2024-04-20T21:35:04.969 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-20T21:35:04.969 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --verbose --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7665444 --name rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi -- /home/teuthworker/archive/rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7665444/orig.config.yaml 2024-04-20T21:35:05.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-20T21:35:05.144 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7665444 branch: wip-rishabh-testing-20240416.193735 description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: null first_in_suite: false job_id: '7665444' kernel: flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/reef ' name: rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240416.193735 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: a8c84f5997950fd7d008204839253291d52e6eda ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a8c84f5997950fd7d008204839253291d52e6eda kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240416.193735 sha1: a8c84f5997950fd7d008204839253291d52e6eda owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 7954 sha1: a8c84f5997950fd7d008204839253291d52e6eda sleep_before_teardown: 0 subset: 364/512 suite: fs suite_branch: wip-rishabh-testing-20240416.193735 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a8c84f5997950fd7d008204839253291d52e6eda targets: smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBmEBIoxIXZ4cAqXa/x1kHPZJAP2smKFPLLhRaXmpRd9RxH14vh29+WjYYCMjP8O8pBVnDNC0lqjtZd3eQNLnUs= smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFzbnjFpY8PUT527bg14rx75k3Cvz58dms2XrL8LHDGy9LfPsu5WcNJeNgpQq+15WK4RWNMjghB+KJeXMvl+Y0g= tasks: - install: branch: reef exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:reef roleless: true - print: '**** done end installing reef cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/rishabh/src/git.ceph.com_ceph-c_wip-rishabh-testing-20240416.193735/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-20_20:50:37 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-04-20T21:35:05.144 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa; will attempt to use it 2024-04-20T21:35:05.145 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks 2024-04-20T21:35:05.145 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-20T21:35:05.147 INFO:teuthology.task.internal:Checking packages... 2024-04-20T21:35:05.170 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a8c84f5997950fd7d008204839253291d52e6eda' 2024-04-20T21:35:05.171 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-20T21:35:05.171 INFO:teuthology.packaging:ref: None 2024-04-20T21:35:05.171 INFO:teuthology.packaging:tag: None 2024-04-20T21:35:05.171 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240416.193735 2024-04-20T21:35:05.171 INFO:teuthology.packaging:sha1: a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:35:05.171 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240416.193735 2024-04-20T21:35:05.474 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3133.ga8c84f59 2024-04-20T21:35:05.475 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-20T21:35:05.482 INFO:teuthology.task.internal:no buildpackages task found 2024-04-20T21:35:05.482 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-20T21:35:05.488 INFO:teuthology.task.internal:Saving configuration 2024-04-20T21:35:05.507 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-20T21:35:05.515 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-20T21:35:05.540 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7665444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-20 21:29:56.346926', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBmEBIoxIXZ4cAqXa/x1kHPZJAP2smKFPLLhRaXmpRd9RxH14vh29+WjYYCMjP8O8pBVnDNC0lqjtZd3eQNLnUs='} 2024-04-20T21:35:05.561 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7665444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-20 21:29:56.345085', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFzbnjFpY8PUT527bg14rx75k3Cvz58dms2XrL8LHDGy9LfPsu5WcNJeNgpQq+15WK4RWNMjghB+KJeXMvl+Y0g='} 2024-04-20T21:35:05.561 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-20T21:35:05.567 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-04-20T21:35:05.567 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-04-20T21:35:05.567 INFO:teuthology.run_tasks:Running task console_log... 2024-04-20T21:35:05.641 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f351f407160>, signals=[15]) 2024-04-20T21:35:05.642 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-20T21:35:05.648 INFO:teuthology.task.internal:Opening connections... 2024-04-20T21:35:05.648 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-04-20T21:35:05.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:35:05.726 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2024-04-20T21:35:05.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:35:05.805 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-20T21:35:05.812 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-04-20T21:35:05.829 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-04-20T21:35:05.830 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-04-20T21:35:05.886 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-04-20T21:35:05.887 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-04-20T21:35:05.887 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-04-20T21:35:05.887 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-04-20T21:35:05.887 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-04-20T21:35:05.887 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-04-20T21:35:05.887 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-20T21:35:05.887 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-04-20T21:35:05.887 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-04-20T21:35:05.887 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-20T21:35:05.887 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-04-20T21:35:05.887 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-20T21:35:05.887 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-20T21:35:05.887 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-20T21:35:05.888 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-04-20T21:35:05.910 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-04-20T21:35:05.928 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-04-20T21:35:05.928 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-04-20T21:35:05.985 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2024-04-20T21:35:05.985 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9" 2024-04-20T21:35:05.985 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2024-04-20T21:35:05.985 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2024-04-20T21:35:05.985 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9" 2024-04-20T21:35:05.986 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9" 2024-04-20T21:35:05.986 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-20T21:35:05.986 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-04-20T21:35:05.986 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon" 2024-04-20T21:35:05.986 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-20T21:35:05.986 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2024-04-20T21:35:05.986 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-20T21:35:05.986 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-20T21:35:05.986 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-20T21:35:05.987 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-04-20T21:35:06.019 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-20T21:35:06.033 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-20T21:35:06.041 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-20T21:35:06.041 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-04-20T21:35:06.044 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2024-04-20T21:35:06.060 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-20T21:35:06.069 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-20T21:35:06.069 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-04-20T21:35:06.100 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2024-04-20T21:35:06.198 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-20T21:35:06.251 INFO:teuthology.run_tasks:Running task kernel... 2024-04-20T21:35:06.265 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-20T21:35:06.265 INFO:teuthology.task.kernel:config {'host.a': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'host.b': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, timeout 300 2024-04-20T21:35:06.265 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-20T21:35:06.266 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-20T21:35:06.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T21:35:06.282 DEBUG:teuthology.task.kernel:sha1 for host.a is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-20T21:35:06.282 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-20T21:35:06.282 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-04-20T21:35:06.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T21:35:06.283 DEBUG:teuthology.task.kernel:sha1 for host.b is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-20T21:35:06.284 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-20T21:35:06.284 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-04-20T21:35:06.338 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-437.el9.x86_64 2024-04-20T21:35:06.339 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-20T21:35:06.339 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-20T21:35:06.339 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-20T21:35:06.343 INFO:teuthology.orchestra.run.smithi164.stdout:5.14.0-437.el9.x86_64 2024-04-20T21:35:06.343 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-20T21:35:06.343 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-20T21:35:06.343 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-20T21:35:06.562 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum upgrade -y linux-firmware 2024-04-20T21:35:06.574 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum upgrade -y linux-firmware 2024-04-20T21:35:09.423 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 6.1 MB/s | 8.0 MB 00:01 2024-04-20T21:35:09.608 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.0 MB 00:01 2024-04-20T21:35:11.442 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-04-20T21:35:11.573 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-04-20T21:35:15.923 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-20T21:35:16.943 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.2 MB 00:01 2024-04-20T21:35:17.282 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 16 kB 00:00 2024-04-20T21:35:18.503 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 16 kB 00:00 2024-04-20T21:35:18.728 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-20T21:35:22.353 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 5.6 MB/s | 21 MB 00:03 2024-04-20T21:35:23.758 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-04-20T21:35:25.719 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:35:25.720 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-20T21:35:25.720 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:35:25.823 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on host.b... 2024-04-20T21:35:25.823 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-20T21:35:25.965 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-20T21:35:25.966 DEBUG:teuthology.orchestra.run.smithi164:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-20T21:35:25.968 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi164.front.sepia.ceph.com to complete... 2024-04-20T21:35:27.369 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-20T21:35:29.473 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:35:29.474 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-20T21:35:29.474 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:35:29.590 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on host.a... 2024-04-20T21:35:29.590 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-20T21:35:29.810 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-04-20T21:35:29.810 DEBUG:teuthology.orchestra.run.smithi142:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-20T21:35:29.812 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi142.front.sepia.ceph.com to complete... 2024-04-20T21:36:03.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20 21:36:03 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-20T21:36:03.670 INFO:teuthology.orchestra.run.smithi142.stderr:FINISHED --2024-04-20 21:36:03-- 2024-04-20T21:36:03.670 INFO:teuthology.orchestra.run.smithi142.stderr:Total wall clock time: 34s 2024-04-20T21:36:03.670 INFO:teuthology.orchestra.run.smithi142.stderr:Downloaded: 1 files, 341M in 33s (10.2 MB/s) 2024-04-20T21:36:03.706 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on host.a... 2024-04-20T21:36:03.706 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-20T21:36:06.606 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying... ######################################## 2024-04-20T21:36:06.770 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing... ######################################## 2024-04-20T21:36:06.886 INFO:teuthology.orchestra.run.smithi142.stdout:Updating / installing... 2024-04-20T21:36:14.868 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-20T21:36:24.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20 21:36:24 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-20T21:36:24.338 INFO:teuthology.orchestra.run.smithi164.stderr:FINISHED --2024-04-20 21:36:24-- 2024-04-20T21:36:24.338 INFO:teuthology.orchestra.run.smithi164.stderr:Total wall clock time: 58s 2024-04-20T21:36:24.338 INFO:teuthology.orchestra.run.smithi164.stderr:Downloaded: 1 files, 341M in 58s (5.90 MB/s) 2024-04-20T21:36:24.340 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on host.b... 2024-04-20T21:36:24.341 DEBUG:teuthology.orchestra.run.smithi164:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-20T21:36:26.667 INFO:teuthology.orchestra.run.smithi164.stdout:Verifying... ######################################## 2024-04-20T21:36:26.861 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing... ######################################## 2024-04-20T21:36:26.999 INFO:teuthology.orchestra.run.smithi164.stdout:Updating / installing... 2024-04-20T21:36:34.946 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-04-20T21:36:51.768 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-20T21:36:51.769 DEBUG:teuthology.orchestra.run.smithi142:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-20T21:36:51.839 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-20T21:36:51.840 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-20T21:36:51.840 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-20T21:36:51.840 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-20T21:36:51.840 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-20T21:36:51.840 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-20T21:36:51.840 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-20T21:36:51.840 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-20T21:36:51.840 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-20T21:36:51.840 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-20T21:36:51.840 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-20T21:36:51.840 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-20T21:36:51.840 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-20T21:36:51.840 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-20T21:36:51.840 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-20T21:36:51.841 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-20T21:36:51.841 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-20T21:36:51.841 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-20T21:36:51.841 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-20T21:36:51.841 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-20T21:36:51.841 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-20T21:36:51.841 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-20T21:36:51.841 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-20T21:36:51.841 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-20T21:36:51.841 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-20T21:36:51.841 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-20T21:36:51.841 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-20T21:36:51.841 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-20T21:36:51.841 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-20T21:36:51.841 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-20T21:36:51.842 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-20T21:36:51.842 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-20T21:36:51.842 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-20T21:36:51.842 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-20T21:36:51.842 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-20T21:36:51.842 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-20T21:36:51.842 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-20T21:36:51.842 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-20T21:36:51.842 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-20T21:36:51.842 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-20T21:36:51.842 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-20T21:36:51.842 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-20T21:36:51.842 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-20T21:36:51.842 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-20T21:36:51.842 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-20T21:36:51.843 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-20T21:36:51.843 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-20T21:36:51.843 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-20T21:36:51.843 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-20T21:36:51.843 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-20T21:36:51.843 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-20T21:36:51.843 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-20T21:36:51.843 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-20T21:36:51.843 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-20T21:36:51.843 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-20T21:36:51.843 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-20T21:36:51.843 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-20T21:36:51.843 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-20T21:36:51.843 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-20T21:36:51.843 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-20T21:36:51.844 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-20T21:36:51.844 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-20T21:36:51.844 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-20T21:36:51.844 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-20T21:36:51.844 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-20T21:36:51.844 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-20T21:36:51.844 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-20T21:36:51.844 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-20T21:36:51.844 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-20T21:36:51.844 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-20T21:36:51.844 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-20T21:36:51.844 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-20T21:36:51.844 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-20T21:36:51.844 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-20T21:36:51.844 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-20T21:36:51.844 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-20T21:36:51.845 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-20T21:36:51.845 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-20T21:36:51.845 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-20T21:36:51.845 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-20T21:36:51.845 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-20T21:36:51.845 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-20T21:36:51.845 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-20T21:36:51.845 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-20T21:36:51.845 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-20T21:36:51.845 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-20T21:36:51.845 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-20T21:36:51.845 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-20T21:36:51.845 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-20T21:36:51.845 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-20T21:36:51.845 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-20T21:36:51.845 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-20T21:36:51.846 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-20T21:36:51.846 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-20T21:36:51.846 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-20T21:36:51.846 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-20T21:36:51.846 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-20T21:36:51.846 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-20T21:36:51.846 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-20T21:36:51.846 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-20T21:36:51.846 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-20T21:36:51.846 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-20T21:36:51.846 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-20T21:36:51.846 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-20T21:36:51.846 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-20T21:36:51.846 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-20T21:36:51.846 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-20T21:36:51.846 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-20T21:36:51.847 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-20T21:36:51.847 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-20T21:36:51.847 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-20T21:36:51.847 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-20T21:36:51.847 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-20T21:36:51.847 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-20T21:36:51.847 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-20T21:36:51.847 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-20T21:36:51.847 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-20T21:36:51.847 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-20T21:36:51.847 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-20T21:36:51.847 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-20T21:36:51.847 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-20T21:36:51.847 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-20T21:36:51.847 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-20T21:36:51.847 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-20T21:36:51.848 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-20T21:36:51.848 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-20T21:36:51.848 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-20T21:36:51.848 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-20T21:36:51.848 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-20T21:36:51.848 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-20T21:36:51.848 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-20T21:36:51.848 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-20T21:36:51.848 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-20T21:36:51.848 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-20T21:36:51.848 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-20T21:36:51.848 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-20T21:36:51.848 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-20T21:36:51.848 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-20T21:36:51.848 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-20T21:36:51.849 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-20T21:36:51.849 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-20T21:36:51.849 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-20T21:36:51.849 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-20T21:36:51.849 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-20T21:36:51.849 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-20T21:36:51.849 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-20T21:36:51.849 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-20T21:36:51.849 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-20T21:36:51.849 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-20T21:36:51.849 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-20T21:36:51.849 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-20T21:36:51.849 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-20T21:36:51.849 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-20T21:36:51.849 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-20T21:36:51.849 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-20T21:36:51.849 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-20T21:36:51.850 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-20T21:36:51.850 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-20T21:36:51.850 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-20T21:36:51.850 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-20T21:36:51.850 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-20T21:36:51.850 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-20T21:36:51.850 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-20T21:36:51.850 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-20T21:36:51.850 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-20T21:36:51.850 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-20T21:36:51.850 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-20T21:36:51.850 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-20T21:36:51.850 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-20T21:36:51.850 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-20T21:36:51.851 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-20T21:36:51.851 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-20T21:36:51.851 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-20T21:36:51.851 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-20T21:36:51.851 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-20T21:36:51.851 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-20T21:36:51.851 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-20T21:36:51.851 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-20T21:36:51.851 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-20T21:36:51.851 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-20T21:36:51.851 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-20T21:36:51.851 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-20T21:36:51.851 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-20T21:36:51.851 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-20T21:36:51.851 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-20T21:36:51.852 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-20T21:36:51.852 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-20T21:36:51.852 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-20T21:36:51.852 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-20T21:36:51.852 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-20T21:36:51.852 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-20T21:36:51.852 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-20T21:36:51.852 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-20T21:36:51.852 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-20T21:36:51.852 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-20T21:36:51.852 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-20T21:36:51.852 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-20T21:36:51.852 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-20T21:36:51.852 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-20T21:36:51.852 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-20T21:36:51.852 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-20T21:36:51.853 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-20T21:36:51.853 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-20T21:36:51.853 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-20T21:36:51.853 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-20T21:36:51.853 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-20T21:36:51.853 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-20T21:36:51.853 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-20T21:36:51.853 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-20T21:36:51.853 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-20T21:36:51.853 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-20T21:36:51.853 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-20T21:36:51.853 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-20T21:36:51.853 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-20T21:36:51.853 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-20T21:36:51.853 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-20T21:36:51.853 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-20T21:36:51.854 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-20T21:36:51.854 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-20T21:36:51.854 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-20T21:36:51.854 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-20T21:36:51.854 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-20T21:36:51.854 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-20T21:36:51.854 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-20T21:36:51.854 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-20T21:36:51.854 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-20T21:36:51.854 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-20T21:36:51.854 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-20T21:36:51.854 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-20T21:36:51.854 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-20T21:36:51.854 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-20T21:36:51.854 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-20T21:36:51.854 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-20T21:36:51.855 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-20T21:36:51.855 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-20T21:36:51.855 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-20T21:36:51.855 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-20T21:36:51.855 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-20T21:36:51.855 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-20T21:36:51.855 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-20T21:36:51.855 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-20T21:36:51.855 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-20T21:36:51.855 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-20T21:36:51.855 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-20T21:36:51.855 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-20T21:36:51.855 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-20T21:36:51.856 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-20T21:36:51.856 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-20T21:36:51.856 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-20T21:36:51.856 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-20T21:36:51.856 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-20T21:36:51.856 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-20T21:36:51.856 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-20T21:36:51.856 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-20T21:36:51.856 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-20T21:36:51.856 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-20T21:36:51.856 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-20T21:36:51.856 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-20T21:36:51.856 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-20T21:36:51.856 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-20T21:36:51.856 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-20T21:36:51.856 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-20T21:36:51.857 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-20T21:36:51.857 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-20T21:36:51.857 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-20T21:36:51.857 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-20T21:36:51.857 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-20T21:36:51.857 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-20T21:36:51.857 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-20T21:36:51.857 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-20T21:36:51.857 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-20T21:36:51.857 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-20T21:36:51.857 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-20T21:36:51.857 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-20T21:36:51.857 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-20T21:36:51.857 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-20T21:36:51.857 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-20T21:36:51.858 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-20T21:36:51.858 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-20T21:36:51.858 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-20T21:36:51.858 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-20T21:36:51.858 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-20T21:36:51.858 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-20T21:36:51.858 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-20T21:36:51.858 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-20T21:36:51.858 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-20T21:36:51.858 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-20T21:36:51.858 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-20T21:36:51.858 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-20T21:36:51.858 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-20T21:36:51.859 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-20T21:36:51.859 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-20T21:36:51.859 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-20T21:36:51.859 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-20T21:36:51.859 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-20T21:36:51.859 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-20T21:36:51.859 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-20T21:36:51.859 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-20T21:36:51.859 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-20T21:36:51.859 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-20T21:36:51.859 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-20T21:36:51.859 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-20T21:36:51.860 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-20T21:36:51.860 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-20T21:36:51.860 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-20T21:36:51.860 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-20T21:36:51.860 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-20T21:36:51.860 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-20T21:36:51.860 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-20T21:36:51.860 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-20T21:36:51.860 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-20T21:36:51.860 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-20T21:36:51.860 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-20T21:36:51.860 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-20T21:36:51.860 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-20T21:36:51.860 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-20T21:36:51.861 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-20T21:36:51.861 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-20T21:36:51.861 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-20T21:36:51.861 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-20T21:36:51.861 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-20T21:36:51.861 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-20T21:36:51.861 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-20T21:36:51.861 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-20T21:36:51.861 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-20T21:36:51.861 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-20T21:36:51.861 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-20T21:36:51.861 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-20T21:36:51.861 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-20T21:36:51.861 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-20T21:36:51.861 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-20T21:36:51.862 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-20T21:36:51.862 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-20T21:36:51.862 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-20T21:36:51.862 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-20T21:36:51.862 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-20T21:36:51.862 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-20T21:36:51.862 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-20T21:36:51.862 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-20T21:36:51.862 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-20T21:36:51.862 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-20T21:36:51.862 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-20T21:36:51.862 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-20T21:36:51.862 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-20T21:36:51.862 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-20T21:36:51.863 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-20T21:36:51.863 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-20T21:36:51.863 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-20T21:36:51.863 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-20T21:36:51.863 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-20T21:36:51.863 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-20T21:36:51.863 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-20T21:36:51.863 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-20T21:36:51.863 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-20T21:36:51.863 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-20T21:36:51.863 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-20T21:36:51.863 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-20T21:36:51.863 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-20T21:36:51.864 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-20T21:36:51.864 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-20T21:36:51.864 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-20T21:36:51.864 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-20T21:36:51.864 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-20T21:36:51.864 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-20T21:36:51.864 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-20T21:36:51.864 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-20T21:36:51.864 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-20T21:36:51.864 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-20T21:36:51.864 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-20T21:36:51.864 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-20T21:36:51.864 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-20T21:36:51.864 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-20T21:36:51.864 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-20T21:36:51.865 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-20T21:36:51.865 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-20T21:36:51.865 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-20T21:36:51.865 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-20T21:36:51.865 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-20T21:36:51.865 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-20T21:36:51.865 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-20T21:36:51.865 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-20T21:36:51.865 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-20T21:36:51.865 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-20T21:36:51.865 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-20T21:36:51.865 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-20T21:36:51.865 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-20T21:36:51.865 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-20T21:36:51.865 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-20T21:36:51.866 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-20T21:36:51.866 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-20T21:36:51.866 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-20T21:36:51.866 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-20T21:36:51.866 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-20T21:36:51.866 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-20T21:36:51.866 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-20T21:36:51.866 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-20T21:36:51.866 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-20T21:36:51.866 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-20T21:36:51.866 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-20T21:36:51.866 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-20T21:36:51.866 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-20T21:36:51.867 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-20T21:36:51.867 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-20T21:36:51.867 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-20T21:36:51.867 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-20T21:36:51.867 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-20T21:36:51.867 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-20T21:36:51.867 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-20T21:36:51.867 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-20T21:36:51.867 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-20T21:36:51.867 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-20T21:36:51.867 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-20T21:36:51.867 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-20T21:36:51.867 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-20T21:36:51.867 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-20T21:36:51.868 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-20T21:36:51.868 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-20T21:36:51.868 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-20T21:36:51.868 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-20T21:36:51.868 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-20T21:36:51.868 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-20T21:36:51.868 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-20T21:36:51.868 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-20T21:36:51.868 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-20T21:36:51.868 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-20T21:36:51.868 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-20T21:36:51.868 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-20T21:36:51.868 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-20T21:36:51.868 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-20T21:36:51.869 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-20T21:36:51.869 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-20T21:36:51.869 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-20T21:36:51.869 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-20T21:36:51.869 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-20T21:36:51.869 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-20T21:36:51.869 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-20T21:36:51.869 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-20T21:36:51.869 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-20T21:36:51.869 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-20T21:36:51.869 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-20T21:36:51.869 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-20T21:36:51.869 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-20T21:36:51.869 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-20T21:36:51.869 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-20T21:36:51.870 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-20T21:36:51.870 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-20T21:36:51.870 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-20T21:36:51.870 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-20T21:36:51.870 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-20T21:36:51.870 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-20T21:36:51.870 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-20T21:36:51.870 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-20T21:36:51.870 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-20T21:36:51.870 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-20T21:36:51.870 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-20T21:36:51.870 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-20T21:36:51.870 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-20T21:36:51.870 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-20T21:36:51.870 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-20T21:36:51.871 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-20T21:36:51.871 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-20T21:36:51.871 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-20T21:36:51.871 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-20T21:36:51.871 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-20T21:36:51.871 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-20T21:36:51.871 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-20T21:36:51.871 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-20T21:36:51.871 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-20T21:36:51.871 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-20T21:36:51.871 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-20T21:36:51.871 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-20T21:36:51.871 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-20T21:36:51.871 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-20T21:36:51.872 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-20T21:36:51.872 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-20T21:36:51.872 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-20T21:36:51.872 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-20T21:36:51.872 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-20T21:36:51.872 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-20T21:36:51.872 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-20T21:36:51.872 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-20T21:36:51.872 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-20T21:36:51.872 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-20T21:36:51.872 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-20T21:36:51.872 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-20T21:36:51.872 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-20T21:36:51.873 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-20T21:36:51.873 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-20T21:36:51.873 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-20T21:36:51.873 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-20T21:36:51.873 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-20T21:36:51.873 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-20T21:36:51.873 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-20T21:36:51.873 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-20T21:36:51.873 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-20T21:36:51.873 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-20T21:36:51.873 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-20T21:36:51.873 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-20T21:36:51.873 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-20T21:36:51.873 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-20T21:36:51.873 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-20T21:36:51.874 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-20T21:36:51.874 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-20T21:36:51.874 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-20T21:36:51.874 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-20T21:36:51.874 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-20T21:36:51.874 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-20T21:36:51.874 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-20T21:36:51.874 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-20T21:36:51.874 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-20T21:36:51.874 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-20T21:36:51.874 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-20T21:36:51.874 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-20T21:36:51.874 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-20T21:36:51.874 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-20T21:36:51.875 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-20T21:36:51.875 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-20T21:36:51.875 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-20T21:36:51.875 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-20T21:36:51.875 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-20T21:36:51.875 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-20T21:36:51.875 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-20T21:36:51.875 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-20T21:36:51.875 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-20T21:36:51.875 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-20T21:36:51.875 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-20T21:36:51.875 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-20T21:36:51.875 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-20T21:36:51.875 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-20T21:36:51.875 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-20T21:36:51.876 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-20T21:36:51.876 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-20T21:36:51.876 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-20T21:36:51.876 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-20T21:36:51.876 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-20T21:36:51.876 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-20T21:36:51.876 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-20T21:36:51.876 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-20T21:36:51.876 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-20T21:36:51.876 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-20T21:36:51.876 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-20T21:36:51.876 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-20T21:36:51.876 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-20T21:36:51.876 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-20T21:36:51.877 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-20T21:36:51.877 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-20T21:36:51.877 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-20T21:36:51.877 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-20T21:36:51.877 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-20T21:36:51.877 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-20T21:36:51.877 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-20T21:36:51.877 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-20T21:36:51.877 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-20T21:36:51.877 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-20T21:36:51.877 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-20T21:36:51.877 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-20T21:36:51.877 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-20T21:36:51.877 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-20T21:36:51.878 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-20T21:36:51.878 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-20T21:36:51.878 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-20T21:36:51.878 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-20T21:36:51.878 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-20T21:36:51.878 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-20T21:36:51.878 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-20T21:36:51.878 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-20T21:36:51.878 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-20T21:36:51.878 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-20T21:36:51.878 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-20T21:36:51.878 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-20T21:36:51.879 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-20T21:36:51.879 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-20T21:36:51.879 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-20T21:36:51.879 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-20T21:36:51.879 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-20T21:36:51.879 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-20T21:36:51.879 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-20T21:36:51.879 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-20T21:36:51.879 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-20T21:36:51.879 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-20T21:36:51.879 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-20T21:36:51.879 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-20T21:36:51.879 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-20T21:36:51.880 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-20T21:36:51.880 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-20T21:36:51.880 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-20T21:36:51.880 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-20T21:36:51.880 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-20T21:36:51.880 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-20T21:36:51.880 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-20T21:36:51.880 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-20T21:36:51.880 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-20T21:36:51.880 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-20T21:36:51.880 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-20T21:36:51.880 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-20T21:36:51.880 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-20T21:36:51.880 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-20T21:36:51.880 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-20T21:36:51.881 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-20T21:36:51.881 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-20T21:36:51.881 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-20T21:36:51.881 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-20T21:36:51.881 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-20T21:36:51.881 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-20T21:36:51.881 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-20T21:36:51.881 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-20T21:36:51.881 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-20T21:36:51.881 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-20T21:36:51.881 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-20T21:36:51.881 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-20T21:36:51.881 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-20T21:36:51.882 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-20T21:36:51.882 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-20T21:36:51.882 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-20T21:36:51.882 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-20T21:36:51.882 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-20T21:36:51.882 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-20T21:36:51.882 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-20T21:36:51.882 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-20T21:36:51.882 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-20T21:36:51.882 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-20T21:36:51.883 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-20T21:36:51.883 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-20T21:36:51.883 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-20T21:36:51.883 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-20T21:36:51.883 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-20T21:36:51.883 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-20T21:36:51.883 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-20T21:36:51.883 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-20T21:36:51.883 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-20T21:36:51.883 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-20T21:36:51.883 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-20T21:36:51.883 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-20T21:36:51.883 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-20T21:36:51.883 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-20T21:36:51.884 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-20T21:36:51.884 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-20T21:36:51.884 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-20T21:36:51.884 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-20T21:36:51.884 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-20T21:36:51.884 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-20T21:36:51.884 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-20T21:36:51.884 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-20T21:36:51.884 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-20T21:36:51.884 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-20T21:36:51.884 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-20T21:36:51.884 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-20T21:36:51.884 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-20T21:36:51.884 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-20T21:36:51.884 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-20T21:36:51.884 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-20T21:36:51.884 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-20T21:36:51.885 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-20T21:36:51.885 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-20T21:36:51.885 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-20T21:36:51.885 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-20T21:36:51.885 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-20T21:36:51.885 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-20T21:36:51.885 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-20T21:36:51.885 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-20T21:36:51.885 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-20T21:36:51.885 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-20T21:36:51.885 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-20T21:36:51.885 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-20T21:36:51.885 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-20T21:36:51.885 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-20T21:36:51.885 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-20T21:36:51.886 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-20T21:36:51.886 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-20T21:36:51.886 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-20T21:36:51.886 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-20T21:36:51.886 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-20T21:36:51.886 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-20T21:36:51.886 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-20T21:36:51.886 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-20T21:36:51.886 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-20T21:36:51.886 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-20T21:36:51.886 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-20T21:36:51.886 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-20T21:36:51.886 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-20T21:36:51.886 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-20T21:36:51.886 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-20T21:36:51.887 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-20T21:36:51.887 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-20T21:36:51.887 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-20T21:36:51.887 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-20T21:36:51.887 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-20T21:36:51.887 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-20T21:36:51.887 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-20T21:36:51.887 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-20T21:36:51.887 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-20T21:36:51.887 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-20T21:36:51.887 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-20T21:36:51.887 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-20T21:36:51.887 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-20T21:36:51.887 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-20T21:36:51.887 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-20T21:36:51.887 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-20T21:36:51.888 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-20T21:36:51.888 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-20T21:36:51.888 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-20T21:36:51.888 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-20T21:36:51.888 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-20T21:36:51.888 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-20T21:36:51.888 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-20T21:36:51.888 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-20T21:36:51.888 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-20T21:36:51.888 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-20T21:36:51.888 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-20T21:36:51.888 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-20T21:36:51.888 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-20T21:36:51.888 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-20T21:36:51.889 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-20T21:36:51.889 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-20T21:36:51.889 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-20T21:36:51.889 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-20T21:36:51.889 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-20T21:36:51.889 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-20T21:36:51.889 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-20T21:36:51.889 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-20T21:36:51.889 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-20T21:36:51.889 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-20T21:36:51.889 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-20T21:36:51.889 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-20T21:36:51.889 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-20T21:36:51.889 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-20T21:36:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-20T21:36:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-20T21:36:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-20T21:36:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-20T21:36:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-20T21:36:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-20T21:36:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-20T21:36:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-20T21:36:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-20T21:36:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-20T21:36:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-20T21:36:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-20T21:36:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-20T21:36:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-20T21:36:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-20T21:36:51.890 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-20T21:36:51.891 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-20T21:36:51.891 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-20T21:36:51.891 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-20T21:36:51.891 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-20T21:36:51.891 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-20T21:36:51.891 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-20T21:36:51.891 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-20T21:36:51.891 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-20T21:36:51.891 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-20T21:36:51.891 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-20T21:36:51.891 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-20T21:36:51.891 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-20T21:36:51.891 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-20T21:36:51.892 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-20T21:36:51.892 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-20T21:36:51.892 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-20T21:36:51.892 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-20T21:36:51.892 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-20T21:36:51.892 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-20T21:36:51.892 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-20T21:36:51.892 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-20T21:36:51.892 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-20T21:36:51.892 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-20T21:36:51.892 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-20T21:36:51.892 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-20T21:36:51.892 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-20T21:36:51.892 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-20T21:36:51.892 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-20T21:36:51.893 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-20T21:36:51.893 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-20T21:36:51.893 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-20T21:36:51.893 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-20T21:36:51.893 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-20T21:36:51.893 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-20T21:36:51.893 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-20T21:36:51.893 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-20T21:36:51.893 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-20T21:36:51.893 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-20T21:36:51.893 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-20T21:36:51.893 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-20T21:36:51.893 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-20T21:36:51.893 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-20T21:36:51.893 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-20T21:36:51.893 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-20T21:36:51.894 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-20T21:36:51.894 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-20T21:36:51.894 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-20T21:36:51.894 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-20T21:36:51.894 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-20T21:36:51.894 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-20T21:36:51.894 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-20T21:36:51.894 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-20T21:36:51.894 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-20T21:36:51.894 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-20T21:36:51.894 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-20T21:36:51.894 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-20T21:36:51.894 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-20T21:36:51.894 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-20T21:36:51.895 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-20T21:36:51.895 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-20T21:36:51.895 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-20T21:36:51.895 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-20T21:36:51.895 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-20T21:36:51.895 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-20T21:36:51.895 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-20T21:36:51.895 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-20T21:36:51.895 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-20T21:36:51.895 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-20T21:36:51.895 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-20T21:36:51.895 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-20T21:36:51.895 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-20T21:36:51.895 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-20T21:36:51.895 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-20T21:36:51.896 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-20T21:36:51.896 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-20T21:36:51.896 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-20T21:36:51.896 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-20T21:36:51.896 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-20T21:36:51.896 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-20T21:36:51.896 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-20T21:36:51.896 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-20T21:36:51.896 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-20T21:36:51.896 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-20T21:36:51.896 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-20T21:36:51.896 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-20T21:36:51.896 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-20T21:36:51.896 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-20T21:36:51.896 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-20T21:36:51.896 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-20T21:36:51.897 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-20T21:36:51.897 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-20T21:36:51.897 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-20T21:36:51.897 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-20T21:36:51.897 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-20T21:36:51.897 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-20T21:36:51.897 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-20T21:36:51.897 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-20T21:36:51.897 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-20T21:36:51.897 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-20T21:36:51.897 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-20T21:36:51.897 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-20T21:36:51.897 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-20T21:36:51.897 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-20T21:36:51.897 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-20T21:36:51.897 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-20T21:36:51.898 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-20T21:36:51.898 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-20T21:36:51.898 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-20T21:36:51.898 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-20T21:36:51.898 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-20T21:36:51.898 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-20T21:36:51.898 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-20T21:36:51.898 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-20T21:36:51.898 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-20T21:36:51.898 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-20T21:36:51.898 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-20T21:36:51.898 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-20T21:36:51.898 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-20T21:36:51.898 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-20T21:36:51.898 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-20T21:36:51.899 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-20T21:36:51.899 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-20T21:36:51.899 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-20T21:36:51.899 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-20T21:36:51.899 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-20T21:36:51.899 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-20T21:36:51.899 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-20T21:36:51.899 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-20T21:36:51.899 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-20T21:36:51.899 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-20T21:36:51.899 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-20T21:36:51.899 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-20T21:36:51.899 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-20T21:36:51.899 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-20T21:36:51.899 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-20T21:36:51.900 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-20T21:36:51.900 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-20T21:36:51.900 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-20T21:36:51.900 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-20T21:36:51.900 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-20T21:36:51.900 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-20T21:36:51.900 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-20T21:36:51.900 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-20T21:36:51.900 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-20T21:36:51.900 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-20T21:36:51.900 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-20T21:36:51.900 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-20T21:36:51.900 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-20T21:36:51.900 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-20T21:36:51.900 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-20T21:36:51.900 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-20T21:36:51.901 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-20T21:36:51.901 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-20T21:36:51.901 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-20T21:36:51.901 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-20T21:36:51.901 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-20T21:36:51.901 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-20T21:36:51.901 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-20T21:36:51.901 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-20T21:36:51.901 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-20T21:36:51.901 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-20T21:36:51.901 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-20T21:36:51.901 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-20T21:36:51.901 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-20T21:36:51.901 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-20T21:36:51.901 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-20T21:36:51.902 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-20T21:36:51.902 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-20T21:36:51.902 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-20T21:36:51.902 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-20T21:36:51.902 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-20T21:36:51.902 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-20T21:36:51.902 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-20T21:36:51.902 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-20T21:36:51.902 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-20T21:36:51.902 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-20T21:36:51.902 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-20T21:36:51.902 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-20T21:36:51.902 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-20T21:36:51.903 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-20T21:36:51.903 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-20T21:36:51.903 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-20T21:36:51.903 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-20T21:36:51.903 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-20T21:36:51.903 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-20T21:36:51.903 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-20T21:36:51.903 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-20T21:36:51.903 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-20T21:36:51.903 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-20T21:36:51.903 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-20T21:36:51.903 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-20T21:36:51.903 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-20T21:36:51.903 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-20T21:36:51.903 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-20T21:36:51.904 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-20T21:36:51.904 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-20T21:36:51.904 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-20T21:36:51.904 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-20T21:36:51.904 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-20T21:36:51.904 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-20T21:36:51.904 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-20T21:36:51.904 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-20T21:36:51.904 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-20T21:36:51.904 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-20T21:36:51.904 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-20T21:36:51.904 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-20T21:36:51.904 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-20T21:36:51.904 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-20T21:36:51.904 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-20T21:36:51.905 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-20T21:36:51.905 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-20T21:36:51.905 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-20T21:36:51.905 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-20T21:36:51.905 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-20T21:36:51.905 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-20T21:36:51.905 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-20T21:36:51.905 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-20T21:36:51.905 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-20T21:36:51.905 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-20T21:36:51.905 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-20T21:36:51.905 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-20T21:36:51.905 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-20T21:36:51.905 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-20T21:36:51.906 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-20T21:36:51.906 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-20T21:36:51.906 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-20T21:36:51.906 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-20T21:36:51.906 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-20T21:36:51.906 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-20T21:36:51.906 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-20T21:36:51.906 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-20T21:36:51.906 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-20T21:36:51.906 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-20T21:36:51.906 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-20T21:36:51.906 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-20T21:36:51.906 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-20T21:36:51.906 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-20T21:36:51.907 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-20T21:36:51.907 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-20T21:36:51.907 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-20T21:36:51.907 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-20T21:36:51.907 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-20T21:36:51.907 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-20T21:36:51.907 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-20T21:36:51.907 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-20T21:36:51.907 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-20T21:36:51.907 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-20T21:36:51.907 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-20T21:36:51.907 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-20T21:36:51.907 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-20T21:36:51.907 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-20T21:36:51.907 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-20T21:36:51.908 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-20T21:36:51.908 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-20T21:36:51.908 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-20T21:36:51.908 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-20T21:36:51.908 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-20T21:36:51.908 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-20T21:36:51.908 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-20T21:36:51.908 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-20T21:36:51.908 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-20T21:36:51.908 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-20T21:36:51.908 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-20T21:36:51.908 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-20T21:36:51.908 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-20T21:36:51.908 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-20T21:36:51.909 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-20T21:36:51.909 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-20T21:36:51.909 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-20T21:36:51.909 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-20T21:36:51.909 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-20T21:36:51.909 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-20T21:36:51.909 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-20T21:36:51.909 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-20T21:36:51.909 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-20T21:36:51.909 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-20T21:36:51.909 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-20T21:36:51.909 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-20T21:36:51.909 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-20T21:36:51.909 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-20T21:36:51.909 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-20T21:36:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-20T21:36:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-20T21:36:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-20T21:36:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-20T21:36:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-20T21:36:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-20T21:36:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-20T21:36:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-20T21:36:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-20T21:36:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-20T21:36:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-20T21:36:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-20T21:36:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-20T21:36:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-20T21:36:51.911 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-20T21:36:51.911 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-20T21:36:51.911 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-20T21:36:51.911 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-20T21:36:51.911 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-20T21:36:51.911 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-20T21:36:51.911 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-20T21:36:51.911 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-20T21:36:51.911 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-20T21:36:51.911 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-20T21:36:51.911 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-20T21:36:51.911 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-20T21:36:51.911 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-20T21:36:51.911 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-20T21:36:51.912 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-20T21:36:51.912 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-20T21:36:51.912 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-20T21:36:51.912 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-20T21:36:51.912 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-20T21:36:51.912 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-20T21:36:51.912 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-20T21:36:51.912 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-20T21:36:51.912 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-20T21:36:51.912 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-20T21:36:51.912 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-20T21:36:51.912 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-20T21:36:51.912 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-20T21:36:51.912 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-20T21:36:51.913 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-20T21:36:51.913 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-20T21:36:51.913 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-20T21:36:51.913 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-20T21:36:51.913 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-20T21:36:51.913 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-20T21:36:51.913 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-20T21:36:51.913 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-20T21:36:51.913 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-20T21:36:51.913 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-20T21:36:51.913 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-20T21:36:51.913 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-20T21:36:51.913 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-20T21:36:51.913 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-20T21:36:51.914 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-20T21:36:51.914 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-20T21:36:51.914 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-20T21:36:51.914 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-20T21:36:51.914 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-20T21:36:51.914 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-20T21:36:51.914 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-20T21:36:51.914 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-20T21:36:51.914 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-20T21:36:51.914 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-20T21:36:51.914 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-20T21:36:51.914 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-20T21:36:51.914 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-20T21:36:51.914 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-20T21:36:51.915 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-20T21:36:51.915 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-20T21:36:51.915 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-20T21:36:51.915 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-20T21:36:51.915 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-20T21:36:51.915 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-20T21:36:51.915 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-20T21:36:51.915 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-20T21:36:51.915 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-20T21:36:51.915 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-20T21:36:51.915 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-20T21:36:51.915 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-20T21:36:51.915 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-20T21:36:51.916 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-20T21:36:51.916 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-20T21:36:51.916 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-20T21:36:51.916 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-20T21:36:51.916 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-20T21:36:51.916 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-20T21:36:51.916 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-20T21:36:51.916 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-20T21:36:51.916 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-20T21:36:51.916 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-20T21:36:51.916 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-20T21:36:51.916 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-20T21:36:51.916 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-20T21:36:51.916 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-20T21:36:51.916 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-20T21:36:51.917 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-20T21:36:51.917 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-20T21:36:51.917 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-20T21:36:51.917 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-20T21:36:51.917 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-20T21:36:51.917 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-20T21:36:51.917 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-20T21:36:51.917 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-20T21:36:51.917 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-20T21:36:51.917 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-20T21:36:51.917 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-20T21:36:51.917 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-20T21:36:51.917 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-20T21:36:51.918 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-20T21:36:51.918 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-20T21:36:51.918 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-20T21:36:51.918 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-20T21:36:51.918 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-20T21:36:51.918 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-20T21:36:51.918 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-20T21:36:51.918 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-20T21:36:51.918 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-20T21:36:51.918 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-20T21:36:51.918 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-20T21:36:51.918 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-20T21:36:51.918 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-20T21:36:51.918 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-20T21:36:51.918 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-20T21:36:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-20T21:36:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-20T21:36:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-20T21:36:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-20T21:36:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-20T21:36:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-20T21:36:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-20T21:36:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-20T21:36:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-20T21:36:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-20T21:36:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-20T21:36:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-20T21:36:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-20T21:36:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-20T21:36:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-20T21:36:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-20T21:36:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-20T21:36:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-20T21:36:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-20T21:36:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-20T21:36:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-20T21:36:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-20T21:36:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-20T21:36:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-20T21:36:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-20T21:36:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-20T21:36:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-20T21:36:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-20T21:36:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-20T21:36:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-20T21:36:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-20T21:36:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-20T21:36:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-20T21:36:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-20T21:36:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-20T21:36:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-20T21:36:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-20T21:36:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-20T21:36:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-20T21:36:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-20T21:36:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-20T21:36:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-20T21:36:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-20T21:36:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-20T21:36:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-20T21:36:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-20T21:36:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-20T21:36:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-20T21:36:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-20T21:36:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-20T21:36:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-20T21:36:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-20T21:36:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-20T21:36:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-20T21:36:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-20T21:36:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-20T21:36:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-20T21:36:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-20T21:36:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-20T21:36:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-20T21:36:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-20T21:36:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-20T21:36:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-20T21:36:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-20T21:36:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-20T21:36:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-20T21:36:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-20T21:36:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-20T21:36:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-20T21:36:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-20T21:36:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-20T21:36:51.924 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-20T21:36:51.924 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-20T21:36:51.924 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-20T21:36:51.924 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-20T21:36:51.924 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-20T21:36:51.924 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-20T21:36:51.924 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-20T21:36:51.924 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-20T21:36:51.924 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-20T21:36:51.924 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-20T21:36:51.924 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-20T21:36:51.924 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-20T21:36:51.924 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-20T21:36:51.924 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-20T21:36:51.924 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-20T21:36:51.924 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-20T21:36:51.925 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-20T21:36:51.925 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-20T21:36:51.925 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-20T21:36:51.925 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-20T21:36:51.925 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-20T21:36:51.925 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-20T21:36:51.925 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-20T21:36:51.925 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-20T21:36:51.925 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-20T21:36:51.925 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-20T21:36:51.925 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-20T21:36:51.925 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-20T21:36:51.925 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-20T21:36:51.925 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-20T21:36:51.925 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-20T21:36:51.926 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-20T21:36:51.926 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-20T21:36:51.926 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-20T21:36:51.926 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-20T21:36:51.926 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-20T21:36:51.926 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-20T21:36:51.926 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-20T21:36:51.926 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-20T21:36:51.926 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-20T21:36:51.926 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-20T21:36:51.926 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-20T21:36:51.926 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-20T21:36:51.926 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-20T21:36:51.926 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-20T21:36:51.927 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-20T21:36:51.927 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-20T21:36:51.927 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-20T21:36:51.927 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-20T21:36:51.927 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-20T21:36:51.927 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-20T21:36:51.927 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-20T21:36:51.927 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-20T21:36:51.927 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-20T21:36:51.927 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-20T21:36:51.927 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-20T21:36:51.927 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-20T21:36:51.927 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-20T21:36:51.927 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-20T21:36:51.927 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-20T21:36:51.928 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-20T21:36:51.928 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-20T21:36:51.928 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-20T21:36:51.928 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-20T21:36:51.928 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-20T21:36:51.928 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-20T21:36:51.928 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-20T21:36:51.928 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-20T21:36:51.928 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-20T21:36:51.928 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-20T21:36:51.928 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-20T21:36:51.928 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-20T21:36:51.928 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-20T21:36:51.928 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-20T21:36:51.928 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-20T21:36:51.928 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-20T21:36:51.929 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-20T21:36:51.929 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-20T21:36:51.929 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-20T21:36:51.929 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-20T21:36:51.929 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-20T21:36:51.929 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-20T21:36:51.929 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-20T21:36:51.929 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-20T21:36:51.929 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-20T21:36:51.929 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-20T21:36:51.929 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-20T21:36:51.929 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-20T21:36:51.929 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-20T21:36:51.929 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-20T21:36:51.930 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-20T21:36:51.930 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-20T21:36:51.930 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-20T21:36:51.930 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-20T21:36:51.930 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-20T21:36:51.930 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-20T21:36:51.930 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-20T21:36:51.930 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-20T21:36:51.930 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-20T21:36:51.930 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-20T21:36:51.930 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-20T21:36:51.930 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-20T21:36:51.930 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-20T21:36:51.930 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-20T21:36:51.930 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-20T21:36:51.930 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-20T21:36:51.931 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-20T21:36:51.931 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-20T21:36:51.931 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-20T21:36:51.931 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-20T21:36:51.931 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-20T21:36:51.931 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-20T21:36:51.931 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-20T21:36:51.931 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-20T21:36:51.931 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-20T21:36:51.931 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-20T21:36:51.931 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-20T21:36:51.931 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-20T21:36:51.931 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-20T21:36:51.931 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-20T21:36:51.931 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-20T21:36:51.932 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-20T21:36:51.932 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-20T21:36:51.932 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-20T21:36:51.932 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-20T21:36:51.932 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-20T21:36:51.932 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-20T21:36:51.932 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-20T21:36:51.932 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-20T21:36:51.932 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-20T21:36:51.932 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-20T21:36:51.932 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-20T21:36:51.932 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-20T21:36:51.932 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-20T21:36:51.932 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-20T21:36:51.932 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-20T21:36:51.933 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-20T21:36:51.933 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-20T21:36:51.933 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-20T21:36:51.933 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-20T21:36:51.933 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-20T21:36:51.933 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-20T21:36:51.933 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-20T21:36:51.933 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-20T21:36:51.933 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-20T21:36:51.933 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-20T21:36:51.933 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-20T21:36:51.933 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-20T21:36:51.933 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-20T21:36:51.933 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-20T21:36:51.934 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-20T21:36:51.934 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-20T21:36:51.934 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-20T21:36:51.934 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-20T21:36:51.934 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-20T21:36:51.934 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-20T21:36:51.934 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-20T21:36:51.934 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-20T21:36:51.934 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-20T21:36:51.934 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-20T21:36:51.934 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-20T21:36:51.934 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-20T21:36:51.934 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-20T21:36:51.934 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-20T21:36:51.934 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-20T21:36:51.935 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-20T21:36:51.935 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-20T21:36:51.935 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-20T21:36:51.935 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-20T21:36:51.935 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-20T21:36:51.935 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-20T21:36:51.935 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-20T21:36:51.935 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-20T21:36:51.935 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-20T21:36:51.935 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-20T21:36:51.935 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-20T21:36:51.935 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-20T21:36:51.936 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-20T21:36:51.936 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-20T21:36:51.936 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-20T21:36:51.936 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-20T21:36:51.936 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-20T21:36:51.936 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-20T21:36:51.936 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-20T21:36:51.936 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-20T21:36:51.936 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-20T21:36:51.936 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-20T21:36:51.936 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-20T21:36:51.936 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-20T21:36:51.936 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-20T21:36:51.936 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-20T21:36:51.936 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-20T21:36:51.937 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-20T21:36:51.937 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-20T21:36:51.937 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-20T21:36:51.937 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-20T21:36:51.937 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-20T21:36:51.937 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-20T21:36:51.937 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-20T21:36:51.937 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-20T21:36:51.937 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-20T21:36:51.937 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-20T21:36:51.937 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-20T21:36:51.937 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-20T21:36:51.937 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-20T21:36:51.937 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-20T21:36:51.938 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-20T21:36:51.938 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-20T21:36:51.938 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-20T21:36:51.938 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-20T21:36:51.938 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-20T21:36:51.938 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-20T21:36:51.938 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-20T21:36:51.938 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-20T21:36:51.938 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-20T21:36:51.938 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-20T21:36:51.938 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-20T21:36:51.938 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-20T21:36:51.939 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-20T21:36:51.939 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-20T21:36:51.939 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-20T21:36:51.939 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-20T21:36:51.939 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-20T21:36:51.939 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-20T21:36:51.939 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-20T21:36:51.939 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-20T21:36:51.939 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-20T21:36:51.939 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-20T21:36:51.939 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-20T21:36:51.939 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-20T21:36:51.939 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-20T21:36:51.939 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-20T21:36:51.940 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-20T21:36:51.940 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-20T21:36:51.940 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-20T21:36:51.940 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-20T21:36:51.940 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-20T21:36:51.940 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-20T21:36:51.940 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-20T21:36:51.940 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-20T21:36:51.940 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-20T21:36:51.940 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-20T21:36:51.940 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-20T21:36:51.940 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-20T21:36:51.940 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-20T21:36:51.940 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-20T21:36:51.940 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-20T21:36:51.940 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-20T21:36:51.941 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-20T21:36:51.941 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-20T21:36:51.941 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-20T21:36:51.941 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-20T21:36:51.941 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-20T21:36:51.941 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-20T21:36:51.941 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-20T21:36:51.941 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-20T21:36:51.941 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-20T21:36:51.941 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-20T21:36:51.941 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-20T21:36:51.941 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-20T21:36:51.941 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-20T21:36:51.941 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-20T21:36:51.941 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-20T21:36:51.942 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-20T21:36:51.942 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-20T21:36:51.942 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-20T21:36:51.942 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-20T21:36:51.942 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-20T21:36:51.942 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-20T21:36:51.942 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-20T21:36:51.942 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-20T21:36:51.942 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-20T21:36:51.942 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-20T21:36:51.942 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-20T21:36:51.942 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-20T21:36:51.942 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-20T21:36:51.942 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-20T21:36:51.943 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-20T21:36:51.943 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-20T21:36:51.943 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-20T21:36:51.943 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-20T21:36:51.943 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-20T21:36:51.943 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-20T21:36:51.943 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-20T21:36:51.943 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-20T21:36:51.943 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-20T21:36:51.943 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-20T21:36:51.943 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-20T21:36:51.943 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-20T21:36:51.943 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-20T21:36:51.943 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-20T21:36:51.943 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-20T21:36:51.944 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-20T21:36:51.944 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-20T21:36:51.944 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-20T21:36:51.944 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-20T21:36:51.944 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-20T21:36:51.944 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-20T21:36:51.944 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-20T21:36:51.944 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-20T21:36:51.944 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-20T21:36:51.944 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-20T21:36:51.944 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-20T21:36:51.944 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-20T21:36:51.944 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-20T21:36:51.944 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-20T21:36:51.945 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-20T21:36:51.945 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-20T21:36:51.945 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-20T21:36:51.945 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-20T21:36:51.945 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-20T21:36:51.945 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-20T21:36:51.945 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-20T21:36:51.945 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-20T21:36:51.945 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-20T21:36:51.945 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-20T21:36:51.945 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-20T21:36:51.945 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-20T21:36:51.945 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-20T21:36:51.945 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-20T21:36:51.945 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-20T21:36:51.946 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-20T21:36:51.946 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-20T21:36:51.946 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-20T21:36:51.946 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-20T21:36:51.946 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-20T21:36:51.946 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-20T21:36:51.946 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-20T21:36:51.946 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-20T21:36:51.946 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-20T21:36:51.946 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-20T21:36:51.946 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-20T21:36:51.946 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-20T21:36:51.946 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-20T21:36:51.947 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-20T21:36:51.947 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-20T21:36:51.947 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-20T21:36:51.947 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-20T21:36:51.947 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-20T21:36:51.947 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-20T21:36:51.947 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-20T21:36:51.947 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-20T21:36:51.947 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-20T21:36:51.947 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-20T21:36:51.947 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-20T21:36:51.947 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-20T21:36:51.947 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-20T21:36:51.948 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-20T21:36:51.948 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-20T21:36:51.948 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-20T21:36:51.948 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-20T21:36:51.948 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-20T21:36:51.948 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-20T21:36:51.948 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-20T21:36:51.948 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-20T21:36:51.948 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-20T21:36:51.948 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-20T21:36:51.948 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-20T21:36:51.948 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-20T21:36:51.948 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-20T21:36:51.948 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-20T21:36:51.949 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-20T21:36:51.949 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-20T21:36:51.949 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-20T21:36:51.949 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-20T21:36:51.949 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-20T21:36:51.949 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-20T21:36:51.949 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-20T21:36:51.949 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-20T21:36:51.949 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-20T21:36:51.949 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-20T21:36:51.949 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-20T21:36:51.949 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-20T21:36:51.950 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-20T21:36:51.950 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-20T21:36:51.950 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-20T21:36:51.950 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-20T21:36:51.950 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-20T21:36:51.950 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-20T21:36:51.950 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-20T21:36:51.950 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-20T21:36:51.950 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-20T21:36:51.950 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-20T21:36:51.950 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-20T21:36:51.950 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-20T21:36:51.950 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-20T21:36:51.951 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-20T21:36:51.951 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-20T21:36:51.951 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-20T21:36:51.951 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-20T21:36:51.951 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-20T21:36:51.951 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-20T21:36:51.951 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-20T21:36:51.951 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-20T21:36:51.951 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-20T21:36:51.951 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-20T21:36:51.951 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-20T21:36:51.951 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-20T21:36:51.951 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-20T21:36:51.952 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-20T21:36:51.952 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-20T21:36:51.952 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-20T21:36:51.952 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-20T21:36:51.952 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-20T21:36:51.952 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-20T21:36:51.952 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-20T21:36:51.952 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-20T21:36:51.952 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-20T21:36:51.952 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-20T21:36:51.952 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-20T21:36:51.952 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-20T21:36:51.952 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-20T21:36:51.953 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-20T21:36:51.953 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-20T21:36:51.953 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-20T21:36:51.953 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-20T21:36:51.953 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-20T21:36:51.953 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-20T21:36:51.953 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-20T21:36:51.953 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-20T21:36:51.953 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-20T21:36:51.953 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-20T21:36:51.953 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-20T21:36:51.953 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-20T21:36:51.953 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-20T21:36:51.954 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-20T21:36:51.954 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-20T21:36:51.954 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-20T21:36:51.954 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-20T21:36:51.954 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-20T21:36:51.954 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-20T21:36:51.954 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-20T21:36:51.954 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-20T21:36:51.954 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-20T21:36:51.954 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-20T21:36:51.954 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-20T21:36:51.954 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-20T21:36:51.954 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-20T21:36:51.954 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-20T21:36:51.955 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-20T21:36:51.955 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-20T21:36:51.955 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-20T21:36:51.955 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-20T21:36:51.955 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-20T21:36:51.955 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-20T21:36:51.955 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-20T21:36:51.955 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-20T21:36:51.955 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-20T21:36:51.955 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-20T21:36:51.955 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-20T21:36:51.955 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-20T21:36:51.955 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-20T21:36:51.955 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-20T21:36:51.956 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-20T21:36:51.956 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-20T21:36:51.956 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-20T21:36:51.956 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-20T21:36:51.956 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-20T21:36:51.956 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-20T21:36:51.956 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-20T21:36:51.956 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-20T21:36:51.956 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-20T21:36:51.956 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-20T21:36:51.956 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-20T21:36:51.956 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-20T21:36:51.956 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-20T21:36:51.957 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-20T21:36:51.957 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-20T21:36:51.957 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-20T21:36:51.957 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-20T21:36:51.957 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-20T21:36:51.957 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-20T21:36:51.957 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-20T21:36:51.957 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-20T21:36:51.957 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-20T21:36:51.957 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-20T21:36:51.957 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-20T21:36:51.957 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-20T21:36:51.957 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-20T21:36:51.957 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-20T21:36:51.958 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-20T21:36:51.958 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-20T21:36:51.958 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-20T21:36:51.958 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-20T21:36:51.958 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-20T21:36:51.958 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-20T21:36:51.958 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-20T21:36:51.958 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-20T21:36:51.958 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-20T21:36:51.958 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-20T21:36:51.958 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-20T21:36:51.958 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-20T21:36:51.958 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-20T21:36:51.959 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-20T21:36:51.959 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-20T21:36:51.959 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-20T21:36:51.959 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-20T21:36:51.959 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-20T21:36:51.959 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-20T21:36:51.959 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-20T21:36:51.959 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-20T21:36:51.959 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-20T21:36:51.959 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-20T21:36:51.959 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-20T21:36:51.959 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-20T21:36:51.959 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-20T21:36:51.959 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-20T21:36:51.960 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-20T21:36:51.960 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-20T21:36:51.960 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-20T21:36:51.960 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-20T21:36:51.960 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-20T21:36:51.960 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-20T21:36:51.960 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-20T21:36:51.960 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-20T21:36:51.960 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-20T21:36:51.960 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-20T21:36:51.960 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-20T21:36:51.960 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-20T21:36:51.960 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-20T21:36:51.960 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-20T21:36:51.960 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-20T21:36:51.961 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-20T21:36:51.961 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-20T21:36:51.961 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-20T21:36:51.961 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-20T21:36:51.961 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-20T21:36:51.961 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-20T21:36:51.961 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-20T21:36:51.961 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-20T21:36:51.961 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-20T21:36:51.961 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-20T21:36:51.961 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-20T21:36:51.961 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-20T21:36:51.961 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-20T21:36:51.961 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-20T21:36:51.962 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-20T21:36:51.962 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-20T21:36:51.962 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-20T21:36:51.962 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-20T21:36:51.962 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-20T21:36:51.962 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-20T21:36:51.962 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-20T21:36:51.962 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-20T21:36:51.962 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-20T21:36:51.962 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-20T21:36:51.962 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-20T21:36:51.962 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-20T21:36:51.962 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-20T21:36:51.962 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-20T21:36:51.963 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-20T21:36:51.963 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-20T21:36:51.963 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-20T21:36:51.963 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-20T21:36:51.963 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-20T21:36:51.963 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-20T21:36:51.963 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-20T21:36:51.963 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-20T21:36:51.963 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-20T21:36:51.963 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-20T21:36:51.963 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-20T21:36:51.963 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-20T21:36:51.963 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-20T21:36:51.963 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-20T21:36:51.964 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-20T21:36:51.964 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-20T21:36:51.964 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-20T21:36:51.964 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-20T21:36:51.964 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-20T21:36:51.964 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-20T21:36:51.964 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-20T21:36:51.964 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-20T21:36:51.964 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-20T21:36:51.964 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-20T21:36:51.964 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-20T21:36:51.964 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-20T21:36:51.964 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-20T21:36:51.965 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-20T21:36:51.965 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-20T21:36:51.965 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-20T21:36:51.965 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-20T21:36:51.965 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-20T21:36:51.965 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-20T21:36:51.965 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-20T21:36:51.965 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-20T21:36:51.965 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-20T21:36:51.965 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-20T21:36:51.965 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-20T21:36:51.965 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-20T21:36:51.965 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-20T21:36:51.965 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-20T21:36:51.966 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-20T21:36:51.966 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-20T21:36:51.966 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-20T21:36:51.966 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-20T21:36:51.966 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-20T21:36:51.966 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-20T21:36:51.966 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-20T21:36:51.966 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-20T21:36:51.966 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-20T21:36:51.966 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-20T21:36:51.966 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-20T21:36:51.966 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-20T21:36:51.966 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-20T21:36:51.967 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-20T21:36:51.967 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-20T21:36:51.967 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-20T21:36:51.967 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-20T21:36:51.967 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-20T21:36:51.967 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-20T21:36:51.967 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-20T21:36:51.967 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-20T21:36:51.967 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-20T21:36:51.967 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-20T21:36:51.967 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-20T21:36:51.967 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-20T21:36:51.967 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-20T21:36:51.967 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-20T21:36:51.968 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-20T21:36:51.968 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-20T21:36:51.968 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-20T21:36:51.968 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-20T21:36:51.968 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-20T21:36:51.968 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-20T21:36:51.968 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-20T21:36:51.968 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-20T21:36:51.968 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-20T21:36:51.968 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-20T21:36:51.968 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-20T21:36:51.968 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-20T21:36:51.968 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-20T21:36:51.968 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-20T21:36:51.968 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-20T21:36:51.969 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-20T21:36:51.969 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-20T21:36:51.969 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-20T21:36:51.969 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-20T21:36:51.969 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-20T21:36:51.969 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-20T21:36:51.969 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-20T21:36:51.969 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-20T21:36:51.969 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-20T21:36:51.969 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-20T21:36:51.969 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-20T21:36:51.969 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-20T21:36:51.969 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-20T21:36:51.970 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-20T21:36:51.970 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-20T21:36:51.970 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-20T21:36:51.970 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-20T21:36:51.970 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-20T21:36:51.970 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-20T21:36:51.970 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-20T21:36:51.970 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-20T21:36:51.970 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-20T21:36:51.970 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-20T21:36:51.970 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-20T21:36:51.970 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-20T21:36:51.970 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-20T21:36:51.970 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-20T21:36:51.971 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-20T21:36:51.971 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-20T21:36:51.971 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-20T21:36:51.971 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-20T21:36:51.971 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-20T21:36:51.971 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-20T21:36:51.971 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-20T21:36:51.971 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-20T21:36:51.971 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-20T21:36:51.971 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-20T21:36:51.971 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-20T21:36:51.971 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-20T21:36:51.971 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-20T21:36:51.972 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-20T21:36:51.972 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-20T21:36:51.972 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-20T21:36:51.972 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-20T21:36:51.972 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-20T21:36:51.972 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-20T21:36:51.972 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-20T21:36:51.972 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-20T21:36:51.972 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-20T21:36:51.972 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-20T21:36:51.972 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-20T21:36:51.972 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-20T21:36:51.972 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-20T21:36:51.972 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-20T21:36:51.973 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-20T21:36:51.973 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-20T21:36:51.973 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-20T21:36:51.973 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-20T21:36:51.973 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-20T21:36:51.973 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-20T21:36:51.973 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-20T21:36:51.973 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-20T21:36:51.973 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-20T21:36:51.973 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-20T21:36:51.973 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-20T21:36:51.973 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-20T21:36:51.973 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-20T21:36:51.974 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-20T21:36:51.974 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-20T21:36:51.974 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-20T21:36:51.974 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-20T21:36:51.974 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-20T21:36:51.974 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-20T21:36:51.974 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-20T21:36:51.974 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-20T21:36:51.974 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-20T21:36:51.974 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-20T21:36:51.974 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-20T21:36:51.974 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-20T21:36:51.975 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-20T21:36:51.975 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-20T21:36:51.975 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-20T21:36:51.975 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-20T21:36:51.975 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-20T21:36:51.975 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-20T21:36:51.975 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-20T21:36:51.975 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-20T21:36:51.975 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-20T21:36:51.975 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-20T21:36:51.975 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-20T21:36:51.975 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-20T21:36:51.975 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-20T21:36:51.976 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-20T21:36:51.976 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-20T21:36:51.980 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-20T21:36:51.980 DEBUG:teuthology.orchestra.run.smithi142:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-20T21:36:52.003 INFO:teuthology.orchestra.run.smithi142.stdout:postinstall scriptlet (using /bin/sh): 2024-04-20T21:36:52.003 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-20T21:36:52.003 INFO:teuthology.orchestra.run.smithi142.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-20T21:36:52.003 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2024-04-20T21:36:52.003 INFO:teuthology.orchestra.run.smithi142.stdout:for file in vmlinuz System.map config; do 2024-04-20T21:36:52.003 INFO:teuthology.orchestra.run.smithi142.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-20T21:36:52.003 INFO:teuthology.orchestra.run.smithi142.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-20T21:36:52.003 INFO:teuthology.orchestra.run.smithi142.stdout: fi 2024-04-20T21:36:52.003 INFO:teuthology.orchestra.run.smithi142.stdout:done 2024-04-20T21:36:52.003 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-20T21:36:52.003 INFO:teuthology.orchestra.run.smithi142.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-20T21:36:52.004 INFO:teuthology.orchestra.run.smithi142.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-20T21:36:52.004 INFO:teuthology.orchestra.run.smithi142.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-20T21:36:52.004 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2024-04-20T21:36:52.004 INFO:teuthology.orchestra.run.smithi142.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-20T21:36:52.004 INFO:teuthology.orchestra.run.smithi142.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-20T21:36:52.004 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2024-04-20T21:36:52.004 INFO:teuthology.orchestra.run.smithi142.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-20T21:36:52.004 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-20T21:36:52.004 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-20T21:36:52.004 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2024-04-20T21:36:52.005 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2024-04-20T21:36:52.074 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2024-04-20T21:36:52.074 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2024-04-20T21:36:52.074 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.06 2024-04-20T21:36:52.074 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 68.el9 2024-04-20T21:36:52.074 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2024-04-20T21:36:52.074 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-20T21:36:52.074 INFO:teuthology.orchestra.run.smithi142.stdout:Group : Unspecified 2024-04-20T21:36:52.074 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 8264254 2024-04-20T21:36:52.074 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2024-04-20T21:36:52.074 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-20T21:36:52.074 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-20T21:36:52.075 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-20T21:36:52.075 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-20T21:36:52.075 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : builder@centos.org 2024-04-20T21:36:52.075 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2024-04-20T21:36:52.075 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-20T21:36:52.075 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2024-04-20T21:36:52.075 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2024-04-20T21:36:52.075 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:36:52.075 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-20T21:36:52.075 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-20T21:36:52.075 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-20T21:36:52.075 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2024-04-20T21:36:52.075 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:36:52.075 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2024-04-20T21:36:52.076 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-20T21:36:52.076 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 6.9.0-rc3-g806ec36b2112 2024-04-20T21:36:52.076 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-20T21:36:52.618 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-04-20T21:36:54.044 INFO:teuthology.orchestra.run.smithi142.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-20T21:36:54.072 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-04-20T21:36:54.074 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-04-20T21:36:54.105 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.NxLfoopgtp 2024-04-20T21:36:54.105 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NxLfoopgtp 2024-04-20T21:36:54.182 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.NxLfoopgtp 2024-04-20T21:36:54.319 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.NxLfoopgtp is 6KB 2024-04-20T21:36:54.339 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.NxLfoopgtp 2024-04-20T21:36:54.353 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2024-04-20T21:36:54.415 INFO:teuthology.orchestra.run.smithi142.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-20T21:36:54.415 INFO:teuthology.orchestra.run.smithi142.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-20T21:36:54.415 INFO:teuthology.orchestra.run.smithi142.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-20T21:36:54.415 INFO:teuthology.orchestra.run.smithi142.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-20T21:36:54.416 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-20T21:36:54.585 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2024-04-20T21:37:11.896 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi164.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-20T21:37:11.897 DEBUG:teuthology.orchestra.run.smithi164:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-20T21:37:11.970 INFO:teuthology.orchestra.run.smithi164.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-20T21:37:11.970 INFO:teuthology.orchestra.run.smithi164.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-04-20T21:37:11.970 INFO:teuthology.orchestra.run.smithi164.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-20T21:37:11.970 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-04-20T21:37:11.971 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-04-20T21:37:11.971 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-04-20T21:37:11.971 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-04-20T21:37:11.971 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-04-20T21:37:11.971 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-04-20T21:37:11.971 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-20T21:37:11.971 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-20T21:37:11.971 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-20T21:37:11.971 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-20T21:37:11.971 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-20T21:37:11.971 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-20T21:37:11.971 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-20T21:37:11.971 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-20T21:37:11.971 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-20T21:37:11.971 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-20T21:37:11.972 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-20T21:37:11.972 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-20T21:37:11.972 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-20T21:37:11.972 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-20T21:37:11.972 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-20T21:37:11.972 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-20T21:37:11.972 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-20T21:37:11.972 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-20T21:37:11.972 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-20T21:37:11.972 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-20T21:37:11.972 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-04-20T21:37:11.972 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-04-20T21:37:11.972 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-04-20T21:37:11.972 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-20T21:37:11.972 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-04-20T21:37:11.973 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-20T21:37:11.973 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-20T21:37:11.973 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-20T21:37:11.973 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-04-20T21:37:11.973 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-20T21:37:11.973 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-20T21:37:11.973 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-20T21:37:11.973 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-04-20T21:37:11.973 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-20T21:37:11.973 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-20T21:37:11.973 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-20T21:37:11.973 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-20T21:37:11.973 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-20T21:37:11.973 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-20T21:37:11.973 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-20T21:37:11.974 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-20T21:37:11.974 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-20T21:37:11.974 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-20T21:37:11.974 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-20T21:37:11.974 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-20T21:37:11.974 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-20T21:37:11.974 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-20T21:37:11.974 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-20T21:37:11.974 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-20T21:37:11.974 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-20T21:37:11.974 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-20T21:37:11.974 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-20T21:37:11.974 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-20T21:37:11.974 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-20T21:37:11.975 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-20T21:37:11.975 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-20T21:37:11.975 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-20T21:37:11.975 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-20T21:37:11.975 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-20T21:37:11.975 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-20T21:37:11.975 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-20T21:37:11.975 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-20T21:37:11.975 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-20T21:37:11.975 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-20T21:37:11.975 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-20T21:37:11.975 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-20T21:37:11.975 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-20T21:37:11.975 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-20T21:37:11.975 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-20T21:37:11.975 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-20T21:37:11.976 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-20T21:37:11.976 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-20T21:37:11.976 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-20T21:37:11.976 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-20T21:37:11.976 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-20T21:37:11.976 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-20T21:37:11.976 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-20T21:37:11.976 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-20T21:37:11.976 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-04-20T21:37:11.976 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-04-20T21:37:11.976 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-20T21:37:11.976 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-20T21:37:11.976 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-20T21:37:11.976 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-20T21:37:11.976 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-20T21:37:11.976 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-20T21:37:11.977 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-20T21:37:11.977 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-04-20T21:37:11.977 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-20T21:37:11.977 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-20T21:37:11.977 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-04-20T21:37:11.977 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-20T21:37:11.977 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-20T21:37:11.977 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-20T21:37:11.977 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-20T21:37:11.977 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-20T21:37:11.977 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-20T21:37:11.977 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-20T21:37:11.977 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-20T21:37:11.977 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-20T21:37:11.977 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-20T21:37:11.978 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-20T21:37:11.978 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-20T21:37:11.978 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-20T21:37:11.978 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-20T21:37:11.978 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-20T21:37:11.978 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-20T21:37:11.978 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-20T21:37:11.978 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-20T21:37:11.978 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-20T21:37:11.978 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-20T21:37:11.978 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-20T21:37:11.978 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-20T21:37:11.978 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-20T21:37:11.978 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-20T21:37:11.979 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-20T21:37:11.979 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-20T21:37:11.979 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-20T21:37:11.979 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-20T21:37:11.979 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-20T21:37:11.979 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-20T21:37:11.979 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-20T21:37:11.979 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-20T21:37:11.979 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-20T21:37:11.979 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-20T21:37:11.979 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-20T21:37:11.979 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-04-20T21:37:11.979 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-20T21:37:11.979 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-20T21:37:11.979 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-20T21:37:11.979 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-20T21:37:11.980 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-20T21:37:11.980 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-20T21:37:11.980 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-20T21:37:11.980 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-20T21:37:11.980 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-20T21:37:11.980 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-20T21:37:11.980 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-20T21:37:11.980 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-20T21:37:11.980 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-20T21:37:11.980 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-20T21:37:11.980 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-20T21:37:11.980 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-20T21:37:11.980 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-20T21:37:11.980 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-04-20T21:37:11.980 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-20T21:37:11.981 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-04-20T21:37:11.981 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-04-20T21:37:11.981 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-20T21:37:11.981 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-20T21:37:11.981 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-04-20T21:37:11.981 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-20T21:37:11.981 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-04-20T21:37:11.981 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-04-20T21:37:11.981 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-20T21:37:11.981 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-04-20T21:37:11.981 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-04-20T21:37:11.981 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-20T21:37:11.981 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-20T21:37:11.981 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-04-20T21:37:11.981 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-04-20T21:37:11.982 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-20T21:37:11.982 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-20T21:37:11.982 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-04-20T21:37:11.982 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-20T21:37:11.982 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-20T21:37:11.982 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-20T21:37:11.982 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-04-20T21:37:11.982 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-04-20T21:37:11.982 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-20T21:37:11.982 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-04-20T21:37:11.982 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-04-20T21:37:11.982 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-20T21:37:11.982 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-04-20T21:37:11.982 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-20T21:37:11.982 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-04-20T21:37:11.983 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-20T21:37:11.983 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-20T21:37:11.983 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-20T21:37:11.983 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-20T21:37:11.983 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-20T21:37:11.983 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-04-20T21:37:11.983 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-20T21:37:11.983 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-20T21:37:11.983 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-20T21:37:11.983 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-20T21:37:11.983 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-20T21:37:11.983 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-20T21:37:11.983 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-20T21:37:11.983 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-04-20T21:37:11.983 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-20T21:37:11.983 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-20T21:37:11.984 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-20T21:37:11.984 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-04-20T21:37:11.984 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-04-20T21:37:11.984 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-20T21:37:11.984 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-20T21:37:11.984 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-20T21:37:11.984 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-20T21:37:11.984 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-20T21:37:11.984 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-04-20T21:37:11.984 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-04-20T21:37:11.984 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-04-20T21:37:11.984 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-20T21:37:11.984 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-20T21:37:11.984 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-20T21:37:11.984 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-20T21:37:11.984 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-20T21:37:11.984 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-20T21:37:11.985 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-04-20T21:37:11.985 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-04-20T21:37:11.985 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-20T21:37:11.985 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-20T21:37:11.985 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-04-20T21:37:11.985 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-04-20T21:37:11.985 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-04-20T21:37:11.985 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-20T21:37:11.985 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-20T21:37:11.985 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-20T21:37:11.985 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-20T21:37:11.985 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-20T21:37:11.985 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-04-20T21:37:11.985 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-20T21:37:11.985 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-04-20T21:37:11.986 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-20T21:37:11.986 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-04-20T21:37:11.986 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-20T21:37:11.986 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-04-20T21:37:11.986 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-04-20T21:37:11.986 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-20T21:37:11.986 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-04-20T21:37:11.986 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-20T21:37:11.986 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-04-20T21:37:11.986 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-20T21:37:11.986 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-20T21:37:11.986 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-20T21:37:11.986 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-20T21:37:11.986 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-20T21:37:11.986 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-20T21:37:11.987 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-20T21:37:11.987 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-20T21:37:11.987 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-20T21:37:11.987 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-20T21:37:11.987 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-20T21:37:11.987 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-20T21:37:11.987 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-20T21:37:11.987 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-04-20T21:37:11.987 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-04-20T21:37:11.987 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-20T21:37:11.987 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-04-20T21:37:11.987 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-20T21:37:11.987 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-20T21:37:11.987 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-04-20T21:37:11.987 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-20T21:37:11.988 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-20T21:37:11.988 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-20T21:37:11.988 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-20T21:37:11.988 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-20T21:37:11.988 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-20T21:37:11.988 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-20T21:37:11.988 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-20T21:37:11.988 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-20T21:37:11.988 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-20T21:37:11.988 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-20T21:37:11.988 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-20T21:37:11.988 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-20T21:37:11.988 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-20T21:37:11.988 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-20T21:37:11.988 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-20T21:37:11.988 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-20T21:37:11.989 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-20T21:37:11.989 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-20T21:37:11.989 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-20T21:37:11.989 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-20T21:37:11.989 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-20T21:37:11.989 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-20T21:37:11.989 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-20T21:37:11.989 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-20T21:37:11.989 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-20T21:37:11.989 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-20T21:37:11.989 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-20T21:37:11.989 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-20T21:37:11.989 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-20T21:37:11.989 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-20T21:37:11.990 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-20T21:37:11.990 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-20T21:37:11.990 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-20T21:37:11.990 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-20T21:37:11.990 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-20T21:37:11.990 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-20T21:37:11.990 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-20T21:37:11.990 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-20T21:37:11.990 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-20T21:37:11.990 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-20T21:37:11.990 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-20T21:37:11.990 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-20T21:37:11.990 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-20T21:37:11.990 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-20T21:37:11.991 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-20T21:37:11.991 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-20T21:37:11.991 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-20T21:37:11.991 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-20T21:37:11.991 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-20T21:37:11.991 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-20T21:37:11.991 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-20T21:37:11.991 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-20T21:37:11.991 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-20T21:37:11.991 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-20T21:37:11.991 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-20T21:37:11.991 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-20T21:37:11.991 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-20T21:37:11.991 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-20T21:37:11.991 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-20T21:37:11.992 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-20T21:37:11.992 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-20T21:37:11.992 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-20T21:37:11.992 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-20T21:37:11.992 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-04-20T21:37:11.992 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-20T21:37:11.992 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-20T21:37:11.992 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-20T21:37:11.992 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-04-20T21:37:11.992 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-20T21:37:11.992 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-20T21:37:11.992 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-20T21:37:11.992 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-20T21:37:11.992 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-20T21:37:11.993 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-20T21:37:11.993 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-20T21:37:11.993 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-20T21:37:11.993 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-20T21:37:11.993 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-20T21:37:11.993 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-20T21:37:11.993 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-20T21:37:11.993 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-20T21:37:11.993 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-20T21:37:11.993 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-20T21:37:11.993 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-20T21:37:11.993 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-20T21:37:11.993 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-20T21:37:11.993 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-20T21:37:11.993 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-20T21:37:11.993 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-20T21:37:11.994 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-20T21:37:11.994 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-20T21:37:11.994 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-20T21:37:11.994 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-20T21:37:11.994 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-20T21:37:11.994 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-20T21:37:11.994 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-20T21:37:11.994 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-20T21:37:11.994 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-20T21:37:11.994 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-20T21:37:11.994 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-20T21:37:11.994 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-20T21:37:11.994 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-20T21:37:11.994 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-20T21:37:11.995 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-20T21:37:11.995 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-20T21:37:11.995 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-20T21:37:11.995 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-20T21:37:11.995 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-20T21:37:11.995 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-20T21:37:11.995 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-20T21:37:11.995 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-20T21:37:11.995 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-20T21:37:11.995 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-20T21:37:11.995 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-20T21:37:11.995 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-20T21:37:11.995 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-20T21:37:11.995 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-20T21:37:11.995 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-20T21:37:11.996 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-20T21:37:11.996 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-20T21:37:11.996 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-20T21:37:11.996 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-20T21:37:11.996 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-20T21:37:11.996 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-20T21:37:11.996 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-20T21:37:11.996 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-20T21:37:11.996 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-20T21:37:11.996 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-20T21:37:11.996 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-20T21:37:11.996 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-20T21:37:11.996 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-20T21:37:11.996 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-20T21:37:11.996 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-20T21:37:11.997 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-20T21:37:11.997 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-20T21:37:11.997 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-20T21:37:11.997 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-20T21:37:11.997 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-20T21:37:11.997 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-20T21:37:11.997 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-20T21:37:11.997 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-20T21:37:11.997 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-20T21:37:11.997 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-20T21:37:11.997 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-20T21:37:11.997 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-20T21:37:11.997 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-20T21:37:11.997 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-20T21:37:11.997 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-20T21:37:11.998 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-20T21:37:11.998 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-20T21:37:11.998 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-20T21:37:11.998 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-20T21:37:11.998 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-20T21:37:11.998 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-20T21:37:11.998 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-20T21:37:11.998 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-20T21:37:11.998 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-04-20T21:37:11.998 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-20T21:37:11.998 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-20T21:37:11.998 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-20T21:37:11.998 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-20T21:37:11.998 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-20T21:37:11.999 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-20T21:37:11.999 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-20T21:37:11.999 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-20T21:37:11.999 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-20T21:37:11.999 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-20T21:37:11.999 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-20T21:37:11.999 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-20T21:37:11.999 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-20T21:37:11.999 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-20T21:37:11.999 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-20T21:37:11.999 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-20T21:37:11.999 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-20T21:37:11.999 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-20T21:37:11.999 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-20T21:37:11.999 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-20T21:37:11.999 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-20T21:37:12.000 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-20T21:37:12.000 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-20T21:37:12.000 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-20T21:37:12.000 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-20T21:37:12.000 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-20T21:37:12.000 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-20T21:37:12.000 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-20T21:37:12.000 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-20T21:37:12.000 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-20T21:37:12.000 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-20T21:37:12.000 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-20T21:37:12.000 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-20T21:37:12.000 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-20T21:37:12.000 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-20T21:37:12.000 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-20T21:37:12.000 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-20T21:37:12.000 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-20T21:37:12.001 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-20T21:37:12.001 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-20T21:37:12.001 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-20T21:37:12.001 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-04-20T21:37:12.001 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-04-20T21:37:12.001 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-20T21:37:12.001 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-20T21:37:12.001 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-04-20T21:37:12.001 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-20T21:37:12.001 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-20T21:37:12.001 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-20T21:37:12.001 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-20T21:37:12.001 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-20T21:37:12.001 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-20T21:37:12.001 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-20T21:37:12.002 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-20T21:37:12.002 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-20T21:37:12.002 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-20T21:37:12.002 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-20T21:37:12.002 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-20T21:37:12.002 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-20T21:37:12.002 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-20T21:37:12.002 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-20T21:37:12.002 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-20T21:37:12.002 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-20T21:37:12.002 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-20T21:37:12.002 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-20T21:37:12.002 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-20T21:37:12.002 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-20T21:37:12.002 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-20T21:37:12.003 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-20T21:37:12.003 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-04-20T21:37:12.003 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-20T21:37:12.003 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-20T21:37:12.003 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-20T21:37:12.003 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-20T21:37:12.003 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-04-20T21:37:12.003 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-04-20T21:37:12.003 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-20T21:37:12.003 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-20T21:37:12.003 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-20T21:37:12.003 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-20T21:37:12.003 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-20T21:37:12.003 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-20T21:37:12.003 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-20T21:37:12.003 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-04-20T21:37:12.003 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-04-20T21:37:12.004 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-20T21:37:12.004 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-04-20T21:37:12.004 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-20T21:37:12.004 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-04-20T21:37:12.004 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-20T21:37:12.004 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-04-20T21:37:12.004 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-20T21:37:12.004 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-04-20T21:37:12.004 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-04-20T21:37:12.004 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-20T21:37:12.004 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-04-20T21:37:12.004 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-20T21:37:12.004 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-04-20T21:37:12.004 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-20T21:37:12.004 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-04-20T21:37:12.004 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-20T21:37:12.005 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-04-20T21:37:12.005 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-20T21:37:12.005 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-04-20T21:37:12.005 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-04-20T21:37:12.005 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-20T21:37:12.005 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-20T21:37:12.005 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-20T21:37:12.005 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-20T21:37:12.005 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-04-20T21:37:12.005 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-20T21:37:12.005 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-04-20T21:37:12.005 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-20T21:37:12.005 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-20T21:37:12.005 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-20T21:37:12.005 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-20T21:37:12.006 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-20T21:37:12.006 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-20T21:37:12.006 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-20T21:37:12.006 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-20T21:37:12.006 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-04-20T21:37:12.006 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-20T21:37:12.006 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-04-20T21:37:12.006 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-20T21:37:12.006 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-20T21:37:12.006 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-20T21:37:12.006 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-20T21:37:12.006 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-20T21:37:12.006 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-04-20T21:37:12.006 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-20T21:37:12.006 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-20T21:37:12.007 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-20T21:37:12.007 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-20T21:37:12.007 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-04-20T21:37:12.007 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-20T21:37:12.007 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-20T21:37:12.007 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-20T21:37:12.007 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-20T21:37:12.007 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-20T21:37:12.007 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-20T21:37:12.007 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-20T21:37:12.007 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-20T21:37:12.007 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-20T21:37:12.007 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-04-20T21:37:12.007 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-04-20T21:37:12.007 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-20T21:37:12.007 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-20T21:37:12.008 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-20T21:37:12.008 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-20T21:37:12.008 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-20T21:37:12.008 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-20T21:37:12.008 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-20T21:37:12.008 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-20T21:37:12.008 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-20T21:37:12.008 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-20T21:37:12.008 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-20T21:37:12.008 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-20T21:37:12.008 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-20T21:37:12.008 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-20T21:37:12.008 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-20T21:37:12.008 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-20T21:37:12.008 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-04-20T21:37:12.009 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-20T21:37:12.009 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-20T21:37:12.009 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-20T21:37:12.009 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-20T21:37:12.009 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-20T21:37:12.009 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-04-20T21:37:12.009 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-04-20T21:37:12.009 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-20T21:37:12.009 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-20T21:37:12.009 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-20T21:37:12.009 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-20T21:37:12.009 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-20T21:37:12.009 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-20T21:37:12.009 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-20T21:37:12.009 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-04-20T21:37:12.010 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-20T21:37:12.010 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-20T21:37:12.010 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-04-20T21:37:12.010 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-20T21:37:12.010 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-20T21:37:12.010 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-20T21:37:12.010 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-20T21:37:12.010 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-04-20T21:37:12.010 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-04-20T21:37:12.010 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-20T21:37:12.010 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-20T21:37:12.010 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-20T21:37:12.010 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-20T21:37:12.010 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-04-20T21:37:12.011 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-20T21:37:12.011 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-04-20T21:37:12.011 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-20T21:37:12.011 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-20T21:37:12.011 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-20T21:37:12.011 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-20T21:37:12.011 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-20T21:37:12.011 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-20T21:37:12.011 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-20T21:37:12.011 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-04-20T21:37:12.011 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-20T21:37:12.011 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-20T21:37:12.011 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-04-20T21:37:12.011 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-20T21:37:12.011 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-20T21:37:12.012 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-20T21:37:12.012 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-04-20T21:37:12.012 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-20T21:37:12.012 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-04-20T21:37:12.012 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-20T21:37:12.012 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-20T21:37:12.012 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-20T21:37:12.012 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-20T21:37:12.012 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-20T21:37:12.012 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-20T21:37:12.012 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-20T21:37:12.012 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-04-20T21:37:12.012 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-20T21:37:12.012 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-04-20T21:37:12.012 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-04-20T21:37:12.012 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-20T21:37:12.012 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-04-20T21:37:12.013 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-04-20T21:37:12.013 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-20T21:37:12.013 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-20T21:37:12.013 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-20T21:37:12.013 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-04-20T21:37:12.013 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-20T21:37:12.013 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-20T21:37:12.013 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-20T21:37:12.013 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-04-20T21:37:12.013 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-04-20T21:37:12.013 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-20T21:37:12.013 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-20T21:37:12.013 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-20T21:37:12.013 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-20T21:37:12.014 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-04-20T21:37:12.014 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-20T21:37:12.014 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-20T21:37:12.014 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-20T21:37:12.014 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-20T21:37:12.014 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-04-20T21:37:12.014 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-20T21:37:12.014 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-04-20T21:37:12.014 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-20T21:37:12.014 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-04-20T21:37:12.014 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-20T21:37:12.014 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-04-20T21:37:12.014 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-20T21:37:12.014 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-04-20T21:37:12.014 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-20T21:37:12.014 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-20T21:37:12.015 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-20T21:37:12.015 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-04-20T21:37:12.015 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-04-20T21:37:12.015 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-20T21:37:12.015 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-20T21:37:12.015 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-20T21:37:12.015 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-20T21:37:12.015 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-20T21:37:12.015 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-04-20T21:37:12.015 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-20T21:37:12.015 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-20T21:37:12.015 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-04-20T21:37:12.015 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-20T21:37:12.015 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-20T21:37:12.015 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-20T21:37:12.016 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-20T21:37:12.016 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-20T21:37:12.016 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-04-20T21:37:12.016 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-20T21:37:12.016 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-20T21:37:12.016 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-04-20T21:37:12.016 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-04-20T21:37:12.016 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-20T21:37:12.016 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-04-20T21:37:12.016 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-20T21:37:12.016 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-20T21:37:12.016 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-20T21:37:12.016 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-20T21:37:12.016 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-20T21:37:12.016 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-20T21:37:12.017 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-20T21:37:12.017 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-20T21:37:12.017 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-20T21:37:12.017 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-20T21:37:12.017 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-04-20T21:37:12.017 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-04-20T21:37:12.017 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-20T21:37:12.017 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-04-20T21:37:12.017 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-04-20T21:37:12.017 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-20T21:37:12.017 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-20T21:37:12.017 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-20T21:37:12.017 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-20T21:37:12.017 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-20T21:37:12.017 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-20T21:37:12.018 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-04-20T21:37:12.018 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-20T21:37:12.018 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-20T21:37:12.018 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-20T21:37:12.018 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-04-20T21:37:12.018 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-04-20T21:37:12.018 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-20T21:37:12.018 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-20T21:37:12.018 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-20T21:37:12.018 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-04-20T21:37:12.018 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-20T21:37:12.018 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-04-20T21:37:12.018 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-20T21:37:12.018 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-04-20T21:37:12.019 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-20T21:37:12.019 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-04-20T21:37:12.019 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-20T21:37:12.019 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-04-20T21:37:12.019 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-20T21:37:12.019 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-04-20T21:37:12.019 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-20T21:37:12.019 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-04-20T21:37:12.019 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-20T21:37:12.019 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-04-20T21:37:12.019 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-20T21:37:12.019 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-20T21:37:12.019 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-20T21:37:12.019 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-20T21:37:12.020 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-20T21:37:12.020 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-20T21:37:12.020 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-04-20T21:37:12.020 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-20T21:37:12.020 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-20T21:37:12.020 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-20T21:37:12.020 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-04-20T21:37:12.020 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-20T21:37:12.020 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-20T21:37:12.020 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-20T21:37:12.020 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-20T21:37:12.020 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-20T21:37:12.020 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-20T21:37:12.020 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-04-20T21:37:12.020 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-20T21:37:12.021 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-04-20T21:37:12.021 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-20T21:37:12.021 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-20T21:37:12.021 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-04-20T21:37:12.021 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-20T21:37:12.021 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-20T21:37:12.021 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-04-20T21:37:12.021 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-20T21:37:12.021 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-04-20T21:37:12.021 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-20T21:37:12.021 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-04-20T21:37:12.021 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-20T21:37:12.021 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-20T21:37:12.021 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-04-20T21:37:12.021 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-20T21:37:12.021 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-20T21:37:12.022 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-20T21:37:12.022 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-20T21:37:12.022 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-20T21:37:12.022 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-04-20T21:37:12.022 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-20T21:37:12.022 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-04-20T21:37:12.022 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-20T21:37:12.022 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-20T21:37:12.022 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-20T21:37:12.022 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-20T21:37:12.022 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-04-20T21:37:12.022 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-20T21:37:12.022 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-04-20T21:37:12.022 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-20T21:37:12.022 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-04-20T21:37:12.023 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-20T21:37:12.023 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-04-20T21:37:12.023 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-20T21:37:12.023 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-20T21:37:12.023 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-04-20T21:37:12.023 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-20T21:37:12.023 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-20T21:37:12.023 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-20T21:37:12.023 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-20T21:37:12.023 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-04-20T21:37:12.023 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-20T21:37:12.023 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-20T21:37:12.023 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-20T21:37:12.023 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-04-20T21:37:12.023 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-20T21:37:12.024 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-20T21:37:12.024 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-20T21:37:12.024 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-20T21:37:12.024 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-04-20T21:37:12.024 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-20T21:37:12.024 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-04-20T21:37:12.024 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-20T21:37:12.024 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-04-20T21:37:12.024 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-20T21:37:12.024 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-20T21:37:12.024 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-04-20T21:37:12.024 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-20T21:37:12.024 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-20T21:37:12.024 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-04-20T21:37:12.024 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-20T21:37:12.024 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-20T21:37:12.024 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-04-20T21:37:12.025 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-20T21:37:12.025 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-04-20T21:37:12.025 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-20T21:37:12.025 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-20T21:37:12.025 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-04-20T21:37:12.025 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-20T21:37:12.025 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-20T21:37:12.025 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-20T21:37:12.025 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-04-20T21:37:12.025 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-20T21:37:12.025 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-20T21:37:12.025 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-20T21:37:12.025 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-20T21:37:12.025 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-20T21:37:12.025 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-04-20T21:37:12.026 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-20T21:37:12.026 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-20T21:37:12.026 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-04-20T21:37:12.026 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-20T21:37:12.026 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-20T21:37:12.026 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-04-20T21:37:12.026 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-20T21:37:12.026 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-20T21:37:12.026 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-20T21:37:12.026 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-20T21:37:12.026 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-20T21:37:12.026 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-20T21:37:12.026 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-20T21:37:12.026 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-20T21:37:12.027 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-04-20T21:37:12.027 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-20T21:37:12.027 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-20T21:37:12.027 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-20T21:37:12.027 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-20T21:37:12.027 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-20T21:37:12.027 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-20T21:37:12.027 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-20T21:37:12.027 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-20T21:37:12.027 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-20T21:37:12.027 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-20T21:37:12.027 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-20T21:37:12.027 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-20T21:37:12.027 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-04-20T21:37:12.027 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-20T21:37:12.027 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-20T21:37:12.028 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-20T21:37:12.028 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-20T21:37:12.028 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-20T21:37:12.028 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-20T21:37:12.028 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-20T21:37:12.028 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-20T21:37:12.028 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-20T21:37:12.028 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-04-20T21:37:12.028 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-04-20T21:37:12.028 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-20T21:37:12.028 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-20T21:37:12.028 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-20T21:37:12.028 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-04-20T21:37:12.028 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-20T21:37:12.028 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-20T21:37:12.028 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-20T21:37:12.029 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-20T21:37:12.029 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-20T21:37:12.029 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-20T21:37:12.029 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-04-20T21:37:12.029 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-20T21:37:12.029 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-04-20T21:37:12.029 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-04-20T21:37:12.029 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-20T21:37:12.029 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-04-20T21:37:12.029 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-20T21:37:12.029 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-04-20T21:37:12.029 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-20T21:37:12.029 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-04-20T21:37:12.029 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-04-20T21:37:12.029 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-20T21:37:12.029 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-04-20T21:37:12.029 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-04-20T21:37:12.030 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-20T21:37:12.030 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-20T21:37:12.030 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-04-20T21:37:12.030 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-20T21:37:12.030 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-20T21:37:12.030 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-20T21:37:12.030 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-20T21:37:12.030 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-04-20T21:37:12.030 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-04-20T21:37:12.030 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-20T21:37:12.030 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-04-20T21:37:12.030 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-20T21:37:12.030 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-20T21:37:12.030 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-04-20T21:37:12.031 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-20T21:37:12.031 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-20T21:37:12.031 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-20T21:37:12.031 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-04-20T21:37:12.031 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-04-20T21:37:12.031 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-20T21:37:12.031 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-04-20T21:37:12.031 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-04-20T21:37:12.031 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-20T21:37:12.031 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-20T21:37:12.031 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-20T21:37:12.031 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-20T21:37:12.031 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-20T21:37:12.031 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-20T21:37:12.031 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-20T21:37:12.031 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-20T21:37:12.031 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-20T21:37:12.032 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-20T21:37:12.032 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-20T21:37:12.032 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-20T21:37:12.032 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-04-20T21:37:12.032 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-20T21:37:12.032 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-20T21:37:12.032 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-20T21:37:12.032 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-20T21:37:12.032 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-20T21:37:12.032 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-20T21:37:12.032 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-20T21:37:12.032 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-20T21:37:12.032 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-20T21:37:12.032 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-20T21:37:12.032 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-20T21:37:12.032 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-20T21:37:12.033 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-04-20T21:37:12.033 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-20T21:37:12.033 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-20T21:37:12.033 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-04-20T21:37:12.033 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-04-20T21:37:12.033 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-20T21:37:12.033 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-20T21:37:12.033 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-20T21:37:12.033 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-20T21:37:12.033 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-04-20T21:37:12.033 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-20T21:37:12.033 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-20T21:37:12.033 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-04-20T21:37:12.033 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-04-20T21:37:12.033 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-04-20T21:37:12.033 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-20T21:37:12.033 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-20T21:37:12.034 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-04-20T21:37:12.034 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-20T21:37:12.034 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-20T21:37:12.034 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-20T21:37:12.034 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-20T21:37:12.034 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-20T21:37:12.034 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-20T21:37:12.034 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-20T21:37:12.034 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-20T21:37:12.034 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-20T21:37:12.034 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-20T21:37:12.034 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-20T21:37:12.034 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-20T21:37:12.034 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-20T21:37:12.035 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-20T21:37:12.035 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-20T21:37:12.035 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-20T21:37:12.035 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-20T21:37:12.035 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-20T21:37:12.035 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-20T21:37:12.035 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-20T21:37:12.035 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-20T21:37:12.035 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-20T21:37:12.035 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-20T21:37:12.035 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-20T21:37:12.035 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-20T21:37:12.035 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-20T21:37:12.035 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-20T21:37:12.035 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-20T21:37:12.035 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-20T21:37:12.035 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-20T21:37:12.036 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-20T21:37:12.036 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-04-20T21:37:12.036 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-20T21:37:12.036 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-20T21:37:12.036 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-20T21:37:12.036 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-20T21:37:12.036 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-20T21:37:12.036 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-04-20T21:37:12.036 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-20T21:37:12.036 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-20T21:37:12.036 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-04-20T21:37:12.036 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-20T21:37:12.036 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-20T21:37:12.036 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-20T21:37:12.036 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-04-20T21:37:12.036 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-20T21:37:12.036 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-20T21:37:12.037 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-04-20T21:37:12.037 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-20T21:37:12.037 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-04-20T21:37:12.037 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-20T21:37:12.037 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-04-20T21:37:12.037 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-20T21:37:12.037 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-04-20T21:37:12.037 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-20T21:37:12.037 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-20T21:37:12.037 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-04-20T21:37:12.037 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-20T21:37:12.037 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-04-20T21:37:12.037 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-20T21:37:12.037 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-20T21:37:12.037 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-20T21:37:12.037 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-20T21:37:12.038 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-20T21:37:12.038 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-20T21:37:12.038 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-04-20T21:37:12.038 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-20T21:37:12.038 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-20T21:37:12.038 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-20T21:37:12.038 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-20T21:37:12.038 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-20T21:37:12.038 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-04-20T21:37:12.038 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-20T21:37:12.038 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-20T21:37:12.038 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-04-20T21:37:12.038 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-20T21:37:12.038 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-20T21:37:12.039 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-04-20T21:37:12.039 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-20T21:37:12.039 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-20T21:37:12.039 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-20T21:37:12.039 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-20T21:37:12.039 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-20T21:37:12.039 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-20T21:37:12.039 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-20T21:37:12.039 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-04-20T21:37:12.039 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-20T21:37:12.039 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-20T21:37:12.039 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-20T21:37:12.039 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-04-20T21:37:12.039 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-20T21:37:12.039 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-20T21:37:12.039 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-20T21:37:12.040 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-04-20T21:37:12.040 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-20T21:37:12.040 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-04-20T21:37:12.040 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-20T21:37:12.040 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-04-20T21:37:12.040 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-20T21:37:12.040 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-20T21:37:12.040 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-20T21:37:12.040 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-20T21:37:12.040 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-04-20T21:37:12.040 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-20T21:37:12.040 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-04-20T21:37:12.040 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-20T21:37:12.040 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-20T21:37:12.040 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-04-20T21:37:12.040 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-20T21:37:12.040 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-20T21:37:12.041 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-20T21:37:12.041 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-04-20T21:37:12.041 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-20T21:37:12.041 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-20T21:37:12.041 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-04-20T21:37:12.041 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-20T21:37:12.041 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-20T21:37:12.041 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-20T21:37:12.041 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-20T21:37:12.041 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-20T21:37:12.041 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-20T21:37:12.041 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-20T21:37:12.041 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-20T21:37:12.041 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-20T21:37:12.041 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-20T21:37:12.041 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-20T21:37:12.041 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-04-20T21:37:12.042 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-20T21:37:12.042 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-20T21:37:12.042 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-20T21:37:12.042 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-20T21:37:12.042 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-04-20T21:37:12.042 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-20T21:37:12.042 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-04-20T21:37:12.042 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-04-20T21:37:12.042 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-20T21:37:12.042 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-04-20T21:37:12.042 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-20T21:37:12.042 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-20T21:37:12.042 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-20T21:37:12.042 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-20T21:37:12.042 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-20T21:37:12.043 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-20T21:37:12.043 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-04-20T21:37:12.043 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-20T21:37:12.043 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-04-20T21:37:12.043 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-04-20T21:37:12.043 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-04-20T21:37:12.043 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-20T21:37:12.043 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-20T21:37:12.043 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-20T21:37:12.043 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-20T21:37:12.043 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-20T21:37:12.043 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-20T21:37:12.043 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-20T21:37:12.043 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-20T21:37:12.043 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-20T21:37:12.043 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-20T21:37:12.043 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-20T21:37:12.044 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-20T21:37:12.044 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-20T21:37:12.044 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-20T21:37:12.044 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-20T21:37:12.044 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-20T21:37:12.044 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-20T21:37:12.044 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-20T21:37:12.044 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-04-20T21:37:12.044 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-04-20T21:37:12.044 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-20T21:37:12.044 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-20T21:37:12.044 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-20T21:37:12.044 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-20T21:37:12.044 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-04-20T21:37:12.044 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-04-20T21:37:12.045 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-20T21:37:12.045 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-20T21:37:12.045 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-04-20T21:37:12.045 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-20T21:37:12.045 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-04-20T21:37:12.045 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-04-20T21:37:12.045 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-20T21:37:12.045 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-04-20T21:37:12.045 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-20T21:37:12.045 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-04-20T21:37:12.045 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-20T21:37:12.045 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-20T21:37:12.045 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-20T21:37:12.045 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-20T21:37:12.045 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-20T21:37:12.045 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-04-20T21:37:12.046 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-04-20T21:37:12.046 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-20T21:37:12.046 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-20T21:37:12.046 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-20T21:37:12.046 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-20T21:37:12.046 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-04-20T21:37:12.046 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-20T21:37:12.046 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-04-20T21:37:12.046 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-20T21:37:12.046 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-20T21:37:12.046 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-04-20T21:37:12.046 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-20T21:37:12.046 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-20T21:37:12.046 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-20T21:37:12.046 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-20T21:37:12.047 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-20T21:37:12.047 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-20T21:37:12.047 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-20T21:37:12.047 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-20T21:37:12.047 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-20T21:37:12.047 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-20T21:37:12.047 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-04-20T21:37:12.047 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-20T21:37:12.047 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-20T21:37:12.047 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-20T21:37:12.047 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-20T21:37:12.047 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-20T21:37:12.047 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-20T21:37:12.047 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-20T21:37:12.047 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-04-20T21:37:12.047 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-20T21:37:12.047 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-04-20T21:37:12.048 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-20T21:37:12.048 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-20T21:37:12.048 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-20T21:37:12.048 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-20T21:37:12.048 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-20T21:37:12.048 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-20T21:37:12.048 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-20T21:37:12.048 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-20T21:37:12.048 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-20T21:37:12.048 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-20T21:37:12.048 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-20T21:37:12.048 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-20T21:37:12.048 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-20T21:37:12.048 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-20T21:37:12.048 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-20T21:37:12.048 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-20T21:37:12.048 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-20T21:37:12.049 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-20T21:37:12.049 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-20T21:37:12.049 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-20T21:37:12.049 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-20T21:37:12.049 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-20T21:37:12.049 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-20T21:37:12.049 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-20T21:37:12.049 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-20T21:37:12.049 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-20T21:37:12.049 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-20T21:37:12.049 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-20T21:37:12.049 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-20T21:37:12.049 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-20T21:37:12.049 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-20T21:37:12.049 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-20T21:37:12.050 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-20T21:37:12.050 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-20T21:37:12.050 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-20T21:37:12.050 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-20T21:37:12.050 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-20T21:37:12.050 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-20T21:37:12.050 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-20T21:37:12.050 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-20T21:37:12.050 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-20T21:37:12.050 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-20T21:37:12.050 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-20T21:37:12.050 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-20T21:37:12.050 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-20T21:37:12.050 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-04-20T21:37:12.050 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-20T21:37:12.051 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-20T21:37:12.051 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-20T21:37:12.051 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-20T21:37:12.051 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-20T21:37:12.051 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-20T21:37:12.051 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-20T21:37:12.051 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-20T21:37:12.051 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-20T21:37:12.051 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-20T21:37:12.051 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-20T21:37:12.051 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-20T21:37:12.051 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-20T21:37:12.051 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-20T21:37:12.051 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-20T21:37:12.051 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-04-20T21:37:12.051 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-20T21:37:12.052 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-20T21:37:12.052 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-20T21:37:12.052 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-04-20T21:37:12.052 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-04-20T21:37:12.052 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-20T21:37:12.052 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-20T21:37:12.052 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-20T21:37:12.052 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-20T21:37:12.052 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-04-20T21:37:12.052 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-20T21:37:12.052 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-20T21:37:12.052 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-20T21:37:12.052 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-20T21:37:12.052 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-04-20T21:37:12.052 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-04-20T21:37:12.052 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-20T21:37:12.053 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-20T21:37:12.053 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-20T21:37:12.053 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-04-20T21:37:12.053 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-04-20T21:37:12.053 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-04-20T21:37:12.053 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-04-20T21:37:12.053 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-04-20T21:37:12.053 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-20T21:37:12.053 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-20T21:37:12.053 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-04-20T21:37:12.053 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-04-20T21:37:12.053 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-04-20T21:37:12.053 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-20T21:37:12.053 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-20T21:37:12.053 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-04-20T21:37:12.053 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-20T21:37:12.054 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-20T21:37:12.054 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-20T21:37:12.054 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-20T21:37:12.054 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-20T21:37:12.054 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-20T21:37:12.054 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-20T21:37:12.054 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-20T21:37:12.054 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-20T21:37:12.054 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-20T21:37:12.054 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-20T21:37:12.054 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-20T21:37:12.054 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-04-20T21:37:12.054 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-20T21:37:12.054 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-20T21:37:12.054 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-20T21:37:12.054 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-20T21:37:12.055 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-20T21:37:12.055 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-20T21:37:12.055 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-20T21:37:12.055 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-20T21:37:12.055 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-20T21:37:12.055 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-20T21:37:12.055 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-20T21:37:12.055 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-20T21:37:12.055 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-20T21:37:12.055 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-20T21:37:12.055 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-20T21:37:12.055 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-20T21:37:12.055 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-20T21:37:12.055 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-20T21:37:12.055 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-20T21:37:12.055 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-20T21:37:12.055 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-20T21:37:12.056 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-20T21:37:12.056 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-20T21:37:12.056 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-20T21:37:12.056 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-20T21:37:12.056 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-20T21:37:12.056 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-04-20T21:37:12.056 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-20T21:37:12.056 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-20T21:37:12.056 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-20T21:37:12.056 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-20T21:37:12.056 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-04-20T21:37:12.056 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-20T21:37:12.056 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-20T21:37:12.056 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-04-20T21:37:12.056 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-20T21:37:12.056 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-04-20T21:37:12.056 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-04-20T21:37:12.057 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-20T21:37:12.057 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-04-20T21:37:12.057 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-20T21:37:12.057 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-04-20T21:37:12.057 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-20T21:37:12.057 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-20T21:37:12.057 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-04-20T21:37:12.057 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-20T21:37:12.057 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-04-20T21:37:12.057 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-20T21:37:12.057 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-04-20T21:37:12.057 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-20T21:37:12.057 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-04-20T21:37:12.057 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-20T21:37:12.057 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-04-20T21:37:12.057 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-20T21:37:12.057 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-04-20T21:37:12.058 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-20T21:37:12.058 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-04-20T21:37:12.058 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-20T21:37:12.058 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-04-20T21:37:12.058 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-20T21:37:12.058 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-04-20T21:37:12.058 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-04-20T21:37:12.058 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-20T21:37:12.058 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-04-20T21:37:12.058 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-04-20T21:37:12.058 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-20T21:37:12.058 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-04-20T21:37:12.058 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-04-20T21:37:12.058 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-20T21:37:12.058 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-04-20T21:37:12.059 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-20T21:37:12.059 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-04-20T21:37:12.059 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-20T21:37:12.059 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-04-20T21:37:12.059 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-20T21:37:12.059 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-04-20T21:37:12.059 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-20T21:37:12.059 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-04-20T21:37:12.059 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-20T21:37:12.059 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-04-20T21:37:12.059 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-20T21:37:12.059 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-04-20T21:37:12.059 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-20T21:37:12.059 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-04-20T21:37:12.059 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-04-20T21:37:12.059 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-20T21:37:12.060 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-04-20T21:37:12.060 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-20T21:37:12.060 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-04-20T21:37:12.060 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-20T21:37:12.060 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-20T21:37:12.060 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-20T21:37:12.060 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-20T21:37:12.060 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-04-20T21:37:12.060 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-20T21:37:12.060 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-20T21:37:12.060 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-04-20T21:37:12.060 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-20T21:37:12.060 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-04-20T21:37:12.060 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-20T21:37:12.060 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-04-20T21:37:12.060 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-20T21:37:12.060 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-20T21:37:12.061 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-20T21:37:12.061 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-20T21:37:12.061 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-20T21:37:12.061 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-20T21:37:12.061 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-20T21:37:12.061 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-20T21:37:12.061 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-20T21:37:12.061 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-20T21:37:12.061 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-20T21:37:12.061 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-20T21:37:12.061 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-20T21:37:12.061 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-20T21:37:12.061 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-20T21:37:12.061 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-20T21:37:12.061 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-20T21:37:12.061 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-20T21:37:12.062 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-20T21:37:12.062 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-20T21:37:12.062 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-20T21:37:12.062 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-20T21:37:12.062 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-20T21:37:12.062 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-20T21:37:12.062 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-20T21:37:12.062 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-20T21:37:12.062 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-20T21:37:12.062 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-20T21:37:12.062 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-20T21:37:12.062 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-20T21:37:12.062 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-20T21:37:12.062 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-20T21:37:12.062 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-20T21:37:12.062 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-20T21:37:12.063 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-20T21:37:12.063 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-20T21:37:12.063 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-20T21:37:12.063 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-20T21:37:12.063 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-20T21:37:12.063 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-20T21:37:12.063 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-20T21:37:12.063 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-20T21:37:12.063 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-20T21:37:12.063 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-20T21:37:12.063 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-20T21:37:12.063 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-20T21:37:12.063 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-20T21:37:12.063 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-20T21:37:12.063 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-20T21:37:12.063 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-20T21:37:12.063 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-04-20T21:37:12.064 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-04-20T21:37:12.064 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-20T21:37:12.064 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-04-20T21:37:12.064 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-20T21:37:12.064 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-04-20T21:37:12.064 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-20T21:37:12.064 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-20T21:37:12.064 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-20T21:37:12.064 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-20T21:37:12.064 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-20T21:37:12.064 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-04-20T21:37:12.064 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-20T21:37:12.064 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-04-20T21:37:12.064 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-20T21:37:12.064 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-04-20T21:37:12.064 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-20T21:37:12.065 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-04-20T21:37:12.065 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-20T21:37:12.065 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-04-20T21:37:12.065 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-04-20T21:37:12.065 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-20T21:37:12.065 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-04-20T21:37:12.065 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-20T21:37:12.065 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-20T21:37:12.065 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-04-20T21:37:12.065 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-20T21:37:12.065 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-04-20T21:37:12.065 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-20T21:37:12.065 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-04-20T21:37:12.065 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-20T21:37:12.065 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-04-20T21:37:12.065 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-20T21:37:12.065 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-04-20T21:37:12.066 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-20T21:37:12.066 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-04-20T21:37:12.066 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-04-20T21:37:12.066 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-04-20T21:37:12.066 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-20T21:37:12.066 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-04-20T21:37:12.066 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-20T21:37:12.066 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-04-20T21:37:12.066 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-04-20T21:37:12.066 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-20T21:37:12.066 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-20T21:37:12.066 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-04-20T21:37:12.066 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-20T21:37:12.066 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-20T21:37:12.066 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-20T21:37:12.066 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-20T21:37:12.067 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-04-20T21:37:12.067 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-20T21:37:12.067 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-20T21:37:12.067 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-04-20T21:37:12.067 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-20T21:37:12.067 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-04-20T21:37:12.067 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-20T21:37:12.067 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-04-20T21:37:12.067 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-20T21:37:12.067 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-20T21:37:12.067 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-20T21:37:12.067 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-20T21:37:12.067 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-04-20T21:37:12.067 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-04-20T21:37:12.067 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-04-20T21:37:12.067 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-20T21:37:12.068 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-04-20T21:37:12.068 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-04-20T21:37:12.068 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-20T21:37:12.068 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-20T21:37:12.068 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-20T21:37:12.068 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-20T21:37:12.068 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-20T21:37:12.068 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-20T21:37:12.068 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-20T21:37:12.068 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-20T21:37:12.068 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-04-20T21:37:12.068 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-20T21:37:12.068 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-20T21:37:12.068 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-20T21:37:12.068 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-20T21:37:12.068 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-20T21:37:12.068 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-04-20T21:37:12.069 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-20T21:37:12.069 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-04-20T21:37:12.069 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-20T21:37:12.069 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-20T21:37:12.069 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-20T21:37:12.069 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-20T21:37:12.069 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-04-20T21:37:12.069 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-20T21:37:12.069 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-04-20T21:37:12.069 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-20T21:37:12.069 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-20T21:37:12.069 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-04-20T21:37:12.069 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-20T21:37:12.069 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-20T21:37:12.069 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-20T21:37:12.069 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-20T21:37:12.069 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-20T21:37:12.070 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-20T21:37:12.070 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-20T21:37:12.070 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-20T21:37:12.070 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-20T21:37:12.070 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-20T21:37:12.070 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-20T21:37:12.070 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-20T21:37:12.070 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-20T21:37:12.070 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-20T21:37:12.070 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-20T21:37:12.070 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-20T21:37:12.070 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-20T21:37:12.070 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-20T21:37:12.070 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-20T21:37:12.070 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-20T21:37:12.070 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-20T21:37:12.071 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-20T21:37:12.071 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-20T21:37:12.071 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-20T21:37:12.071 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-04-20T21:37:12.071 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-20T21:37:12.071 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-04-20T21:37:12.071 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-04-20T21:37:12.071 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-20T21:37:12.071 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-04-20T21:37:12.071 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-20T21:37:12.071 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-20T21:37:12.071 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-20T21:37:12.071 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-20T21:37:12.071 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-04-20T21:37:12.071 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-04-20T21:37:12.071 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-04-20T21:37:12.072 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-20T21:37:12.072 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-20T21:37:12.072 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-20T21:37:12.072 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-20T21:37:12.072 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-20T21:37:12.072 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-04-20T21:37:12.072 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-04-20T21:37:12.072 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-20T21:37:12.072 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-20T21:37:12.072 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-20T21:37:12.072 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-04-20T21:37:12.072 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-20T21:37:12.072 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-20T21:37:12.072 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-20T21:37:12.072 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-20T21:37:12.072 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-20T21:37:12.073 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-20T21:37:12.073 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-20T21:37:12.073 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-20T21:37:12.073 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-20T21:37:12.073 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-20T21:37:12.073 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-04-20T21:37:12.073 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-20T21:37:12.073 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-20T21:37:12.073 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-20T21:37:12.073 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-20T21:37:12.073 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-20T21:37:12.073 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-20T21:37:12.073 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-20T21:37:12.073 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-20T21:37:12.073 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-20T21:37:12.073 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-20T21:37:12.074 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-20T21:37:12.074 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-20T21:37:12.074 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-20T21:37:12.074 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-20T21:37:12.074 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-20T21:37:12.074 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-20T21:37:12.074 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-20T21:37:12.074 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-20T21:37:12.074 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-20T21:37:12.074 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-20T21:37:12.074 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-20T21:37:12.074 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-20T21:37:12.074 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-20T21:37:12.074 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-20T21:37:12.074 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-20T21:37:12.075 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-20T21:37:12.075 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-20T21:37:12.075 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-20T21:37:12.075 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-20T21:37:12.075 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-20T21:37:12.075 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-20T21:37:12.075 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-20T21:37:12.075 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-20T21:37:12.075 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-20T21:37:12.075 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-20T21:37:12.075 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-20T21:37:12.075 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-20T21:37:12.075 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-20T21:37:12.075 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-04-20T21:37:12.075 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-20T21:37:12.075 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-20T21:37:12.076 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-20T21:37:12.076 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-20T21:37:12.076 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-20T21:37:12.076 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-20T21:37:12.076 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-20T21:37:12.076 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-04-20T21:37:12.076 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-20T21:37:12.076 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-20T21:37:12.076 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-20T21:37:12.076 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-20T21:37:12.076 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-20T21:37:12.076 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-20T21:37:12.076 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-20T21:37:12.076 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-20T21:37:12.076 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-20T21:37:12.076 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-20T21:37:12.077 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-20T21:37:12.077 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-20T21:37:12.077 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-20T21:37:12.077 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-20T21:37:12.077 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-20T21:37:12.077 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-20T21:37:12.077 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-20T21:37:12.077 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-20T21:37:12.077 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-20T21:37:12.077 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-20T21:37:12.077 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-20T21:37:12.077 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-20T21:37:12.077 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-20T21:37:12.077 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-20T21:37:12.077 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-20T21:37:12.077 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-20T21:37:12.077 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-20T21:37:12.078 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-04-20T21:37:12.078 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-20T21:37:12.078 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-04-20T21:37:12.078 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-20T21:37:12.078 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-20T21:37:12.078 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-20T21:37:12.078 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-20T21:37:12.078 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-20T21:37:12.078 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-20T21:37:12.078 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-20T21:37:12.078 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-04-20T21:37:12.078 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-20T21:37:12.078 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-04-20T21:37:12.078 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-20T21:37:12.078 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-04-20T21:37:12.078 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-20T21:37:12.079 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-04-20T21:37:12.079 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-04-20T21:37:12.079 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-20T21:37:12.079 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-20T21:37:12.079 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-20T21:37:12.079 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-20T21:37:12.079 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-20T21:37:12.079 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-20T21:37:12.079 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-20T21:37:12.079 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-20T21:37:12.079 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-20T21:37:12.079 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-20T21:37:12.079 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-20T21:37:12.079 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-20T21:37:12.079 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-20T21:37:12.079 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-20T21:37:12.079 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-20T21:37:12.080 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-20T21:37:12.080 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-04-20T21:37:12.080 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-20T21:37:12.080 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-20T21:37:12.080 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-20T21:37:12.080 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-20T21:37:12.080 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-20T21:37:12.080 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-20T21:37:12.080 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-20T21:37:12.080 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-20T21:37:12.080 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-20T21:37:12.080 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-20T21:37:12.080 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-20T21:37:12.080 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-20T21:37:12.080 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-20T21:37:12.080 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-20T21:37:12.080 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-20T21:37:12.081 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-20T21:37:12.081 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-20T21:37:12.081 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-20T21:37:12.081 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-20T21:37:12.081 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-20T21:37:12.081 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-20T21:37:12.081 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-20T21:37:12.081 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-20T21:37:12.081 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-20T21:37:12.081 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-20T21:37:12.081 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-20T21:37:12.081 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-20T21:37:12.081 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-20T21:37:12.081 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-20T21:37:12.081 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-20T21:37:12.082 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-20T21:37:12.082 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-20T21:37:12.082 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-20T21:37:12.082 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-20T21:37:12.082 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-20T21:37:12.082 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-20T21:37:12.082 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-20T21:37:12.082 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-20T21:37:12.082 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-20T21:37:12.082 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-20T21:37:12.082 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-20T21:37:12.082 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-20T21:37:12.082 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-20T21:37:12.082 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-20T21:37:12.082 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-20T21:37:12.082 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-20T21:37:12.083 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-20T21:37:12.083 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-20T21:37:12.083 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-20T21:37:12.083 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-20T21:37:12.083 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-20T21:37:12.083 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-20T21:37:12.083 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-20T21:37:12.083 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-20T21:37:12.083 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-20T21:37:12.083 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-20T21:37:12.083 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-20T21:37:12.083 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-20T21:37:12.083 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-04-20T21:37:12.083 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-20T21:37:12.083 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-20T21:37:12.083 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-20T21:37:12.083 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-20T21:37:12.084 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-04-20T21:37:12.084 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-20T21:37:12.084 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-20T21:37:12.084 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-20T21:37:12.084 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-20T21:37:12.084 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-20T21:37:12.084 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-20T21:37:12.084 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-20T21:37:12.084 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-20T21:37:12.084 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-20T21:37:12.084 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-20T21:37:12.084 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-20T21:37:12.084 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-20T21:37:12.084 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-20T21:37:12.084 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-20T21:37:12.084 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-20T21:37:12.084 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-20T21:37:12.085 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-20T21:37:12.085 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-20T21:37:12.085 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-20T21:37:12.085 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-20T21:37:12.085 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-20T21:37:12.085 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-20T21:37:12.085 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-20T21:37:12.085 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-20T21:37:12.085 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-20T21:37:12.085 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-20T21:37:12.085 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-20T21:37:12.085 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-20T21:37:12.085 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-20T21:37:12.085 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-20T21:37:12.085 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-20T21:37:12.085 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-20T21:37:12.086 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-20T21:37:12.086 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-20T21:37:12.086 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-20T21:37:12.086 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-20T21:37:12.086 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-20T21:37:12.086 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-20T21:37:12.086 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-20T21:37:12.086 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-20T21:37:12.086 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-20T21:37:12.086 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-20T21:37:12.086 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-20T21:37:12.086 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-20T21:37:12.086 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-20T21:37:12.086 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-20T21:37:12.086 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-20T21:37:12.086 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-20T21:37:12.086 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-20T21:37:12.087 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-20T21:37:12.087 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-20T21:37:12.087 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-20T21:37:12.087 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-20T21:37:12.087 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-20T21:37:12.087 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-20T21:37:12.087 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-20T21:37:12.087 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-20T21:37:12.087 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-20T21:37:12.087 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-20T21:37:12.087 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-20T21:37:12.087 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-20T21:37:12.087 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-20T21:37:12.087 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-20T21:37:12.087 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-20T21:37:12.087 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-20T21:37:12.088 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-20T21:37:12.088 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-20T21:37:12.088 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-20T21:37:12.088 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-20T21:37:12.088 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-20T21:37:12.088 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-20T21:37:12.088 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-04-20T21:37:12.088 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-20T21:37:12.088 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-04-20T21:37:12.088 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-20T21:37:12.088 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-04-20T21:37:12.088 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-20T21:37:12.088 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-20T21:37:12.088 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-20T21:37:12.088 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-20T21:37:12.088 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-04-20T21:37:12.088 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-20T21:37:12.089 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-04-20T21:37:12.089 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-20T21:37:12.089 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-20T21:37:12.089 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-20T21:37:12.089 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-04-20T21:37:12.089 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-20T21:37:12.089 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-20T21:37:12.089 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-20T21:37:12.089 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-20T21:37:12.089 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-20T21:37:12.089 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-20T21:37:12.089 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-20T21:37:12.089 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-20T21:37:12.089 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-20T21:37:12.089 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-20T21:37:12.089 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-20T21:37:12.089 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-20T21:37:12.090 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-20T21:37:12.090 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-20T21:37:12.090 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-20T21:37:12.090 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-20T21:37:12.090 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-20T21:37:12.090 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-20T21:37:12.090 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-20T21:37:12.090 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-20T21:37:12.090 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-20T21:37:12.090 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-20T21:37:12.090 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-20T21:37:12.090 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-20T21:37:12.090 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-20T21:37:12.090 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-20T21:37:12.090 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-20T21:37:12.091 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-20T21:37:12.091 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-20T21:37:12.091 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-20T21:37:12.091 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-20T21:37:12.091 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-20T21:37:12.091 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-20T21:37:12.091 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-20T21:37:12.091 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-20T21:37:12.091 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-20T21:37:12.091 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-20T21:37:12.091 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-20T21:37:12.091 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-20T21:37:12.091 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-20T21:37:12.091 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-20T21:37:12.091 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-20T21:37:12.092 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-20T21:37:12.092 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-04-20T21:37:12.092 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-20T21:37:12.092 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-20T21:37:12.092 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-04-20T21:37:12.092 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-04-20T21:37:12.092 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-20T21:37:12.092 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-20T21:37:12.092 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-20T21:37:12.092 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-04-20T21:37:12.092 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-20T21:37:12.092 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-04-20T21:37:12.092 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-20T21:37:12.092 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-20T21:37:12.092 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-04-20T21:37:12.092 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-20T21:37:12.093 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-04-20T21:37:12.093 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-20T21:37:12.093 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-20T21:37:12.093 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-20T21:37:12.093 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-20T21:37:12.093 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-20T21:37:12.093 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-04-20T21:37:12.093 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-20T21:37:12.093 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-04-20T21:37:12.093 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-04-20T21:37:12.093 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-04-20T21:37:12.093 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-20T21:37:12.093 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-04-20T21:37:12.093 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-04-20T21:37:12.093 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-20T21:37:12.093 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-20T21:37:12.093 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-20T21:37:12.094 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-20T21:37:12.094 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-20T21:37:12.094 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-20T21:37:12.094 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-20T21:37:12.094 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-20T21:37:12.094 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-20T21:37:12.094 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-20T21:37:12.094 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-20T21:37:12.094 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-20T21:37:12.094 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-20T21:37:12.094 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-20T21:37:12.097 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-20T21:37:12.097 DEBUG:teuthology.orchestra.run.smithi164:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-20T21:37:12.119 INFO:teuthology.orchestra.run.smithi164.stdout:postinstall scriptlet (using /bin/sh): 2024-04-20T21:37:12.119 INFO:teuthology.orchestra.run.smithi164.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-20T21:37:12.119 INFO:teuthology.orchestra.run.smithi164.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-04-20T21:37:12.119 INFO:teuthology.orchestra.run.smithi164.stdout:fi 2024-04-20T21:37:12.119 INFO:teuthology.orchestra.run.smithi164.stdout:for file in vmlinuz System.map config; do 2024-04-20T21:37:12.120 INFO:teuthology.orchestra.run.smithi164.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-04-20T21:37:12.120 INFO:teuthology.orchestra.run.smithi164.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-04-20T21:37:12.120 INFO:teuthology.orchestra.run.smithi164.stdout: fi 2024-04-20T21:37:12.120 INFO:teuthology.orchestra.run.smithi164.stdout:done 2024-04-20T21:37:12.120 INFO:teuthology.orchestra.run.smithi164.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-04-20T21:37:12.120 INFO:teuthology.orchestra.run.smithi164.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-04-20T21:37:12.120 INFO:teuthology.orchestra.run.smithi164.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-20T21:37:12.120 INFO:teuthology.orchestra.run.smithi164.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-04-20T21:37:12.120 INFO:teuthology.orchestra.run.smithi164.stdout:fi 2024-04-20T21:37:12.120 INFO:teuthology.orchestra.run.smithi164.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-04-20T21:37:12.120 INFO:teuthology.orchestra.run.smithi164.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-04-20T21:37:12.120 INFO:teuthology.orchestra.run.smithi164.stdout:fi 2024-04-20T21:37:12.120 INFO:teuthology.orchestra.run.smithi164.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-20T21:37:12.120 INFO:teuthology.orchestra.run.smithi164.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-20T21:37:12.120 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-04-20T21:37:12.120 INFO:teuthology.orchestra.run.smithi164.stdout:fi 2024-04-20T21:37:12.121 DEBUG:teuthology.orchestra.run.smithi164:> sudo rpm -qi grub2-tools 2024-04-20T21:37:12.194 INFO:teuthology.orchestra.run.smithi164.stdout:Name : grub2-tools 2024-04-20T21:37:12.194 INFO:teuthology.orchestra.run.smithi164.stdout:Epoch : 1 2024-04-20T21:37:12.194 INFO:teuthology.orchestra.run.smithi164.stdout:Version : 2.06 2024-04-20T21:37:12.194 INFO:teuthology.orchestra.run.smithi164.stdout:Release : 68.el9 2024-04-20T21:37:12.195 INFO:teuthology.orchestra.run.smithi164.stdout:Architecture: x86_64 2024-04-20T21:37:12.195 INFO:teuthology.orchestra.run.smithi164.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-04-20T21:37:12.195 INFO:teuthology.orchestra.run.smithi164.stdout:Group : Unspecified 2024-04-20T21:37:12.195 INFO:teuthology.orchestra.run.smithi164.stdout:Size : 8264254 2024-04-20T21:37:12.195 INFO:teuthology.orchestra.run.smithi164.stdout:License : GPLv3+ 2024-04-20T21:37:12.195 INFO:teuthology.orchestra.run.smithi164.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-20T21:37:12.195 INFO:teuthology.orchestra.run.smithi164.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-20T21:37:12.195 INFO:teuthology.orchestra.run.smithi164.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-20T21:37:12.195 INFO:teuthology.orchestra.run.smithi164.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-20T21:37:12.195 INFO:teuthology.orchestra.run.smithi164.stdout:Packager : builder@centos.org 2024-04-20T21:37:12.195 INFO:teuthology.orchestra.run.smithi164.stdout:Vendor : CentOS 2024-04-20T21:37:12.195 INFO:teuthology.orchestra.run.smithi164.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-20T21:37:12.195 INFO:teuthology.orchestra.run.smithi164.stdout:Summary : Support tools for GRUB. 2024-04-20T21:37:12.195 INFO:teuthology.orchestra.run.smithi164.stdout:Description : 2024-04-20T21:37:12.195 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:37:12.195 INFO:teuthology.orchestra.run.smithi164.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-20T21:37:12.196 INFO:teuthology.orchestra.run.smithi164.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-20T21:37:12.196 INFO:teuthology.orchestra.run.smithi164.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-20T21:37:12.196 INFO:teuthology.orchestra.run.smithi164.stdout:hardware devices. 2024-04-20T21:37:12.196 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:37:12.196 INFO:teuthology.orchestra.run.smithi164.stdout:This subpackage provides tools for support of all platforms. 2024-04-20T21:37:12.197 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-20T21:37:12.197 INFO:teuthology.task.kernel:Updating grub on smithi164 to boot 6.9.0-rc3-g806ec36b2112 2024-04-20T21:37:12.197 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-20T21:37:12.733 INFO:teuthology.orchestra.run.smithi164.stderr:Generating grub configuration file ... 2024-04-20T21:37:14.113 INFO:teuthology.orchestra.run.smithi164.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-20T21:37:14.140 INFO:teuthology.orchestra.run.smithi164.stderr:done 2024-04-20T21:37:14.142 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-04-20T21:37:14.157 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.HuPHcCMPes 2024-04-20T21:37:14.158 DEBUG:teuthology.orchestra.run.smithi164:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HuPHcCMPes 2024-04-20T21:37:14.236 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.HuPHcCMPes 2024-04-20T21:37:14.375 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.HuPHcCMPes is 6KB 2024-04-20T21:37:14.422 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.HuPHcCMPes 2024-04-20T21:37:14.436 DEBUG:teuthology.orchestra.run.smithi164:> sudo /bin/ls /boot/loader/entries || true 2024-04-20T21:37:14.498 INFO:teuthology.orchestra.run.smithi164.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-04-20T21:37:14.498 INFO:teuthology.orchestra.run.smithi164.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-04-20T21:37:14.498 INFO:teuthology.orchestra.run.smithi164.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-04-20T21:37:14.498 INFO:teuthology.orchestra.run.smithi164.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-04-20T21:37:14.500 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-04-20T21:37:14.654 DEBUG:teuthology.orchestra.run.smithi164:> sudo shutdown -r now 2024-04-20T21:37:24.594 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-04-20T21:37:24.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-20T21:37:24.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:37:44.678 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-04-20T21:37:44.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-20T21:37:44.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:38:03.171 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-20T21:38:12.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-20T21:38:12.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:38:15.262 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-20T21:38:24.602 DEBUG:teuthology.orchestra.remote:timed out 2024-04-20T21:38:27.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-20T21:38:27.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:38:33.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-20T21:38:33.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:38:37.138 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-04-20T21:38:37.755 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-20T21:38:37.755 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "6.9.0-rc3-g806ec36b2112"... 2024-04-20T21:38:37.755 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-04-20T21:38:37.797 INFO:teuthology.orchestra.run.smithi142.stdout:6.9.0-rc3-g806ec36b2112 2024-04-20T21:38:37.798 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-20T21:38:37.798 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-20T21:38:37.798 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-20T21:38:38.799 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-04-20T21:38:38.799 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-20T21:38:38.942 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2024-04-20T21:38:38.995 DEBUG:teuthology.parallel:result is None 2024-04-20T21:38:45.662 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-20T21:39:00.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-20T21:39:00.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:39:03.742 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-20T21:39:21.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-20T21:39:21.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:39:22.087 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-04-20T21:39:22.603 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-20T21:39:22.604 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "6.9.0-rc3-g806ec36b2112"... 2024-04-20T21:39:22.604 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-04-20T21:39:22.640 INFO:teuthology.orchestra.run.smithi164.stdout:6.9.0-rc3-g806ec36b2112 2024-04-20T21:39:22.640 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-20T21:39:22.640 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-20T21:39:22.640 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-20T21:39:23.641 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-04-20T21:39:23.641 DEBUG:teuthology.orchestra.run.smithi164:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-20T21:39:23.751 INFO:teuthology.orchestra.run.smithi164.stdout:ttyS1 2024-04-20T21:39:23.790 DEBUG:teuthology.parallel:result is None 2024-04-20T21:39:23.791 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-20T21:39:23.799 INFO:teuthology.task.internal:Creating test directory... 2024-04-20T21:39:23.799 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-20T21:39:23.808 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-20T21:39:23.860 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-20T21:39:23.867 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-20T21:39:23.875 INFO:teuthology.task.internal:Creating archive directory... 2024-04-20T21:39:23.875 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-20T21:39:23.880 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-20T21:39:23.993 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-20T21:39:24.000 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-20T21:39:24.001 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-20T21:39:24.008 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-20T21:39:24.081 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T21:39:24.094 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T21:39:24.107 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T21:39:24.124 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T21:39:24.128 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-20T21:39:24.135 INFO:teuthology.task.internal:Configuring sudo... 2024-04-20T21:39:24.135 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-20T21:39:24.142 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-20T21:39:24.223 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-20T21:39:24.231 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-20T21:39:24.232 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-20T21:39:24.236 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-20T21:39:24.282 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T21:39:24.355 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T21:39:24.463 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T21:39:24.547 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T21:39:24.633 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-20T21:39:24.633 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-20T21:39:24.715 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T21:39:24.794 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T21:39:24.888 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T21:39:24.967 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T21:39:25.040 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-20T21:39:25.040 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-20T21:39:25.110 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-04-20T21:39:25.118 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2024-04-20T21:39:25.236 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T21:39:25.259 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T21:39:25.529 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-20T21:39:25.539 INFO:teuthology.task.internal:Starting timer... 2024-04-20T21:39:25.539 INFO:teuthology.run_tasks:Running task pcp... 2024-04-20T21:39:25.551 INFO:teuthology.run_tasks:Running task selinux... 2024-04-20T21:39:25.559 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-20T21:39:25.559 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2024-04-20T21:39:25.686 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2024-04-20T21:39:25.691 DEBUG:teuthology.orchestra.run.smithi164:> sudo service auditd rotate 2024-04-20T21:39:25.896 INFO:teuthology.orchestra.run.smithi164.stdout:Rotating logs: 2024-04-20T21:39:25.901 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-20T21:39:25.902 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2024-04-20T21:39:25.957 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2024-04-20T21:39:25.957 DEBUG:teuthology.orchestra.run.smithi164:> /usr/sbin/getenforce 2024-04-20T21:39:26.031 INFO:teuthology.orchestra.run.smithi164.stdout:Permissive 2024-04-20T21:39:26.031 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi142.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi164.front.sepia.ceph.com': 'permissive'} 2024-04-20T21:39:26.032 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-20T21:39:26.114 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T21:39:26.114 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-20T21:39:26.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T21:39:26.240 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-20T21:39:26.241 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2024-04-20T21:39:26.313 DEBUG:teuthology.orchestra.run.smithi164:> sudo /usr/sbin/setenforce permissive 2024-04-20T21:39:26.458 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-20T21:39:26.468 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-20T21:39:26.474 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-20T21:39:26.598 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-20T21:39:26.614 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-20T21:39:26.615 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi142.front.sepia.ceph.com,smithi164.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-20T21:41:44.287 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi142.front.sepia.ceph.com'), Remote(name='ubuntu@smithi164.front.sepia.ceph.com')] 2024-04-20T21:41:44.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-20T21:41:44.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:41:44.398 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-04-20T21:41:44.555 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-20T21:41:44.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-20T21:41:44.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T21:41:44.662 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-04-20T21:41:44.811 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-20T21:41:44.811 INFO:teuthology.run_tasks:Running task clock... 2024-04-20T21:41:44.822 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-20T21:41:44.822 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-20T21:41:44.822 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T21:41:44.830 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-20T21:41:44.830 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T21:41:44.918 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-20T21:41:44.922 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-20T21:41:44.959 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-20T21:41:44.963 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-20T21:41:45.031 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2024-04-20T21:41:45.035 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: ntpd: command not found 2024-04-20T21:41:45.061 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2024-04-20T21:41:45.065 INFO:teuthology.orchestra.run.smithi164.stdout:506 Cannot talk to daemon 2024-04-20T21:41:45.098 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-20T21:41:45.105 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-20T21:41:45.140 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-20T21:41:45.144 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-20T21:41:45.280 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-04-20T21:41:45.284 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-04-20T21:41:45.289 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T21:41:45.289 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-04-20T21:41:45.289 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T21:41:45.289 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T21:41:45.289 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T21:41:45.289 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T21:41:45.294 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T21:41:45.294 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-04-20T21:41:45.294 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T21:41:45.294 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T21:41:45.294 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T21:41:45.294 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T21:41:45.296 INFO:teuthology.run_tasks:Running task install... 2024-04-20T21:41:45.304 DEBUG:teuthology.task.install:project ceph 2024-04-20T21:41:45.304 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}} 2024-04-20T21:41:45.304 DEBUG:teuthology.task.install:config {'branch': 'reef', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'} 2024-04-20T21:41:45.304 INFO:teuthology.task.install:Using flavor: default 2024-04-20T21:41:45.312 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-20T21:41:45.312 INFO:teuthology.task.install:extra packages: [] 2024-04-20T21:41:45.312 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'tag': None, 'wait_for_package': False} 2024-04-20T21:41:45.313 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-20T21:41:45.313 INFO:teuthology.packaging:ref: None 2024-04-20T21:41:45.313 INFO:teuthology.packaging:tag: None 2024-04-20T21:41:45.313 INFO:teuthology.packaging:branch: reef 2024-04-20T21:41:45.313 INFO:teuthology.packaging:sha1: a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:41:45.313 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-04-20T21:41:45.315 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'tag': None, 'wait_for_package': False} 2024-04-20T21:41:45.315 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-20T21:41:45.315 INFO:teuthology.packaging:ref: None 2024-04-20T21:41:45.315 INFO:teuthology.packaging:tag: None 2024-04-20T21:41:45.315 INFO:teuthology.packaging:branch: reef 2024-04-20T21:41:45.315 INFO:teuthology.packaging:sha1: a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:41:45.315 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-04-20T21:41:45.626 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/9d98999acebbad2663cc4938e94c9ffd83485cbd/centos/9/flavors/default/ 2024-04-20T21:41:45.626 INFO:teuthology.task.install.rpm:Package version is 18.2.2-0 2024-04-20T21:41:45.645 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/9d98999acebbad2663cc4938e94c9ffd83485cbd/centos/9/flavors/default/ 2024-04-20T21:41:45.645 INFO:teuthology.task.install.rpm:Package version is 18.2.2-0 2024-04-20T21:41:45.659 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/9d98999acebbad2663cc4938e94c9ffd83485cbd/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/9d98999acebbad2663cc4938e94c9ffd83485cbd/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/9d98999acebbad2663cc4938e94c9ffd83485cbd/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-20T21:41:45.659 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-20T21:41:45.659 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-20T21:41:45.671 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/9d98999acebbad2663cc4938e94c9ffd83485cbd/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/9d98999acebbad2663cc4938e94c9ffd83485cbd/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/9d98999acebbad2663cc4938e94c9ffd83485cbd/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-20T21:41:45.671 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-20T21:41:45.671 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-20T21:41:45.749 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-20T21:41:45.750 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-20T21:41:45.750 INFO:teuthology.packaging:ref: None 2024-04-20T21:41:45.750 INFO:teuthology.packaging:tag: None 2024-04-20T21:41:45.750 INFO:teuthology.packaging:branch: reef 2024-04-20T21:41:45.750 INFO:teuthology.packaging:sha1: a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:41:45.750 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-20T21:41:45.752 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-20T21:41:45.752 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-20T21:41:45.752 INFO:teuthology.packaging:ref: None 2024-04-20T21:41:45.752 INFO:teuthology.packaging:tag: None 2024-04-20T21:41:45.752 INFO:teuthology.packaging:branch: reef 2024-04-20T21:41:45.752 INFO:teuthology.packaging:sha1: a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:41:45.752 DEBUG:teuthology.orchestra.run.smithi164:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-20T21:41:45.879 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-20T21:41:45.880 DEBUG:teuthology.orchestra.run.smithi164:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-20T21:41:45.990 DEBUG:teuthology.orchestra.run.smithi164:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-20T21:41:45.994 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-20T21:41:46.068 INFO:teuthology.orchestra.run.smithi164.stdout:check_obsoletes = 1 2024-04-20T21:41:46.072 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum clean all 2024-04-20T21:41:46.072 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2024-04-20T21:41:46.076 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2024-04-20T21:41:46.387 INFO:teuthology.orchestra.run.smithi164.stdout:48 files removed 2024-04-20T21:41:46.410 INFO:teuthology.orchestra.run.smithi142.stdout:48 files removed 2024-04-20T21:41:46.426 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-radosgw 2024-04-20T21:41:46.448 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw 2024-04-20T21:41:47.025 INFO:teuthology.orchestra.run.smithi164.stdout:ceph packages for x86_64 468 kB/s | 76 kB 00:00 2024-04-20T21:41:47.081 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 402 kB/s | 76 kB 00:00 2024-04-20T21:41:47.218 INFO:teuthology.orchestra.run.smithi164.stdout:ceph noarch packages 64 kB/s | 9.4 kB 00:00 2024-04-20T21:41:47.315 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 53 kB/s | 9.4 kB 00:00 2024-04-20T21:41:47.418 INFO:teuthology.orchestra.run.smithi164.stdout:ceph source packages 14 kB/s | 2.2 kB 00:00 2024-04-20T21:41:47.549 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 12 kB/s | 2.2 kB 00:00 2024-04-20T21:41:49.149 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.0 MB 00:01 2024-04-20T21:41:50.859 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 2.4 MB/s | 8.0 MB 00:03 2024-04-20T21:41:52.916 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 7.5 MB/s | 19 MB 00:02 2024-04-20T21:41:58.350 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.2 MB 00:01 2024-04-20T21:42:01.209 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 16 kB 00:01 2024-04-20T21:42:02.818 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 1.8 MB/s | 19 MB 00:10 2024-04-20T21:42:03.917 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 8.3 MB/s | 21 MB 00:02 2024-04-20T21:42:09.787 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-04-20T21:42:12.298 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:42:12.322 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:42:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-04-20T21:42:12.323 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:42:12.323 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-20T21:42:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:18.2.2-0.el9 ceph 7.7 M 2024-04-20T21:42:12.323 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-04-20T21:42:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:18.2.2-0.el9 ceph 3.3 M 2024-04-20T21:42:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:18.2.2-0.el9 ceph 3.0 M 2024-04-20T21:42:12.323 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-20T21:42:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-20T21:42:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:18.2.2-0.el9 ceph 5.2 M 2024-04-20T21:42:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:18.2.2-0.el9 ceph 18 M 2024-04-20T21:42:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:18.2.2-0.el9 ceph 25 k 2024-04-20T21:42:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-20T21:42:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-20T21:42:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-20T21:42:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-20T21:42:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:18.2.2-0.el9 ceph 658 k 2024-04-20T21:42:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-20T21:42:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-20T21:42:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-20T21:42:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:18.2.2-0.el9 ceph 475 k 2024-04-20T21:42:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-20T21:42:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:18.2.2-0.el9 ceph 4.5 M 2024-04-20T21:42:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-20T21:42:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-20T21:42:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-20T21:42:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:18.2.2-0.el9 ceph 45 k 2024-04-20T21:42:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:18.2.2-0.el9 ceph 124 k 2024-04-20T21:42:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:18.2.2-0.el9 ceph 162 k 2024-04-20T21:42:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-20T21:42:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:18.2.2-0.el9 ceph 320 k 2024-04-20T21:42:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:18.2.2-0.el9 ceph 298 k 2024-04-20T21:42:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:18.2.2-0.el9 ceph 99 k 2024-04-20T21:42:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-20T21:42:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-20T21:42:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:42:12.325 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-20T21:42:12.325 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:42:12.325 INFO:teuthology.orchestra.run.smithi142.stdout:Install 28 Packages 2024-04-20T21:42:12.325 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 2 Packages 2024-04-20T21:42:12.326 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:42:12.326 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 53 M 2024-04-20T21:42:12.326 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-20T21:42:12.897 INFO:teuthology.orchestra.run.smithi142.stdout:(1/30): ceph-base-18.2.2-0.el9.x86_64.rpm 16 MB/s | 5.2 MB 00:00 2024-04-20T21:42:12.938 INFO:teuthology.orchestra.run.smithi142.stdout:(2/30): ceph-selinux-18.2.2-0.el9.x86_64.rpm 609 kB/s | 25 kB 00:00 2024-04-20T21:42:12.997 INFO:teuthology.orchestra.run.smithi142.stdout:(3/30): libcephfs2-18.2.2-0.el9.x86_64.rpm 11 MB/s | 658 kB 00:00 2024-04-20T21:42:13.039 INFO:teuthology.orchestra.run.smithi142.stdout:(4/30): libradosstriper1-18.2.2-0.el9.x86_64.rp 11 MB/s | 475 kB 00:00 2024-04-20T21:42:13.206 INFO:teuthology.orchestra.run.smithi142.stdout:(5/30): ceph-radosgw-18.2.2-0.el9.x86_64.rpm 12 MB/s | 7.7 MB 00:00 2024-04-20T21:42:13.248 INFO:teuthology.orchestra.run.smithi142.stdout:(6/30): python3-ceph-argparse-18.2.2-0.el9.x86_ 1.1 MB/s | 45 kB 00:00 2024-04-20T21:42:13.281 INFO:teuthology.orchestra.run.smithi142.stdout:(7/30): python3-ceph-common-18.2.2-0.el9.x86_64 3.8 MB/s | 124 kB 00:00 2024-04-20T21:42:13.342 INFO:teuthology.orchestra.run.smithi142.stdout:(8/30): python3-cephfs-18.2.2-0.el9.x86_64.rpm 2.8 MB/s | 162 kB 00:00 2024-04-20T21:42:13.382 INFO:teuthology.orchestra.run.smithi142.stdout:(9/30): python3-rados-18.2.2-0.el9.x86_64.rpm 7.7 MB/s | 320 kB 00:00 2024-04-20T21:42:13.424 INFO:teuthology.orchestra.run.smithi142.stdout:(10/30): python3-rbd-18.2.2-0.el9.x86_64.rpm 7.2 MB/s | 298 kB 00:00 2024-04-20T21:42:13.457 INFO:teuthology.orchestra.run.smithi142.stdout:(11/30): python3-rgw-18.2.2-0.el9.x86_64.rpm 3.0 MB/s | 99 kB 00:00 2024-04-20T21:42:13.583 INFO:teuthology.orchestra.run.smithi142.stdout:(12/30): librgw2-18.2.2-0.el9.x86_64.rpm 8.2 MB/s | 4.5 MB 00:00 2024-04-20T21:42:13.858 INFO:teuthology.orchestra.run.smithi142.stdout:(13/30): ceph-common-18.2.2-0.el9.x86_64.rpm 14 MB/s | 18 MB 00:01 2024-04-20T21:42:14.008 INFO:teuthology.orchestra.run.smithi142.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 194 kB/s | 107 kB 00:00 2024-04-20T21:42:14.175 INFO:teuthology.orchestra.run.smithi142.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 271 kB/s | 160 kB 00:00 2024-04-20T21:42:14.234 INFO:teuthology.orchestra.run.smithi142.stdout:(16/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 121 kB/s | 45 kB 00:00 2024-04-20T21:42:14.376 INFO:teuthology.orchestra.run.smithi142.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 299 kB/s | 42 kB 00:00 2024-04-20T21:42:14.443 INFO:teuthology.orchestra.run.smithi142.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.1 MB/s | 292 kB 00:00 2024-04-20T21:42:14.543 INFO:teuthology.orchestra.run.smithi142.stdout:(19/30): librdkafka-1.6.1-102.el9.x86_64.rpm 1.2 MB/s | 662 kB 00:00 2024-04-20T21:42:14.801 INFO:teuthology.orchestra.run.smithi142.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 261 kB/s | 111 kB 00:00 2024-04-20T21:42:14.918 INFO:teuthology.orchestra.run.smithi142.stdout:(21/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 224 kB/s | 26 kB 00:00 2024-04-20T21:42:14.993 INFO:teuthology.orchestra.run.smithi142.stdout:(22/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 645 kB/s | 309 kB 00:00 2024-04-20T21:42:15.044 INFO:teuthology.orchestra.run.smithi142.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 390 kB/s | 49 kB 00:00 2024-04-20T21:42:15.077 INFO:teuthology.orchestra.run.smithi142.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 816 kB/s | 67 kB 00:00 2024-04-20T21:42:15.118 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 752 kB/s | 6.2 MB 00:08 2024-04-20T21:42:15.186 INFO:teuthology.orchestra.run.smithi142.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-20T21:42:15.270 INFO:teuthology.orchestra.run.smithi142.stdout:(26/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.6 MB/s | 838 kB 00:00 2024-04-20T21:42:15.403 INFO:teuthology.orchestra.run.smithi142.stdout:(27/30): libarrow-9.0.0-10.el9.x86_64.rpm 5.1 MB/s | 4.4 MB 00:00 2024-04-20T21:42:15.495 INFO:teuthology.orchestra.run.smithi142.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 5.1 MB/s | 1.6 MB 00:00 2024-04-20T21:42:15.612 INFO:teuthology.orchestra.run.smithi142.stdout:(29/30): librados2-18.2.2-0.el9.x86_64.rpm 9.6 MB/s | 3.3 MB 00:00 2024-04-20T21:42:15.687 INFO:teuthology.orchestra.run.smithi142.stdout:(30/30): librbd1-18.2.2-0.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-04-20T21:42:15.698 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:42:15.698 INFO:teuthology.orchestra.run.smithi142.stdout:Total 16 MB/s | 53 MB 00:03 2024-04-20T21:42:15.934 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-20T21:42:16.034 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-20T21:42:16.034 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-20T21:42:16.826 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 16 kB 00:00 2024-04-20T21:42:16.925 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-20T21:42:16.926 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-20T21:42:18.013 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:01 2024-04-20T21:42:18.513 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-20T21:42:18.678 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-04-20T21:42:18.730 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-04-20T21:42:18.839 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-04-20T21:42:19.253 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-04-20T21:42:19.358 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:18.2.2-0.el9.x86_64 5/32 2024-04-20T21:42:19.547 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:18.2.2-0.el9.x86_64 5/32 2024-04-20T21:42:19.656 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:18.2.2-0.el9.x86_64 6/32 2024-04-20T21:42:19.683 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:18.2.2-0.el9.x86_64 7/32 2024-04-20T21:42:19.818 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:18.2.2-0.el9.x86_64 7/32 2024-04-20T21:42:19.852 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-04-20T21:42:19.909 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:18.2.2-0.el9.x86_64 9/32 2024-04-20T21:42:20.007 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:18.2.2-0.el9.x86_64 10/32 2024-04-20T21:42:20.044 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:18.2.2-0.el9.x86_64 11/32 2024-04-20T21:42:20.121 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:18.2.2-0.el9.x86_64 11/32 2024-04-20T21:42:20.315 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-04-20T21:42:20.355 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-04-20T21:42:20.413 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-04-20T21:42:20.453 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-04-20T21:42:20.510 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-04-20T21:42:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-04-20T21:42:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-04-20T21:42:20.983 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-04-20T21:42:21.024 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:18.2.2-0.el9.x86_64 20/32 2024-04-20T21:42:21.139 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:18.2.2-0.el9.x86_64 20/32 2024-04-20T21:42:21.173 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:18.2.2-0.el9.x86_64 21/32 2024-04-20T21:42:21.231 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-04-20T21:42:21.717 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-04-20T21:42:21.743 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:18.2.2-0.el9.x86_64 24/32 2024-04-20T21:42:21.836 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:18.2.2-0.el9.x86_64 24/32 2024-04-20T21:42:21.936 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:18.2.2-0.el9.x86_64 25/32 2024-04-20T21:42:21.970 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:18.2.2-0.el9.x86_64 26/32 2024-04-20T21:42:24.080 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-20T21:42:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:18.2.2-0.el9.x86_64 27/32 2024-04-20T21:42:24.602 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:18.2.2-0.el9.x86_64 27/32 2024-04-20T21:42:25.268 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:18.2.2-0.el9.x86_64 27/32 2024-04-20T21:42:25.320 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:18.2.2-0.el9.x86_64 28/32 2024-04-20T21:42:25.492 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:18.2.2-0.el9.x86_64 28/32 2024-04-20T21:42:25.492 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-20T21:42:25.492 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-20T21:42:25.492 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:42:25.538 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:18.2.2-0.el9.x86_64 29/32 2024-04-20T21:42:26.551 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:42:26.559 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:42:26.559 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-20T21:42:26.559 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:42:26.559 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-20T21:42:26.559 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw x86_64 2:18.2.2-0.el9 ceph 7.7 M 2024-04-20T21:42:26.559 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2024-04-20T21:42:26.559 INFO:teuthology.orchestra.run.smithi164.stdout: librados2 x86_64 2:18.2.2-0.el9 ceph 3.3 M 2024-04-20T21:42:26.559 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1 x86_64 2:18.2.2-0.el9 ceph 3.0 M 2024-04-20T21:42:26.559 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-20T21:42:26.559 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-20T21:42:26.559 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base x86_64 2:18.2.2-0.el9 ceph 5.2 M 2024-04-20T21:42:26.559 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common x86_64 2:18.2.2-0.el9 ceph 18 M 2024-04-20T21:42:26.559 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux x86_64 2:18.2.2-0.el9 ceph 25 k 2024-04-20T21:42:26.560 INFO:teuthology.orchestra.run.smithi164.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-20T21:42:26.560 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-20T21:42:26.560 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-20T21:42:26.560 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-20T21:42:26.560 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2 x86_64 2:18.2.2-0.el9 ceph 658 k 2024-04-20T21:42:26.560 INFO:teuthology.orchestra.run.smithi164.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-20T21:42:26.560 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-20T21:42:26.560 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-20T21:42:26.560 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 x86_64 2:18.2.2-0.el9 ceph 475 k 2024-04-20T21:42:26.560 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-20T21:42:26.560 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2 x86_64 2:18.2.2-0.el9 ceph 4.5 M 2024-04-20T21:42:26.560 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-20T21:42:26.560 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-20T21:42:26.561 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-20T21:42:26.561 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse x86_64 2:18.2.2-0.el9 ceph 45 k 2024-04-20T21:42:26.561 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common x86_64 2:18.2.2-0.el9 ceph 124 k 2024-04-20T21:42:26.561 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs x86_64 2:18.2.2-0.el9 ceph 162 k 2024-04-20T21:42:26.561 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-20T21:42:26.561 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados x86_64 2:18.2.2-0.el9 ceph 320 k 2024-04-20T21:42:26.561 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd x86_64 2:18.2.2-0.el9 ceph 298 k 2024-04-20T21:42:26.561 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw x86_64 2:18.2.2-0.el9 ceph 99 k 2024-04-20T21:42:26.561 INFO:teuthology.orchestra.run.smithi164.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-20T21:42:26.561 INFO:teuthology.orchestra.run.smithi164.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-20T21:42:26.561 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:42:26.561 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-20T21:42:26.561 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:42:26.561 INFO:teuthology.orchestra.run.smithi164.stdout:Install 28 Packages 2024-04-20T21:42:26.561 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 2 Packages 2024-04-20T21:42:26.562 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:42:26.562 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 53 M 2024-04-20T21:42:26.562 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-20T21:42:27.398 INFO:teuthology.orchestra.run.smithi164.stdout:(1/30): ceph-base-18.2.2-0.el9.x86_64.rpm 16 MB/s | 5.2 MB 00:00 2024-04-20T21:42:27.423 INFO:teuthology.orchestra.run.smithi164.stdout:(2/30): ceph-selinux-18.2.2-0.el9.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2024-04-20T21:42:27.473 INFO:teuthology.orchestra.run.smithi164.stdout:(3/30): libcephfs2-18.2.2-0.el9.x86_64.rpm 13 MB/s | 658 kB 00:00 2024-04-20T21:42:27.515 INFO:teuthology.orchestra.run.smithi164.stdout:(4/30): libradosstriper1-18.2.2-0.el9.x86_64.rp 11 MB/s | 475 kB 00:00 2024-04-20T21:42:27.674 INFO:teuthology.orchestra.run.smithi164.stdout:(5/30): ceph-radosgw-18.2.2-0.el9.x86_64.rpm 13 MB/s | 7.7 MB 00:00 2024-04-20T21:42:27.699 INFO:teuthology.orchestra.run.smithi164.stdout:(6/30): python3-ceph-argparse-18.2.2-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-04-20T21:42:27.733 INFO:teuthology.orchestra.run.smithi164.stdout:(7/30): python3-ceph-common-18.2.2-0.el9.x86_64 3.8 MB/s | 124 kB 00:00 2024-04-20T21:42:27.766 INFO:teuthology.orchestra.run.smithi164.stdout:(8/30): python3-cephfs-18.2.2-0.el9.x86_64.rpm 4.9 MB/s | 162 kB 00:00 2024-04-20T21:42:27.817 INFO:teuthology.orchestra.run.smithi164.stdout:(9/30): python3-rados-18.2.2-0.el9.x86_64.rpm 6.4 MB/s | 320 kB 00:00 2024-04-20T21:42:27.859 INFO:teuthology.orchestra.run.smithi164.stdout:(10/30): python3-rbd-18.2.2-0.el9.x86_64.rpm 7.1 MB/s | 298 kB 00:00 2024-04-20T21:42:27.892 INFO:teuthology.orchestra.run.smithi164.stdout:(11/30): python3-rgw-18.2.2-0.el9.x86_64.rpm 3.0 MB/s | 99 kB 00:00 2024-04-20T21:42:28.017 INFO:teuthology.orchestra.run.smithi164.stdout:(12/30): librgw2-18.2.2-0.el9.x86_64.rpm 8.9 MB/s | 4.5 MB 00:00 2024-04-20T21:42:28.360 INFO:teuthology.orchestra.run.smithi164.stdout:(13/30): ceph-common-18.2.2-0.el9.x86_64.rpm 14 MB/s | 18 MB 00:01 2024-04-20T21:42:28.393 INFO:teuthology.orchestra.run.smithi164.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 214 kB/s | 107 kB 00:00 2024-04-20T21:42:28.427 INFO:teuthology.orchestra.run.smithi164.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 392 kB/s | 160 kB 00:00 2024-04-20T21:42:28.452 INFO:teuthology.orchestra.run.smithi164.stdout:(16/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 496 kB/s | 45 kB 00:00 2024-04-20T21:42:28.585 INFO:teuthology.orchestra.run.smithi164.stdout:(17/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-04-20T21:42:28.627 INFO:teuthology.orchestra.run.smithi164.stdout:(18/30): librdkafka-1.6.1-102.el9.x86_64.rpm 2.8 MB/s | 662 kB 00:00 2024-04-20T21:42:28.661 INFO:teuthology.orchestra.run.smithi164.stdout:(19/30): python3-prettytable-0.7.2-27.el9.noarc 203 kB/s | 42 kB 00:00 2024-04-20T21:42:28.845 INFO:teuthology.orchestra.run.smithi164.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 432 kB/s | 111 kB 00:00 2024-04-20T21:42:28.912 INFO:teuthology.orchestra.run.smithi164.stdout:(21/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 395 kB/s | 26 kB 00:00 2024-04-20T21:42:28.945 INFO:teuthology.orchestra.run.smithi164.stdout:(22/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 975 kB/s | 309 kB 00:00 2024-04-20T21:42:28.979 INFO:teuthology.orchestra.run.smithi164.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 735 kB/s | 49 kB 00:00 2024-04-20T21:42:29.013 INFO:teuthology.orchestra.run.smithi164.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-04-20T21:42:29.146 INFO:teuthology.orchestra.run.smithi164.stdout:(25/30): libarrow-9.0.0-10.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-04-20T21:42:29.171 INFO:teuthology.orchestra.run.smithi164.stdout:(26/30): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-04-20T21:42:29.238 INFO:teuthology.orchestra.run.smithi164.stdout:(27/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.2 MB/s | 838 kB 00:00 2024-04-20T21:42:29.330 INFO:teuthology.orchestra.run.smithi164.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-04-20T21:42:29.447 INFO:teuthology.orchestra.run.smithi164.stdout:(29/30): librados2-18.2.2-0.el9.x86_64.rpm 12 MB/s | 3.3 MB 00:00 2024-04-20T21:42:29.522 INFO:teuthology.orchestra.run.smithi164.stdout:(30/30): librbd1-18.2.2-0.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-04-20T21:42:29.533 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:42:29.533 INFO:teuthology.orchestra.run.smithi164.stdout:Total 18 MB/s | 53 MB 00:02 2024-04-20T21:42:29.760 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-20T21:42:29.866 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-20T21:42:29.866 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-20T21:42:30.762 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-20T21:42:30.763 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-20T21:42:32.369 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-20T21:42:32.503 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-04-20T21:42:32.547 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-04-20T21:42:32.665 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-04-20T21:42:33.103 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-04-20T21:42:33.217 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librados2-2:18.2.2-0.el9.x86_64 5/32 2024-04-20T21:42:33.351 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:18.2.2-0.el9.x86_64 5/32 2024-04-20T21:42:33.450 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rados-2:18.2.2-0.el9.x86_64 6/32 2024-04-20T21:42:33.477 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs2-2:18.2.2-0.el9.x86_64 7/32 2024-04-20T21:42:33.561 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs2-2:18.2.2-0.el9.x86_64 7/32 2024-04-20T21:42:33.595 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-04-20T21:42:33.642 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-argparse-2:18.2.2-0.el9.x86_64 9/32 2024-04-20T21:42:33.736 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cephfs-2:18.2.2-0.el9.x86_64 10/32 2024-04-20T21:42:33.771 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libradosstriper1-2:18.2.2-0.el9.x86_64 11/32 2024-04-20T21:42:33.863 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libradosstriper1-2:18.2.2-0.el9.x86_64 11/32 2024-04-20T21:42:34.057 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-04-20T21:42:34.098 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-04-20T21:42:34.176 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-04-20T21:42:34.214 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-04-20T21:42:34.254 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-04-20T21:42:34.305 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-04-20T21:42:34.352 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-04-20T21:42:34.751 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-04-20T21:42:34.793 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librbd1-2:18.2.2-0.el9.x86_64 20/32 2024-04-20T21:42:34.916 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:18.2.2-0.el9.x86_64 20/32 2024-04-20T21:42:34.951 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rbd-2:18.2.2-0.el9.x86_64 21/32 2024-04-20T21:42:35.012 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-04-20T21:42:35.492 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-04-20T21:42:35.552 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librgw2-2:18.2.2-0.el9.x86_64 24/32 2024-04-20T21:42:35.647 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librgw2-2:18.2.2-0.el9.x86_64 24/32 2024-04-20T21:42:35.750 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rgw-2:18.2.2-0.el9.x86_64 25/32 2024-04-20T21:42:35.789 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-common-2:18.2.2-0.el9.x86_64 26/32 2024-04-20T21:42:36.376 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:18.2.2-0.el9.x86_64 29/32 2024-04-20T21:42:36.376 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2024-04-20T21:42:36.376 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2024-04-20T21:42:36.376 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2024-04-20T21:42:36.376 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2024-04-20T21:42:36.376 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2024-04-20T21:42:36.376 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /root 2024-04-20T21:42:36.376 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2024-04-20T21:42:36.376 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:42:37.220 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:18.2.2-0.el9.x86_64 30/32 2024-04-20T21:42:37.311 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-0.el9.x86_64 30/32 2024-04-20T21:42:37.312 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:42:37.312 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-20T21:42:37.312 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-20T21:42:37.312 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-20T21:42:37.312 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:42:37.317 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-04-20T21:42:37.441 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-04-20T21:42:37.442 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-04-20T21:42:38.518 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:18.2.2-0.el9.x86_64 27/32 2024-04-20T21:42:38.561 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-common-2:18.2.2-0.el9.x86_64 27/32 2024-04-20T21:42:39.073 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-04-20T21:42:39.073 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:18.2.2-0.el9.x86_64 1/32 2024-04-20T21:42:39.073 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:18.2.2-0.el9.x86_64 2/32 2024-04-20T21:42:39.073 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:18.2.2-0.el9.x86_64 3/32 2024-04-20T21:42:39.073 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:18.2.2-0.el9.x86_64 4/32 2024-04-20T21:42:39.073 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:18.2.2-0.el9.x86_64 5/32 2024-04-20T21:42:39.073 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:18.2.2-0.el9.x86_64 6/32 2024-04-20T21:42:39.074 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:18.2.2-0.el9.x86_64 7/32 2024-04-20T21:42:39.074 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:18.2.2-0.el9.x86_64 8/32 2024-04-20T21:42:39.074 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:18.2.2-0.el9.x86_64 9/32 2024-04-20T21:42:39.074 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:18.2.2-0.el9.x86_64 10/32 2024-04-20T21:42:39.074 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:18.2.2-0.el9.x86_64 11/32 2024-04-20T21:42:39.074 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:18.2.2-0.el9.x86_64 12/32 2024-04-20T21:42:39.074 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:18.2.2-0.el9.x86_64 13/32 2024-04-20T21:42:39.074 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-04-20T21:42:39.074 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-04-20T21:42:39.074 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-04-20T21:42:39.074 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-04-20T21:42:39.074 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-04-20T21:42:39.074 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-04-20T21:42:39.074 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-04-20T21:42:39.075 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-04-20T21:42:39.075 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-04-20T21:42:39.075 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-04-20T21:42:39.075 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-04-20T21:42:39.075 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-04-20T21:42:39.075 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-04-20T21:42:39.075 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-04-20T21:42:39.075 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-04-20T21:42:39.075 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:18.2.2-0.el9.x86_64 29/32 2024-04-20T21:42:39.075 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-04-20T21:42:39.075 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:18.2.2-0.el9.x86_64 31/32 2024-04-20T21:42:39.258 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:18.2.2-0.el9.x86_64 27/32 2024-04-20T21:42:39.306 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-base-2:18.2.2-0.el9.x86_64 28/32 2024-04-20T21:42:39.486 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-base-2:18.2.2-0.el9.x86_64 28/32 2024-04-20T21:42:39.486 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-20T21:42:39.486 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-20T21:42:39.486 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:42:39.532 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-selinux-2:18.2.2-0.el9.x86_64 29/32 2024-04-20T21:42:39.874 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-04-20T21:42:39.874 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:42:39.874 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-04-20T21:42:39.874 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:18.2.2-0.el9.x86_64 librbd1-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:39.874 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-20T21:42:39.875 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-20T21:42:39.875 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:39.875 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:39.875 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:39.875 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:39.875 INFO:teuthology.orchestra.run.smithi142.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-20T21:42:39.875 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-20T21:42:39.875 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-20T21:42:39.875 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-20T21:42:39.875 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:39.875 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-20T21:42:39.875 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-20T21:42:39.875 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-20T21:42:39.875 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:39.875 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-20T21:42:39.876 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:39.876 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-20T21:42:39.876 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-20T21:42:39.876 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-20T21:42:39.876 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:39.876 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:39.876 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:39.876 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-20T21:42:39.876 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:39.876 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:39.876 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:39.876 INFO:teuthology.orchestra.run.smithi142.stdout: re2-1:20211101-3.el9.x86_64 2024-04-20T21:42:39.876 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-20T21:42:39.876 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:42:39.877 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:42:40.253 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-test 2024-04-20T21:42:41.016 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:32 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:42:41.152 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:42:41.153 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:42:41.153 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-04-20T21:42:41.153 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:42:41.153 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-20T21:42:41.153 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:18.2.2-0.el9 ceph 40 M 2024-04-20T21:42:41.153 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-20T21:42:41.153 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:18.2.2-0.el9 ceph 165 k 2024-04-20T21:42:41.153 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-20T21:42:41.153 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-20T21:42:41.153 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:42:41.153 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-20T21:42:41.153 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:42:41.153 INFO:teuthology.orchestra.run.smithi142.stdout:Install 4 Packages 2024-04-20T21:42:41.154 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:42:41.154 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 40 M 2024-04-20T21:42:41.154 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 166 M 2024-04-20T21:42:41.154 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-20T21:42:41.449 INFO:teuthology.orchestra.run.smithi142.stdout:(1/4): libcephsqlite-18.2.2-0.el9.x86_64.rpm 1.1 MB/s | 165 kB 00:00 2024-04-20T21:42:41.590 INFO:teuthology.orchestra.run.smithi142.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 305 kB 00:00 2024-04-20T21:42:41.633 INFO:teuthology.orchestra.run.smithi142.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 348 kB/s | 64 kB 00:00 2024-04-20T21:42:42.158 INFO:teuthology.orchestra.run.smithi142.stdout:(4/4): ceph-test-18.2.2-0.el9.x86_64.rpm 46 MB/s | 40 MB 00:00 2024-04-20T21:42:42.163 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:42:42.163 INFO:teuthology.orchestra.run.smithi142.stdout:Total 40 MB/s | 40 MB 00:01 2024-04-20T21:42:42.229 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-20T21:42:42.258 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-20T21:42:42.258 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-20T21:42:42.644 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-20T21:42:42.644 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-20T21:42:43.312 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-20T21:42:43.478 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-20T21:42:43.589 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-20T21:42:43.640 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:18.2.2-0.el9.x86_64 3/4 2024-04-20T21:42:47.967 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:18.2.2-0.el9.x86_64 3/4 2024-04-20T21:42:48.191 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:18.2.2-0.el9.x86_64 4/4 2024-04-20T21:42:50.139 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-test-2:18.2.2-0.el9.x86_64 4/4 2024-04-20T21:42:50.139 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:18.2.2-0.el9.x86_64 1/4 2024-04-20T21:42:50.139 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:18.2.2-0.el9.x86_64 2/4 2024-04-20T21:42:50.139 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-20T21:42:50.425 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-20T21:42:50.425 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:42:50.425 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-20T21:42:50.425 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:18.2.2-0.el9.x86_64 libcephsqlite-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:50.426 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-04-20T21:42:50.426 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:42:50.426 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:42:50.515 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-selinux-2:18.2.2-0.el9.x86_64 29/32 2024-04-20T21:42:50.515 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /sys 2024-04-20T21:42:50.516 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /proc 2024-04-20T21:42:50.516 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /mnt 2024-04-20T21:42:50.516 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /var/tmp 2024-04-20T21:42:50.516 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /home 2024-04-20T21:42:50.516 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /root 2024-04-20T21:42:50.516 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /tmp 2024-04-20T21:42:50.516 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:42:50.754 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph 2024-04-20T21:42:51.406 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-radosgw-2:18.2.2-0.el9.x86_64 30/32 2024-04-20T21:42:51.477 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-0.el9.x86_64 30/32 2024-04-20T21:42:51.477 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:42:51.477 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-20T21:42:51.477 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-20T21:42:51.477 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-20T21:42:51.478 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:42:51.483 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-04-20T21:42:51.520 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:42 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:42:51.619 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-04-20T21:42:51.620 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-04-20T21:42:51.645 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:42:51.648 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:42:51.648 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-04-20T21:42:51.648 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:42:51.648 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-20T21:42:51.648 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:18.2.2-0.el9 ceph 6.4 k 2024-04-20T21:42:51.648 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-20T21:42:51.648 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:18.2.2-0.el9 ceph 2.1 M 2024-04-20T21:42:51.648 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:18.2.2-0.el9 ceph 1.4 M 2024-04-20T21:42:51.648 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:18.2.2-0.el9 ceph-noarch 242 k 2024-04-20T21:42:51.649 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:18.2.2-0.el9 ceph 4.5 M 2024-04-20T21:42:51.649 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:18.2.2-0.el9 ceph 18 M 2024-04-20T21:42:51.649 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-20T21:42:51.649 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-20T21:42:51.649 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-20T21:42:51.649 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-20T21:42:51.649 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-20T21:42:51.649 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-20T21:42:51.649 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-20T21:42:51.649 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-20T21:42:51.649 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-20T21:42:51.649 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-20T21:42:51.649 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-20T21:42:51.649 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-20T21:42:51.650 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-20T21:42:51.650 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-20T21:42:51.650 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-20T21:42:51.650 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-20T21:42:51.650 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-20T21:42:51.650 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-20T21:42:51.650 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-20T21:42:51.650 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-20T21:42:51.650 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-20T21:42:51.650 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-20T21:42:51.650 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-20T21:42:51.650 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-20T21:42:51.650 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-20T21:42:51.650 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-20T21:42:51.651 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-20T21:42:51.651 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:42:51.651 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-20T21:42:51.651 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:42:51.651 INFO:teuthology.orchestra.run.smithi142.stdout:Install 33 Packages 2024-04-20T21:42:51.651 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:42:51.651 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 30 M 2024-04-20T21:42:51.652 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 110 M 2024-04-20T21:42:51.652 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-20T21:42:52.392 INFO:teuthology.orchestra.run.smithi142.stdout:(1/33): ceph-18.2.2-0.el9.x86_64.rpm 37 kB/s | 6.4 kB 00:00 2024-04-20T21:42:52.459 INFO:teuthology.orchestra.run.smithi142.stdout:(2/33): ceph-mgr-18.2.2-0.el9.x86_64.rpm 6.0 MB/s | 1.4 MB 00:00 2024-04-20T21:42:52.509 INFO:teuthology.orchestra.run.smithi142.stdout:(3/33): ceph-mds-18.2.2-0.el9.x86_64.rpm 7.3 MB/s | 2.1 MB 00:00 2024-04-20T21:42:52.542 INFO:teuthology.orchestra.run.smithi142.stdout:(4/33): ceph-mgr-modules-core-18.2.2-0.el9.noar 7.2 MB/s | 242 kB 00:00 2024-04-20T21:42:52.634 INFO:teuthology.orchestra.run.smithi142.stdout:(5/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-04-20T21:42:52.726 INFO:teuthology.orchestra.run.smithi142.stdout:(6/33): ceph-mon-18.2.2-0.el9.x86_64.rpm 13 MB/s | 4.5 MB 00:00 2024-04-20T21:42:52.802 INFO:teuthology.orchestra.run.smithi142.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-04-20T21:42:52.852 INFO:teuthology.orchestra.run.smithi142.stdout:(8/33): python3-cryptography-36.0.1-4.el9.x86_6 5.7 MB/s | 1.2 MB 00:00 2024-04-20T21:42:52.910 INFO:teuthology.orchestra.run.smithi142.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.2 MB/s | 135 kB 00:00 2024-04-20T21:42:52.944 INFO:teuthology.orchestra.run.smithi142.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 1.3 MB/s | 125 kB 00:00 2024-04-20T21:42:53.011 INFO:teuthology.orchestra.run.smithi142.stdout:(11/33): python3-urllib3-1.26.5-5.el9.noarch.rp 2.1 MB/s | 215 kB 00:00 2024-04-20T21:42:53.103 INFO:teuthology.orchestra.run.smithi142.stdout:(12/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-04-20T21:42:53.128 INFO:teuthology.orchestra.run.smithi142.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 300 kB/s | 35 kB 00:00 2024-04-20T21:42:53.154 INFO:teuthology.orchestra.run.smithi142.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-20T21:42:53.217 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-04-20T21:42:53.218 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-base-2:18.2.2-0.el9.x86_64 1/32 2024-04-20T21:42:53.218 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-common-2:18.2.2-0.el9.x86_64 2/32 2024-04-20T21:42:53.218 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-radosgw-2:18.2.2-0.el9.x86_64 3/32 2024-04-20T21:42:53.218 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-selinux-2:18.2.2-0.el9.x86_64 4/32 2024-04-20T21:42:53.218 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs2-2:18.2.2-0.el9.x86_64 5/32 2024-04-20T21:42:53.218 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libradosstriper1-2:18.2.2-0.el9.x86_64 6/32 2024-04-20T21:42:53.218 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librgw2-2:18.2.2-0.el9.x86_64 7/32 2024-04-20T21:42:53.218 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-argparse-2:18.2.2-0.el9.x86_64 8/32 2024-04-20T21:42:53.218 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-common-2:18.2.2-0.el9.x86_64 9/32 2024-04-20T21:42:53.218 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cephfs-2:18.2.2-0.el9.x86_64 10/32 2024-04-20T21:42:53.218 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rados-2:18.2.2-0.el9.x86_64 11/32 2024-04-20T21:42:53.218 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rbd-2:18.2.2-0.el9.x86_64 12/32 2024-04-20T21:42:53.218 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rgw-2:18.2.2-0.el9.x86_64 13/32 2024-04-20T21:42:53.218 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-04-20T21:42:53.218 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-04-20T21:42:53.219 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-04-20T21:42:53.219 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-04-20T21:42:53.219 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-04-20T21:42:53.219 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-04-20T21:42:53.219 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-04-20T21:42:53.219 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-04-20T21:42:53.219 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-04-20T21:42:53.219 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-04-20T21:42:53.219 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-04-20T21:42:53.219 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-04-20T21:42:53.219 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-04-20T21:42:53.219 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-04-20T21:42:53.219 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-04-20T21:42:53.219 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:18.2.2-0.el9.x86_64 29/32 2024-04-20T21:42:53.219 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-04-20T21:42:53.220 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:18.2.2-0.el9.x86_64 31/32 2024-04-20T21:42:53.387 INFO:teuthology.orchestra.run.smithi142.stdout:(15/33): ceph-osd-18.2.2-0.el9.x86_64.rpm 19 MB/s | 18 MB 00:00 2024-04-20T21:42:53.412 INFO:teuthology.orchestra.run.smithi142.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 147 kB/s | 42 kB 00:00 2024-04-20T21:42:53.738 INFO:teuthology.orchestra.run.smithi142.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 74 kB/s | 43 kB 00:00 2024-04-20T21:42:53.846 INFO:teuthology.orchestra.run.smithi142.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 375 kB/s | 172 kB 00:00 2024-04-20T21:42:53.872 INFO:teuthology.orchestra.run.smithi142.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 80 kB/s | 11 kB 00:00 2024-04-20T21:42:53.947 INFO:teuthology.orchestra.run.smithi142.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 178 kB/s | 18 kB 00:00 2024-04-20T21:42:53.980 INFO:teuthology.orchestra.run.smithi142.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 214 kB/s | 23 kB 00:00 2024-04-20T21:42:54.014 INFO:teuthology.orchestra.run.smithi142.stdout:(22/33): python3-cherrypy-18.6.1-2.el9.noarch.r 597 kB/s | 358 kB 00:00 2024-04-20T21:42:54.056 INFO:teuthology.orchestra.run.smithi142.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 180 kB/s | 19 kB 00:00 2024-04-20T21:42:54.081 INFO:teuthology.orchestra.run.smithi142.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 197 kB/s | 20 kB 00:00 2024-04-20T21:42:54.098 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-04-20T21:42:54.098 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:42:54.098 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2024-04-20T21:42:54.099 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-2:18.2.2-0.el9.x86_64 librbd1-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:54.099 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-20T21:42:54.099 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-20T21:42:54.099 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:54.099 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:54.099 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:54.099 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:54.099 INFO:teuthology.orchestra.run.smithi164.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-20T21:42:54.099 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-20T21:42:54.099 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-20T21:42:54.099 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-20T21:42:54.099 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:54.099 INFO:teuthology.orchestra.run.smithi164.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-20T21:42:54.099 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-20T21:42:54.100 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-20T21:42:54.100 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:54.100 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-20T21:42:54.100 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:54.100 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-20T21:42:54.100 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-20T21:42:54.100 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-20T21:42:54.100 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:54.100 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:54.100 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:54.100 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-20T21:42:54.100 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:54.100 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:54.100 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-2:18.2.2-0.el9.x86_64 2024-04-20T21:42:54.101 INFO:teuthology.orchestra.run.smithi164.stdout: re2-1:20211101-3.el9.x86_64 2024-04-20T21:42:54.101 INFO:teuthology.orchestra.run.smithi164.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-20T21:42:54.101 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:42:54.101 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:42:54.115 INFO:teuthology.orchestra.run.smithi142.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 463 kB/s | 46 kB 00:00 2024-04-20T21:42:54.215 INFO:teuthology.orchestra.run.smithi142.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 499 kB/s | 79 kB 00:00 2024-04-20T21:42:54.232 INFO:teuthology.orchestra.run.smithi142.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 141 kB/s | 16 kB 00:00 2024-04-20T21:42:54.299 INFO:teuthology.orchestra.run.smithi142.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-04-20T21:42:54.324 INFO:teuthology.orchestra.run.smithi142.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 392 kB/s | 36 kB 00:00 2024-04-20T21:42:54.366 INFO:teuthology.orchestra.run.smithi142.stdout:(30/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 599 kB/s | 90 kB 00:00 2024-04-20T21:42:54.416 INFO:teuthology.orchestra.run.smithi142.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-04-20T21:42:54.483 INFO:teuthology.orchestra.run.smithi142.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 172 kB/s | 20 kB 00:00 2024-04-20T21:42:54.504 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-test 2024-04-20T21:42:54.516 INFO:teuthology.orchestra.run.smithi142.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.2 MB/s | 427 kB 00:00 2024-04-20T21:42:54.521 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:42:54.522 INFO:teuthology.orchestra.run.smithi142.stdout:Total 10 MB/s | 30 MB 00:02 2024-04-20T21:42:54.886 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-20T21:42:54.971 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-20T21:42:54.971 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-20T21:42:55.255 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:31 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:42:55.392 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:42:55.393 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:42:55.393 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-04-20T21:42:55.393 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:42:55.393 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-20T21:42:55.393 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test x86_64 2:18.2.2-0.el9 ceph 40 M 2024-04-20T21:42:55.393 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-20T21:42:55.393 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite x86_64 2:18.2.2-0.el9 ceph 165 k 2024-04-20T21:42:55.393 INFO:teuthology.orchestra.run.smithi164.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-20T21:42:55.393 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-20T21:42:55.394 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:42:55.394 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-20T21:42:55.394 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:42:55.394 INFO:teuthology.orchestra.run.smithi164.stdout:Install 4 Packages 2024-04-20T21:42:55.394 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:42:55.395 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 40 M 2024-04-20T21:42:55.395 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 166 M 2024-04-20T21:42:55.395 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-20T21:42:55.482 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-20T21:42:55.483 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-20T21:42:55.679 INFO:teuthology.orchestra.run.smithi164.stdout:(1/4): libcephsqlite-18.2.2-0.el9.x86_64.rpm 1.3 MB/s | 165 kB 00:00 2024-04-20T21:42:55.770 INFO:teuthology.orchestra.run.smithi164.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 305 kB 00:00 2024-04-20T21:42:55.852 INFO:teuthology.orchestra.run.smithi164.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 368 kB/s | 64 kB 00:00 2024-04-20T21:42:56.388 INFO:teuthology.orchestra.run.smithi164.stdout:(4/4): ceph-test-18.2.2-0.el9.x86_64.rpm 48 MB/s | 40 MB 00:00 2024-04-20T21:42:56.392 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:42:56.393 INFO:teuthology.orchestra.run.smithi164.stdout:Total 40 MB/s | 40 MB 00:00 2024-04-20T21:42:56.461 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-20T21:42:56.485 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-20T21:42:56.485 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-20T21:42:56.809 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-20T21:42:56.866 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-20T21:42:56.867 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-20T21:42:56.920 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-20T21:42:56.970 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-20T21:42:57.024 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-20T21:42:57.174 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-20T21:42:57.273 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-20T21:42:57.327 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-20T21:42:57.376 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-20T21:42:57.414 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-20T21:42:57.451 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-20T21:42:57.492 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-20T21:42:57.493 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-20T21:42:57.562 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-20T21:42:57.572 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-20T21:42:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-20T21:42:57.642 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-20T21:42:57.671 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-20T21:42:57.690 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephsqlite-2:18.2.2-0.el9.x86_64 3/4 2024-04-20T21:42:57.733 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-20T21:42:57.891 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-20T21:42:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-20T21:42:58.195 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-20T21:42:58.263 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-20T21:42:58.306 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-20T21:42:58.369 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-20T21:42:58.452 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-20T21:42:58.704 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-20T21:42:58.761 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-20T21:42:58.852 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-20T21:42:58.968 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-20T21:42:59.007 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-20T21:42:59.151 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-20T21:42:59.322 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-0.el9.noarch 28/33 2024-04-20T21:42:59.356 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:18.2.2-0.el9.x86_64 29/33 2024-04-20T21:42:59.427 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:18.2.2-0.el9.x86_64 29/33 2024-04-20T21:42:59.427 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:42:59.427 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-20T21:42:59.427 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-20T21:42:59.427 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-20T21:42:59.427 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:01.066 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:18.2.2-0.el9.x86_64 30/33 2024-04-20T21:43:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:18.2.2-0.el9.x86_64 30/33 2024-04-20T21:43:01.142 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:43:01.142 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-20T21:43:01.142 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-20T21:43:01.142 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-20T21:43:01.142 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:01.633 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:18.2.2-0.el9.x86_64 31/33 2024-04-20T21:43:01.701 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:18.2.2-0.el9.x86_64 31/33 2024-04-20T21:43:01.701 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:43:01.701 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-20T21:43:01.701 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-20T21:43:01.702 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-20T21:43:01.702 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:01.915 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephsqlite-2:18.2.2-0.el9.x86_64 3/4 2024-04-20T21:43:01.934 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:18.2.2-0.el9.x86_64 32/33 2024-04-20T21:43:02.002 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:18.2.2-0.el9.x86_64 32/33 2024-04-20T21:43:02.002 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:43:02.002 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-20T21:43:02.002 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-20T21:43:02.002 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-20T21:43:02.002 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:02.074 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:18.2.2-0.el9.x86_64 33/33 2024-04-20T21:43:02.193 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-2:18.2.2-0.el9.x86_64 33/33 2024-04-20T21:43:02.193 INFO:teuthology.orchestra.run.smithi142.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-20T21:43:02.194 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:02.221 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-test-2:18.2.2-0.el9.x86_64 4/4 2024-04-20T21:43:04.024 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:18.2.2-0.el9.x86_64 1/33 2024-04-20T21:43:04.024 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:18.2.2-0.el9.x86_64 2/33 2024-04-20T21:43:04.024 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:18.2.2-0.el9.x86_64 3/33 2024-04-20T21:43:04.024 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:18.2.2-0.el9.x86_64 4/33 2024-04-20T21:43:04.024 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:18.2.2-0.el9.x86_64 5/33 2024-04-20T21:43:04.024 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-0.el9.noarch 6/33 2024-04-20T21:43:04.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-20T21:43:04.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-20T21:43:04.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-20T21:43:04.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-20T21:43:04.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-20T21:43:04.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-20T21:43:04.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-20T21:43:04.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-20T21:43:04.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-20T21:43:04.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-20T21:43:04.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-20T21:43:04.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-20T21:43:04.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-20T21:43:04.025 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-20T21:43:04.026 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-20T21:43:04.026 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-20T21:43:04.026 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-20T21:43:04.026 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-20T21:43:04.026 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-20T21:43:04.026 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-20T21:43:04.026 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-20T21:43:04.026 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-20T21:43:04.026 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-20T21:43:04.026 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-20T21:43:04.027 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-20T21:43:04.027 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-20T21:43:04.118 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-test-2:18.2.2-0.el9.x86_64 4/4 2024-04-20T21:43:04.118 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-test-2:18.2.2-0.el9.x86_64 1/4 2024-04-20T21:43:04.119 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephsqlite-2:18.2.2-0.el9.x86_64 2/4 2024-04-20T21:43:04.119 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-20T21:43:04.447 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-20T21:43:04.447 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:04.447 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-20T21:43:04.447 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-2:18.2.2-0.el9.x86_64 libcephsqlite-2:18.2.2-0.el9.x86_64 2024-04-20T21:43:04.447 INFO:teuthology.orchestra.run.smithi164.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-04-20T21:43:04.447 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:04.447 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:43:04.775 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph 2024-04-20T21:43:05.004 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-20T21:43:05.004 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:05.004 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-20T21:43:05.004 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:18.2.2-0.el9.x86_64 2024-04-20T21:43:05.004 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:18.2.2-0.el9.x86_64 2024-04-20T21:43:05.004 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:18.2.2-0.el9.x86_64 2024-04-20T21:43:05.004 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:18.2.2-0.el9.noarch 2024-04-20T21:43:05.004 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:18.2.2-0.el9.x86_64 2024-04-20T21:43:05.005 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:18.2.2-0.el9.x86_64 2024-04-20T21:43:05.005 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-20T21:43:05.005 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-20T21:43:05.005 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-20T21:43:05.005 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-20T21:43:05.005 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-20T21:43:05.005 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-20T21:43:05.005 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-20T21:43:05.005 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-20T21:43:05.005 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-20T21:43:05.005 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-20T21:43:05.005 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-20T21:43:05.005 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-20T21:43:05.005 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-20T21:43:05.006 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-20T21:43:05.006 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-20T21:43:05.006 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply-3.11-14.el9.noarch 2024-04-20T21:43:05.006 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-20T21:43:05.006 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-20T21:43:05.006 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-20T21:43:05.006 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-20T21:43:05.006 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-20T21:43:05.006 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-20T21:43:05.006 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-20T21:43:05.006 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-20T21:43:05.006 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-20T21:43:05.006 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-20T21:43:05.006 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-20T21:43:05.007 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:05.007 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:43:05.436 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-base 2024-04-20T21:43:05.546 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:41 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:43:05.677 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:43:05.679 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-20T21:43:05.680 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:05.680 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-20T21:43:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: ceph x86_64 2:18.2.2-0.el9 ceph 6.4 k 2024-04-20T21:43:05.680 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-20T21:43:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds x86_64 2:18.2.2-0.el9 ceph 2.1 M 2024-04-20T21:43:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr x86_64 2:18.2.2-0.el9 ceph 1.4 M 2024-04-20T21:43:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core noarch 2:18.2.2-0.el9 ceph-noarch 242 k 2024-04-20T21:43:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon x86_64 2:18.2.2-0.el9 ceph 4.5 M 2024-04-20T21:43:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd x86_64 2:18.2.2-0.el9 ceph 18 M 2024-04-20T21:43:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-20T21:43:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-20T21:43:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-20T21:43:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-20T21:43:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-20T21:43:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-20T21:43:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-20T21:43:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-20T21:43:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-20T21:43:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-20T21:43:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-20T21:43:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-20T21:43:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-20T21:43:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-20T21:43:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-20T21:43:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-20T21:43:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-20T21:43:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-20T21:43:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-20T21:43:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-20T21:43:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-20T21:43:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-20T21:43:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-20T21:43:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-20T21:43:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-20T21:43:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-20T21:43:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-20T21:43:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:05.682 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-20T21:43:05.682 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:05.682 INFO:teuthology.orchestra.run.smithi164.stdout:Install 33 Packages 2024-04-20T21:43:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:05.683 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 30 M 2024-04-20T21:43:05.683 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 110 M 2024-04-20T21:43:05.683 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-20T21:43:06.195 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:57 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:43:06.215 INFO:teuthology.orchestra.run.smithi164.stdout:(1/33): ceph-18.2.2-0.el9.x86_64.rpm 33 kB/s | 6.4 kB 00:00 2024-04-20T21:43:06.276 INFO:teuthology.orchestra.run.smithi142.stdout:Package ceph-base-2:18.2.2-0.el9.x86_64 is already installed. 2024-04-20T21:43:06.291 INFO:teuthology.orchestra.run.smithi164.stdout:(2/33): ceph-mgr-18.2.2-0.el9.x86_64.rpm 5.4 MB/s | 1.4 MB 00:00 2024-04-20T21:43:06.319 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:43:06.320 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-20T21:43:06.320 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:43:06.366 INFO:teuthology.orchestra.run.smithi164.stdout:(3/33): ceph-mds-18.2.2-0.el9.x86_64.rpm 6.1 MB/s | 2.1 MB 00:00 2024-04-20T21:43:06.399 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install cephadm 2024-04-20T21:43:06.399 INFO:teuthology.orchestra.run.smithi164.stdout:(4/33): ceph-mgr-modules-core-18.2.2-0.el9.noar 7.2 MB/s | 242 kB 00:00 2024-04-20T21:43:06.525 INFO:teuthology.orchestra.run.smithi164.stdout:(5/33): ceph-mon-18.2.2-0.el9.x86_64.rpm 14 MB/s | 4.5 MB 00:00 2024-04-20T21:43:06.625 INFO:teuthology.orchestra.run.smithi164.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-04-20T21:43:06.675 INFO:teuthology.orchestra.run.smithi164.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-20T21:43:06.726 INFO:teuthology.orchestra.run.smithi164.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 2.7 MB/s | 135 kB 00:00 2024-04-20T21:43:06.793 INFO:teuthology.orchestra.run.smithi164.stdout:(9/33): python3-cryptography-36.0.1-4.el9.x86_6 4.6 MB/s | 1.2 MB 00:00 2024-04-20T21:43:06.818 INFO:teuthology.orchestra.run.smithi164.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 1.3 MB/s | 125 kB 00:00 2024-04-20T21:43:06.851 INFO:teuthology.orchestra.run.smithi164.stdout:(11/33): python3-urllib3-1.26.5-5.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-04-20T21:43:07.085 INFO:teuthology.orchestra.run.smithi164.stdout:(12/33): ceph-osd-18.2.2-0.el9.x86_64.rpm 22 MB/s | 18 MB 00:00 2024-04-20T21:43:07.121 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:58 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:43:07.152 INFO:teuthology.orchestra.run.smithi164.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 116 kB/s | 35 kB 00:00 2024-04-20T21:43:07.177 INFO:teuthology.orchestra.run.smithi164.stdout:(14/33): python3-mako-1.1.4-6.el9.noarch.rpm 481 kB/s | 172 kB 00:00 2024-04-20T21:43:07.202 INFO:teuthology.orchestra.run.smithi164.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 440 kB/s | 51 kB 00:00 2024-04-20T21:43:07.228 INFO:teuthology.orchestra.run.smithi164.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 559 kB/s | 42 kB 00:00 2024-04-20T21:43:07.243 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:43:07.243 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:07.243 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-04-20T21:43:07.243 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:07.243 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-20T21:43:07.243 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:18.2.2-0.el9 ceph-noarch 221 k 2024-04-20T21:43:07.243 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:07.243 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-20T21:43:07.244 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:07.244 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-04-20T21:43:07.244 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:07.244 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 221 k 2024-04-20T21:43:07.244 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 213 k 2024-04-20T21:43:07.244 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-20T21:43:07.331 INFO:teuthology.orchestra.run.smithi142.stdout:cephadm-18.2.2-0.el9.noarch.rpm 2.5 MB/s | 221 kB 00:00 2024-04-20T21:43:07.332 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:43:07.332 INFO:teuthology.orchestra.run.smithi142.stdout:Total 2.5 MB/s | 221 kB 00:00 2024-04-20T21:43:07.332 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-20T21:43:07.339 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-20T21:43:07.339 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-20T21:43:07.342 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-20T21:43:07.342 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-20T21:43:07.362 INFO:teuthology.orchestra.run.smithi164.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 276 kB/s | 43 kB 00:00 2024-04-20T21:43:07.428 INFO:teuthology.orchestra.run.smithi164.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 162 kB/s | 11 kB 00:00 2024-04-20T21:43:07.436 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-20T21:43:07.479 INFO:teuthology.orchestra.run.smithi164.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 626 kB/s | 172 kB 00:00 2024-04-20T21:43:07.504 INFO:teuthology.orchestra.run.smithi164.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 237 kB/s | 18 kB 00:00 2024-04-20T21:43:07.538 INFO:teuthology.orchestra.run.smithi164.stdout:(21/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.1 MB/s | 358 kB 00:00 2024-04-20T21:43:07.563 INFO:teuthology.orchestra.run.smithi164.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 279 kB/s | 23 kB 00:00 2024-04-20T21:43:07.580 INFO:teuthology.orchestra.run.smithi164.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 260 kB/s | 19 kB 00:00 2024-04-20T21:43:07.596 INFO:teuthology.orchestra.run.smithi164.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 340 kB/s | 20 kB 00:00 2024-04-20T21:43:07.630 INFO:teuthology.orchestra.run.smithi164.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 696 kB/s | 46 kB 00:00 2024-04-20T21:43:07.664 INFO:teuthology.orchestra.run.smithi164.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 949 kB/s | 79 kB 00:00 2024-04-20T21:43:07.697 INFO:teuthology.orchestra.run.smithi164.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-04-20T21:43:07.714 INFO:teuthology.orchestra.run.smithi164.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 197 kB/s | 16 kB 00:00 2024-04-20T21:43:07.739 INFO:teuthology.orchestra.run.smithi164.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-04-20T21:43:07.773 INFO:teuthology.orchestra.run.smithi164.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 478 kB/s | 36 kB 00:00 2024-04-20T21:43:07.807 INFO:teuthology.orchestra.run.smithi164.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.5 MB/s | 230 kB 00:00 2024-04-20T21:43:07.841 INFO:teuthology.orchestra.run.smithi164.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 303 kB/s | 20 kB 00:00 2024-04-20T21:43:07.882 INFO:teuthology.orchestra.run.smithi164.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.9 MB/s | 427 kB 00:00 2024-04-20T21:43:07.886 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:43:07.886 INFO:teuthology.orchestra.run.smithi164.stdout:Total 14 MB/s | 30 MB 00:02 2024-04-20T21:43:08.245 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-20T21:43:08.322 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:18.2.2-0.el9.noarch 1/1 2024-04-20T21:43:08.331 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-20T21:43:08.331 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-20T21:43:08.452 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:18.2.2-0.el9.noarch 1/1 2024-04-20T21:43:08.882 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-20T21:43:08.883 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-20T21:43:08.952 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:18.2.2-0.el9.noarch 1/1 2024-04-20T21:43:09.267 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:18.2.2-0.el9.noarch 1/1 2024-04-20T21:43:09.267 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:09.268 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-20T21:43:09.268 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:18.2.2-0.el9.noarch 2024-04-20T21:43:09.268 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:09.268 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:43:09.593 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-immutable-object-cache 2024-04-20T21:43:10.232 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-20T21:43:10.328 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-20T21:43:10.376 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-20T21:43:10.377 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:01 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:43:10.428 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-20T21:43:10.501 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:43:10.502 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:10.502 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2024-04-20T21:43:10.502 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:10.502 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-20T21:43:10.502 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-0.el9 ceph 142 k 2024-04-20T21:43:10.502 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:10.502 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-20T21:43:10.502 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:10.502 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-04-20T21:43:10.502 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:10.502 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 142 k 2024-04-20T21:43:10.503 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 395 k 2024-04-20T21:43:10.503 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-20T21:43:10.578 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-20T21:43:10.627 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-immutable-object-cache-18.2.2-0.el9.x86_64 1.1 MB/s | 142 kB 00:00 2024-04-20T21:43:10.628 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:43:10.629 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.1 MB/s | 142 kB 00:00 2024-04-20T21:43:10.629 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-20T21:43:10.639 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-20T21:43:10.639 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-20T21:43:10.685 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-20T21:43:10.710 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-20T21:43:10.711 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-20T21:43:10.742 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-20T21:43:10.783 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-20T21:43:10.821 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-20T21:43:10.857 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-20T21:43:10.901 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-20T21:43:10.963 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-20T21:43:10.984 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-20T21:43:11.057 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-20T21:43:11.080 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:43:11.105 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-20T21:43:11.151 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:43:11.151 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:43:11.151 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-20T21:43:11.151 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:11.167 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-20T21:43:11.300 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-20T21:43:11.494 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-20T21:43:11.594 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-20T21:43:11.662 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-20T21:43:11.730 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-20T21:43:11.796 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-20T21:43:11.867 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-20T21:43:12.122 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-20T21:43:12.184 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-20T21:43:12.275 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-20T21:43:12.392 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-20T21:43:12.414 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:43:12.414 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:12.414 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-20T21:43:12.414 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:18.2.2-0.el9.x86_64 2024-04-20T21:43:12.414 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:12.414 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:43:12.440 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-20T21:43:12.593 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-20T21:43:12.761 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-0.el9.noarch 28/33 2024-04-20T21:43:12.778 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr 2024-04-20T21:43:12.788 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-2:18.2.2-0.el9.x86_64 29/33 2024-04-20T21:43:12.870 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-2:18.2.2-0.el9.x86_64 29/33 2024-04-20T21:43:12.870 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:43:12.870 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-20T21:43:12.870 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-20T21:43:12.870 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-20T21:43:12.871 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:13.526 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:04 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:43:13.608 INFO:teuthology.orchestra.run.smithi142.stdout:Package ceph-mgr-2:18.2.2-0.el9.x86_64 is already installed. 2024-04-20T21:43:13.651 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:43:13.652 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-20T21:43:13.652 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:43:13.740 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-dashboard 2024-04-20T21:43:14.490 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:05 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:43:14.590 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-osd-2:18.2.2-0.el9.x86_64 30/33 2024-04-20T21:43:14.616 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:43:14.617 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:14.617 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-04-20T21:43:14.617 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:14.617 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-20T21:43:14.617 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:18.2.2-0.el9 ceph-noarch 1.8 M 2024-04-20T21:43:14.618 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-20T21:43:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:18.2.2-0.el9 ceph-noarch 23 k 2024-04-20T21:43:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:18.2.2-0.el9 ceph-noarch 15 k 2024-04-20T21:43:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-20T21:43:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-20T21:43:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-20T21:43:14.618 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2024-04-20T21:43:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-20T21:43:14.618 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:14.618 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-20T21:43:14.618 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:14.618 INFO:teuthology.orchestra.run.smithi142.stdout:Install 7 Packages 2024-04-20T21:43:14.619 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:14.619 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 2.1 M 2024-04-20T21:43:14.619 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 8.5 M 2024-04-20T21:43:14.619 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-20T21:43:14.685 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-osd-2:18.2.2-0.el9.x86_64 30/33 2024-04-20T21:43:14.685 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:43:14.685 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-20T21:43:14.685 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-20T21:43:14.685 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-20T21:43:14.685 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:15.157 INFO:teuthology.orchestra.run.smithi142.stdout:(1/7): ceph-grafana-dashboards-18.2.2-0.el9.noa 132 kB/s | 23 kB 00:00 2024-04-20T21:43:15.182 INFO:teuthology.orchestra.run.smithi142.stdout:(2/7): ceph-prometheus-alerts-18.2.2-0.el9.noar 73 kB/s | 15 kB 00:00 2024-04-20T21:43:15.182 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mon-2:18.2.2-0.el9.x86_64 31/33 2024-04-20T21:43:15.250 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mon-2:18.2.2-0.el9.x86_64 31/33 2024-04-20T21:43:15.250 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:43:15.250 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-20T21:43:15.250 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-20T21:43:15.250 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-20T21:43:15.250 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:15.265 INFO:teuthology.orchestra.run.smithi142.stdout:(3/7): ceph-mgr-dashboard-18.2.2-0.el9.noarch.r 6.2 MB/s | 1.8 MB 00:00 2024-04-20T21:43:15.449 INFO:teuthology.orchestra.run.smithi142.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 31 kB/s | 9.0 kB 00:00 2024-04-20T21:43:15.499 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mds-2:18.2.2-0.el9.x86_64 32/33 2024-04-20T21:43:15.549 INFO:teuthology.orchestra.run.smithi142.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 111 kB/s | 41 kB 00:00 2024-04-20T21:43:15.568 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mds-2:18.2.2-0.el9.x86_64 32/33 2024-04-20T21:43:15.568 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:43:15.568 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-20T21:43:15.568 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-20T21:43:15.568 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-20T21:43:15.568 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:15.574 INFO:teuthology.orchestra.run.smithi142.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 142 kB/s | 31 kB 00:00 2024-04-20T21:43:15.631 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-2:18.2.2-0.el9.x86_64 33/33 2024-04-20T21:43:15.633 INFO:teuthology.orchestra.run.smithi142.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.0 MB/s | 188 kB 00:00 2024-04-20T21:43:15.644 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:43:15.644 INFO:teuthology.orchestra.run.smithi142.stdout:Total 2.0 MB/s | 2.1 MB 00:01 2024-04-20T21:43:15.645 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-20T21:43:15.673 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-20T21:43:15.673 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-20T21:43:15.743 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-2:18.2.2-0.el9.x86_64 33/33 2024-04-20T21:43:15.744 INFO:teuthology.orchestra.run.smithi164.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-20T21:43:15.744 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:15.814 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-20T21:43:15.814 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-20T21:43:16.211 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-20T21:43:16.309 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-20T21:43:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-20T21:43:16.465 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-20T21:43:16.500 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-20T21:43:16.546 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-0.el9.noarch 5/7 2024-04-20T21:43:16.852 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-0.el9.noarch 6/7 2024-04-20T21:43:16.895 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-0.el9.noarch 7/7 2024-04-20T21:43:17.487 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-2:18.2.2-0.el9.x86_64 1/33 2024-04-20T21:43:17.487 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mds-2:18.2.2-0.el9.x86_64 2/33 2024-04-20T21:43:17.487 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-2:18.2.2-0.el9.x86_64 3/33 2024-04-20T21:43:17.487 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mon-2:18.2.2-0.el9.x86_64 4/33 2024-04-20T21:43:17.487 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-osd-2:18.2.2-0.el9.x86_64 5/33 2024-04-20T21:43:17.487 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-0.el9.noarch 6/33 2024-04-20T21:43:17.487 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-20T21:43:17.487 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-20T21:43:17.488 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-20T21:43:17.488 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-20T21:43:17.488 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-20T21:43:17.488 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-20T21:43:17.488 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-20T21:43:17.488 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-20T21:43:17.488 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-20T21:43:17.488 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-20T21:43:17.488 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-20T21:43:17.488 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-20T21:43:17.488 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-20T21:43:17.488 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-20T21:43:17.488 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-20T21:43:17.488 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-20T21:43:17.489 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-20T21:43:17.489 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-20T21:43:17.489 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-20T21:43:17.489 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-20T21:43:17.490 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-20T21:43:17.490 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-20T21:43:17.490 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-20T21:43:17.490 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-20T21:43:17.490 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-20T21:43:17.490 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-20T21:43:17.494 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-0.el9.noarch 7/7 2024-04-20T21:43:17.494 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-0.el9.noarch 1/7 2024-04-20T21:43:17.495 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-0.el9.noarch 2/7 2024-04-20T21:43:17.495 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-0.el9.noarch 3/7 2024-04-20T21:43:17.495 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-20T21:43:17.495 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-20T21:43:17.495 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-20T21:43:17.807 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-20T21:43:17.807 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:17.807 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-20T21:43:17.807 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:18.2.2-0.el9.noarch 2024-04-20T21:43:17.808 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:18.2.2-0.el9.noarch 2024-04-20T21:43:17.808 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:18.2.2-0.el9.noarch 2024-04-20T21:43:17.808 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-20T21:43:17.808 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-20T21:43:17.808 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-20T21:43:17.808 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-20T21:43:17.808 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:17.808 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:43:18.067 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-20T21:43:18.501 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-20T21:43:18.502 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:18.502 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-20T21:43:18.502 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-2:18.2.2-0.el9.x86_64 2024-04-20T21:43:18.502 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-2:18.2.2-0.el9.x86_64 2024-04-20T21:43:18.502 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-2:18.2.2-0.el9.x86_64 2024-04-20T21:43:18.502 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core-2:18.2.2-0.el9.noarch 2024-04-20T21:43:18.502 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-2:18.2.2-0.el9.x86_64 2024-04-20T21:43:18.502 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-2:18.2.2-0.el9.x86_64 2024-04-20T21:43:18.502 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-20T21:43:18.503 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-20T21:43:18.503 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-20T21:43:18.503 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-20T21:43:18.503 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-20T21:43:18.503 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-20T21:43:18.503 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-20T21:43:18.503 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-20T21:43:18.503 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-20T21:43:18.503 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-20T21:43:18.503 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-20T21:43:18.503 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-20T21:43:18.503 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-20T21:43:18.503 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-20T21:43:18.504 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-20T21:43:18.504 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply-3.11-14.el9.noarch 2024-04-20T21:43:18.504 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-20T21:43:18.504 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-20T21:43:18.504 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-20T21:43:18.504 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-20T21:43:18.504 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-20T21:43:18.504 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-20T21:43:18.504 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-20T21:43:18.504 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-20T21:43:18.504 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-20T21:43:18.504 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-20T21:43:18.504 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-20T21:43:18.504 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:18.504 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:43:18.856 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:09 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:43:18.954 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-base 2024-04-20T21:43:18.985 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:43:18.987 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:18.987 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-04-20T21:43:18.987 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:18.987 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-20T21:43:18.987 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-0.el9 ceph-noarch 7.4 M 2024-04-20T21:43:18.987 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-20T21:43:18.987 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-20T21:43:18.987 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-20T21:43:18.987 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-20T21:43:18.987 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-20T21:43:18.987 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-20T21:43:18.988 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-20T21:43:18.988 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-20T21:43:18.988 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-20T21:43:18.988 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-20T21:43:18.988 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-20T21:43:18.988 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-20T21:43:18.988 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:18.988 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-20T21:43:18.988 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:18.988 INFO:teuthology.orchestra.run.smithi142.stdout:Install 12 Packages 2024-04-20T21:43:18.988 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:18.989 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 38 M 2024-04-20T21:43:18.989 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 209 M 2024-04-20T21:43:18.989 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-20T21:43:19.697 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:55 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:43:19.764 INFO:teuthology.orchestra.run.smithi142.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.2-0. 22 MB/s | 7.4 MB 00:00 2024-04-20T21:43:19.779 INFO:teuthology.orchestra.run.smithi164.stdout:Package ceph-base-2:18.2.2-0.el9.x86_64 is already installed. 2024-04-20T21:43:19.814 INFO:teuthology.orchestra.run.smithi142.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 665 kB/s | 33 kB 00:00 2024-04-20T21:43:19.822 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:43:19.823 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-20T21:43:19.823 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:43:19.848 INFO:teuthology.orchestra.run.smithi142.stdout:(3/12): libquadmath-11.4.1-3.el9.x86_64.rpm 461 kB/s | 195 kB 00:00 2024-04-20T21:43:19.898 INFO:teuthology.orchestra.run.smithi142.stdout:(4/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.7 MB/s | 803 kB 00:00 2024-04-20T21:43:19.915 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install cephadm 2024-04-20T21:43:19.923 INFO:teuthology.orchestra.run.smithi142.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 243 kB/s | 18 kB 00:00 2024-04-20T21:43:19.965 INFO:teuthology.orchestra.run.smithi142.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 535 kB/s | 35 kB 00:00 2024-04-20T21:43:20.066 INFO:teuthology.orchestra.run.smithi142.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2024-04-20T21:43:20.099 INFO:teuthology.orchestra.run.smithi142.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.8 MB/s | 244 kB 00:00 2024-04-20T21:43:20.266 INFO:teuthology.orchestra.run.smithi142.stdout:(9/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2024-04-20T21:43:20.300 INFO:teuthology.orchestra.run.smithi142.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.2 MB/s | 250 kB 00:00 2024-04-20T21:43:20.592 INFO:teuthology.orchestra.run.smithi142.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.7 MB/s | 5.1 MB 00:00 2024-04-20T21:43:20.673 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:56 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:43:20.796 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:43:20.796 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:20.796 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-04-20T21:43:20.796 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:20.796 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-20T21:43:20.796 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm noarch 2:18.2.2-0.el9 ceph-noarch 221 k 2024-04-20T21:43:20.796 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:20.796 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-20T21:43:20.796 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:20.797 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-20T21:43:20.797 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:20.797 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 221 k 2024-04-20T21:43:20.797 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 213 k 2024-04-20T21:43:20.797 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-20T21:43:20.850 INFO:teuthology.orchestra.run.smithi142.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-04-20T21:43:20.857 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:43:20.857 INFO:teuthology.orchestra.run.smithi142.stdout:Total 20 MB/s | 38 MB 00:01 2024-04-20T21:43:20.881 INFO:teuthology.orchestra.run.smithi164.stdout:cephadm-18.2.2-0.el9.noarch.rpm 2.6 MB/s | 221 kB 00:00 2024-04-20T21:43:20.881 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:43:20.882 INFO:teuthology.orchestra.run.smithi164.stdout:Total 2.5 MB/s | 221 kB 00:00 2024-04-20T21:43:20.882 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-20T21:43:20.888 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-20T21:43:20.888 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-20T21:43:20.892 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-20T21:43:20.892 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-20T21:43:20.977 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-20T21:43:21.469 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-20T21:43:21.548 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-20T21:43:21.548 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-20T21:43:21.620 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:18.2.2-0.el9.noarch 1/1 2024-04-20T21:43:21.718 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephadm-2:18.2.2-0.el9.noarch 1/1 2024-04-20T21:43:22.129 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:18.2.2-0.el9.noarch 1/1 2024-04-20T21:43:22.177 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-20T21:43:22.178 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-20T21:43:22.473 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephadm-2:18.2.2-0.el9.noarch 1/1 2024-04-20T21:43:22.473 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:22.473 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-20T21:43:22.473 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm-2:18.2.2-0.el9.noarch 2024-04-20T21:43:22.473 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:22.473 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:43:22.764 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-immutable-object-cache 2024-04-20T21:43:23.111 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-20T21:43:23.233 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-20T21:43:23.293 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-20T21:43:23.448 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-20T21:43:23.493 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-20T21:43:23.577 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:59 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:43:23.698 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:43:23.699 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:23.699 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-04-20T21:43:23.699 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:23.699 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-20T21:43:23.699 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-0.el9 ceph 142 k 2024-04-20T21:43:23.699 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:23.699 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-20T21:43:23.699 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:23.699 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-20T21:43:23.699 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:23.700 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 142 k 2024-04-20T21:43:23.700 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 395 k 2024-04-20T21:43:23.700 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-20T21:43:23.746 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-20T21:43:23.769 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-immutable-object-cache-18.2.2-0.el9.x86_64 2.0 MB/s | 142 kB 00:00 2024-04-20T21:43:23.770 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:43:23.770 INFO:teuthology.orchestra.run.smithi164.stdout:Total 2.0 MB/s | 142 kB 00:00 2024-04-20T21:43:23.770 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-20T21:43:23.779 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-20T21:43:23.779 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-20T21:43:23.791 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-20T21:43:23.845 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-20T21:43:23.845 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-20T21:43:23.923 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-20T21:43:24.016 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-20T21:43:24.087 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:43:24.154 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:43:24.154 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:43:24.154 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-20T21:43:24.154 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:24.795 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-20T21:43:24.934 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-20T21:43:25.391 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:43:25.391 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:25.391 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-20T21:43:25.391 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-2:18.2.2-0.el9.x86_64 2024-04-20T21:43:25.391 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:25.391 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:43:25.672 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr 2024-04-20T21:43:26.438 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:02 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:43:26.507 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-20T21:43:26.519 INFO:teuthology.orchestra.run.smithi164.stdout:Package ceph-mgr-2:18.2.2-0.el9.x86_64 is already installed. 2024-04-20T21:43:26.562 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:43:26.563 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-20T21:43:26.563 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:43:26.655 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr-dashboard 2024-04-20T21:43:27.380 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:03 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:43:27.509 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:43:27.510 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:27.510 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-20T21:43:27.510 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:27.510 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-20T21:43:27.511 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard noarch 2:18.2.2-0.el9 ceph-noarch 1.8 M 2024-04-20T21:43:27.511 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-20T21:43:27.511 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards noarch 2:18.2.2-0.el9 ceph-noarch 23 k 2024-04-20T21:43:27.511 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts noarch 2:18.2.2-0.el9 ceph-noarch 15 k 2024-04-20T21:43:27.511 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-20T21:43:27.511 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-20T21:43:27.511 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-20T21:43:27.511 INFO:teuthology.orchestra.run.smithi164.stdout:Installing weak dependencies: 2024-04-20T21:43:27.511 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-20T21:43:27.511 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:27.511 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-20T21:43:27.511 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:27.511 INFO:teuthology.orchestra.run.smithi164.stdout:Install 7 Packages 2024-04-20T21:43:27.511 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:27.512 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 2.1 M 2024-04-20T21:43:27.512 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 8.5 M 2024-04-20T21:43:27.512 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-20T21:43:27.671 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-20T21:43:27.705 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-0.el9.noarc 12/12 2024-04-20T21:43:27.872 INFO:teuthology.orchestra.run.smithi164.stdout:(1/7): ceph-grafana-dashboards-18.2.2-0.el9.noa 123 kB/s | 23 kB 00:00 2024-04-20T21:43:27.897 INFO:teuthology.orchestra.run.smithi164.stdout:(2/7): ceph-prometheus-alerts-18.2.2-0.el9.noar 68 kB/s | 15 kB 00:00 2024-04-20T21:43:27.964 INFO:teuthology.orchestra.run.smithi164.stdout:(3/7): ceph-mgr-dashboard-18.2.2-0.el9.noarch.r 6.3 MB/s | 1.8 MB 00:00 2024-04-20T21:43:28.281 INFO:teuthology.orchestra.run.smithi164.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 22 kB/s | 9.0 kB 00:00 2024-04-20T21:43:28.357 INFO:teuthology.orchestra.run.smithi164.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 89 kB/s | 41 kB 00:00 2024-04-20T21:43:28.407 INFO:teuthology.orchestra.run.smithi164.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 70 kB/s | 31 kB 00:00 2024-04-20T21:43:28.674 INFO:teuthology.orchestra.run.smithi164.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 482 kB/s | 188 kB 00:00 2024-04-20T21:43:28.684 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:43:28.685 INFO:teuthology.orchestra.run.smithi164.stdout:Total 1.8 MB/s | 2.1 MB 00:01 2024-04-20T21:43:28.685 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-20T21:43:28.713 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-20T21:43:28.714 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-20T21:43:28.872 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-20T21:43:28.873 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-20T21:43:29.267 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-20T21:43:29.325 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-20T21:43:29.366 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-20T21:43:29.436 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-20T21:43:29.473 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-20T21:43:29.516 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-0.el9.noarch 5/7 2024-04-20T21:43:29.821 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-0.el9.noarch 6/7 2024-04-20T21:43:29.882 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-0.el9.noarch 7/7 2024-04-20T21:43:30.306 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-0.el9.noarc 12/12 2024-04-20T21:43:30.306 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-0.el9.noarc 1/12 2024-04-20T21:43:30.306 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-20T21:43:30.306 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-20T21:43:30.306 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-20T21:43:30.306 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-20T21:43:30.307 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-20T21:43:30.307 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-20T21:43:30.307 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-20T21:43:30.307 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-20T21:43:30.307 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-20T21:43:30.307 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-20T21:43:30.445 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-0.el9.noarch 7/7 2024-04-20T21:43:30.445 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-0.el9.noarch 1/7 2024-04-20T21:43:30.445 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-0.el9.noarch 2/7 2024-04-20T21:43:30.445 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-0.el9.noarch 3/7 2024-04-20T21:43:30.445 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-20T21:43:30.445 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-20T21:43:30.445 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-20T21:43:30.687 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-20T21:43:30.688 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:30.688 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-20T21:43:30.688 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:18.2.2-0.el9.noarch 2024-04-20T21:43:30.688 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-20T21:43:30.688 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-20T21:43:30.688 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-20T21:43:30.688 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-20T21:43:30.688 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-20T21:43:30.688 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-20T21:43:30.688 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-20T21:43:30.688 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-20T21:43:30.688 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-20T21:43:30.689 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-20T21:43:30.689 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-20T21:43:30.689 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:30.689 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:43:30.796 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-20T21:43:30.796 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:30.796 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-20T21:43:30.796 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards-2:18.2.2-0.el9.noarch 2024-04-20T21:43:30.796 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard-2:18.2.2-0.el9.noarch 2024-04-20T21:43:30.796 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts-2:18.2.2-0.el9.noarch 2024-04-20T21:43:30.796 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-20T21:43:30.796 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-20T21:43:30.796 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-20T21:43:30.796 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-20T21:43:30.796 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:30.796 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:43:31.079 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-20T21:43:31.157 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-rook 2024-04-20T21:43:31.878 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:07 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:43:31.924 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:22 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:43:32.011 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:43:32.012 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:32.012 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-20T21:43:32.012 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:32.012 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-20T21:43:32.012 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-0.el9 ceph-noarch 7.4 M 2024-04-20T21:43:32.012 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-20T21:43:32.013 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-20T21:43:32.013 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-20T21:43:32.013 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-20T21:43:32.013 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-20T21:43:32.013 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-20T21:43:32.013 INFO:teuthology.orchestra.run.smithi164.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-20T21:43:32.013 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-20T21:43:32.013 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-20T21:43:32.013 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-20T21:43:32.013 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-20T21:43:32.013 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-20T21:43:32.013 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:32.013 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-20T21:43:32.013 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:32.013 INFO:teuthology.orchestra.run.smithi164.stdout:Install 12 Packages 2024-04-20T21:43:32.014 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:32.014 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 38 M 2024-04-20T21:43:32.014 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 209 M 2024-04-20T21:43:32.014 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-20T21:43:32.050 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:43:32.052 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:32.052 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-04-20T21:43:32.052 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:32.052 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-20T21:43:32.052 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:18.2.2-0.el9 ceph-noarch 50 k 2024-04-20T21:43:32.052 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-20T21:43:32.052 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-20T21:43:32.052 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-20T21:43:32.052 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-20T21:43:32.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-20T21:43:32.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-20T21:43:32.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-20T21:43:32.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-20T21:43:32.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-20T21:43:32.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-20T21:43:32.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-20T21:43:32.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-20T21:43:32.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-20T21:43:32.053 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:32.053 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-20T21:43:32.053 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:32.053 INFO:teuthology.orchestra.run.smithi142.stdout:Install 13 Packages 2024-04-20T21:43:32.053 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:32.054 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 2.2 M 2024-04-20T21:43:32.054 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 26 M 2024-04-20T21:43:32.054 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-20T21:43:32.448 INFO:teuthology.orchestra.run.smithi142.stdout:(1/13): ceph-mgr-rook-18.2.2-0.el9.noarch.rpm 463 kB/s | 50 kB 00:00 2024-04-20T21:43:32.639 INFO:teuthology.orchestra.run.smithi164.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.2-0. 28 MB/s | 7.4 MB 00:00 2024-04-20T21:43:32.648 INFO:teuthology.orchestra.run.smithi142.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 62 kB/s | 19 kB 00:00 2024-04-20T21:43:32.681 INFO:teuthology.orchestra.run.smithi142.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 75 kB/s | 26 kB 00:00 2024-04-20T21:43:32.731 INFO:teuthology.orchestra.run.smithi164.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 362 kB/s | 33 kB 00:00 2024-04-20T21:43:32.765 INFO:teuthology.orchestra.run.smithi142.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-04-20T21:43:32.815 INFO:teuthology.orchestra.run.smithi142.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 607 kB/s | 222 kB 00:00 2024-04-20T21:43:32.849 INFO:teuthology.orchestra.run.smithi142.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.6 MB/s | 279 kB 00:00 2024-04-20T21:43:32.874 INFO:teuthology.orchestra.run.smithi142.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 495 kB/s | 54 kB 00:00 2024-04-20T21:43:32.965 INFO:teuthology.orchestra.run.smithi164.stdout:(3/12): libquadmath-11.4.1-3.el9.x86_64.rpm 333 kB/s | 195 kB 00:00 2024-04-20T21:43:32.991 INFO:teuthology.orchestra.run.smithi142.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 184 kB/s | 32 kB 00:00 2024-04-20T21:43:33.016 INFO:teuthology.orchestra.run.smithi142.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 90 kB/s | 15 kB 00:00 2024-04-20T21:43:33.089 INFO:teuthology.orchestra.run.smithi164.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.4 MB/s | 3.0 MB 00:00 2024-04-20T21:43:33.115 INFO:teuthology.orchestra.run.smithi164.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 122 kB/s | 18 kB 00:00 2024-04-20T21:43:33.133 INFO:teuthology.orchestra.run.smithi142.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 510 kB/s | 59 kB 00:00 2024-04-20T21:43:33.140 INFO:teuthology.orchestra.run.smithi164.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 711 kB/s | 35 kB 00:00 2024-04-20T21:43:33.175 INFO:teuthology.orchestra.run.smithi142.stdout:(11/13): python3-google-auth-2.28.2-1.el9.noarc 676 kB/s | 203 kB 00:00 2024-04-20T21:43:33.199 INFO:teuthology.orchestra.run.smithi164.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-04-20T21:43:33.259 INFO:teuthology.orchestra.run.smithi142.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 720 kB/s | 90 kB 00:00 2024-04-20T21:43:33.299 INFO:teuthology.orchestra.run.smithi164.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 871 kB/s | 803 kB 00:00 2024-04-20T21:43:33.317 INFO:teuthology.orchestra.run.smithi142.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.1 MB/s | 1.0 MB 00:00 2024-04-20T21:43:33.325 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:43:33.325 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.7 MB/s | 2.2 MB 00:01 2024-04-20T21:43:33.457 INFO:teuthology.orchestra.run.smithi164.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.6 MB/s | 250 kB 00:00 2024-04-20T21:43:33.538 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-20T21:43:33.585 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-20T21:43:33.585 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-20T21:43:33.700 INFO:teuthology.orchestra.run.smithi164.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 8.1 MB/s | 4.7 MB 00:00 2024-04-20T21:43:33.732 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-20T21:43:33.733 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-20T21:43:33.816 INFO:teuthology.orchestra.run.smithi164.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.3 MB/s | 5.1 MB 00:00 2024-04-20T21:43:34.507 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-20T21:43:34.737 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-20T21:43:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-20T21:43:34.901 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-20T21:43:34.933 INFO:teuthology.orchestra.run.smithi164.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-04-20T21:43:34.934 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:43:34.935 INFO:teuthology.orchestra.run.smithi164.stdout:Total 13 MB/s | 38 MB 00:02 2024-04-20T21:43:34.939 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-20T21:43:34.994 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-20T21:43:35.132 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-20T21:43:35.271 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-20T21:43:35.346 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-20T21:43:35.570 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-20T21:43:35.648 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-20T21:43:35.649 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-20T21:43:36.241 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-20T21:43:36.295 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-20T21:43:36.295 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-20T21:43:36.296 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-20T21:43:36.328 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-20T21:43:36.378 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-20T21:43:36.405 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:18.2.2-0.el9.noarch 13/13 2024-04-20T21:43:37.197 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-20T21:43:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-0.el9.noarch 13/13 2024-04-20T21:43:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:18.2.2-0.el9.noarch 1/13 2024-04-20T21:43:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-20T21:43:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-20T21:43:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-20T21:43:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-20T21:43:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-20T21:43:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-20T21:43:37.252 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-20T21:43:37.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-20T21:43:37.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-20T21:43:37.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-20T21:43:37.253 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-20T21:43:37.274 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-20T21:43:37.327 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-20T21:43:37.477 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-20T21:43:37.519 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-20T21:43:37.668 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-20T21:43:37.669 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:37.669 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-20T21:43:37.669 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:18.2.2-0.el9.noarch 2024-04-20T21:43:37.669 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-20T21:43:37.669 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-20T21:43:37.669 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-20T21:43:37.670 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-20T21:43:37.670 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-20T21:43:37.670 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-20T21:43:37.670 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-20T21:43:37.670 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-20T21:43:37.670 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-20T21:43:37.670 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-20T21:43:37.671 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-20T21:43:37.671 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-20T21:43:37.671 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:37.671 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:43:37.773 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-20T21:43:37.807 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-20T21:43:37.923 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-20T21:43:37.969 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-cephadm 2024-04-20T21:43:38.730 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:29 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:43:38.831 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-20T21:43:38.852 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:43:38.853 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:38.853 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-04-20T21:43:38.853 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:38.853 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-20T21:43:38.853 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:18.2.2-0.el9 ceph-noarch 132 k 2024-04-20T21:43:38.854 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-20T21:43:38.854 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-20T21:43:38.854 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-20T21:43:38.854 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-20T21:43:38.854 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-20T21:43:38.854 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-20T21:43:38.854 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:38.854 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-20T21:43:38.854 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:38.854 INFO:teuthology.orchestra.run.smithi142.stdout:Install 6 Packages 2024-04-20T21:43:38.854 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:38.855 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 7.0 M 2024-04-20T21:43:38.855 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 33 M 2024-04-20T21:43:38.855 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-20T21:43:38.978 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-20T21:43:39.136 INFO:teuthology.orchestra.run.smithi142.stdout:(1/6): ceph-mgr-cephadm-18.2.2-0.el9.noarch.rpm 1.1 MB/s | 132 kB 00:00 2024-04-20T21:43:39.211 INFO:teuthology.orchestra.run.smithi142.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-04-20T21:43:39.478 INFO:teuthology.orchestra.run.smithi142.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-04-20T21:43:39.653 INFO:teuthology.orchestra.run.smithi142.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 155 kB/s | 58 kB 00:00 2024-04-20T21:43:39.820 INFO:teuthology.orchestra.run.smithi142.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 150 kB/s | 51 kB 00:00 2024-04-20T21:43:39.920 INFO:teuthology.orchestra.run.smithi142.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 700 kB/s | 548 kB 00:00 2024-04-20T21:43:39.929 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:43:39.929 INFO:teuthology.orchestra.run.smithi142.stdout:Total 6.5 MB/s | 7.0 MB 00:01 2024-04-20T21:43:40.052 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-20T21:43:40.089 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-20T21:43:40.090 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-20T21:43:40.224 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-20T21:43:40.225 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-20T21:43:40.609 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-20T21:43:40.611 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-20T21:43:40.844 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-20T21:43:40.903 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-20T21:43:41.564 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-20T21:43:41.658 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-20T21:43:41.734 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-20T21:43:41.771 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-20T21:43:41.775 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-0.el9.noarch 6/6 2024-04-20T21:43:41.797 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-0.el9.noarc 12/12 2024-04-20T21:43:42.643 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-0.el9.noarch 6/6 2024-04-20T21:43:42.643 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-0.el9.noarch 1/6 2024-04-20T21:43:42.643 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-20T21:43:42.643 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-20T21:43:42.643 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-20T21:43:42.643 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-20T21:43:42.934 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-20T21:43:42.934 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:42.934 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-20T21:43:42.934 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:18.2.2-0.el9.noarch 2024-04-20T21:43:42.934 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-20T21:43:42.934 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-20T21:43:42.934 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-20T21:43:42.934 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-20T21:43:42.934 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-20T21:43:42.934 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:42.934 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:43:43.220 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-fuse 2024-04-20T21:43:43.998 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:34 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:43:44.122 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:43:44.123 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:44.124 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-04-20T21:43:44.124 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:44.124 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-20T21:43:44.124 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:18.2.2-0.el9 ceph 840 k 2024-04-20T21:43:44.124 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-20T21:43:44.124 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-20T21:43:44.124 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:44.124 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-20T21:43:44.124 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:44.124 INFO:teuthology.orchestra.run.smithi142.stdout:Install 2 Packages 2024-04-20T21:43:44.124 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:44.124 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 920 k 2024-04-20T21:43:44.125 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 2.7 M 2024-04-20T21:43:44.125 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-20T21:43:44.260 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-0.el9.noarc 12/12 2024-04-20T21:43:44.260 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-0.el9.noarc 1/12 2024-04-20T21:43:44.260 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-20T21:43:44.260 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-20T21:43:44.260 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-20T21:43:44.261 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-20T21:43:44.261 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-20T21:43:44.261 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-20T21:43:44.261 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-20T21:43:44.261 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-20T21:43:44.261 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-20T21:43:44.261 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-20T21:43:44.405 INFO:teuthology.orchestra.run.smithi142.stdout:(1/2): ceph-fuse-18.2.2-0.el9.x86_64.rpm 6.3 MB/s | 840 kB 00:00 2024-04-20T21:43:44.681 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-20T21:43:44.681 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:44.681 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-20T21:43:44.682 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local-2:18.2.2-0.el9.noarch 2024-04-20T21:43:44.682 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-20T21:43:44.682 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-20T21:43:44.682 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-20T21:43:44.682 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-20T21:43:44.682 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-20T21:43:44.682 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-20T21:43:44.682 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-20T21:43:44.682 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-20T21:43:44.682 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-20T21:43:44.682 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-20T21:43:44.682 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-20T21:43:44.682 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:44.683 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:43:44.755 INFO:teuthology.orchestra.run.smithi142.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 167 kB/s | 80 kB 00:00 2024-04-20T21:43:44.757 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:43:44.758 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.4 MB/s | 920 kB 00:00 2024-04-20T21:43:44.797 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-20T21:43:44.872 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-20T21:43:44.872 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-20T21:43:44.977 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-20T21:43:44.977 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-20T21:43:45.133 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr-rook 2024-04-20T21:43:45.235 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-20T21:43:45.445 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-20T21:43:45.524 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:18.2.2-0.el9.x86_64 2/2 2024-04-20T21:43:45.930 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:21 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:43:46.067 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:43:46.068 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:46.068 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-20T21:43:46.069 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:46.069 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-20T21:43:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook noarch 2:18.2.2-0.el9 ceph-noarch 50 k 2024-04-20T21:43:46.069 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-20T21:43:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-20T21:43:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-20T21:43:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-20T21:43:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-20T21:43:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-20T21:43:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-20T21:43:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-20T21:43:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-20T21:43:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-20T21:43:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-20T21:43:46.069 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-20T21:43:46.070 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-20T21:43:46.070 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:46.070 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-20T21:43:46.070 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:46.070 INFO:teuthology.orchestra.run.smithi164.stdout:Install 13 Packages 2024-04-20T21:43:46.070 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:46.070 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 2.2 M 2024-04-20T21:43:46.070 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 26 M 2024-04-20T21:43:46.071 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-20T21:43:46.414 INFO:teuthology.orchestra.run.smithi164.stdout:(1/13): ceph-mgr-rook-18.2.2-0.el9.noarch.rpm 293 kB/s | 50 kB 00:00 2024-04-20T21:43:46.439 INFO:teuthology.orchestra.run.smithi164.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 130 kB/s | 26 kB 00:00 2024-04-20T21:43:46.488 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-fuse-2:18.2.2-0.el9.x86_64 2/2 2024-04-20T21:43:46.488 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:18.2.2-0.el9.x86_64 1/2 2024-04-20T21:43:46.498 INFO:teuthology.orchestra.run.smithi164.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 75 kB/s | 19 kB 00:00 2024-04-20T21:43:46.631 INFO:teuthology.orchestra.run.smithi164.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.0 MB/s | 222 kB 00:00 2024-04-20T21:43:46.748 INFO:teuthology.orchestra.run.smithi164.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 577 kB/s | 159 kB 00:00 2024-04-20T21:43:46.782 INFO:teuthology.orchestra.run.smithi164.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.1 MB/s | 279 kB 00:00 2024-04-20T21:43:46.800 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-20T21:43:46.800 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:46.800 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-20T21:43:46.800 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:18.2.2-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-20T21:43:46.800 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:46.801 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:43:46.807 INFO:teuthology.orchestra.run.smithi164.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 307 kB/s | 54 kB 00:00 2024-04-20T21:43:47.086 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librados-devel 2024-04-20T21:43:47.124 INFO:teuthology.orchestra.run.smithi164.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 44 kB/s | 15 kB 00:00 2024-04-20T21:43:47.149 INFO:teuthology.orchestra.run.smithi164.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 80 kB/s | 32 kB 00:00 2024-04-20T21:43:47.275 INFO:teuthology.orchestra.run.smithi164.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 476 kB/s | 59 kB 00:00 2024-04-20T21:43:47.350 INFO:teuthology.orchestra.run.smithi164.stdout:(11/13): python3-google-auth-2.28.2-1.el9.noarc 374 kB/s | 203 kB 00:00 2024-04-20T21:43:47.392 INFO:teuthology.orchestra.run.smithi164.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 773 kB/s | 90 kB 00:00 2024-04-20T21:43:47.550 INFO:teuthology.orchestra.run.smithi164.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.4 MB/s | 1.0 MB 00:00 2024-04-20T21:43:47.559 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:43:47.560 INFO:teuthology.orchestra.run.smithi164.stdout:Total 1.5 MB/s | 2.2 MB 00:01 2024-04-20T21:43:47.772 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-20T21:43:47.820 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-20T21:43:47.820 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-20T21:43:47.845 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:38 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:43:47.967 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-20T21:43:47.968 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-20T21:43:47.973 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:43:47.973 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:47.973 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-04-20T21:43:47.973 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:47.973 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-20T21:43:47.974 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:18.2.2-0.el9 ceph 126 k 2024-04-20T21:43:47.974 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:47.974 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-20T21:43:47.974 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:47.974 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-04-20T21:43:47.974 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:47.974 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 126 k 2024-04-20T21:43:47.975 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 456 k 2024-04-20T21:43:47.975 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-20T21:43:48.041 INFO:teuthology.orchestra.run.smithi142.stdout:librados-devel-18.2.2-0.el9.x86_64.rpm 1.9 MB/s | 126 kB 00:00 2024-04-20T21:43:48.042 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:43:48.042 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.8 MB/s | 126 kB 00:00 2024-04-20T21:43:48.043 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-20T21:43:48.049 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-20T21:43:48.049 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-20T21:43:48.124 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-20T21:43:48.125 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-20T21:43:48.299 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-20T21:43:48.421 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:43:48.696 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-20T21:43:48.913 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-20T21:43:48.987 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-20T21:43:49.053 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados-devel-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:43:49.059 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-20T21:43:49.098 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-20T21:43:49.153 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-20T21:43:49.300 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:43:49.300 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:49.300 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-20T21:43:49.301 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:18.2.2-0.el9.x86_64 2024-04-20T21:43:49.301 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:49.301 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:43:49.314 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-20T21:43:49.460 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-20T21:43:49.537 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-20T21:43:49.570 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install libcephfs2 2024-04-20T21:43:50.343 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:41 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:43:50.433 INFO:teuthology.orchestra.run.smithi142.stdout:Package libcephfs2-2:18.2.2-0.el9.x86_64 is already installed. 2024-04-20T21:43:50.453 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-20T21:43:50.476 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:43:50.477 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-20T21:43:50.477 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:43:50.512 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-20T21:43:50.546 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-20T21:43:50.553 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install libcephfs-devel 2024-04-20T21:43:50.601 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-20T21:43:50.630 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-rook-2:18.2.2-0.el9.noarch 13/13 2024-04-20T21:43:51.268 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:42 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:43:51.398 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:43:51.399 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:51.399 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-04-20T21:43:51.399 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:51.399 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-20T21:43:51.399 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:18.2.2-0.el9 ceph 31 k 2024-04-20T21:43:51.399 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:51.399 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-20T21:43:51.399 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:51.399 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-04-20T21:43:51.399 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:51.400 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 31 k 2024-04-20T21:43:51.400 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 139 k 2024-04-20T21:43:51.400 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-20T21:43:51.520 INFO:teuthology.orchestra.run.smithi142.stdout:libcephfs-devel-18.2.2-0.el9.x86_64.rpm 260 kB/s | 31 kB 00:00 2024-04-20T21:43:51.520 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:43:51.520 INFO:teuthology.orchestra.run.smithi142.stdout:Total 256 kB/s | 31 kB 00:00 2024-04-20T21:43:51.521 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-20T21:43:51.525 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-20T21:43:51.525 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-20T21:43:51.545 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-20T21:43:51.546 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-20T21:43:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-0.el9.noarch 13/13 2024-04-20T21:43:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-rook-2:18.2.2-0.el9.noarch 1/13 2024-04-20T21:43:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-20T21:43:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-20T21:43:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-20T21:43:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-20T21:43:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-20T21:43:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-20T21:43:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-20T21:43:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-20T21:43:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-20T21:43:51.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-20T21:43:51.563 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-20T21:43:51.681 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-20T21:43:51.862 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:43:51.982 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-20T21:43:51.982 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:51.982 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-20T21:43:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook-2:18.2.2-0.el9.noarch 2024-04-20T21:43:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-20T21:43:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-20T21:43:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-20T21:43:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-20T21:43:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-20T21:43:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-20T21:43:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-20T21:43:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-20T21:43:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-20T21:43:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-20T21:43:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-20T21:43:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-20T21:43:51.983 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:51.983 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:43:52.332 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs-devel-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:43:52.333 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr-cephadm 2024-04-20T21:43:52.601 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:43:52.601 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:52.601 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-20T21:43:52.601 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:18.2.2-0.el9.x86_64 2024-04-20T21:43:52.601 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:52.601 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:43:52.838 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librados2 2024-04-20T21:43:53.148 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:29 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:43:53.275 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:43:53.276 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:53.276 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-20T21:43:53.276 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:53.276 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-20T21:43:53.276 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm noarch 2:18.2.2-0.el9 ceph-noarch 132 k 2024-04-20T21:43:53.276 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-20T21:43:53.276 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-20T21:43:53.276 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-20T21:43:53.277 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-20T21:43:53.277 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-20T21:43:53.277 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-20T21:43:53.277 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:53.277 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-20T21:43:53.277 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:53.277 INFO:teuthology.orchestra.run.smithi164.stdout:Install 6 Packages 2024-04-20T21:43:53.277 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:53.278 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 7.0 M 2024-04-20T21:43:53.278 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 33 M 2024-04-20T21:43:53.278 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-20T21:43:53.619 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:44 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:43:53.700 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:18.2.2-0.el9.x86_64 is already installed. 2024-04-20T21:43:53.742 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:43:53.743 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-20T21:43:53.743 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:43:53.812 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librbd1 2024-04-20T21:43:53.845 INFO:teuthology.orchestra.run.smithi164.stdout:(1/6): ceph-mgr-cephadm-18.2.2-0.el9.noarch.rpm 1.0 MB/s | 132 kB 00:00 2024-04-20T21:43:53.912 INFO:teuthology.orchestra.run.smithi164.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-04-20T21:43:54.179 INFO:teuthology.orchestra.run.smithi164.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-04-20T21:43:54.379 INFO:teuthology.orchestra.run.smithi164.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 146 kB/s | 58 kB 00:00 2024-04-20T21:43:54.487 INFO:teuthology.orchestra.run.smithi164.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 855 kB/s | 548 kB 00:00 2024-04-20T21:43:54.529 INFO:teuthology.orchestra.run.smithi164.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 146 kB/s | 51 kB 00:00 2024-04-20T21:43:54.537 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:43:54.538 INFO:teuthology.orchestra.run.smithi164.stdout:Total 5.5 MB/s | 7.0 MB 00:01 2024-04-20T21:43:54.584 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:45 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:43:54.663 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-20T21:43:54.665 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:18.2.2-0.el9.x86_64 is already installed. 2024-04-20T21:43:54.701 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-20T21:43:54.701 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-20T21:43:54.706 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:43:54.708 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-20T21:43:54.708 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:43:54.785 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rados 2024-04-20T21:43:54.853 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-20T21:43:54.854 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-20T21:43:55.269 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-20T21:43:55.487 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-20T21:43:55.530 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:46 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:43:55.555 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-20T21:43:55.617 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rados-2:18.2.2-0.el9.x86_64 is already installed. 2024-04-20T21:43:55.658 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:43:55.660 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-20T21:43:55.660 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:43:55.728 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rgw 2024-04-20T21:43:56.240 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-20T21:43:56.353 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-20T21:43:56.482 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:47 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:43:56.544 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-20T21:43:56.568 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rgw-2:18.2.2-0.el9.x86_64 is already installed. 2024-04-20T21:43:56.585 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-0.el9.noarch 6/6 2024-04-20T21:43:56.610 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:43:56.611 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-20T21:43:56.611 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:43:56.691 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-cephfs 2024-04-20T21:43:57.366 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-0.el9.noarch 6/6 2024-04-20T21:43:57.366 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-0.el9.noarch 1/6 2024-04-20T21:43:57.366 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-20T21:43:57.366 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-20T21:43:57.366 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-20T21:43:57.366 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-20T21:43:57.413 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:48 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:43:57.500 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-cephfs-2:18.2.2-0.el9.x86_64 is already installed. 2024-04-20T21:43:57.541 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:43:57.542 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-20T21:43:57.542 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:43:57.615 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rbd 2024-04-20T21:43:57.680 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-20T21:43:57.680 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:57.680 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-20T21:43:57.680 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm-2:18.2.2-0.el9.noarch 2024-04-20T21:43:57.680 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-20T21:43:57.680 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-20T21:43:57.680 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-20T21:43:57.680 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-20T21:43:57.680 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-20T21:43:57.680 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:57.680 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:43:57.955 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-fuse 2024-04-20T21:43:58.345 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:49 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:43:58.432 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rbd-2:18.2.2-0.el9.x86_64 is already installed. 2024-04-20T21:43:58.475 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:43:58.476 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-20T21:43:58.476 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:43:58.557 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-fuse 2024-04-20T21:43:58.717 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:34 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:43:58.839 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:43:58.840 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:58.840 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-04-20T21:43:58.840 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:58.840 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-20T21:43:58.840 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse x86_64 2:18.2.2-0.el9 ceph 840 k 2024-04-20T21:43:58.840 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-20T21:43:58.840 INFO:teuthology.orchestra.run.smithi164.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-20T21:43:58.841 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:58.841 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-20T21:43:58.841 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:43:58.841 INFO:teuthology.orchestra.run.smithi164.stdout:Install 2 Packages 2024-04-20T21:43:58.841 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:43:58.841 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 920 k 2024-04-20T21:43:58.841 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 2.7 M 2024-04-20T21:43:58.842 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-20T21:43:59.006 INFO:teuthology.orchestra.run.smithi164.stdout:(1/2): ceph-fuse-18.2.2-0.el9.x86_64.rpm 8.5 MB/s | 840 kB 00:00 2024-04-20T21:43:59.318 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:50 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:43:59.447 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:43:59.448 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:59.448 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-04-20T21:43:59.448 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:59.448 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-20T21:43:59.448 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:18.2.2-0.el9 ceph 86 k 2024-04-20T21:43:59.448 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:59.448 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-20T21:43:59.449 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:43:59.449 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-04-20T21:43:59.449 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:43:59.449 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 86 k 2024-04-20T21:43:59.449 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 227 k 2024-04-20T21:43:59.449 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-20T21:43:59.547 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-fuse-18.2.2-0.el9.x86_64.rpm 880 kB/s | 86 kB 00:00 2024-04-20T21:43:59.548 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:43:59.548 INFO:teuthology.orchestra.run.smithi142.stdout:Total 863 kB/s | 86 kB 00:00 2024-04-20T21:43:59.549 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-20T21:43:59.557 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-20T21:43:59.557 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-20T21:43:59.633 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-20T21:43:59.634 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-20T21:43:59.756 INFO:teuthology.orchestra.run.smithi164.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 95 kB/s | 80 kB 00:00 2024-04-20T21:43:59.759 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:43:59.760 INFO:teuthology.orchestra.run.smithi164.stdout:Total 1.0 MB/s | 920 kB 00:00 2024-04-20T21:43:59.799 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-20T21:43:59.827 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-20T21:43:59.875 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-20T21:43:59.875 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-20T21:43:59.953 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:43:59.982 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-20T21:43:59.983 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-20T21:44:00.248 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-20T21:44:00.429 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-20T21:44:00.478 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-fuse-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:00.517 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-fuse-2:18.2.2-0.el9.x86_64 2/2 2024-04-20T21:44:00.724 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:00.724 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:44:00.724 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-20T21:44:00.724 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:18.2.2-0.el9.x86_64 2024-04-20T21:44:00.725 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:44:00.725 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:44:00.996 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-mirror 2024-04-20T21:44:01.413 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-fuse-2:18.2.2-0.el9.x86_64 2/2 2024-04-20T21:44:01.413 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-fuse-2:18.2.2-0.el9.x86_64 1/2 2024-04-20T21:44:01.746 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-20T21:44:01.746 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:01.747 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-20T21:44:01.747 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-2:18.2.2-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-20T21:44:01.747 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:01.747 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:44:01.759 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:52 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:44:01.895 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:44:01.895 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:44:01.895 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-04-20T21:44:01.895 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:44:01.896 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-20T21:44:01.896 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:18.2.2-0.el9 ceph 3.0 M 2024-04-20T21:44:01.896 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:44:01.896 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-20T21:44:01.896 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:44:01.896 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-04-20T21:44:01.896 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:44:01.896 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 3.0 M 2024-04-20T21:44:01.897 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 12 M 2024-04-20T21:44:01.897 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-20T21:44:02.009 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-mirror-18.2.2-0.el9.x86_64.rpm 27 MB/s | 3.0 MB 00:00 2024-04-20T21:44:02.009 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:44:02.010 INFO:teuthology.orchestra.run.smithi142.stdout:Total 26 MB/s | 3.0 MB 00:00 2024-04-20T21:44:02.010 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-20T21:44:02.021 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-20T21:44:02.021 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-20T21:44:02.022 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install librados-devel 2024-04-20T21:44:02.110 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-20T21:44:02.114 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-20T21:44:02.576 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-20T21:44:02.660 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:02.754 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:02.754 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:44:02.755 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-20T21:44:02.755 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-20T21:44:02.755 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-20T21:44:02.755 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:44:02.802 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:38 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:44:02.932 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:44:02.933 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:44:02.933 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-04-20T21:44:02.933 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:44:02.933 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-20T21:44:02.934 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel x86_64 2:18.2.2-0.el9 ceph 126 k 2024-04-20T21:44:02.934 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:02.934 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-20T21:44:02.934 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:44:02.934 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-20T21:44:02.934 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:02.934 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 126 k 2024-04-20T21:44:02.934 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 456 k 2024-04-20T21:44:02.934 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-20T21:44:03.011 INFO:teuthology.orchestra.run.smithi164.stdout:librados-devel-18.2.2-0.el9.x86_64.rpm 1.6 MB/s | 126 kB 00:00 2024-04-20T21:44:03.011 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:44:03.011 INFO:teuthology.orchestra.run.smithi164.stdout:Total 1.6 MB/s | 126 kB 00:00 2024-04-20T21:44:03.012 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-20T21:44:03.018 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-20T21:44:03.019 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-20T21:44:03.093 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-20T21:44:03.094 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-20T21:44:03.269 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-20T21:44:03.383 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados-devel-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:03.871 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados-devel-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:04.141 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:04.141 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:44:04.141 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-20T21:44:04.141 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:18.2.2-0.el9.x86_64 2024-04-20T21:44:04.141 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:44:04.141 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:44:04.202 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados-devel-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:04.202 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:04.202 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-20T21:44:04.202 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-2:18.2.2-0.el9.x86_64 2024-04-20T21:44:04.202 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:04.202 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:44:04.461 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-nbd 2024-04-20T21:44:04.520 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install libcephfs2 2024-04-20T21:44:05.231 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:56 ago on Sat 20 Apr 2024 09:42:09 PM UTC. 2024-04-20T21:44:05.269 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:41 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:44:05.355 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-20T21:44:05.355 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:44:05.355 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-04-20T21:44:05.355 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:44:05.355 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-20T21:44:05.355 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:18.2.2-0.el9 ceph 171 k 2024-04-20T21:44:05.355 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:44:05.356 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-20T21:44:05.356 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-20T21:44:05.356 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-04-20T21:44:05.356 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:44:05.356 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 171 k 2024-04-20T21:44:05.356 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 494 k 2024-04-20T21:44:05.356 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-20T21:44:05.358 INFO:teuthology.orchestra.run.smithi164.stdout:Package libcephfs2-2:18.2.2-0.el9.x86_64 is already installed. 2024-04-20T21:44:05.399 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:44:05.400 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-20T21:44:05.400 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:44:05.428 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-nbd-18.2.2-0.el9.x86_64.rpm 2.4 MB/s | 171 kB 00:00 2024-04-20T21:44:05.429 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:44:05.429 INFO:teuthology.orchestra.run.smithi142.stdout:Total 2.3 MB/s | 171 kB 00:00 2024-04-20T21:44:05.429 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-20T21:44:05.438 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-20T21:44:05.439 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-20T21:44:05.481 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install libcephfs-devel 2024-04-20T21:44:05.511 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-20T21:44:05.512 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-20T21:44:05.693 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-20T21:44:05.834 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:06.224 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:42 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:44:06.352 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:44:06.352 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:44:06.352 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-04-20T21:44:06.352 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:44:06.352 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-20T21:44:06.352 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel x86_64 2:18.2.2-0.el9 ceph 31 k 2024-04-20T21:44:06.352 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:06.352 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-20T21:44:06.353 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:44:06.353 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-20T21:44:06.353 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:06.353 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 31 k 2024-04-20T21:44:06.353 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 139 k 2024-04-20T21:44:06.353 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-20T21:44:06.439 INFO:teuthology.orchestra.run.smithi164.stdout:libcephfs-devel-18.2.2-0.el9.x86_64.rpm 363 kB/s | 31 kB 00:00 2024-04-20T21:44:06.440 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:44:06.440 INFO:teuthology.orchestra.run.smithi164.stdout:Total 354 kB/s | 31 kB 00:00 2024-04-20T21:44:06.440 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-20T21:44:06.445 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-20T21:44:06.445 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-20T21:44:06.463 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-20T21:44:06.464 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-20T21:44:06.467 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-nbd-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:06.594 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-20T21:44:06.747 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs-devel-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:44:06.751 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-20T21:44:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:18.2.2-0.el9.x86_64 2024-04-20T21:44:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:44:06.751 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-20T21:44:07.071 DEBUG:teuthology.parallel:result is None 2024-04-20T21:44:07.132 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs-devel-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:07.378 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs-devel-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:07.378 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:07.378 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-20T21:44:07.378 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel-2:18.2.2-0.el9.x86_64 2024-04-20T21:44:07.378 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:07.378 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:44:07.617 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install librados2 2024-04-20T21:44:08.385 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:44 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:44:08.466 INFO:teuthology.orchestra.run.smithi164.stdout:Package librados2-2:18.2.2-0.el9.x86_64 is already installed. 2024-04-20T21:44:08.507 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:44:08.508 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-20T21:44:08.509 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:44:08.590 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install librbd1 2024-04-20T21:44:09.338 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:45 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:44:09.419 INFO:teuthology.orchestra.run.smithi164.stdout:Package librbd1-2:18.2.2-0.el9.x86_64 is already installed. 2024-04-20T21:44:09.461 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:44:09.462 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-20T21:44:09.462 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:44:09.537 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-rados 2024-04-20T21:44:10.276 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:46 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:44:10.361 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-rados-2:18.2.2-0.el9.x86_64 is already installed. 2024-04-20T21:44:10.403 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:44:10.404 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-20T21:44:10.404 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:44:10.480 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-rgw 2024-04-20T21:44:11.200 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:47 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:44:11.284 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-rgw-2:18.2.2-0.el9.x86_64 is already installed. 2024-04-20T21:44:11.325 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:44:11.326 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-20T21:44:11.326 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:44:11.407 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-cephfs 2024-04-20T21:44:12.129 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:48 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:44:12.216 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-cephfs-2:18.2.2-0.el9.x86_64 is already installed. 2024-04-20T21:44:12.258 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:44:12.259 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-20T21:44:12.259 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:44:12.330 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-rbd 2024-04-20T21:44:13.053 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:49 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:44:13.138 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-rbd-2:18.2.2-0.el9.x86_64 is already installed. 2024-04-20T21:44:13.179 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:44:13.180 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-04-20T21:44:13.181 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:44:13.255 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install rbd-fuse 2024-04-20T21:44:13.991 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:49 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:44:14.115 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:44:14.115 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:44:14.116 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-04-20T21:44:14.116 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:44:14.116 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-20T21:44:14.116 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse x86_64 2:18.2.2-0.el9 ceph 86 k 2024-04-20T21:44:14.116 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:14.116 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-20T21:44:14.116 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:44:14.116 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-20T21:44:14.116 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:14.117 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 86 k 2024-04-20T21:44:14.117 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 227 k 2024-04-20T21:44:14.117 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-20T21:44:14.192 INFO:teuthology.orchestra.run.smithi164.stdout:rbd-fuse-18.2.2-0.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2024-04-20T21:44:14.193 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:44:14.193 INFO:teuthology.orchestra.run.smithi164.stdout:Total 1.1 MB/s | 86 kB 00:00 2024-04-20T21:44:14.193 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-20T21:44:14.202 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-20T21:44:14.202 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-20T21:44:14.274 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-20T21:44:14.275 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-20T21:44:14.449 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-20T21:44:14.550 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-fuse-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:15.020 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-fuse-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:15.262 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-fuse-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:15.262 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:15.262 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-20T21:44:15.262 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-2:18.2.2-0.el9.x86_64 2024-04-20T21:44:15.262 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:15.262 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:44:15.567 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install rbd-mirror 2024-04-20T21:44:16.318 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:52 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:44:16.453 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:44:16.453 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:44:16.454 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-04-20T21:44:16.454 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:44:16.454 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-20T21:44:16.454 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror x86_64 2:18.2.2-0.el9 ceph 3.0 M 2024-04-20T21:44:16.454 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:16.454 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-20T21:44:16.454 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:44:16.454 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-20T21:44:16.454 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:16.455 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 3.0 M 2024-04-20T21:44:16.455 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 12 M 2024-04-20T21:44:16.455 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-20T21:44:16.562 INFO:teuthology.orchestra.run.smithi164.stdout:rbd-mirror-18.2.2-0.el9.x86_64.rpm 28 MB/s | 3.0 MB 00:00 2024-04-20T21:44:16.563 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:44:16.564 INFO:teuthology.orchestra.run.smithi164.stdout:Total 27 MB/s | 3.0 MB 00:00 2024-04-20T21:44:16.564 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-20T21:44:16.575 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-20T21:44:16.575 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-20T21:44:16.668 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-20T21:44:16.668 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-20T21:44:17.161 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-20T21:44:17.230 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-mirror-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:17.303 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-mirror-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:17.303 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T21:44:17.303 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-20T21:44:17.303 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-20T21:44:17.303 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-20T21:44:17.303 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:18.726 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-mirror-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:18.726 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:18.726 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-20T21:44:18.726 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-2:18.2.2-0.el9.x86_64 2024-04-20T21:44:18.726 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:18.726 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:44:19.021 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install rbd-nbd 2024-04-20T21:44:19.812 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:55 ago on Sat 20 Apr 2024 09:42:24 PM UTC. 2024-04-20T21:44:19.936 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-20T21:44:19.937 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:44:19.937 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-04-20T21:44:19.937 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:44:19.937 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-20T21:44:19.937 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd x86_64 2:18.2.2-0.el9 ceph 171 k 2024-04-20T21:44:19.937 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:19.937 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-20T21:44:19.937 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-20T21:44:19.937 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-04-20T21:44:19.937 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:19.938 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 171 k 2024-04-20T21:44:19.938 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 494 k 2024-04-20T21:44:19.938 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-20T21:44:20.009 INFO:teuthology.orchestra.run.smithi164.stdout:rbd-nbd-18.2.2-0.el9.x86_64.rpm 2.4 MB/s | 171 kB 00:00 2024-04-20T21:44:20.010 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:44:20.010 INFO:teuthology.orchestra.run.smithi164.stdout:Total 2.3 MB/s | 171 kB 00:00 2024-04-20T21:44:20.010 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-20T21:44:20.019 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-20T21:44:20.019 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-20T21:44:20.092 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-20T21:44:20.093 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-20T21:44:20.268 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-20T21:44:20.375 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-nbd-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:20.898 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-nbd-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:21.261 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-nbd-2:18.2.2-0.el9.x86_64 1/1 2024-04-20T21:44:21.262 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:21.262 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-20T21:44:21.262 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-2:18.2.2-0.el9.x86_64 2024-04-20T21:44:21.262 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:44:21.262 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-20T21:44:21.588 DEBUG:teuthology.parallel:result is None 2024-04-20T21:44:21.588 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-20T21:44:21.589 INFO:teuthology.packaging:ref: None 2024-04-20T21:44:21.589 INFO:teuthology.packaging:tag: None 2024-04-20T21:44:21.589 INFO:teuthology.packaging:branch: reef 2024-04-20T21:44:21.589 INFO:teuthology.packaging:sha1: a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:44:21.589 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-04-20T21:44:21.809 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-20T21:44:21.882 INFO:teuthology.orchestra.run.smithi142.stdout:18.2.2-0.el9 2024-04-20T21:44:21.882 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-0.el9 2024-04-20T21:44:21.882 INFO:teuthology.task.install:The correct ceph version 18.2.2-0 is installed. 2024-04-20T21:44:21.884 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-20T21:44:21.884 INFO:teuthology.packaging:ref: None 2024-04-20T21:44:21.884 INFO:teuthology.packaging:tag: None 2024-04-20T21:44:21.884 INFO:teuthology.packaging:branch: reef 2024-04-20T21:44:21.884 INFO:teuthology.packaging:sha1: a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:44:21.884 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-04-20T21:44:22.243 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-20T21:44:22.312 INFO:teuthology.orchestra.run.smithi164.stdout:18.2.2-0.el9 2024-04-20T21:44:22.312 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-0.el9 2024-04-20T21:44:22.313 INFO:teuthology.task.install:The correct ceph version 18.2.2-0 is installed. 2024-04-20T21:44:22.314 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-20T21:44:22.315 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-20T21:44:22.315 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-20T21:44:22.404 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-20T21:44:22.405 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-20T21:44:22.491 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-20T21:44:22.491 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-20T21:44:22.491 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-04-20T21:44:22.579 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-20T21:44:22.662 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-20T21:44:22.663 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2024-04-20T21:44:22.753 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-20T21:44:22.838 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-20T21:44:22.838 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-20T21:44:22.838 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-20T21:44:22.925 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-20T21:44:23.051 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-20T21:44:23.051 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-20T21:44:23.139 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-20T21:44:23.259 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-20T21:44:23.259 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-20T21:44:23.259 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-04-20T21:44:23.346 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-20T21:44:23.428 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-20T21:44:23.429 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2024-04-20T21:44:23.514 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-20T21:44:23.597 INFO:teuthology.run_tasks:Running task print... 2024-04-20T21:44:23.607 INFO:teuthology.task.print:**** done install task... 2024-04-20T21:44:23.607 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-20T21:44:23.718 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:reef', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'} 2024-04-20T21:44:23.718 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:reef 2024-04-20T21:44:23.719 INFO:tasks.cephadm:Cluster fsid is 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T21:44:23.719 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-20T21:44:23.719 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-04-20T21:44:23.719 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi142': '172.21.15.142', 'mon.smithi164': '172.21.15.164'} 2024-04-20T21:44:23.719 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-20T21:44:23.719 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname $(hostname -s) 2024-04-20T21:44:23.808 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname $(hostname -s) 2024-04-20T21:44:23.902 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-04-20T21:44:23.903 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:44:24.166 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/78637/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3133-ga8c84f59', 'node_name': '172.21.5.35+adami05', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3133.ga8c84f59'}, 'url': 'https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-16 21:41:56.138585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240416.193735', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-04-20T21:44:24.553 INFO:tasks.util.chacra:got chacra host chacra.ceph.com, ref reef, sha1 9d98999acebbad2663cc4938e94c9ffd83485cbd from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-04-20T21:44:24.554 INFO:tasks.cephadm:Discovered cachra url: https://chacra.ceph.com/binaries/ceph/reef/9d98999acebbad2663cc4938e94c9ffd83485cbd/centos/9/x86_64/flavors/default/cephadm 2024-04-20T21:44:24.554 DEBUG:teuthology.orchestra.run.smithi142:> curl --silent -L https://chacra.ceph.com/binaries/ceph/reef/9d98999acebbad2663cc4938e94c9ffd83485cbd/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-20T21:44:24.941 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r--. 1 ubuntu ubuntu 212578 Apr 20 21:44 /home/ubuntu/cephtest/cephadm 2024-04-20T21:44:24.942 DEBUG:teuthology.orchestra.run.smithi164:> curl --silent -L https://chacra.ceph.com/binaries/ceph/reef/9d98999acebbad2663cc4938e94c9ffd83485cbd/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-20T21:44:25.283 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r--. 1 ubuntu ubuntu 212578 Apr 20 21:44 /home/ubuntu/cephtest/cephadm 2024-04-20T21:44:25.283 DEBUG:teuthology.orchestra.run.smithi142:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-20T21:44:25.342 DEBUG:teuthology.orchestra.run.smithi164:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-20T21:44:25.413 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:reef on all hosts... 2024-04-20T21:44:25.414 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-04-20T21:44:25.421 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-04-20T21:44:27.281 INFO:teuthology.orchestra.run.smithi142.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-04-20T21:44:27.326 INFO:teuthology.orchestra.run.smithi164.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-04-20T21:45:05.900 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-20T21:45:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_version": "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)", 2024-04-20T21:45:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: "image_id": "9900ed1a6b81aaf043a19454fc819f6cb21ac0421c7c720b31d8fae6faebb644", 2024-04-20T21:45:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: "repo_digests": [ 2024-04-20T21:45:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210" 2024-04-20T21:45:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-20T21:45:05.901 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-20T21:45:07.130 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T21:45:07.131 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_version": "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)", 2024-04-20T21:45:07.131 INFO:teuthology.orchestra.run.smithi142.stdout: "image_id": "9900ed1a6b81aaf043a19454fc819f6cb21ac0421c7c720b31d8fae6faebb644", 2024-04-20T21:45:07.131 INFO:teuthology.orchestra.run.smithi142.stdout: "repo_digests": [ 2024-04-20T21:45:07.131 INFO:teuthology.orchestra.run.smithi142.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210" 2024-04-20T21:45:07.131 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-20T21:45:07.131 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T21:45:07.180 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph 2024-04-20T21:45:07.268 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph 2024-04-20T21:45:07.358 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /etc/ceph 2024-04-20T21:45:07.443 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /etc/ceph 2024-04-20T21:45:07.526 INFO:tasks.cephadm:Writing seed config... 2024-04-20T21:45:07.527 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-04-20T21:45:07.527 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-04-20T21:45:07.527 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-04-20T21:45:07.527 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-04-20T21:45:07.527 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-04-20T21:45:07.527 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-20T21:45:07.527 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-20T21:45:07.527 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-04-20T21:45:07.527 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-04-20T21:45:07.528 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-20T21:45:07.528 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-20T21:45:07.528 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-04-20T21:45:07.528 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-20T21:45:07.528 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-20T21:45:07.528 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-20T21:45:07.528 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-20T21:45:07.528 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-20T21:45:07.528 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-20T21:45:07.528 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-20T21:45:07.528 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-20T21:45:07.528 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-20T21:45:07.528 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-20T21:45:07.528 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-20T21:45:07.529 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-04-20T21:45:07.529 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-20T21:45:07.529 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-20T21:45:07.529 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-20T21:45:07.529 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-20T21:45:07.529 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-20T21:45:07.529 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-20T21:45:07.529 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-20T21:45:07.529 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-20T21:45:07.529 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-20T21:45:07.529 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-20T21:45:07.529 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-20T21:45:07.529 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-20T21:45:07.529 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-20T21:45:07.530 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-20T21:45:07.530 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-20T21:45:07.530 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-20T21:45:07.530 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-20T21:45:07.530 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-20T21:45:07.530 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-20T21:45:07.531 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-20T21:45:07.588 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 270cccba-ff5f-11ee-bc93-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-20T21:45:07.588 DEBUG:teuthology.orchestra.run.smithi142:mon.smithi142> sudo journalctl -f -n 0 -u ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mon.smithi142.service 2024-04-20T21:45:07.636 INFO:tasks.cephadm:Bootstrapping... 2024-04-20T21:45:07.636 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef -v bootstrap --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.142 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-20T21:45:07.865 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-20T21:45:07.865 INFO:teuthology.orchestra.run.smithi142.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:reef', '-v', 'bootstrap', '--fsid', '270cccba-ff5f-11ee-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.142', '--skip-admin-label'] 2024-04-20T21:45:07.949 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-20T21:45:07.949 INFO:teuthology.orchestra.run.smithi142.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-20T21:45:07.949 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying podman|docker is present... 2024-04-20T21:45:08.003 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-20T21:45:08.003 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying lvm2 is present... 2024-04-20T21:45:08.003 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying time synchronization is in place... 2024-04-20T21:45:08.019 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-20T21:45:08.019 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-20T21:45:08.035 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-20T21:45:08.035 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout inactive 2024-04-20T21:45:08.057 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout enabled 2024-04-20T21:45:08.075 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout active 2024-04-20T21:45:08.075 INFO:teuthology.orchestra.run.smithi142.stdout:Unit chronyd.service is enabled and running 2024-04-20T21:45:08.075 INFO:teuthology.orchestra.run.smithi142.stdout:Repeating the final host check... 2024-04-20T21:45:08.133 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-20T21:45:08.133 INFO:teuthology.orchestra.run.smithi142.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-20T21:45:08.134 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl is present 2024-04-20T21:45:08.134 INFO:teuthology.orchestra.run.smithi142.stdout:lvcreate is present 2024-04-20T21:45:08.153 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-20T21:45:08.153 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-20T21:45:08.173 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-20T21:45:08.173 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout inactive 2024-04-20T21:45:08.197 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout enabled 2024-04-20T21:45:08.218 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout active 2024-04-20T21:45:08.218 INFO:teuthology.orchestra.run.smithi142.stdout:Unit chronyd.service is enabled and running 2024-04-20T21:45:08.218 INFO:teuthology.orchestra.run.smithi142.stdout:Host looks OK 2024-04-20T21:45:08.218 INFO:teuthology.orchestra.run.smithi142.stdout:Cluster fsid: 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T21:45:08.219 INFO:teuthology.orchestra.run.smithi142.stdout:Acquiring lock 139662542494352 on /run/cephadm/270cccba-ff5f-11ee-bc93-c7b262605968.lock 2024-04-20T21:45:08.219 INFO:teuthology.orchestra.run.smithi142.stdout:Lock 139662542494352 acquired on /run/cephadm/270cccba-ff5f-11ee-bc93-c7b262605968.lock 2024-04-20T21:45:08.221 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying IP 172.21.15.142 port 3300 ... 2024-04-20T21:45:08.221 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying IP 172.21.15.142 port 6789 ... 2024-04-20T21:45:08.222 INFO:teuthology.orchestra.run.smithi142.stdout:Base mon IP(s) is [172.21.15.142:3300, 172.21.15.142:6789], mon addrv is [v2:172.21.15.142:3300,v1:172.21.15.142:6789] 2024-04-20T21:45:08.236 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.142 metric 100 2024-04-20T21:45:08.236 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.142 metric 100 2024-04-20T21:45:08.249 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-20T21:45:08.250 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-04-20T21:45:08.250 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1783sec hoplimit 64 pref medium 2024-04-20T21:45:08.262 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-20T21:45:08.262 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-20T21:45:08.262 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-20T21:45:08.262 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-20T21:45:08.262 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2024-04-20T21:45:08.262 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-20T21:45:08.265 INFO:teuthology.orchestra.run.smithi142.stdout:Mon IP `172.21.15.142` is in CIDR network `172.21.0.0/20` 2024-04-20T21:45:08.265 INFO:teuthology.orchestra.run.smithi142.stdout:Mon IP `172.21.15.142` is in CIDR network `172.21.0.0/20` 2024-04-20T21:45:08.265 INFO:teuthology.orchestra.run.smithi142.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-20T21:45:08.267 INFO:teuthology.orchestra.run.smithi142.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-20T21:45:08.270 INFO:teuthology.orchestra.run.smithi142.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-04-20T21:45:16.713 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stdout 9900ed1a6b81aaf043a19454fc819f6cb21ac0421c7c720b31d8fae6faebb644 2024-04-20T21:45:16.713 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:reef... 2024-04-20T21:45:16.713 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stderr Getting image source signatures 2024-04-20T21:45:16.713 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stderr Copying blob sha256:c98db977c11909275f2799ff686e2165262975518f51f9eea9b24a5c8a4ea0d6 2024-04-20T21:45:16.713 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stderr Copying blob sha256:426fede9fffa2c7dfe40a4f9322a34794b72405170134d54d2c30d9cc6c6a5be 2024-04-20T21:45:16.713 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stderr Copying config sha256:9900ed1a6b81aaf043a19454fc819f6cb21ac0421c7c720b31d8fae6faebb644 2024-04-20T21:45:16.713 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-20T21:45:17.941 INFO:teuthology.orchestra.run.smithi142.stdout:ceph: stdout ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable) 2024-04-20T21:45:17.941 INFO:teuthology.orchestra.run.smithi142.stdout:Ceph version: ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable) 2024-04-20T21:45:17.941 INFO:teuthology.orchestra.run.smithi142.stdout:Extracting ceph user uid/gid from container image... 2024-04-20T21:45:19.040 INFO:teuthology.orchestra.run.smithi142.stdout:stat: stdout 167 167 2024-04-20T21:45:19.040 INFO:teuthology.orchestra.run.smithi142.stdout:Creating initial keys... 2024-04-20T21:45:20.133 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph-authtool: stdout AQBvNyRmL/oIHhAA/6ZUi7J/xOkb5c4RiCf0OQ== 2024-04-20T21:45:21.438 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph-authtool: stdout AQBwNyRmZGTXIxAAQklSRQkAqOZ9cFHOyIAkUQ== 2024-04-20T21:45:22.715 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph-authtool: stdout AQBxNyRmWHvoNRAA1jozriAqpbDUJLnl+Fe0gw== 2024-04-20T21:45:22.717 INFO:teuthology.orchestra.run.smithi142.stdout:Creating initial monmap... 2024-04-20T21:45:23.902 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-20T21:45:23.902 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-04-20T21:45:23.902 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T21:45:23.902 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-20T21:45:23.902 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool for smithi142 [v2:172.21.15.142:3300,v1:172.21.15.142:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-20T21:45:23.902 INFO:teuthology.orchestra.run.smithi142.stdout:setting min_mon_release = pacific 2024-04-20T21:45:23.902 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/monmaptool: set fsid to 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T21:45:23.902 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-20T21:45:23.902 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:45:23.902 INFO:teuthology.orchestra.run.smithi142.stdout:Creating mon... 2024-04-20T21:45:24.973 INFO:teuthology.orchestra.run.smithi142.stdout:create mon.smithi142 on 2024-04-20T21:45:25.335 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-20T21:45:25.571 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-20T21:45:25.881 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-270cccba-ff5f-11ee-bc93-c7b262605968.target → /etc/systemd/system/ceph-270cccba-ff5f-11ee-bc93-c7b262605968.target. 2024-04-20T21:45:25.881 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-270cccba-ff5f-11ee-bc93-c7b262605968.target → /etc/systemd/system/ceph-270cccba-ff5f-11ee-bc93-c7b262605968.target. 2024-04-20T21:45:26.237 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mon.smithi142 2024-04-20T21:45:26.237 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Failed to reset failed state of unit ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mon.smithi142.service: Unit ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mon.smithi142.service not loaded. 2024-04-20T21:45:26.524 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-270cccba-ff5f-11ee-bc93-c7b262605968.target.wants/ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mon.smithi142.service → /etc/systemd/system/ceph-270cccba-ff5f-11ee-bc93-c7b262605968@.service. 2024-04-20T21:45:27.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:27 smithi142 podman[15441]: 2024-04-20 21:45:27.136758563 +0000 UTC m=+0.343914661 container start 11d61ecbbb9e9f323c744bedd927e602fa0dc122e5b41ec27c2767f32c62923a (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142, RELEASE=reef-646b8c7, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-20T21:45:27.248 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-20T21:45:27.248 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout disabled 2024-04-20T21:45:27.263 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-20T21:45:27.263 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout inactive 2024-04-20T21:45:27.263 INFO:teuthology.orchestra.run.smithi142.stdout:firewalld.service is not enabled 2024-04-20T21:45:27.263 INFO:teuthology.orchestra.run.smithi142.stdout:Not possible to enable service . firewalld.service is not available 2024-04-20T21:45:27.263 INFO:teuthology.orchestra.run.smithi142.stdout:Waiting for mon to start... 2024-04-20T21:45:27.263 INFO:teuthology.orchestra.run.smithi142.stdout:Waiting for mon... 2024-04-20T21:45:27.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:27 smithi142 bash[15441]: 11d61ecbbb9e9f323c744bedd927e602fa0dc122e5b41ec27c2767f32c62923a 2024-04-20T21:45:27.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:27 smithi142 ceph-mon[15459]: mkfs 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T21:45:27.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:27 smithi142 ceph-mon[15459]: mon.smithi142 is new leader, mons smithi142 in quorum (ranks 0) 2024-04-20T21:45:27.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:27 smithi142 systemd[1]: Started Ceph mon.smithi142 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T21:45:28.496 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:28 smithi142 ceph-mon[15459]: mon.smithi142 is new leader, mons smithi142 in quorum (ranks 0) 2024-04-20T21:45:28.497 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:28 smithi142 ceph-mon[15459]: monmap e1: 1 mons at {smithi142=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-20T21:45:28.497 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:28 smithi142 ceph-mon[15459]: fsmap 2024-04-20T21:45:28.497 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:28 smithi142 ceph-mon[15459]: osdmap e1: 0 total, 0 up, 0 in 2024-04-20T21:45:28.497 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:28 smithi142 ceph-mon[15459]: mgrmap e1: no daemons active 2024-04-20T21:45:29.384 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:29 smithi142 ceph-mon[15459]: from='client.? 172.21.15.142:0/129978705' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-20T21:45:29.394 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout cluster: 2024-04-20T21:45:29.401 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout id: 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T21:45:29.401 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-20T21:45:29.401 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2024-04-20T21:45:29.401 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout services: 2024-04-20T21:45:29.401 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi142 (age 1.53993s) 2024-04-20T21:45:29.401 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-20T21:45:29.401 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-20T21:45:29.401 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2024-04-20T21:45:29.401 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout data: 2024-04-20T21:45:29.401 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-20T21:45:29.401 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-20T21:45:29.401 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-20T21:45:29.401 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout pgs: 2024-04-20T21:45:29.402 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2024-04-20T21:45:29.402 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.661+0000 7f4569c00700 1 Processor -- start 2024-04-20T21:45:29.402 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.661+0000 7f4569c00700 1 -- start start 2024-04-20T21:45:29.402 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.662+0000 7f4569c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456410cf50 0x7f456410d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:29.402 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.662+0000 7f4569c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456410d940 con 0x7f456410cf50 2024-04-20T21:45:29.402 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.663+0000 7f4563e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456410cf50 0x7f456410d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:29.402 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.663+0000 7f4563e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456410cf50 0x7f456410d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45076/0 (socket says 172.21.15.142:45076) 2024-04-20T21:45:29.402 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.663+0000 7f4563e00700 1 -- 172.21.15.142:0/821985091 learned_addr learned my addr 172.21.15.142:0/821985091 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:29.402 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.664+0000 7f4563e00700 1 -- 172.21.15.142:0/821985091 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456410da80 con 0x7f456410cf50 2024-04-20T21:45:29.402 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.664+0000 7f4563e00700 1 --2- 172.21.15.142:0/821985091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456410cf50 0x7f456410d370 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f45540098a0 tx=0x7f4554009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7a1811b39eaabe server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:29.402 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.664+0000 7f4562a00700 1 -- 172.21.15.142:0/821985091 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4554004180 con 0x7f456410cf50 2024-04-20T21:45:29.402 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.664+0000 7f4562a00700 1 -- 172.21.15.142:0/821985091 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45540042e0 con 0x7f456410cf50 2024-04-20T21:45:29.403 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.664+0000 7f4562a00700 1 -- 172.21.15.142:0/821985091 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f45540036a0 con 0x7f456410cf50 2024-04-20T21:45:29.403 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.665+0000 7f4569c00700 1 -- 172.21.15.142:0/821985091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456410cf50 msgr2=0x7f456410d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:29.403 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.665+0000 7f4569c00700 1 --2- 172.21.15.142:0/821985091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456410cf50 0x7f456410d370 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f45540098a0 tx=0x7f4554009bb0 comp rx=0 tx=0).stop 2024-04-20T21:45:29.403 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.665+0000 7f4569c00700 1 -- 172.21.15.142:0/821985091 shutdown_connections 2024-04-20T21:45:29.403 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.665+0000 7f4569c00700 1 --2- 172.21.15.142:0/821985091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456410cf50 0x7f456410d370 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:29.403 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.665+0000 7f4569c00700 1 -- 172.21.15.142:0/821985091 >> 172.21.15.142:0/821985091 conn(0x7f456407b9f0 msgr2=0x7f456407de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:29.403 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.665+0000 7f4569c00700 1 -- 172.21.15.142:0/821985091 shutdown_connections 2024-04-20T21:45:29.403 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.665+0000 7f4569c00700 1 -- 172.21.15.142:0/821985091 wait complete. 2024-04-20T21:45:29.403 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.666+0000 7f4569c00700 1 Processor -- start 2024-04-20T21:45:29.403 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.666+0000 7f4569c00700 1 -- start start 2024-04-20T21:45:29.403 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.667+0000 7f4569c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456410cf50 0x7f456419fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:29.403 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.667+0000 7f4569c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45641a0350 con 0x7f456410cf50 2024-04-20T21:45:29.403 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.667+0000 7f4563e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456410cf50 0x7f456419fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:29.403 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.667+0000 7f4563e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456410cf50 0x7f456419fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45080/0 (socket says 172.21.15.142:45080) 2024-04-20T21:45:29.403 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.667+0000 7f4563e00700 1 -- 172.21.15.142:0/129978705 learned_addr learned my addr 172.21.15.142:0/129978705 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:29.404 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.667+0000 7f4563e00700 1 -- 172.21.15.142:0/129978705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4554009550 con 0x7f456410cf50 2024-04-20T21:45:29.404 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.668+0000 7f4563e00700 1 --2- 172.21.15.142:0/129978705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456410cf50 0x7f456419fe10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4554004000 tx=0x7f4554004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:29.404 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.668+0000 7f4560c00700 1 -- 172.21.15.142:0/129978705 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4554003ce0 con 0x7f456410cf50 2024-04-20T21:45:29.404 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.668+0000 7f4560c00700 1 -- 172.21.15.142:0/129978705 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4554020070 con 0x7f456410cf50 2024-04-20T21:45:29.404 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.668+0000 7f4560c00700 1 -- 172.21.15.142:0/129978705 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4554011630 con 0x7f456410cf50 2024-04-20T21:45:29.404 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.668+0000 7f4569c00700 1 -- 172.21.15.142:0/129978705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45641a0550 con 0x7f456410cf50 2024-04-20T21:45:29.404 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.668+0000 7f4569c00700 1 -- 172.21.15.142:0/129978705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45641a09f0 con 0x7f456410cf50 2024-04-20T21:45:29.404 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.669+0000 7f4560c00700 1 -- 172.21.15.142:0/129978705 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f4554022030 con 0x7f456410cf50 2024-04-20T21:45:29.404 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.669+0000 7f4560c00700 1 -- 172.21.15.142:0/129978705 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4554025cf0 con 0x7f456410cf50 2024-04-20T21:45:29.404 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.669+0000 7f4569c00700 1 -- 172.21.15.142:0/129978705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4564199b80 con 0x7f456410cf50 2024-04-20T21:45:29.404 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.673+0000 7f4560c00700 1 -- 172.21.15.142:0/129978705 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f4554025480 con 0x7f456410cf50 2024-04-20T21:45:29.404 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.751+0000 7f4569c00700 1 -- 172.21.15.142:0/129978705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f456410dfd0 con 0x7f456410cf50 2024-04-20T21:45:29.404 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.751+0000 7f4560c00700 1 -- 172.21.15.142:0/129978705 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+324 (secure 0 0 0) 0x7f4554036070 con 0x7f456410cf50 2024-04-20T21:45:29.404 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.752+0000 7f4569c00700 1 -- 172.21.15.142:0/129978705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456410cf50 msgr2=0x7f456419fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:29.405 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.752+0000 7f4569c00700 1 --2- 172.21.15.142:0/129978705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456410cf50 0x7f456419fe10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4554004000 tx=0x7f4554004750 comp rx=0 tx=0).stop 2024-04-20T21:45:29.405 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.753+0000 7f4569c00700 1 -- 172.21.15.142:0/129978705 shutdown_connections 2024-04-20T21:45:29.405 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.753+0000 7f4569c00700 1 --2- 172.21.15.142:0/129978705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456410cf50 0x7f456419fe10 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:29.405 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.753+0000 7f4569c00700 1 -- 172.21.15.142:0/129978705 >> 172.21.15.142:0/129978705 conn(0x7f456407b9f0 msgr2=0x7f4564196cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:29.405 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.753+0000 7f4569c00700 1 -- 172.21.15.142:0/129978705 shutdown_connections 2024-04-20T21:45:29.405 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:28.753+0000 7f4569c00700 1 -- 172.21.15.142:0/129978705 wait complete. 2024-04-20T21:45:29.405 INFO:teuthology.orchestra.run.smithi142.stdout:mon is available 2024-04-20T21:45:29.405 INFO:teuthology.orchestra.run.smithi142.stdout:Assimilating anything we can from ceph.conf... 2024-04-20T21:45:30.649 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:30 smithi142 ceph-mon[15459]: from='client.? 172.21.15.142:0/2261451109' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-20T21:45:30.649 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:30 smithi142 ceph-mon[15459]: from='client.? 172.21.15.142:0/2261451109' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-20T21:45:30.664 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2024-04-20T21:45:30.664 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout [global] 2024-04-20T21:45:30.664 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout fsid = 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T21:45:30.664 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.142:3300,v1:172.21.15.142:6789] 2024-04-20T21:45:30.664 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-20T21:45:30.664 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-20T21:45:30.664 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-20T21:45:30.664 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-20T21:45:30.664 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2024-04-20T21:45:30.664 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-20T21:45:30.664 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-20T21:45:30.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2024-04-20T21:45:30.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout [osd] 2024-04-20T21:45:30.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-20T21:45:30.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-20T21:45:30.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-20T21:45:30.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-20T21:45:30.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-20T21:45:30.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.968+0000 7f4916800700 1 Processor -- start 2024-04-20T21:45:30.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.968+0000 7f4916800700 1 -- start start 2024-04-20T21:45:30.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.968+0000 7f4916800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f491007be80 0x7f491007a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:30.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.968+0000 7f4916800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491007a8b0 con 0x7f491007be80 2024-04-20T21:45:30.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.968+0000 7f490f400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f491007be80 0x7f491007a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:30.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.969+0000 7f490f400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f491007be80 0x7f491007a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45086/0 (socket says 172.21.15.142:45086) 2024-04-20T21:45:30.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.969+0000 7f490f400700 1 -- 172.21.15.142:0/1072024427 learned_addr learned my addr 172.21.15.142:0/1072024427 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:30.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.969+0000 7f490f400700 1 -- 172.21.15.142:0/1072024427 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491007a9f0 con 0x7f491007be80 2024-04-20T21:45:30.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.969+0000 7f490f400700 1 --2- 172.21.15.142:0/1072024427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f491007be80 0x7f491007a2e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f49000098a0 tx=0x7f4900009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3298187e75d764 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:30.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.970+0000 7f490ea00700 1 -- 172.21.15.142:0/1072024427 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4900004180 con 0x7f491007be80 2024-04-20T21:45:30.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.970+0000 7f490ea00700 1 -- 172.21.15.142:0/1072024427 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49000042e0 con 0x7f491007be80 2024-04-20T21:45:30.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.970+0000 7f490ea00700 1 -- 172.21.15.142:0/1072024427 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49000036a0 con 0x7f491007be80 2024-04-20T21:45:30.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.970+0000 7f4916800700 1 -- 172.21.15.142:0/1072024427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f491007be80 msgr2=0x7f491007a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:30.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.970+0000 7f4916800700 1 --2- 172.21.15.142:0/1072024427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f491007be80 0x7f491007a2e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f49000098a0 tx=0x7f4900009bb0 comp rx=0 tx=0).stop 2024-04-20T21:45:30.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.970+0000 7f4916800700 1 -- 172.21.15.142:0/1072024427 shutdown_connections 2024-04-20T21:45:30.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.970+0000 7f4916800700 1 --2- 172.21.15.142:0/1072024427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f491007be80 0x7f491007a2e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:30.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.970+0000 7f4916800700 1 -- 172.21.15.142:0/1072024427 >> 172.21.15.142:0/1072024427 conn(0x7f4910101be0 msgr2=0x7f4910104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:30.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.970+0000 7f4916800700 1 -- 172.21.15.142:0/1072024427 shutdown_connections 2024-04-20T21:45:30.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.970+0000 7f4916800700 1 -- 172.21.15.142:0/1072024427 wait complete. 2024-04-20T21:45:30.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.971+0000 7f4916800700 1 Processor -- start 2024-04-20T21:45:30.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.972+0000 7f4916800700 1 -- start start 2024-04-20T21:45:30.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.972+0000 7f4916800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f491007be80 0x7f491019bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:30.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.972+0000 7f4916800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491019c150 con 0x7f491007be80 2024-04-20T21:45:30.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.972+0000 7f490f400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f491007be80 0x7f491019bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:30.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.972+0000 7f490f400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f491007be80 0x7f491019bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45088/0 (socket says 172.21.15.142:45088) 2024-04-20T21:45:30.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.972+0000 7f490f400700 1 -- 172.21.15.142:0/2261451109 learned_addr learned my addr 172.21.15.142:0/2261451109 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:30.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.973+0000 7f490f400700 1 -- 172.21.15.142:0/2261451109 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4900009550 con 0x7f491007be80 2024-04-20T21:45:30.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.973+0000 7f490f400700 1 --2- 172.21.15.142:0/2261451109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f491007be80 0x7f491019bc10 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f491007b350 tx=0x7f4900004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:30.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.973+0000 7f490cc00700 1 -- 172.21.15.142:0/2261451109 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4900003ce0 con 0x7f491007be80 2024-04-20T21:45:30.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.973+0000 7f490cc00700 1 -- 172.21.15.142:0/2261451109 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4900020070 con 0x7f491007be80 2024-04-20T21:45:30.668 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.973+0000 7f4916800700 1 -- 172.21.15.142:0/2261451109 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491019c350 con 0x7f491007be80 2024-04-20T21:45:30.668 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.973+0000 7f490cc00700 1 -- 172.21.15.142:0/2261451109 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4900011630 con 0x7f491007be80 2024-04-20T21:45:30.668 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.973+0000 7f4916800700 1 -- 172.21.15.142:0/2261451109 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491019c7f0 con 0x7f491007be80 2024-04-20T21:45:30.668 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.974+0000 7f490cc00700 1 -- 172.21.15.142:0/2261451109 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f4900022030 con 0x7f491007be80 2024-04-20T21:45:30.668 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.974+0000 7f490cc00700 1 -- 172.21.15.142:0/2261451109 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4900025cb0 con 0x7f491007be80 2024-04-20T21:45:30.668 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.975+0000 7f4916800700 1 -- 172.21.15.142:0/2261451109 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4910195b50 con 0x7f491007be80 2024-04-20T21:45:30.668 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:29.977+0000 7f490cc00700 1 -- 172.21.15.142:0/2261451109 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f4900025480 con 0x7f491007be80 2024-04-20T21:45:30.668 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:30.052+0000 7f4916800700 1 -- 172.21.15.142:0/2261451109 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f491007af90 con 0x7f491007be80 2024-04-20T21:45:30.668 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:30.060+0000 7f490cc00700 1 -- 172.21.15.142:0/2261451109 <== mon.0 v2:172.21.15.142:3300/0 7 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f4900011bd0 con 0x7f491007be80 2024-04-20T21:45:30.668 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:30.060+0000 7f490cc00700 1 -- 172.21.15.142:0/2261451109 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7f4900038590 con 0x7f491007be80 2024-04-20T21:45:30.668 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:30.062+0000 7f4916800700 1 -- 172.21.15.142:0/2261451109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f491007be80 msgr2=0x7f491019bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:30.668 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:30.062+0000 7f4916800700 1 --2- 172.21.15.142:0/2261451109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f491007be80 0x7f491019bc10 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f491007b350 tx=0x7f4900004750 comp rx=0 tx=0).stop 2024-04-20T21:45:30.668 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:30.062+0000 7f4916800700 1 -- 172.21.15.142:0/2261451109 shutdown_connections 2024-04-20T21:45:30.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:30.062+0000 7f4916800700 1 --2- 172.21.15.142:0/2261451109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f491007be80 0x7f491019bc10 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:30.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:30.062+0000 7f4916800700 1 -- 172.21.15.142:0/2261451109 >> 172.21.15.142:0/2261451109 conn(0x7f4910101be0 msgr2=0x7f4910102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:30.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:30.062+0000 7f4916800700 1 -- 172.21.15.142:0/2261451109 shutdown_connections 2024-04-20T21:45:30.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:30.062+0000 7f4916800700 1 -- 172.21.15.142:0/2261451109 wait complete. 2024-04-20T21:45:30.669 INFO:teuthology.orchestra.run.smithi142.stdout:Generating new minimal ceph.conf... 2024-04-20T21:45:31.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:31 smithi142 ceph-mon[15459]: from='client.? 172.21.15.142:0/3178904199' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:45:32.027 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.249+0000 7f7a13e00700 1 Processor -- start 2024-04-20T21:45:32.027 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.249+0000 7f7a13e00700 1 -- start start 2024-04-20T21:45:32.027 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.249+0000 7f7a13e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a141052e0 0x7f7a14105700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:32.027 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.249+0000 7f7a13e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a14105cd0 con 0x7f7a141052e0 2024-04-20T21:45:32.027 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.250+0000 7f7a12a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a141052e0 0x7f7a14105700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:32.027 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.250+0000 7f7a12a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a141052e0 0x7f7a14105700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45098/0 (socket says 172.21.15.142:45098) 2024-04-20T21:45:32.027 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.250+0000 7f7a12a00700 1 -- 172.21.15.142:0/2945315576 learned_addr learned my addr 172.21.15.142:0/2945315576 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:32.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.251+0000 7f7a12a00700 1 -- 172.21.15.142:0/2945315576 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a141064e0 con 0x7f7a141052e0 2024-04-20T21:45:32.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.251+0000 7f7a12a00700 1 --2- 172.21.15.142:0/2945315576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a141052e0 0x7f7a14105700 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7a040098a0 tx=0x7f7a04009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ddf7d34ffaebdcd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:32.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.251+0000 7f7a11600700 1 -- 172.21.15.142:0/2945315576 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a04004180 con 0x7f7a141052e0 2024-04-20T21:45:32.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.251+0000 7f7a11600700 1 -- 172.21.15.142:0/2945315576 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f7a040042e0 con 0x7f7a141052e0 2024-04-20T21:45:32.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.251+0000 7f7a11600700 1 -- 172.21.15.142:0/2945315576 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a04011a70 con 0x7f7a141052e0 2024-04-20T21:45:32.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.252+0000 7f7a13e00700 1 -- 172.21.15.142:0/2945315576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a141052e0 msgr2=0x7f7a14105700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:32.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.252+0000 7f7a13e00700 1 --2- 172.21.15.142:0/2945315576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a141052e0 0x7f7a14105700 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7a040098a0 tx=0x7f7a04009bb0 comp rx=0 tx=0).stop 2024-04-20T21:45:32.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.252+0000 7f7a13e00700 1 -- 172.21.15.142:0/2945315576 shutdown_connections 2024-04-20T21:45:32.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.252+0000 7f7a13e00700 1 --2- 172.21.15.142:0/2945315576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a141052e0 0x7f7a14105700 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:32.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.252+0000 7f7a13e00700 1 -- 172.21.15.142:0/2945315576 >> 172.21.15.142:0/2945315576 conn(0x7f7a141008c0 msgr2=0x7f7a14102ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:32.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.252+0000 7f7a13e00700 1 -- 172.21.15.142:0/2945315576 shutdown_connections 2024-04-20T21:45:32.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.252+0000 7f7a13e00700 1 -- 172.21.15.142:0/2945315576 wait complete. 2024-04-20T21:45:32.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.253+0000 7f7a13e00700 1 Processor -- start 2024-04-20T21:45:32.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.253+0000 7f7a13e00700 1 -- start start 2024-04-20T21:45:32.029 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.254+0000 7f7a13e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a141052e0 0x7f7a1419c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:32.029 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.254+0000 7f7a13e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1419c780 con 0x7f7a141052e0 2024-04-20T21:45:32.029 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.254+0000 7f7a12a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a141052e0 0x7f7a1419c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:32.029 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.254+0000 7f7a12a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a141052e0 0x7f7a1419c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45100/0 (socket says 172.21.15.142:45100) 2024-04-20T21:45:32.029 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.254+0000 7f7a12a00700 1 -- 172.21.15.142:0/3178904199 learned_addr learned my addr 172.21.15.142:0/3178904199 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:32.029 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.254+0000 7f7a12a00700 1 -- 172.21.15.142:0/3178904199 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a04009550 con 0x7f7a141052e0 2024-04-20T21:45:32.029 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.255+0000 7f7a12a00700 1 --2- 172.21.15.142:0/3178904199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a141052e0 0x7f7a1419c240 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7a04011710 tx=0x7f7a040047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:32.029 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.255+0000 7f7a0b400700 1 -- 172.21.15.142:0/3178904199 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a04003b10 con 0x7f7a141052e0 2024-04-20T21:45:32.029 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.255+0000 7f7a0b400700 1 -- 172.21.15.142:0/3178904199 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f7a0401b8c0 con 0x7f7a141052e0 2024-04-20T21:45:32.029 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.255+0000 7f7a13e00700 1 -- 172.21.15.142:0/3178904199 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1419c980 con 0x7f7a141052e0 2024-04-20T21:45:32.029 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.255+0000 7f7a0b400700 1 -- 172.21.15.142:0/3178904199 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a04019770 con 0x7f7a141052e0 2024-04-20T21:45:32.029 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.255+0000 7f7a13e00700 1 -- 172.21.15.142:0/3178904199 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1419ce20 con 0x7f7a141052e0 2024-04-20T21:45:32.029 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.255+0000 7f7a0b400700 1 -- 172.21.15.142:0/3178904199 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f7a04019ca0 con 0x7f7a141052e0 2024-04-20T21:45:32.030 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.255+0000 7f7a0b400700 1 -- 172.21.15.142:0/3178904199 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7a0401a710 con 0x7f7a141052e0 2024-04-20T21:45:32.030 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.256+0000 7f7a13e00700 1 -- 172.21.15.142:0/3178904199 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a14196700 con 0x7f7a141052e0 2024-04-20T21:45:32.030 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.259+0000 7f7a0b400700 1 -- 172.21.15.142:0/3178904199 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f7a04029060 con 0x7f7a141052e0 2024-04-20T21:45:32.030 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.335+0000 7f7a13e00700 1 -- 172.21.15.142:0/3178904199 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f7a14062510 con 0x7f7a141052e0 2024-04-20T21:45:32.030 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.335+0000 7f7a0b400700 1 -- 172.21.15.142:0/3178904199 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f7a0401f070 con 0x7f7a141052e0 2024-04-20T21:45:32.030 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.337+0000 7f7a13e00700 1 -- 172.21.15.142:0/3178904199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a141052e0 msgr2=0x7f7a1419c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:32.030 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.337+0000 7f7a13e00700 1 --2- 172.21.15.142:0/3178904199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a141052e0 0x7f7a1419c240 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7a04011710 tx=0x7f7a040047c0 comp rx=0 tx=0).stop 2024-04-20T21:45:32.030 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.337+0000 7f7a13e00700 1 -- 172.21.15.142:0/3178904199 shutdown_connections 2024-04-20T21:45:32.030 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.337+0000 7f7a13e00700 1 --2- 172.21.15.142:0/3178904199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a141052e0 0x7f7a1419c240 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:32.030 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.337+0000 7f7a13e00700 1 -- 172.21.15.142:0/3178904199 >> 172.21.15.142:0/3178904199 conn(0x7f7a141008c0 msgr2=0x7f7a141016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:32.030 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.337+0000 7f7a13e00700 1 -- 172.21.15.142:0/3178904199 shutdown_connections 2024-04-20T21:45:32.030 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:31.337+0000 7f7a13e00700 1 -- 172.21.15.142:0/3178904199 wait complete. 2024-04-20T21:45:32.030 INFO:teuthology.orchestra.run.smithi142.stdout:Restarting the monitor... 2024-04-20T21:45:32.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:32 smithi142 systemd[1]: Stopping Ceph mon.smithi142 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T21:45:32.812 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:32 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142[15455]: 2024-04-20T21:45:32.515+0000 7f354b000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi142 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T21:45:32.812 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:32 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142[15455]: 2024-04-20T21:45:32.515+0000 7f354b000700 -1 mon.smithi142@0(leader) e1 *** Got Signal Terminated *** 2024-04-20T21:45:32.812 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:32 smithi142 podman[15703]: 2024-04-20 21:45:32.557068941 +0000 UTC m=+0.172740924 container died 11d61ecbbb9e9f323c744bedd927e602fa0dc122e5b41ec27c2767f32c62923a (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=reef-646b8c7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux ) 2024-04-20T21:45:33.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:33 smithi142 podman[15703]: 2024-04-20 21:45:33.142005477 +0000 UTC m=+0.757677511 container cleanup 11d61ecbbb9e9f323c744bedd927e602fa0dc122e5b41ec27c2767f32c62923a (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=reef-646b8c7, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-20T21:45:33.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:33 smithi142 bash[15703]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142 2024-04-20T21:45:34.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:34 smithi142 podman[15717]: 2024-04-20 21:45:34.159535732 +0000 UTC m=+1.588302326 container remove 11d61ecbbb9e9f323c744bedd927e602fa0dc122e5b41ec27c2767f32c62923a (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=reef-646b8c7) 2024-04-20T21:45:35.148 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:34 smithi142 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mon.smithi142.service: Deactivated successfully. 2024-04-20T21:45:35.148 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:34 smithi142 systemd[1]: Stopped Ceph mon.smithi142 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T21:45:35.148 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:34 smithi142 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mon.smithi142.service: Consumed 1.919s CPU time. 2024-04-20T21:45:35.148 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:34 smithi142 systemd[1]: Starting Ceph mon.smithi142 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T21:45:35.403 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 podman[15808]: 2024-04-20 21:45:35.054854377 +0000 UTC m=+0.036616454 image pull 9900ed1a6b81aaf043a19454fc819f6cb21ac0421c7c720b31d8fae6faebb644 quay.ceph.io/ceph-ci/ceph:reef 2024-04-20T21:45:35.403 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 podman[15808]: 2024-04-20 21:45:35.15182115 +0000 UTC m=+0.133583275 container create c076f7eb00ea069949471cd9b44607437211566911d9032ddf62c4e631213cf1 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142, org.label-schema.schema-version=1.0, RELEASE=reef-646b8c7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-20T21:45:35.403 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 podman[15808]: 2024-04-20 21:45:35.404989021 +0000 UTC m=+0.386751139 container init c076f7eb00ea069949471cd9b44607437211566911d9032ddf62c4e631213cf1 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142, ceph=True, RELEASE=reef-646b8c7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-20T21:45:35.520 INFO:teuthology.orchestra.run.smithi142.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-20T21:45:35.669 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 podman[15808]: 2024-04-20 21:45:35.418135319 +0000 UTC m=+0.399897400 container start c076f7eb00ea069949471cd9b44607437211566911d9032ddf62c4e631213cf1 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=reef-646b8c7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416) 2024-04-20T21:45:35.669 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: set uid:gid to 167:167 (ceph:ceph) 2024-04-20T21:45:35.669 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable), process ceph-mon, pid 2 2024-04-20T21:45:35.669 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: pidfile_write: ignore empty --pid-file 2024-04-20T21:45:35.669 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: load: jerasure load: lrc 2024-04-20T21:45:35.669 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: RocksDB version: 7.9.2 2024-04-20T21:45:35.669 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Git sha 0 2024-04-20T21:45:35.669 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Compile date 2024-04-18 11:37:30 2024-04-20T21:45:35.669 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: DB SUMMARY 2024-04-20T21:45:35.669 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: DB Session ID: 59XKX67CDVX8V8FHFBQL 2024-04-20T21:45:35.669 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: CURRENT file: CURRENT 2024-04-20T21:45:35.669 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: IDENTITY file: IDENTITY 2024-04-20T21:45:35.669 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-20T21:45:35.670 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi142/store.db dir, Total Num: 1, files: 000008.sst 2024-04-20T21:45:35.670 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi142/store.db: 000009.log size: 98812 ; 2024-04-20T21:45:35.670 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.error_if_exists: 0 2024-04-20T21:45:35.670 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.create_if_missing: 0 2024-04-20T21:45:35.670 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.paranoid_checks: 1 2024-04-20T21:45:35.670 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-20T21:45:35.670 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-20T21:45:35.670 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-20T21:45:35.670 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.env: 0x558586898820 2024-04-20T21:45:35.670 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.fs: PosixFileSystem 2024-04-20T21:45:35.670 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.info_log: 0x558588e8d420 2024-04-20T21:45:35.670 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_file_opening_threads: 16 2024-04-20T21:45:35.670 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.statistics: (nil) 2024-04-20T21:45:35.671 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.use_fsync: 0 2024-04-20T21:45:35.671 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_log_file_size: 0 2024-04-20T21:45:35.671 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-20T21:45:35.671 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-20T21:45:35.671 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.keep_log_file_num: 1000 2024-04-20T21:45:35.671 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.recycle_log_file_num: 0 2024-04-20T21:45:35.671 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.allow_fallocate: 1 2024-04-20T21:45:35.671 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.allow_mmap_reads: 0 2024-04-20T21:45:35.672 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.allow_mmap_writes: 0 2024-04-20T21:45:35.672 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.use_direct_reads: 0 2024-04-20T21:45:35.672 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-20T21:45:35.672 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.create_missing_column_families: 0 2024-04-20T21:45:35.672 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.db_log_dir: 2024-04-20T21:45:35.672 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.wal_dir: 2024-04-20T21:45:35.672 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-20T21:45:35.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-20T21:45:35.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-20T21:45:35.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-20T21:45:35.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-20T21:45:35.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-20T21:45:35.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.advise_random_on_open: 1 2024-04-20T21:45:35.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.db_write_buffer_size: 0 2024-04-20T21:45:35.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.write_buffer_manager: 0x558588102140 2024-04-20T21:45:35.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-20T21:45:35.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-20T21:45:35.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-20T21:45:35.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.rate_limiter: (nil) 2024-04-20T21:45:35.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-20T21:45:35.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.wal_recovery_mode: 2 2024-04-20T21:45:35.674 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.enable_thread_tracking: 0 2024-04-20T21:45:35.674 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.enable_pipelined_write: 0 2024-04-20T21:45:35.674 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.unordered_write: 0 2024-04-20T21:45:35.674 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-20T21:45:35.674 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-20T21:45:35.674 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-20T21:45:35.674 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-20T21:45:35.674 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.row_cache: None 2024-04-20T21:45:35.674 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.wal_filter: None 2024-04-20T21:45:35.674 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-20T21:45:35.674 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.allow_ingest_behind: 0 2024-04-20T21:45:35.674 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.two_write_queues: 0 2024-04-20T21:45:35.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.manual_wal_flush: 0 2024-04-20T21:45:35.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.wal_compression: 0 2024-04-20T21:45:35.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.atomic_flush: 0 2024-04-20T21:45:35.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-20T21:45:35.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-20T21:45:35.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-20T21:45:35.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.log_readahead_size: 0 2024-04-20T21:45:35.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-20T21:45:35.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.best_efforts_recovery: 0 2024-04-20T21:45:35.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-20T21:45:35.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-20T21:45:35.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.allow_data_in_errors: 0 2024-04-20T21:45:35.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.db_host_id: __hostname__ 2024-04-20T21:45:35.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-20T21:45:35.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_background_jobs: 2 2024-04-20T21:45:35.675 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_background_compactions: -1 2024-04-20T21:45:35.676 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_subcompactions: 1 2024-04-20T21:45:35.676 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-20T21:45:35.676 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-20T21:45:35.676 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-20T21:45:35.676 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_total_wal_size: 0 2024-04-20T21:45:35.676 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-20T21:45:35.676 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-20T21:45:35.676 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-20T21:45:35.676 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-20T21:45:35.676 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_open_files: -1 2024-04-20T21:45:35.676 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.bytes_per_sync: 0 2024-04-20T21:45:35.676 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-20T21:45:35.676 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-20T21:45:35.676 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compaction_readahead_size: 0 2024-04-20T21:45:35.677 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_background_flushes: -1 2024-04-20T21:45:35.677 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Compression algorithms supported: 2024-04-20T21:45:35.677 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-20T21:45:35.677 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: kZSTD supported: 0 2024-04-20T21:45:35.677 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: kXpressCompression supported: 0 2024-04-20T21:45:35.677 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: kLZ4HCCompression supported: 1 2024-04-20T21:45:35.677 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: kZlibCompression supported: 1 2024-04-20T21:45:35.677 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: kSnappyCompression supported: 1 2024-04-20T21:45:35.677 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: kLZ4Compression supported: 1 2024-04-20T21:45:35.677 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: kBZip2Compression supported: 0 2024-04-20T21:45:35.677 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-20T21:45:35.677 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-20T21:45:35.678 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi142/store.db/MANIFEST-000010 2024-04-20T21:45:35.678 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-20T21:45:35.678 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-20T21:45:35.678 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.merge_operator: 2024-04-20T21:45:35.678 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compaction_filter: None 2024-04-20T21:45:35.678 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compaction_filter_factory: None 2024-04-20T21:45:35.678 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.sst_partitioner_factory: None 2024-04-20T21:45:35.678 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-20T21:45:35.678 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-20T21:45:35.678 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558588e8d520) 2024-04-20T21:45:35.678 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: cache_index_and_filter_blocks: 1 2024-04-20T21:45:35.678 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-20T21:45:35.678 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-20T21:45:35.678 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: pin_top_level_index_and_filter: 1 2024-04-20T21:45:35.678 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: index_type: 0 2024-04-20T21:45:35.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: data_block_index_type: 0 2024-04-20T21:45:35.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: index_shortening: 1 2024-04-20T21:45:35.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-20T21:45:35.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: checksum: 4 2024-04-20T21:45:35.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: no_block_cache: 0 2024-04-20T21:45:35.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_cache: 0x5585881a31f0 2024-04-20T21:45:35.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_cache_name: BinnedLRUCache 2024-04-20T21:45:35.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_cache_options: 2024-04-20T21:45:35.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: capacity : 536870912 2024-04-20T21:45:35.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: num_shard_bits : 4 2024-04-20T21:45:35.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: strict_capacity_limit : 0 2024-04-20T21:45:35.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: high_pri_pool_ratio: 0.000 2024-04-20T21:45:35.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_cache_compressed: (nil) 2024-04-20T21:45:35.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: persistent_cache: (nil) 2024-04-20T21:45:35.679 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_size: 4096 2024-04-20T21:45:35.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_size_deviation: 10 2024-04-20T21:45:35.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_restart_interval: 16 2024-04-20T21:45:35.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: index_block_restart_interval: 1 2024-04-20T21:45:35.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: metadata_block_size: 4096 2024-04-20T21:45:35.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: partition_filters: 0 2024-04-20T21:45:35.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: use_delta_encoding: 1 2024-04-20T21:45:35.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: filter_policy: bloomfilter 2024-04-20T21:45:35.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: whole_key_filtering: 1 2024-04-20T21:45:35.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: verify_compression: 0 2024-04-20T21:45:35.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: read_amp_bytes_per_bit: 0 2024-04-20T21:45:35.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: format_version: 5 2024-04-20T21:45:35.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: enable_index_compression: 1 2024-04-20T21:45:35.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_align: 0 2024-04-20T21:45:35.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: max_auto_readahead_size: 262144 2024-04-20T21:45:35.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: prepopulate_block_cache: 0 2024-04-20T21:45:35.680 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: initial_auto_readahead_size: 8192 2024-04-20T21:45:35.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: num_file_reads_for_auto_readahead: 2 2024-04-20T21:45:35.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.write_buffer_size: 33554432 2024-04-20T21:45:35.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_write_buffer_number: 2 2024-04-20T21:45:35.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compression: NoCompression 2024-04-20T21:45:35.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.bottommost_compression: Disabled 2024-04-20T21:45:35.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.prefix_extractor: nullptr 2024-04-20T21:45:35.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-20T21:45:35.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.num_levels: 7 2024-04-20T21:45:35.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-20T21:45:35.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-20T21:45:35.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-20T21:45:35.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-20T21:45:35.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-20T21:45:35.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-20T21:45:35.681 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-20T21:45:35.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-20T21:45:35.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-20T21:45:35.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-20T21:45:35.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-20T21:45:35.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-20T21:45:35.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-20T21:45:35.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compression_opts.level: 32767 2024-04-20T21:45:35.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compression_opts.strategy: 0 2024-04-20T21:45:35.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-20T21:45:35.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-20T21:45:35.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-20T21:45:35.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-20T21:45:35.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compression_opts.enabled: false 2024-04-20T21:45:35.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-20T21:45:35.682 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-20T21:45:35.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-20T21:45:35.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-20T21:45:35.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.target_file_size_base: 67108864 2024-04-20T21:45:35.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-20T21:45:35.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-20T21:45:35.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-20T21:45:35.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-20T21:45:35.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-20T21:45:35.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-20T21:45:35.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-20T21:45:35.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-20T21:45:35.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-20T21:45:35.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-20T21:45:35.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-20T21:45:35.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-20T21:45:35.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-20T21:45:35.684 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-20T21:45:35.684 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.arena_block_size: 1048576 2024-04-20T21:45:35.684 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-20T21:45:35.684 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-20T21:45:35.684 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.disable_auto_compactions: 0 2024-04-20T21:45:35.684 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-20T21:45:35.684 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-20T21:45:35.684 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-20T21:45:35.685 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-20T21:45:35.685 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-20T21:45:35.685 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-20T21:45:35.685 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-20T21:45:35.685 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-20T21:45:35.685 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-20T21:45:35.685 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-20T21:45:35.685 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.table_properties_collectors: 2024-04-20T21:45:35.685 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.inplace_update_support: 0 2024-04-20T21:45:35.685 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-20T21:45:35.685 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-20T21:45:35.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-20T21:45:35.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-20T21:45:35.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.bloom_locality: 0 2024-04-20T21:45:35.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.max_successive_merges: 0 2024-04-20T21:45:35.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-20T21:45:35.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.paranoid_file_checks: 0 2024-04-20T21:45:35.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.force_consistency_checks: 1 2024-04-20T21:45:35.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.report_bg_io_stats: 0 2024-04-20T21:45:35.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.ttl: 2592000 2024-04-20T21:45:35.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-20T21:45:35.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-20T21:45:35.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-20T21:45:35.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.enable_blob_files: false 2024-04-20T21:45:35.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.min_blob_size: 0 2024-04-20T21:45:35.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.blob_file_size: 268435456 2024-04-20T21:45:35.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-20T21:45:35.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-20T21:45:35.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-20T21:45:35.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-20T21:45:35.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-20T21:45:35.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.blob_file_starting_level: 0 2024-04-20T21:45:35.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-20T21:45:35.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi142/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-20T21:45:35.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-20T21:45:35.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c0c1d3d1-daa4-45d8-be05-2d3f70d52c1f 2024-04-20T21:45:35.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713649535475038, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-20T21:45:35.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-20T21:45:35.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713649535476824, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93941, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 320, "table_properties": {"data_size": 91975, "index_size": 248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13606, "raw_average_key_size": 49, "raw_value_size": 84513, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 275, "num_filter_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713649535, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c0c1d3d1-daa4-45d8-be05-2d3f70d52c1f", "db_session_id": "59XKX67CDVX8V8FHFBQL", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-20T21:45:35.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713649535477052, "job": 1, "event": "recovery_finished"} 2024-04-20T21:45:35.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-20T21:45:35.688 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi142/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-20T21:45:35.688 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558588242000 2024-04-20T21:45:35.688 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: DB pointer 0x558588230000 2024-04-20T21:45:35.688 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-20T21:45:35.688 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-20T21:45:35.688 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ** DB Stats ** 2024-04-20T21:45:35.688 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-20T21:45:35.688 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-20T21:45:35.688 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-20T21:45:35.688 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-20T21:45:35.688 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-20T21:45:35.688 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-20T21:45:35.688 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-20T21:45:35.688 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-04-20T21:45:35.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ** Compaction Stats [default] ** 2024-04-20T21:45:35.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-20T21:45:35.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-20T21:45:35.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: L0 2/0 93.61 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 81.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-20T21:45:35.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Sum 2/0 93.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 81.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-20T21:45:35.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 81.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-20T21:45:35.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-04-20T21:45:35.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ** Compaction Stats [default] ** 2024-04-20T21:45:35.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-20T21:45:35.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-20T21:45:35.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 81.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-20T21:45:35.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-04-20T21:45:35.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-20T21:45:35.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-04-20T21:45:35.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-20T21:45:35.689 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-20T21:45:35.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-20T21:45:35.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-20T21:45:35.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-20T21:45:35.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-20T21:45:35.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Cumulative compaction: 0.00 GB write, 12.13 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-20T21:45:35.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Interval compaction: 0.00 GB write, 12.13 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-20T21:45:35.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-20T21:45:35.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Block cache BinnedLRUCache@0x5585881a31f0#2 capacity: 512.00 MB usage: 1.33 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-04-20T21:45:35.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-04-20T21:45:35.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-04-20T21:45:35.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-20T21:45:35.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: starting mon.smithi142 rank 0 at public addrs [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] at bind addrs [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi142 fsid 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T21:45:35.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: mon.smithi142@-1(???) e1 preinit fsid 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T21:45:35.690 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: mon.smithi142@-1(???).mds e1 new map 2024-04-20T21:45:35.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: mon.smithi142@-1(???).mds e1 print_map 2024-04-20T21:45:35.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: e1 2024-04-20T21:45:35.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T21:45:35.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:45:35.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: legacy client fscid: -1 2024-04-20T21:45:35.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-04-20T21:45:35.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: No filesystems configured 2024-04-20T21:45:35.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: mon.smithi142@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-20T21:45:35.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: mon.smithi142@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-20T21:45:35.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: mon.smithi142@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-20T21:45:35.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: mon.smithi142@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-20T21:45:35.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: mon.smithi142@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-20T21:45:35.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 bash[15808]: c076f7eb00ea069949471cd9b44607437211566911d9032ddf62c4e631213cf1 2024-04-20T21:45:35.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 systemd[1]: Started Ceph mon.smithi142 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T21:45:35.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: mon.smithi142 is new leader, mons smithi142 in quorum (ranks 0) 2024-04-20T21:45:35.691 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: monmap e1: 1 mons at {smithi142=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-20T21:45:35.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: fsmap 2024-04-20T21:45:35.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: osdmap e1: 0 total, 0 up, 0 in 2024-04-20T21:45:35.692 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:35 smithi142 ceph-mon[15828]: mgrmap e1: no daemons active 2024-04-20T21:45:36.861 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.188+0000 7fe9a3600700 1 Processor -- start 2024-04-20T21:45:36.862 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.188+0000 7fe9a3600700 1 -- start start 2024-04-20T21:45:36.862 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.188+0000 7fe9a3600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe99c1070b0 0x7fe99c1094a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:36.862 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.188+0000 7fe9a3600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c074710 con 0x7fe99c1070b0 2024-04-20T21:45:36.862 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.189+0000 7fe9a0c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe99c1070b0 0x7fe99c1094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:36.862 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.189+0000 7fe9a0c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe99c1070b0 0x7fe99c1094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45114/0 (socket says 172.21.15.142:45114) 2024-04-20T21:45:36.862 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.189+0000 7fe9a0c00700 1 -- 172.21.15.142:0/1077513407 learned_addr learned my addr 172.21.15.142:0/1077513407 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:36.862 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.189+0000 7fe9a0c00700 1 -- 172.21.15.142:0/1077513407 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c074850 con 0x7fe99c1070b0 2024-04-20T21:45:36.862 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.189+0000 7fe9a0c00700 1 --2- 172.21.15.142:0/1077513407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe99c1070b0 0x7fe99c1094a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe9900098a0 tx=0x7fe990009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab5ccb8c0513c1f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:36.862 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.190+0000 7fe99b400700 1 -- 172.21.15.142:0/1077513407 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe990004180 con 0x7fe99c1070b0 2024-04-20T21:45:36.862 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.190+0000 7fe99b400700 1 -- 172.21.15.142:0/1077513407 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe9900042e0 con 0x7fe99c1070b0 2024-04-20T21:45:36.863 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.190+0000 7fe99b400700 1 -- 172.21.15.142:0/1077513407 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe990011a70 con 0x7fe99c1070b0 2024-04-20T21:45:36.863 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.191+0000 7fe9a3600700 1 -- 172.21.15.142:0/1077513407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe99c1070b0 msgr2=0x7fe99c1094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:36.863 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.191+0000 7fe9a3600700 1 --2- 172.21.15.142:0/1077513407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe99c1070b0 0x7fe99c1094a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe9900098a0 tx=0x7fe990009bb0 comp rx=0 tx=0).stop 2024-04-20T21:45:36.863 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.191+0000 7fe9a3600700 1 -- 172.21.15.142:0/1077513407 shutdown_connections 2024-04-20T21:45:36.863 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.191+0000 7fe9a3600700 1 --2- 172.21.15.142:0/1077513407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe99c1070b0 0x7fe99c1094a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:36.863 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.191+0000 7fe9a3600700 1 -- 172.21.15.142:0/1077513407 >> 172.21.15.142:0/1077513407 conn(0x7fe99c100a60 msgr2=0x7fe99c102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:36.863 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.191+0000 7fe9a3600700 1 -- 172.21.15.142:0/1077513407 shutdown_connections 2024-04-20T21:45:36.863 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.191+0000 7fe9a3600700 1 -- 172.21.15.142:0/1077513407 wait complete. 2024-04-20T21:45:36.863 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.192+0000 7fe9a3600700 1 Processor -- start 2024-04-20T21:45:36.863 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.192+0000 7fe9a3600700 1 -- start start 2024-04-20T21:45:36.863 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.192+0000 7fe9a3600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe99c1070b0 0x7fe99c19c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:36.863 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.192+0000 7fe9a3600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c19ca60 con 0x7fe99c1070b0 2024-04-20T21:45:36.863 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.193+0000 7fe9a0c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe99c1070b0 0x7fe99c19c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:36.864 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.193+0000 7fe9a0c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe99c1070b0 0x7fe99c19c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45128/0 (socket says 172.21.15.142:45128) 2024-04-20T21:45:36.864 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.193+0000 7fe9a0c00700 1 -- 172.21.15.142:0/1190763218 learned_addr learned my addr 172.21.15.142:0/1190763218 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:36.864 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.193+0000 7fe9a0c00700 1 -- 172.21.15.142:0/1190763218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe990009550 con 0x7fe99c1070b0 2024-04-20T21:45:36.864 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.193+0000 7fe9a0c00700 1 --2- 172.21.15.142:0/1190763218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe99c1070b0 0x7fe99c19c520 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe990011710 tx=0x7fe9900047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:36.864 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.193+0000 7fe999600700 1 -- 172.21.15.142:0/1190763218 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe990003b10 con 0x7fe99c1070b0 2024-04-20T21:45:36.864 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.194+0000 7fe999600700 1 -- 172.21.15.142:0/1190763218 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe99001b8c0 con 0x7fe99c1070b0 2024-04-20T21:45:36.864 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.194+0000 7fe9a3600700 1 -- 172.21.15.142:0/1190763218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99c19cc60 con 0x7fe99c1070b0 2024-04-20T21:45:36.864 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.194+0000 7fe999600700 1 -- 172.21.15.142:0/1190763218 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9900197e0 con 0x7fe99c1070b0 2024-04-20T21:45:36.864 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.194+0000 7fe9a3600700 1 -- 172.21.15.142:0/1190763218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99c19d100 con 0x7fe99c1070b0 2024-04-20T21:45:36.864 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.194+0000 7fe999600700 1 -- 172.21.15.142:0/1190763218 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe990019cd0 con 0x7fe99c1070b0 2024-04-20T21:45:36.864 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.194+0000 7fe999600700 1 -- 172.21.15.142:0/1190763218 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe99001a710 con 0x7fe99c1070b0 2024-04-20T21:45:36.864 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.195+0000 7fe9a3600700 1 -- 172.21.15.142:0/1190763218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99c10a6c0 con 0x7fe99c1070b0 2024-04-20T21:45:36.864 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.198+0000 7fe999600700 1 -- 172.21.15.142:0/1190763218 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fe990029060 con 0x7fe99c1070b0 2024-04-20T21:45:36.864 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.274+0000 7fe9a3600700 1 -- 172.21.15.142:0/1190763218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fe99c19f990 con 0x7fe99c1070b0 2024-04-20T21:45:36.865 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.277+0000 7fe999600700 1 -- 172.21.15.142:0/1190763218 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe99001f070 con 0x7fe99c1070b0 2024-04-20T21:45:36.865 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.278+0000 7fe9a3600700 1 -- 172.21.15.142:0/1190763218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe99c1070b0 msgr2=0x7fe99c19c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:36.865 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.278+0000 7fe9a3600700 1 --2- 172.21.15.142:0/1190763218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe99c1070b0 0x7fe99c19c520 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe990011710 tx=0x7fe9900047c0 comp rx=0 tx=0).stop 2024-04-20T21:45:36.865 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.278+0000 7fe9a3600700 1 -- 172.21.15.142:0/1190763218 shutdown_connections 2024-04-20T21:45:36.865 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.278+0000 7fe9a3600700 1 --2- 172.21.15.142:0/1190763218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe99c1070b0 0x7fe99c19c520 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:36.865 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.278+0000 7fe9a3600700 1 -- 172.21.15.142:0/1190763218 >> 172.21.15.142:0/1190763218 conn(0x7fe99c100a60 msgr2=0x7fe99c101540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:36.865 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.279+0000 7fe9a3600700 1 -- 172.21.15.142:0/1190763218 shutdown_connections 2024-04-20T21:45:36.865 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:36.279+0000 7fe9a3600700 1 -- 172.21.15.142:0/1190763218 wait complete. 2024-04-20T21:45:36.865 INFO:teuthology.orchestra.run.smithi142.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-20T21:45:36.908 INFO:teuthology.orchestra.run.smithi142.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-20T21:45:36.908 INFO:teuthology.orchestra.run.smithi142.stdout:Creating mgr... 2024-04-20T21:45:36.909 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-20T21:45:36.911 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-20T21:45:36.911 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying port 0.0.0.0:8443 ... 2024-04-20T21:45:37.346 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mgr.smithi142.zzmcfz 2024-04-20T21:45:37.346 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Failed to reset failed state of unit ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mgr.smithi142.zzmcfz.service: Unit ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mgr.smithi142.zzmcfz.service not loaded. 2024-04-20T21:45:37.598 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-270cccba-ff5f-11ee-bc93-c7b262605968.target.wants/ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mgr.smithi142.zzmcfz.service → /etc/systemd/system/ceph-270cccba-ff5f-11ee-bc93-c7b262605968@.service. 2024-04-20T21:45:37.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:37 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1190763218' entity='client.admin' 2024-04-20T21:45:38.385 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-20T21:45:38.385 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout disabled 2024-04-20T21:45:38.403 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-20T21:45:38.403 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout inactive 2024-04-20T21:45:38.403 INFO:teuthology.orchestra.run.smithi142.stdout:firewalld.service is not enabled 2024-04-20T21:45:38.403 INFO:teuthology.orchestra.run.smithi142.stdout:Not possible to enable service . firewalld.service is not available 2024-04-20T21:45:38.427 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-20T21:45:38.427 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout disabled 2024-04-20T21:45:38.446 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-20T21:45:38.446 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout inactive 2024-04-20T21:45:38.446 INFO:teuthology.orchestra.run.smithi142.stdout:firewalld.service is not enabled 2024-04-20T21:45:38.447 INFO:teuthology.orchestra.run.smithi142.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-04-20T21:45:38.447 INFO:teuthology.orchestra.run.smithi142.stdout:Waiting for mgr to start... 2024-04-20T21:45:38.447 INFO:teuthology.orchestra.run.smithi142.stdout:Waiting for mgr... 2024-04-20T21:45:39.325 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:39 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2669229039' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-20T21:45:39.791 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2024-04-20T21:45:39.791 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout { 2024-04-20T21:45:39.791 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "fsid": "270cccba-ff5f-11ee-bc93-c7b262605968", 2024-04-20T21:45:39.791 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "health": { 2024-04-20T21:45:39.791 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-20T21:45:39.791 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-20T21:45:39.791 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-20T21:45:39.792 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:39.792 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-20T21:45:39.792 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-20T21:45:39.792 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 0 2024-04-20T21:45:39.792 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2024-04-20T21:45:39.792 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-20T21:45:39.792 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "smithi142" 2024-04-20T21:45:39.792 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2024-04-20T21:45:39.792 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-04-20T21:45:39.792 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-20T21:45:39.792 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T21:45:39.792 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-04-20T21:45:39.792 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-20T21:45:39.792 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:39.793 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-20T21:45:39.793 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T21:45:39.793 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-20T21:45:39.793 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-20T21:45:39.793 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-20T21:45:39.801 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-20T21:45:39.801 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-20T21:45:39.801 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-20T21:45:39.801 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:39.801 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-20T21:45:39.801 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-20T21:45:39.801 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-20T21:45:39.801 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-20T21:45:39.801 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-20T21:45:39.801 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-20T21:45:39.802 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-20T21:45:39.802 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-20T21:45:39.802 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-20T21:45:39.802 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:39.802 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-20T21:45:39.802 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T21:45:39.802 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-20T21:45:39.802 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-20T21:45:39.802 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:39.802 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-20T21:45:39.802 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-20T21:45:39.802 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-20T21:45:39.802 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-20T21:45:39.802 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-20T21:45:39.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-20T21:45:39.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "restful" 2024-04-20T21:45:39.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2024-04-20T21:45:39.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-20T21:45:39.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:39.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-20T21:45:39.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T21:45:39.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "modified": "2024-04-20T21:45:27.214173+0000", 2024-04-20T21:45:39.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-20T21:45:39.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:39.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-20T21:45:39.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout } 2024-04-20T21:45:39.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.052+0000 7f50c5800700 1 Processor -- start 2024-04-20T21:45:39.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.052+0000 7f50c5800700 1 -- start start 2024-04-20T21:45:39.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.052+0000 7f50c5800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c01065a0 0x7f50c01069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:39.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.052+0000 7f50c5800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c0106f90 con 0x7f50c01065a0 2024-04-20T21:45:39.804 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.053+0000 7f50bea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c01065a0 0x7f50c01069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:39.804 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.053+0000 7f50bea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c01065a0 0x7f50c01069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36014/0 (socket says 172.21.15.142:36014) 2024-04-20T21:45:39.804 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.053+0000 7f50bea00700 1 -- 172.21.15.142:0/4167063232 learned_addr learned my addr 172.21.15.142:0/4167063232 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:39.804 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.053+0000 7f50bea00700 1 -- 172.21.15.142:0/4167063232 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c01077a0 con 0x7f50c01065a0 2024-04-20T21:45:39.804 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.054+0000 7f50bea00700 1 --2- 172.21.15.142:0/4167063232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c01065a0 0x7f50c01069c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f50b00098a0 tx=0x7f50b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f049846f167011 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:39.804 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.054+0000 7f50bd600700 1 -- 172.21.15.142:0/4167063232 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50b0004180 con 0x7f50c01065a0 2024-04-20T21:45:39.804 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.054+0000 7f50bd600700 1 -- 172.21.15.142:0/4167063232 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f50b00042e0 con 0x7f50c01065a0 2024-04-20T21:45:39.804 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.054+0000 7f50bd600700 1 -- 172.21.15.142:0/4167063232 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50b0011a70 con 0x7f50c01065a0 2024-04-20T21:45:39.804 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.055+0000 7f50c5800700 1 -- 172.21.15.142:0/4167063232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c01065a0 msgr2=0x7f50c01069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:39.804 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.055+0000 7f50c5800700 1 --2- 172.21.15.142:0/4167063232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c01065a0 0x7f50c01069c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f50b00098a0 tx=0x7f50b0009bb0 comp rx=0 tx=0).stop 2024-04-20T21:45:39.804 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.055+0000 7f50c5800700 1 -- 172.21.15.142:0/4167063232 shutdown_connections 2024-04-20T21:45:39.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.055+0000 7f50c5800700 1 --2- 172.21.15.142:0/4167063232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c01065a0 0x7f50c01069c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:39.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.055+0000 7f50c5800700 1 -- 172.21.15.142:0/4167063232 >> 172.21.15.142:0/4167063232 conn(0x7f50c0101ba0 msgr2=0x7f50c0103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:39.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.055+0000 7f50c5800700 1 -- 172.21.15.142:0/4167063232 shutdown_connections 2024-04-20T21:45:39.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.055+0000 7f50c5800700 1 -- 172.21.15.142:0/4167063232 wait complete. 2024-04-20T21:45:39.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.056+0000 7f50c5800700 1 Processor -- start 2024-04-20T21:45:39.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.056+0000 7f50c5800700 1 -- start start 2024-04-20T21:45:39.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.057+0000 7f50c5800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c01065a0 0x7f50c019c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:39.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.057+0000 7f50c5800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c019cb10 con 0x7f50c01065a0 2024-04-20T21:45:39.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.057+0000 7f50bea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c01065a0 0x7f50c019c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:39.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.057+0000 7f50bea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c01065a0 0x7f50c019c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36022/0 (socket says 172.21.15.142:36022) 2024-04-20T21:45:39.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.057+0000 7f50bea00700 1 -- 172.21.15.142:0/2669229039 learned_addr learned my addr 172.21.15.142:0/2669229039 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:39.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.057+0000 7f50bea00700 1 -- 172.21.15.142:0/2669229039 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b0009550 con 0x7f50c01065a0 2024-04-20T21:45:39.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.058+0000 7f50bea00700 1 --2- 172.21.15.142:0/2669229039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c01065a0 0x7f50c019c5d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f50b0006af0 tx=0x7f50b00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:39.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.058+0000 7f50b7400700 1 -- 172.21.15.142:0/2669229039 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50b0003a00 con 0x7f50c01065a0 2024-04-20T21:45:39.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.058+0000 7f50b7400700 1 -- 172.21.15.142:0/2669229039 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f50b0003b60 con 0x7f50c01065a0 2024-04-20T21:45:39.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.058+0000 7f50c5800700 1 -- 172.21.15.142:0/2669229039 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c019cd10 con 0x7f50c01065a0 2024-04-20T21:45:39.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.058+0000 7f50b7400700 1 -- 172.21.15.142:0/2669229039 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50b0023750 con 0x7f50c01065a0 2024-04-20T21:45:39.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.059+0000 7f50c5800700 1 -- 172.21.15.142:0/2669229039 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c019d1b0 con 0x7f50c01065a0 2024-04-20T21:45:39.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.059+0000 7f50b7400700 1 -- 172.21.15.142:0/2669229039 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f50b0023940 con 0x7f50c01065a0 2024-04-20T21:45:39.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.059+0000 7f50b7400700 1 -- 172.21.15.142:0/2669229039 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f50b002cd20 con 0x7f50c01065a0 2024-04-20T21:45:39.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.060+0000 7f50c5800700 1 -- 172.21.15.142:0/2669229039 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c0062510 con 0x7f50c01065a0 2024-04-20T21:45:39.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.062+0000 7f50b7400700 1 -- 172.21.15.142:0/2669229039 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f50b001bbe0 con 0x7f50c01065a0 2024-04-20T21:45:39.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.140+0000 7f50c5800700 1 -- 172.21.15.142:0/2669229039 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f50c010a9d0 con 0x7f50c01065a0 2024-04-20T21:45:39.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.141+0000 7f50b7400700 1 -- 172.21.15.142:0/2669229039 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f50b0023d30 con 0x7f50c01065a0 2024-04-20T21:45:39.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.142+0000 7f50c5800700 1 -- 172.21.15.142:0/2669229039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c01065a0 msgr2=0x7f50c019c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:39.807 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.142+0000 7f50c5800700 1 --2- 172.21.15.142:0/2669229039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c01065a0 0x7f50c019c5d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f50b0006af0 tx=0x7f50b00047c0 comp rx=0 tx=0).stop 2024-04-20T21:45:39.807 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.142+0000 7f50c5800700 1 -- 172.21.15.142:0/2669229039 shutdown_connections 2024-04-20T21:45:39.807 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.142+0000 7f50c5800700 1 --2- 172.21.15.142:0/2669229039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c01065a0 0x7f50c019c5d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:39.807 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.142+0000 7f50c5800700 1 -- 172.21.15.142:0/2669229039 >> 172.21.15.142:0/2669229039 conn(0x7f50c0101ba0 msgr2=0x7f50c0102790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:39.807 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.142+0000 7f50c5800700 1 -- 172.21.15.142:0/2669229039 shutdown_connections 2024-04-20T21:45:39.807 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:39.142+0000 7f50c5800700 1 -- 172.21.15.142:0/2669229039 wait complete. 2024-04-20T21:45:39.807 INFO:teuthology.orchestra.run.smithi142.stdout:mgr not available, waiting (1/15)... 2024-04-20T21:45:42.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:42 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/819838579' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-20T21:45:43.198 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2024-04-20T21:45:43.198 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout { 2024-04-20T21:45:43.198 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "fsid": "270cccba-ff5f-11ee-bc93-c7b262605968", 2024-04-20T21:45:43.198 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "health": { 2024-04-20T21:45:43.198 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-20T21:45:43.198 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-20T21:45:43.199 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-20T21:45:43.199 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:43.199 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-20T21:45:43.199 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-20T21:45:43.199 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 0 2024-04-20T21:45:43.199 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2024-04-20T21:45:43.199 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-20T21:45:43.199 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "smithi142" 2024-04-20T21:45:43.199 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2024-04-20T21:45:43.199 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-04-20T21:45:43.200 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-20T21:45:43.200 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T21:45:43.200 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-04-20T21:45:43.200 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-20T21:45:43.200 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:43.200 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-20T21:45:43.200 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T21:45:43.200 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-20T21:45:43.200 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-20T21:45:43.200 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-20T21:45:43.200 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-20T21:45:43.200 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-20T21:45:43.200 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-20T21:45:43.200 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:43.201 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-20T21:45:43.201 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-20T21:45:43.201 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-20T21:45:43.201 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-20T21:45:43.201 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-20T21:45:43.201 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-20T21:45:43.201 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-20T21:45:43.201 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-20T21:45:43.201 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-20T21:45:43.201 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:43.201 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-20T21:45:43.201 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T21:45:43.201 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-20T21:45:43.202 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-20T21:45:43.202 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:43.202 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-20T21:45:43.202 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-20T21:45:43.202 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-20T21:45:43.202 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-20T21:45:43.202 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-20T21:45:43.202 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-20T21:45:43.202 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "restful" 2024-04-20T21:45:43.202 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2024-04-20T21:45:43.202 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-20T21:45:43.202 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:43.202 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-20T21:45:43.202 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T21:45:43.203 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "modified": "2024-04-20T21:45:27.214173+0000", 2024-04-20T21:45:43.203 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-20T21:45:43.203 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:43.203 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-20T21:45:43.203 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout } 2024-04-20T21:45:43.203 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.424+0000 7f58d8400700 1 Processor -- start 2024-04-20T21:45:43.203 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.424+0000 7f58d8400700 1 -- start start 2024-04-20T21:45:43.203 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.424+0000 7f58d8400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d0104e90 0x7f58d01052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:43.203 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.424+0000 7f58d8400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d0074730 con 0x7f58d0104e90 2024-04-20T21:45:43.203 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.425+0000 7f58d5a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d0104e90 0x7f58d01052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:43.203 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.425+0000 7f58d5a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d0104e90 0x7f58d01052b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36030/0 (socket says 172.21.15.142:36030) 2024-04-20T21:45:43.203 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.425+0000 7f58d5a00700 1 -- 172.21.15.142:0/2526774415 learned_addr learned my addr 172.21.15.142:0/2526774415 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:43.203 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.425+0000 7f58d5a00700 1 -- 172.21.15.142:0/2526774415 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d01057f0 con 0x7f58d0104e90 2024-04-20T21:45:43.203 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.426+0000 7f58d5a00700 1 --2- 172.21.15.142:0/2526774415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d0104e90 0x7f58d01052b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f58c40098a0 tx=0x7f58c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb54c4c8a736dc83 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:43.204 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.426+0000 7f58cfe00700 1 -- 172.21.15.142:0/2526774415 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58c4004180 con 0x7f58d0104e90 2024-04-20T21:45:43.204 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.426+0000 7f58cfe00700 1 -- 172.21.15.142:0/2526774415 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f58c40042e0 con 0x7f58d0104e90 2024-04-20T21:45:43.204 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.426+0000 7f58cfe00700 1 -- 172.21.15.142:0/2526774415 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58c4011a70 con 0x7f58d0104e90 2024-04-20T21:45:43.204 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.427+0000 7f58d8400700 1 -- 172.21.15.142:0/2526774415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d0104e90 msgr2=0x7f58d01052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:43.204 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.427+0000 7f58d8400700 1 --2- 172.21.15.142:0/2526774415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d0104e90 0x7f58d01052b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f58c40098a0 tx=0x7f58c4009bb0 comp rx=0 tx=0).stop 2024-04-20T21:45:43.204 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.427+0000 7f58d8400700 1 -- 172.21.15.142:0/2526774415 shutdown_connections 2024-04-20T21:45:43.204 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.427+0000 7f58d8400700 1 --2- 172.21.15.142:0/2526774415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d0104e90 0x7f58d01052b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:43.204 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.427+0000 7f58d8400700 1 -- 172.21.15.142:0/2526774415 >> 172.21.15.142:0/2526774415 conn(0x7f58d0100a50 msgr2=0x7f58d0102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:43.204 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.427+0000 7f58d8400700 1 -- 172.21.15.142:0/2526774415 shutdown_connections 2024-04-20T21:45:43.204 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.427+0000 7f58d8400700 1 -- 172.21.15.142:0/2526774415 wait complete. 2024-04-20T21:45:43.204 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.428+0000 7f58d8400700 1 Processor -- start 2024-04-20T21:45:43.204 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.428+0000 7f58d8400700 1 -- start start 2024-04-20T21:45:43.204 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.429+0000 7f58d8400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d0104e90 0x7f58d019c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:43.204 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.429+0000 7f58d8400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d019ca50 con 0x7f58d0104e90 2024-04-20T21:45:43.205 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.429+0000 7f58d5a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d0104e90 0x7f58d019c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:43.205 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.429+0000 7f58d5a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d0104e90 0x7f58d019c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36032/0 (socket says 172.21.15.142:36032) 2024-04-20T21:45:43.205 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.429+0000 7f58d5a00700 1 -- 172.21.15.142:0/819838579 learned_addr learned my addr 172.21.15.142:0/819838579 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:43.205 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.429+0000 7f58d5a00700 1 -- 172.21.15.142:0/819838579 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c4009550 con 0x7f58d0104e90 2024-04-20T21:45:43.205 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.430+0000 7f58d5a00700 1 --2- 172.21.15.142:0/819838579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d0104e90 0x7f58d019c510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f58c4011710 tx=0x7f58c40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:43.205 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.430+0000 7f58ce000700 1 -- 172.21.15.142:0/819838579 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58c4003b10 con 0x7f58d0104e90 2024-04-20T21:45:43.205 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.430+0000 7f58ce000700 1 -- 172.21.15.142:0/819838579 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f58c401b8c0 con 0x7f58d0104e90 2024-04-20T21:45:43.205 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.430+0000 7f58d8400700 1 -- 172.21.15.142:0/819838579 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d019cc50 con 0x7f58d0104e90 2024-04-20T21:45:43.205 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.430+0000 7f58ce000700 1 -- 172.21.15.142:0/819838579 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58c40197e0 con 0x7f58d0104e90 2024-04-20T21:45:43.205 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.430+0000 7f58d8400700 1 -- 172.21.15.142:0/819838579 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d019d0f0 con 0x7f58d0104e90 2024-04-20T21:45:43.205 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.430+0000 7f58ce000700 1 -- 172.21.15.142:0/819838579 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f58c4019cd0 con 0x7f58d0104e90 2024-04-20T21:45:43.205 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.430+0000 7f58ce000700 1 -- 172.21.15.142:0/819838579 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f58c401a710 con 0x7f58d0104e90 2024-04-20T21:45:43.205 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.431+0000 7f58d8400700 1 -- 172.21.15.142:0/819838579 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d0196260 con 0x7f58d0104e90 2024-04-20T21:45:43.205 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.434+0000 7f58ce000700 1 -- 172.21.15.142:0/819838579 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f58c4029060 con 0x7f58d0104e90 2024-04-20T21:45:43.206 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.512+0000 7f58d8400700 1 -- 172.21.15.142:0/819838579 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f58d0106700 con 0x7f58d0104e90 2024-04-20T21:45:43.206 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.513+0000 7f58ce000700 1 -- 172.21.15.142:0/819838579 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f58c401f070 con 0x7f58d0104e90 2024-04-20T21:45:43.206 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.514+0000 7f58d8400700 1 -- 172.21.15.142:0/819838579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d0104e90 msgr2=0x7f58d019c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:43.206 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.514+0000 7f58d8400700 1 --2- 172.21.15.142:0/819838579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d0104e90 0x7f58d019c510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f58c4011710 tx=0x7f58c40047c0 comp rx=0 tx=0).stop 2024-04-20T21:45:43.206 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.514+0000 7f58d8400700 1 -- 172.21.15.142:0/819838579 shutdown_connections 2024-04-20T21:45:43.206 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.514+0000 7f58d8400700 1 --2- 172.21.15.142:0/819838579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d0104e90 0x7f58d019c510 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:43.206 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.514+0000 7f58d8400700 1 -- 172.21.15.142:0/819838579 >> 172.21.15.142:0/819838579 conn(0x7f58d0100a50 msgr2=0x7f58d01933a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:43.206 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.514+0000 7f58d8400700 1 -- 172.21.15.142:0/819838579 shutdown_connections 2024-04-20T21:45:43.206 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:42.514+0000 7f58d8400700 1 -- 172.21.15.142:0/819838579 wait complete. 2024-04-20T21:45:43.206 INFO:teuthology.orchestra.run.smithi142.stdout:mgr not available, waiting (2/15)... 2024-04-20T21:45:46.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:45 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/3135803978' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-20T21:45:46.522 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2024-04-20T21:45:46.522 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout { 2024-04-20T21:45:46.522 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "fsid": "270cccba-ff5f-11ee-bc93-c7b262605968", 2024-04-20T21:45:46.522 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "health": { 2024-04-20T21:45:46.522 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-20T21:45:46.522 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-20T21:45:46.522 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-20T21:45:46.522 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:46.522 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-20T21:45:46.523 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-20T21:45:46.523 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 0 2024-04-20T21:45:46.523 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2024-04-20T21:45:46.523 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-20T21:45:46.523 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "smithi142" 2024-04-20T21:45:46.523 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2024-04-20T21:45:46.523 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-04-20T21:45:46.523 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-20T21:45:46.523 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T21:45:46.523 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-04-20T21:45:46.523 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-20T21:45:46.523 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:46.523 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-20T21:45:46.523 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T21:45:46.523 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-20T21:45:46.524 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-20T21:45:46.524 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-20T21:45:46.531 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-20T21:45:46.531 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-20T21:45:46.531 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-20T21:45:46.531 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:46.532 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-20T21:45:46.532 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-20T21:45:46.532 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-20T21:45:46.532 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-20T21:45:46.532 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-20T21:45:46.532 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-20T21:45:46.532 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-20T21:45:46.532 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-20T21:45:46.532 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-20T21:45:46.532 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:46.532 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-20T21:45:46.532 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T21:45:46.532 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-20T21:45:46.532 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-20T21:45:46.533 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:46.533 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-20T21:45:46.533 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-20T21:45:46.533 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-20T21:45:46.533 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-20T21:45:46.533 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-20T21:45:46.533 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-20T21:45:46.533 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "restful" 2024-04-20T21:45:46.533 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2024-04-20T21:45:46.533 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-20T21:45:46.533 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:46.533 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-20T21:45:46.533 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T21:45:46.534 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "modified": "2024-04-20T21:45:27.214173+0000", 2024-04-20T21:45:46.534 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-20T21:45:46.534 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:46.534 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-20T21:45:46.534 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout } 2024-04-20T21:45:46.534 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.807+0000 7fe446a00700 1 Processor -- start 2024-04-20T21:45:46.535 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.807+0000 7fe446a00700 1 -- start start 2024-04-20T21:45:46.535 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.807+0000 7fe446a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe44007adb0 0x7fe440079210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:46.535 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.807+0000 7fe446a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4400797e0 con 0x7fe44007adb0 2024-04-20T21:45:46.535 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.808+0000 7fe43fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe44007adb0 0x7fe440079210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:46.535 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.808+0000 7fe43fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe44007adb0 0x7fe440079210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36046/0 (socket says 172.21.15.142:36046) 2024-04-20T21:45:46.535 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.808+0000 7fe43fe00700 1 -- 172.21.15.142:0/3773494688 learned_addr learned my addr 172.21.15.142:0/3773494688 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:46.535 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.808+0000 7fe43fe00700 1 -- 172.21.15.142:0/3773494688 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe440079920 con 0x7fe44007adb0 2024-04-20T21:45:46.535 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.808+0000 7fe43fe00700 1 --2- 172.21.15.142:0/3773494688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe44007adb0 0x7fe440079210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe4300098a0 tx=0x7fe430009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b055c2c95b7a2cd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:46.535 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.809+0000 7fe43ea00700 1 -- 172.21.15.142:0/3773494688 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe430004180 con 0x7fe44007adb0 2024-04-20T21:45:46.535 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.809+0000 7fe43ea00700 1 -- 172.21.15.142:0/3773494688 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe4300042e0 con 0x7fe44007adb0 2024-04-20T21:45:46.535 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.809+0000 7fe43ea00700 1 -- 172.21.15.142:0/3773494688 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe430011a70 con 0x7fe44007adb0 2024-04-20T21:45:46.535 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.809+0000 7fe446a00700 1 -- 172.21.15.142:0/3773494688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe44007adb0 msgr2=0x7fe440079210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:46.535 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.810+0000 7fe446a00700 1 --2- 172.21.15.142:0/3773494688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe44007adb0 0x7fe440079210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe4300098a0 tx=0x7fe430009bb0 comp rx=0 tx=0).stop 2024-04-20T21:45:46.535 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.810+0000 7fe446a00700 1 -- 172.21.15.142:0/3773494688 shutdown_connections 2024-04-20T21:45:46.536 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.810+0000 7fe446a00700 1 --2- 172.21.15.142:0/3773494688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe44007adb0 0x7fe440079210 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:46.536 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.810+0000 7fe446a00700 1 -- 172.21.15.142:0/3773494688 >> 172.21.15.142:0/3773494688 conn(0x7fe440101ba0 msgr2=0x7fe440103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:46.536 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.810+0000 7fe446a00700 1 -- 172.21.15.142:0/3773494688 shutdown_connections 2024-04-20T21:45:46.536 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.810+0000 7fe446a00700 1 -- 172.21.15.142:0/3773494688 wait complete. 2024-04-20T21:45:46.536 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.811+0000 7fe446a00700 1 Processor -- start 2024-04-20T21:45:46.536 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.811+0000 7fe446a00700 1 -- start start 2024-04-20T21:45:46.536 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.811+0000 7fe446a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe44007adb0 0x7fe44019c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:46.536 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.811+0000 7fe446a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44019cae0 con 0x7fe44007adb0 2024-04-20T21:45:46.536 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.811+0000 7fe43fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe44007adb0 0x7fe44019c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:46.536 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.812+0000 7fe43fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe44007adb0 0x7fe44019c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36052/0 (socket says 172.21.15.142:36052) 2024-04-20T21:45:46.536 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.812+0000 7fe43fe00700 1 -- 172.21.15.142:0/3135803978 learned_addr learned my addr 172.21.15.142:0/3135803978 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:46.536 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.812+0000 7fe43fe00700 1 -- 172.21.15.142:0/3135803978 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe430009550 con 0x7fe44007adb0 2024-04-20T21:45:46.536 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.812+0000 7fe43fe00700 1 --2- 172.21.15.142:0/3135803978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe44007adb0 0x7fe44019c5a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe430006af0 tx=0x7fe4300047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:46.537 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.812+0000 7fe43cc00700 1 -- 172.21.15.142:0/3135803978 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe430003a00 con 0x7fe44007adb0 2024-04-20T21:45:46.537 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.812+0000 7fe43cc00700 1 -- 172.21.15.142:0/3135803978 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe430003b60 con 0x7fe44007adb0 2024-04-20T21:45:46.537 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.813+0000 7fe446a00700 1 -- 172.21.15.142:0/3135803978 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44019cce0 con 0x7fe44007adb0 2024-04-20T21:45:46.537 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.813+0000 7fe43cc00700 1 -- 172.21.15.142:0/3135803978 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe430023750 con 0x7fe44007adb0 2024-04-20T21:45:46.537 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.813+0000 7fe446a00700 1 -- 172.21.15.142:0/3135803978 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44019d180 con 0x7fe44007adb0 2024-04-20T21:45:46.537 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.813+0000 7fe43cc00700 1 -- 172.21.15.142:0/3135803978 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe430023c40 con 0x7fe44007adb0 2024-04-20T21:45:46.537 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.813+0000 7fe43cc00700 1 -- 172.21.15.142:0/3135803978 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe430019710 con 0x7fe44007adb0 2024-04-20T21:45:46.537 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.814+0000 7fe446a00700 1 -- 172.21.15.142:0/3135803978 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe44010c900 con 0x7fe44007adb0 2024-04-20T21:45:46.537 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.816+0000 7fe43cc00700 1 -- 172.21.15.142:0/3135803978 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fe43001bbe0 con 0x7fe44007adb0 2024-04-20T21:45:46.537 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.896+0000 7fe446a00700 1 -- 172.21.15.142:0/3135803978 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe44010caf0 con 0x7fe44007adb0 2024-04-20T21:45:46.537 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.897+0000 7fe43cc00700 1 -- 172.21.15.142:0/3135803978 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1247 (secure 0 0 0) 0x7fe430005a20 con 0x7fe44007adb0 2024-04-20T21:45:46.537 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.898+0000 7fe446a00700 1 -- 172.21.15.142:0/3135803978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe44007adb0 msgr2=0x7fe44019c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:46.537 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.898+0000 7fe446a00700 1 --2- 172.21.15.142:0/3135803978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe44007adb0 0x7fe44019c5a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe430006af0 tx=0x7fe4300047c0 comp rx=0 tx=0).stop 2024-04-20T21:45:46.537 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.898+0000 7fe446a00700 1 -- 172.21.15.142:0/3135803978 shutdown_connections 2024-04-20T21:45:46.538 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.898+0000 7fe446a00700 1 --2- 172.21.15.142:0/3135803978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe44007adb0 0x7fe44019c5a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:46.538 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.898+0000 7fe446a00700 1 -- 172.21.15.142:0/3135803978 >> 172.21.15.142:0/3135803978 conn(0x7fe440101ba0 msgr2=0x7fe440102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:46.538 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.898+0000 7fe446a00700 1 -- 172.21.15.142:0/3135803978 shutdown_connections 2024-04-20T21:45:46.538 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:45.899+0000 7fe446a00700 1 -- 172.21.15.142:0/3135803978 wait complete. 2024-04-20T21:45:46.538 INFO:teuthology.orchestra.run.smithi142.stdout:mgr not available, waiting (3/15)... 2024-04-20T21:45:47.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:47 smithi142 ceph-mon[15828]: Activating manager daemon smithi142.zzmcfz 2024-04-20T21:45:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:47 smithi142 ceph-mon[15828]: mgrmap e2: smithi142.zzmcfz(active, starting, since 0.0108906s) 2024-04-20T21:45:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:47 smithi142 ceph-mon[15828]: from='mgr.14100 172.21.15.142:0/1786704636' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-20T21:45:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:47 smithi142 ceph-mon[15828]: from='mgr.14100 172.21.15.142:0/1786704636' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-20T21:45:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:47 smithi142 ceph-mon[15828]: from='mgr.14100 172.21.15.142:0/1786704636' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-20T21:45:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:47 smithi142 ceph-mon[15828]: from='mgr.14100 172.21.15.142:0/1786704636' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T21:45:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:47 smithi142 ceph-mon[15828]: from='mgr.14100 172.21.15.142:0/1786704636' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr metadata", "who": "smithi142.zzmcfz", "id": "smithi142.zzmcfz"}]: dispatch 2024-04-20T21:45:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:47 smithi142 ceph-mon[15828]: Manager daemon smithi142.zzmcfz is now available 2024-04-20T21:45:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:47 smithi142 ceph-mon[15828]: from='mgr.14100 172.21.15.142:0/1786704636' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.zzmcfz/mirror_snapshot_schedule"}]: dispatch 2024-04-20T21:45:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:47 smithi142 ceph-mon[15828]: from='mgr.14100 172.21.15.142:0/1786704636' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:45:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:47 smithi142 ceph-mon[15828]: from='mgr.14100 172.21.15.142:0/1786704636' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.zzmcfz/trash_purge_schedule"}]: dispatch 2024-04-20T21:45:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:47 smithi142 ceph-mon[15828]: from='mgr.14100 172.21.15.142:0/1786704636' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:45:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:47 smithi142 ceph-mon[15828]: from='mgr.14100 172.21.15.142:0/1786704636' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:45:49.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:49 smithi142 ceph-mon[15828]: mgrmap e3: smithi142.zzmcfz(active, since 1.0207s) 2024-04-20T21:45:50.394 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:50 smithi142 ceph-mon[15828]: mgrmap e4: smithi142.zzmcfz(active, since 2s) 2024-04-20T21:45:50.394 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:50 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2063748173' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-20T21:45:50.406 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2024-04-20T21:45:50.406 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout { 2024-04-20T21:45:50.406 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "fsid": "270cccba-ff5f-11ee-bc93-c7b262605968", 2024-04-20T21:45:50.406 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "health": { 2024-04-20T21:45:50.406 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-20T21:45:50.406 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-20T21:45:50.406 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-20T21:45:50.406 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:50.406 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-20T21:45:50.407 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-20T21:45:50.407 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 0 2024-04-20T21:45:50.407 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2024-04-20T21:45:50.407 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-20T21:45:50.407 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "smithi142" 2024-04-20T21:45:50.407 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2024-04-20T21:45:50.407 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-04-20T21:45:50.407 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-20T21:45:50.407 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T21:45:50.407 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-04-20T21:45:50.407 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-20T21:45:50.407 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:50.407 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-20T21:45:50.407 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T21:45:50.407 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-20T21:45:50.407 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-20T21:45:50.408 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-20T21:45:50.417 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-20T21:45:50.417 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-20T21:45:50.417 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-20T21:45:50.417 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:50.417 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-20T21:45:50.417 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-20T21:45:50.417 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-20T21:45:50.417 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-20T21:45:50.417 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-20T21:45:50.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-20T21:45:50.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-20T21:45:50.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-20T21:45:50.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-20T21:45:50.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:50.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-20T21:45:50.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T21:45:50.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-20T21:45:50.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-20T21:45:50.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:50.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-20T21:45:50.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-20T21:45:50.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-20T21:45:50.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-20T21:45:50.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-20T21:45:50.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-20T21:45:50.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "restful" 2024-04-20T21:45:50.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2024-04-20T21:45:50.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-20T21:45:50.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:50.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-20T21:45:50.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T21:45:50.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "modified": "2024-04-20T21:45:27.214173+0000", 2024-04-20T21:45:50.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-20T21:45:50.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2024-04-20T21:45:50.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-20T21:45:50.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout } 2024-04-20T21:45:50.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.150+0000 7f56c5200700 1 Processor -- start 2024-04-20T21:45:50.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.151+0000 7f56c5200700 1 -- start start 2024-04-20T21:45:50.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.151+0000 7f56c5200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c010d080 0x7f56c010d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:50.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.151+0000 7f56c5200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c010da70 con 0x7f56c010d080 2024-04-20T21:45:50.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.151+0000 7f56bde00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c010d080 0x7f56c010d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:50.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.152+0000 7f56bde00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c010d080 0x7f56c010d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58952/0 (socket says 172.21.15.142:58952) 2024-04-20T21:45:50.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.152+0000 7f56bde00700 1 -- 172.21.15.142:0/3908732236 learned_addr learned my addr 172.21.15.142:0/3908732236 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:50.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.152+0000 7f56bde00700 1 -- 172.21.15.142:0/3908732236 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c010de00 con 0x7f56c010d080 2024-04-20T21:45:50.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.152+0000 7f56bde00700 1 --2- 172.21.15.142:0/3908732236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c010d080 0x7f56c010d4a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f56b00098a0 tx=0x7f56b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0d2dd0ee42987c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:50.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.153+0000 7f56bca00700 1 -- 172.21.15.142:0/3908732236 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56b0004180 con 0x7f56c010d080 2024-04-20T21:45:50.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.153+0000 7f56bca00700 1 -- 172.21.15.142:0/3908732236 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f56b00042e0 con 0x7f56c010d080 2024-04-20T21:45:50.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.153+0000 7f56bca00700 1 -- 172.21.15.142:0/3908732236 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56b0011a70 con 0x7f56c010d080 2024-04-20T21:45:50.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.153+0000 7f56c5200700 1 -- 172.21.15.142:0/3908732236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c010d080 msgr2=0x7f56c010d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:50.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.153+0000 7f56c5200700 1 --2- 172.21.15.142:0/3908732236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c010d080 0x7f56c010d4a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f56b00098a0 tx=0x7f56b0009bb0 comp rx=0 tx=0).stop 2024-04-20T21:45:50.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.154+0000 7f56c5200700 1 -- 172.21.15.142:0/3908732236 shutdown_connections 2024-04-20T21:45:50.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.154+0000 7f56c5200700 1 --2- 172.21.15.142:0/3908732236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c010d080 0x7f56c010d4a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:50.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.154+0000 7f56c5200700 1 -- 172.21.15.142:0/3908732236 >> 172.21.15.142:0/3908732236 conn(0x7f56c007bbf0 msgr2=0x7f56c007e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:50.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.154+0000 7f56c5200700 1 -- 172.21.15.142:0/3908732236 shutdown_connections 2024-04-20T21:45:50.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.154+0000 7f56c5200700 1 -- 172.21.15.142:0/3908732236 wait complete. 2024-04-20T21:45:50.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.155+0000 7f56c5200700 1 Processor -- start 2024-04-20T21:45:50.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.155+0000 7f56c5200700 1 -- start start 2024-04-20T21:45:50.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.155+0000 7f56c5200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c010d080 0x7f56c01a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:50.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.155+0000 7f56c5200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c01a0e50 con 0x7f56c010d080 2024-04-20T21:45:50.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.156+0000 7f56bde00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c010d080 0x7f56c01a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:50.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.156+0000 7f56bde00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c010d080 0x7f56c01a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58958/0 (socket says 172.21.15.142:58958) 2024-04-20T21:45:50.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.156+0000 7f56bde00700 1 -- 172.21.15.142:0/2063748173 learned_addr learned my addr 172.21.15.142:0/2063748173 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:50.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.156+0000 7f56bde00700 1 -- 172.21.15.142:0/2063748173 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b0009550 con 0x7f56c010d080 2024-04-20T21:45:50.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.156+0000 7f56bde00700 1 --2- 172.21.15.142:0/2063748173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c010d080 0x7f56c01a0910 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f56b0011710 tx=0x7f56b00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:50.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.156+0000 7f56b6a00700 1 -- 172.21.15.142:0/2063748173 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56b0003b10 con 0x7f56c010d080 2024-04-20T21:45:50.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.157+0000 7f56b6a00700 1 -- 172.21.15.142:0/2063748173 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f56b001b8c0 con 0x7f56c010d080 2024-04-20T21:45:50.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.157+0000 7f56b6a00700 1 -- 172.21.15.142:0/2063748173 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56b0019770 con 0x7f56c010d080 2024-04-20T21:45:50.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.157+0000 7f56c5200700 1 -- 172.21.15.142:0/2063748173 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c01a1050 con 0x7f56c010d080 2024-04-20T21:45:50.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.157+0000 7f56c5200700 1 -- 172.21.15.142:0/2063748173 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c01a14f0 con 0x7f56c010d080 2024-04-20T21:45:50.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.158+0000 7f56b6a00700 1 -- 172.21.15.142:0/2063748173 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 3) v1 ==== 45439+0+0 (secure 0 0 0) 0x7f56b001b440 con 0x7f56c010d080 2024-04-20T21:45:50.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.158+0000 7f56c5200700 1 -- 172.21.15.142:0/2063748173 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c0111030 con 0x7f56c010d080 2024-04-20T21:45:50.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.158+0000 7f56b6a00700 1 --2- 172.21.15.142:0/2063748173 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f56a4038600 0x7f56a403aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:50.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.158+0000 7f56b6a00700 1 -- 172.21.15.142:0/2063748173 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f56b004c680 con 0x7f56c010d080 2024-04-20T21:45:50.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.158+0000 7f56bd400700 1 --2- 172.21.15.142:0/2063748173 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f56a4038600 0x7f56a403aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:50.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.159+0000 7f56bd400700 1 --2- 172.21.15.142:0/2063748173 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f56a4038600 0x7f56a403aac0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f56ac006fd0 tx=0x7f56ac006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:50.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.164+0000 7f56b6a00700 1 -- 172.21.15.142:0/2063748173 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f56b001b6f0 con 0x7f56c010d080 2024-04-20T21:45:50.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.168+0000 7f56b6a00700 1 -- 172.21.15.142:0/2063748173 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7f56b0019d20 con 0x7f56c010d080 2024-04-20T21:45:50.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.464+0000 7f56c5200700 1 -- 172.21.15.142:0/2063748173 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f56c01a3d80 con 0x7f56c010d080 2024-04-20T21:45:50.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.465+0000 7f56b6a00700 1 -- 172.21.15.142:0/2063748173 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f56b001f090 con 0x7f56c010d080 2024-04-20T21:45:50.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.468+0000 7f56c5200700 1 -- 172.21.15.142:0/2063748173 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f56a4038600 msgr2=0x7f56a403aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:50.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.468+0000 7f56c5200700 1 --2- 172.21.15.142:0/2063748173 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f56a4038600 0x7f56a403aac0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f56ac006fd0 tx=0x7f56ac006e40 comp rx=0 tx=0).stop 2024-04-20T21:45:50.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.468+0000 7f56c5200700 1 -- 172.21.15.142:0/2063748173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c010d080 msgr2=0x7f56c01a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:50.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.468+0000 7f56c5200700 1 --2- 172.21.15.142:0/2063748173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c010d080 0x7f56c01a0910 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f56b0011710 tx=0x7f56b00047c0 comp rx=0 tx=0).stop 2024-04-20T21:45:50.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.468+0000 7f56c5200700 1 -- 172.21.15.142:0/2063748173 shutdown_connections 2024-04-20T21:45:50.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.468+0000 7f56c5200700 1 --2- 172.21.15.142:0/2063748173 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f56a4038600 0x7f56a403aac0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:50.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.468+0000 7f56c5200700 1 --2- 172.21.15.142:0/2063748173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56c010d080 0x7f56c01a0910 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:50.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.468+0000 7f56c5200700 1 -- 172.21.15.142:0/2063748173 >> 172.21.15.142:0/2063748173 conn(0x7f56c007bbf0 msgr2=0x7f56c007c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:50.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.468+0000 7f56c5200700 1 -- 172.21.15.142:0/2063748173 shutdown_connections 2024-04-20T21:45:50.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:49.468+0000 7f56c5200700 1 -- 172.21.15.142:0/2063748173 wait complete. 2024-04-20T21:45:50.423 INFO:teuthology.orchestra.run.smithi142.stdout:mgr is available 2024-04-20T21:45:51.571 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:51 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1490185162' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-20T21:45:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2024-04-20T21:45:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout [global] 2024-04-20T21:45:51.910 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout fsid = 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T21:45:51.911 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-20T21:45:51.911 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-20T21:45:51.918 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-20T21:45:51.918 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-20T21:45:51.918 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2024-04-20T21:45:51.918 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-20T21:45:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-20T21:45:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2024-04-20T21:45:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout [osd] 2024-04-20T21:45:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-20T21:45:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-20T21:45:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-20T21:45:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-20T21:45:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-20T21:45:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.971+0000 7f8079e00700 1 Processor -- start 2024-04-20T21:45:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.971+0000 7f8079e00700 1 -- start start 2024-04-20T21:45:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.972+0000 7f8079e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8074108800 0x7f8074108c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.972+0000 7f8079e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80741091f0 con 0x7f8074108800 2024-04-20T21:45:51.919 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.972+0000 7f8072a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8074108800 0x7f8074108c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.972+0000 7f8072a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8074108800 0x7f8074108c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58968/0 (socket says 172.21.15.142:58968) 2024-04-20T21:45:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.972+0000 7f8072a00700 1 -- 172.21.15.142:0/2598550319 learned_addr learned my addr 172.21.15.142:0/2598550319 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.973+0000 7f8072a00700 1 -- 172.21.15.142:0/2598550319 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80741099b0 con 0x7f8074108800 2024-04-20T21:45:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.973+0000 7f8072a00700 1 --2- 172.21.15.142:0/2598550319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8074108800 0x7f8074108c20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8064009e80 tx=0x7f806400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3e878aa76fc14b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.973+0000 7f8072000700 1 -- 172.21.15.142:0/2598550319 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f806400e070 con 0x7f8074108800 2024-04-20T21:45:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.973+0000 7f8072000700 1 -- 172.21.15.142:0/2598550319 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f806400b8c0 con 0x7f8074108800 2024-04-20T21:45:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.973+0000 7f8072000700 1 -- 172.21.15.142:0/2598550319 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8064004440 con 0x7f8074108800 2024-04-20T21:45:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.974+0000 7f8079e00700 1 -- 172.21.15.142:0/2598550319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8074108800 msgr2=0x7f8074108c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.974+0000 7f8079e00700 1 --2- 172.21.15.142:0/2598550319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8074108800 0x7f8074108c20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8064009e80 tx=0x7f806400b330 comp rx=0 tx=0).stop 2024-04-20T21:45:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.974+0000 7f8079e00700 1 -- 172.21.15.142:0/2598550319 shutdown_connections 2024-04-20T21:45:51.920 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.974+0000 7f8079e00700 1 --2- 172.21.15.142:0/2598550319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8074108800 0x7f8074108c20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.974+0000 7f8079e00700 1 -- 172.21.15.142:0/2598550319 >> 172.21.15.142:0/2598550319 conn(0x7f8074103dc0 msgr2=0x7f80741061e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.974+0000 7f8079e00700 1 -- 172.21.15.142:0/2598550319 shutdown_connections 2024-04-20T21:45:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.974+0000 7f8079e00700 1 -- 172.21.15.142:0/2598550319 wait complete. 2024-04-20T21:45:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.975+0000 7f8079e00700 1 Processor -- start 2024-04-20T21:45:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.975+0000 7f8079e00700 1 -- start start 2024-04-20T21:45:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.975+0000 7f8079e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8074108800 0x7f807419c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.976+0000 7f8079e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807419c9e0 con 0x7f8074108800 2024-04-20T21:45:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.976+0000 7f8072a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8074108800 0x7f807419c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.976+0000 7f8072a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8074108800 0x7f807419c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58984/0 (socket says 172.21.15.142:58984) 2024-04-20T21:45:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.976+0000 7f8072a00700 1 -- 172.21.15.142:0/1490185162 learned_addr learned my addr 172.21.15.142:0/1490185162 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.976+0000 7f8072a00700 1 -- 172.21.15.142:0/1490185162 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8064009b30 con 0x7f8074108800 2024-04-20T21:45:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.976+0000 7f8072a00700 1 --2- 172.21.15.142:0/1490185162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8074108800 0x7f807419c4a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f80640099e0 tx=0x7f8064003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:51.921 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.977+0000 7f8078a00700 1 -- 172.21.15.142:0/1490185162 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f806400e040 con 0x7f8074108800 2024-04-20T21:45:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.977+0000 7f8078a00700 1 -- 172.21.15.142:0/1490185162 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f806400bc40 con 0x7f8074108800 2024-04-20T21:45:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.977+0000 7f8078a00700 1 -- 172.21.15.142:0/1490185162 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80640125e0 con 0x7f8074108800 2024-04-20T21:45:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.977+0000 7f8079e00700 1 -- 172.21.15.142:0/1490185162 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807419cbe0 con 0x7f8074108800 2024-04-20T21:45:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.977+0000 7f8079e00700 1 -- 172.21.15.142:0/1490185162 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807419d0e0 con 0x7f8074108800 2024-04-20T21:45:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.978+0000 7f8078a00700 1 -- 172.21.15.142:0/1490185162 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7f8064019040 con 0x7f8074108800 2024-04-20T21:45:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.978+0000 7f8079e00700 1 -- 172.21.15.142:0/1490185162 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807410cbe0 con 0x7f8074108800 2024-04-20T21:45:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.978+0000 7f8078a00700 1 --2- 172.21.15.142:0/1490185162 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f80580386b0 0x7f805803ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.979+0000 7f8078a00700 1 -- 172.21.15.142:0/1490185162 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f806404bd10 con 0x7f8074108800 2024-04-20T21:45:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.979+0000 7f806a000700 1 --2- 172.21.15.142:0/1490185162 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f80580386b0 0x7f805803ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.979+0000 7f806a000700 1 --2- 172.21.15.142:0/1490185162 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f80580386b0 0x7f805803ab70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f805c006fd0 tx=0x7f805c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:50.984+0000 7f8078a00700 1 -- 172.21.15.142:0/1490185162 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f8064051020 con 0x7f8074108800 2024-04-20T21:45:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:51.201+0000 7f8079e00700 1 -- 172.21.15.142:0/1490185162 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f807419f910 con 0x7f8074108800 2024-04-20T21:45:51.922 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:51.203+0000 7f8078a00700 1 -- 172.21.15.142:0/1490185162 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f806401f020 con 0x7f8074108800 2024-04-20T21:45:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:51.206+0000 7f8079e00700 1 -- 172.21.15.142:0/1490185162 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f80580386b0 msgr2=0x7f805803ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:51.206+0000 7f8079e00700 1 --2- 172.21.15.142:0/1490185162 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f80580386b0 0x7f805803ab70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f805c006fd0 tx=0x7f805c006e40 comp rx=0 tx=0).stop 2024-04-20T21:45:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:51.206+0000 7f8079e00700 1 -- 172.21.15.142:0/1490185162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8074108800 msgr2=0x7f807419c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:51.206+0000 7f8079e00700 1 --2- 172.21.15.142:0/1490185162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8074108800 0x7f807419c4a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f80640099e0 tx=0x7f8064003d00 comp rx=0 tx=0).stop 2024-04-20T21:45:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:51.206+0000 7f8079e00700 1 -- 172.21.15.142:0/1490185162 shutdown_connections 2024-04-20T21:45:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:51.206+0000 7f8079e00700 1 --2- 172.21.15.142:0/1490185162 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f80580386b0 0x7f805803ab70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:51.206+0000 7f8079e00700 1 --2- 172.21.15.142:0/1490185162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8074108800 0x7f807419c4a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:51.206+0000 7f8079e00700 1 -- 172.21.15.142:0/1490185162 >> 172.21.15.142:0/1490185162 conn(0x7f8074103dc0 msgr2=0x7f8074104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:51.206+0000 7f8079e00700 1 -- 172.21.15.142:0/1490185162 shutdown_connections 2024-04-20T21:45:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:51.206+0000 7f8079e00700 1 -- 172.21.15.142:0/1490185162 wait complete. 2024-04-20T21:45:51.923 INFO:teuthology.orchestra.run.smithi142.stdout:Enabling cephadm module... 2024-04-20T21:45:53.083 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:52 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2747214154' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-20T21:45:53.470 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.466+0000 7f36d5c00700 1 Processor -- start 2024-04-20T21:45:53.470 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.467+0000 7f36d5c00700 1 -- start start 2024-04-20T21:45:53.470 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.467+0000 7f36d5c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d010d130 0x7f36d010d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:53.470 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.467+0000 7f36d5c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d010db20 con 0x7f36d010d130 2024-04-20T21:45:53.470 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.468+0000 7f36cea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d010d130 0x7f36d010d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:53.471 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.468+0000 7f36cea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d010d130 0x7f36d010d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58998/0 (socket says 172.21.15.142:58998) 2024-04-20T21:45:53.471 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.468+0000 7f36cea00700 1 -- 172.21.15.142:0/42106552 learned_addr learned my addr 172.21.15.142:0/42106552 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:53.471 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.468+0000 7f36cea00700 1 -- 172.21.15.142:0/42106552 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d010dda0 con 0x7f36d010d130 2024-04-20T21:45:53.471 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.468+0000 7f36cea00700 1 --2- 172.21.15.142:0/42106552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d010d130 0x7f36d010d550 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f36c00098a0 tx=0x7f36c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be1d5603f787e0f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:53.471 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.468+0000 7f36ce000700 1 -- 172.21.15.142:0/42106552 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f36c0004180 con 0x7f36d010d130 2024-04-20T21:45:53.471 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.469+0000 7f36ce000700 1 -- 172.21.15.142:0/42106552 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f36c00042e0 con 0x7f36d010d130 2024-04-20T21:45:53.471 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.469+0000 7f36ce000700 1 -- 172.21.15.142:0/42106552 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f36c0011a70 con 0x7f36d010d130 2024-04-20T21:45:53.471 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.469+0000 7f36d5c00700 1 -- 172.21.15.142:0/42106552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d010d130 msgr2=0x7f36d010d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:53.471 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.469+0000 7f36d5c00700 1 --2- 172.21.15.142:0/42106552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d010d130 0x7f36d010d550 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f36c00098a0 tx=0x7f36c0009bb0 comp rx=0 tx=0).stop 2024-04-20T21:45:53.471 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.469+0000 7f36d5c00700 1 -- 172.21.15.142:0/42106552 shutdown_connections 2024-04-20T21:45:53.471 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.469+0000 7f36d5c00700 1 --2- 172.21.15.142:0/42106552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d010d130 0x7f36d010d550 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:53.471 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.469+0000 7f36d5c00700 1 -- 172.21.15.142:0/42106552 >> 172.21.15.142:0/42106552 conn(0x7f36d007bbf0 msgr2=0x7f36d007e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:53.472 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.470+0000 7f36d5c00700 1 -- 172.21.15.142:0/42106552 shutdown_connections 2024-04-20T21:45:53.472 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.470+0000 7f36d5c00700 1 -- 172.21.15.142:0/42106552 wait complete. 2024-04-20T21:45:53.472 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.470+0000 7f36d5c00700 1 Processor -- start 2024-04-20T21:45:53.472 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.471+0000 7f36d5c00700 1 -- start start 2024-04-20T21:45:53.472 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.471+0000 7f36d5c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d010d130 0x7f36d01a08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:53.472 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.471+0000 7f36d5c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d01a0e00 con 0x7f36d010d130 2024-04-20T21:45:53.472 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.471+0000 7f36cea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d010d130 0x7f36d01a08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:53.472 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.471+0000 7f36cea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d010d130 0x7f36d01a08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59004/0 (socket says 172.21.15.142:59004) 2024-04-20T21:45:53.472 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.471+0000 7f36cea00700 1 -- 172.21.15.142:0/2747214154 learned_addr learned my addr 172.21.15.142:0/2747214154 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:53.472 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.472+0000 7f36cea00700 1 -- 172.21.15.142:0/2747214154 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c0009550 con 0x7f36d010d130 2024-04-20T21:45:53.472 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.472+0000 7f36cea00700 1 --2- 172.21.15.142:0/2747214154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d010d130 0x7f36d01a08c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f36c0011710 tx=0x7f36c00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:53.472 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.472+0000 7f36c7400700 1 -- 172.21.15.142:0/2747214154 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f36c0003b10 con 0x7f36d010d130 2024-04-20T21:45:53.472 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.472+0000 7f36c7400700 1 -- 172.21.15.142:0/2747214154 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f36c001b8c0 con 0x7f36d010d130 2024-04-20T21:45:53.472 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.472+0000 7f36d5c00700 1 -- 172.21.15.142:0/2747214154 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d01a1000 con 0x7f36d010d130 2024-04-20T21:45:53.473 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.472+0000 7f36c7400700 1 -- 172.21.15.142:0/2747214154 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f36c0019770 con 0x7f36d010d130 2024-04-20T21:45:53.473 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.472+0000 7f36d5c00700 1 -- 172.21.15.142:0/2747214154 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d01a14a0 con 0x7f36d010d130 2024-04-20T21:45:53.473 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.473+0000 7f36d5c00700 1 -- 172.21.15.142:0/2747214154 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d0110fd0 con 0x7f36d010d130 2024-04-20T21:45:53.473 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.473+0000 7f36c7400700 1 -- 172.21.15.142:0/2747214154 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7f36c001ba30 con 0x7f36d010d130 2024-04-20T21:45:53.473 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.474+0000 7f36c7400700 1 --2- 172.21.15.142:0/2747214154 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f36b40386d0 0x7f36b403ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:53.473 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.474+0000 7f36c7400700 1 -- 172.21.15.142:0/2747214154 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f36c004c890 con 0x7f36d010d130 2024-04-20T21:45:53.473 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.474+0000 7f36c7e00700 1 --2- 172.21.15.142:0/2747214154 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f36b40386d0 0x7f36b403ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:53.473 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.475+0000 7f36c7e00700 1 --2- 172.21.15.142:0/2747214154 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f36b40386d0 0x7f36b403ab90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f36b8006fd0 tx=0x7f36b8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:53.473 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.479+0000 7f36c7400700 1 -- 172.21.15.142:0/2747214154 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f36c002cce0 con 0x7f36d010d130 2024-04-20T21:45:53.473 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.749+0000 7f36d5c00700 1 -- 172.21.15.142:0/2747214154 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f36d01a3d30 con 0x7f36d010d130 2024-04-20T21:45:53.473 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.805+0000 7f36c7400700 1 -- 172.21.15.142:0/2747214154 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f36c001b440 con 0x7f36d010d130 2024-04-20T21:45:53.473 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.808+0000 7f36c7400700 1 -- 172.21.15.142:0/2747214154 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f36c004c2b0 con 0x7f36d010d130 2024-04-20T21:45:53.473 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.811+0000 7f36d5c00700 1 -- 172.21.15.142:0/2747214154 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f36b40386d0 msgr2=0x7f36b403ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:53.473 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.811+0000 7f36d5c00700 1 --2- 172.21.15.142:0/2747214154 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f36b40386d0 0x7f36b403ab90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f36b8006fd0 tx=0x7f36b8006e40 comp rx=0 tx=0).stop 2024-04-20T21:45:53.474 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.811+0000 7f36d5c00700 1 -- 172.21.15.142:0/2747214154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d010d130 msgr2=0x7f36d01a08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:53.474 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.811+0000 7f36d5c00700 1 --2- 172.21.15.142:0/2747214154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d010d130 0x7f36d01a08c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f36c0011710 tx=0x7f36c00047c0 comp rx=0 tx=0).stop 2024-04-20T21:45:53.474 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.811+0000 7f36d5c00700 1 -- 172.21.15.142:0/2747214154 shutdown_connections 2024-04-20T21:45:53.474 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.811+0000 7f36d5c00700 1 --2- 172.21.15.142:0/2747214154 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f36b40386d0 0x7f36b403ab90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:53.474 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.811+0000 7f36d5c00700 1 --2- 172.21.15.142:0/2747214154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36d010d130 0x7f36d01a08c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:53.474 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.811+0000 7f36d5c00700 1 -- 172.21.15.142:0/2747214154 >> 172.21.15.142:0/2747214154 conn(0x7f36d007bbf0 msgr2=0x7f36d007c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:53.474 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.811+0000 7f36d5c00700 1 -- 172.21.15.142:0/2747214154 shutdown_connections 2024-04-20T21:45:53.474 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:52.811+0000 7f36d5c00700 1 -- 172.21.15.142:0/2747214154 wait complete. 2024-04-20T21:45:53.896 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:53 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2747214154' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-20T21:45:53.896 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:53 smithi142 ceph-mon[15828]: mgrmap e5: smithi142.zzmcfz(active, since 5s) 2024-04-20T21:45:55.078 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:45:54 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2429917411' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-20T21:45:55.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout { 2024-04-20T21:45:55.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-20T21:45:55.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-20T21:45:55.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "active_name": "smithi142.zzmcfz", 2024-04-20T21:45:55.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-20T21:45:55.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout } 2024-04-20T21:45:55.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.089+0000 7efdee400700 1 Processor -- start 2024-04-20T21:45:55.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.089+0000 7efdee400700 1 -- start start 2024-04-20T21:45:55.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.090+0000 7efdee400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efde807ad90 0x7efde80791f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:55.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.090+0000 7efdee400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde80797c0 con 0x7efde807ad90 2024-04-20T21:45:55.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.090+0000 7efde7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efde807ad90 0x7efde80791f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:55.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.090+0000 7efde7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efde807ad90 0x7efde80791f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59040/0 (socket says 172.21.15.142:59040) 2024-04-20T21:45:55.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.090+0000 7efde7400700 1 -- 172.21.15.142:0/588317326 learned_addr learned my addr 172.21.15.142:0/588317326 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:55.099 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.091+0000 7efde7400700 1 -- 172.21.15.142:0/588317326 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde8079900 con 0x7efde807ad90 2024-04-20T21:45:55.099 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.091+0000 7efde7400700 1 --2- 172.21.15.142:0/588317326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efde807ad90 0x7efde80791f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efdd80098a0 tx=0x7efdd8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7f27d2c224980e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:55.099 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.091+0000 7efde6000700 1 -- 172.21.15.142:0/588317326 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdd8004180 con 0x7efde807ad90 2024-04-20T21:45:55.099 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.091+0000 7efde6000700 1 -- 172.21.15.142:0/588317326 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7efdd80042e0 con 0x7efde807ad90 2024-04-20T21:45:55.099 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.091+0000 7efde6000700 1 -- 172.21.15.142:0/588317326 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdd8011a70 con 0x7efde807ad90 2024-04-20T21:45:55.099 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.092+0000 7efdee400700 1 -- 172.21.15.142:0/588317326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efde807ad90 msgr2=0x7efde80791f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:55.100 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.092+0000 7efdee400700 1 --2- 172.21.15.142:0/588317326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efde807ad90 0x7efde80791f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efdd80098a0 tx=0x7efdd8009bb0 comp rx=0 tx=0).stop 2024-04-20T21:45:55.100 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.092+0000 7efdee400700 1 -- 172.21.15.142:0/588317326 shutdown_connections 2024-04-20T21:45:55.100 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.092+0000 7efdee400700 1 --2- 172.21.15.142:0/588317326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efde807ad90 0x7efde80791f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:55.100 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.092+0000 7efdee400700 1 -- 172.21.15.142:0/588317326 >> 172.21.15.142:0/588317326 conn(0x7efde8101ba0 msgr2=0x7efde8103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:55.100 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.093+0000 7efdee400700 1 -- 172.21.15.142:0/588317326 shutdown_connections 2024-04-20T21:45:55.100 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.093+0000 7efdee400700 1 -- 172.21.15.142:0/588317326 wait complete. 2024-04-20T21:45:55.100 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.094+0000 7efdee400700 1 Processor -- start 2024-04-20T21:45:55.101 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.094+0000 7efdee400700 1 -- start start 2024-04-20T21:45:55.101 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.094+0000 7efdee400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efde807ad90 0x7efde819c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:55.101 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.094+0000 7efdee400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde819ca90 con 0x7efde807ad90 2024-04-20T21:45:55.101 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.094+0000 7efde7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efde807ad90 0x7efde819c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:45:55.101 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.094+0000 7efde7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efde807ad90 0x7efde819c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59042/0 (socket says 172.21.15.142:59042) 2024-04-20T21:45:55.102 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.095+0000 7efde7400700 1 -- 172.21.15.142:0/2429917411 learned_addr learned my addr 172.21.15.142:0/2429917411 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:45:55.102 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.095+0000 7efde7400700 1 -- 172.21.15.142:0/2429917411 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd8009550 con 0x7efde807ad90 2024-04-20T21:45:55.102 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.095+0000 7efde7400700 1 --2- 172.21.15.142:0/2429917411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efde807ad90 0x7efde819c550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efdd8006af0 tx=0x7efdd80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:45:55.102 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.095+0000 7efddfe00700 1 -- 172.21.15.142:0/2429917411 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdd8003a00 con 0x7efde807ad90 2024-04-20T21:45:55.102 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.095+0000 7efddfe00700 1 -- 172.21.15.142:0/2429917411 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7efdd8003b60 con 0x7efde807ad90 2024-04-20T21:45:55.103 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.095+0000 7efdee400700 1 -- 172.21.15.142:0/2429917411 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde819cc90 con 0x7efde807ad90 2024-04-20T21:45:55.103 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.095+0000 7efddfe00700 1 -- 172.21.15.142:0/2429917411 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efdd8023750 con 0x7efde807ad90 2024-04-20T21:45:55.103 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.096+0000 7efdee400700 1 -- 172.21.15.142:0/2429917411 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde819d130 con 0x7efde807ad90 2024-04-20T21:45:55.103 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.097+0000 7efdee400700 1 -- 172.21.15.142:0/2429917411 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde810c920 con 0x7efde807ad90 2024-04-20T21:45:55.103 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.097+0000 7efddfe00700 1 -- 172.21.15.142:0/2429917411 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7efdd80239d0 con 0x7efde807ad90 2024-04-20T21:45:55.104 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.098+0000 7efddfe00700 1 --2- 172.21.15.142:0/2429917411 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7efdcc038720 0x7efdcc03abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:45:55.104 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.098+0000 7efddfe00700 1 -- 172.21.15.142:0/2429917411 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efdd804ca80 con 0x7efde807ad90 2024-04-20T21:45:55.104 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.098+0000 7efde6a00700 1 -- 172.21.15.142:0/2429917411 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7efdcc038720 msgr2=0x7efdcc03abe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/2803679129 2024-04-20T21:45:55.104 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.098+0000 7efde6a00700 1 --2- 172.21.15.142:0/2429917411 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7efdcc038720 0x7efdcc03abe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T21:45:55.104 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.103+0000 7efddfe00700 1 -- 172.21.15.142:0/2429917411 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7efdd802b760 con 0x7efde807ad90 2024-04-20T21:45:55.104 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.299+0000 7efde6a00700 1 -- 172.21.15.142:0/2429917411 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7efdcc038720 msgr2=0x7efdcc03abe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/2803679129 2024-04-20T21:45:55.104 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.299+0000 7efde6a00700 1 --2- 172.21.15.142:0/2429917411 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7efdcc038720 0x7efdcc03abe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-20T21:45:55.104 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.385+0000 7efdee400700 1 -- 172.21.15.142:0/2429917411 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7efde819f9c0 con 0x7efde807ad90 2024-04-20T21:45:55.104 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.386+0000 7efddfe00700 1 -- 172.21.15.142:0/2429917411 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7efdd800b3e0 con 0x7efde807ad90 2024-04-20T21:45:55.104 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.389+0000 7efdee400700 1 -- 172.21.15.142:0/2429917411 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7efdcc038720 msgr2=0x7efdcc03abe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T21:45:55.104 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.389+0000 7efdee400700 1 --2- 172.21.15.142:0/2429917411 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7efdcc038720 0x7efdcc03abe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:55.104 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.389+0000 7efdee400700 1 -- 172.21.15.142:0/2429917411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efde807ad90 msgr2=0x7efde819c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:45:55.104 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.389+0000 7efdee400700 1 --2- 172.21.15.142:0/2429917411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efde807ad90 0x7efde819c550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efdd8006af0 tx=0x7efdd80047c0 comp rx=0 tx=0).stop 2024-04-20T21:45:55.105 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.389+0000 7efdee400700 1 -- 172.21.15.142:0/2429917411 shutdown_connections 2024-04-20T21:45:55.105 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.389+0000 7efdee400700 1 --2- 172.21.15.142:0/2429917411 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7efdcc038720 0x7efdcc03abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:55.105 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.389+0000 7efdee400700 1 --2- 172.21.15.142:0/2429917411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efde807ad90 0x7efde819c550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:45:55.105 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.389+0000 7efdee400700 1 -- 172.21.15.142:0/2429917411 >> 172.21.15.142:0/2429917411 conn(0x7efde8101ba0 msgr2=0x7efde81027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:45:55.105 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.390+0000 7efdee400700 1 -- 172.21.15.142:0/2429917411 shutdown_connections 2024-04-20T21:45:55.105 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:54.390+0000 7efdee400700 1 -- 172.21.15.142:0/2429917411 wait complete. 2024-04-20T21:45:55.105 INFO:teuthology.orchestra.run.smithi142.stdout:Waiting for the mgr to restart... 2024-04-20T21:45:55.105 INFO:teuthology.orchestra.run.smithi142.stdout:Waiting for mgr epoch 5... 2024-04-20T21:46:01.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:01 smithi142 ceph-mon[15828]: Active manager daemon smithi142.zzmcfz restarted 2024-04-20T21:46:01.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:01 smithi142 ceph-mon[15828]: Activating manager daemon smithi142.zzmcfz 2024-04-20T21:46:01.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:01 smithi142 ceph-mon[15828]: osdmap e2: 0 total, 0 up, 0 in 2024-04-20T21:46:01.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:01 smithi142 ceph-mon[15828]: mgrmap e6: smithi142.zzmcfz(active, starting, since 0.00699864s) 2024-04-20T21:46:01.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:01 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T21:46:01.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:01 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr metadata", "who": "smithi142.zzmcfz", "id": "smithi142.zzmcfz"}]: dispatch 2024-04-20T21:46:01.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:01 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-20T21:46:01.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:01 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-20T21:46:01.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:01 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-20T21:46:01.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:01 smithi142 ceph-mon[15828]: Manager daemon smithi142.zzmcfz is now available 2024-04-20T21:46:01.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:01 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:01.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:01 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:02.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:02 smithi142 ceph-mon[15828]: Found migration_current of "None". Setting to last migration. 2024-04-20T21:46:02.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:02 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:46:02.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:02 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:46:02.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:02 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.zzmcfz/mirror_snapshot_schedule"}]: dispatch 2024-04-20T21:46:02.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:02 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.zzmcfz/trash_purge_schedule"}]: dispatch 2024-04-20T21:46:02.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:02 smithi142 ceph-mon[15828]: mgrmap e7: smithi142.zzmcfz(active, since 1.01331s) 2024-04-20T21:46:03.411 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout { 2024-04-20T21:46:03.411 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-20T21:46:03.411 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-20T21:46:03.411 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout } 2024-04-20T21:46:03.411 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.702+0000 7f8132200700 1 Processor -- start 2024-04-20T21:46:03.411 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.702+0000 7f8132200700 1 -- start start 2024-04-20T21:46:03.411 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.702+0000 7f8132200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f812c1065a0 0x7f812c1069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:03.411 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.702+0000 7f8132200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c106f90 con 0x7f812c1065a0 2024-04-20T21:46:03.411 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.703+0000 7f812b400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f812c1065a0 0x7f812c1069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:03.411 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.703+0000 7f812b400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f812c1065a0 0x7f812c1069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59044/0 (socket says 172.21.15.142:59044) 2024-04-20T21:46:03.412 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.703+0000 7f812b400700 1 -- 172.21.15.142:0/2104983576 learned_addr learned my addr 172.21.15.142:0/2104983576 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:03.412 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.703+0000 7f812b400700 1 -- 172.21.15.142:0/2104983576 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c1077a0 con 0x7f812c1065a0 2024-04-20T21:46:03.412 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.703+0000 7f812b400700 1 --2- 172.21.15.142:0/2104983576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f812c1065a0 0x7f812c1069c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f811c0098a0 tx=0x7f811c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd986565ca28a81 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:03.412 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.704+0000 7f812a000700 1 -- 172.21.15.142:0/2104983576 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f811c004180 con 0x7f812c1065a0 2024-04-20T21:46:03.412 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.704+0000 7f812a000700 1 -- 172.21.15.142:0/2104983576 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f811c0042e0 con 0x7f812c1065a0 2024-04-20T21:46:03.412 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.704+0000 7f812a000700 1 -- 172.21.15.142:0/2104983576 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f811c011a70 con 0x7f812c1065a0 2024-04-20T21:46:03.412 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.704+0000 7f8132200700 1 -- 172.21.15.142:0/2104983576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f812c1065a0 msgr2=0x7f812c1069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:03.412 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.704+0000 7f8132200700 1 --2- 172.21.15.142:0/2104983576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f812c1065a0 0x7f812c1069c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f811c0098a0 tx=0x7f811c009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:03.412 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.704+0000 7f8132200700 1 -- 172.21.15.142:0/2104983576 shutdown_connections 2024-04-20T21:46:03.412 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.704+0000 7f8132200700 1 --2- 172.21.15.142:0/2104983576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f812c1065a0 0x7f812c1069c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:03.412 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.704+0000 7f8132200700 1 -- 172.21.15.142:0/2104983576 >> 172.21.15.142:0/2104983576 conn(0x7f812c101ba0 msgr2=0x7f812c103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:03.412 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.705+0000 7f8132200700 1 -- 172.21.15.142:0/2104983576 shutdown_connections 2024-04-20T21:46:03.412 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.705+0000 7f8132200700 1 -- 172.21.15.142:0/2104983576 wait complete. 2024-04-20T21:46:03.413 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.706+0000 7f8132200700 1 Processor -- start 2024-04-20T21:46:03.413 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.706+0000 7f8132200700 1 -- start start 2024-04-20T21:46:03.413 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.707+0000 7f8132200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f812c1065a0 0x7f812c07aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:03.413 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.707+0000 7f8132200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c07af70 con 0x7f812c1065a0 2024-04-20T21:46:03.413 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.707+0000 7f812b400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f812c1065a0 0x7f812c07aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:03.413 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.707+0000 7f812b400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f812c1065a0 0x7f812c07aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59060/0 (socket says 172.21.15.142:59060) 2024-04-20T21:46:03.413 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.707+0000 7f812b400700 1 -- 172.21.15.142:0/1770929657 learned_addr learned my addr 172.21.15.142:0/1770929657 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:03.413 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.707+0000 7f812b400700 1 -- 172.21.15.142:0/1770929657 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c009550 con 0x7f812c1065a0 2024-04-20T21:46:03.413 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.707+0000 7f812b400700 1 --2- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f812c1065a0 0x7f812c07aa30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f811c006af0 tx=0x7f811c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:03.413 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.708+0000 7f8123e00700 1 -- 172.21.15.142:0/1770929657 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f811c003a00 con 0x7f812c1065a0 2024-04-20T21:46:03.413 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.708+0000 7f8123e00700 1 -- 172.21.15.142:0/1770929657 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f811c003b60 con 0x7f812c1065a0 2024-04-20T21:46:03.413 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.708+0000 7f8132200700 1 -- 172.21.15.142:0/1770929657 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812c0791b0 con 0x7f812c1065a0 2024-04-20T21:46:03.413 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.708+0000 7f8123e00700 1 -- 172.21.15.142:0/1770929657 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f811c023750 con 0x7f812c1065a0 2024-04-20T21:46:03.413 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.708+0000 7f8132200700 1 -- 172.21.15.142:0/1770929657 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812c079650 con 0x7f812c1065a0 2024-04-20T21:46:03.414 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.709+0000 7f8123e00700 1 -- 172.21.15.142:0/1770929657 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f811c023940 con 0x7f812c1065a0 2024-04-20T21:46:03.414 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.710+0000 7f8123e00700 1 --2- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f8110038770 0x7f811003ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:03.414 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.710+0000 7f8123e00700 1 -- 172.21.15.142:0/1770929657 --> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f811003b340 con 0x7f8110038770 2024-04-20T21:46:03.414 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.710+0000 7f8123e00700 1 -- 172.21.15.142:0/1770929657 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f811c04c970 con 0x7f812c1065a0 2024-04-20T21:46:03.414 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.710+0000 7f812aa00700 1 -- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f8110038770 msgr2=0x7f811003ac30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/2803679129 2024-04-20T21:46:03.414 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.710+0000 7f812aa00700 1 --2- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f8110038770 0x7f811003ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T21:46:03.414 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.911+0000 7f812aa00700 1 -- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f8110038770 msgr2=0x7f811003ac30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/2803679129 2024-04-20T21:46:03.414 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:55.911+0000 7f812aa00700 1 --2- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f8110038770 0x7f811003ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-20T21:46:03.414 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:56.312+0000 7f812aa00700 1 -- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f8110038770 msgr2=0x7f811003ac30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/2803679129 2024-04-20T21:46:03.414 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:56.312+0000 7f812aa00700 1 --2- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f8110038770 0x7f811003ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-20T21:46:03.414 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:57.113+0000 7f812aa00700 1 -- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f8110038770 msgr2=0x7f811003ac30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/2803679129 2024-04-20T21:46:03.414 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:57.113+0000 7f812aa00700 1 --2- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f8110038770 0x7f811003ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-20T21:46:03.414 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:58.716+0000 7f812aa00700 1 -- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f8110038770 msgr2=0x7f811003ac30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/2803679129 2024-04-20T21:46:03.415 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:45:58.716+0000 7f812aa00700 1 --2- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f8110038770 0x7f811003ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-20T21:46:03.415 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:01.685+0000 7f8123e00700 1 -- 172.21.15.142:0/1770929657 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mgrmap(e 6) v1 ==== 45323+0+0 (secure 0 0 0) 0x7f811c023bf0 con 0x7f812c1065a0 2024-04-20T21:46:03.415 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:01.685+0000 7f8123e00700 1 -- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f8110038770 msgr2=0x7f811003ac30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T21:46:03.415 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:01.685+0000 7f8123e00700 1 --2- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f8110038770 0x7f811003ac30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:03.415 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:02.687+0000 7f8123e00700 1 -- 172.21.15.142:0/1770929657 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mgrmap(e 7) v1 ==== 45450+0+0 (secure 0 0 0) 0x7f811c04eaa0 con 0x7f812c1065a0 2024-04-20T21:46:03.415 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:02.687+0000 7f8123e00700 1 --2- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f811003bfb0 0x7f811003e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:03.415 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:02.687+0000 7f8123e00700 1 -- 172.21.15.142:0/1770929657 --> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f811003b340 con 0x7f811003bfb0 2024-04-20T21:46:03.415 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:02.690+0000 7f812aa00700 1 --2- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f811003bfb0 0x7f811003e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:03.415 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:02.695+0000 7f812aa00700 1 --2- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f811003bfb0 0x7f811003e3a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8118003a10 tx=0x7f81180092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:03.415 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:02.696+0000 7f8123e00700 1 -- 172.21.15.142:0/1770929657 <== mgr.14120 v2:172.21.15.142:6800/550675874 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f811003b340 con 0x7f811003bfb0 2024-04-20T21:46:03.415 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:02.703+0000 7f8132200700 1 -- 172.21.15.142:0/1770929657 --> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f812c1085c0 con 0x7f811003bfb0 2024-04-20T21:46:03.415 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:02.703+0000 7f8123e00700 1 -- 172.21.15.142:0/1770929657 <== mgr.14120 v2:172.21.15.142:6800/550675874 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f811800a050 con 0x7f811003bfb0 2024-04-20T21:46:03.415 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:02.704+0000 7f8132200700 1 -- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f811003bfb0 msgr2=0x7f811003e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:03.415 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:02.704+0000 7f8132200700 1 --2- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f811003bfb0 0x7f811003e3a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8118003a10 tx=0x7f81180092b0 comp rx=0 tx=0).stop 2024-04-20T21:46:03.416 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:02.704+0000 7f8132200700 1 -- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f812c1065a0 msgr2=0x7f812c07aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:03.416 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:02.704+0000 7f8132200700 1 --2- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f812c1065a0 0x7f812c07aa30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f811c006af0 tx=0x7f811c0047c0 comp rx=0 tx=0).stop 2024-04-20T21:46:03.416 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:02.704+0000 7f8132200700 1 -- 172.21.15.142:0/1770929657 shutdown_connections 2024-04-20T21:46:03.416 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:02.704+0000 7f8132200700 1 --2- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f811003bfb0 0x7f811003e3a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:03.416 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:02.704+0000 7f8132200700 1 --2- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f812c1065a0 0x7f812c07aa30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:03.416 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:02.704+0000 7f8132200700 1 --2- 172.21.15.142:0/1770929657 >> [v2:172.21.15.142:6800/2803679129,v1:172.21.15.142:6801/2803679129] conn(0x7f8110038770 0x7f811003ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:03.416 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:02.704+0000 7f8132200700 1 -- 172.21.15.142:0/1770929657 >> 172.21.15.142:0/1770929657 conn(0x7f812c101ba0 msgr2=0x7f812c102820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:03.416 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:02.704+0000 7f8132200700 1 -- 172.21.15.142:0/1770929657 shutdown_connections 2024-04-20T21:46:03.416 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:02.705+0000 7f8132200700 1 -- 172.21.15.142:0/1770929657 wait complete. 2024-04-20T21:46:03.416 INFO:teuthology.orchestra.run.smithi142.stdout:mgr epoch 5 is available 2024-04-20T21:46:03.416 INFO:teuthology.orchestra.run.smithi142.stdout:Setting orchestrator backend to cephadm... 2024-04-20T21:46:04.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:03 smithi142 ceph-mon[15828]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-20T21:46:04.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:03 smithi142 ceph-mon[15828]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-20T21:46:04.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:03 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:04.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:03 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:04.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:03 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:46:04.940 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:04 smithi142 ceph-mon[15828]: [20/Apr/2024:21:46:03] ENGINE Bus STARTING 2024-04-20T21:46:04.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:04 smithi142 ceph-mon[15828]: [20/Apr/2024:21:46:03] ENGINE Serving on https://172.21.15.142:7150 2024-04-20T21:46:04.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:04 smithi142 ceph-mon[15828]: [20/Apr/2024:21:46:03] ENGINE Serving on http://172.21.15.142:8765 2024-04-20T21:46:04.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:04 smithi142 ceph-mon[15828]: [20/Apr/2024:21:46:03] ENGINE Bus STARTED 2024-04-20T21:46:04.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:04 smithi142 ceph-mon[15828]: mgrmap e8: smithi142.zzmcfz(active, since 2s) 2024-04-20T21:46:04.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:04 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:04.941 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:04 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:46:04.955 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.016+0000 7f92ee400700 1 Processor -- start 2024-04-20T21:46:04.956 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.016+0000 7f92ee400700 1 -- start start 2024-04-20T21:46:04.956 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.016+0000 7f92ee400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e8107010 0x7f92e8109400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:04.956 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.016+0000 7f92ee400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e80747b0 con 0x7f92e8107010 2024-04-20T21:46:04.956 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.017+0000 7f92e7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e8107010 0x7f92e8109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:04.961 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.017+0000 7f92e7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e8107010 0x7f92e8109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49364/0 (socket says 172.21.15.142:49364) 2024-04-20T21:46:04.961 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.017+0000 7f92e7400700 1 -- 172.21.15.142:0/2601338105 learned_addr learned my addr 172.21.15.142:0/2601338105 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:04.961 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.017+0000 7f92e7400700 1 -- 172.21.15.142:0/2601338105 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e8109940 con 0x7f92e8107010 2024-04-20T21:46:04.961 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.018+0000 7f92e7400700 1 --2- 172.21.15.142:0/2601338105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e8107010 0x7f92e8109400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f92d80098a0 tx=0x7f92d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5f54cb6ff3fc50 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:04.961 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.018+0000 7f92e6000700 1 -- 172.21.15.142:0/2601338105 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92d8004180 con 0x7f92e8107010 2024-04-20T21:46:04.961 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.018+0000 7f92e6000700 1 -- 172.21.15.142:0/2601338105 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f92d80042e0 con 0x7f92e8107010 2024-04-20T21:46:04.961 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.018+0000 7f92e6000700 1 -- 172.21.15.142:0/2601338105 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92d8011a70 con 0x7f92e8107010 2024-04-20T21:46:04.961 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.019+0000 7f92ee400700 1 -- 172.21.15.142:0/2601338105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e8107010 msgr2=0x7f92e8109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:04.961 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.019+0000 7f92ee400700 1 --2- 172.21.15.142:0/2601338105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e8107010 0x7f92e8109400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f92d80098a0 tx=0x7f92d8009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:04.961 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.019+0000 7f92ee400700 1 -- 172.21.15.142:0/2601338105 shutdown_connections 2024-04-20T21:46:04.962 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.019+0000 7f92ee400700 1 --2- 172.21.15.142:0/2601338105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e8107010 0x7f92e8109400 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:04.962 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.019+0000 7f92ee400700 1 -- 172.21.15.142:0/2601338105 >> 172.21.15.142:0/2601338105 conn(0x7f92e8100a60 msgr2=0x7f92e8102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:04.962 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.019+0000 7f92ee400700 1 -- 172.21.15.142:0/2601338105 shutdown_connections 2024-04-20T21:46:04.962 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.019+0000 7f92ee400700 1 -- 172.21.15.142:0/2601338105 wait complete. 2024-04-20T21:46:04.962 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.020+0000 7f92ee400700 1 Processor -- start 2024-04-20T21:46:04.962 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.020+0000 7f92ee400700 1 -- start start 2024-04-20T21:46:04.962 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.020+0000 7f92ee400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e8107010 0x7f92e819c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:04.962 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.020+0000 7f92ee400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e819c9e0 con 0x7f92e8107010 2024-04-20T21:46:04.962 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.021+0000 7f92e7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e8107010 0x7f92e819c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:04.962 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.021+0000 7f92e7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e8107010 0x7f92e819c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49380/0 (socket says 172.21.15.142:49380) 2024-04-20T21:46:04.962 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.021+0000 7f92e7400700 1 -- 172.21.15.142:0/1931614962 learned_addr learned my addr 172.21.15.142:0/1931614962 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:04.962 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.021+0000 7f92e7400700 1 -- 172.21.15.142:0/1931614962 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d8009550 con 0x7f92e8107010 2024-04-20T21:46:04.962 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.021+0000 7f92e7400700 1 --2- 172.21.15.142:0/1931614962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e8107010 0x7f92e819c4a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f92d8011710 tx=0x7f92d80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:04.963 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.021+0000 7f92dfe00700 1 -- 172.21.15.142:0/1931614962 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92d8003b10 con 0x7f92e8107010 2024-04-20T21:46:04.963 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.021+0000 7f92dfe00700 1 -- 172.21.15.142:0/1931614962 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f92d801b8c0 con 0x7f92e8107010 2024-04-20T21:46:04.963 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.021+0000 7f92dfe00700 1 -- 172.21.15.142:0/1931614962 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92d80197e0 con 0x7f92e8107010 2024-04-20T21:46:04.963 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.021+0000 7f92ee400700 1 -- 172.21.15.142:0/1931614962 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e819cbe0 con 0x7f92e8107010 2024-04-20T21:46:04.963 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.022+0000 7f92ee400700 1 -- 172.21.15.142:0/1931614962 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e819d080 con 0x7f92e8107010 2024-04-20T21:46:04.963 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.023+0000 7f92dfe00700 1 -- 172.21.15.142:0/1931614962 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f92d801ba30 con 0x7f92e8107010 2024-04-20T21:46:04.963 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.023+0000 7f92ee400700 1 -- 172.21.15.142:0/1931614962 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e810a6c0 con 0x7f92e8107010 2024-04-20T21:46:04.963 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.023+0000 7f92dfe00700 1 --2- 172.21.15.142:0/1931614962 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f92cc038770 0x7f92cc03ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:04.963 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.023+0000 7f92dfe00700 1 -- 172.21.15.142:0/1931614962 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f92d804c9c0 con 0x7f92e8107010 2024-04-20T21:46:04.963 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.023+0000 7f92e6a00700 1 --2- 172.21.15.142:0/1931614962 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f92cc038770 0x7f92cc03ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:04.963 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.024+0000 7f92e6a00700 1 --2- 172.21.15.142:0/1931614962 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f92cc038770 0x7f92cc03ac30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f92d4006fd0 tx=0x7f92d4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:04.963 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.029+0000 7f92dfe00700 1 -- 172.21.15.142:0/1931614962 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f92d801bce0 con 0x7f92e8107010 2024-04-20T21:46:04.963 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.252+0000 7f92ee400700 1 -- 172.21.15.142:0/1931614962 --> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f92e8101c20 con 0x7f92cc038770 2024-04-20T21:46:04.963 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.272+0000 7f92dfe00700 1 -- 172.21.15.142:0/1931614962 <== mgr.14120 v2:172.21.15.142:6800/550675874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f92e8101c20 con 0x7f92cc038770 2024-04-20T21:46:04.965 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.276+0000 7f92ee400700 1 -- 172.21.15.142:0/1931614962 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f92cc038770 msgr2=0x7f92cc03ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:04.965 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.276+0000 7f92ee400700 1 --2- 172.21.15.142:0/1931614962 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f92cc038770 0x7f92cc03ac30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f92d4006fd0 tx=0x7f92d4006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:04.965 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.276+0000 7f92ee400700 1 -- 172.21.15.142:0/1931614962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e8107010 msgr2=0x7f92e819c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:04.965 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.276+0000 7f92ee400700 1 --2- 172.21.15.142:0/1931614962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e8107010 0x7f92e819c4a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f92d8011710 tx=0x7f92d80047c0 comp rx=0 tx=0).stop 2024-04-20T21:46:04.965 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.276+0000 7f92ee400700 1 -- 172.21.15.142:0/1931614962 shutdown_connections 2024-04-20T21:46:04.965 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.276+0000 7f92ee400700 1 --2- 172.21.15.142:0/1931614962 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f92cc038770 0x7f92cc03ac30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:04.965 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.276+0000 7f92ee400700 1 --2- 172.21.15.142:0/1931614962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e8107010 0x7f92e819c4a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:04.965 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.276+0000 7f92ee400700 1 -- 172.21.15.142:0/1931614962 >> 172.21.15.142:0/1931614962 conn(0x7f92e8100a60 msgr2=0x7f92e8101510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:04.965 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.277+0000 7f92ee400700 1 -- 172.21.15.142:0/1931614962 shutdown_connections 2024-04-20T21:46:04.965 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:04.277+0000 7f92ee400700 1 -- 172.21.15.142:0/1931614962 wait complete. 2024-04-20T21:46:05.824 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:05 smithi142 ceph-mon[15828]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:46:06.503 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-20T21:46:06.503 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.587+0000 7f36a0400700 1 Processor -- start 2024-04-20T21:46:06.503 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.587+0000 7f36a0400700 1 -- start start 2024-04-20T21:46:06.503 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.587+0000 7f36a0400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f369810cfd0 0x7f369810d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:06.503 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.587+0000 7f36a0400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369810d9c0 con 0x7f369810cfd0 2024-04-20T21:46:06.503 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.588+0000 7f369da00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f369810cfd0 0x7f369810d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:06.503 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.588+0000 7f369da00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f369810cfd0 0x7f369810d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49396/0 (socket says 172.21.15.142:49396) 2024-04-20T21:46:06.503 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.588+0000 7f369da00700 1 -- 172.21.15.142:0/837040685 learned_addr learned my addr 172.21.15.142:0/837040685 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:06.503 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.588+0000 7f369da00700 1 -- 172.21.15.142:0/837040685 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369810ddc0 con 0x7f369810cfd0 2024-04-20T21:46:06.504 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.589+0000 7f369da00700 1 --2- 172.21.15.142:0/837040685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f369810cfd0 0x7f369810d3f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f368c0098a0 tx=0x7f368c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3daf368c7dc8127 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:06.504 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.589+0000 7f3697e00700 1 -- 172.21.15.142:0/837040685 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f368c004180 con 0x7f369810cfd0 2024-04-20T21:46:06.504 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.589+0000 7f3697e00700 1 -- 172.21.15.142:0/837040685 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f368c0042e0 con 0x7f369810cfd0 2024-04-20T21:46:06.504 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.589+0000 7f3697e00700 1 -- 172.21.15.142:0/837040685 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f368c011a70 con 0x7f369810cfd0 2024-04-20T21:46:06.504 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.590+0000 7f36a0400700 1 -- 172.21.15.142:0/837040685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f369810cfd0 msgr2=0x7f369810d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:06.504 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.590+0000 7f36a0400700 1 --2- 172.21.15.142:0/837040685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f369810cfd0 0x7f369810d3f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f368c0098a0 tx=0x7f368c009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:06.504 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.590+0000 7f36a0400700 1 -- 172.21.15.142:0/837040685 shutdown_connections 2024-04-20T21:46:06.504 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.590+0000 7f36a0400700 1 --2- 172.21.15.142:0/837040685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f369810cfd0 0x7f369810d3f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:06.504 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.590+0000 7f36a0400700 1 -- 172.21.15.142:0/837040685 >> 172.21.15.142:0/837040685 conn(0x7f369807bbf0 msgr2=0x7f369807e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:06.504 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.590+0000 7f36a0400700 1 -- 172.21.15.142:0/837040685 shutdown_connections 2024-04-20T21:46:06.504 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.590+0000 7f36a0400700 1 -- 172.21.15.142:0/837040685 wait complete. 2024-04-20T21:46:06.504 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.591+0000 7f36a0400700 1 Processor -- start 2024-04-20T21:46:06.504 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.591+0000 7f36a0400700 1 -- start start 2024-04-20T21:46:06.504 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.591+0000 7f36a0400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f369810cfd0 0x7f36981a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:06.504 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.591+0000 7f36a0400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36981a0dd0 con 0x7f369810cfd0 2024-04-20T21:46:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.591+0000 7f369da00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f369810cfd0 0x7f36981a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.592+0000 7f369da00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f369810cfd0 0x7f36981a0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49404/0 (socket says 172.21.15.142:49404) 2024-04-20T21:46:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.592+0000 7f369da00700 1 -- 172.21.15.142:0/2031829605 learned_addr learned my addr 172.21.15.142:0/2031829605 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.592+0000 7f369da00700 1 -- 172.21.15.142:0/2031829605 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c009550 con 0x7f369810cfd0 2024-04-20T21:46:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.592+0000 7f369da00700 1 --2- 172.21.15.142:0/2031829605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f369810cfd0 0x7f36981a0890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f368c011710 tx=0x7f368c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.592+0000 7f3696000700 1 -- 172.21.15.142:0/2031829605 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f368c003b10 con 0x7f369810cfd0 2024-04-20T21:46:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.592+0000 7f3696000700 1 -- 172.21.15.142:0/2031829605 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f368c01b8c0 con 0x7f369810cfd0 2024-04-20T21:46:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.592+0000 7f36a0400700 1 -- 172.21.15.142:0/2031829605 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36981a0fd0 con 0x7f369810cfd0 2024-04-20T21:46:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.592+0000 7f3696000700 1 -- 172.21.15.142:0/2031829605 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f368c0197e0 con 0x7f369810cfd0 2024-04-20T21:46:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.593+0000 7f36a0400700 1 -- 172.21.15.142:0/2031829605 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36981a1470 con 0x7f369810cfd0 2024-04-20T21:46:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.594+0000 7f3696000700 1 -- 172.21.15.142:0/2031829605 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f368c0199d0 con 0x7f369810cfd0 2024-04-20T21:46:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.594+0000 7f36a0400700 1 -- 172.21.15.142:0/2031829605 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3698110ff0 con 0x7f369810cfd0 2024-04-20T21:46:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.594+0000 7f3696000700 1 --2- 172.21.15.142:0/2031829605 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f3680038770 0x7f368003ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.594+0000 7f3696000700 1 -- 172.21.15.142:0/2031829605 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f368c04ca20 con 0x7f369810cfd0 2024-04-20T21:46:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.594+0000 7f369d000700 1 --2- 172.21.15.142:0/2031829605 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f3680038770 0x7f368003ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.595+0000 7f369d000700 1 --2- 172.21.15.142:0/2031829605 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f3680038770 0x7f368003ac30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3684006fd0 tx=0x7f3684006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:06.506 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.600+0000 7f3696000700 1 -- 172.21.15.142:0/2031829605 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f368c018db0 con 0x7f369810cfd0 2024-04-20T21:46:06.506 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.825+0000 7f36a0400700 1 -- 172.21.15.142:0/2031829605 --> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f369807ce50 con 0x7f3680038770 2024-04-20T21:46:06.506 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.826+0000 7f3696000700 1 -- 172.21.15.142:0/2031829605 <== mgr.14120 v2:172.21.15.142:6800/550675874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f369807ce50 con 0x7f3680038770 2024-04-20T21:46:06.506 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.829+0000 7f36a0400700 1 -- 172.21.15.142:0/2031829605 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f3680038770 msgr2=0x7f368003ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:06.506 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.829+0000 7f36a0400700 1 --2- 172.21.15.142:0/2031829605 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f3680038770 0x7f368003ac30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3684006fd0 tx=0x7f3684006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:06.506 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.829+0000 7f36a0400700 1 -- 172.21.15.142:0/2031829605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f369810cfd0 msgr2=0x7f36981a0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:06.506 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.829+0000 7f36a0400700 1 --2- 172.21.15.142:0/2031829605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f369810cfd0 0x7f36981a0890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f368c011710 tx=0x7f368c0047c0 comp rx=0 tx=0).stop 2024-04-20T21:46:06.506 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.829+0000 7f36a0400700 1 -- 172.21.15.142:0/2031829605 shutdown_connections 2024-04-20T21:46:06.506 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.829+0000 7f36a0400700 1 --2- 172.21.15.142:0/2031829605 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f3680038770 0x7f368003ac30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:06.506 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.829+0000 7f36a0400700 1 --2- 172.21.15.142:0/2031829605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f369810cfd0 0x7f36981a0890 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:06.506 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.829+0000 7f36a0400700 1 -- 172.21.15.142:0/2031829605 >> 172.21.15.142:0/2031829605 conn(0x7f369807bbf0 msgr2=0x7f369807c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:06.506 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.829+0000 7f36a0400700 1 -- 172.21.15.142:0/2031829605 shutdown_connections 2024-04-20T21:46:06.506 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:05.829+0000 7f36a0400700 1 -- 172.21.15.142:0/2031829605 wait complete. 2024-04-20T21:46:06.506 INFO:teuthology.orchestra.run.smithi142.stdout:Generating ssh key... 2024-04-20T21:46:07.065 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:06 smithi142 ceph-mon[15828]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:46:08.348 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.127+0000 7fd4c8e00700 1 Processor -- start 2024-04-20T21:46:08.348 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.127+0000 7fd4c8e00700 1 -- start start 2024-04-20T21:46:08.348 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.128+0000 7fd4c8e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c41065a0 0x7fd4c41069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:08.348 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.128+0000 7fd4c8e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c4106f90 con 0x7fd4c41065a0 2024-04-20T21:46:08.352 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.128+0000 7fd4c1e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c41065a0 0x7fd4c41069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:08.352 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.128+0000 7fd4c1e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c41065a0 0x7fd4c41069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36582/0 (socket says 172.21.15.142:36582) 2024-04-20T21:46:08.352 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.128+0000 7fd4c1e00700 1 -- 172.21.15.142:0/4239944082 learned_addr learned my addr 172.21.15.142:0/4239944082 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:08.352 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.129+0000 7fd4c1e00700 1 -- 172.21.15.142:0/4239944082 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c41077a0 con 0x7fd4c41065a0 2024-04-20T21:46:08.352 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.129+0000 7fd4c1e00700 1 --2- 172.21.15.142:0/4239944082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c41065a0 0x7fd4c41069c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40098a0 tx=0x7fd4b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36cd7f20ffb0dc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:08.352 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.129+0000 7fd4c0a00700 1 -- 172.21.15.142:0/4239944082 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4b4004180 con 0x7fd4c41065a0 2024-04-20T21:46:08.352 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.129+0000 7fd4c0a00700 1 -- 172.21.15.142:0/4239944082 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fd4b40042e0 con 0x7fd4c41065a0 2024-04-20T21:46:08.352 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.129+0000 7fd4c0a00700 1 -- 172.21.15.142:0/4239944082 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4b4011a70 con 0x7fd4c41065a0 2024-04-20T21:46:08.352 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.130+0000 7fd4c8e00700 1 -- 172.21.15.142:0/4239944082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c41065a0 msgr2=0x7fd4c41069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:08.352 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.130+0000 7fd4c8e00700 1 --2- 172.21.15.142:0/4239944082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c41065a0 0x7fd4c41069c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40098a0 tx=0x7fd4b4009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:08.353 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.130+0000 7fd4c8e00700 1 -- 172.21.15.142:0/4239944082 shutdown_connections 2024-04-20T21:46:08.353 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.130+0000 7fd4c8e00700 1 --2- 172.21.15.142:0/4239944082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c41065a0 0x7fd4c41069c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:08.353 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.130+0000 7fd4c8e00700 1 -- 172.21.15.142:0/4239944082 >> 172.21.15.142:0/4239944082 conn(0x7fd4c4101ba0 msgr2=0x7fd4c4103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:08.353 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.130+0000 7fd4c8e00700 1 -- 172.21.15.142:0/4239944082 shutdown_connections 2024-04-20T21:46:08.353 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.130+0000 7fd4c8e00700 1 -- 172.21.15.142:0/4239944082 wait complete. 2024-04-20T21:46:08.353 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.131+0000 7fd4c8e00700 1 Processor -- start 2024-04-20T21:46:08.353 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.131+0000 7fd4c8e00700 1 -- start start 2024-04-20T21:46:08.353 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.132+0000 7fd4c8e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c41065a0 0x7fd4c407aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:08.353 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.132+0000 7fd4c8e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c407af70 con 0x7fd4c41065a0 2024-04-20T21:46:08.353 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.132+0000 7fd4c1e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c41065a0 0x7fd4c407aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:08.353 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.132+0000 7fd4c1e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c41065a0 0x7fd4c407aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36598/0 (socket says 172.21.15.142:36598) 2024-04-20T21:46:08.353 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.132+0000 7fd4c1e00700 1 -- 172.21.15.142:0/4035759857 learned_addr learned my addr 172.21.15.142:0/4035759857 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:08.353 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.132+0000 7fd4c1e00700 1 -- 172.21.15.142:0/4035759857 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b4009550 con 0x7fd4c41065a0 2024-04-20T21:46:08.353 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.133+0000 7fd4c1e00700 1 --2- 172.21.15.142:0/4035759857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c41065a0 0x7fd4c407aa30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4003df0 tx=0x7fd4b40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:08.353 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.133+0000 7fd4baa00700 1 -- 172.21.15.142:0/4035759857 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4b4003a00 con 0x7fd4c41065a0 2024-04-20T21:46:08.354 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.133+0000 7fd4baa00700 1 -- 172.21.15.142:0/4035759857 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fd4b4003b60 con 0x7fd4c41065a0 2024-04-20T21:46:08.354 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.133+0000 7fd4baa00700 1 -- 172.21.15.142:0/4035759857 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4b4023770 con 0x7fd4c41065a0 2024-04-20T21:46:08.354 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.133+0000 7fd4c8e00700 1 -- 172.21.15.142:0/4035759857 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c40791b0 con 0x7fd4c41065a0 2024-04-20T21:46:08.354 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.133+0000 7fd4c8e00700 1 -- 172.21.15.142:0/4035759857 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c4079650 con 0x7fd4c41065a0 2024-04-20T21:46:08.354 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.134+0000 7fd4baa00700 1 -- 172.21.15.142:0/4035759857 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fd4b401bbe0 con 0x7fd4c41065a0 2024-04-20T21:46:08.354 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.134+0000 7fd4c8e00700 1 -- 172.21.15.142:0/4035759857 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c4062510 con 0x7fd4c41065a0 2024-04-20T21:46:08.354 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.135+0000 7fd4baa00700 1 --2- 172.21.15.142:0/4035759857 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fd4a8038730 0x7fd4a803abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:08.354 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.135+0000 7fd4baa00700 1 -- 172.21.15.142:0/4035759857 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd4b404c9f0 con 0x7fd4c41065a0 2024-04-20T21:46:08.356 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.135+0000 7fd4c1400700 1 --2- 172.21.15.142:0/4035759857 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fd4a8038730 0x7fd4a803abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:08.356 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.136+0000 7fd4c1400700 1 --2- 172.21.15.142:0/4035759857 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fd4a8038730 0x7fd4a803abf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0006fd0 tx=0x7fd4b0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:08.356 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.141+0000 7fd4baa00700 1 -- 172.21.15.142:0/4035759857 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fd4b401b440 con 0x7fd4c41065a0 2024-04-20T21:46:08.356 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.362+0000 7fd4c8e00700 1 -- 172.21.15.142:0/4035759857 --> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4c4079c90 con 0x7fd4a8038730 2024-04-20T21:46:08.356 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.646+0000 7fd4baa00700 1 -- 172.21.15.142:0/4035759857 <== mgr.14120 v2:172.21.15.142:6800/550675874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd4c4079c90 con 0x7fd4a8038730 2024-04-20T21:46:08.356 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.649+0000 7fd4c8e00700 1 -- 172.21.15.142:0/4035759857 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fd4a8038730 msgr2=0x7fd4a803abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:08.356 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.649+0000 7fd4c8e00700 1 --2- 172.21.15.142:0/4035759857 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fd4a8038730 0x7fd4a803abf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0006fd0 tx=0x7fd4b0006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:08.356 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.649+0000 7fd4c8e00700 1 -- 172.21.15.142:0/4035759857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c41065a0 msgr2=0x7fd4c407aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:08.356 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.649+0000 7fd4c8e00700 1 --2- 172.21.15.142:0/4035759857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c41065a0 0x7fd4c407aa30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4003df0 tx=0x7fd4b40047c0 comp rx=0 tx=0).stop 2024-04-20T21:46:08.357 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.650+0000 7fd4c8e00700 1 -- 172.21.15.142:0/4035759857 shutdown_connections 2024-04-20T21:46:08.357 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.650+0000 7fd4c8e00700 1 --2- 172.21.15.142:0/4035759857 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fd4a8038730 0x7fd4a803abf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:08.357 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.650+0000 7fd4c8e00700 1 --2- 172.21.15.142:0/4035759857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c41065a0 0x7fd4c407aa30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:08.357 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.650+0000 7fd4c8e00700 1 -- 172.21.15.142:0/4035759857 >> 172.21.15.142:0/4035759857 conn(0x7fd4c4101ba0 msgr2=0x7fd4c4102820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:08.357 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.650+0000 7fd4c8e00700 1 -- 172.21.15.142:0/4035759857 shutdown_connections 2024-04-20T21:46:08.357 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:07.650+0000 7fd4c8e00700 1 -- 172.21.15.142:0/4035759857 wait complete. 2024-04-20T21:46:08.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:08 smithi142 ceph-mon[15828]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:46:08.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:08 smithi142 ceph-mon[15828]: Generating ssh key... 2024-04-20T21:46:08.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:08 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:08.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:08 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:09.861 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7cGiT8olwRjjF9882c35eD2pIzN+kkdhT+Uon6kbNpD2bn3NpDn4WIWxsB7uLaUGlj/hOaT4zvGNlB1D5hraDI9otzxGaPz+Zlr2+ZHYbRDo/k8o7+wizVWLcy3iku6WiDcyJz6HvM7ODl+Xo10NSoySokh0is2YGsjC3ZMSiK+aP2Bb+y2gexcD+dXjDvb4zjMKW4EBgyV0ce2G19+cejR3kH7S9AW3XYw2mWV5A0a3dYejzhItRJywEuGae7N/rzbxQ8amwA9+PQBMToNS3jtO+vTUsdl7TB4K4tFFKCldiBZxt8JUoSFUS29Yp3WpgQHlRdUr6WF8tDpvhXen2+wug90niztJqF43vJrp3lbjB6tOADNxi1NMIfUIIi6UTgWcHGC0Li2IukeQM3sWm15OC3EBsdLBO7RU2pS8IiiGBDmiSD/xFaEmSym2tO2H8d6qE2qkKoccQmDAP0Mgykxr/8En71HaX7zslnlnLtOU52qb2bReMd/BTsUrXzs8= ceph-270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T21:46:09.862 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.008+0000 7f084dc00700 1 Processor -- start 2024-04-20T21:46:09.862 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.008+0000 7f084dc00700 1 -- start start 2024-04-20T21:46:09.862 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.009+0000 7f084dc00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0848106590 0x7f08481069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:09.863 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.009+0000 7f084dc00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0848106f80 con 0x7f0848106590 2024-04-20T21:46:09.863 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.009+0000 7f0846a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0848106590 0x7f08481069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:09.863 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.010+0000 7f0846a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0848106590 0x7f08481069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36614/0 (socket says 172.21.15.142:36614) 2024-04-20T21:46:09.864 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.010+0000 7f0846a00700 1 -- 172.21.15.142:0/2368911845 learned_addr learned my addr 172.21.15.142:0/2368911845 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:09.864 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.010+0000 7f0846a00700 1 -- 172.21.15.142:0/2368911845 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0848107790 con 0x7f0848106590 2024-04-20T21:46:09.864 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.010+0000 7f0846a00700 1 --2- 172.21.15.142:0/2368911845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0848106590 0x7f08481069b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f08380098a0 tx=0x7f0838009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9264801bbe9dff8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:09.865 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.010+0000 7f0846000700 1 -- 172.21.15.142:0/2368911845 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0838004180 con 0x7f0848106590 2024-04-20T21:46:09.865 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.011+0000 7f0846000700 1 -- 172.21.15.142:0/2368911845 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f08380042e0 con 0x7f0848106590 2024-04-20T21:46:09.865 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.011+0000 7f0846000700 1 -- 172.21.15.142:0/2368911845 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0838011a70 con 0x7f0848106590 2024-04-20T21:46:09.865 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.011+0000 7f084dc00700 1 -- 172.21.15.142:0/2368911845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0848106590 msgr2=0x7f08481069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:09.865 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.011+0000 7f084dc00700 1 --2- 172.21.15.142:0/2368911845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0848106590 0x7f08481069b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f08380098a0 tx=0x7f0838009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:09.865 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.011+0000 7f084dc00700 1 -- 172.21.15.142:0/2368911845 shutdown_connections 2024-04-20T21:46:09.867 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.011+0000 7f084dc00700 1 --2- 172.21.15.142:0/2368911845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0848106590 0x7f08481069b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:09.867 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.011+0000 7f084dc00700 1 -- 172.21.15.142:0/2368911845 >> 172.21.15.142:0/2368911845 conn(0x7f0848101b70 msgr2=0x7f0848103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:09.867 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.011+0000 7f084dc00700 1 -- 172.21.15.142:0/2368911845 shutdown_connections 2024-04-20T21:46:09.867 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.011+0000 7f084dc00700 1 -- 172.21.15.142:0/2368911845 wait complete. 2024-04-20T21:46:09.867 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.012+0000 7f084dc00700 1 Processor -- start 2024-04-20T21:46:09.868 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.013+0000 7f084dc00700 1 -- start start 2024-04-20T21:46:09.868 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.013+0000 7f084dc00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0848106590 0x7f084819a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:09.868 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.013+0000 7f084dc00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084819a860 con 0x7f0848106590 2024-04-20T21:46:09.868 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.013+0000 7f0846a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0848106590 0x7f084819a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:09.868 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.013+0000 7f0846a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0848106590 0x7f084819a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36628/0 (socket says 172.21.15.142:36628) 2024-04-20T21:46:09.868 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.013+0000 7f0846a00700 1 -- 172.21.15.142:0/2967059981 learned_addr learned my addr 172.21.15.142:0/2967059981 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:09.868 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.014+0000 7f0846a00700 1 -- 172.21.15.142:0/2967059981 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0838009550 con 0x7f0848106590 2024-04-20T21:46:09.868 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.014+0000 7f0846a00700 1 --2- 172.21.15.142:0/2967059981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0848106590 0x7f084819a320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0838011710 tx=0x7f08380047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:09.868 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.014+0000 7f083f400700 1 -- 172.21.15.142:0/2967059981 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0838003b10 con 0x7f0848106590 2024-04-20T21:46:09.868 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.014+0000 7f083f400700 1 -- 172.21.15.142:0/2967059981 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f083801b8c0 con 0x7f0848106590 2024-04-20T21:46:09.868 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.014+0000 7f084dc00700 1 -- 172.21.15.142:0/2967059981 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084819aa60 con 0x7f0848106590 2024-04-20T21:46:09.868 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.014+0000 7f083f400700 1 -- 172.21.15.142:0/2967059981 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0838019770 con 0x7f0848106590 2024-04-20T21:46:09.868 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.014+0000 7f084dc00700 1 -- 172.21.15.142:0/2967059981 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f084819af00 con 0x7f0848106590 2024-04-20T21:46:09.868 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.015+0000 7f084dc00700 1 -- 172.21.15.142:0/2967059981 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084810a9c0 con 0x7f0848106590 2024-04-20T21:46:09.870 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.015+0000 7f083f400700 1 -- 172.21.15.142:0/2967059981 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f083801ba30 con 0x7f0848106590 2024-04-20T21:46:09.870 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.016+0000 7f083f400700 1 --2- 172.21.15.142:0/2967059981 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f082c038720 0x7f082c03abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:09.870 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.016+0000 7f083f400700 1 -- 172.21.15.142:0/2967059981 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f083804c9a0 con 0x7f0848106590 2024-04-20T21:46:09.870 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.016+0000 7f083fe00700 1 --2- 172.21.15.142:0/2967059981 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f082c038720 0x7f082c03abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:09.871 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.017+0000 7f083fe00700 1 --2- 172.21.15.142:0/2967059981 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f082c038720 0x7f082c03abe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0830006fd0 tx=0x7f0830006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:09.871 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.021+0000 7f083f400700 1 -- 172.21.15.142:0/2967059981 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f083802cce0 con 0x7f0848106590 2024-04-20T21:46:09.871 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.223+0000 7f084dc00700 1 -- 172.21.15.142:0/2967059981 --> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f084819d7f0 con 0x7f082c038720 2024-04-20T21:46:09.871 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.225+0000 7f083f400700 1 -- 172.21.15.142:0/2967059981 <== mgr.14120 v2:172.21.15.142:6800/550675874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f084819d7f0 con 0x7f082c038720 2024-04-20T21:46:09.871 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.228+0000 7f084dc00700 1 -- 172.21.15.142:0/2967059981 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f082c038720 msgr2=0x7f082c03abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:09.871 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.228+0000 7f084dc00700 1 --2- 172.21.15.142:0/2967059981 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f082c038720 0x7f082c03abe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0830006fd0 tx=0x7f0830006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:09.871 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.228+0000 7f084dc00700 1 -- 172.21.15.142:0/2967059981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0848106590 msgr2=0x7f084819a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:09.871 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.228+0000 7f084dc00700 1 --2- 172.21.15.142:0/2967059981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0848106590 0x7f084819a320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0838011710 tx=0x7f08380047c0 comp rx=0 tx=0).stop 2024-04-20T21:46:09.871 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.229+0000 7f084dc00700 1 -- 172.21.15.142:0/2967059981 shutdown_connections 2024-04-20T21:46:09.871 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.229+0000 7f084dc00700 1 --2- 172.21.15.142:0/2967059981 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f082c038720 0x7f082c03abe0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:09.871 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.229+0000 7f084dc00700 1 --2- 172.21.15.142:0/2967059981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0848106590 0x7f084819a320 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:09.871 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.229+0000 7f084dc00700 1 -- 172.21.15.142:0/2967059981 >> 172.21.15.142:0/2967059981 conn(0x7f0848101b70 msgr2=0x7f0848102720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:09.871 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.229+0000 7f084dc00700 1 -- 172.21.15.142:0/2967059981 shutdown_connections 2024-04-20T21:46:09.871 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:09.229+0000 7f084dc00700 1 -- 172.21.15.142:0/2967059981 wait complete. 2024-04-20T21:46:09.872 INFO:teuthology.orchestra.run.smithi142.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-20T21:46:09.872 INFO:teuthology.orchestra.run.smithi142.stdout:Adding key to root@localhost authorized_keys... 2024-04-20T21:46:09.879 INFO:teuthology.orchestra.run.smithi142.stdout:Adding host smithi142... 2024-04-20T21:46:10.192 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:09 smithi142 ceph-mon[15828]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:46:11.110 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:10 smithi142 ceph-mon[15828]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi142", "addr": "172.21.15.142", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:46:13.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:12 smithi142 ceph-mon[15828]: Deploying cephadm binary to smithi142 2024-04-20T21:46:15.660 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout Added host 'smithi142' with addr '172.21.15.142' 2024-04-20T21:46:15.660 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.537+0000 7fcbb7e00700 1 Processor -- start 2024-04-20T21:46:15.660 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.537+0000 7fcbb7e00700 1 -- start start 2024-04-20T21:46:15.660 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.538+0000 7fcbb7e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb807ad70 0x7fcbb80791d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:15.660 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.538+0000 7fcbb7e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb80797a0 con 0x7fcbb807ad70 2024-04-20T21:46:15.660 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.538+0000 7fcbb6a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb807ad70 0x7fcbb80791d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:15.660 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.538+0000 7fcbb6a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb807ad70 0x7fcbb80791d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36634/0 (socket says 172.21.15.142:36634) 2024-04-20T21:46:15.661 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.538+0000 7fcbb6a00700 1 -- 172.21.15.142:0/2673324932 learned_addr learned my addr 172.21.15.142:0/2673324932 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:15.661 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.539+0000 7fcbb6a00700 1 -- 172.21.15.142:0/2673324932 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb80798e0 con 0x7fcbb807ad70 2024-04-20T21:46:15.661 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.539+0000 7fcbb6a00700 1 --2- 172.21.15.142:0/2673324932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb807ad70 0x7fcbb80791d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcba8009e80 tx=0x7fcba800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1807ac3adf8ddfc server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:15.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.539+0000 7fcbb6000700 1 -- 172.21.15.142:0/2673324932 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcba800e070 con 0x7fcbb807ad70 2024-04-20T21:46:15.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.539+0000 7fcbb6000700 1 -- 172.21.15.142:0/2673324932 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fcba800b8c0 con 0x7fcbb807ad70 2024-04-20T21:46:15.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.539+0000 7fcbb6000700 1 -- 172.21.15.142:0/2673324932 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcba8004440 con 0x7fcbb807ad70 2024-04-20T21:46:15.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.540+0000 7fcbb7e00700 1 -- 172.21.15.142:0/2673324932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb807ad70 msgr2=0x7fcbb80791d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:15.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.540+0000 7fcbb7e00700 1 --2- 172.21.15.142:0/2673324932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb807ad70 0x7fcbb80791d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcba8009e80 tx=0x7fcba800b330 comp rx=0 tx=0).stop 2024-04-20T21:46:15.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.540+0000 7fcbb7e00700 1 -- 172.21.15.142:0/2673324932 shutdown_connections 2024-04-20T21:46:15.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.540+0000 7fcbb7e00700 1 --2- 172.21.15.142:0/2673324932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb807ad70 0x7fcbb80791d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:15.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.540+0000 7fcbb7e00700 1 -- 172.21.15.142:0/2673324932 >> 172.21.15.142:0/2673324932 conn(0x7fcbb8101a30 msgr2=0x7fcbb8103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:15.665 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.540+0000 7fcbb7e00700 1 -- 172.21.15.142:0/2673324932 shutdown_connections 2024-04-20T21:46:15.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.540+0000 7fcbb7e00700 1 -- 172.21.15.142:0/2673324932 wait complete. 2024-04-20T21:46:15.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.541+0000 7fcbb7e00700 1 Processor -- start 2024-04-20T21:46:15.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.542+0000 7fcbb7e00700 1 -- start start 2024-04-20T21:46:15.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.542+0000 7fcbb7e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb807ad70 0x7fcbb819c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:15.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.542+0000 7fcbb7e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb819c770 con 0x7fcbb807ad70 2024-04-20T21:46:15.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.542+0000 7fcbb6a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb807ad70 0x7fcbb819c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:15.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.542+0000 7fcbb6a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb807ad70 0x7fcbb819c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36648/0 (socket says 172.21.15.142:36648) 2024-04-20T21:46:15.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.542+0000 7fcbb6a00700 1 -- 172.21.15.142:0/2714884796 learned_addr learned my addr 172.21.15.142:0/2714884796 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:15.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.542+0000 7fcbb6a00700 1 -- 172.21.15.142:0/2714884796 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba8009b30 con 0x7fcbb807ad70 2024-04-20T21:46:15.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.543+0000 7fcbb6a00700 1 --2- 172.21.15.142:0/2714884796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb807ad70 0x7fcbb819c230 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcba8003c50 tx=0x7fcba8003d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:15.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.543+0000 7fcbafe00700 1 -- 172.21.15.142:0/2714884796 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcba800e040 con 0x7fcbb807ad70 2024-04-20T21:46:15.666 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.543+0000 7fcbafe00700 1 -- 172.21.15.142:0/2714884796 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fcba800bc40 con 0x7fcbb807ad70 2024-04-20T21:46:15.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.543+0000 7fcbafe00700 1 -- 172.21.15.142:0/2714884796 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcba80125e0 con 0x7fcbb807ad70 2024-04-20T21:46:15.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.543+0000 7fcbb7e00700 1 -- 172.21.15.142:0/2714884796 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb819c970 con 0x7fcbb807ad70 2024-04-20T21:46:15.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.543+0000 7fcbb7e00700 1 -- 172.21.15.142:0/2714884796 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb819ce70 con 0x7fcbb807ad70 2024-04-20T21:46:15.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.544+0000 7fcbafe00700 1 -- 172.21.15.142:0/2714884796 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fcba8019040 con 0x7fcbb807ad70 2024-04-20T21:46:15.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.544+0000 7fcbb7e00700 1 -- 172.21.15.142:0/2714884796 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb810c750 con 0x7fcbb807ad70 2024-04-20T21:46:15.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.545+0000 7fcbafe00700 1 --2- 172.21.15.142:0/2714884796 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fcb9c038810 0x7fcb9c03acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:15.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.545+0000 7fcbafe00700 1 -- 172.21.15.142:0/2714884796 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fcba804c150 con 0x7fcbb807ad70 2024-04-20T21:46:15.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.545+0000 7fcbae000700 1 --2- 172.21.15.142:0/2714884796 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fcb9c038810 0x7fcb9c03acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:15.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.546+0000 7fcbae000700 1 --2- 172.21.15.142:0/2714884796 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fcb9c038810 0x7fcb9c03acd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcba0006fd0 tx=0x7fcba0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:15.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.550+0000 7fcbafe00700 1 -- 172.21.15.142:0/2714884796 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fcba801b430 con 0x7fcbb807ad70 2024-04-20T21:46:15.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:10.772+0000 7fcbb7e00700 1 -- 172.21.15.142:0/2714884796 --> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi142", "addr": "172.21.15.142", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbb8102bf0 con 0x7fcb9c038810 2024-04-20T21:46:15.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:14.918+0000 7fcbafe00700 1 -- 172.21.15.142:0/2714884796 <== mgr.14120 v2:172.21.15.142:6800/550675874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fcbb8102bf0 con 0x7fcb9c038810 2024-04-20T21:46:15.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:14.922+0000 7fcbb7e00700 1 -- 172.21.15.142:0/2714884796 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fcb9c038810 msgr2=0x7fcb9c03acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:15.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:14.922+0000 7fcbb7e00700 1 --2- 172.21.15.142:0/2714884796 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fcb9c038810 0x7fcb9c03acd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcba0006fd0 tx=0x7fcba0006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:15.668 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:14.922+0000 7fcbb7e00700 1 -- 172.21.15.142:0/2714884796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb807ad70 msgr2=0x7fcbb819c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:15.668 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:14.922+0000 7fcbb7e00700 1 --2- 172.21.15.142:0/2714884796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb807ad70 0x7fcbb819c230 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcba8003c50 tx=0x7fcba8003d30 comp rx=0 tx=0).stop 2024-04-20T21:46:15.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:14.922+0000 7fcbb7e00700 1 -- 172.21.15.142:0/2714884796 shutdown_connections 2024-04-20T21:46:15.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:14.922+0000 7fcbb7e00700 1 --2- 172.21.15.142:0/2714884796 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fcb9c038810 0x7fcb9c03acd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:15.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:14.922+0000 7fcbb7e00700 1 --2- 172.21.15.142:0/2714884796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb807ad70 0x7fcbb819c230 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:15.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:14.922+0000 7fcbb7e00700 1 -- 172.21.15.142:0/2714884796 >> 172.21.15.142:0/2714884796 conn(0x7fcbb8101a30 msgr2=0x7fcbb81024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:15.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:14.922+0000 7fcbb7e00700 1 -- 172.21.15.142:0/2714884796 shutdown_connections 2024-04-20T21:46:15.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:14.923+0000 7fcbb7e00700 1 -- 172.21.15.142:0/2714884796 wait complete. 2024-04-20T21:46:15.669 INFO:teuthology.orchestra.run.smithi142.stdout:Deploying mon service with default placement... 2024-04-20T21:46:16.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:15 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:16.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:15 smithi142 ceph-mon[15828]: Added host smithi142 2024-04-20T21:46:16.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:15 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:46:17.758 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:17 smithi142 ceph-mon[15828]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:46:17.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:17 smithi142 ceph-mon[15828]: Saving service mon spec with placement count:5 2024-04-20T21:46:17.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:17 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:18.146 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-20T21:46:18.147 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.303+0000 7fdc99400700 1 Processor -- start 2024-04-20T21:46:18.147 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.303+0000 7fdc99400700 1 -- start start 2024-04-20T21:46:18.147 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.303+0000 7fdc99400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc9407ad90 0x7fdc940791f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:18.147 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.303+0000 7fdc99400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc940797c0 con 0x7fdc9407ad90 2024-04-20T21:46:18.147 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.304+0000 7fdc92800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc9407ad90 0x7fdc940791f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:18.152 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.304+0000 7fdc92800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc9407ad90 0x7fdc940791f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36664/0 (socket says 172.21.15.142:36664) 2024-04-20T21:46:18.152 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.304+0000 7fdc92800700 1 -- 172.21.15.142:0/1893999426 learned_addr learned my addr 172.21.15.142:0/1893999426 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:18.152 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.304+0000 7fdc92800700 1 -- 172.21.15.142:0/1893999426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc94079900 con 0x7fdc9407ad90 2024-04-20T21:46:18.152 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.305+0000 7fdc92800700 1 --2- 172.21.15.142:0/1893999426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc9407ad90 0x7fdc940791f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdc840098a0 tx=0x7fdc84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358daa16f8fda9e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:18.152 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.305+0000 7fdc91e00700 1 -- 172.21.15.142:0/1893999426 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc84004180 con 0x7fdc9407ad90 2024-04-20T21:46:18.152 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.305+0000 7fdc91e00700 1 -- 172.21.15.142:0/1893999426 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fdc840042e0 con 0x7fdc9407ad90 2024-04-20T21:46:18.152 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.305+0000 7fdc91e00700 1 -- 172.21.15.142:0/1893999426 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc84011a70 con 0x7fdc9407ad90 2024-04-20T21:46:18.152 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.306+0000 7fdc99400700 1 -- 172.21.15.142:0/1893999426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc9407ad90 msgr2=0x7fdc940791f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:18.153 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.306+0000 7fdc99400700 1 --2- 172.21.15.142:0/1893999426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc9407ad90 0x7fdc940791f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdc840098a0 tx=0x7fdc84009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:18.153 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.306+0000 7fdc99400700 1 -- 172.21.15.142:0/1893999426 shutdown_connections 2024-04-20T21:46:18.153 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.306+0000 7fdc99400700 1 --2- 172.21.15.142:0/1893999426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc9407ad90 0x7fdc940791f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:18.153 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.306+0000 7fdc99400700 1 -- 172.21.15.142:0/1893999426 >> 172.21.15.142:0/1893999426 conn(0x7fdc94101ba0 msgr2=0x7fdc94103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:18.153 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.306+0000 7fdc99400700 1 -- 172.21.15.142:0/1893999426 shutdown_connections 2024-04-20T21:46:18.153 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.306+0000 7fdc99400700 1 -- 172.21.15.142:0/1893999426 wait complete. 2024-04-20T21:46:18.153 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.307+0000 7fdc99400700 1 Processor -- start 2024-04-20T21:46:18.153 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.307+0000 7fdc99400700 1 -- start start 2024-04-20T21:46:18.153 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.307+0000 7fdc99400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc9407ad90 0x7fdc9419c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:18.153 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.307+0000 7fdc99400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9419ca90 con 0x7fdc9407ad90 2024-04-20T21:46:18.153 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.308+0000 7fdc92800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc9407ad90 0x7fdc9419c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:18.153 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.308+0000 7fdc92800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc9407ad90 0x7fdc9419c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36676/0 (socket says 172.21.15.142:36676) 2024-04-20T21:46:18.153 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.308+0000 7fdc92800700 1 -- 172.21.15.142:0/4265559791 learned_addr learned my addr 172.21.15.142:0/4265559791 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:18.153 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.308+0000 7fdc92800700 1 -- 172.21.15.142:0/4265559791 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc84009550 con 0x7fdc9407ad90 2024-04-20T21:46:18.154 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.308+0000 7fdc92800700 1 --2- 172.21.15.142:0/4265559791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc9407ad90 0x7fdc9419c550 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdc84006af0 tx=0x7fdc840047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:18.154 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.308+0000 7fdc8b400700 1 -- 172.21.15.142:0/4265559791 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc84003a00 con 0x7fdc9407ad90 2024-04-20T21:46:18.154 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.309+0000 7fdc8b400700 1 -- 172.21.15.142:0/4265559791 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fdc84003b60 con 0x7fdc9407ad90 2024-04-20T21:46:18.154 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.309+0000 7fdc8b400700 1 -- 172.21.15.142:0/4265559791 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc84023750 con 0x7fdc9407ad90 2024-04-20T21:46:18.154 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.309+0000 7fdc99400700 1 -- 172.21.15.142:0/4265559791 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9419cc90 con 0x7fdc9407ad90 2024-04-20T21:46:18.154 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.309+0000 7fdc99400700 1 -- 172.21.15.142:0/4265559791 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc9419d130 con 0x7fdc9407ad90 2024-04-20T21:46:18.154 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.310+0000 7fdc99400700 1 -- 172.21.15.142:0/4265559791 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9410c920 con 0x7fdc9407ad90 2024-04-20T21:46:18.154 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.310+0000 7fdc8b400700 1 -- 172.21.15.142:0/4265559791 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fdc840239d0 con 0x7fdc9407ad90 2024-04-20T21:46:18.154 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.311+0000 7fdc8b400700 1 --2- 172.21.15.142:0/4265559791 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fdc78038720 0x7fdc7803abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:18.154 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.311+0000 7fdc8b400700 1 -- 172.21.15.142:0/4265559791 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdc8404cb50 con 0x7fdc9407ad90 2024-04-20T21:46:18.154 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.311+0000 7fdc8be00700 1 --2- 172.21.15.142:0/4265559791 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fdc78038720 0x7fdc7803abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:18.154 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.312+0000 7fdc8be00700 1 --2- 172.21.15.142:0/4265559791 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fdc78038720 0x7fdc7803abe0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c006fd0 tx=0x7fdc7c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:18.154 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.316+0000 7fdc8b400700 1 -- 172.21.15.142:0/4265559791 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fdc8402b760 con 0x7fdc9407ad90 2024-04-20T21:46:18.155 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.560+0000 7fdc99400700 1 -- 172.21.15.142:0/4265559791 --> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc94102eb0 con 0x7fdc78038720 2024-04-20T21:46:18.155 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.567+0000 7fdc8b400700 1 -- 172.21.15.142:0/4265559791 <== mgr.14120 v2:172.21.15.142:6800/550675874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fdc94102eb0 con 0x7fdc78038720 2024-04-20T21:46:18.155 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.569+0000 7fdc99400700 1 -- 172.21.15.142:0/4265559791 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fdc78038720 msgr2=0x7fdc7803abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:18.155 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.569+0000 7fdc99400700 1 --2- 172.21.15.142:0/4265559791 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fdc78038720 0x7fdc7803abe0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c006fd0 tx=0x7fdc7c006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:18.155 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.569+0000 7fdc99400700 1 -- 172.21.15.142:0/4265559791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc9407ad90 msgr2=0x7fdc9419c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:18.155 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.569+0000 7fdc99400700 1 --2- 172.21.15.142:0/4265559791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc9407ad90 0x7fdc9419c550 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdc84006af0 tx=0x7fdc840047c0 comp rx=0 tx=0).stop 2024-04-20T21:46:18.155 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.569+0000 7fdc99400700 1 -- 172.21.15.142:0/4265559791 shutdown_connections 2024-04-20T21:46:18.155 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.569+0000 7fdc99400700 1 --2- 172.21.15.142:0/4265559791 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fdc78038720 0x7fdc7803abe0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:18.155 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.569+0000 7fdc99400700 1 --2- 172.21.15.142:0/4265559791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc9407ad90 0x7fdc9419c550 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:18.155 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.569+0000 7fdc99400700 1 -- 172.21.15.142:0/4265559791 >> 172.21.15.142:0/4265559791 conn(0x7fdc94101ba0 msgr2=0x7fdc941027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:18.155 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.570+0000 7fdc99400700 1 -- 172.21.15.142:0/4265559791 shutdown_connections 2024-04-20T21:46:18.155 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:16.570+0000 7fdc99400700 1 -- 172.21.15.142:0/4265559791 wait complete. 2024-04-20T21:46:18.155 INFO:teuthology.orchestra.run.smithi142.stdout:Deploying mgr service with default placement... 2024-04-20T21:46:19.020 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:18 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:19.021 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:18 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:19.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-20T21:46:19.667 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.773+0000 7f10f3600700 1 Processor -- start 2024-04-20T21:46:19.668 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.773+0000 7f10f3600700 1 -- start start 2024-04-20T21:46:19.668 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.773+0000 7f10f3600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec07adf0 0x7f10ec079250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:19.668 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.773+0000 7f10f3600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec079820 con 0x7f10ec07adf0 2024-04-20T21:46:19.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.774+0000 7f10f0c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec07adf0 0x7f10ec079250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:19.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.774+0000 7f10f0c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec07adf0 0x7f10ec079250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59524/0 (socket says 172.21.15.142:59524) 2024-04-20T21:46:19.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.774+0000 7f10f0c00700 1 -- 172.21.15.142:0/2428177538 learned_addr learned my addr 172.21.15.142:0/2428177538 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:19.670 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.774+0000 7f10f0c00700 1 -- 172.21.15.142:0/2428177538 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec079960 con 0x7f10ec07adf0 2024-04-20T21:46:19.670 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.775+0000 7f10f0c00700 1 --2- 172.21.15.142:0/2428177538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec07adf0 0x7f10ec079250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f10e00098a0 tx=0x7f10e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3391d1608917dc server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:19.670 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.775+0000 7f10eb400700 1 -- 172.21.15.142:0/2428177538 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f10e0004180 con 0x7f10ec07adf0 2024-04-20T21:46:19.670 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.775+0000 7f10eb400700 1 -- 172.21.15.142:0/2428177538 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f10e00042e0 con 0x7f10ec07adf0 2024-04-20T21:46:19.670 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.775+0000 7f10eb400700 1 -- 172.21.15.142:0/2428177538 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f10e0011b10 con 0x7f10ec07adf0 2024-04-20T21:46:19.672 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.775+0000 7f10f3600700 1 -- 172.21.15.142:0/2428177538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec07adf0 msgr2=0x7f10ec079250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:19.672 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.776+0000 7f10f3600700 1 --2- 172.21.15.142:0/2428177538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec07adf0 0x7f10ec079250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f10e00098a0 tx=0x7f10e0009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:19.672 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.776+0000 7f10f3600700 1 -- 172.21.15.142:0/2428177538 shutdown_connections 2024-04-20T21:46:19.672 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.776+0000 7f10f3600700 1 --2- 172.21.15.142:0/2428177538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec07adf0 0x7f10ec079250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:19.673 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.776+0000 7f10f3600700 1 -- 172.21.15.142:0/2428177538 >> 172.21.15.142:0/2428177538 conn(0x7f10ec101c00 msgr2=0x7f10ec104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:19.673 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.776+0000 7f10f3600700 1 -- 172.21.15.142:0/2428177538 shutdown_connections 2024-04-20T21:46:19.673 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.776+0000 7f10f3600700 1 -- 172.21.15.142:0/2428177538 wait complete. 2024-04-20T21:46:19.673 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.777+0000 7f10f3600700 1 Processor -- start 2024-04-20T21:46:19.673 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.777+0000 7f10f3600700 1 -- start start 2024-04-20T21:46:19.673 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.777+0000 7f10f3600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec07adf0 0x7f10ec1a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:19.673 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.777+0000 7f10f3600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec1a0e80 con 0x7f10ec07adf0 2024-04-20T21:46:19.673 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.778+0000 7f10f0c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec07adf0 0x7f10ec1a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:19.673 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.778+0000 7f10f0c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec07adf0 0x7f10ec1a0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59536/0 (socket says 172.21.15.142:59536) 2024-04-20T21:46:19.673 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.778+0000 7f10f0c00700 1 -- 172.21.15.142:0/3035684196 learned_addr learned my addr 172.21.15.142:0/3035684196 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:19.673 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.778+0000 7f10f0c00700 1 -- 172.21.15.142:0/3035684196 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e0009550 con 0x7f10ec07adf0 2024-04-20T21:46:19.673 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.779+0000 7f10f0c00700 1 --2- 172.21.15.142:0/3035684196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec07adf0 0x7f10ec1a0940 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f10e00117b0 tx=0x7f10e0011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:19.673 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.779+0000 7f10e9600700 1 -- 172.21.15.142:0/3035684196 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f10e00038b0 con 0x7f10ec07adf0 2024-04-20T21:46:19.673 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.779+0000 7f10e9600700 1 -- 172.21.15.142:0/3035684196 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f10e0003a10 con 0x7f10ec07adf0 2024-04-20T21:46:19.676 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.779+0000 7f10f3600700 1 -- 172.21.15.142:0/3035684196 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ec1a1080 con 0x7f10ec07adf0 2024-04-20T21:46:19.676 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.779+0000 7f10f3600700 1 -- 172.21.15.142:0/3035684196 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ec1a1520 con 0x7f10ec07adf0 2024-04-20T21:46:19.676 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.779+0000 7f10e9600700 1 -- 172.21.15.142:0/3035684196 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f10e00246e0 con 0x7f10ec07adf0 2024-04-20T21:46:19.676 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.780+0000 7f10e9600700 1 -- 172.21.15.142:0/3035684196 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f10e002d3f0 con 0x7f10ec07adf0 2024-04-20T21:46:19.676 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.780+0000 7f10f3600700 1 -- 172.21.15.142:0/3035684196 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10cc005320 con 0x7f10ec07adf0 2024-04-20T21:46:19.676 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.781+0000 7f10e9600700 1 --2- 172.21.15.142:0/3035684196 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f10d4038770 0x7f10d403ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:19.677 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.781+0000 7f10e9600700 1 -- 172.21.15.142:0/3035684196 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f10e004c8b0 con 0x7f10ec07adf0 2024-04-20T21:46:19.677 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.781+0000 7f10ebe00700 1 --2- 172.21.15.142:0/3035684196 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f10d4038770 0x7f10d403ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:19.677 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.782+0000 7f10ebe00700 1 --2- 172.21.15.142:0/3035684196 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f10d4038770 0x7f10d403ac30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f10d8006fd0 tx=0x7f10d8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:19.677 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:18.786+0000 7f10e9600700 1 -- 172.21.15.142:0/3035684196 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f10e0010950 con 0x7f10ec07adf0 2024-04-20T21:46:19.677 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:19.021+0000 7f10f3600700 1 -- 172.21.15.142:0/3035684196 --> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f10cc000bf0 con 0x7f10d4038770 2024-04-20T21:46:19.677 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:19.029+0000 7f10e9600700 1 -- 172.21.15.142:0/3035684196 <== mgr.14120 v2:172.21.15.142:6800/550675874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f10cc000bf0 con 0x7f10d4038770 2024-04-20T21:46:19.677 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:19.032+0000 7f10f3600700 1 -- 172.21.15.142:0/3035684196 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f10d4038770 msgr2=0x7f10d403ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:19.677 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:19.032+0000 7f10f3600700 1 --2- 172.21.15.142:0/3035684196 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f10d4038770 0x7f10d403ac30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f10d8006fd0 tx=0x7f10d8006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:19.677 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:19.032+0000 7f10f3600700 1 -- 172.21.15.142:0/3035684196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec07adf0 msgr2=0x7f10ec1a0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:19.677 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:19.032+0000 7f10f3600700 1 --2- 172.21.15.142:0/3035684196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec07adf0 0x7f10ec1a0940 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f10e00117b0 tx=0x7f10e0011890 comp rx=0 tx=0).stop 2024-04-20T21:46:19.677 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:19.032+0000 7f10f3600700 1 -- 172.21.15.142:0/3035684196 shutdown_connections 2024-04-20T21:46:19.678 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:19.032+0000 7f10f3600700 1 --2- 172.21.15.142:0/3035684196 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f10d4038770 0x7f10d403ac30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:19.678 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:19.032+0000 7f10f3600700 1 --2- 172.21.15.142:0/3035684196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10ec07adf0 0x7f10ec1a0940 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:19.678 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:19.032+0000 7f10f3600700 1 -- 172.21.15.142:0/3035684196 >> 172.21.15.142:0/3035684196 conn(0x7f10ec101c00 msgr2=0x7f10ec103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:19.678 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:19.033+0000 7f10f3600700 1 -- 172.21.15.142:0/3035684196 shutdown_connections 2024-04-20T21:46:19.678 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:19.033+0000 7f10f3600700 1 -- 172.21.15.142:0/3035684196 wait complete. 2024-04-20T21:46:19.678 INFO:teuthology.orchestra.run.smithi142.stdout:Deploying crash service with default placement... 2024-04-20T21:46:20.227 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:20 smithi142 ceph-mon[15828]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:46:20.227 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:20 smithi142 ceph-mon[15828]: Saving service mgr spec with placement count:2 2024-04-20T21:46:20.227 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:20 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:21.708 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-04-20T21:46:21.708 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.295+0000 7f2baae00700 1 Processor -- start 2024-04-20T21:46:21.708 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.295+0000 7f2baae00700 1 -- start start 2024-04-20T21:46:21.708 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.295+0000 7f2baae00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ba4108820 0x7f2ba4108c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:21.708 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.295+0000 7f2baae00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba4109210 con 0x7f2ba4108820 2024-04-20T21:46:21.709 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.296+0000 7f2ba3e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ba4108820 0x7f2ba4108c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:21.709 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.296+0000 7f2ba3e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ba4108820 0x7f2ba4108c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59542/0 (socket says 172.21.15.142:59542) 2024-04-20T21:46:21.709 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.296+0000 7f2ba3e00700 1 -- 172.21.15.142:0/568444997 learned_addr learned my addr 172.21.15.142:0/568444997 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:21.709 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.296+0000 7f2ba3e00700 1 -- 172.21.15.142:0/568444997 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba41099d0 con 0x7f2ba4108820 2024-04-20T21:46:21.714 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.296+0000 7f2ba3e00700 1 --2- 172.21.15.142:0/568444997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ba4108820 0x7f2ba4108c40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2b940098a0 tx=0x7f2b94009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb81585ce39ef600 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:21.714 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.297+0000 7f2ba2a00700 1 -- 172.21.15.142:0/568444997 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b94004180 con 0x7f2ba4108820 2024-04-20T21:46:21.714 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.297+0000 7f2ba2a00700 1 -- 172.21.15.142:0/568444997 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b940042e0 con 0x7f2ba4108820 2024-04-20T21:46:21.714 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.297+0000 7f2ba2a00700 1 -- 172.21.15.142:0/568444997 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b94011b10 con 0x7f2ba4108820 2024-04-20T21:46:21.714 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.298+0000 7f2baae00700 1 -- 172.21.15.142:0/568444997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ba4108820 msgr2=0x7f2ba4108c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:21.714 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.298+0000 7f2baae00700 1 --2- 172.21.15.142:0/568444997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ba4108820 0x7f2ba4108c40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2b940098a0 tx=0x7f2b94009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:21.714 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.298+0000 7f2baae00700 1 -- 172.21.15.142:0/568444997 shutdown_connections 2024-04-20T21:46:21.714 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.298+0000 7f2baae00700 1 --2- 172.21.15.142:0/568444997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ba4108820 0x7f2ba4108c40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:21.714 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.298+0000 7f2baae00700 1 -- 172.21.15.142:0/568444997 >> 172.21.15.142:0/568444997 conn(0x7f2ba407bd30 msgr2=0x7f2ba41064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:21.714 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.299+0000 7f2baae00700 1 -- 172.21.15.142:0/568444997 shutdown_connections 2024-04-20T21:46:21.714 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.299+0000 7f2baae00700 1 -- 172.21.15.142:0/568444997 wait complete. 2024-04-20T21:46:21.714 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.300+0000 7f2baae00700 1 Processor -- start 2024-04-20T21:46:21.715 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.300+0000 7f2baae00700 1 -- start start 2024-04-20T21:46:21.715 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.300+0000 7f2baae00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ba4108820 0x7f2ba419c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:21.715 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.300+0000 7f2baae00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba419cb10 con 0x7f2ba4108820 2024-04-20T21:46:21.715 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.300+0000 7f2ba3e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ba4108820 0x7f2ba419c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:21.715 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.300+0000 7f2ba3e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ba4108820 0x7f2ba419c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59554/0 (socket says 172.21.15.142:59554) 2024-04-20T21:46:21.715 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.300+0000 7f2ba3e00700 1 -- 172.21.15.142:0/3285360479 learned_addr learned my addr 172.21.15.142:0/3285360479 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:21.715 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.301+0000 7f2ba3e00700 1 -- 172.21.15.142:0/3285360479 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b94009550 con 0x7f2ba4108820 2024-04-20T21:46:21.715 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.301+0000 7f2ba3e00700 1 --2- 172.21.15.142:0/3285360479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ba4108820 0x7f2ba419c5d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2b94000c00 tx=0x7f2b94011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:21.715 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.302+0000 7f2ba0c00700 1 -- 172.21.15.142:0/3285360479 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b940038b0 con 0x7f2ba4108820 2024-04-20T21:46:21.715 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.302+0000 7f2ba0c00700 1 -- 172.21.15.142:0/3285360479 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b94003a10 con 0x7f2ba4108820 2024-04-20T21:46:21.715 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.302+0000 7f2baae00700 1 -- 172.21.15.142:0/3285360479 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba419cd10 con 0x7f2ba4108820 2024-04-20T21:46:21.715 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.302+0000 7f2ba0c00700 1 -- 172.21.15.142:0/3285360479 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b94024780 con 0x7f2ba4108820 2024-04-20T21:46:21.715 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.302+0000 7f2baae00700 1 -- 172.21.15.142:0/3285360479 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba419d1b0 con 0x7f2ba4108820 2024-04-20T21:46:21.715 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.303+0000 7f2ba0c00700 1 -- 172.21.15.142:0/3285360479 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f2b9402d3f0 con 0x7f2ba4108820 2024-04-20T21:46:21.716 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.303+0000 7f2baae00700 1 -- 172.21.15.142:0/3285360479 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba410cc00 con 0x7f2ba4108820 2024-04-20T21:46:21.716 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.303+0000 7f2ba0c00700 1 --2- 172.21.15.142:0/3285360479 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f2b88038720 0x7f2b8803abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:21.716 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.304+0000 7f2ba0c00700 1 -- 172.21.15.142:0/3285360479 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2b9404c6e0 con 0x7f2ba4108820 2024-04-20T21:46:21.716 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.304+0000 7f2ba3400700 1 --2- 172.21.15.142:0/3285360479 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f2b88038720 0x7f2b8803abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:21.716 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.305+0000 7f2ba3400700 1 --2- 172.21.15.142:0/3285360479 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f2b88038720 0x7f2b8803abe0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2b90006fd0 tx=0x7f2b90006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:21.716 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.309+0000 7f2ba0c00700 1 -- 172.21.15.142:0/3285360479 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f2b9401ac10 con 0x7f2ba4108820 2024-04-20T21:46:21.716 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.549+0000 7f2baae00700 1 -- 172.21.15.142:0/3285360479 --> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ba419fa40 con 0x7f2b88038720 2024-04-20T21:46:21.716 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.557+0000 7f2ba0c00700 1 -- 172.21.15.142:0/3285360479 <== mgr.14120 v2:172.21.15.142:6800/550675874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f2ba419fa40 con 0x7f2b88038720 2024-04-20T21:46:21.716 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.560+0000 7f2baae00700 1 -- 172.21.15.142:0/3285360479 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f2b88038720 msgr2=0x7f2b8803abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:21.716 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.560+0000 7f2baae00700 1 --2- 172.21.15.142:0/3285360479 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f2b88038720 0x7f2b8803abe0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2b90006fd0 tx=0x7f2b90006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:21.716 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.560+0000 7f2baae00700 1 -- 172.21.15.142:0/3285360479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ba4108820 msgr2=0x7f2ba419c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:21.716 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.560+0000 7f2baae00700 1 --2- 172.21.15.142:0/3285360479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ba4108820 0x7f2ba419c5d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2b94000c00 tx=0x7f2b94011890 comp rx=0 tx=0).stop 2024-04-20T21:46:21.716 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.561+0000 7f2baae00700 1 -- 172.21.15.142:0/3285360479 shutdown_connections 2024-04-20T21:46:21.716 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.561+0000 7f2baae00700 1 --2- 172.21.15.142:0/3285360479 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f2b88038720 0x7f2b8803abe0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:21.717 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.561+0000 7f2baae00700 1 --2- 172.21.15.142:0/3285360479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ba4108820 0x7f2ba419c5d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:21.717 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.561+0000 7f2baae00700 1 -- 172.21.15.142:0/3285360479 >> 172.21.15.142:0/3285360479 conn(0x7f2ba407bd30 msgr2=0x7f2ba4105cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:21.717 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.561+0000 7f2baae00700 1 -- 172.21.15.142:0/3285360479 shutdown_connections 2024-04-20T21:46:21.717 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:20.561+0000 7f2baae00700 1 -- 172.21.15.142:0/3285360479 wait complete. 2024-04-20T21:46:21.717 INFO:teuthology.orchestra.run.smithi142.stdout:Deploying ceph-exporter service with default placement... 2024-04-20T21:46:21.861 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:21 smithi142 ceph-mon[15828]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:46:21.861 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:21 smithi142 ceph-mon[15828]: Saving service crash spec with placement * 2024-04-20T21:46:21.861 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:21 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:22.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:22 smithi142 ceph-mon[15828]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:46:22.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:22 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:22.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:22 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:23.300 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-04-20T21:46:23.304 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.343+0000 7f028fe00700 1 Processor -- start 2024-04-20T21:46:23.304 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.343+0000 7f028fe00700 1 -- start start 2024-04-20T21:46:23.304 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.343+0000 7f028fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02881065e0 0x7f0288106a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:23.304 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.343+0000 7f028fe00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0288106fd0 con 0x7f02881065e0 2024-04-20T21:46:23.304 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.344+0000 7f028d400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02881065e0 0x7f0288106a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:23.304 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.344+0000 7f028d400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02881065e0 0x7f0288106a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59566/0 (socket says 172.21.15.142:59566) 2024-04-20T21:46:23.304 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.344+0000 7f028d400700 1 -- 172.21.15.142:0/1099271924 learned_addr learned my addr 172.21.15.142:0/1099271924 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:23.304 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.344+0000 7f028d400700 1 -- 172.21.15.142:0/1099271924 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02881077e0 con 0x7f02881065e0 2024-04-20T21:46:23.304 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.345+0000 7f028d400700 1 --2- 172.21.15.142:0/1099271924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02881065e0 0x7f0288106a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f027c0098a0 tx=0x7f027c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b668397c0f9e43b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:23.304 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.345+0000 7f0287e00700 1 -- 172.21.15.142:0/1099271924 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f027c004180 con 0x7f02881065e0 2024-04-20T21:46:23.305 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.345+0000 7f0287e00700 1 -- 172.21.15.142:0/1099271924 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f027c0042e0 con 0x7f02881065e0 2024-04-20T21:46:23.305 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.345+0000 7f0287e00700 1 -- 172.21.15.142:0/1099271924 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f027c011b10 con 0x7f02881065e0 2024-04-20T21:46:23.305 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.346+0000 7f028fe00700 1 -- 172.21.15.142:0/1099271924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02881065e0 msgr2=0x7f0288106a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:23.305 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.346+0000 7f028fe00700 1 --2- 172.21.15.142:0/1099271924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02881065e0 0x7f0288106a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f027c0098a0 tx=0x7f027c009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:23.305 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.346+0000 7f028fe00700 1 -- 172.21.15.142:0/1099271924 shutdown_connections 2024-04-20T21:46:23.305 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.346+0000 7f028fe00700 1 --2- 172.21.15.142:0/1099271924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02881065e0 0x7f0288106a00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:23.305 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.346+0000 7f028fe00700 1 -- 172.21.15.142:0/1099271924 >> 172.21.15.142:0/1099271924 conn(0x7f0288101c00 msgr2=0x7f0288104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:23.305 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.346+0000 7f028fe00700 1 -- 172.21.15.142:0/1099271924 shutdown_connections 2024-04-20T21:46:23.305 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.346+0000 7f028fe00700 1 -- 172.21.15.142:0/1099271924 wait complete. 2024-04-20T21:46:23.305 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.347+0000 7f028fe00700 1 Processor -- start 2024-04-20T21:46:23.305 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.347+0000 7f028fe00700 1 -- start start 2024-04-20T21:46:23.305 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.348+0000 7f028fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02881065e0 0x7f028819a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:23.305 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.348+0000 7f028fe00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028819a870 con 0x7f02881065e0 2024-04-20T21:46:23.305 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.348+0000 7f028d400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02881065e0 0x7f028819a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:23.305 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.348+0000 7f028d400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02881065e0 0x7f028819a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59570/0 (socket says 172.21.15.142:59570) 2024-04-20T21:46:23.305 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.348+0000 7f028d400700 1 -- 172.21.15.142:0/1600421057 learned_addr learned my addr 172.21.15.142:0/1600421057 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:23.306 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.348+0000 7f028d400700 1 -- 172.21.15.142:0/1600421057 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c009550 con 0x7f02881065e0 2024-04-20T21:46:23.306 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.349+0000 7f028d400700 1 --2- 172.21.15.142:0/1600421057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02881065e0 0x7f028819a330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f027c0117b0 tx=0x7f027c011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:23.306 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.349+0000 7f0286000700 1 -- 172.21.15.142:0/1600421057 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f027c0038b0 con 0x7f02881065e0 2024-04-20T21:46:23.306 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.349+0000 7f0286000700 1 -- 172.21.15.142:0/1600421057 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f027c003a10 con 0x7f02881065e0 2024-04-20T21:46:23.308 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.349+0000 7f0286000700 1 -- 172.21.15.142:0/1600421057 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f027c0246e0 con 0x7f02881065e0 2024-04-20T21:46:23.308 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.349+0000 7f028fe00700 1 -- 172.21.15.142:0/1600421057 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028819aa70 con 0x7f02881065e0 2024-04-20T21:46:23.308 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.349+0000 7f028fe00700 1 -- 172.21.15.142:0/1600421057 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028819af10 con 0x7f02881065e0 2024-04-20T21:46:23.308 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.350+0000 7f0286000700 1 -- 172.21.15.142:0/1600421057 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f027c01a430 con 0x7f02881065e0 2024-04-20T21:46:23.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.351+0000 7f028fe00700 1 -- 172.21.15.142:0/1600421057 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028810aa10 con 0x7f02881065e0 2024-04-20T21:46:23.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.351+0000 7f0286000700 1 --2- 172.21.15.142:0/1600421057 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f0270038770 0x7f027003ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:23.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.351+0000 7f0286000700 1 -- 172.21.15.142:0/1600421057 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f027c04c8d0 con 0x7f02881065e0 2024-04-20T21:46:23.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.351+0000 7f028ca00700 1 --2- 172.21.15.142:0/1600421057 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f0270038770 0x7f027003ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:23.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.352+0000 7f028ca00700 1 --2- 172.21.15.142:0/1600421057 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f0270038770 0x7f027003ac30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0274006fd0 tx=0x7f0274006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:23.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.360+0000 7f0286000700 1 -- 172.21.15.142:0/1600421057 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f027c018b40 con 0x7f02881065e0 2024-04-20T21:46:23.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.599+0000 7f028fe00700 1 -- 172.21.15.142:0/1600421057 --> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f028819d800 con 0x7f0270038770 2024-04-20T21:46:23.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.607+0000 7f0286000700 1 -- 172.21.15.142:0/1600421057 <== mgr.14120 v2:172.21.15.142:6800/550675874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f028819d800 con 0x7f0270038770 2024-04-20T21:46:23.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.610+0000 7f028fe00700 1 -- 172.21.15.142:0/1600421057 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f0270038770 msgr2=0x7f027003ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:23.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.610+0000 7f028fe00700 1 --2- 172.21.15.142:0/1600421057 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f0270038770 0x7f027003ac30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0274006fd0 tx=0x7f0274006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:23.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.610+0000 7f028fe00700 1 -- 172.21.15.142:0/1600421057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02881065e0 msgr2=0x7f028819a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:23.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.610+0000 7f028fe00700 1 --2- 172.21.15.142:0/1600421057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02881065e0 0x7f028819a330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f027c0117b0 tx=0x7f027c011890 comp rx=0 tx=0).stop 2024-04-20T21:46:23.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.610+0000 7f028fe00700 1 -- 172.21.15.142:0/1600421057 shutdown_connections 2024-04-20T21:46:23.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.610+0000 7f028fe00700 1 --2- 172.21.15.142:0/1600421057 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f0270038770 0x7f027003ac30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:23.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.610+0000 7f028fe00700 1 --2- 172.21.15.142:0/1600421057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02881065e0 0x7f028819a330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:23.310 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.610+0000 7f028fe00700 1 -- 172.21.15.142:0/1600421057 >> 172.21.15.142:0/1600421057 conn(0x7f0288101c00 msgr2=0x7f0288102760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:23.310 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.611+0000 7f028fe00700 1 -- 172.21.15.142:0/1600421057 shutdown_connections 2024-04-20T21:46:23.310 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:22.611+0000 7f028fe00700 1 -- 172.21.15.142:0/1600421057 wait complete. 2024-04-20T21:46:23.310 INFO:teuthology.orchestra.run.smithi142.stdout:Deploying prometheus service with default placement... 2024-04-20T21:46:23.865 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:23 smithi142 ceph-mon[15828]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:46:23.865 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:23 smithi142 ceph-mon[15828]: Saving service ceph-exporter spec with placement * 2024-04-20T21:46:23.866 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:23 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:24.839 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-04-20T21:46:24.840 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.866+0000 7ff948800700 1 Processor -- start 2024-04-20T21:46:24.840 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.866+0000 7ff948800700 1 -- start start 2024-04-20T21:46:24.840 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.867+0000 7ff948800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff94007adb0 0x7ff940079210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:24.841 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.867+0000 7ff948800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9400797e0 con 0x7ff94007adb0 2024-04-20T21:46:24.841 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.867+0000 7ff945e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff94007adb0 0x7ff940079210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:24.841 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.867+0000 7ff945e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff94007adb0 0x7ff940079210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59580/0 (socket says 172.21.15.142:59580) 2024-04-20T21:46:24.841 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.867+0000 7ff945e00700 1 -- 172.21.15.142:0/4045321562 learned_addr learned my addr 172.21.15.142:0/4045321562 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:24.841 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.868+0000 7ff945e00700 1 -- 172.21.15.142:0/4045321562 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff940079920 con 0x7ff94007adb0 2024-04-20T21:46:24.843 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.868+0000 7ff945e00700 1 --2- 172.21.15.142:0/4045321562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff94007adb0 0x7ff940079210 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff9340098a0 tx=0x7ff934009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f9bd539a14cba8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:24.843 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.868+0000 7ff944a00700 1 -- 172.21.15.142:0/4045321562 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff934004180 con 0x7ff94007adb0 2024-04-20T21:46:24.843 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.868+0000 7ff944a00700 1 -- 172.21.15.142:0/4045321562 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff9340042e0 con 0x7ff94007adb0 2024-04-20T21:46:24.843 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.868+0000 7ff944a00700 1 -- 172.21.15.142:0/4045321562 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff934011b10 con 0x7ff94007adb0 2024-04-20T21:46:24.843 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.869+0000 7ff948800700 1 -- 172.21.15.142:0/4045321562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff94007adb0 msgr2=0x7ff940079210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:24.843 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.869+0000 7ff948800700 1 --2- 172.21.15.142:0/4045321562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff94007adb0 0x7ff940079210 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff9340098a0 tx=0x7ff934009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:24.843 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.869+0000 7ff948800700 1 -- 172.21.15.142:0/4045321562 shutdown_connections 2024-04-20T21:46:24.843 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.869+0000 7ff948800700 1 --2- 172.21.15.142:0/4045321562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff94007adb0 0x7ff940079210 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:24.843 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.869+0000 7ff948800700 1 -- 172.21.15.142:0/4045321562 >> 172.21.15.142:0/4045321562 conn(0x7ff940101ba0 msgr2=0x7ff940103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:24.844 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.869+0000 7ff948800700 1 -- 172.21.15.142:0/4045321562 shutdown_connections 2024-04-20T21:46:24.844 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.870+0000 7ff948800700 1 -- 172.21.15.142:0/4045321562 wait complete. 2024-04-20T21:46:24.844 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.870+0000 7ff948800700 1 Processor -- start 2024-04-20T21:46:24.846 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.871+0000 7ff948800700 1 -- start start 2024-04-20T21:46:24.846 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.871+0000 7ff948800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff94007adb0 0x7ff94019c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:24.846 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.871+0000 7ff948800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94019cb20 con 0x7ff94007adb0 2024-04-20T21:46:24.846 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.871+0000 7ff945e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff94007adb0 0x7ff94019c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:24.846 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.871+0000 7ff945e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff94007adb0 0x7ff94019c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59584/0 (socket says 172.21.15.142:59584) 2024-04-20T21:46:24.846 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.871+0000 7ff945e00700 1 -- 172.21.15.142:0/2464967490 learned_addr learned my addr 172.21.15.142:0/2464967490 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:24.846 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.872+0000 7ff945e00700 1 -- 172.21.15.142:0/2464967490 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff934009550 con 0x7ff94007adb0 2024-04-20T21:46:24.846 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.872+0000 7ff945e00700 1 --2- 172.21.15.142:0/2464967490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff94007adb0 0x7ff94019c5e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff934000c00 tx=0x7ff934011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:24.846 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.872+0000 7ff93aa00700 1 -- 172.21.15.142:0/2464967490 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9340038b0 con 0x7ff94007adb0 2024-04-20T21:46:24.847 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.872+0000 7ff93aa00700 1 -- 172.21.15.142:0/2464967490 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff934003a10 con 0x7ff94007adb0 2024-04-20T21:46:24.847 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.872+0000 7ff948800700 1 -- 172.21.15.142:0/2464967490 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94019cd20 con 0x7ff94007adb0 2024-04-20T21:46:24.847 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.873+0000 7ff93aa00700 1 -- 172.21.15.142:0/2464967490 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff934024780 con 0x7ff94007adb0 2024-04-20T21:46:24.847 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.873+0000 7ff948800700 1 -- 172.21.15.142:0/2464967490 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94019d1c0 con 0x7ff94007adb0 2024-04-20T21:46:24.847 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.874+0000 7ff948800700 1 -- 172.21.15.142:0/2464967490 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94010c960 con 0x7ff94007adb0 2024-04-20T21:46:24.847 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.874+0000 7ff93aa00700 1 -- 172.21.15.142:0/2464967490 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7ff93401ac10 con 0x7ff94007adb0 2024-04-20T21:46:24.847 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.875+0000 7ff93aa00700 1 --2- 172.21.15.142:0/2464967490 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7ff928038720 0x7ff92803abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:24.847 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.875+0000 7ff93aa00700 1 -- 172.21.15.142:0/2464967490 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff93404c650 con 0x7ff94007adb0 2024-04-20T21:46:24.847 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.875+0000 7ff945400700 1 --2- 172.21.15.142:0/2464967490 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7ff928038720 0x7ff92803abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:24.847 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.876+0000 7ff945400700 1 --2- 172.21.15.142:0/2464967490 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7ff928038720 0x7ff92803abe0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff930006fd0 tx=0x7ff930006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:24.847 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:23.884+0000 7ff93aa00700 1 -- 172.21.15.142:0/2464967490 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7ff934010380 con 0x7ff94007adb0 2024-04-20T21:46:24.849 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:24.119+0000 7ff948800700 1 -- 172.21.15.142:0/2464967490 --> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7ff940102fb0 con 0x7ff928038720 2024-04-20T21:46:24.849 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:24.129+0000 7ff93aa00700 1 -- 172.21.15.142:0/2464967490 <== mgr.14120 v2:172.21.15.142:6800/550675874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7ff940102fb0 con 0x7ff928038720 2024-04-20T21:46:24.849 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:24.132+0000 7ff948800700 1 -- 172.21.15.142:0/2464967490 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7ff928038720 msgr2=0x7ff92803abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:24.849 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:24.132+0000 7ff948800700 1 --2- 172.21.15.142:0/2464967490 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7ff928038720 0x7ff92803abe0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff930006fd0 tx=0x7ff930006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:24.849 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:24.132+0000 7ff948800700 1 -- 172.21.15.142:0/2464967490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff94007adb0 msgr2=0x7ff94019c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:24.849 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:24.132+0000 7ff948800700 1 --2- 172.21.15.142:0/2464967490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff94007adb0 0x7ff94019c5e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff934000c00 tx=0x7ff934011890 comp rx=0 tx=0).stop 2024-04-20T21:46:24.849 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:24.132+0000 7ff948800700 1 -- 172.21.15.142:0/2464967490 shutdown_connections 2024-04-20T21:46:24.849 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:24.132+0000 7ff948800700 1 --2- 172.21.15.142:0/2464967490 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7ff928038720 0x7ff92803abe0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:24.849 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:24.132+0000 7ff948800700 1 --2- 172.21.15.142:0/2464967490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff94007adb0 0x7ff94019c5e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:24.849 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:24.132+0000 7ff948800700 1 -- 172.21.15.142:0/2464967490 >> 172.21.15.142:0/2464967490 conn(0x7ff940101ba0 msgr2=0x7ff940102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:24.849 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:24.132+0000 7ff948800700 1 -- 172.21.15.142:0/2464967490 shutdown_connections 2024-04-20T21:46:24.849 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:24.132+0000 7ff948800700 1 -- 172.21.15.142:0/2464967490 wait complete. 2024-04-20T21:46:24.849 INFO:teuthology.orchestra.run.smithi142.stdout:Deploying grafana service with default placement... 2024-04-20T21:46:25.166 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:24 smithi142 ceph-mon[15828]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:46:25.166 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:24 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:26.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:25 smithi142 ceph-mon[15828]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:46:26.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:25 smithi142 ceph-mon[15828]: Saving service prometheus spec with placement count:1 2024-04-20T21:46:26.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:25 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:26.604 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-04-20T21:46:26.604 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.511+0000 7fad7d600700 1 Processor -- start 2024-04-20T21:46:26.604 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.511+0000 7fad7d600700 1 -- start start 2024-04-20T21:46:26.604 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.511+0000 7fad7d600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad7810d080 0x7fad7810d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:26.604 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.511+0000 7fad7d600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7810da70 con 0x7fad7810d080 2024-04-20T21:46:26.605 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.512+0000 7fad76a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad7810d080 0x7fad7810d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:26.605 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.512+0000 7fad76a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad7810d080 0x7fad7810d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59600/0 (socket says 172.21.15.142:59600) 2024-04-20T21:46:26.605 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.512+0000 7fad76a00700 1 -- 172.21.15.142:0/2614094400 learned_addr learned my addr 172.21.15.142:0/2614094400 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:26.605 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.512+0000 7fad76a00700 1 -- 172.21.15.142:0/2614094400 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7810de00 con 0x7fad7810d080 2024-04-20T21:46:26.605 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.512+0000 7fad76a00700 1 --2- 172.21.15.142:0/2614094400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad7810d080 0x7fad7810d4a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fad680098a0 tx=0x7fad68009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33418d1d5c515a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:26.605 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.513+0000 7fad75600700 1 -- 172.21.15.142:0/2614094400 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad68004180 con 0x7fad7810d080 2024-04-20T21:46:26.605 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.513+0000 7fad75600700 1 -- 172.21.15.142:0/2614094400 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad680042e0 con 0x7fad7810d080 2024-04-20T21:46:26.605 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.513+0000 7fad75600700 1 -- 172.21.15.142:0/2614094400 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad68011b10 con 0x7fad7810d080 2024-04-20T21:46:26.605 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.513+0000 7fad7d600700 1 -- 172.21.15.142:0/2614094400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad7810d080 msgr2=0x7fad7810d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:26.605 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.513+0000 7fad7d600700 1 --2- 172.21.15.142:0/2614094400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad7810d080 0x7fad7810d4a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fad680098a0 tx=0x7fad68009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:26.605 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.513+0000 7fad7d600700 1 -- 172.21.15.142:0/2614094400 shutdown_connections 2024-04-20T21:46:26.605 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.513+0000 7fad7d600700 1 --2- 172.21.15.142:0/2614094400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad7810d080 0x7fad7810d4a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:26.605 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.513+0000 7fad7d600700 1 -- 172.21.15.142:0/2614094400 >> 172.21.15.142:0/2614094400 conn(0x7fad7807bbf0 msgr2=0x7fad7807e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:26.605 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.513+0000 7fad7d600700 1 -- 172.21.15.142:0/2614094400 shutdown_connections 2024-04-20T21:46:26.605 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.514+0000 7fad7d600700 1 -- 172.21.15.142:0/2614094400 wait complete. 2024-04-20T21:46:26.605 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.515+0000 7fad7d600700 1 Processor -- start 2024-04-20T21:46:26.606 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.515+0000 7fad7d600700 1 -- start start 2024-04-20T21:46:26.606 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.515+0000 7fad7d600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad7810d080 0x7fad781a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:26.606 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.515+0000 7fad7d600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad781a0ed0 con 0x7fad7810d080 2024-04-20T21:46:26.606 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.515+0000 7fad76a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad7810d080 0x7fad781a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:26.606 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.515+0000 7fad76a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad7810d080 0x7fad781a0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59614/0 (socket says 172.21.15.142:59614) 2024-04-20T21:46:26.606 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.515+0000 7fad76a00700 1 -- 172.21.15.142:0/1678811578 learned_addr learned my addr 172.21.15.142:0/1678811578 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:26.606 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.516+0000 7fad76a00700 1 -- 172.21.15.142:0/1678811578 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad68009550 con 0x7fad7810d080 2024-04-20T21:46:26.606 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.516+0000 7fad76a00700 1 --2- 172.21.15.142:0/1678811578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad7810d080 0x7fad781a0990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fad680117b0 tx=0x7fad68011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:26.606 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.516+0000 7fad6f400700 1 -- 172.21.15.142:0/1678811578 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad680038b0 con 0x7fad7810d080 2024-04-20T21:46:26.606 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.516+0000 7fad6f400700 1 -- 172.21.15.142:0/1678811578 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad68003a10 con 0x7fad7810d080 2024-04-20T21:46:26.606 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.516+0000 7fad6f400700 1 -- 172.21.15.142:0/1678811578 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad680246e0 con 0x7fad7810d080 2024-04-20T21:46:26.606 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.516+0000 7fad7d600700 1 -- 172.21.15.142:0/1678811578 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad781a10d0 con 0x7fad7810d080 2024-04-20T21:46:26.606 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.516+0000 7fad7d600700 1 -- 172.21.15.142:0/1678811578 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad781a1570 con 0x7fad7810d080 2024-04-20T21:46:26.606 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.517+0000 7fad6f400700 1 -- 172.21.15.142:0/1678811578 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fad6801ab80 con 0x7fad7810d080 2024-04-20T21:46:26.606 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.518+0000 7fad7d600700 1 -- 172.21.15.142:0/1678811578 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad78111030 con 0x7fad7810d080 2024-04-20T21:46:26.607 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.518+0000 7fad6f400700 1 --2- 172.21.15.142:0/1678811578 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fad5c038720 0x7fad5c03abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:26.607 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.518+0000 7fad6f400700 1 -- 172.21.15.142:0/1678811578 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fad6804c920 con 0x7fad7810d080 2024-04-20T21:46:26.607 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.518+0000 7fad76000700 1 --2- 172.21.15.142:0/1678811578 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fad5c038720 0x7fad5c03abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:26.607 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.519+0000 7fad76000700 1 --2- 172.21.15.142:0/1678811578 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fad5c038720 0x7fad5c03abe0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fad64006fd0 tx=0x7fad64006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:26.607 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.523+0000 7fad6f400700 1 -- 172.21.15.142:0/1678811578 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fad68010380 con 0x7fad7810d080 2024-04-20T21:46:26.607 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.761+0000 7fad7d600700 1 -- 172.21.15.142:0/1678811578 --> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fad7807ce20 con 0x7fad5c038720 2024-04-20T21:46:26.607 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.771+0000 7fad6f400700 1 -- 172.21.15.142:0/1678811578 <== mgr.14120 v2:172.21.15.142:6800/550675874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fad7807ce20 con 0x7fad5c038720 2024-04-20T21:46:26.607 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.774+0000 7fad7d600700 1 -- 172.21.15.142:0/1678811578 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fad5c038720 msgr2=0x7fad5c03abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:26.607 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.774+0000 7fad7d600700 1 --2- 172.21.15.142:0/1678811578 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fad5c038720 0x7fad5c03abe0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fad64006fd0 tx=0x7fad64006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:26.607 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.774+0000 7fad7d600700 1 -- 172.21.15.142:0/1678811578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad7810d080 msgr2=0x7fad781a0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:26.607 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.774+0000 7fad7d600700 1 --2- 172.21.15.142:0/1678811578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad7810d080 0x7fad781a0990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fad680117b0 tx=0x7fad68011890 comp rx=0 tx=0).stop 2024-04-20T21:46:26.607 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.774+0000 7fad7d600700 1 -- 172.21.15.142:0/1678811578 shutdown_connections 2024-04-20T21:46:26.607 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.774+0000 7fad7d600700 1 --2- 172.21.15.142:0/1678811578 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fad5c038720 0x7fad5c03abe0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:26.607 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.774+0000 7fad7d600700 1 --2- 172.21.15.142:0/1678811578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad7810d080 0x7fad781a0990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:26.608 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.774+0000 7fad7d600700 1 -- 172.21.15.142:0/1678811578 >> 172.21.15.142:0/1678811578 conn(0x7fad7807bbf0 msgr2=0x7fad7807c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:26.608 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.774+0000 7fad7d600700 1 -- 172.21.15.142:0/1678811578 shutdown_connections 2024-04-20T21:46:26.608 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:25.774+0000 7fad7d600700 1 -- 172.21.15.142:0/1678811578 wait complete. 2024-04-20T21:46:26.608 INFO:teuthology.orchestra.run.smithi142.stdout:Deploying node-exporter service with default placement... 2024-04-20T21:46:27.168 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:26 smithi142 ceph-mon[15828]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:46:27.168 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:26 smithi142 ceph-mon[15828]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:46:27.168 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:26 smithi142 ceph-mon[15828]: Saving service grafana spec with placement count:1 2024-04-20T21:46:28.507 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-04-20T21:46:28.509 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.692+0000 7f3e48c00700 1 Processor -- start 2024-04-20T21:46:28.509 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.692+0000 7f3e48c00700 1 -- start start 2024-04-20T21:46:28.510 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.692+0000 7f3e48c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e441087b0 0x7f3e44108bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:28.510 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.692+0000 7f3e48c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e441091a0 con 0x7f3e441087b0 2024-04-20T21:46:28.510 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.693+0000 7f3e41e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e441087b0 0x7f3e44108bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:28.510 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.693+0000 7f3e41e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e441087b0 0x7f3e44108bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45516/0 (socket says 172.21.15.142:45516) 2024-04-20T21:46:28.510 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.693+0000 7f3e41e00700 1 -- 172.21.15.142:0/1025849165 learned_addr learned my addr 172.21.15.142:0/1025849165 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:28.510 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.693+0000 7f3e41e00700 1 -- 172.21.15.142:0/1025849165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e441099b0 con 0x7f3e441087b0 2024-04-20T21:46:28.510 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.693+0000 7f3e41e00700 1 --2- 172.21.15.142:0/1025849165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e441087b0 0x7f3e44108bd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009e80 tx=0x7f3e3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a94687d006084d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:28.511 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.694+0000 7f3e41400700 1 -- 172.21.15.142:0/1025849165 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e3400e070 con 0x7f3e441087b0 2024-04-20T21:46:28.511 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.694+0000 7f3e41400700 1 -- 172.21.15.142:0/1025849165 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3e3400b8c0 con 0x7f3e441087b0 2024-04-20T21:46:28.511 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.694+0000 7f3e41400700 1 -- 172.21.15.142:0/1025849165 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e340044d0 con 0x7f3e441087b0 2024-04-20T21:46:28.511 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.694+0000 7f3e48c00700 1 -- 172.21.15.142:0/1025849165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e441087b0 msgr2=0x7f3e44108bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:28.511 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.694+0000 7f3e48c00700 1 --2- 172.21.15.142:0/1025849165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e441087b0 0x7f3e44108bd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009e80 tx=0x7f3e3400b330 comp rx=0 tx=0).stop 2024-04-20T21:46:28.511 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.694+0000 7f3e48c00700 1 -- 172.21.15.142:0/1025849165 shutdown_connections 2024-04-20T21:46:28.511 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.694+0000 7f3e48c00700 1 --2- 172.21.15.142:0/1025849165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e441087b0 0x7f3e44108bd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:28.512 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.695+0000 7f3e48c00700 1 -- 172.21.15.142:0/1025849165 >> 172.21.15.142:0/1025849165 conn(0x7f3e4407bbf0 msgr2=0x7f3e441064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:28.516 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.695+0000 7f3e48c00700 1 -- 172.21.15.142:0/1025849165 shutdown_connections 2024-04-20T21:46:28.516 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.695+0000 7f3e48c00700 1 -- 172.21.15.142:0/1025849165 wait complete. 2024-04-20T21:46:28.516 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.696+0000 7f3e48c00700 1 Processor -- start 2024-04-20T21:46:28.516 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.696+0000 7f3e48c00700 1 -- start start 2024-04-20T21:46:28.516 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.696+0000 7f3e48c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e441087b0 0x7f3e4419c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:28.516 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.696+0000 7f3e48c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4419ca00 con 0x7f3e441087b0 2024-04-20T21:46:28.516 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.696+0000 7f3e41e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e441087b0 0x7f3e4419c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:28.517 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.696+0000 7f3e41e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e441087b0 0x7f3e4419c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45522/0 (socket says 172.21.15.142:45522) 2024-04-20T21:46:28.517 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.696+0000 7f3e41e00700 1 -- 172.21.15.142:0/2860706264 learned_addr learned my addr 172.21.15.142:0/2860706264 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:28.517 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.697+0000 7f3e41e00700 1 -- 172.21.15.142:0/2860706264 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e34009b30 con 0x7f3e441087b0 2024-04-20T21:46:28.517 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.697+0000 7f3e41e00700 1 --2- 172.21.15.142:0/2860706264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e441087b0 0x7f3e4419c4c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3e34000f80 tx=0x7f3e3400bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:28.517 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.697+0000 7f3e3b400700 1 -- 172.21.15.142:0/2860706264 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e3400e040 con 0x7f3e441087b0 2024-04-20T21:46:28.517 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.697+0000 7f3e3b400700 1 -- 172.21.15.142:0/2860706264 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3e34003c30 con 0x7f3e441087b0 2024-04-20T21:46:28.517 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.697+0000 7f3e48c00700 1 -- 172.21.15.142:0/2860706264 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4419cc00 con 0x7f3e441087b0 2024-04-20T21:46:28.517 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.697+0000 7f3e3b400700 1 -- 172.21.15.142:0/2860706264 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e34012670 con 0x7f3e441087b0 2024-04-20T21:46:28.517 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.697+0000 7f3e48c00700 1 -- 172.21.15.142:0/2860706264 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4419d100 con 0x7f3e441087b0 2024-04-20T21:46:28.517 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.699+0000 7f3e3b400700 1 -- 172.21.15.142:0/2860706264 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f3e34019040 con 0x7f3e441087b0 2024-04-20T21:46:28.517 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.699+0000 7f3e38c00700 1 -- 172.21.15.142:0/2860706264 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e180052f0 con 0x7f3e441087b0 2024-04-20T21:46:28.517 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.699+0000 7f3e3b400700 1 --2- 172.21.15.142:0/2860706264 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f3e24038770 0x7f3e2403ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:28.518 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.699+0000 7f3e3b400700 1 -- 172.21.15.142:0/2860706264 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3e3404c140 con 0x7f3e441087b0 2024-04-20T21:46:28.518 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.699+0000 7f3e33e00700 1 --2- 172.21.15.142:0/2860706264 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f3e24038770 0x7f3e2403ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:28.518 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.700+0000 7f3e33e00700 1 --2- 172.21.15.142:0/2860706264 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f3e24038770 0x7f3e2403ac30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c006fd0 tx=0x7f3e2c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:28.518 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.705+0000 7f3e3b400700 1 -- 172.21.15.142:0/2860706264 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f3e34003da0 con 0x7f3e441087b0 2024-04-20T21:46:28.518 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.937+0000 7f3e38c00700 1 -- 172.21.15.142:0/2860706264 --> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e18000bc0 con 0x7f3e24038770 2024-04-20T21:46:28.518 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.947+0000 7f3e3b400700 1 -- 172.21.15.142:0/2860706264 <== mgr.14120 v2:172.21.15.142:6800/550675874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f3e18000bc0 con 0x7f3e24038770 2024-04-20T21:46:28.518 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.950+0000 7f3e38c00700 1 -- 172.21.15.142:0/2860706264 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f3e24038770 msgr2=0x7f3e2403ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:28.518 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.950+0000 7f3e38c00700 1 --2- 172.21.15.142:0/2860706264 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f3e24038770 0x7f3e2403ac30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c006fd0 tx=0x7f3e2c006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:28.518 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.950+0000 7f3e38c00700 1 -- 172.21.15.142:0/2860706264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e441087b0 msgr2=0x7f3e4419c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:28.518 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.950+0000 7f3e38c00700 1 --2- 172.21.15.142:0/2860706264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e441087b0 0x7f3e4419c4c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3e34000f80 tx=0x7f3e3400bd10 comp rx=0 tx=0).stop 2024-04-20T21:46:28.519 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.950+0000 7f3e38c00700 1 -- 172.21.15.142:0/2860706264 shutdown_connections 2024-04-20T21:46:28.519 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.950+0000 7f3e38c00700 1 --2- 172.21.15.142:0/2860706264 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f3e24038770 0x7f3e2403ac30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:28.519 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.950+0000 7f3e38c00700 1 --2- 172.21.15.142:0/2860706264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e441087b0 0x7f3e4419c4c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:28.519 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.950+0000 7f3e38c00700 1 -- 172.21.15.142:0/2860706264 >> 172.21.15.142:0/2860706264 conn(0x7f3e4407bbf0 msgr2=0x7f3e44105c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:28.519 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.950+0000 7f3e38c00700 1 -- 172.21.15.142:0/2860706264 shutdown_connections 2024-04-20T21:46:28.519 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:27.950+0000 7f3e38c00700 1 -- 172.21.15.142:0/2860706264 wait complete. 2024-04-20T21:46:28.519 INFO:teuthology.orchestra.run.smithi142.stdout:Deploying alertmanager service with default placement... 2024-04-20T21:46:29.148 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:28 smithi142 ceph-mon[15828]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:46:29.148 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:28 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:30.138 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:29 smithi142 ceph-mon[15828]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:46:30.139 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:29 smithi142 ceph-mon[15828]: Saving service node-exporter spec with placement * 2024-04-20T21:46:30.139 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:29 smithi142 ceph-mon[15828]: from='mgr.14120 172.21.15.142:0/1348740072' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:30.156 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-04-20T21:46:30.156 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.149+0000 7f17a7800700 1 Processor -- start 2024-04-20T21:46:30.156 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.149+0000 7f17a7800700 1 -- start start 2024-04-20T21:46:30.157 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.150+0000 7f17a7800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a010d080 0x7f17a010d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:30.157 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.150+0000 7f17a7800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a010da70 con 0x7f17a010d080 2024-04-20T21:46:30.157 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.150+0000 7f17a4e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a010d080 0x7f17a010d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:30.157 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.150+0000 7f17a4e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a010d080 0x7f17a010d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45526/0 (socket says 172.21.15.142:45526) 2024-04-20T21:46:30.157 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.150+0000 7f17a4e00700 1 -- 172.21.15.142:0/1472856992 learned_addr learned my addr 172.21.15.142:0/1472856992 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:30.157 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.151+0000 7f17a4e00700 1 -- 172.21.15.142:0/1472856992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a010de00 con 0x7f17a010d080 2024-04-20T21:46:30.157 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.151+0000 7f17a4e00700 1 --2- 172.21.15.142:0/1472856992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a010d080 0x7f17a010d4a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f17940098a0 tx=0x7f1794009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ccbf0b3ef4e18 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:30.157 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.151+0000 7f179f400700 1 -- 172.21.15.142:0/1472856992 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1794004180 con 0x7f17a010d080 2024-04-20T21:46:30.157 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.151+0000 7f179f400700 1 -- 172.21.15.142:0/1472856992 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17940042e0 con 0x7f17a010d080 2024-04-20T21:46:30.157 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.151+0000 7f179f400700 1 -- 172.21.15.142:0/1472856992 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1794011b10 con 0x7f17a010d080 2024-04-20T21:46:30.157 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.152+0000 7f17a7800700 1 -- 172.21.15.142:0/1472856992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a010d080 msgr2=0x7f17a010d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:30.157 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.152+0000 7f17a7800700 1 --2- 172.21.15.142:0/1472856992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a010d080 0x7f17a010d4a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f17940098a0 tx=0x7f1794009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:30.157 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.152+0000 7f17a7800700 1 -- 172.21.15.142:0/1472856992 shutdown_connections 2024-04-20T21:46:30.157 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.152+0000 7f17a7800700 1 --2- 172.21.15.142:0/1472856992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a010d080 0x7f17a010d4a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:30.158 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.152+0000 7f17a7800700 1 -- 172.21.15.142:0/1472856992 >> 172.21.15.142:0/1472856992 conn(0x7f17a007bbf0 msgr2=0x7f17a007e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:30.158 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.152+0000 7f17a7800700 1 -- 172.21.15.142:0/1472856992 shutdown_connections 2024-04-20T21:46:30.158 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.152+0000 7f17a7800700 1 -- 172.21.15.142:0/1472856992 wait complete. 2024-04-20T21:46:30.158 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.153+0000 7f17a7800700 1 Processor -- start 2024-04-20T21:46:30.158 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.154+0000 7f17a7800700 1 -- start start 2024-04-20T21:46:30.158 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.154+0000 7f17a7800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a010d080 0x7f17a01a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:30.158 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.154+0000 7f17a7800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a01a0ed0 con 0x7f17a010d080 2024-04-20T21:46:30.158 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.154+0000 7f17a4e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a010d080 0x7f17a01a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:30.158 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.154+0000 7f17a4e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a010d080 0x7f17a01a0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45536/0 (socket says 172.21.15.142:45536) 2024-04-20T21:46:30.158 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.154+0000 7f17a4e00700 1 -- 172.21.15.142:0/3598557540 learned_addr learned my addr 172.21.15.142:0/3598557540 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:30.158 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.155+0000 7f17a4e00700 1 -- 172.21.15.142:0/3598557540 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1794009550 con 0x7f17a010d080 2024-04-20T21:46:30.158 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.155+0000 7f17a4e00700 1 --2- 172.21.15.142:0/3598557540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a010d080 0x7f17a01a0990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f17940117b0 tx=0x7f1794011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:30.158 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.155+0000 7f179d600700 1 -- 172.21.15.142:0/3598557540 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17940038b0 con 0x7f17a010d080 2024-04-20T21:46:30.158 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.155+0000 7f179d600700 1 -- 172.21.15.142:0/3598557540 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1794003a10 con 0x7f17a010d080 2024-04-20T21:46:30.159 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.155+0000 7f17a7800700 1 -- 172.21.15.142:0/3598557540 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a01a10d0 con 0x7f17a010d080 2024-04-20T21:46:30.159 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.155+0000 7f179d600700 1 -- 172.21.15.142:0/3598557540 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17940246e0 con 0x7f17a010d080 2024-04-20T21:46:30.159 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.155+0000 7f17a7800700 1 -- 172.21.15.142:0/3598557540 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a01a1570 con 0x7f17a010d080 2024-04-20T21:46:30.159 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.156+0000 7f17a7800700 1 -- 172.21.15.142:0/3598557540 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a0111030 con 0x7f17a010d080 2024-04-20T21:46:30.159 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.156+0000 7f179d600700 1 -- 172.21.15.142:0/3598557540 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f179401ab80 con 0x7f17a010d080 2024-04-20T21:46:30.159 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.157+0000 7f179d600700 1 --2- 172.21.15.142:0/3598557540 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f1788038770 0x7f178803ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:30.159 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.157+0000 7f179d600700 1 -- 172.21.15.142:0/3598557540 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f179404c9c0 con 0x7f17a010d080 2024-04-20T21:46:30.159 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.157+0000 7f179fe00700 1 --2- 172.21.15.142:0/3598557540 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f1788038770 0x7f178803ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:30.159 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.158+0000 7f179fe00700 1 --2- 172.21.15.142:0/3598557540 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f1788038770 0x7f178803ac30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f178c006fd0 tx=0x7f178c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:30.159 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.162+0000 7f179d600700 1 -- 172.21.15.142:0/3598557540 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f1794010380 con 0x7f17a010d080 2024-04-20T21:46:30.159 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.393+0000 7f17a7800700 1 -- 172.21.15.142:0/3598557540 --> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f17a01a3e10 con 0x7f1788038770 2024-04-20T21:46:30.159 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.404+0000 7f179d600700 1 -- 172.21.15.142:0/3598557540 <== mgr.14120 v2:172.21.15.142:6800/550675874 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f17a01a3e10 con 0x7f1788038770 2024-04-20T21:46:30.159 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.406+0000 7f17a7800700 1 -- 172.21.15.142:0/3598557540 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f1788038770 msgr2=0x7f178803ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:30.159 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.406+0000 7f17a7800700 1 --2- 172.21.15.142:0/3598557540 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f1788038770 0x7f178803ac30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f178c006fd0 tx=0x7f178c006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:30.160 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.406+0000 7f17a7800700 1 -- 172.21.15.142:0/3598557540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a010d080 msgr2=0x7f17a01a0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:30.160 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.406+0000 7f17a7800700 1 --2- 172.21.15.142:0/3598557540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a010d080 0x7f17a01a0990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f17940117b0 tx=0x7f1794011890 comp rx=0 tx=0).stop 2024-04-20T21:46:30.160 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.407+0000 7f17a7800700 1 -- 172.21.15.142:0/3598557540 shutdown_connections 2024-04-20T21:46:30.160 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.407+0000 7f17a7800700 1 --2- 172.21.15.142:0/3598557540 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f1788038770 0x7f178803ac30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:30.160 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.407+0000 7f17a7800700 1 --2- 172.21.15.142:0/3598557540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17a010d080 0x7f17a01a0990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:30.160 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.407+0000 7f17a7800700 1 -- 172.21.15.142:0/3598557540 >> 172.21.15.142:0/3598557540 conn(0x7f17a007bbf0 msgr2=0x7f17a007c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:30.160 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.407+0000 7f17a7800700 1 -- 172.21.15.142:0/3598557540 shutdown_connections 2024-04-20T21:46:30.160 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:29.407+0000 7f17a7800700 1 -- 172.21.15.142:0/3598557540 wait complete. 2024-04-20T21:46:31.017 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:30 smithi142 ceph-mon[15828]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:46:31.017 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:30 smithi142 ceph-mon[15828]: Saving service alertmanager spec with placement count:1 2024-04-20T21:46:31.018 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:30 smithi142 ceph-mon[15828]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:46:31.704 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.761+0000 7f3a64200700 1 Processor -- start 2024-04-20T21:46:31.704 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.761+0000 7f3a64200700 1 -- start start 2024-04-20T21:46:31.705 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.761+0000 7f3a64200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a5c104e50 0x7f3a5c105270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:31.705 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.761+0000 7f3a64200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c074770 con 0x7f3a5c104e50 2024-04-20T21:46:31.705 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.762+0000 7f3a61800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a5c104e50 0x7f3a5c105270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:31.705 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.762+0000 7f3a61800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a5c104e50 0x7f3a5c105270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45540/0 (socket says 172.21.15.142:45540) 2024-04-20T21:46:31.705 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.762+0000 7f3a61800700 1 -- 172.21.15.142:0/2176649319 learned_addr learned my addr 172.21.15.142:0/2176649319 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:31.705 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.762+0000 7f3a61800700 1 -- 172.21.15.142:0/2176649319 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c1057b0 con 0x7f3a5c104e50 2024-04-20T21:46:31.705 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.763+0000 7f3a61800700 1 --2- 172.21.15.142:0/2176649319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a5c104e50 0x7f3a5c105270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0098a0 tx=0x7f3a4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d4d758edbb8412 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:31.705 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.763+0000 7f3a5be00700 1 -- 172.21.15.142:0/2176649319 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a4c004180 con 0x7f3a5c104e50 2024-04-20T21:46:31.705 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.763+0000 7f3a5be00700 1 -- 172.21.15.142:0/2176649319 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a4c0042e0 con 0x7f3a5c104e50 2024-04-20T21:46:31.706 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.763+0000 7f3a5be00700 1 -- 172.21.15.142:0/2176649319 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a4c011b10 con 0x7f3a5c104e50 2024-04-20T21:46:31.706 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.763+0000 7f3a64200700 1 -- 172.21.15.142:0/2176649319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a5c104e50 msgr2=0x7f3a5c105270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:31.706 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.763+0000 7f3a64200700 1 --2- 172.21.15.142:0/2176649319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a5c104e50 0x7f3a5c105270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0098a0 tx=0x7f3a4c009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:31.706 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.764+0000 7f3a64200700 1 -- 172.21.15.142:0/2176649319 shutdown_connections 2024-04-20T21:46:31.706 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.764+0000 7f3a64200700 1 --2- 172.21.15.142:0/2176649319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a5c104e50 0x7f3a5c105270 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:31.706 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.764+0000 7f3a64200700 1 -- 172.21.15.142:0/2176649319 >> 172.21.15.142:0/2176649319 conn(0x7f3a5c100a50 msgr2=0x7f3a5c102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:31.706 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.764+0000 7f3a64200700 1 -- 172.21.15.142:0/2176649319 shutdown_connections 2024-04-20T21:46:31.706 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.764+0000 7f3a64200700 1 -- 172.21.15.142:0/2176649319 wait complete. 2024-04-20T21:46:31.706 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.765+0000 7f3a64200700 1 Processor -- start 2024-04-20T21:46:31.706 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.765+0000 7f3a64200700 1 -- start start 2024-04-20T21:46:31.706 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.765+0000 7f3a64200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a5c104e50 0x7f3a5c19c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:31.706 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.765+0000 7f3a64200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c19ca60 con 0x7f3a5c104e50 2024-04-20T21:46:31.706 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.766+0000 7f3a61800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a5c104e50 0x7f3a5c19c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:31.707 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.766+0000 7f3a61800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a5c104e50 0x7f3a5c19c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45548/0 (socket says 172.21.15.142:45548) 2024-04-20T21:46:31.707 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.766+0000 7f3a61800700 1 -- 172.21.15.142:0/367299339 learned_addr learned my addr 172.21.15.142:0/367299339 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:31.707 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.766+0000 7f3a61800700 1 -- 172.21.15.142:0/367299339 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c009550 con 0x7f3a5c104e50 2024-04-20T21:46:31.707 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.766+0000 7f3a61800700 1 --2- 172.21.15.142:0/367299339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a5c104e50 0x7f3a5c19c520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c009fb0 tx=0x7f3a4c011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:31.707 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.767+0000 7f3a5a000700 1 -- 172.21.15.142:0/367299339 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a4c0038b0 con 0x7f3a5c104e50 2024-04-20T21:46:31.707 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.767+0000 7f3a5a000700 1 -- 172.21.15.142:0/367299339 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a4c003a10 con 0x7f3a5c104e50 2024-04-20T21:46:31.707 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.767+0000 7f3a5a000700 1 -- 172.21.15.142:0/367299339 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a4c019750 con 0x7f3a5c104e50 2024-04-20T21:46:31.707 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.767+0000 7f3a64200700 1 -- 172.21.15.142:0/367299339 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5c19cc60 con 0x7f3a5c104e50 2024-04-20T21:46:31.707 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.767+0000 7f3a64200700 1 -- 172.21.15.142:0/367299339 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5c19d100 con 0x7f3a5c104e50 2024-04-20T21:46:31.707 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.768+0000 7f3a64200700 1 -- 172.21.15.142:0/367299339 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a5c196270 con 0x7f3a5c104e50 2024-04-20T21:46:31.707 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.768+0000 7f3a5a000700 1 -- 172.21.15.142:0/367299339 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f3a4c01ac10 con 0x7f3a5c104e50 2024-04-20T21:46:31.707 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.769+0000 7f3a5a000700 1 --2- 172.21.15.142:0/367299339 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f3a40038780 0x7f3a4003ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:31.707 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.769+0000 7f3a5a000700 1 -- 172.21.15.142:0/367299339 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3a4c04c8a0 con 0x7f3a5c104e50 2024-04-20T21:46:31.708 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.769+0000 7f3a60e00700 1 --2- 172.21.15.142:0/367299339 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f3a40038780 0x7f3a4003ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:31.708 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.770+0000 7f3a60e00700 1 --2- 172.21.15.142:0/367299339 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f3a40038780 0x7f3a4003ac40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3a48006fd0 tx=0x7f3a48006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:31.708 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.774+0000 7f3a5a000700 1 -- 172.21.15.142:0/367299339 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f3a4c0198b0 con 0x7f3a5c104e50 2024-04-20T21:46:31.708 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.992+0000 7f3a64200700 1 -- 172.21.15.142:0/367299339 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f3a5c02cf40 con 0x7f3a5c104e50 2024-04-20T21:46:31.708 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:30.997+0000 7f3a5a000700 1 -- 172.21.15.142:0/367299339 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f3a4c022310 con 0x7f3a5c104e50 2024-04-20T21:46:31.708 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:31.000+0000 7f3a64200700 1 -- 172.21.15.142:0/367299339 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f3a40038780 msgr2=0x7f3a4003ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:31.708 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:31.000+0000 7f3a64200700 1 --2- 172.21.15.142:0/367299339 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f3a40038780 0x7f3a4003ac40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3a48006fd0 tx=0x7f3a48006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:31.708 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:31.000+0000 7f3a64200700 1 -- 172.21.15.142:0/367299339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a5c104e50 msgr2=0x7f3a5c19c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:31.708 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:31.000+0000 7f3a64200700 1 --2- 172.21.15.142:0/367299339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a5c104e50 0x7f3a5c19c520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c009fb0 tx=0x7f3a4c011890 comp rx=0 tx=0).stop 2024-04-20T21:46:31.709 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:31.000+0000 7f3a64200700 1 -- 172.21.15.142:0/367299339 shutdown_connections 2024-04-20T21:46:31.709 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:31.000+0000 7f3a64200700 1 --2- 172.21.15.142:0/367299339 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f3a40038780 0x7f3a4003ac40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:31.709 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:31.000+0000 7f3a64200700 1 --2- 172.21.15.142:0/367299339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a5c104e50 0x7f3a5c19c520 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:31.709 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:31.000+0000 7f3a64200700 1 -- 172.21.15.142:0/367299339 >> 172.21.15.142:0/367299339 conn(0x7f3a5c100a50 msgr2=0x7f3a5c1933b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:31.709 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:31.000+0000 7f3a64200700 1 -- 172.21.15.142:0/367299339 shutdown_connections 2024-04-20T21:46:31.709 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:31.000+0000 7f3a64200700 1 -- 172.21.15.142:0/367299339 wait complete. 2024-04-20T21:46:32.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:32 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/367299339' entity='client.admin' 2024-04-20T21:46:32.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:32 smithi142 ceph-mon[15828]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:46:33.225 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.328+0000 7f30c0600700 1 Processor -- start 2024-04-20T21:46:33.225 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.329+0000 7f30c0600700 1 -- start start 2024-04-20T21:46:33.225 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.329+0000 7f30c0600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b810d130 0x7f30b810d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:33.225 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.329+0000 7f30c0600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b810db20 con 0x7f30b810d130 2024-04-20T21:46:33.225 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.329+0000 7f30bdc00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b810d130 0x7f30b810d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:33.225 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.329+0000 7f30bdc00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b810d130 0x7f30b810d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45554/0 (socket says 172.21.15.142:45554) 2024-04-20T21:46:33.225 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.329+0000 7f30bdc00700 1 -- 172.21.15.142:0/2410754268 learned_addr learned my addr 172.21.15.142:0/2410754268 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:33.225 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.330+0000 7f30bdc00700 1 -- 172.21.15.142:0/2410754268 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b810dda0 con 0x7f30b810d130 2024-04-20T21:46:33.225 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.330+0000 7f30bdc00700 1 --2- 172.21.15.142:0/2410754268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b810d130 0x7f30b810d550 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0098a0 tx=0x7f30ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58eeb7b6dd0521b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:33.225 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.330+0000 7f30b7e00700 1 -- 172.21.15.142:0/2410754268 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30ac004180 con 0x7f30b810d130 2024-04-20T21:46:33.225 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.331+0000 7f30b7e00700 1 -- 172.21.15.142:0/2410754268 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f30ac0042e0 con 0x7f30b810d130 2024-04-20T21:46:33.225 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.331+0000 7f30b7e00700 1 -- 172.21.15.142:0/2410754268 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30ac011b10 con 0x7f30b810d130 2024-04-20T21:46:33.226 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.331+0000 7f30c0600700 1 -- 172.21.15.142:0/2410754268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b810d130 msgr2=0x7f30b810d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:33.226 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.331+0000 7f30c0600700 1 --2- 172.21.15.142:0/2410754268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b810d130 0x7f30b810d550 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0098a0 tx=0x7f30ac009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:33.226 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.331+0000 7f30c0600700 1 -- 172.21.15.142:0/2410754268 shutdown_connections 2024-04-20T21:46:33.226 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.331+0000 7f30c0600700 1 --2- 172.21.15.142:0/2410754268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b810d130 0x7f30b810d550 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:33.226 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.331+0000 7f30c0600700 1 -- 172.21.15.142:0/2410754268 >> 172.21.15.142:0/2410754268 conn(0x7f30b807bbf0 msgr2=0x7f30b807e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:33.226 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.331+0000 7f30c0600700 1 -- 172.21.15.142:0/2410754268 shutdown_connections 2024-04-20T21:46:33.226 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.332+0000 7f30c0600700 1 -- 172.21.15.142:0/2410754268 wait complete. 2024-04-20T21:46:33.226 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.333+0000 7f30c0600700 1 Processor -- start 2024-04-20T21:46:33.226 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.333+0000 7f30c0600700 1 -- start start 2024-04-20T21:46:33.226 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.333+0000 7f30c0600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b810d130 0x7f30b81a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:33.227 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.333+0000 7f30c0600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b81a0e50 con 0x7f30b810d130 2024-04-20T21:46:33.227 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.333+0000 7f30bdc00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b810d130 0x7f30b81a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:33.227 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.333+0000 7f30bdc00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b810d130 0x7f30b81a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45560/0 (socket says 172.21.15.142:45560) 2024-04-20T21:46:33.227 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.333+0000 7f30bdc00700 1 -- 172.21.15.142:0/2300194755 learned_addr learned my addr 172.21.15.142:0/2300194755 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:33.227 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.334+0000 7f30bdc00700 1 -- 172.21.15.142:0/2300194755 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac009550 con 0x7f30b810d130 2024-04-20T21:46:33.227 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.334+0000 7f30bdc00700 1 --2- 172.21.15.142:0/2300194755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b810d130 0x7f30b81a0910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0117b0 tx=0x7f30ac011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:33.227 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.334+0000 7f30b6000700 1 -- 172.21.15.142:0/2300194755 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30ac0038b0 con 0x7f30b810d130 2024-04-20T21:46:33.227 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.334+0000 7f30b6000700 1 -- 172.21.15.142:0/2300194755 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f30ac003a10 con 0x7f30b810d130 2024-04-20T21:46:33.227 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.334+0000 7f30c0600700 1 -- 172.21.15.142:0/2300194755 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b81a1050 con 0x7f30b810d130 2024-04-20T21:46:33.227 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.334+0000 7f30b6000700 1 -- 172.21.15.142:0/2300194755 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30ac0246e0 con 0x7f30b810d130 2024-04-20T21:46:33.227 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.334+0000 7f30c0600700 1 -- 172.21.15.142:0/2300194755 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b81a14f0 con 0x7f30b810d130 2024-04-20T21:46:33.227 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.336+0000 7f30c0600700 1 -- 172.21.15.142:0/2300194755 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30b8110fd0 con 0x7f30b810d130 2024-04-20T21:46:33.227 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.336+0000 7f30b6000700 1 -- 172.21.15.142:0/2300194755 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f30ac01ab80 con 0x7f30b810d130 2024-04-20T21:46:33.227 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.336+0000 7f30b6000700 1 --2- 172.21.15.142:0/2300194755 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f30a0038720 0x7f30a003abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:33.228 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.336+0000 7f30b6000700 1 -- 172.21.15.142:0/2300194755 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f30ac04ca10 con 0x7f30b810d130 2024-04-20T21:46:33.228 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.337+0000 7f30bd200700 1 --2- 172.21.15.142:0/2300194755 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f30a0038720 0x7f30a003abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:33.228 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.338+0000 7f30bd200700 1 --2- 172.21.15.142:0/2300194755 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f30a0038720 0x7f30a003abe0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f30a4006fd0 tx=0x7f30a4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:33.228 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.342+0000 7f30b6000700 1 -- 172.21.15.142:0/2300194755 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f30ac010380 con 0x7f30b810d130 2024-04-20T21:46:33.228 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.561+0000 7f30c0600700 1 -- 172.21.15.142:0/2300194755 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f30b81a3de0 con 0x7f30b810d130 2024-04-20T21:46:33.228 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.569+0000 7f30b6000700 1 -- 172.21.15.142:0/2300194755 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f30ac018b40 con 0x7f30b810d130 2024-04-20T21:46:33.228 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.572+0000 7f30c0600700 1 -- 172.21.15.142:0/2300194755 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f30a0038720 msgr2=0x7f30a003abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:33.228 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.572+0000 7f30c0600700 1 --2- 172.21.15.142:0/2300194755 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f30a0038720 0x7f30a003abe0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f30a4006fd0 tx=0x7f30a4006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:33.228 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.572+0000 7f30c0600700 1 -- 172.21.15.142:0/2300194755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b810d130 msgr2=0x7f30b81a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:33.228 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.572+0000 7f30c0600700 1 --2- 172.21.15.142:0/2300194755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b810d130 0x7f30b81a0910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0117b0 tx=0x7f30ac011890 comp rx=0 tx=0).stop 2024-04-20T21:46:33.228 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.573+0000 7f30c0600700 1 -- 172.21.15.142:0/2300194755 shutdown_connections 2024-04-20T21:46:33.228 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.573+0000 7f30c0600700 1 --2- 172.21.15.142:0/2300194755 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f30a0038720 0x7f30a003abe0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:33.228 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.573+0000 7f30c0600700 1 --2- 172.21.15.142:0/2300194755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30b810d130 0x7f30b81a0910 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:33.228 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.573+0000 7f30c0600700 1 -- 172.21.15.142:0/2300194755 >> 172.21.15.142:0/2300194755 conn(0x7f30b807bbf0 msgr2=0x7f30b807c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:33.229 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.573+0000 7f30c0600700 1 -- 172.21.15.142:0/2300194755 shutdown_connections 2024-04-20T21:46:33.229 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:32.573+0000 7f30c0600700 1 -- 172.21.15.142:0/2300194755 wait complete. 2024-04-20T21:46:33.229 INFO:teuthology.orchestra.run.smithi142.stdout:Enabling the dashboard module... 2024-04-20T21:46:33.814 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:33 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2300194755' entity='client.admin' 2024-04-20T21:46:34.864 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:34 smithi142 ceph-mon[15828]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:46:34.864 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:34 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1480710705' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-20T21:46:35.326 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.815+0000 7fed92e00700 1 Processor -- start 2024-04-20T21:46:35.326 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.815+0000 7fed92e00700 1 -- start start 2024-04-20T21:46:35.326 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.816+0000 7fed92e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed8c07ad90 0x7fed8c0791f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:35.326 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.816+0000 7fed92e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0797c0 con 0x7fed8c07ad90 2024-04-20T21:46:35.326 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.816+0000 7fed8be00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed8c07ad90 0x7fed8c0791f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:35.326 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.816+0000 7fed8be00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed8c07ad90 0x7fed8c0791f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45562/0 (socket says 172.21.15.142:45562) 2024-04-20T21:46:35.326 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.816+0000 7fed8be00700 1 -- 172.21.15.142:0/4247002572 learned_addr learned my addr 172.21.15.142:0/4247002572 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:35.326 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.817+0000 7fed8be00700 1 -- 172.21.15.142:0/4247002572 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c079900 con 0x7fed8c07ad90 2024-04-20T21:46:35.326 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.817+0000 7fed8be00700 1 --2- 172.21.15.142:0/4247002572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed8c07ad90 0x7fed8c0791f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0098a0 tx=0x7fed7c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffc2c9e09bdda08 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:35.326 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.817+0000 7fed8b400700 1 -- 172.21.15.142:0/4247002572 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed7c004180 con 0x7fed8c07ad90 2024-04-20T21:46:35.326 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.818+0000 7fed8b400700 1 -- 172.21.15.142:0/4247002572 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed7c0042e0 con 0x7fed8c07ad90 2024-04-20T21:46:35.327 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.818+0000 7fed8b400700 1 -- 172.21.15.142:0/4247002572 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed7c011b10 con 0x7fed8c07ad90 2024-04-20T21:46:35.327 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.818+0000 7fed92e00700 1 -- 172.21.15.142:0/4247002572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed8c07ad90 msgr2=0x7fed8c0791f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:35.327 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.818+0000 7fed92e00700 1 --2- 172.21.15.142:0/4247002572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed8c07ad90 0x7fed8c0791f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0098a0 tx=0x7fed7c009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:35.327 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.818+0000 7fed92e00700 1 -- 172.21.15.142:0/4247002572 shutdown_connections 2024-04-20T21:46:35.327 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.818+0000 7fed92e00700 1 --2- 172.21.15.142:0/4247002572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed8c07ad90 0x7fed8c0791f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:35.327 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.818+0000 7fed92e00700 1 -- 172.21.15.142:0/4247002572 >> 172.21.15.142:0/4247002572 conn(0x7fed8c101ba0 msgr2=0x7fed8c103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:35.327 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.818+0000 7fed92e00700 1 -- 172.21.15.142:0/4247002572 shutdown_connections 2024-04-20T21:46:35.327 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.818+0000 7fed92e00700 1 -- 172.21.15.142:0/4247002572 wait complete. 2024-04-20T21:46:35.327 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.819+0000 7fed92e00700 1 Processor -- start 2024-04-20T21:46:35.327 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.820+0000 7fed92e00700 1 -- start start 2024-04-20T21:46:35.327 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.820+0000 7fed92e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed8c07ad90 0x7fed8c19c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:35.327 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.820+0000 7fed92e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c19cad0 con 0x7fed8c07ad90 2024-04-20T21:46:35.327 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.820+0000 7fed8be00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed8c07ad90 0x7fed8c19c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:35.327 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.820+0000 7fed8be00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed8c07ad90 0x7fed8c19c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45574/0 (socket says 172.21.15.142:45574) 2024-04-20T21:46:35.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.820+0000 7fed8be00700 1 -- 172.21.15.142:0/1480710705 learned_addr learned my addr 172.21.15.142:0/1480710705 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:35.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.821+0000 7fed8be00700 1 -- 172.21.15.142:0/1480710705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7c009550 con 0x7fed8c07ad90 2024-04-20T21:46:35.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.821+0000 7fed8be00700 1 --2- 172.21.15.142:0/1480710705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed8c07ad90 0x7fed8c19c590 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fed7c004210 tx=0x7fed7c011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:35.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.821+0000 7fed89600700 1 -- 172.21.15.142:0/1480710705 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed7c0038b0 con 0x7fed8c07ad90 2024-04-20T21:46:35.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.821+0000 7fed89600700 1 -- 172.21.15.142:0/1480710705 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed7c003a10 con 0x7fed8c07ad90 2024-04-20T21:46:35.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.821+0000 7fed92e00700 1 -- 172.21.15.142:0/1480710705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8c19ccd0 con 0x7fed8c07ad90 2024-04-20T21:46:35.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.821+0000 7fed89600700 1 -- 172.21.15.142:0/1480710705 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed7c024650 con 0x7fed8c07ad90 2024-04-20T21:46:35.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.821+0000 7fed92e00700 1 -- 172.21.15.142:0/1480710705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8c19d170 con 0x7fed8c07ad90 2024-04-20T21:46:35.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.822+0000 7fed92e00700 1 -- 172.21.15.142:0/1480710705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8c10c980 con 0x7fed8c07ad90 2024-04-20T21:46:35.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.823+0000 7fed89600700 1 -- 172.21.15.142:0/1480710705 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fed7c01ab80 con 0x7fed8c07ad90 2024-04-20T21:46:35.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.823+0000 7fed89600700 1 --2- 172.21.15.142:0/1480710705 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fed70038720 0x7fed7003abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:35.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.823+0000 7fed89600700 1 -- 172.21.15.142:0/1480710705 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fed7c04c770 con 0x7fed8c07ad90 2024-04-20T21:46:35.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.823+0000 7fed83e00700 1 --2- 172.21.15.142:0/1480710705 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fed70038720 0x7fed7003abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:35.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.824+0000 7fed83e00700 1 --2- 172.21.15.142:0/1480710705 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fed70038720 0x7fed7003abe0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fed74006fd0 tx=0x7fed74006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:35.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:33.828+0000 7fed89600700 1 -- 172.21.15.142:0/1480710705 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fed7c01a950 con 0x7fed8c07ad90 2024-04-20T21:46:35.329 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:34.106+0000 7fed92e00700 1 -- 172.21.15.142:0/1480710705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fed8c10cbc0 con 0x7fed8c07ad90 2024-04-20T21:46:35.329 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:34.577+0000 7fed89600700 1 -- 172.21.15.142:0/1480710705 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fed7c01a430 con 0x7fed8c07ad90 2024-04-20T21:46:35.329 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:34.581+0000 7fed89600700 1 -- 172.21.15.142:0/1480710705 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fed7c0248a0 con 0x7fed8c07ad90 2024-04-20T21:46:35.329 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:34.584+0000 7fed92e00700 1 -- 172.21.15.142:0/1480710705 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fed70038720 msgr2=0x7fed7003abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:35.329 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:34.584+0000 7fed92e00700 1 --2- 172.21.15.142:0/1480710705 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fed70038720 0x7fed7003abe0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fed74006fd0 tx=0x7fed74006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:35.329 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:34.584+0000 7fed92e00700 1 -- 172.21.15.142:0/1480710705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed8c07ad90 msgr2=0x7fed8c19c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:35.329 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:34.584+0000 7fed92e00700 1 --2- 172.21.15.142:0/1480710705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed8c07ad90 0x7fed8c19c590 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fed7c004210 tx=0x7fed7c011940 comp rx=0 tx=0).stop 2024-04-20T21:46:35.329 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:34.584+0000 7fed92e00700 1 -- 172.21.15.142:0/1480710705 shutdown_connections 2024-04-20T21:46:35.329 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:34.584+0000 7fed92e00700 1 --2- 172.21.15.142:0/1480710705 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7fed70038720 0x7fed7003abe0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:35.329 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:34.584+0000 7fed92e00700 1 --2- 172.21.15.142:0/1480710705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed8c07ad90 0x7fed8c19c590 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:35.329 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:34.584+0000 7fed92e00700 1 -- 172.21.15.142:0/1480710705 >> 172.21.15.142:0/1480710705 conn(0x7fed8c101ba0 msgr2=0x7fed8c1027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:35.329 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:34.584+0000 7fed92e00700 1 -- 172.21.15.142:0/1480710705 shutdown_connections 2024-04-20T21:46:35.329 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:34.585+0000 7fed92e00700 1 -- 172.21.15.142:0/1480710705 wait complete. 2024-04-20T21:46:35.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:35 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1480710705' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-20T21:46:35.759 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:35 smithi142 ceph-mon[15828]: mgrmap e9: smithi142.zzmcfz(active, since 32s) 2024-04-20T21:46:36.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:36 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2278145708' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-20T21:46:36.984 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout { 2024-04-20T21:46:36.984 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-20T21:46:36.985 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-20T21:46:36.985 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "active_name": "smithi142.zzmcfz", 2024-04-20T21:46:36.985 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-20T21:46:36.985 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout } 2024-04-20T21:46:36.985 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.955+0000 7f78ae400700 1 Processor -- start 2024-04-20T21:46:36.985 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.955+0000 7f78ae400700 1 -- start start 2024-04-20T21:46:36.985 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.955+0000 7f78ae400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78a81065a0 0x7f78a81069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:36.985 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.955+0000 7f78ae400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8106f90 con 0x7f78a81065a0 2024-04-20T21:46:36.985 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.956+0000 7f78a7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78a81065a0 0x7f78a81069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:36.985 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.956+0000 7f78a7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78a81065a0 0x7f78a81069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45600/0 (socket says 172.21.15.142:45600) 2024-04-20T21:46:36.985 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.956+0000 7f78a7400700 1 -- 172.21.15.142:0/4153712817 learned_addr learned my addr 172.21.15.142:0/4153712817 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:36.985 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.956+0000 7f78a7400700 1 -- 172.21.15.142:0/4153712817 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a81077a0 con 0x7f78a81065a0 2024-04-20T21:46:36.985 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.957+0000 7f78a7400700 1 --2- 172.21.15.142:0/4153712817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78a81065a0 0x7f78a81069c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f78980098a0 tx=0x7f7898009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacff46fca347321 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:36.986 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.957+0000 7f78a6000700 1 -- 172.21.15.142:0/4153712817 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7898004180 con 0x7f78a81065a0 2024-04-20T21:46:36.986 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.957+0000 7f78a6000700 1 -- 172.21.15.142:0/4153712817 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f78980042e0 con 0x7f78a81065a0 2024-04-20T21:46:36.986 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.957+0000 7f78a6000700 1 -- 172.21.15.142:0/4153712817 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7898011b10 con 0x7f78a81065a0 2024-04-20T21:46:36.986 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.957+0000 7f78ae400700 1 -- 172.21.15.142:0/4153712817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78a81065a0 msgr2=0x7f78a81069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:36.986 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.957+0000 7f78ae400700 1 --2- 172.21.15.142:0/4153712817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78a81065a0 0x7f78a81069c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f78980098a0 tx=0x7f7898009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:36.986 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.958+0000 7f78ae400700 1 -- 172.21.15.142:0/4153712817 shutdown_connections 2024-04-20T21:46:36.986 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.958+0000 7f78ae400700 1 --2- 172.21.15.142:0/4153712817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78a81065a0 0x7f78a81069c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:36.986 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.958+0000 7f78ae400700 1 -- 172.21.15.142:0/4153712817 >> 172.21.15.142:0/4153712817 conn(0x7f78a8101ba0 msgr2=0x7f78a8103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:36.986 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.958+0000 7f78ae400700 1 -- 172.21.15.142:0/4153712817 shutdown_connections 2024-04-20T21:46:36.986 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.958+0000 7f78ae400700 1 -- 172.21.15.142:0/4153712817 wait complete. 2024-04-20T21:46:36.986 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.959+0000 7f78ae400700 1 Processor -- start 2024-04-20T21:46:36.986 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.959+0000 7f78ae400700 1 -- start start 2024-04-20T21:46:36.986 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.959+0000 7f78ae400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78a81065a0 0x7f78a819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.959+0000 7f78ae400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a819a940 con 0x7f78a81065a0 2024-04-20T21:46:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.959+0000 7f78a7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78a81065a0 0x7f78a819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.959+0000 7f78a7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78a81065a0 0x7f78a819a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45604/0 (socket says 172.21.15.142:45604) 2024-04-20T21:46:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.959+0000 7f78a7400700 1 -- 172.21.15.142:0/2278145708 learned_addr learned my addr 172.21.15.142:0/2278145708 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.960+0000 7f78a7400700 1 -- 172.21.15.142:0/2278145708 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7898009550 con 0x7f78a81065a0 2024-04-20T21:46:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.960+0000 7f78a7400700 1 --2- 172.21.15.142:0/2278145708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78a81065a0 0x7f78a819a400 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7898000c00 tx=0x7f7898011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.960+0000 7f789fe00700 1 -- 172.21.15.142:0/2278145708 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78980038b0 con 0x7f78a81065a0 2024-04-20T21:46:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.960+0000 7f789fe00700 1 -- 172.21.15.142:0/2278145708 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7898003a10 con 0x7f78a81065a0 2024-04-20T21:46:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.960+0000 7f789fe00700 1 -- 172.21.15.142:0/2278145708 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7898024780 con 0x7f78a81065a0 2024-04-20T21:46:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.960+0000 7f78ae400700 1 -- 172.21.15.142:0/2278145708 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a819ab40 con 0x7f78a81065a0 2024-04-20T21:46:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.961+0000 7f78ae400700 1 -- 172.21.15.142:0/2278145708 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a819afe0 con 0x7f78a81065a0 2024-04-20T21:46:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.962+0000 7f789fe00700 1 -- 172.21.15.142:0/2278145708 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f789801a430 con 0x7f78a81065a0 2024-04-20T21:46:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.962+0000 7f78ae400700 1 -- 172.21.15.142:0/2278145708 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a810a9d0 con 0x7f78a81065a0 2024-04-20T21:46:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.962+0000 7f789fe00700 1 --2- 172.21.15.142:0/2278145708 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f788c038810 0x7f788c03acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.962+0000 7f789fe00700 1 -- 172.21.15.142:0/2278145708 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f789804c6c0 con 0x7f78a81065a0 2024-04-20T21:46:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.962+0000 7f78a6a00700 1 -- 172.21.15.142:0/2278145708 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f788c038810 msgr2=0x7f788c03acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/550675874 2024-04-20T21:46:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.962+0000 7f78a6a00700 1 --2- 172.21.15.142:0/2278145708 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f788c038810 0x7f788c03acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T21:46:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:35.968+0000 7f789fe00700 1 -- 172.21.15.142:0/2278145708 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f7898018b40 con 0x7f78a81065a0 2024-04-20T21:46:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:36.163+0000 7f78a6a00700 1 -- 172.21.15.142:0/2278145708 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f788c038810 msgr2=0x7f788c03acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/550675874 2024-04-20T21:46:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:36.163+0000 7f78a6a00700 1 --2- 172.21.15.142:0/2278145708 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f788c038810 0x7f788c03acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-20T21:46:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:36.246+0000 7f78ae400700 1 -- 172.21.15.142:0/2278145708 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f78a819d8d0 con 0x7f78a81065a0 2024-04-20T21:46:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:36.246+0000 7f789fe00700 1 -- 172.21.15.142:0/2278145708 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f7898018b40 con 0x7f78a81065a0 2024-04-20T21:46:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:36.249+0000 7f78ae400700 1 -- 172.21.15.142:0/2278145708 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f788c038810 msgr2=0x7f788c03acd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T21:46:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:36.249+0000 7f78ae400700 1 --2- 172.21.15.142:0/2278145708 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f788c038810 0x7f788c03acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:36.249+0000 7f78ae400700 1 -- 172.21.15.142:0/2278145708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78a81065a0 msgr2=0x7f78a819a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:36.249+0000 7f78ae400700 1 --2- 172.21.15.142:0/2278145708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78a81065a0 0x7f78a819a400 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7898000c00 tx=0x7f7898011890 comp rx=0 tx=0).stop 2024-04-20T21:46:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:36.249+0000 7f78ae400700 1 -- 172.21.15.142:0/2278145708 shutdown_connections 2024-04-20T21:46:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:36.249+0000 7f78ae400700 1 --2- 172.21.15.142:0/2278145708 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f788c038810 0x7f788c03acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:36.249+0000 7f78ae400700 1 --2- 172.21.15.142:0/2278145708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78a81065a0 0x7f78a819a400 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:36.249+0000 7f78ae400700 1 -- 172.21.15.142:0/2278145708 >> 172.21.15.142:0/2278145708 conn(0x7f78a8101ba0 msgr2=0x7f78a8102840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:36.989 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:36.250+0000 7f78ae400700 1 -- 172.21.15.142:0/2278145708 shutdown_connections 2024-04-20T21:46:36.989 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:36.250+0000 7f78ae400700 1 -- 172.21.15.142:0/2278145708 wait complete. 2024-04-20T21:46:36.989 INFO:teuthology.orchestra.run.smithi142.stdout:Waiting for the mgr to restart... 2024-04-20T21:46:36.989 INFO:teuthology.orchestra.run.smithi142.stdout:Waiting for mgr epoch 9... 2024-04-20T21:46:43.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:43 smithi142 ceph-mon[15828]: Active manager daemon smithi142.zzmcfz restarted 2024-04-20T21:46:43.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:43 smithi142 ceph-mon[15828]: Activating manager daemon smithi142.zzmcfz 2024-04-20T21:46:43.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:43 smithi142 ceph-mon[15828]: osdmap e3: 0 total, 0 up, 0 in 2024-04-20T21:46:43.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:43 smithi142 ceph-mon[15828]: mgrmap e10: smithi142.zzmcfz(active, starting, since 0.00511853s) 2024-04-20T21:46:43.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:43 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T21:46:43.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:43 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr metadata", "who": "smithi142.zzmcfz", "id": "smithi142.zzmcfz"}]: dispatch 2024-04-20T21:46:43.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:43 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-20T21:46:43.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:43 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-20T21:46:43.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:43 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-20T21:46:43.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:43 smithi142 ceph-mon[15828]: Manager daemon smithi142.zzmcfz is now available 2024-04-20T21:46:43.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:43 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:46:44.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:44 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.zzmcfz/mirror_snapshot_schedule"}]: dispatch 2024-04-20T21:46:44.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:44 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.zzmcfz/trash_purge_schedule"}]: dispatch 2024-04-20T21:46:44.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:44 smithi142 ceph-mon[15828]: [20/Apr/2024:21:46:43] ENGINE Bus STARTING 2024-04-20T21:46:44.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:44 smithi142 ceph-mon[15828]: mgrmap e11: smithi142.zzmcfz(active, since 1.01086s) 2024-04-20T21:46:45.795 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:45 smithi142 ceph-mon[15828]: [20/Apr/2024:21:46:43] ENGINE Serving on https://172.21.15.142:7150 2024-04-20T21:46:45.796 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:45 smithi142 ceph-mon[15828]: [20/Apr/2024:21:46:43] ENGINE Serving on http://172.21.15.142:8765 2024-04-20T21:46:45.796 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:45 smithi142 ceph-mon[15828]: [20/Apr/2024:21:46:43] ENGINE Bus STARTED 2024-04-20T21:46:45.796 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:45 smithi142 ceph-mon[15828]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-20T21:46:45.796 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:45 smithi142 ceph-mon[15828]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-20T21:46:45.804 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout { 2024-04-20T21:46:45.804 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-20T21:46:45.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-20T21:46:45.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout } 2024-04-20T21:46:45.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.581+0000 7f6cb6a00700 1 Processor -- start 2024-04-20T21:46:45.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.581+0000 7f6cb6a00700 1 -- start start 2024-04-20T21:46:45.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.582+0000 7f6cb6a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb0107020 0x7f6cb0109410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:45.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.582+0000 7f6cb6a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb00747b0 con 0x7f6cb0107020 2024-04-20T21:46:45.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.582+0000 7f6cafe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb0107020 0x7f6cb0109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:45.807 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.583+0000 7f6cafe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb0107020 0x7f6cb0109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38006/0 (socket says 172.21.15.142:38006) 2024-04-20T21:46:45.807 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.583+0000 7f6cafe00700 1 -- 172.21.15.142:0/285480434 learned_addr learned my addr 172.21.15.142:0/285480434 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:45.807 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.583+0000 7f6cafe00700 1 -- 172.21.15.142:0/285480434 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb0109950 con 0x7f6cb0107020 2024-04-20T21:46:45.807 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.583+0000 7f6cafe00700 1 --2- 172.21.15.142:0/285480434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb0107020 0x7f6cb0109410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00098a0 tx=0x7f6ca0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa38b7635a403cd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:45.808 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.584+0000 7f6caea00700 1 -- 172.21.15.142:0/285480434 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ca0004180 con 0x7f6cb0107020 2024-04-20T21:46:45.808 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.584+0000 7f6caea00700 1 -- 172.21.15.142:0/285480434 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ca00042e0 con 0x7f6cb0107020 2024-04-20T21:46:45.808 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.584+0000 7f6caea00700 1 -- 172.21.15.142:0/285480434 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ca0011b10 con 0x7f6cb0107020 2024-04-20T21:46:45.809 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.585+0000 7f6cb6a00700 1 -- 172.21.15.142:0/285480434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb0107020 msgr2=0x7f6cb0109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:45.809 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.585+0000 7f6cb6a00700 1 --2- 172.21.15.142:0/285480434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb0107020 0x7f6cb0109410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00098a0 tx=0x7f6ca0009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:45.809 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.585+0000 7f6cb6a00700 1 -- 172.21.15.142:0/285480434 shutdown_connections 2024-04-20T21:46:45.809 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.585+0000 7f6cb6a00700 1 --2- 172.21.15.142:0/285480434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb0107020 0x7f6cb0109410 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:45.809 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.585+0000 7f6cb6a00700 1 -- 172.21.15.142:0/285480434 >> 172.21.15.142:0/285480434 conn(0x7f6cb0100a50 msgr2=0x7f6cb0102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:45.810 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.585+0000 7f6cb6a00700 1 -- 172.21.15.142:0/285480434 shutdown_connections 2024-04-20T21:46:45.810 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.585+0000 7f6cb6a00700 1 -- 172.21.15.142:0/285480434 wait complete. 2024-04-20T21:46:45.810 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.586+0000 7f6cb6a00700 1 Processor -- start 2024-04-20T21:46:45.810 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.586+0000 7f6cb6a00700 1 -- start start 2024-04-20T21:46:45.811 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.587+0000 7f6cb6a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb0107020 0x7f6cb019c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:45.811 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.587+0000 7f6cb6a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb019caa0 con 0x7f6cb0107020 2024-04-20T21:46:45.811 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.587+0000 7f6cafe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb0107020 0x7f6cb019c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:45.811 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.587+0000 7f6cafe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb0107020 0x7f6cb019c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38010/0 (socket says 172.21.15.142:38010) 2024-04-20T21:46:45.812 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.587+0000 7f6cafe00700 1 -- 172.21.15.142:0/3821051993 learned_addr learned my addr 172.21.15.142:0/3821051993 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:45.812 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.587+0000 7f6cafe00700 1 -- 172.21.15.142:0/3821051993 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca0009550 con 0x7f6cb0107020 2024-04-20T21:46:45.812 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.588+0000 7f6cafe00700 1 --2- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb0107020 0x7f6cb019c560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00117b0 tx=0x7f6ca0011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:45.812 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.588+0000 7f6cacc00700 1 -- 172.21.15.142:0/3821051993 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ca00038b0 con 0x7f6cb0107020 2024-04-20T21:46:45.812 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.588+0000 7f6cacc00700 1 -- 172.21.15.142:0/3821051993 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ca0003a10 con 0x7f6cb0107020 2024-04-20T21:46:45.813 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.588+0000 7f6cacc00700 1 -- 172.21.15.142:0/3821051993 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6ca0024780 con 0x7f6cb0107020 2024-04-20T21:46:45.813 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.588+0000 7f6cb6a00700 1 -- 172.21.15.142:0/3821051993 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb019cca0 con 0x7f6cb0107020 2024-04-20T21:46:45.813 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.588+0000 7f6cb6a00700 1 -- 172.21.15.142:0/3821051993 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb019d140 con 0x7f6cb0107020 2024-04-20T21:46:45.813 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.590+0000 7f6cacc00700 1 -- 172.21.15.142:0/3821051993 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f6ca001ac10 con 0x7f6cb0107020 2024-04-20T21:46:45.813 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.590+0000 7f6cacc00700 1 --2- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f6c940387c0 0x7f6c9403ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:45.814 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.590+0000 7f6cacc00700 1 -- 172.21.15.142:0/3821051993 --> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c9403b390 con 0x7f6c940387c0 2024-04-20T21:46:45.814 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.590+0000 7f6cacc00700 1 -- 172.21.15.142:0/3821051993 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6ca004c7a0 con 0x7f6cb0107020 2024-04-20T21:46:45.814 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.590+0000 7f6caf400700 1 -- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f6c940387c0 msgr2=0x7f6c9403ac80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/550675874 2024-04-20T21:46:45.814 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.590+0000 7f6caf400700 1 --2- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f6c940387c0 0x7f6c9403ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T21:46:45.814 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.791+0000 7f6caf400700 1 -- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f6c940387c0 msgr2=0x7f6c9403ac80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/550675874 2024-04-20T21:46:45.815 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:37.791+0000 7f6caf400700 1 --2- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f6c940387c0 0x7f6c9403ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-20T21:46:45.815 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:38.192+0000 7f6caf400700 1 -- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f6c940387c0 msgr2=0x7f6c9403ac80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/550675874 2024-04-20T21:46:45.815 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:38.192+0000 7f6caf400700 1 --2- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f6c940387c0 0x7f6c9403ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-20T21:46:45.815 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:38.993+0000 7f6caf400700 1 -- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f6c940387c0 msgr2=0x7f6c9403ac80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/550675874 2024-04-20T21:46:45.815 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:38.993+0000 7f6caf400700 1 --2- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f6c940387c0 0x7f6c9403ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-20T21:46:45.815 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:40.595+0000 7f6caf400700 1 -- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f6c940387c0 msgr2=0x7f6c9403ac80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/550675874 2024-04-20T21:46:45.816 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:40.595+0000 7f6caf400700 1 --2- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f6c940387c0 0x7f6c9403ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-20T21:46:45.816 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:43.411+0000 7f6cacc00700 1 -- 172.21.15.142:0/3821051993 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mgrmap(e 10) v1 ==== 45336+0+0 (secure 0 0 0) 0x7f6ca000ebd0 con 0x7f6cb0107020 2024-04-20T21:46:45.816 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:43.411+0000 7f6cacc00700 1 -- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f6c940387c0 msgr2=0x7f6c9403ac80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T21:46:45.816 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:43.411+0000 7f6cacc00700 1 --2- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f6c940387c0 0x7f6c9403ac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:45.816 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:44.415+0000 7f6cacc00700 1 -- 172.21.15.142:0/3821051993 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mgrmap(e 11) v1 ==== 45463+0+0 (secure 0 0 0) 0x7f6ca004e290 con 0x7f6cb0107020 2024-04-20T21:46:45.817 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:44.415+0000 7f6cacc00700 1 --2- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f6c9403bfc0 0x7f6c9403e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:45.817 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:44.415+0000 7f6cacc00700 1 -- 172.21.15.142:0/3821051993 --> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c9403b390 con 0x7f6c9403bfc0 2024-04-20T21:46:45.817 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:44.416+0000 7f6caf400700 1 --2- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f6c9403bfc0 0x7f6c9403e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:45.817 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:44.418+0000 7f6caf400700 1 --2- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f6c9403bfc0 0x7f6c9403e3b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c003a10 tx=0x7f6c9c009270 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:45.818 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:44.419+0000 7f6cacc00700 1 -- 172.21.15.142:0/3821051993 <== mgr.14164 v2:172.21.15.142:6800/3464616902 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f6c9403b390 con 0x7f6c9403bfc0 2024-04-20T21:46:45.818 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:44.426+0000 7f6cb6a00700 1 -- 172.21.15.142:0/3821051993 --> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f6cb010a740 con 0x7f6c9403bfc0 2024-04-20T21:46:45.818 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:44.426+0000 7f6cacc00700 1 -- 172.21.15.142:0/3821051993 <== mgr.14164 v2:172.21.15.142:6800/3464616902 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f6cb010a740 con 0x7f6c9403bfc0 2024-04-20T21:46:45.818 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:44.427+0000 7f6cb6a00700 1 -- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f6c9403bfc0 msgr2=0x7f6c9403e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:45.819 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:44.427+0000 7f6cb6a00700 1 --2- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f6c9403bfc0 0x7f6c9403e3b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c003a10 tx=0x7f6c9c009270 comp rx=0 tx=0).stop 2024-04-20T21:46:45.819 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:44.427+0000 7f6cb6a00700 1 -- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb0107020 msgr2=0x7f6cb019c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:45.819 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:44.427+0000 7f6cb6a00700 1 --2- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb0107020 0x7f6cb019c560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00117b0 tx=0x7f6ca0011890 comp rx=0 tx=0).stop 2024-04-20T21:46:45.819 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:44.427+0000 7f6cb6a00700 1 -- 172.21.15.142:0/3821051993 shutdown_connections 2024-04-20T21:46:45.819 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:44.427+0000 7f6cb6a00700 1 --2- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb0107020 0x7f6cb019c560 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:45.819 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:44.427+0000 7f6cb6a00700 1 --2- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f6c9403bfc0 0x7f6c9403e3b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:45.820 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:44.427+0000 7f6cb6a00700 1 --2- 172.21.15.142:0/3821051993 >> [v2:172.21.15.142:6800/550675874,v1:172.21.15.142:6801/550675874] conn(0x7f6c940387c0 0x7f6c9403ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:45.820 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:44.427+0000 7f6cb6a00700 1 -- 172.21.15.142:0/3821051993 >> 172.21.15.142:0/3821051993 conn(0x7f6cb0100a50 msgr2=0x7f6cb0101510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:45.820 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:44.427+0000 7f6cb6a00700 1 -- 172.21.15.142:0/3821051993 shutdown_connections 2024-04-20T21:46:45.820 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:44.427+0000 7f6cb6a00700 1 -- 172.21.15.142:0/3821051993 wait complete. 2024-04-20T21:46:45.820 INFO:teuthology.orchestra.run.smithi142.stdout:mgr epoch 9 is available 2024-04-20T21:46:45.820 INFO:teuthology.orchestra.run.smithi142.stdout:Generating a dashboard self-signed certificate... 2024-04-20T21:46:46.655 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:46 smithi142 ceph-mon[15828]: mgrmap e12: smithi142.zzmcfz(active, since 2s) 2024-04-20T21:46:46.655 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:46 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:47.547 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-20T21:46:47.547 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.417+0000 7f4356e00700 1 Processor -- start 2024-04-20T21:46:47.548 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.417+0000 7f4356e00700 1 -- start start 2024-04-20T21:46:47.548 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.418+0000 7f4356e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4350106590 0x7f43501069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:47.553 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.418+0000 7f4356e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4350106f80 con 0x7f4350106590 2024-04-20T21:46:47.553 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.418+0000 7f434fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4350106590 0x7f43501069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:47.553 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.418+0000 7f434fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4350106590 0x7f43501069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38074/0 (socket says 172.21.15.142:38074) 2024-04-20T21:46:47.553 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.418+0000 7f434fe00700 1 -- 172.21.15.142:0/3087181305 learned_addr learned my addr 172.21.15.142:0/3087181305 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:47.553 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.419+0000 7f434fe00700 1 -- 172.21.15.142:0/3087181305 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4350107790 con 0x7f4350106590 2024-04-20T21:46:47.553 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.419+0000 7f434fe00700 1 --2- 172.21.15.142:0/3087181305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4350106590 0x7f43501069b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4340009e80 tx=0x7f434000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e99472aa7bbaf99 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:47.553 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.419+0000 7f434f400700 1 -- 172.21.15.142:0/3087181305 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f434000e070 con 0x7f4350106590 2024-04-20T21:46:47.553 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.419+0000 7f434f400700 1 -- 172.21.15.142:0/3087181305 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f434000b8c0 con 0x7f4350106590 2024-04-20T21:46:47.554 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.419+0000 7f434f400700 1 -- 172.21.15.142:0/3087181305 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f43400044d0 con 0x7f4350106590 2024-04-20T21:46:47.554 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.420+0000 7f4356e00700 1 -- 172.21.15.142:0/3087181305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4350106590 msgr2=0x7f43501069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:47.554 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.420+0000 7f4356e00700 1 --2- 172.21.15.142:0/3087181305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4350106590 0x7f43501069b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4340009e80 tx=0x7f434000b330 comp rx=0 tx=0).stop 2024-04-20T21:46:47.554 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.420+0000 7f4356e00700 1 -- 172.21.15.142:0/3087181305 shutdown_connections 2024-04-20T21:46:47.554 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.420+0000 7f4356e00700 1 --2- 172.21.15.142:0/3087181305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4350106590 0x7f43501069b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:47.554 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.420+0000 7f4356e00700 1 -- 172.21.15.142:0/3087181305 >> 172.21.15.142:0/3087181305 conn(0x7f4350101b70 msgr2=0x7f4350103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:47.554 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.420+0000 7f4356e00700 1 -- 172.21.15.142:0/3087181305 shutdown_connections 2024-04-20T21:46:47.554 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.420+0000 7f4356e00700 1 -- 172.21.15.142:0/3087181305 wait complete. 2024-04-20T21:46:47.554 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.421+0000 7f4356e00700 1 Processor -- start 2024-04-20T21:46:47.554 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.421+0000 7f4356e00700 1 -- start start 2024-04-20T21:46:47.554 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.422+0000 7f4356e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4350106590 0x7f435007aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:47.554 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.422+0000 7f4356e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435007af70 con 0x7f4350106590 2024-04-20T21:46:47.554 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.422+0000 7f434fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4350106590 0x7f435007aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:47.555 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.422+0000 7f434fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4350106590 0x7f435007aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38084/0 (socket says 172.21.15.142:38084) 2024-04-20T21:46:47.555 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.422+0000 7f434fe00700 1 -- 172.21.15.142:0/2802312214 learned_addr learned my addr 172.21.15.142:0/2802312214 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:47.555 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.422+0000 7f434fe00700 1 -- 172.21.15.142:0/2802312214 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4340009b30 con 0x7f4350106590 2024-04-20T21:46:47.555 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.423+0000 7f434fe00700 1 --2- 172.21.15.142:0/2802312214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4350106590 0x7f435007aa30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f43400072a0 tx=0x7f434000bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:47.555 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.423+0000 7f434d600700 1 -- 172.21.15.142:0/2802312214 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f434000e040 con 0x7f4350106590 2024-04-20T21:46:47.555 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.423+0000 7f434d600700 1 -- 172.21.15.142:0/2802312214 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4340003dc0 con 0x7f4350106590 2024-04-20T21:46:47.555 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.423+0000 7f434d600700 1 -- 172.21.15.142:0/2802312214 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4340012600 con 0x7f4350106590 2024-04-20T21:46:47.555 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.423+0000 7f4356e00700 1 -- 172.21.15.142:0/2802312214 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43500791b0 con 0x7f4350106590 2024-04-20T21:46:47.555 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.423+0000 7f4356e00700 1 -- 172.21.15.142:0/2802312214 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43500796b0 con 0x7f4350106590 2024-04-20T21:46:47.555 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.424+0000 7f4356e00700 1 -- 172.21.15.142:0/2802312214 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4350062510 con 0x7f4350106590 2024-04-20T21:46:47.555 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.425+0000 7f434d600700 1 -- 172.21.15.142:0/2802312214 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f4340019040 con 0x7f4350106590 2024-04-20T21:46:47.555 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.425+0000 7f434d600700 1 --2- 172.21.15.142:0/2802312214 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f4334038710 0x7f433403abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:47.555 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.425+0000 7f434d600700 1 -- 172.21.15.142:0/2802312214 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f434004c520 con 0x7f4350106590 2024-04-20T21:46:47.555 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.425+0000 7f4347e00700 1 --2- 172.21.15.142:0/2802312214 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f4334038710 0x7f433403abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:47.556 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.426+0000 7f4347e00700 1 --2- 172.21.15.142:0/2802312214 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f4334038710 0x7f433403abd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4338006fd0 tx=0x7f4338006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:47.556 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.431+0000 7f434d600700 1 -- 172.21.15.142:0/2802312214 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f434001b430 con 0x7f4350106590 2024-04-20T21:46:47.556 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.656+0000 7f4356e00700 1 -- 172.21.15.142:0/2802312214 --> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f4350079c10 con 0x7f4334038710 2024-04-20T21:46:47.556 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.798+0000 7f434d600700 1 -- 172.21.15.142:0/2802312214 <== mgr.14164 v2:172.21.15.142:6800/3464616902 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f4350079c10 con 0x7f4334038710 2024-04-20T21:46:47.556 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.801+0000 7f4356e00700 1 -- 172.21.15.142:0/2802312214 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f4334038710 msgr2=0x7f433403abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:47.556 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.801+0000 7f4356e00700 1 --2- 172.21.15.142:0/2802312214 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f4334038710 0x7f433403abd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4338006fd0 tx=0x7f4338006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:47.556 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.801+0000 7f4356e00700 1 -- 172.21.15.142:0/2802312214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4350106590 msgr2=0x7f435007aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:47.556 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.801+0000 7f4356e00700 1 --2- 172.21.15.142:0/2802312214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4350106590 0x7f435007aa30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f43400072a0 tx=0x7f434000bf70 comp rx=0 tx=0).stop 2024-04-20T21:46:47.556 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.801+0000 7f4356e00700 1 -- 172.21.15.142:0/2802312214 shutdown_connections 2024-04-20T21:46:47.556 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.801+0000 7f4356e00700 1 --2- 172.21.15.142:0/2802312214 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f4334038710 0x7f433403abd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:47.556 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.801+0000 7f4356e00700 1 --2- 172.21.15.142:0/2802312214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4350106590 0x7f435007aa30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:47.556 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.801+0000 7f4356e00700 1 -- 172.21.15.142:0/2802312214 >> 172.21.15.142:0/2802312214 conn(0x7f4350101b70 msgr2=0x7f4350102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:47.556 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.801+0000 7f4356e00700 1 -- 172.21.15.142:0/2802312214 shutdown_connections 2024-04-20T21:46:47.556 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:46.801+0000 7f4356e00700 1 -- 172.21.15.142:0/2802312214 wait complete. 2024-04-20T21:46:47.556 INFO:teuthology.orchestra.run.smithi142.stdout:Creating initial admin user... 2024-04-20T21:46:47.735 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:47 smithi142 ceph-mon[15828]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:46:47.735 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:47 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:47.735 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:47 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:48.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:48 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:49.770 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:49 smithi142 ceph-mon[15828]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:46:49.771 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:49 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:50.090 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$2crzXT1lfV1/D2afw2NxzeRHTuNJ.o/oxaOujI9mhNjazjY75hHku", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1713649608, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-20T21:46:50.090 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.165+0000 7fec28400700 1 Processor -- start 2024-04-20T21:46:50.090 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.166+0000 7fec28400700 1 -- start start 2024-04-20T21:46:50.090 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.166+0000 7fec28400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2010d0d0 0x7fec2010d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:50.090 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.166+0000 7fec28400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2010dac0 con 0x7fec2010d0d0 2024-04-20T21:46:50.090 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.166+0000 7fec25a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2010d0d0 0x7fec2010d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:50.095 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.167+0000 7fec25a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2010d0d0 0x7fec2010d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41280/0 (socket says 172.21.15.142:41280) 2024-04-20T21:46:50.095 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.167+0000 7fec25a00700 1 -- 172.21.15.142:0/438713584 learned_addr learned my addr 172.21.15.142:0/438713584 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:50.095 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.167+0000 7fec25a00700 1 -- 172.21.15.142:0/438713584 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2010dda0 con 0x7fec2010d0d0 2024-04-20T21:46:50.095 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.167+0000 7fec25a00700 1 --2- 172.21.15.142:0/438713584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2010d0d0 0x7fec2010d4f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec140098a0 tx=0x7fec14009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e84665db2a92922 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:50.095 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.168+0000 7fec1fe00700 1 -- 172.21.15.142:0/438713584 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec14004180 con 0x7fec2010d0d0 2024-04-20T21:46:50.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.168+0000 7fec1fe00700 1 -- 172.21.15.142:0/438713584 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec140042e0 con 0x7fec2010d0d0 2024-04-20T21:46:50.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.168+0000 7fec1fe00700 1 -- 172.21.15.142:0/438713584 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec14011b10 con 0x7fec2010d0d0 2024-04-20T21:46:50.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.168+0000 7fec28400700 1 -- 172.21.15.142:0/438713584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2010d0d0 msgr2=0x7fec2010d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:50.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.168+0000 7fec28400700 1 --2- 172.21.15.142:0/438713584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2010d0d0 0x7fec2010d4f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec140098a0 tx=0x7fec14009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:50.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.169+0000 7fec28400700 1 -- 172.21.15.142:0/438713584 shutdown_connections 2024-04-20T21:46:50.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.169+0000 7fec28400700 1 --2- 172.21.15.142:0/438713584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2010d0d0 0x7fec2010d4f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:50.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.169+0000 7fec28400700 1 -- 172.21.15.142:0/438713584 >> 172.21.15.142:0/438713584 conn(0x7fec2007bc20 msgr2=0x7fec2007e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:50.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.169+0000 7fec28400700 1 -- 172.21.15.142:0/438713584 shutdown_connections 2024-04-20T21:46:50.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.169+0000 7fec28400700 1 -- 172.21.15.142:0/438713584 wait complete. 2024-04-20T21:46:50.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.170+0000 7fec28400700 1 Processor -- start 2024-04-20T21:46:50.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.170+0000 7fec28400700 1 -- start start 2024-04-20T21:46:50.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.171+0000 7fec28400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2010d0d0 0x7fec201a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:50.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.171+0000 7fec28400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec201a0e70 con 0x7fec2010d0d0 2024-04-20T21:46:50.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.171+0000 7fec25a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2010d0d0 0x7fec201a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:50.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.171+0000 7fec25a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2010d0d0 0x7fec201a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41296/0 (socket says 172.21.15.142:41296) 2024-04-20T21:46:50.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.171+0000 7fec25a00700 1 -- 172.21.15.142:0/367999423 learned_addr learned my addr 172.21.15.142:0/367999423 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:50.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.171+0000 7fec25a00700 1 -- 172.21.15.142:0/367999423 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec14009550 con 0x7fec2010d0d0 2024-04-20T21:46:50.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.172+0000 7fec25a00700 1 --2- 172.21.15.142:0/367999423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2010d0d0 0x7fec201a0930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fec140117b0 tx=0x7fec14011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:50.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.172+0000 7fec1e000700 1 -- 172.21.15.142:0/367999423 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec140038b0 con 0x7fec2010d0d0 2024-04-20T21:46:50.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.172+0000 7fec1e000700 1 -- 172.21.15.142:0/367999423 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec14003a10 con 0x7fec2010d0d0 2024-04-20T21:46:50.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.172+0000 7fec1e000700 1 -- 172.21.15.142:0/367999423 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec140246e0 con 0x7fec2010d0d0 2024-04-20T21:46:50.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.173+0000 7fec28400700 1 -- 172.21.15.142:0/367999423 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec201a1070 con 0x7fec2010d0d0 2024-04-20T21:46:50.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.173+0000 7fec28400700 1 -- 172.21.15.142:0/367999423 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec201a1510 con 0x7fec2010d0d0 2024-04-20T21:46:50.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.174+0000 7fec28400700 1 -- 172.21.15.142:0/367999423 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec20110fd0 con 0x7fec2010d0d0 2024-04-20T21:46:50.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.175+0000 7fec1e000700 1 -- 172.21.15.142:0/367999423 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fec1401ab80 con 0x7fec2010d0d0 2024-04-20T21:46:50.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.175+0000 7fec1e000700 1 --2- 172.21.15.142:0/367999423 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7fec080387c0 0x7fec0803ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:50.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.175+0000 7fec1e000700 1 -- 172.21.15.142:0/367999423 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fec1404c9a0 con 0x7fec2010d0d0 2024-04-20T21:46:50.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.176+0000 7fec25000700 1 --2- 172.21.15.142:0/367999423 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7fec080387c0 0x7fec0803ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:50.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.177+0000 7fec25000700 1 --2- 172.21.15.142:0/367999423 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7fec080387c0 0x7fec0803ac80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fec0c006fd0 tx=0x7fec0c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:50.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.181+0000 7fec1e000700 1 -- 172.21.15.142:0/367999423 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fec1401a430 con 0x7fec2010d0d0 2024-04-20T21:46:50.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.440+0000 7fec28400700 1 -- 172.21.15.142:0/367999423 --> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fec20062330 con 0x7fec080387c0 2024-04-20T21:46:50.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.711+0000 7fec1e000700 1 -- 172.21.15.142:0/367999423 <== mgr.14164 v2:172.21.15.142:6800/3464616902 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fec20062330 con 0x7fec080387c0 2024-04-20T21:46:50.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.714+0000 7fec28400700 1 -- 172.21.15.142:0/367999423 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7fec080387c0 msgr2=0x7fec0803ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:50.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.714+0000 7fec28400700 1 --2- 172.21.15.142:0/367999423 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7fec080387c0 0x7fec0803ac80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fec0c006fd0 tx=0x7fec0c006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:50.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.714+0000 7fec28400700 1 -- 172.21.15.142:0/367999423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2010d0d0 msgr2=0x7fec201a0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:50.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.714+0000 7fec28400700 1 --2- 172.21.15.142:0/367999423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2010d0d0 0x7fec201a0930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fec140117b0 tx=0x7fec14011890 comp rx=0 tx=0).stop 2024-04-20T21:46:50.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.714+0000 7fec28400700 1 -- 172.21.15.142:0/367999423 shutdown_connections 2024-04-20T21:46:50.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.714+0000 7fec28400700 1 --2- 172.21.15.142:0/367999423 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7fec080387c0 0x7fec0803ac80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:50.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.714+0000 7fec28400700 1 --2- 172.21.15.142:0/367999423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec2010d0d0 0x7fec201a0930 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:50.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.714+0000 7fec28400700 1 -- 172.21.15.142:0/367999423 >> 172.21.15.142:0/367999423 conn(0x7fec2007bc20 msgr2=0x7fec2007c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:50.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.714+0000 7fec28400700 1 -- 172.21.15.142:0/367999423 shutdown_connections 2024-04-20T21:46:50.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:48.714+0000 7fec28400700 1 -- 172.21.15.142:0/367999423 wait complete. 2024-04-20T21:46:50.098 INFO:teuthology.orchestra.run.smithi142.stdout:Fetching dashboard port number... 2024-04-20T21:46:50.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:50 smithi142 ceph-mon[15828]: mgrmap e13: smithi142.zzmcfz(active, since 6s) 2024-04-20T21:46:51.668 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 8443 2024-04-20T21:46:51.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.724+0000 7efcd2600700 1 Processor -- start 2024-04-20T21:46:51.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.724+0000 7efcd2600700 1 -- start start 2024-04-20T21:46:51.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.724+0000 7efcd2600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efccc1065a0 0x7efccc1069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:51.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.724+0000 7efcd2600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc106f90 con 0x7efccc1065a0 2024-04-20T21:46:51.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.725+0000 7efccb400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efccc1065a0 0x7efccc1069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:51.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.725+0000 7efccb400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efccc1065a0 0x7efccc1069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41306/0 (socket says 172.21.15.142:41306) 2024-04-20T21:46:51.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.725+0000 7efccb400700 1 -- 172.21.15.142:0/1638516023 learned_addr learned my addr 172.21.15.142:0/1638516023 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:51.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.725+0000 7efccb400700 1 -- 172.21.15.142:0/1638516023 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc1077a0 con 0x7efccc1065a0 2024-04-20T21:46:51.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.726+0000 7efccb400700 1 --2- 172.21.15.142:0/1638516023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efccc1065a0 0x7efccc1069c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0098a0 tx=0x7efcbc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45d3c1c98b9600f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:51.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.726+0000 7efcca000700 1 -- 172.21.15.142:0/1638516023 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcbc004180 con 0x7efccc1065a0 2024-04-20T21:46:51.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.726+0000 7efcca000700 1 -- 172.21.15.142:0/1638516023 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efcbc0042e0 con 0x7efccc1065a0 2024-04-20T21:46:51.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.726+0000 7efcca000700 1 -- 172.21.15.142:0/1638516023 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcbc011b10 con 0x7efccc1065a0 2024-04-20T21:46:51.669 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.726+0000 7efcd2600700 1 -- 172.21.15.142:0/1638516023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efccc1065a0 msgr2=0x7efccc1069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:51.670 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.726+0000 7efcd2600700 1 --2- 172.21.15.142:0/1638516023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efccc1065a0 0x7efccc1069c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0098a0 tx=0x7efcbc009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:51.670 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.727+0000 7efcd2600700 1 -- 172.21.15.142:0/1638516023 shutdown_connections 2024-04-20T21:46:51.670 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.727+0000 7efcd2600700 1 --2- 172.21.15.142:0/1638516023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efccc1065a0 0x7efccc1069c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:51.670 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.727+0000 7efcd2600700 1 -- 172.21.15.142:0/1638516023 >> 172.21.15.142:0/1638516023 conn(0x7efccc101ba0 msgr2=0x7efccc103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:51.670 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.727+0000 7efcd2600700 1 -- 172.21.15.142:0/1638516023 shutdown_connections 2024-04-20T21:46:51.670 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.727+0000 7efcd2600700 1 -- 172.21.15.142:0/1638516023 wait complete. 2024-04-20T21:46:51.670 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.728+0000 7efcd2600700 1 Processor -- start 2024-04-20T21:46:51.670 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.728+0000 7efcd2600700 1 -- start start 2024-04-20T21:46:51.670 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.728+0000 7efcd2600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efccc1065a0 0x7efccc19a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:51.670 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.728+0000 7efcd2600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc19a940 con 0x7efccc1065a0 2024-04-20T21:46:51.670 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.728+0000 7efccb400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efccc1065a0 0x7efccc19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:51.670 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.729+0000 7efccb400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efccc1065a0 0x7efccc19a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41314/0 (socket says 172.21.15.142:41314) 2024-04-20T21:46:51.671 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.729+0000 7efccb400700 1 -- 172.21.15.142:0/2462218082 learned_addr learned my addr 172.21.15.142:0/2462218082 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:51.671 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.729+0000 7efccb400700 1 -- 172.21.15.142:0/2462218082 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc009550 con 0x7efccc1065a0 2024-04-20T21:46:51.671 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.729+0000 7efccb400700 1 --2- 172.21.15.142:0/2462218082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efccc1065a0 0x7efccc19a400 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efcbc000c00 tx=0x7efcbc011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:51.671 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.729+0000 7efcc3e00700 1 -- 172.21.15.142:0/2462218082 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcbc0038b0 con 0x7efccc1065a0 2024-04-20T21:46:51.671 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.729+0000 7efcc3e00700 1 -- 172.21.15.142:0/2462218082 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efcbc003a10 con 0x7efccc1065a0 2024-04-20T21:46:51.671 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.729+0000 7efcc3e00700 1 -- 172.21.15.142:0/2462218082 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcbc024780 con 0x7efccc1065a0 2024-04-20T21:46:51.671 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.729+0000 7efcd2600700 1 -- 172.21.15.142:0/2462218082 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efccc19ab40 con 0x7efccc1065a0 2024-04-20T21:46:51.671 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.730+0000 7efcd2600700 1 -- 172.21.15.142:0/2462218082 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efccc19afe0 con 0x7efccc1065a0 2024-04-20T21:46:51.671 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.731+0000 7efcc3e00700 1 -- 172.21.15.142:0/2462218082 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7efcbc01ac10 con 0x7efccc1065a0 2024-04-20T21:46:51.671 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.731+0000 7efcd2600700 1 -- 172.21.15.142:0/2462218082 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efccc10a9d0 con 0x7efccc1065a0 2024-04-20T21:46:51.671 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.731+0000 7efcc3e00700 1 --2- 172.21.15.142:0/2462218082 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7efcb0038860 0x7efcb003ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:51.671 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.731+0000 7efcc3e00700 1 -- 172.21.15.142:0/2462218082 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7efcbc04c7b0 con 0x7efccc1065a0 2024-04-20T21:46:51.671 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.731+0000 7efccaa00700 1 --2- 172.21.15.142:0/2462218082 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7efcb0038860 0x7efcb003ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:51.671 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.732+0000 7efccaa00700 1 --2- 172.21.15.142:0/2462218082 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7efcb0038860 0x7efcb003ad20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efcb8006fd0 tx=0x7efcb8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:51.671 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.737+0000 7efcc3e00700 1 -- 172.21.15.142:0/2462218082 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7efcbc01a430 con 0x7efccc1065a0 2024-04-20T21:46:51.672 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.954+0000 7efcd2600700 1 -- 172.21.15.142:0/2462218082 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7efccc19d870 con 0x7efccc1065a0 2024-04-20T21:46:51.672 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.955+0000 7efcc3e00700 1 -- 172.21.15.142:0/2462218082 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7efcbc018b40 con 0x7efccc1065a0 2024-04-20T21:46:51.672 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.957+0000 7efcd2600700 1 -- 172.21.15.142:0/2462218082 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7efcb0038860 msgr2=0x7efcb003ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:51.672 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.957+0000 7efcd2600700 1 --2- 172.21.15.142:0/2462218082 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7efcb0038860 0x7efcb003ad20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efcb8006fd0 tx=0x7efcb8006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:51.672 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.957+0000 7efcd2600700 1 -- 172.21.15.142:0/2462218082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efccc1065a0 msgr2=0x7efccc19a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:51.672 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.957+0000 7efcd2600700 1 --2- 172.21.15.142:0/2462218082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efccc1065a0 0x7efccc19a400 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efcbc000c00 tx=0x7efcbc011890 comp rx=0 tx=0).stop 2024-04-20T21:46:51.672 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.957+0000 7efcd2600700 1 -- 172.21.15.142:0/2462218082 shutdown_connections 2024-04-20T21:46:51.672 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.957+0000 7efcd2600700 1 --2- 172.21.15.142:0/2462218082 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7efcb0038860 0x7efcb003ad20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:51.672 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.957+0000 7efcd2600700 1 --2- 172.21.15.142:0/2462218082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efccc1065a0 0x7efccc19a400 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:51.672 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.957+0000 7efcd2600700 1 -- 172.21.15.142:0/2462218082 >> 172.21.15.142:0/2462218082 conn(0x7efccc101ba0 msgr2=0x7efccc102840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:51.672 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.958+0000 7efcd2600700 1 -- 172.21.15.142:0/2462218082 shutdown_connections 2024-04-20T21:46:51.672 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:50.958+0000 7efcd2600700 1 -- 172.21.15.142:0/2462218082 wait complete. 2024-04-20T21:46:51.692 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-20T21:46:51.692 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout disabled 2024-04-20T21:46:51.711 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-20T21:46:51.711 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout inactive 2024-04-20T21:46:51.711 INFO:teuthology.orchestra.run.smithi142.stdout:firewalld.service is not enabled 2024-04-20T21:46:51.711 INFO:teuthology.orchestra.run.smithi142.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-20T21:46:51.714 INFO:teuthology.orchestra.run.smithi142.stdout:Ceph Dashboard is now available at: 2024-04-20T21:46:51.714 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:46:51.714 INFO:teuthology.orchestra.run.smithi142.stdout: URL: https://smithi142.front.sepia.ceph.com:8443/ 2024-04-20T21:46:51.714 INFO:teuthology.orchestra.run.smithi142.stdout: User: admin 2024-04-20T21:46:51.715 INFO:teuthology.orchestra.run.smithi142.stdout: Password: 1l76z2pz6b 2024-04-20T21:46:51.715 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:46:51.715 INFO:teuthology.orchestra.run.smithi142.stdout:Saving cluster configuration to /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config directory 2024-04-20T21:46:51.716 INFO:teuthology.orchestra.run.smithi142.stdout:Enabling autotune for osd_memory_target 2024-04-20T21:46:51.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:51 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2462218082' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-20T21:46:53.189 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.340+0000 7f7ab9400700 1 Processor -- start 2024-04-20T21:46:53.189 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.340+0000 7f7ab9400700 1 -- start start 2024-04-20T21:46:53.189 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.341+0000 7f7ab9400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab4108790 0x7f7ab4108bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:53.189 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.341+0000 7f7ab9400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4109180 con 0x7f7ab4108790 2024-04-20T21:46:53.189 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.342+0000 7f7ab2800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab4108790 0x7f7ab4108bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:53.190 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.342+0000 7f7ab2800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab4108790 0x7f7ab4108bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41324/0 (socket says 172.21.15.142:41324) 2024-04-20T21:46:53.190 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.342+0000 7f7ab2800700 1 -- 172.21.15.142:0/4149662602 learned_addr learned my addr 172.21.15.142:0/4149662602 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:53.190 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.342+0000 7f7ab2800700 1 -- 172.21.15.142:0/4149662602 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab4109990 con 0x7f7ab4108790 2024-04-20T21:46:53.190 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.342+0000 7f7ab2800700 1 --2- 172.21.15.142:0/4149662602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab4108790 0x7f7ab4108bb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40098a0 tx=0x7f7aa4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e378341cc36d6133 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:53.190 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.343+0000 7f7ab1400700 1 -- 172.21.15.142:0/4149662602 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7aa4004180 con 0x7f7ab4108790 2024-04-20T21:46:53.190 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.343+0000 7f7ab1400700 1 -- 172.21.15.142:0/4149662602 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7aa40042e0 con 0x7f7ab4108790 2024-04-20T21:46:53.190 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.343+0000 7f7ab1400700 1 -- 172.21.15.142:0/4149662602 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7aa4011b10 con 0x7f7ab4108790 2024-04-20T21:46:53.190 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.344+0000 7f7ab9400700 1 -- 172.21.15.142:0/4149662602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab4108790 msgr2=0x7f7ab4108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:53.190 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.344+0000 7f7ab9400700 1 --2- 172.21.15.142:0/4149662602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab4108790 0x7f7ab4108bb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40098a0 tx=0x7f7aa4009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:53.190 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.344+0000 7f7ab9400700 1 -- 172.21.15.142:0/4149662602 shutdown_connections 2024-04-20T21:46:53.190 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.344+0000 7f7ab9400700 1 --2- 172.21.15.142:0/4149662602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab4108790 0x7f7ab4108bb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:53.190 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.344+0000 7f7ab9400700 1 -- 172.21.15.142:0/4149662602 >> 172.21.15.142:0/4149662602 conn(0x7f7ab407bbf0 msgr2=0x7f7ab41064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:53.190 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.344+0000 7f7ab9400700 1 -- 172.21.15.142:0/4149662602 shutdown_connections 2024-04-20T21:46:53.190 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.344+0000 7f7ab9400700 1 -- 172.21.15.142:0/4149662602 wait complete. 2024-04-20T21:46:53.191 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.345+0000 7f7ab9400700 1 Processor -- start 2024-04-20T21:46:53.191 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.345+0000 7f7ab9400700 1 -- start start 2024-04-20T21:46:53.191 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.345+0000 7f7ab9400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab4108790 0x7f7ab419c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:53.191 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.346+0000 7f7ab9400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab419ca40 con 0x7f7ab4108790 2024-04-20T21:46:53.191 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.346+0000 7f7ab2800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab4108790 0x7f7ab419c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:53.191 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.346+0000 7f7ab2800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab4108790 0x7f7ab419c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41332/0 (socket says 172.21.15.142:41332) 2024-04-20T21:46:53.191 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.346+0000 7f7ab2800700 1 -- 172.21.15.142:0/2401045573 learned_addr learned my addr 172.21.15.142:0/2401045573 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:53.191 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.346+0000 7f7ab2800700 1 -- 172.21.15.142:0/2401045573 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa4009550 con 0x7f7ab4108790 2024-04-20T21:46:53.191 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.347+0000 7f7ab2800700 1 --2- 172.21.15.142:0/2401045573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab4108790 0x7f7ab419c500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40117b0 tx=0x7f7aa4011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:53.191 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.347+0000 7f7aab400700 1 -- 172.21.15.142:0/2401045573 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7aa40038b0 con 0x7f7ab4108790 2024-04-20T21:46:53.191 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.347+0000 7f7aab400700 1 -- 172.21.15.142:0/2401045573 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7aa4003a10 con 0x7f7ab4108790 2024-04-20T21:46:53.191 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.347+0000 7f7ab9400700 1 -- 172.21.15.142:0/2401045573 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab419cc40 con 0x7f7ab4108790 2024-04-20T21:46:53.191 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.347+0000 7f7aab400700 1 -- 172.21.15.142:0/2401045573 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7aa40246e0 con 0x7f7ab4108790 2024-04-20T21:46:53.191 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.347+0000 7f7ab9400700 1 -- 172.21.15.142:0/2401045573 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab419d0e0 con 0x7f7ab4108790 2024-04-20T21:46:53.192 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.348+0000 7f7aab400700 1 -- 172.21.15.142:0/2401045573 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f7aa401a430 con 0x7f7ab4108790 2024-04-20T21:46:53.192 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.348+0000 7f7ab9400700 1 -- 172.21.15.142:0/2401045573 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab410cbc0 con 0x7f7ab4108790 2024-04-20T21:46:53.192 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.349+0000 7f7aab400700 1 --2- 172.21.15.142:0/2401045573 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f7a98038860 0x7f7a9803ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:53.192 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.349+0000 7f7aab400700 1 -- 172.21.15.142:0/2401045573 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7aa404cab0 con 0x7f7ab4108790 2024-04-20T21:46:53.192 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.349+0000 7f7ab1e00700 1 --2- 172.21.15.142:0/2401045573 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f7a98038860 0x7f7a9803ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:53.192 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.350+0000 7f7ab1e00700 1 --2- 172.21.15.142:0/2401045573 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f7a98038860 0x7f7a9803ad20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0006fd0 tx=0x7f7aa0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:53.192 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.355+0000 7f7aab400700 1 -- 172.21.15.142:0/2401045573 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f7aa4018b40 con 0x7f7ab4108790 2024-04-20T21:46:53.192 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.571+0000 7f7ab9400700 1 -- 172.21.15.142:0/2401045573 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f7ab419f970 con 0x7f7ab4108790 2024-04-20T21:46:53.192 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.572+0000 7f7aab400700 1 -- 172.21.15.142:0/2401045573 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f7aa4018b40 con 0x7f7ab4108790 2024-04-20T21:46:53.192 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.575+0000 7f7ab9400700 1 -- 172.21.15.142:0/2401045573 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f7a98038860 msgr2=0x7f7a9803ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:53.192 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.575+0000 7f7ab9400700 1 --2- 172.21.15.142:0/2401045573 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f7a98038860 0x7f7a9803ad20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0006fd0 tx=0x7f7aa0006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:53.192 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.575+0000 7f7ab9400700 1 -- 172.21.15.142:0/2401045573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab4108790 msgr2=0x7f7ab419c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:53.192 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.575+0000 7f7ab9400700 1 --2- 172.21.15.142:0/2401045573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab4108790 0x7f7ab419c500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40117b0 tx=0x7f7aa4011890 comp rx=0 tx=0).stop 2024-04-20T21:46:53.193 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.575+0000 7f7ab9400700 1 -- 172.21.15.142:0/2401045573 shutdown_connections 2024-04-20T21:46:53.193 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.575+0000 7f7ab9400700 1 --2- 172.21.15.142:0/2401045573 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f7a98038860 0x7f7a9803ad20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:53.193 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.575+0000 7f7ab9400700 1 --2- 172.21.15.142:0/2401045573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ab4108790 0x7f7ab419c500 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:53.193 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.575+0000 7f7ab9400700 1 -- 172.21.15.142:0/2401045573 >> 172.21.15.142:0/2401045573 conn(0x7f7ab407bbf0 msgr2=0x7f7ab4105c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:53.193 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.576+0000 7f7ab9400700 1 -- 172.21.15.142:0/2401045573 shutdown_connections 2024-04-20T21:46:53.193 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:52.576+0000 7f7ab9400700 1 -- 172.21.15.142:0/2401045573 wait complete. 2024-04-20T21:46:54.887 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.852+0000 7f4687600700 1 Processor -- start 2024-04-20T21:46:54.887 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.852+0000 7f4687600700 1 -- start start 2024-04-20T21:46:54.887 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.852+0000 7f4687600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46801087a0 0x7f4680108bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:54.887 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.852+0000 7f4687600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4680109190 con 0x7f46801087a0 2024-04-20T21:46:54.887 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.853+0000 7f4684c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46801087a0 0x7f4680108bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:54.887 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.853+0000 7f4684c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46801087a0 0x7f4680108bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41344/0 (socket says 172.21.15.142:41344) 2024-04-20T21:46:54.887 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.853+0000 7f4684c00700 1 -- 172.21.15.142:0/179046766 learned_addr learned my addr 172.21.15.142:0/179046766 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:54.887 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.853+0000 7f4684c00700 1 -- 172.21.15.142:0/179046766 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46801099a0 con 0x7f46801087a0 2024-04-20T21:46:54.887 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.854+0000 7f4684c00700 1 --2- 172.21.15.142:0/179046766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46801087a0 0x7f4680108bc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f46740098a0 tx=0x7f4674009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e896d9206ccb95c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:54.888 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.854+0000 7f467f400700 1 -- 172.21.15.142:0/179046766 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4674004180 con 0x7f46801087a0 2024-04-20T21:46:54.888 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.854+0000 7f467f400700 1 -- 172.21.15.142:0/179046766 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f46740042e0 con 0x7f46801087a0 2024-04-20T21:46:54.888 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.854+0000 7f467f400700 1 -- 172.21.15.142:0/179046766 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4674011b10 con 0x7f46801087a0 2024-04-20T21:46:54.888 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.855+0000 7f4687600700 1 -- 172.21.15.142:0/179046766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46801087a0 msgr2=0x7f4680108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:54.888 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.855+0000 7f4687600700 1 --2- 172.21.15.142:0/179046766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46801087a0 0x7f4680108bc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f46740098a0 tx=0x7f4674009bb0 comp rx=0 tx=0).stop 2024-04-20T21:46:54.888 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.855+0000 7f4687600700 1 -- 172.21.15.142:0/179046766 shutdown_connections 2024-04-20T21:46:54.888 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.855+0000 7f4687600700 1 --2- 172.21.15.142:0/179046766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46801087a0 0x7f4680108bc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:54.888 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.855+0000 7f4687600700 1 -- 172.21.15.142:0/179046766 >> 172.21.15.142:0/179046766 conn(0x7f4680103d60 msgr2=0x7f4680106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:54.888 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.855+0000 7f4687600700 1 -- 172.21.15.142:0/179046766 shutdown_connections 2024-04-20T21:46:54.888 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.855+0000 7f4687600700 1 -- 172.21.15.142:0/179046766 wait complete. 2024-04-20T21:46:54.888 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.856+0000 7f4687600700 1 Processor -- start 2024-04-20T21:46:54.888 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.856+0000 7f4687600700 1 -- start start 2024-04-20T21:46:54.888 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.856+0000 7f4687600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46801087a0 0x7f468019c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:54.888 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.856+0000 7f4687600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468019ca70 con 0x7f46801087a0 2024-04-20T21:46:54.888 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.857+0000 7f4684c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46801087a0 0x7f468019c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:54.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.857+0000 7f4684c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46801087a0 0x7f468019c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41346/0 (socket says 172.21.15.142:41346) 2024-04-20T21:46:54.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.857+0000 7f4684c00700 1 -- 172.21.15.142:0/1145429367 learned_addr learned my addr 172.21.15.142:0/1145429367 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:54.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.857+0000 7f4684c00700 1 -- 172.21.15.142:0/1145429367 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4674009550 con 0x7f46801087a0 2024-04-20T21:46:54.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.857+0000 7f4684c00700 1 --2- 172.21.15.142:0/1145429367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46801087a0 0x7f468019c530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f46740117b0 tx=0x7f4674011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:54.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.857+0000 7f467d600700 1 -- 172.21.15.142:0/1145429367 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46740038b0 con 0x7f46801087a0 2024-04-20T21:46:54.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.858+0000 7f467d600700 1 -- 172.21.15.142:0/1145429367 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4674003a10 con 0x7f46801087a0 2024-04-20T21:46:54.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.858+0000 7f4687600700 1 -- 172.21.15.142:0/1145429367 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468019cc70 con 0x7f46801087a0 2024-04-20T21:46:54.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.858+0000 7f467d600700 1 -- 172.21.15.142:0/1145429367 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f46740246e0 con 0x7f46801087a0 2024-04-20T21:46:54.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.858+0000 7f4687600700 1 -- 172.21.15.142:0/1145429367 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f468019d110 con 0x7f46801087a0 2024-04-20T21:46:54.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.859+0000 7f467d600700 1 -- 172.21.15.142:0/1145429367 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f467401a430 con 0x7f46801087a0 2024-04-20T21:46:54.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.859+0000 7f4687600700 1 -- 172.21.15.142:0/1145429367 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468010cbd0 con 0x7f46801087a0 2024-04-20T21:46:54.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.859+0000 7f467d600700 1 --2- 172.21.15.142:0/1145429367 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f4668038810 0x7f466803acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:54.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.859+0000 7f467d600700 1 -- 172.21.15.142:0/1145429367 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f467404ca40 con 0x7f46801087a0 2024-04-20T21:46:54.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.860+0000 7f467fe00700 1 --2- 172.21.15.142:0/1145429367 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f4668038810 0x7f466803acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:54.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.860+0000 7f467fe00700 1 --2- 172.21.15.142:0/1145429367 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f4668038810 0x7f466803acd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f466c006fd0 tx=0x7f466c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:54.890 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:53.864+0000 7f467d600700 1 -- 172.21.15.142:0/1145429367 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f467404ee60 con 0x7f46801087a0 2024-04-20T21:46:54.890 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:54.202+0000 7f4687600700 1 -- 172.21.15.142:0/1145429367 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f468019f9a0 con 0x7f46801087a0 2024-04-20T21:46:54.890 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:54.209+0000 7f467d600700 1 -- 172.21.15.142:0/1145429367 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f4674018b40 con 0x7f46801087a0 2024-04-20T21:46:54.890 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:54.212+0000 7f4687600700 1 -- 172.21.15.142:0/1145429367 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f4668038810 msgr2=0x7f466803acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:54.890 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:54.212+0000 7f4687600700 1 --2- 172.21.15.142:0/1145429367 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f4668038810 0x7f466803acd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f466c006fd0 tx=0x7f466c006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:54.890 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:54.212+0000 7f4687600700 1 -- 172.21.15.142:0/1145429367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46801087a0 msgr2=0x7f468019c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:54.890 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:54.212+0000 7f4687600700 1 --2- 172.21.15.142:0/1145429367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46801087a0 0x7f468019c530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f46740117b0 tx=0x7f4674011890 comp rx=0 tx=0).stop 2024-04-20T21:46:54.890 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:54.212+0000 7f4687600700 1 -- 172.21.15.142:0/1145429367 shutdown_connections 2024-04-20T21:46:54.890 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:54.212+0000 7f4687600700 1 --2- 172.21.15.142:0/1145429367 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f4668038810 0x7f466803acd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:54.890 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:54.212+0000 7f4687600700 1 --2- 172.21.15.142:0/1145429367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46801087a0 0x7f468019c530 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:54.890 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:54.212+0000 7f4687600700 1 -- 172.21.15.142:0/1145429367 >> 172.21.15.142:0/1145429367 conn(0x7f4680103d60 msgr2=0x7f46801048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:54.890 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:54.212+0000 7f4687600700 1 -- 172.21.15.142:0/1145429367 shutdown_connections 2024-04-20T21:46:54.890 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2024-04-20T21:46:54.212+0000 7f4687600700 1 -- 172.21.15.142:0/1145429367 wait complete. 2024-04-20T21:46:54.890 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-20T21:46:54.890 INFO:teuthology.orchestra.run.smithi142.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-20T21:46:54.891 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:46:54.891 INFO:teuthology.orchestra.run.smithi142.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-20T21:46:54.891 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:46:54.891 INFO:teuthology.orchestra.run.smithi142.stdout:Or, if you are only running a single cluster on this host: 2024-04-20T21:46:54.891 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:46:54.891 INFO:teuthology.orchestra.run.smithi142.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-20T21:46:54.891 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:46:54.891 INFO:teuthology.orchestra.run.smithi142.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-20T21:46:54.891 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:46:54.891 INFO:teuthology.orchestra.run.smithi142.stdout: ceph telemetry on 2024-04-20T21:46:54.891 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:46:54.891 INFO:teuthology.orchestra.run.smithi142.stdout:For more information see: 2024-04-20T21:46:54.891 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:46:54.891 INFO:teuthology.orchestra.run.smithi142.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-20T21:46:54.891 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:46:54.891 INFO:teuthology.orchestra.run.smithi142.stdout:Bootstrap complete. 2024-04-20T21:46:54.961 INFO:tasks.cephadm:Fetching config... 2024-04-20T21:46:54.961 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-20T21:46:54.961 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-20T21:46:55.005 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-20T21:46:55.005 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-20T21:46:55.005 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-20T21:46:55.089 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-20T21:46:55.089 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-20T21:46:55.090 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/keyring of=/dev/stdout 2024-04-20T21:46:55.198 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-20T21:46:55.198 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-20T21:46:55.198 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-20T21:46:55.292 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-20T21:46:55.293 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7cGiT8olwRjjF9882c35eD2pIzN+kkdhT+Uon6kbNpD2bn3NpDn4WIWxsB7uLaUGlj/hOaT4zvGNlB1D5hraDI9otzxGaPz+Zlr2+ZHYbRDo/k8o7+wizVWLcy3iku6WiDcyJz6HvM7ODl+Xo10NSoySokh0is2YGsjC3ZMSiK+aP2Bb+y2gexcD+dXjDvb4zjMKW4EBgyV0ce2G19+cejR3kH7S9AW3XYw2mWV5A0a3dYejzhItRJywEuGae7N/rzbxQ8amwA9+PQBMToNS3jtO+vTUsdl7TB4K4tFFKCldiBZxt8JUoSFUS29Yp3WpgQHlRdUr6WF8tDpvhXen2+wug90niztJqF43vJrp3lbjB6tOADNxi1NMIfUIIi6UTgWcHGC0Li2IukeQM3sWm15OC3EBsdLBO7RU2pS8IiiGBDmiSD/xFaEmSym2tO2H8d6qE2qkKoccQmDAP0Mgykxr/8En71HaX7zslnlnLtOU52qb2bReMd/BTsUrXzs8= ceph-270cccba-ff5f-11ee-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-20T21:46:55.387 INFO:teuthology.orchestra.run.smithi142.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7cGiT8olwRjjF9882c35eD2pIzN+kkdhT+Uon6kbNpD2bn3NpDn4WIWxsB7uLaUGlj/hOaT4zvGNlB1D5hraDI9otzxGaPz+Zlr2+ZHYbRDo/k8o7+wizVWLcy3iku6WiDcyJz6HvM7ODl+Xo10NSoySokh0is2YGsjC3ZMSiK+aP2Bb+y2gexcD+dXjDvb4zjMKW4EBgyV0ce2G19+cejR3kH7S9AW3XYw2mWV5A0a3dYejzhItRJywEuGae7N/rzbxQ8amwA9+PQBMToNS3jtO+vTUsdl7TB4K4tFFKCldiBZxt8JUoSFUS29Yp3WpgQHlRdUr6WF8tDpvhXen2+wug90niztJqF43vJrp3lbjB6tOADNxi1NMIfUIIi6UTgWcHGC0Li2IukeQM3sWm15OC3EBsdLBO7RU2pS8IiiGBDmiSD/xFaEmSym2tO2H8d6qE2qkKoccQmDAP0Mgykxr/8En71HaX7zslnlnLtOU52qb2bReMd/BTsUrXzs8= ceph-270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T21:46:55.417 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7cGiT8olwRjjF9882c35eD2pIzN+kkdhT+Uon6kbNpD2bn3NpDn4WIWxsB7uLaUGlj/hOaT4zvGNlB1D5hraDI9otzxGaPz+Zlr2+ZHYbRDo/k8o7+wizVWLcy3iku6WiDcyJz6HvM7ODl+Xo10NSoySokh0is2YGsjC3ZMSiK+aP2Bb+y2gexcD+dXjDvb4zjMKW4EBgyV0ce2G19+cejR3kH7S9AW3XYw2mWV5A0a3dYejzhItRJywEuGae7N/rzbxQ8amwA9+PQBMToNS3jtO+vTUsdl7TB4K4tFFKCldiBZxt8JUoSFUS29Yp3WpgQHlRdUr6WF8tDpvhXen2+wug90niztJqF43vJrp3lbjB6tOADNxi1NMIfUIIi6UTgWcHGC0Li2IukeQM3sWm15OC3EBsdLBO7RU2pS8IiiGBDmiSD/xFaEmSym2tO2H8d6qE2qkKoccQmDAP0Mgykxr/8En71HaX7zslnlnLtOU52qb2bReMd/BTsUrXzs8= ceph-270cccba-ff5f-11ee-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-20T21:46:55.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:55 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1145429367' entity='client.admin' 2024-04-20T21:46:55.545 INFO:teuthology.orchestra.run.smithi164.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7cGiT8olwRjjF9882c35eD2pIzN+kkdhT+Uon6kbNpD2bn3NpDn4WIWxsB7uLaUGlj/hOaT4zvGNlB1D5hraDI9otzxGaPz+Zlr2+ZHYbRDo/k8o7+wizVWLcy3iku6WiDcyJz6HvM7ODl+Xo10NSoySokh0is2YGsjC3ZMSiK+aP2Bb+y2gexcD+dXjDvb4zjMKW4EBgyV0ce2G19+cejR3kH7S9AW3XYw2mWV5A0a3dYejzhItRJywEuGae7N/rzbxQ8amwA9+PQBMToNS3jtO+vTUsdl7TB4K4tFFKCldiBZxt8JUoSFUS29Yp3WpgQHlRdUr6WF8tDpvhXen2+wug90niztJqF43vJrp3lbjB6tOADNxi1NMIfUIIi6UTgWcHGC0Li2IukeQM3sWm15OC3EBsdLBO7RU2pS8IiiGBDmiSD/xFaEmSym2tO2H8d6qE2qkKoccQmDAP0Mgykxr/8En71HaX7zslnlnLtOU52qb2bReMd/BTsUrXzs8= ceph-270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T21:46:55.580 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-20T21:46:55.949 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:46:58.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.695+0000 7fdd3e800700 1 -- 172.21.15.142:0/3244360799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd381070a0 msgr2=0x7fdd381074c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:58.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.695+0000 7fdd3e800700 1 --2- 172.21.15.142:0/3244360799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd381070a0 0x7fdd381074c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009910 tx=0x7fdd28009c20 comp rx=0 tx=0).stop 2024-04-20T21:46:58.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.695+0000 7fdd3e800700 1 -- 172.21.15.142:0/3244360799 shutdown_connections 2024-04-20T21:46:58.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.695+0000 7fdd3e800700 1 --2- 172.21.15.142:0/3244360799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd381070a0 0x7fdd381074c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:58.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.695+0000 7fdd3e800700 1 -- 172.21.15.142:0/3244360799 >> 172.21.15.142:0/3244360799 conn(0x7fdd38075f60 msgr2=0x7fdd380783a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:58.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.695+0000 7fdd3e800700 1 -- 172.21.15.142:0/3244360799 shutdown_connections 2024-04-20T21:46:58.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.695+0000 7fdd3e800700 1 -- 172.21.15.142:0/3244360799 wait complete. 2024-04-20T21:46:58.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.696+0000 7fdd3e800700 1 Processor -- start 2024-04-20T21:46:58.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.697+0000 7fdd3e800700 1 -- start start 2024-04-20T21:46:58.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.697+0000 7fdd3e800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd381070a0 0x7fdd3819c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:58.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.697+0000 7fdd3e800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3819c850 con 0x7fdd381070a0 2024-04-20T21:46:58.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.697+0000 7fdd37400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd381070a0 0x7fdd3819c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:58.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.697+0000 7fdd37400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd381070a0 0x7fdd3819c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60458/0 (socket says 172.21.15.142:60458) 2024-04-20T21:46:58.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.697+0000 7fdd37400700 1 -- 172.21.15.142:0/1719034586 learned_addr learned my addr 172.21.15.142:0/1719034586 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:46:58.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.698+0000 7fdd37400700 1 -- 172.21.15.142:0/1719034586 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd280095f0 con 0x7fdd381070a0 2024-04-20T21:46:58.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.698+0000 7fdd37400700 1 --2- 172.21.15.142:0/1719034586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd381070a0 0x7fdd3819c310 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdd28006010 tx=0x7fdd280050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:58.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.698+0000 7fdd2fe00700 1 -- 172.21.15.142:0/1719034586 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd2801d070 con 0x7fdd381070a0 2024-04-20T21:46:58.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.698+0000 7fdd2fe00700 1 -- 172.21.15.142:0/1719034586 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd2800be20 con 0x7fdd381070a0 2024-04-20T21:46:58.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.698+0000 7fdd2fe00700 1 -- 172.21.15.142:0/1719034586 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd2800f460 con 0x7fdd381070a0 2024-04-20T21:46:58.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.698+0000 7fdd3e800700 1 -- 172.21.15.142:0/1719034586 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3819ca50 con 0x7fdd381070a0 2024-04-20T21:46:58.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.698+0000 7fdd3e800700 1 -- 172.21.15.142:0/1719034586 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3819cef0 con 0x7fdd381070a0 2024-04-20T21:46:58.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.699+0000 7fdd2fe00700 1 -- 172.21.15.142:0/1719034586 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7fdd28022470 con 0x7fdd381070a0 2024-04-20T21:46:58.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.700+0000 7fdd3e800700 1 -- 172.21.15.142:0/1719034586 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd38195c40 con 0x7fdd381070a0 2024-04-20T21:46:58.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.700+0000 7fdd2fe00700 1 --2- 172.21.15.142:0/1719034586 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7fdd1c038820 0x7fdd1c03ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:46:58.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.700+0000 7fdd2fe00700 1 -- 172.21.15.142:0/1719034586 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fdd2804cd70 con 0x7fdd381070a0 2024-04-20T21:46:58.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.700+0000 7fdd36a00700 1 --2- 172.21.15.142:0/1719034586 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7fdd1c038820 0x7fdd1c03ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:46:58.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.701+0000 7fdd36a00700 1 --2- 172.21.15.142:0/1719034586 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7fdd1c038820 0x7fdd1c03ace0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdd20006fd0 tx=0x7fdd20006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:46:58.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.706+0000 7fdd2fe00700 1 -- 172.21.15.142:0/1719034586 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fdd28005c00 con 0x7fdd381070a0 2024-04-20T21:46:58.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.921+0000 7fdd3e800700 1 -- 172.21.15.142:0/1719034586 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fdd3810ce90 con 0x7fdd381070a0 2024-04-20T21:46:58.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.929+0000 7fdd2fe00700 1 -- 172.21.15.142:0/1719034586 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fdd2802bba0 con 0x7fdd381070a0 2024-04-20T21:46:58.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.932+0000 7fdd3e800700 1 -- 172.21.15.142:0/1719034586 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7fdd1c038820 msgr2=0x7fdd1c03ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:58.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.932+0000 7fdd3e800700 1 --2- 172.21.15.142:0/1719034586 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7fdd1c038820 0x7fdd1c03ace0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdd20006fd0 tx=0x7fdd20006e40 comp rx=0 tx=0).stop 2024-04-20T21:46:58.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.932+0000 7fdd3e800700 1 -- 172.21.15.142:0/1719034586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd381070a0 msgr2=0x7fdd3819c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:46:58.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.932+0000 7fdd3e800700 1 --2- 172.21.15.142:0/1719034586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd381070a0 0x7fdd3819c310 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdd28006010 tx=0x7fdd280050b0 comp rx=0 tx=0).stop 2024-04-20T21:46:58.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.932+0000 7fdd3e800700 1 -- 172.21.15.142:0/1719034586 shutdown_connections 2024-04-20T21:46:58.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.932+0000 7fdd3e800700 1 --2- 172.21.15.142:0/1719034586 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7fdd1c038820 0x7fdd1c03ace0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:58.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.932+0000 7fdd3e800700 1 --2- 172.21.15.142:0/1719034586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd381070a0 0x7fdd3819c310 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:46:58.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.932+0000 7fdd3e800700 1 -- 172.21.15.142:0/1719034586 >> 172.21.15.142:0/1719034586 conn(0x7fdd38075f60 msgr2=0x7fdd380769b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:46:58.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.932+0000 7fdd3e800700 1 -- 172.21.15.142:0/1719034586 shutdown_connections 2024-04-20T21:46:58.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:46:58.932+0000 7fdd3e800700 1 -- 172.21.15.142:0/1719034586 wait complete. 2024-04-20T21:46:59.310 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:58 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:59.310 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:58 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:59.310 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:58 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:46:59.310 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:58 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:46:59.311 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:58 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-20T21:46:59.311 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:58 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-20T21:46:59.311 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:58 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:46:59.311 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:58 smithi142 ceph-mon[15828]: Deploying daemon ceph-exporter.smithi142 on smithi142 2024-04-20T21:46:59.311 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:46:58 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1719034586' entity='client.admin' 2024-04-20T21:46:59.732 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-20T21:46:59.733 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-20T21:47:00.117 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:47:02.580 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.581+0000 7f952e400700 1 -- 172.21.15.142:0/2564232295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9528102a90 msgr2=0x7f9528102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:02.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.581+0000 7f952e400700 1 --2- 172.21.15.142:0/2564232295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9528102a90 0x7f9528102eb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9518009910 tx=0x7f9518009c20 comp rx=0 tx=0).stop 2024-04-20T21:47:02.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.581+0000 7f952e400700 1 -- 172.21.15.142:0/2564232295 shutdown_connections 2024-04-20T21:47:02.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.581+0000 7f952e400700 1 --2- 172.21.15.142:0/2564232295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9528102a90 0x7f9528102eb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:02.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.581+0000 7f952e400700 1 -- 172.21.15.142:0/2564232295 >> 172.21.15.142:0/2564232295 conn(0x7f95280fe050 msgr2=0x7f9528100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:02.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.581+0000 7f952e400700 1 -- 172.21.15.142:0/2564232295 shutdown_connections 2024-04-20T21:47:02.581 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.581+0000 7f952e400700 1 -- 172.21.15.142:0/2564232295 wait complete. 2024-04-20T21:47:02.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.582+0000 7f952e400700 1 Processor -- start 2024-04-20T21:47:02.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.582+0000 7f952e400700 1 -- start start 2024-04-20T21:47:02.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.583+0000 7f952e400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9528102a90 0x7f9528197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:02.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.583+0000 7f952e400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9528198480 con 0x7f9528102a90 2024-04-20T21:47:02.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.583+0000 7f9527400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9528102a90 0x7f9528197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:02.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.583+0000 7f9527400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9528102a90 0x7f9528197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60464/0 (socket says 172.21.15.142:60464) 2024-04-20T21:47:02.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.583+0000 7f9527400700 1 -- 172.21.15.142:0/2388656076 learned_addr learned my addr 172.21.15.142:0/2388656076 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:47:02.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.583+0000 7f9527400700 1 -- 172.21.15.142:0/2388656076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95180095f0 con 0x7f9528102a90 2024-04-20T21:47:02.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.584+0000 7f9527400700 1 --2- 172.21.15.142:0/2388656076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9528102a90 0x7f9528197f40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9518006010 tx=0x7f9518009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:02.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.584+0000 7f9524c00700 1 -- 172.21.15.142:0/2388656076 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f951801d070 con 0x7f9528102a90 2024-04-20T21:47:02.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.584+0000 7f9524c00700 1 -- 172.21.15.142:0/2388656076 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9518005dc0 con 0x7f9528102a90 2024-04-20T21:47:02.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.584+0000 7f9524c00700 1 -- 172.21.15.142:0/2388656076 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9518022e90 con 0x7f9528102a90 2024-04-20T21:47:02.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.584+0000 7f952e400700 1 -- 172.21.15.142:0/2388656076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9528198680 con 0x7f9528102a90 2024-04-20T21:47:02.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.584+0000 7f952e400700 1 -- 172.21.15.142:0/2388656076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9528198b20 con 0x7f9528102a90 2024-04-20T21:47:02.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.585+0000 7f9524c00700 1 -- 172.21.15.142:0/2388656076 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f9518022470 con 0x7f9528102a90 2024-04-20T21:47:02.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.585+0000 7f952e400700 1 -- 172.21.15.142:0/2388656076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95281918c0 con 0x7f9528102a90 2024-04-20T21:47:02.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.586+0000 7f9524c00700 1 --2- 172.21.15.142:0/2388656076 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f950c0387c0 0x7f950c03ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:02.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.586+0000 7f9524c00700 1 -- 172.21.15.142:0/2388656076 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f951804c850 con 0x7f9528102a90 2024-04-20T21:47:02.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.586+0000 7f951ea00700 1 --2- 172.21.15.142:0/2388656076 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f950c0387c0 0x7f950c03ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:02.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.587+0000 7f951ea00700 1 --2- 172.21.15.142:0/2388656076 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f950c0387c0 0x7f950c03ac80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9510006fd0 tx=0x7f9510006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:02.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.591+0000 7f9524c00700 1 -- 172.21.15.142:0/2388656076 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f951800f4b0 con 0x7f9528102a90 2024-04-20T21:47:02.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.821+0000 7f952e400700 1 -- 172.21.15.142:0/2388656076 --> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f9528061320 con 0x7f950c0387c0 2024-04-20T21:47:02.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.829+0000 7f9524c00700 1 -- 172.21.15.142:0/2388656076 <== mgr.14164 v2:172.21.15.142:6800/3464616902 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9528061320 con 0x7f950c0387c0 2024-04-20T21:47:02.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.832+0000 7f952e400700 1 -- 172.21.15.142:0/2388656076 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f950c0387c0 msgr2=0x7f950c03ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:02.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.832+0000 7f952e400700 1 --2- 172.21.15.142:0/2388656076 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f950c0387c0 0x7f950c03ac80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9510006fd0 tx=0x7f9510006e40 comp rx=0 tx=0).stop 2024-04-20T21:47:02.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.832+0000 7f952e400700 1 -- 172.21.15.142:0/2388656076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9528102a90 msgr2=0x7f9528197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:02.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.832+0000 7f952e400700 1 --2- 172.21.15.142:0/2388656076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9528102a90 0x7f9528197f40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9518006010 tx=0x7f9518009f80 comp rx=0 tx=0).stop 2024-04-20T21:47:02.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.832+0000 7f952e400700 1 -- 172.21.15.142:0/2388656076 shutdown_connections 2024-04-20T21:47:02.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.832+0000 7f952e400700 1 --2- 172.21.15.142:0/2388656076 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f950c0387c0 0x7f950c03ac80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:02.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.832+0000 7f952e400700 1 --2- 172.21.15.142:0/2388656076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9528102a90 0x7f9528197f40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:02.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.832+0000 7f952e400700 1 -- 172.21.15.142:0/2388656076 >> 172.21.15.142:0/2388656076 conn(0x7f95280fe050 msgr2=0x7f95280feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:02.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.833+0000 7f952e400700 1 -- 172.21.15.142:0/2388656076 shutdown_connections 2024-04-20T21:47:02.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:02.833+0000 7f952e400700 1 -- 172.21.15.142:0/2388656076 wait complete. 2024-04-20T21:47:03.482 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi164 2024-04-20T21:47:03.482 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-20T21:47:03.482 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/etc/ceph/ceph.conf 2024-04-20T21:47:03.540 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-20T21:47:03.540 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-20T21:47:03.635 INFO:tasks.cephadm:Adding host smithi164 to orchestrator... 2024-04-20T21:47:03.635 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph orch host add smithi164 2024-04-20T21:47:04.191 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:03 smithi142 ceph-mon[15828]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:47:04.191 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:03 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:04.191 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:03 smithi142 ceph-mon[15828]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:04.285 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:47:06.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.611+0000 7f74bec00700 1 -- 172.21.15.142:0/195715301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b80ff760 msgr2=0x7f74b80ffb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:06.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.611+0000 7f74bec00700 1 --2- 172.21.15.142:0/195715301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b80ff760 0x7f74b80ffb80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009910 tx=0x7f74a8009c20 comp rx=0 tx=0).stop 2024-04-20T21:47:06.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.611+0000 7f74bec00700 1 -- 172.21.15.142:0/195715301 shutdown_connections 2024-04-20T21:47:06.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.611+0000 7f74bec00700 1 --2- 172.21.15.142:0/195715301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b80ff760 0x7f74b80ffb80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:06.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.611+0000 7f74bec00700 1 -- 172.21.15.142:0/195715301 >> 172.21.15.142:0/195715301 conn(0x7f74b80fad00 msgr2=0x7f74b80fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:06.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.611+0000 7f74bec00700 1 -- 172.21.15.142:0/195715301 shutdown_connections 2024-04-20T21:47:06.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.612+0000 7f74bec00700 1 -- 172.21.15.142:0/195715301 wait complete. 2024-04-20T21:47:06.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.613+0000 7f74bec00700 1 Processor -- start 2024-04-20T21:47:06.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.613+0000 7f74bec00700 1 -- start start 2024-04-20T21:47:06.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.614+0000 7f74bec00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b80ff760 0x7f74b8106380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:06.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.614+0000 7f74bec00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b81068c0 con 0x7f74b80ff760 2024-04-20T21:47:06.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.614+0000 7f74b7e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b80ff760 0x7f74b8106380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:06.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.614+0000 7f74b7e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b80ff760 0x7f74b8106380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60502/0 (socket says 172.21.15.142:60502) 2024-04-20T21:47:06.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.614+0000 7f74b7e00700 1 -- 172.21.15.142:0/2823935815 learned_addr learned my addr 172.21.15.142:0/2823935815 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:47:06.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.615+0000 7f74b7e00700 1 -- 172.21.15.142:0/2823935815 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a80095f0 con 0x7f74b80ff760 2024-04-20T21:47:06.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.615+0000 7f74b7e00700 1 --2- 172.21.15.142:0/2823935815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b80ff760 0x7f74b8106380 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f74a8006010 tx=0x7f74a80050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:06.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.615+0000 7f74b4c00700 1 -- 172.21.15.142:0/2823935815 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74a801d070 con 0x7f74b80ff760 2024-04-20T21:47:06.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.615+0000 7f74b4c00700 1 -- 172.21.15.142:0/2823935815 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74a800be20 con 0x7f74b80ff760 2024-04-20T21:47:06.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.615+0000 7f74b4c00700 1 -- 172.21.15.142:0/2823935815 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74a8022de0 con 0x7f74b80ff760 2024-04-20T21:47:06.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.615+0000 7f74bec00700 1 -- 172.21.15.142:0/2823935815 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b8104b00 con 0x7f74b80ff760 2024-04-20T21:47:06.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.615+0000 7f74bec00700 1 -- 172.21.15.142:0/2823935815 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b8104fa0 con 0x7f74b80ff760 2024-04-20T21:47:06.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.617+0000 7f74bec00700 1 -- 172.21.15.142:0/2823935815 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b8106fc0 con 0x7f74b80ff760 2024-04-20T21:47:06.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.617+0000 7f74b4c00700 1 -- 172.21.15.142:0/2823935815 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f74a80226c0 con 0x7f74b80ff760 2024-04-20T21:47:06.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.618+0000 7f74b4c00700 1 --2- 172.21.15.142:0/2823935815 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f749c038820 0x7f749c03ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:06.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.618+0000 7f74b4c00700 1 -- 172.21.15.142:0/2823935815 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f74a804c8a0 con 0x7f74b80ff760 2024-04-20T21:47:06.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.618+0000 7f74b7400700 1 --2- 172.21.15.142:0/2823935815 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f749c038820 0x7f749c03ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:06.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.619+0000 7f74b7400700 1 --2- 172.21.15.142:0/2823935815 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f749c038820 0x7f749c03ace0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f74a4006fd0 tx=0x7f74a4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:06.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.628+0000 7f74b4c00700 1 -- 172.21.15.142:0/2823935815 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f74a800f460 con 0x7f74b80ff760 2024-04-20T21:47:06.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:06 smithi142 ceph-mon[15828]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:06.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:06 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:06.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:06 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:06.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:06 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:06.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:06 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:06.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:06 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-20T21:47:06.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:06 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-20T21:47:06.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:06 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:47:06.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:06.881+0000 7f74bec00700 1 -- 172.21.15.142:0/2823935815 --> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi164", "target": ["mon-mgr", ""]}) v1 -- 0x7f74b8105250 con 0x7f749c038820 2024-04-20T21:47:07.645 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:07 smithi142 ceph-mon[15828]: Deploying daemon crash.smithi142 on smithi142 2024-04-20T21:47:08.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:08 smithi142 ceph-mon[15828]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi164", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:47:08.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:08 smithi142 ceph-mon[15828]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:08.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:08 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:09.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:09 smithi142 ceph-mon[15828]: Deploying cephadm binary to smithi164 2024-04-20T21:47:10.804 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:10 smithi142 ceph-mon[15828]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:10.804 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:10 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:10.804 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:10 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:10.805 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:10 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:10.805 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:10 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:11.023 INFO:teuthology.orchestra.run.smithi142.stdout:Added host 'smithi164' with addr '172.21.15.164' 2024-04-20T21:47:11.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:11.022+0000 7f74b4c00700 1 -- 172.21.15.142:0/2823935815 <== mgr.14164 v2:172.21.15.142:6800/3464616902 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f74b8105250 con 0x7f749c038820 2024-04-20T21:47:11.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:11.026+0000 7f74bec00700 1 -- 172.21.15.142:0/2823935815 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f749c038820 msgr2=0x7f749c03ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:11.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:11.026+0000 7f74bec00700 1 --2- 172.21.15.142:0/2823935815 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f749c038820 0x7f749c03ace0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f74a4006fd0 tx=0x7f74a4006e40 comp rx=0 tx=0).stop 2024-04-20T21:47:11.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:11.026+0000 7f74bec00700 1 -- 172.21.15.142:0/2823935815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b80ff760 msgr2=0x7f74b8106380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:11.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:11.026+0000 7f74bec00700 1 --2- 172.21.15.142:0/2823935815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b80ff760 0x7f74b8106380 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f74a8006010 tx=0x7f74a80050b0 comp rx=0 tx=0).stop 2024-04-20T21:47:11.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:11.026+0000 7f74bec00700 1 -- 172.21.15.142:0/2823935815 shutdown_connections 2024-04-20T21:47:11.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:11.026+0000 7f74bec00700 1 --2- 172.21.15.142:0/2823935815 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f749c038820 0x7f749c03ace0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:11.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:11.026+0000 7f74bec00700 1 --2- 172.21.15.142:0/2823935815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b80ff760 0x7f74b8106380 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:11.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:11.026+0000 7f74bec00700 1 -- 172.21.15.142:0/2823935815 >> 172.21.15.142:0/2823935815 conn(0x7f74b80fad00 msgr2=0x7f74b80fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:11.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:11.027+0000 7f74bec00700 1 -- 172.21.15.142:0/2823935815 shutdown_connections 2024-04-20T21:47:11.026 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:11.027+0000 7f74bec00700 1 -- 172.21.15.142:0/2823935815 wait complete. 2024-04-20T21:47:11.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:11 smithi142 ceph-mon[15828]: Deploying daemon node-exporter.smithi142 on smithi142 2024-04-20T21:47:11.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:11 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:11.876 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-20T21:47:12.262 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:47:12.810 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:12 smithi142 ceph-mon[15828]: Added host smithi164 2024-04-20T21:47:12.810 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:12 smithi142 ceph-mon[15828]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:14.910 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:14 smithi142 ceph-mon[15828]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:14.911 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:14 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:16.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.213+0000 7f54e9c00700 1 -- 172.21.15.142:0/2881328626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54e4074f10 msgr2=0x7f54e4073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:16.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.213+0000 7f54e9c00700 1 --2- 172.21.15.142:0/2881328626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54e4074f10 0x7f54e4073370 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009910 tx=0x7f54d4009c20 comp rx=0 tx=0).stop 2024-04-20T21:47:16.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.214+0000 7f54e9c00700 1 -- 172.21.15.142:0/2881328626 shutdown_connections 2024-04-20T21:47:16.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.214+0000 7f54e9c00700 1 --2- 172.21.15.142:0/2881328626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54e4074f10 0x7f54e4073370 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:16.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.214+0000 7f54e9c00700 1 -- 172.21.15.142:0/2881328626 >> 172.21.15.142:0/2881328626 conn(0x7f54e40fbe30 msgr2=0x7f54e40fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:16.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.214+0000 7f54e9c00700 1 -- 172.21.15.142:0/2881328626 shutdown_connections 2024-04-20T21:47:16.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.214+0000 7f54e9c00700 1 -- 172.21.15.142:0/2881328626 wait complete. 2024-04-20T21:47:16.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.215+0000 7f54e9c00700 1 Processor -- start 2024-04-20T21:47:16.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.215+0000 7f54e9c00700 1 -- start start 2024-04-20T21:47:16.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.215+0000 7f54e9c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54e4074f10 0x7f54e4197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:16.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.215+0000 7f54e9c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e4198480 con 0x7f54e4074f10 2024-04-20T21:47:16.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.215+0000 7f54e2a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54e4074f10 0x7f54e4197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:16.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.215+0000 7f54e2a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54e4074f10 0x7f54e4197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36016/0 (socket says 172.21.15.142:36016) 2024-04-20T21:47:16.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.215+0000 7f54e2a00700 1 -- 172.21.15.142:0/3144823502 learned_addr learned my addr 172.21.15.142:0/3144823502 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:47:16.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.216+0000 7f54e2a00700 1 -- 172.21.15.142:0/3144823502 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d40095f0 con 0x7f54e4074f10 2024-04-20T21:47:16.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.216+0000 7f54e2a00700 1 --2- 172.21.15.142:0/3144823502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54e4074f10 0x7f54e4197f40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f54d4006010 tx=0x7f54d4009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:16.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.216+0000 7f54db400700 1 -- 172.21.15.142:0/3144823502 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54d401d070 con 0x7f54e4074f10 2024-04-20T21:47:16.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.216+0000 7f54db400700 1 -- 172.21.15.142:0/3144823502 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f54d4005dc0 con 0x7f54e4074f10 2024-04-20T21:47:16.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.216+0000 7f54db400700 1 -- 172.21.15.142:0/3144823502 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54d4022e90 con 0x7f54e4074f10 2024-04-20T21:47:16.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.217+0000 7f54e9c00700 1 -- 172.21.15.142:0/3144823502 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e4198680 con 0x7f54e4074f10 2024-04-20T21:47:16.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.217+0000 7f54e9c00700 1 -- 172.21.15.142:0/3144823502 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e4198b20 con 0x7f54e4074f10 2024-04-20T21:47:16.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.218+0000 7f54e9c00700 1 -- 172.21.15.142:0/3144823502 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e4191890 con 0x7f54e4074f10 2024-04-20T21:47:16.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.218+0000 7f54db400700 1 -- 172.21.15.142:0/3144823502 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f54d4022470 con 0x7f54e4074f10 2024-04-20T21:47:16.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.218+0000 7f54db400700 1 --2- 172.21.15.142:0/3144823502 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f54c80387c0 0x7f54c803ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:16.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.219+0000 7f54db400700 1 -- 172.21.15.142:0/3144823502 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f54d404c870 con 0x7f54e4074f10 2024-04-20T21:47:16.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.219+0000 7f54dbe00700 1 --2- 172.21.15.142:0/3144823502 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f54c80387c0 0x7f54c803ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:16.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.219+0000 7f54dbe00700 1 --2- 172.21.15.142:0/3144823502 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f54c80387c0 0x7f54c803ac80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f54cc006fd0 tx=0x7f54cc006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:16.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.224+0000 7f54db400700 1 -- 172.21.15.142:0/3144823502 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f54d400b960 con 0x7f54e4074f10 2024-04-20T21:47:16.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.468+0000 7f54e9c00700 1 -- 172.21.15.142:0/3144823502 --> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54e402cdb0 con 0x7f54c80387c0 2024-04-20T21:47:16.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.470+0000 7f54db400700 1 -- 172.21.15.142:0/3144823502 <== mgr.14164 v2:172.21.15.142:6800/3464616902 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f54e402cdb0 con 0x7f54c80387c0 2024-04-20T21:47:16.469 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:47:16.469 INFO:teuthology.orchestra.run.smithi142.stdout:[{"addr": "172.21.15.142", "hostname": "smithi142", "labels": [], "status": ""}, {"addr": "172.21.15.164", "hostname": "smithi164", "labels": [], "status": ""}] 2024-04-20T21:47:16.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.473+0000 7f54e9c00700 1 -- 172.21.15.142:0/3144823502 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f54c80387c0 msgr2=0x7f54c803ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:16.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.473+0000 7f54e9c00700 1 --2- 172.21.15.142:0/3144823502 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f54c80387c0 0x7f54c803ac80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f54cc006fd0 tx=0x7f54cc006e40 comp rx=0 tx=0).stop 2024-04-20T21:47:16.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.473+0000 7f54e9c00700 1 -- 172.21.15.142:0/3144823502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54e4074f10 msgr2=0x7f54e4197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:16.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.473+0000 7f54e9c00700 1 --2- 172.21.15.142:0/3144823502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54e4074f10 0x7f54e4197f40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f54d4006010 tx=0x7f54d4009f80 comp rx=0 tx=0).stop 2024-04-20T21:47:16.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.473+0000 7f54e9c00700 1 -- 172.21.15.142:0/3144823502 shutdown_connections 2024-04-20T21:47:16.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.473+0000 7f54e9c00700 1 --2- 172.21.15.142:0/3144823502 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f54c80387c0 0x7f54c803ac80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:16.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.473+0000 7f54e9c00700 1 --2- 172.21.15.142:0/3144823502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54e4074f10 0x7f54e4197f40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:16.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.473+0000 7f54e9c00700 1 -- 172.21.15.142:0/3144823502 >> 172.21.15.142:0/3144823502 conn(0x7f54e40fbe30 msgr2=0x7f54e40fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:16.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.474+0000 7f54e9c00700 1 -- 172.21.15.142:0/3144823502 shutdown_connections 2024-04-20T21:47:16.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:16.474+0000 7f54e9c00700 1 -- 172.21.15.142:0/3144823502 wait complete. 2024-04-20T21:47:16.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:16 smithi142 ceph-mon[15828]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:17.193 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-20T21:47:17.194 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-20T21:47:17.570 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:47:17.919 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:17 smithi142 ceph-mon[15828]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T21:47:17.919 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:17 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:17.919 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:17 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:17.919 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:17 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:17.919 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:17 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:17.919 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:17 smithi142 ceph-mon[15828]: Deploying daemon alertmanager.smithi142 on smithi142 2024-04-20T21:47:18.800 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:18 smithi142 ceph-mon[15828]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:18.801 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:18 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:20.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.279+0000 7f2d06a00700 1 -- 172.21.15.142:0/3080800079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d00102a90 msgr2=0x7f2d00102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:20.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.279+0000 7f2d06a00700 1 --2- 172.21.15.142:0/3080800079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d00102a90 0x7f2d00102eb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0009910 tx=0x7f2cf0009c20 comp rx=0 tx=0).stop 2024-04-20T21:47:20.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.279+0000 7f2d06a00700 1 -- 172.21.15.142:0/3080800079 shutdown_connections 2024-04-20T21:47:20.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.279+0000 7f2d06a00700 1 --2- 172.21.15.142:0/3080800079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d00102a90 0x7f2d00102eb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:20.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.279+0000 7f2d06a00700 1 -- 172.21.15.142:0/3080800079 >> 172.21.15.142:0/3080800079 conn(0x7f2d000fe050 msgr2=0x7f2d00100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:20.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.279+0000 7f2d06a00700 1 -- 172.21.15.142:0/3080800079 shutdown_connections 2024-04-20T21:47:20.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.279+0000 7f2d06a00700 1 -- 172.21.15.142:0/3080800079 wait complete. 2024-04-20T21:47:20.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.280+0000 7f2d06a00700 1 Processor -- start 2024-04-20T21:47:20.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.280+0000 7f2d06a00700 1 -- start start 2024-04-20T21:47:20.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.281+0000 7f2d06a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d00102a90 0x7f2d00197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:20.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.281+0000 7f2d06a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d00198450 con 0x7f2d00102a90 2024-04-20T21:47:20.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.281+0000 7f2cffe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d00102a90 0x7f2d00197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:20.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.281+0000 7f2cffe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d00102a90 0x7f2d00197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60860/0 (socket says 172.21.15.142:60860) 2024-04-20T21:47:20.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.281+0000 7f2cffe00700 1 -- 172.21.15.142:0/1621834627 learned_addr learned my addr 172.21.15.142:0/1621834627 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:47:20.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.282+0000 7f2cffe00700 1 -- 172.21.15.142:0/1621834627 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf00095f0 con 0x7f2d00102a90 2024-04-20T21:47:20.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.282+0000 7f2cffe00700 1 --2- 172.21.15.142:0/1621834627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d00102a90 0x7f2d00197f10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0006010 tx=0x7f2cf00050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:20.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.282+0000 7f2cfcc00700 1 -- 172.21.15.142:0/1621834627 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2cf001d070 con 0x7f2d00102a90 2024-04-20T21:47:20.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.282+0000 7f2d06a00700 1 -- 172.21.15.142:0/1621834627 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d00198650 con 0x7f2d00102a90 2024-04-20T21:47:20.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.282+0000 7f2cfcc00700 1 -- 172.21.15.142:0/1621834627 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2cf000be20 con 0x7f2d00102a90 2024-04-20T21:47:20.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.282+0000 7f2cfcc00700 1 -- 172.21.15.142:0/1621834627 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2cf0022de0 con 0x7f2d00102a90 2024-04-20T21:47:20.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.282+0000 7f2d06a00700 1 -- 172.21.15.142:0/1621834627 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d00198af0 con 0x7f2d00102a90 2024-04-20T21:47:20.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.283+0000 7f2d06a00700 1 -- 172.21.15.142:0/1621834627 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d001918c0 con 0x7f2d00102a90 2024-04-20T21:47:20.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.283+0000 7f2cfcc00700 1 -- 172.21.15.142:0/1621834627 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f2cf00226c0 con 0x7f2d00102a90 2024-04-20T21:47:20.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.284+0000 7f2cfcc00700 1 --2- 172.21.15.142:0/1621834627 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f2ce40387b0 0x7f2ce403ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:20.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.284+0000 7f2cfcc00700 1 -- 172.21.15.142:0/1621834627 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2cf004caa0 con 0x7f2d00102a90 2024-04-20T21:47:20.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.284+0000 7f2cff400700 1 --2- 172.21.15.142:0/1621834627 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f2ce40387b0 0x7f2ce403ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:20.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.285+0000 7f2cff400700 1 --2- 172.21.15.142:0/1621834627 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f2ce40387b0 0x7f2ce403ac70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2cec006fd0 tx=0x7f2cec006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:20.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.289+0000 7f2cfcc00700 1 -- 172.21.15.142:0/1621834627 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f2cf000b960 con 0x7f2d00102a90 2024-04-20T21:47:20.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.512+0000 7f2d06a00700 1 -- 172.21.15.142:0/1621834627 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2d00062510 con 0x7f2d00102a90 2024-04-20T21:47:20.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.554+0000 7f2cfcc00700 1 -- 172.21.15.142:0/1621834627 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2cf0027020 con 0x7f2d00102a90 2024-04-20T21:47:20.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.558+0000 7f2d06a00700 1 -- 172.21.15.142:0/1621834627 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f2ce40387b0 msgr2=0x7f2ce403ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:20.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.558+0000 7f2d06a00700 1 --2- 172.21.15.142:0/1621834627 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f2ce40387b0 0x7f2ce403ac70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2cec006fd0 tx=0x7f2cec006e40 comp rx=0 tx=0).stop 2024-04-20T21:47:20.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.558+0000 7f2d06a00700 1 -- 172.21.15.142:0/1621834627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d00102a90 msgr2=0x7f2d00197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:20.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.558+0000 7f2d06a00700 1 --2- 172.21.15.142:0/1621834627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d00102a90 0x7f2d00197f10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0006010 tx=0x7f2cf00050b0 comp rx=0 tx=0).stop 2024-04-20T21:47:20.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.558+0000 7f2d06a00700 1 -- 172.21.15.142:0/1621834627 shutdown_connections 2024-04-20T21:47:20.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.558+0000 7f2d06a00700 1 --2- 172.21.15.142:0/1621834627 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f2ce40387b0 0x7f2ce403ac70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:20.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.558+0000 7f2d06a00700 1 --2- 172.21.15.142:0/1621834627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d00102a90 0x7f2d00197f10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:20.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.558+0000 7f2d06a00700 1 -- 172.21.15.142:0/1621834627 >> 172.21.15.142:0/1621834627 conn(0x7f2d000fe050 msgr2=0x7f2d000feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:20.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.558+0000 7f2d06a00700 1 -- 172.21.15.142:0/1621834627 shutdown_connections 2024-04-20T21:47:20.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:47:20.558+0000 7f2d06a00700 1 -- 172.21.15.142:0/1621834627 wait complete. 2024-04-20T21:47:20.558 INFO:teuthology.orchestra.run.smithi142.stderr:adjusted tunables profile to default 2024-04-20T21:47:20.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:20 smithi142 ceph-mon[15828]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:20.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:20 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1621834627' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-20T21:47:21.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:21 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1621834627' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-20T21:47:21.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:21 smithi142 ceph-mon[15828]: osdmap e4: 0 total, 0 up, 0 in 2024-04-20T21:47:22.063 INFO:tasks.cephadm:Adding mon.smithi142 on smithi142 2024-04-20T21:47:22.063 INFO:tasks.cephadm:Adding mon.smithi164 on smithi164 2024-04-20T21:47:22.063 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph orch apply mon '2;smithi142:172.21.15.142=smithi142;smithi164:172.21.15.164=smithi164' 2024-04-20T21:47:22.437 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:47:22.545 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:47:22.880 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:22 smithi142 ceph-mon[15828]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:24.578 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:24 smithi142 ceph-mon[15828]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.179+0000 7f9e0f200700 1 -- 172.21.15.164:0/3370537128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e081070a0 msgr2=0x7f9e081074c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.179+0000 7f9e0f200700 1 --2- 172.21.15.164:0/3370537128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e081070a0 0x7f9e081074c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9df800b0a0 tx=0x7f9df800b3b0 comp rx=0 tx=0).stop 2024-04-20T21:47:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.179+0000 7f9e0f200700 1 -- 172.21.15.164:0/3370537128 shutdown_connections 2024-04-20T21:47:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.179+0000 7f9e0f200700 1 --2- 172.21.15.164:0/3370537128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e081070a0 0x7f9e081074c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.179+0000 7f9e0f200700 1 -- 172.21.15.164:0/3370537128 >> 172.21.15.164:0/3370537128 conn(0x7f9e08075f60 msgr2=0x7f9e080783a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.179+0000 7f9e0f200700 1 -- 172.21.15.164:0/3370537128 shutdown_connections 2024-04-20T21:47:25.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.179+0000 7f9e0f200700 1 -- 172.21.15.164:0/3370537128 wait complete. 2024-04-20T21:47:25.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.180+0000 7f9e0f200700 1 Processor -- start 2024-04-20T21:47:25.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.180+0000 7f9e0f200700 1 -- start start 2024-04-20T21:47:25.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.181+0000 7f9e0f200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e081070a0 0x7f9e0819c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:25.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.181+0000 7f9e0f200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0819c850 con 0x7f9e081070a0 2024-04-20T21:47:25.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.181+0000 7f9e07e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e081070a0 0x7f9e0819c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:25.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.181+0000 7f9e07e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e081070a0 0x7f9e0819c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.164:52492/0 (socket says 172.21.15.164:52492) 2024-04-20T21:47:25.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.181+0000 7f9e07e00700 1 -- 172.21.15.164:0/2756348298 learned_addr learned my addr 172.21.15.164:0/2756348298 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:47:25.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.182+0000 7f9e07e00700 1 -- 172.21.15.164:0/2756348298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df8009d00 con 0x7f9e081070a0 2024-04-20T21:47:25.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.182+0000 7f9e07e00700 1 --2- 172.21.15.164:0/2756348298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e081070a0 0x7f9e0819c310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9df8015040 tx=0x7f9df800bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:25.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.183+0000 7f9e05600700 1 -- 172.21.15.164:0/2756348298 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9df800e040 con 0x7f9e081070a0 2024-04-20T21:47:25.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.183+0000 7f9e0f200700 1 -- 172.21.15.164:0/2756348298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0819ca50 con 0x7f9e081070a0 2024-04-20T21:47:25.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.183+0000 7f9e05600700 1 -- 172.21.15.164:0/2756348298 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9df8003d70 con 0x7f9e081070a0 2024-04-20T21:47:25.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.183+0000 7f9e05600700 1 -- 172.21.15.164:0/2756348298 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9df801c9e0 con 0x7f9e081070a0 2024-04-20T21:47:25.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.183+0000 7f9e0f200700 1 -- 172.21.15.164:0/2756348298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0819cef0 con 0x7f9e081070a0 2024-04-20T21:47:25.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.184+0000 7f9e0f200700 1 -- 172.21.15.164:0/2756348298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e08195c40 con 0x7f9e081070a0 2024-04-20T21:47:25.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.185+0000 7f9e05600700 1 -- 172.21.15.164:0/2756348298 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f9df8012640 con 0x7f9e081070a0 2024-04-20T21:47:25.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.186+0000 7f9e05600700 1 --2- 172.21.15.164:0/2756348298 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f9dec038810 0x7f9dec03acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:25.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.186+0000 7f9e05600700 1 -- 172.21.15.164:0/2756348298 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9df804c960 con 0x7f9e081070a0 2024-04-20T21:47:25.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.186+0000 7f9dff400700 1 --2- 172.21.15.164:0/2756348298 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f9dec038810 0x7f9dec03acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:25.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.187+0000 7f9dff400700 1 --2- 172.21.15.164:0/2756348298 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f9dec038810 0x7f9dec03acd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9df0006fd0 tx=0x7f9df0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:25.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.201+0000 7f9e05600700 1 -- 172.21.15.164:0/2756348298 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f9df801a9a0 con 0x7f9e081070a0 2024-04-20T21:47:25.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.436+0000 7f9e0f200700 1 -- 172.21.15.164:0/2756348298 --> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi142:172.21.15.142=smithi142;smithi164:172.21.15.164=smithi164", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e0802ce60 con 0x7f9dec038810 2024-04-20T21:47:25.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.449+0000 7f9e05600700 1 -- 172.21.15.164:0/2756348298 <== mgr.14164 v2:172.21.15.142:6800/3464616902 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9e0802ce60 con 0x7f9dec038810 2024-04-20T21:47:25.448 INFO:teuthology.orchestra.run.smithi164.stdout:Scheduled mon update... 2024-04-20T21:47:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.452+0000 7f9e0f200700 1 -- 172.21.15.164:0/2756348298 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f9dec038810 msgr2=0x7f9dec03acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.452+0000 7f9e0f200700 1 --2- 172.21.15.164:0/2756348298 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f9dec038810 0x7f9dec03acd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9df0006fd0 tx=0x7f9df0006e40 comp rx=0 tx=0).stop 2024-04-20T21:47:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.452+0000 7f9e0f200700 1 -- 172.21.15.164:0/2756348298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e081070a0 msgr2=0x7f9e0819c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.452+0000 7f9e0f200700 1 --2- 172.21.15.164:0/2756348298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e081070a0 0x7f9e0819c310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9df8015040 tx=0x7f9df800bd40 comp rx=0 tx=0).stop 2024-04-20T21:47:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.452+0000 7f9e0f200700 1 -- 172.21.15.164:0/2756348298 shutdown_connections 2024-04-20T21:47:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.452+0000 7f9e0f200700 1 --2- 172.21.15.164:0/2756348298 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f9dec038810 0x7f9dec03acd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:25.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.452+0000 7f9e0f200700 1 --2- 172.21.15.164:0/2756348298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e081070a0 0x7f9e0819c310 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:25.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.452+0000 7f9e0f200700 1 -- 172.21.15.164:0/2756348298 >> 172.21.15.164:0/2756348298 conn(0x7f9e08075f60 msgr2=0x7f9e080769b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:25.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.452+0000 7f9e0f200700 1 -- 172.21.15.164:0/2756348298 shutdown_connections 2024-04-20T21:47:25.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:25.452+0000 7f9e0f200700 1 -- 172.21.15.164:0/2756348298 wait complete. 2024-04-20T21:47:26.345 DEBUG:teuthology.orchestra.run.smithi164:mon.smithi164> sudo journalctl -f -n 0 -u ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mon.smithi164.service 2024-04-20T21:47:26.349 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-20T21:47:26.350 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-20T21:47:26.784 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:26 smithi142 ceph-mon[15828]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:26.784 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:26 smithi142 ceph-mon[15828]: from='client.14197 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi142:172.21.15.142=smithi142;smithi164:172.21.15.164=smithi164", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:47:26.784 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:26 smithi142 ceph-mon[15828]: Saving service mon spec with placement smithi142:172.21.15.142=smithi142;smithi164:172.21.15.164=smithi164;count:2 2024-04-20T21:47:26.785 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:26 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:27.182 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:47:27.292 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:47:28.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:28 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:28.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:28 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:28.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:28 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:28.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:28 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:28.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:28 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:28.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:28 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:28.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:28 smithi142 ceph-mon[15828]: Regenerating cephadm self-signed grafana TLS certificates 2024-04-20T21:47:28.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:28 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:28.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:28 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:28.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:28 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-20T21:47:28.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:28 smithi142 ceph-mon[15828]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-20T21:47:28.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:28 smithi142 ceph-mon[15828]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:28.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:28 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:28.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:28 smithi142 ceph-mon[15828]: Deploying daemon grafana.smithi142 on smithi142 2024-04-20T21:47:29.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.495+0000 7ff815e00700 1 -- 172.21.15.164:0/3919194779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8101070a0 msgr2=0x7ff8101074c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:29.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.495+0000 7ff815e00700 1 --2- 172.21.15.164:0/3919194779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8101070a0 0x7ff8101074c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff800009910 tx=0x7ff800009c20 comp rx=0 tx=0).stop 2024-04-20T21:47:29.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.495+0000 7ff815e00700 1 -- 172.21.15.164:0/3919194779 shutdown_connections 2024-04-20T21:47:29.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.495+0000 7ff815e00700 1 --2- 172.21.15.164:0/3919194779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8101070a0 0x7ff8101074c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:29.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.495+0000 7ff815e00700 1 -- 172.21.15.164:0/3919194779 >> 172.21.15.164:0/3919194779 conn(0x7ff810075f60 msgr2=0x7ff8100783a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:29.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.495+0000 7ff815e00700 1 -- 172.21.15.164:0/3919194779 shutdown_connections 2024-04-20T21:47:29.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.496+0000 7ff815e00700 1 -- 172.21.15.164:0/3919194779 wait complete. 2024-04-20T21:47:29.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.497+0000 7ff815e00700 1 Processor -- start 2024-04-20T21:47:29.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.497+0000 7ff815e00700 1 -- start start 2024-04-20T21:47:29.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.498+0000 7ff815e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8101070a0 0x7ff81019c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:29.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.498+0000 7ff815e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81019c860 con 0x7ff8101070a0 2024-04-20T21:47:29.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.498+0000 7ff80ea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8101070a0 0x7ff81019c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:29.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.498+0000 7ff80ea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8101070a0 0x7ff81019c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.164:48900/0 (socket says 172.21.15.164:48900) 2024-04-20T21:47:29.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.498+0000 7ff80ea00700 1 -- 172.21.15.164:0/1426193665 learned_addr learned my addr 172.21.15.164:0/1426193665 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:47:29.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.499+0000 7ff80ea00700 1 -- 172.21.15.164:0/1426193665 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8000095f0 con 0x7ff8101070a0 2024-04-20T21:47:29.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.500+0000 7ff80ea00700 1 --2- 172.21.15.164:0/1426193665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8101070a0 0x7ff81019c320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff800006010 tx=0x7ff8000050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:29.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.503+0000 7ff814a00700 1 -- 172.21.15.164:0/1426193665 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff80001d070 con 0x7ff8101070a0 2024-04-20T21:47:29.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.503+0000 7ff814a00700 1 -- 172.21.15.164:0/1426193665 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff80000be20 con 0x7ff8101070a0 2024-04-20T21:47:29.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.503+0000 7ff815e00700 1 -- 172.21.15.164:0/1426193665 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff81019ca60 con 0x7ff8101070a0 2024-04-20T21:47:29.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.503+0000 7ff814a00700 1 -- 172.21.15.164:0/1426193665 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff80000f460 con 0x7ff8101070a0 2024-04-20T21:47:29.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.503+0000 7ff815e00700 1 -- 172.21.15.164:0/1426193665 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff81019cf00 con 0x7ff8101070a0 2024-04-20T21:47:29.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.504+0000 7ff815e00700 1 -- 172.21.15.164:0/1426193665 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff810195c40 con 0x7ff8101070a0 2024-04-20T21:47:29.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.512+0000 7ff814a00700 1 -- 172.21.15.164:0/1426193665 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7ff800022470 con 0x7ff8101070a0 2024-04-20T21:47:29.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.512+0000 7ff814a00700 1 --2- 172.21.15.164:0/1426193665 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7ff7f4038870 0x7ff7f403ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:29.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.512+0000 7ff814a00700 1 -- 172.21.15.164:0/1426193665 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff80004d140 con 0x7ff8101070a0 2024-04-20T21:47:29.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.513+0000 7ff80e000700 1 --2- 172.21.15.164:0/1426193665 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7ff7f4038870 0x7ff7f403ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:29.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.515+0000 7ff80e000700 1 --2- 172.21.15.164:0/1426193665 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7ff7f4038870 0x7ff7f403ad30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc006fd0 tx=0x7ff7fc006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:29.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.531+0000 7ff814a00700 1 -- 172.21.15.164:0/1426193665 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7ff800005c00 con 0x7ff8101070a0 2024-04-20T21:47:29.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.827+0000 7ff815e00700 1 -- 172.21.15.164:0/1426193665 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff810062510 con 0x7ff8101070a0 2024-04-20T21:47:29.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.828+0000 7ff814a00700 1 -- 172.21.15.164:0/1426193665 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7ff80002b3b0 con 0x7ff8101070a0 2024-04-20T21:47:29.827 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:47:29.827 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":1,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","modified":"2024-04-20T21:45:23.189616Z","created":"2024-04-20T21:45:23.189616Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-20T21:47:29.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.831+0000 7ff815e00700 1 -- 172.21.15.164:0/1426193665 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7ff7f4038870 msgr2=0x7ff7f403ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:29.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.831+0000 7ff815e00700 1 --2- 172.21.15.164:0/1426193665 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7ff7f4038870 0x7ff7f403ad30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc006fd0 tx=0x7ff7fc006e40 comp rx=0 tx=0).stop 2024-04-20T21:47:29.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.831+0000 7ff815e00700 1 -- 172.21.15.164:0/1426193665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8101070a0 msgr2=0x7ff81019c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:29.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.831+0000 7ff815e00700 1 --2- 172.21.15.164:0/1426193665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8101070a0 0x7ff81019c320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff800006010 tx=0x7ff8000050b0 comp rx=0 tx=0).stop 2024-04-20T21:47:29.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.831+0000 7ff815e00700 1 -- 172.21.15.164:0/1426193665 shutdown_connections 2024-04-20T21:47:29.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.831+0000 7ff815e00700 1 --2- 172.21.15.164:0/1426193665 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7ff7f4038870 0x7ff7f403ad30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:29.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.831+0000 7ff815e00700 1 --2- 172.21.15.164:0/1426193665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8101070a0 0x7ff81019c320 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:29.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.831+0000 7ff815e00700 1 -- 172.21.15.164:0/1426193665 >> 172.21.15.164:0/1426193665 conn(0x7ff810075f60 msgr2=0x7ff8100769f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:29.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.832+0000 7ff815e00700 1 -- 172.21.15.164:0/1426193665 shutdown_connections 2024-04-20T21:47:29.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:29.832+0000 7ff815e00700 1 -- 172.21.15.164:0/1426193665 wait complete. 2024-04-20T21:47:29.831 INFO:teuthology.orchestra.run.smithi164.stderr:dumped monmap epoch 1 2024-04-20T21:47:29.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:29 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:30.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:30 smithi142 ceph-mon[15828]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:30.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:30 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/1426193665' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T21:47:31.500 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-20T21:47:31.500 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-20T21:47:31.862 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:47:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:47:32.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:32 smithi142 ceph-mon[15828]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:33.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.760+0000 7f9568600700 1 -- 172.21.15.164:0/1727480515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9560100850 msgr2=0x7f9560100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.760+0000 7f9568600700 1 --2- 172.21.15.164:0/1727480515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9560100850 0x7f9560100c70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f955400b0a0 tx=0x7f955400b3b0 comp rx=0 tx=0).stop 2024-04-20T21:47:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.760+0000 7f9568600700 1 -- 172.21.15.164:0/1727480515 shutdown_connections 2024-04-20T21:47:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.760+0000 7f9568600700 1 --2- 172.21.15.164:0/1727480515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9560100850 0x7f9560100c70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.760+0000 7f9568600700 1 -- 172.21.15.164:0/1727480515 >> 172.21.15.164:0/1727480515 conn(0x7f95600fbe30 msgr2=0x7f95600fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.760+0000 7f9568600700 1 -- 172.21.15.164:0/1727480515 shutdown_connections 2024-04-20T21:47:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.760+0000 7f9568600700 1 -- 172.21.15.164:0/1727480515 wait complete. 2024-04-20T21:47:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.761+0000 7f9568600700 1 Processor -- start 2024-04-20T21:47:33.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.761+0000 7f9568600700 1 -- start start 2024-04-20T21:47:33.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.761+0000 7f9568600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9560100850 0x7f9560197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:33.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.761+0000 7f9568600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9560198460 con 0x7f9560100850 2024-04-20T21:47:33.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.762+0000 7f9565c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9560100850 0x7f9560197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:33.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.762+0000 7f9565c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9560100850 0x7f9560197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.164:48908/0 (socket says 172.21.15.164:48908) 2024-04-20T21:47:33.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.762+0000 7f9565c00700 1 -- 172.21.15.164:0/3411460310 learned_addr learned my addr 172.21.15.164:0/3411460310 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:47:33.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.763+0000 7f9565c00700 1 -- 172.21.15.164:0/3411460310 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9554009d00 con 0x7f9560100850 2024-04-20T21:47:33.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.763+0000 7f9565c00700 1 --2- 172.21.15.164:0/3411460310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9560100850 0x7f9560197f20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f955400bc90 tx=0x7f955400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:33.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.763+0000 7f955e000700 1 -- 172.21.15.164:0/3411460310 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f955400e040 con 0x7f9560100850 2024-04-20T21:47:33.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.764+0000 7f955e000700 1 -- 172.21.15.164:0/3411460310 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9554003d50 con 0x7f9560100850 2024-04-20T21:47:33.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.764+0000 7f9568600700 1 -- 172.21.15.164:0/3411460310 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9560198660 con 0x7f9560100850 2024-04-20T21:47:33.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.764+0000 7f955e000700 1 -- 172.21.15.164:0/3411460310 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f955401c8f0 con 0x7f9560100850 2024-04-20T21:47:33.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.764+0000 7f9568600700 1 -- 172.21.15.164:0/3411460310 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9560198b00 con 0x7f9560100850 2024-04-20T21:47:33.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.765+0000 7f9568600700 1 -- 172.21.15.164:0/3411460310 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9560191a80 con 0x7f9560100850 2024-04-20T21:47:33.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.765+0000 7f955e000700 1 -- 172.21.15.164:0/3411460310 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f955401cb60 con 0x7f9560100850 2024-04-20T21:47:33.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.766+0000 7f955e000700 1 --2- 172.21.15.164:0/3411460310 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f9548038860 0x7f954803ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:33.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.766+0000 7f955e000700 1 -- 172.21.15.164:0/3411460310 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f955404c8e0 con 0x7f9560100850 2024-04-20T21:47:33.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.767+0000 7f9565200700 1 --2- 172.21.15.164:0/3411460310 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f9548038860 0x7f954803ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:33.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.768+0000 7f9565200700 1 --2- 172.21.15.164:0/3411460310 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f9548038860 0x7f954803ad20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f954c006fd0 tx=0x7f954c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:33.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:33.783+0000 7f955e000700 1 -- 172.21.15.164:0/3411460310 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f955401a3b0 con 0x7f9560100850 2024-04-20T21:47:34.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:34.088+0000 7f9568600700 1 -- 172.21.15.164:0/3411460310 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9560062510 con 0x7f9560100850 2024-04-20T21:47:34.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:34.090+0000 7f955e000700 1 -- 172.21.15.164:0/3411460310 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f9560062510 con 0x7f9560100850 2024-04-20T21:47:34.089 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:47:34.089 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":1,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","modified":"2024-04-20T21:45:23.189616Z","created":"2024-04-20T21:45:23.189616Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-20T21:47:34.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:34.092+0000 7f9568600700 1 -- 172.21.15.164:0/3411460310 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f9548038860 msgr2=0x7f954803ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:34.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:34.092+0000 7f9568600700 1 --2- 172.21.15.164:0/3411460310 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f9548038860 0x7f954803ad20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f954c006fd0 tx=0x7f954c006e40 comp rx=0 tx=0).stop 2024-04-20T21:47:34.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:34.092+0000 7f9568600700 1 -- 172.21.15.164:0/3411460310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9560100850 msgr2=0x7f9560197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:34.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:34.092+0000 7f9568600700 1 --2- 172.21.15.164:0/3411460310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9560100850 0x7f9560197f20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f955400bc90 tx=0x7f955400bd70 comp rx=0 tx=0).stop 2024-04-20T21:47:34.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:34.092+0000 7f9568600700 1 -- 172.21.15.164:0/3411460310 shutdown_connections 2024-04-20T21:47:34.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:34.092+0000 7f9568600700 1 --2- 172.21.15.164:0/3411460310 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f9548038860 0x7f954803ad20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:34.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:34.092+0000 7f9568600700 1 --2- 172.21.15.164:0/3411460310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9560100850 0x7f9560197f20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:34.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:34.092+0000 7f9568600700 1 -- 172.21.15.164:0/3411460310 >> 172.21.15.164:0/3411460310 conn(0x7f95600fbe30 msgr2=0x7f95600fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:34.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:34.093+0000 7f9568600700 1 -- 172.21.15.164:0/3411460310 shutdown_connections 2024-04-20T21:47:34.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:34.093+0000 7f9568600700 1 -- 172.21.15.164:0/3411460310 wait complete. 2024-04-20T21:47:34.093 INFO:teuthology.orchestra.run.smithi164.stderr:dumped monmap epoch 1 2024-04-20T21:47:34.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:34 smithi142 ceph-mon[15828]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:34.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:34 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/3411460310' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T21:47:35.752 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-20T21:47:35.752 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-20T21:47:36.124 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:47:36.226 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:47:36.861 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:36 smithi142 ceph-mon[15828]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:38.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.219+0000 7f677f400700 1 -- 172.21.15.164:0/397396458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67780ff0e0 msgr2=0x7f6778101510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:38.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.219+0000 7f677f400700 1 --2- 172.21.15.164:0/397396458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67780ff0e0 0x7f6778101510 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f676c009910 tx=0x7f676c009c20 comp rx=0 tx=0).stop 2024-04-20T21:47:38.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.220+0000 7f677f400700 1 -- 172.21.15.164:0/397396458 shutdown_connections 2024-04-20T21:47:38.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.220+0000 7f677f400700 1 --2- 172.21.15.164:0/397396458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67780ff0e0 0x7f6778101510 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:38.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.220+0000 7f677f400700 1 -- 172.21.15.164:0/397396458 >> 172.21.15.164:0/397396458 conn(0x7f67780face0 msgr2=0x7f67780fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:38.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.220+0000 7f677f400700 1 -- 172.21.15.164:0/397396458 shutdown_connections 2024-04-20T21:47:38.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.220+0000 7f677f400700 1 -- 172.21.15.164:0/397396458 wait complete. 2024-04-20T21:47:38.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.221+0000 7f677f400700 1 Processor -- start 2024-04-20T21:47:38.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.221+0000 7f677f400700 1 -- start start 2024-04-20T21:47:38.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.222+0000 7f677f400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67780ff0e0 0x7f677819c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:38.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.222+0000 7f677f400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677819c800 con 0x7f67780ff0e0 2024-04-20T21:47:38.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.222+0000 7f677ca00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67780ff0e0 0x7f677819c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:38.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.222+0000 7f677ca00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67780ff0e0 0x7f677819c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.164:48924/0 (socket says 172.21.15.164:48924) 2024-04-20T21:47:38.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.222+0000 7f677ca00700 1 -- 172.21.15.164:0/1950405594 learned_addr learned my addr 172.21.15.164:0/1950405594 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:47:38.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.223+0000 7f677ca00700 1 -- 172.21.15.164:0/1950405594 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676c0095f0 con 0x7f67780ff0e0 2024-04-20T21:47:38.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.223+0000 7f677ca00700 1 --2- 172.21.15.164:0/1950405594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67780ff0e0 0x7f677819c2c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f676c006010 tx=0x7f676c0050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:38.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.223+0000 7f6775600700 1 -- 172.21.15.164:0/1950405594 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f676c01d070 con 0x7f67780ff0e0 2024-04-20T21:47:38.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.224+0000 7f677f400700 1 -- 172.21.15.164:0/1950405594 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677819ca00 con 0x7f67780ff0e0 2024-04-20T21:47:38.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.224+0000 7f6775600700 1 -- 172.21.15.164:0/1950405594 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f676c00be20 con 0x7f67780ff0e0 2024-04-20T21:47:38.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.224+0000 7f6775600700 1 -- 172.21.15.164:0/1950405594 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f676c00f460 con 0x7f67780ff0e0 2024-04-20T21:47:38.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.224+0000 7f677f400700 1 -- 172.21.15.164:0/1950405594 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677819cea0 con 0x7f67780ff0e0 2024-04-20T21:47:38.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.225+0000 7f677f400700 1 -- 172.21.15.164:0/1950405594 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67781963d0 con 0x7f67780ff0e0 2024-04-20T21:47:38.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.225+0000 7f6775600700 1 -- 172.21.15.164:0/1950405594 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f676c022470 con 0x7f67780ff0e0 2024-04-20T21:47:38.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.226+0000 7f6775600700 1 --2- 172.21.15.164:0/1950405594 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f6760038820 0x7f676003ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:38.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.226+0000 7f6775600700 1 -- 172.21.15.164:0/1950405594 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f676c04cdb0 con 0x7f67780ff0e0 2024-04-20T21:47:38.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.227+0000 7f6777e00700 1 --2- 172.21.15.164:0/1950405594 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f6760038820 0x7f676003ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:38.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.227+0000 7f6777e00700 1 --2- 172.21.15.164:0/1950405594 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f6760038820 0x7f676003ace0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6764006fd0 tx=0x7f6764006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:38.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.239+0000 7f6775600700 1 -- 172.21.15.164:0/1950405594 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f676c005c00 con 0x7f67780ff0e0 2024-04-20T21:47:38.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.543+0000 7f677f400700 1 -- 172.21.15.164:0/1950405594 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6778062510 con 0x7f67780ff0e0 2024-04-20T21:47:38.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.544+0000 7f6775600700 1 -- 172.21.15.164:0/1950405594 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f6778062510 con 0x7f67780ff0e0 2024-04-20T21:47:38.543 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:47:38.543 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":1,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","modified":"2024-04-20T21:45:23.189616Z","created":"2024-04-20T21:45:23.189616Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-20T21:47:38.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.547+0000 7f677f400700 1 -- 172.21.15.164:0/1950405594 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f6760038820 msgr2=0x7f676003ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:38.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.547+0000 7f677f400700 1 --2- 172.21.15.164:0/1950405594 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f6760038820 0x7f676003ace0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6764006fd0 tx=0x7f6764006e40 comp rx=0 tx=0).stop 2024-04-20T21:47:38.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.547+0000 7f677f400700 1 -- 172.21.15.164:0/1950405594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67780ff0e0 msgr2=0x7f677819c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:38.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.547+0000 7f677f400700 1 --2- 172.21.15.164:0/1950405594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67780ff0e0 0x7f677819c2c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f676c006010 tx=0x7f676c0050b0 comp rx=0 tx=0).stop 2024-04-20T21:47:38.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.547+0000 7f677f400700 1 -- 172.21.15.164:0/1950405594 shutdown_connections 2024-04-20T21:47:38.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.547+0000 7f677f400700 1 --2- 172.21.15.164:0/1950405594 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f6760038820 0x7f676003ace0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:38.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.547+0000 7f677f400700 1 --2- 172.21.15.164:0/1950405594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67780ff0e0 0x7f677819c2c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:38.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.547+0000 7f677f400700 1 -- 172.21.15.164:0/1950405594 >> 172.21.15.164:0/1950405594 conn(0x7f67780face0 msgr2=0x7f67780fb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:38.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.547+0000 7f677f400700 1 -- 172.21.15.164:0/1950405594 shutdown_connections 2024-04-20T21:47:38.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:38.547+0000 7f677f400700 1 -- 172.21.15.164:0/1950405594 wait complete. 2024-04-20T21:47:38.547 INFO:teuthology.orchestra.run.smithi164.stderr:dumped monmap epoch 1 2024-04-20T21:47:38.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:38 smithi142 ceph-mon[15828]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:39.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:39 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/1950405594' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T21:47:40.250 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-20T21:47:40.250 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-20T21:47:40.623 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:47:40.723 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:47:40.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:40 smithi142 ceph-mon[15828]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:42.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.746+0000 7f52d7e00700 1 -- 172.21.15.164:0/466741262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52d81070f0 msgr2=0x7f52d8107510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:42.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.746+0000 7f52d7e00700 1 --2- 172.21.15.164:0/466741262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52d81070f0 0x7f52d8107510 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009910 tx=0x7f52c8009c20 comp rx=0 tx=0).stop 2024-04-20T21:47:42.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.746+0000 7f52d7e00700 1 -- 172.21.15.164:0/466741262 shutdown_connections 2024-04-20T21:47:42.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.746+0000 7f52d7e00700 1 --2- 172.21.15.164:0/466741262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52d81070f0 0x7f52d8107510 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:42.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.746+0000 7f52d7e00700 1 -- 172.21.15.164:0/466741262 >> 172.21.15.164:0/466741262 conn(0x7f52d8075cb0 msgr2=0x7f52d80780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:42.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.746+0000 7f52d7e00700 1 -- 172.21.15.164:0/466741262 shutdown_connections 2024-04-20T21:47:42.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.746+0000 7f52d7e00700 1 -- 172.21.15.164:0/466741262 wait complete. 2024-04-20T21:47:42.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.747+0000 7f52d7e00700 1 Processor -- start 2024-04-20T21:47:42.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.747+0000 7f52d7e00700 1 -- start start 2024-04-20T21:47:42.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.748+0000 7f52d7e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52d81070f0 0x7f52d819c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:42.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.748+0000 7f52d7e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d819c6e0 con 0x7f52d81070f0 2024-04-20T21:47:42.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.748+0000 7f52d6a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52d81070f0 0x7f52d819c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:42.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.749+0000 7f52d6a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52d81070f0 0x7f52d819c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.164:48864/0 (socket says 172.21.15.164:48864) 2024-04-20T21:47:42.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.749+0000 7f52d6a00700 1 -- 172.21.15.164:0/2755797379 learned_addr learned my addr 172.21.15.164:0/2755797379 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:47:42.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.749+0000 7f52d6a00700 1 -- 172.21.15.164:0/2755797379 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c80095f0 con 0x7f52d81070f0 2024-04-20T21:47:42.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.750+0000 7f52d6a00700 1 --2- 172.21.15.164:0/2755797379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52d81070f0 0x7f52d819c1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f52c8006010 tx=0x7f52c80050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:42.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.750+0000 7f52cf400700 1 -- 172.21.15.164:0/2755797379 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52c801d070 con 0x7f52d81070f0 2024-04-20T21:47:42.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.750+0000 7f52d7e00700 1 -- 172.21.15.164:0/2755797379 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d819c8e0 con 0x7f52d81070f0 2024-04-20T21:47:42.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.750+0000 7f52cf400700 1 -- 172.21.15.164:0/2755797379 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f52c800be20 con 0x7f52d81070f0 2024-04-20T21:47:42.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.750+0000 7f52cf400700 1 -- 172.21.15.164:0/2755797379 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52c8022de0 con 0x7f52d81070f0 2024-04-20T21:47:42.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.750+0000 7f52d7e00700 1 -- 172.21.15.164:0/2755797379 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d819cd80 con 0x7f52d81070f0 2024-04-20T21:47:42.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.752+0000 7f52d7e00700 1 -- 172.21.15.164:0/2755797379 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d8195ad0 con 0x7f52d81070f0 2024-04-20T21:47:42.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.752+0000 7f52cf400700 1 -- 172.21.15.164:0/2755797379 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f52c80226c0 con 0x7f52d81070f0 2024-04-20T21:47:42.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.752+0000 7f52cf400700 1 --2- 172.21.15.164:0/2755797379 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f52bc038820 0x7f52bc03ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:42.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.753+0000 7f52cf400700 1 -- 172.21.15.164:0/2755797379 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f52c804c8e0 con 0x7f52d81070f0 2024-04-20T21:47:42.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.753+0000 7f52d6000700 1 --2- 172.21.15.164:0/2755797379 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f52bc038820 0x7f52bc03ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:42.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.755+0000 7f52d6000700 1 --2- 172.21.15.164:0/2755797379 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f52bc038820 0x7f52bc03ace0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f52c4006fd0 tx=0x7f52c4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:42.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:42.769+0000 7f52cf400700 1 -- 172.21.15.164:0/2755797379 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f52c802a360 con 0x7f52d81070f0 2024-04-20T21:47:42.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:42 smithi142 ceph-mon[15828]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:43.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:43.078+0000 7f52d7e00700 1 -- 172.21.15.164:0/2755797379 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f52d810cae0 con 0x7f52d81070f0 2024-04-20T21:47:43.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:43.079+0000 7f52cf400700 1 -- 172.21.15.164:0/2755797379 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f52d810cae0 con 0x7f52d81070f0 2024-04-20T21:47:43.079 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:47:43.079 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":1,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","modified":"2024-04-20T21:45:23.189616Z","created":"2024-04-20T21:45:23.189616Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-20T21:47:43.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:43.083+0000 7f52d7e00700 1 -- 172.21.15.164:0/2755797379 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f52bc038820 msgr2=0x7f52bc03ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:43.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:43.083+0000 7f52d7e00700 1 --2- 172.21.15.164:0/2755797379 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f52bc038820 0x7f52bc03ace0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f52c4006fd0 tx=0x7f52c4006e40 comp rx=0 tx=0).stop 2024-04-20T21:47:43.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:43.083+0000 7f52d7e00700 1 -- 172.21.15.164:0/2755797379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52d81070f0 msgr2=0x7f52d819c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:43.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:43.083+0000 7f52d7e00700 1 --2- 172.21.15.164:0/2755797379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52d81070f0 0x7f52d819c1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f52c8006010 tx=0x7f52c80050b0 comp rx=0 tx=0).stop 2024-04-20T21:47:43.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:43.083+0000 7f52d7e00700 1 -- 172.21.15.164:0/2755797379 shutdown_connections 2024-04-20T21:47:43.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:43.083+0000 7f52d7e00700 1 --2- 172.21.15.164:0/2755797379 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f52bc038820 0x7f52bc03ace0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:43.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:43.083+0000 7f52d7e00700 1 --2- 172.21.15.164:0/2755797379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52d81070f0 0x7f52d819c1a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:43.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:43.083+0000 7f52d7e00700 1 -- 172.21.15.164:0/2755797379 >> 172.21.15.164:0/2755797379 conn(0x7f52d8075cb0 msgr2=0x7f52d80767d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:43.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:43.084+0000 7f52d7e00700 1 -- 172.21.15.164:0/2755797379 shutdown_connections 2024-04-20T21:47:43.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:43.084+0000 7f52d7e00700 1 -- 172.21.15.164:0/2755797379 wait complete. 2024-04-20T21:47:43.083 INFO:teuthology.orchestra.run.smithi164.stderr:dumped monmap epoch 1 2024-04-20T21:47:43.782 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:43 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/2755797379' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T21:47:44.819 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-20T21:47:44.820 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-20T21:47:44.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:44 smithi142 ceph-mon[15828]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:45.194 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:47:45.296 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:47:46.650 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:46 smithi142 ceph-mon[15828]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:46.650 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:46 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:46.650 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:46 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:46.650 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:46 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:46.650 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:46 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:46.650 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:46 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:46.650 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:46 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:46.650 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:46 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:46.650 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:46 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:47.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.233+0000 7fdf00e00700 1 -- 172.21.15.164:0/4286118835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdefc1028c0 msgr2=0x7fdefc102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:47.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.233+0000 7fdf00e00700 1 --2- 172.21.15.164:0/4286118835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdefc1028c0 0x7fdefc102ce0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009910 tx=0x7fdeec009c20 comp rx=0 tx=0).stop 2024-04-20T21:47:47.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.233+0000 7fdf00e00700 1 -- 172.21.15.164:0/4286118835 shutdown_connections 2024-04-20T21:47:47.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.233+0000 7fdf00e00700 1 --2- 172.21.15.164:0/4286118835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdefc1028c0 0x7fdefc102ce0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:47.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.233+0000 7fdf00e00700 1 -- 172.21.15.164:0/4286118835 >> 172.21.15.164:0/4286118835 conn(0x7fdefc0fde40 msgr2=0x7fdefc1002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:47.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.233+0000 7fdf00e00700 1 -- 172.21.15.164:0/4286118835 shutdown_connections 2024-04-20T21:47:47.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.233+0000 7fdf00e00700 1 -- 172.21.15.164:0/4286118835 wait complete. 2024-04-20T21:47:47.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.234+0000 7fdf00e00700 1 Processor -- start 2024-04-20T21:47:47.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.235+0000 7fdf00e00700 1 -- start start 2024-04-20T21:47:47.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.235+0000 7fdf00e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdefc1028c0 0x7fdefc197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:47.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.235+0000 7fdf00e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc1982a0 con 0x7fdefc1028c0 2024-04-20T21:47:47.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.235+0000 7fdefb400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdefc1028c0 0x7fdefc197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:47.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.235+0000 7fdefb400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdefc1028c0 0x7fdefc197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.164:48886/0 (socket says 172.21.15.164:48886) 2024-04-20T21:47:47.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.235+0000 7fdefb400700 1 -- 172.21.15.164:0/518687913 learned_addr learned my addr 172.21.15.164:0/518687913 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:47:47.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.236+0000 7fdefb400700 1 -- 172.21.15.164:0/518687913 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec0095f0 con 0x7fdefc1028c0 2024-04-20T21:47:47.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.236+0000 7fdefb400700 1 --2- 172.21.15.164:0/518687913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdefc1028c0 0x7fdefc197d60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdeec006010 tx=0x7fdeec0050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:47.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.236+0000 7fdef3e00700 1 -- 172.21.15.164:0/518687913 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdeec01d070 con 0x7fdefc1028c0 2024-04-20T21:47:47.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.237+0000 7fdf00e00700 1 -- 172.21.15.164:0/518687913 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdefc1984a0 con 0x7fdefc1028c0 2024-04-20T21:47:47.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.237+0000 7fdef3e00700 1 -- 172.21.15.164:0/518687913 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdeec00be20 con 0x7fdefc1028c0 2024-04-20T21:47:47.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.237+0000 7fdef3e00700 1 -- 172.21.15.164:0/518687913 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdeec022de0 con 0x7fdefc1028c0 2024-04-20T21:47:47.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.237+0000 7fdf00e00700 1 -- 172.21.15.164:0/518687913 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdefc198940 con 0x7fdefc1028c0 2024-04-20T21:47:47.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.238+0000 7fdf00e00700 1 -- 172.21.15.164:0/518687913 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdefc1916f0 con 0x7fdefc1028c0 2024-04-20T21:47:47.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.238+0000 7fdef3e00700 1 -- 172.21.15.164:0/518687913 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7fdeec0226c0 con 0x7fdefc1028c0 2024-04-20T21:47:47.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.239+0000 7fdef3e00700 1 --2- 172.21.15.164:0/518687913 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7fdee0038820 0x7fdee003ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:47.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.239+0000 7fdef3e00700 1 -- 172.21.15.164:0/518687913 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fdeec04c9a0 con 0x7fdefc1028c0 2024-04-20T21:47:47.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.240+0000 7fdefaa00700 1 --2- 172.21.15.164:0/518687913 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7fdee0038820 0x7fdee003ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:47.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.241+0000 7fdefaa00700 1 --2- 172.21.15.164:0/518687913 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7fdee0038820 0x7fdee003ace0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdee8006fd0 tx=0x7fdee8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:47.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.260+0000 7fdef3e00700 1 -- 172.21.15.164:0/518687913 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fdeec02a360 con 0x7fdefc1028c0 2024-04-20T21:47:47.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.565+0000 7fdf00e00700 1 -- 172.21.15.164:0/518687913 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdefc108700 con 0x7fdefc1028c0 2024-04-20T21:47:47.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.566+0000 7fdef3e00700 1 -- 172.21.15.164:0/518687913 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fdefc108700 con 0x7fdefc1028c0 2024-04-20T21:47:47.565 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:47:47.565 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":1,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","modified":"2024-04-20T21:45:23.189616Z","created":"2024-04-20T21:45:23.189616Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-20T21:47:47.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.569+0000 7fdf00e00700 1 -- 172.21.15.164:0/518687913 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7fdee0038820 msgr2=0x7fdee003ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:47.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.569+0000 7fdf00e00700 1 --2- 172.21.15.164:0/518687913 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7fdee0038820 0x7fdee003ace0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdee8006fd0 tx=0x7fdee8006e40 comp rx=0 tx=0).stop 2024-04-20T21:47:47.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.569+0000 7fdf00e00700 1 -- 172.21.15.164:0/518687913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdefc1028c0 msgr2=0x7fdefc197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:47.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.569+0000 7fdf00e00700 1 --2- 172.21.15.164:0/518687913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdefc1028c0 0x7fdefc197d60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdeec006010 tx=0x7fdeec0050b0 comp rx=0 tx=0).stop 2024-04-20T21:47:47.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.569+0000 7fdf00e00700 1 -- 172.21.15.164:0/518687913 shutdown_connections 2024-04-20T21:47:47.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.569+0000 7fdf00e00700 1 --2- 172.21.15.164:0/518687913 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7fdee0038820 0x7fdee003ace0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:47.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.569+0000 7fdf00e00700 1 --2- 172.21.15.164:0/518687913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdefc1028c0 0x7fdefc197d60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:47.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.569+0000 7fdf00e00700 1 -- 172.21.15.164:0/518687913 >> 172.21.15.164:0/518687913 conn(0x7fdefc0fde40 msgr2=0x7fdefc0fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:47.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.569+0000 7fdf00e00700 1 -- 172.21.15.164:0/518687913 shutdown_connections 2024-04-20T21:47:47.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:47.569+0000 7fdf00e00700 1 -- 172.21.15.164:0/518687913 wait complete. 2024-04-20T21:47:47.569 INFO:teuthology.orchestra.run.smithi164.stderr:dumped monmap epoch 1 2024-04-20T21:47:47.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:47 smithi142 ceph-mon[15828]: Deploying daemon prometheus.smithi142 on smithi142 2024-04-20T21:47:48.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:48 smithi142 ceph-mon[15828]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:48.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:48 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/518687913' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T21:47:48.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:48 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:47:49.222 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-20T21:47:49.222 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-20T21:47:49.592 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:47:49.692 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:47:50.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:50 smithi142 ceph-mon[15828]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:51.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.641+0000 7f309ba00700 1 -- 172.21.15.164:0/1800117416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3094074f10 msgr2=0x7f3094073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:51.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.641+0000 7f309ba00700 1 --2- 172.21.15.164:0/1800117416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3094074f10 0x7f3094073370 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3088009910 tx=0x7f3088009c20 comp rx=0 tx=0).stop 2024-04-20T21:47:51.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.641+0000 7f309ba00700 1 -- 172.21.15.164:0/1800117416 shutdown_connections 2024-04-20T21:47:51.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.641+0000 7f309ba00700 1 --2- 172.21.15.164:0/1800117416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3094074f10 0x7f3094073370 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:51.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.641+0000 7f309ba00700 1 -- 172.21.15.164:0/1800117416 >> 172.21.15.164:0/1800117416 conn(0x7f30940fbe30 msgr2=0x7f30940fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:51.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.641+0000 7f309ba00700 1 -- 172.21.15.164:0/1800117416 shutdown_connections 2024-04-20T21:47:51.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.641+0000 7f309ba00700 1 -- 172.21.15.164:0/1800117416 wait complete. 2024-04-20T21:47:51.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.643+0000 7f309ba00700 1 Processor -- start 2024-04-20T21:47:51.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.643+0000 7f309ba00700 1 -- start start 2024-04-20T21:47:51.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.644+0000 7f309ba00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3094074f10 0x7f309419c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:51.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.644+0000 7f309ba00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309419ca00 con 0x7f3094074f10 2024-04-20T21:47:51.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.644+0000 7f3099000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3094074f10 0x7f309419c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:51.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.644+0000 7f3099000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3094074f10 0x7f309419c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.164:53106/0 (socket says 172.21.15.164:53106) 2024-04-20T21:47:51.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.644+0000 7f3099000700 1 -- 172.21.15.164:0/3327563376 learned_addr learned my addr 172.21.15.164:0/3327563376 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:47:51.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.645+0000 7f3099000700 1 -- 172.21.15.164:0/3327563376 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30880095f0 con 0x7f3094074f10 2024-04-20T21:47:51.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.645+0000 7f3099000700 1 --2- 172.21.15.164:0/3327563376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3094074f10 0x7f309419c4c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3088006010 tx=0x7f3088009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:51.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.646+0000 7f3091600700 1 -- 172.21.15.164:0/3327563376 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f308801d070 con 0x7f3094074f10 2024-04-20T21:47:51.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.646+0000 7f3091600700 1 -- 172.21.15.164:0/3327563376 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3088005dc0 con 0x7f3094074f10 2024-04-20T21:47:51.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.646+0000 7f309ba00700 1 -- 172.21.15.164:0/3327563376 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3094104490 con 0x7f3094074f10 2024-04-20T21:47:51.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.646+0000 7f3091600700 1 -- 172.21.15.164:0/3327563376 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3088022e90 con 0x7f3094074f10 2024-04-20T21:47:51.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.646+0000 7f309ba00700 1 -- 172.21.15.164:0/3327563376 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309419cf10 con 0x7f3094074f10 2024-04-20T21:47:51.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.647+0000 7f309ba00700 1 -- 172.21.15.164:0/3327563376 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3094195e20 con 0x7f3094074f10 2024-04-20T21:47:51.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.648+0000 7f3091600700 1 -- 172.21.15.164:0/3327563376 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f3088022470 con 0x7f3094074f10 2024-04-20T21:47:51.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.648+0000 7f3091600700 1 --2- 172.21.15.164:0/3327563376 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f307c0387c0 0x7f307c03ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:51.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.648+0000 7f3091600700 1 -- 172.21.15.164:0/3327563376 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f308804c870 con 0x7f3094074f10 2024-04-20T21:47:51.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.649+0000 7f3093e00700 1 --2- 172.21.15.164:0/3327563376 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f307c0387c0 0x7f307c03ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:51.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.650+0000 7f3093e00700 1 --2- 172.21.15.164:0/3327563376 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f307c0387c0 0x7f307c03ac80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3080006fd0 tx=0x7f3080006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:51.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.667+0000 7f3091600700 1 -- 172.21.15.164:0/3327563376 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f308800b960 con 0x7f3094074f10 2024-04-20T21:47:51.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.968+0000 7f309ba00700 1 -- 172.21.15.164:0/3327563376 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f309410d0f0 con 0x7f3094074f10 2024-04-20T21:47:51.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.970+0000 7f3091600700 1 -- 172.21.15.164:0/3327563376 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f3088027020 con 0x7f3094074f10 2024-04-20T21:47:51.969 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:47:51.970 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":1,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","modified":"2024-04-20T21:45:23.189616Z","created":"2024-04-20T21:45:23.189616Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-20T21:47:51.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.972+0000 7f309ba00700 1 -- 172.21.15.164:0/3327563376 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f307c0387c0 msgr2=0x7f307c03ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:51.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.972+0000 7f309ba00700 1 --2- 172.21.15.164:0/3327563376 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f307c0387c0 0x7f307c03ac80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3080006fd0 tx=0x7f3080006e40 comp rx=0 tx=0).stop 2024-04-20T21:47:51.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.972+0000 7f309ba00700 1 -- 172.21.15.164:0/3327563376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3094074f10 msgr2=0x7f309419c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:51.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.972+0000 7f309ba00700 1 --2- 172.21.15.164:0/3327563376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3094074f10 0x7f309419c4c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3088006010 tx=0x7f3088009f80 comp rx=0 tx=0).stop 2024-04-20T21:47:51.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.972+0000 7f309ba00700 1 -- 172.21.15.164:0/3327563376 shutdown_connections 2024-04-20T21:47:51.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.972+0000 7f309ba00700 1 --2- 172.21.15.164:0/3327563376 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f307c0387c0 0x7f307c03ac80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:51.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.972+0000 7f309ba00700 1 --2- 172.21.15.164:0/3327563376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3094074f10 0x7f309419c4c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:51.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.972+0000 7f309ba00700 1 -- 172.21.15.164:0/3327563376 >> 172.21.15.164:0/3327563376 conn(0x7f30940fbe30 msgr2=0x7f30940fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:51.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.972+0000 7f309ba00700 1 -- 172.21.15.164:0/3327563376 shutdown_connections 2024-04-20T21:47:51.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:51.972+0000 7f309ba00700 1 -- 172.21.15.164:0/3327563376 wait complete. 2024-04-20T21:47:51.973 INFO:teuthology.orchestra.run.smithi164.stderr:dumped monmap epoch 1 2024-04-20T21:47:52.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:52 smithi142 ceph-mon[15828]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:52.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:52 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/3327563376' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T21:47:53.611 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-20T21:47:53.612 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-20T21:47:53.990 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:47:54.092 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:47:54.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:54 smithi142 ceph-mon[15828]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:56.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.050+0000 7f61d5a00700 1 -- 172.21.15.164:0/4201334246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d0100690 msgr2=0x7f61d0100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:56.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.050+0000 7f61d5a00700 1 --2- 172.21.15.164:0/4201334246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d0100690 0x7f61d0100ab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f61c000b0a0 tx=0x7f61c000b3b0 comp rx=0 tx=0).stop 2024-04-20T21:47:56.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.051+0000 7f61d5a00700 1 -- 172.21.15.164:0/4201334246 shutdown_connections 2024-04-20T21:47:56.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.051+0000 7f61d5a00700 1 --2- 172.21.15.164:0/4201334246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d0100690 0x7f61d0100ab0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:56.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.051+0000 7f61d5a00700 1 -- 172.21.15.164:0/4201334246 >> 172.21.15.164:0/4201334246 conn(0x7f61d00fbc50 msgr2=0x7f61d00fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:56.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.051+0000 7f61d5a00700 1 -- 172.21.15.164:0/4201334246 shutdown_connections 2024-04-20T21:47:56.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.051+0000 7f61d5a00700 1 -- 172.21.15.164:0/4201334246 wait complete. 2024-04-20T21:47:56.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.052+0000 7f61d5a00700 1 Processor -- start 2024-04-20T21:47:56.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.052+0000 7f61d5a00700 1 -- start start 2024-04-20T21:47:56.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.052+0000 7f61d5a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d0100690 0x7f61d0197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:56.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.052+0000 7f61d5a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0198270 con 0x7f61d0100690 2024-04-20T21:47:56.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.053+0000 7f61cfe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d0100690 0x7f61d0197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:56.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.053+0000 7f61cfe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d0100690 0x7f61d0197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.164:53120/0 (socket says 172.21.15.164:53120) 2024-04-20T21:47:56.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.053+0000 7f61cfe00700 1 -- 172.21.15.164:0/710905186 learned_addr learned my addr 172.21.15.164:0/710905186 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:47:56.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.053+0000 7f61cfe00700 1 -- 172.21.15.164:0/710905186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c0009d00 con 0x7f61d0100690 2024-04-20T21:47:56.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.054+0000 7f61cfe00700 1 --2- 172.21.15.164:0/710905186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d0100690 0x7f61d0197d30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f61c000bc90 tx=0x7f61c000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:56.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.054+0000 7f61ccc00700 1 -- 172.21.15.164:0/710905186 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61c000e040 con 0x7f61d0100690 2024-04-20T21:47:56.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.054+0000 7f61d5a00700 1 -- 172.21.15.164:0/710905186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d0198470 con 0x7f61d0100690 2024-04-20T21:47:56.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.054+0000 7f61ccc00700 1 -- 172.21.15.164:0/710905186 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f61c0003d50 con 0x7f61d0100690 2024-04-20T21:47:56.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.054+0000 7f61ccc00700 1 -- 172.21.15.164:0/710905186 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61c001c8f0 con 0x7f61d0100690 2024-04-20T21:47:56.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.054+0000 7f61d5a00700 1 -- 172.21.15.164:0/710905186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d0198910 con 0x7f61d0100690 2024-04-20T21:47:56.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.055+0000 7f61d5a00700 1 -- 172.21.15.164:0/710905186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d01918c0 con 0x7f61d0100690 2024-04-20T21:47:56.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.055+0000 7f61ccc00700 1 -- 172.21.15.164:0/710905186 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f61c001cbb0 con 0x7f61d0100690 2024-04-20T21:47:56.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.056+0000 7f61ccc00700 1 --2- 172.21.15.164:0/710905186 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f61b4038810 0x7f61b403acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:47:56.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.056+0000 7f61ccc00700 1 -- 172.21.15.164:0/710905186 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f61c004ca40 con 0x7f61d0100690 2024-04-20T21:47:56.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.056+0000 7f61cf400700 1 --2- 172.21.15.164:0/710905186 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f61b4038810 0x7f61b403acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:47:56.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.057+0000 7f61cf400700 1 --2- 172.21.15.164:0/710905186 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f61b4038810 0x7f61b403acd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f61bc006fd0 tx=0x7f61bc006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:47:56.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.065+0000 7f61ccc00700 1 -- 172.21.15.164:0/710905186 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f61c001c400 con 0x7f61d0100690 2024-04-20T21:47:56.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.368+0000 7f61d5a00700 1 -- 172.21.15.164:0/710905186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f61d0062510 con 0x7f61d0100690 2024-04-20T21:47:56.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.370+0000 7f61ccc00700 1 -- 172.21.15.164:0/710905186 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f61c001ce60 con 0x7f61d0100690 2024-04-20T21:47:56.370 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:47:56.370 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":1,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","modified":"2024-04-20T21:45:23.189616Z","created":"2024-04-20T21:45:23.189616Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-20T21:47:56.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.372+0000 7f61d5a00700 1 -- 172.21.15.164:0/710905186 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f61b4038810 msgr2=0x7f61b403acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:56.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.372+0000 7f61d5a00700 1 --2- 172.21.15.164:0/710905186 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f61b4038810 0x7f61b403acd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f61bc006fd0 tx=0x7f61bc006e40 comp rx=0 tx=0).stop 2024-04-20T21:47:56.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.372+0000 7f61d5a00700 1 -- 172.21.15.164:0/710905186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d0100690 msgr2=0x7f61d0197d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:47:56.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.372+0000 7f61d5a00700 1 --2- 172.21.15.164:0/710905186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d0100690 0x7f61d0197d30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f61c000bc90 tx=0x7f61c000bd70 comp rx=0 tx=0).stop 2024-04-20T21:47:56.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.373+0000 7f61d5a00700 1 -- 172.21.15.164:0/710905186 shutdown_connections 2024-04-20T21:47:56.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.373+0000 7f61d5a00700 1 --2- 172.21.15.164:0/710905186 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f61b4038810 0x7f61b403acd0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:56.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.373+0000 7f61d5a00700 1 --2- 172.21.15.164:0/710905186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61d0100690 0x7f61d0197d30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:47:56.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.373+0000 7f61d5a00700 1 -- 172.21.15.164:0/710905186 >> 172.21.15.164:0/710905186 conn(0x7f61d00fbc50 msgr2=0x7f61d00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:47:56.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.373+0000 7f61d5a00700 1 -- 172.21.15.164:0/710905186 shutdown_connections 2024-04-20T21:47:56.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:47:56.373+0000 7f61d5a00700 1 -- 172.21.15.164:0/710905186 wait complete. 2024-04-20T21:47:56.374 INFO:teuthology.orchestra.run.smithi164.stderr:dumped monmap epoch 1 2024-04-20T21:47:56.828 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:56 smithi142 ceph-mon[15828]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:47:56.828 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:56 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/710905186' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T21:47:58.081 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-20T21:47:58.081 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-20T21:47:58.439 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:47:58.538 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:47:58.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:47:58 smithi142 ceph-mon[15828]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:00.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.460+0000 7f0534600700 1 -- 172.21.15.164:0/2988061607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f052c074f10 msgr2=0x7f052c073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:00.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.460+0000 7f0534600700 1 --2- 172.21.15.164:0/2988061607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f052c074f10 0x7f052c073370 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f051c009910 tx=0x7f051c009c20 comp rx=0 tx=0).stop 2024-04-20T21:48:00.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.460+0000 7f0534600700 1 -- 172.21.15.164:0/2988061607 shutdown_connections 2024-04-20T21:48:00.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.460+0000 7f0534600700 1 --2- 172.21.15.164:0/2988061607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f052c074f10 0x7f052c073370 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:00.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.460+0000 7f0534600700 1 -- 172.21.15.164:0/2988061607 >> 172.21.15.164:0/2988061607 conn(0x7f052c0fbe30 msgr2=0x7f052c0fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:00.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.460+0000 7f0534600700 1 -- 172.21.15.164:0/2988061607 shutdown_connections 2024-04-20T21:48:00.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.460+0000 7f0534600700 1 -- 172.21.15.164:0/2988061607 wait complete. 2024-04-20T21:48:00.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.462+0000 7f0534600700 1 Processor -- start 2024-04-20T21:48:00.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.462+0000 7f0534600700 1 -- start start 2024-04-20T21:48:00.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.462+0000 7f0534600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f052c074f10 0x7f052c19c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:00.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.462+0000 7f0534600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c19ca00 con 0x7f052c074f10 2024-04-20T21:48:00.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.463+0000 7f0531c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f052c074f10 0x7f052c19c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:00.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.463+0000 7f0531c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f052c074f10 0x7f052c19c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.164:56268/0 (socket says 172.21.15.164:56268) 2024-04-20T21:48:00.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.463+0000 7f0531c00700 1 -- 172.21.15.164:0/4261005303 learned_addr learned my addr 172.21.15.164:0/4261005303 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:48:00.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.464+0000 7f0531c00700 1 -- 172.21.15.164:0/4261005303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051c0095f0 con 0x7f052c074f10 2024-04-20T21:48:00.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.464+0000 7f0531c00700 1 --2- 172.21.15.164:0/4261005303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f052c074f10 0x7f052c19c4c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f051c006010 tx=0x7f051c0050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:00.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.465+0000 7f052a000700 1 -- 172.21.15.164:0/4261005303 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f051c01d070 con 0x7f052c074f10 2024-04-20T21:48:00.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.465+0000 7f0534600700 1 -- 172.21.15.164:0/4261005303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052c104490 con 0x7f052c074f10 2024-04-20T21:48:00.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.465+0000 7f052a000700 1 -- 172.21.15.164:0/4261005303 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f051c00be20 con 0x7f052c074f10 2024-04-20T21:48:00.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.465+0000 7f0534600700 1 -- 172.21.15.164:0/4261005303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052c19cf10 con 0x7f052c074f10 2024-04-20T21:48:00.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.465+0000 7f052a000700 1 -- 172.21.15.164:0/4261005303 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f051c022df0 con 0x7f052c074f10 2024-04-20T21:48:00.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.466+0000 7f0534600700 1 -- 172.21.15.164:0/4261005303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052c195e20 con 0x7f052c074f10 2024-04-20T21:48:00.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.466+0000 7f052a000700 1 -- 172.21.15.164:0/4261005303 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45613+0+0 (secure 0 0 0) 0x7f051c0226c0 con 0x7f052c074f10 2024-04-20T21:48:00.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.467+0000 7f052a000700 1 --2- 172.21.15.164:0/4261005303 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f05100387d0 0x7f051003ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:00.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.467+0000 7f052a000700 1 -- 172.21.15.164:0/4261005303 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f051c04c8a0 con 0x7f052c074f10 2024-04-20T21:48:00.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.467+0000 7f0531200700 1 --2- 172.21.15.164:0/4261005303 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f05100387d0 0x7f051003ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:00.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.468+0000 7f0531200700 1 --2- 172.21.15.164:0/4261005303 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f05100387d0 0x7f051003ac90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0518006fd0 tx=0x7f0518006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:00.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.481+0000 7f052a000700 1 -- 172.21.15.164:0/4261005303 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f051c00b960 con 0x7f052c074f10 2024-04-20T21:48:00.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.783+0000 7f0534600700 1 -- 172.21.15.164:0/4261005303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f052c10d0f0 con 0x7f052c074f10 2024-04-20T21:48:00.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.784+0000 7f052a000700 1 -- 172.21.15.164:0/4261005303 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f051c027030 con 0x7f052c074f10 2024-04-20T21:48:00.784 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:48:00.784 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":1,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","modified":"2024-04-20T21:45:23.189616Z","created":"2024-04-20T21:45:23.189616Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-20T21:48:00.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.787+0000 7f0534600700 1 -- 172.21.15.164:0/4261005303 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f05100387d0 msgr2=0x7f051003ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:00.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.787+0000 7f0534600700 1 --2- 172.21.15.164:0/4261005303 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f05100387d0 0x7f051003ac90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0518006fd0 tx=0x7f0518006e40 comp rx=0 tx=0).stop 2024-04-20T21:48:00.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.787+0000 7f0534600700 1 -- 172.21.15.164:0/4261005303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f052c074f10 msgr2=0x7f052c19c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:00.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.787+0000 7f0534600700 1 --2- 172.21.15.164:0/4261005303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f052c074f10 0x7f052c19c4c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f051c006010 tx=0x7f051c0050b0 comp rx=0 tx=0).stop 2024-04-20T21:48:00.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.787+0000 7f0534600700 1 -- 172.21.15.164:0/4261005303 shutdown_connections 2024-04-20T21:48:00.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.787+0000 7f0534600700 1 --2- 172.21.15.164:0/4261005303 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f05100387d0 0x7f051003ac90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:00.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.787+0000 7f0534600700 1 --2- 172.21.15.164:0/4261005303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f052c074f10 0x7f052c19c4c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:00.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.787+0000 7f0534600700 1 -- 172.21.15.164:0/4261005303 >> 172.21.15.164:0/4261005303 conn(0x7f052c0fbe30 msgr2=0x7f052c0fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:00.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.787+0000 7f0534600700 1 -- 172.21.15.164:0/4261005303 shutdown_connections 2024-04-20T21:48:00.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:00.787+0000 7f0534600700 1 -- 172.21.15.164:0/4261005303 wait complete. 2024-04-20T21:48:00.788 INFO:teuthology.orchestra.run.smithi164.stderr:dumped monmap epoch 1 2024-04-20T21:48:00.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:00 smithi142 ceph-mon[15828]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:00.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:00 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:00.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:00 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:00.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:00 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:00.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:00 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-20T21:48:01.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:01 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/4261005303' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T21:48:01.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:01 smithi142 ceph-mon[15828]: from='mgr.14164 172.21.15.142:0/3075150169' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-20T21:48:01.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:01 smithi142 ceph-mon[15828]: mgrmap e14: smithi142.zzmcfz(active, since 77s) 2024-04-20T21:48:02.544 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-20T21:48:02.545 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-20T21:48:02.921 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:48:03.021 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:48:04.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.941+0000 7f8568600700 1 -- 172.21.15.164:0/832123062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85600ff760 msgr2=0x7f85600ffb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:04.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.941+0000 7f8568600700 1 --2- 172.21.15.164:0/832123062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85600ff760 0x7f85600ffb80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8554009910 tx=0x7f8554009c20 comp rx=0 tx=0).stop 2024-04-20T21:48:04.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.941+0000 7f8568600700 1 -- 172.21.15.164:0/832123062 shutdown_connections 2024-04-20T21:48:04.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.941+0000 7f8568600700 1 --2- 172.21.15.164:0/832123062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85600ff760 0x7f85600ffb80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:04.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.941+0000 7f8568600700 1 -- 172.21.15.164:0/832123062 >> 172.21.15.164:0/832123062 conn(0x7f85600face0 msgr2=0x7f85600fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:04.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.941+0000 7f8568600700 1 -- 172.21.15.164:0/832123062 shutdown_connections 2024-04-20T21:48:04.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.941+0000 7f8568600700 1 -- 172.21.15.164:0/832123062 wait complete. 2024-04-20T21:48:04.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.942+0000 7f8568600700 1 Processor -- start 2024-04-20T21:48:04.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.942+0000 7f8568600700 1 -- start start 2024-04-20T21:48:04.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.943+0000 7f8568600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85600ff760 0x7f8560197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:04.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.943+0000 7f8568600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8560198450 con 0x7f85600ff760 2024-04-20T21:48:04.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.943+0000 7f8565c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85600ff760 0x7f8560197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:04.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.943+0000 7f8565c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85600ff760 0x7f8560197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.164:56276/0 (socket says 172.21.15.164:56276) 2024-04-20T21:48:04.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.943+0000 7f8565c00700 1 -- 172.21.15.164:0/2221244939 learned_addr learned my addr 172.21.15.164:0/2221244939 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:48:04.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.944+0000 7f8565c00700 1 -- 172.21.15.164:0/2221244939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85540095f0 con 0x7f85600ff760 2024-04-20T21:48:04.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.944+0000 7f8565c00700 1 --2- 172.21.15.164:0/2221244939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85600ff760 0x7f8560197f10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8554006010 tx=0x7f8554009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:04.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.944+0000 7f855e000700 1 -- 172.21.15.164:0/2221244939 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f855401d070 con 0x7f85600ff760 2024-04-20T21:48:04.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.944+0000 7f855e000700 1 -- 172.21.15.164:0/2221244939 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8554005dc0 con 0x7f85600ff760 2024-04-20T21:48:04.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.944+0000 7f855e000700 1 -- 172.21.15.164:0/2221244939 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8554022e90 con 0x7f85600ff760 2024-04-20T21:48:04.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.944+0000 7f8568600700 1 -- 172.21.15.164:0/2221244939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8560198650 con 0x7f85600ff760 2024-04-20T21:48:04.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.945+0000 7f8568600700 1 -- 172.21.15.164:0/2221244939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8560198af0 con 0x7f85600ff760 2024-04-20T21:48:04.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.946+0000 7f8568600700 1 -- 172.21.15.164:0/2221244939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8560062510 con 0x7f85600ff760 2024-04-20T21:48:04.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.946+0000 7f855e000700 1 -- 172.21.15.164:0/2221244939 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 14) v1 ==== 45627+0+0 (secure 0 0 0) 0x7f8554022470 con 0x7f85600ff760 2024-04-20T21:48:04.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.946+0000 7f855e000700 1 --2- 172.21.15.164:0/2221244939 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f8548038810 0x7f854803acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:04.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.946+0000 7f855e000700 1 -- 172.21.15.164:0/2221244939 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f855404c8d0 con 0x7f85600ff760 2024-04-20T21:48:04.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.947+0000 7f8565200700 1 -- 172.21.15.164:0/2221244939 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f8548038810 msgr2=0x7f854803acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3464616902 2024-04-20T21:48:04.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.947+0000 7f8565200700 1 --2- 172.21.15.164:0/2221244939 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f8548038810 0x7f854803acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T21:48:04.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:04.961+0000 7f855e000700 1 -- 172.21.15.164:0/2221244939 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f855400b960 con 0x7f85600ff760 2024-04-20T21:48:05.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:05.148+0000 7f8565200700 1 -- 172.21.15.164:0/2221244939 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f8548038810 msgr2=0x7f854803acd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3464616902 2024-04-20T21:48:05.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:05.148+0000 7f8565200700 1 --2- 172.21.15.164:0/2221244939 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f8548038810 0x7f854803acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-20T21:48:05.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:05.267+0000 7f8568600700 1 -- 172.21.15.164:0/2221244939 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8560105790 con 0x7f85600ff760 2024-04-20T21:48:05.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:05.268+0000 7f855e000700 1 -- 172.21.15.164:0/2221244939 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f8554027020 con 0x7f85600ff760 2024-04-20T21:48:05.268 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:48:05.268 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":1,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","modified":"2024-04-20T21:45:23.189616Z","created":"2024-04-20T21:45:23.189616Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-20T21:48:05.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:05.271+0000 7f8568600700 1 -- 172.21.15.164:0/2221244939 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f8548038810 msgr2=0x7f854803acd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T21:48:05.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:05.271+0000 7f8568600700 1 --2- 172.21.15.164:0/2221244939 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f8548038810 0x7f854803acd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:05.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:05.271+0000 7f8568600700 1 -- 172.21.15.164:0/2221244939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85600ff760 msgr2=0x7f8560197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:05.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:05.271+0000 7f8568600700 1 --2- 172.21.15.164:0/2221244939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85600ff760 0x7f8560197f10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8554006010 tx=0x7f8554009f80 comp rx=0 tx=0).stop 2024-04-20T21:48:05.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:05.271+0000 7f8568600700 1 -- 172.21.15.164:0/2221244939 shutdown_connections 2024-04-20T21:48:05.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:05.271+0000 7f8568600700 1 --2- 172.21.15.164:0/2221244939 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f8548038810 0x7f854803acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:05.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:05.271+0000 7f8568600700 1 --2- 172.21.15.164:0/2221244939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85600ff760 0x7f8560197f10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:05.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:05.271+0000 7f8568600700 1 -- 172.21.15.164:0/2221244939 >> 172.21.15.164:0/2221244939 conn(0x7f85600face0 msgr2=0x7f85600fba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:05.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:05.271+0000 7f8568600700 1 -- 172.21.15.164:0/2221244939 shutdown_connections 2024-04-20T21:48:05.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:05.271+0000 7f8568600700 1 -- 172.21.15.164:0/2221244939 wait complete. 2024-04-20T21:48:05.272 INFO:teuthology.orchestra.run.smithi164.stderr:dumped monmap epoch 1 2024-04-20T21:48:05.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:05 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/2221244939' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T21:48:06.966 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-20T21:48:06.966 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-20T21:48:07.338 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:48:07.437 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:48:09.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.414+0000 7f2d7b600700 1 -- 172.21.15.164:0/3127306282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d740ff760 msgr2=0x7f2d740ffb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:09.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.414+0000 7f2d7b600700 1 --2- 172.21.15.164:0/3127306282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d740ff760 0x7f2d740ffb80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009910 tx=0x7f2d68009c20 comp rx=0 tx=0).stop 2024-04-20T21:48:09.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.415+0000 7f2d7b600700 1 -- 172.21.15.164:0/3127306282 shutdown_connections 2024-04-20T21:48:09.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.415+0000 7f2d7b600700 1 --2- 172.21.15.164:0/3127306282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d740ff760 0x7f2d740ffb80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:09.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.415+0000 7f2d7b600700 1 -- 172.21.15.164:0/3127306282 >> 172.21.15.164:0/3127306282 conn(0x7f2d740face0 msgr2=0x7f2d740fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:09.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.415+0000 7f2d7b600700 1 -- 172.21.15.164:0/3127306282 shutdown_connections 2024-04-20T21:48:09.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.415+0000 7f2d7b600700 1 -- 172.21.15.164:0/3127306282 wait complete. 2024-04-20T21:48:09.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.416+0000 7f2d7b600700 1 Processor -- start 2024-04-20T21:48:09.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.416+0000 7f2d7b600700 1 -- start start 2024-04-20T21:48:09.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.416+0000 7f2d7b600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d740ff760 0x7f2d74197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:09.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.416+0000 7f2d7b600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d74198480 con 0x7f2d740ff760 2024-04-20T21:48:09.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.417+0000 7f2d78c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d740ff760 0x7f2d74197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:09.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.417+0000 7f2d78c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d740ff760 0x7f2d74197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.164:35512/0 (socket says 172.21.15.164:35512) 2024-04-20T21:48:09.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.417+0000 7f2d78c00700 1 -- 172.21.15.164:0/3272602277 learned_addr learned my addr 172.21.15.164:0/3272602277 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:48:09.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.418+0000 7f2d78c00700 1 -- 172.21.15.164:0/3272602277 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d680095f0 con 0x7f2d740ff760 2024-04-20T21:48:09.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.418+0000 7f2d78c00700 1 --2- 172.21.15.164:0/3272602277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d740ff760 0x7f2d74197f40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2d68006010 tx=0x7f2d680050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:09.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.418+0000 7f2d71600700 1 -- 172.21.15.164:0/3272602277 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d6801d070 con 0x7f2d740ff760 2024-04-20T21:48:09.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.419+0000 7f2d7b600700 1 -- 172.21.15.164:0/3272602277 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d74198680 con 0x7f2d740ff760 2024-04-20T21:48:09.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.419+0000 7f2d71600700 1 -- 172.21.15.164:0/3272602277 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d6800be20 con 0x7f2d740ff760 2024-04-20T21:48:09.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.419+0000 7f2d71600700 1 -- 172.21.15.164:0/3272602277 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d68022de0 con 0x7f2d740ff760 2024-04-20T21:48:09.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.419+0000 7f2d7b600700 1 -- 172.21.15.164:0/3272602277 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d74198b20 con 0x7f2d740ff760 2024-04-20T21:48:09.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.420+0000 7f2d7b600700 1 -- 172.21.15.164:0/3272602277 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d741920b0 con 0x7f2d740ff760 2024-04-20T21:48:09.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.421+0000 7f2d71600700 1 -- 172.21.15.164:0/3272602277 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 14) v1 ==== 45627+0+0 (secure 0 0 0) 0x7f2d680226c0 con 0x7f2d740ff760 2024-04-20T21:48:09.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.421+0000 7f2d71600700 1 --2- 172.21.15.164:0/3272602277 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f2d5c038870 0x7f2d5c03ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:09.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.421+0000 7f2d71600700 1 -- 172.21.15.164:0/3272602277 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2d6804d090 con 0x7f2d740ff760 2024-04-20T21:48:09.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.421+0000 7f2d73e00700 1 -- 172.21.15.164:0/3272602277 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f2d5c038870 msgr2=0x7f2d5c03ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3464616902 2024-04-20T21:48:09.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.421+0000 7f2d73e00700 1 --2- 172.21.15.164:0/3272602277 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f2d5c038870 0x7f2d5c03ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T21:48:09.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.440+0000 7f2d71600700 1 -- 172.21.15.164:0/3272602277 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f2d6802b980 con 0x7f2d740ff760 2024-04-20T21:48:09.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.622+0000 7f2d73e00700 1 -- 172.21.15.164:0/3272602277 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f2d5c038870 msgr2=0x7f2d5c03ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3464616902 2024-04-20T21:48:09.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.622+0000 7f2d73e00700 1 --2- 172.21.15.164:0/3272602277 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f2d5c038870 0x7f2d5c03ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-20T21:48:09.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.746+0000 7f2d7b600700 1 -- 172.21.15.164:0/3272602277 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2d74105740 con 0x7f2d740ff760 2024-04-20T21:48:09.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.747+0000 7f2d71600700 1 -- 172.21.15.164:0/3272602277 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f2d68027030 con 0x7f2d740ff760 2024-04-20T21:48:09.746 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:48:09.746 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":1,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","modified":"2024-04-20T21:45:23.189616Z","created":"2024-04-20T21:45:23.189616Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-20T21:48:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.749+0000 7f2d7b600700 1 -- 172.21.15.164:0/3272602277 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f2d5c038870 msgr2=0x7f2d5c03ad30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T21:48:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.749+0000 7f2d7b600700 1 --2- 172.21.15.164:0/3272602277 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f2d5c038870 0x7f2d5c03ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.750+0000 7f2d7b600700 1 -- 172.21.15.164:0/3272602277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d740ff760 msgr2=0x7f2d74197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.750+0000 7f2d7b600700 1 --2- 172.21.15.164:0/3272602277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d740ff760 0x7f2d74197f40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2d68006010 tx=0x7f2d680050b0 comp rx=0 tx=0).stop 2024-04-20T21:48:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.750+0000 7f2d7b600700 1 -- 172.21.15.164:0/3272602277 shutdown_connections 2024-04-20T21:48:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.750+0000 7f2d7b600700 1 --2- 172.21.15.164:0/3272602277 >> [v2:172.21.15.142:6800/3464616902,v1:172.21.15.142:6801/3464616902] conn(0x7f2d5c038870 0x7f2d5c03ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.750+0000 7f2d7b600700 1 --2- 172.21.15.164:0/3272602277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d740ff760 0x7f2d74197f40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.750+0000 7f2d7b600700 1 -- 172.21.15.164:0/3272602277 >> 172.21.15.164:0/3272602277 conn(0x7f2d740face0 msgr2=0x7f2d7418f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.750+0000 7f2d7b600700 1 -- 172.21.15.164:0/3272602277 shutdown_connections 2024-04-20T21:48:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:09.750+0000 7f2d7b600700 1 -- 172.21.15.164:0/3272602277 wait complete. 2024-04-20T21:48:09.750 INFO:teuthology.orchestra.run.smithi164.stderr:dumped monmap epoch 1 2024-04-20T21:48:09.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:09 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/3272602277' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T21:48:11.186 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:10 smithi142 ceph-mon[15828]: Active manager daemon smithi142.zzmcfz restarted 2024-04-20T21:48:11.186 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:10 smithi142 ceph-mon[15828]: Activating manager daemon smithi142.zzmcfz 2024-04-20T21:48:11.186 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:10 smithi142 ceph-mon[15828]: osdmap e5: 0 total, 0 up, 0 in 2024-04-20T21:48:11.186 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:10 smithi142 ceph-mon[15828]: mgrmap e15: smithi142.zzmcfz(active, starting, since 0.00439932s) 2024-04-20T21:48:11.186 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:10 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T21:48:11.186 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:10 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr metadata", "who": "smithi142.zzmcfz", "id": "smithi142.zzmcfz"}]: dispatch 2024-04-20T21:48:11.186 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:10 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-20T21:48:11.186 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:10 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-20T21:48:11.186 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:10 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-20T21:48:11.186 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:10 smithi142 ceph-mon[15828]: Manager daemon smithi142.zzmcfz is now available 2024-04-20T21:48:11.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:10 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:48:11.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:10 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:11.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:10 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:48:11.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:10 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.zzmcfz/mirror_snapshot_schedule"}]: dispatch 2024-04-20T21:48:11.187 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:10 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.zzmcfz/trash_purge_schedule"}]: dispatch 2024-04-20T21:48:11.503 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-20T21:48:11.503 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-20T21:48:11.859 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:48:11.957 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:48:12.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:11 smithi142 ceph-mon[15828]: [20/Apr/2024:21:48:10] ENGINE Bus STARTING 2024-04-20T21:48:12.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:11 smithi142 ceph-mon[15828]: [20/Apr/2024:21:48:10] ENGINE Serving on https://172.21.15.142:7150 2024-04-20T21:48:12.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:11 smithi142 ceph-mon[15828]: [20/Apr/2024:21:48:10] ENGINE Serving on http://172.21.15.142:8765 2024-04-20T21:48:12.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:11 smithi142 ceph-mon[15828]: [20/Apr/2024:21:48:10] ENGINE Bus STARTED 2024-04-20T21:48:12.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:11 smithi142 ceph-mon[15828]: mgrmap e16: smithi142.zzmcfz(active, since 1.00757s) 2024-04-20T21:48:12.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:12 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:12.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:12 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:14.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.116+0000 7fdad7200700 1 -- 172.21.15.164:0/3423311752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdad0100850 msgr2=0x7fdad0100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:14.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.116+0000 7fdad7200700 1 --2- 172.21.15.164:0/3423311752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdad0100850 0x7fdad0100c70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdac0009910 tx=0x7fdac0009c20 comp rx=0 tx=0).stop 2024-04-20T21:48:14.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.116+0000 7fdad7200700 1 -- 172.21.15.164:0/3423311752 shutdown_connections 2024-04-20T21:48:14.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.116+0000 7fdad7200700 1 --2- 172.21.15.164:0/3423311752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdad0100850 0x7fdad0100c70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:14.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.116+0000 7fdad7200700 1 -- 172.21.15.164:0/3423311752 >> 172.21.15.164:0/3423311752 conn(0x7fdad00fbe30 msgr2=0x7fdad00fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:14.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.116+0000 7fdad7200700 1 -- 172.21.15.164:0/3423311752 shutdown_connections 2024-04-20T21:48:14.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.116+0000 7fdad7200700 1 -- 172.21.15.164:0/3423311752 wait complete. 2024-04-20T21:48:14.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.117+0000 7fdad7200700 1 Processor -- start 2024-04-20T21:48:14.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.118+0000 7fdad7200700 1 -- start start 2024-04-20T21:48:14.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.118+0000 7fdad7200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdad0100850 0x7fdad0197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:14.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.118+0000 7fdad7200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad0198460 con 0x7fdad0100850 2024-04-20T21:48:14.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.118+0000 7fdacfe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdad0100850 0x7fdad0197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:14.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.118+0000 7fdacfe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdad0100850 0x7fdad0197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.164:35534/0 (socket says 172.21.15.164:35534) 2024-04-20T21:48:14.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.118+0000 7fdacfe00700 1 -- 172.21.15.164:0/114274810 learned_addr learned my addr 172.21.15.164:0/114274810 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:48:14.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.119+0000 7fdacfe00700 1 -- 172.21.15.164:0/114274810 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac00095f0 con 0x7fdad0100850 2024-04-20T21:48:14.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.119+0000 7fdacfe00700 1 --2- 172.21.15.164:0/114274810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdad0100850 0x7fdad0197f20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdac0006010 tx=0x7fdac00050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:14.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.119+0000 7fdaccc00700 1 -- 172.21.15.164:0/114274810 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdac001d070 con 0x7fdad0100850 2024-04-20T21:48:14.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.119+0000 7fdaccc00700 1 -- 172.21.15.164:0/114274810 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdac000be20 con 0x7fdad0100850 2024-04-20T21:48:14.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.120+0000 7fdad7200700 1 -- 172.21.15.164:0/114274810 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad0198660 con 0x7fdad0100850 2024-04-20T21:48:14.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.120+0000 7fdaccc00700 1 -- 172.21.15.164:0/114274810 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdac0022de0 con 0x7fdad0100850 2024-04-20T21:48:14.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.120+0000 7fdad7200700 1 -- 172.21.15.164:0/114274810 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad0198b00 con 0x7fdad0100850 2024-04-20T21:48:14.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.121+0000 7fdaccc00700 1 -- 172.21.15.164:0/114274810 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 45671+0+0 (secure 0 0 0) 0x7fdac000b960 con 0x7fdad0100850 2024-04-20T21:48:14.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.121+0000 7fdad7200700 1 -- 172.21.15.164:0/114274810 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad0191a80 con 0x7fdad0100850 2024-04-20T21:48:14.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.121+0000 7fdaccc00700 1 --2- 172.21.15.164:0/114274810 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fdab4038910 0x7fdab403add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:14.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.121+0000 7fdaccc00700 1 -- 172.21.15.164:0/114274810 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fdac004cbd0 con 0x7fdad0100850 2024-04-20T21:48:14.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.122+0000 7fdacf400700 1 --2- 172.21.15.164:0/114274810 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fdab4038910 0x7fdab403add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:14.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.122+0000 7fdacf400700 1 --2- 172.21.15.164:0/114274810 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fdab4038910 0x7fdab403add0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdabc006fd0 tx=0x7fdabc006e40 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:14.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.127+0000 7fdaccc00700 1 -- 172.21.15.164:0/114274810 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fdac002bd40 con 0x7fdad0100850 2024-04-20T21:48:14.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:13 smithi142 ceph-mon[15828]: mgrmap e17: smithi142.zzmcfz(active, since 2s) 2024-04-20T21:48:14.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.449+0000 7fdad7200700 1 -- 172.21.15.164:0/114274810 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdad002cd40 con 0x7fdad0100850 2024-04-20T21:48:14.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.451+0000 7fdaccc00700 1 -- 172.21.15.164:0/114274810 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fdac0027030 con 0x7fdad0100850 2024-04-20T21:48:14.450 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:48:14.450 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":1,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","modified":"2024-04-20T21:45:23.189616Z","created":"2024-04-20T21:45:23.189616Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-20T21:48:14.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.454+0000 7fdad7200700 1 -- 172.21.15.164:0/114274810 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fdab4038910 msgr2=0x7fdab403add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:14.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.454+0000 7fdad7200700 1 --2- 172.21.15.164:0/114274810 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fdab4038910 0x7fdab403add0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdabc006fd0 tx=0x7fdabc006e40 comp rx=0 tx=0).stop 2024-04-20T21:48:14.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.454+0000 7fdad7200700 1 -- 172.21.15.164:0/114274810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdad0100850 msgr2=0x7fdad0197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:14.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.454+0000 7fdad7200700 1 --2- 172.21.15.164:0/114274810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdad0100850 0x7fdad0197f20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdac0006010 tx=0x7fdac00050b0 comp rx=0 tx=0).stop 2024-04-20T21:48:14.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.454+0000 7fdad7200700 1 -- 172.21.15.164:0/114274810 shutdown_connections 2024-04-20T21:48:14.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.454+0000 7fdad7200700 1 --2- 172.21.15.164:0/114274810 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fdab4038910 0x7fdab403add0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:14.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.454+0000 7fdad7200700 1 --2- 172.21.15.164:0/114274810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdad0100850 0x7fdad0197f20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:14.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.454+0000 7fdad7200700 1 -- 172.21.15.164:0/114274810 >> 172.21.15.164:0/114274810 conn(0x7fdad00fbe30 msgr2=0x7fdad00fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:14.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.454+0000 7fdad7200700 1 -- 172.21.15.164:0/114274810 shutdown_connections 2024-04-20T21:48:14.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:14.454+0000 7fdad7200700 1 -- 172.21.15.164:0/114274810 wait complete. 2024-04-20T21:48:14.454 INFO:teuthology.orchestra.run.smithi164.stderr:dumped monmap epoch 1 2024-04-20T21:48:15.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:15 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:15.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:15 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/114274810' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T21:48:16.146 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-20T21:48:16.146 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-20T21:48:17.000 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:48:17.128 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-20T21:48:18.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:18 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:18.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:18 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:19.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.716+0000 7fe8fe400700 1 -- 172.21.15.164:0/3230340292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8f80ff120 msgr2=0x7fe8f80ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:19.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.716+0000 7fe8fe400700 1 --2- 172.21.15.164:0/3230340292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8f80ff120 0x7fe8f80ff540 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8009910 tx=0x7fe8e8009c20 comp rx=0 tx=0).stop 2024-04-20T21:48:19.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.716+0000 7fe8fe400700 1 -- 172.21.15.164:0/3230340292 shutdown_connections 2024-04-20T21:48:19.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.716+0000 7fe8fe400700 1 --2- 172.21.15.164:0/3230340292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8f80ff120 0x7fe8f80ff540 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:19.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.716+0000 7fe8fe400700 1 -- 172.21.15.164:0/3230340292 >> 172.21.15.164:0/3230340292 conn(0x7fe8f80fad00 msgr2=0x7fe8f80fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:19.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.717+0000 7fe8fe400700 1 -- 172.21.15.164:0/3230340292 shutdown_connections 2024-04-20T21:48:19.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.717+0000 7fe8fe400700 1 -- 172.21.15.164:0/3230340292 wait complete. 2024-04-20T21:48:19.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.718+0000 7fe8fe400700 1 Processor -- start 2024-04-20T21:48:19.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.718+0000 7fe8fe400700 1 -- start start 2024-04-20T21:48:19.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.718+0000 7fe8fe400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8f80ff120 0x7fe8f8197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:19.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.718+0000 7fe8fe400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f8198400 con 0x7fe8f80ff120 2024-04-20T21:48:19.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.719+0000 7fe8f7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8f80ff120 0x7fe8f8197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:19.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.719+0000 7fe8f7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8f80ff120 0x7fe8f8197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.164:43826/0 (socket says 172.21.15.164:43826) 2024-04-20T21:48:19.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.719+0000 7fe8f7400700 1 -- 172.21.15.164:0/3870147535 learned_addr learned my addr 172.21.15.164:0/3870147535 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:48:19.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.719+0000 7fe8f7400700 1 -- 172.21.15.164:0/3870147535 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80095f0 con 0x7fe8f80ff120 2024-04-20T21:48:19.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.720+0000 7fe8f7400700 1 --2- 172.21.15.164:0/3870147535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8f80ff120 0x7fe8f8197ec0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8009ed0 tx=0x7fe8e8004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:19.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.720+0000 7fe8efe00700 1 -- 172.21.15.164:0/3870147535 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8e801d070 con 0x7fe8f80ff120 2024-04-20T21:48:19.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.720+0000 7fe8efe00700 1 -- 172.21.15.164:0/3870147535 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8e800be20 con 0x7fe8f80ff120 2024-04-20T21:48:19.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.720+0000 7fe8fe400700 1 -- 172.21.15.164:0/3870147535 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f8198600 con 0x7fe8f80ff120 2024-04-20T21:48:19.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.720+0000 7fe8efe00700 1 -- 172.21.15.164:0/3870147535 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8e800f460 con 0x7fe8f80ff120 2024-04-20T21:48:19.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.720+0000 7fe8fe400700 1 -- 172.21.15.164:0/3870147535 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f8198aa0 con 0x7fe8f80ff120 2024-04-20T21:48:19.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.722+0000 7fe8efe00700 1 -- 172.21.15.164:0/3870147535 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 45671+0+0 (secure 0 0 0) 0x7fe8e800f5c0 con 0x7fe8f80ff120 2024-04-20T21:48:19.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.722+0000 7fe8efe00700 1 --2- 172.21.15.164:0/3870147535 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fe8dc038910 0x7fe8dc03add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:19.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.722+0000 7fe8efe00700 1 -- 172.21.15.164:0/3870147535 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fe8e804caf0 con 0x7fe8f80ff120 2024-04-20T21:48:19.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.722+0000 7fe8fe400700 1 -- 172.21.15.164:0/3870147535 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f8191880 con 0x7fe8f80ff120 2024-04-20T21:48:19.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.723+0000 7fe8f6a00700 1 --2- 172.21.15.164:0/3870147535 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fe8dc038910 0x7fe8dc03add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:19.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.724+0000 7fe8f6a00700 1 --2- 172.21.15.164:0/3870147535 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fe8dc038910 0x7fe8dc03add0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4006fd0 tx=0x7fe8e4006e40 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:19.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:19.729+0000 7fe8efe00700 1 -- 172.21.15.164:0/3870147535 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fe8e8027070 con 0x7fe8f80ff120 2024-04-20T21:48:20.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:20.039+0000 7fe8fe400700 1 -- 172.21.15.164:0/3870147535 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe8f8062510 con 0x7fe8f80ff120 2024-04-20T21:48:20.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:20.040+0000 7fe8efe00700 1 -- 172.21.15.164:0/3870147535 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fe8e802c440 con 0x7fe8f80ff120 2024-04-20T21:48:20.039 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:48:20.039 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":1,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","modified":"2024-04-20T21:45:23.189616Z","created":"2024-04-20T21:45:23.189616Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-20T21:48:20.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:20.044+0000 7fe8fe400700 1 -- 172.21.15.164:0/3870147535 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fe8dc038910 msgr2=0x7fe8dc03add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:20.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:20.044+0000 7fe8fe400700 1 --2- 172.21.15.164:0/3870147535 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fe8dc038910 0x7fe8dc03add0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4006fd0 tx=0x7fe8e4006e40 comp rx=0 tx=0).stop 2024-04-20T21:48:20.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:20.044+0000 7fe8fe400700 1 -- 172.21.15.164:0/3870147535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8f80ff120 msgr2=0x7fe8f8197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:20.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:20.044+0000 7fe8fe400700 1 --2- 172.21.15.164:0/3870147535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8f80ff120 0x7fe8f8197ec0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8009ed0 tx=0x7fe8e8004690 comp rx=0 tx=0).stop 2024-04-20T21:48:20.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:20.044+0000 7fe8fe400700 1 -- 172.21.15.164:0/3870147535 shutdown_connections 2024-04-20T21:48:20.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:20.044+0000 7fe8fe400700 1 --2- 172.21.15.164:0/3870147535 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fe8dc038910 0x7fe8dc03add0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:20.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:20.044+0000 7fe8fe400700 1 --2- 172.21.15.164:0/3870147535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8f80ff120 0x7fe8f8197ec0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:20.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:20.044+0000 7fe8fe400700 1 -- 172.21.15.164:0/3870147535 >> 172.21.15.164:0/3870147535 conn(0x7fe8f80fad00 msgr2=0x7fe8f80fb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:20.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:20.044+0000 7fe8fe400700 1 -- 172.21.15.164:0/3870147535 shutdown_connections 2024-04-20T21:48:20.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:20.044+0000 7fe8fe400700 1 -- 172.21.15.164:0/3870147535 wait complete. 2024-04-20T21:48:20.044 INFO:teuthology.orchestra.run.smithi164.stderr:dumped monmap epoch 1 2024-04-20T21:48:20.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:20 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:20.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:20 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:20.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:20 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:20.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:20 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:20.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:20 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi164", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:48:20.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:20 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:20 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:20 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:48:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:20 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:48:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:20 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:48:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:20 smithi142 ceph-mon[15828]: Updating smithi142:/etc/ceph/ceph.conf 2024-04-20T21:48:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:20 smithi142 ceph-mon[15828]: Updating smithi164:/etc/ceph/ceph.conf 2024-04-20T21:48:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:20 smithi142 ceph-mon[15828]: Updating smithi164:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T21:48:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:20 smithi142 ceph-mon[15828]: Updating smithi142:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T21:48:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:20 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/3870147535' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T21:48:21.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:21 smithi142 ceph-mon[15828]: Updating smithi164:/etc/ceph/ceph.client.admin.keyring 2024-04-20T21:48:21.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:21 smithi142 ceph-mon[15828]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-04-20T21:48:21.869 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-20T21:48:21.870 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-20T21:48:22.212 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T21:48:23.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:23 smithi142 ceph-mon[15828]: Updating smithi164:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T21:48:23.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:23 smithi142 ceph-mon[15828]: Updating smithi142:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T21:48:23.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:23 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:23.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:23 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:23.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:23 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:23.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:23 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:23.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:23 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:23.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:23 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi164", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-20T21:48:23.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:23 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi164", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-20T21:48:23.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:23 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:48:24.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.400+0000 7fbe44e00700 1 -- 172.21.15.164:0/1955247945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe40108a20 msgr2=0x7fbe40108e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:24.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.400+0000 7fbe44e00700 1 --2- 172.21.15.164:0/1955247945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe40108a20 0x7fbe40108e00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbe30009910 tx=0x7fbe30009c20 comp rx=0 tx=0).stop 2024-04-20T21:48:24.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.400+0000 7fbe44e00700 1 -- 172.21.15.164:0/1955247945 shutdown_connections 2024-04-20T21:48:24.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.400+0000 7fbe44e00700 1 --2- 172.21.15.164:0/1955247945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe40108a20 0x7fbe40108e00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:24.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.400+0000 7fbe44e00700 1 -- 172.21.15.164:0/1955247945 >> 172.21.15.164:0/1955247945 conn(0x7fbe400fe530 msgr2=0x7fbe40100950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:24.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.400+0000 7fbe44e00700 1 -- 172.21.15.164:0/1955247945 shutdown_connections 2024-04-20T21:48:24.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.400+0000 7fbe44e00700 1 -- 172.21.15.164:0/1955247945 wait complete. 2024-04-20T21:48:24.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.401+0000 7fbe44e00700 1 Processor -- start 2024-04-20T21:48:24.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.401+0000 7fbe44e00700 1 -- start start 2024-04-20T21:48:24.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.402+0000 7fbe44e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe40108a20 0x7fbe401985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:24.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.402+0000 7fbe44e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe40198b20 con 0x7fbe40108a20 2024-04-20T21:48:24.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.402+0000 7fbe3de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe40108a20 0x7fbe401985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:24.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.402+0000 7fbe3de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe40108a20 0x7fbe401985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.164:43858/0 (socket says 172.21.15.164:43858) 2024-04-20T21:48:24.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.402+0000 7fbe3de00700 1 -- 172.21.15.164:0/351466519 learned_addr learned my addr 172.21.15.164:0/351466519 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:48:24.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.403+0000 7fbe3de00700 1 -- 172.21.15.164:0/351466519 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe300095f0 con 0x7fbe40108a20 2024-04-20T21:48:24.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.403+0000 7fbe3de00700 1 --2- 172.21.15.164:0/351466519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe40108a20 0x7fbe401985e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbe30005490 tx=0x7fbe30005570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:24.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.404+0000 7fbe36a00700 1 -- 172.21.15.164:0/351466519 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe3001d070 con 0x7fbe40108a20 2024-04-20T21:48:24.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.404+0000 7fbe44e00700 1 -- 172.21.15.164:0/351466519 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe40198d80 con 0x7fbe40108a20 2024-04-20T21:48:24.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.404+0000 7fbe36a00700 1 -- 172.21.15.164:0/351466519 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe30005700 con 0x7fbe40108a20 2024-04-20T21:48:24.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.404+0000 7fbe36a00700 1 -- 172.21.15.164:0/351466519 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe300038e0 con 0x7fbe40108a20 2024-04-20T21:48:24.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.404+0000 7fbe44e00700 1 -- 172.21.15.164:0/351466519 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe40199200 con 0x7fbe40108a20 2024-04-20T21:48:24.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.405+0000 7fbe44e00700 1 -- 172.21.15.164:0/351466519 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe40104160 con 0x7fbe40108a20 2024-04-20T21:48:24.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.405+0000 7fbe36a00700 1 -- 172.21.15.164:0/351466519 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 45671+0+0 (secure 0 0 0) 0x7fbe30003b50 con 0x7fbe40108a20 2024-04-20T21:48:24.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.406+0000 7fbe36a00700 1 --2- 172.21.15.164:0/351466519 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fbe24038910 0x7fbe2403add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:24.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.406+0000 7fbe36a00700 1 -- 172.21.15.164:0/351466519 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fbe3004c570 con 0x7fbe40108a20 2024-04-20T21:48:24.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.407+0000 7fbe3d400700 1 --2- 172.21.15.164:0/351466519 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fbe24038910 0x7fbe2403add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:24.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.407+0000 7fbe3d400700 1 --2- 172.21.15.164:0/351466519 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fbe24038910 0x7fbe2403add0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c006fd0 tx=0x7fbe2c006e40 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:24.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.423+0000 7fbe36a00700 1 -- 172.21.15.164:0/351466519 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fbe3002a590 con 0x7fbe40108a20 2024-04-20T21:48:24.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:24 smithi142 ceph-mon[15828]: Deploying daemon ceph-exporter.smithi164 on smithi164 2024-04-20T21:48:24.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.731+0000 7fbe44e00700 1 -- 172.21.15.164:0/351466519 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbe40062510 con 0x7fbe40108a20 2024-04-20T21:48:24.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.732+0000 7fbe36a00700 1 -- 172.21.15.164:0/351466519 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fbe30026070 con 0x7fbe40108a20 2024-04-20T21:48:24.731 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:48:24.731 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":1,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","modified":"2024-04-20T21:45:23.189616Z","created":"2024-04-20T21:45:23.189616Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-20T21:48:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.735+0000 7fbe44e00700 1 -- 172.21.15.164:0/351466519 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fbe24038910 msgr2=0x7fbe2403add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.735+0000 7fbe44e00700 1 --2- 172.21.15.164:0/351466519 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fbe24038910 0x7fbe2403add0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c006fd0 tx=0x7fbe2c006e40 comp rx=0 tx=0).stop 2024-04-20T21:48:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.735+0000 7fbe44e00700 1 -- 172.21.15.164:0/351466519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe40108a20 msgr2=0x7fbe401985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.735+0000 7fbe44e00700 1 --2- 172.21.15.164:0/351466519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe40108a20 0x7fbe401985e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbe30005490 tx=0x7fbe30005570 comp rx=0 tx=0).stop 2024-04-20T21:48:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.735+0000 7fbe44e00700 1 -- 172.21.15.164:0/351466519 shutdown_connections 2024-04-20T21:48:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.735+0000 7fbe44e00700 1 --2- 172.21.15.164:0/351466519 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fbe24038910 0x7fbe2403add0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.735+0000 7fbe44e00700 1 --2- 172.21.15.164:0/351466519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe40108a20 0x7fbe401985e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.735+0000 7fbe44e00700 1 -- 172.21.15.164:0/351466519 >> 172.21.15.164:0/351466519 conn(0x7fbe400fe530 msgr2=0x7fbe4010a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.735+0000 7fbe44e00700 1 -- 172.21.15.164:0/351466519 shutdown_connections 2024-04-20T21:48:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:24.735+0000 7fbe44e00700 1 -- 172.21.15.164:0/351466519 wait complete. 2024-04-20T21:48:24.736 INFO:teuthology.orchestra.run.smithi164.stderr:dumped monmap epoch 1 2024-04-20T21:48:25.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:25 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/351466519' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T21:48:26.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:26 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:48:26.983 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-20T21:48:26.983 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-20T21:48:27.709 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T21:48:29.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:28 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:29.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:28 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:29.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:28 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:29.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:28 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:29.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:28 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi164", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-20T21:48:29.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:28 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi164", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-20T21:48:29.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:28 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:48:29.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:28 smithi142 ceph-mon[15828]: Deploying daemon crash.smithi164 on smithi164 2024-04-20T21:48:30.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.239+0000 7f9bee600700 1 -- 172.21.15.164:0/9354041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be8107080 msgr2=0x7f9be8107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:30.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.239+0000 7f9bee600700 1 --2- 172.21.15.164:0/9354041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be8107080 0x7f9be8107460 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009910 tx=0x7f9bd8009c20 comp rx=0 tx=0).stop 2024-04-20T21:48:30.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.240+0000 7f9bee600700 1 -- 172.21.15.164:0/9354041 shutdown_connections 2024-04-20T21:48:30.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.240+0000 7f9bee600700 1 --2- 172.21.15.164:0/9354041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be8107080 0x7f9be8107460 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:30.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.240+0000 7f9bee600700 1 -- 172.21.15.164:0/9354041 >> 172.21.15.164:0/9354041 conn(0x7f9be80765d0 msgr2=0x7f9be80789f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:30.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.240+0000 7f9bee600700 1 -- 172.21.15.164:0/9354041 shutdown_connections 2024-04-20T21:48:30.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.240+0000 7f9bee600700 1 -- 172.21.15.164:0/9354041 wait complete. 2024-04-20T21:48:30.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.241+0000 7f9bee600700 1 Processor -- start 2024-04-20T21:48:30.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.241+0000 7f9bee600700 1 -- start start 2024-04-20T21:48:30.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.242+0000 7f9bee600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be8107080 0x7f9be819c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:30.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.242+0000 7f9bee600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be819cca0 con 0x7f9be8107080 2024-04-20T21:48:30.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.242+0000 7f9be7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be8107080 0x7f9be819c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:30.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.242+0000 7f9be7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be8107080 0x7f9be819c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.164:40468/0 (socket says 172.21.15.164:40468) 2024-04-20T21:48:30.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.242+0000 7f9be7400700 1 -- 172.21.15.164:0/1304762391 learned_addr learned my addr 172.21.15.164:0/1304762391 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:48:30.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.243+0000 7f9be7400700 1 -- 172.21.15.164:0/1304762391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd80095f0 con 0x7f9be8107080 2024-04-20T21:48:30.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.243+0000 7f9be7400700 1 --2- 172.21.15.164:0/1304762391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be8107080 0x7f9be819c760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80098e0 tx=0x7f9bd8005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:30.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.244+0000 7f9bdfe00700 1 -- 172.21.15.164:0/1304762391 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bd801d070 con 0x7f9be8107080 2024-04-20T21:48:30.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.244+0000 7f9bdfe00700 1 -- 172.21.15.164:0/1304762391 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9bd80056b0 con 0x7f9be8107080 2024-04-20T21:48:30.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.244+0000 7f9bee600700 1 -- 172.21.15.164:0/1304762391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be819cea0 con 0x7f9be8107080 2024-04-20T21:48:30.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.244+0000 7f9bdfe00700 1 -- 172.21.15.164:0/1304762391 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9bd8022d80 con 0x7f9be8107080 2024-04-20T21:48:30.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.244+0000 7f9bee600700 1 -- 172.21.15.164:0/1304762391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be819d2c0 con 0x7f9be8107080 2024-04-20T21:48:30.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.245+0000 7f9bee600700 1 -- 172.21.15.164:0/1304762391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be8108560 con 0x7f9be8107080 2024-04-20T21:48:30.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.246+0000 7f9bdfe00700 1 -- 172.21.15.164:0/1304762391 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 45671+0+0 (secure 0 0 0) 0x7f9bd8022470 con 0x7f9be8107080 2024-04-20T21:48:30.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.247+0000 7f9bdfe00700 1 --2- 172.21.15.164:0/1304762391 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f9bcc038900 0x7f9bcc03adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:30.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.247+0000 7f9bdfe00700 1 -- 172.21.15.164:0/1304762391 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f9bd804caa0 con 0x7f9be8107080 2024-04-20T21:48:30.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.247+0000 7f9be6a00700 1 --2- 172.21.15.164:0/1304762391 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f9bcc038900 0x7f9bcc03adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:30.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.249+0000 7f9be6a00700 1 --2- 172.21.15.164:0/1304762391 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f9bcc038900 0x7f9bcc03adc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4006fd0 tx=0x7f9bd4006e40 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:30.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.262+0000 7f9bdfe00700 1 -- 172.21.15.164:0/1304762391 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f9bd800ebd0 con 0x7f9be8107080 2024-04-20T21:48:30.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.567+0000 7f9bee600700 1 -- 172.21.15.164:0/1304762391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9be819dbc0 con 0x7f9be8107080 2024-04-20T21:48:30.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.568+0000 7f9bdfe00700 1 -- 172.21.15.164:0/1304762391 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f9bd8027030 con 0x7f9be8107080 2024-04-20T21:48:30.567 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:48:30.567 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":1,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","modified":"2024-04-20T21:45:23.189616Z","created":"2024-04-20T21:45:23.189616Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-20T21:48:30.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.571+0000 7f9bee600700 1 -- 172.21.15.164:0/1304762391 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f9bcc038900 msgr2=0x7f9bcc03adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:30.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.571+0000 7f9bee600700 1 --2- 172.21.15.164:0/1304762391 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f9bcc038900 0x7f9bcc03adc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4006fd0 tx=0x7f9bd4006e40 comp rx=0 tx=0).stop 2024-04-20T21:48:30.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.571+0000 7f9bee600700 1 -- 172.21.15.164:0/1304762391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be8107080 msgr2=0x7f9be819c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:30.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.571+0000 7f9bee600700 1 --2- 172.21.15.164:0/1304762391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be8107080 0x7f9be819c760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9bd80098e0 tx=0x7f9bd8005520 comp rx=0 tx=0).stop 2024-04-20T21:48:30.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.571+0000 7f9bee600700 1 -- 172.21.15.164:0/1304762391 shutdown_connections 2024-04-20T21:48:30.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.571+0000 7f9bee600700 1 --2- 172.21.15.164:0/1304762391 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f9bcc038900 0x7f9bcc03adc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:30.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.571+0000 7f9bee600700 1 --2- 172.21.15.164:0/1304762391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9be8107080 0x7f9be819c760 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:30.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.571+0000 7f9bee600700 1 -- 172.21.15.164:0/1304762391 >> 172.21.15.164:0/1304762391 conn(0x7f9be80765d0 msgr2=0x7f9be8108a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:30.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.571+0000 7f9bee600700 1 -- 172.21.15.164:0/1304762391 shutdown_connections 2024-04-20T21:48:30.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:30.571+0000 7f9bee600700 1 -- 172.21.15.164:0/1304762391 wait complete. 2024-04-20T21:48:30.571 INFO:teuthology.orchestra.run.smithi164.stderr:dumped monmap epoch 1 2024-04-20T21:48:31.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:30 smithi142 ceph-mon[15828]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:31.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:30 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:31.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:30 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/1304762391' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T21:48:32.603 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-20T21:48:32.604 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-20T21:48:32.991 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T21:48:33.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:32 smithi142 ceph-mon[15828]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:33.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:32 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:33.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:32 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:33.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:32 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:33.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:32 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:34.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:33 smithi142 ceph-mon[15828]: Deploying daemon node-exporter.smithi164 on smithi164 2024-04-20T21:48:35.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.265+0000 7fc987200700 1 -- 172.21.15.164:0/449591940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc988108810 msgr2=0x7fc988108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:35.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.265+0000 7fc987200700 1 --2- 172.21.15.164:0/449591940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc988108810 0x7fc988108bf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc978009910 tx=0x7fc978009c20 comp rx=0 tx=0).stop 2024-04-20T21:48:35.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.265+0000 7fc987200700 1 -- 172.21.15.164:0/449591940 shutdown_connections 2024-04-20T21:48:35.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.265+0000 7fc987200700 1 --2- 172.21.15.164:0/449591940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc988108810 0x7fc988108bf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:35.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.265+0000 7fc987200700 1 -- 172.21.15.164:0/449591940 >> 172.21.15.164:0/449591940 conn(0x7fc9880fe300 msgr2=0x7fc988100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:35.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.266+0000 7fc987200700 1 -- 172.21.15.164:0/449591940 shutdown_connections 2024-04-20T21:48:35.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.266+0000 7fc987200700 1 -- 172.21.15.164:0/449591940 wait complete. 2024-04-20T21:48:35.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.267+0000 7fc987200700 1 Processor -- start 2024-04-20T21:48:35.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.267+0000 7fc987200700 1 -- start start 2024-04-20T21:48:35.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.267+0000 7fc987200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc988108810 0x7fc988198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:35.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.267+0000 7fc987200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc988198660 con 0x7fc988108810 2024-04-20T21:48:35.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.268+0000 7fc985e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc988108810 0x7fc988198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:35.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.268+0000 7fc985e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc988108810 0x7fc988198120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.164:40494/0 (socket says 172.21.15.164:40494) 2024-04-20T21:48:35.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.268+0000 7fc985e00700 1 -- 172.21.15.164:0/1955506468 learned_addr learned my addr 172.21.15.164:0/1955506468 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:48:35.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.269+0000 7fc985e00700 1 -- 172.21.15.164:0/1955506468 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9780095f0 con 0x7fc988108810 2024-04-20T21:48:35.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.269+0000 7fc985e00700 1 --2- 172.21.15.164:0/1955506468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc988108810 0x7fc988198120 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc9780098e0 tx=0x7fc978005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:35.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.270+0000 7fc97ea00700 1 -- 172.21.15.164:0/1955506468 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc97801d070 con 0x7fc988108810 2024-04-20T21:48:35.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.270+0000 7fc987200700 1 -- 172.21.15.164:0/1955506468 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9881988c0 con 0x7fc988108810 2024-04-20T21:48:35.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.270+0000 7fc97ea00700 1 -- 172.21.15.164:0/1955506468 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9780056b0 con 0x7fc988108810 2024-04-20T21:48:35.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.270+0000 7fc97ea00700 1 -- 172.21.15.164:0/1955506468 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc978022d80 con 0x7fc988108810 2024-04-20T21:48:35.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.270+0000 7fc987200700 1 -- 172.21.15.164:0/1955506468 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc988198d40 con 0x7fc988108810 2024-04-20T21:48:35.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.271+0000 7fc987200700 1 -- 172.21.15.164:0/1955506468 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc988103f50 con 0x7fc988108810 2024-04-20T21:48:35.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.271+0000 7fc97ea00700 1 -- 172.21.15.164:0/1955506468 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 45671+0+0 (secure 0 0 0) 0x7fc978022470 con 0x7fc988108810 2024-04-20T21:48:35.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.272+0000 7fc97ea00700 1 --2- 172.21.15.164:0/1955506468 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc96c038900 0x7fc96c03adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:35.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.272+0000 7fc97ea00700 1 -- 172.21.15.164:0/1955506468 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fc97804c9d0 con 0x7fc988108810 2024-04-20T21:48:35.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.272+0000 7fc985400700 1 --2- 172.21.15.164:0/1955506468 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc96c038900 0x7fc96c03adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:35.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.274+0000 7fc985400700 1 --2- 172.21.15.164:0/1955506468 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc96c038900 0x7fc96c03adc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc974006fd0 tx=0x7fc974006e40 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:35.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.288+0000 7fc97ea00700 1 -- 172.21.15.164:0/1955506468 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fc97802b590 con 0x7fc988108810 2024-04-20T21:48:35.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:34 smithi142 ceph-mon[15828]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:35.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.646+0000 7fc987200700 1 -- 172.21.15.164:0/1955506468 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc98810cc00 con 0x7fc988108810 2024-04-20T21:48:35.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.647+0000 7fc97ea00700 1 -- 172.21.15.164:0/1955506468 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fc978027030 con 0x7fc988108810 2024-04-20T21:48:35.646 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:48:35.646 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":1,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","modified":"2024-04-20T21:45:23.189616Z","created":"2024-04-20T21:45:23.189616Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-20T21:48:35.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.650+0000 7fc987200700 1 -- 172.21.15.164:0/1955506468 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc96c038900 msgr2=0x7fc96c03adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:35.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.650+0000 7fc987200700 1 --2- 172.21.15.164:0/1955506468 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc96c038900 0x7fc96c03adc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc974006fd0 tx=0x7fc974006e40 comp rx=0 tx=0).stop 2024-04-20T21:48:35.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.650+0000 7fc987200700 1 -- 172.21.15.164:0/1955506468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc988108810 msgr2=0x7fc988198120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:35.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.650+0000 7fc987200700 1 --2- 172.21.15.164:0/1955506468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc988108810 0x7fc988198120 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc9780098e0 tx=0x7fc978005520 comp rx=0 tx=0).stop 2024-04-20T21:48:35.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.651+0000 7fc987200700 1 -- 172.21.15.164:0/1955506468 shutdown_connections 2024-04-20T21:48:35.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.651+0000 7fc987200700 1 --2- 172.21.15.164:0/1955506468 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc96c038900 0x7fc96c03adc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:35.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.651+0000 7fc987200700 1 --2- 172.21.15.164:0/1955506468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc988108810 0x7fc988198120 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:35.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.651+0000 7fc987200700 1 -- 172.21.15.164:0/1955506468 >> 172.21.15.164:0/1955506468 conn(0x7fc9880fe300 msgr2=0x7fc98810a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:35.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.651+0000 7fc987200700 1 -- 172.21.15.164:0/1955506468 shutdown_connections 2024-04-20T21:48:35.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:35.651+0000 7fc987200700 1 -- 172.21.15.164:0/1955506468 wait complete. 2024-04-20T21:48:35.651 INFO:teuthology.orchestra.run.smithi164.stderr:dumped monmap epoch 1 2024-04-20T21:48:36.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:36 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:36.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:36 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/1955506468' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T21:48:36.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:36 smithi142 ceph-mon[15828]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:38.134 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-20T21:48:38.135 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-20T21:48:38.577 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T21:48:39.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:38 smithi142 ceph-mon[15828]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:39.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:38 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:39.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:38 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:39.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:38 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:39.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:38 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:39.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:38 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi164.oejajr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T21:48:39.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:38 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi164.oejajr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-20T21:48:39.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:38 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T21:48:39.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:38 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:48:40.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:39 smithi142 ceph-mon[15828]: Deploying daemon mgr.smithi164.oejajr on smithi164 2024-04-20T21:48:41.265 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:40 smithi142 ceph-mon[15828]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:41.265 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:40 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:48:41.266 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:40 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:41.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.488+0000 7faeffa00700 1 -- 172.21.15.164:0/904105762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faef810be10 msgr2=0x7faef810c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:41.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.488+0000 7faeffa00700 1 --2- 172.21.15.164:0/904105762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faef810be10 0x7faef810c1f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faeec009910 tx=0x7faeec009c20 comp rx=0 tx=0).stop 2024-04-20T21:48:41.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.488+0000 7faeffa00700 1 -- 172.21.15.164:0/904105762 shutdown_connections 2024-04-20T21:48:41.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.488+0000 7faeffa00700 1 --2- 172.21.15.164:0/904105762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faef810be10 0x7faef810c1f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:41.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.488+0000 7faeffa00700 1 -- 172.21.15.164:0/904105762 >> 172.21.15.164:0/904105762 conn(0x7faef8076690 msgr2=0x7faef8078ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:41.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.488+0000 7faeffa00700 1 -- 172.21.15.164:0/904105762 shutdown_connections 2024-04-20T21:48:41.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.488+0000 7faeffa00700 1 -- 172.21.15.164:0/904105762 wait complete. 2024-04-20T21:48:41.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.489+0000 7faeffa00700 1 Processor -- start 2024-04-20T21:48:41.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.490+0000 7faeffa00700 1 -- start start 2024-04-20T21:48:41.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.490+0000 7faeffa00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faef810be10 0x7faef819c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:41.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.490+0000 7faeffa00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef819cd10 con 0x7faef810be10 2024-04-20T21:48:41.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.491+0000 7faefd000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faef810be10 0x7faef819c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:41.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.491+0000 7faefd000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faef810be10 0x7faef819c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.164:43058/0 (socket says 172.21.15.164:43058) 2024-04-20T21:48:41.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.491+0000 7faefd000700 1 -- 172.21.15.164:0/2850956480 learned_addr learned my addr 172.21.15.164:0/2850956480 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:48:41.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.491+0000 7faefd000700 1 -- 172.21.15.164:0/2850956480 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec0095f0 con 0x7faef810be10 2024-04-20T21:48:41.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.492+0000 7faefd000700 1 --2- 172.21.15.164:0/2850956480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faef810be10 0x7faef819c7d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faeec005490 tx=0x7faeec005570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:41.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.492+0000 7faef5600700 1 -- 172.21.15.164:0/2850956480 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faeec01d070 con 0x7faef810be10 2024-04-20T21:48:41.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.492+0000 7faeffa00700 1 -- 172.21.15.164:0/2850956480 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef819cf70 con 0x7faef810be10 2024-04-20T21:48:41.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.492+0000 7faef5600700 1 -- 172.21.15.164:0/2850956480 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faeec0056c0 con 0x7faef810be10 2024-04-20T21:48:41.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.492+0000 7faeffa00700 1 -- 172.21.15.164:0/2850956480 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef819d3f0 con 0x7faef810be10 2024-04-20T21:48:41.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.492+0000 7faef5600700 1 -- 172.21.15.164:0/2850956480 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faeec003830 con 0x7faef810be10 2024-04-20T21:48:41.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.494+0000 7faeffa00700 1 -- 172.21.15.164:0/2850956480 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef810de90 con 0x7faef810be10 2024-04-20T21:48:41.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.494+0000 7faef5600700 1 -- 172.21.15.164:0/2850956480 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 45671+0+0 (secure 0 0 0) 0x7faeec00b6f0 con 0x7faef810be10 2024-04-20T21:48:41.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.494+0000 7faef5600700 1 --2- 172.21.15.164:0/2850956480 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7faee0038900 0x7faee003adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:41.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.494+0000 7faef5600700 1 -- 172.21.15.164:0/2850956480 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7faeec04c2e0 con 0x7faef810be10 2024-04-20T21:48:41.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.495+0000 7faef7e00700 1 --2- 172.21.15.164:0/2850956480 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7faee0038900 0x7faee003adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:41.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.496+0000 7faef7e00700 1 --2- 172.21.15.164:0/2850956480 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7faee0038900 0x7faee003adc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faee4006fd0 tx=0x7faee4006e40 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:41.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.509+0000 7faef5600700 1 -- 172.21.15.164:0/2850956480 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7faeec029360 con 0x7faef810be10 2024-04-20T21:48:41.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.819+0000 7faeffa00700 1 -- 172.21.15.164:0/2850956480 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7faef810c900 con 0x7faef810be10 2024-04-20T21:48:41.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.820+0000 7faef5600700 1 -- 172.21.15.164:0/2850956480 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7faef810c900 con 0x7faef810be10 2024-04-20T21:48:41.819 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:48:41.820 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":1,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","modified":"2024-04-20T21:45:23.189616Z","created":"2024-04-20T21:45:23.189616Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-20T21:48:41.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.823+0000 7faeffa00700 1 -- 172.21.15.164:0/2850956480 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7faee0038900 msgr2=0x7faee003adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:41.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.823+0000 7faeffa00700 1 --2- 172.21.15.164:0/2850956480 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7faee0038900 0x7faee003adc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faee4006fd0 tx=0x7faee4006e40 comp rx=0 tx=0).stop 2024-04-20T21:48:41.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.823+0000 7faeffa00700 1 -- 172.21.15.164:0/2850956480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faef810be10 msgr2=0x7faef819c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:41.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.823+0000 7faeffa00700 1 --2- 172.21.15.164:0/2850956480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faef810be10 0x7faef819c7d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faeec005490 tx=0x7faeec005570 comp rx=0 tx=0).stop 2024-04-20T21:48:41.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.824+0000 7faeffa00700 1 -- 172.21.15.164:0/2850956480 shutdown_connections 2024-04-20T21:48:41.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.824+0000 7faeffa00700 1 --2- 172.21.15.164:0/2850956480 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7faee0038900 0x7faee003adc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:41.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.824+0000 7faeffa00700 1 --2- 172.21.15.164:0/2850956480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faef810be10 0x7faef819c7d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:41.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.824+0000 7faeffa00700 1 -- 172.21.15.164:0/2850956480 >> 172.21.15.164:0/2850956480 conn(0x7faef8076690 msgr2=0x7faef810cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:41.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.824+0000 7faeffa00700 1 -- 172.21.15.164:0/2850956480 shutdown_connections 2024-04-20T21:48:41.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:41.824+0000 7faeffa00700 1 -- 172.21.15.164:0/2850956480 wait complete. 2024-04-20T21:48:41.823 INFO:teuthology.orchestra.run.smithi164.stderr:dumped monmap epoch 1 2024-04-20T21:48:42.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:42 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/2850956480' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T21:48:43.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:43 smithi142 ceph-mon[15828]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:43.644 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-20T21:48:43.644 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-20T21:48:44.023 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T21:48:44.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:44.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:44.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:44.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:44.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T21:48:44.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:48:44.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:44 smithi142 ceph-mon[15828]: Deploying daemon mon.smithi164 on smithi164 2024-04-20T21:48:44.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:44 smithi142 ceph-mon[15828]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:46.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:46 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:46.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:46 smithi142 ceph-mon[15828]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:47.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.325+0000 7fd206e00700 1 -- 172.21.15.164:0/3723043563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2001067f0 msgr2=0x7fd200106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:47.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.325+0000 7fd206e00700 1 --2- 172.21.15.164:0/3723043563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2001067f0 0x7fd200106bd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0009910 tx=0x7fd1f0009c20 comp rx=0 tx=0).stop 2024-04-20T21:48:47.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.325+0000 7fd206e00700 1 -- 172.21.15.164:0/3723043563 shutdown_connections 2024-04-20T21:48:47.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.325+0000 7fd206e00700 1 --2- 172.21.15.164:0/3723043563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2001067f0 0x7fd200106bd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:47.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.325+0000 7fd206e00700 1 -- 172.21.15.164:0/3723043563 >> 172.21.15.164:0/3723043563 conn(0x7fd2000fc300 msgr2=0x7fd2000fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:47.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.326+0000 7fd206e00700 1 -- 172.21.15.164:0/3723043563 shutdown_connections 2024-04-20T21:48:47.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.326+0000 7fd206e00700 1 -- 172.21.15.164:0/3723043563 wait complete. 2024-04-20T21:48:47.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.327+0000 7fd206e00700 1 Processor -- start 2024-04-20T21:48:47.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.327+0000 7fd206e00700 1 -- start start 2024-04-20T21:48:47.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.328+0000 7fd206e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2001067f0 0x7fd2000731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:47.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.328+0000 7fd206e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000750a0 con 0x7fd2001067f0 2024-04-20T21:48:47.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.328+0000 7fd1ffe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2001067f0 0x7fd2000731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:47.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.328+0000 7fd1ffe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2001067f0 0x7fd2000731e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.164:43100/0 (socket says 172.21.15.164:43100) 2024-04-20T21:48:47.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.328+0000 7fd1ffe00700 1 -- 172.21.15.164:0/1503117265 learned_addr learned my addr 172.21.15.164:0/1503117265 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:48:47.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.329+0000 7fd1ffe00700 1 -- 172.21.15.164:0/1503117265 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f00095f0 con 0x7fd2001067f0 2024-04-20T21:48:47.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.329+0000 7fd1ffe00700 1 --2- 172.21.15.164:0/1503117265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2001067f0 0x7fd2000731e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0005490 tx=0x7fd1f0005570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:47.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.330+0000 7fd1fcc00700 1 -- 172.21.15.164:0/1503117265 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1f001d070 con 0x7fd2001067f0 2024-04-20T21:48:47.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.330+0000 7fd206e00700 1 -- 172.21.15.164:0/1503117265 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd200073720 con 0x7fd2001067f0 2024-04-20T21:48:47.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.330+0000 7fd1fcc00700 1 -- 172.21.15.164:0/1503117265 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd1f0005700 con 0x7fd2001067f0 2024-04-20T21:48:47.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.330+0000 7fd1fcc00700 1 -- 172.21.15.164:0/1503117265 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1f00038e0 con 0x7fd2001067f0 2024-04-20T21:48:47.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.330+0000 7fd206e00700 1 -- 172.21.15.164:0/1503117265 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd200073ba0 con 0x7fd2001067f0 2024-04-20T21:48:47.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.331+0000 7fd206e00700 1 -- 172.21.15.164:0/1503117265 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd200101f30 con 0x7fd2001067f0 2024-04-20T21:48:47.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.332+0000 7fd1fcc00700 1 -- 172.21.15.164:0/1503117265 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 45671+0+0 (secure 0 0 0) 0x7fd1f0003b50 con 0x7fd2001067f0 2024-04-20T21:48:47.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.332+0000 7fd1fcc00700 1 --2- 172.21.15.164:0/1503117265 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd1e4038910 0x7fd1e403add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:47.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.332+0000 7fd1fcc00700 1 -- 172.21.15.164:0/1503117265 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fd1f004c650 con 0x7fd2001067f0 2024-04-20T21:48:47.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.333+0000 7fd1ff400700 1 --2- 172.21.15.164:0/1503117265 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd1e4038910 0x7fd1e403add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:47.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.334+0000 7fd1ff400700 1 --2- 172.21.15.164:0/1503117265 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd1e4038910 0x7fd1e403add0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec006fd0 tx=0x7fd1ec006e40 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:47.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.349+0000 7fd1fcc00700 1 -- 172.21.15.164:0/1503117265 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fd1f00219a0 con 0x7fd2001067f0 2024-04-20T21:48:47.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.678+0000 7fd206e00700 1 -- 172.21.15.164:0/1503117265 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd2000747e0 con 0x7fd2001067f0 2024-04-20T21:48:47.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.680+0000 7fd1fcc00700 1 -- 172.21.15.164:0/1503117265 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fd1f0026030 con 0x7fd2001067f0 2024-04-20T21:48:47.679 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:48:47.679 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":1,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","modified":"2024-04-20T21:45:23.189616Z","created":"2024-04-20T21:45:23.189616Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-20T21:48:47.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.683+0000 7fd206e00700 1 -- 172.21.15.164:0/1503117265 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd1e4038910 msgr2=0x7fd1e403add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:47.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.683+0000 7fd206e00700 1 --2- 172.21.15.164:0/1503117265 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd1e4038910 0x7fd1e403add0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec006fd0 tx=0x7fd1ec006e40 comp rx=0 tx=0).stop 2024-04-20T21:48:47.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.683+0000 7fd206e00700 1 -- 172.21.15.164:0/1503117265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2001067f0 msgr2=0x7fd2000731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:47.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.683+0000 7fd206e00700 1 --2- 172.21.15.164:0/1503117265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2001067f0 0x7fd2000731e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0005490 tx=0x7fd1f0005570 comp rx=0 tx=0).stop 2024-04-20T21:48:47.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.683+0000 7fd206e00700 1 -- 172.21.15.164:0/1503117265 shutdown_connections 2024-04-20T21:48:47.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.683+0000 7fd206e00700 1 --2- 172.21.15.164:0/1503117265 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd1e4038910 0x7fd1e403add0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:47.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.683+0000 7fd206e00700 1 --2- 172.21.15.164:0/1503117265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2001067f0 0x7fd2000731e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:47.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.683+0000 7fd206e00700 1 -- 172.21.15.164:0/1503117265 >> 172.21.15.164:0/1503117265 conn(0x7fd2000fc300 msgr2=0x7fd2000fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:47.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.683+0000 7fd206e00700 1 -- 172.21.15.164:0/1503117265 shutdown_connections 2024-04-20T21:48:47.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:47.683+0000 7fd206e00700 1 -- 172.21.15.164:0/1503117265 wait complete. 2024-04-20T21:48:47.683 INFO:teuthology.orchestra.run.smithi164.stderr:dumped monmap epoch 1 2024-04-20T21:48:48.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:47 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/1503117265' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T21:48:49.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:48 smithi142 ceph-mon[15828]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:49.565 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-20T21:48:49.565 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-20T21:48:50.349 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi164/config 2024-04-20T21:48:50.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:50 smithi164 ceph-mon[23506]: mon.smithi164@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-04-20T21:48:55.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.400+0000 7f537f200700 1 -- 172.21.15.164:0/3506360779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5378106920 msgr2=0x7f535c005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:55.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.400+0000 7f537f200700 1 --2- 172.21.15.164:0/3506360779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5378106920 0x7f535c005610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5368005fa0 tx=0x7f536800ffc0 comp rx=0 tx=0).stop 2024-04-20T21:48:55.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.400+0000 7f537f200700 1 -- 172.21.15.164:0/3506360779 shutdown_connections 2024-04-20T21:48:55.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.400+0000 7f537f200700 1 --2- 172.21.15.164:0/3506360779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5378106920 0x7f535c005610 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:55.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.400+0000 7f537f200700 1 -- 172.21.15.164:0/3506360779 >> 172.21.15.164:0/3506360779 conn(0x7f53780fc430 msgr2=0x7f53780fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:55.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.400+0000 7f537f200700 1 -- 172.21.15.164:0/3506360779 shutdown_connections 2024-04-20T21:48:55.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.400+0000 7f537f200700 1 -- 172.21.15.164:0/3506360779 wait complete. 2024-04-20T21:48:55.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.404+0000 7f537f200700 1 Processor -- start 2024-04-20T21:48:55.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.404+0000 7f537f200700 1 -- start start 2024-04-20T21:48:55.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.405+0000 7f537f200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5378106920 0x7f5378196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:55.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.405+0000 7f537f200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5378196780 0x7f537819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:55.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.405+0000 7f537f200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5378196da0 con 0x7f5378196780 2024-04-20T21:48:55.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.405+0000 7f537f200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5378196f10 con 0x7f5378106920 2024-04-20T21:48:55.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.405+0000 7f5377400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5378196780 0x7f537819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:55.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.405+0000 7f5377400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5378196780 0x7f537819ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.164:41998/0 (socket says 172.21.15.164:41998) 2024-04-20T21:48:55.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.405+0000 7f5377400700 1 -- 172.21.15.164:0/3896056884 learned_addr learned my addr 172.21.15.164:0/3896056884 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:48:55.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.406+0000 7f5377e00700 1 --2- 172.21.15.164:0/3896056884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5378106920 0x7f5378196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:55.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.406+0000 7f5377e00700 1 -- 172.21.15.164:0/3896056884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5378106920 msgr2=0x7f5378196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-20T21:48:55.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.406+0000 7f5377e00700 1 -- 172.21.15.164:0/3896056884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5378106920 msgr2=0x7f5378196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-20T21:48:55.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.406+0000 7f5377e00700 1 --2- 172.21.15.164:0/3896056884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5378106920 0x7f5378196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-20T21:48:55.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.406+0000 7f5377e00700 1 --2- 172.21.15.164:0/3896056884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5378106920 0x7f5378196240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T21:48:55.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.407+0000 7f5377400700 1 -- 172.21.15.164:0/3896056884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5378106920 msgr2=0x7f5378196240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T21:48:55.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.407+0000 7f5377400700 1 --2- 172.21.15.164:0/3896056884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5378106920 0x7f5378196240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:55.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.407+0000 7f5377400700 1 -- 172.21.15.164:0/3896056884 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536800f9c0 con 0x7f5378196780 2024-04-20T21:48:55.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.407+0000 7f5377400700 1 --2- 172.21.15.164:0/3896056884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5378196780 0x7f537819ab30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f536400b700 tx=0x7f536400bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:55.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.408+0000 7f5374c00700 1 -- 172.21.15.164:0/3896056884 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5364011800 con 0x7f5378196780 2024-04-20T21:48:55.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.408+0000 7f537f200700 1 -- 172.21.15.164:0/3896056884 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537819b130 con 0x7f5378196780 2024-04-20T21:48:55.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.408+0000 7f537f200700 1 -- 172.21.15.164:0/3896056884 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537819b680 con 0x7f5378196780 2024-04-20T21:48:55.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.408+0000 7f5374c00700 1 -- 172.21.15.164:0/3896056884 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5364011e20 con 0x7f5378196780 2024-04-20T21:48:55.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.408+0000 7f5374c00700 1 -- 172.21.15.164:0/3896056884 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f536400f2e0 con 0x7f5378196780 2024-04-20T21:48:55.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.410+0000 7f537f200700 1 -- 172.21.15.164:0/3896056884 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535c002170 con 0x7f5378196780 2024-04-20T21:48:55.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.412+0000 7f5374c00700 1 -- 172.21.15.164:0/3896056884 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 90796+0+0 (secure 0 0 0) 0x7f5364011960 con 0x7f5378196780 2024-04-20T21:48:55.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.413+0000 7f5374c00700 1 --2- 172.21.15.164:0/3896056884 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f535806ce00 0x7f535806f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:55.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.413+0000 7f5374c00700 1 -- 172.21.15.164:0/3896056884 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f536408ade0 con 0x7f5378196780 2024-04-20T21:48:55.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.414+0000 7f5377e00700 1 --2- 172.21.15.164:0/3896056884 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f535806ce00 0x7f535806f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:55.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.415+0000 7f5377e00700 1 --2- 172.21.15.164:0/3896056884 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f535806ce00 0x7f535806f2c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5368005ed0 tx=0x7f5368005da0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:55.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.424+0000 7f5374c00700 1 -- 172.21.15.164:0/3896056884 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f5364056270 con 0x7f5378196780 2024-04-20T21:48:55.650 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T21:48:55.651 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:48:55.651 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: mon.smithi142 calling monitor election 2024-04-20T21:48:55.651 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:48:55.651 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:55.651 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:48:55.651 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: mon.smithi164 calling monitor election 2024-04-20T21:48:55.651 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/1824718892' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/crt"}]: dispatch 2024-04-20T21:48:55.651 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:48:55.651 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:55.651 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:48:55.651 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:48:55.651 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:48:55.652 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: mon.smithi142 is new leader, mons smithi142,smithi164 in quorum (ranks 0,1) 2024-04-20T21:48:55.652 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: monmap e2: 2 mons at {smithi142=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0],smithi164=[v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-20T21:48:55.652 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: fsmap 2024-04-20T21:48:55.652 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: osdmap e5: 0 total, 0 up, 0 in 2024-04-20T21:48:55.652 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: mgrmap e17: smithi142.zzmcfz(active, since 45s) 2024-04-20T21:48:55.652 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: overall HEALTH_OK 2024-04-20T21:48:55.652 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: Standby manager daemon smithi164.oejajr started 2024-04-20T21:48:55.652 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/1824718892' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T21:48:55.652 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:55.652 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/1824718892' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/key"}]: dispatch 2024-04-20T21:48:55.652 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/1824718892' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T21:48:55.652 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:55.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T21:48:55.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:48:55.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: mon.smithi142 calling monitor election 2024-04-20T21:48:55.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:48:55.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:55.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:48:55.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: mon.smithi164 calling monitor election 2024-04-20T21:48:55.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.164:0/1824718892' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/crt"}]: dispatch 2024-04-20T21:48:55.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:48:55.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:55.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:48:55.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:48:55.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:48:55.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: mon.smithi142 is new leader, mons smithi142,smithi164 in quorum (ranks 0,1) 2024-04-20T21:48:55.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: monmap e2: 2 mons at {smithi142=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0],smithi164=[v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-20T21:48:55.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: fsmap 2024-04-20T21:48:55.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: osdmap e5: 0 total, 0 up, 0 in 2024-04-20T21:48:55.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: mgrmap e17: smithi142.zzmcfz(active, since 45s) 2024-04-20T21:48:55.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: overall HEALTH_OK 2024-04-20T21:48:55.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: Standby manager daemon smithi164.oejajr started 2024-04-20T21:48:55.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.164:0/1824718892' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T21:48:55.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:55.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.164:0/1824718892' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/key"}]: dispatch 2024-04-20T21:48:55.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.164:0/1824718892' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T21:48:55.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:55.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.729+0000 7f537f200700 1 -- 172.21.15.164:0/3896056884 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f535c002cb0 con 0x7f5378196780 2024-04-20T21:48:55.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.730+0000 7f5374c00700 1 -- 172.21.15.164:0/3896056884 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1026 (secure 0 0 0) 0x7f5364022e60 con 0x7f5378196780 2024-04-20T21:48:55.730 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-20T21:48:55.730 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":2,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","modified":"2024-04-20T21:48:50.292622Z","created":"2024-04-20T21:45:23.189616Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi142","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi164","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:3300","nonce":0},{"type":"v1","addr":"172.21.15.164:6789","nonce":0}]},"addr":"172.21.15.164:6789/0","public_addr":"172.21.15.164:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-20T21:48:55.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.733+0000 7f537f200700 1 -- 172.21.15.164:0/3896056884 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f535806ce00 msgr2=0x7f535806f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:55.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.733+0000 7f537f200700 1 --2- 172.21.15.164:0/3896056884 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f535806ce00 0x7f535806f2c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5368005ed0 tx=0x7f5368005da0 comp rx=0 tx=0).stop 2024-04-20T21:48:55.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.733+0000 7f537f200700 1 -- 172.21.15.164:0/3896056884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5378196780 msgr2=0x7f537819ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:55.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.733+0000 7f537f200700 1 --2- 172.21.15.164:0/3896056884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5378196780 0x7f537819ab30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f536400b700 tx=0x7f536400bac0 comp rx=0 tx=0).stop 2024-04-20T21:48:55.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.733+0000 7f537f200700 1 -- 172.21.15.164:0/3896056884 shutdown_connections 2024-04-20T21:48:55.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.733+0000 7f537f200700 1 --2- 172.21.15.164:0/3896056884 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f535806ce00 0x7f535806f2c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:55.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.733+0000 7f537f200700 1 --2- 172.21.15.164:0/3896056884 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5378106920 0x7f5378196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:55.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.733+0000 7f537f200700 1 --2- 172.21.15.164:0/3896056884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5378196780 0x7f537819ab30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:55.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.733+0000 7f537f200700 1 -- 172.21.15.164:0/3896056884 >> 172.21.15.164:0/3896056884 conn(0x7f53780fc430 msgr2=0x7f53780fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:55.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.734+0000 7f537f200700 1 -- 172.21.15.164:0/3896056884 shutdown_connections 2024-04-20T21:48:55.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:48:55.734+0000 7f537f200700 1 -- 172.21.15.164:0/3896056884 wait complete. 2024-04-20T21:48:55.734 INFO:teuthology.orchestra.run.smithi164.stderr:dumped monmap epoch 2 2024-04-20T21:48:56.500 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-20T21:48:56.500 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-20T21:48:56.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:56 smithi142 ceph-mon[15828]: mgrmap e18: smithi142.zzmcfz(active, since 45s), standbys: smithi164.oejajr 2024-04-20T21:48:56.581 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:56 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr metadata", "who": "smithi164.oejajr", "id": "smithi164.oejajr"}]: dispatch 2024-04-20T21:48:56.581 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:56 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:56.581 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:56 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:56.581 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:56 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:56.581 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:56 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:48:56.581 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:56 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/3896056884' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T21:48:56.581 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:56 smithi142 ceph-mon[15828]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:56.581 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:56 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:48:56.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:56 smithi164 ceph-mon[23506]: mgrmap e18: smithi142.zzmcfz(active, since 45s), standbys: smithi164.oejajr 2024-04-20T21:48:56.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:56 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr metadata", "who": "smithi164.oejajr", "id": "smithi164.oejajr"}]: dispatch 2024-04-20T21:48:56.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:56 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:56.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:56 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:56.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:56 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:56.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:56 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:48:56.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:56 smithi164 ceph-mon[23506]: from='client.? 172.21.15.164:0/3896056884' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T21:48:56.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:56 smithi164 ceph-mon[23506]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:56.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:56 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:48:56.907 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:48:59.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.005+0000 7fb699000700 1 -- 172.21.15.142:0/2488273640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6940ff550 msgr2=0x7fb6940ff930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:59.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.005+0000 7fb699000700 1 --2- 172.21.15.142:0/2488273640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6940ff550 0x7fb6940ff930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb684009910 tx=0x7fb684009c20 comp rx=0 tx=0).stop 2024-04-20T21:48:59.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.005+0000 7fb699000700 1 -- 172.21.15.142:0/2488273640 shutdown_connections 2024-04-20T21:48:59.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.005+0000 7fb699000700 1 --2- 172.21.15.142:0/2488273640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6940ff550 0x7fb6940ff930 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:59.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.005+0000 7fb699000700 1 -- 172.21.15.142:0/2488273640 >> 172.21.15.142:0/2488273640 conn(0x7fb694076390 msgr2=0x7fb6940fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:59.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.005+0000 7fb699000700 1 -- 172.21.15.142:0/2488273640 shutdown_connections 2024-04-20T21:48:59.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.005+0000 7fb699000700 1 -- 172.21.15.142:0/2488273640 wait complete. 2024-04-20T21:48:59.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.006+0000 7fb699000700 1 Processor -- start 2024-04-20T21:48:59.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.006+0000 7fb699000700 1 -- start start 2024-04-20T21:48:59.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.007+0000 7fb699000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6940ff550 0x7fb6941984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:59.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.007+0000 7fb699000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb694198a20 0x7fb69419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:59.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.007+0000 7fb699000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb694199040 con 0x7fb694198a20 2024-04-20T21:48:59.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.007+0000 7fb699000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6941991b0 con 0x7fb6940ff550 2024-04-20T21:48:59.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.007+0000 7fb691400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb694198a20 0x7fb69419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:59.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.007+0000 7fb691400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb694198a20 0x7fb69419cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42760/0 (socket says 172.21.15.142:42760) 2024-04-20T21:48:59.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.007+0000 7fb691400700 1 -- 172.21.15.142:0/943146543 learned_addr learned my addr 172.21.15.142:0/943146543 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:48:59.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.007+0000 7fb691e00700 1 --2- 172.21.15.142:0/943146543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6940ff550 0x7fb6941984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:59.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.008+0000 7fb691e00700 1 -- 172.21.15.142:0/943146543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6940ff550 msgr2=0x7fb6941984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-20T21:48:59.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.008+0000 7fb691e00700 1 -- 172.21.15.142:0/943146543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6940ff550 msgr2=0x7fb6941984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-20T21:48:59.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.008+0000 7fb691e00700 1 --2- 172.21.15.142:0/943146543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6940ff550 0x7fb6941984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-20T21:48:59.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.008+0000 7fb691400700 1 -- 172.21.15.142:0/943146543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6940ff550 msgr2=0x7fb6941984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:59.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.008+0000 7fb691e00700 1 --2- 172.21.15.142:0/943146543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6940ff550 0x7fb6941984e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T21:48:59.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.008+0000 7fb691400700 1 --2- 172.21.15.142:0/943146543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6940ff550 0x7fb6941984e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:59.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.008+0000 7fb691400700 1 -- 172.21.15.142:0/943146543 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6840095f0 con 0x7fb694198a20 2024-04-20T21:48:59.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.008+0000 7fb691400700 1 --2- 172.21.15.142:0/943146543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb694198a20 0x7fb69419cdd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb68000b700 tx=0x7fb68000bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:59.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.008+0000 7fb68aa00700 1 -- 172.21.15.142:0/943146543 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb680011800 con 0x7fb694198a20 2024-04-20T21:48:59.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.009+0000 7fb68aa00700 1 -- 172.21.15.142:0/943146543 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb680011e20 con 0x7fb694198a20 2024-04-20T21:48:59.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.009+0000 7fb699000700 1 -- 172.21.15.142:0/943146543 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69419d3d0 con 0x7fb694198a20 2024-04-20T21:48:59.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.009+0000 7fb68aa00700 1 -- 172.21.15.142:0/943146543 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb68000f2e0 con 0x7fb694198a20 2024-04-20T21:48:59.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.009+0000 7fb699000700 1 -- 172.21.15.142:0/943146543 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69419d920 con 0x7fb694198a20 2024-04-20T21:48:59.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.010+0000 7fb699000700 1 -- 172.21.15.142:0/943146543 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6940688c0 con 0x7fb694198a20 2024-04-20T21:48:59.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.012+0000 7fb68aa00700 1 -- 172.21.15.142:0/943146543 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 90796+0+0 (secure 0 0 0) 0x7fb680010380 con 0x7fb694198a20 2024-04-20T21:48:59.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.013+0000 7fb68aa00700 1 --2- 172.21.15.142:0/943146543 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb67806cdb0 0x7fb67806f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:48:59.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.013+0000 7fb68aa00700 1 -- 172.21.15.142:0/943146543 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fb68008ae90 con 0x7fb694198a20 2024-04-20T21:48:59.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.014+0000 7fb691e00700 1 --2- 172.21.15.142:0/943146543 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb67806cdb0 0x7fb67806f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:48:59.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.014+0000 7fb691e00700 1 --2- 172.21.15.142:0/943146543 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb67806cdb0 0x7fb67806f270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb684006010 tx=0x7fb68400b540 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:48:59.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.019+0000 7fb68aa00700 1 -- 172.21.15.142:0/943146543 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fb6800562a0 con 0x7fb694198a20 2024-04-20T21:48:59.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:58 smithi142 ceph-mon[15828]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:59.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:58 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:59.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:58 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:59.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:58 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:48:59.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:58 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:48:59.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.244+0000 7fb699000700 1 -- 172.21.15.142:0/943146543 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fb69419dbd0 con 0x7fb694198a20 2024-04-20T21:48:59.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.244+0000 7fb68aa00700 1 -- 172.21.15.142:0/943146543 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7fb6800598c0 con 0x7fb694198a20 2024-04-20T21:48:59.243 INFO:teuthology.orchestra.run.smithi142.stdout:# minimal ceph.conf for 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T21:48:59.243 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2024-04-20T21:48:59.243 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T21:48:59.243 INFO:teuthology.orchestra.run.smithi142.stdout: mon_host = [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-04-20T21:48:59.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.247+0000 7fb699000700 1 -- 172.21.15.142:0/943146543 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb67806cdb0 msgr2=0x7fb67806f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:59.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.247+0000 7fb699000700 1 --2- 172.21.15.142:0/943146543 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb67806cdb0 0x7fb67806f270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb684006010 tx=0x7fb68400b540 comp rx=0 tx=0).stop 2024-04-20T21:48:59.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.247+0000 7fb699000700 1 -- 172.21.15.142:0/943146543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb694198a20 msgr2=0x7fb69419cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:48:59.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.247+0000 7fb699000700 1 --2- 172.21.15.142:0/943146543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb694198a20 0x7fb69419cdd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb68000b700 tx=0x7fb68000bac0 comp rx=0 tx=0).stop 2024-04-20T21:48:59.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.247+0000 7fb699000700 1 -- 172.21.15.142:0/943146543 shutdown_connections 2024-04-20T21:48:59.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.247+0000 7fb699000700 1 --2- 172.21.15.142:0/943146543 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb67806cdb0 0x7fb67806f270 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:59.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.247+0000 7fb699000700 1 --2- 172.21.15.142:0/943146543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb6940ff550 0x7fb6941984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:59.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.247+0000 7fb699000700 1 --2- 172.21.15.142:0/943146543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb694198a20 0x7fb69419cdd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:48:59.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.247+0000 7fb699000700 1 -- 172.21.15.142:0/943146543 >> 172.21.15.142:0/943146543 conn(0x7fb694076390 msgr2=0x7fb6940fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:48:59.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.247+0000 7fb699000700 1 -- 172.21.15.142:0/943146543 shutdown_connections 2024-04-20T21:48:59.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:48:59.247+0000 7fb699000700 1 -- 172.21.15.142:0/943146543 wait complete. 2024-04-20T21:48:59.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:58 smithi164 ceph-mon[23506]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:48:59.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:58 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:59.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:58 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:48:59.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:58 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:48:59.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:48:58 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:49:00.045 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-20T21:49:00.045 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-20T21:49:00.045 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.conf 2024-04-20T21:49:00.123 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-20T21:49:00.123 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-20T21:49:00.250 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-20T21:49:00.250 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.conf 2024-04-20T21:49:00.316 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:00 smithi164 ceph-mon[23506]: Updating smithi142:/etc/ceph/ceph.conf 2024-04-20T21:49:00.316 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:00 smithi164 ceph-mon[23506]: Updating smithi164:/etc/ceph/ceph.conf 2024-04-20T21:49:00.316 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:00 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/943146543' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:00.331 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-20T21:49:00.331 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-20T21:49:00.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:59 smithi142 ceph-mon[15828]: Updating smithi142:/etc/ceph/ceph.conf 2024-04-20T21:49:00.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:59 smithi142 ceph-mon[15828]: Updating smithi164:/etc/ceph/ceph.conf 2024-04-20T21:49:00.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:48:59 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/943146543' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:00.461 INFO:tasks.cephadm:Deploying OSDs... 2024-04-20T21:49:00.461 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-20T21:49:00.462 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2024-04-20T21:49:00.511 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-20T21:49:00.512 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2024-04-20T21:49:00.563 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-20T21:49:00.563 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T21:49:00.563 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-04-20T21:49:00.564 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T21:49:00.564 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T21:49:00.564 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-20 21:47:58.879689940 +0000 2024-04-20T21:49:00.564 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-20 21:41:16.149802115 +0000 2024-04-20T21:49:00.564 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-20 21:41:16.149802115 +0000 2024-04-20T21:49:00.564 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-04-20 21:41:16.149802115 +0000 2024-04-20T21:49:00.564 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-20T21:49:00.629 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-20T21:49:00.629 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-20T21:49:00.629 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000323409 s, 1.6 MB/s 2024-04-20T21:49:00.632 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-20T21:49:00.675 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2024-04-20T21:49:00.754 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-20T21:49:00.754 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T21:49:00.754 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-04-20T21:49:00.754 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T21:49:00.754 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T21:49:00.754 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-20 21:47:58.880689922 +0000 2024-04-20T21:49:00.754 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-20 21:41:16.747790864 +0000 2024-04-20T21:49:00.754 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-20 21:41:16.747790864 +0000 2024-04-20T21:49:00.754 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-04-20 21:41:16.747790864 +0000 2024-04-20T21:49:00.755 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-20T21:49:00.864 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-20T21:49:00.864 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-20T21:49:00.865 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000306078 s, 1.7 MB/s 2024-04-20T21:49:00.868 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-20T21:49:00.918 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2024-04-20T21:49:00.965 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-20T21:49:00.965 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T21:49:00.966 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-04-20T21:49:00.966 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T21:49:00.966 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T21:49:00.966 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-20 21:47:58.881689903 +0000 2024-04-20T21:49:00.966 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-20 21:41:17.317780139 +0000 2024-04-20T21:49:00.966 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-20 21:41:17.318780120 +0000 2024-04-20T21:49:00.966 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-04-20 21:41:17.317780139 +0000 2024-04-20T21:49:00.966 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-20T21:49:01.033 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-20T21:49:01.033 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-20T21:49:01.033 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000330069 s, 1.6 MB/s 2024-04-20T21:49:01.036 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-20T21:49:01.079 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2024-04-20T21:49:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-20T21:49:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T21:49:01.161 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-04-20T21:49:01.161 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T21:49:01.161 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T21:49:01.162 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-20 21:47:58.881689903 +0000 2024-04-20T21:49:01.162 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-20 21:41:17.928768642 +0000 2024-04-20T21:49:01.162 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-20 21:41:17.928768642 +0000 2024-04-20T21:49:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-04-20 21:41:17.928768642 +0000 2024-04-20T21:49:01.162 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-20T21:49:01.274 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-20T21:49:01.274 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-20T21:49:01.275 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000331356 s, 1.5 MB/s 2024-04-20T21:49:01.278 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-20T21:49:01.327 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-20T21:49:01.327 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2024-04-20T21:49:01.338 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:01 smithi142 ceph-mon[15828]: Updating smithi142:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T21:49:01.338 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:01 smithi142 ceph-mon[15828]: Updating smithi164:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T21:49:01.339 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:01 smithi142 ceph-mon[15828]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:01.339 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:01.339 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:01.339 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:01.339 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:01.339 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:01.339 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:01.340 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T21:49:01.340 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T21:49:01.340 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:01.386 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-20T21:49:01.386 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 2024-04-20T21:49:01.436 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-20T21:49:01.436 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T21:49:01.436 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-04-20T21:49:01.436 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T21:49:01.436 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T21:49:01.436 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-20 21:48:49.420046759 +0000 2024-04-20T21:49:01.436 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-20 21:41:16.141747982 +0000 2024-04-20T21:49:01.436 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-20 21:41:16.141747982 +0000 2024-04-20T21:49:01.436 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-20 21:41:16.141747982 +0000 2024-04-20T21:49:01.437 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-20T21:49:01.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:01 smithi164 ceph-mon[23506]: Updating smithi142:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T21:49:01.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:01 smithi164 ceph-mon[23506]: Updating smithi164:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T21:49:01.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:01 smithi164 ceph-mon[23506]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:01.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:01.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:01.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:01.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:01.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:01.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:01.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T21:49:01.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T21:49:01.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:01.515 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-20T21:49:01.516 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-20T21:49:01.516 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000375623 s, 1.4 MB/s 2024-04-20T21:49:01.519 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-20T21:49:01.619 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 2024-04-20T21:49:01.671 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-20T21:49:01.671 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T21:49:01.671 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-04-20T21:49:01.671 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T21:49:01.671 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T21:49:01.672 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-20 21:48:49.421046743 +0000 2024-04-20T21:49:01.672 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-20 21:41:16.743738017 +0000 2024-04-20T21:49:01.672 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-20 21:41:16.743738017 +0000 2024-04-20T21:49:01.672 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-20 21:41:16.743738017 +0000 2024-04-20T21:49:01.672 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-20T21:49:01.751 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-20T21:49:01.751 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-20T21:49:01.751 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000353486 s, 1.4 MB/s 2024-04-20T21:49:01.755 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-20T21:49:01.812 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 2024-04-20T21:49:01.861 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-20T21:49:01.861 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T21:49:01.861 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-04-20T21:49:01.861 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T21:49:01.861 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T21:49:01.861 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-20 21:48:49.422046727 +0000 2024-04-20T21:49:01.861 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-20 21:41:17.355727888 +0000 2024-04-20T21:49:01.861 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-20 21:41:17.355727888 +0000 2024-04-20T21:49:01.861 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-20 21:41:17.355727888 +0000 2024-04-20T21:49:01.862 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-20T21:49:01.940 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-20T21:49:01.940 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-20T21:49:01.940 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000324198 s, 1.6 MB/s 2024-04-20T21:49:01.944 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-20T21:49:02.001 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 2024-04-20T21:49:02.051 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-20T21:49:02.051 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T21:49:02.051 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-04-20T21:49:02.051 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T21:49:02.051 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T21:49:02.051 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-20 21:48:49.422046727 +0000 2024-04-20T21:49:02.051 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-20 21:41:17.970717707 +0000 2024-04-20T21:49:02.051 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-20 21:41:17.970717707 +0000 2024-04-20T21:49:02.051 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-20 21:41:17.970717707 +0000 2024-04-20T21:49:02.052 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-20T21:49:02.128 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-20T21:49:02.128 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-20T21:49:02.129 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000328177 s, 1.6 MB/s 2024-04-20T21:49:02.132 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-20T21:49:02.187 INFO:tasks.cephadm:Deploying osd.0 on smithi142 with /dev/vg_nvme/lv_4... 2024-04-20T21:49:02.187 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-20T21:49:02.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:02 smithi164 ceph-mon[23506]: Reconfiguring mon.smithi142 (unknown last config time)... 2024-04-20T21:49:02.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:02 smithi164 ceph-mon[23506]: Reconfiguring daemon mon.smithi142 on smithi142 2024-04-20T21:49:02.266 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:02 smithi142 ceph-mon[15828]: Reconfiguring mon.smithi142 (unknown last config time)... 2024-04-20T21:49:02.266 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:02 smithi142 ceph-mon[15828]: Reconfiguring daemon mon.smithi142 on smithi142 2024-04-20T21:49:02.588 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:49:03.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:03 smithi142 ceph-mon[15828]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:03.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:03 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:03.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:03 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:03.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:03 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.zzmcfz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T21:49:03.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:03 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T21:49:03.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:03 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:03.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:03 smithi164 ceph-mon[23506]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:03.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:03 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:03.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:03 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:03.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:03 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.zzmcfz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T21:49:03.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:03 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T21:49:03.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:03 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:04.352 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:04 smithi142 ceph-mon[15828]: Reconfiguring mgr.smithi142.zzmcfz (unknown last config time)... 2024-04-20T21:49:04.352 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:04 smithi142 ceph-mon[15828]: Reconfiguring daemon mgr.smithi142.zzmcfz on smithi142 2024-04-20T21:49:04.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:04 smithi164 ceph-mon[23506]: Reconfiguring mgr.smithi142.zzmcfz (unknown last config time)... 2024-04-20T21:49:04.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:04 smithi164 ceph-mon[23506]: Reconfiguring daemon mgr.smithi142.zzmcfz on smithi142 2024-04-20T21:49:05.414 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:05 smithi142 ceph-mon[15828]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:05.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:05 smithi164 ceph-mon[23506]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:05.796 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-20T21:49:05.796 INFO:teuthology.orchestra.run.smithi142.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-20T21:49:05.796 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10+0 records in 2024-04-20T21:49:05.796 INFO:teuthology.orchestra.run.smithi142.stderr:10+0 records out 2024-04-20T21:49:05.796 INFO:teuthology.orchestra.run.smithi142.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.032529 s, 322 MB/s 2024-04-20T21:49:05.796 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping successful for: 2024-04-20T21:49:06.663 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph orch daemon add osd smithi142:vg_nvme/lv_4 2024-04-20T21:49:06.898 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:06 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:06.898 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:06 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:06.898 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:06 smithi142 ceph-mon[15828]: Reconfiguring ceph-exporter.smithi142 (monmap changed)... 2024-04-20T21:49:06.898 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:06 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-20T21:49:06.899 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:06 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:06.899 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:06 smithi142 ceph-mon[15828]: Reconfiguring daemon ceph-exporter.smithi142 on smithi142 2024-04-20T21:49:06.899 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:06 smithi142 ceph-mon[15828]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:06.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:06 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:06.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:06 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:06.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:06 smithi164 ceph-mon[23506]: Reconfiguring ceph-exporter.smithi142 (monmap changed)... 2024-04-20T21:49:06.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:06 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-20T21:49:06.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:06 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:06.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:06 smithi164 ceph-mon[23506]: Reconfiguring daemon ceph-exporter.smithi142 on smithi142 2024-04-20T21:49:06.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:06 smithi164 ceph-mon[23506]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:07.873 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:49:08.985 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:08 smithi142 ceph-mon[15828]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:08.985 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:08 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:08.985 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:08 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:08.985 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:08 smithi142 ceph-mon[15828]: Reconfiguring crash.smithi142 (monmap changed)... 2024-04-20T21:49:08.985 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:08 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-20T21:49:08.985 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:08 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:08.985 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:08 smithi142 ceph-mon[15828]: Reconfiguring daemon crash.smithi142 on smithi142 2024-04-20T21:49:09.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:08 smithi164 ceph-mon[23506]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:08 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:08 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:08 smithi164 ceph-mon[23506]: Reconfiguring crash.smithi142 (monmap changed)... 2024-04-20T21:49:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:08 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-20T21:49:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:08 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:08 smithi164 ceph-mon[23506]: Reconfiguring daemon crash.smithi142 on smithi142 2024-04-20T21:49:10.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.125+0000 7f5c3fe00700 1 -- 172.21.15.142:0/4241775691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c38102e20 msgr2=0x7f5c38103240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:49:10.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.125+0000 7f5c3fe00700 1 --2- 172.21.15.142:0/4241775691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c38102e20 0x7f5c38103240 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c009910 tx=0x7f5c2c009c20 comp rx=0 tx=0).stop 2024-04-20T21:49:10.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.125+0000 7f5c3fe00700 1 -- 172.21.15.142:0/4241775691 shutdown_connections 2024-04-20T21:49:10.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.125+0000 7f5c3fe00700 1 --2- 172.21.15.142:0/4241775691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c38103f80 0x7f5c38104400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:49:10.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.125+0000 7f5c3fe00700 1 --2- 172.21.15.142:0/4241775691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c38102e20 0x7f5c38103240 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:49:10.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.125+0000 7f5c3fe00700 1 -- 172.21.15.142:0/4241775691 >> 172.21.15.142:0/4241775691 conn(0x7f5c380fe3a0 msgr2=0x7f5c38100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:49:10.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.125+0000 7f5c3fe00700 1 -- 172.21.15.142:0/4241775691 shutdown_connections 2024-04-20T21:49:10.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.125+0000 7f5c3fe00700 1 -- 172.21.15.142:0/4241775691 wait complete. 2024-04-20T21:49:10.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.126+0000 7f5c3fe00700 1 Processor -- start 2024-04-20T21:49:10.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.127+0000 7f5c3fe00700 1 -- start start 2024-04-20T21:49:10.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.127+0000 7f5c3fe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c38102e20 0x7f5c38198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:49:10.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.127+0000 7f5c3fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c38103f80 0x7f5c38198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:49:10.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.127+0000 7f5c3fe00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c38199380 con 0x7f5c38103f80 2024-04-20T21:49:10.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.127+0000 7f5c3fe00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c381994c0 con 0x7f5c38102e20 2024-04-20T21:49:10.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.127+0000 7f5c3ca00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c38103f80 0x7f5c38198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:49:10.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.127+0000 7f5c3ca00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c38103f80 0x7f5c38198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50808/0 (socket says 172.21.15.142:50808) 2024-04-20T21:49:10.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.127+0000 7f5c3ca00700 1 -- 172.21.15.142:0/2932294788 learned_addr learned my addr 172.21.15.142:0/2932294788 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:49:10.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.128+0000 7f5c3d400700 1 --2- 172.21.15.142:0/2932294788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c38102e20 0x7f5c38198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:49:10.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.128+0000 7f5c3ca00700 1 -- 172.21.15.142:0/2932294788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c38102e20 msgr2=0x7f5c38198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:49:10.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.128+0000 7f5c3ca00700 1 --2- 172.21.15.142:0/2932294788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c38102e20 0x7f5c38198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:49:10.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.128+0000 7f5c3ca00700 1 -- 172.21.15.142:0/2932294788 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c0095f0 con 0x7f5c38103f80 2024-04-20T21:49:10.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.128+0000 7f5c3ca00700 1 --2- 172.21.15.142:0/2932294788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c38103f80 0x7f5c38198d60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400c8a0 tx=0x7f5c2400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:49:10.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.128+0000 7f5c36000700 1 -- 172.21.15.142:0/2932294788 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c2400cea0 con 0x7f5c38103f80 2024-04-20T21:49:10.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.128+0000 7f5c36000700 1 -- 172.21.15.142:0/2932294788 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c24004830 con 0x7f5c38103f80 2024-04-20T21:49:10.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.128+0000 7f5c36000700 1 -- 172.21.15.142:0/2932294788 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c240055b0 con 0x7f5c38103f80 2024-04-20T21:49:10.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.128+0000 7f5c3fe00700 1 -- 172.21.15.142:0/2932294788 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3819ded0 con 0x7f5c38103f80 2024-04-20T21:49:10.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.128+0000 7f5c3fe00700 1 -- 172.21.15.142:0/2932294788 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3819e470 con 0x7f5c38103f80 2024-04-20T21:49:10.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.130+0000 7f5c3fe00700 1 -- 172.21.15.142:0/2932294788 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c38192920 con 0x7f5c38103f80 2024-04-20T21:49:10.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.131+0000 7f5c36000700 1 -- 172.21.15.142:0/2932294788 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 90796+0+0 (secure 0 0 0) 0x7f5c240049a0 con 0x7f5c38103f80 2024-04-20T21:49:10.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.132+0000 7f5c36000700 1 --2- 172.21.15.142:0/2932294788 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f5c2006cc70 0x7f5c2006f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:49:10.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.132+0000 7f5c36000700 1 -- 172.21.15.142:0/2932294788 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f5c2408ad80 con 0x7f5c38103f80 2024-04-20T21:49:10.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.132+0000 7f5c3d400700 1 --2- 172.21.15.142:0/2932294788 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f5c2006cc70 0x7f5c2006f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:49:10.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.133+0000 7f5c3d400700 1 --2- 172.21.15.142:0/2932294788 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f5c2006cc70 0x7f5c2006f130 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00b5c0 tx=0x7f5c2c005160 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:49:10.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.137+0000 7f5c36000700 1 -- 172.21.15.142:0/2932294788 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f5c24059ca0 con 0x7f5c38103f80 2024-04-20T21:49:10.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:10.360+0000 7f5c3fe00700 1 -- 172.21.15.142:0/2932294788 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c3802ce50 con 0x7f5c2006cc70 2024-04-20T21:49:11.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:10 smithi142 ceph-mon[15828]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:11.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:10 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:49:11.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:10 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T21:49:11.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:10 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T21:49:11.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:10 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:11.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:10 smithi164 ceph-mon[23506]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:11.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:10 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:49:11.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:10 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T21:49:11.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:10 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T21:49:11.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:10 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:12.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:12 smithi142 ceph-mon[15828]: from='client.14254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:49:12.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:12 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:12.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:12 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:12.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:12 smithi142 ceph-mon[15828]: Reconfiguring alertmanager.smithi142 (dependencies changed)... 2024-04-20T21:49:12.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:12 smithi142 ceph-mon[15828]: Reconfiguring daemon alertmanager.smithi142 on smithi142 2024-04-20T21:49:12.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:12 smithi164 ceph-mon[23506]: from='client.14254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:49:12.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:12 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:12.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:12 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:12 smithi164 ceph-mon[23506]: Reconfiguring alertmanager.smithi142 (dependencies changed)... 2024-04-20T21:49:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:12 smithi164 ceph-mon[23506]: Reconfiguring daemon alertmanager.smithi142 on smithi142 2024-04-20T21:49:13.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:13 smithi142 ceph-mon[15828]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:13.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:13 smithi164 ceph-mon[23506]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:15.315 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:15 smithi142 ceph-mon[15828]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:15.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:15 smithi164 ceph-mon[23506]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:17.394 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:17 smithi142 ceph-mon[15828]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:17.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:17 smithi164 ceph-mon[23506]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:19.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:19 smithi142 ceph-mon[15828]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:19.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:19 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:19.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:19 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:19.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:19 smithi164 ceph-mon[23506]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:19.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:19 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:19.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:19 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:20.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:20 smithi142 ceph-mon[15828]: Reconfiguring grafana.smithi142 (dependencies changed)... 2024-04-20T21:49:20.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:20 smithi142 ceph-mon[15828]: Reconfiguring daemon grafana.smithi142 on smithi142 2024-04-20T21:49:20.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:20 smithi164 ceph-mon[23506]: Reconfiguring grafana.smithi142 (dependencies changed)... 2024-04-20T21:49:20.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:20 smithi164 ceph-mon[23506]: Reconfiguring daemon grafana.smithi142 on smithi142 2024-04-20T21:49:21.389 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:21 smithi142 ceph-mon[15828]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:21.389 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:21 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1582512094' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0042c600-a874-4d57-bb8f-7b6f32723bb9"}]: dispatch 2024-04-20T21:49:21.390 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:21 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1582512094' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0042c600-a874-4d57-bb8f-7b6f32723bb9"}]': finished 2024-04-20T21:49:21.390 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:21 smithi142 ceph-mon[15828]: osdmap e6: 1 total, 0 up, 1 in 2024-04-20T21:49:21.390 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:21 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T21:49:21.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:21 smithi164 ceph-mon[23506]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:21.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:21 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/1582512094' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0042c600-a874-4d57-bb8f-7b6f32723bb9"}]: dispatch 2024-04-20T21:49:21.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:21 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/1582512094' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0042c600-a874-4d57-bb8f-7b6f32723bb9"}]': finished 2024-04-20T21:49:21.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:21 smithi164 ceph-mon[23506]: osdmap e6: 1 total, 0 up, 1 in 2024-04-20T21:49:21.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:21 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T21:49:22.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:22 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/3441498997' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T21:49:22.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:22 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/3441498997' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T21:49:23.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:23 smithi164 ceph-mon[23506]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:23.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:23 smithi142 ceph-mon[15828]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:25.407 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:25 smithi142 ceph-mon[15828]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:25.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:25 smithi164 ceph-mon[23506]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:26.425 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:26 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:49:26.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:26 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:49:27.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:27 smithi164 ceph-mon[23506]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:27.278 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:27 smithi142 ceph-mon[15828]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:29.367 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:29 smithi142 ceph-mon[15828]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:29.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:29 smithi164 ceph-mon[23506]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:31.443 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:31 smithi142 ceph-mon[15828]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:31.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:31 smithi164 ceph-mon[23506]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:33.305 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:33 smithi142 ceph-mon[15828]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:33.305 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:33 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:33.305 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:33 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:33.305 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:33 smithi142 ceph-mon[15828]: Reconfiguring prometheus.smithi142 (dependencies changed)... 2024-04-20T21:49:33.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:33 smithi164 ceph-mon[23506]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:33.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:33 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:33.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:33 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:33.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:33 smithi164 ceph-mon[23506]: Reconfiguring prometheus.smithi142 (dependencies changed)... 2024-04-20T21:49:34.082 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:34 smithi142 ceph-mon[15828]: Reconfiguring daemon prometheus.smithi142 on smithi142 2024-04-20T21:49:34.082 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:34 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-20T21:49:34.082 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:34 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:34.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:34 smithi164 ceph-mon[23506]: Reconfiguring daemon prometheus.smithi142 on smithi142 2024-04-20T21:49:34.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:34 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-20T21:49:34.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:34 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:35.246 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:35 smithi142 ceph-mon[15828]: Deploying daemon osd.0 on smithi142 2024-04-20T21:49:35.246 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:35 smithi142 ceph-mon[15828]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:35.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:35 smithi164 ceph-mon[23506]: Deploying daemon osd.0 on smithi142 2024-04-20T21:49:35.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:35 smithi164 ceph-mon[23506]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:37.413 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:37 smithi142 ceph-mon[15828]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:37.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:37 smithi164 ceph-mon[23506]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:39.424 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:39 smithi142 ceph-mon[15828]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:39.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:39 smithi164 ceph-mon[23506]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:40 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:40 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:40 smithi164 ceph-mon[23506]: Reconfiguring ceph-exporter.smithi164 (monmap changed)... 2024-04-20T21:49:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:40 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi164", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-20T21:49:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:40 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:40 smithi164 ceph-mon[23506]: Reconfiguring daemon ceph-exporter.smithi164 on smithi164 2024-04-20T21:49:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:40 smithi164 ceph-mon[23506]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:40 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:49:41.160 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:40 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:41.160 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:40 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:41.160 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:40 smithi142 ceph-mon[15828]: Reconfiguring ceph-exporter.smithi164 (monmap changed)... 2024-04-20T21:49:41.160 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:40 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi164", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-20T21:49:41.160 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:40 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:41.160 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:40 smithi142 ceph-mon[15828]: Reconfiguring daemon ceph-exporter.smithi164 on smithi164 2024-04-20T21:49:41.160 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:40 smithi142 ceph-mon[15828]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:41.160 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:40 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:49:42.942 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:42 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:42.943 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:42 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:42.943 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:42 smithi164 ceph-mon[23506]: Reconfiguring crash.smithi164 (monmap changed)... 2024-04-20T21:49:42.943 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:42 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi164", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-20T21:49:42.943 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:42 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:42.943 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:42 smithi164 ceph-mon[23506]: Reconfiguring daemon crash.smithi164 on smithi164 2024-04-20T21:49:42.943 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:42 smithi164 ceph-mon[23506]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:43.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:42 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:43.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:42 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:43.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:42 smithi142 ceph-mon[15828]: Reconfiguring crash.smithi164 (monmap changed)... 2024-04-20T21:49:43.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:42 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi164", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-20T21:49:43.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:42 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:43.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:42 smithi142 ceph-mon[15828]: Reconfiguring daemon crash.smithi164 on smithi164 2024-04-20T21:49:43.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:42 smithi142 ceph-mon[15828]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:44.941 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:44 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:44.941 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:44 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:44.941 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:44 smithi164 ceph-mon[23506]: Reconfiguring mgr.smithi164.oejajr (monmap changed)... 2024-04-20T21:49:44.941 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:44 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi164.oejajr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T21:49:44.941 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:44 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T21:49:44.941 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:44 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:44.942 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:44 smithi164 ceph-mon[23506]: Reconfiguring daemon mgr.smithi164.oejajr on smithi164 2024-04-20T21:49:44.942 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:44 smithi164 ceph-mon[23506]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:45.023 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:45.023 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:45.023 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:44 smithi142 ceph-mon[15828]: Reconfiguring mgr.smithi164.oejajr (monmap changed)... 2024-04-20T21:49:45.023 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi164.oejajr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T21:49:45.024 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T21:49:45.024 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:45.024 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:44 smithi142 ceph-mon[15828]: Reconfiguring daemon mgr.smithi164.oejajr on smithi164 2024-04-20T21:49:45.024 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:44 smithi142 ceph-mon[15828]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:46.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:46 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:46.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:46 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:46.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:46 smithi142 ceph-mon[15828]: Reconfiguring mon.smithi164 (monmap changed)... 2024-04-20T21:49:46.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:46 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T21:49:46.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:46 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T21:49:46.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:46 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:46.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:46 smithi142 ceph-mon[15828]: Reconfiguring daemon mon.smithi164 on smithi164 2024-04-20T21:49:46.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:46 smithi142 ceph-mon[15828]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:46.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:46 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:46.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:46 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:46.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:46 smithi164 ceph-mon[23506]: Reconfiguring mon.smithi164 (monmap changed)... 2024-04-20T21:49:46.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:46 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T21:49:46.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:46 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T21:49:46.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:46 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:49:46.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:46 smithi164 ceph-mon[23506]: Reconfiguring daemon mon.smithi164 on smithi164 2024-04-20T21:49:46.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:46 smithi164 ceph-mon[23506]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:48.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:48.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:48.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:48.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:48.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-20T21:49:48.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-20T21:49:48.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi142.front.sepia.ceph.com:9093"}]: dispatch 2024-04-20T21:49:48.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi142.front.sepia.ceph.com:9093"}]: dispatch 2024-04-20T21:49:48.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:48.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-20T21:49:48.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-20T21:49:48.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi142.front.sepia.ceph.com:3000"}]: dispatch 2024-04-20T21:49:48.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi142.front.sepia.ceph.com:3000"}]: dispatch 2024-04-20T21:49:48.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:48.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-20T21:49:48.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-20T21:49:48.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi142.front.sepia.ceph.com:9095"}]: dispatch 2024-04-20T21:49:48.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi142.front.sepia.ceph.com:9095"}]: dispatch 2024-04-20T21:49:48.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:48.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:49:48.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:48 smithi142 ceph-mon[15828]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-20T21:49:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-20T21:49:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi142.front.sepia.ceph.com:9093"}]: dispatch 2024-04-20T21:49:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi142.front.sepia.ceph.com:9093"}]: dispatch 2024-04-20T21:49:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-20T21:49:48.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-20T21:49:48.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi142.front.sepia.ceph.com:3000"}]: dispatch 2024-04-20T21:49:48.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi142.front.sepia.ceph.com:3000"}]: dispatch 2024-04-20T21:49:48.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:48.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-20T21:49:48.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-20T21:49:48.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi142.front.sepia.ceph.com:9095"}]: dispatch 2024-04-20T21:49:48.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi142.front.sepia.ceph.com:9095"}]: dispatch 2024-04-20T21:49:48.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:48.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:49:48.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:48 smithi164 ceph-mon[23506]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:51.418 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:51 smithi142 ceph-mon[15828]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:51.418 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:51 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:51.419 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:51 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:51.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:51 smithi164 ceph-mon[23506]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:51.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:51 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:51.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:51 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:51.903 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 0 on host 'smithi142' 2024-04-20T21:49:51.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:51.903+0000 7f5c36000700 1 -- 172.21.15.142:0/2932294788 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5c3802ce50 con 0x7f5c2006cc70 2024-04-20T21:49:51.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:51.906+0000 7f5c3fe00700 1 -- 172.21.15.142:0/2932294788 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f5c2006cc70 msgr2=0x7f5c2006f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:49:51.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:51.906+0000 7f5c3fe00700 1 --2- 172.21.15.142:0/2932294788 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f5c2006cc70 0x7f5c2006f130 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00b5c0 tx=0x7f5c2c005160 comp rx=0 tx=0).stop 2024-04-20T21:49:51.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:51.906+0000 7f5c3fe00700 1 -- 172.21.15.142:0/2932294788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c38103f80 msgr2=0x7f5c38198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:49:51.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:51.906+0000 7f5c3fe00700 1 --2- 172.21.15.142:0/2932294788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c38103f80 0x7f5c38198d60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400c8a0 tx=0x7f5c2400cc60 comp rx=0 tx=0).stop 2024-04-20T21:49:51.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:51.906+0000 7f5c3fe00700 1 -- 172.21.15.142:0/2932294788 shutdown_connections 2024-04-20T21:49:51.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:51.906+0000 7f5c3fe00700 1 --2- 172.21.15.142:0/2932294788 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f5c2006cc70 0x7f5c2006f130 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:49:51.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:51.907+0000 7f5c3fe00700 1 --2- 172.21.15.142:0/2932294788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c38102e20 0x7f5c38198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:49:51.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:51.907+0000 7f5c3fe00700 1 --2- 172.21.15.142:0/2932294788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c38103f80 0x7f5c38198d60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:49:51.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:51.907+0000 7f5c3fe00700 1 -- 172.21.15.142:0/2932294788 >> 172.21.15.142:0/2932294788 conn(0x7f5c380fe3a0 msgr2=0x7f5c38107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:49:51.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:51.907+0000 7f5c3fe00700 1 -- 172.21.15.142:0/2932294788 shutdown_connections 2024-04-20T21:49:51.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:49:51.907+0000 7f5c3fe00700 1 -- 172.21.15.142:0/2932294788 wait complete. 2024-04-20T21:49:52.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:52 smithi142 ceph-mon[15828]: from='osd.0 [v2:172.21.15.142:6802/477229295,v1:172.21.15.142:6803/477229295]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-20T21:49:52.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:52 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:52.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:52 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:52.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:52 smithi164 ceph-mon[23506]: from='osd.0 [v2:172.21.15.142:6802/477229295,v1:172.21.15.142:6803/477229295]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-20T21:49:52.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:52 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:52.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:52 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:52.725 DEBUG:teuthology.orchestra.run.smithi142:osd.0> sudo journalctl -f -n 0 -u ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.0.service 2024-04-20T21:49:52.731 INFO:tasks.cephadm:Deploying osd.1 on smithi142 with /dev/vg_nvme/lv_3... 2024-04-20T21:49:52.732 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-20T21:49:53.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:53 smithi164 ceph-mon[23506]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:53.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:53 smithi164 ceph-mon[23506]: from='osd.0 [v2:172.21.15.142:6802/477229295,v1:172.21.15.142:6803/477229295]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-20T21:49:53.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:53 smithi164 ceph-mon[23506]: osdmap e7: 1 total, 0 up, 1 in 2024-04-20T21:49:53.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:53 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T21:49:53.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:53 smithi164 ceph-mon[23506]: from='osd.0 [v2:172.21.15.142:6802/477229295,v1:172.21.15.142:6803/477229295]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-04-20T21:49:53.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:53 smithi142 ceph-mon[15828]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:53.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:53 smithi142 ceph-mon[15828]: from='osd.0 [v2:172.21.15.142:6802/477229295,v1:172.21.15.142:6803/477229295]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-20T21:49:53.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:53 smithi142 ceph-mon[15828]: osdmap e7: 1 total, 0 up, 1 in 2024-04-20T21:49:53.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:53 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T21:49:53.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:53 smithi142 ceph-mon[15828]: from='osd.0 [v2:172.21.15.142:6802/477229295,v1:172.21.15.142:6803/477229295]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-04-20T21:49:53.446 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 21:49:53 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0[34479]: 2024-04-20T21:49:53.040+0000 7fae59600700 -1 osd.0 0 waiting for initial osdmap 2024-04-20T21:49:53.446 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 21:49:53 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0[34479]: 2024-04-20T21:49:53.047+0000 7fae54e00700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T21:49:53.536 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:49:54.419 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:54 smithi142 ceph-mon[15828]: from='osd.0 [v2:172.21.15.142:6802/477229295,v1:172.21.15.142:6803/477229295]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-04-20T21:49:54.420 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:54 smithi142 ceph-mon[15828]: osdmap e8: 1 total, 0 up, 1 in 2024-04-20T21:49:54.420 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:54 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T21:49:54.420 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:54 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T21:49:54.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:54 smithi164 ceph-mon[23506]: from='osd.0 [v2:172.21.15.142:6802/477229295,v1:172.21.15.142:6803/477229295]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-04-20T21:49:54.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:54 smithi164 ceph-mon[23506]: osdmap e8: 1 total, 0 up, 1 in 2024-04-20T21:49:54.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:54 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T21:49:54.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:54 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T21:49:55.348 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:55 smithi164 ceph-mon[23506]: purged_snaps scrub starts 2024-04-20T21:49:55.349 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:55 smithi164 ceph-mon[23506]: purged_snaps scrub ok 2024-04-20T21:49:55.349 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:55 smithi164 ceph-mon[23506]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:55.349 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T21:49:55.349 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:55 smithi164 ceph-mon[23506]: osd.0 [v2:172.21.15.142:6802/477229295,v1:172.21.15.142:6803/477229295] boot 2024-04-20T21:49:55.349 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:55 smithi164 ceph-mon[23506]: osdmap e9: 1 total, 1 up, 1 in 2024-04-20T21:49:55.349 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T21:49:55.373 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:55 smithi142 ceph-mon[15828]: purged_snaps scrub starts 2024-04-20T21:49:55.373 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:55 smithi142 ceph-mon[15828]: purged_snaps scrub ok 2024-04-20T21:49:55.373 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:55 smithi142 ceph-mon[15828]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T21:49:55.373 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T21:49:55.373 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:55 smithi142 ceph-mon[15828]: osd.0 [v2:172.21.15.142:6802/477229295,v1:172.21.15.142:6803/477229295] boot 2024-04-20T21:49:55.373 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:55 smithi142 ceph-mon[15828]: osdmap e9: 1 total, 1 up, 1 in 2024-04-20T21:49:55.373 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T21:49:56.400 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:56 smithi142 ceph-mon[15828]: osdmap e10: 1 total, 1 up, 1 in 2024-04-20T21:49:56.400 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:56 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:49:56.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:56 smithi164 ceph-mon[23506]: osdmap e10: 1 total, 1 up, 1 in 2024-04-20T21:49:56.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:56 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:49:56.948 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-20T21:49:56.949 INFO:teuthology.orchestra.run.smithi142.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-20T21:49:56.949 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10+0 records in 2024-04-20T21:49:56.949 INFO:teuthology.orchestra.run.smithi142.stderr:10+0 records out 2024-04-20T21:49:56.949 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0354146 s, 296 MB/s 2024-04-20T21:49:56.949 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping successful for: 2024-04-20T21:49:57.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:57 smithi164 ceph-mon[23506]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:49:57.240 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:57 smithi142 ceph-mon[15828]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:49:58.341 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph orch daemon add osd smithi142:vg_nvme/lv_3 2024-04-20T21:49:58.719 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:49:59.173 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:58 smithi142 ceph-mon[15828]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:49:59.173 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:58 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:59.173 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:49:58 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:59.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:58 smithi164 ceph-mon[23506]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:49:59.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:58 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:49:59.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:49:58 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:01.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.120+0000 7f372a800700 1 -- 172.21.15.142:0/130907634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3724107260 msgr2=0x7f3724107680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:50:01.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.120+0000 7f372a800700 1 --2- 172.21.15.142:0/130907634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3724107260 0x7f3724107680 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3714009910 tx=0x7f3714009c20 comp rx=0 tx=0).stop 2024-04-20T21:50:01.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.120+0000 7f372a800700 1 -- 172.21.15.142:0/130907634 shutdown_connections 2024-04-20T21:50:01.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.120+0000 7f372a800700 1 --2- 172.21.15.142:0/130907634 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3724108430 0x7f37241088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:50:01.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.120+0000 7f372a800700 1 --2- 172.21.15.142:0/130907634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3724107260 0x7f3724107680 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:50:01.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.120+0000 7f372a800700 1 -- 172.21.15.142:0/130907634 >> 172.21.15.142:0/130907634 conn(0x7f3724076400 msgr2=0x7f3724078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:50:01.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.120+0000 7f372a800700 1 -- 172.21.15.142:0/130907634 shutdown_connections 2024-04-20T21:50:01.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.120+0000 7f372a800700 1 -- 172.21.15.142:0/130907634 wait complete. 2024-04-20T21:50:01.120 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:00 smithi142 ceph-mon[15828]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:01.121 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:00 smithi142 ceph-mon[15828]: overall HEALTH_OK 2024-04-20T21:50:01.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.121+0000 7f372a800700 1 Processor -- start 2024-04-20T21:50:01.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.121+0000 7f372a800700 1 -- start start 2024-04-20T21:50:01.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.122+0000 7f372a800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3724107260 0x7f372419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:50:01.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.122+0000 7f372a800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3724108430 0x7f372419d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:50:01.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.122+0000 7f372a800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372419d770 con 0x7f3724108430 2024-04-20T21:50:01.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.122+0000 7f372a800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372419d8b0 con 0x7f3724107260 2024-04-20T21:50:01.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.122+0000 7f3722a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3724108430 0x7f372419d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:50:01.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.122+0000 7f3722a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3724108430 0x7f372419d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58000/0 (socket says 172.21.15.142:58000) 2024-04-20T21:50:01.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.122+0000 7f3722a00700 1 -- 172.21.15.142:0/3076759003 learned_addr learned my addr 172.21.15.142:0/3076759003 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:50:01.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.123+0000 7f3723400700 1 --2- 172.21.15.142:0/3076759003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3724107260 0x7f372419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:50:01.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.123+0000 7f3722a00700 1 -- 172.21.15.142:0/3076759003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3724107260 msgr2=0x7f372419cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:50:01.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.123+0000 7f3722a00700 1 --2- 172.21.15.142:0/3076759003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3724107260 0x7f372419cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:50:01.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.123+0000 7f3722a00700 1 -- 172.21.15.142:0/3076759003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37140095f0 con 0x7f3724108430 2024-04-20T21:50:01.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.123+0000 7f3722a00700 1 --2- 172.21.15.142:0/3076759003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3724108430 0x7f372419d150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f371000e920 tx=0x7f371000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:50:01.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.123+0000 7f371be00700 1 -- 172.21.15.142:0/3076759003 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3710009790 con 0x7f3724108430 2024-04-20T21:50:01.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.123+0000 7f371be00700 1 -- 172.21.15.142:0/3076759003 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f371000cba0 con 0x7f3724108430 2024-04-20T21:50:01.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.123+0000 7f371be00700 1 -- 172.21.15.142:0/3076759003 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3710018650 con 0x7f3724108430 2024-04-20T21:50:01.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.123+0000 7f372a800700 1 -- 172.21.15.142:0/3076759003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37241a22c0 con 0x7f3724108430 2024-04-20T21:50:01.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.124+0000 7f372a800700 1 -- 172.21.15.142:0/3076759003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37241a2890 con 0x7f3724108430 2024-04-20T21:50:01.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.125+0000 7f372a800700 1 -- 172.21.15.142:0/3076759003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3724196dd0 con 0x7f3724108430 2024-04-20T21:50:01.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.126+0000 7f371be00700 1 -- 172.21.15.142:0/3076759003 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 90796+0+0 (secure 0 0 0) 0x7f371000cd10 con 0x7f3724108430 2024-04-20T21:50:01.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.128+0000 7f371be00700 1 --2- 172.21.15.142:0/3076759003 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f370806cc50 0x7f370806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:50:01.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.128+0000 7f371be00700 1 -- 172.21.15.142:0/3076759003 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7f3710014070 con 0x7f3724108430 2024-04-20T21:50:01.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.128+0000 7f3723400700 1 --2- 172.21.15.142:0/3076759003 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f370806cc50 0x7f370806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:50:01.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.129+0000 7f3723400700 1 --2- 172.21.15.142:0/3076759003 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f370806cc50 0x7f370806f110 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f371400b800 tx=0x7f3714009f70 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:50:01.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.132+0000 7f371be00700 1 -- 172.21.15.142:0/3076759003 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f371005ad80 con 0x7f3724108430 2024-04-20T21:50:01.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:01.362+0000 7f372a800700 1 -- 172.21.15.142:0/3076759003 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f372402cdb0 con 0x7f370806cc50 2024-04-20T21:50:01.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:00 smithi164 ceph-mon[23506]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:01.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:00 smithi164 ceph-mon[23506]: overall HEALTH_OK 2024-04-20T21:50:02.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T21:50:02.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T21:50:02.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:50:02.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T21:50:02.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T21:50:02.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:50:03.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:02 smithi164 ceph-mon[23506]: from='client.14272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:50:03.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:02 smithi164 ceph-mon[23506]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:03.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:02 smithi142 ceph-mon[15828]: from='client.14272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:50:03.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:02 smithi142 ceph-mon[15828]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:05.167 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:04 smithi142 ceph-mon[15828]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:05.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:04 smithi164 ceph-mon[23506]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:06.616 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:06 smithi142 ceph-mon[15828]: Detected new or changed devices on smithi142 2024-04-20T21:50:06.616 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:06 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:06.616 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:06 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:06.616 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:06 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:50:06.616 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:06 smithi142 ceph-mon[15828]: Adjusting osd_memory_target on smithi142 to 11841M 2024-04-20T21:50:06.616 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:06 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:06.617 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:06 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:50:06.617 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:06 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:50:06.617 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:06 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:06.617 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:06 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:50:06.617 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:06 smithi142 ceph-mon[15828]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:06.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:06 smithi164 ceph-mon[23506]: Detected new or changed devices on smithi142 2024-04-20T21:50:06.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:06 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:06.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:06 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:06.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:06 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:50:06.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:06 smithi164 ceph-mon[23506]: Adjusting osd_memory_target on smithi142 to 11841M 2024-04-20T21:50:06.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:06 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:06.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:06 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:50:06.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:06 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:50:06.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:06 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:06.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:06 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:50:06.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:06 smithi164 ceph-mon[23506]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:07.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:07 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2585018748' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29049537-368a-4d1f-b92c-21d962dd8031"}]: dispatch 2024-04-20T21:50:07.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:07 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2585018748' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29049537-368a-4d1f-b92c-21d962dd8031"}]': finished 2024-04-20T21:50:07.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:07 smithi142 ceph-mon[15828]: osdmap e11: 2 total, 1 up, 2 in 2024-04-20T21:50:07.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:07 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T21:50:07.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:07 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/2585018748' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29049537-368a-4d1f-b92c-21d962dd8031"}]: dispatch 2024-04-20T21:50:07.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:07 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/2585018748' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29049537-368a-4d1f-b92c-21d962dd8031"}]': finished 2024-04-20T21:50:07.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:07 smithi164 ceph-mon[23506]: osdmap e11: 2 total, 1 up, 2 in 2024-04-20T21:50:07.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:07 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T21:50:08.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:08 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/943116014' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T21:50:08.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:08 smithi142 ceph-mon[15828]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:08.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:08 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/943116014' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T21:50:08.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:08 smithi164 ceph-mon[23506]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:09.790 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:09 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:09.791 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:09 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:09.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:09 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:09.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:09 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:10.757 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:10 smithi142 ceph-mon[15828]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:10.757 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:10 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:50:10.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:10 smithi164 ceph-mon[23506]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:10.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:10 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:50:12.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:12 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:12.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:12 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:12.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:12 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:50:12.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:12 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:50:12.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:12 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:12.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:12 smithi142 ceph-mon[15828]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:12 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:12 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:12 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:50:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:12 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:50:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:12 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:12 smithi164 ceph-mon[23506]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:15.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:15 smithi164 ceph-mon[23506]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:15.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:15 smithi142 ceph-mon[15828]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:17.347 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:17 smithi142 ceph-mon[15828]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:17.347 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:17 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-20T21:50:17.347 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:17 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:50:17.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:17 smithi164 ceph-mon[23506]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:17.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:17 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-20T21:50:17.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:17 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:50:18.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:18 smithi164 ceph-mon[23506]: Deploying daemon osd.1 on smithi142 2024-04-20T21:50:18.444 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:18 smithi142 ceph-mon[15828]: Deploying daemon osd.1 on smithi142 2024-04-20T21:50:19.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:19 smithi142 ceph-mon[15828]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:19.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:19 smithi164 ceph-mon[23506]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:21.181 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:21 smithi142 ceph-mon[15828]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:21.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:21 smithi164 ceph-mon[23506]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:23.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:23 smithi164 ceph-mon[23506]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:23.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:23 smithi142 ceph-mon[15828]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:25.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:25 smithi142 ceph-mon[15828]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:25.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:25 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:25.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:25 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:25.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:25 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:50:25.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:25 smithi164 ceph-mon[23506]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:25.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:25 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:25.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:25 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:25.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:25 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:50:26.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:26 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:50:26.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:26 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:50:27.079 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:27 smithi164 ceph-mon[23506]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:27.409 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:27 smithi142 ceph-mon[15828]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:28.944 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:28 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:28.944 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:28 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:28.944 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:28 smithi142 ceph-mon[15828]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:28.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:28 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:28.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:28 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:28.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:28 smithi164 ceph-mon[23506]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:29.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:29 smithi164 ceph-mon[23506]: from='osd.1 [v2:172.21.15.142:6810/2225466348,v1:172.21.15.142:6811/2225466348]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-20T21:50:29.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:29 smithi142 ceph-mon[15828]: from='osd.1 [v2:172.21.15.142:6810/2225466348,v1:172.21.15.142:6811/2225466348]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-20T21:50:30.356 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 1 on host 'smithi142' 2024-04-20T21:50:30.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:30.357+0000 7f371be00700 1 -- 172.21.15.142:0/3076759003 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f372402cdb0 con 0x7f370806cc50 2024-04-20T21:50:30.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:30.360+0000 7f372a800700 1 -- 172.21.15.142:0/3076759003 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f370806cc50 msgr2=0x7f370806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:50:30.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:30.360+0000 7f372a800700 1 --2- 172.21.15.142:0/3076759003 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f370806cc50 0x7f370806f110 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f371400b800 tx=0x7f3714009f70 comp rx=0 tx=0).stop 2024-04-20T21:50:30.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:30.360+0000 7f372a800700 1 -- 172.21.15.142:0/3076759003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3724108430 msgr2=0x7f372419d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:50:30.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:30.360+0000 7f372a800700 1 --2- 172.21.15.142:0/3076759003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3724108430 0x7f372419d150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f371000e920 tx=0x7f371000ece0 comp rx=0 tx=0).stop 2024-04-20T21:50:30.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:30.360+0000 7f372a800700 1 -- 172.21.15.142:0/3076759003 shutdown_connections 2024-04-20T21:50:30.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:30.360+0000 7f372a800700 1 --2- 172.21.15.142:0/3076759003 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f370806cc50 0x7f370806f110 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:50:30.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:30.360+0000 7f372a800700 1 --2- 172.21.15.142:0/3076759003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3724107260 0x7f372419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:50:30.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:30.360+0000 7f372a800700 1 --2- 172.21.15.142:0/3076759003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3724108430 0x7f372419d150 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:50:30.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:30.360+0000 7f372a800700 1 -- 172.21.15.142:0/3076759003 >> 172.21.15.142:0/3076759003 conn(0x7f3724076400 msgr2=0x7f372410b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:50:30.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:30.360+0000 7f372a800700 1 -- 172.21.15.142:0/3076759003 shutdown_connections 2024-04-20T21:50:30.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:30.360+0000 7f372a800700 1 -- 172.21.15.142:0/3076759003 wait complete. 2024-04-20T21:50:30.868 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:30 smithi142 ceph-mon[15828]: from='osd.1 [v2:172.21.15.142:6810/2225466348,v1:172.21.15.142:6811/2225466348]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-20T21:50:30.868 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:30 smithi142 ceph-mon[15828]: osdmap e12: 2 total, 1 up, 2 in 2024-04-20T21:50:30.868 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:30 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T21:50:30.869 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:30 smithi142 ceph-mon[15828]: from='osd.1 [v2:172.21.15.142:6810/2225466348,v1:172.21.15.142:6811/2225466348]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-04-20T21:50:30.869 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:30 smithi142 ceph-mon[15828]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:30.869 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:30 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:30.869 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:30 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:31.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:30 smithi164 ceph-mon[23506]: from='osd.1 [v2:172.21.15.142:6810/2225466348,v1:172.21.15.142:6811/2225466348]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-20T21:50:31.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:30 smithi164 ceph-mon[23506]: osdmap e12: 2 total, 1 up, 2 in 2024-04-20T21:50:31.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:30 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T21:50:31.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:30 smithi164 ceph-mon[23506]: from='osd.1 [v2:172.21.15.142:6810/2225466348,v1:172.21.15.142:6811/2225466348]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-04-20T21:50:31.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:30 smithi164 ceph-mon[23506]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-20T21:50:31.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:30 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:31.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:30 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:31.363 DEBUG:teuthology.orchestra.run.smithi142:osd.1> sudo journalctl -f -n 0 -u ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.1.service 2024-04-20T21:50:31.369 INFO:tasks.cephadm:Deploying osd.2 on smithi142 with /dev/vg_nvme/lv_2... 2024-04-20T21:50:31.369 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-20T21:50:31.914 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:31 smithi142 ceph-mon[15828]: from='osd.1 [v2:172.21.15.142:6810/2225466348,v1:172.21.15.142:6811/2225466348]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-04-20T21:50:31.915 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:31 smithi142 ceph-mon[15828]: osdmap e13: 2 total, 1 up, 2 in 2024-04-20T21:50:31.915 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:31 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T21:50:31.915 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:31 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T21:50:31.978 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:50:32.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:31 smithi164 ceph-mon[23506]: from='osd.1 [v2:172.21.15.142:6810/2225466348,v1:172.21.15.142:6811/2225466348]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-04-20T21:50:32.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:31 smithi164 ceph-mon[23506]: osdmap e13: 2 total, 1 up, 2 in 2024-04-20T21:50:32.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:31 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T21:50:32.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:31 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T21:50:32.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:32 smithi142 ceph-mon[15828]: purged_snaps scrub starts 2024-04-20T21:50:32.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:32 smithi142 ceph-mon[15828]: purged_snaps scrub ok 2024-04-20T21:50:32.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:32 smithi142 ceph-mon[15828]: osd.1 [v2:172.21.15.142:6810/2225466348,v1:172.21.15.142:6811/2225466348] boot 2024-04-20T21:50:32.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:32 smithi142 ceph-mon[15828]: osdmap e14: 2 total, 2 up, 2 in 2024-04-20T21:50:32.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:32 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T21:50:32.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:32 smithi142 ceph-mon[15828]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:33.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:32 smithi164 ceph-mon[23506]: purged_snaps scrub starts 2024-04-20T21:50:33.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:32 smithi164 ceph-mon[23506]: purged_snaps scrub ok 2024-04-20T21:50:33.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:32 smithi164 ceph-mon[23506]: osd.1 [v2:172.21.15.142:6810/2225466348,v1:172.21.15.142:6811/2225466348] boot 2024-04-20T21:50:33.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:32 smithi164 ceph-mon[23506]: osdmap e14: 2 total, 2 up, 2 in 2024-04-20T21:50:33.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:32 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T21:50:33.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:32 smithi164 ceph-mon[23506]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:34.117 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:33 smithi142 ceph-mon[15828]: osdmap e15: 2 total, 2 up, 2 in 2024-04-20T21:50:34.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:33 smithi164 ceph-mon[23506]: osdmap e15: 2 total, 2 up, 2 in 2024-04-20T21:50:35.054 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:34 smithi142 ceph-mon[15828]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:35.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:34 smithi164 ceph-mon[23506]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:35.902 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-20T21:50:35.902 INFO:teuthology.orchestra.run.smithi142.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-20T21:50:35.902 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10+0 records in 2024-04-20T21:50:35.902 INFO:teuthology.orchestra.run.smithi142.stderr:10+0 records out 2024-04-20T21:50:35.902 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0335583 s, 312 MB/s 2024-04-20T21:50:35.902 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping successful for: 2024-04-20T21:50:36.494 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:36 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:36.494 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:36 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:36.494 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:36 smithi142 ceph-mon[15828]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:36.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:36 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:36.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:36 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:36.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:36 smithi164 ceph-mon[23506]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:37.076 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph orch daemon add osd smithi142:vg_nvme/lv_2 2024-04-20T21:50:38.169 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:50:39.121 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:39 smithi142 ceph-mon[15828]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:39.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:39 smithi164 ceph-mon[23506]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:41.107 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:41 smithi142 ceph-mon[15828]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:41.108 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:41 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:50:41.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.108+0000 7ff136c00700 1 -- 172.21.15.142:0/2387900878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff130107260 msgr2=0x7ff130107680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:50:41.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.108+0000 7ff136c00700 1 --2- 172.21.15.142:0/2387900878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff130107260 0x7ff130107680 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff120009910 tx=0x7ff120009c20 comp rx=0 tx=0).stop 2024-04-20T21:50:41.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.108+0000 7ff136c00700 1 -- 172.21.15.142:0/2387900878 shutdown_connections 2024-04-20T21:50:41.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.108+0000 7ff136c00700 1 --2- 172.21.15.142:0/2387900878 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff130108430 0x7ff1301088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:50:41.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.108+0000 7ff136c00700 1 --2- 172.21.15.142:0/2387900878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff130107260 0x7ff130107680 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:50:41.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.108+0000 7ff136c00700 1 -- 172.21.15.142:0/2387900878 >> 172.21.15.142:0/2387900878 conn(0x7ff130076400 msgr2=0x7ff130078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:50:41.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.108+0000 7ff136c00700 1 -- 172.21.15.142:0/2387900878 shutdown_connections 2024-04-20T21:50:41.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.108+0000 7ff136c00700 1 -- 172.21.15.142:0/2387900878 wait complete. 2024-04-20T21:50:41.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.109+0000 7ff136c00700 1 Processor -- start 2024-04-20T21:50:41.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.110+0000 7ff136c00700 1 -- start start 2024-04-20T21:50:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.110+0000 7ff136c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff130107260 0x7ff13019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:50:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.110+0000 7ff136c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff130108430 0x7ff13019d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:50:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.110+0000 7ff136c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13019d770 con 0x7ff130107260 2024-04-20T21:50:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.110+0000 7ff136c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13019d8b0 con 0x7ff130108430 2024-04-20T21:50:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.110+0000 7ff12fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff130107260 0x7ff13019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:50:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.110+0000 7ff12fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff130107260 0x7ff13019cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42418/0 (socket says 172.21.15.142:42418) 2024-04-20T21:50:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.110+0000 7ff12fe00700 1 -- 172.21.15.142:0/1674569288 learned_addr learned my addr 172.21.15.142:0/1674569288 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:50:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.111+0000 7ff12f400700 1 --2- 172.21.15.142:0/1674569288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff130108430 0x7ff13019d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:50:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.111+0000 7ff12fe00700 1 -- 172.21.15.142:0/1674569288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff130108430 msgr2=0x7ff13019d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:50:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.111+0000 7ff12fe00700 1 --2- 172.21.15.142:0/1674569288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff130108430 0x7ff13019d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:50:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.111+0000 7ff12fe00700 1 -- 172.21.15.142:0/1674569288 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1200095f0 con 0x7ff130107260 2024-04-20T21:50:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.111+0000 7ff12fe00700 1 --2- 172.21.15.142:0/1674569288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff130107260 0x7ff13019cc10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff120006010 tx=0x7ff12000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:50:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.111+0000 7ff12cc00700 1 -- 172.21.15.142:0/1674569288 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff12001d070 con 0x7ff130107260 2024-04-20T21:50:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.111+0000 7ff12cc00700 1 -- 172.21.15.142:0/1674569288 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff120005dc0 con 0x7ff130107260 2024-04-20T21:50:41.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.111+0000 7ff136c00700 1 -- 172.21.15.142:0/1674569288 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1301a2260 con 0x7ff130107260 2024-04-20T21:50:41.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.111+0000 7ff12cc00700 1 -- 172.21.15.142:0/1674569288 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff120021640 con 0x7ff130107260 2024-04-20T21:50:41.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.112+0000 7ff136c00700 1 -- 172.21.15.142:0/1674569288 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1301a27d0 con 0x7ff130107260 2024-04-20T21:50:41.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.113+0000 7ff136c00700 1 -- 172.21.15.142:0/1674569288 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff130196dd0 con 0x7ff130107260 2024-04-20T21:50:41.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.114+0000 7ff12cc00700 1 -- 172.21.15.142:0/1674569288 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 90796+0+0 (secure 0 0 0) 0x7ff12000f880 con 0x7ff130107260 2024-04-20T21:50:41.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.115+0000 7ff12cc00700 1 --2- 172.21.15.142:0/1674569288 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff11406cc50 0x7ff11406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:50:41.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.115+0000 7ff12cc00700 1 -- 172.21.15.142:0/1674569288 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7ff12008c7c0 con 0x7ff130107260 2024-04-20T21:50:41.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.115+0000 7ff12f400700 1 --2- 172.21.15.142:0/1674569288 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff11406cc50 0x7ff11406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:50:41.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.116+0000 7ff12f400700 1 --2- 172.21.15.142:0/1674569288 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff11406cc50 0x7ff11406f110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff11c005950 tx=0x7ff11c0058e0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:50:41.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.120+0000 7ff12cc00700 1 -- 172.21.15.142:0/1674569288 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7ff12005b2d0 con 0x7ff130107260 2024-04-20T21:50:41.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:50:41.355+0000 7ff136c00700 1 -- 172.21.15.142:0/1674569288 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff13002cde0 con 0x7ff11406cc50 2024-04-20T21:50:41.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:41 smithi164 ceph-mon[23506]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:41.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:41 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:50:42.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:42 smithi164 ceph-mon[23506]: Detected new or changed devices on smithi142 2024-04-20T21:50:42.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:42 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:42.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:42 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:42.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:42 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:50:42.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:42 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:50:42.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:42 smithi164 ceph-mon[23506]: Adjusting osd_memory_target on smithi142 to 5920M 2024-04-20T21:50:42.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:42 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:42.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:42 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:50:42.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:42 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:50:42.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:42 smithi164 ceph-mon[23506]: from='client.14290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:50:42.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:42 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:42.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:42 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T21:50:42.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:42 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T21:50:42.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:42 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:50:42.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:42 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:50:42.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:42 smithi164 ceph-mon[23506]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:42.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:42 smithi142 ceph-mon[15828]: Detected new or changed devices on smithi142 2024-04-20T21:50:42.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:42 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:42.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:42 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:42.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:42 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:50:42.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:42 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:50:42.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:42 smithi142 ceph-mon[15828]: Adjusting osd_memory_target on smithi142 to 5920M 2024-04-20T21:50:42.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:42 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:42.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:42 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:50:42.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:42 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:50:42.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:42 smithi142 ceph-mon[15828]: from='client.14290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:50:42.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:42 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:42.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:42 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T21:50:42.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:42 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T21:50:42.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:42 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:50:42.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:42 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:50:42.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:42 smithi142 ceph-mon[15828]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:45.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:45 smithi142 ceph-mon[15828]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:45.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:45 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:45.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:45 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:45.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:45 smithi164 ceph-mon[23506]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:45.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:45 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:45.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:45 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:46.404 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:46 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/283151326' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ea8215b-dc6f-4f18-9d2c-5a5b21e02fa8"}]: dispatch 2024-04-20T21:50:46.404 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:46 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/283151326' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ea8215b-dc6f-4f18-9d2c-5a5b21e02fa8"}]': finished 2024-04-20T21:50:46.404 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:46 smithi142 ceph-mon[15828]: osdmap e16: 3 total, 2 up, 3 in 2024-04-20T21:50:46.404 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:46 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T21:50:46.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:46 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/283151326' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ea8215b-dc6f-4f18-9d2c-5a5b21e02fa8"}]: dispatch 2024-04-20T21:50:46.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:46 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/283151326' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ea8215b-dc6f-4f18-9d2c-5a5b21e02fa8"}]': finished 2024-04-20T21:50:46.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:46 smithi164 ceph-mon[23506]: osdmap e16: 3 total, 2 up, 3 in 2024-04-20T21:50:46.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:46 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T21:50:47.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:47 smithi142 ceph-mon[15828]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:47.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:47 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1779870270' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T21:50:47.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:47 smithi164 ceph-mon[23506]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:47.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:47 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/1779870270' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T21:50:49.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:49 smithi142 ceph-mon[15828]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:49.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:49 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:49.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:49 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:49.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:49 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:50:49.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:49 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:50:49.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:49 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:49.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:49 smithi164 ceph-mon[23506]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:49.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:49 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:49.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:49 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:49.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:49 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:50:49.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:49 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:50:49.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:49 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:50:51.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:51 smithi142 ceph-mon[15828]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:51.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:51 smithi164 ceph-mon[23506]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:53.428 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:53 smithi142 ceph-mon[15828]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:53.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:53 smithi164 ceph-mon[23506]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:55.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:55 smithi142 ceph-mon[15828]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:55.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-20T21:50:55.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:50:55.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:55 smithi164 ceph-mon[23506]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:55.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-20T21:50:55.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:50:56.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:56 smithi164 ceph-mon[23506]: Deploying daemon osd.2 on smithi142 2024-04-20T21:50:56.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:56 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:50:56.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:56 smithi142 ceph-mon[15828]: Deploying daemon osd.2 on smithi142 2024-04-20T21:50:56.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:56 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:50:57.414 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:57 smithi142 ceph-mon[15828]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:57.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:57 smithi164 ceph-mon[23506]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:59.372 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:50:59 smithi142 ceph-mon[15828]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:50:59.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:50:59 smithi164 ceph-mon[23506]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:51:00.308 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:00 smithi142 ceph-mon[15828]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:51:00.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:00 smithi164 ceph-mon[23506]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:51:03.277 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:03 smithi142 ceph-mon[15828]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:51:03.277 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:03 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:03.277 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:03 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:51:03.278 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:03 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:03.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:03 smithi164 ceph-mon[23506]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:51:03.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:03 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:03.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:03 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:51:03.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:03 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:05.330 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:05 smithi142 ceph-mon[15828]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:51:05.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:05 smithi164 ceph-mon[23506]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:51:07.166 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:07 smithi142 ceph-mon[15828]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:51:07.166 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:07 smithi142 ceph-mon[15828]: from='osd.2 [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-20T21:51:07.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:07 smithi164 ceph-mon[23506]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:51:07.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:07 smithi164 ceph-mon[23506]: from='osd.2 [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-20T21:51:07.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:51:07.955+0000 7ff12cc00700 1 -- 172.21.15.142:0/1674569288 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff13002cde0 con 0x7ff11406cc50 2024-04-20T21:51:07.956 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 2 on host 'smithi142' 2024-04-20T21:51:07.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:51:07.959+0000 7ff136c00700 1 -- 172.21.15.142:0/1674569288 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff11406cc50 msgr2=0x7ff11406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:51:07.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:51:07.959+0000 7ff136c00700 1 --2- 172.21.15.142:0/1674569288 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff11406cc50 0x7ff11406f110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff11c005950 tx=0x7ff11c0058e0 comp rx=0 tx=0).stop 2024-04-20T21:51:07.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:51:07.959+0000 7ff136c00700 1 -- 172.21.15.142:0/1674569288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff130107260 msgr2=0x7ff13019cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:51:07.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:51:07.959+0000 7ff136c00700 1 --2- 172.21.15.142:0/1674569288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff130107260 0x7ff13019cc10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff120006010 tx=0x7ff12000be20 comp rx=0 tx=0).stop 2024-04-20T21:51:07.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:51:07.960+0000 7ff136c00700 1 -- 172.21.15.142:0/1674569288 shutdown_connections 2024-04-20T21:51:07.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:51:07.960+0000 7ff136c00700 1 --2- 172.21.15.142:0/1674569288 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff11406cc50 0x7ff11406f110 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:51:07.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:51:07.960+0000 7ff136c00700 1 --2- 172.21.15.142:0/1674569288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff130107260 0x7ff13019cc10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:51:07.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:51:07.960+0000 7ff136c00700 1 --2- 172.21.15.142:0/1674569288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff130108430 0x7ff13019d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:51:07.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:51:07.960+0000 7ff136c00700 1 -- 172.21.15.142:0/1674569288 >> 172.21.15.142:0/1674569288 conn(0x7ff130076400 msgr2=0x7ff13010b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:51:07.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:51:07.960+0000 7ff136c00700 1 -- 172.21.15.142:0/1674569288 shutdown_connections 2024-04-20T21:51:07.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:51:07.960+0000 7ff136c00700 1 -- 172.21.15.142:0/1674569288 wait complete. 2024-04-20T21:51:08.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:08 smithi142 ceph-mon[15828]: from='osd.2 [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-20T21:51:08.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:08 smithi142 ceph-mon[15828]: osdmap e17: 3 total, 2 up, 3 in 2024-04-20T21:51:08.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:08 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T21:51:08.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:08 smithi142 ceph-mon[15828]: from='osd.2 [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-04-20T21:51:08.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:08 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:08.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:08 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:08.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:08 smithi142 ceph-mon[15828]: from='osd.2 [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-04-20T21:51:08.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:08 smithi142 ceph-mon[15828]: osdmap e18: 3 total, 2 up, 3 in 2024-04-20T21:51:08.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:08 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T21:51:08.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:08 smithi164 ceph-mon[23506]: from='osd.2 [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-20T21:51:08.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:08 smithi164 ceph-mon[23506]: osdmap e17: 3 total, 2 up, 3 in 2024-04-20T21:51:08.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:08 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T21:51:08.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:08 smithi164 ceph-mon[23506]: from='osd.2 [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-04-20T21:51:08.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:08 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:08.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:08 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:08.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:08 smithi164 ceph-mon[23506]: from='osd.2 [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-04-20T21:51:08.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:08 smithi164 ceph-mon[23506]: osdmap e18: 3 total, 2 up, 3 in 2024-04-20T21:51:08.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:08 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T21:51:09.348 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:09 smithi142 ceph-mon[15828]: pgmap v94: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:51:09.348 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:09 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T21:51:09.394 DEBUG:teuthology.orchestra.run.smithi142:osd.2> sudo journalctl -f -n 0 -u ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.2.service 2024-04-20T21:51:09.401 INFO:tasks.cephadm:Deploying osd.3 on smithi164 with /dev/vg_nvme/lv_4... 2024-04-20T21:51:09.401 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-20T21:51:09.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:09 smithi164 ceph-mon[23506]: pgmap v94: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:51:09.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:09 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T21:51:09.798 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi164/config 2024-04-20T21:51:10.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:10 smithi142 ceph-mon[15828]: purged_snaps scrub starts 2024-04-20T21:51:10.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:10 smithi142 ceph-mon[15828]: purged_snaps scrub ok 2024-04-20T21:51:10.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:10 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T21:51:10.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:10 smithi142 ceph-mon[15828]: from='osd.2 [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263]' entity='osd.2' 2024-04-20T21:51:10.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:10 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T21:51:10.237 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:10 smithi164 ceph-mon[23506]: purged_snaps scrub starts 2024-04-20T21:51:10.237 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:10 smithi164 ceph-mon[23506]: purged_snaps scrub ok 2024-04-20T21:51:10.237 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:10 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T21:51:10.237 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:10 smithi164 ceph-mon[23506]: from='osd.2 [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263]' entity='osd.2' 2024-04-20T21:51:10.237 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:10 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T21:51:11.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:11 smithi142 ceph-mon[15828]: pgmap v96: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:51:11.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:11 smithi142 ceph-mon[15828]: osd.2 [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263] boot 2024-04-20T21:51:11.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:11 smithi142 ceph-mon[15828]: osdmap e19: 3 total, 3 up, 3 in 2024-04-20T21:51:11.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:11 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T21:51:11.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:11 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:51:11.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:11 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-20T21:51:11.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:11 smithi164 ceph-mon[23506]: pgmap v96: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-04-20T21:51:11.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:11 smithi164 ceph-mon[23506]: osd.2 [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263] boot 2024-04-20T21:51:11.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:11 smithi164 ceph-mon[23506]: osdmap e19: 3 total, 3 up, 3 in 2024-04-20T21:51:11.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:11 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T21:51:11.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:11 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:51:11.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:11 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-20T21:51:12.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:12 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-20T21:51:12.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:12 smithi142 ceph-mon[15828]: osdmap e20: 3 total, 3 up, 3 in 2024-04-20T21:51:12.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:12 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-20T21:51:12.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:12 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:12.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:12 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:12 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-20T21:51:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:12 smithi164 ceph-mon[23506]: osdmap e20: 3 total, 3 up, 3 in 2024-04-20T21:51:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:12 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-20T21:51:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:12 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:12 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:12.768 INFO:teuthology.orchestra.run.smithi164.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-20T21:51:12.768 INFO:teuthology.orchestra.run.smithi164.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-20T21:51:12.768 INFO:teuthology.orchestra.run.smithi164.stderr: stderr: 10+0 records in 2024-04-20T21:51:12.769 INFO:teuthology.orchestra.run.smithi164.stderr:10+0 records out 2024-04-20T21:51:12.769 INFO:teuthology.orchestra.run.smithi164.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0362714 s, 289 MB/s 2024-04-20T21:51:12.769 INFO:teuthology.orchestra.run.smithi164.stderr:--> Zapping successful for: 2024-04-20T21:51:13.413 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:13 smithi164 ceph-mon[23506]: pgmap v99: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:13.413 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:13 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-20T21:51:13.413 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:13 smithi164 ceph-mon[23506]: osdmap e21: 3 total, 3 up, 3 in 2024-04-20T21:51:13.413 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:13 smithi164 ceph-mon[23506]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-20T21:51:13.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:13 smithi142 ceph-mon[15828]: pgmap v99: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:13.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:13 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-20T21:51:13.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:13 smithi142 ceph-mon[15828]: osdmap e21: 3 total, 3 up, 3 in 2024-04-20T21:51:13.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:13 smithi142 ceph-mon[15828]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-20T21:51:13.445 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 21:51:13 smithi142 sudo[51443]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-20T21:51:13.446 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 21:51:13 smithi142 sudo[51443]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T21:51:13.446 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 21:51:13 smithi142 sudo[51443]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T21:51:13.446 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 21:51:13 smithi142 sudo[51443]: pam_unix(sudo:session): session closed for user root 2024-04-20T21:51:13.666 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph orch daemon add osd smithi164:vg_nvme/lv_4 2024-04-20T21:51:13.808 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 21:51:13 smithi142 sudo[51502]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-20T21:51:13.809 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 21:51:13 smithi142 sudo[51502]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T21:51:13.809 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 21:51:13 smithi142 sudo[51502]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T21:51:13.809 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 21:51:13 smithi142 sudo[51502]: pam_unix(sudo:session): session closed for user root 2024-04-20T21:51:14.073 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi164/config 2024-04-20T21:51:14.378 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:14 smithi164 ceph-mon[23506]: osdmap e22: 3 total, 3 up, 3 in 2024-04-20T21:51:14.378 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:14 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:14.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:14 smithi142 ceph-mon[15828]: osdmap e22: 3 total, 3 up, 3 in 2024-04-20T21:51:14.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:14 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:14.445 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 21:51:14 smithi142 sudo[51524]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-20T21:51:14.446 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 21:51:14 smithi142 sudo[51524]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T21:51:14.446 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 21:51:14 smithi142 sudo[51524]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T21:51:14.446 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 21:51:14 smithi142 sudo[51524]: pam_unix(sudo:session): session closed for user root 2024-04-20T21:51:15.179 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 21:51:14 smithi142 sudo[51546]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-20T21:51:15.179 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 21:51:14 smithi142 sudo[51546]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T21:51:15.179 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 21:51:14 smithi142 sudo[51546]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T21:51:15.179 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 21:51:14 smithi142 sudo[51546]: pam_unix(sudo:session): session closed for user root 2024-04-20T21:51:15.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:15 smithi142 ceph-mon[15828]: pgmap v102: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:15.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:15 smithi142 ceph-mon[15828]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-20T21:51:15.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:15 smithi142 ceph-mon[15828]: Cluster is now healthy 2024-04-20T21:51:15.180 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:15 smithi142 ceph-mon[15828]: mgrmap e19: smithi142.zzmcfz(active, since 3m), standbys: smithi164.oejajr 2024-04-20T21:51:15.343 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:15 smithi164 ceph-mon[23506]: pgmap v102: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:15.343 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:15 smithi164 ceph-mon[23506]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-20T21:51:15.343 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:15 smithi164 ceph-mon[23506]: Cluster is now healthy 2024-04-20T21:51:15.343 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:15 smithi164 ceph-mon[23506]: mgrmap e19: smithi142.zzmcfz(active, since 3m), standbys: smithi164.oejajr 2024-04-20T21:51:15.945 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 21:51:15 smithi142 sudo[51557]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-20T21:51:15.946 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 21:51:15 smithi142 sudo[51557]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T21:51:15.946 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 21:51:15 smithi142 sudo[51557]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T21:51:15.946 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 21:51:15 smithi142 sudo[51557]: pam_unix(sudo:session): session closed for user root 2024-04-20T21:51:16.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.146+0000 7f9357a00700 1 -- 172.21.15.164:0/162841798 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93500ffaf0 msgr2=0x7f93500fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:51:16.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.146+0000 7f9357a00700 1 --2- 172.21.15.164:0/162841798 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93500ffaf0 0x7f93500fff10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9344009910 tx=0x7f9344009c20 comp rx=0 tx=0).stop 2024-04-20T21:51:16.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.146+0000 7f9357a00700 1 -- 172.21.15.164:0/162841798 shutdown_connections 2024-04-20T21:51:16.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.146+0000 7f9357a00700 1 --2- 172.21.15.164:0/162841798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9350100cf0 0x7f9350101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:51:16.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.146+0000 7f9357a00700 1 --2- 172.21.15.164:0/162841798 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93500ffaf0 0x7f93500fff10 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:51:16.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.146+0000 7f9357a00700 1 -- 172.21.15.164:0/162841798 >> 172.21.15.164:0/162841798 conn(0x7f93500fb0d0 msgr2=0x7f93500fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:51:16.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.146+0000 7f9357a00700 1 -- 172.21.15.164:0/162841798 shutdown_connections 2024-04-20T21:51:16.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.146+0000 7f9357a00700 1 -- 172.21.15.164:0/162841798 wait complete. 2024-04-20T21:51:16.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.147+0000 7f9357a00700 1 Processor -- start 2024-04-20T21:51:16.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.148+0000 7f9357a00700 1 -- start start 2024-04-20T21:51:16.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.148+0000 7f9357a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93500ffaf0 0x7f9350198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:51:16.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.148+0000 7f9357a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9350100cf0 0x7f9350198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:51:16.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.148+0000 7f9357a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9350199470 con 0x7f9350100cf0 2024-04-20T21:51:16.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.148+0000 7f9357a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93501995b0 con 0x7f93500ffaf0 2024-04-20T21:51:16.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.148+0000 7f9355000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93500ffaf0 0x7f9350198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:51:16.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.148+0000 7f9355000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93500ffaf0 0x7f9350198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34382/0 (socket says 172.21.15.164:34382) 2024-04-20T21:51:16.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.148+0000 7f9355000700 1 -- 172.21.15.164:0/1133910307 learned_addr learned my addr 172.21.15.164:0/1133910307 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:51:16.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.149+0000 7f934fe00700 1 --2- 172.21.15.164:0/1133910307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9350100cf0 0x7f9350198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:51:16.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.149+0000 7f9355000700 1 -- 172.21.15.164:0/1133910307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9350100cf0 msgr2=0x7f9350198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:51:16.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.149+0000 7f9355000700 1 --2- 172.21.15.164:0/1133910307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9350100cf0 0x7f9350198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:51:16.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.149+0000 7f9355000700 1 -- 172.21.15.164:0/1133910307 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93440095f0 con 0x7f93500ffaf0 2024-04-20T21:51:16.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.149+0000 7f9355000700 1 --2- 172.21.15.164:0/1133910307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93500ffaf0 0x7f9350198910 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f934400bd70 tx=0x7f934400be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:51:16.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.149+0000 7f934d600700 1 -- 172.21.15.164:0/1133910307 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f934401d070 con 0x7f93500ffaf0 2024-04-20T21:51:16.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.149+0000 7f934d600700 1 -- 172.21.15.164:0/1133910307 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f934400f460 con 0x7f93500ffaf0 2024-04-20T21:51:16.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.150+0000 7f9357a00700 1 -- 172.21.15.164:0/1133910307 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935019dfb0 con 0x7f93500ffaf0 2024-04-20T21:51:16.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.150+0000 7f934d600700 1 -- 172.21.15.164:0/1133910307 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9344021600 con 0x7f93500ffaf0 2024-04-20T21:51:16.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.150+0000 7f9357a00700 1 -- 172.21.15.164:0/1133910307 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f935019e4a0 con 0x7f93500ffaf0 2024-04-20T21:51:16.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.151+0000 7f9357a00700 1 -- 172.21.15.164:0/1133910307 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9350062510 con 0x7f93500ffaf0 2024-04-20T21:51:16.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.152+0000 7f934d600700 1 -- 172.21.15.164:0/1133910307 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f934400fa50 con 0x7f93500ffaf0 2024-04-20T21:51:16.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.153+0000 7f934d600700 1 --2- 172.21.15.164:0/1133910307 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f933806cce0 0x7f933806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:51:16.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.153+0000 7f934d600700 1 -- 172.21.15.164:0/1133910307 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3232+0+0 (secure 0 0 0) 0x7f934408cbe0 con 0x7f93500ffaf0 2024-04-20T21:51:16.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.153+0000 7f934fe00700 1 --2- 172.21.15.164:0/1133910307 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f933806cce0 0x7f933806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:51:16.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.154+0000 7f934fe00700 1 --2- 172.21.15.164:0/1133910307 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f933806cce0 0x7f933806f1a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f933c006fd0 tx=0x7f933c008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:51:16.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.159+0000 7f934d600700 1 -- 172.21.15.164:0/1133910307 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f934405b380 con 0x7f93500ffaf0 2024-04-20T21:51:16.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:16.390+0000 7f9357a00700 1 -- 172.21.15.164:0/1133910307 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f9350068cd0 con 0x7f933806cce0 2024-04-20T21:51:16.445 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 21:51:16 smithi142 sudo[51581]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-20T21:51:16.445 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 21:51:16 smithi142 sudo[51581]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T21:51:16.445 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 21:51:16 smithi142 sudo[51581]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T21:51:16.445 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 21:51:16 smithi142 sudo[51581]: pam_unix(sudo:session): session closed for user root 2024-04-20T21:51:16.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:16 smithi142 sudo[53117]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-20T21:51:16.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:16 smithi142 sudo[53117]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T21:51:16.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:16 smithi142 sudo[53117]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T21:51:16.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:16 smithi142 sudo[53117]: pam_unix(sudo:session): session closed for user root 2024-04-20T21:51:17.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:17 smithi142 sudo[53840]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-20T21:51:17.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:17 smithi142 sudo[53840]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T21:51:17.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:17 smithi142 sudo[53840]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T21:51:17.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:17 smithi142 sudo[53840]: pam_unix(sudo:session): session closed for user root 2024-04-20T21:51:18.119 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:17 smithi164 sudo[27268]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-20T21:51:18.120 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:17 smithi164 sudo[27268]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T21:51:18.120 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:17 smithi164 sudo[27268]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T21:51:18.120 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:17 smithi164 sudo[27268]: pam_unix(sudo:session): session closed for user root 2024-04-20T21:51:18.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:18 smithi164 sudo[27317]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-20T21:51:18.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:18 smithi164 sudo[27317]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T21:51:18.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:18 smithi164 sudo[27317]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T21:51:18.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:18 smithi164 sudo[27317]: pam_unix(sudo:session): session closed for user root 2024-04-20T21:51:18.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:18 smithi164 ceph-mon[23506]: pgmap v103: 1 pgs: 1 creating+peering; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:18.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:18 smithi164 ceph-mon[23506]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-20T21:51:18.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:18 smithi164 ceph-mon[23506]: from='client.24133 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:51:18.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:18 smithi164 ceph-mon[23506]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-20T21:51:18.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:18 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T21:51:18.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:18 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:51:18.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:18 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T21:51:18.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:18 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T21:51:18.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:18 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:51:18.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:18 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T21:51:18.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:18 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:51:18.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:18 smithi142 ceph-mon[15828]: pgmap v103: 1 pgs: 1 creating+peering; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:18.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:18 smithi142 ceph-mon[15828]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-20T21:51:18.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:18 smithi142 ceph-mon[15828]: from='client.24133 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:51:18.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:18 smithi142 ceph-mon[15828]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-20T21:51:18.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:18 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T21:51:18.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:18 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:51:18.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:18 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T21:51:18.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:18 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T21:51:18.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:18 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:51:18.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:18 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T21:51:18.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:18 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:51:19.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:19 smithi142 ceph-mon[15828]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-20T21:51:19.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:19 smithi142 ceph-mon[15828]: Detected new or changed devices on smithi142 2024-04-20T21:51:19.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:19 smithi142 ceph-mon[15828]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:19.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:19 smithi142 ceph-mon[15828]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-20T21:51:19.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:19 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:19.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:19 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:19.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:19 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:51:19.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:19 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:51:19.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:19 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:51:19.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:19 smithi142 ceph-mon[15828]: Adjusting osd_memory_target on smithi142 to 3947M 2024-04-20T21:51:19.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:19 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:19.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:19 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:19.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:19 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:51:19.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:19 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:51:19.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:19 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:19.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:19 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:51:19.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:19 smithi164 ceph-mon[23506]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-20T21:51:19.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:19 smithi164 ceph-mon[23506]: Detected new or changed devices on smithi142 2024-04-20T21:51:19.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:19 smithi164 ceph-mon[23506]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:19.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:19 smithi164 ceph-mon[23506]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-20T21:51:19.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:19 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:19.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:19 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:19.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:19 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:51:19.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:19 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:51:19.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:19 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:51:19.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:19 smithi164 ceph-mon[23506]: Adjusting osd_memory_target on smithi142 to 3947M 2024-04-20T21:51:19.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:19 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:19.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:19 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:19.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:19 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:51:19.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:19 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:51:19.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:19 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:19.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:19 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:51:20.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:20 smithi142 ceph-mon[15828]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:20.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:20 smithi164 ceph-mon[23506]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:21.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:21 smithi164 ceph-mon[23506]: from='client.? 172.21.15.164:0/3985373743' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "981987e0-cff5-42e9-8129-2a08175c6ce1"}]: dispatch 2024-04-20T21:51:21.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:21 smithi164 ceph-mon[23506]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "981987e0-cff5-42e9-8129-2a08175c6ce1"}]: dispatch 2024-04-20T21:51:21.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:21 smithi164 ceph-mon[23506]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "981987e0-cff5-42e9-8129-2a08175c6ce1"}]': finished 2024-04-20T21:51:21.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:21 smithi164 ceph-mon[23506]: osdmap e23: 4 total, 3 up, 4 in 2024-04-20T21:51:21.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:21 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:51:21.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:21 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/3985373743' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "981987e0-cff5-42e9-8129-2a08175c6ce1"}]: dispatch 2024-04-20T21:51:21.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:21 smithi142 ceph-mon[15828]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "981987e0-cff5-42e9-8129-2a08175c6ce1"}]: dispatch 2024-04-20T21:51:21.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:21 smithi142 ceph-mon[15828]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "981987e0-cff5-42e9-8129-2a08175c6ce1"}]': finished 2024-04-20T21:51:21.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:21 smithi142 ceph-mon[15828]: osdmap e23: 4 total, 3 up, 4 in 2024-04-20T21:51:21.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:21 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:51:22.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:22 smithi164 ceph-mon[23506]: from='client.? 172.21.15.164:0/136074433' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T21:51:22.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:22 smithi164 ceph-mon[23506]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-04-20T21:51:22.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:22 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/136074433' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T21:51:22.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:22 smithi142 ceph-mon[15828]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-04-20T21:51:25.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:25 smithi164 ceph-mon[23506]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-20T21:51:25.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:25 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:25.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:25 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:25.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:25 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:51:25.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:25 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:51:25.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:25 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:25.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:25 smithi142 ceph-mon[15828]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-20T21:51:25.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:25 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:25.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:25 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:25.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:25 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:51:25.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:25 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:51:25.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:25 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:26.123 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:26 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:51:26.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:26 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:51:27.321 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:27 smithi164 ceph-mon[23506]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-20T21:51:27.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:27 smithi142 ceph-mon[15828]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-20T21:51:29.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:29 smithi164 ceph-mon[23506]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-20T21:51:29.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:29 smithi142 ceph-mon[15828]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-20T21:51:31.366 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:31 smithi164 ceph-mon[23506]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-20T21:51:31.366 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:31 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-20T21:51:31.366 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:31 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:51:31.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:31 smithi142 ceph-mon[15828]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-20T21:51:31.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:31 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-20T21:51:31.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:31 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:51:32.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:32 smithi164 ceph-mon[23506]: Deploying daemon osd.3 on smithi164 2024-04-20T21:51:32.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:32 smithi142 ceph-mon[15828]: Deploying daemon osd.3 on smithi164 2024-04-20T21:51:33.407 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:33 smithi164 ceph-mon[23506]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 71 KiB/s wr, 5 op/s 2024-04-20T21:51:33.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:33 smithi142 ceph-mon[15828]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 71 KiB/s wr, 5 op/s 2024-04-20T21:51:35.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:35 smithi164 ceph-mon[23506]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:35.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:35 smithi142 ceph-mon[15828]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:37.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:37 smithi142 ceph-mon[15828]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:37.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:37 smithi164 ceph-mon[23506]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:39.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:39 smithi142 ceph-mon[15828]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:39.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:39 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:39.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:39 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:39.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:39 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:51:39.350 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:39 smithi164 ceph-mon[23506]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:39.350 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:39 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:39.351 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:39 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:39.351 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:39 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:51:41.339 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:41 smithi164 ceph-mon[23506]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:41.339 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:41 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:51:41.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:41 smithi142 ceph-mon[15828]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:41.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:41 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:51:43.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:43.046+0000 7f934d600700 1 -- 172.21.15.164:0/1133910307 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9350068cd0 con 0x7f933806cce0 2024-04-20T21:51:43.046 INFO:teuthology.orchestra.run.smithi164.stdout:Created osd(s) 3 on host 'smithi164' 2024-04-20T21:51:43.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:43.050+0000 7f9357a00700 1 -- 172.21.15.164:0/1133910307 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f933806cce0 msgr2=0x7f933806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:51:43.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:43.050+0000 7f9357a00700 1 --2- 172.21.15.164:0/1133910307 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f933806cce0 0x7f933806f1a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f933c006fd0 tx=0x7f933c008040 comp rx=0 tx=0).stop 2024-04-20T21:51:43.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:43.050+0000 7f9357a00700 1 -- 172.21.15.164:0/1133910307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93500ffaf0 msgr2=0x7f9350198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:51:43.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:43.050+0000 7f9357a00700 1 --2- 172.21.15.164:0/1133910307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93500ffaf0 0x7f9350198910 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f934400bd70 tx=0x7f934400be50 comp rx=0 tx=0).stop 2024-04-20T21:51:43.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:43.050+0000 7f9357a00700 1 -- 172.21.15.164:0/1133910307 shutdown_connections 2024-04-20T21:51:43.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:43.050+0000 7f9357a00700 1 --2- 172.21.15.164:0/1133910307 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f933806cce0 0x7f933806f1a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:51:43.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:43.050+0000 7f9357a00700 1 --2- 172.21.15.164:0/1133910307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93500ffaf0 0x7f9350198910 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:51:43.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:43.050+0000 7f9357a00700 1 --2- 172.21.15.164:0/1133910307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9350100cf0 0x7f9350198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:51:43.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:43.050+0000 7f9357a00700 1 -- 172.21.15.164:0/1133910307 >> 172.21.15.164:0/1133910307 conn(0x7f93500fb0d0 msgr2=0x7f93500685c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:51:43.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:43.050+0000 7f9357a00700 1 -- 172.21.15.164:0/1133910307 shutdown_connections 2024-04-20T21:51:43.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:43.050+0000 7f9357a00700 1 -- 172.21.15.164:0/1133910307 wait complete. 2024-04-20T21:51:43.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:43 smithi142 ceph-mon[15828]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:43.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:43 smithi142 ceph-mon[15828]: from='osd.3 [v2:172.21.15.164:6800/4283809575,v1:172.21.15.164:6801/4283809575]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-20T21:51:43.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:43 smithi142 ceph-mon[15828]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-20T21:51:43.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:43 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:43.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:43 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:43.419 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:43 smithi164 ceph-mon[23506]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:43.419 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:43 smithi164 ceph-mon[23506]: from='osd.3 [v2:172.21.15.164:6800/4283809575,v1:172.21.15.164:6801/4283809575]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-20T21:51:43.420 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:43 smithi164 ceph-mon[23506]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-20T21:51:43.420 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:43 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:43.420 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:43 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:43.858 DEBUG:teuthology.orchestra.run.smithi164:osd.3> sudo journalctl -f -n 0 -u ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.3.service 2024-04-20T21:51:43.864 INFO:tasks.cephadm:Deploying osd.4 on smithi164 with /dev/vg_nvme/lv_3... 2024-04-20T21:51:43.864 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-20T21:51:44.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:44 smithi164 ceph-mon[23506]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-20T21:51:44.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:44 smithi164 ceph-mon[23506]: osdmap e24: 4 total, 3 up, 4 in 2024-04-20T21:51:44.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:44 smithi164 ceph-mon[23506]: from='osd.3 [v2:172.21.15.164:6800/4283809575,v1:172.21.15.164:6801/4283809575]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T21:51:44.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:44 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:51:44.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:44 smithi164 ceph-mon[23506]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T21:51:44.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:44 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:44.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:44 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:44.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:44 smithi164 ceph-mon[23506]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-04-20T21:51:44.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:44 smithi142 ceph-mon[15828]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-20T21:51:44.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:44 smithi142 ceph-mon[15828]: osdmap e24: 4 total, 3 up, 4 in 2024-04-20T21:51:44.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:44 smithi142 ceph-mon[15828]: from='osd.3 [v2:172.21.15.164:6800/4283809575,v1:172.21.15.164:6801/4283809575]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T21:51:44.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:51:44.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:44 smithi142 ceph-mon[15828]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T21:51:44.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:44.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:44.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:44 smithi142 ceph-mon[15828]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-04-20T21:51:45.301 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:45 smithi164 ceph-mon[23506]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:45.302 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:45 smithi164 ceph-mon[23506]: osdmap e25: 4 total, 3 up, 4 in 2024-04-20T21:51:45.302 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:45 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:51:45.302 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:45 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:51:45.302 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 21:51:45 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3[29535]: 2024-04-20T21:51:45.121+0000 7f8c0fc00700 -1 osd.3 0 waiting for initial osdmap 2024-04-20T21:51:45.302 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 21:51:45 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3[29535]: 2024-04-20T21:51:45.139+0000 7f8c06400700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T21:51:45.417 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi164/config 2024-04-20T21:51:45.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:45 smithi142 ceph-mon[15828]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:45.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:45 smithi142 ceph-mon[15828]: osdmap e25: 4 total, 3 up, 4 in 2024-04-20T21:51:45.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:45 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:51:45.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:45 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:51:46.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:46 smithi164 ceph-mon[23506]: purged_snaps scrub starts 2024-04-20T21:51:46.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:46 smithi164 ceph-mon[23506]: purged_snaps scrub ok 2024-04-20T21:51:46.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:46 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:51:46.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:46 smithi164 ceph-mon[23506]: osdmap e26: 4 total, 3 up, 4 in 2024-04-20T21:51:46.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:46 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:51:46.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:46 smithi164 ceph-mon[23506]: from='osd.3 ' entity='osd.3' 2024-04-20T21:51:46.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:46 smithi142 ceph-mon[15828]: purged_snaps scrub starts 2024-04-20T21:51:46.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:46 smithi142 ceph-mon[15828]: purged_snaps scrub ok 2024-04-20T21:51:46.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:46 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:51:46.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:46 smithi142 ceph-mon[15828]: osdmap e26: 4 total, 3 up, 4 in 2024-04-20T21:51:46.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:46 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:51:46.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:46 smithi142 ceph-mon[15828]: from='osd.3 ' entity='osd.3' 2024-04-20T21:51:47.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:47 smithi164 ceph-mon[23506]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:47.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:47 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:51:47.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:47 smithi164 ceph-mon[23506]: osd.3 [v2:172.21.15.164:6800/4283809575,v1:172.21.15.164:6801/4283809575] boot 2024-04-20T21:51:47.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:47 smithi164 ceph-mon[23506]: osdmap e27: 4 total, 4 up, 4 in 2024-04-20T21:51:47.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:47 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:51:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:47 smithi142 ceph-mon[15828]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-04-20T21:51:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:47 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:51:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:47 smithi142 ceph-mon[15828]: osd.3 [v2:172.21.15.164:6800/4283809575,v1:172.21.15.164:6801/4283809575] boot 2024-04-20T21:51:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:47 smithi142 ceph-mon[15828]: osdmap e27: 4 total, 4 up, 4 in 2024-04-20T21:51:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:47 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:51:48.357 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:48 smithi164 ceph-mon[23506]: osdmap e28: 4 total, 4 up, 4 in 2024-04-20T21:51:48.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:48 smithi142 ceph-mon[15828]: osdmap e28: 4 total, 4 up, 4 in 2024-04-20T21:51:48.976 INFO:teuthology.orchestra.run.smithi164.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-20T21:51:48.976 INFO:teuthology.orchestra.run.smithi164.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-20T21:51:48.977 INFO:teuthology.orchestra.run.smithi164.stderr: stderr: 10+0 records in 2024-04-20T21:51:48.977 INFO:teuthology.orchestra.run.smithi164.stderr:10+0 records out 2024-04-20T21:51:48.977 INFO:teuthology.orchestra.run.smithi164.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0354167 s, 296 MB/s 2024-04-20T21:51:48.977 INFO:teuthology.orchestra.run.smithi164.stderr:--> Zapping successful for: 2024-04-20T21:51:49.397 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:49 smithi164 ceph-mon[23506]: pgmap v125: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:51:49.397 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:49 smithi164 ceph-mon[23506]: osdmap e29: 4 total, 4 up, 4 in 2024-04-20T21:51:49.397 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:49 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:49.397 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:49 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:49.397 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:49 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:51:49.397 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:49 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:49.397 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:49 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:51:49.397 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:49 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:51:49.397 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:49 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:49.397 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:49 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:51:49.398 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:49 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:51:49.398 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:49 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:51:49.398 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:49 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:49.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:49 smithi142 ceph-mon[15828]: pgmap v125: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:51:49.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:49 smithi142 ceph-mon[15828]: osdmap e29: 4 total, 4 up, 4 in 2024-04-20T21:51:49.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:49 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:49.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:49 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:49.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:49 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:51:49.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:49 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:49.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:49 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:51:49.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:49 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:51:49.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:49 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:49.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:49 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:51:49.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:49 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:51:49.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:49 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:51:49.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:49 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:51:49.783 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph orch daemon add osd smithi164:vg_nvme/lv_3 2024-04-20T21:51:50.183 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi164/config 2024-04-20T21:51:50.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:50 smithi142 ceph-mon[15828]: Detected new or changed devices on smithi164 2024-04-20T21:51:50.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:50 smithi142 ceph-mon[15828]: Adjusting osd_memory_target on smithi164 to 14913M 2024-04-20T21:51:50.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:50 smithi142 ceph-mon[15828]: osdmap e30: 4 total, 4 up, 4 in 2024-04-20T21:51:50.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:50 smithi142 ceph-mon[15828]: pgmap v128: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:51:50.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:50 smithi142 ceph-mon[15828]: osdmap e31: 4 total, 4 up, 4 in 2024-04-20T21:51:50.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:50 smithi164 ceph-mon[23506]: Detected new or changed devices on smithi164 2024-04-20T21:51:50.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:50 smithi164 ceph-mon[23506]: Adjusting osd_memory_target on smithi164 to 14913M 2024-04-20T21:51:50.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:50 smithi164 ceph-mon[23506]: osdmap e30: 4 total, 4 up, 4 in 2024-04-20T21:51:50.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:50 smithi164 ceph-mon[23506]: pgmap v128: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:51:50.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:50 smithi164 ceph-mon[23506]: osdmap e31: 4 total, 4 up, 4 in 2024-04-20T21:51:52.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.286+0000 7f45a2a00700 1 -- 172.21.15.164:0/2732743346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f459c107260 msgr2=0x7f459c107680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:51:52.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.286+0000 7f45a2a00700 1 --2- 172.21.15.164:0/2732743346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f459c107260 0x7f459c107680 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f458c009910 tx=0x7f458c009c20 comp rx=0 tx=0).stop 2024-04-20T21:51:52.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.287+0000 7f45a2a00700 1 -- 172.21.15.164:0/2732743346 shutdown_connections 2024-04-20T21:51:52.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.287+0000 7f45a2a00700 1 --2- 172.21.15.164:0/2732743346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f459c108430 0x7f459c1088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:51:52.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.287+0000 7f45a2a00700 1 --2- 172.21.15.164:0/2732743346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f459c107260 0x7f459c107680 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:51:52.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.287+0000 7f45a2a00700 1 -- 172.21.15.164:0/2732743346 >> 172.21.15.164:0/2732743346 conn(0x7f459c076400 msgr2=0x7f459c078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:51:52.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.287+0000 7f45a2a00700 1 -- 172.21.15.164:0/2732743346 shutdown_connections 2024-04-20T21:51:52.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.287+0000 7f45a2a00700 1 -- 172.21.15.164:0/2732743346 wait complete. 2024-04-20T21:51:52.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.289+0000 7f45a2a00700 1 Processor -- start 2024-04-20T21:51:52.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.289+0000 7f45a2a00700 1 -- start start 2024-04-20T21:51:52.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.289+0000 7f45a2a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f459c107260 0x7f459c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:51:52.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.289+0000 7f45a2a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f459c108430 0x7f459c19d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:51:52.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.289+0000 7f45a2a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c19d790 con 0x7f459c107260 2024-04-20T21:51:52.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.289+0000 7f45a2a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c19d8d0 con 0x7f459c108430 2024-04-20T21:51:52.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.290+0000 7f459b400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f459c108430 0x7f459c19d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:51:52.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.290+0000 7f459b400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f459c108430 0x7f459c19d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55356/0 (socket says 172.21.15.164:55356) 2024-04-20T21:51:52.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.290+0000 7f459b400700 1 -- 172.21.15.164:0/351859194 learned_addr learned my addr 172.21.15.164:0/351859194 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:51:52.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.290+0000 7f459be00700 1 --2- 172.21.15.164:0/351859194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f459c107260 0x7f459c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:51:52.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.290+0000 7f459b400700 1 -- 172.21.15.164:0/351859194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f459c107260 msgr2=0x7f459c19cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:51:52.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.290+0000 7f459b400700 1 --2- 172.21.15.164:0/351859194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f459c107260 0x7f459c19cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:51:52.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.290+0000 7f459b400700 1 -- 172.21.15.164:0/351859194 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458c0095f0 con 0x7f459c108430 2024-04-20T21:51:52.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.291+0000 7f459b400700 1 --2- 172.21.15.164:0/351859194 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f459c108430 0x7f459c19d170 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f458800e920 tx=0x7f458800ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:51:52.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.291+0000 7f4598c00700 1 -- 172.21.15.164:0/351859194 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4588009790 con 0x7f459c108430 2024-04-20T21:51:52.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.291+0000 7f45a2a00700 1 -- 172.21.15.164:0/351859194 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459c1a22e0 con 0x7f459c108430 2024-04-20T21:51:52.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.291+0000 7f4598c00700 1 -- 172.21.15.164:0/351859194 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f458800cba0 con 0x7f459c108430 2024-04-20T21:51:52.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.291+0000 7f4598c00700 1 -- 172.21.15.164:0/351859194 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4588018650 con 0x7f459c108430 2024-04-20T21:51:52.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.291+0000 7f45a2a00700 1 -- 172.21.15.164:0/351859194 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459c1a28b0 con 0x7f459c108430 2024-04-20T21:51:52.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.292+0000 7f45a2a00700 1 -- 172.21.15.164:0/351859194 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459c196dd0 con 0x7f459c108430 2024-04-20T21:51:52.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.294+0000 7f4598c00700 1 -- 172.21.15.164:0/351859194 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f458800cd10 con 0x7f459c108430 2024-04-20T21:51:52.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.295+0000 7f4598c00700 1 --2- 172.21.15.164:0/351859194 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f458006cce0 0x7f458006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:51:52.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.295+0000 7f4598c00700 1 -- 172.21.15.164:0/351859194 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3774+0+0 (secure 0 0 0) 0x7f4588014070 con 0x7f459c108430 2024-04-20T21:51:52.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.296+0000 7f459be00700 1 --2- 172.21.15.164:0/351859194 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f458006cce0 0x7f458006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:51:52.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.297+0000 7f459be00700 1 --2- 172.21.15.164:0/351859194 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f458006cce0 0x7f458006f1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f458c006010 tx=0x7f458c009f70 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:51:52.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.301+0000 7f4598c00700 1 -- 172.21.15.164:0/351859194 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f4588052c50 con 0x7f459c108430 2024-04-20T21:51:52.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:51:52.530+0000 7f45a2a00700 1 -- 172.21.15.164:0/351859194 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f459c02ceb0 con 0x7f458006cce0 2024-04-20T21:51:53.362 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:53 smithi164 ceph-mon[23506]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-04-20T21:51:53.363 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:53 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T21:51:53.363 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:53 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T21:51:53.363 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:53 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:51:53.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:53 smithi142 ceph-mon[15828]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-04-20T21:51:53.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:53 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T21:51:53.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:53 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T21:51:53.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:53 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:51:54.381 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:54 smithi164 ceph-mon[23506]: from='client.24153 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:51:54.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:54 smithi142 ceph-mon[15828]: from='client.24153 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:51:55.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:55 smithi142 ceph-mon[15828]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-20T21:51:55.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:55 smithi164 ceph-mon[23506]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-20T21:51:56.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:56 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:51:56.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:56 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:51:57.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:57 smithi164 ceph-mon[23506]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-20T21:51:57.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:57 smithi164 ceph-mon[23506]: from='client.? 172.21.15.164:0/2051093108' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a839fb7d-f82c-4bb0-8c33-b4f4f261bcae"}]: dispatch 2024-04-20T21:51:57.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:57 smithi164 ceph-mon[23506]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a839fb7d-f82c-4bb0-8c33-b4f4f261bcae"}]: dispatch 2024-04-20T21:51:57.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:57 smithi164 ceph-mon[23506]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a839fb7d-f82c-4bb0-8c33-b4f4f261bcae"}]': finished 2024-04-20T21:51:57.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:57 smithi164 ceph-mon[23506]: osdmap e32: 5 total, 4 up, 5 in 2024-04-20T21:51:57.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:57 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T21:51:57.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:57 smithi142 ceph-mon[15828]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-04-20T21:51:57.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:57 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/2051093108' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a839fb7d-f82c-4bb0-8c33-b4f4f261bcae"}]: dispatch 2024-04-20T21:51:57.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:57 smithi142 ceph-mon[15828]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a839fb7d-f82c-4bb0-8c33-b4f4f261bcae"}]: dispatch 2024-04-20T21:51:57.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:57 smithi142 ceph-mon[15828]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a839fb7d-f82c-4bb0-8c33-b4f4f261bcae"}]': finished 2024-04-20T21:51:57.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:57 smithi142 ceph-mon[15828]: osdmap e32: 5 total, 4 up, 5 in 2024-04-20T21:51:57.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:57 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T21:51:58.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:58 smithi164 ceph-mon[23506]: from='client.? 172.21.15.164:0/423541419' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T21:51:58.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:58 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/423541419' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T21:51:59.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:51:59 smithi142 ceph-mon[15828]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-20T21:51:59.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:51:59 smithi164 ceph-mon[23506]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-20T21:52:01.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:01 smithi164 ceph-mon[23506]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-20T21:52:01.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:01 smithi142 ceph-mon[15828]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-20T21:52:03.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:03 smithi164 ceph-mon[23506]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:03.379 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:03 smithi142 ceph-mon[15828]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:05.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:05 smithi164 ceph-mon[23506]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:05.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:05 smithi142 ceph-mon[15828]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:06.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:06 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-20T21:52:06.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:06 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:52:06.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:06 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-20T21:52:06.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:06 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:52:07.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:07 smithi164 ceph-mon[23506]: Deploying daemon osd.4 on smithi164 2024-04-20T21:52:07.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:07 smithi164 ceph-mon[23506]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:07.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:07 smithi142 ceph-mon[15828]: Deploying daemon osd.4 on smithi164 2024-04-20T21:52:07.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:07 smithi142 ceph-mon[15828]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:09.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:09 smithi142 ceph-mon[15828]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:09.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:09 smithi164 ceph-mon[23506]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:11.262 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:11 smithi164 ceph-mon[23506]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:11.262 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:11 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:52:11.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:11 smithi142 ceph-mon[15828]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:11.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:11 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:52:13.299 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:13 smithi164 ceph-mon[23506]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:13.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:13 smithi142 ceph-mon[15828]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:14.366 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:14 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:52:14.366 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:14 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:14.367 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:14 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:14.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:14 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:52:14.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:14 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:14.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:14 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:15.368 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:15 smithi164 ceph-mon[23506]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:15.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:15 smithi142 ceph-mon[15828]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:17.443 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:17 smithi164 ceph-mon[23506]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:17.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:17 smithi142 ceph-mon[15828]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:18.393 INFO:teuthology.orchestra.run.smithi164.stdout:Created osd(s) 4 on host 'smithi164' 2024-04-20T21:52:18.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:18.394+0000 7f4598c00700 1 -- 172.21.15.164:0/351859194 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f459c02ceb0 con 0x7f458006cce0 2024-04-20T21:52:18.394 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:18 smithi164 ceph-mon[23506]: from='osd.4 [v2:172.21.15.164:6808/3702640245,v1:172.21.15.164:6809/3702640245]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-20T21:52:18.394 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:18 smithi164 ceph-mon[23506]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-20T21:52:18.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:18.397+0000 7f45a2a00700 1 -- 172.21.15.164:0/351859194 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f458006cce0 msgr2=0x7f458006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:52:18.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:18.397+0000 7f45a2a00700 1 --2- 172.21.15.164:0/351859194 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f458006cce0 0x7f458006f1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f458c006010 tx=0x7f458c009f70 comp rx=0 tx=0).stop 2024-04-20T21:52:18.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:18.397+0000 7f45a2a00700 1 -- 172.21.15.164:0/351859194 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f459c108430 msgr2=0x7f459c19d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:52:18.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:18.397+0000 7f45a2a00700 1 --2- 172.21.15.164:0/351859194 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f459c108430 0x7f459c19d170 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f458800e920 tx=0x7f458800ece0 comp rx=0 tx=0).stop 2024-04-20T21:52:18.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:18.397+0000 7f45a2a00700 1 -- 172.21.15.164:0/351859194 shutdown_connections 2024-04-20T21:52:18.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:18.397+0000 7f45a2a00700 1 --2- 172.21.15.164:0/351859194 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f458006cce0 0x7f458006f1a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:52:18.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:18.397+0000 7f45a2a00700 1 --2- 172.21.15.164:0/351859194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f459c107260 0x7f459c19cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:52:18.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:18.397+0000 7f45a2a00700 1 --2- 172.21.15.164:0/351859194 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f459c108430 0x7f459c19d170 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:52:18.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:18.397+0000 7f45a2a00700 1 -- 172.21.15.164:0/351859194 >> 172.21.15.164:0/351859194 conn(0x7f459c076400 msgr2=0x7f459c10b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:52:18.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:18.398+0000 7f45a2a00700 1 -- 172.21.15.164:0/351859194 shutdown_connections 2024-04-20T21:52:18.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:18.398+0000 7f45a2a00700 1 -- 172.21.15.164:0/351859194 wait complete. 2024-04-20T21:52:18.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:18 smithi142 ceph-mon[15828]: from='osd.4 [v2:172.21.15.164:6808/3702640245,v1:172.21.15.164:6809/3702640245]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-20T21:52:18.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:18 smithi142 ceph-mon[15828]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-20T21:52:19.215 DEBUG:teuthology.orchestra.run.smithi164:osd.4> sudo journalctl -f -n 0 -u ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.4.service 2024-04-20T21:52:19.219 INFO:tasks.cephadm:Deploying osd.5 on smithi164 with /dev/vg_nvme/lv_2... 2024-04-20T21:52:19.220 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-20T21:52:19.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:19 smithi142 ceph-mon[15828]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:19.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:19 smithi142 ceph-mon[15828]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-20T21:52:19.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:19 smithi142 ceph-mon[15828]: osdmap e33: 5 total, 4 up, 5 in 2024-04-20T21:52:19.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:19 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T21:52:19.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:19 smithi142 ceph-mon[15828]: from='osd.4 [v2:172.21.15.164:6808/3702640245,v1:172.21.15.164:6809/3702640245]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T21:52:19.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:19 smithi142 ceph-mon[15828]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T21:52:19.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:19 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:19.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:19 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:19.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:19 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:19.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:19 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:19.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:19 smithi164 ceph-mon[23506]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:19.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:19 smithi164 ceph-mon[23506]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-20T21:52:19.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:19 smithi164 ceph-mon[23506]: osdmap e33: 5 total, 4 up, 5 in 2024-04-20T21:52:19.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:19 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T21:52:19.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:19 smithi164 ceph-mon[23506]: from='osd.4 [v2:172.21.15.164:6808/3702640245,v1:172.21.15.164:6809/3702640245]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T21:52:19.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:19 smithi164 ceph-mon[23506]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T21:52:19.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:19 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:19.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:19 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:19.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:19 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:19.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:19 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:19.708 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi164/config 2024-04-20T21:52:20.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:20 smithi164 ceph-mon[23506]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-04-20T21:52:20.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:20 smithi164 ceph-mon[23506]: osdmap e34: 5 total, 4 up, 5 in 2024-04-20T21:52:20.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:20 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T21:52:20.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:20 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T21:52:20.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:20 smithi164 ceph-mon[23506]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:20.446 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 21:52:20 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[36403]: 2024-04-20T21:52:20.305+0000 7f5dbf800700 -1 osd.4 0 waiting for initial osdmap 2024-04-20T21:52:20.446 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 21:52:20 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[36403]: 2024-04-20T21:52:20.333+0000 7f5db6000700 -1 osd.4 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T21:52:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:20 smithi142 ceph-mon[15828]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-04-20T21:52:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:20 smithi142 ceph-mon[15828]: osdmap e34: 5 total, 4 up, 5 in 2024-04-20T21:52:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:20 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T21:52:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:20 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T21:52:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:20 smithi142 ceph-mon[15828]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:21.238 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:21 smithi164 ceph-mon[23506]: purged_snaps scrub starts 2024-04-20T21:52:21.239 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:21 smithi164 ceph-mon[23506]: purged_snaps scrub ok 2024-04-20T21:52:21.239 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:21 smithi164 ceph-mon[23506]: osdmap e35: 5 total, 4 up, 5 in 2024-04-20T21:52:21.239 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:21 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T21:52:21.239 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:21 smithi164 ceph-mon[23506]: from='osd.4 ' entity='osd.4' 2024-04-20T21:52:21.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:21 smithi142 ceph-mon[15828]: purged_snaps scrub starts 2024-04-20T21:52:21.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:21 smithi142 ceph-mon[15828]: purged_snaps scrub ok 2024-04-20T21:52:21.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:21 smithi142 ceph-mon[15828]: osdmap e35: 5 total, 4 up, 5 in 2024-04-20T21:52:21.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:21 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T21:52:21.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:21 smithi142 ceph-mon[15828]: from='osd.4 ' entity='osd.4' 2024-04-20T21:52:22.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:22 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T21:52:22.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:22 smithi164 ceph-mon[23506]: osd.4 [v2:172.21.15.164:6808/3702640245,v1:172.21.15.164:6809/3702640245] boot 2024-04-20T21:52:22.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:22 smithi164 ceph-mon[23506]: osdmap e36: 5 total, 5 up, 5 in 2024-04-20T21:52:22.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:22 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T21:52:22.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:22 smithi164 ceph-mon[23506]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:22.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:22 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T21:52:22.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:22 smithi142 ceph-mon[15828]: osd.4 [v2:172.21.15.164:6808/3702640245,v1:172.21.15.164:6809/3702640245] boot 2024-04-20T21:52:22.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:22 smithi142 ceph-mon[15828]: osdmap e36: 5 total, 5 up, 5 in 2024-04-20T21:52:22.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:22 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T21:52:22.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:22 smithi142 ceph-mon[15828]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-04-20T21:52:22.577 INFO:teuthology.orchestra.run.smithi164.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-20T21:52:22.577 INFO:teuthology.orchestra.run.smithi164.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-20T21:52:22.577 INFO:teuthology.orchestra.run.smithi164.stderr: stderr: 10+0 records in 2024-04-20T21:52:22.577 INFO:teuthology.orchestra.run.smithi164.stderr:10+0 records out 2024-04-20T21:52:22.577 INFO:teuthology.orchestra.run.smithi164.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0359836 s, 291 MB/s 2024-04-20T21:52:22.577 INFO:teuthology.orchestra.run.smithi164.stderr:--> Zapping successful for: 2024-04-20T21:52:23.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:23 smithi164 ceph-mon[23506]: osdmap e37: 5 total, 5 up, 5 in 2024-04-20T21:52:23.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:23 smithi142 ceph-mon[15828]: osdmap e37: 5 total, 5 up, 5 in 2024-04-20T21:52:23.816 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph orch daemon add osd smithi164:vg_nvme/lv_2 2024-04-20T21:52:24.490 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi164/config 2024-04-20T21:52:24.641 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:24 smithi164 ceph-mon[23506]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:24.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:24 smithi142 ceph-mon[15828]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:25.637 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:25 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:52:25.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:25 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:52:26.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:26 smithi142 ceph-mon[15828]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:26.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:26 smithi164 ceph-mon[23506]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:27.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.392+0000 7f6b1fa00700 1 -- 172.21.15.164:0/1515660123 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b18074f10 msgr2=0x7f6b18073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:52:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.392+0000 7f6b1fa00700 1 --2- 172.21.15.164:0/1515660123 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b18074f10 0x7f6b18073370 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00b0a0 tx=0x7f6b0c00b3b0 comp rx=0 tx=0).stop 2024-04-20T21:52:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.392+0000 7f6b1fa00700 1 -- 172.21.15.164:0/1515660123 shutdown_connections 2024-04-20T21:52:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.392+0000 7f6b1fa00700 1 --2- 172.21.15.164:0/1515660123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b18073940 0x7f6b18073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:52:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.392+0000 7f6b1fa00700 1 --2- 172.21.15.164:0/1515660123 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b18074f10 0x7f6b18073370 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:52:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.392+0000 7f6b1fa00700 1 -- 172.21.15.164:0/1515660123 >> 172.21.15.164:0/1515660123 conn(0x7f6b180fc1c0 msgr2=0x7f6b180fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:52:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.393+0000 7f6b1fa00700 1 -- 172.21.15.164:0/1515660123 shutdown_connections 2024-04-20T21:52:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.393+0000 7f6b1fa00700 1 -- 172.21.15.164:0/1515660123 wait complete. 2024-04-20T21:52:27.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.394+0000 7f6b1fa00700 1 Processor -- start 2024-04-20T21:52:27.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.394+0000 7f6b1fa00700 1 -- start start 2024-04-20T21:52:27.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.394+0000 7f6b1fa00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b18073940 0x7f6b1819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:52:27.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.394+0000 7f6b1fa00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b18074f10 0x7f6b1819d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:52:27.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.394+0000 7f6b1fa00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1819d800 con 0x7f6b18073940 2024-04-20T21:52:27.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.394+0000 7f6b1fa00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b181a21c0 con 0x7f6b18074f10 2024-04-20T21:52:27.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.395+0000 7f6b17e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b18074f10 0x7f6b1819d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:52:27.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.395+0000 7f6b17e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b18074f10 0x7f6b1819d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:50896/0 (socket says 172.21.15.164:50896) 2024-04-20T21:52:27.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.395+0000 7f6b17e00700 1 -- 172.21.15.164:0/667357879 learned_addr learned my addr 172.21.15.164:0/667357879 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:52:27.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.395+0000 7f6b1d000700 1 --2- 172.21.15.164:0/667357879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b18073940 0x7f6b1819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:52:27.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.395+0000 7f6b17e00700 1 -- 172.21.15.164:0/667357879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b18073940 msgr2=0x7f6b1819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:52:27.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.395+0000 7f6b17e00700 1 --2- 172.21.15.164:0/667357879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b18073940 0x7f6b1819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:52:27.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.395+0000 7f6b17e00700 1 -- 172.21.15.164:0/667357879 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c009d00 con 0x7f6b18074f10 2024-04-20T21:52:27.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.396+0000 7f6b17e00700 1 --2- 172.21.15.164:0/667357879 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b18074f10 0x7f6b1819d1e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400d900 tx=0x7f6b0400dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:52:27.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.396+0000 7f6b15600700 1 -- 172.21.15.164:0/667357879 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b040041f0 con 0x7f6b18074f10 2024-04-20T21:52:27.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.396+0000 7f6b15600700 1 -- 172.21.15.164:0/667357879 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b04004350 con 0x7f6b18074f10 2024-04-20T21:52:27.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.396+0000 7f6b15600700 1 -- 172.21.15.164:0/667357879 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b04003cf0 con 0x7f6b18074f10 2024-04-20T21:52:27.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.396+0000 7f6b1fa00700 1 -- 172.21.15.164:0/667357879 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b181a23c0 con 0x7f6b18074f10 2024-04-20T21:52:27.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.396+0000 7f6b1fa00700 1 -- 172.21.15.164:0/667357879 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b181a2910 con 0x7f6b18074f10 2024-04-20T21:52:27.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.398+0000 7f6b1fa00700 1 -- 172.21.15.164:0/667357879 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b18196d90 con 0x7f6b18074f10 2024-04-20T21:52:27.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.399+0000 7f6b15600700 1 -- 172.21.15.164:0/667357879 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f6b04009730 con 0x7f6b18074f10 2024-04-20T21:52:27.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.400+0000 7f6b15600700 1 --2- 172.21.15.164:0/667357879 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6b0006cce0 0x7f6b0006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:52:27.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.400+0000 7f6b15600700 1 -- 172.21.15.164:0/667357879 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4206+0+0 (secure 0 0 0) 0x7f6b0408bc70 con 0x7f6b18074f10 2024-04-20T21:52:27.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.400+0000 7f6b1d000700 1 --2- 172.21.15.164:0/667357879 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6b0006cce0 0x7f6b0006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:52:27.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.402+0000 7f6b1d000700 1 --2- 172.21.15.164:0/667357879 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6b0006cce0 0x7f6b0006f1a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b1819e130 tx=0x7f6b0c007910 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:52:27.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.406+0000 7f6b15600700 1 -- 172.21.15.164:0/667357879 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f6b04092080 con 0x7f6b18074f10 2024-04-20T21:52:27.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:27.642+0000 7f6b1fa00700 1 -- 172.21.15.164:0/667357879 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b1802ce50 con 0x7f6b0006cce0 2024-04-20T21:52:27.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:27 smithi164 ceph-mon[23506]: Detected new or changed devices on smithi164 2024-04-20T21:52:27.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:27 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:27.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:27 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:27.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:27 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:52:27.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:27 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:52:27.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:27 smithi164 ceph-mon[23506]: Adjusting osd_memory_target on smithi164 to 7456M 2024-04-20T21:52:27.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:27 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:27.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:27 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:52:27.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:27 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:52:27.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:27 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:27.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:27 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:52:27.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:27 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:52:27.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:27 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:52:27.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:27 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:27.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:27 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T21:52:27.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:27 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T21:52:27.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:27 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:52:28.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:27 smithi142 ceph-mon[15828]: Detected new or changed devices on smithi164 2024-04-20T21:52:28.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:27 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:28.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:27 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:28.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:27 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:52:28.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:27 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:52:28.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:27 smithi142 ceph-mon[15828]: Adjusting osd_memory_target on smithi164 to 7456M 2024-04-20T21:52:28.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:27 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:28.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:27 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:52:28.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:27 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:52:28.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:27 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:28.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:27 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:52:28.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:27 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:52:28.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:27 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:52:28.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:27 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:28.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:27 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T21:52:28.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:27 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T21:52:28.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:27 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:52:28.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:28 smithi164 ceph-mon[23506]: from='client.24171 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:52:28.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:28 smithi164 ceph-mon[23506]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:29.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:28 smithi142 ceph-mon[15828]: from='client.24171 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:52:29.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:28 smithi142 ceph-mon[15828]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:31.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:31 smithi142 ceph-mon[15828]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:31.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:31 smithi164 ceph-mon[23506]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:32.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:32 smithi164 ceph-mon[23506]: from='client.? 172.21.15.164:0/1415870586' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72378e50-3a51-469d-a402-489d9bbfed7f"}]: dispatch 2024-04-20T21:52:32.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:32 smithi164 ceph-mon[23506]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72378e50-3a51-469d-a402-489d9bbfed7f"}]: dispatch 2024-04-20T21:52:32.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:32 smithi164 ceph-mon[23506]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72378e50-3a51-469d-a402-489d9bbfed7f"}]': finished 2024-04-20T21:52:32.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:32 smithi164 ceph-mon[23506]: osdmap e38: 6 total, 5 up, 6 in 2024-04-20T21:52:32.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:32 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T21:52:32.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:32 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/1415870586' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72378e50-3a51-469d-a402-489d9bbfed7f"}]: dispatch 2024-04-20T21:52:32.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:32 smithi142 ceph-mon[15828]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72378e50-3a51-469d-a402-489d9bbfed7f"}]: dispatch 2024-04-20T21:52:32.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:32 smithi142 ceph-mon[15828]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72378e50-3a51-469d-a402-489d9bbfed7f"}]': finished 2024-04-20T21:52:32.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:32 smithi142 ceph-mon[15828]: osdmap e38: 6 total, 5 up, 6 in 2024-04-20T21:52:32.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:32 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T21:52:33.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:33 smithi142 ceph-mon[15828]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:33.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:33 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/422080462' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T21:52:33.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:33 smithi164 ceph-mon[23506]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:33.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:33 smithi164 ceph-mon[23506]: from='client.? 172.21.15.164:0/422080462' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T21:52:35.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:35 smithi142 ceph-mon[15828]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:35.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:35 smithi164 ceph-mon[23506]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:37.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:37 smithi164 ceph-mon[23506]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:37.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:37 smithi142 ceph-mon[15828]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:39.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:39 smithi164 ceph-mon[23506]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:39.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:39 smithi142 ceph-mon[15828]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:41.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:41 smithi164 ceph-mon[23506]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:41.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:41 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:52:41.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:41 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-20T21:52:41.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:41 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:52:41.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:41 smithi142 ceph-mon[15828]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:41.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:41 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:52:41.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:41 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-20T21:52:41.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:41 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:52:42.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:42 smithi142 ceph-mon[15828]: Deploying daemon osd.5 on smithi164 2024-04-20T21:52:42.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:42 smithi164 ceph-mon[23506]: Deploying daemon osd.5 on smithi164 2024-04-20T21:52:43.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:43 smithi164 ceph-mon[23506]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:43.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:43 smithi142 ceph-mon[15828]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:45.412 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:45 smithi164 ceph-mon[23506]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:45.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:45 smithi142 ceph-mon[15828]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:47 smithi142 ceph-mon[15828]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:47.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:47 smithi164 ceph-mon[23506]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:49.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:49 smithi164 ceph-mon[23506]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:49.394 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:49 smithi142 ceph-mon[15828]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:50.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:50 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:50.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:50 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:50.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:50 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:52:50.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:50 smithi164 ceph-mon[23506]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:50.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:50 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:50.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:50 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:50.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:50 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:52:50.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:50 smithi142 ceph-mon[15828]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:53.330 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:53 smithi164 ceph-mon[23506]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:53.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:53 smithi142 ceph-mon[15828]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:54.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:54 smithi164 ceph-mon[23506]: from='osd.5 [v2:172.21.15.164:6816/3340529941,v1:172.21.15.164:6817/3340529941]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-20T21:52:54.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:54 smithi164 ceph-mon[23506]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-20T21:52:54.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:54.403+0000 7f6b15600700 1 -- 172.21.15.164:0/667357879 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6b1802ce50 con 0x7f6b0006cce0 2024-04-20T21:52:54.402 INFO:teuthology.orchestra.run.smithi164.stdout:Created osd(s) 5 on host 'smithi164' 2024-04-20T21:52:54.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:54.406+0000 7f6b1fa00700 1 -- 172.21.15.164:0/667357879 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6b0006cce0 msgr2=0x7f6b0006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:52:54.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:54.406+0000 7f6b1fa00700 1 --2- 172.21.15.164:0/667357879 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6b0006cce0 0x7f6b0006f1a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b1819e130 tx=0x7f6b0c007910 comp rx=0 tx=0).stop 2024-04-20T21:52:54.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:54.406+0000 7f6b1fa00700 1 -- 172.21.15.164:0/667357879 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b18074f10 msgr2=0x7f6b1819d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:52:54.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:54.406+0000 7f6b1fa00700 1 --2- 172.21.15.164:0/667357879 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b18074f10 0x7f6b1819d1e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400d900 tx=0x7f6b0400dc10 comp rx=0 tx=0).stop 2024-04-20T21:52:54.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:54.406+0000 7f6b1fa00700 1 -- 172.21.15.164:0/667357879 shutdown_connections 2024-04-20T21:52:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:54.406+0000 7f6b1fa00700 1 --2- 172.21.15.164:0/667357879 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6b0006cce0 0x7f6b0006f1a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:52:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:54.406+0000 7f6b1fa00700 1 --2- 172.21.15.164:0/667357879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b18073940 0x7f6b1819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:52:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:54.406+0000 7f6b1fa00700 1 --2- 172.21.15.164:0/667357879 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b18074f10 0x7f6b1819d1e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:52:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:54.406+0000 7f6b1fa00700 1 -- 172.21.15.164:0/667357879 >> 172.21.15.164:0/667357879 conn(0x7f6b180fc1c0 msgr2=0x7f6b181029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:52:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:54.406+0000 7f6b1fa00700 1 -- 172.21.15.164:0/667357879 shutdown_connections 2024-04-20T21:52:54.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:52:54.406+0000 7f6b1fa00700 1 -- 172.21.15.164:0/667357879 wait complete. 2024-04-20T21:52:54.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:54 smithi142 ceph-mon[15828]: from='osd.5 [v2:172.21.15.164:6816/3340529941,v1:172.21.15.164:6817/3340529941]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-20T21:52:54.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:54 smithi142 ceph-mon[15828]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-20T21:52:55.180 DEBUG:teuthology.orchestra.run.smithi164:osd.5> sudo journalctl -f -n 0 -u ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.5.service 2024-04-20T21:52:55.185 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-04-20T21:52:55.185 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-20T21:52:55.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:55 smithi142 ceph-mon[15828]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:55.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:55 smithi142 ceph-mon[15828]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-20T21:52:55.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:55 smithi142 ceph-mon[15828]: osdmap e39: 6 total, 5 up, 6 in 2024-04-20T21:52:55.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T21:52:55.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:55 smithi142 ceph-mon[15828]: from='osd.5 [v2:172.21.15.164:6816/3340529941,v1:172.21.15.164:6817/3340529941]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T21:52:55.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:55 smithi142 ceph-mon[15828]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T21:52:55.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:55.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:55.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:55.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:55.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:55 smithi164 ceph-mon[23506]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:55.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:55 smithi164 ceph-mon[23506]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-20T21:52:55.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:55 smithi164 ceph-mon[23506]: osdmap e39: 6 total, 5 up, 6 in 2024-04-20T21:52:55.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T21:52:55.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:55 smithi164 ceph-mon[23506]: from='osd.5 [v2:172.21.15.164:6816/3340529941,v1:172.21.15.164:6817/3340529941]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T21:52:55.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:55 smithi164 ceph-mon[23506]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T21:52:55.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:55.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:55.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:55.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:52:55.597 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:52:56.141 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:56 smithi164 ceph-mon[23506]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-04-20T21:52:56.141 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:56 smithi164 ceph-mon[23506]: osdmap e40: 6 total, 5 up, 6 in 2024-04-20T21:52:56.141 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:56 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T21:52:56.141 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:56 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T21:52:56.141 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:56 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:52:56.412 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 21:52:56 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[43045]: 2024-04-20T21:52:56.141+0000 7f56d7c00700 -1 osd.5 0 waiting for initial osdmap 2024-04-20T21:52:56.412 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 21:52:56 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[43045]: 2024-04-20T21:52:56.167+0000 7f56ce400700 -1 osd.5 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T21:52:56.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:56 smithi142 ceph-mon[15828]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-04-20T21:52:56.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:56 smithi142 ceph-mon[15828]: osdmap e40: 6 total, 5 up, 6 in 2024-04-20T21:52:56.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:56 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T21:52:56.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:56 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T21:52:56.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:56 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:52:57.292 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:57 smithi142 ceph-mon[15828]: purged_snaps scrub starts 2024-04-20T21:52:57.292 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:57 smithi142 ceph-mon[15828]: purged_snaps scrub ok 2024-04-20T21:52:57.292 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:57 smithi142 ceph-mon[15828]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:57.292 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:57 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T21:52:57.292 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:57 smithi142 ceph-mon[15828]: from='osd.5 ' entity='osd.5' 2024-04-20T21:52:57.292 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:57 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T21:52:57.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:57 smithi164 ceph-mon[23506]: purged_snaps scrub starts 2024-04-20T21:52:57.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:57 smithi164 ceph-mon[23506]: purged_snaps scrub ok 2024-04-20T21:52:57.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:57 smithi164 ceph-mon[23506]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:57.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:57 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T21:52:57.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:57 smithi164 ceph-mon[23506]: from='osd.5 ' entity='osd.5' 2024-04-20T21:52:57.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:57 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T21:52:57.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.837+0000 7fc62de00700 1 -- 172.21.15.142:0/2481235310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc628108430 msgr2=0x7fc6281088b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:52:57.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.837+0000 7fc62de00700 1 --2- 172.21.15.142:0/2481235310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc628108430 0x7fc6281088b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc614009910 tx=0x7fc614009c20 comp rx=0 tx=0).stop 2024-04-20T21:52:57.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.837+0000 7fc62de00700 1 -- 172.21.15.142:0/2481235310 shutdown_connections 2024-04-20T21:52:57.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.837+0000 7fc62de00700 1 --2- 172.21.15.142:0/2481235310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc628108430 0x7fc6281088b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:52:57.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.837+0000 7fc62de00700 1 --2- 172.21.15.142:0/2481235310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc628107260 0x7fc628107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:52:57.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.837+0000 7fc62de00700 1 -- 172.21.15.142:0/2481235310 >> 172.21.15.142:0/2481235310 conn(0x7fc628076400 msgr2=0x7fc628078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:52:57.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.837+0000 7fc62de00700 1 -- 172.21.15.142:0/2481235310 shutdown_connections 2024-04-20T21:52:57.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.837+0000 7fc62de00700 1 -- 172.21.15.142:0/2481235310 wait complete. 2024-04-20T21:52:57.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.838+0000 7fc62de00700 1 Processor -- start 2024-04-20T21:52:57.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.838+0000 7fc62de00700 1 -- start start 2024-04-20T21:52:57.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.839+0000 7fc62de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc628107260 0x7fc62819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:52:57.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.839+0000 7fc62de00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc628108430 0x7fc62819d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:52:57.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.839+0000 7fc62de00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62819d8a0 con 0x7fc628107260 2024-04-20T21:52:57.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.839+0000 7fc62de00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6281a2260 con 0x7fc628108430 2024-04-20T21:52:57.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.839+0000 7fc626a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc628107260 0x7fc62819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:52:57.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.839+0000 7fc626a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc628107260 0x7fc62819cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34682/0 (socket says 172.21.15.142:34682) 2024-04-20T21:52:57.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.839+0000 7fc626a00700 1 -- 172.21.15.142:0/3033734734 learned_addr learned my addr 172.21.15.142:0/3033734734 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:52:57.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.839+0000 7fc626a00700 1 -- 172.21.15.142:0/3033734734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc628108430 msgr2=0x7fc62819d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:52:57.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.839+0000 7fc626a00700 1 --2- 172.21.15.142:0/3033734734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc628108430 0x7fc62819d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:52:57.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.839+0000 7fc626a00700 1 -- 172.21.15.142:0/3033734734 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6140095f0 con 0x7fc628107260 2024-04-20T21:52:57.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.840+0000 7fc626a00700 1 --2- 172.21.15.142:0/3033734734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc628107260 0x7fc62819cd40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc61800b4b0 tx=0x7fc61800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:52:57.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.840+0000 7fc62ca00700 1 -- 172.21.15.142:0/3033734734 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc618011800 con 0x7fc628107260 2024-04-20T21:52:57.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.840+0000 7fc62de00700 1 -- 172.21.15.142:0/3033734734 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6281a2460 con 0x7fc628107260 2024-04-20T21:52:57.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.840+0000 7fc62ca00700 1 -- 172.21.15.142:0/3033734734 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc618011e20 con 0x7fc628107260 2024-04-20T21:52:57.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.840+0000 7fc62ca00700 1 -- 172.21.15.142:0/3033734734 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc61800f2e0 con 0x7fc628107260 2024-04-20T21:52:57.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.840+0000 7fc62de00700 1 -- 172.21.15.142:0/3033734734 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6281a2a00 con 0x7fc628107260 2024-04-20T21:52:57.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.842+0000 7fc62de00700 1 -- 172.21.15.142:0/3033734734 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc628196e50 con 0x7fc628107260 2024-04-20T21:52:57.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.843+0000 7fc62ca00700 1 -- 172.21.15.142:0/3033734734 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc618010380 con 0x7fc628107260 2024-04-20T21:52:57.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.844+0000 7fc62ca00700 1 --2- 172.21.15.142:0/3033734734 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc60c06ccf0 0x7fc60c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:52:57.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.844+0000 7fc62ca00700 1 -- 172.21.15.142:0/3033734734 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc61808bac0 con 0x7fc628107260 2024-04-20T21:52:57.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.845+0000 7fc626000700 1 --2- 172.21.15.142:0/3033734734 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc60c06ccf0 0x7fc60c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:52:57.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.845+0000 7fc626000700 1 --2- 172.21.15.142:0/3033734734 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc60c06ccf0 0x7fc60c06f1b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc6140051c0 tx=0x7fc614005fd0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:52:57.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:57.850+0000 7fc62ca00700 1 -- 172.21.15.142:0/3033734734 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fc6180561d0 con 0x7fc628107260 2024-04-20T21:52:58.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:58.068+0000 7fc62de00700 1 -- 172.21.15.142:0/3033734734 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fc62804ebb0 con 0x7fc628107260 2024-04-20T21:52:58.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:58.069+0000 7fc62ca00700 1 -- 172.21.15.142:0/3033734734 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v41) v1 ==== 74+0+130 (secure 0 0 0) 0x7fc6180597f0 con 0x7fc628107260 2024-04-20T21:52:58.068 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:52:58.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:58.073+0000 7fc62de00700 1 -- 172.21.15.142:0/3033734734 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc60c06ccf0 msgr2=0x7fc60c06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:52:58.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:58.073+0000 7fc62de00700 1 --2- 172.21.15.142:0/3033734734 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc60c06ccf0 0x7fc60c06f1b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc6140051c0 tx=0x7fc614005fd0 comp rx=0 tx=0).stop 2024-04-20T21:52:58.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:58.073+0000 7fc62de00700 1 -- 172.21.15.142:0/3033734734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc628107260 msgr2=0x7fc62819cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:52:58.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:58.073+0000 7fc62de00700 1 --2- 172.21.15.142:0/3033734734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc628107260 0x7fc62819cd40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc61800b4b0 tx=0x7fc61800b870 comp rx=0 tx=0).stop 2024-04-20T21:52:58.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:58.073+0000 7fc62de00700 1 -- 172.21.15.142:0/3033734734 shutdown_connections 2024-04-20T21:52:58.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:58.073+0000 7fc62de00700 1 --2- 172.21.15.142:0/3033734734 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc60c06ccf0 0x7fc60c06f1b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:52:58.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:58.073+0000 7fc62de00700 1 --2- 172.21.15.142:0/3033734734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc628107260 0x7fc62819cd40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:52:58.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:58.073+0000 7fc62de00700 1 --2- 172.21.15.142:0/3033734734 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc628108430 0x7fc62819d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:52:58.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:58.073+0000 7fc62de00700 1 -- 172.21.15.142:0/3033734734 >> 172.21.15.142:0/3033734734 conn(0x7fc628076400 msgr2=0x7fc62810ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:52:58.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:58.073+0000 7fc62de00700 1 -- 172.21.15.142:0/3033734734 shutdown_connections 2024-04-20T21:52:58.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:52:58.073+0000 7fc62de00700 1 -- 172.21.15.142:0/3033734734 wait complete. 2024-04-20T21:52:58.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:58 smithi142 ceph-mon[15828]: osd.5 [v2:172.21.15.164:6816/3340529941,v1:172.21.15.164:6817/3340529941] boot 2024-04-20T21:52:58.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:58 smithi142 ceph-mon[15828]: osdmap e41: 6 total, 6 up, 6 in 2024-04-20T21:52:58.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:58 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T21:52:58.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:58 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/3033734734' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-20T21:52:58.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:58 smithi164 ceph-mon[23506]: osd.5 [v2:172.21.15.164:6816/3340529941,v1:172.21.15.164:6817/3340529941] boot 2024-04-20T21:52:58.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:58 smithi164 ceph-mon[23506]: osdmap e41: 6 total, 6 up, 6 in 2024-04-20T21:52:58.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:58 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T21:52:58.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:58 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/3033734734' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-20T21:52:58.952 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":41,"num_osds":6,"num_up_osds":6,"osd_up_since":1713649977,"num_in_osds":6,"osd_in_since":1713649951,"num_remapped_pgs":0} 2024-04-20T21:52:58.952 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-20T21:52:59.345 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:52:59.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:59 smithi164 ceph-mon[23506]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:59.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:52:59 smithi164 ceph-mon[23506]: osdmap e42: 6 total, 6 up, 6 in 2024-04-20T21:52:59.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:59 smithi142 ceph-mon[15828]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-04-20T21:52:59.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:52:59 smithi142 ceph-mon[15828]: osdmap e42: 6 total, 6 up, 6 in 2024-04-20T21:53:00.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:00 smithi164 ceph-mon[23506]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:00.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:00 smithi142 ceph-mon[15828]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:01.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.533+0000 7fa2ad000700 1 -- 172.21.15.142:0/2586954630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a81017c0 msgr2=0x7fa2a8105810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:01.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.533+0000 7fa2ad000700 1 --2- 172.21.15.142:0/2586954630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a81017c0 0x7fa2a8105810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa294009910 tx=0x7fa294009c20 comp rx=0 tx=0).stop 2024-04-20T21:53:01.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.533+0000 7fa2ad000700 1 -- 172.21.15.142:0/2586954630 shutdown_connections 2024-04-20T21:53:01.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.533+0000 7fa2ad000700 1 --2- 172.21.15.142:0/2586954630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a81017c0 0x7fa2a8105810 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:01.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.533+0000 7fa2ad000700 1 --2- 172.21.15.142:0/2586954630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2a8100e10 0x7fa2a81011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:01.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.533+0000 7fa2ad000700 1 -- 172.21.15.142:0/2586954630 >> 172.21.15.142:0/2586954630 conn(0x7fa2a80fc6a0 msgr2=0x7fa2a80feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:01.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.533+0000 7fa2ad000700 1 -- 172.21.15.142:0/2586954630 shutdown_connections 2024-04-20T21:53:01.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.533+0000 7fa2ad000700 1 -- 172.21.15.142:0/2586954630 wait complete. 2024-04-20T21:53:01.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.534+0000 7fa2ad000700 1 Processor -- start 2024-04-20T21:53:01.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.535+0000 7fa2ad000700 1 -- start start 2024-04-20T21:53:01.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.535+0000 7fa2ad000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a8100e10 0x7fa2a80731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:01.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.535+0000 7fa2ad000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2a81017c0 0x7fa2a8073720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:01.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.535+0000 7fa2ad000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a8075160 con 0x7fa2a8100e10 2024-04-20T21:53:01.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.535+0000 7fa2ad000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a8073c60 con 0x7fa2a81017c0 2024-04-20T21:53:01.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.535+0000 7fa2a5e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a8100e10 0x7fa2a80731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:01.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.535+0000 7fa2a5e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a8100e10 0x7fa2a80731e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34706/0 (socket says 172.21.15.142:34706) 2024-04-20T21:53:01.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.535+0000 7fa2a5e00700 1 -- 172.21.15.142:0/271889601 learned_addr learned my addr 172.21.15.142:0/271889601 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:01.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.536+0000 7fa2a5400700 1 --2- 172.21.15.142:0/271889601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2a81017c0 0x7fa2a8073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:01.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.536+0000 7fa2a5e00700 1 -- 172.21.15.142:0/271889601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2a81017c0 msgr2=0x7fa2a8073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:01.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.536+0000 7fa2a5e00700 1 --2- 172.21.15.142:0/271889601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2a81017c0 0x7fa2a8073720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:01.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.536+0000 7fa2a5e00700 1 -- 172.21.15.142:0/271889601 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2940095f0 con 0x7fa2a8100e10 2024-04-20T21:53:01.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.536+0000 7fa2a5400700 1 --2- 172.21.15.142:0/271889601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2a81017c0 0x7fa2a8073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:53:01.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.536+0000 7fa2a5e00700 1 --2- 172.21.15.142:0/271889601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a8100e10 0x7fa2a80731e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa29800c930 tx=0x7fa29800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:01.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.536+0000 7fa29ea00700 1 -- 172.21.15.142:0/271889601 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa298007ad0 con 0x7fa2a8100e10 2024-04-20T21:53:01.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.536+0000 7fa29ea00700 1 -- 172.21.15.142:0/271889601 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa298007c30 con 0x7fa2a8100e10 2024-04-20T21:53:01.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.536+0000 7fa29ea00700 1 -- 172.21.15.142:0/271889601 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa298018610 con 0x7fa2a8100e10 2024-04-20T21:53:01.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.536+0000 7fa2ad000700 1 -- 172.21.15.142:0/271889601 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a8073f40 con 0x7fa2a8100e10 2024-04-20T21:53:01.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.537+0000 7fa2ad000700 1 -- 172.21.15.142:0/271889601 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a81a2f30 con 0x7fa2a8100e10 2024-04-20T21:53:01.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.538+0000 7fa2ad000700 1 -- 172.21.15.142:0/271889601 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a8109210 con 0x7fa2a8100e10 2024-04-20T21:53:01.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.539+0000 7fa29ea00700 1 -- 172.21.15.142:0/271889601 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa29800f450 con 0x7fa2a8100e10 2024-04-20T21:53:01.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.540+0000 7fa29ea00700 1 --2- 172.21.15.142:0/271889601 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa28c06ccf0 0x7fa28c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:01.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.540+0000 7fa29ea00700 1 -- 172.21.15.142:0/271889601 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa29808c1e0 con 0x7fa2a8100e10 2024-04-20T21:53:01.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.540+0000 7fa2a5400700 1 --2- 172.21.15.142:0/271889601 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa28c06ccf0 0x7fa28c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:01.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.541+0000 7fa2a5400700 1 --2- 172.21.15.142:0/271889601 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa28c06ccf0 0x7fa28c06f1b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa294006010 tx=0x7fa29400b540 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:01.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.545+0000 7fa29ea00700 1 -- 172.21.15.142:0/271889601 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fa298056850 con 0x7fa2a8100e10 2024-04-20T21:53:01.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:01 smithi142 ceph-mon[15828]: Detected new or changed devices on smithi164 2024-04-20T21:53:01.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:53:01.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:53:01.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:53:01.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:53:01.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:53:01.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:01 smithi142 ceph-mon[15828]: Adjusting osd_memory_target on smithi164 to 4971M 2024-04-20T21:53:01.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:53:01.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:53:01.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:53:01.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:53:01.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:53:01.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:53:01.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:53:01.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:53:01.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:01 smithi164 ceph-mon[23506]: Detected new or changed devices on smithi164 2024-04-20T21:53:01.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:53:01.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:53:01.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:53:01.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:53:01.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:53:01.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:01 smithi164 ceph-mon[23506]: Adjusting osd_memory_target on smithi164 to 4971M 2024-04-20T21:53:01.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:53:01.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:53:01.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:53:01.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:53:01.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:53:01.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:53:01.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:53:01.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:53:01.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.768+0000 7fa2ad000700 1 -- 172.21.15.142:0/271889601 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2a81022f0 con 0x7fa2a8100e10 2024-04-20T21:53:01.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.770+0000 7fa29ea00700 1 -- 172.21.15.142:0/271889601 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+11384 (secure 0 0 0) 0x7fa298059e70 con 0x7fa2a8100e10 2024-04-20T21:53:01.769 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:53:01.769 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":42,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","created":"2024-04-20T21:45:27.213653+0000","modified":"2024-04-20T21:52:58.151538+0000","last_up_change":"2024-04-20T21:52:57.146714+0000","last_in_change":"2024-04-20T21:52:31.576977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:51:10.763901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0042c600-a874-4d57-bb8f-7b6f32723bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":477229295},{"type":"v1","addr":"172.21.15.142:6803","nonce":477229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":477229295},{"type":"v1","addr":"172.21.15.142:6805","nonce":477229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":477229295},{"type":"v1","addr":"172.21.15.142:6809","nonce":477229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":477229295},{"type":"v1","addr":"172.21.15.142:6807","nonce":477229295}]},"public_addr":"172.21.15.142:6803/477229295","cluster_addr":"172.21.15.142:6805/477229295","heartbeat_back_addr":"172.21.15.142:6809/477229295","heartbeat_front_addr":"172.21.15.142:6807/477229295","state":["exists","up"]},{"osd":1,"uuid":"29049537-368a-4d1f-b92c-21d962dd8031","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2225466348},{"type":"v1","addr":"172.21.15.142:6811","nonce":2225466348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2225466348},{"type":"v1","addr":"172.21.15.142:6813","nonce":2225466348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2225466348},{"type":"v1","addr":"172.21.15.142:6817","nonce":2225466348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2225466348},{"type":"v1","addr":"172.21.15.142:6815","nonce":2225466348}]},"public_addr":"172.21.15.142:6811/2225466348","cluster_addr":"172.21.15.142:6813/2225466348","heartbeat_back_addr":"172.21.15.142:6817/2225466348","heartbeat_front_addr":"172.21.15.142:6815/2225466348","state":["exists","up"]},{"osd":2,"uuid":"4ea8215b-dc6f-4f18-9d2c-5a5b21e02fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1851191263},{"type":"v1","addr":"172.21.15.142:6819","nonce":1851191263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1851191263},{"type":"v1","addr":"172.21.15.142:6821","nonce":1851191263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1851191263},{"type":"v1","addr":"172.21.15.142:6825","nonce":1851191263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1851191263},{"type":"v1","addr":"172.21.15.142:6823","nonce":1851191263}]},"public_addr":"172.21.15.142:6819/1851191263","cluster_addr":"172.21.15.142:6821/1851191263","heartbeat_back_addr":"172.21.15.142:6825/1851191263","heartbeat_front_addr":"172.21.15.142:6823/1851191263","state":["exists","up"]},{"osd":3,"uuid":"981987e0-cff5-42e9-8129-2a08175c6ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":4283809575},{"type":"v1","addr":"172.21.15.164:6801","nonce":4283809575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":4283809575},{"type":"v1","addr":"172.21.15.164:6803","nonce":4283809575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":4283809575},{"type":"v1","addr":"172.21.15.164:6807","nonce":4283809575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":4283809575},{"type":"v1","addr":"172.21.15.164:6805","nonce":4283809575}]},"public_addr":"172.21.15.164:6801/4283809575","cluster_addr":"172.21.15.164:6803/4283809575","heartbeat_back_addr":"172.21.15.164:6807/4283809575","heartbeat_front_addr":"172.21.15.164:6805/4283809575","state":["exists","up"]},{"osd":4,"uuid":"a839fb7d-f82c-4bb0-8c33-b4f4f261bcae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3702640245},{"type":"v1","addr":"172.21.15.164:6809","nonce":3702640245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":3702640245},{"type":"v1","addr":"172.21.15.164:6811","nonce":3702640245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":3702640245},{"type":"v1","addr":"172.21.15.164:6815","nonce":3702640245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":3702640245},{"type":"v1","addr":"172.21.15.164:6813","nonce":3702640245}]},"public_addr":"172.21.15.164:6809/3702640245","cluster_addr":"172.21.15.164:6811/3702640245","heartbeat_back_addr":"172.21.15.164:6815/3702640245","heartbeat_front_addr":"172.21.15.164:6813/3702640245","state":["exists","up"]},{"osd":5,"uuid":"72378e50-3a51-469d-a402-489d9bbfed7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3340529941},{"type":"v1","addr":"172.21.15.164:6817","nonce":3340529941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3340529941},{"type":"v1","addr":"172.21.15.164:6819","nonce":3340529941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3340529941},{"type":"v1","addr":"172.21.15.164:6823","nonce":3340529941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3340529941},{"type":"v1","addr":"172.21.15.164:6821","nonce":3340529941}]},"public_addr":"172.21.15.164:6817/3340529941","cluster_addr":"172.21.15.164:6819/3340529941","heartbeat_back_addr":"172.21.15.164:6823/3340529941","heartbeat_front_addr":"172.21.15.164:6821/3340529941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:49:52.556673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:50:29.868343+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:51:07.890840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:51:43.365372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:52:18.872393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:52:54.318402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/3515098784":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/195339089":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/4246233855":"2024-04-21T21:46:43.407590+0000","172.21.15.142:0/801898031":"2024-04-21T21:46:43.407590+0000","172.21.15.142:0/1140713527":"2024-04-21T21:46:01.678961+0000","172.21.15.142:6801/550675874":"2024-04-21T21:46:43.407590+0000","172.21.15.142:0/3501876256":"2024-04-21T21:46:01.678961+0000","172.21.15.142:6801/2803679129":"2024-04-21T21:46:01.678961+0000","172.21.15.142:6800/3464616902":"2024-04-21T21:48:09.914211+0000","172.21.15.142:6800/550675874":"2024-04-21T21:46:43.407590+0000","172.21.15.142:6800/2803679129":"2024-04-21T21:46:01.678961+0000","172.21.15.142:0/841637693":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/2901318326":"2024-04-21T21:46:01.678961+0000","172.21.15.142:6801/3464616902":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/680486182":"2024-04-21T21:46:43.407590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:53:01.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.772+0000 7fa2ad000700 1 -- 172.21.15.142:0/271889601 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa28c06ccf0 msgr2=0x7fa28c06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:01.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.772+0000 7fa2ad000700 1 --2- 172.21.15.142:0/271889601 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa28c06ccf0 0x7fa28c06f1b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa294006010 tx=0x7fa29400b540 comp rx=0 tx=0).stop 2024-04-20T21:53:01.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.773+0000 7fa2ad000700 1 -- 172.21.15.142:0/271889601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a8100e10 msgr2=0x7fa2a80731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:01.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.773+0000 7fa2ad000700 1 --2- 172.21.15.142:0/271889601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a8100e10 0x7fa2a80731e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa29800c930 tx=0x7fa29800ccf0 comp rx=0 tx=0).stop 2024-04-20T21:53:01.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.773+0000 7fa2ad000700 1 -- 172.21.15.142:0/271889601 shutdown_connections 2024-04-20T21:53:01.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.773+0000 7fa2ad000700 1 --2- 172.21.15.142:0/271889601 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa28c06ccf0 0x7fa28c06f1b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:01.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.773+0000 7fa2ad000700 1 --2- 172.21.15.142:0/271889601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a8100e10 0x7fa2a80731e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:01.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.773+0000 7fa2ad000700 1 --2- 172.21.15.142:0/271889601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2a81017c0 0x7fa2a8073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:01.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.773+0000 7fa2ad000700 1 -- 172.21.15.142:0/271889601 >> 172.21.15.142:0/271889601 conn(0x7fa2a80fc6a0 msgr2=0x7fa2a80fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:01.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.773+0000 7fa2ad000700 1 -- 172.21.15.142:0/271889601 shutdown_connections 2024-04-20T21:53:01.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:01.773+0000 7fa2ad000700 1 -- 172.21.15.142:0/271889601 wait complete. 2024-04-20T21:53:02.553 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:51:10.763901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T21:53:02.553 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-20T21:53:02.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:02 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/271889601' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T21:53:02.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:02 smithi164 ceph-mon[23506]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:02.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:02 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/271889601' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T21:53:02.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:02 smithi142 ceph-mon[15828]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:02.938 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:53:04.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.886+0000 7fca0ca00700 1 -- 172.21.15.142:0/3075708957 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca08102730 msgr2=0x7fca0810ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:04.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.886+0000 7fca0ca00700 1 --2- 172.21.15.142:0/3075708957 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca08102730 0x7fca0810ac20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009910 tx=0x7fc9f0009c20 comp rx=0 tx=0).stop 2024-04-20T21:53:04.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.886+0000 7fca0ca00700 1 -- 172.21.15.142:0/3075708957 shutdown_connections 2024-04-20T21:53:04.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.886+0000 7fca0ca00700 1 --2- 172.21.15.142:0/3075708957 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca08102730 0x7fca0810ac20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:04.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.886+0000 7fca0ca00700 1 --2- 172.21.15.142:0/3075708957 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca08101e10 0x7fca081021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:04.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.886+0000 7fca0ca00700 1 -- 172.21.15.142:0/3075708957 >> 172.21.15.142:0/3075708957 conn(0x7fca080fb5c0 msgr2=0x7fca080fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:04.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.887+0000 7fca0ca00700 1 -- 172.21.15.142:0/3075708957 shutdown_connections 2024-04-20T21:53:04.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.887+0000 7fca0ca00700 1 -- 172.21.15.142:0/3075708957 wait complete. 2024-04-20T21:53:04.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.888+0000 7fca0ca00700 1 Processor -- start 2024-04-20T21:53:04.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.888+0000 7fca0ca00700 1 -- start start 2024-04-20T21:53:04.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.888+0000 7fca0ca00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca08101e10 0x7fca08198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:04.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.888+0000 7fca0ca00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca08102730 0x7fca081993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:04.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.888+0000 7fca0ca00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca08199ad0 con 0x7fca08102730 2024-04-20T21:53:04.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.888+0000 7fca0ca00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0819d7a0 con 0x7fca08101e10 2024-04-20T21:53:04.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.888+0000 7fc9fd400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca08102730 0x7fca081993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:04.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.889+0000 7fc9fd400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca08102730 0x7fca081993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34722/0 (socket says 172.21.15.142:34722) 2024-04-20T21:53:04.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.889+0000 7fc9fd400700 1 -- 172.21.15.142:0/4292983557 learned_addr learned my addr 172.21.15.142:0/4292983557 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:04.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.889+0000 7fca05e00700 1 --2- 172.21.15.142:0/4292983557 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca08101e10 0x7fca08198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:04.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.889+0000 7fc9fd400700 1 -- 172.21.15.142:0/4292983557 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca08101e10 msgr2=0x7fca08198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:04.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.889+0000 7fc9fd400700 1 --2- 172.21.15.142:0/4292983557 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca08101e10 0x7fca08198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:04.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.889+0000 7fc9fd400700 1 -- 172.21.15.142:0/4292983557 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f00095f0 con 0x7fca08102730 2024-04-20T21:53:04.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.889+0000 7fc9fd400700 1 --2- 172.21.15.142:0/4292983557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca08102730 0x7fca081993f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc9f00092e0 tx=0x7fc9f000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:04.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.889+0000 7fc9ff400700 1 -- 172.21.15.142:0/4292983557 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f001d070 con 0x7fca08102730 2024-04-20T21:53:04.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.890+0000 7fc9ff400700 1 -- 172.21.15.142:0/4292983557 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9f000f460 con 0x7fca08102730 2024-04-20T21:53:04.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.890+0000 7fca0ca00700 1 -- 172.21.15.142:0/4292983557 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0819da20 con 0x7fca08102730 2024-04-20T21:53:04.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.890+0000 7fc9ff400700 1 -- 172.21.15.142:0/4292983557 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f0017630 con 0x7fca08102730 2024-04-20T21:53:04.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.890+0000 7fca0ca00700 1 -- 172.21.15.142:0/4292983557 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0819df10 con 0x7fca08102730 2024-04-20T21:53:04.891 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.891+0000 7fca0ca00700 1 -- 172.21.15.142:0/4292983557 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0810a710 con 0x7fca08102730 2024-04-20T21:53:04.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.892+0000 7fc9ff400700 1 -- 172.21.15.142:0/4292983557 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc9f000f5d0 con 0x7fca08102730 2024-04-20T21:53:04.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.893+0000 7fc9ff400700 1 --2- 172.21.15.142:0/4292983557 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc9ec06cce0 0x7fc9ec06f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:04.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.893+0000 7fc9ff400700 1 -- 172.21.15.142:0/4292983557 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc9f008d3c0 con 0x7fca08102730 2024-04-20T21:53:04.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.893+0000 7fca05e00700 1 --2- 172.21.15.142:0/4292983557 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc9ec06cce0 0x7fc9ec06f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:04.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.894+0000 7fca05e00700 1 --2- 172.21.15.142:0/4292983557 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc9ec06cce0 0x7fc9ec06f1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8006fd0 tx=0x7fc9f8008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:04.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:04.898+0000 7fc9ff400700 1 -- 172.21.15.142:0/4292983557 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fc9f0057ad0 con 0x7fca08102730 2024-04-20T21:53:05.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:05.119+0000 7fca0ca00700 1 -- 172.21.15.142:0/4292983557 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca0810de30 con 0x7fca08102730 2024-04-20T21:53:05.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:05.120+0000 7fc9ff400700 1 -- 172.21.15.142:0/4292983557 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc9f0005740 con 0x7fca08102730 2024-04-20T21:53:05.121 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2024-04-20T21:53:05.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:05.123+0000 7fca0ca00700 1 -- 172.21.15.142:0/4292983557 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc9ec06cce0 msgr2=0x7fc9ec06f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:05.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:05.123+0000 7fca0ca00700 1 --2- 172.21.15.142:0/4292983557 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc9ec06cce0 0x7fc9ec06f1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8006fd0 tx=0x7fc9f8008040 comp rx=0 tx=0).stop 2024-04-20T21:53:05.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:05.123+0000 7fca0ca00700 1 -- 172.21.15.142:0/4292983557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca08102730 msgr2=0x7fca081993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:05.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:05.123+0000 7fca0ca00700 1 --2- 172.21.15.142:0/4292983557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca08102730 0x7fca081993f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc9f00092e0 tx=0x7fc9f000be20 comp rx=0 tx=0).stop 2024-04-20T21:53:05.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:05.123+0000 7fca0ca00700 1 -- 172.21.15.142:0/4292983557 shutdown_connections 2024-04-20T21:53:05.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:05.123+0000 7fca0ca00700 1 --2- 172.21.15.142:0/4292983557 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc9ec06cce0 0x7fc9ec06f1a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:05.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:05.123+0000 7fca0ca00700 1 --2- 172.21.15.142:0/4292983557 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca08101e10 0x7fca08198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:05.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:05.123+0000 7fca0ca00700 1 --2- 172.21.15.142:0/4292983557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca08102730 0x7fca081993f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:05.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:05.123+0000 7fca0ca00700 1 -- 172.21.15.142:0/4292983557 >> 172.21.15.142:0/4292983557 conn(0x7fca080fb5c0 msgr2=0x7fca08101160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:05.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:05.123+0000 7fca0ca00700 1 -- 172.21.15.142:0/4292983557 shutdown_connections 2024-04-20T21:53:05.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:05.123+0000 7fca0ca00700 1 -- 172.21.15.142:0/4292983557 wait complete. 2024-04-20T21:53:05.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:05 smithi142 ceph-mon[15828]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:05.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:05 smithi164 ceph-mon[23506]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:05.920 INFO:tasks.cephadm:Setting up client nodes... 2024-04-20T21:53:05.920 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-20T21:53:06.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:06 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/4292983557' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T21:53:06.321 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:53:06.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:06 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/4292983557' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T21:53:07.337 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:07 smithi142 ceph-mon[15828]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:07.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:07 smithi164 ceph-mon[23506]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:08.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.477+0000 7f9c45600700 1 -- 172.21.15.142:0/3154184584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c401016c0 msgr2=0x7f9c40103ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:08.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.477+0000 7f9c45600700 1 --2- 172.21.15.142:0/3154184584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c401016c0 0x7f9c40103ab0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009910 tx=0x7f9c30009c20 comp rx=0 tx=0).stop 2024-04-20T21:53:08.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.477+0000 7f9c45600700 1 -- 172.21.15.142:0/3154184584 shutdown_connections 2024-04-20T21:53:08.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.477+0000 7f9c45600700 1 --2- 172.21.15.142:0/3154184584 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c40103ff0 0x7f9c401063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:08.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.477+0000 7f9c45600700 1 --2- 172.21.15.142:0/3154184584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c401016c0 0x7f9c40103ab0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:08.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.477+0000 7f9c45600700 1 -- 172.21.15.142:0/3154184584 >> 172.21.15.142:0/3154184584 conn(0x7f9c400fb090 msgr2=0x7f9c400fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:08.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.477+0000 7f9c45600700 1 -- 172.21.15.142:0/3154184584 shutdown_connections 2024-04-20T21:53:08.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.477+0000 7f9c45600700 1 -- 172.21.15.142:0/3154184584 wait complete. 2024-04-20T21:53:08.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.478+0000 7f9c45600700 1 Processor -- start 2024-04-20T21:53:08.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.478+0000 7f9c45600700 1 -- start start 2024-04-20T21:53:08.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.479+0000 7f9c45600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c401016c0 0x7f9c401987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:08.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.479+0000 7f9c45600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c40103ff0 0x7f9c40198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:08.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.479+0000 7f9c45600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c40199350 con 0x7f9c40103ff0 2024-04-20T21:53:08.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.479+0000 7f9c45600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c40199490 con 0x7f9c401016c0 2024-04-20T21:53:08.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.479+0000 7f9c3e000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c40103ff0 0x7f9c40198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:08.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.479+0000 7f9c3e000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c40103ff0 0x7f9c40198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56380/0 (socket says 172.21.15.142:56380) 2024-04-20T21:53:08.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.479+0000 7f9c3e000700 1 -- 172.21.15.142:0/2887756057 learned_addr learned my addr 172.21.15.142:0/2887756057 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:08.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.479+0000 7f9c3ea00700 1 --2- 172.21.15.142:0/2887756057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c401016c0 0x7f9c401987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:08.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.479+0000 7f9c3e000700 1 -- 172.21.15.142:0/2887756057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c401016c0 msgr2=0x7f9c401987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:08.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.479+0000 7f9c3e000700 1 --2- 172.21.15.142:0/2887756057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c401016c0 0x7f9c401987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:08.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.479+0000 7f9c3e000700 1 -- 172.21.15.142:0/2887756057 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c300095f0 con 0x7f9c40103ff0 2024-04-20T21:53:08.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.480+0000 7f9c3e000700 1 --2- 172.21.15.142:0/2887756057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c40103ff0 0x7f9c40198d30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00c8a0 tx=0x7f9c2c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:08.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.480+0000 7f9c37400700 1 -- 172.21.15.142:0/2887756057 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c2c00cea0 con 0x7f9c40103ff0 2024-04-20T21:53:08.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.480+0000 7f9c37400700 1 -- 172.21.15.142:0/2887756057 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c2c004830 con 0x7f9c40103ff0 2024-04-20T21:53:08.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.480+0000 7f9c45600700 1 -- 172.21.15.142:0/2887756057 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c4019def0 con 0x7f9c40103ff0 2024-04-20T21:53:08.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.480+0000 7f9c37400700 1 -- 172.21.15.142:0/2887756057 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c2c0055b0 con 0x7f9c40103ff0 2024-04-20T21:53:08.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.480+0000 7f9c45600700 1 -- 172.21.15.142:0/2887756057 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4019e490 con 0x7f9c40103ff0 2024-04-20T21:53:08.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.481+0000 7f9c45600700 1 -- 172.21.15.142:0/2887756057 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c400fcca0 con 0x7f9c40103ff0 2024-04-20T21:53:08.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.483+0000 7f9c37400700 1 -- 172.21.15.142:0/2887756057 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f9c2c0049a0 con 0x7f9c40103ff0 2024-04-20T21:53:08.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.484+0000 7f9c37400700 1 --2- 172.21.15.142:0/2887756057 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f9c2406cce0 0x7f9c2406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:08.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.484+0000 7f9c37400700 1 -- 172.21.15.142:0/2887756057 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f9c2c08bb60 con 0x7f9c40103ff0 2024-04-20T21:53:08.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.484+0000 7f9c3ea00700 1 --2- 172.21.15.142:0/2887756057 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f9c2406cce0 0x7f9c2406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:08.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.485+0000 7f9c3ea00700 1 --2- 172.21.15.142:0/2887756057 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f9c2406cce0 0x7f9c2406f1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9c300051c0 tx=0x7f9c3000b540 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:08.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.489+0000 7f9c37400700 1 -- 172.21.15.142:0/2887756057 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f9c2c059ce0 con 0x7f9c40103ff0 2024-04-20T21:53:08.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.796+0000 7f9c45600700 1 -- 172.21.15.142:0/2887756057 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f9c4004ebb0 con 0x7f9c40103ff0 2024-04-20T21:53:08.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.804+0000 7f9c37400700 1 -- 172.21.15.142:0/2887756057 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f9c2c01d0f0 con 0x7f9c40103ff0 2024-04-20T21:53:08.804 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2024-04-20T21:53:08.804 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBEOSRmmFKYLxAANEFQ7YetAR68kxyJhu8TYQ== 2024-04-20T21:53:08.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.807+0000 7f9c45600700 1 -- 172.21.15.142:0/2887756057 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f9c2406cce0 msgr2=0x7f9c2406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:08.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.807+0000 7f9c45600700 1 --2- 172.21.15.142:0/2887756057 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f9c2406cce0 0x7f9c2406f1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9c300051c0 tx=0x7f9c3000b540 comp rx=0 tx=0).stop 2024-04-20T21:53:08.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.807+0000 7f9c45600700 1 -- 172.21.15.142:0/2887756057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c40103ff0 msgr2=0x7f9c40198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:08.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.807+0000 7f9c45600700 1 --2- 172.21.15.142:0/2887756057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c40103ff0 0x7f9c40198d30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00c8a0 tx=0x7f9c2c00cc60 comp rx=0 tx=0).stop 2024-04-20T21:53:08.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.807+0000 7f9c45600700 1 -- 172.21.15.142:0/2887756057 shutdown_connections 2024-04-20T21:53:08.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.807+0000 7f9c45600700 1 --2- 172.21.15.142:0/2887756057 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f9c2406cce0 0x7f9c2406f1a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:08.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.807+0000 7f9c45600700 1 --2- 172.21.15.142:0/2887756057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c401016c0 0x7f9c401987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:08.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.807+0000 7f9c45600700 1 --2- 172.21.15.142:0/2887756057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c40103ff0 0x7f9c40198d30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:08.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.807+0000 7f9c45600700 1 -- 172.21.15.142:0/2887756057 >> 172.21.15.142:0/2887756057 conn(0x7f9c400fb090 msgr2=0x7f9c40100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:08.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.808+0000 7f9c45600700 1 -- 172.21.15.142:0/2887756057 shutdown_connections 2024-04-20T21:53:08.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:08.808+0000 7f9c45600700 1 -- 172.21.15.142:0/2887756057 wait complete. 2024-04-20T21:53:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:09 smithi164 ceph-mon[23506]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:09 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/2887756057' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-20T21:53:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:09 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/2887756057' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-20T21:53:09.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:09 smithi142 ceph-mon[15828]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:09.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:09 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2887756057' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-20T21:53:09.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:09 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2887756057' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-20T21:53:09.609 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-20T21:53:09.609 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-20T21:53:09.609 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-20T21:53:09.726 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-20T21:53:10.141 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi164/config 2024-04-20T21:53:11.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:11 smithi164 ceph-mon[23506]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:11.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:11 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:53:11.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:11 smithi142 ceph-mon[15828]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:11.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:11 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:53:12.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.411+0000 7f89d6e00700 1 -- 172.21.15.164:0/2816791546 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0101c10 msgr2=0x7f89d0102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:12.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.411+0000 7f89d6e00700 1 --2- 172.21.15.164:0/2816791546 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0101c10 0x7f89d0102070 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009910 tx=0x7f89bc009c20 comp rx=0 tx=0).stop 2024-04-20T21:53:12.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.411+0000 7f89d6e00700 1 -- 172.21.15.164:0/2816791546 shutdown_connections 2024-04-20T21:53:12.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.411+0000 7f89d6e00700 1 --2- 172.21.15.164:0/2816791546 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0101c10 0x7f89d0102070 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:12.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.411+0000 7f89d6e00700 1 --2- 172.21.15.164:0/2816791546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89d0100a10 0x7f89d0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:12.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.411+0000 7f89d6e00700 1 -- 172.21.15.164:0/2816791546 >> 172.21.15.164:0/2816791546 conn(0x7f89d00fbfd0 msgr2=0x7f89d00fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:12.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.412+0000 7f89d6e00700 1 -- 172.21.15.164:0/2816791546 shutdown_connections 2024-04-20T21:53:12.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.412+0000 7f89d6e00700 1 -- 172.21.15.164:0/2816791546 wait complete. 2024-04-20T21:53:12.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.413+0000 7f89d6e00700 1 Processor -- start 2024-04-20T21:53:12.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.413+0000 7f89d6e00700 1 -- start start 2024-04-20T21:53:12.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.413+0000 7f89d6e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89d0100a10 0x7f89d0198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:12.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.413+0000 7f89d6e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0101c10 0x7f89d0198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:12.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.413+0000 7f89d6e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d01992e0 con 0x7f89d0100a10 2024-04-20T21:53:12.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.413+0000 7f89d6e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d0199420 con 0x7f89d0101c10 2024-04-20T21:53:12.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.413+0000 7f89d5000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0101c10 0x7f89d0198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:12.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.413+0000 7f89d5000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0101c10 0x7f89d0198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54124/0 (socket says 172.21.15.164:54124) 2024-04-20T21:53:12.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.413+0000 7f89d5000700 1 -- 172.21.15.164:0/3493382916 learned_addr learned my addr 172.21.15.164:0/3493382916 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-20T21:53:12.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.414+0000 7f89d5a00700 1 --2- 172.21.15.164:0/3493382916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89d0100a10 0x7f89d0198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:12.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.414+0000 7f89d5000700 1 -- 172.21.15.164:0/3493382916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89d0100a10 msgr2=0x7f89d0198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:12.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.414+0000 7f89d5000700 1 --2- 172.21.15.164:0/3493382916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89d0100a10 0x7f89d0198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:12.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.414+0000 7f89d5000700 1 -- 172.21.15.164:0/3493382916 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89bc0095f0 con 0x7f89d0101c10 2024-04-20T21:53:12.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.414+0000 7f89d5a00700 1 --2- 172.21.15.164:0/3493382916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89d0100a10 0x7f89d0198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:53:12.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.414+0000 7f89d5000700 1 --2- 172.21.15.164:0/3493382916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0101c10 0x7f89d0198cc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00bd70 tx=0x7f89bc00be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:12.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.414+0000 7f89ce000700 1 -- 172.21.15.164:0/3493382916 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89bc01d070 con 0x7f89d0101c10 2024-04-20T21:53:12.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.415+0000 7f89ce000700 1 -- 172.21.15.164:0/3493382916 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f89bc00f460 con 0x7f89d0101c10 2024-04-20T21:53:12.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.415+0000 7f89d6e00700 1 -- 172.21.15.164:0/3493382916 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d019ddd0 con 0x7f89d0101c10 2024-04-20T21:53:12.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.415+0000 7f89ce000700 1 -- 172.21.15.164:0/3493382916 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89bc021620 con 0x7f89d0101c10 2024-04-20T21:53:12.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.415+0000 7f89d6e00700 1 -- 172.21.15.164:0/3493382916 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d019e340 con 0x7f89d0101c10 2024-04-20T21:53:12.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.416+0000 7f89d6e00700 1 -- 172.21.15.164:0/3493382916 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d0106110 con 0x7f89d0101c10 2024-04-20T21:53:12.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.417+0000 7f89ce000700 1 -- 172.21.15.164:0/3493382916 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f89bc00fa70 con 0x7f89d0101c10 2024-04-20T21:53:12.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.418+0000 7f89ce000700 1 --2- 172.21.15.164:0/3493382916 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f89b806cce0 0x7f89b806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:12.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.418+0000 7f89ce000700 1 -- 172.21.15.164:0/3493382916 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f89bc08d2b0 con 0x7f89d0101c10 2024-04-20T21:53:12.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.419+0000 7f89d5a00700 1 --2- 172.21.15.164:0/3493382916 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f89b806cce0 0x7f89b806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:12.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.420+0000 7f89d5a00700 1 --2- 172.21.15.164:0/3493382916 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f89b806cce0 0x7f89b806f1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f89d0101a70 tx=0x7f89c4008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:12.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.423+0000 7f89ce000700 1 -- 172.21.15.164:0/3493382916 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f89bc05b450 con 0x7f89d0101c10 2024-04-20T21:53:12.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.728+0000 7f89d6e00700 1 -- 172.21.15.164:0/3493382916 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f89d002cd40 con 0x7f89d0101c10 2024-04-20T21:53:12.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.739+0000 7f89ce000700 1 -- 172.21.15.164:0/3493382916 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7f89bc05afe0 con 0x7f89d0101c10 2024-04-20T21:53:12.739 INFO:teuthology.orchestra.run.smithi164.stdout:[client.1] 2024-04-20T21:53:12.739 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBIOSRmj0CiKxAALuh0oRFZK+19Rd1nm7r8iw== 2024-04-20T21:53:12.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.742+0000 7f89d6e00700 1 -- 172.21.15.164:0/3493382916 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f89b806cce0 msgr2=0x7f89b806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:12.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.742+0000 7f89d6e00700 1 --2- 172.21.15.164:0/3493382916 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f89b806cce0 0x7f89b806f1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f89d0101a70 tx=0x7f89c4008040 comp rx=0 tx=0).stop 2024-04-20T21:53:12.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.742+0000 7f89d6e00700 1 -- 172.21.15.164:0/3493382916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0101c10 msgr2=0x7f89d0198cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:12.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.742+0000 7f89d6e00700 1 --2- 172.21.15.164:0/3493382916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0101c10 0x7f89d0198cc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00bd70 tx=0x7f89bc00be50 comp rx=0 tx=0).stop 2024-04-20T21:53:12.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.742+0000 7f89d6e00700 1 -- 172.21.15.164:0/3493382916 shutdown_connections 2024-04-20T21:53:12.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.742+0000 7f89d6e00700 1 --2- 172.21.15.164:0/3493382916 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f89b806cce0 0x7f89b806f1a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:12.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.742+0000 7f89d6e00700 1 --2- 172.21.15.164:0/3493382916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89d0100a10 0x7f89d0198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:12.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.742+0000 7f89d6e00700 1 --2- 172.21.15.164:0/3493382916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89d0101c10 0x7f89d0198cc0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:12.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.742+0000 7f89d6e00700 1 -- 172.21.15.164:0/3493382916 >> 172.21.15.164:0/3493382916 conn(0x7f89d00fbfd0 msgr2=0x7f89d0103250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:12.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.743+0000 7f89d6e00700 1 -- 172.21.15.164:0/3493382916 shutdown_connections 2024-04-20T21:53:12.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:53:12.743+0000 7f89d6e00700 1 -- 172.21.15.164:0/3493382916 wait complete. 2024-04-20T21:53:13.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:13 smithi164 ceph-mon[23506]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:13.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:13 smithi164 ceph-mon[23506]: from='client.? 172.21.15.164:0/3493382916' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-20T21:53:13.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:13 smithi164 ceph-mon[23506]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-20T21:53:13.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:13 smithi164 ceph-mon[23506]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-20T21:53:13.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:13 smithi142 ceph-mon[15828]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:13.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:13 smithi142 ceph-mon[15828]: from='client.? 172.21.15.164:0/3493382916' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-20T21:53:13.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:13 smithi142 ceph-mon[15828]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-20T21:53:13.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:13 smithi142 ceph-mon[15828]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-20T21:53:13.605 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-20T21:53:13.605 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-04-20T21:53:13.605 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-20T21:53:13.748 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-20T21:53:13.748 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-20T21:53:13.748 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-20T21:53:14.172 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:53:15.184 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:15 smithi142 ceph-mon[15828]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:15.437 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:15 smithi164 ceph-mon[23506]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:16.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.310+0000 7f6f7ea00700 1 -- 172.21.15.142:0/4173373587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f78073ba0 msgr2=0x7f6f78111680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:16.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.310+0000 7f6f7ea00700 1 --2- 172.21.15.142:0/4173373587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f78073ba0 0x7f6f78111680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6f60009910 tx=0x7f6f60009c20 comp rx=0 tx=0).stop 2024-04-20T21:53:16.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.310+0000 7f6f7ea00700 1 -- 172.21.15.142:0/4173373587 shutdown_connections 2024-04-20T21:53:16.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.310+0000 7f6f7ea00700 1 --2- 172.21.15.142:0/4173373587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f78073ba0 0x7f6f78111680 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:16.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.310+0000 7f6f7ea00700 1 --2- 172.21.15.142:0/4173373587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f78073280 0x7f6f78073660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:16.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.310+0000 7f6f7ea00700 1 -- 172.21.15.142:0/4173373587 >> 172.21.15.142:0/4173373587 conn(0x7f6f780fc6c0 msgr2=0x7f6f780feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:16.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.310+0000 7f6f7ea00700 1 -- 172.21.15.142:0/4173373587 shutdown_connections 2024-04-20T21:53:16.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.310+0000 7f6f7ea00700 1 -- 172.21.15.142:0/4173373587 wait complete. 2024-04-20T21:53:16.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.311+0000 7f6f7ea00700 1 Processor -- start 2024-04-20T21:53:16.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.312+0000 7f6f7ea00700 1 -- start start 2024-04-20T21:53:16.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.312+0000 7f6f7ea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f78073280 0x7f6f7819d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:16.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.312+0000 7f6f7ea00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f78073ba0 0x7f6f7819d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:16.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.312+0000 7f6f7ea00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7819dcc0 con 0x7f6f78073280 2024-04-20T21:53:16.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.312+0000 7f6f7ea00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f781a1990 con 0x7f6f78073ba0 2024-04-20T21:53:16.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.312+0000 7f6f77e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f78073280 0x7f6f7819d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:16.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.312+0000 7f6f77e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f78073280 0x7f6f7819d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56404/0 (socket says 172.21.15.142:56404) 2024-04-20T21:53:16.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.312+0000 7f6f77e00700 1 -- 172.21.15.142:0/1098001303 learned_addr learned my addr 172.21.15.142:0/1098001303 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:16.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.313+0000 7f6f6fe00700 1 --2- 172.21.15.142:0/1098001303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f78073ba0 0x7f6f7819d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:16.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.313+0000 7f6f77e00700 1 -- 172.21.15.142:0/1098001303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f78073ba0 msgr2=0x7f6f7819d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:16.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.313+0000 7f6f77e00700 1 --2- 172.21.15.142:0/1098001303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f78073ba0 0x7f6f7819d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:16.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.313+0000 7f6f77e00700 1 -- 172.21.15.142:0/1098001303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f600095f0 con 0x7f6f78073280 2024-04-20T21:53:16.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.313+0000 7f6f77e00700 1 --2- 172.21.15.142:0/1098001303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f78073280 0x7f6f7819d0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800d8d0 tx=0x7f6f6800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.313+0000 7f6f75600700 1 -- 172.21.15.142:0/1098001303 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f68009940 con 0x7f6f78073280 2024-04-20T21:53:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.313+0000 7f6f7ea00700 1 -- 172.21.15.142:0/1098001303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f781a1c70 con 0x7f6f78073280 2024-04-20T21:53:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.313+0000 7f6f75600700 1 -- 172.21.15.142:0/1098001303 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f68010460 con 0x7f6f78073280 2024-04-20T21:53:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.313+0000 7f6f75600700 1 -- 172.21.15.142:0/1098001303 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f6800f5f0 con 0x7f6f78073280 2024-04-20T21:53:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.314+0000 7f6f7ea00700 1 -- 172.21.15.142:0/1098001303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f781a21c0 con 0x7f6f78073280 2024-04-20T21:53:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.315+0000 7f6f7ea00700 1 -- 172.21.15.142:0/1098001303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f780749c0 con 0x7f6f78073280 2024-04-20T21:53:16.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.316+0000 7f6f75600700 1 -- 172.21.15.142:0/1098001303 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f6f680105d0 con 0x7f6f78073280 2024-04-20T21:53:16.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.316+0000 7f6f75600700 1 --2- 172.21.15.142:0/1098001303 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6f5c06cce0 0x7f6f5c06f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:16.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.317+0000 7f6f75600700 1 -- 172.21.15.142:0/1098001303 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f6f6808bfc0 con 0x7f6f78073280 2024-04-20T21:53:16.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.317+0000 7f6f6fe00700 1 --2- 172.21.15.142:0/1098001303 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6f5c06cce0 0x7f6f5c06f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:16.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.318+0000 7f6f6fe00700 1 --2- 172.21.15.142:0/1098001303 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6f5c06cce0 0x7f6f5c06f1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6f60005b40 tx=0x7f6f6001a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:16.320 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.322+0000 7f6f75600700 1 -- 172.21.15.142:0/1098001303 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f6f680bfc50 con 0x7f6f78073280 2024-04-20T21:53:16.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.602+0000 7f6f7ea00700 1 -- 172.21.15.142:0/1098001303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f6f78114410 con 0x7f6f78073280 2024-04-20T21:53:16.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.606+0000 7f6f75600700 1 -- 172.21.15.142:0/1098001303 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+174020 (secure 0 0 0) 0x7f6f680bd7e0 con 0x7f6f78073280 2024-04-20T21:53:16.608 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:53:16.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.610+0000 7f6f7ea00700 1 -- 172.21.15.142:0/1098001303 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6f5c06cce0 msgr2=0x7f6f5c06f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:16.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.610+0000 7f6f7ea00700 1 --2- 172.21.15.142:0/1098001303 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6f5c06cce0 0x7f6f5c06f1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6f60005b40 tx=0x7f6f6001a040 comp rx=0 tx=0).stop 2024-04-20T21:53:16.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.610+0000 7f6f7ea00700 1 -- 172.21.15.142:0/1098001303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f78073280 msgr2=0x7f6f7819d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:16.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.610+0000 7f6f7ea00700 1 --2- 172.21.15.142:0/1098001303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f78073280 0x7f6f7819d0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800d8d0 tx=0x7f6f6800dc90 comp rx=0 tx=0).stop 2024-04-20T21:53:16.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.610+0000 7f6f7ea00700 1 -- 172.21.15.142:0/1098001303 shutdown_connections 2024-04-20T21:53:16.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.610+0000 7f6f7ea00700 1 --2- 172.21.15.142:0/1098001303 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6f5c06cce0 0x7f6f5c06f1a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:16.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.610+0000 7f6f7ea00700 1 --2- 172.21.15.142:0/1098001303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f78073280 0x7f6f7819d0a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:16.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.610+0000 7f6f7ea00700 1 --2- 172.21.15.142:0/1098001303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f78073ba0 0x7f6f7819d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:16.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.610+0000 7f6f7ea00700 1 -- 172.21.15.142:0/1098001303 >> 172.21.15.142:0/1098001303 conn(0x7f6f780fc6c0 msgr2=0x7f6f781008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:16.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.610+0000 7f6f7ea00700 1 -- 172.21.15.142:0/1098001303 shutdown_connections 2024-04-20T21:53:16.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:16.610+0000 7f6f7ea00700 1 -- 172.21.15.142:0/1098001303 wait complete. 2024-04-20T21:53:17.361 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:17 smithi142 ceph-mon[15828]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:17.361 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:17 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1098001303' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-20T21:53:17.435 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":19,"flags":0,"active_gid":14215,"active_name":"smithi142.zzmcfz","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3610638500},{"type":"v1","addr":"172.21.15.142:6801","nonce":3610638500}]},"active_addr":"172.21.15.142:6801/3610638500","active_change":"2024-04-20T21:48:09.914416+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14240,"name":"smithi164.oejajr","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.142:8443/","prometheus":"http://172.21.15.142:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":99578737}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":3333243244}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":4043640333}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":2483063574}]}]} 2024-04-20T21:53:17.439 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-20T21:53:17.439 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-20T21:53:17.440 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-20T21:53:17.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:17 smithi164 ceph-mon[23506]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:17.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:17 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/1098001303' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-20T21:53:17.852 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:53:19.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:19 smithi142 ceph-mon[15828]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:19.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:19 smithi164 ceph-mon[23506]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:19.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.913+0000 7f6bf2a00700 1 -- 172.21.15.142:0/3682659599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bec101de0 msgr2=0x7f6bec1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:19.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.913+0000 7f6bf2a00700 1 --2- 172.21.15.142:0/3682659599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bec101de0 0x7f6bec1021c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00b0a0 tx=0x7f6bdc00b3b0 comp rx=0 tx=0).stop 2024-04-20T21:53:19.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.913+0000 7f6bf2a00700 1 -- 172.21.15.142:0/3682659599 shutdown_connections 2024-04-20T21:53:19.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.913+0000 7f6bf2a00700 1 --2- 172.21.15.142:0/3682659599 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6bec102700 0x7f6bec10abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:19.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.913+0000 7f6bf2a00700 1 --2- 172.21.15.142:0/3682659599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bec101de0 0x7f6bec1021c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:19.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.913+0000 7f6bf2a00700 1 -- 172.21.15.142:0/3682659599 >> 172.21.15.142:0/3682659599 conn(0x7f6bec076750 msgr2=0x7f6bec0fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:19.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.913+0000 7f6bf2a00700 1 -- 172.21.15.142:0/3682659599 shutdown_connections 2024-04-20T21:53:19.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.913+0000 7f6bf2a00700 1 -- 172.21.15.142:0/3682659599 wait complete. 2024-04-20T21:53:19.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.914+0000 7f6bf2a00700 1 Processor -- start 2024-04-20T21:53:19.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.914+0000 7f6bf2a00700 1 -- start start 2024-04-20T21:53:19.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.915+0000 7f6bf2a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bec101de0 0x7f6bec198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:19.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.915+0000 7f6bf2a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6bec102700 0x7f6bec199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:19.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.915+0000 7f6bf2a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec199a30 con 0x7f6bec101de0 2024-04-20T21:53:19.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.915+0000 7f6bf2a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec19d700 con 0x7f6bec102700 2024-04-20T21:53:19.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.915+0000 7f6bebe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bec101de0 0x7f6bec198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:19.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.915+0000 7f6bebe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bec101de0 0x7f6bec198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53420/0 (socket says 172.21.15.142:53420) 2024-04-20T21:53:19.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.915+0000 7f6bebe00700 1 -- 172.21.15.142:0/2781785706 learned_addr learned my addr 172.21.15.142:0/2781785706 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.915+0000 7f6bebe00700 1 -- 172.21.15.142:0/2781785706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6bec102700 msgr2=0x7f6bec199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.915+0000 7f6bebe00700 1 --2- 172.21.15.142:0/2781785706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6bec102700 0x7f6bec199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.915+0000 7f6bebe00700 1 -- 172.21.15.142:0/2781785706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc009d00 con 0x7f6bec101de0 2024-04-20T21:53:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.916+0000 7f6bebe00700 1 --2- 172.21.15.142:0/2781785706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bec101de0 0x7f6bec198e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc015040 tx=0x7f6bdc003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.916+0000 7f6be8c00700 1 -- 172.21.15.142:0/2781785706 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bdc00e040 con 0x7f6bec101de0 2024-04-20T21:53:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.916+0000 7f6be8c00700 1 -- 172.21.15.142:0/2781785706 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6bdc007cd0 con 0x7f6bec101de0 2024-04-20T21:53:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.916+0000 7f6be8c00700 1 -- 172.21.15.142:0/2781785706 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bdc01d6b0 con 0x7f6bec101de0 2024-04-20T21:53:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.916+0000 7f6bf2a00700 1 -- 172.21.15.142:0/2781785706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bec19d980 con 0x7f6bec101de0 2024-04-20T21:53:19.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.916+0000 7f6bf2a00700 1 -- 172.21.15.142:0/2781785706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bec19de70 con 0x7f6bec101de0 2024-04-20T21:53:19.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.917+0000 7f6bf2a00700 1 -- 172.21.15.142:0/2781785706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bec10a750 con 0x7f6bec101de0 2024-04-20T21:53:19.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.919+0000 7f6be8c00700 1 -- 172.21.15.142:0/2781785706 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f6bdc004040 con 0x7f6bec101de0 2024-04-20T21:53:19.918 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.920+0000 7f6be8c00700 1 --2- 172.21.15.142:0/2781785706 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6bd006cce0 0x7f6bd006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:19.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.920+0000 7f6be8c00700 1 -- 172.21.15.142:0/2781785706 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f6bdc08dc50 con 0x7f6bec101de0 2024-04-20T21:53:19.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.920+0000 7f6beb400700 1 --2- 172.21.15.142:0/2781785706 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6bd006cce0 0x7f6bd006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:19.919 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.921+0000 7f6beb400700 1 --2- 172.21.15.142:0/2781785706 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6bd006cce0 0x7f6bd006f1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6bec19a370 tx=0x7f6bd8006d20 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:19.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:19.924+0000 7f6be8c00700 1 -- 172.21.15.142:0/2781785706 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f6bdc0583c0 con 0x7f6bec101de0 2024-04-20T21:53:20.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:20.149+0000 7f6bf2a00700 1 -- 172.21.15.142:0/2781785706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bec068db0 con 0x7f6bec101de0 2024-04-20T21:53:20.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:20.151+0000 7f6be8c00700 1 -- 172.21.15.142:0/2781785706 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+11384 (secure 0 0 0) 0x7f6bdc05b9e0 con 0x7f6bec101de0 2024-04-20T21:53:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:53:20.151 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":42,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","created":"2024-04-20T21:45:27.213653+0000","modified":"2024-04-20T21:52:58.151538+0000","last_up_change":"2024-04-20T21:52:57.146714+0000","last_in_change":"2024-04-20T21:52:31.576977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:51:10.763901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0042c600-a874-4d57-bb8f-7b6f32723bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":477229295},{"type":"v1","addr":"172.21.15.142:6803","nonce":477229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":477229295},{"type":"v1","addr":"172.21.15.142:6805","nonce":477229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":477229295},{"type":"v1","addr":"172.21.15.142:6809","nonce":477229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":477229295},{"type":"v1","addr":"172.21.15.142:6807","nonce":477229295}]},"public_addr":"172.21.15.142:6803/477229295","cluster_addr":"172.21.15.142:6805/477229295","heartbeat_back_addr":"172.21.15.142:6809/477229295","heartbeat_front_addr":"172.21.15.142:6807/477229295","state":["exists","up"]},{"osd":1,"uuid":"29049537-368a-4d1f-b92c-21d962dd8031","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2225466348},{"type":"v1","addr":"172.21.15.142:6811","nonce":2225466348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2225466348},{"type":"v1","addr":"172.21.15.142:6813","nonce":2225466348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2225466348},{"type":"v1","addr":"172.21.15.142:6817","nonce":2225466348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2225466348},{"type":"v1","addr":"172.21.15.142:6815","nonce":2225466348}]},"public_addr":"172.21.15.142:6811/2225466348","cluster_addr":"172.21.15.142:6813/2225466348","heartbeat_back_addr":"172.21.15.142:6817/2225466348","heartbeat_front_addr":"172.21.15.142:6815/2225466348","state":["exists","up"]},{"osd":2,"uuid":"4ea8215b-dc6f-4f18-9d2c-5a5b21e02fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1851191263},{"type":"v1","addr":"172.21.15.142:6819","nonce":1851191263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1851191263},{"type":"v1","addr":"172.21.15.142:6821","nonce":1851191263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1851191263},{"type":"v1","addr":"172.21.15.142:6825","nonce":1851191263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1851191263},{"type":"v1","addr":"172.21.15.142:6823","nonce":1851191263}]},"public_addr":"172.21.15.142:6819/1851191263","cluster_addr":"172.21.15.142:6821/1851191263","heartbeat_back_addr":"172.21.15.142:6825/1851191263","heartbeat_front_addr":"172.21.15.142:6823/1851191263","state":["exists","up"]},{"osd":3,"uuid":"981987e0-cff5-42e9-8129-2a08175c6ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":4283809575},{"type":"v1","addr":"172.21.15.164:6801","nonce":4283809575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":4283809575},{"type":"v1","addr":"172.21.15.164:6803","nonce":4283809575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":4283809575},{"type":"v1","addr":"172.21.15.164:6807","nonce":4283809575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":4283809575},{"type":"v1","addr":"172.21.15.164:6805","nonce":4283809575}]},"public_addr":"172.21.15.164:6801/4283809575","cluster_addr":"172.21.15.164:6803/4283809575","heartbeat_back_addr":"172.21.15.164:6807/4283809575","heartbeat_front_addr":"172.21.15.164:6805/4283809575","state":["exists","up"]},{"osd":4,"uuid":"a839fb7d-f82c-4bb0-8c33-b4f4f261bcae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3702640245},{"type":"v1","addr":"172.21.15.164:6809","nonce":3702640245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":3702640245},{"type":"v1","addr":"172.21.15.164:6811","nonce":3702640245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":3702640245},{"type":"v1","addr":"172.21.15.164:6815","nonce":3702640245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":3702640245},{"type":"v1","addr":"172.21.15.164:6813","nonce":3702640245}]},"public_addr":"172.21.15.164:6809/3702640245","cluster_addr":"172.21.15.164:6811/3702640245","heartbeat_back_addr":"172.21.15.164:6815/3702640245","heartbeat_front_addr":"172.21.15.164:6813/3702640245","state":["exists","up"]},{"osd":5,"uuid":"72378e50-3a51-469d-a402-489d9bbfed7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3340529941},{"type":"v1","addr":"172.21.15.164:6817","nonce":3340529941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3340529941},{"type":"v1","addr":"172.21.15.164:6819","nonce":3340529941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3340529941},{"type":"v1","addr":"172.21.15.164:6823","nonce":3340529941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3340529941},{"type":"v1","addr":"172.21.15.164:6821","nonce":3340529941}]},"public_addr":"172.21.15.164:6817/3340529941","cluster_addr":"172.21.15.164:6819/3340529941","heartbeat_back_addr":"172.21.15.164:6823/3340529941","heartbeat_front_addr":"172.21.15.164:6821/3340529941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:49:52.556673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:50:29.868343+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:51:07.890840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:51:43.365372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:52:18.872393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:52:54.318402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/3515098784":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/195339089":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/4246233855":"2024-04-21T21:46:43.407590+0000","172.21.15.142:0/801898031":"2024-04-21T21:46:43.407590+0000","172.21.15.142:0/1140713527":"2024-04-21T21:46:01.678961+0000","172.21.15.142:6801/550675874":"2024-04-21T21:46:43.407590+0000","172.21.15.142:0/3501876256":"2024-04-21T21:46:01.678961+0000","172.21.15.142:6801/2803679129":"2024-04-21T21:46:01.678961+0000","172.21.15.142:6800/3464616902":"2024-04-21T21:48:09.914211+0000","172.21.15.142:6800/550675874":"2024-04-21T21:46:43.407590+0000","172.21.15.142:6800/2803679129":"2024-04-21T21:46:01.678961+0000","172.21.15.142:0/841637693":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/2901318326":"2024-04-21T21:46:01.678961+0000","172.21.15.142:6801/3464616902":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/680486182":"2024-04-21T21:46:43.407590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:53:20.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:20.154+0000 7f6bf2a00700 1 -- 172.21.15.142:0/2781785706 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6bd006cce0 msgr2=0x7f6bd006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:20.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:20.154+0000 7f6bf2a00700 1 --2- 172.21.15.142:0/2781785706 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6bd006cce0 0x7f6bd006f1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6bec19a370 tx=0x7f6bd8006d20 comp rx=0 tx=0).stop 2024-04-20T21:53:20.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:20.154+0000 7f6bf2a00700 1 -- 172.21.15.142:0/2781785706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bec101de0 msgr2=0x7f6bec198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:20.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:20.154+0000 7f6bf2a00700 1 --2- 172.21.15.142:0/2781785706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bec101de0 0x7f6bec198e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc015040 tx=0x7f6bdc003ce0 comp rx=0 tx=0).stop 2024-04-20T21:53:20.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:20.154+0000 7f6bf2a00700 1 -- 172.21.15.142:0/2781785706 shutdown_connections 2024-04-20T21:53:20.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:20.154+0000 7f6bf2a00700 1 --2- 172.21.15.142:0/2781785706 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6bd006cce0 0x7f6bd006f1a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:20.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:20.154+0000 7f6bf2a00700 1 --2- 172.21.15.142:0/2781785706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bec101de0 0x7f6bec198e10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:20.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:20.154+0000 7f6bf2a00700 1 --2- 172.21.15.142:0/2781785706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6bec102700 0x7f6bec199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:20.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:20.154+0000 7f6bf2a00700 1 -- 172.21.15.142:0/2781785706 >> 172.21.15.142:0/2781785706 conn(0x7f6bec076750 msgr2=0x7f6bec101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:20.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:20.155+0000 7f6bf2a00700 1 -- 172.21.15.142:0/2781785706 shutdown_connections 2024-04-20T21:53:20.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:20.155+0000 7f6bf2a00700 1 -- 172.21.15.142:0/2781785706 wait complete. 2024-04-20T21:53:20.908 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-20T21:53:20.908 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-20T21:53:21.328 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:53:21.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:21 smithi142 ceph-mon[15828]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:21.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:21 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2781785706' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T21:53:21.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:21 smithi164 ceph-mon[23506]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:21.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:21 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/2781785706' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T21:53:23.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:23 smithi142 ceph-mon[15828]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:23.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.406+0000 7f514fc00700 1 -- 172.21.15.142:0/1772676660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5148073c30 msgr2=0x7f514810ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:23.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.406+0000 7f514fc00700 1 --2- 172.21.15.142:0/1772676660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5148073c30 0x7f514810ceb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5134009910 tx=0x7f5134009c20 comp rx=0 tx=0).stop 2024-04-20T21:53:23.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.406+0000 7f514fc00700 1 -- 172.21.15.142:0/1772676660 shutdown_connections 2024-04-20T21:53:23.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.406+0000 7f514fc00700 1 --2- 172.21.15.142:0/1772676660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5148073c30 0x7f514810ceb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:23.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.406+0000 7f514fc00700 1 --2- 172.21.15.142:0/1772676660 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5148073310 0x7f51480736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:23.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.406+0000 7f514fc00700 1 -- 172.21.15.142:0/1772676660 >> 172.21.15.142:0/1772676660 conn(0x7f51480fc6c0 msgr2=0x7f51480feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:23.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.406+0000 7f514fc00700 1 -- 172.21.15.142:0/1772676660 shutdown_connections 2024-04-20T21:53:23.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.406+0000 7f514fc00700 1 -- 172.21.15.142:0/1772676660 wait complete. 2024-04-20T21:53:23.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.407+0000 7f514fc00700 1 Processor -- start 2024-04-20T21:53:23.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.407+0000 7f514fc00700 1 -- start start 2024-04-20T21:53:23.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.408+0000 7f514fc00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5148073310 0x7f5148198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:23.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.408+0000 7f514fc00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5148073c30 0x7f51481992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:23.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.408+0000 7f514fc00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51481999c0 con 0x7f5148073c30 2024-04-20T21:53:23.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.408+0000 7f514fc00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514819d690 con 0x7f5148073310 2024-04-20T21:53:23.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.408+0000 7f513fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5148073c30 0x7f51481992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:23.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.408+0000 7f513fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5148073c30 0x7f51481992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53446/0 (socket says 172.21.15.142:53446) 2024-04-20T21:53:23.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.408+0000 7f513fe00700 1 -- 172.21.15.142:0/1386326983 learned_addr learned my addr 172.21.15.142:0/1386326983 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:23.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.408+0000 7f514d200700 1 --2- 172.21.15.142:0/1386326983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5148073310 0x7f5148198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:23.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.409+0000 7f513fe00700 1 -- 172.21.15.142:0/1386326983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5148073310 msgr2=0x7f5148198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:23.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.409+0000 7f513fe00700 1 --2- 172.21.15.142:0/1386326983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5148073310 0x7f5148198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:23.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.409+0000 7f513fe00700 1 -- 172.21.15.142:0/1386326983 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51340095f0 con 0x7f5148073c30 2024-04-20T21:53:23.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.409+0000 7f514d200700 1 --2- 172.21.15.142:0/1386326983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5148073310 0x7f5148198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:53:23.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.409+0000 7f513fe00700 1 --2- 172.21.15.142:0/1386326983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5148073c30 0x7f51481992e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5134000c00 tx=0x7f513400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:23.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.409+0000 7f5146000700 1 -- 172.21.15.142:0/1386326983 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f513401d070 con 0x7f5148073c30 2024-04-20T21:53:23.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.409+0000 7f5146000700 1 -- 172.21.15.142:0/1386326983 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f51340056e0 con 0x7f5148073c30 2024-04-20T21:53:23.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.409+0000 7f514fc00700 1 -- 172.21.15.142:0/1386326983 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514819d910 con 0x7f5148073c30 2024-04-20T21:53:23.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.409+0000 7f5146000700 1 -- 172.21.15.142:0/1386326983 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f513400fe80 con 0x7f5148073c30 2024-04-20T21:53:23.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.409+0000 7f514fc00700 1 -- 172.21.15.142:0/1386326983 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514819de00 con 0x7f5148073c30 2024-04-20T21:53:23.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.411+0000 7f514fc00700 1 -- 172.21.15.142:0/1386326983 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51480749c0 con 0x7f5148073c30 2024-04-20T21:53:23.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.412+0000 7f5146000700 1 -- 172.21.15.142:0/1386326983 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f513400f6f0 con 0x7f5148073c30 2024-04-20T21:53:23.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.413+0000 7f5146000700 1 --2- 172.21.15.142:0/1386326983 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f512406cce0 0x7f512406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:23.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.413+0000 7f5146000700 1 -- 172.21.15.142:0/1386326983 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f513408d3c0 con 0x7f5148073c30 2024-04-20T21:53:23.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.413+0000 7f514d200700 1 --2- 172.21.15.142:0/1386326983 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f512406cce0 0x7f512406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:23.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.414+0000 7f514d200700 1 --2- 172.21.15.142:0/1386326983 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f512406cce0 0x7f512406f1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f512c005fd0 tx=0x7f512c005ee0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:23.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.417+0000 7f5146000700 1 -- 172.21.15.142:0/1386326983 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f5134057a30 con 0x7f5148073c30 2024-04-20T21:53:23.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:23 smithi164 ceph-mon[23506]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:23.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.636+0000 7f514fc00700 1 -- 172.21.15.142:0/1386326983 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5148110000 con 0x7f5148073c30 2024-04-20T21:53:23.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.640+0000 7f5146000700 1 -- 172.21.15.142:0/1386326983 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+11384 (secure 0 0 0) 0x7f513405b050 con 0x7f5148073c30 2024-04-20T21:53:23.640 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:53:23.640 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":42,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","created":"2024-04-20T21:45:27.213653+0000","modified":"2024-04-20T21:52:58.151538+0000","last_up_change":"2024-04-20T21:52:57.146714+0000","last_in_change":"2024-04-20T21:52:31.576977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:51:10.763901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0042c600-a874-4d57-bb8f-7b6f32723bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":477229295},{"type":"v1","addr":"172.21.15.142:6803","nonce":477229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":477229295},{"type":"v1","addr":"172.21.15.142:6805","nonce":477229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":477229295},{"type":"v1","addr":"172.21.15.142:6809","nonce":477229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":477229295},{"type":"v1","addr":"172.21.15.142:6807","nonce":477229295}]},"public_addr":"172.21.15.142:6803/477229295","cluster_addr":"172.21.15.142:6805/477229295","heartbeat_back_addr":"172.21.15.142:6809/477229295","heartbeat_front_addr":"172.21.15.142:6807/477229295","state":["exists","up"]},{"osd":1,"uuid":"29049537-368a-4d1f-b92c-21d962dd8031","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2225466348},{"type":"v1","addr":"172.21.15.142:6811","nonce":2225466348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2225466348},{"type":"v1","addr":"172.21.15.142:6813","nonce":2225466348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2225466348},{"type":"v1","addr":"172.21.15.142:6817","nonce":2225466348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2225466348},{"type":"v1","addr":"172.21.15.142:6815","nonce":2225466348}]},"public_addr":"172.21.15.142:6811/2225466348","cluster_addr":"172.21.15.142:6813/2225466348","heartbeat_back_addr":"172.21.15.142:6817/2225466348","heartbeat_front_addr":"172.21.15.142:6815/2225466348","state":["exists","up"]},{"osd":2,"uuid":"4ea8215b-dc6f-4f18-9d2c-5a5b21e02fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1851191263},{"type":"v1","addr":"172.21.15.142:6819","nonce":1851191263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1851191263},{"type":"v1","addr":"172.21.15.142:6821","nonce":1851191263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1851191263},{"type":"v1","addr":"172.21.15.142:6825","nonce":1851191263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1851191263},{"type":"v1","addr":"172.21.15.142:6823","nonce":1851191263}]},"public_addr":"172.21.15.142:6819/1851191263","cluster_addr":"172.21.15.142:6821/1851191263","heartbeat_back_addr":"172.21.15.142:6825/1851191263","heartbeat_front_addr":"172.21.15.142:6823/1851191263","state":["exists","up"]},{"osd":3,"uuid":"981987e0-cff5-42e9-8129-2a08175c6ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":4283809575},{"type":"v1","addr":"172.21.15.164:6801","nonce":4283809575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":4283809575},{"type":"v1","addr":"172.21.15.164:6803","nonce":4283809575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":4283809575},{"type":"v1","addr":"172.21.15.164:6807","nonce":4283809575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":4283809575},{"type":"v1","addr":"172.21.15.164:6805","nonce":4283809575}]},"public_addr":"172.21.15.164:6801/4283809575","cluster_addr":"172.21.15.164:6803/4283809575","heartbeat_back_addr":"172.21.15.164:6807/4283809575","heartbeat_front_addr":"172.21.15.164:6805/4283809575","state":["exists","up"]},{"osd":4,"uuid":"a839fb7d-f82c-4bb0-8c33-b4f4f261bcae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3702640245},{"type":"v1","addr":"172.21.15.164:6809","nonce":3702640245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":3702640245},{"type":"v1","addr":"172.21.15.164:6811","nonce":3702640245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":3702640245},{"type":"v1","addr":"172.21.15.164:6815","nonce":3702640245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":3702640245},{"type":"v1","addr":"172.21.15.164:6813","nonce":3702640245}]},"public_addr":"172.21.15.164:6809/3702640245","cluster_addr":"172.21.15.164:6811/3702640245","heartbeat_back_addr":"172.21.15.164:6815/3702640245","heartbeat_front_addr":"172.21.15.164:6813/3702640245","state":["exists","up"]},{"osd":5,"uuid":"72378e50-3a51-469d-a402-489d9bbfed7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3340529941},{"type":"v1","addr":"172.21.15.164:6817","nonce":3340529941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3340529941},{"type":"v1","addr":"172.21.15.164:6819","nonce":3340529941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3340529941},{"type":"v1","addr":"172.21.15.164:6823","nonce":3340529941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3340529941},{"type":"v1","addr":"172.21.15.164:6821","nonce":3340529941}]},"public_addr":"172.21.15.164:6817/3340529941","cluster_addr":"172.21.15.164:6819/3340529941","heartbeat_back_addr":"172.21.15.164:6823/3340529941","heartbeat_front_addr":"172.21.15.164:6821/3340529941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:49:52.556673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:50:29.868343+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:51:07.890840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:51:43.365372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:52:18.872393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:52:54.318402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/3515098784":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/195339089":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/4246233855":"2024-04-21T21:46:43.407590+0000","172.21.15.142:0/801898031":"2024-04-21T21:46:43.407590+0000","172.21.15.142:0/1140713527":"2024-04-21T21:46:01.678961+0000","172.21.15.142:6801/550675874":"2024-04-21T21:46:43.407590+0000","172.21.15.142:0/3501876256":"2024-04-21T21:46:01.678961+0000","172.21.15.142:6801/2803679129":"2024-04-21T21:46:01.678961+0000","172.21.15.142:6800/3464616902":"2024-04-21T21:48:09.914211+0000","172.21.15.142:6800/550675874":"2024-04-21T21:46:43.407590+0000","172.21.15.142:6800/2803679129":"2024-04-21T21:46:01.678961+0000","172.21.15.142:0/841637693":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/2901318326":"2024-04-21T21:46:01.678961+0000","172.21.15.142:6801/3464616902":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/680486182":"2024-04-21T21:46:43.407590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:53:23.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.643+0000 7f514fc00700 1 -- 172.21.15.142:0/1386326983 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f512406cce0 msgr2=0x7f512406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:23.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.643+0000 7f514fc00700 1 --2- 172.21.15.142:0/1386326983 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f512406cce0 0x7f512406f1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f512c005fd0 tx=0x7f512c005ee0 comp rx=0 tx=0).stop 2024-04-20T21:53:23.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.643+0000 7f514fc00700 1 -- 172.21.15.142:0/1386326983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5148073c30 msgr2=0x7f51481992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:23.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.643+0000 7f514fc00700 1 --2- 172.21.15.142:0/1386326983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5148073c30 0x7f51481992e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5134000c00 tx=0x7f513400be20 comp rx=0 tx=0).stop 2024-04-20T21:53:23.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.643+0000 7f514fc00700 1 -- 172.21.15.142:0/1386326983 shutdown_connections 2024-04-20T21:53:23.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.643+0000 7f514fc00700 1 --2- 172.21.15.142:0/1386326983 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f512406cce0 0x7f512406f1a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:23.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.643+0000 7f514fc00700 1 --2- 172.21.15.142:0/1386326983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5148073310 0x7f5148198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:23.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.643+0000 7f514fc00700 1 --2- 172.21.15.142:0/1386326983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5148073c30 0x7f51481992e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:23.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.643+0000 7f514fc00700 1 -- 172.21.15.142:0/1386326983 >> 172.21.15.142:0/1386326983 conn(0x7f51480fc6c0 msgr2=0x7f5148105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:23.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.643+0000 7f514fc00700 1 -- 172.21.15.142:0/1386326983 shutdown_connections 2024-04-20T21:53:23.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:23.643+0000 7f514fc00700 1 -- 172.21.15.142:0/1386326983 wait complete. 2024-04-20T21:53:24.351 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:24 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1386326983' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T21:53:24.414 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-20T21:53:24.414 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-20T21:53:24.415 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-20T21:53:24.415 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-20T21:53:24.416 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-20T21:53:24.416 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-20T21:53:24.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:24 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/1386326983' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T21:53:24.910 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:53:24.919 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:53:24.940 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:53:24.997 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:53:25.016 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:53:25.019 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:53:25.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:25 smithi164 ceph-mon[23506]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:25.353 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:25 smithi142 ceph-mon[15828]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:26.389 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:26 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:53:26.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:26 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:53:27.395 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:27 smithi142 ceph-mon[15828]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:27.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:27 smithi164 ceph-mon[23506]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:29.296 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:29 smithi142 ceph-mon[15828]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:29.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:29 smithi164 ceph-mon[23506]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.067+0000 7f7048800700 1 -- 172.21.15.142:0/806336330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7040105a80 msgr2=0x7f7040105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.067+0000 7f7048800700 1 --2- 172.21.15.142:0/806336330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7040105a80 0x7f7040105e60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7038009910 tx=0x7f7038009c20 comp rx=0 tx=0).stop 2024-04-20T21:53:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.067+0000 7f7048800700 1 -- 172.21.15.142:0/806336330 shutdown_connections 2024-04-20T21:53:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.067+0000 7f7048800700 1 --2- 172.21.15.142:0/806336330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70400ffa80 0x7f70400fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.067+0000 7f7048800700 1 --2- 172.21.15.142:0/806336330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7040105a80 0x7f7040105e60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.067+0000 7f7048800700 1 -- 172.21.15.142:0/806336330 >> 172.21.15.142:0/806336330 conn(0x7f7040076750 msgr2=0x7f70400fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.068+0000 7f7048800700 1 -- 172.21.15.142:0/806336330 shutdown_connections 2024-04-20T21:53:31.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.068+0000 7f7048800700 1 -- 172.21.15.142:0/806336330 wait complete. 2024-04-20T21:53:31.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.069+0000 7f7048800700 1 Processor -- start 2024-04-20T21:53:31.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.069+0000 7f7048800700 1 -- start start 2024-04-20T21:53:31.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.069+0000 7f7048800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70400ffa80 0x7f704019c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:31.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.069+0000 7f7048800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7040105a80 0x7f704019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.069+0000 7f7048800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704019d3c0 con 0x7f7040105a80 2024-04-20T21:53:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.069+0000 7f7048800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70401968e0 con 0x7f70400ffa80 2024-04-20T21:53:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.070+0000 7f7045400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7040105a80 0x7f704019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.070+0000 7f7045400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7040105a80 0x7f704019cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38608/0 (socket says 172.21.15.142:38608) 2024-04-20T21:53:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.070+0000 7f7045400700 1 -- 172.21.15.142:0/1394112089 learned_addr learned my addr 172.21.15.142:0/1394112089 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.070+0000 7f7045e00700 1 --2- 172.21.15.142:0/1394112089 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70400ffa80 0x7f704019c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.070+0000 7f7045400700 1 -- 172.21.15.142:0/1394112089 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70400ffa80 msgr2=0x7f704019c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.070+0000 7f7045400700 1 --2- 172.21.15.142:0/1394112089 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70400ffa80 0x7f704019c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.070+0000 7f7045400700 1 -- 172.21.15.142:0/1394112089 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70380095f0 con 0x7f7040105a80 2024-04-20T21:53:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.070+0000 7f7045400700 1 --2- 172.21.15.142:0/1394112089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7040105a80 0x7f704019cd70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f703000c930 tx=0x7f703000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.071+0000 7f7036a00700 1 -- 172.21.15.142:0/1394112089 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7030007ad0 con 0x7f7040105a80 2024-04-20T21:53:31.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.071+0000 7f7036a00700 1 -- 172.21.15.142:0/1394112089 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7030007c30 con 0x7f7040105a80 2024-04-20T21:53:31.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.071+0000 7f7036a00700 1 -- 172.21.15.142:0/1394112089 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7030018610 con 0x7f7040105a80 2024-04-20T21:53:31.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.071+0000 7f7048800700 1 -- 172.21.15.142:0/1394112089 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7040196bc0 con 0x7f7040105a80 2024-04-20T21:53:31.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.071+0000 7f7048800700 1 -- 172.21.15.142:0/1394112089 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7040197070 con 0x7f7040105a80 2024-04-20T21:53:31.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.072+0000 7f7048800700 1 -- 172.21.15.142:0/1394112089 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f704010cf40 con 0x7f7040105a80 2024-04-20T21:53:31.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.073+0000 7f7036a00700 1 -- 172.21.15.142:0/1394112089 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f703000f450 con 0x7f7040105a80 2024-04-20T21:53:31.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.074+0000 7f7036a00700 1 --2- 172.21.15.142:0/1394112089 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f702c06cce0 0x7f702c06f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:31.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.074+0000 7f7036a00700 1 -- 172.21.15.142:0/1394112089 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f703008c1e0 con 0x7f7040105a80 2024-04-20T21:53:31.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.074+0000 7f7045e00700 1 --2- 172.21.15.142:0/1394112089 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f702c06cce0 0x7f702c06f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:31.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.074+0000 7f7036a00700 1 --2- 172.21.15.142:0/1394112089 >> [v2:172.21.15.142:6810/2225466348,v1:172.21.15.142:6811/2225466348] conn(0x7f702c0729c0 0x7f702c074de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:31.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.074+0000 7f7036a00700 1 -- 172.21.15.142:0/1394112089 --> [v2:172.21.15.142:6810/2225466348,v1:172.21.15.142:6811/2225466348] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f702c075490 con 0x7f702c0729c0 2024-04-20T21:53:31.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.075+0000 7f7036a00700 1 -- 172.21.15.142:0/1394112089 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f703008e810 con 0x7f7040105a80 2024-04-20T21:53:31.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.075+0000 7f7046800700 1 --2- 172.21.15.142:0/1394112089 >> [v2:172.21.15.142:6810/2225466348,v1:172.21.15.142:6811/2225466348] conn(0x7f702c0729c0 0x7f702c074de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:31.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.075+0000 7f7045e00700 1 --2- 172.21.15.142:0/1394112089 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f702c06cce0 0x7f702c06f1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f703800b5c0 tx=0x7f703801a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:31.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.075+0000 7f7046800700 1 --2- 172.21.15.142:0/1394112089 >> [v2:172.21.15.142:6810/2225466348,v1:172.21.15.142:6811/2225466348] conn(0x7f702c0729c0 0x7f702c074de0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:31.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.076+0000 7f7036a00700 1 -- 172.21.15.142:0/1394112089 <== osd.1 v2:172.21.15.142:6810/2225466348 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f702c075490 con 0x7f702c0729c0 2024-04-20T21:53:31.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.093+0000 7f7048800700 1 -- 172.21.15.142:0/1394112089 --> [v2:172.21.15.142:6810/2225466348,v1:172.21.15.142:6811/2225466348] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7040197580 con 0x7f702c0729c0 2024-04-20T21:53:31.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.094+0000 7f7036a00700 1 -- 172.21.15.142:0/1394112089 <== osd.1 v2:172.21.15.142:6810/2225466348 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7040197580 con 0x7f702c0729c0 2024-04-20T21:53:31.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.094+0000 7f7048800700 1 -- 172.21.15.142:0/1394112089 >> [v2:172.21.15.142:6810/2225466348,v1:172.21.15.142:6811/2225466348] conn(0x7f702c0729c0 msgr2=0x7f702c074de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:31.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.094+0000 7f7048800700 1 --2- 172.21.15.142:0/1394112089 >> [v2:172.21.15.142:6810/2225466348,v1:172.21.15.142:6811/2225466348] conn(0x7f702c0729c0 0x7f702c074de0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:31.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.094+0000 7f7048800700 1 -- 172.21.15.142:0/1394112089 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f702c06cce0 msgr2=0x7f702c06f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:31.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.094+0000 7f7048800700 1 --2- 172.21.15.142:0/1394112089 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f702c06cce0 0x7f702c06f1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f703800b5c0 tx=0x7f703801a040 comp rx=0 tx=0).stop 2024-04-20T21:53:31.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.094+0000 7f7048800700 1 -- 172.21.15.142:0/1394112089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7040105a80 msgr2=0x7f704019cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:31.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.094+0000 7f7048800700 1 --2- 172.21.15.142:0/1394112089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7040105a80 0x7f704019cd70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f703000c930 tx=0x7f703000ccf0 comp rx=0 tx=0).stop 2024-04-20T21:53:31.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.094+0000 7f7048800700 1 -- 172.21.15.142:0/1394112089 shutdown_connections 2024-04-20T21:53:31.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.094+0000 7f7048800700 1 --2- 172.21.15.142:0/1394112089 >> [v2:172.21.15.142:6810/2225466348,v1:172.21.15.142:6811/2225466348] conn(0x7f702c0729c0 0x7f702c074de0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:31.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.094+0000 7f7048800700 1 --2- 172.21.15.142:0/1394112089 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f702c06cce0 0x7f702c06f1a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:31.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.094+0000 7f7048800700 1 --2- 172.21.15.142:0/1394112089 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f70400ffa80 0x7f704019c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:31.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.094+0000 7f7048800700 1 --2- 172.21.15.142:0/1394112089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7040105a80 0x7f704019cd70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:31.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.095+0000 7f7048800700 1 -- 172.21.15.142:0/1394112089 >> 172.21.15.142:0/1394112089 conn(0x7f7040076750 msgr2=0x7f70400fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:31.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.095+0000 7f7048800700 1 -- 172.21.15.142:0/1394112089 shutdown_connections 2024-04-20T21:53:31.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:31.095+0000 7f7048800700 1 -- 172.21.15.142:0/1394112089 wait complete. 2024-04-20T21:53:31.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:31 smithi142 ceph-mon[15828]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:31.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:31 smithi164 ceph-mon[23506]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:33.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:33 smithi142 ceph-mon[15828]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:33.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.333+0000 7f80a2600700 1 -- 172.21.15.142:0/3574899063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f809c0ffa80 msgr2=0x7f809c0fff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:33.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.333+0000 7f80a2600700 1 --2- 172.21.15.142:0/3574899063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f809c0ffa80 0x7f809c0fff00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8084009910 tx=0x7f8084009c20 comp rx=0 tx=0).stop 2024-04-20T21:53:33.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.333+0000 7f80a2600700 1 -- 172.21.15.142:0/3574899063 shutdown_connections 2024-04-20T21:53:33.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.333+0000 7f80a2600700 1 --2- 172.21.15.142:0/3574899063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f809c0ffa80 0x7f809c0fff00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:33.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.333+0000 7f80a2600700 1 --2- 172.21.15.142:0/3574899063 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f809c105a80 0x7f809c105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:33.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.333+0000 7f80a2600700 1 -- 172.21.15.142:0/3574899063 >> 172.21.15.142:0/3574899063 conn(0x7f809c076750 msgr2=0x7f809c0fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:33.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.333+0000 7f80a2600700 1 -- 172.21.15.142:0/3574899063 shutdown_connections 2024-04-20T21:53:33.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.333+0000 7f80a2600700 1 -- 172.21.15.142:0/3574899063 wait complete. 2024-04-20T21:53:33.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.335+0000 7f80a2600700 1 Processor -- start 2024-04-20T21:53:33.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.335+0000 7f80a2600700 1 -- start start 2024-04-20T21:53:33.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.336+0000 7f80a2600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f809c0ffa80 0x7f809c19c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:33.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.336+0000 7f80a2600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f809c105a80 0x7f809c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:33.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.336+0000 7f80a2600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c19d320 con 0x7f809c105a80 2024-04-20T21:53:33.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.336+0000 7f80a2600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c196950 con 0x7f809c0ffa80 2024-04-20T21:53:33.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.336+0000 7f8093e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f809c105a80 0x7f809c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:33.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.336+0000 7f8093e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f809c105a80 0x7f809c19cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38632/0 (socket says 172.21.15.142:38632) 2024-04-20T21:53:33.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.336+0000 7f8093e00700 1 -- 172.21.15.142:0/527365134 learned_addr learned my addr 172.21.15.142:0/527365134 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:33.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.336+0000 7f8093e00700 1 -- 172.21.15.142:0/527365134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f809c0ffa80 msgr2=0x7f809c19c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:33.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.336+0000 7f809b400700 1 --2- 172.21.15.142:0/527365134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f809c0ffa80 0x7f809c19c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:33.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.337+0000 7f8093e00700 1 --2- 172.21.15.142:0/527365134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f809c0ffa80 0x7f809c19c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:33.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.337+0000 7f8093e00700 1 -- 172.21.15.142:0/527365134 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80840095f0 con 0x7f809c105a80 2024-04-20T21:53:33.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.337+0000 7f8093e00700 1 --2- 172.21.15.142:0/527365134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f809c105a80 0x7f809c19cd00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f80840092e0 tx=0x7f808400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:33.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.337+0000 7f8098c00700 1 -- 172.21.15.142:0/527365134 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f808401d070 con 0x7f809c105a80 2024-04-20T21:53:33.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.337+0000 7f8098c00700 1 -- 172.21.15.142:0/527365134 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f808400f460 con 0x7f809c105a80 2024-04-20T21:53:33.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.337+0000 7f8098c00700 1 -- 172.21.15.142:0/527365134 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8084017630 con 0x7f809c105a80 2024-04-20T21:53:33.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.337+0000 7f80a2600700 1 -- 172.21.15.142:0/527365134 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809c196bd0 con 0x7f809c105a80 2024-04-20T21:53:33.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.337+0000 7f80a2600700 1 -- 172.21.15.142:0/527365134 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809c1970c0 con 0x7f809c105a80 2024-04-20T21:53:33.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.338+0000 7f80a2600700 1 -- 172.21.15.142:0/527365134 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f809c10cf80 con 0x7f809c105a80 2024-04-20T21:53:33.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.339+0000 7f8098c00700 1 -- 172.21.15.142:0/527365134 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f808400f5d0 con 0x7f809c105a80 2024-04-20T21:53:33.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.341+0000 7f8098c00700 1 --2- 172.21.15.142:0/527365134 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f808006cce0 0x7f808006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:33.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.341+0000 7f8098c00700 1 -- 172.21.15.142:0/527365134 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f808408da20 con 0x7f809c105a80 2024-04-20T21:53:33.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.341+0000 7f809b400700 1 --2- 172.21.15.142:0/527365134 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f808006cce0 0x7f808006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:33.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.341+0000 7f8098c00700 1 --2- 172.21.15.142:0/527365134 >> [v2:172.21.15.164:6816/3340529941,v1:172.21.15.164:6817/3340529941] conn(0x7f80800729c0 0x7f8080074de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:33.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.341+0000 7f8098c00700 1 -- 172.21.15.142:0/527365134 --> [v2:172.21.15.164:6816/3340529941,v1:172.21.15.164:6817/3340529941] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8080075490 con 0x7f80800729c0 2024-04-20T21:53:33.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.342+0000 7f8098c00700 1 -- 172.21.15.142:0/527365134 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f808408dde0 con 0x7f809c105a80 2024-04-20T21:53:33.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.342+0000 7f809b400700 1 --2- 172.21.15.142:0/527365134 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f808006cce0 0x7f808006f1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f808c005950 tx=0x7f808c005cf0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:33.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.342+0000 7f809be00700 1 --2- 172.21.15.142:0/527365134 >> [v2:172.21.15.164:6816/3340529941,v1:172.21.15.164:6817/3340529941] conn(0x7f80800729c0 0x7f8080074de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:33.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.343+0000 7f809be00700 1 --2- 172.21.15.142:0/527365134 >> [v2:172.21.15.164:6816/3340529941,v1:172.21.15.164:6817/3340529941] conn(0x7f80800729c0 0x7f8080074de0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:33.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.345+0000 7f8098c00700 1 -- 172.21.15.142:0/527365134 <== osd.5 v2:172.21.15.164:6816/3340529941 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f8080075490 con 0x7f80800729c0 2024-04-20T21:53:33.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.362+0000 7f80a2600700 1 -- 172.21.15.142:0/527365134 --> [v2:172.21.15.164:6816/3340529941,v1:172.21.15.164:6817/3340529941] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f809c197520 con 0x7f80800729c0 2024-04-20T21:53:33.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.363+0000 7f8098c00700 1 -- 172.21.15.142:0/527365134 <== osd.5 v2:172.21.15.164:6816/3340529941 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f809c197520 con 0x7f80800729c0 2024-04-20T21:53:33.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.364+0000 7f80a2600700 1 -- 172.21.15.142:0/527365134 >> [v2:172.21.15.164:6816/3340529941,v1:172.21.15.164:6817/3340529941] conn(0x7f80800729c0 msgr2=0x7f8080074de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:33.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.364+0000 7f80a2600700 1 --2- 172.21.15.142:0/527365134 >> [v2:172.21.15.164:6816/3340529941,v1:172.21.15.164:6817/3340529941] conn(0x7f80800729c0 0x7f8080074de0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:33.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.364+0000 7f80a2600700 1 -- 172.21.15.142:0/527365134 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f808006cce0 msgr2=0x7f808006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:33.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.364+0000 7f80a2600700 1 --2- 172.21.15.142:0/527365134 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f808006cce0 0x7f808006f1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f808c005950 tx=0x7f808c005cf0 comp rx=0 tx=0).stop 2024-04-20T21:53:33.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.364+0000 7f80a2600700 1 -- 172.21.15.142:0/527365134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f809c105a80 msgr2=0x7f809c19cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:33.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.364+0000 7f80a2600700 1 --2- 172.21.15.142:0/527365134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f809c105a80 0x7f809c19cd00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f80840092e0 tx=0x7f808400be20 comp rx=0 tx=0).stop 2024-04-20T21:53:33.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.364+0000 7f80a2600700 1 -- 172.21.15.142:0/527365134 shutdown_connections 2024-04-20T21:53:33.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.364+0000 7f80a2600700 1 --2- 172.21.15.142:0/527365134 >> [v2:172.21.15.164:6816/3340529941,v1:172.21.15.164:6817/3340529941] conn(0x7f80800729c0 0x7f8080074de0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:33.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.364+0000 7f80a2600700 1 --2- 172.21.15.142:0/527365134 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f808006cce0 0x7f808006f1a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:33.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.364+0000 7f80a2600700 1 --2- 172.21.15.142:0/527365134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f809c0ffa80 0x7f809c19c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:33.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.364+0000 7f80a2600700 1 --2- 172.21.15.142:0/527365134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f809c105a80 0x7f809c19cd00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:33.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.364+0000 7f80a2600700 1 -- 172.21.15.142:0/527365134 >> 172.21.15.142:0/527365134 conn(0x7f809c076750 msgr2=0x7f809c103230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:33.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.365+0000 7f80a2600700 1 -- 172.21.15.142:0/527365134 shutdown_connections 2024-04-20T21:53:33.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.365+0000 7f80a2600700 1 -- 172.21.15.142:0/527365134 wait complete. 2024-04-20T21:53:33.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:33 smithi164 ceph-mon[23506]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:33.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.430+0000 7fc1c1400700 1 -- 172.21.15.142:0/1488020817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1bc108a60 msgr2=0x7fc1bc115650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:33.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.430+0000 7fc1c1400700 1 --2- 172.21.15.142:0/1488020817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1bc108a60 0x7fc1bc115650 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009940 tx=0x7fc1a8009c50 comp rx=0 tx=0).stop 2024-04-20T21:53:33.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.430+0000 7fc1c1400700 1 -- 172.21.15.142:0/1488020817 shutdown_connections 2024-04-20T21:53:33.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.430+0000 7fc1c1400700 1 --2- 172.21.15.142:0/1488020817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1bc108a60 0x7fc1bc115650 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:33.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.430+0000 7fc1c1400700 1 --2- 172.21.15.142:0/1488020817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1bc108140 0x7fc1bc108520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:33.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.430+0000 7fc1c1400700 1 -- 172.21.15.142:0/1488020817 >> 172.21.15.142:0/1488020817 conn(0x7fc1bc06c110 msgr2=0x7fc1bc06c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:33.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.430+0000 7fc1c1400700 1 -- 172.21.15.142:0/1488020817 shutdown_connections 2024-04-20T21:53:33.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.430+0000 7fc1c1400700 1 -- 172.21.15.142:0/1488020817 wait complete. 2024-04-20T21:53:33.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.431+0000 7fc1c1400700 1 Processor -- start 2024-04-20T21:53:33.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.431+0000 7fc1c1400700 1 -- start start 2024-04-20T21:53:33.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.432+0000 7fc1c1400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1bc108140 0x7fc1bc1a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:33.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.432+0000 7fc1c1400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1bc108a60 0x7fc1bc1a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:33.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.432+0000 7fc1c1400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc1a2160 con 0x7fc1bc108140 2024-04-20T21:53:33.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.432+0000 7fc1c1400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc1a5e30 con 0x7fc1bc108a60 2024-04-20T21:53:33.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.432+0000 7fc1ba800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1bc108140 0x7fc1bc1a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:33.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.432+0000 7fc1ba800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1bc108140 0x7fc1bc1a1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38654/0 (socket says 172.21.15.142:38654) 2024-04-20T21:53:33.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.432+0000 7fc1ba800700 1 -- 172.21.15.142:0/3377915171 learned_addr learned my addr 172.21.15.142:0/3377915171 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:33.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.433+0000 7fc1b9e00700 1 --2- 172.21.15.142:0/3377915171 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1bc108a60 0x7fc1bc1a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:33.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.433+0000 7fc1ba800700 1 -- 172.21.15.142:0/3377915171 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1bc108a60 msgr2=0x7fc1bc1a1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:33.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.433+0000 7fc1ba800700 1 --2- 172.21.15.142:0/3377915171 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1bc108a60 0x7fc1bc1a1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:33.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.433+0000 7fc1ba800700 1 -- 172.21.15.142:0/3377915171 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a80095f0 con 0x7fc1bc108140 2024-04-20T21:53:33.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.433+0000 7fc1ba800700 1 --2- 172.21.15.142:0/3377915171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1bc108140 0x7fc1bc1a1540 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac00c8a0 tx=0x7fc1ac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:33.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.433+0000 7fc1b3400700 1 -- 172.21.15.142:0/3377915171 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1ac00cea0 con 0x7fc1bc108140 2024-04-20T21:53:33.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.433+0000 7fc1c1400700 1 -- 172.21.15.142:0/3377915171 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1bc1a6110 con 0x7fc1bc108140 2024-04-20T21:53:33.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.433+0000 7fc1b3400700 1 -- 172.21.15.142:0/3377915171 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1ac004830 con 0x7fc1bc108140 2024-04-20T21:53:33.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.433+0000 7fc1c1400700 1 -- 172.21.15.142:0/3377915171 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1bc1a6630 con 0x7fc1bc108140 2024-04-20T21:53:33.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.433+0000 7fc1b3400700 1 -- 172.21.15.142:0/3377915171 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1ac0055b0 con 0x7fc1bc108140 2024-04-20T21:53:33.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.434+0000 7fc1c1400700 1 -- 172.21.15.142:0/3377915171 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc1bc118ad0 con 0x7fc1bc108140 2024-04-20T21:53:33.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.436+0000 7fc1b3400700 1 -- 172.21.15.142:0/3377915171 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc1ac0049a0 con 0x7fc1bc108140 2024-04-20T21:53:33.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.437+0000 7fc1b3400700 1 --2- 172.21.15.142:0/3377915171 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc1a006ccf0 0x7fc1a006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:33.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.437+0000 7fc1b3400700 1 -- 172.21.15.142:0/3377915171 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc1ac08bfd0 con 0x7fc1bc108140 2024-04-20T21:53:33.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.437+0000 7fc1b3400700 1 --2- 172.21.15.142:0/3377915171 >> [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263] conn(0x7fc1a00729d0 0x7fc1a0074df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:33.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.437+0000 7fc1b3400700 1 -- 172.21.15.142:0/3377915171 --> [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc1a00754a0 con 0x7fc1a00729d0 2024-04-20T21:53:33.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.437+0000 7fc1b9e00700 1 --2- 172.21.15.142:0/3377915171 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc1a006ccf0 0x7fc1a006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:33.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.437+0000 7fc1b3400700 1 -- 172.21.15.142:0/3377915171 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1ac08c430 con 0x7fc1bc108140 2024-04-20T21:53:33.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.437+0000 7fc1bb200700 1 --2- 172.21.15.142:0/3377915171 >> [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263] conn(0x7fc1a00729d0 0x7fc1a0074df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:33.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.438+0000 7fc1b9e00700 1 --2- 172.21.15.142:0/3377915171 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc1a006ccf0 0x7fc1a006f1b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009910 tx=0x7fc1a8005c20 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:33.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.438+0000 7fc1bb200700 1 --2- 172.21.15.142:0/3377915171 >> [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263] conn(0x7fc1a00729d0 0x7fc1a0074df0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:33.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.439+0000 7fc1b3400700 1 -- 172.21.15.142:0/3377915171 <== osd.2 v2:172.21.15.142:6818/1851191263 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fc1a00754a0 con 0x7fc1a00729d0 2024-04-20T21:53:33.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.456+0000 7fc1c1400700 1 -- 172.21.15.142:0/3377915171 --> [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc1bc072930 con 0x7fc1a00729d0 2024-04-20T21:53:33.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.456+0000 7fc1b3400700 1 -- 172.21.15.142:0/3377915171 <== osd.2 v2:172.21.15.142:6818/1851191263 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc1bc072930 con 0x7fc1a00729d0 2024-04-20T21:53:33.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.457+0000 7fc1c1400700 1 -- 172.21.15.142:0/3377915171 >> [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263] conn(0x7fc1a00729d0 msgr2=0x7fc1a0074df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:33.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.457+0000 7fc1c1400700 1 --2- 172.21.15.142:0/3377915171 >> [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263] conn(0x7fc1a00729d0 0x7fc1a0074df0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:33.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.457+0000 7fc1c1400700 1 -- 172.21.15.142:0/3377915171 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc1a006ccf0 msgr2=0x7fc1a006f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:33.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.457+0000 7fc1c1400700 1 --2- 172.21.15.142:0/3377915171 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc1a006ccf0 0x7fc1a006f1b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009910 tx=0x7fc1a8005c20 comp rx=0 tx=0).stop 2024-04-20T21:53:33.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.457+0000 7fc1c1400700 1 -- 172.21.15.142:0/3377915171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1bc108140 msgr2=0x7fc1bc1a1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:33.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.457+0000 7fc1c1400700 1 --2- 172.21.15.142:0/3377915171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1bc108140 0x7fc1bc1a1540 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac00c8a0 tx=0x7fc1ac00cc60 comp rx=0 tx=0).stop 2024-04-20T21:53:33.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.457+0000 7fc1c1400700 1 -- 172.21.15.142:0/3377915171 shutdown_connections 2024-04-20T21:53:33.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.457+0000 7fc1c1400700 1 --2- 172.21.15.142:0/3377915171 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc1a006ccf0 0x7fc1a006f1b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:33.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.457+0000 7fc1c1400700 1 --2- 172.21.15.142:0/3377915171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1bc108140 0x7fc1bc1a1540 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:33.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.457+0000 7fc1c1400700 1 --2- 172.21.15.142:0/3377915171 >> [v2:172.21.15.142:6818/1851191263,v1:172.21.15.142:6819/1851191263] conn(0x7fc1a00729d0 0x7fc1a0074df0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:33.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.457+0000 7fc1c1400700 1 --2- 172.21.15.142:0/3377915171 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1bc108a60 0x7fc1bc1a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:33.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.457+0000 7fc1c1400700 1 -- 172.21.15.142:0/3377915171 >> 172.21.15.142:0/3377915171 conn(0x7fc1bc06c110 msgr2=0x7fc1bc071170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:33.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.457+0000 7fc1c1400700 1 -- 172.21.15.142:0/3377915171 shutdown_connections 2024-04-20T21:53:33.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:32.457+0000 7fc1c1400700 1 -- 172.21.15.142:0/3377915171 wait complete. 2024-04-20T21:53:34.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.280+0000 7f4433c00700 1 -- 172.21.15.142:0/2843677040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f442c073c30 msgr2=0x7f442c10ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:34.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.280+0000 7f4433c00700 1 --2- 172.21.15.142:0/2843677040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f442c073c30 0x7f442c10ceb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4418009910 tx=0x7f4418009c20 comp rx=0 tx=0).stop 2024-04-20T21:53:34.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.280+0000 7f4433c00700 1 -- 172.21.15.142:0/2843677040 shutdown_connections 2024-04-20T21:53:34.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.280+0000 7f4433c00700 1 --2- 172.21.15.142:0/2843677040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f442c073c30 0x7f442c10ceb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:34.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.280+0000 7f4433c00700 1 --2- 172.21.15.142:0/2843677040 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f442c073310 0x7f442c0736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:34.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.280+0000 7f4433c00700 1 -- 172.21.15.142:0/2843677040 >> 172.21.15.142:0/2843677040 conn(0x7f442c0fc6c0 msgr2=0x7f442c0feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:34.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.280+0000 7f4433c00700 1 -- 172.21.15.142:0/2843677040 shutdown_connections 2024-04-20T21:53:34.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.280+0000 7f4433c00700 1 -- 172.21.15.142:0/2843677040 wait complete. 2024-04-20T21:53:34.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.281+0000 7f4433c00700 1 Processor -- start 2024-04-20T21:53:34.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.281+0000 7f4433c00700 1 -- start start 2024-04-20T21:53:34.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.282+0000 7f4433c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f442c073310 0x7f442c198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:34.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.282+0000 7f4433c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f442c073c30 0x7f442c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:34.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.282+0000 7f4433c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c1999c0 con 0x7f442c073c30 2024-04-20T21:53:34.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.282+0000 7f4433c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c19d690 con 0x7f442c073310 2024-04-20T21:53:34.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.282+0000 7f442be00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f442c073c30 0x7f442c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:34.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.282+0000 7f442be00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f442c073c30 0x7f442c1992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38666/0 (socket says 172.21.15.142:38666) 2024-04-20T21:53:34.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.282+0000 7f442be00700 1 -- 172.21.15.142:0/1061257345 learned_addr learned my addr 172.21.15.142:0/1061257345 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:34.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.282+0000 7f4431200700 1 --2- 172.21.15.142:0/1061257345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f442c073310 0x7f442c198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:34.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.283+0000 7f442be00700 1 -- 172.21.15.142:0/1061257345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f442c073310 msgr2=0x7f442c198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:34.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.283+0000 7f442be00700 1 --2- 172.21.15.142:0/1061257345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f442c073310 0x7f442c198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:34.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.283+0000 7f442be00700 1 -- 172.21.15.142:0/1061257345 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44180095f0 con 0x7f442c073c30 2024-04-20T21:53:34.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.283+0000 7f442be00700 1 --2- 172.21.15.142:0/1061257345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f442c073c30 0x7f442c1992e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f44180092e0 tx=0x7f441800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:34.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.283+0000 7f4429600700 1 -- 172.21.15.142:0/1061257345 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f441801d070 con 0x7f442c073c30 2024-04-20T21:53:34.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.283+0000 7f4429600700 1 -- 172.21.15.142:0/1061257345 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f441800f460 con 0x7f442c073c30 2024-04-20T21:53:34.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.283+0000 7f4433c00700 1 -- 172.21.15.142:0/1061257345 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442c19d910 con 0x7f442c073c30 2024-04-20T21:53:34.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.283+0000 7f4429600700 1 -- 172.21.15.142:0/1061257345 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4418017630 con 0x7f442c073c30 2024-04-20T21:53:34.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.283+0000 7f4433c00700 1 -- 172.21.15.142:0/1061257345 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442c19de00 con 0x7f442c073c30 2024-04-20T21:53:34.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.284+0000 7f4433c00700 1 -- 172.21.15.142:0/1061257345 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f442c110250 con 0x7f442c073c30 2024-04-20T21:53:34.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.285+0000 7f4429600700 1 -- 172.21.15.142:0/1061257345 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f441800f5d0 con 0x7f442c073c30 2024-04-20T21:53:34.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.286+0000 7f4429600700 1 --2- 172.21.15.142:0/1061257345 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f441406cce0 0x7f441406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:34.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.286+0000 7f4429600700 1 -- 172.21.15.142:0/1061257345 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f441808d410 con 0x7f442c073c30 2024-04-20T21:53:34.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.287+0000 7f4431200700 1 --2- 172.21.15.142:0/1061257345 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f441406cce0 0x7f441406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:34.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.287+0000 7f4429600700 1 --2- 172.21.15.142:0/1061257345 >> [v2:172.21.15.142:6802/477229295,v1:172.21.15.142:6803/477229295] conn(0x7f44140729c0 0x7f4414074de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:34.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.287+0000 7f4429600700 1 -- 172.21.15.142:0/1061257345 --> [v2:172.21.15.142:6802/477229295,v1:172.21.15.142:6803/477229295] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4414075490 con 0x7f44140729c0 2024-04-20T21:53:34.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.287+0000 7f4429600700 1 -- 172.21.15.142:0/1061257345 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f441808fa40 con 0x7f442c073c30 2024-04-20T21:53:34.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.287+0000 7f4431c00700 1 --2- 172.21.15.142:0/1061257345 >> [v2:172.21.15.142:6802/477229295,v1:172.21.15.142:6803/477229295] conn(0x7f44140729c0 0x7f4414074de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:34.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.287+0000 7f4431200700 1 --2- 172.21.15.142:0/1061257345 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f441406cce0 0x7f441406f1a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f44200060b0 tx=0x7f4420007b80 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:34.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.288+0000 7f4431c00700 1 --2- 172.21.15.142:0/1061257345 >> [v2:172.21.15.142:6802/477229295,v1:172.21.15.142:6803/477229295] conn(0x7f44140729c0 0x7f4414074de0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:34.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.289+0000 7f4429600700 1 -- 172.21.15.142:0/1061257345 <== osd.0 v2:172.21.15.142:6802/477229295 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f4414075490 con 0x7f44140729c0 2024-04-20T21:53:34.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.305+0000 7f4433c00700 1 -- 172.21.15.142:0/1061257345 --> [v2:172.21.15.142:6802/477229295,v1:172.21.15.142:6803/477229295] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f442c19e2b0 con 0x7f44140729c0 2024-04-20T21:53:34.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.306+0000 7f4429600700 1 -- 172.21.15.142:0/1061257345 <== osd.0 v2:172.21.15.142:6802/477229295 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f442c19e2b0 con 0x7f44140729c0 2024-04-20T21:53:34.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.306+0000 7f4433c00700 1 -- 172.21.15.142:0/1061257345 >> [v2:172.21.15.142:6802/477229295,v1:172.21.15.142:6803/477229295] conn(0x7f44140729c0 msgr2=0x7f4414074de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:34.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.306+0000 7f4433c00700 1 --2- 172.21.15.142:0/1061257345 >> [v2:172.21.15.142:6802/477229295,v1:172.21.15.142:6803/477229295] conn(0x7f44140729c0 0x7f4414074de0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:34.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.306+0000 7f4433c00700 1 -- 172.21.15.142:0/1061257345 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f441406cce0 msgr2=0x7f441406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:34.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.306+0000 7f4433c00700 1 --2- 172.21.15.142:0/1061257345 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f441406cce0 0x7f441406f1a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f44200060b0 tx=0x7f4420007b80 comp rx=0 tx=0).stop 2024-04-20T21:53:34.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.306+0000 7f4433c00700 1 -- 172.21.15.142:0/1061257345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f442c073c30 msgr2=0x7f442c1992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:34.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.306+0000 7f4433c00700 1 --2- 172.21.15.142:0/1061257345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f442c073c30 0x7f442c1992e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f44180092e0 tx=0x7f441800be20 comp rx=0 tx=0).stop 2024-04-20T21:53:34.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.307+0000 7f4433c00700 1 -- 172.21.15.142:0/1061257345 shutdown_connections 2024-04-20T21:53:34.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.307+0000 7f4433c00700 1 --2- 172.21.15.142:0/1061257345 >> [v2:172.21.15.142:6802/477229295,v1:172.21.15.142:6803/477229295] conn(0x7f44140729c0 0x7f4414074de0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:34.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.307+0000 7f4433c00700 1 --2- 172.21.15.142:0/1061257345 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f441406cce0 0x7f441406f1a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:34.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.307+0000 7f4433c00700 1 --2- 172.21.15.142:0/1061257345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f442c073310 0x7f442c198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:34.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.307+0000 7f4433c00700 1 --2- 172.21.15.142:0/1061257345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f442c073c30 0x7f442c1992e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:34.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.307+0000 7f4433c00700 1 -- 172.21.15.142:0/1061257345 >> 172.21.15.142:0/1061257345 conn(0x7f442c0fc6c0 msgr2=0x7f442c105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:34.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.307+0000 7f4433c00700 1 -- 172.21.15.142:0/1061257345 shutdown_connections 2024-04-20T21:53:34.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:34.307+0000 7f4433c00700 1 -- 172.21.15.142:0/1061257345 wait complete. 2024-04-20T21:53:34.637 INFO:teuthology.orchestra.run.smithi142.stdout:81604378657 2024-04-20T21:53:34.638 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-20T21:53:35.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:35 smithi164 ceph-mon[23506]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:35.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:35 smithi142 ceph-mon[15828]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:35.746 INFO:teuthology.orchestra.run.smithi142.stdout:60129542182 2024-04-20T21:53:35.747 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-20T21:53:35.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.955+0000 7f8e94c00700 1 -- 172.21.15.142:0/33251364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e90073ba0 msgr2=0x7f8e90111680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:35.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.955+0000 7f8e94c00700 1 --2- 172.21.15.142:0/33251364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e90073ba0 0x7f8e90111680 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c009910 tx=0x7f8e7c009c20 comp rx=0 tx=0).stop 2024-04-20T21:53:35.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.955+0000 7f8e94c00700 1 -- 172.21.15.142:0/33251364 shutdown_connections 2024-04-20T21:53:35.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.955+0000 7f8e94c00700 1 --2- 172.21.15.142:0/33251364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e90073ba0 0x7f8e90111680 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:35.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.955+0000 7f8e94c00700 1 --2- 172.21.15.142:0/33251364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e90073280 0x7f8e90073660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:35.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.955+0000 7f8e94c00700 1 -- 172.21.15.142:0/33251364 >> 172.21.15.142:0/33251364 conn(0x7f8e900fc6c0 msgr2=0x7f8e900feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:35.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.955+0000 7f8e94c00700 1 -- 172.21.15.142:0/33251364 shutdown_connections 2024-04-20T21:53:35.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.955+0000 7f8e94c00700 1 -- 172.21.15.142:0/33251364 wait complete. 2024-04-20T21:53:35.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.956+0000 7f8e94c00700 1 Processor -- start 2024-04-20T21:53:35.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.956+0000 7f8e94c00700 1 -- start start 2024-04-20T21:53:35.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.957+0000 7f8e94c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e90073280 0x7f8e9019d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:35.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.957+0000 7f8e94c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e90073ba0 0x7f8e9019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:35.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.957+0000 7f8e94c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9019dd80 con 0x7f8e90073280 2024-04-20T21:53:35.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.957+0000 7f8e94c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e901a1a50 con 0x7f8e90073ba0 2024-04-20T21:53:35.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.957+0000 7f8e8de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e90073280 0x7f8e9019d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:35.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.957+0000 7f8e8de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e90073280 0x7f8e9019d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38686/0 (socket says 172.21.15.142:38686) 2024-04-20T21:53:35.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.957+0000 7f8e8de00700 1 -- 172.21.15.142:0/1735588626 learned_addr learned my addr 172.21.15.142:0/1735588626 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:35.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.957+0000 7f8e8d400700 1 --2- 172.21.15.142:0/1735588626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e90073ba0 0x7f8e9019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:35.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.958+0000 7f8e8de00700 1 -- 172.21.15.142:0/1735588626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e90073ba0 msgr2=0x7f8e9019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:35.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.958+0000 7f8e8de00700 1 --2- 172.21.15.142:0/1735588626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e90073ba0 0x7f8e9019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:35.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.958+0000 7f8e8de00700 1 -- 172.21.15.142:0/1735588626 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c0095f0 con 0x7f8e90073280 2024-04-20T21:53:35.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.958+0000 7f8e8d400700 1 --2- 172.21.15.142:0/1735588626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e90073ba0 0x7f8e9019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:53:35.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.958+0000 7f8e8de00700 1 --2- 172.21.15.142:0/1735588626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e90073280 0x7f8e9019d160 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000b4b0 tx=0x7f8e8000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:35.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.958+0000 7f8e86a00700 1 -- 172.21.15.142:0/1735588626 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e80011800 con 0x7f8e90073280 2024-04-20T21:53:35.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.958+0000 7f8e86a00700 1 -- 172.21.15.142:0/1735588626 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e80011e20 con 0x7f8e90073280 2024-04-20T21:53:35.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.958+0000 7f8e86a00700 1 -- 172.21.15.142:0/1735588626 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e8000f2e0 con 0x7f8e90073280 2024-04-20T21:53:35.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.958+0000 7f8e94c00700 1 -- 172.21.15.142:0/1735588626 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e901a1d30 con 0x7f8e90073280 2024-04-20T21:53:35.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.959+0000 7f8e94c00700 1 -- 172.21.15.142:0/1735588626 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e901a2230 con 0x7f8e90073280 2024-04-20T21:53:35.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.959+0000 7f8e94c00700 1 -- 172.21.15.142:0/1735588626 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e901146d0 con 0x7f8e90073280 2024-04-20T21:53:35.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.961+0000 7f8e86a00700 1 -- 172.21.15.142:0/1735588626 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f8e80010380 con 0x7f8e90073280 2024-04-20T21:53:35.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.962+0000 7f8e86a00700 1 --2- 172.21.15.142:0/1735588626 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f8e7406cce0 0x7f8e7406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:35.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.962+0000 7f8e86a00700 1 -- 172.21.15.142:0/1735588626 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f8e8008baf0 con 0x7f8e90073280 2024-04-20T21:53:35.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.962+0000 7f8e86a00700 1 --2- 172.21.15.142:0/1735588626 >> [v2:172.21.15.164:6808/3702640245,v1:172.21.15.164:6809/3702640245] conn(0x7f8e740729c0 0x7f8e74074de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:35.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.962+0000 7f8e8d400700 1 --2- 172.21.15.142:0/1735588626 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f8e7406cce0 0x7f8e7406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:35.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.962+0000 7f8e86a00700 1 -- 172.21.15.142:0/1735588626 --> [v2:172.21.15.164:6808/3702640245,v1:172.21.15.164:6809/3702640245] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e74075490 con 0x7f8e740729c0 2024-04-20T21:53:35.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.962+0000 7f8e86a00700 1 -- 172.21.15.142:0/1735588626 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e800902a0 con 0x7f8e90073280 2024-04-20T21:53:35.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.963+0000 7f8e8e800700 1 --2- 172.21.15.142:0/1735588626 >> [v2:172.21.15.164:6808/3702640245,v1:172.21.15.164:6809/3702640245] conn(0x7f8e740729c0 0x7f8e74074de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:35.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.963+0000 7f8e8d400700 1 --2- 172.21.15.142:0/1735588626 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f8e7406cce0 0x7f8e7406f1a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8e9019e6c0 tx=0x7f8e7c00b560 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:35.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.964+0000 7f8e8e800700 1 --2- 172.21.15.142:0/1735588626 >> [v2:172.21.15.164:6808/3702640245,v1:172.21.15.164:6809/3702640245] conn(0x7f8e740729c0 0x7f8e74074de0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:35.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.966+0000 7f8e86a00700 1 -- 172.21.15.142:0/1735588626 <== osd.4 v2:172.21.15.164:6808/3702640245 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f8e74075490 con 0x7f8e740729c0 2024-04-20T21:53:35.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.983+0000 7f8e94c00700 1 -- 172.21.15.142:0/1735588626 --> [v2:172.21.15.164:6808/3702640245,v1:172.21.15.164:6809/3702640245] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8e900749c0 con 0x7f8e740729c0 2024-04-20T21:53:35.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.984+0000 7f8e86a00700 1 -- 172.21.15.142:0/1735588626 <== osd.4 v2:172.21.15.164:6808/3702640245 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8e900749c0 con 0x7f8e740729c0 2024-04-20T21:53:35.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.984+0000 7f8e94c00700 1 -- 172.21.15.142:0/1735588626 >> [v2:172.21.15.164:6808/3702640245,v1:172.21.15.164:6809/3702640245] conn(0x7f8e740729c0 msgr2=0x7f8e74074de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:35.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.984+0000 7f8e94c00700 1 --2- 172.21.15.142:0/1735588626 >> [v2:172.21.15.164:6808/3702640245,v1:172.21.15.164:6809/3702640245] conn(0x7f8e740729c0 0x7f8e74074de0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:35.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.984+0000 7f8e94c00700 1 -- 172.21.15.142:0/1735588626 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f8e7406cce0 msgr2=0x7f8e7406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:35.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.984+0000 7f8e94c00700 1 --2- 172.21.15.142:0/1735588626 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f8e7406cce0 0x7f8e7406f1a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8e9019e6c0 tx=0x7f8e7c00b560 comp rx=0 tx=0).stop 2024-04-20T21:53:35.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.984+0000 7f8e94c00700 1 -- 172.21.15.142:0/1735588626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e90073280 msgr2=0x7f8e9019d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:35.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.984+0000 7f8e94c00700 1 --2- 172.21.15.142:0/1735588626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e90073280 0x7f8e9019d160 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000b4b0 tx=0x7f8e8000b870 comp rx=0 tx=0).stop 2024-04-20T21:53:35.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.984+0000 7f8e94c00700 1 -- 172.21.15.142:0/1735588626 shutdown_connections 2024-04-20T21:53:35.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.984+0000 7f8e94c00700 1 --2- 172.21.15.142:0/1735588626 >> [v2:172.21.15.164:6808/3702640245,v1:172.21.15.164:6809/3702640245] conn(0x7f8e740729c0 0x7f8e74074de0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:35.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.984+0000 7f8e94c00700 1 --2- 172.21.15.142:0/1735588626 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f8e7406cce0 0x7f8e7406f1a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:35.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.984+0000 7f8e94c00700 1 --2- 172.21.15.142:0/1735588626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e90073280 0x7f8e9019d160 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:35.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.984+0000 7f8e94c00700 1 --2- 172.21.15.142:0/1735588626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e90073ba0 0x7f8e9019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:35.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.985+0000 7f8e94c00700 1 -- 172.21.15.142:0/1735588626 >> 172.21.15.142:0/1735588626 conn(0x7f8e900fc6c0 msgr2=0x7f8e901008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:35.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.985+0000 7f8e94c00700 1 -- 172.21.15.142:0/1735588626 shutdown_connections 2024-04-20T21:53:35.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:35.985+0000 7f8e94c00700 1 -- 172.21.15.142:0/1735588626 wait complete. 2024-04-20T21:53:36.404 INFO:teuthology.orchestra.run.smithi142.stdout:176093659146 2024-04-20T21:53:36.404 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-20T21:53:36.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:36 smithi164 ceph-mon[23506]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:36.467 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:36 smithi142 ceph-mon[15828]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:36.950 INFO:teuthology.orchestra.run.smithi142.stdout:154618822674 2024-04-20T21:53:36.950 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-20T21:53:37.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.846+0000 7f64c6000700 1 -- 172.21.15.142:0/1235091897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64c0100e20 msgr2=0x7f64c0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:37.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.846+0000 7f64c6000700 1 --2- 172.21.15.142:0/1235091897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64c0100e20 0x7f64c0101200 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f64b0009910 tx=0x7f64b0009c20 comp rx=0 tx=0).stop 2024-04-20T21:53:37.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.846+0000 7f64c6000700 1 -- 172.21.15.142:0/1235091897 shutdown_connections 2024-04-20T21:53:37.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.846+0000 7f64c6000700 1 --2- 172.21.15.142:0/1235091897 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c01017d0 0x7f64c0105820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:37.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.846+0000 7f64c6000700 1 --2- 172.21.15.142:0/1235091897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64c0100e20 0x7f64c0101200 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:37.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.846+0000 7f64c6000700 1 -- 172.21.15.142:0/1235091897 >> 172.21.15.142:0/1235091897 conn(0x7f64c00fc6f0 msgr2=0x7f64c00feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:37.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.846+0000 7f64c6000700 1 -- 172.21.15.142:0/1235091897 shutdown_connections 2024-04-20T21:53:37.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.846+0000 7f64c6000700 1 -- 172.21.15.142:0/1235091897 wait complete. 2024-04-20T21:53:37.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.847+0000 7f64c6000700 1 Processor -- start 2024-04-20T21:53:37.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.847+0000 7f64c6000700 1 -- start start 2024-04-20T21:53:37.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.848+0000 7f64c6000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c0100e20 0x7f64c0198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:37.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.848+0000 7f64c6000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64c01017d0 0x7f64c0199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:37.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.848+0000 7f64c6000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c0199a00 con 0x7f64c01017d0 2024-04-20T21:53:37.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.848+0000 7f64c6000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c019d6d0 con 0x7f64c0100e20 2024-04-20T21:53:37.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.848+0000 7f64b6a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64c01017d0 0x7f64c0199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:37.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.848+0000 7f64b6a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64c01017d0 0x7f64c0199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38616/0 (socket says 172.21.15.142:38616) 2024-04-20T21:53:37.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.848+0000 7f64b6a00700 1 -- 172.21.15.142:0/3234848745 learned_addr learned my addr 172.21.15.142:0/3234848745 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:37.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.849+0000 7f64bf400700 1 --2- 172.21.15.142:0/3234848745 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c0100e20 0x7f64c0198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:37.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.849+0000 7f64b6a00700 1 -- 172.21.15.142:0/3234848745 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c0100e20 msgr2=0x7f64c0198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:37.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.849+0000 7f64b6a00700 1 --2- 172.21.15.142:0/3234848745 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c0100e20 0x7f64c0198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:37.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.849+0000 7f64b6a00700 1 -- 172.21.15.142:0/3234848745 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b00095f0 con 0x7f64c01017d0 2024-04-20T21:53:37.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.849+0000 7f64b6a00700 1 --2- 172.21.15.142:0/3234848745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64c01017d0 0x7f64c0199320 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f64a800b480 tx=0x7f64a800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:37.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.849+0000 7f64bcc00700 1 -- 172.21.15.142:0/3234848745 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64a80118c0 con 0x7f64c01017d0 2024-04-20T21:53:37.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.849+0000 7f64bcc00700 1 -- 172.21.15.142:0/3234848745 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f64a8010380 con 0x7f64c01017d0 2024-04-20T21:53:37.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.849+0000 7f64c6000700 1 -- 172.21.15.142:0/3234848745 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c019d9b0 con 0x7f64c01017d0 2024-04-20T21:53:37.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.849+0000 7f64bcc00700 1 -- 172.21.15.142:0/3234848745 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64a800f4f0 con 0x7f64c01017d0 2024-04-20T21:53:37.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.850+0000 7f64c6000700 1 -- 172.21.15.142:0/3234848745 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c019df00 con 0x7f64c01017d0 2024-04-20T21:53:37.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.850+0000 7f64c6000700 1 -- 172.21.15.142:0/3234848745 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f64c010e160 con 0x7f64c01017d0 2024-04-20T21:53:37.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.852+0000 7f64bcc00700 1 -- 172.21.15.142:0/3234848745 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f64a80104f0 con 0x7f64c01017d0 2024-04-20T21:53:37.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.852+0000 7f64bcc00700 1 --2- 172.21.15.142:0/3234848745 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f64a406cce0 0x7f64a406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:37.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.853+0000 7f64bcc00700 1 -- 172.21.15.142:0/3234848745 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f64a808bc30 con 0x7f64c01017d0 2024-04-20T21:53:37.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.853+0000 7f64bf400700 1 --2- 172.21.15.142:0/3234848745 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f64a406cce0 0x7f64a406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:37.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.853+0000 7f64bcc00700 1 --2- 172.21.15.142:0/3234848745 >> [v2:172.21.15.164:6800/4283809575,v1:172.21.15.164:6801/4283809575] conn(0x7f64a40729c0 0x7f64a4074de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:37.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.853+0000 7f64bcc00700 1 -- 172.21.15.142:0/3234848745 --> [v2:172.21.15.164:6800/4283809575,v1:172.21.15.164:6801/4283809575] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f64a4075490 con 0x7f64a40729c0 2024-04-20T21:53:37.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.853+0000 7f64bcc00700 1 -- 172.21.15.142:0/3234848745 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64a80902a0 con 0x7f64c01017d0 2024-04-20T21:53:37.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.853+0000 7f64bf400700 1 --2- 172.21.15.142:0/3234848745 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f64a406cce0 0x7f64a406f1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f64b000b5c0 tx=0x7f64b001a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:37.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.854+0000 7f64bfe00700 1 --2- 172.21.15.142:0/3234848745 >> [v2:172.21.15.164:6800/4283809575,v1:172.21.15.164:6801/4283809575] conn(0x7f64a40729c0 0x7f64a4074de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:37.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.855+0000 7f64bfe00700 1 --2- 172.21.15.142:0/3234848745 >> [v2:172.21.15.164:6800/4283809575,v1:172.21.15.164:6801/4283809575] conn(0x7f64a40729c0 0x7f64a4074de0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:37.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.857+0000 7f64bcc00700 1 -- 172.21.15.142:0/3234848745 <== osd.3 v2:172.21.15.164:6800/4283809575 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f64a4075490 con 0x7f64a40729c0 2024-04-20T21:53:37.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.874+0000 7f64c6000700 1 -- 172.21.15.142:0/3234848745 --> [v2:172.21.15.164:6800/4283809575,v1:172.21.15.164:6801/4283809575] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f64c019e400 con 0x7f64a40729c0 2024-04-20T21:53:37.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.875+0000 7f64bcc00700 1 -- 172.21.15.142:0/3234848745 <== osd.3 v2:172.21.15.164:6800/4283809575 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f64c019e400 con 0x7f64a40729c0 2024-04-20T21:53:37.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.875+0000 7f64c6000700 1 -- 172.21.15.142:0/3234848745 >> [v2:172.21.15.164:6800/4283809575,v1:172.21.15.164:6801/4283809575] conn(0x7f64a40729c0 msgr2=0x7f64a4074de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:37.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.875+0000 7f64c6000700 1 --2- 172.21.15.142:0/3234848745 >> [v2:172.21.15.164:6800/4283809575,v1:172.21.15.164:6801/4283809575] conn(0x7f64a40729c0 0x7f64a4074de0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:37.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.876+0000 7f64c6000700 1 -- 172.21.15.142:0/3234848745 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f64a406cce0 msgr2=0x7f64a406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:37.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.876+0000 7f64c6000700 1 --2- 172.21.15.142:0/3234848745 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f64a406cce0 0x7f64a406f1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f64b000b5c0 tx=0x7f64b001a040 comp rx=0 tx=0).stop 2024-04-20T21:53:37.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.876+0000 7f64c6000700 1 -- 172.21.15.142:0/3234848745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64c01017d0 msgr2=0x7f64c0199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:37.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.876+0000 7f64c6000700 1 --2- 172.21.15.142:0/3234848745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64c01017d0 0x7f64c0199320 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f64a800b480 tx=0x7f64a800b840 comp rx=0 tx=0).stop 2024-04-20T21:53:37.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.876+0000 7f64c6000700 1 -- 172.21.15.142:0/3234848745 shutdown_connections 2024-04-20T21:53:37.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.876+0000 7f64c6000700 1 --2- 172.21.15.142:0/3234848745 >> [v2:172.21.15.164:6800/4283809575,v1:172.21.15.164:6801/4283809575] conn(0x7f64a40729c0 0x7f64a4074de0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:37.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.876+0000 7f64c6000700 1 --2- 172.21.15.142:0/3234848745 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f64a406cce0 0x7f64a406f1a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:37.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.876+0000 7f64c6000700 1 --2- 172.21.15.142:0/3234848745 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f64c0100e20 0x7f64c0198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:37.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.876+0000 7f64c6000700 1 --2- 172.21.15.142:0/3234848745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f64c01017d0 0x7f64c0199320 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:37.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.876+0000 7f64c6000700 1 -- 172.21.15.142:0/3234848745 >> 172.21.15.142:0/3234848745 conn(0x7f64c00fc6f0 msgr2=0x7f64c0074400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:37.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.876+0000 7f64c6000700 1 -- 172.21.15.142:0/3234848745 shutdown_connections 2024-04-20T21:53:37.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:37.876+0000 7f64c6000700 1 -- 172.21.15.142:0/3234848745 wait complete. 2024-04-20T21:53:37.920 INFO:teuthology.orchestra.run.smithi142.stdout:38654705710 2024-04-20T21:53:37.921 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-20T21:53:38.635 INFO:teuthology.orchestra.run.smithi142.stdout:115964117019 2024-04-20T21:53:38.636 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-20T21:53:38.731 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:53:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:53:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:53:38.741 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:53:38.751 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:53:39.156 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:39 smithi142 ceph-mon[15828]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:39.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:39 smithi164 ceph-mon[23506]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:41.296 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:41 smithi142 ceph-mon[15828]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:41.296 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:41 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:53:41.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:41 smithi164 ceph-mon[23506]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:41.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:41 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:53:42.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.942+0000 7f53bda00700 1 -- 172.21.15.142:0/1935616814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53b81017c0 msgr2=0x7f53b8105810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:42.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.942+0000 7f53bda00700 1 --2- 172.21.15.142:0/1935616814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53b81017c0 0x7f53b8105810 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009910 tx=0x7f53a4009c20 comp rx=0 tx=0).stop 2024-04-20T21:53:42.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.943+0000 7f53bda00700 1 -- 172.21.15.142:0/1935616814 shutdown_connections 2024-04-20T21:53:42.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.943+0000 7f53bda00700 1 --2- 172.21.15.142:0/1935616814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53b81017c0 0x7f53b8105810 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:42.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.943+0000 7f53bda00700 1 --2- 172.21.15.142:0/1935616814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53b8100e10 0x7f53b81011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:42.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.943+0000 7f53bda00700 1 -- 172.21.15.142:0/1935616814 >> 172.21.15.142:0/1935616814 conn(0x7f53b80fc6c0 msgr2=0x7f53b80feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:42.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.943+0000 7f53bda00700 1 -- 172.21.15.142:0/1935616814 shutdown_connections 2024-04-20T21:53:42.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.943+0000 7f53bda00700 1 -- 172.21.15.142:0/1935616814 wait complete. 2024-04-20T21:53:42.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.945+0000 7f53bda00700 1 Processor -- start 2024-04-20T21:53:42.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.945+0000 7f53bda00700 1 -- start start 2024-04-20T21:53:42.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.945+0000 7f53bda00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53b8100e10 0x7f53b819e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:42.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.945+0000 7f53bda00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53b81017c0 0x7f53b819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:42.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.945+0000 7f53bda00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b819f5a0 con 0x7f53b81017c0 2024-04-20T21:53:42.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.945+0000 7f53bda00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b8198b20 con 0x7f53b8100e10 2024-04-20T21:53:42.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.946+0000 7f53b6000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53b81017c0 0x7f53b819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:42.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.946+0000 7f53b6000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53b81017c0 0x7f53b819eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38634/0 (socket says 172.21.15.142:38634) 2024-04-20T21:53:42.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.946+0000 7f53b6000700 1 -- 172.21.15.142:0/165217002 learned_addr learned my addr 172.21.15.142:0/165217002 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:42.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.946+0000 7f53b6a00700 1 --2- 172.21.15.142:0/165217002 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53b8100e10 0x7f53b819e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:42.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.946+0000 7f53b6000700 1 -- 172.21.15.142:0/165217002 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53b8100e10 msgr2=0x7f53b819e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:42.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.946+0000 7f53b6000700 1 --2- 172.21.15.142:0/165217002 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53b8100e10 0x7f53b819e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:42.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.946+0000 7f53b6000700 1 -- 172.21.15.142:0/165217002 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a40095f0 con 0x7f53b81017c0 2024-04-20T21:53:42.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.947+0000 7f53b6000700 1 --2- 172.21.15.142:0/165217002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53b81017c0 0x7f53b819eec0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f53a4005b40 tx=0x7f53a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:42.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.947+0000 7f53af400700 1 -- 172.21.15.142:0/165217002 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53a401d070 con 0x7f53b81017c0 2024-04-20T21:53:42.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.947+0000 7f53bda00700 1 -- 172.21.15.142:0/165217002 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b8198da0 con 0x7f53b81017c0 2024-04-20T21:53:42.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.947+0000 7f53bda00700 1 -- 172.21.15.142:0/165217002 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b8199290 con 0x7f53b81017c0 2024-04-20T21:53:42.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.948+0000 7f53af400700 1 -- 172.21.15.142:0/165217002 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f53a4004f00 con 0x7f53b81017c0 2024-04-20T21:53:42.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.948+0000 7f53af400700 1 -- 172.21.15.142:0/165217002 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53a400f460 con 0x7f53b81017c0 2024-04-20T21:53:42.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.949+0000 7f53bda00700 1 -- 172.21.15.142:0/165217002 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53980052f0 con 0x7f53b81017c0 2024-04-20T21:53:42.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.950+0000 7f53af400700 1 -- 172.21.15.142:0/165217002 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f53a4004a40 con 0x7f53b81017c0 2024-04-20T21:53:42.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.951+0000 7f53af400700 1 --2- 172.21.15.142:0/165217002 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f539c06cce0 0x7f539c06f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:42.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.951+0000 7f53af400700 1 -- 172.21.15.142:0/165217002 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f53a408d450 con 0x7f53b81017c0 2024-04-20T21:53:42.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.952+0000 7f53b6a00700 1 --2- 172.21.15.142:0/165217002 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f539c06cce0 0x7f539c06f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:42.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.953+0000 7f53b6a00700 1 --2- 172.21.15.142:0/165217002 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f539c06cce0 0x7f539c06f1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f53a8005fd0 tx=0x7f53a800a560 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:42.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:42.958+0000 7f53af400700 1 -- 172.21.15.142:0/165217002 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f53a405b6f0 con 0x7f53b81017c0 2024-04-20T21:53:43.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:43.185+0000 7f53bda00700 1 -- 172.21.15.142:0/165217002 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5398005160 con 0x7f53b81017c0 2024-04-20T21:53:43.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:43.186+0000 7f53af400700 1 -- 172.21.15.142:0/165217002 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f53a405b280 con 0x7f53b81017c0 2024-04-20T21:53:43.185 INFO:teuthology.orchestra.run.smithi142.stdout:38654705712 2024-04-20T21:53:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:43.189+0000 7f53bda00700 1 -- 172.21.15.142:0/165217002 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f539c06cce0 msgr2=0x7f539c06f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:43.189+0000 7f53bda00700 1 --2- 172.21.15.142:0/165217002 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f539c06cce0 0x7f539c06f1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f53a8005fd0 tx=0x7f53a800a560 comp rx=0 tx=0).stop 2024-04-20T21:53:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:43.189+0000 7f53bda00700 1 -- 172.21.15.142:0/165217002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53b81017c0 msgr2=0x7f53b819eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:43.189+0000 7f53bda00700 1 --2- 172.21.15.142:0/165217002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53b81017c0 0x7f53b819eec0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f53a4005b40 tx=0x7f53a40057f0 comp rx=0 tx=0).stop 2024-04-20T21:53:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:43.189+0000 7f53bda00700 1 -- 172.21.15.142:0/165217002 shutdown_connections 2024-04-20T21:53:43.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:43.189+0000 7f53bda00700 1 --2- 172.21.15.142:0/165217002 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f539c06cce0 0x7f539c06f1a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:43.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:43.189+0000 7f53bda00700 1 --2- 172.21.15.142:0/165217002 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f53b8100e10 0x7f53b819e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:43.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:43.189+0000 7f53bda00700 1 --2- 172.21.15.142:0/165217002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53b81017c0 0x7f53b819eec0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:43.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:43.189+0000 7f53bda00700 1 -- 172.21.15.142:0/165217002 >> 172.21.15.142:0/165217002 conn(0x7f53b80fc6c0 msgr2=0x7f53b80fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:43.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:43.189+0000 7f53bda00700 1 -- 172.21.15.142:0/165217002 shutdown_connections 2024-04-20T21:53:43.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:43.189+0000 7f53bda00700 1 -- 172.21.15.142:0/165217002 wait complete. 2024-04-20T21:53:43.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:43 smithi142 ceph-mon[15828]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:43.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:43 smithi164 ceph-mon[23506]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:44.294 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:44 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/165217002' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-20T21:53:44.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:44 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/165217002' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-20T21:53:44.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.739+0000 7fc547200700 1 -- 172.21.15.142:0/1083066574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc540073280 msgr2=0x7fc540073660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:44.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.739+0000 7fc547200700 1 --2- 172.21.15.142:0/1083066574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc540073280 0x7fc540073660 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc530009910 tx=0x7fc530009c20 comp rx=0 tx=0).stop 2024-04-20T21:53:44.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.740+0000 7fc547200700 1 -- 172.21.15.142:0/1083066574 shutdown_connections 2024-04-20T21:53:44.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.740+0000 7fc547200700 1 --2- 172.21.15.142:0/1083066574 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc540073ba0 0x7fc540111680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:44.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.740+0000 7fc547200700 1 --2- 172.21.15.142:0/1083066574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc540073280 0x7fc540073660 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:44.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.740+0000 7fc547200700 1 -- 172.21.15.142:0/1083066574 >> 172.21.15.142:0/1083066574 conn(0x7fc5400fc6c0 msgr2=0x7fc5400feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:44.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.740+0000 7fc547200700 1 -- 172.21.15.142:0/1083066574 shutdown_connections 2024-04-20T21:53:44.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.740+0000 7fc547200700 1 -- 172.21.15.142:0/1083066574 wait complete. 2024-04-20T21:53:44.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.741+0000 7fc547200700 1 Processor -- start 2024-04-20T21:53:44.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.741+0000 7fc547200700 1 -- start start 2024-04-20T21:53:44.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.742+0000 7fc547200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc540073280 0x7fc54019d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:44.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.742+0000 7fc547200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc540073ba0 0x7fc54019d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:44.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.742+0000 7fc547200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54019ddc0 con 0x7fc540073ba0 2024-04-20T21:53:44.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.742+0000 7fc547200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5401a1a40 con 0x7fc540073280 2024-04-20T21:53:44.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.742+0000 7fc53f400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc540073ba0 0x7fc54019d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:44.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.742+0000 7fc53f400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc540073ba0 0x7fc54019d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38660/0 (socket says 172.21.15.142:38660) 2024-04-20T21:53:44.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.742+0000 7fc53f400700 1 -- 172.21.15.142:0/3829117135 learned_addr learned my addr 172.21.15.142:0/3829117135 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:44.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.742+0000 7fc53fe00700 1 --2- 172.21.15.142:0/3829117135 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc540073280 0x7fc54019d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:44.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.743+0000 7fc53f400700 1 -- 172.21.15.142:0/3829117135 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc540073280 msgr2=0x7fc54019d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:44.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.743+0000 7fc53f400700 1 --2- 172.21.15.142:0/3829117135 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc540073280 0x7fc54019d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:44.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.743+0000 7fc53f400700 1 -- 172.21.15.142:0/3829117135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5300095f0 con 0x7fc540073ba0 2024-04-20T21:53:44.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.743+0000 7fc53f400700 1 --2- 172.21.15.142:0/3829117135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc540073ba0 0x7fc54019d6e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00b4b0 tx=0x7fc52c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:44.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.743+0000 7fc53cc00700 1 -- 172.21.15.142:0/3829117135 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc52c011800 con 0x7fc540073ba0 2024-04-20T21:53:44.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.743+0000 7fc547200700 1 -- 172.21.15.142:0/3829117135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5401a1d20 con 0x7fc540073ba0 2024-04-20T21:53:44.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.743+0000 7fc53cc00700 1 -- 172.21.15.142:0/3829117135 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc52c011e20 con 0x7fc540073ba0 2024-04-20T21:53:44.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.743+0000 7fc53cc00700 1 -- 172.21.15.142:0/3829117135 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc52c00f2e0 con 0x7fc540073ba0 2024-04-20T21:53:44.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.744+0000 7fc547200700 1 -- 172.21.15.142:0/3829117135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5401a2270 con 0x7fc540073ba0 2024-04-20T21:53:44.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.745+0000 7fc547200700 1 -- 172.21.15.142:0/3829117135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5400749c0 con 0x7fc540073ba0 2024-04-20T21:53:44.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.746+0000 7fc53cc00700 1 -- 172.21.15.142:0/3829117135 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc52c010380 con 0x7fc540073ba0 2024-04-20T21:53:44.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.747+0000 7fc53cc00700 1 --2- 172.21.15.142:0/3829117135 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc52406cce0 0x7fc52406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:44.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.747+0000 7fc53cc00700 1 -- 172.21.15.142:0/3829117135 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc52c08baf0 con 0x7fc540073ba0 2024-04-20T21:53:44.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.748+0000 7fc53fe00700 1 --2- 172.21.15.142:0/3829117135 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc52406cce0 0x7fc52406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:44.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.748+0000 7fc53fe00700 1 --2- 172.21.15.142:0/3829117135 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc52406cce0 0x7fc52406f1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc53000b5c0 tx=0x7fc53001a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:44.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.752+0000 7fc53cc00700 1 -- 172.21.15.142:0/3829117135 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fc52c056200 con 0x7fc540073ba0 2024-04-20T21:53:44.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.990+0000 7fc547200700 1 -- 172.21.15.142:0/3829117135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc540062510 con 0x7fc540073ba0 2024-04-20T21:53:44.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.991+0000 7fc53cc00700 1 -- 172.21.15.142:0/3829117135 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc52c059820 con 0x7fc540073ba0 2024-04-20T21:53:44.990 INFO:teuthology.orchestra.run.smithi142.stdout:81604378659 2024-04-20T21:53:44.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.994+0000 7fc547200700 1 -- 172.21.15.142:0/3829117135 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc52406cce0 msgr2=0x7fc52406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:44.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.994+0000 7fc547200700 1 --2- 172.21.15.142:0/3829117135 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc52406cce0 0x7fc52406f1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc53000b5c0 tx=0x7fc53001a040 comp rx=0 tx=0).stop 2024-04-20T21:53:44.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.994+0000 7fc547200700 1 -- 172.21.15.142:0/3829117135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc540073ba0 msgr2=0x7fc54019d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:44.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.994+0000 7fc547200700 1 --2- 172.21.15.142:0/3829117135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc540073ba0 0x7fc54019d6e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00b4b0 tx=0x7fc52c00b870 comp rx=0 tx=0).stop 2024-04-20T21:53:44.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.994+0000 7fc547200700 1 -- 172.21.15.142:0/3829117135 shutdown_connections 2024-04-20T21:53:44.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.994+0000 7fc547200700 1 --2- 172.21.15.142:0/3829117135 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc52406cce0 0x7fc52406f1a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:44.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.994+0000 7fc547200700 1 --2- 172.21.15.142:0/3829117135 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc540073280 0x7fc54019d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:44.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.994+0000 7fc547200700 1 --2- 172.21.15.142:0/3829117135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc540073ba0 0x7fc54019d6e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:44.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.994+0000 7fc547200700 1 -- 172.21.15.142:0/3829117135 >> 172.21.15.142:0/3829117135 conn(0x7fc5400fc6c0 msgr2=0x7fc5401008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:44.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.995+0000 7fc547200700 1 -- 172.21.15.142:0/3829117135 shutdown_connections 2024-04-20T21:53:44.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:44.995+0000 7fc547200700 1 -- 172.21.15.142:0/3829117135 wait complete. 2024-04-20T21:53:45.193 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:45 smithi142 ceph-mon[15828]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:45.193 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:45 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/3829117135' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-20T21:53:45.342 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:45 smithi164 ceph-mon[23506]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:45.342 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:45 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/3829117135' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-20T21:53:46.622 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378657 got 81604378659 for osd.2 2024-04-20T21:53:46.622 DEBUG:teuthology.parallel:result is None 2024-04-20T21:53:46.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.154+0000 7f1462800700 1 -- 172.21.15.142:0/1261631180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f145c104a00 msgr2=0x7f145c104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:46.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.154+0000 7f1462800700 1 --2- 172.21.15.142:0/1261631180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f145c104a00 0x7f145c104e80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1448009910 tx=0x7f1448009c20 comp rx=0 tx=0).stop 2024-04-20T21:53:46.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.154+0000 7f1462800700 1 -- 172.21.15.142:0/1261631180 shutdown_connections 2024-04-20T21:53:46.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.154+0000 7f1462800700 1 --2- 172.21.15.142:0/1261631180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f145c104a00 0x7f145c104e80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:46.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.154+0000 7f1462800700 1 --2- 172.21.15.142:0/1261631180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f145c103110 0x7f145c1034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:46.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.154+0000 7f1462800700 1 -- 172.21.15.142:0/1261631180 >> 172.21.15.142:0/1261631180 conn(0x7f145c0fe880 msgr2=0x7f145c100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:46.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.154+0000 7f1462800700 1 -- 172.21.15.142:0/1261631180 shutdown_connections 2024-04-20T21:53:46.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.154+0000 7f1462800700 1 -- 172.21.15.142:0/1261631180 wait complete. 2024-04-20T21:53:46.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.156+0000 7f1462800700 1 Processor -- start 2024-04-20T21:53:46.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.156+0000 7f1462800700 1 -- start start 2024-04-20T21:53:46.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.156+0000 7f1462800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f145c103110 0x7f145c19ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:46.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.156+0000 7f1462800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f145c104a00 0x7f145c19ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:46.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.156+0000 7f1462800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c19f520 con 0x7f145c104a00 2024-04-20T21:53:46.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.156+0000 7f1462800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c198b90 con 0x7f145c103110 2024-04-20T21:53:46.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.157+0000 7f145aa00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f145c104a00 0x7f145c19ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:46.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.157+0000 7f145aa00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f145c104a00 0x7f145c19ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38684/0 (socket says 172.21.15.142:38684) 2024-04-20T21:53:46.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.157+0000 7f145aa00700 1 -- 172.21.15.142:0/1865922705 learned_addr learned my addr 172.21.15.142:0/1865922705 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:46.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.157+0000 7f145b400700 1 --2- 172.21.15.142:0/1865922705 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f145c103110 0x7f145c19ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:46.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.157+0000 7f145aa00700 1 -- 172.21.15.142:0/1865922705 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f145c103110 msgr2=0x7f145c19ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:46.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.157+0000 7f145aa00700 1 --2- 172.21.15.142:0/1865922705 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f145c103110 0x7f145c19ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:46.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.157+0000 7f145aa00700 1 -- 172.21.15.142:0/1865922705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14480095f0 con 0x7f145c104a00 2024-04-20T21:53:46.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.157+0000 7f145aa00700 1 --2- 172.21.15.142:0/1865922705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f145c104a00 0x7f145c19ef90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f14480092e0 tx=0x7f144800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:46.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.158+0000 7f1453e00700 1 -- 172.21.15.142:0/1865922705 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f144801d070 con 0x7f145c104a00 2024-04-20T21:53:46.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.158+0000 7f1453e00700 1 -- 172.21.15.142:0/1865922705 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f144800f460 con 0x7f145c104a00 2024-04-20T21:53:46.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.158+0000 7f1453e00700 1 -- 172.21.15.142:0/1865922705 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1448017630 con 0x7f145c104a00 2024-04-20T21:53:46.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.158+0000 7f1462800700 1 -- 172.21.15.142:0/1865922705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145c198e10 con 0x7f145c104a00 2024-04-20T21:53:46.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.158+0000 7f1462800700 1 -- 172.21.15.142:0/1865922705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145c199380 con 0x7f145c104a00 2024-04-20T21:53:46.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.159+0000 7f1462800700 1 -- 172.21.15.142:0/1865922705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145c10b480 con 0x7f145c104a00 2024-04-20T21:53:46.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.160+0000 7f1453e00700 1 -- 172.21.15.142:0/1865922705 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f144800f5d0 con 0x7f145c104a00 2024-04-20T21:53:46.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.161+0000 7f1453e00700 1 --2- 172.21.15.142:0/1865922705 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f144006ccf0 0x7f144006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:46.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.161+0000 7f1453e00700 1 -- 172.21.15.142:0/1865922705 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f144808d370 con 0x7f145c104a00 2024-04-20T21:53:46.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.162+0000 7f145b400700 1 --2- 172.21.15.142:0/1865922705 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f144006ccf0 0x7f144006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:46.931 INFO:teuthology.orchestra.run.smithi142.stdout:176093659149 2024-04-20T21:53:46.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.162+0000 7f145b400700 1 --2- 172.21.15.142:0/1865922705 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f144006ccf0 0x7f144006f1b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f144c005ea0 tx=0x7f144c005e30 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:46.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.167+0000 7f1453e00700 1 -- 172.21.15.142:0/1865922705 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f144805b590 con 0x7f145c104a00 2024-04-20T21:53:46.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.392+0000 7f1462800700 1 -- 172.21.15.142:0/1865922705 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f145c104510 con 0x7f145c104a00 2024-04-20T21:53:46.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.393+0000 7f1453e00700 1 -- 172.21.15.142:0/1865922705 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f144805b120 con 0x7f145c104a00 2024-04-20T21:53:46.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.396+0000 7f1462800700 1 -- 172.21.15.142:0/1865922705 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f144006ccf0 msgr2=0x7f144006f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:46.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.396+0000 7f1462800700 1 --2- 172.21.15.142:0/1865922705 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f144006ccf0 0x7f144006f1b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f144c005ea0 tx=0x7f144c005e30 comp rx=0 tx=0).stop 2024-04-20T21:53:46.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.396+0000 7f1462800700 1 -- 172.21.15.142:0/1865922705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f145c104a00 msgr2=0x7f145c19ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:46.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.396+0000 7f1462800700 1 --2- 172.21.15.142:0/1865922705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f145c104a00 0x7f145c19ef90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f14480092e0 tx=0x7f144800be20 comp rx=0 tx=0).stop 2024-04-20T21:53:46.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.396+0000 7f1462800700 1 -- 172.21.15.142:0/1865922705 shutdown_connections 2024-04-20T21:53:46.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.396+0000 7f1462800700 1 --2- 172.21.15.142:0/1865922705 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f144006ccf0 0x7f144006f1b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:46.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.396+0000 7f1462800700 1 --2- 172.21.15.142:0/1865922705 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f145c103110 0x7f145c19ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:46.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.396+0000 7f1462800700 1 --2- 172.21.15.142:0/1865922705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f145c104a00 0x7f145c19ef90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:46.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.396+0000 7f1462800700 1 -- 172.21.15.142:0/1865922705 >> 172.21.15.142:0/1865922705 conn(0x7f145c0fe880 msgr2=0x7f145c0ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:46.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.396+0000 7f1462800700 1 -- 172.21.15.142:0/1865922705 shutdown_connections 2024-04-20T21:53:46.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:46.396+0000 7f1462800700 1 -- 172.21.15.142:0/1865922705 wait complete. 2024-04-20T21:53:47.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:47 smithi142 ceph-mon[15828]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:47.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:47 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1865922705' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-20T21:53:47.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.399+0000 7f465b000700 1 -- 172.21.15.142:0/2049855325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4654073c30 msgr2=0x7f465410ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:47.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.399+0000 7f465b000700 1 --2- 172.21.15.142:0/2049855325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4654073c30 0x7f465410ceb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f463c009910 tx=0x7f463c009c20 comp rx=0 tx=0).stop 2024-04-20T21:53:47.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.399+0000 7f465b000700 1 -- 172.21.15.142:0/2049855325 shutdown_connections 2024-04-20T21:53:47.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.399+0000 7f465b000700 1 --2- 172.21.15.142:0/2049855325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4654073c30 0x7f465410ceb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:47.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.399+0000 7f465b000700 1 --2- 172.21.15.142:0/2049855325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4654073310 0x7f46540736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:47.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.399+0000 7f465b000700 1 -- 172.21.15.142:0/2049855325 >> 172.21.15.142:0/2049855325 conn(0x7f46540fc6c0 msgr2=0x7f46540feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:47.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.400+0000 7f465b000700 1 -- 172.21.15.142:0/2049855325 shutdown_connections 2024-04-20T21:53:47.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.400+0000 7f465b000700 1 -- 172.21.15.142:0/2049855325 wait complete. 2024-04-20T21:53:47.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.401+0000 7f465b000700 1 Processor -- start 2024-04-20T21:53:47.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.401+0000 7f465b000700 1 -- start start 2024-04-20T21:53:47.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.401+0000 7f465b000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4654073310 0x7f4654198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:47.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.401+0000 7f465b000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4654073c30 0x7f46541992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:47.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.401+0000 7f465b000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46541999c0 con 0x7f4654073310 2024-04-20T21:53:47.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.401+0000 7f465b000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465419d690 con 0x7f4654073c30 2024-04-20T21:53:47.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.401+0000 7f4653e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4654073310 0x7f4654198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:47.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.401+0000 7f4653e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4654073310 0x7f4654198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58902/0 (socket says 172.21.15.142:58902) 2024-04-20T21:53:47.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.401+0000 7f4653e00700 1 -- 172.21.15.142:0/1549098163 learned_addr learned my addr 172.21.15.142:0/1549098163 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.402+0000 7f464be00700 1 --2- 172.21.15.142:0/1549098163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4654073c30 0x7f46541992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.402+0000 7f4653e00700 1 -- 172.21.15.142:0/1549098163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4654073c30 msgr2=0x7f46541992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.402+0000 7f4653e00700 1 --2- 172.21.15.142:0/1549098163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4654073c30 0x7f46541992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.402+0000 7f4653e00700 1 -- 172.21.15.142:0/1549098163 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c0095f0 con 0x7f4654073310 2024-04-20T21:53:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.402+0000 7f4653e00700 1 --2- 172.21.15.142:0/1549098163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4654073310 0x7f4654198da0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f464400ada0 tx=0x7f464400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.402+0000 7f4651600700 1 -- 172.21.15.142:0/1549098163 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f464400f070 con 0x7f4654073310 2024-04-20T21:53:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.402+0000 7f4651600700 1 -- 172.21.15.142:0/1549098163 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4644007bf0 con 0x7f4654073310 2024-04-20T21:53:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.402+0000 7f4651600700 1 -- 172.21.15.142:0/1549098163 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4644005690 con 0x7f4654073310 2024-04-20T21:53:47.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.402+0000 7f465b000700 1 -- 172.21.15.142:0/1549098163 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465419d970 con 0x7f4654073310 2024-04-20T21:53:47.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.403+0000 7f465b000700 1 -- 172.21.15.142:0/1549098163 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465419dec0 con 0x7f4654073310 2024-04-20T21:53:47.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.404+0000 7f465b000700 1 -- 172.21.15.142:0/1549098163 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46540749c0 con 0x7f4654073310 2024-04-20T21:53:47.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.405+0000 7f4651600700 1 -- 172.21.15.142:0/1549098163 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4644005850 con 0x7f4654073310 2024-04-20T21:53:47.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.406+0000 7f4651600700 1 --2- 172.21.15.142:0/1549098163 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f463806cce0 0x7f463806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:47.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.407+0000 7f4651600700 1 -- 172.21.15.142:0/1549098163 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f464408b8e0 con 0x7f4654073310 2024-04-20T21:53:47.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.407+0000 7f464be00700 1 --2- 172.21.15.142:0/1549098163 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f463806cce0 0x7f463806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:47.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.407+0000 7f464be00700 1 --2- 172.21.15.142:0/1549098163 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f463806cce0 0x7f463806f1a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f463c006010 tx=0x7f463c00b540 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:47.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.412+0000 7f4651600700 1 -- 172.21.15.142:0/1549098163 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f4644055fd0 con 0x7f4654073310 2024-04-20T21:53:47.416 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:53:47.437 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705710 got 38654705712 for osd.0 2024-04-20T21:53:47.438 DEBUG:teuthology.parallel:result is None 2024-04-20T21:53:47.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:47 smithi164 ceph-mon[23506]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:47.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:47 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/1865922705' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-20T21:53:47.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.655+0000 7f465b000700 1 -- 172.21.15.142:0/1549098163 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f465410ffd0 con 0x7f4654073310 2024-04-20T21:53:47.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.656+0000 7f4651600700 1 -- 172.21.15.142:0/1549098163 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f46440595f0 con 0x7f4654073310 2024-04-20T21:53:47.655 INFO:teuthology.orchestra.run.smithi142.stdout:154618822676 2024-04-20T21:53:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.659+0000 7f465b000700 1 -- 172.21.15.142:0/1549098163 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f463806cce0 msgr2=0x7f463806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.659+0000 7f465b000700 1 --2- 172.21.15.142:0/1549098163 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f463806cce0 0x7f463806f1a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f463c006010 tx=0x7f463c00b540 comp rx=0 tx=0).stop 2024-04-20T21:53:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.659+0000 7f465b000700 1 -- 172.21.15.142:0/1549098163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4654073310 msgr2=0x7f4654198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.659+0000 7f465b000700 1 --2- 172.21.15.142:0/1549098163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4654073310 0x7f4654198da0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f464400ada0 tx=0x7f464400c330 comp rx=0 tx=0).stop 2024-04-20T21:53:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.659+0000 7f465b000700 1 -- 172.21.15.142:0/1549098163 shutdown_connections 2024-04-20T21:53:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.659+0000 7f465b000700 1 --2- 172.21.15.142:0/1549098163 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f463806cce0 0x7f463806f1a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.659+0000 7f465b000700 1 --2- 172.21.15.142:0/1549098163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4654073310 0x7f4654198da0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.659+0000 7f465b000700 1 --2- 172.21.15.142:0/1549098163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4654073c30 0x7f46541992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.659+0000 7f465b000700 1 -- 172.21.15.142:0/1549098163 >> 172.21.15.142:0/1549098163 conn(0x7f46540fc6c0 msgr2=0x7f4654105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.660+0000 7f465b000700 1 -- 172.21.15.142:0/1549098163 shutdown_connections 2024-04-20T21:53:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:47.660+0000 7f465b000700 1 -- 172.21.15.142:0/1549098163 wait complete. 2024-04-20T21:53:48.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.218+0000 7fc2fb000700 1 -- 172.21.15.142:0/4113727622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2f4100e10 msgr2=0x7fc2f41011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:48.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.218+0000 7fc2fb000700 1 --2- 172.21.15.142:0/4113727622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2f4100e10 0x7fc2f41011f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009910 tx=0x7fc2e4009c20 comp rx=0 tx=0).stop 2024-04-20T21:53:48.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.218+0000 7fc2fb000700 1 -- 172.21.15.142:0/4113727622 shutdown_connections 2024-04-20T21:53:48.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.218+0000 7fc2fb000700 1 --2- 172.21.15.142:0/4113727622 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2f41017c0 0x7fc2f4105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:48.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.218+0000 7fc2fb000700 1 --2- 172.21.15.142:0/4113727622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2f4100e10 0x7fc2f41011f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:48.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.218+0000 7fc2fb000700 1 -- 172.21.15.142:0/4113727622 >> 172.21.15.142:0/4113727622 conn(0x7fc2f40fc6c0 msgr2=0x7fc2f40feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:48.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.218+0000 7fc2fb000700 1 -- 172.21.15.142:0/4113727622 shutdown_connections 2024-04-20T21:53:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.218+0000 7fc2fb000700 1 -- 172.21.15.142:0/4113727622 wait complete. 2024-04-20T21:53:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.220+0000 7fc2fb000700 1 Processor -- start 2024-04-20T21:53:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.220+0000 7fc2fb000700 1 -- start start 2024-04-20T21:53:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.220+0000 7fc2fb000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2f4100e10 0x7fc2f419c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.221+0000 7fc2fb000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2f41017c0 0x7fc2f419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.221+0000 7fc2fb000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f419d360 con 0x7fc2f4100e10 2024-04-20T21:53:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.221+0000 7fc2fb000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f4196940 con 0x7fc2f41017c0 2024-04-20T21:53:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.221+0000 7fc2f3e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2f4100e10 0x7fc2f419c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.221+0000 7fc2f3e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2f4100e10 0x7fc2f419c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58926/0 (socket says 172.21.15.142:58926) 2024-04-20T21:53:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.221+0000 7fc2f3e00700 1 -- 172.21.15.142:0/4245793983 learned_addr learned my addr 172.21.15.142:0/4245793983 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.221+0000 7fc2eb400700 1 --2- 172.21.15.142:0/4245793983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2f41017c0 0x7fc2f419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.221+0000 7fc2f3e00700 1 -- 172.21.15.142:0/4245793983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2f41017c0 msgr2=0x7fc2f419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.221+0000 7fc2f3e00700 1 --2- 172.21.15.142:0/4245793983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2f41017c0 0x7fc2f419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:48.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.221+0000 7fc2f3e00700 1 -- 172.21.15.142:0/4245793983 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e40095f0 con 0x7fc2f4100e10 2024-04-20T21:53:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.221+0000 7fc2eb400700 1 --2- 172.21.15.142:0/4245793983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2f41017c0 0x7fc2f419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:53:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.221+0000 7fc2f3e00700 1 --2- 172.21.15.142:0/4245793983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2f4100e10 0x7fc2f419c800 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40092e0 tx=0x7fc2e400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.222+0000 7fc2f1600700 1 -- 172.21.15.142:0/4245793983 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2e401d070 con 0x7fc2f4100e10 2024-04-20T21:53:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.222+0000 7fc2f1600700 1 -- 172.21.15.142:0/4245793983 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2e400f460 con 0x7fc2f4100e10 2024-04-20T21:53:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.222+0000 7fc2fb000700 1 -- 172.21.15.142:0/4245793983 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f4196bc0 con 0x7fc2f4100e10 2024-04-20T21:53:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.222+0000 7fc2f1600700 1 -- 172.21.15.142:0/4245793983 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2e4017630 con 0x7fc2f4100e10 2024-04-20T21:53:48.264 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:48 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1549098163' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-20T21:53:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.222+0000 7fc2fb000700 1 -- 172.21.15.142:0/4245793983 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f41970b0 con 0x7fc2f4100e10 2024-04-20T21:53:48.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.223+0000 7fc2fb000700 1 -- 172.21.15.142:0/4245793983 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f41091b0 con 0x7fc2f4100e10 2024-04-20T21:53:48.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.224+0000 7fc2f1600700 1 -- 172.21.15.142:0/4245793983 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc2e400f5d0 con 0x7fc2f4100e10 2024-04-20T21:53:48.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.225+0000 7fc2f1600700 1 --2- 172.21.15.142:0/4245793983 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc2d806cce0 0x7fc2d806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:48.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.225+0000 7fc2f1600700 1 -- 172.21.15.142:0/4245793983 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc2e408d370 con 0x7fc2f4100e10 2024-04-20T21:53:48.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.225+0000 7fc2eb400700 1 --2- 172.21.15.142:0/4245793983 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc2d806cce0 0x7fc2d806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:48.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.226+0000 7fc2eb400700 1 --2- 172.21.15.142:0/4245793983 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc2d806cce0 0x7fc2d806f1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc005fd0 tx=0x7fc2dc005dc0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:48.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.230+0000 7fc2f1600700 1 -- 172.21.15.142:0/4245793983 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fc2e405b590 con 0x7fc2f4100e10 2024-04-20T21:53:48.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:48 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/1549098163' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-20T21:53:48.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.456+0000 7fc2fb000700 1 -- 172.21.15.142:0/4245793983 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc2f41022f0 con 0x7fc2f4100e10 2024-04-20T21:53:48.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.456+0000 7fc2f1600700 1 -- 172.21.15.142:0/4245793983 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc2e405b120 con 0x7fc2f4100e10 2024-04-20T21:53:48.455 INFO:teuthology.orchestra.run.smithi142.stdout:60129542186 2024-04-20T21:53:48.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.459+0000 7fc2fb000700 1 -- 172.21.15.142:0/4245793983 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc2d806cce0 msgr2=0x7fc2d806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:48.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.459+0000 7fc2fb000700 1 --2- 172.21.15.142:0/4245793983 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc2d806cce0 0x7fc2d806f1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc005fd0 tx=0x7fc2dc005dc0 comp rx=0 tx=0).stop 2024-04-20T21:53:48.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.460+0000 7fc2fb000700 1 -- 172.21.15.142:0/4245793983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2f4100e10 msgr2=0x7fc2f419c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:48.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.460+0000 7fc2fb000700 1 --2- 172.21.15.142:0/4245793983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2f4100e10 0x7fc2f419c800 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40092e0 tx=0x7fc2e400be20 comp rx=0 tx=0).stop 2024-04-20T21:53:48.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.460+0000 7fc2fb000700 1 -- 172.21.15.142:0/4245793983 shutdown_connections 2024-04-20T21:53:48.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.460+0000 7fc2fb000700 1 --2- 172.21.15.142:0/4245793983 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc2d806cce0 0x7fc2d806f1a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:48.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.460+0000 7fc2fb000700 1 --2- 172.21.15.142:0/4245793983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2f4100e10 0x7fc2f419c800 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:48.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.460+0000 7fc2fb000700 1 --2- 172.21.15.142:0/4245793983 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2f41017c0 0x7fc2f419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:48.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.460+0000 7fc2fb000700 1 -- 172.21.15.142:0/4245793983 >> 172.21.15.142:0/4245793983 conn(0x7fc2f40fc6c0 msgr2=0x7fc2f40fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:48.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.460+0000 7fc2fb000700 1 -- 172.21.15.142:0/4245793983 shutdown_connections 2024-04-20T21:53:48.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:48.460+0000 7fc2fb000700 1 -- 172.21.15.142:0/4245793983 wait complete. 2024-04-20T21:53:49.374 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:49 smithi142 ceph-mon[15828]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:49.374 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:49 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/4245793983' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-20T21:53:49.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:49 smithi164 ceph-mon[23506]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:49.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:49 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/4245793983' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-20T21:53:49.710 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659146 got 176093659149 for osd.5 2024-04-20T21:53:49.710 DEBUG:teuthology.parallel:result is None 2024-04-20T21:53:50.133 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822674 got 154618822676 for osd.4 2024-04-20T21:53:50.133 DEBUG:teuthology.parallel:result is None 2024-04-20T21:53:51.169 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:51 smithi142 ceph-mon[15828]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:51.214 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542182 got 60129542186 for osd.1 2024-04-20T21:53:51.214 DEBUG:teuthology.parallel:result is None 2024-04-20T21:53:51.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:51 smithi164 ceph-mon[23506]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:51.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.854+0000 7f4ed5a00700 1 -- 172.21.15.142:0/1230187643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ed0102660 msgr2=0x7f4ed010ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:51.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.854+0000 7f4ed5a00700 1 --2- 172.21.15.142:0/1230187643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ed0102660 0x7f4ed010ab50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009910 tx=0x7f4ebc009c20 comp rx=0 tx=0).stop 2024-04-20T21:53:51.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.854+0000 7f4ed5a00700 1 -- 172.21.15.142:0/1230187643 shutdown_connections 2024-04-20T21:53:51.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.854+0000 7f4ed5a00700 1 --2- 172.21.15.142:0/1230187643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ed0102660 0x7f4ed010ab50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:51.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.854+0000 7f4ed5a00700 1 --2- 172.21.15.142:0/1230187643 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ed0101d40 0x7f4ed0102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:51.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.854+0000 7f4ed5a00700 1 -- 172.21.15.142:0/1230187643 >> 172.21.15.142:0/1230187643 conn(0x7f4ed0076750 msgr2=0x7f4ed00fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:51.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.854+0000 7f4ed5a00700 1 -- 172.21.15.142:0/1230187643 shutdown_connections 2024-04-20T21:53:51.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.854+0000 7f4ed5a00700 1 -- 172.21.15.142:0/1230187643 wait complete. 2024-04-20T21:53:51.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.855+0000 7f4ed5a00700 1 Processor -- start 2024-04-20T21:53:51.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.856+0000 7f4ed5a00700 1 -- start start 2024-04-20T21:53:51.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.856+0000 7f4ed5a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ed0101d40 0x7f4ed00ff9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:51.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.856+0000 7f4ed5a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ed0102660 0x7f4ed00ffee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:51.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.856+0000 7f4ed5a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed0100420 con 0x7f4ed0101d40 2024-04-20T21:53:51.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.856+0000 7f4ed5a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed0100560 con 0x7f4ed0102660 2024-04-20T21:53:51.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.856+0000 7f4ecea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ed0101d40 0x7f4ed00ff9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:51.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.856+0000 7f4ecea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ed0101d40 0x7f4ed00ff9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58934/0 (socket says 172.21.15.142:58934) 2024-04-20T21:53:51.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.857+0000 7f4ecea00700 1 -- 172.21.15.142:0/2324753158 learned_addr learned my addr 172.21.15.142:0/2324753158 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:51.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.857+0000 7f4ece000700 1 --2- 172.21.15.142:0/2324753158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ed0102660 0x7f4ed00ffee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:51.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.857+0000 7f4ecea00700 1 -- 172.21.15.142:0/2324753158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ed0102660 msgr2=0x7f4ed00ffee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:51.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.857+0000 7f4ecea00700 1 --2- 172.21.15.142:0/2324753158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ed0102660 0x7f4ed00ffee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:51.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.857+0000 7f4ecea00700 1 -- 172.21.15.142:0/2324753158 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ebc0095f0 con 0x7f4ed0101d40 2024-04-20T21:53:51.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.857+0000 7f4ecea00700 1 --2- 172.21.15.142:0/2324753158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ed0101d40 0x7f4ed00ff9a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000c8a0 tx=0x7f4ec000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:51.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.857+0000 7f4ec7400700 1 -- 172.21.15.142:0/2324753158 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ec000cea0 con 0x7f4ed0101d40 2024-04-20T21:53:51.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.858+0000 7f4ed5a00700 1 -- 172.21.15.142:0/2324753158 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed01a2d00 con 0x7f4ed0101d40 2024-04-20T21:53:51.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.858+0000 7f4ec7400700 1 -- 172.21.15.142:0/2324753158 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ec0004830 con 0x7f4ed0101d40 2024-04-20T21:53:51.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.858+0000 7f4ec7400700 1 -- 172.21.15.142:0/2324753158 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ec00055b0 con 0x7f4ed0101d40 2024-04-20T21:53:51.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.858+0000 7f4ed5a00700 1 -- 172.21.15.142:0/2324753158 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed01a3060 con 0x7f4ed0101d40 2024-04-20T21:53:51.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.859+0000 7f4ed5a00700 1 -- 172.21.15.142:0/2324753158 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed0068e50 con 0x7f4ed0101d40 2024-04-20T21:53:51.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.860+0000 7f4ec7400700 1 -- 172.21.15.142:0/2324753158 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4ec00049a0 con 0x7f4ed0101d40 2024-04-20T21:53:51.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.861+0000 7f4ec7400700 1 --2- 172.21.15.142:0/2324753158 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f4eb406cce0 0x7f4eb406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:51.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.861+0000 7f4ec7400700 1 -- 172.21.15.142:0/2324753158 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f4ec008bbd0 con 0x7f4ed0101d40 2024-04-20T21:53:51.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.861+0000 7f4ece000700 1 --2- 172.21.15.142:0/2324753158 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f4eb406cce0 0x7f4eb406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:51.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.862+0000 7f4ece000700 1 --2- 172.21.15.142:0/2324753158 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f4eb406cce0 0x7f4eb406f1a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc00b5c0 tx=0x7f4ebc005380 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:51.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:51.866+0000 7f4ec7400700 1 -- 172.21.15.142:0/2324753158 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f4ec00562c0 con 0x7f4ed0101d40 2024-04-20T21:53:52.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:52.086+0000 7f4ed5a00700 1 -- 172.21.15.142:0/2324753158 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4ed0062510 con 0x7f4ed0101d40 2024-04-20T21:53:52.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:52.087+0000 7f4ec7400700 1 -- 172.21.15.142:0/2324753158 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ec001d090 con 0x7f4ed0101d40 2024-04-20T21:53:52.086 INFO:teuthology.orchestra.run.smithi142.stdout:115964117021 2024-04-20T21:53:52.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:52.090+0000 7f4ed5a00700 1 -- 172.21.15.142:0/2324753158 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f4eb406cce0 msgr2=0x7f4eb406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:52.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:52.090+0000 7f4ed5a00700 1 --2- 172.21.15.142:0/2324753158 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f4eb406cce0 0x7f4eb406f1a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc00b5c0 tx=0x7f4ebc005380 comp rx=0 tx=0).stop 2024-04-20T21:53:52.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:52.090+0000 7f4ed5a00700 1 -- 172.21.15.142:0/2324753158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ed0101d40 msgr2=0x7f4ed00ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:52.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:52.090+0000 7f4ed5a00700 1 --2- 172.21.15.142:0/2324753158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ed0101d40 0x7f4ed00ff9a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000c8a0 tx=0x7f4ec000cc60 comp rx=0 tx=0).stop 2024-04-20T21:53:52.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:52.090+0000 7f4ed5a00700 1 -- 172.21.15.142:0/2324753158 shutdown_connections 2024-04-20T21:53:52.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:52.090+0000 7f4ed5a00700 1 --2- 172.21.15.142:0/2324753158 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f4eb406cce0 0x7f4eb406f1a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:52.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:52.090+0000 7f4ed5a00700 1 --2- 172.21.15.142:0/2324753158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ed0101d40 0x7f4ed00ff9a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:52.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:52.090+0000 7f4ed5a00700 1 --2- 172.21.15.142:0/2324753158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ed0102660 0x7f4ed00ffee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:52.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:52.090+0000 7f4ed5a00700 1 -- 172.21.15.142:0/2324753158 >> 172.21.15.142:0/2324753158 conn(0x7f4ed0076750 msgr2=0x7f4ed0103030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:52.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:52.090+0000 7f4ed5a00700 1 -- 172.21.15.142:0/2324753158 shutdown_connections 2024-04-20T21:53:52.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:52.090+0000 7f4ed5a00700 1 -- 172.21.15.142:0/2324753158 wait complete. 2024-04-20T21:53:52.438 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:52 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2324753158' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-20T21:53:52.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:52 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/2324753158' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-20T21:53:52.809 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117019 got 115964117021 for osd.3 2024-04-20T21:53:52.810 DEBUG:teuthology.parallel:result is None 2024-04-20T21:53:52.810 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-20T21:53:52.810 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-20T21:53:53.221 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:53:53.376 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:53 smithi142 ceph-mon[15828]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:53.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:53 smithi164 ceph-mon[23506]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:55.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.335+0000 7f10c6200700 1 -- 172.21.15.142:0/3313740996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0106a20 msgr2=0x7f10c0106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:55.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.335+0000 7f10c6200700 1 --2- 172.21.15.142:0/3313740996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0106a20 0x7f10c0106e00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009910 tx=0x7f10b0009c20 comp rx=0 tx=0).stop 2024-04-20T21:53:55.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.335+0000 7f10c6200700 1 -- 172.21.15.142:0/3313740996 shutdown_connections 2024-04-20T21:53:55.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.335+0000 7f10c6200700 1 --2- 172.21.15.142:0/3313740996 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10c0100a20 0x7f10c0100ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:55.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.336+0000 7f10c6200700 1 --2- 172.21.15.142:0/3313740996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0106a20 0x7f10c0106e00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:55.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.336+0000 7f10c6200700 1 -- 172.21.15.142:0/3313740996 >> 172.21.15.142:0/3313740996 conn(0x7f10c00fc530 msgr2=0x7f10c00fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:55.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.336+0000 7f10c6200700 1 -- 172.21.15.142:0/3313740996 shutdown_connections 2024-04-20T21:53:55.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.336+0000 7f10c6200700 1 -- 172.21.15.142:0/3313740996 wait complete. 2024-04-20T21:53:55.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.337+0000 7f10c6200700 1 Processor -- start 2024-04-20T21:53:55.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.337+0000 7f10c6200700 1 -- start start 2024-04-20T21:53:55.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.337+0000 7f10c6200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0100a20 0x7f10c019e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:55.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.337+0000 7f10c6200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10c0106a20 0x7f10c019edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:55.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.337+0000 7f10c6200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c0198990 con 0x7f10c0100a20 2024-04-20T21:53:55.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.337+0000 7f10c6200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c0198b00 con 0x7f10c0106a20 2024-04-20T21:53:55.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.337+0000 7f10c4e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0100a20 0x7f10c019e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:55.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.338+0000 7f10c4e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0100a20 0x7f10c019e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58958/0 (socket says 172.21.15.142:58958) 2024-04-20T21:53:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.338+0000 7f10c4e00700 1 -- 172.21.15.142:0/1330130935 learned_addr learned my addr 172.21.15.142:0/1330130935 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.338+0000 7f10b7e00700 1 --2- 172.21.15.142:0/1330130935 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10c0106a20 0x7f10c019edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.338+0000 7f10c4e00700 1 -- 172.21.15.142:0/1330130935 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10c0106a20 msgr2=0x7f10c019edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.338+0000 7f10c4e00700 1 --2- 172.21.15.142:0/1330130935 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10c0106a20 0x7f10c019edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.338+0000 7f10c4e00700 1 -- 172.21.15.142:0/1330130935 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b00095f0 con 0x7f10c0100a20 2024-04-20T21:53:55.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.338+0000 7f10c4e00700 1 --2- 172.21.15.142:0/1330130935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0100a20 0x7f10c019e890 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f10b000bd70 tx=0x7f10b000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:55.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.339+0000 7f10be000700 1 -- 172.21.15.142:0/1330130935 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10b001d070 con 0x7f10c0100a20 2024-04-20T21:53:55.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.339+0000 7f10be000700 1 -- 172.21.15.142:0/1330130935 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f10b000f460 con 0x7f10c0100a20 2024-04-20T21:53:55.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.339+0000 7f10be000700 1 -- 172.21.15.142:0/1330130935 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10b0017630 con 0x7f10c0100a20 2024-04-20T21:53:55.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.339+0000 7f10c6200700 1 -- 172.21.15.142:0/1330130935 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c0198d80 con 0x7f10c0100a20 2024-04-20T21:53:55.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.339+0000 7f10c6200700 1 -- 172.21.15.142:0/1330130935 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c0199270 con 0x7f10c0100a20 2024-04-20T21:53:55.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.340+0000 7f10c6200700 1 -- 172.21.15.142:0/1330130935 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c0104cd0 con 0x7f10c0100a20 2024-04-20T21:53:55.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.341+0000 7f10be000700 1 -- 172.21.15.142:0/1330130935 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f10b000f5d0 con 0x7f10c0100a20 2024-04-20T21:53:55.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.342+0000 7f10be000700 1 --2- 172.21.15.142:0/1330130935 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f10a006cce0 0x7f10a006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:55.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.342+0000 7f10be000700 1 -- 172.21.15.142:0/1330130935 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f10b008d500 con 0x7f10c0100a20 2024-04-20T21:53:55.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.342+0000 7f10b7e00700 1 --2- 172.21.15.142:0/1330130935 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f10a006cce0 0x7f10a006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:55.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.343+0000 7f10b7e00700 1 --2- 172.21.15.142:0/1330130935 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f10a006cce0 0x7f10a006f1a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f10a8005fd0 tx=0x7f10a800a560 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:55.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.347+0000 7f10be000700 1 -- 172.21.15.142:0/1330130935 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f10b0057b70 con 0x7f10c0100a20 2024-04-20T21:53:55.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:55 smithi142 ceph-mon[15828]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:55.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:55 smithi164 ceph-mon[23506]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:55.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.563+0000 7f10c6200700 1 -- 172.21.15.142:0/1330130935 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10c0199e20 con 0x7f10a006cce0 2024-04-20T21:53:55.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.567+0000 7f10be000700 1 -- 172.21.15.142:0/1330130935 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27284 (secure 0 0 0) 0x7f10c0199e20 con 0x7f10a006cce0 2024-04-20T21:53:55.567 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:53:55.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.570+0000 7f10c6200700 1 -- 172.21.15.142:0/1330130935 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f10a006cce0 msgr2=0x7f10a006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:55.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.570+0000 7f10c6200700 1 --2- 172.21.15.142:0/1330130935 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f10a006cce0 0x7f10a006f1a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f10a8005fd0 tx=0x7f10a800a560 comp rx=0 tx=0).stop 2024-04-20T21:53:55.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.570+0000 7f10c6200700 1 -- 172.21.15.142:0/1330130935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0100a20 msgr2=0x7f10c019e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:55.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.570+0000 7f10c6200700 1 --2- 172.21.15.142:0/1330130935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0100a20 0x7f10c019e890 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f10b000bd70 tx=0x7f10b000be50 comp rx=0 tx=0).stop 2024-04-20T21:53:55.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.570+0000 7f10c6200700 1 -- 172.21.15.142:0/1330130935 shutdown_connections 2024-04-20T21:53:55.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.570+0000 7f10c6200700 1 --2- 172.21.15.142:0/1330130935 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f10a006cce0 0x7f10a006f1a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:55.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.570+0000 7f10c6200700 1 --2- 172.21.15.142:0/1330130935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0100a20 0x7f10c019e890 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:55.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.570+0000 7f10c6200700 1 --2- 172.21.15.142:0/1330130935 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10c0106a20 0x7f10c019edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:55.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.570+0000 7f10c6200700 1 -- 172.21.15.142:0/1330130935 >> 172.21.15.142:0/1330130935 conn(0x7f10c00fc530 msgr2=0x7f10c00732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:55.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.571+0000 7f10c6200700 1 -- 172.21.15.142:0/1330130935 shutdown_connections 2024-04-20T21:53:55.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:55.571+0000 7f10c6200700 1 -- 172.21.15.142:0/1330130935 wait complete. 2024-04-20T21:53:55.571 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-20T21:53:56.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:56 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:53:56.303 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-04-20T21:53:54.010450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":194772,"kb_used_data":3972,"kb_used_omap":9,"kb_used_meta":190710,"kb_avail":562276140,"statfs":{"total":575970213888,"available":575770767360,"internally_reserved":0,"allocated":4067328,"data_stored":2656332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9563,"internal_metadata":195287717},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003772"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":189,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-20T21:52:57.296859+0000","last_change":"2024-04-20T21:52:20.178728+0000","last_active":"2024-04-20T21:52:57.296859+0000","last_peered":"2024-04-20T21:52:57.296859+0000","last_clean":"2024-04-20T21:52:57.296859+0000","last_became_active":"2024-04-20T21:52:20.178338+0000","last_became_peered":"2024-04-20T21:52:20.178338+0000","last_unstale":"2024-04-20T21:52:57.296859+0000","last_undegraded":"2024-04-20T21:52:57.296859+0000","last_fullsized":"2024-04-20T21:52:57.296859+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:51:11.093899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:51:11.093899+0000","last_clean_scrub_stamp":"2024-04-20T21:51:11.093899+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:54:39.653665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":41,"seq":176093659151,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":35584,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709568,"statfs":{"total":95995035648,"available":95958597632,"internally_reserved":0,"allocated":380928,"data_stored":147538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3720000000000001}]}]},{"osd":4,"up_from":36,"seq":154618822678,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":35588,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709564,"statfs":{"total":95995035648,"available":95958593536,"internally_reserved":0,"allocated":380928,"data_stored":147538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 21:53:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.179},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.67800000000000005}]},{"osd":1,"last update":"Sat Apr 20 21:53:22 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":0.80100000000000005}]},{"osd":2,"last update":"Sat Apr 20 21:53:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.86399999999999999}]},{"osd":3,"last update":"Sat Apr 20 21:53:22 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.107},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.95499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]}]},{"osd":3,"up_from":27,"seq":115964117022,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":974848,"data_stored":737906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 21:53:51 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.97399999999999998,"15min":0.97799999999999998},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3049999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.333,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.91900000000000004}]},{"osd":1,"last update":"Sat Apr 20 21:53:51 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.0169999999999999,"15min":1.0009999999999999},"min":{"1min":0.73599999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.3439999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.98499999999999999,"15min":0.97499999999999998},"min":{"1min":0.78400000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4359999999999999,"5min":1.444,"15min":1.444},"last":0.89000000000000001}]},{"osd":2,"last update":"Sat Apr 20 21:53:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.042,"15min":1.042},"min":{"1min":0.79900000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.407,"5min":1.492,"15min":1.492},"last":1.028},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.044,"15min":1.0329999999999999},"min":{"1min":0.73899999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.399,"5min":1.736,"15min":1.736},"last":1.111}]},{"osd":4,"last update":"Sat Apr 20 21:53:25 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":1.042},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.091}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]}]},{"osd":2,"up_from":19,"seq":81604378661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":35584,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709568,"statfs":{"total":95995035648,"available":95958597632,"internally_reserved":0,"allocated":380928,"data_stored":147538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 21:53:18 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.80200000000000005,"15min":0.79100000000000004},"min":{"1min":0.432,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.86599999999999999,"15min":0.86399999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.89900000000000002}]},{"osd":1,"last update":"Sat Apr 20 21:53:18 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.89300000000000002,"15min":0.88500000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.095},{"interface":"front","average":{"1min":1.008,"5min":0.94399999999999995,"15min":0.93400000000000005},"min":{"1min":0.63300000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":1.147}]},{"osd":3,"last update":"Sat Apr 20 21:53:50 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.107,"15min":1.099},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.23},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.286,"15min":1.3},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.72,"5min":5.5300000000000002,"15min":5.5300000000000002},"last":1.3600000000000001}]},{"osd":4,"last update":"Sat Apr 20 21:53:23 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.194},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.3220000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":974848,"data_stored":737906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Apr 20 21:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.74399999999999999,"15min":0.70999999999999996},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1899999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.80300000000000005,"15min":0.76500000000000001},"min":{"1min":0.441,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.72999999999999998}]},{"osd":2,"last update":"Sat Apr 20 21:53:12 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.93600000000000005,"15min":0.94799999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0940000000000001,"5min":2.331,"15min":2.331},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0429999999999999,"15min":1.0509999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.401,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.65100000000000002}]},{"osd":3,"last update":"Sat Apr 20 21:52:47 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":3.149,"5min":3.149,"15min":3.149},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":3.0950000000000002,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.0429999999999999}]},{"osd":4,"last update":"Sat Apr 20 21:53:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.077},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":974848,"data_stored":737906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 21:53:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.70299999999999996,"15min":0.67800000000000005},"min":{"1min":0.47599999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.94999999999999996,"5min":1.264,"15min":1.264},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.76400000000000001,"15min":0.69799999999999995},"min":{"1min":0.45500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.54900000000000004}]},{"osd":2,"last update":"Sat Apr 20 21:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.93700000000000006,"15min":0.92500000000000004},"min":{"1min":0.70399999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.90800000000000003,"15min":0.89500000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2470000000000001,"5min":1.349,"15min":1.349},"last":0.61399999999999999}]},{"osd":3,"last update":"Sat Apr 20 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.085,"15min":1.0469999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.2999999999999998,"5min":4.2999999999999998,"15min":4.2999999999999998},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1000000000000001,"15min":1.097},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.4630000000000001,"5min":1.843,"15min":1.843},"last":0.98999999999999999}]},{"osd":4,"last update":"Sat Apr 20 21:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.052}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T21:53:56.304 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-20T21:53:56.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:56 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:53:56.710 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:53:57.425 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:57 smithi142 ceph-mon[15828]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T21:53:57.425 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:57 smithi142 ceph-mon[15828]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:57.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:57 smithi164 ceph-mon[23506]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T21:53:57.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:57 smithi164 ceph-mon[23506]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:59.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.115+0000 7f2331e00700 1 -- 172.21.15.142:0/2695763288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232c108e10 msgr2=0x7f232c109290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:59.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.115+0000 7f2331e00700 1 --2- 172.21.15.142:0/2695763288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232c108e10 0x7f232c109290 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2318009910 tx=0x7f2318009c20 comp rx=0 tx=0).stop 2024-04-20T21:53:59.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.115+0000 7f2331e00700 1 -- 172.21.15.142:0/2695763288 shutdown_connections 2024-04-20T21:53:59.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.115+0000 7f2331e00700 1 --2- 172.21.15.142:0/2695763288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232c108e10 0x7f232c109290 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:59.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.115+0000 7f2331e00700 1 --2- 172.21.15.142:0/2695763288 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f232c107520 0x7f232c107900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:59.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.115+0000 7f2331e00700 1 -- 172.21.15.142:0/2695763288 >> 172.21.15.142:0/2695763288 conn(0x7f232c0768f0 msgr2=0x7f232c078d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:59.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.115+0000 7f2331e00700 1 -- 172.21.15.142:0/2695763288 shutdown_connections 2024-04-20T21:53:59.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.115+0000 7f2331e00700 1 -- 172.21.15.142:0/2695763288 wait complete. 2024-04-20T21:53:59.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.116+0000 7f2331e00700 1 Processor -- start 2024-04-20T21:53:59.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.116+0000 7f2331e00700 1 -- start start 2024-04-20T21:53:59.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.117+0000 7f2331e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232c107520 0x7f232c19d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:59.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.117+0000 7f2331e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f232c108e10 0x7f232c19d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:59.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.117+0000 7f2331e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c19ddf0 con 0x7f232c107520 2024-04-20T21:53:59.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.117+0000 7f2331e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c1a1a70 con 0x7f232c108e10 2024-04-20T21:53:59.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.117+0000 7f232aa00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232c107520 0x7f232c19d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:59.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.117+0000 7f232aa00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232c107520 0x7f232c19d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39530/0 (socket says 172.21.15.142:39530) 2024-04-20T21:53:59.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.117+0000 7f232aa00700 1 -- 172.21.15.142:0/2651560195 learned_addr learned my addr 172.21.15.142:0/2651560195 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:53:59.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.117+0000 7f232a000700 1 --2- 172.21.15.142:0/2651560195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f232c108e10 0x7f232c19d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:59.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.117+0000 7f232aa00700 1 -- 172.21.15.142:0/2651560195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f232c108e10 msgr2=0x7f232c19d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:59.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.117+0000 7f232aa00700 1 --2- 172.21.15.142:0/2651560195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f232c108e10 0x7f232c19d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:59.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.117+0000 7f232aa00700 1 -- 172.21.15.142:0/2651560195 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23180095f0 con 0x7f232c107520 2024-04-20T21:53:59.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.118+0000 7f232aa00700 1 --2- 172.21.15.142:0/2651560195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232c107520 0x7f232c19d1d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f231c00d8d0 tx=0x7f231c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:59.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.118+0000 7f2330a00700 1 -- 172.21.15.142:0/2651560195 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f231c009940 con 0x7f232c107520 2024-04-20T21:53:59.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.118+0000 7f2330a00700 1 -- 172.21.15.142:0/2651560195 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f231c010460 con 0x7f232c107520 2024-04-20T21:53:59.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.118+0000 7f2331e00700 1 -- 172.21.15.142:0/2651560195 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232c1a1d50 con 0x7f232c107520 2024-04-20T21:53:59.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.118+0000 7f2330a00700 1 -- 172.21.15.142:0/2651560195 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f231c00f5f0 con 0x7f232c107520 2024-04-20T21:53:59.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.118+0000 7f2331e00700 1 -- 172.21.15.142:0/2651560195 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c1a2320 con 0x7f232c107520 2024-04-20T21:53:59.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.119+0000 7f2331e00700 1 -- 172.21.15.142:0/2651560195 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232c10f870 con 0x7f232c107520 2024-04-20T21:53:59.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.120+0000 7f2330a00700 1 -- 172.21.15.142:0/2651560195 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f231c0105d0 con 0x7f232c107520 2024-04-20T21:53:59.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.121+0000 7f2330a00700 1 --2- 172.21.15.142:0/2651560195 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f231006ccf0 0x7f231006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:53:59.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.121+0000 7f2330a00700 1 -- 172.21.15.142:0/2651560195 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f231c08bfc0 con 0x7f232c107520 2024-04-20T21:53:59.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.121+0000 7f232a000700 1 --2- 172.21.15.142:0/2651560195 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f231006ccf0 0x7f231006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:53:59.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.122+0000 7f232a000700 1 --2- 172.21.15.142:0/2651560195 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f231006ccf0 0x7f231006f1b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2318005b40 tx=0x7f231801a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:53:59.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.126+0000 7f2330a00700 1 -- 172.21.15.142:0/2651560195 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f231c0bfc50 con 0x7f232c107520 2024-04-20T21:53:59.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.339+0000 7f2331e00700 1 -- 172.21.15.142:0/2651560195 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f232c1144c0 con 0x7f231006ccf0 2024-04-20T21:53:59.340 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:53:59 smithi142 ceph-mon[15828]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:53:59.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.343+0000 7f2330a00700 1 -- 172.21.15.142:0/2651560195 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27308 (secure 0 0 0) 0x7f232c1144c0 con 0x7f231006ccf0 2024-04-20T21:53:59.344 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:53:59.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.346+0000 7f2331e00700 1 -- 172.21.15.142:0/2651560195 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f231006ccf0 msgr2=0x7f231006f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:59.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.347+0000 7f2331e00700 1 --2- 172.21.15.142:0/2651560195 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f231006ccf0 0x7f231006f1b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2318005b40 tx=0x7f231801a040 comp rx=0 tx=0).stop 2024-04-20T21:53:59.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.347+0000 7f2331e00700 1 -- 172.21.15.142:0/2651560195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232c107520 msgr2=0x7f232c19d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:53:59.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.347+0000 7f2331e00700 1 --2- 172.21.15.142:0/2651560195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232c107520 0x7f232c19d1d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f231c00d8d0 tx=0x7f231c00dc90 comp rx=0 tx=0).stop 2024-04-20T21:53:59.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.347+0000 7f2331e00700 1 -- 172.21.15.142:0/2651560195 shutdown_connections 2024-04-20T21:53:59.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.347+0000 7f2331e00700 1 --2- 172.21.15.142:0/2651560195 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f231006ccf0 0x7f231006f1b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:59.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.347+0000 7f2331e00700 1 --2- 172.21.15.142:0/2651560195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232c107520 0x7f232c19d1d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:59.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.347+0000 7f2331e00700 1 --2- 172.21.15.142:0/2651560195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f232c108e10 0x7f232c19d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:53:59.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.347+0000 7f2331e00700 1 -- 172.21.15.142:0/2651560195 >> 172.21.15.142:0/2651560195 conn(0x7f232c0768f0 msgr2=0x7f232c077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:53:59.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.347+0000 7f2331e00700 1 -- 172.21.15.142:0/2651560195 shutdown_connections 2024-04-20T21:53:59.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:53:59.347+0000 7f2331e00700 1 -- 172.21.15.142:0/2651560195 wait complete. 2024-04-20T21:53:59.348 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-20T21:53:59.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:53:59 smithi164 ceph-mon[23506]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:00.228 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-04-20T21:53:58.011605+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":194772,"kb_used_data":3972,"kb_used_omap":9,"kb_used_meta":190710,"kb_avail":562276140,"statfs":{"total":575970213888,"available":575770767360,"internally_reserved":0,"allocated":4067328,"data_stored":2656332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9563,"internal_metadata":195287717},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003508"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":189,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-20T21:52:57.296859+0000","last_change":"2024-04-20T21:52:20.178728+0000","last_active":"2024-04-20T21:52:57.296859+0000","last_peered":"2024-04-20T21:52:57.296859+0000","last_clean":"2024-04-20T21:52:57.296859+0000","last_became_active":"2024-04-20T21:52:20.178338+0000","last_became_peered":"2024-04-20T21:52:20.178338+0000","last_unstale":"2024-04-20T21:52:57.296859+0000","last_undegraded":"2024-04-20T21:52:57.296859+0000","last_fullsized":"2024-04-20T21:52:57.296859+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T21:51:11.093899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T21:51:11.093899+0000","last_clean_scrub_stamp":"2024-04-20T21:51:11.093899+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T07:54:39.653665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":41,"seq":176093659151,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":35584,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709568,"statfs":{"total":95995035648,"available":95958597632,"internally_reserved":0,"allocated":380928,"data_stored":147538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3720000000000001}]}]},{"osd":4,"up_from":36,"seq":154618822679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":35588,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709564,"statfs":{"total":95995035648,"available":95958593536,"internally_reserved":0,"allocated":380928,"data_stored":147538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 21:53:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.1559999999999999}]},{"osd":1,"last update":"Sat Apr 20 21:53:22 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":0.77300000000000002}]},{"osd":2,"last update":"Sat Apr 20 21:53:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.2929999999999999}]},{"osd":3,"last update":"Sat Apr 20 21:53:22 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.242},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.3580000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]}]},{"osd":3,"up_from":27,"seq":115964117023,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":974848,"data_stored":737906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 21:53:51 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.97399999999999998,"15min":0.97799999999999998},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3049999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.333,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.018}]},{"osd":1,"last update":"Sat Apr 20 21:53:51 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.0169999999999999,"15min":1.0009999999999999},"min":{"1min":0.73599999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.3439999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.98499999999999999,"15min":0.97499999999999998},"min":{"1min":0.78400000000000003,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4359999999999999,"5min":1.444,"15min":1.444},"last":1.1539999999999999}]},{"osd":2,"last update":"Sat Apr 20 21:53:51 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.042,"15min":1.042},"min":{"1min":0.79900000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.407,"5min":1.492,"15min":1.492},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.044,"15min":1.0329999999999999},"min":{"1min":0.73899999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.399,"5min":1.736,"15min":1.736},"last":1.1850000000000001}]},{"osd":4,"last update":"Sat Apr 20 21:53:25 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.2190000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378662,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":35584,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709568,"statfs":{"total":95995035648,"available":95958597632,"internally_reserved":0,"allocated":380928,"data_stored":147538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 21:53:18 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.80200000000000005,"15min":0.79100000000000004},"min":{"1min":0.432,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.86599999999999999,"15min":0.86399999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.89900000000000002}]},{"osd":1,"last update":"Sat Apr 20 21:53:18 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.89300000000000002,"15min":0.88500000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.095},{"interface":"front","average":{"1min":1.008,"5min":0.94399999999999995,"15min":0.93400000000000005},"min":{"1min":0.63300000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":1.147}]},{"osd":3,"last update":"Sat Apr 20 21:53:50 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.107,"15min":1.099},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.23},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.286,"15min":1.3},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.72,"5min":5.5300000000000002,"15min":5.5300000000000002},"last":1.3600000000000001}]},{"osd":4,"last update":"Sat Apr 20 21:53:23 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.194},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.3220000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":974848,"data_stored":737906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Apr 20 21:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.74399999999999999,"15min":0.70999999999999996},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1899999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.80300000000000005,"15min":0.76500000000000001},"min":{"1min":0.441,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.86199999999999999}]},{"osd":2,"last update":"Sat Apr 20 21:53:12 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.93600000000000005,"15min":0.94799999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0940000000000001,"5min":2.331,"15min":2.331},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0429999999999999,"15min":1.0509999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.401,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.79300000000000004}]},{"osd":3,"last update":"Sat Apr 20 21:53:50 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.137,"15min":1.1399999999999999},"min":{"1min":0.82399999999999995,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.8140000000000001,"5min":3.149,"15min":3.149},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.206,"15min":1.22},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.891,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.2}]},{"osd":4,"last update":"Sat Apr 20 21:53:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.042},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.0660000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":974848,"data_stored":737906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Apr 20 21:53:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.70299999999999996,"15min":0.67800000000000005},"min":{"1min":0.47599999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.94999999999999996,"5min":1.264,"15min":1.264},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.76400000000000001,"15min":0.69799999999999995},"min":{"1min":0.45500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.3939999999999999}]},{"osd":2,"last update":"Sat Apr 20 21:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.93700000000000006,"15min":0.92500000000000004},"min":{"1min":0.70399999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.2909999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.90800000000000003,"15min":0.89500000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2470000000000001,"5min":1.349,"15min":1.349},"last":1.1200000000000001}]},{"osd":3,"last update":"Sat Apr 20 21:53:47 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.085,"15min":1.0469999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.2999999999999998,"5min":4.2999999999999998,"15min":4.2999999999999998},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1000000000000001,"15min":1.097},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.4630000000000001,"5min":1.843,"15min":1.843},"last":0.93200000000000005}]},{"osd":4,"last update":"Sat Apr 20 21:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":1.0589999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T21:54:00.229 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-20T21:54:00.229 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-20T21:54:00.229 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-20T21:54:00.229 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph health --format=json 2024-04-20T21:54:00.631 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:54:01.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:01 smithi164 ceph-mon[23506]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T21:54:01.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:01 smithi164 ceph-mon[23506]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:01.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:01 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:54:01.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:01 smithi142 ceph-mon[15828]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T21:54:01.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:01 smithi142 ceph-mon[15828]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:01.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:01 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:54:02.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.956+0000 7f12b3200700 1 -- 172.21.15.142:0/4275555786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12ac108e10 msgr2=0x7f12ac109290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:02.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.956+0000 7f12b3200700 1 --2- 172.21.15.142:0/4275555786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12ac108e10 0x7f12ac109290 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1298009910 tx=0x7f1298009c20 comp rx=0 tx=0).stop 2024-04-20T21:54:02.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.956+0000 7f12b3200700 1 -- 172.21.15.142:0/4275555786 shutdown_connections 2024-04-20T21:54:02.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.956+0000 7f12b3200700 1 --2- 172.21.15.142:0/4275555786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12ac108e10 0x7f12ac109290 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:02.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.956+0000 7f12b3200700 1 --2- 172.21.15.142:0/4275555786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12ac107520 0x7f12ac107900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:02.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.956+0000 7f12b3200700 1 -- 172.21.15.142:0/4275555786 >> 172.21.15.142:0/4275555786 conn(0x7f12ac0768f0 msgr2=0x7f12ac078d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:02.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.956+0000 7f12b3200700 1 -- 172.21.15.142:0/4275555786 shutdown_connections 2024-04-20T21:54:02.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.956+0000 7f12b3200700 1 -- 172.21.15.142:0/4275555786 wait complete. 2024-04-20T21:54:02.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.957+0000 7f12b3200700 1 Processor -- start 2024-04-20T21:54:02.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.957+0000 7f12b3200700 1 -- start start 2024-04-20T21:54:02.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.958+0000 7f12b3200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12ac107520 0x7f12ac19d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:02.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.958+0000 7f12b3200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12ac108e10 0x7f12ac19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:02.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.958+0000 7f12b3200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac19ddb0 con 0x7f12ac107520 2024-04-20T21:54:02.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.958+0000 7f12b3200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac1a1a80 con 0x7f12ac108e10 2024-04-20T21:54:02.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.958+0000 7f12abe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12ac107520 0x7f12ac19d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:02.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.958+0000 7f12abe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12ac107520 0x7f12ac19d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39544/0 (socket says 172.21.15.142:39544) 2024-04-20T21:54:02.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.958+0000 7f12abe00700 1 -- 172.21.15.142:0/2621964256 learned_addr learned my addr 172.21.15.142:0/2621964256 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:54:02.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.959+0000 7f12ab400700 1 --2- 172.21.15.142:0/2621964256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12ac108e10 0x7f12ac19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:02.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.959+0000 7f12abe00700 1 -- 172.21.15.142:0/2621964256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12ac108e10 msgr2=0x7f12ac19d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:02.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.959+0000 7f12abe00700 1 --2- 172.21.15.142:0/2621964256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12ac108e10 0x7f12ac19d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:02.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.959+0000 7f12abe00700 1 -- 172.21.15.142:0/2621964256 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12980095f0 con 0x7f12ac107520 2024-04-20T21:54:02.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.959+0000 7f12ab400700 1 --2- 172.21.15.142:0/2621964256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12ac108e10 0x7f12ac19d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:54:02.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.959+0000 7f12abe00700 1 --2- 172.21.15.142:0/2621964256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12ac107520 0x7f12ac19d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f129c00e940 tx=0x7f129c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:02.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.959+0000 7f12a8c00700 1 -- 172.21.15.142:0/2621964256 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f129c0097b0 con 0x7f12ac107520 2024-04-20T21:54:02.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.959+0000 7f12a8c00700 1 -- 172.21.15.142:0/2621964256 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f129c004cf0 con 0x7f12ac107520 2024-04-20T21:54:02.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.959+0000 7f12a8c00700 1 -- 172.21.15.142:0/2621964256 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f129c005700 con 0x7f12ac107520 2024-04-20T21:54:02.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.959+0000 7f12b3200700 1 -- 172.21.15.142:0/2621964256 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ac1a1d60 con 0x7f12ac107520 2024-04-20T21:54:02.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.959+0000 7f12b3200700 1 -- 172.21.15.142:0/2621964256 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ac1a2330 con 0x7f12ac107520 2024-04-20T21:54:02.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.961+0000 7f12b3200700 1 -- 172.21.15.142:0/2621964256 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ac10f870 con 0x7f12ac107520 2024-04-20T21:54:02.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.961+0000 7f12a8c00700 1 -- 172.21.15.142:0/2621964256 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f129c00cba0 con 0x7f12ac107520 2024-04-20T21:54:02.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.962+0000 7f12a8c00700 1 --2- 172.21.15.142:0/2621964256 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f129006cce0 0x7f129006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:02.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.962+0000 7f12a8c00700 1 -- 172.21.15.142:0/2621964256 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f129c014070 con 0x7f12ac107520 2024-04-20T21:54:02.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.963+0000 7f12ab400700 1 --2- 172.21.15.142:0/2621964256 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f129006cce0 0x7f129006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:02.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.963+0000 7f12ab400700 1 --2- 172.21.15.142:0/2621964256 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f129006cce0 0x7f129006f1a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1298009fd0 tx=0x7f1298005fb0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:02.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:02.967+0000 7f12a8c00700 1 -- 172.21.15.142:0/2621964256 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f129c0569c0 con 0x7f12ac107520 2024-04-20T21:54:03.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:03.233+0000 7f12b3200700 1 -- 172.21.15.142:0/2621964256 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f12ac108920 con 0x7f12ac107520 2024-04-20T21:54:03.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:03.234+0000 7f12a8c00700 1 -- 172.21.15.142:0/2621964256 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f129c059fe0 con 0x7f12ac107520 2024-04-20T21:54:03.233 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:54:03.233 INFO:teuthology.orchestra.run.smithi142.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-20T21:54:03.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:03.237+0000 7f12b3200700 1 -- 172.21.15.142:0/2621964256 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f129006cce0 msgr2=0x7f129006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:03.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:03.237+0000 7f12b3200700 1 --2- 172.21.15.142:0/2621964256 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f129006cce0 0x7f129006f1a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1298009fd0 tx=0x7f1298005fb0 comp rx=0 tx=0).stop 2024-04-20T21:54:03.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:03.237+0000 7f12b3200700 1 -- 172.21.15.142:0/2621964256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12ac107520 msgr2=0x7f12ac19d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:03.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:03.237+0000 7f12b3200700 1 --2- 172.21.15.142:0/2621964256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12ac107520 0x7f12ac19d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f129c00e940 tx=0x7f129c00ed00 comp rx=0 tx=0).stop 2024-04-20T21:54:03.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:03.237+0000 7f12b3200700 1 -- 172.21.15.142:0/2621964256 shutdown_connections 2024-04-20T21:54:03.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:03.237+0000 7f12b3200700 1 --2- 172.21.15.142:0/2621964256 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f129006cce0 0x7f129006f1a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:03.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:03.237+0000 7f12b3200700 1 --2- 172.21.15.142:0/2621964256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12ac107520 0x7f12ac19d190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:03.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:03.237+0000 7f12b3200700 1 --2- 172.21.15.142:0/2621964256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f12ac108e10 0x7f12ac19d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:03.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:03.237+0000 7f12b3200700 1 -- 172.21.15.142:0/2621964256 >> 172.21.15.142:0/2621964256 conn(0x7f12ac0768f0 msgr2=0x7f12ac0774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:03.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:03.237+0000 7f12b3200700 1 -- 172.21.15.142:0/2621964256 shutdown_connections 2024-04-20T21:54:03.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:03.237+0000 7f12b3200700 1 -- 172.21.15.142:0/2621964256 wait complete. 2024-04-20T21:54:03.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:03 smithi164 ceph-mon[23506]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:03.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:03 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:54:03.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:03 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:54:03.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:03 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:03.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:03 smithi142 ceph-mon[15828]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:03.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:03 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:54:03.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:03 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:54:03.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:03 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:04.069 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-20T21:54:04.069 INFO:tasks.cephadm:Setup complete, yielding 2024-04-20T21:54:04.069 INFO:teuthology.run_tasks:Running task print... 2024-04-20T21:54:04.078 INFO:teuthology.task.print:**** done end installing reef cephadm ... 2024-04-20T21:54:04.078 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-20T21:54:04.092 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi142.front.sepia.ceph.com 2024-04-20T21:54:04.092 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-04-20T21:54:04.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:04 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2621964256' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-20T21:54:04.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:04 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/2621964256' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-20T21:54:04.515 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:54:05.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:05 smithi142 ceph-mon[15828]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:05.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:05 smithi164 ceph-mon[23506]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:06.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.657+0000 7ffaa0200700 1 -- 172.21.15.142:0/706622426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa98102e20 msgr2=0x7ffa98103240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:06.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.657+0000 7ffaa0200700 1 --2- 172.21.15.142:0/706622426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa98102e20 0x7ffa98103240 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c009910 tx=0x7ffa8c009c20 comp rx=0 tx=0).stop 2024-04-20T21:54:06.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.657+0000 7ffaa0200700 1 -- 172.21.15.142:0/706622426 shutdown_connections 2024-04-20T21:54:06.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.657+0000 7ffaa0200700 1 --2- 172.21.15.142:0/706622426 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa98103f80 0x7ffa98104400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:06.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.657+0000 7ffaa0200700 1 --2- 172.21.15.142:0/706622426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa98102e20 0x7ffa98103240 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:06.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.657+0000 7ffaa0200700 1 -- 172.21.15.142:0/706622426 >> 172.21.15.142:0/706622426 conn(0x7ffa980fe3e0 msgr2=0x7ffa98100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:06.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.657+0000 7ffaa0200700 1 -- 172.21.15.142:0/706622426 shutdown_connections 2024-04-20T21:54:06.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.657+0000 7ffaa0200700 1 -- 172.21.15.142:0/706622426 wait complete. 2024-04-20T21:54:06.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.658+0000 7ffaa0200700 1 Processor -- start 2024-04-20T21:54:06.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.658+0000 7ffaa0200700 1 -- start start 2024-04-20T21:54:06.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.659+0000 7ffaa0200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa98102e20 0x7ffa981987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:06.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.659+0000 7ffaa0200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa98103f80 0x7ffa98198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:06.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.659+0000 7ffaa0200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa98199320 con 0x7ffa98103f80 2024-04-20T21:54:06.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.659+0000 7ffaa0200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa98199460 con 0x7ffa98102e20 2024-04-20T21:54:06.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.659+0000 7ffa9ce00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa98103f80 0x7ffa98198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:06.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.659+0000 7ffa9ce00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa98103f80 0x7ffa98198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39562/0 (socket says 172.21.15.142:39562) 2024-04-20T21:54:06.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.659+0000 7ffa9ce00700 1 -- 172.21.15.142:0/241292783 learned_addr learned my addr 172.21.15.142:0/241292783 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:54:06.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.659+0000 7ffa9d800700 1 --2- 172.21.15.142:0/241292783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa98102e20 0x7ffa981987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:06.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.659+0000 7ffa9ce00700 1 -- 172.21.15.142:0/241292783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa98102e20 msgr2=0x7ffa981987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:06.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.659+0000 7ffa9ce00700 1 --2- 172.21.15.142:0/241292783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa98102e20 0x7ffa981987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:06.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.659+0000 7ffa9ce00700 1 -- 172.21.15.142:0/241292783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c0095f0 con 0x7ffa98103f80 2024-04-20T21:54:06.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.660+0000 7ffa9ce00700 1 --2- 172.21.15.142:0/241292783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa98103f80 0x7ffa98198d00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400c8a0 tx=0x7ffa8400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:06.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.660+0000 7ffa96000700 1 -- 172.21.15.142:0/241292783 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa8400cea0 con 0x7ffa98103f80 2024-04-20T21:54:06.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.660+0000 7ffa96000700 1 -- 172.21.15.142:0/241292783 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa84004830 con 0x7ffa98103f80 2024-04-20T21:54:06.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.660+0000 7ffaa0200700 1 -- 172.21.15.142:0/241292783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa9819dec0 con 0x7ffa98103f80 2024-04-20T21:54:06.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.660+0000 7ffa96000700 1 -- 172.21.15.142:0/241292783 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa840055b0 con 0x7ffa98103f80 2024-04-20T21:54:06.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.660+0000 7ffaa0200700 1 -- 172.21.15.142:0/241292783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9819e460 con 0x7ffa98103f80 2024-04-20T21:54:06.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.661+0000 7ffaa0200700 1 -- 172.21.15.142:0/241292783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa98192920 con 0x7ffa98103f80 2024-04-20T21:54:06.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.662+0000 7ffa96000700 1 -- 172.21.15.142:0/241292783 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ffa840049a0 con 0x7ffa98103f80 2024-04-20T21:54:06.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.663+0000 7ffa96000700 1 --2- 172.21.15.142:0/241292783 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ffa8006cd40 0x7ffa8006f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:06.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.663+0000 7ffa96000700 1 -- 172.21.15.142:0/241292783 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ffa8408bab0 con 0x7ffa98103f80 2024-04-20T21:54:06.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.663+0000 7ffa9d800700 1 --2- 172.21.15.142:0/241292783 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ffa8006cd40 0x7ffa8006f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:06.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.664+0000 7ffa9d800700 1 --2- 172.21.15.142:0/241292783 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ffa8006cd40 0x7ffa8006f200 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c0051c0 tx=0x7ffa8c00b540 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:06.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.668+0000 7ffa96000700 1 -- 172.21.15.142:0/241292783 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7ffa8408de60 con 0x7ffa98103f80 2024-04-20T21:54:06.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.890+0000 7ffaa0200700 1 -- 172.21.15.142:0/241292783 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7ffa9804ebb0 con 0x7ffa98103f80 2024-04-20T21:54:06.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.898+0000 7ffa96000700 1 -- 172.21.15.142:0/241292783 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v24)=0 v24) v1 ==== 143+0+0 (secure 0 0 0) 0x7ffa8401d0d0 con 0x7ffa98103f80 2024-04-20T21:54:06.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.902+0000 7ffaa0200700 1 -- 172.21.15.142:0/241292783 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ffa8006cd40 msgr2=0x7ffa8006f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:06.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.902+0000 7ffaa0200700 1 --2- 172.21.15.142:0/241292783 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ffa8006cd40 0x7ffa8006f200 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c0051c0 tx=0x7ffa8c00b540 comp rx=0 tx=0).stop 2024-04-20T21:54:06.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.902+0000 7ffaa0200700 1 -- 172.21.15.142:0/241292783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa98103f80 msgr2=0x7ffa98198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:06.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.902+0000 7ffaa0200700 1 --2- 172.21.15.142:0/241292783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa98103f80 0x7ffa98198d00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400c8a0 tx=0x7ffa8400cc60 comp rx=0 tx=0).stop 2024-04-20T21:54:06.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.903+0000 7ffaa0200700 1 -- 172.21.15.142:0/241292783 shutdown_connections 2024-04-20T21:54:06.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.903+0000 7ffaa0200700 1 --2- 172.21.15.142:0/241292783 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ffa8006cd40 0x7ffa8006f200 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:06.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.903+0000 7ffaa0200700 1 --2- 172.21.15.142:0/241292783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa98102e20 0x7ffa981987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:06.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.903+0000 7ffaa0200700 1 --2- 172.21.15.142:0/241292783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa98103f80 0x7ffa98198d00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:06.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.903+0000 7ffaa0200700 1 -- 172.21.15.142:0/241292783 >> 172.21.15.142:0/241292783 conn(0x7ffa980fe3e0 msgr2=0x7ffa981075c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:06.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.903+0000 7ffaa0200700 1 -- 172.21.15.142:0/241292783 shutdown_connections 2024-04-20T21:54:06.903 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:06.903+0000 7ffaa0200700 1 -- 172.21.15.142:0/241292783 wait complete. 2024-04-20T21:54:07.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:07 smithi164 ceph-mon[23506]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:07.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:07 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/241292783' entity='client.admin' 2024-04-20T21:54:07.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:07 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:54:07.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:07 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:54:07.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:07 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:54:07.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:07 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:07.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:07 smithi142 ceph-mon[15828]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:07.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:07 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/241292783' entity='client.admin' 2024-04-20T21:54:07.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:07 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:54:07.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:07 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:54:07.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:07 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:54:07.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:07 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:07.810 INFO:teuthology.run_tasks:Running task print... 2024-04-20T21:54:07.819 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-04-20T21:54:07.819 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-20T21:54:07.866 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi142.front.sepia.ceph.com 2024-04-20T21:54:07.866 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-20T21:54:08.298 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:54:08.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:08 smithi142 ceph-mon[15828]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:08.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:08 smithi164 ceph-mon[23506]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:10.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.512+0000 7f7387c00700 1 -- 172.21.15.142:0/3121560278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73800738c0 msgr2=0x7f7380073d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:10.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.512+0000 7f7387c00700 1 --2- 172.21.15.142:0/3121560278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73800738c0 0x7f7380073d40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f736c009910 tx=0x7f736c009c20 comp rx=0 tx=0).stop 2024-04-20T21:54:10.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.512+0000 7f7387c00700 1 -- 172.21.15.142:0/3121560278 shutdown_connections 2024-04-20T21:54:10.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.512+0000 7f7387c00700 1 --2- 172.21.15.142:0/3121560278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73800738c0 0x7f7380073d40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:10.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.512+0000 7f7387c00700 1 --2- 172.21.15.142:0/3121560278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7380074e90 0x7f73800732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:10.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.512+0000 7f7387c00700 1 -- 172.21.15.142:0/3121560278 >> 172.21.15.142:0/3121560278 conn(0x7f73800fc1e0 msgr2=0x7f73800fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:10.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.512+0000 7f7387c00700 1 -- 172.21.15.142:0/3121560278 shutdown_connections 2024-04-20T21:54:10.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.512+0000 7f7387c00700 1 -- 172.21.15.142:0/3121560278 wait complete. 2024-04-20T21:54:10.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.513+0000 7f7387c00700 1 Processor -- start 2024-04-20T21:54:10.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.514+0000 7f7387c00700 1 -- start start 2024-04-20T21:54:10.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.514+0000 7f7387c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73800738c0 0x7f7380198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:10.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.514+0000 7f7387c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7380074e90 0x7f7380198cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:10.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.514+0000 7f7387c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73801992f0 con 0x7f73800738c0 2024-04-20T21:54:10.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.514+0000 7f7387c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7380199430 con 0x7f7380074e90 2024-04-20T21:54:10.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.514+0000 7f7385200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73800738c0 0x7f7380198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:10.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.514+0000 7f7385200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73800738c0 0x7f7380198790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42262/0 (socket says 172.21.15.142:42262) 2024-04-20T21:54:10.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.514+0000 7f7385200700 1 -- 172.21.15.142:0/66428074 learned_addr learned my addr 172.21.15.142:0/66428074 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:54:10.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.515+0000 7f737fe00700 1 --2- 172.21.15.142:0/66428074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7380074e90 0x7f7380198cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:10.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.515+0000 7f7385200700 1 -- 172.21.15.142:0/66428074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7380074e90 msgr2=0x7f7380198cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:10.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.515+0000 7f7385200700 1 --2- 172.21.15.142:0/66428074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7380074e90 0x7f7380198cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:10.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.515+0000 7f7385200700 1 -- 172.21.15.142:0/66428074 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c0095f0 con 0x7f73800738c0 2024-04-20T21:54:10.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.515+0000 7f7385200700 1 --2- 172.21.15.142:0/66428074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73800738c0 0x7f7380198790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f737400c8a0 tx=0x7f737400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:10.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.515+0000 7f737d600700 1 -- 172.21.15.142:0/66428074 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f737400cea0 con 0x7f73800738c0 2024-04-20T21:54:10.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.515+0000 7f737d600700 1 -- 172.21.15.142:0/66428074 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7374004830 con 0x7f73800738c0 2024-04-20T21:54:10.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.515+0000 7f7387c00700 1 -- 172.21.15.142:0/66428074 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738019de90 con 0x7f73800738c0 2024-04-20T21:54:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.515+0000 7f737d600700 1 -- 172.21.15.142:0/66428074 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73740055b0 con 0x7f73800738c0 2024-04-20T21:54:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.515+0000 7f7387c00700 1 -- 172.21.15.142:0/66428074 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738019e3d0 con 0x7f73800738c0 2024-04-20T21:54:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.517+0000 7f7387c00700 1 -- 172.21.15.142:0/66428074 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7380192990 con 0x7f73800738c0 2024-04-20T21:54:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.518+0000 7f737d600700 1 -- 172.21.15.142:0/66428074 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f73740049a0 con 0x7f73800738c0 2024-04-20T21:54:10.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.518+0000 7f737d600700 1 --2- 172.21.15.142:0/66428074 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f736806cce0 0x7f736806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:10.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.519+0000 7f737d600700 1 -- 172.21.15.142:0/66428074 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f737408bc50 con 0x7f73800738c0 2024-04-20T21:54:10.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.519+0000 7f737fe00700 1 --2- 172.21.15.142:0/66428074 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f736806cce0 0x7f736806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:10.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.520+0000 7f737fe00700 1 --2- 172.21.15.142:0/66428074 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f736806cce0 0x7f736806f1a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f736c00b5c0 tx=0x7f736c005160 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.523+0000 7f737d600700 1 -- 172.21.15.142:0/66428074 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f7374059d50 con 0x7f73800738c0 2024-04-20T21:54:10.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.763+0000 7f7387c00700 1 -- 172.21.15.142:0/66428074 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f738002ceb0 con 0x7f736806cce0 2024-04-20T21:54:10.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.765+0000 7f737d600700 1 -- 172.21.15.142:0/66428074 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f738002ceb0 con 0x7f736806cce0 2024-04-20T21:54:10.765 INFO:teuthology.orchestra.run.smithi142.stdout:Backend: cephadm 2024-04-20T21:54:10.765 INFO:teuthology.orchestra.run.smithi142.stdout:Available: Yes 2024-04-20T21:54:10.765 INFO:teuthology.orchestra.run.smithi142.stdout:Paused: No 2024-04-20T21:54:10.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.768+0000 7f7387c00700 1 -- 172.21.15.142:0/66428074 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f736806cce0 msgr2=0x7f736806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:10.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.768+0000 7f7387c00700 1 --2- 172.21.15.142:0/66428074 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f736806cce0 0x7f736806f1a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f736c00b5c0 tx=0x7f736c005160 comp rx=0 tx=0).stop 2024-04-20T21:54:10.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.768+0000 7f7387c00700 1 -- 172.21.15.142:0/66428074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73800738c0 msgr2=0x7f7380198790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:10.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.768+0000 7f7387c00700 1 --2- 172.21.15.142:0/66428074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73800738c0 0x7f7380198790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f737400c8a0 tx=0x7f737400cc60 comp rx=0 tx=0).stop 2024-04-20T21:54:10.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.768+0000 7f7387c00700 1 -- 172.21.15.142:0/66428074 shutdown_connections 2024-04-20T21:54:10.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.768+0000 7f7387c00700 1 --2- 172.21.15.142:0/66428074 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f736806cce0 0x7f736806f1a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:10.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.768+0000 7f7387c00700 1 --2- 172.21.15.142:0/66428074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73800738c0 0x7f7380198790 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:10.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.768+0000 7f7387c00700 1 --2- 172.21.15.142:0/66428074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7380074e90 0x7f7380198cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:10.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.768+0000 7f7387c00700 1 -- 172.21.15.142:0/66428074 >> 172.21.15.142:0/66428074 conn(0x7f73800fc1e0 msgr2=0x7f7380106da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:10.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.768+0000 7f7387c00700 1 -- 172.21.15.142:0/66428074 shutdown_connections 2024-04-20T21:54:10.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:10.768+0000 7f7387c00700 1 -- 172.21.15.142:0/66428074 wait complete. 2024-04-20T21:54:11.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:11 smithi164 ceph-mon[23506]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:11.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:11 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:54:11.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:11 smithi142 ceph-mon[15828]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:11.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:11 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:54:11.667 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-20T21:54:12.080 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:54:12.436 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:12 smithi142 ceph-mon[15828]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:54:12.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:12 smithi164 ceph-mon[23506]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:54:13.432 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:13 smithi142 ceph-mon[15828]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:13.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:13 smithi164 ceph-mon[23506]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:14.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.263+0000 7fa2e5c00700 1 -- 172.21.15.142:0/2476715351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2e0103fb0 msgr2=0x7fa2e0104430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:14.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.263+0000 7fa2e5c00700 1 --2- 172.21.15.142:0/2476715351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2e0103fb0 0x7fa2e0104430 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009910 tx=0x7fa2cc009c20 comp rx=0 tx=0).stop 2024-04-20T21:54:14.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.264+0000 7fa2e5c00700 1 -- 172.21.15.142:0/2476715351 shutdown_connections 2024-04-20T21:54:14.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.264+0000 7fa2e5c00700 1 --2- 172.21.15.142:0/2476715351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2e0103fb0 0x7fa2e0104430 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:14.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.264+0000 7fa2e5c00700 1 --2- 172.21.15.142:0/2476715351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2e0102e50 0x7fa2e0103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:14.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.264+0000 7fa2e5c00700 1 -- 172.21.15.142:0/2476715351 >> 172.21.15.142:0/2476715351 conn(0x7fa2e00fe3d0 msgr2=0x7fa2e0100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:14.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.264+0000 7fa2e5c00700 1 -- 172.21.15.142:0/2476715351 shutdown_connections 2024-04-20T21:54:14.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.264+0000 7fa2e5c00700 1 -- 172.21.15.142:0/2476715351 wait complete. 2024-04-20T21:54:14.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.266+0000 7fa2e5c00700 1 Processor -- start 2024-04-20T21:54:14.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.266+0000 7fa2e5c00700 1 -- start start 2024-04-20T21:54:14.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.266+0000 7fa2e5c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2e0102e50 0x7fa2e01987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:14.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.266+0000 7fa2e5c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2e0103fb0 0x7fa2e0198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:14.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.266+0000 7fa2e5c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e0199340 con 0x7fa2e0102e50 2024-04-20T21:54:14.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.266+0000 7fa2e5c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e0199480 con 0x7fa2e0103fb0 2024-04-20T21:54:14.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.266+0000 7fa2dea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2e0102e50 0x7fa2e01987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:14.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.267+0000 7fa2dea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2e0102e50 0x7fa2e01987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42292/0 (socket says 172.21.15.142:42292) 2024-04-20T21:54:14.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.267+0000 7fa2dea00700 1 -- 172.21.15.142:0/3244684249 learned_addr learned my addr 172.21.15.142:0/3244684249 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:54:14.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.267+0000 7fa2de000700 1 --2- 172.21.15.142:0/3244684249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2e0103fb0 0x7fa2e0198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:14.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.267+0000 7fa2dea00700 1 -- 172.21.15.142:0/3244684249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2e0103fb0 msgr2=0x7fa2e0198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:14.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.267+0000 7fa2dea00700 1 --2- 172.21.15.142:0/3244684249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2e0103fb0 0x7fa2e0198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:14.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.267+0000 7fa2dea00700 1 -- 172.21.15.142:0/3244684249 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc0095f0 con 0x7fa2e0102e50 2024-04-20T21:54:14.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.267+0000 7fa2dea00700 1 --2- 172.21.15.142:0/3244684249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2e0102e50 0x7fa2e01987e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000d8d0 tx=0x7fa2d000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:14.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.267+0000 7fa2d7400700 1 -- 172.21.15.142:0/3244684249 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2d0009940 con 0x7fa2e0102e50 2024-04-20T21:54:14.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.268+0000 7fa2d7400700 1 -- 172.21.15.142:0/3244684249 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa2d0010460 con 0x7fa2e0102e50 2024-04-20T21:54:14.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.268+0000 7fa2d7400700 1 -- 172.21.15.142:0/3244684249 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2d000f5f0 con 0x7fa2e0102e50 2024-04-20T21:54:14.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.268+0000 7fa2e5c00700 1 -- 172.21.15.142:0/3244684249 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e019dee0 con 0x7fa2e0102e50 2024-04-20T21:54:14.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.268+0000 7fa2e5c00700 1 -- 172.21.15.142:0/3244684249 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e019e420 con 0x7fa2e0102e50 2024-04-20T21:54:14.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.269+0000 7fa2e5c00700 1 -- 172.21.15.142:0/3244684249 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e0192950 con 0x7fa2e0102e50 2024-04-20T21:54:14.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.270+0000 7fa2d7400700 1 -- 172.21.15.142:0/3244684249 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa2d00105d0 con 0x7fa2e0102e50 2024-04-20T21:54:14.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.271+0000 7fa2d7400700 1 --2- 172.21.15.142:0/3244684249 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa2c406ccf0 0x7fa2c406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:14.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.271+0000 7fa2d7400700 1 -- 172.21.15.142:0/3244684249 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa2d008beb0 con 0x7fa2e0102e50 2024-04-20T21:54:14.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.271+0000 7fa2de000700 1 --2- 172.21.15.142:0/3244684249 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa2c406ccf0 0x7fa2c406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:14.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.272+0000 7fa2de000700 1 --2- 172.21.15.142:0/3244684249 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa2c406ccf0 0x7fa2c406f1b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00b5c0 tx=0x7fa2cc005160 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:14.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.278+0000 7fa2d7400700 1 -- 172.21.15.142:0/3244684249 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fa2d005a030 con 0x7fa2e0102e50 2024-04-20T21:54:14.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.507+0000 7fa2e5c00700 1 -- 172.21.15.142:0/3244684249 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2e002ce80 con 0x7fa2c406ccf0 2024-04-20T21:54:14.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.518+0000 7fa2d7400700 1 -- 172.21.15.142:0/3244684249 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3100 (secure 0 0 0) 0x7fa2e002ce80 con 0x7fa2c406ccf0 2024-04-20T21:54:14.518 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T21:54:14.518 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (4m) 2m ago 6m 13.7M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T21:54:14.518 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (7m) 2m ago 7m 7096k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T21:54:14.518 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (5m) 79s ago 5m 7008k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T21:54:14.518 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (7m) 2m ago 7m 6665k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 56f2e41784f8 2024-04-20T21:54:14.518 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (5m) 79s ago 5m 6660k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 bce67525dd3e 2024-04-20T21:54:14.519 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (4m) 2m ago 6m 74.3M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T21:54:14.519 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:9283,8765,8443 running (8m) 2m ago 8m 492M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d2c979afd250 2024-04-20T21:54:14.519 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (5m) 79s ago 5m 448M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 2e2b1f8dfca1 2024-04-20T21:54:14.519 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (8m) 2m ago 8m 44.2M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c076f7eb00ea 2024-04-20T21:54:14.519 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (5m) 79s ago 5m 39.9M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 2bacdeb02ee0 2024-04-20T21:54:14.519 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (6m) 2m ago 6m 7772k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T21:54:14.519 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (5m) 79s ago 5m 7658k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T21:54:14.519 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (4m) 2m ago 4m 39.6M 3947M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4361ae428e0d 2024-04-20T21:54:14.519 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (3m) 2m ago 3m 41.2M 3947M 18.2.2-1237-g646b8c7d 9900ed1a6b81 dd7e7cf8e8e1 2024-04-20T21:54:14.519 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (3m) 2m ago 3m 46.7M 3947M 18.2.2-1237-g646b8c7d 9900ed1a6b81 8e9165365127 2024-04-20T21:54:14.519 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (2m) 79s ago 2m 46.3M 4971M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c081911f56ab 2024-04-20T21:54:14.519 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (2m) 79s ago 2m 44.6M 4971M 18.2.2-1237-g646b8c7d 9900ed1a6b81 39e09d63d44f 2024-04-20T21:54:14.519 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (85s) 79s ago 85s 11.3M 4971M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4f36124aeb0d 2024-04-20T21:54:14.519 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (4m) 2m ago 6m 39.8M - 2.43.0 a07b618ecd1d a1f0ad25692f 2024-04-20T21:54:14.520 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.521+0000 7fa2e5c00700 1 -- 172.21.15.142:0/3244684249 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa2c406ccf0 msgr2=0x7fa2c406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:14.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.521+0000 7fa2e5c00700 1 --2- 172.21.15.142:0/3244684249 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa2c406ccf0 0x7fa2c406f1b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00b5c0 tx=0x7fa2cc005160 comp rx=0 tx=0).stop 2024-04-20T21:54:14.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.521+0000 7fa2e5c00700 1 -- 172.21.15.142:0/3244684249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2e0102e50 msgr2=0x7fa2e01987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:14.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.521+0000 7fa2e5c00700 1 --2- 172.21.15.142:0/3244684249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2e0102e50 0x7fa2e01987e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000d8d0 tx=0x7fa2d000dc90 comp rx=0 tx=0).stop 2024-04-20T21:54:14.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.521+0000 7fa2e5c00700 1 -- 172.21.15.142:0/3244684249 shutdown_connections 2024-04-20T21:54:14.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.521+0000 7fa2e5c00700 1 --2- 172.21.15.142:0/3244684249 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa2c406ccf0 0x7fa2c406f1b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:14.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.521+0000 7fa2e5c00700 1 --2- 172.21.15.142:0/3244684249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2e0102e50 0x7fa2e01987e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:14.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.521+0000 7fa2e5c00700 1 --2- 172.21.15.142:0/3244684249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2e0103fb0 0x7fa2e0198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:14.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.521+0000 7fa2e5c00700 1 -- 172.21.15.142:0/3244684249 >> 172.21.15.142:0/3244684249 conn(0x7fa2e00fe3d0 msgr2=0x7fa2e0107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:14.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.521+0000 7fa2e5c00700 1 -- 172.21.15.142:0/3244684249 shutdown_connections 2024-04-20T21:54:14.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:14.521+0000 7fa2e5c00700 1 -- 172.21.15.142:0/3244684249 wait complete. 2024-04-20T21:54:15.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:15 smithi142 ceph-mon[15828]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:15.369 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-20T21:54:15.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:15 smithi164 ceph-mon[23506]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:15.770 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:54:16.173 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:16 smithi142 ceph-mon[15828]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:54:16.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:16 smithi164 ceph-mon[23506]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:54:17.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:17 smithi142 ceph-mon[15828]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:17.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:17 smithi164 ceph-mon[23506]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:17.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.911+0000 7fb70ec00700 1 -- 172.21.15.142:0/1702862155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb708101720 msgr2=0x7fb708103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:17.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.911+0000 7fb70ec00700 1 --2- 172.21.15.142:0/1702862155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb708101720 0x7fb708103b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800b0a0 tx=0x7fb6f800b3b0 comp rx=0 tx=0).stop 2024-04-20T21:54:17.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.911+0000 7fb70ec00700 1 -- 172.21.15.142:0/1702862155 shutdown_connections 2024-04-20T21:54:17.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.911+0000 7fb70ec00700 1 --2- 172.21.15.142:0/1702862155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb708104050 0x7fb708106440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:17.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.911+0000 7fb70ec00700 1 --2- 172.21.15.142:0/1702862155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb708101720 0x7fb708103b10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:17.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.911+0000 7fb70ec00700 1 -- 172.21.15.142:0/1702862155 >> 172.21.15.142:0/1702862155 conn(0x7fb7080fb0d0 msgr2=0x7fb7080fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:17.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.911+0000 7fb70ec00700 1 -- 172.21.15.142:0/1702862155 shutdown_connections 2024-04-20T21:54:17.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.911+0000 7fb70ec00700 1 -- 172.21.15.142:0/1702862155 wait complete. 2024-04-20T21:54:17.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.912+0000 7fb70ec00700 1 Processor -- start 2024-04-20T21:54:17.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.913+0000 7fb70ec00700 1 -- start start 2024-04-20T21:54:17.913 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.913+0000 7fb70ec00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb708101720 0x7fb708101030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:17.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.913+0000 7fb70ec00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb708104050 0x7fb7080ff6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:17.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.913+0000 7fb70ec00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7081015c0 con 0x7fb708104050 2024-04-20T21:54:17.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.913+0000 7fb70ec00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080ffc10 con 0x7fb708101720 2024-04-20T21:54:17.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.913+0000 7fb6ff400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb708104050 0x7fb7080ff6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:17.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.913+0000 7fb6ff400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb708104050 0x7fb7080ff6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54434/0 (socket says 172.21.15.142:54434) 2024-04-20T21:54:17.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.913+0000 7fb6ff400700 1 -- 172.21.15.142:0/2133023272 learned_addr learned my addr 172.21.15.142:0/2133023272 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:54:17.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.913+0000 7fb707e00700 1 --2- 172.21.15.142:0/2133023272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb708101720 0x7fb708101030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:17.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.914+0000 7fb6ff400700 1 -- 172.21.15.142:0/2133023272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb708101720 msgr2=0x7fb708101030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:17.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.914+0000 7fb6ff400700 1 --2- 172.21.15.142:0/2133023272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb708101720 0x7fb708101030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:17.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.914+0000 7fb6ff400700 1 -- 172.21.15.142:0/2133023272 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f8009d00 con 0x7fb708104050 2024-04-20T21:54:17.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.914+0000 7fb6ff400700 1 --2- 172.21.15.142:0/2133023272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb708104050 0x7fb7080ff6d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000c930 tx=0x7fb6f000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:17.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.914+0000 7fb705600700 1 -- 172.21.15.142:0/2133023272 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6f0007ad0 con 0x7fb708104050 2024-04-20T21:54:17.914 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.914+0000 7fb705600700 1 -- 172.21.15.142:0/2133023272 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb6f0007c30 con 0x7fb708104050 2024-04-20T21:54:17.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.914+0000 7fb70ec00700 1 -- 172.21.15.142:0/2133023272 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7080ffef0 con 0x7fb708104050 2024-04-20T21:54:17.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.914+0000 7fb705600700 1 -- 172.21.15.142:0/2133023272 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6f0018610 con 0x7fb708104050 2024-04-20T21:54:17.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.915+0000 7fb70ec00700 1 -- 172.21.15.142:0/2133023272 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7081004c0 con 0x7fb708104050 2024-04-20T21:54:17.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.916+0000 7fb70ec00700 1 -- 172.21.15.142:0/2133023272 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb708062510 con 0x7fb708104050 2024-04-20T21:54:17.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.917+0000 7fb705600700 1 -- 172.21.15.142:0/2133023272 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb6f000f450 con 0x7fb708104050 2024-04-20T21:54:17.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.917+0000 7fb705600700 1 --2- 172.21.15.142:0/2133023272 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb6ec06cce0 0x7fb6ec06f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:17.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.918+0000 7fb705600700 1 -- 172.21.15.142:0/2133023272 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb6f008c0d0 con 0x7fb708104050 2024-04-20T21:54:17.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.918+0000 7fb707e00700 1 --2- 172.21.15.142:0/2133023272 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb6ec06cce0 0x7fb6ec06f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:17.917 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.918+0000 7fb707e00700 1 --2- 172.21.15.142:0/2133023272 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb6ec06cce0 0x7fb6ec06f1a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8000f80 tx=0x7fb6f800b7b0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:17.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:17.923+0000 7fb705600700 1 -- 172.21.15.142:0/2133023272 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fb6f005a250 con 0x7fb708104050 2024-04-20T21:54:18.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:18.151+0000 7fb70ec00700 1 -- 172.21.15.142:0/2133023272 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb708105f70 con 0x7fb6ec06cce0 2024-04-20T21:54:18.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:18.169+0000 7fb705600700 1 -- 172.21.15.142:0/2133023272 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1310 (secure 0 0 0) 0x7fb708105f70 con 0x7fb6ec06cce0 2024-04-20T21:54:18.168 INFO:teuthology.orchestra.run.smithi142.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-20T21:54:18.168 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager ?:9093,9094 1/1 2m ago 7m count:1 2024-04-20T21:54:18.169 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter 2/2 2m ago 7m * 2024-04-20T21:54:18.169 INFO:teuthology.orchestra.run.smithi142.stdout:crash 2/2 2m ago 7m * 2024-04-20T21:54:18.169 INFO:teuthology.orchestra.run.smithi142.stdout:grafana ?:3000 1/1 2m ago 7m count:1 2024-04-20T21:54:18.169 INFO:teuthology.orchestra.run.smithi142.stdout:mgr 2/2 2m ago 7m count:2 2024-04-20T21:54:18.169 INFO:teuthology.orchestra.run.smithi142.stdout:mon 2/2 2m ago 6m smithi142:172.21.15.142=smithi142;smithi164:172.21.15.164=smithi164;count:2 2024-04-20T21:54:18.169 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter ?:9100 2/2 2m ago 7m * 2024-04-20T21:54:18.169 INFO:teuthology.orchestra.run.smithi142.stdout:osd 6 2m ago - 2024-04-20T21:54:18.169 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus ?:9095 1/1 2m ago 7m count:1 2024-04-20T21:54:18.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:18.172+0000 7fb70ec00700 1 -- 172.21.15.142:0/2133023272 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb6ec06cce0 msgr2=0x7fb6ec06f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:18.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:18.172+0000 7fb70ec00700 1 --2- 172.21.15.142:0/2133023272 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb6ec06cce0 0x7fb6ec06f1a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8000f80 tx=0x7fb6f800b7b0 comp rx=0 tx=0).stop 2024-04-20T21:54:18.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:18.172+0000 7fb70ec00700 1 -- 172.21.15.142:0/2133023272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb708104050 msgr2=0x7fb7080ff6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:18.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:18.172+0000 7fb70ec00700 1 --2- 172.21.15.142:0/2133023272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb708104050 0x7fb7080ff6d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000c930 tx=0x7fb6f000ccf0 comp rx=0 tx=0).stop 2024-04-20T21:54:18.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:18.172+0000 7fb70ec00700 1 -- 172.21.15.142:0/2133023272 shutdown_connections 2024-04-20T21:54:18.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:18.172+0000 7fb70ec00700 1 --2- 172.21.15.142:0/2133023272 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb6ec06cce0 0x7fb6ec06f1a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:18.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:18.172+0000 7fb70ec00700 1 --2- 172.21.15.142:0/2133023272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb708101720 0x7fb708101030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:18.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:18.172+0000 7fb70ec00700 1 --2- 172.21.15.142:0/2133023272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb708104050 0x7fb7080ff6d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:18.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:18.172+0000 7fb70ec00700 1 -- 172.21.15.142:0/2133023272 >> 172.21.15.142:0/2133023272 conn(0x7fb7080fb0d0 msgr2=0x7fb7080fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:18.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:18.172+0000 7fb70ec00700 1 -- 172.21.15.142:0/2133023272 shutdown_connections 2024-04-20T21:54:18.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:18.172+0000 7fb70ec00700 1 -- 172.21.15.142:0/2133023272 wait complete. 2024-04-20T21:54:18.977 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-20T21:54:19.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:19 smithi142 ceph-mon[15828]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:19.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:19 smithi142 ceph-mon[15828]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:54:19.398 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:54:19.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:19 smithi164 ceph-mon[23506]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:19.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:19 smithi164 ceph-mon[23506]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:54:21.141 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:21 smithi142 ceph-mon[15828]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:21.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.406+0000 7f33d7000700 1 -- 172.21.15.142:0/1476981762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33d0107260 msgr2=0x7f33d0107680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:21.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.406+0000 7f33d7000700 1 --2- 172.21.15.142:0/1476981762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33d0107260 0x7f33d0107680 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f33c0009910 tx=0x7f33c0009c20 comp rx=0 tx=0).stop 2024-04-20T21:54:21.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.407+0000 7f33d7000700 1 -- 172.21.15.142:0/1476981762 shutdown_connections 2024-04-20T21:54:21.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.407+0000 7f33d7000700 1 --2- 172.21.15.142:0/1476981762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d0108430 0x7f33d01088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:21.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.407+0000 7f33d7000700 1 --2- 172.21.15.142:0/1476981762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33d0107260 0x7f33d0107680 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:21.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.407+0000 7f33d7000700 1 -- 172.21.15.142:0/1476981762 >> 172.21.15.142:0/1476981762 conn(0x7f33d0076400 msgr2=0x7f33d0078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:21.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.407+0000 7f33d7000700 1 -- 172.21.15.142:0/1476981762 shutdown_connections 2024-04-20T21:54:21.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.407+0000 7f33d7000700 1 -- 172.21.15.142:0/1476981762 wait complete. 2024-04-20T21:54:21.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.408+0000 7f33d7000700 1 Processor -- start 2024-04-20T21:54:21.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.408+0000 7f33d7000700 1 -- start start 2024-04-20T21:54:21.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.408+0000 7f33d7000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d0107260 0x7f33d019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:21.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.408+0000 7f33d7000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33d0108430 0x7f33d019d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:21.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.408+0000 7f33d7000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d019d770 con 0x7f33d0108430 2024-04-20T21:54:21.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.408+0000 7f33d7000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d019d8b0 con 0x7f33d0107260 2024-04-20T21:54:21.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.409+0000 7f33c7e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33d0108430 0x7f33d019d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:21.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.409+0000 7f33c7e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33d0108430 0x7f33d019d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54454/0 (socket says 172.21.15.142:54454) 2024-04-20T21:54:21.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.409+0000 7f33c7e00700 1 -- 172.21.15.142:0/1901343199 learned_addr learned my addr 172.21.15.142:0/1901343199 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:54:21.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.409+0000 7f33cfe00700 1 --2- 172.21.15.142:0/1901343199 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d0107260 0x7f33d019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:21.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.409+0000 7f33c7e00700 1 -- 172.21.15.142:0/1901343199 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d0107260 msgr2=0x7f33d019cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:21.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.409+0000 7f33c7e00700 1 --2- 172.21.15.142:0/1901343199 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d0107260 0x7f33d019cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:21.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.409+0000 7f33c7e00700 1 -- 172.21.15.142:0/1901343199 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c00095f0 con 0x7f33d0108430 2024-04-20T21:54:21.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.409+0000 7f33cfe00700 1 --2- 172.21.15.142:0/1901343199 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d0107260 0x7f33d019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:54:21.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.409+0000 7f33c7e00700 1 --2- 172.21.15.142:0/1901343199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33d0108430 0x7f33d019d150 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f33b800d8d0 tx=0x7f33b800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:21.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.410+0000 7f33cd600700 1 -- 172.21.15.142:0/1901343199 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33b8009940 con 0x7f33d0108430 2024-04-20T21:54:21.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.410+0000 7f33cd600700 1 -- 172.21.15.142:0/1901343199 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f33b8010460 con 0x7f33d0108430 2024-04-20T21:54:21.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.410+0000 7f33cd600700 1 -- 172.21.15.142:0/1901343199 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33b800f5f0 con 0x7f33d0108430 2024-04-20T21:54:21.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.410+0000 7f33d7000700 1 -- 172.21.15.142:0/1901343199 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d01a2310 con 0x7f33d0108430 2024-04-20T21:54:21.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.410+0000 7f33d7000700 1 -- 172.21.15.142:0/1901343199 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d01a28e0 con 0x7f33d0108430 2024-04-20T21:54:21.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.411+0000 7f33d7000700 1 -- 172.21.15.142:0/1901343199 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d0196dd0 con 0x7f33d0108430 2024-04-20T21:54:21.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.412+0000 7f33cd600700 1 -- 172.21.15.142:0/1901343199 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f33b80105d0 con 0x7f33d0108430 2024-04-20T21:54:21.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.414+0000 7f33cd600700 1 --2- 172.21.15.142:0/1901343199 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f33b406ccf0 0x7f33b406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:21.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.414+0000 7f33cd600700 1 -- 172.21.15.142:0/1901343199 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f33b808be50 con 0x7f33d0108430 2024-04-20T21:54:21.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.414+0000 7f33cfe00700 1 --2- 172.21.15.142:0/1901343199 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f33b406ccf0 0x7f33b406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:21.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.414+0000 7f33cfe00700 1 --2- 172.21.15.142:0/1901343199 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f33b406ccf0 0x7f33b406f1b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f33c0006010 tx=0x7f33c000b560 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:21.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.419+0000 7f33cd600700 1 -- 172.21.15.142:0/1901343199 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f33b805a070 con 0x7f33d0108430 2024-04-20T21:54:21.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:21 smithi164 ceph-mon[23506]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:21.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.647+0000 7f33d7000700 1 -- 172.21.15.142:0/1901343199 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f33d002ce30 con 0x7f33b406ccf0 2024-04-20T21:54:21.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.649+0000 7f33cd600700 1 -- 172.21.15.142:0/1901343199 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f33d002ce30 con 0x7f33b406ccf0 2024-04-20T21:54:21.648 INFO:teuthology.orchestra.run.smithi142.stdout:HOST ADDR LABELS STATUS 2024-04-20T21:54:21.648 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142 172.21.15.142 2024-04-20T21:54:21.648 INFO:teuthology.orchestra.run.smithi142.stdout:smithi164 172.21.15.164 2024-04-20T21:54:21.649 INFO:teuthology.orchestra.run.smithi142.stdout:2 hosts in cluster 2024-04-20T21:54:21.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.652+0000 7f33d7000700 1 -- 172.21.15.142:0/1901343199 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f33b406ccf0 msgr2=0x7f33b406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:21.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.652+0000 7f33d7000700 1 --2- 172.21.15.142:0/1901343199 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f33b406ccf0 0x7f33b406f1b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f33c0006010 tx=0x7f33c000b560 comp rx=0 tx=0).stop 2024-04-20T21:54:21.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.652+0000 7f33d7000700 1 -- 172.21.15.142:0/1901343199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33d0108430 msgr2=0x7f33d019d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:21.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.652+0000 7f33d7000700 1 --2- 172.21.15.142:0/1901343199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33d0108430 0x7f33d019d150 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f33b800d8d0 tx=0x7f33b800dc90 comp rx=0 tx=0).stop 2024-04-20T21:54:21.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.652+0000 7f33d7000700 1 -- 172.21.15.142:0/1901343199 shutdown_connections 2024-04-20T21:54:21.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.652+0000 7f33d7000700 1 --2- 172.21.15.142:0/1901343199 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f33b406ccf0 0x7f33b406f1b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:21.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.652+0000 7f33d7000700 1 --2- 172.21.15.142:0/1901343199 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d0107260 0x7f33d019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:21.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.652+0000 7f33d7000700 1 --2- 172.21.15.142:0/1901343199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33d0108430 0x7f33d019d150 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:21.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.652+0000 7f33d7000700 1 -- 172.21.15.142:0/1901343199 >> 172.21.15.142:0/1901343199 conn(0x7f33d0076400 msgr2=0x7f33d010ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:21.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.652+0000 7f33d7000700 1 -- 172.21.15.142:0/1901343199 shutdown_connections 2024-04-20T21:54:21.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:21.652+0000 7f33d7000700 1 -- 172.21.15.142:0/1901343199 wait complete. 2024-04-20T21:54:22.346 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-20T21:54:22.751 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:54:23.159 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:23 smithi142 ceph-mon[15828]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:54:23.159 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:23 smithi142 ceph-mon[15828]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:23.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:23 smithi164 ceph-mon[23506]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:54:23.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:23 smithi164 ceph-mon[23506]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:24.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.718+0000 7f6547200700 1 -- 172.21.15.142:0/517020306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6540108290 msgr2=0x7f65401086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:24.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.718+0000 7f6547200700 1 --2- 172.21.15.142:0/517020306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6540108290 0x7f65401086f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6530009910 tx=0x7f6530009c20 comp rx=0 tx=0).stop 2024-04-20T21:54:24.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.718+0000 7f6547200700 1 -- 172.21.15.142:0/517020306 shutdown_connections 2024-04-20T21:54:24.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.718+0000 7f6547200700 1 --2- 172.21.15.142:0/517020306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6540108290 0x7f65401086f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:24.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.718+0000 7f6547200700 1 --2- 172.21.15.142:0/517020306 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65401070f0 0x7f6540107510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:24.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.718+0000 7f6547200700 1 -- 172.21.15.142:0/517020306 >> 172.21.15.142:0/517020306 conn(0x7f65400761d0 msgr2=0x7f6540078610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:24.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.718+0000 7f6547200700 1 -- 172.21.15.142:0/517020306 shutdown_connections 2024-04-20T21:54:24.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.718+0000 7f6547200700 1 -- 172.21.15.142:0/517020306 wait complete. 2024-04-20T21:54:24.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.719+0000 7f6547200700 1 Processor -- start 2024-04-20T21:54:24.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.719+0000 7f6547200700 1 -- start start 2024-04-20T21:54:24.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.719+0000 7f6547200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65401070f0 0x7f654019ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:24.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.719+0000 7f6547200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6540108290 0x7f654019cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:24.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.719+0000 7f6547200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654019d5d0 con 0x7f65401070f0 2024-04-20T21:54:24.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.719+0000 7f6547200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654019d710 con 0x7f6540108290 2024-04-20T21:54:24.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.720+0000 7f6545e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65401070f0 0x7f654019ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:24.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.720+0000 7f6545e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65401070f0 0x7f654019ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54472/0 (socket says 172.21.15.142:54472) 2024-04-20T21:54:24.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.720+0000 7f6545e00700 1 -- 172.21.15.142:0/682964581 learned_addr learned my addr 172.21.15.142:0/682964581 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:54:24.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.720+0000 7f6545400700 1 --2- 172.21.15.142:0/682964581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6540108290 0x7f654019cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:24.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.720+0000 7f6545e00700 1 -- 172.21.15.142:0/682964581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6540108290 msgr2=0x7f654019cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:24.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.720+0000 7f6545e00700 1 --2- 172.21.15.142:0/682964581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6540108290 0x7f654019cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:24.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.720+0000 7f6545e00700 1 -- 172.21.15.142:0/682964581 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65300095f0 con 0x7f65401070f0 2024-04-20T21:54:24.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.720+0000 7f6545400700 1 --2- 172.21.15.142:0/682964581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6540108290 0x7f654019cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:54:24.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.720+0000 7f6545e00700 1 --2- 172.21.15.142:0/682964581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65401070f0 0x7f654019ca70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f653400d900 tx=0x7f653400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:24.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.721+0000 7f653aa00700 1 -- 172.21.15.142:0/682964581 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65340041f0 con 0x7f65401070f0 2024-04-20T21:54:24.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.721+0000 7f653aa00700 1 -- 172.21.15.142:0/682964581 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6534004350 con 0x7f65401070f0 2024-04-20T21:54:24.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.721+0000 7f6547200700 1 -- 172.21.15.142:0/682964581 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65401a2170 con 0x7f65401070f0 2024-04-20T21:54:24.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.721+0000 7f653aa00700 1 -- 172.21.15.142:0/682964581 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6534003dc0 con 0x7f65401070f0 2024-04-20T21:54:24.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.721+0000 7f6547200700 1 -- 172.21.15.142:0/682964581 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65401a2740 con 0x7f65401070f0 2024-04-20T21:54:24.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.722+0000 7f6547200700 1 -- 172.21.15.142:0/682964581 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6540196c10 con 0x7f65401070f0 2024-04-20T21:54:24.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.723+0000 7f653aa00700 1 -- 172.21.15.142:0/682964581 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f6534009730 con 0x7f65401070f0 2024-04-20T21:54:24.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.724+0000 7f653aa00700 1 --2- 172.21.15.142:0/682964581 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f652806cce0 0x7f652806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:24.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.724+0000 7f653aa00700 1 -- 172.21.15.142:0/682964581 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f653408c190 con 0x7f65401070f0 2024-04-20T21:54:24.723 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.724+0000 7f6545400700 1 --2- 172.21.15.142:0/682964581 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f652806cce0 0x7f652806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:24.724 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.725+0000 7f6545400700 1 --2- 172.21.15.142:0/682964581 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f652806cce0 0x7f652806f1a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f65300059d0 tx=0x7f6530005960 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:24.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.729+0000 7f653aa00700 1 -- 172.21.15.142:0/682964581 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f653405a290 con 0x7f65401070f0 2024-04-20T21:54:24.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.959+0000 7f6547200700 1 -- 172.21.15.142:0/682964581 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f654002cec0 con 0x7f652806cce0 2024-04-20T21:54:24.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.961+0000 7f653aa00700 1 -- 172.21.15.142:0/682964581 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f654002cec0 con 0x7f652806cce0 2024-04-20T21:54:24.960 INFO:teuthology.orchestra.run.smithi142.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-20T21:54:24.961 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6303009Y400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-20T21:54:24.961 INFO:teuthology.orchestra.run.smithi142.stdout:smithi164 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300H0400BGN 372G No 84s ago Has a FileSystem, LVM detected 2024-04-20T21:54:24.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.964+0000 7f6547200700 1 -- 172.21.15.142:0/682964581 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f652806cce0 msgr2=0x7f652806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:24.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.964+0000 7f6547200700 1 --2- 172.21.15.142:0/682964581 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f652806cce0 0x7f652806f1a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f65300059d0 tx=0x7f6530005960 comp rx=0 tx=0).stop 2024-04-20T21:54:24.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.964+0000 7f6547200700 1 -- 172.21.15.142:0/682964581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65401070f0 msgr2=0x7f654019ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:24.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.964+0000 7f6547200700 1 --2- 172.21.15.142:0/682964581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65401070f0 0x7f654019ca70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f653400d900 tx=0x7f653400dcc0 comp rx=0 tx=0).stop 2024-04-20T21:54:24.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.964+0000 7f6547200700 1 -- 172.21.15.142:0/682964581 shutdown_connections 2024-04-20T21:54:24.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.964+0000 7f6547200700 1 --2- 172.21.15.142:0/682964581 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f652806cce0 0x7f652806f1a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:24.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.964+0000 7f6547200700 1 --2- 172.21.15.142:0/682964581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65401070f0 0x7f654019ca70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:24.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.964+0000 7f6547200700 1 --2- 172.21.15.142:0/682964581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6540108290 0x7f654019cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:24.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.964+0000 7f6547200700 1 -- 172.21.15.142:0/682964581 >> 172.21.15.142:0/682964581 conn(0x7f65400761d0 msgr2=0x7f654010b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:24.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.965+0000 7f6547200700 1 -- 172.21.15.142:0/682964581 shutdown_connections 2024-04-20T21:54:24.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:24.965+0000 7f6547200700 1 -- 172.21.15.142:0/682964581 wait complete. 2024-04-20T21:54:25.330 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:25 smithi142 ceph-mon[15828]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:25.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:25 smithi164 ceph-mon[23506]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:25.789 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-20T21:54:25.800 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi142.front.sepia.ceph.com 2024-04-20T21:54:25.800 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-04-20T21:54:26.205 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:54:26.391 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:26 smithi142 ceph-mon[15828]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:54:26.391 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:26 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:54:26.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:26 smithi164 ceph-mon[23506]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:54:26.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:26 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:54:27.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:27 smithi164 ceph-mon[23506]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:27.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:27 smithi142 ceph-mon[15828]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:28.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.542+0000 7ffbece00700 1 -- 172.21.15.142:0/3777637649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbe80738e0 msgr2=0x7ffbe8073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:28.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.542+0000 7ffbece00700 1 --2- 172.21.15.142:0/3777637649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbe80738e0 0x7ffbe8073d60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009910 tx=0x7ffbd4009c20 comp rx=0 tx=0).stop 2024-04-20T21:54:28.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.542+0000 7ffbece00700 1 -- 172.21.15.142:0/3777637649 shutdown_connections 2024-04-20T21:54:28.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.542+0000 7ffbece00700 1 --2- 172.21.15.142:0/3777637649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbe80738e0 0x7ffbe8073d60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:28.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.542+0000 7ffbece00700 1 --2- 172.21.15.142:0/3777637649 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffbe8074eb0 0x7ffbe8073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:28.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.542+0000 7ffbece00700 1 -- 172.21.15.142:0/3777637649 >> 172.21.15.142:0/3777637649 conn(0x7ffbe80fc1e0 msgr2=0x7ffbe80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:28.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.542+0000 7ffbece00700 1 -- 172.21.15.142:0/3777637649 shutdown_connections 2024-04-20T21:54:28.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.542+0000 7ffbece00700 1 -- 172.21.15.142:0/3777637649 wait complete. 2024-04-20T21:54:28.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.543+0000 7ffbece00700 1 Processor -- start 2024-04-20T21:54:28.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.543+0000 7ffbece00700 1 -- start start 2024-04-20T21:54:28.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.544+0000 7ffbece00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbe80738e0 0x7ffbe81988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:28.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.544+0000 7ffbece00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffbe8074eb0 0x7ffbe8198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:28.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.544+0000 7ffbece00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe8199440 con 0x7ffbe80738e0 2024-04-20T21:54:28.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.544+0000 7ffbece00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe8199580 con 0x7ffbe8074eb0 2024-04-20T21:54:28.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.544+0000 7ffbe5e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbe80738e0 0x7ffbe81988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:28.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.544+0000 7ffbe5e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbe80738e0 0x7ffbe81988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34618/0 (socket says 172.21.15.142:34618) 2024-04-20T21:54:28.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.544+0000 7ffbe5e00700 1 -- 172.21.15.142:0/3954524515 learned_addr learned my addr 172.21.15.142:0/3954524515 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:54:28.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.544+0000 7ffbe5400700 1 --2- 172.21.15.142:0/3954524515 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffbe8074eb0 0x7ffbe8198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:28.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.545+0000 7ffbe5e00700 1 -- 172.21.15.142:0/3954524515 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffbe8074eb0 msgr2=0x7ffbe8198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:28.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.545+0000 7ffbe5e00700 1 --2- 172.21.15.142:0/3954524515 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffbe8074eb0 0x7ffbe8198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:28.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.545+0000 7ffbe5e00700 1 -- 172.21.15.142:0/3954524515 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd40095f0 con 0x7ffbe80738e0 2024-04-20T21:54:28.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.545+0000 7ffbe5400700 1 --2- 172.21.15.142:0/3954524515 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffbe8074eb0 0x7ffbe8198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:54:28.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.545+0000 7ffbe5e00700 1 --2- 172.21.15.142:0/3954524515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbe80738e0 0x7ffbe81988e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800b4b0 tx=0x7ffbd800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:28.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.545+0000 7ffbdea00700 1 -- 172.21.15.142:0/3954524515 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbd8011800 con 0x7ffbe80738e0 2024-04-20T21:54:28.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.545+0000 7ffbdea00700 1 -- 172.21.15.142:0/3954524515 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffbd8011e20 con 0x7ffbe80738e0 2024-04-20T21:54:28.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.545+0000 7ffbdea00700 1 -- 172.21.15.142:0/3954524515 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbd800f2e0 con 0x7ffbe80738e0 2024-04-20T21:54:28.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.545+0000 7ffbece00700 1 -- 172.21.15.142:0/3954524515 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe819df90 con 0x7ffbe80738e0 2024-04-20T21:54:28.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.545+0000 7ffbece00700 1 -- 172.21.15.142:0/3954524515 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe819e4d0 con 0x7ffbe80738e0 2024-04-20T21:54:28.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.547+0000 7ffbece00700 1 -- 172.21.15.142:0/3954524515 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe8192a10 con 0x7ffbe80738e0 2024-04-20T21:54:28.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.548+0000 7ffbdea00700 1 -- 172.21.15.142:0/3954524515 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ffbd8010380 con 0x7ffbe80738e0 2024-04-20T21:54:28.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.549+0000 7ffbdea00700 1 --2- 172.21.15.142:0/3954524515 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ffbcc06cce0 0x7ffbcc06f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:28.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.549+0000 7ffbdea00700 1 -- 172.21.15.142:0/3954524515 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ffbd808ba70 con 0x7ffbe80738e0 2024-04-20T21:54:28.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.549+0000 7ffbe5400700 1 --2- 172.21.15.142:0/3954524515 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ffbcc06cce0 0x7ffbcc06f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:28.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.550+0000 7ffbe5400700 1 --2- 172.21.15.142:0/3954524515 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ffbcc06cce0 0x7ffbcc06f1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400b5c0 tx=0x7ffbd4005160 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:28.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.554+0000 7ffbdea00700 1 -- 172.21.15.142:0/3954524515 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7ffbd8059bf0 con 0x7ffbe80738e0 2024-04-20T21:54:28.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:28.808+0000 7ffbece00700 1 -- 172.21.15.142:0/3954524515 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbe802cea0 con 0x7ffbcc06cce0 2024-04-20T21:54:29.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:29 smithi164 ceph-mon[23506]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:29.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:29 smithi164 ceph-mon[23506]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:54:29.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:29 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-20T21:54:29.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:29 smithi142 ceph-mon[15828]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:29.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:29 smithi142 ceph-mon[15828]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:54:29.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:29 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-20T21:54:30.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:30.466+0000 7ffbdea00700 1 -- 172.21.15.142:0/3954524515 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ffbe802cea0 con 0x7ffbcc06cce0 2024-04-20T21:54:30.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:30.470+0000 7ffbece00700 1 -- 172.21.15.142:0/3954524515 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ffbcc06cce0 msgr2=0x7ffbcc06f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:30.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:30.470+0000 7ffbece00700 1 --2- 172.21.15.142:0/3954524515 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ffbcc06cce0 0x7ffbcc06f1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400b5c0 tx=0x7ffbd4005160 comp rx=0 tx=0).stop 2024-04-20T21:54:30.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:30.470+0000 7ffbece00700 1 -- 172.21.15.142:0/3954524515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbe80738e0 msgr2=0x7ffbe81988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:30.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:30.470+0000 7ffbece00700 1 --2- 172.21.15.142:0/3954524515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbe80738e0 0x7ffbe81988e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800b4b0 tx=0x7ffbd800b870 comp rx=0 tx=0).stop 2024-04-20T21:54:30.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:30.471+0000 7ffbece00700 1 -- 172.21.15.142:0/3954524515 shutdown_connections 2024-04-20T21:54:30.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:30.471+0000 7ffbece00700 1 --2- 172.21.15.142:0/3954524515 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ffbcc06cce0 0x7ffbcc06f1a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:30.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:30.471+0000 7ffbece00700 1 --2- 172.21.15.142:0/3954524515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffbe80738e0 0x7ffbe81988e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:30.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:30.471+0000 7ffbece00700 1 --2- 172.21.15.142:0/3954524515 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffbe8074eb0 0x7ffbe8198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:30.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:30.471+0000 7ffbece00700 1 -- 172.21.15.142:0/3954524515 >> 172.21.15.142:0/3954524515 conn(0x7ffbe80fc1e0 msgr2=0x7ffbe8106e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:30.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:30.471+0000 7ffbece00700 1 -- 172.21.15.142:0/3954524515 shutdown_connections 2024-04-20T21:54:30.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:30.472+0000 7ffbece00700 1 -- 172.21.15.142:0/3954524515 wait complete. 2024-04-20T21:54:30.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:30 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-20T21:54:30.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:30 smithi164 ceph-mon[23506]: osdmap e43: 6 total, 6 up, 6 in 2024-04-20T21:54:30.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:30 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-20T21:54:30.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:30 smithi164 ceph-mon[23506]: pgmap v221: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:30.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:30 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-20T21:54:30.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:30 smithi142 ceph-mon[15828]: osdmap e43: 6 total, 6 up, 6 in 2024-04-20T21:54:30.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:30 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-20T21:54:30.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:30 smithi142 ceph-mon[15828]: pgmap v221: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:30.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:30 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142[15823]: 2024-04-20T21:54:30.428+0000 7fc742e00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T21:54:31.351 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-20T21:54:31.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:31 smithi142 ceph-mon[15828]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-20T21:54:31.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:31 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-20T21:54:31.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:31 smithi142 ceph-mon[15828]: osdmap e44: 6 total, 6 up, 6 in 2024-04-20T21:54:31.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:31 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-20T21:54:31.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:31 smithi142 ceph-mon[15828]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T21:54:31.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:31 smithi142 ceph-mon[15828]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-20T21:54:31.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:31 smithi142 ceph-mon[15828]: osdmap e45: 6 total, 6 up, 6 in 2024-04-20T21:54:31.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:31 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-20T21:54:31.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:31 smithi142 ceph-mon[15828]: fsmap cephfs:0 2024-04-20T21:54:31.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:31 smithi142 ceph-mon[15828]: Saving service mds.cephfs spec with placement count:4 2024-04-20T21:54:31.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:31 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:31.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:31 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:54:31.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:31 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:54:31.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:31 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:54:31.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:31 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:31.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:31 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.lirkws", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T21:54:31.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:31 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.lirkws", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T21:54:31.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:31 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:54:31.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:31 smithi142 ceph-mon[15828]: Deploying daemon mds.cephfs.smithi142.lirkws on smithi142 2024-04-20T21:54:31.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:31 smithi164 ceph-mon[23506]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-20T21:54:31.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:31 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-20T21:54:31.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:31 smithi164 ceph-mon[23506]: osdmap e44: 6 total, 6 up, 6 in 2024-04-20T21:54:31.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:31 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-20T21:54:31.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:31 smithi164 ceph-mon[23506]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T21:54:31.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:31 smithi164 ceph-mon[23506]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-20T21:54:31.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:31 smithi164 ceph-mon[23506]: osdmap e45: 6 total, 6 up, 6 in 2024-04-20T21:54:31.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:31 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-20T21:54:31.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:31 smithi164 ceph-mon[23506]: fsmap cephfs:0 2024-04-20T21:54:31.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:31 smithi164 ceph-mon[23506]: Saving service mds.cephfs spec with placement count:4 2024-04-20T21:54:31.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:31 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:31.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:31 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:54:31.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:31 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:54:31.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:31 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:54:31.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:31 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:31.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:31 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.lirkws", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T21:54:31.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:31 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.lirkws", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T21:54:31.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:31 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:54:31.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:31 smithi164 ceph-mon[23506]: Deploying daemon mds.cephfs.smithi142.lirkws on smithi142 2024-04-20T21:54:32.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:32 smithi164 ceph-mon[23506]: osdmap e46: 6 total, 6 up, 6 in 2024-04-20T21:54:32.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:32 smithi164 ceph-mon[23506]: pgmap v225: 65 pgs: 7 creating+peering, 18 active+clean, 40 unknown; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:32.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:32 smithi142 ceph-mon[15828]: osdmap e46: 6 total, 6 up, 6 in 2024-04-20T21:54:32.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:32 smithi142 ceph-mon[15828]: pgmap v225: 65 pgs: 7 creating+peering, 18 active+clean, 40 unknown; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:32.908 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:54:33.575 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:33 smithi142 ceph-mon[15828]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-20T21:54:33.575 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:33 smithi142 ceph-mon[15828]: osdmap e47: 6 total, 6 up, 6 in 2024-04-20T21:54:33.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:33 smithi164 ceph-mon[23506]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-20T21:54:33.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:33 smithi164 ceph-mon[23506]: osdmap e47: 6 total, 6 up, 6 in 2024-04-20T21:54:34.512 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:34 smithi142 ceph-mon[15828]: pgmap v227: 65 pgs: 7 creating+peering, 52 active+clean, 6 unknown; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:34.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:34 smithi164 ceph-mon[23506]: pgmap v227: 65 pgs: 7 creating+peering, 52 active+clean, 6 unknown; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:35.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.541+0000 7fb191200700 1 -- 172.21.15.142:0/2383307526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb18c074f10 msgr2=0x7fb18c073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:35.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.541+0000 7fb191200700 1 --2- 172.21.15.142:0/2383307526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb18c074f10 0x7fb18c073370 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb17c009910 tx=0x7fb17c009c20 comp rx=0 tx=0).stop 2024-04-20T21:54:35.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.541+0000 7fb191200700 1 -- 172.21.15.142:0/2383307526 shutdown_connections 2024-04-20T21:54:35.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.541+0000 7fb191200700 1 --2- 172.21.15.142:0/2383307526 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb18c073940 0x7fb18c073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:35.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.542+0000 7fb191200700 1 --2- 172.21.15.142:0/2383307526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb18c074f10 0x7fb18c073370 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:35.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.542+0000 7fb191200700 1 -- 172.21.15.142:0/2383307526 >> 172.21.15.142:0/2383307526 conn(0x7fb18c0fc1c0 msgr2=0x7fb18c0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:35.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.542+0000 7fb191200700 1 -- 172.21.15.142:0/2383307526 shutdown_connections 2024-04-20T21:54:35.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.542+0000 7fb191200700 1 -- 172.21.15.142:0/2383307526 wait complete. 2024-04-20T21:54:35.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.543+0000 7fb191200700 1 Processor -- start 2024-04-20T21:54:35.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.543+0000 7fb191200700 1 -- start start 2024-04-20T21:54:35.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.543+0000 7fb191200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb18c073940 0x7fb18c198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:35.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.543+0000 7fb191200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb18c074f10 0x7fb18c198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:35.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.543+0000 7fb191200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c1993d0 con 0x7fb18c074f10 2024-04-20T21:54:35.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.543+0000 7fb191200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c199510 con 0x7fb18c073940 2024-04-20T21:54:35.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.543+0000 7fb189400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb18c074f10 0x7fb18c198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:35.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.544+0000 7fb189400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb18c074f10 0x7fb18c198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34642/0 (socket says 172.21.15.142:34642) 2024-04-20T21:54:35.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.544+0000 7fb189400700 1 -- 172.21.15.142:0/3209635547 learned_addr learned my addr 172.21.15.142:0/3209635547 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:54:35.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.544+0000 7fb189e00700 1 --2- 172.21.15.142:0/3209635547 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb18c073940 0x7fb18c198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:35.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.544+0000 7fb189400700 1 -- 172.21.15.142:0/3209635547 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb18c073940 msgr2=0x7fb18c198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:35.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.544+0000 7fb189400700 1 --2- 172.21.15.142:0/3209635547 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb18c073940 0x7fb18c198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:35.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.544+0000 7fb189400700 1 -- 172.21.15.142:0/3209635547 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c0095f0 con 0x7fb18c074f10 2024-04-20T21:54:35.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.544+0000 7fb189400700 1 --2- 172.21.15.142:0/3209635547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb18c074f10 0x7fb18c198db0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb17800d900 tx=0x7fb17800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:35.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.544+0000 7fb182a00700 1 -- 172.21.15.142:0/3209635547 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1780041f0 con 0x7fb18c074f10 2024-04-20T21:54:35.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.545+0000 7fb191200700 1 -- 172.21.15.142:0/3209635547 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18c19df20 con 0x7fb18c074f10 2024-04-20T21:54:35.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.545+0000 7fb182a00700 1 -- 172.21.15.142:0/3209635547 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb178004350 con 0x7fb18c074f10 2024-04-20T21:54:35.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.545+0000 7fb182a00700 1 -- 172.21.15.142:0/3209635547 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb178003cf0 con 0x7fb18c074f10 2024-04-20T21:54:35.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.545+0000 7fb191200700 1 -- 172.21.15.142:0/3209635547 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18c19e4c0 con 0x7fb18c074f10 2024-04-20T21:54:35.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.546+0000 7fb191200700 1 -- 172.21.15.142:0/3209635547 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18c192990 con 0x7fb18c074f10 2024-04-20T21:54:35.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.547+0000 7fb182a00700 1 -- 172.21.15.142:0/3209635547 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb178009730 con 0x7fb18c074f10 2024-04-20T21:54:35.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.549+0000 7fb182a00700 1 --2- 172.21.15.142:0/3209635547 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb17006cce0 0x7fb17006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:35.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.549+0000 7fb182a00700 1 -- 172.21.15.142:0/3209635547 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fb17808b850 con 0x7fb18c074f10 2024-04-20T21:54:35.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.549+0000 7fb189e00700 1 --2- 172.21.15.142:0/3209635547 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb17006cce0 0x7fb17006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:35.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.550+0000 7fb189e00700 1 --2- 172.21.15.142:0/3209635547 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb17006cce0 0x7fb17006f1a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb17c005090 tx=0x7fb17c005180 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:35.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.554+0000 7fb182a00700 1 -- 172.21.15.142:0/3209635547 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fb1780597d0 con 0x7fb18c074f10 2024-04-20T21:54:35.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.813+0000 7fb191200700 1 -- 172.21.15.142:0/3209635547 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb18c062510 con 0x7fb18c074f10 2024-04-20T21:54:35.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.814+0000 7fb182a00700 1 -- 172.21.15.142:0/3209635547 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 4 v4) v1 ==== 75+0+1287 (secure 0 0 0) 0x7fb178059360 con 0x7fb18c074f10 2024-04-20T21:54:35.814 INFO:teuthology.orchestra.run.smithi142.stdout:e4 2024-04-20T21:54:35.814 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T21:54:35.814 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:54:35.815 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T21:54:35.815 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:54:35.815 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T21:54:35.815 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T21:54:35.815 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 4 2024-04-20T21:54:35.815 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T21:54:35.815 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T21:54:35.815 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:35.465051+0000 2024-04-20T21:54:35.815 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T21:54:35.815 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T21:54:35.816 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T21:54:35.816 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T21:54:35.816 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T21:54:35.816 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T21:54:35.816 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T21:54:35.816 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T21:54:35.817 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T21:54:35.818 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:54:35.818 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T21:54:35.818 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T21:54:35.818 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T21:54:35.818 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T21:54:35.818 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T21:54:35.818 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T21:54:35.818 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T21:54:35.818 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T21:54:35.818 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T21:54:35.818 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T21:54:35.818 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T21:54:35.818 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 0 2024-04-20T21:54:35.819 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:creating seq 1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:54:35.819 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:54:35.819 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:54:35.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.817+0000 7fb191200700 1 -- 172.21.15.142:0/3209635547 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb17006cce0 msgr2=0x7fb17006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:35.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.817+0000 7fb191200700 1 --2- 172.21.15.142:0/3209635547 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb17006cce0 0x7fb17006f1a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb17c005090 tx=0x7fb17c005180 comp rx=0 tx=0).stop 2024-04-20T21:54:35.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.817+0000 7fb191200700 1 -- 172.21.15.142:0/3209635547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb18c074f10 msgr2=0x7fb18c198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:35.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.817+0000 7fb191200700 1 --2- 172.21.15.142:0/3209635547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb18c074f10 0x7fb18c198db0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb17800d900 tx=0x7fb17800dc10 comp rx=0 tx=0).stop 2024-04-20T21:54:35.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.817+0000 7fb191200700 1 -- 172.21.15.142:0/3209635547 shutdown_connections 2024-04-20T21:54:35.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.817+0000 7fb191200700 1 --2- 172.21.15.142:0/3209635547 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb17006cce0 0x7fb17006f1a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:35.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.817+0000 7fb191200700 1 --2- 172.21.15.142:0/3209635547 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb18c073940 0x7fb18c198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:35.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.817+0000 7fb191200700 1 --2- 172.21.15.142:0/3209635547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb18c074f10 0x7fb18c198db0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:35.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.817+0000 7fb191200700 1 -- 172.21.15.142:0/3209635547 >> 172.21.15.142:0/3209635547 conn(0x7fb18c0fc1c0 msgr2=0x7fb18c106e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:35.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.818+0000 7fb191200700 1 -- 172.21.15.142:0/3209635547 shutdown_connections 2024-04-20T21:54:35.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:35.818+0000 7fb191200700 1 -- 172.21.15.142:0/3209635547 wait complete. 2024-04-20T21:54:35.820 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 4 2024-04-20T21:54:36.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:36 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:36.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:36 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:36.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:36 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:36.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:36 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi164.ybvzha", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T21:54:36.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:36 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi164.ybvzha", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T21:54:36.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:36 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:54:36.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:36 smithi142 ceph-mon[15828]: Deploying daemon mds.cephfs.smithi164.ybvzha on smithi164 2024-04-20T21:54:36.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:36 smithi142 ceph-mon[15828]: mds.? [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] up:boot 2024-04-20T21:54:36.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:36 smithi142 ceph-mon[15828]: daemon mds.cephfs.smithi142.lirkws assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-20T21:54:36.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:36 smithi142 ceph-mon[15828]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-20T21:54:36.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:36 smithi142 ceph-mon[15828]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-20T21:54:36.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:36 smithi142 ceph-mon[15828]: Cluster is now healthy 2024-04-20T21:54:36.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:36 smithi142 ceph-mon[15828]: fsmap cephfs:0 1 up:standby 2024-04-20T21:54:36.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:36 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lirkws"}]: dispatch 2024-04-20T21:54:36.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:36 smithi142 ceph-mon[15828]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:creating} 2024-04-20T21:54:36.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:36 smithi142 ceph-mon[15828]: daemon mds.cephfs.smithi142.lirkws is now active in filesystem cephfs as rank 0 2024-04-20T21:54:36.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:36 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/3209635547' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:54:36.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:36 smithi142 ceph-mon[15828]: pgmap v228: 65 pgs: 4 creating+peering, 61 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:36.628 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:36 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:36.628 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:36 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:36.628 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:36 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:36.628 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:36 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi164.ybvzha", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T21:54:36.628 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:36 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi164.ybvzha", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T21:54:36.629 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:36 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:54:36.629 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:36 smithi164 ceph-mon[23506]: Deploying daemon mds.cephfs.smithi164.ybvzha on smithi164 2024-04-20T21:54:36.629 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:36 smithi164 ceph-mon[23506]: mds.? [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] up:boot 2024-04-20T21:54:36.629 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:36 smithi164 ceph-mon[23506]: daemon mds.cephfs.smithi142.lirkws assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-20T21:54:36.629 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:36 smithi164 ceph-mon[23506]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-20T21:54:36.629 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:36 smithi164 ceph-mon[23506]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-20T21:54:36.629 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:36 smithi164 ceph-mon[23506]: Cluster is now healthy 2024-04-20T21:54:36.629 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:36 smithi164 ceph-mon[23506]: fsmap cephfs:0 1 up:standby 2024-04-20T21:54:36.629 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:36 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lirkws"}]: dispatch 2024-04-20T21:54:36.629 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:36 smithi164 ceph-mon[23506]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:creating} 2024-04-20T21:54:36.629 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:36 smithi164 ceph-mon[23506]: daemon mds.cephfs.smithi142.lirkws is now active in filesystem cephfs as rank 0 2024-04-20T21:54:36.629 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:36 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/3209635547' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:54:36.629 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:36 smithi164 ceph-mon[23506]: pgmap v228: 65 pgs: 4 creating+peering, 61 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:36.645 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-20T21:54:36.655 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi142.front.sepia.ceph.com 2024-04-20T21:54:36.655 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-04-20T21:54:37.047 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:54:37.761 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:37 smithi164 ceph-mon[23506]: mds.? [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] up:active 2024-04-20T21:54:37.762 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:37 smithi164 ceph-mon[23506]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 2024-04-20T21:54:37.852 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:37 smithi142 ceph-mon[15828]: mds.? [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] up:active 2024-04-20T21:54:37.852 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:37 smithi142 ceph-mon[15828]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 2024-04-20T21:54:38.524 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:38 smithi142 ceph-mon[15828]: pgmap v229: 65 pgs: 65 active+clean; 578 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 810 B/s wr, 4 op/s 2024-04-20T21:54:38.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:38 smithi164 ceph-mon[23506]: pgmap v229: 65 pgs: 65 active+clean; 578 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 810 B/s wr, 4 op/s 2024-04-20T21:54:38.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:38.999+0000 7fda05000700 1 -- 172.21.15.142:0/81537343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda000ff930 msgr2=0x7fda000ffd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:38.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:38.999+0000 7fda05000700 1 --2- 172.21.15.142:0/81537343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda000ff930 0x7fda000ffd50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0009910 tx=0x7fd9f0009c20 comp rx=0 tx=0).stop 2024-04-20T21:54:38.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:38.999+0000 7fda05000700 1 -- 172.21.15.142:0/81537343 shutdown_connections 2024-04-20T21:54:38.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:38.999+0000 7fda05000700 1 --2- 172.21.15.142:0/81537343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda00100b30 0x7fda00100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:38.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:38.999+0000 7fda05000700 1 --2- 172.21.15.142:0/81537343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda000ff930 0x7fda000ffd50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:38.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:38.999+0000 7fda05000700 1 -- 172.21.15.142:0/81537343 >> 172.21.15.142:0/81537343 conn(0x7fda000faef0 msgr2=0x7fda000fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:38.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:38.999+0000 7fda05000700 1 -- 172.21.15.142:0/81537343 shutdown_connections 2024-04-20T21:54:38.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:38.999+0000 7fda05000700 1 -- 172.21.15.142:0/81537343 wait complete. 2024-04-20T21:54:39.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.000+0000 7fda05000700 1 Processor -- start 2024-04-20T21:54:39.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.000+0000 7fda05000700 1 -- start start 2024-04-20T21:54:39.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.001+0000 7fda05000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda000ff930 0x7fda001096d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:39.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.001+0000 7fda05000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda00100b30 0x7fda00107dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:39.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.001+0000 7fda05000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda00108300 con 0x7fda00100b30 2024-04-20T21:54:39.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.001+0000 7fda05000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda00108440 con 0x7fda000ff930 2024-04-20T21:54:39.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.001+0000 7fd9fea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda00100b30 0x7fda00107dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:39.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.001+0000 7fd9fea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda00100b30 0x7fda00107dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37860/0 (socket says 172.21.15.142:37860) 2024-04-20T21:54:39.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.001+0000 7fd9fea00700 1 -- 172.21.15.142:0/3854325148 learned_addr learned my addr 172.21.15.142:0/3854325148 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:54:39.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.001+0000 7fd9ff400700 1 --2- 172.21.15.142:0/3854325148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda000ff930 0x7fda001096d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:39.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.001+0000 7fd9fea00700 1 -- 172.21.15.142:0/3854325148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda000ff930 msgr2=0x7fda001096d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:39.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.001+0000 7fd9fea00700 1 --2- 172.21.15.142:0/3854325148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda000ff930 0x7fda001096d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:39.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.001+0000 7fd9fea00700 1 -- 172.21.15.142:0/3854325148 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f00095f0 con 0x7fda00100b30 2024-04-20T21:54:39.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.002+0000 7fd9fea00700 1 --2- 172.21.15.142:0/3854325148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda00100b30 0x7fda00107dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00d8d0 tx=0x7fd9ec00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:39.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.002+0000 7fd9f7e00700 1 -- 172.21.15.142:0/3854325148 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9ec0098a0 con 0x7fda00100b30 2024-04-20T21:54:39.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.002+0000 7fd9f7e00700 1 -- 172.21.15.142:0/3854325148 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd9ec010460 con 0x7fda00100b30 2024-04-20T21:54:39.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.002+0000 7fda05000700 1 -- 172.21.15.142:0/3854325148 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda00108720 con 0x7fda00100b30 2024-04-20T21:54:39.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.002+0000 7fd9f7e00700 1 -- 172.21.15.142:0/3854325148 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9ec00f5f0 con 0x7fda00100b30 2024-04-20T21:54:39.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.002+0000 7fda05000700 1 -- 172.21.15.142:0/3854325148 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0019e510 con 0x7fda00100b30 2024-04-20T21:54:39.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.003+0000 7fda05000700 1 -- 172.21.15.142:0/3854325148 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda001905e0 con 0x7fda00100b30 2024-04-20T21:54:39.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.005+0000 7fd9f7e00700 1 -- 172.21.15.142:0/3854325148 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd9ec009a00 con 0x7fda00100b30 2024-04-20T21:54:39.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.006+0000 7fd9f7e00700 1 --2- 172.21.15.142:0/3854325148 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd9e406cce0 0x7fd9e406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:39.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.006+0000 7fd9f7e00700 1 -- 172.21.15.142:0/3854325148 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fd9ec08c110 con 0x7fda00100b30 2024-04-20T21:54:39.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.006+0000 7fd9ff400700 1 --2- 172.21.15.142:0/3854325148 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd9e406cce0 0x7fd9e406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:39.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.007+0000 7fd9ff400700 1 --2- 172.21.15.142:0/3854325148 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd9e406cce0 0x7fd9e406f1a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0005090 tx=0x7fd9f0005180 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:39.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.011+0000 7fd9f7e00700 1 -- 172.21.15.142:0/3854325148 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fd9ec059f50 con 0x7fda00100b30 2024-04-20T21:54:39.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.283+0000 7fda05000700 1 -- 172.21.15.142:0/3854325148 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fda000690b0 con 0x7fda00100b30 2024-04-20T21:54:39.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.498+0000 7fd9f7e00700 1 -- 172.21.15.142:0/3854325148 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7fd9ec059ae0 con 0x7fda00100b30 2024-04-20T21:54:39.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.502+0000 7fda05000700 1 -- 172.21.15.142:0/3854325148 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd9e406cce0 msgr2=0x7fd9e406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:39.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.502+0000 7fda05000700 1 --2- 172.21.15.142:0/3854325148 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd9e406cce0 0x7fd9e406f1a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0005090 tx=0x7fd9f0005180 comp rx=0 tx=0).stop 2024-04-20T21:54:39.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.502+0000 7fda05000700 1 -- 172.21.15.142:0/3854325148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda00100b30 msgr2=0x7fda00107dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:39.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.502+0000 7fda05000700 1 --2- 172.21.15.142:0/3854325148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda00100b30 0x7fda00107dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00d8d0 tx=0x7fd9ec00dbe0 comp rx=0 tx=0).stop 2024-04-20T21:54:39.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.502+0000 7fda05000700 1 -- 172.21.15.142:0/3854325148 shutdown_connections 2024-04-20T21:54:39.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.502+0000 7fda05000700 1 --2- 172.21.15.142:0/3854325148 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd9e406cce0 0x7fd9e406f1a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:39.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.502+0000 7fda05000700 1 --2- 172.21.15.142:0/3854325148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fda000ff930 0x7fda001096d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:39.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.502+0000 7fda05000700 1 --2- 172.21.15.142:0/3854325148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda00100b30 0x7fda00107dc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:39.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.502+0000 7fda05000700 1 -- 172.21.15.142:0/3854325148 >> 172.21.15.142:0/3854325148 conn(0x7fda000faef0 msgr2=0x7fda00104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:39.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.502+0000 7fda05000700 1 -- 172.21.15.142:0/3854325148 shutdown_connections 2024-04-20T21:54:39.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:39.502+0000 7fda05000700 1 -- 172.21.15.142:0/3854325148 wait complete. 2024-04-20T21:54:39.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:39 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/3854325148' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-20T21:54:39.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:39 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:39.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:39 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:39.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:39 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:39.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:39 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.lrvfgg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T21:54:39.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:39 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.lrvfgg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T21:54:39.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:39 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:54:39.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:39 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/3854325148' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-20T21:54:39.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:39 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:39.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:39 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:39.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:39 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:39.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:39 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.lrvfgg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T21:54:39.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:39 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.lrvfgg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T21:54:39.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:39 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:54:40.183 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-20T21:54:40.193 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi142.front.sepia.ceph.com 2024-04-20T21:54:40.193 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-04-20T21:54:40.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:40 smithi142 ceph-mon[15828]: Deploying daemon mds.cephfs.smithi142.lrvfgg on smithi142 2024-04-20T21:54:40.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:40 smithi142 ceph-mon[15828]: mds.? [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] up:boot 2024-04-20T21:54:40.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:40 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/3854325148' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-20T21:54:40.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:40 smithi142 ceph-mon[15828]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 1 up:standby 2024-04-20T21:54:40.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:40 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.ybvzha"}]: dispatch 2024-04-20T21:54:40.674 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:40 smithi142 ceph-mon[15828]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 1 up:standby 2024-04-20T21:54:40.674 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:40 smithi142 ceph-mon[15828]: pgmap v230: 65 pgs: 65 active+clean; 578 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 715 B/s wr, 4 op/s 2024-04-20T21:54:40.674 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:40 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:54:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:40 smithi164 ceph-mon[23506]: Deploying daemon mds.cephfs.smithi142.lrvfgg on smithi142 2024-04-20T21:54:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:40 smithi164 ceph-mon[23506]: mds.? [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] up:boot 2024-04-20T21:54:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:40 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/3854325148' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-20T21:54:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:40 smithi164 ceph-mon[23506]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 1 up:standby 2024-04-20T21:54:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:40 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.ybvzha"}]: dispatch 2024-04-20T21:54:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:40 smithi164 ceph-mon[23506]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 1 up:standby 2024-04-20T21:54:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:40 smithi164 ceph-mon[23506]: pgmap v230: 65 pgs: 65 active+clean; 578 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 715 B/s wr, 4 op/s 2024-04-20T21:54:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:40 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:54:41.563 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:54:43.162 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:43 smithi142 ceph-mon[15828]: pgmap v231: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-20T21:54:43.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:43 smithi164 ceph-mon[23506]: pgmap v231: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-20T21:54:44.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.137+0000 7efff4600700 1 -- 172.21.15.142:0/3010883584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effec074f10 msgr2=0x7effec073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:44.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.137+0000 7efff4600700 1 --2- 172.21.15.142:0/3010883584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effec074f10 0x7effec073370 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7effe0009910 tx=0x7effe0009c20 comp rx=0 tx=0).stop 2024-04-20T21:54:44.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.137+0000 7efff4600700 1 -- 172.21.15.142:0/3010883584 shutdown_connections 2024-04-20T21:54:44.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.137+0000 7efff4600700 1 --2- 172.21.15.142:0/3010883584 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7effec073940 0x7effec073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:44.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.137+0000 7efff4600700 1 --2- 172.21.15.142:0/3010883584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effec074f10 0x7effec073370 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:44.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.137+0000 7efff4600700 1 -- 172.21.15.142:0/3010883584 >> 172.21.15.142:0/3010883584 conn(0x7effec0fc1c0 msgr2=0x7effec0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:44.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.137+0000 7efff4600700 1 -- 172.21.15.142:0/3010883584 shutdown_connections 2024-04-20T21:54:44.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.137+0000 7efff4600700 1 -- 172.21.15.142:0/3010883584 wait complete. 2024-04-20T21:54:44.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.138+0000 7efff4600700 1 Processor -- start 2024-04-20T21:54:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.138+0000 7efff4600700 1 -- start start 2024-04-20T21:54:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.139+0000 7efff4600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effec073940 0x7effec198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.139+0000 7efff4600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7effec074f10 0x7effec198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.139+0000 7efff4600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec1993d0 con 0x7effec073940 2024-04-20T21:54:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.139+0000 7efff4600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec199510 con 0x7effec074f10 2024-04-20T21:54:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.139+0000 7efff1c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effec073940 0x7effec198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.139+0000 7efff1c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effec073940 0x7effec198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37886/0 (socket says 172.21.15.142:37886) 2024-04-20T21:54:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.139+0000 7efff1c00700 1 -- 172.21.15.142:0/1197512263 learned_addr learned my addr 172.21.15.142:0/1197512263 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:54:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.140+0000 7efff1c00700 1 -- 172.21.15.142:0/1197512263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7effec074f10 msgr2=0x7effec198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:44.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.140+0000 7efff1c00700 1 --2- 172.21.15.142:0/1197512263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7effec074f10 0x7effec198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:44.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.140+0000 7efff1c00700 1 -- 172.21.15.142:0/1197512263 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe00095f0 con 0x7effec073940 2024-04-20T21:54:44.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.140+0000 7efff1c00700 1 --2- 172.21.15.142:0/1197512263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effec073940 0x7effec198870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7effe00059d0 tx=0x7effe000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:44.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.140+0000 7effea000700 1 -- 172.21.15.142:0/1197512263 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effe001d070 con 0x7effec073940 2024-04-20T21:54:44.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.141+0000 7effea000700 1 -- 172.21.15.142:0/1197512263 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7effe000f460 con 0x7effec073940 2024-04-20T21:54:44.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.141+0000 7efff4600700 1 -- 172.21.15.142:0/1197512263 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effec19dec0 con 0x7effec073940 2024-04-20T21:54:44.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.141+0000 7effea000700 1 -- 172.21.15.142:0/1197512263 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effe0021620 con 0x7effec073940 2024-04-20T21:54:44.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.141+0000 7efff4600700 1 -- 172.21.15.142:0/1197512263 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec19e3e0 con 0x7effec073940 2024-04-20T21:54:44.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.142+0000 7efff4600700 1 -- 172.21.15.142:0/1197512263 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effec192990 con 0x7effec073940 2024-04-20T21:54:44.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.143+0000 7effea000700 1 -- 172.21.15.142:0/1197512263 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7effe000fa70 con 0x7effec073940 2024-04-20T21:54:44.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.144+0000 7effea000700 1 --2- 172.21.15.142:0/1197512263 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7effd406cce0 0x7effd406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:44.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.144+0000 7effea000700 1 -- 172.21.15.142:0/1197512263 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7effe008d5e0 con 0x7effec073940 2024-04-20T21:54:44.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.144+0000 7efff1200700 1 --2- 172.21.15.142:0/1197512263 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7effd406cce0 0x7effd406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:44.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.145+0000 7efff1200700 1 --2- 172.21.15.142:0/1197512263 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7effd406cce0 0x7effd406f1a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7effec074c40 tx=0x7effd8005ca0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:44.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.149+0000 7effea000700 1 -- 172.21.15.142:0/1197512263 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7effe005b440 con 0x7effec073940 2024-04-20T21:54:44.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:44.415+0000 7efff4600700 1 -- 172.21.15.142:0/1197512263 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7effec062510 con 0x7effec073940 2024-04-20T21:54:44.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:44 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:44.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:44 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:44.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:44 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:44.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:44 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi164.gmmrfu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T21:54:44.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:44 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi164.gmmrfu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T21:54:44.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:44 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:54:44.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:44 smithi164 ceph-mon[23506]: Deploying daemon mds.cephfs.smithi164.gmmrfu on smithi164 2024-04-20T21:54:44.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:44 smithi164 ceph-mon[23506]: pgmap v232: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-20T21:54:44.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:44 smithi164 ceph-mon[23506]: mds.? [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] up:boot 2024-04-20T21:54:44.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:44 smithi164 ceph-mon[23506]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 2 up:standby 2024-04-20T21:54:44.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:44 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lrvfgg"}]: dispatch 2024-04-20T21:54:44.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:44 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/1197512263' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-04-20T21:54:45.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:45.093+0000 7effea000700 1 -- 172.21.15.142:0/1197512263 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7effe005afd0 con 0x7effec073940 2024-04-20T21:54:45.094 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:45.094 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:45.094 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:45.094 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi164.gmmrfu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T21:54:45.094 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi164.gmmrfu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T21:54:45.094 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:54:45.094 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:44 smithi142 ceph-mon[15828]: Deploying daemon mds.cephfs.smithi164.gmmrfu on smithi164 2024-04-20T21:54:45.094 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:44 smithi142 ceph-mon[15828]: pgmap v232: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-20T21:54:45.094 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:44 smithi142 ceph-mon[15828]: mds.? [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] up:boot 2024-04-20T21:54:45.094 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:44 smithi142 ceph-mon[15828]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 2 up:standby 2024-04-20T21:54:45.094 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:44 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lrvfgg"}]: dispatch 2024-04-20T21:54:45.094 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:44 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1197512263' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-04-20T21:54:45.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:45.097+0000 7efff4600700 1 -- 172.21.15.142:0/1197512263 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7effd406cce0 msgr2=0x7effd406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:45.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:45.097+0000 7efff4600700 1 --2- 172.21.15.142:0/1197512263 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7effd406cce0 0x7effd406f1a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7effec074c40 tx=0x7effd8005ca0 comp rx=0 tx=0).stop 2024-04-20T21:54:45.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:45.097+0000 7efff4600700 1 -- 172.21.15.142:0/1197512263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effec073940 msgr2=0x7effec198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:45.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:45.097+0000 7efff4600700 1 --2- 172.21.15.142:0/1197512263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effec073940 0x7effec198870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7effe00059d0 tx=0x7effe000be20 comp rx=0 tx=0).stop 2024-04-20T21:54:45.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:45.097+0000 7efff4600700 1 -- 172.21.15.142:0/1197512263 shutdown_connections 2024-04-20T21:54:45.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:45.097+0000 7efff4600700 1 --2- 172.21.15.142:0/1197512263 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7effd406cce0 0x7effd406f1a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:45.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:45.097+0000 7efff4600700 1 --2- 172.21.15.142:0/1197512263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7effec073940 0x7effec198870 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:45.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:45.097+0000 7efff4600700 1 --2- 172.21.15.142:0/1197512263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7effec074f10 0x7effec198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:45.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:45.097+0000 7efff4600700 1 -- 172.21.15.142:0/1197512263 >> 172.21.15.142:0/1197512263 conn(0x7effec0fc1c0 msgr2=0x7effec106e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:45.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:45.098+0000 7efff4600700 1 -- 172.21.15.142:0/1197512263 shutdown_connections 2024-04-20T21:54:45.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:45.098+0000 7efff4600700 1 -- 172.21.15.142:0/1197512263 wait complete. 2024-04-20T21:54:45.923 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-20T21:54:45.934 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi142.front.sepia.ceph.com 2024-04-20T21:54:45.934 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-04-20T21:54:46.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:46 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1197512263' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-04-20T21:54:46.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:46 smithi142 ceph-mon[15828]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 2 up:standby 2024-04-20T21:54:46.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:46 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:46.352 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:54:46.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:46 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/1197512263' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-04-20T21:54:46.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:46 smithi164 ceph-mon[23506]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 2 up:standby 2024-04-20T21:54:46.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:46 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:47 smithi142 ceph-mon[15828]: pgmap v233: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-20T21:54:47.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:47 smithi164 ceph-mon[23506]: pgmap v233: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-20T21:54:48.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.389+0000 7fd848e00700 1 -- 172.21.15.142:0/2227747725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd844101670 msgr2=0x7fd844103a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:48.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.389+0000 7fd848e00700 1 --2- 172.21.15.142:0/2227747725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd844101670 0x7fd844103a60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd834009910 tx=0x7fd834009c20 comp rx=0 tx=0).stop 2024-04-20T21:54:48.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.389+0000 7fd848e00700 1 -- 172.21.15.142:0/2227747725 shutdown_connections 2024-04-20T21:54:48.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.389+0000 7fd848e00700 1 --2- 172.21.15.142:0/2227747725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd844103fa0 0x7fd844106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:48.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.389+0000 7fd848e00700 1 --2- 172.21.15.142:0/2227747725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd844101670 0x7fd844103a60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:48.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.389+0000 7fd848e00700 1 -- 172.21.15.142:0/2227747725 >> 172.21.15.142:0/2227747725 conn(0x7fd8440fb060 msgr2=0x7fd8440fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:48.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.389+0000 7fd848e00700 1 -- 172.21.15.142:0/2227747725 shutdown_connections 2024-04-20T21:54:48.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.389+0000 7fd848e00700 1 -- 172.21.15.142:0/2227747725 wait complete. 2024-04-20T21:54:48.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.390+0000 7fd848e00700 1 Processor -- start 2024-04-20T21:54:48.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.390+0000 7fd848e00700 1 -- start start 2024-04-20T21:54:48.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.390+0000 7fd848e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd844101670 0x7fd844100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:48.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.390+0000 7fd848e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd844103fa0 0x7fd8440ff620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:48.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.390+0000 7fd848e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440ffb60 con 0x7fd844103fa0 2024-04-20T21:54:48.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.390+0000 7fd848e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440ffca0 con 0x7fd844101670 2024-04-20T21:54:48.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.391+0000 7fd841400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd844103fa0 0x7fd8440ff620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:48.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.391+0000 7fd841400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd844103fa0 0x7fd8440ff620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51800/0 (socket says 172.21.15.142:51800) 2024-04-20T21:54:48.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.391+0000 7fd841400700 1 -- 172.21.15.142:0/394702014 learned_addr learned my addr 172.21.15.142:0/394702014 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:54:48.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.391+0000 7fd841e00700 1 --2- 172.21.15.142:0/394702014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd844101670 0x7fd844100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:48.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.391+0000 7fd841400700 1 -- 172.21.15.142:0/394702014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd844101670 msgr2=0x7fd844100f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:48.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.391+0000 7fd841400700 1 --2- 172.21.15.142:0/394702014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd844101670 0x7fd844100f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:48.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.391+0000 7fd841400700 1 -- 172.21.15.142:0/394702014 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340095f0 con 0x7fd844103fa0 2024-04-20T21:54:48.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.392+0000 7fd841400700 1 --2- 172.21.15.142:0/394702014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd844103fa0 0x7fd8440ff620 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd83000d8d0 tx=0x7fd83000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:48.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.392+0000 7fd83aa00700 1 -- 172.21.15.142:0/394702014 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd830009940 con 0x7fd844103fa0 2024-04-20T21:54:48.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.392+0000 7fd83aa00700 1 -- 172.21.15.142:0/394702014 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd830010460 con 0x7fd844103fa0 2024-04-20T21:54:48.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.392+0000 7fd848e00700 1 -- 172.21.15.142:0/394702014 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8440fff80 con 0x7fd844103fa0 2024-04-20T21:54:48.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.392+0000 7fd83aa00700 1 -- 172.21.15.142:0/394702014 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd83000f5f0 con 0x7fd844103fa0 2024-04-20T21:54:48.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.392+0000 7fd848e00700 1 -- 172.21.15.142:0/394702014 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84419e600 con 0x7fd844103fa0 2024-04-20T21:54:48.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.393+0000 7fd848e00700 1 -- 172.21.15.142:0/394702014 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd844062510 con 0x7fd844103fa0 2024-04-20T21:54:48.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.395+0000 7fd83aa00700 1 -- 172.21.15.142:0/394702014 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd8300105d0 con 0x7fd844103fa0 2024-04-20T21:54:48.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.396+0000 7fd83aa00700 1 --2- 172.21.15.142:0/394702014 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd82806cce0 0x7fd82806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:48.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.396+0000 7fd83aa00700 1 -- 172.21.15.142:0/394702014 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fd83008c190 con 0x7fd844103fa0 2024-04-20T21:54:48.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.396+0000 7fd841e00700 1 --2- 172.21.15.142:0/394702014 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd82806cce0 0x7fd82806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:48.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.397+0000 7fd841e00700 1 --2- 172.21.15.142:0/394702014 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd82806cce0 0x7fd82806f1a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd834006010 tx=0x7fd83400b580 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:48.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.401+0000 7fd83aa00700 1 -- 172.21.15.142:0/394702014 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fd83005a070 con 0x7fd844103fa0 2024-04-20T21:54:48.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:48.698+0000 7fd848e00700 1 -- 172.21.15.142:0/394702014 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7fd8441096e0 con 0x7fd844103fa0 2024-04-20T21:54:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:48 smithi164 ceph-mon[23506]: pgmap v234: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-20T21:54:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:54:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:48 smithi164 ceph-mon[23506]: mds.? [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] up:boot 2024-04-20T21:54:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:48 smithi164 ceph-mon[23506]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 3 up:standby 2024-04-20T21:54:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:48 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.gmmrfu"}]: dispatch 2024-04-20T21:54:48.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:48.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:48.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:48.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:48.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:48.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:48 smithi142 ceph-mon[15828]: pgmap v234: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-20T21:54:48.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:54:48.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:48 smithi142 ceph-mon[15828]: mds.? [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] up:boot 2024-04-20T21:54:48.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:48 smithi142 ceph-mon[15828]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 3 up:standby 2024-04-20T21:54:48.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:48 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.gmmrfu"}]: dispatch 2024-04-20T21:54:49.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:49.686+0000 7fd83aa00700 1 -- 172.21.15.142:0/394702014 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v11) v1 ==== 133+0+0 (secure 0 0 0) 0x7fd830059c00 con 0x7fd844103fa0 2024-04-20T21:54:49.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:49.691+0000 7fd848e00700 1 -- 172.21.15.142:0/394702014 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd82806cce0 msgr2=0x7fd82806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:49.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:49.691+0000 7fd848e00700 1 --2- 172.21.15.142:0/394702014 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd82806cce0 0x7fd82806f1a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd834006010 tx=0x7fd83400b580 comp rx=0 tx=0).stop 2024-04-20T21:54:49.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:49.691+0000 7fd848e00700 1 -- 172.21.15.142:0/394702014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd844103fa0 msgr2=0x7fd8440ff620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:49.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:49.691+0000 7fd848e00700 1 --2- 172.21.15.142:0/394702014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd844103fa0 0x7fd8440ff620 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd83000d8d0 tx=0x7fd83000dc90 comp rx=0 tx=0).stop 2024-04-20T21:54:49.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:49.691+0000 7fd848e00700 1 -- 172.21.15.142:0/394702014 shutdown_connections 2024-04-20T21:54:49.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:49.691+0000 7fd848e00700 1 --2- 172.21.15.142:0/394702014 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd82806cce0 0x7fd82806f1a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:49.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:49.691+0000 7fd848e00700 1 --2- 172.21.15.142:0/394702014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd844101670 0x7fd844100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:49.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:49.692+0000 7fd848e00700 1 --2- 172.21.15.142:0/394702014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd844103fa0 0x7fd8440ff620 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:49.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:49.692+0000 7fd848e00700 1 -- 172.21.15.142:0/394702014 >> 172.21.15.142:0/394702014 conn(0x7fd8440fb060 msgr2=0x7fd8440fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:49.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:49.692+0000 7fd848e00700 1 -- 172.21.15.142:0/394702014 shutdown_connections 2024-04-20T21:54:49.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:49.692+0000 7fd848e00700 1 -- 172.21.15.142:0/394702014 wait complete. 2024-04-20T21:54:49.692 INFO:teuthology.orchestra.run.smithi142.stderr:inline data disabled 2024-04-20T21:54:49.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:49 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/394702014' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-04-20T21:54:49.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:49 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/394702014' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-04-20T21:54:50.543 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-20T21:54:50.556 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi142.front.sepia.ceph.com 2024-04-20T21:54:50.556 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-20T21:54:50.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:50 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/394702014' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-04-20T21:54:50.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:50 smithi164 ceph-mon[23506]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 3 up:standby 2024-04-20T21:54:50.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:50 smithi164 ceph-mon[23506]: pgmap v235: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-20T21:54:50.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:50 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:50.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:50 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/394702014' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-04-20T21:54:50.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:50 smithi142 ceph-mon[15828]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 3 up:standby 2024-04-20T21:54:50.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:50 smithi142 ceph-mon[15828]: pgmap v235: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-20T21:54:50.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:50 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:51.651 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:54:52.772 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:52 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:52.773 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:52 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:52.773 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:52 smithi142 ceph-mon[15828]: mds.? [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] up:standby 2024-04-20T21:54:52.773 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:52 smithi142 ceph-mon[15828]: mds.? [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] up:active 2024-04-20T21:54:52.773 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:52 smithi142 ceph-mon[15828]: mds.? [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] up:standby 2024-04-20T21:54:52.773 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:52 smithi142 ceph-mon[15828]: mds.? [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] up:standby 2024-04-20T21:54:52.773 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:52 smithi142 ceph-mon[15828]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 3 up:standby 2024-04-20T21:54:52.773 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:52 smithi142 ceph-mon[15828]: pgmap v236: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-20T21:54:52.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:52 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:52.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:52 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:52.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:52 smithi164 ceph-mon[23506]: mds.? [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] up:standby 2024-04-20T21:54:52.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:52 smithi164 ceph-mon[23506]: mds.? [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] up:active 2024-04-20T21:54:52.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:52 smithi164 ceph-mon[23506]: mds.? [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] up:standby 2024-04-20T21:54:52.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:52 smithi164 ceph-mon[23506]: mds.? [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] up:standby 2024-04-20T21:54:52.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:52 smithi164 ceph-mon[23506]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 3 up:standby 2024-04-20T21:54:52.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:52 smithi164 ceph-mon[23506]: pgmap v236: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-20T21:54:54.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.629+0000 7f6b25e00700 1 -- 172.21.15.142:0/79476850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b20100c00 msgr2=0x7f6b20101020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:54.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.629+0000 7f6b25e00700 1 --2- 172.21.15.142:0/79476850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b20100c00 0x7f6b20101020 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009910 tx=0x7f6b10009c20 comp rx=0 tx=0).stop 2024-04-20T21:54:54.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.629+0000 7f6b25e00700 1 -- 172.21.15.142:0/79476850 shutdown_connections 2024-04-20T21:54:54.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.629+0000 7f6b25e00700 1 --2- 172.21.15.142:0/79476850 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b20101e00 0x7f6b20102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:54.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.629+0000 7f6b25e00700 1 --2- 172.21.15.142:0/79476850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b20100c00 0x7f6b20101020 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:54.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.629+0000 7f6b25e00700 1 -- 172.21.15.142:0/79476850 >> 172.21.15.142:0/79476850 conn(0x7f6b200fc1c0 msgr2=0x7f6b200fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:54.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.629+0000 7f6b25e00700 1 -- 172.21.15.142:0/79476850 shutdown_connections 2024-04-20T21:54:54.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.629+0000 7f6b25e00700 1 -- 172.21.15.142:0/79476850 wait complete. 2024-04-20T21:54:54.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.630+0000 7f6b25e00700 1 Processor -- start 2024-04-20T21:54:54.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.631+0000 7f6b25e00700 1 -- start start 2024-04-20T21:54:54.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.631+0000 7f6b25e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b20100c00 0x7f6b20074be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:54.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.631+0000 7f6b25e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b20101e00 0x7f6b200732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:54.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.631+0000 7f6b25e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b20073810 con 0x7f6b20101e00 2024-04-20T21:54:54.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.631+0000 7f6b25e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b20073950 con 0x7f6b20100c00 2024-04-20T21:54:54.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.631+0000 7f6b17e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b20101e00 0x7f6b200732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:54.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.631+0000 7f6b17e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b20101e00 0x7f6b200732d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51820/0 (socket says 172.21.15.142:51820) 2024-04-20T21:54:54.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.631+0000 7f6b17e00700 1 -- 172.21.15.142:0/2352978520 learned_addr learned my addr 172.21.15.142:0/2352978520 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:54:54.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.631+0000 7f6b1ea00700 1 --2- 172.21.15.142:0/2352978520 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b20100c00 0x7f6b20074be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:54.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.632+0000 7f6b17e00700 1 -- 172.21.15.142:0/2352978520 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b20100c00 msgr2=0x7f6b20074be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:54.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.632+0000 7f6b17e00700 1 --2- 172.21.15.142:0/2352978520 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b20100c00 0x7f6b20074be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:54.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.632+0000 7f6b17e00700 1 -- 172.21.15.142:0/2352978520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b100095f0 con 0x7f6b20101e00 2024-04-20T21:54:54.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.632+0000 7f6b1ea00700 1 --2- 172.21.15.142:0/2352978520 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b20100c00 0x7f6b20074be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:54:54.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.632+0000 7f6b17e00700 1 --2- 172.21.15.142:0/2352978520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b20101e00 0x7f6b200732d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800d8d0 tx=0x7f6b0800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:54.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.632+0000 7f6b24a00700 1 -- 172.21.15.142:0/2352978520 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b08009940 con 0x7f6b20101e00 2024-04-20T21:54:54.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.632+0000 7f6b24a00700 1 -- 172.21.15.142:0/2352978520 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b08010460 con 0x7f6b20101e00 2024-04-20T21:54:54.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.633+0000 7f6b25e00700 1 -- 172.21.15.142:0/2352978520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b20073c30 con 0x7f6b20101e00 2024-04-20T21:54:54.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.633+0000 7f6b24a00700 1 -- 172.21.15.142:0/2352978520 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b0800f5f0 con 0x7f6b20101e00 2024-04-20T21:54:54.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.633+0000 7f6b25e00700 1 -- 172.21.15.142:0/2352978520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2019e6c0 con 0x7f6b20101e00 2024-04-20T21:54:54.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.634+0000 7f6b25e00700 1 -- 172.21.15.142:0/2352978520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b20190780 con 0x7f6b20101e00 2024-04-20T21:54:54.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.635+0000 7f6b24a00700 1 -- 172.21.15.142:0/2352978520 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f6b08009aa0 con 0x7f6b20101e00 2024-04-20T21:54:54.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.636+0000 7f6b24a00700 1 --2- 172.21.15.142:0/2352978520 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6b0406cce0 0x7f6b0406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:54.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.636+0000 7f6b24a00700 1 -- 172.21.15.142:0/2352978520 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f6b0808c2e0 con 0x7f6b20101e00 2024-04-20T21:54:54.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.636+0000 7f6b1ea00700 1 --2- 172.21.15.142:0/2352978520 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6b0406cce0 0x7f6b0406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:54.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.637+0000 7f6b1ea00700 1 --2- 172.21.15.142:0/2352978520 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6b0406cce0 0x7f6b0406f1a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6b10006010 tx=0x7f6b1000b540 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:54.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.641+0000 7f6b24a00700 1 -- 172.21.15.142:0/2352978520 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f6b0805a0a0 con 0x7f6b20101e00 2024-04-20T21:54:54.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.916+0000 7f6b25e00700 1 -- 172.21.15.142:0/2352978520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6b20062510 con 0x7f6b20101e00 2024-04-20T21:54:54.916 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.916+0000 7f6b24a00700 1 -- 172.21.15.142:0/2352978520 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1853 (secure 0 0 0) 0x7f6b08059c30 con 0x7f6b20101e00 2024-04-20T21:54:54.917 INFO:teuthology.orchestra.run.smithi142.stdout:e12 2024-04-20T21:54:54.918 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T21:54:54.918 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:54:54.918 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T21:54:54.918 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:54:54.918 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T21:54:54.918 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T21:54:54.918 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 12 2024-04-20T21:54:54.918 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T21:54:54.918 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T21:54:54.918 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:51.692699+0000 2024-04-20T21:54:54.918 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T21:54:54.918 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T21:54:54.918 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T21:54:54.919 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T21:54:54.919 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T21:54:54.919 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T21:54:54.919 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T21:54:54.919 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T21:54:54.919 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T21:54:54.919 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:54:54.919 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T21:54:54.919 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T21:54:54.919 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T21:54:54.919 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T21:54:54.919 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T21:54:54.919 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T21:54:54.919 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T21:54:54.919 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T21:54:54.919 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T21:54:54.920 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T21:54:54.920 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T21:54:54.920 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T21:54:54.920 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:54:54.920 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:54:54.920 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:54:54.920 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T21:54:54.920 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:54:54.920 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:54:54.920 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:54:54.920 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:54:54.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.921+0000 7f6b25e00700 1 -- 172.21.15.142:0/2352978520 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6b0406cce0 msgr2=0x7f6b0406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:54.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.921+0000 7f6b25e00700 1 --2- 172.21.15.142:0/2352978520 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6b0406cce0 0x7f6b0406f1a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6b10006010 tx=0x7f6b1000b540 comp rx=0 tx=0).stop 2024-04-20T21:54:54.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.921+0000 7f6b25e00700 1 -- 172.21.15.142:0/2352978520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b20101e00 msgr2=0x7f6b200732d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:54.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.921+0000 7f6b25e00700 1 --2- 172.21.15.142:0/2352978520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b20101e00 0x7f6b200732d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6b0800d8d0 tx=0x7f6b0800dc90 comp rx=0 tx=0).stop 2024-04-20T21:54:54.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.922+0000 7f6b25e00700 1 -- 172.21.15.142:0/2352978520 shutdown_connections 2024-04-20T21:54:54.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.922+0000 7f6b25e00700 1 --2- 172.21.15.142:0/2352978520 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f6b0406cce0 0x7f6b0406f1a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:54.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.922+0000 7f6b25e00700 1 --2- 172.21.15.142:0/2352978520 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6b20100c00 0x7f6b20074be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:54.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.922+0000 7f6b25e00700 1 --2- 172.21.15.142:0/2352978520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b20101e00 0x7f6b200732d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:54.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.922+0000 7f6b25e00700 1 -- 172.21.15.142:0/2352978520 >> 172.21.15.142:0/2352978520 conn(0x7f6b200fc1c0 msgr2=0x7f6b20105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:54.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.922+0000 7f6b25e00700 1 -- 172.21.15.142:0/2352978520 shutdown_connections 2024-04-20T21:54:54.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:54.922+0000 7f6b25e00700 1 -- 172.21.15.142:0/2352978520 wait complete. 2024-04-20T21:54:54.924 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T21:54:55.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:55 smithi142 ceph-mon[15828]: pgmap v237: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:55.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:55 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2352978520' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:54:55.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:55 smithi164 ceph-mon[23506]: pgmap v237: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:55.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:55 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/2352978520' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:54:55.914 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-04-20T21:54:56.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:56 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:54:56.321 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:54:56.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:56 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:54:57.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:57 smithi142 ceph-mon[15828]: pgmap v238: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:57.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:57 smithi164 ceph-mon[23506]: pgmap v238: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:58.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.486+0000 7f0fd0e00700 1 -- 172.21.15.142:0/2748995278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fcc076ae0 msgr2=0x7f0fcc076f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:58.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.486+0000 7f0fd0e00700 1 --2- 172.21.15.142:0/2748995278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fcc076ae0 0x7f0fcc076f60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8009910 tx=0x7f0fb8009c20 comp rx=0 tx=0).stop 2024-04-20T21:54:58.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.486+0000 7f0fd0e00700 1 -- 172.21.15.142:0/2748995278 shutdown_connections 2024-04-20T21:54:58.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.486+0000 7f0fd0e00700 1 --2- 172.21.15.142:0/2748995278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fcc076ae0 0x7f0fcc076f60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:58.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.486+0000 7f0fd0e00700 1 --2- 172.21.15.142:0/2748995278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fcc075890 0x7f0fcc075cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:58.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.486+0000 7f0fd0e00700 1 -- 172.21.15.142:0/2748995278 >> 172.21.15.142:0/2748995278 conn(0x7f0fcc0fe3d0 msgr2=0x7f0fcc1007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:58.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.486+0000 7f0fd0e00700 1 -- 172.21.15.142:0/2748995278 shutdown_connections 2024-04-20T21:54:58.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.486+0000 7f0fd0e00700 1 -- 172.21.15.142:0/2748995278 wait complete. 2024-04-20T21:54:58.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.488+0000 7f0fd0e00700 1 Processor -- start 2024-04-20T21:54:58.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.488+0000 7f0fd0e00700 1 -- start start 2024-04-20T21:54:58.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.488+0000 7f0fd0e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fcc075890 0x7f0fcc19cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:58.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.488+0000 7f0fd0e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fcc076ae0 0x7f0fcc19d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:58.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.489+0000 7f0fd0e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc19d6f0 con 0x7f0fcc076ae0 2024-04-20T21:54:58.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.489+0000 7f0fd0e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc19d830 con 0x7f0fcc075890 2024-04-20T21:54:58.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.489+0000 7f0fc9400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fcc076ae0 0x7f0fcc19d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:58.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.489+0000 7f0fc9400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fcc076ae0 0x7f0fcc19d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58286/0 (socket says 172.21.15.142:58286) 2024-04-20T21:54:58.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.489+0000 7f0fc9400700 1 -- 172.21.15.142:0/359360833 learned_addr learned my addr 172.21.15.142:0/359360833 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:54:58.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.489+0000 7f0fc9e00700 1 --2- 172.21.15.142:0/359360833 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fcc075890 0x7f0fcc19cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:58.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.489+0000 7f0fc9400700 1 -- 172.21.15.142:0/359360833 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fcc075890 msgr2=0x7f0fcc19cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:58.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.489+0000 7f0fc9400700 1 --2- 172.21.15.142:0/359360833 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fcc075890 0x7f0fcc19cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:58.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.489+0000 7f0fc9400700 1 -- 172.21.15.142:0/359360833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb80095f0 con 0x7f0fcc076ae0 2024-04-20T21:54:58.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.489+0000 7f0fc9e00700 1 --2- 172.21.15.142:0/359360833 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fcc075890 0x7f0fcc19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:54:58.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.490+0000 7f0fc9400700 1 --2- 172.21.15.142:0/359360833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fcc076ae0 0x7f0fcc19d0d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8005f30 tx=0x7f0fb8005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:58.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.490+0000 7f0fc2a00700 1 -- 172.21.15.142:0/359360833 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fb801d070 con 0x7f0fcc076ae0 2024-04-20T21:54:58.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.490+0000 7f0fc2a00700 1 -- 172.21.15.142:0/359360833 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0fb80052a0 con 0x7f0fcc076ae0 2024-04-20T21:54:58.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.490+0000 7f0fc2a00700 1 -- 172.21.15.142:0/359360833 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fb8017400 con 0x7f0fcc076ae0 2024-04-20T21:54:58.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.490+0000 7f0fd0e00700 1 -- 172.21.15.142:0/359360833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fcc1a2230 con 0x7f0fcc076ae0 2024-04-20T21:54:58.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.490+0000 7f0fd0e00700 1 -- 172.21.15.142:0/359360833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fcc1a2750 con 0x7f0fcc076ae0 2024-04-20T21:54:58.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.492+0000 7f0fd0e00700 1 -- 172.21.15.142:0/359360833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fcc196d80 con 0x7f0fcc076ae0 2024-04-20T21:54:58.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.493+0000 7f0fc2a00700 1 -- 172.21.15.142:0/359360833 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f0fb8003680 con 0x7f0fcc076ae0 2024-04-20T21:54:58.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.494+0000 7f0fc2a00700 1 --2- 172.21.15.142:0/359360833 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f0fb006cce0 0x7f0fb006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:54:58.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.494+0000 7f0fc2a00700 1 -- 172.21.15.142:0/359360833 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f0fb808d730 con 0x7f0fcc076ae0 2024-04-20T21:54:58.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.495+0000 7f0fc9e00700 1 --2- 172.21.15.142:0/359360833 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f0fb006cce0 0x7f0fb006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:54:58.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.495+0000 7f0fc9e00700 1 --2- 172.21.15.142:0/359360833 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f0fb006cce0 0x7f0fb006f1a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc011490 tx=0x7f0fbc009260 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:54:58.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.500+0000 7f0fc2a00700 1 -- 172.21.15.142:0/359360833 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f0fb805b4f0 con 0x7f0fcc076ae0 2024-04-20T21:54:58.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:58 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:58.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:58 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:58.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:58 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:54:58.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:58 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:54:58.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:58 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:58.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:58 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:54:58.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:58 smithi142 ceph-mon[15828]: pgmap v239: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:58.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:58 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:58.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:58 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:58.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:58 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:54:58.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:58 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:54:58.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:58 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:54:58.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:58 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:54:58.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:58 smithi164 ceph-mon[23506]: pgmap v239: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:54:58.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.854+0000 7f0fd0e00700 1 -- 172.21.15.142:0/359360833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fcc062510 con 0x7f0fcc076ae0 2024-04-20T21:54:58.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.855+0000 7f0fc2a00700 1 -- 172.21.15.142:0/359360833 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4835 (secure 0 0 0) 0x7f0fb805b080 con 0x7f0fcc076ae0 2024-04-20T21:54:58.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.857+0000 7f0fd0e00700 1 -- 172.21.15.142:0/359360833 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f0fb006cce0 msgr2=0x7f0fb006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:58.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.857+0000 7f0fd0e00700 1 --2- 172.21.15.142:0/359360833 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f0fb006cce0 0x7f0fb006f1a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc011490 tx=0x7f0fbc009260 comp rx=0 tx=0).stop 2024-04-20T21:54:58.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.857+0000 7f0fd0e00700 1 -- 172.21.15.142:0/359360833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fcc076ae0 msgr2=0x7f0fcc19d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:54:58.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.857+0000 7f0fd0e00700 1 --2- 172.21.15.142:0/359360833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fcc076ae0 0x7f0fcc19d0d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8005f30 tx=0x7f0fb8005960 comp rx=0 tx=0).stop 2024-04-20T21:54:58.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.857+0000 7f0fd0e00700 1 -- 172.21.15.142:0/359360833 shutdown_connections 2024-04-20T21:54:58.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.857+0000 7f0fd0e00700 1 --2- 172.21.15.142:0/359360833 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f0fb006cce0 0x7f0fb006f1a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:58.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.857+0000 7f0fd0e00700 1 --2- 172.21.15.142:0/359360833 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0fcc075890 0x7f0fcc19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:58.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.857+0000 7f0fd0e00700 1 --2- 172.21.15.142:0/359360833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fcc076ae0 0x7f0fcc19d0d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:54:58.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.857+0000 7f0fd0e00700 1 -- 172.21.15.142:0/359360833 >> 172.21.15.142:0/359360833 conn(0x7f0fcc0fe3d0 msgr2=0x7f0fcc10d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:54:58.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.858+0000 7f0fd0e00700 1 -- 172.21.15.142:0/359360833 shutdown_connections 2024-04-20T21:54:58.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:54:58.858+0000 7f0fd0e00700 1 -- 172.21.15.142:0/359360833 wait complete. 2024-04-20T21:54:58.858 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T21:54:58.872 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T21:54:59.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:54:59 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/359360833' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T21:54:59.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:54:59 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/359360833' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T21:55:00.006 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-04-20T21:55:00.750 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:55:00.897 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:00 smithi142 ceph-mon[15828]: pgmap v240: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:00.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:00 smithi164 ceph-mon[23506]: pgmap v240: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:02.416 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:02 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:55:02.416 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:02 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:55:02.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:02 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:55:02.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:02 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:55:03.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.179+0000 7fb30ba00700 1 -- 172.21.15.142:0/2070276307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb304107260 msgr2=0x7fb304107680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:03.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.179+0000 7fb30ba00700 1 --2- 172.21.15.142:0/2070276307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb304107260 0x7fb304107680 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009910 tx=0x7fb2f8009c20 comp rx=0 tx=0).stop 2024-04-20T21:55:03.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.179+0000 7fb30ba00700 1 -- 172.21.15.142:0/2070276307 shutdown_connections 2024-04-20T21:55:03.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.179+0000 7fb30ba00700 1 --2- 172.21.15.142:0/2070276307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb304108430 0x7fb3041088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:03.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.179+0000 7fb30ba00700 1 --2- 172.21.15.142:0/2070276307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb304107260 0x7fb304107680 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:03.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.179+0000 7fb30ba00700 1 -- 172.21.15.142:0/2070276307 >> 172.21.15.142:0/2070276307 conn(0x7fb304076400 msgr2=0x7fb304078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:03.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.179+0000 7fb30ba00700 1 -- 172.21.15.142:0/2070276307 shutdown_connections 2024-04-20T21:55:03.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.179+0000 7fb30ba00700 1 -- 172.21.15.142:0/2070276307 wait complete. 2024-04-20T21:55:03.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.180+0000 7fb30ba00700 1 Processor -- start 2024-04-20T21:55:03.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.181+0000 7fb30ba00700 1 -- start start 2024-04-20T21:55:03.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.181+0000 7fb30ba00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb304107260 0x7fb30419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:03.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.181+0000 7fb30ba00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb304108430 0x7fb30419d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:03.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.181+0000 7fb30ba00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30419d770 con 0x7fb304108430 2024-04-20T21:55:03.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.181+0000 7fb30ba00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30419d8b0 con 0x7fb304107260 2024-04-20T21:55:03.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.181+0000 7fb303e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb304108430 0x7fb30419d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:03.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.181+0000 7fb303e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb304108430 0x7fb30419d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58292/0 (socket says 172.21.15.142:58292) 2024-04-20T21:55:03.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.181+0000 7fb303e00700 1 -- 172.21.15.142:0/3065372504 learned_addr learned my addr 172.21.15.142:0/3065372504 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:03.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.182+0000 7fb309000700 1 --2- 172.21.15.142:0/3065372504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb304107260 0x7fb30419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:03.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.182+0000 7fb303e00700 1 -- 172.21.15.142:0/3065372504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb304107260 msgr2=0x7fb30419cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:03.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.182+0000 7fb303e00700 1 --2- 172.21.15.142:0/3065372504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb304107260 0x7fb30419cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:03.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.182+0000 7fb303e00700 1 -- 172.21.15.142:0/3065372504 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f80095f0 con 0x7fb304108430 2024-04-20T21:55:03.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.182+0000 7fb309000700 1 --2- 172.21.15.142:0/3065372504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb304107260 0x7fb30419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:55:03.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.182+0000 7fb303e00700 1 --2- 172.21.15.142:0/3065372504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb304108430 0x7fb30419d150 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000d8d0 tx=0x7fb2f000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:03.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.182+0000 7fb301600700 1 -- 172.21.15.142:0/3065372504 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2f0009940 con 0x7fb304108430 2024-04-20T21:55:03.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.182+0000 7fb301600700 1 -- 172.21.15.142:0/3065372504 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2f0010460 con 0x7fb304108430 2024-04-20T21:55:03.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.182+0000 7fb301600700 1 -- 172.21.15.142:0/3065372504 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2f000f5f0 con 0x7fb304108430 2024-04-20T21:55:03.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.182+0000 7fb30ba00700 1 -- 172.21.15.142:0/3065372504 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3041a2310 con 0x7fb304108430 2024-04-20T21:55:03.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.183+0000 7fb30ba00700 1 -- 172.21.15.142:0/3065372504 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3041a2890 con 0x7fb304108430 2024-04-20T21:55:03.183 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.184+0000 7fb30ba00700 1 -- 172.21.15.142:0/3065372504 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb304196dd0 con 0x7fb304108430 2024-04-20T21:55:03.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.185+0000 7fb301600700 1 -- 172.21.15.142:0/3065372504 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb2f00105d0 con 0x7fb304108430 2024-04-20T21:55:03.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.186+0000 7fb301600700 1 --2- 172.21.15.142:0/3065372504 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb2ec06cce0 0x7fb2ec06f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:03.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.186+0000 7fb301600700 1 -- 172.21.15.142:0/3065372504 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fb2f008c300 con 0x7fb304108430 2024-04-20T21:55:03.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.186+0000 7fb309000700 1 --2- 172.21.15.142:0/3065372504 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb2ec06cce0 0x7fb2ec06f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:03.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.187+0000 7fb309000700 1 --2- 172.21.15.142:0/3065372504 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb2ec06cce0 0x7fb2ec06f1a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80059d0 tx=0x7fb2f8005960 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:03.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.191+0000 7fb301600700 1 -- 172.21.15.142:0/3065372504 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fb2f005a0c0 con 0x7fb304108430 2024-04-20T21:55:03.190 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:03 smithi142 ceph-mon[15828]: pgmap v241: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:03.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:03 smithi164 ceph-mon[23506]: pgmap v241: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:03.520 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.521+0000 7fb30ba00700 1 -- 172.21.15.142:0/3065372504 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fb30404ebb0 con 0x7fb304108430 2024-04-20T21:55:03.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.522+0000 7fb301600700 1 -- 172.21.15.142:0/3065372504 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v12) v1 ==== 78+0+98 (secure 0 0 0) 0x7fb2f0059c50 con 0x7fb304108430 2024-04-20T21:55:03.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.525+0000 7fb30ba00700 1 -- 172.21.15.142:0/3065372504 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb2ec06cce0 msgr2=0x7fb2ec06f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:03.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.525+0000 7fb30ba00700 1 --2- 172.21.15.142:0/3065372504 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb2ec06cce0 0x7fb2ec06f1a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80059d0 tx=0x7fb2f8005960 comp rx=0 tx=0).stop 2024-04-20T21:55:03.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.525+0000 7fb30ba00700 1 -- 172.21.15.142:0/3065372504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb304108430 msgr2=0x7fb30419d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:03.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.525+0000 7fb30ba00700 1 --2- 172.21.15.142:0/3065372504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb304108430 0x7fb30419d150 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000d8d0 tx=0x7fb2f000dc90 comp rx=0 tx=0).stop 2024-04-20T21:55:03.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.525+0000 7fb30ba00700 1 -- 172.21.15.142:0/3065372504 shutdown_connections 2024-04-20T21:55:03.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.525+0000 7fb30ba00700 1 --2- 172.21.15.142:0/3065372504 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb2ec06cce0 0x7fb2ec06f1a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:03.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.525+0000 7fb30ba00700 1 --2- 172.21.15.142:0/3065372504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb304107260 0x7fb30419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:03.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.525+0000 7fb30ba00700 1 --2- 172.21.15.142:0/3065372504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb304108430 0x7fb30419d150 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:03.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.525+0000 7fb30ba00700 1 -- 172.21.15.142:0/3065372504 >> 172.21.15.142:0/3065372504 conn(0x7fb304076400 msgr2=0x7fb30410ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:03.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.525+0000 7fb30ba00700 1 -- 172.21.15.142:0/3065372504 shutdown_connections 2024-04-20T21:55:03.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:03.526+0000 7fb30ba00700 1 -- 172.21.15.142:0/3065372504 wait complete. 2024-04-20T21:55:03.540 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T21:55:04.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:04 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/3065372504' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-20T21:55:04.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:04 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/3065372504' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-20T21:55:05.051 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-04-20T21:55:05.063 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T21:55:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.275+0000 7f450ba00640 1 -- 172.21.15.142:0/3669254476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4504106700 msgr2=0x7f4504106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.275+0000 7f450ba00640 1 --2- 172.21.15.142:0/3669254476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4504106700 0x7f4504106b20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f44f8009880 tx=0x7f44f802bce0 comp rx=0 tx=0).stop 2024-04-20T21:55:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.275+0000 7f450ba00640 1 -- 172.21.15.142:0/3669254476 shutdown_connections 2024-04-20T21:55:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.275+0000 7f450ba00640 1 --2- 172.21.15.142:0/3669254476 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45041078f0 0x7f4504107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.275+0000 7f450ba00640 1 --2- 172.21.15.142:0/3669254476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4504106700 0x7f4504106b20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.275+0000 7f450ba00640 1 -- 172.21.15.142:0/3669254476 >> 172.21.15.142:0/3669254476 conn(0x7f4504075760 msgr2=0x7f4504077b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.276+0000 7f450ba00640 1 -- 172.21.15.142:0/3669254476 shutdown_connections 2024-04-20T21:55:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.276+0000 7f450ba00640 1 -- 172.21.15.142:0/3669254476 wait complete. 2024-04-20T21:55:05.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.276+0000 7f450ba00640 1 Processor -- start 2024-04-20T21:55:05.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.277+0000 7f450ba00640 1 -- start start 2024-04-20T21:55:05.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.277+0000 7f450ba00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4504106700 0x7f450419be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.277+0000 7f450ba00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45041078f0 0x7f450419c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.277+0000 7f450ba00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450419c8f0 con 0x7f45041078f0 2024-04-20T21:55:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.277+0000 7f450ba00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450419ca60 con 0x7f4504106700 2024-04-20T21:55:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.277+0000 7f4503e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45041078f0 0x7f450419c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.277+0000 7f4503e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45041078f0 0x7f450419c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58314/0 (socket says 172.21.15.142:58314) 2024-04-20T21:55:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.277+0000 7f4503e00640 1 -- 172.21.15.142:0/567602615 learned_addr learned my addr 172.21.15.142:0/567602615 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.277+0000 7f4503e00640 1 -- 172.21.15.142:0/567602615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4504106700 msgr2=0x7f450419be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.278+0000 7f4509000640 1 --2- 172.21.15.142:0/567602615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4504106700 0x7f450419be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.278+0000 7f4503e00640 1 --2- 172.21.15.142:0/567602615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4504106700 0x7f450419be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.278+0000 7f4503e00640 1 -- 172.21.15.142:0/567602615 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f8009560 con 0x7f45041078f0 2024-04-20T21:55:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.278+0000 7f4503e00640 1 --2- 172.21.15.142:0/567602615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45041078f0 0x7f450419c3b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f44f000c8a0 tx=0x7f44f000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.278+0000 7f4501600640 1 -- 172.21.15.142:0/567602615 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44f0007b80 con 0x7f45041078f0 2024-04-20T21:55:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.278+0000 7f4501600640 1 -- 172.21.15.142:0/567602615 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f44f0007ce0 con 0x7f45041078f0 2024-04-20T21:55:05.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.278+0000 7f4501600640 1 -- 172.21.15.142:0/567602615 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44f0018810 con 0x7f45041078f0 2024-04-20T21:55:05.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.278+0000 7f450ba00640 1 -- 172.21.15.142:0/567602615 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45041a1530 con 0x7f45041078f0 2024-04-20T21:55:05.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.278+0000 7f450ba00640 1 -- 172.21.15.142:0/567602615 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45041a1a90 con 0x7f45041078f0 2024-04-20T21:55:05.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.279+0000 7f450ba00640 1 -- 172.21.15.142:0/567602615 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450410f430 con 0x7f45041078f0 2024-04-20T21:55:05.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.281+0000 7f4501600640 1 -- 172.21.15.142:0/567602615 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f44f0018a80 con 0x7f45041078f0 2024-04-20T21:55:05.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.282+0000 7f4501600640 1 --2- 172.21.15.142:0/567602615 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f44ec06cd10 0x7f44ec06f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:05.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.282+0000 7f4501600640 1 -- 172.21.15.142:0/567602615 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f44f008c500 con 0x7f45041078f0 2024-04-20T21:55:05.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.282+0000 7f4509000640 1 --2- 172.21.15.142:0/567602615 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f44ec06cd10 0x7f44ec06f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:05.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.283+0000 7f4509000640 1 --2- 172.21.15.142:0/567602615 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f44ec06cd10 0x7f44ec06f1d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f44f802c7c0 tx=0x7f44f8005fd0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:05.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.287+0000 7f4501600640 1 -- 172.21.15.142:0/567602615 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f44f00568e0 con 0x7f45041078f0 2024-04-20T21:55:05.417 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:05 smithi142 ceph-mon[15828]: pgmap v242: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:05.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:05 smithi164 ceph-mon[23506]: pgmap v242: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:05.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.488+0000 7f450ba00640 1 -- 172.21.15.142:0/567602615 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45041a1d60 con 0x7f45041078f0 2024-04-20T21:55:05.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.489+0000 7f4501600640 1 -- 172.21.15.142:0/567602615 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+15057 (secure 0 0 0) 0x7f44f0059f00 con 0x7f45041078f0 2024-04-20T21:55:05.489 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:55:05.489 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":47,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","created":"2024-04-20T21:45:27.213653+0000","modified":"2024-04-20T21:54:32.443163+0000","last_up_change":"2024-04-20T21:52:57.146714+0000","last_in_change":"2024-04-20T21:52:31.576977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:51:10.763901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-20T21:54:29.338742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-20T21:54:29.935422+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0042c600-a874-4d57-bb8f-7b6f32723bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":477229295},{"type":"v1","addr":"172.21.15.142:6803","nonce":477229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":477229295},{"type":"v1","addr":"172.21.15.142:6805","nonce":477229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":477229295},{"type":"v1","addr":"172.21.15.142:6809","nonce":477229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":477229295},{"type":"v1","addr":"172.21.15.142:6807","nonce":477229295}]},"public_addr":"172.21.15.142:6803/477229295","cluster_addr":"172.21.15.142:6805/477229295","heartbeat_back_addr":"172.21.15.142:6809/477229295","heartbeat_front_addr":"172.21.15.142:6807/477229295","state":["exists","up"]},{"osd":1,"uuid":"29049537-368a-4d1f-b92c-21d962dd8031","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2225466348},{"type":"v1","addr":"172.21.15.142:6811","nonce":2225466348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2225466348},{"type":"v1","addr":"172.21.15.142:6813","nonce":2225466348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":2225466348},{"type":"v1","addr":"172.21.15.142:6817","nonce":2225466348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2225466348},{"type":"v1","addr":"172.21.15.142:6815","nonce":2225466348}]},"public_addr":"172.21.15.142:6811/2225466348","cluster_addr":"172.21.15.142:6813/2225466348","heartbeat_back_addr":"172.21.15.142:6817/2225466348","heartbeat_front_addr":"172.21.15.142:6815/2225466348","state":["exists","up"]},{"osd":2,"uuid":"4ea8215b-dc6f-4f18-9d2c-5a5b21e02fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1851191263},{"type":"v1","addr":"172.21.15.142:6819","nonce":1851191263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1851191263},{"type":"v1","addr":"172.21.15.142:6821","nonce":1851191263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1851191263},{"type":"v1","addr":"172.21.15.142:6825","nonce":1851191263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1851191263},{"type":"v1","addr":"172.21.15.142:6823","nonce":1851191263}]},"public_addr":"172.21.15.142:6819/1851191263","cluster_addr":"172.21.15.142:6821/1851191263","heartbeat_back_addr":"172.21.15.142:6825/1851191263","heartbeat_front_addr":"172.21.15.142:6823/1851191263","state":["exists","up"]},{"osd":3,"uuid":"981987e0-cff5-42e9-8129-2a08175c6ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":4283809575},{"type":"v1","addr":"172.21.15.164:6801","nonce":4283809575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":4283809575},{"type":"v1","addr":"172.21.15.164:6803","nonce":4283809575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":4283809575},{"type":"v1","addr":"172.21.15.164:6807","nonce":4283809575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":4283809575},{"type":"v1","addr":"172.21.15.164:6805","nonce":4283809575}]},"public_addr":"172.21.15.164:6801/4283809575","cluster_addr":"172.21.15.164:6803/4283809575","heartbeat_back_addr":"172.21.15.164:6807/4283809575","heartbeat_front_addr":"172.21.15.164:6805/4283809575","state":["exists","up"]},{"osd":4,"uuid":"a839fb7d-f82c-4bb0-8c33-b4f4f261bcae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3702640245},{"type":"v1","addr":"172.21.15.164:6809","nonce":3702640245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":3702640245},{"type":"v1","addr":"172.21.15.164:6811","nonce":3702640245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":3702640245},{"type":"v1","addr":"172.21.15.164:6815","nonce":3702640245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":3702640245},{"type":"v1","addr":"172.21.15.164:6813","nonce":3702640245}]},"public_addr":"172.21.15.164:6809/3702640245","cluster_addr":"172.21.15.164:6811/3702640245","heartbeat_back_addr":"172.21.15.164:6815/3702640245","heartbeat_front_addr":"172.21.15.164:6813/3702640245","state":["exists","up"]},{"osd":5,"uuid":"72378e50-3a51-469d-a402-489d9bbfed7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3340529941},{"type":"v1","addr":"172.21.15.164:6817","nonce":3340529941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3340529941},{"type":"v1","addr":"172.21.15.164:6819","nonce":3340529941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3340529941},{"type":"v1","addr":"172.21.15.164:6823","nonce":3340529941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3340529941},{"type":"v1","addr":"172.21.15.164:6821","nonce":3340529941}]},"public_addr":"172.21.15.164:6817/3340529941","cluster_addr":"172.21.15.164:6819/3340529941","heartbeat_back_addr":"172.21.15.164:6823/3340529941","heartbeat_front_addr":"172.21.15.164:6821/3340529941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:49:52.556673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:50:29.868343+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:51:07.890840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:51:43.365372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:52:18.872393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:52:54.318402+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/3515098784":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/195339089":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/4246233855":"2024-04-21T21:46:43.407590+0000","172.21.15.142:0/801898031":"2024-04-21T21:46:43.407590+0000","172.21.15.142:0/1140713527":"2024-04-21T21:46:01.678961+0000","172.21.15.142:6801/550675874":"2024-04-21T21:46:43.407590+0000","172.21.15.142:0/3501876256":"2024-04-21T21:46:01.678961+0000","172.21.15.142:6801/2803679129":"2024-04-21T21:46:01.678961+0000","172.21.15.142:6800/3464616902":"2024-04-21T21:48:09.914211+0000","172.21.15.142:6800/550675874":"2024-04-21T21:46:43.407590+0000","172.21.15.142:6800/2803679129":"2024-04-21T21:46:01.678961+0000","172.21.15.142:0/841637693":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/2901318326":"2024-04-21T21:46:01.678961+0000","172.21.15.142:6801/3464616902":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/680486182":"2024-04-21T21:46:43.407590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T21:55:05.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.493+0000 7f450ba00640 1 -- 172.21.15.142:0/567602615 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f44ec06cd10 msgr2=0x7f44ec06f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:05.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.493+0000 7f450ba00640 1 --2- 172.21.15.142:0/567602615 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f44ec06cd10 0x7f44ec06f1d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f44f802c7c0 tx=0x7f44f8005fd0 comp rx=0 tx=0).stop 2024-04-20T21:55:05.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.493+0000 7f450ba00640 1 -- 172.21.15.142:0/567602615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45041078f0 msgr2=0x7f450419c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:05.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.493+0000 7f450ba00640 1 --2- 172.21.15.142:0/567602615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45041078f0 0x7f450419c3b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f44f000c8a0 tx=0x7f44f000cd60 comp rx=0 tx=0).stop 2024-04-20T21:55:05.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.493+0000 7f450ba00640 1 -- 172.21.15.142:0/567602615 shutdown_connections 2024-04-20T21:55:05.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.493+0000 7f450ba00640 1 --2- 172.21.15.142:0/567602615 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f44ec06cd10 0x7f44ec06f1d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:05.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.493+0000 7f450ba00640 1 --2- 172.21.15.142:0/567602615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45041078f0 0x7f450419c3b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:05.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.493+0000 7f450ba00640 1 --2- 172.21.15.142:0/567602615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4504106700 0x7f450419be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:05.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.493+0000 7f450ba00640 1 -- 172.21.15.142:0/567602615 >> 172.21.15.142:0/567602615 conn(0x7f4504075760 msgr2=0x7f450410ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:05.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.494+0000 7f450ba00640 1 -- 172.21.15.142:0/567602615 shutdown_connections 2024-04-20T21:55:05.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.494+0000 7f450ba00640 1 -- 172.21.15.142:0/567602615 wait complete. 2024-04-20T21:55:05.513 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:51:10.763901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-20T21:54:29.338742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-20T21:54:29.935422+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T21:55:05.514 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T21:55:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.716+0000 7f6519000640 1 -- 172.21.15.142:0/2226879832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65141022d0 msgr2=0x7f65141026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.716+0000 7f6519000640 1 --2- 172.21.15.142:0/2226879832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65141022d0 0x7f65141026f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6504009880 tx=0x7f650402bce0 comp rx=0 tx=0).stop 2024-04-20T21:55:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.716+0000 7f6519000640 1 -- 172.21.15.142:0/2226879832 shutdown_connections 2024-04-20T21:55:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.716+0000 7f6519000640 1 --2- 172.21.15.142:0/2226879832 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65141034c0 0x7f6514103940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:05.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.716+0000 7f6519000640 1 --2- 172.21.15.142:0/2226879832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65141022d0 0x7f65141026f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.716+0000 7f6519000640 1 -- 172.21.15.142:0/2226879832 >> 172.21.15.142:0/2226879832 conn(0x7f65140fd840 msgr2=0x7f65140ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.716+0000 7f6519000640 1 -- 172.21.15.142:0/2226879832 shutdown_connections 2024-04-20T21:55:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.716+0000 7f6519000640 1 -- 172.21.15.142:0/2226879832 wait complete. 2024-04-20T21:55:05.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.717+0000 7f6519000640 1 Processor -- start 2024-04-20T21:55:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.717+0000 7f6519000640 1 -- start start 2024-04-20T21:55:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.717+0000 7f6519000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65141022d0 0x7f6514197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.717+0000 7f6519000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65141034c0 0x7f65141980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.718+0000 7f6519000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65141986a0 con 0x7f65141034c0 2024-04-20T21:55:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.718+0000 7f6519000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6514198810 con 0x7f65141022d0 2024-04-20T21:55:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.718+0000 7f650be00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65141034c0 0x7f65141980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.718+0000 7f650be00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65141034c0 0x7f65141980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58332/0 (socket says 172.21.15.142:58332) 2024-04-20T21:55:05.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.718+0000 7f650be00640 1 -- 172.21.15.142:0/1414642426 learned_addr learned my addr 172.21.15.142:0/1414642426 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.718+0000 7f6511e00640 1 --2- 172.21.15.142:0/1414642426 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65141022d0 0x7f6514197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.718+0000 7f650be00640 1 -- 172.21.15.142:0/1414642426 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65141022d0 msgr2=0x7f6514197b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.718+0000 7f650be00640 1 --2- 172.21.15.142:0/1414642426 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65141022d0 0x7f6514197b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.718+0000 7f650be00640 1 -- 172.21.15.142:0/1414642426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6504009560 con 0x7f65141034c0 2024-04-20T21:55:05.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.719+0000 7f650be00640 1 --2- 172.21.15.142:0/1414642426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65141034c0 0x7f65141980d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00d6f0 tx=0x7f64fc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:05.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.719+0000 7f650aa00640 1 -- 172.21.15.142:0/1414642426 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64fc009a30 con 0x7f65141034c0 2024-04-20T21:55:05.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.719+0000 7f650aa00640 1 -- 172.21.15.142:0/1414642426 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f64fc0054e0 con 0x7f65141034c0 2024-04-20T21:55:05.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.719+0000 7f650aa00640 1 -- 172.21.15.142:0/1414642426 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64fc010460 con 0x7f65141034c0 2024-04-20T21:55:05.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.719+0000 7f6519000640 1 -- 172.21.15.142:0/1414642426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f651419d2a0 con 0x7f65141034c0 2024-04-20T21:55:05.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.719+0000 7f6519000640 1 -- 172.21.15.142:0/1414642426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f651419d830 con 0x7f65141034c0 2024-04-20T21:55:05.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.720+0000 7f6519000640 1 -- 172.21.15.142:0/1414642426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f651410b020 con 0x7f65141034c0 2024-04-20T21:55:05.720 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.721+0000 7f650aa00640 1 -- 172.21.15.142:0/1414642426 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f64fc009b90 con 0x7f65141034c0 2024-04-20T21:55:05.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.722+0000 7f650aa00640 1 --2- 172.21.15.142:0/1414642426 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f64f806cc50 0x7f64f806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:05.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.722+0000 7f650aa00640 1 -- 172.21.15.142:0/1414642426 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f64fc08bea0 con 0x7f65141034c0 2024-04-20T21:55:05.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.722+0000 7f6511e00640 1 --2- 172.21.15.142:0/1414642426 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f64f806cc50 0x7f64f806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:05.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.723+0000 7f6511e00640 1 --2- 172.21.15.142:0/1414642426 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f64f806cc50 0x7f64f806f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6504006010 tx=0x7f650402cf90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:05.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.727+0000 7f650aa00640 1 -- 172.21.15.142:0/1414642426 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f64fc0561d0 con 0x7f65141034c0 2024-04-20T21:55:05.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.922+0000 7f6519000640 1 -- 172.21.15.142:0/1414642426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f651419daa0 con 0x7f65141034c0 2024-04-20T21:55:05.922 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.923+0000 7f650aa00640 1 -- 172.21.15.142:0/1414642426 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64fc0597f0 con 0x7f65141034c0 2024-04-20T21:55:05.922 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2024-04-20T21:55:05.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.926+0000 7f6519000640 1 -- 172.21.15.142:0/1414642426 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f64f806cc50 msgr2=0x7f64f806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:05.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.926+0000 7f6519000640 1 --2- 172.21.15.142:0/1414642426 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f64f806cc50 0x7f64f806f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6504006010 tx=0x7f650402cf90 comp rx=0 tx=0).stop 2024-04-20T21:55:05.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.926+0000 7f6519000640 1 -- 172.21.15.142:0/1414642426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65141034c0 msgr2=0x7f65141980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:05.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.926+0000 7f6519000640 1 --2- 172.21.15.142:0/1414642426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65141034c0 0x7f65141980d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00d6f0 tx=0x7f64fc00dbb0 comp rx=0 tx=0).stop 2024-04-20T21:55:05.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.926+0000 7f6519000640 1 -- 172.21.15.142:0/1414642426 shutdown_connections 2024-04-20T21:55:05.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.926+0000 7f6519000640 1 --2- 172.21.15.142:0/1414642426 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f64f806cc50 0x7f64f806f110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:05.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.926+0000 7f6519000640 1 --2- 172.21.15.142:0/1414642426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65141034c0 0x7f65141980d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:05.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.926+0000 7f6519000640 1 --2- 172.21.15.142:0/1414642426 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65141022d0 0x7f6514197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:05.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.926+0000 7f6519000640 1 -- 172.21.15.142:0/1414642426 >> 172.21.15.142:0/1414642426 conn(0x7f65140fd840 msgr2=0x7f65141066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:05.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.927+0000 7f6519000640 1 -- 172.21.15.142:0/1414642426 shutdown_connections 2024-04-20T21:55:05.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:05.927+0000 7f6519000640 1 -- 172.21.15.142:0/1414642426 wait complete. 2024-04-20T21:55:05.944 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-20T21:55:06.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.155+0000 7fa2d3200640 1 -- 172.21.15.142:0/739227991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d4101090 msgr2=0x7fa2d4101510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:06.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.155+0000 7fa2d3200640 1 --2- 172.21.15.142:0/739227991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d4101090 0x7fa2d4101510 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0009880 tx=0x7fa2c002bce0 comp rx=0 tx=0).stop 2024-04-20T21:55:06.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.155+0000 7fa2d3200640 1 -- 172.21.15.142:0/739227991 shutdown_connections 2024-04-20T21:55:06.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.155+0000 7fa2d3200640 1 --2- 172.21.15.142:0/739227991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d4101090 0x7fa2d4101510 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:06.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.155+0000 7fa2d3200640 1 --2- 172.21.15.142:0/739227991 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2d40ffeb0 0x7fa2d41002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:06.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.155+0000 7fa2d3200640 1 -- 172.21.15.142:0/739227991 >> 172.21.15.142:0/739227991 conn(0x7fa2d40fb470 msgr2=0x7fa2d40fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:06.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.155+0000 7fa2d3200640 1 -- 172.21.15.142:0/739227991 shutdown_connections 2024-04-20T21:55:06.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.155+0000 7fa2d3200640 1 -- 172.21.15.142:0/739227991 wait complete. 2024-04-20T21:55:06.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.156+0000 7fa2d3200640 1 Processor -- start 2024-04-20T21:55:06.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.156+0000 7fa2d3200640 1 -- start start 2024-04-20T21:55:06.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.156+0000 7fa2d3200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d40ffeb0 0x7fa2d4197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:06.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.156+0000 7fa2d3200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2d4101090 0x7fa2d4197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:06.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.156+0000 7fa2d3200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d4198490 con 0x7fa2d40ffeb0 2024-04-20T21:55:06.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.156+0000 7fa2d3200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d4198600 con 0x7fa2d4101090 2024-04-20T21:55:06.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.157+0000 7fa2d1e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d40ffeb0 0x7fa2d4197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:06.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.157+0000 7fa2d1e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d40ffeb0 0x7fa2d4197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58350/0 (socket says 172.21.15.142:58350) 2024-04-20T21:55:06.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.157+0000 7fa2d1e00640 1 -- 172.21.15.142:0/1726429706 learned_addr learned my addr 172.21.15.142:0/1726429706 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:06.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.157+0000 7fa2d1400640 1 --2- 172.21.15.142:0/1726429706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2d4101090 0x7fa2d4197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:06.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.157+0000 7fa2d1e00640 1 -- 172.21.15.142:0/1726429706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2d4101090 msgr2=0x7fa2d4197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:06.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.157+0000 7fa2d1e00640 1 --2- 172.21.15.142:0/1726429706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2d4101090 0x7fa2d4197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:06.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.157+0000 7fa2d1e00640 1 -- 172.21.15.142:0/1726429706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c0009560 con 0x7fa2d40ffeb0 2024-04-20T21:55:06.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.157+0000 7fa2d1400640 1 --2- 172.21.15.142:0/1726429706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2d4101090 0x7fa2d4197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:55:06.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.158+0000 7fa2d1e00640 1 --2- 172.21.15.142:0/1726429706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d40ffeb0 0x7fa2d4197980 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400d8d0 tx=0x7fa2c400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:06.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.158+0000 7fa2caa00640 1 -- 172.21.15.142:0/1726429706 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2c4009a30 con 0x7fa2d40ffeb0 2024-04-20T21:55:06.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.158+0000 7fa2caa00640 1 -- 172.21.15.142:0/1726429706 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa2c4009b90 con 0x7fa2d40ffeb0 2024-04-20T21:55:06.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.158+0000 7fa2d3200640 1 -- 172.21.15.142:0/1726429706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d419d090 con 0x7fa2d40ffeb0 2024-04-20T21:55:06.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.158+0000 7fa2caa00640 1 -- 172.21.15.142:0/1726429706 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2c400f680 con 0x7fa2d40ffeb0 2024-04-20T21:55:06.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.158+0000 7fa2d3200640 1 -- 172.21.15.142:0/1726429706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d419d670 con 0x7fa2d40ffeb0 2024-04-20T21:55:06.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.159+0000 7fa2d3200640 1 -- 172.21.15.142:0/1726429706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d4105170 con 0x7fa2d40ffeb0 2024-04-20T21:55:06.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.161+0000 7fa2caa00640 1 -- 172.21.15.142:0/1726429706 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa2c4010460 con 0x7fa2d40ffeb0 2024-04-20T21:55:06.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.162+0000 7fa2caa00640 1 --2- 172.21.15.142:0/1726429706 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa2b806cc50 0x7fa2b806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:06.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.162+0000 7fa2caa00640 1 -- 172.21.15.142:0/1726429706 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fa2c408c1c0 con 0x7fa2d40ffeb0 2024-04-20T21:55:06.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.162+0000 7fa2d1400640 1 --2- 172.21.15.142:0/1726429706 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa2b806cc50 0x7fa2b806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:06.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.163+0000 7fa2d1400640 1 --2- 172.21.15.142:0/1726429706 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa2b806cc50 0x7fa2b806f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4198e90 tx=0x7fa2c002cf90 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:06.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.167+0000 7fa2caa00640 1 -- 172.21.15.142:0/1726429706 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fa2c40564f0 con 0x7fa2d40ffeb0 2024-04-20T21:55:06.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:06 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/567602615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T21:55:06.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:06 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1414642426' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T21:55:06.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.357+0000 7fa2d3200640 1 -- 172.21.15.142:0/1726429706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fa2d402c460 con 0x7fa2d40ffeb0 2024-04-20T21:55:06.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.358+0000 7fa2caa00640 1 -- 172.21.15.142:0/1726429706 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa2c4059b10 con 0x7fa2d40ffeb0 2024-04-20T21:55:06.357 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2024-04-20T21:55:06.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.361+0000 7fa2d3200640 1 -- 172.21.15.142:0/1726429706 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa2b806cc50 msgr2=0x7fa2b806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:06.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.361+0000 7fa2d3200640 1 --2- 172.21.15.142:0/1726429706 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa2b806cc50 0x7fa2b806f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4198e90 tx=0x7fa2c002cf90 comp rx=0 tx=0).stop 2024-04-20T21:55:06.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.361+0000 7fa2d3200640 1 -- 172.21.15.142:0/1726429706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d40ffeb0 msgr2=0x7fa2d4197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:06.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.361+0000 7fa2d3200640 1 --2- 172.21.15.142:0/1726429706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d40ffeb0 0x7fa2d4197980 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400d8d0 tx=0x7fa2c400dd90 comp rx=0 tx=0).stop 2024-04-20T21:55:06.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.361+0000 7fa2d3200640 1 -- 172.21.15.142:0/1726429706 shutdown_connections 2024-04-20T21:55:06.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.361+0000 7fa2d3200640 1 --2- 172.21.15.142:0/1726429706 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa2b806cc50 0x7fa2b806f110 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:06.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.361+0000 7fa2d3200640 1 --2- 172.21.15.142:0/1726429706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2d4101090 0x7fa2d4197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:06.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.361+0000 7fa2d3200640 1 --2- 172.21.15.142:0/1726429706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d40ffeb0 0x7fa2d4197980 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:06.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.361+0000 7fa2d3200640 1 -- 172.21.15.142:0/1726429706 >> 172.21.15.142:0/1726429706 conn(0x7fa2d40fb470 msgr2=0x7fa2d4102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:06.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.361+0000 7fa2d3200640 1 -- 172.21.15.142:0/1726429706 shutdown_connections 2024-04-20T21:55:06.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.361+0000 7fa2d3200640 1 -- 172.21.15.142:0/1726429706 wait complete. 2024-04-20T21:55:06.380 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-20T21:55:06.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:06 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/567602615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T21:55:06.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:06 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/1414642426' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T21:55:06.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.562+0000 7fa699400640 1 -- 172.21.15.142:0/768072898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa694103350 msgr2=0x7fa694105740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:06.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.562+0000 7fa699400640 1 --2- 172.21.15.142:0/768072898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa694103350 0x7fa694105740 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa680009880 tx=0x7fa68002bce0 comp rx=0 tx=0).stop 2024-04-20T21:55:06.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.562+0000 7fa699400640 1 -- 172.21.15.142:0/768072898 shutdown_connections 2024-04-20T21:55:06.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.563+0000 7fa699400640 1 --2- 172.21.15.142:0/768072898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa694103350 0x7fa694105740 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:06.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.563+0000 7fa699400640 1 --2- 172.21.15.142:0/768072898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa694100a20 0x7fa694102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:06.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.563+0000 7fa699400640 1 -- 172.21.15.142:0/768072898 >> 172.21.15.142:0/768072898 conn(0x7fa6940fa330 msgr2=0x7fa6940fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:06.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.563+0000 7fa699400640 1 -- 172.21.15.142:0/768072898 shutdown_connections 2024-04-20T21:55:06.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.563+0000 7fa699400640 1 -- 172.21.15.142:0/768072898 wait complete. 2024-04-20T21:55:06.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.564+0000 7fa699400640 1 Processor -- start 2024-04-20T21:55:06.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.564+0000 7fa699400640 1 -- start start 2024-04-20T21:55:06.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.564+0000 7fa699400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa694100a20 0x7fa694100390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:06.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.564+0000 7fa699400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa694103350 0x7fa6940fe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:06.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.564+0000 7fa699400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940fef10 con 0x7fa694103350 2024-04-20T21:55:06.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.564+0000 7fa699400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940ff080 con 0x7fa694100a20 2024-04-20T21:55:06.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.564+0000 7fa693400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa694103350 0x7fa6940fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:06.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.564+0000 7fa693400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa694103350 0x7fa6940fe9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58378/0 (socket says 172.21.15.142:58378) 2024-04-20T21:55:06.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.564+0000 7fa693400640 1 -- 172.21.15.142:0/4260797364 learned_addr learned my addr 172.21.15.142:0/4260797364 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:06.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.565+0000 7fa693e00640 1 --2- 172.21.15.142:0/4260797364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa694100a20 0x7fa694100390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:06.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.565+0000 7fa693400640 1 -- 172.21.15.142:0/4260797364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa694100a20 msgr2=0x7fa694100390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:06.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.565+0000 7fa693400640 1 --2- 172.21.15.142:0/4260797364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa694100a20 0x7fa694100390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:06.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.565+0000 7fa693400640 1 -- 172.21.15.142:0/4260797364 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa680009560 con 0x7fa694103350 2024-04-20T21:55:06.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.565+0000 7fa693e00640 1 --2- 172.21.15.142:0/4260797364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa694100a20 0x7fa694100390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:55:06.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.565+0000 7fa693400640 1 --2- 172.21.15.142:0/4260797364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa694103350 0x7fa6940fe9d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa680009230 tx=0x7fa680004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:06.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.565+0000 7fa690c00640 1 -- 172.21.15.142:0/4260797364 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6800037c0 con 0x7fa694103350 2024-04-20T21:55:06.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.565+0000 7fa690c00640 1 -- 172.21.15.142:0/4260797364 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa680003de0 con 0x7fa694103350 2024-04-20T21:55:06.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.565+0000 7fa690c00640 1 -- 172.21.15.142:0/4260797364 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa680034440 con 0x7fa694103350 2024-04-20T21:55:06.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.565+0000 7fa699400640 1 -- 172.21.15.142:0/4260797364 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6940ff300 con 0x7fa694103350 2024-04-20T21:55:06.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.566+0000 7fa699400640 1 -- 172.21.15.142:0/4260797364 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69419d7f0 con 0x7fa694103350 2024-04-20T21:55:06.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.567+0000 7fa699400640 1 -- 172.21.15.142:0/4260797364 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69418f870 con 0x7fa694103350 2024-04-20T21:55:06.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.568+0000 7fa690c00640 1 -- 172.21.15.142:0/4260797364 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fa680004fb0 con 0x7fa694103350 2024-04-20T21:55:06.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.568+0000 7fa690c00640 1 --2- 172.21.15.142:0/4260797364 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa67806cc50 0x7fa67806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:06.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.569+0000 7fa690c00640 1 -- 172.21.15.142:0/4260797364 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fa6800ae6f0 con 0x7fa694103350 2024-04-20T21:55:06.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.569+0000 7fa693e00640 1 --2- 172.21.15.142:0/4260797364 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa67806cc50 0x7fa67806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:06.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.569+0000 7fa693e00640 1 --2- 172.21.15.142:0/4260797364 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa67806cc50 0x7fa67806f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa684009b40 tx=0x7fa684005e50 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:06.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.574+0000 7fa690c00640 1 -- 172.21.15.142:0/4260797364 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fa680078aa0 con 0x7fa694103350 2024-04-20T21:55:06.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.768+0000 7fa699400640 1 -- 172.21.15.142:0/4260797364 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fa694108af0 con 0x7fa694103350 2024-04-20T21:55:06.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.769+0000 7fa690c00640 1 -- 172.21.15.142:0/4260797364 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa680041020 con 0x7fa694103350 2024-04-20T21:55:06.769 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2024-04-20T21:55:06.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.772+0000 7fa699400640 1 -- 172.21.15.142:0/4260797364 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa67806cc50 msgr2=0x7fa67806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:06.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.772+0000 7fa699400640 1 --2- 172.21.15.142:0/4260797364 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa67806cc50 0x7fa67806f110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa684009b40 tx=0x7fa684005e50 comp rx=0 tx=0).stop 2024-04-20T21:55:06.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.772+0000 7fa699400640 1 -- 172.21.15.142:0/4260797364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa694103350 msgr2=0x7fa6940fe9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:06.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.772+0000 7fa699400640 1 --2- 172.21.15.142:0/4260797364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa694103350 0x7fa6940fe9d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa680009230 tx=0x7fa680004270 comp rx=0 tx=0).stop 2024-04-20T21:55:06.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.772+0000 7fa699400640 1 -- 172.21.15.142:0/4260797364 shutdown_connections 2024-04-20T21:55:06.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.772+0000 7fa699400640 1 --2- 172.21.15.142:0/4260797364 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fa67806cc50 0x7fa67806f110 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:06.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.772+0000 7fa699400640 1 --2- 172.21.15.142:0/4260797364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa694103350 0x7fa6940fe9d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:06.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.772+0000 7fa699400640 1 --2- 172.21.15.142:0/4260797364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa694100a20 0x7fa694100390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:06.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.772+0000 7fa699400640 1 -- 172.21.15.142:0/4260797364 >> 172.21.15.142:0/4260797364 conn(0x7fa6940fa330 msgr2=0x7fa6940fc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:06.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.772+0000 7fa699400640 1 -- 172.21.15.142:0/4260797364 shutdown_connections 2024-04-20T21:55:06.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.772+0000 7fa699400640 1 -- 172.21.15.142:0/4260797364 wait complete. 2024-04-20T21:55:06.789 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T21:55:06.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.997+0000 7f04fe800640 1 -- 172.21.15.142:0/1273834698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04f81032e0 msgr2=0x7f04f81056d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:06.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.997+0000 7f04fe800640 1 --2- 172.21.15.142:0/1273834698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04f81032e0 0x7f04f81056d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f04e40098b0 tx=0x7f04e402bcd0 comp rx=0 tx=0).stop 2024-04-20T21:55:06.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.997+0000 7f04fe800640 1 -- 172.21.15.142:0/1273834698 shutdown_connections 2024-04-20T21:55:06.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.997+0000 7f04fe800640 1 --2- 172.21.15.142:0/1273834698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04f81032e0 0x7f04f81056d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:06.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.997+0000 7f04fe800640 1 --2- 172.21.15.142:0/1273834698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f04f81009b0 0x7f04f8102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:06.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.997+0000 7f04fe800640 1 -- 172.21.15.142:0/1273834698 >> 172.21.15.142:0/1273834698 conn(0x7f04f80fa380 msgr2=0x7f04f80fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:06.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.997+0000 7f04fe800640 1 -- 172.21.15.142:0/1273834698 shutdown_connections 2024-04-20T21:55:06.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.997+0000 7f04fe800640 1 -- 172.21.15.142:0/1273834698 wait complete. 2024-04-20T21:55:06.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.998+0000 7f04fe800640 1 Processor -- start 2024-04-20T21:55:06.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.999+0000 7f04fe800640 1 -- start start 2024-04-20T21:55:06.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.999+0000 7f04fe800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f04f81009b0 0x7f04f8100320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:06.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.999+0000 7f04fe800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04f81032e0 0x7f04f80fe960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:06.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.999+0000 7f04fe800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80feea0 con 0x7f04f81032e0 2024-04-20T21:55:06.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.999+0000 7f04fe800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80ff010 con 0x7f04f81009b0 2024-04-20T21:55:07.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.999+0000 7f04fca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04f81032e0 0x7f04f80fe960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:07.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.999+0000 7f04fca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04f81032e0 0x7f04f80fe960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51706/0 (socket says 172.21.15.142:51706) 2024-04-20T21:55:07.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:06.999+0000 7f04fca00640 1 -- 172.21.15.142:0/1824179188 learned_addr learned my addr 172.21.15.142:0/1824179188 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:07.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.000+0000 7f04fd400640 1 --2- 172.21.15.142:0/1824179188 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f04f81009b0 0x7f04f8100320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:07.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.000+0000 7f04fca00640 1 -- 172.21.15.142:0/1824179188 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f04f81009b0 msgr2=0x7f04f8100320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:07.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.000+0000 7f04fca00640 1 --2- 172.21.15.142:0/1824179188 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f04f81009b0 0x7f04f8100320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:07.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.000+0000 7f04fca00640 1 -- 172.21.15.142:0/1824179188 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e4009560 con 0x7f04f81032e0 2024-04-20T21:55:07.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.000+0000 7f04fca00640 1 --2- 172.21.15.142:0/1824179188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04f81032e0 0x7f04f80fe960 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f04e4000c00 tx=0x7f04e4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:07.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.000+0000 7f04f6000640 1 -- 172.21.15.142:0/1824179188 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04e40037c0 con 0x7f04f81032e0 2024-04-20T21:55:07.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.000+0000 7f04fe800640 1 -- 172.21.15.142:0/1824179188 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f80ff290 con 0x7f04f81032e0 2024-04-20T21:55:07.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.000+0000 7f04f6000640 1 -- 172.21.15.142:0/1824179188 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f04e4003de0 con 0x7f04f81032e0 2024-04-20T21:55:07.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.001+0000 7f04f6000640 1 -- 172.21.15.142:0/1824179188 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04e4046450 con 0x7f04f81032e0 2024-04-20T21:55:07.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.001+0000 7f04fe800640 1 -- 172.21.15.142:0/1824179188 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f819d760 con 0x7f04f81032e0 2024-04-20T21:55:07.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.002+0000 7f04fe800640 1 -- 172.21.15.142:0/1824179188 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f818f840 con 0x7f04f81032e0 2024-04-20T21:55:07.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.003+0000 7f04f6000640 1 -- 172.21.15.142:0/1824179188 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f04e4004fd0 con 0x7f04f81032e0 2024-04-20T21:55:07.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.004+0000 7f04f6000640 1 --2- 172.21.15.142:0/1824179188 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f04e006cd10 0x7f04e006f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:07.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.004+0000 7f04f6000640 1 -- 172.21.15.142:0/1824179188 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f04e40aeb60 con 0x7f04f81032e0 2024-04-20T21:55:07.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.004+0000 7f04fd400640 1 --2- 172.21.15.142:0/1824179188 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f04e006cd10 0x7f04e006f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:07.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.005+0000 7f04fd400640 1 --2- 172.21.15.142:0/1824179188 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f04e006cd10 0x7f04e006f1d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f04ec005fd0 tx=0x7f04ec005850 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:07.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.009+0000 7f04f6000640 1 -- 172.21.15.142:0/1824179188 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f04e4078e90 con 0x7f04f81032e0 2024-04-20T21:55:07.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.302+0000 7f04fe800640 1 -- 172.21.15.142:0/1824179188 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04f8108ac0 con 0x7f04f81032e0 2024-04-20T21:55:07.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.303+0000 7f04f6000640 1 -- 172.21.15.142:0/1824179188 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4835 (secure 0 0 0) 0x7f04e407c4b0 con 0x7f04f81032e0 2024-04-20T21:55:07.302 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:55:07.302 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14484,"name":"cephfs.smithi142.lrvfgg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.142:6829/3327440588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3327440588},{"type":"v1","addr":"172.21.15.142:6829","nonce":3327440588}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24245,"name":"cephfs.smithi164.ybvzha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.164:6825/4054029190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":4054029190},{"type":"v1","addr":"172.21.15.164:6825","nonce":4054029190}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24253,"name":"cephfs.smithi164.gmmrfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.164:6827/3096926963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3096926963},{"type":"v1","addr":"172.21.15.164:6827","nonce":3096926963}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T21:54:51.692699+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14468},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14468":{"gid":14468,"name":"cephfs.smithi142.lirkws","rank":0,"incarnation":4,"state":"up:active","state_seq":6,"addr":"172.21.15.142:6827/2866697672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2866697672},{"type":"v1","addr":"172.21.15.142:6827","nonce":2866697672}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-20T21:55:07.302 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T21:55:07.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.305+0000 7f04fe800640 1 -- 172.21.15.142:0/1824179188 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f04e006cd10 msgr2=0x7f04e006f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:07.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.305+0000 7f04fe800640 1 --2- 172.21.15.142:0/1824179188 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f04e006cd10 0x7f04e006f1d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f04ec005fd0 tx=0x7f04ec005850 comp rx=0 tx=0).stop 2024-04-20T21:55:07.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.305+0000 7f04fe800640 1 -- 172.21.15.142:0/1824179188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04f81032e0 msgr2=0x7f04f80fe960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:07.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.305+0000 7f04fe800640 1 --2- 172.21.15.142:0/1824179188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04f81032e0 0x7f04f80fe960 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f04e4000c00 tx=0x7f04e4004270 comp rx=0 tx=0).stop 2024-04-20T21:55:07.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.305+0000 7f04fe800640 1 -- 172.21.15.142:0/1824179188 shutdown_connections 2024-04-20T21:55:07.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.305+0000 7f04fe800640 1 --2- 172.21.15.142:0/1824179188 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f04e006cd10 0x7f04e006f1d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:07.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.305+0000 7f04fe800640 1 --2- 172.21.15.142:0/1824179188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04f81032e0 0x7f04f80fe960 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:07.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.305+0000 7f04fe800640 1 --2- 172.21.15.142:0/1824179188 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f04f81009b0 0x7f04f8100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:07.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.305+0000 7f04fe800640 1 -- 172.21.15.142:0/1824179188 >> 172.21.15.142:0/1824179188 conn(0x7f04f80fa380 msgr2=0x7f04f80fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:07.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.305+0000 7f04fe800640 1 -- 172.21.15.142:0/1824179188 shutdown_connections 2024-04-20T21:55:07.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:07.306+0000 7f04fe800640 1 -- 172.21.15.142:0/1824179188 wait complete. 2024-04-20T21:55:07.324 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 12, 'max_mds': 1, 'flags': 18} 2024-04-20T21:55:07.324 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-20T21:55:07.350 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-20T21:55:07.350 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-04-20T21:55:07.350 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-20T21:55:07.350 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-20T21:55:07.350 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-20T21:55:07.350 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-20T21:55:07.350 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-20T21:55:07.350 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-20T21:55:07.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:07.351 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2024-04-20T21:55:07.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:07.411 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2024-04-20T21:55:07.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:07 smithi164 ceph-mon[23506]: pgmap v243: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:07.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:07 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/1726429706' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-20T21:55:07.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:07 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/4260797364' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-20T21:55:07.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:07 smithi142 ceph-mon[15828]: pgmap v243: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:07.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:07 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1726429706' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-20T21:55:07.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:07 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/4260797364' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-20T21:55:07.499 INFO:teuthology.orchestra.run.smithi164.stderr:Cannot find device "ceph-brx" 2024-04-20T21:55:07.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T21:55:07.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:07.502 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-04-20T21:55:07.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:07.551 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-04-20T21:55:07.657 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-04-20T21:55:07.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T21:55:07.661 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-20T21:55:07.661 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph fs ls 2024-04-20T21:55:08.044 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:55:08.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:08 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/1824179188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T21:55:08.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:08 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:55:08.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:08 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:55:08.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:08 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1824179188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T21:55:08.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:08 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:55:08.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:08 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:55:09.308 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:09 smithi142 ceph-mon[15828]: pgmap v244: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:09.308 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:09 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:55:09.309 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:09 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:55:09.309 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:09 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:55:09.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:09 smithi164 ceph-mon[23506]: pgmap v244: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:09 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:55:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:09 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:55:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:09 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:55:10.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.120+0000 7f1aad200700 1 -- 172.21.15.142:0/4013658892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1aa8073310 msgr2=0x7f1aa80736f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:10.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.120+0000 7f1aad200700 1 --2- 172.21.15.142:0/4013658892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1aa8073310 0x7f1aa80736f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009910 tx=0x7f1a98009c20 comp rx=0 tx=0).stop 2024-04-20T21:55:10.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.120+0000 7f1aad200700 1 -- 172.21.15.142:0/4013658892 shutdown_connections 2024-04-20T21:55:10.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.120+0000 7f1aad200700 1 --2- 172.21.15.142:0/4013658892 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1aa8073c30 0x7f1aa810ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:10.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.120+0000 7f1aad200700 1 --2- 172.21.15.142:0/4013658892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1aa8073310 0x7f1aa80736f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:10.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.120+0000 7f1aad200700 1 -- 172.21.15.142:0/4013658892 >> 172.21.15.142:0/4013658892 conn(0x7f1aa80fc6c0 msgr2=0x7f1aa80feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:10.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.120+0000 7f1aad200700 1 -- 172.21.15.142:0/4013658892 shutdown_connections 2024-04-20T21:55:10.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.120+0000 7f1aad200700 1 -- 172.21.15.142:0/4013658892 wait complete. 2024-04-20T21:55:10.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.121+0000 7f1aad200700 1 Processor -- start 2024-04-20T21:55:10.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.122+0000 7f1aad200700 1 -- start start 2024-04-20T21:55:10.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.122+0000 7f1aad200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1aa8073310 0x7f1aa8198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:10.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.122+0000 7f1aad200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1aa8073c30 0x7f1aa8199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:10.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.122+0000 7f1aad200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa8199a20 con 0x7f1aa8073310 2024-04-20T21:55:10.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.122+0000 7f1aad200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa819d6f0 con 0x7f1aa8073c30 2024-04-20T21:55:10.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.122+0000 7f1aa5e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1aa8073310 0x7f1aa8198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:10.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.122+0000 7f1aa5e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1aa8073310 0x7f1aa8198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51720/0 (socket says 172.21.15.142:51720) 2024-04-20T21:55:10.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.122+0000 7f1aa5e00700 1 -- 172.21.15.142:0/604199394 learned_addr learned my addr 172.21.15.142:0/604199394 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:10.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.123+0000 7f1a9fe00700 1 --2- 172.21.15.142:0/604199394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1aa8073c30 0x7f1aa8199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:10.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.123+0000 7f1aa5e00700 1 -- 172.21.15.142:0/604199394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1aa8073c30 msgr2=0x7f1aa8199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:10.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.123+0000 7f1aa5e00700 1 --2- 172.21.15.142:0/604199394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1aa8073c30 0x7f1aa8199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:10.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.123+0000 7f1aa5e00700 1 -- 172.21.15.142:0/604199394 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a980095f0 con 0x7f1aa8073310 2024-04-20T21:55:10.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.123+0000 7f1aa5e00700 1 --2- 172.21.15.142:0/604199394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1aa8073310 0x7f1aa8198e00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1a98006010 tx=0x7f1a9800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:10.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.123+0000 7f1a9ea00700 1 -- 172.21.15.142:0/604199394 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a9801d070 con 0x7f1aa8073310 2024-04-20T21:55:10.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.123+0000 7f1aad200700 1 -- 172.21.15.142:0/604199394 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa819d970 con 0x7f1aa8073310 2024-04-20T21:55:10.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.124+0000 7f1a9ea00700 1 -- 172.21.15.142:0/604199394 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a9800f460 con 0x7f1aa8073310 2024-04-20T21:55:10.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.124+0000 7f1a9ea00700 1 -- 172.21.15.142:0/604199394 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a98017630 con 0x7f1aa8073310 2024-04-20T21:55:10.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.124+0000 7f1aad200700 1 -- 172.21.15.142:0/604199394 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa819de60 con 0x7f1aa8073310 2024-04-20T21:55:10.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.125+0000 7f1aad200700 1 -- 172.21.15.142:0/604199394 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa80749c0 con 0x7f1aa8073310 2024-04-20T21:55:10.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.126+0000 7f1a9ea00700 1 -- 172.21.15.142:0/604199394 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1a9800f5d0 con 0x7f1aa8073310 2024-04-20T21:55:10.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.127+0000 7f1a9ea00700 1 --2- 172.21.15.142:0/604199394 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1a8c06cce0 0x7f1a8c06f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:10.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.127+0000 7f1a9ea00700 1 -- 172.21.15.142:0/604199394 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f1a9808d7c0 con 0x7f1aa8073310 2024-04-20T21:55:10.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.127+0000 7f1a9fe00700 1 --2- 172.21.15.142:0/604199394 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1a8c06cce0 0x7f1a8c06f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:10.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.128+0000 7f1a9fe00700 1 --2- 172.21.15.142:0/604199394 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1a8c06cce0 0x7f1a8c06f1a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1a90006fd0 tx=0x7f1a90008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:10.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.132+0000 7f1a9ea00700 1 -- 172.21.15.142:0/604199394 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f1a98057bb0 con 0x7f1aa8073310 2024-04-20T21:55:10.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.397+0000 7f1aad200700 1 -- 172.21.15.142:0/604199394 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1aa81077f0 con 0x7f1aa8073310 2024-04-20T21:55:10.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.398+0000 7f1a9ea00700 1 -- 172.21.15.142:0/604199394 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) v1 ==== 53+0+83 (secure 0 0 0) 0x7f1a9805b1d0 con 0x7f1aa8073310 2024-04-20T21:55:10.398 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-20T21:55:10.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.401+0000 7f1aad200700 1 -- 172.21.15.142:0/604199394 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1a8c06cce0 msgr2=0x7f1a8c06f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:10.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.401+0000 7f1aad200700 1 --2- 172.21.15.142:0/604199394 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1a8c06cce0 0x7f1a8c06f1a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1a90006fd0 tx=0x7f1a90008040 comp rx=0 tx=0).stop 2024-04-20T21:55:10.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.401+0000 7f1aad200700 1 -- 172.21.15.142:0/604199394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1aa8073310 msgr2=0x7f1aa8198e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:10.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.401+0000 7f1aad200700 1 --2- 172.21.15.142:0/604199394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1aa8073310 0x7f1aa8198e00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1a98006010 tx=0x7f1a9800be20 comp rx=0 tx=0).stop 2024-04-20T21:55:10.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.401+0000 7f1aad200700 1 -- 172.21.15.142:0/604199394 shutdown_connections 2024-04-20T21:55:10.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.401+0000 7f1aad200700 1 --2- 172.21.15.142:0/604199394 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1a8c06cce0 0x7f1a8c06f1a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:10.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.401+0000 7f1aad200700 1 --2- 172.21.15.142:0/604199394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1aa8073310 0x7f1aa8198e00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:10.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.401+0000 7f1aad200700 1 --2- 172.21.15.142:0/604199394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1aa8073c30 0x7f1aa8199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:10.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.401+0000 7f1aad200700 1 -- 172.21.15.142:0/604199394 >> 172.21.15.142:0/604199394 conn(0x7f1aa80fc6c0 msgr2=0x7f1aa8105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:10.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.401+0000 7f1aad200700 1 -- 172.21.15.142:0/604199394 shutdown_connections 2024-04-20T21:55:10.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:10.402+0000 7f1aad200700 1 -- 172.21.15.142:0/604199394 wait complete. 2024-04-20T21:55:11.158 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-20T21:55:11.159 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-20T21:55:11.159 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2024-04-20T21:55:11.159 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-20T21:55:11.159 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-20T21:55:11.159 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-20T21:55:11.159 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-20T21:55:11.159 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-20T21:55:11.159 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-20T21:55:11.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:11.159 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2024-04-20T21:55:11.216 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-20T21:55:11.216 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-20T21:55:11.217 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-04-20T21:55:11.217 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:55:11.217 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-04-20T21:55:11.217 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:55:11.217 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:55:11.217 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2024-04-20T21:55:11.217 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2024-04-20T21:55:11.217 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:55:11.217 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2024-04-20T21:55:11.217 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2024-04-20T21:55:11.217 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:55:11.217 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2024-04-20T21:55:11.217 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-20T21:55:11.217 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2024-04-20T21:55:11.218 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-20T21:55:11.218 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42204sec preferred_lft 42204sec 2024-04-20T21:55:11.218 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2024-04-20T21:55:11.218 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:55:11.219 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-20T21:55:11.219 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:55:11.219 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-04-20T21:55:11.219 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add name ceph-brx type bridge 2024-04-20T21:55:11.219 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr flush dev ceph-brx 2024-04-20T21:55:11.219 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set ceph-brx up 2024-04-20T21:55:11.219 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-20T21:55:11.219 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-04-20T21:55:11.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:55:11.354 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:11 smithi142 ceph-mon[15828]: pgmap v245: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:11.354 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:11 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:55:11.354 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:11 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/604199394' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-20T21:55:11.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:11 smithi164 ceph-mon[23506]: pgmap v245: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:11.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:11 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:55:11.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:11 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/604199394' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-20T21:55:11.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:55:11.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:11.720 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-20T21:55:11.788 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-04-20T21:55:11.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:11.791 DEBUG:teuthology.orchestra.run.smithi142:> route 2024-04-20T21:55:11.850 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2024-04-20T21:55:11.850 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-20T21:55:11.850 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-20T21:55:11.850 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-20T21:55:11.850 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-20T21:55:11.851 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:55:11.851 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-04-20T21:55:11.851 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-20T21:55:11.851 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-20T21:55:11.851 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-20T21:55:11.851 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-04-20T21:55:11.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:55:12.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:55:12.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:12.610 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-04-20T21:55:12.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:12.663 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2024-04-20T21:55:12.719 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:55:12.719 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-04-20T21:55:12.719 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:55:12.719 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-20T21:55:12.719 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-04-20T21:55:12.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:55:12.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:55:12.903 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-20T21:55:12.903 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:55:12.903 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-04-20T21:55:12.903 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-20T21:55:12.903 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-20T21:55:12.904 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-20T21:55:12.904 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-20T21:55:12.904 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-20T21:55:12.904 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-04-20T21:55:13.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:55:13.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:55:13.203 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:55:13.204 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-04-20T21:55:13.204 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2024-04-20T21:55:13.204 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.0 master ceph-brx 2024-04-20T21:55:13.204 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-04-20T21:55:13.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:55:13.357 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:13 smithi142 ceph-mon[15828]: pgmap v246: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:13.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:55:13.412 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-20T21:55:13.412 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T21:55:13.412 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-20T21:55:13.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:13 smithi164 ceph-mon[23506]: pgmap v246: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:13.457 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-20T21:55:13.457 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T21:55:13.457 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-20T21:55:13.553 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2024-04-20T21:55:13.633 DEBUG:teuthology.orchestra.run.smithi142:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:55:13.688 INFO:teuthology.orchestra.run.smithi142.stdout:/proc 2024-04-20T21:55:13.688 INFO:teuthology.orchestra.run.smithi142.stdout:/sys 2024-04-20T21:55:13.688 INFO:teuthology.orchestra.run.smithi142.stdout:/dev 2024-04-20T21:55:13.688 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/security 2024-04-20T21:55:13.688 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/shm 2024-04-20T21:55:13.688 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/pts 2024-04-20T21:55:13.688 INFO:teuthology.orchestra.run.smithi142.stdout:/run 2024-04-20T21:55:13.688 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/cgroup 2024-04-20T21:55:13.688 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/pstore 2024-04-20T21:55:13.688 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/bpf 2024-04-20T21:55:13.689 INFO:teuthology.orchestra.run.smithi142.stdout:/ 2024-04-20T21:55:13.689 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/selinux 2024-04-20T21:55:13.689 INFO:teuthology.orchestra.run.smithi142.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:55:13.689 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/mqueue 2024-04-20T21:55:13.689 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/hugepages 2024-04-20T21:55:13.689 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/debug 2024-04-20T21:55:13.689 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/tracing 2024-04-20T21:55:13.689 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/fuse/connections 2024-04-20T21:55:13.689 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/config 2024-04-20T21:55:13.689 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:55:13.689 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:55:13.689 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:55:13.689 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:55:13.689 INFO:teuthology.orchestra.run.smithi142.stdout:/run/user/1000 2024-04-20T21:55:13.690 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph 2024-04-20T21:55:13.690 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay 2024-04-20T21:55:13.690 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/bf841ace6667038d6b9e0497621bb14b4d52549dcf99d4d737a10e3a14c33734/merged 2024-04-20T21:55:13.690 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/800a714522ca30374af47f09dbdc538788d2e532bba8e39c073f314d67a3021c/merged 2024-04-20T21:55:13.690 INFO:teuthology.orchestra.run.smithi142.stdout:/run/user/0 2024-04-20T21:55:13.690 INFO:teuthology.orchestra.run.smithi142.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:55:13.690 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/a8f69b677ba208e069d66c8bee994a6dcb1c51cb6f69970b53a8eb86bfa0887e/merged 2024-04-20T21:55:13.690 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/f256a61f279bab5e02355ff73170b07e35ab9f5a4d2cb89cb7fc560fcd7ed30f/merged 2024-04-20T21:55:13.690 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/d720afc4630b051a5560b51ad228923dcff4e01f81fc6f270fc80a7f32035ebd/merged 2024-04-20T21:55:13.690 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/5ea9d2e26a6f1b90a66efd8cb682f85fb1067f43fff48c8d6c0e9254bee66b77/merged 2024-04-20T21:55:13.690 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/4eb94a0988efd5666cce53babfa347e2dcd992df09e90c42ddf56be79257fabd/merged 2024-04-20T21:55:13.690 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/7a4281497814b3b1aecb52a0be40aa2d9c91a37cdd0fc8716cfde250ff1c0154/merged 2024-04-20T21:55:13.690 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/bb01639520ad110b6addcd437ab22fb43aadc10a51b21f4e5d75e98bfe957160/merged 2024-04-20T21:55:13.691 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/0cc6ba204084c88c4e763b6cffae8fbbfc59c616fcf8de1ccbda6f65feab8af0/merged 2024-04-20T21:55:13.691 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/de891b2f49fac9a62e6ad8f3be6edd7b2dd2ba293a229f360cb3385b757eefb3/merged 2024-04-20T21:55:13.691 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/aa0a64d4e05f4d45bc70b26440af78e4f32f59cc23b062f97f4990d9f92de502/merged 2024-04-20T21:55:13.691 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/d8ea2626e39d94d46c4be0459ea11d58374d4f6d16930c0fc53e5e9a9e17eda2/merged 2024-04-20T21:55:13.691 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns 2024-04-20T21:55:13.691 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:55:13.691 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:55:13.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:13.692 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2024-04-20T21:55:13.742 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-20T21:55:13.742 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-20T21:55:13.747 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2024-04-20T21:55:13.816 DEBUG:teuthology.orchestra.run.smithi142:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:55:13.864 INFO:teuthology.orchestra.run.smithi142.stdout:/proc 2024-04-20T21:55:13.864 INFO:teuthology.orchestra.run.smithi142.stdout:/sys 2024-04-20T21:55:13.864 INFO:teuthology.orchestra.run.smithi142.stdout:/dev 2024-04-20T21:55:13.864 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/security 2024-04-20T21:55:13.864 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/shm 2024-04-20T21:55:13.864 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/pts 2024-04-20T21:55:13.864 INFO:teuthology.orchestra.run.smithi142.stdout:/run 2024-04-20T21:55:13.864 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/cgroup 2024-04-20T21:55:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/pstore 2024-04-20T21:55:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/bpf 2024-04-20T21:55:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:/ 2024-04-20T21:55:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/selinux 2024-04-20T21:55:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:55:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/mqueue 2024-04-20T21:55:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/hugepages 2024-04-20T21:55:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/debug 2024-04-20T21:55:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/tracing 2024-04-20T21:55:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/fuse/connections 2024-04-20T21:55:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/config 2024-04-20T21:55:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:55:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:55:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:55:13.865 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:55:13.866 INFO:teuthology.orchestra.run.smithi142.stdout:/run/user/1000 2024-04-20T21:55:13.866 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph 2024-04-20T21:55:13.866 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay 2024-04-20T21:55:13.866 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/bf841ace6667038d6b9e0497621bb14b4d52549dcf99d4d737a10e3a14c33734/merged 2024-04-20T21:55:13.866 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/800a714522ca30374af47f09dbdc538788d2e532bba8e39c073f314d67a3021c/merged 2024-04-20T21:55:13.866 INFO:teuthology.orchestra.run.smithi142.stdout:/run/user/0 2024-04-20T21:55:13.866 INFO:teuthology.orchestra.run.smithi142.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:55:13.866 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/a8f69b677ba208e069d66c8bee994a6dcb1c51cb6f69970b53a8eb86bfa0887e/merged 2024-04-20T21:55:13.866 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/f256a61f279bab5e02355ff73170b07e35ab9f5a4d2cb89cb7fc560fcd7ed30f/merged 2024-04-20T21:55:13.866 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/d720afc4630b051a5560b51ad228923dcff4e01f81fc6f270fc80a7f32035ebd/merged 2024-04-20T21:55:13.866 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/5ea9d2e26a6f1b90a66efd8cb682f85fb1067f43fff48c8d6c0e9254bee66b77/merged 2024-04-20T21:55:13.866 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/4eb94a0988efd5666cce53babfa347e2dcd992df09e90c42ddf56be79257fabd/merged 2024-04-20T21:55:13.866 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/7a4281497814b3b1aecb52a0be40aa2d9c91a37cdd0fc8716cfde250ff1c0154/merged 2024-04-20T21:55:13.866 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/bb01639520ad110b6addcd437ab22fb43aadc10a51b21f4e5d75e98bfe957160/merged 2024-04-20T21:55:13.867 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/0cc6ba204084c88c4e763b6cffae8fbbfc59c616fcf8de1ccbda6f65feab8af0/merged 2024-04-20T21:55:13.867 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/de891b2f49fac9a62e6ad8f3be6edd7b2dd2ba293a229f360cb3385b757eefb3/merged 2024-04-20T21:55:13.867 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/aa0a64d4e05f4d45bc70b26440af78e4f32f59cc23b062f97f4990d9f92de502/merged 2024-04-20T21:55:13.867 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/d8ea2626e39d94d46c4be0459ea11d58374d4f6d16930c0fc53e5e9a9e17eda2/merged 2024-04-20T21:55:13.867 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns 2024-04-20T21:55:13.867 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:55:13.867 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:55:13.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:13.868 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2024-04-20T21:55:13.941 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi142.stderr:2024-04-20T21:55:13.942+0000 7f595d045480 -1 init, newargv = 0x558ff9879580 newargc=15 2024-04-20T21:55:13.942 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi142.stderr:ceph-fuse[63446]: starting ceph client 2024-04-20T21:55:13.955 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi142.stderr:ceph-fuse[63446]: starting fuse 2024-04-20T21:55:15.012 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2024-04-20T21:55:15.108 DEBUG:teuthology.orchestra.run.smithi142:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:55:15.166 INFO:teuthology.orchestra.run.smithi142.stdout:/proc 2024-04-20T21:55:15.167 INFO:teuthology.orchestra.run.smithi142.stdout:/sys 2024-04-20T21:55:15.167 INFO:teuthology.orchestra.run.smithi142.stdout:/dev 2024-04-20T21:55:15.167 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/security 2024-04-20T21:55:15.167 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/shm 2024-04-20T21:55:15.167 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/pts 2024-04-20T21:55:15.167 INFO:teuthology.orchestra.run.smithi142.stdout:/run 2024-04-20T21:55:15.167 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/cgroup 2024-04-20T21:55:15.167 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/pstore 2024-04-20T21:55:15.167 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/bpf 2024-04-20T21:55:15.167 INFO:teuthology.orchestra.run.smithi142.stdout:/ 2024-04-20T21:55:15.167 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/selinux 2024-04-20T21:55:15.167 INFO:teuthology.orchestra.run.smithi142.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:55:15.167 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/mqueue 2024-04-20T21:55:15.168 INFO:teuthology.orchestra.run.smithi142.stdout:/dev/hugepages 2024-04-20T21:55:15.168 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/debug 2024-04-20T21:55:15.168 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/tracing 2024-04-20T21:55:15.168 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/fs/fuse/connections 2024-04-20T21:55:15.168 INFO:teuthology.orchestra.run.smithi142.stdout:/sys/kernel/config 2024-04-20T21:55:15.168 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:55:15.168 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:55:15.168 INFO:teuthology.orchestra.run.smithi142.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:55:15.168 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:55:15.168 INFO:teuthology.orchestra.run.smithi142.stdout:/run/user/1000 2024-04-20T21:55:15.168 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/ceph 2024-04-20T21:55:15.168 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay 2024-04-20T21:55:15.168 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/bf841ace6667038d6b9e0497621bb14b4d52549dcf99d4d737a10e3a14c33734/merged 2024-04-20T21:55:15.168 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/800a714522ca30374af47f09dbdc538788d2e532bba8e39c073f314d67a3021c/merged 2024-04-20T21:55:15.169 INFO:teuthology.orchestra.run.smithi142.stdout:/run/user/0 2024-04-20T21:55:15.169 INFO:teuthology.orchestra.run.smithi142.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:55:15.169 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/a8f69b677ba208e069d66c8bee994a6dcb1c51cb6f69970b53a8eb86bfa0887e/merged 2024-04-20T21:55:15.169 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/f256a61f279bab5e02355ff73170b07e35ab9f5a4d2cb89cb7fc560fcd7ed30f/merged 2024-04-20T21:55:15.169 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/d720afc4630b051a5560b51ad228923dcff4e01f81fc6f270fc80a7f32035ebd/merged 2024-04-20T21:55:15.169 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/5ea9d2e26a6f1b90a66efd8cb682f85fb1067f43fff48c8d6c0e9254bee66b77/merged 2024-04-20T21:55:15.169 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/4eb94a0988efd5666cce53babfa347e2dcd992df09e90c42ddf56be79257fabd/merged 2024-04-20T21:55:15.169 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/7a4281497814b3b1aecb52a0be40aa2d9c91a37cdd0fc8716cfde250ff1c0154/merged 2024-04-20T21:55:15.169 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/bb01639520ad110b6addcd437ab22fb43aadc10a51b21f4e5d75e98bfe957160/merged 2024-04-20T21:55:15.169 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/0cc6ba204084c88c4e763b6cffae8fbbfc59c616fcf8de1ccbda6f65feab8af0/merged 2024-04-20T21:55:15.169 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/de891b2f49fac9a62e6ad8f3be6edd7b2dd2ba293a229f360cb3385b757eefb3/merged 2024-04-20T21:55:15.169 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/aa0a64d4e05f4d45bc70b26440af78e4f32f59cc23b062f97f4990d9f92de502/merged 2024-04-20T21:55:15.169 INFO:teuthology.orchestra.run.smithi142.stdout:/var/lib/containers/storage/overlay/d8ea2626e39d94d46c4be0459ea11d58374d4f6d16930c0fc53e5e9a9e17eda2/merged 2024-04-20T21:55:15.170 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns 2024-04-20T21:55:15.170 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:55:15.170 INFO:teuthology.orchestra.run.smithi142.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T21:55:15.170 INFO:teuthology.orchestra.run.smithi142.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-20T21:55:15.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:15.171 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2024-04-20T21:55:15.223 INFO:teuthology.orchestra.run.smithi142.stdout:155 2024-04-20T21:55:15.223 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [155] 2024-04-20T21:55:15.224 DEBUG:teuthology.orchestra.run.smithi142:> sudo stdin-killer -- python3 -c ' 2024-04-20T21:55:15.224 DEBUG:teuthology.orchestra.run.smithi142:> import glob 2024-04-20T21:55:15.224 DEBUG:teuthology.orchestra.run.smithi142:> import re 2024-04-20T21:55:15.224 DEBUG:teuthology.orchestra.run.smithi142:> import os 2024-04-20T21:55:15.224 DEBUG:teuthology.orchestra.run.smithi142:> import subprocess 2024-04-20T21:55:15.224 DEBUG:teuthology.orchestra.run.smithi142:> 2024-04-20T21:55:15.224 DEBUG:teuthology.orchestra.run.smithi142:> def _find_admin_socket(client_name): 2024-04-20T21:55:15.224 DEBUG:teuthology.orchestra.run.smithi142:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-20T21:55:15.224 DEBUG:teuthology.orchestra.run.smithi142:> files = glob.glob(asok_path) 2024-04-20T21:55:15.224 DEBUG:teuthology.orchestra.run.smithi142:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-20T21:55:15.224 DEBUG:teuthology.orchestra.run.smithi142:> 2024-04-20T21:55:15.224 DEBUG:teuthology.orchestra.run.smithi142:> # Given a non-glob path, it better be there 2024-04-20T21:55:15.224 DEBUG:teuthology.orchestra.run.smithi142:> if "*" not in asok_path: 2024-04-20T21:55:15.224 DEBUG:teuthology.orchestra.run.smithi142:> assert(len(files) == 1) 2024-04-20T21:55:15.225 DEBUG:teuthology.orchestra.run.smithi142:> return files[0] 2024-04-20T21:55:15.225 DEBUG:teuthology.orchestra.run.smithi142:> 2024-04-20T21:55:15.225 DEBUG:teuthology.orchestra.run.smithi142:> for f in files: 2024-04-20T21:55:15.225 DEBUG:teuthology.orchestra.run.smithi142:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-20T21:55:15.225 DEBUG:teuthology.orchestra.run.smithi142:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-20T21:55:15.225 DEBUG:teuthology.orchestra.run.smithi142:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-20T21:55:15.225 DEBUG:teuthology.orchestra.run.smithi142:> contents = proc_f.read() 2024-04-20T21:55:15.225 DEBUG:teuthology.orchestra.run.smithi142:> if mountpoint in contents: 2024-04-20T21:55:15.225 DEBUG:teuthology.orchestra.run.smithi142:> return f 2024-04-20T21:55:15.225 DEBUG:teuthology.orchestra.run.smithi142:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-20T21:55:15.225 DEBUG:teuthology.orchestra.run.smithi142:> 2024-04-20T21:55:15.225 DEBUG:teuthology.orchestra.run.smithi142:> print(_find_admin_socket("client.0")) 2024-04-20T21:55:15.225 DEBUG:teuthology.orchestra.run.smithi142:> ' 2024-04-20T21:55:15.390 INFO:teuthology.orchestra.run.smithi142.stdout:/var/run/ceph/ceph-client.0.63446.asok 2024-04-20T21:55:15.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:55:15.404 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:15 smithi142 ceph-mon[15828]: pgmap v247: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:15.407 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.63446.asok 2024-04-20T21:55:15.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:15.407 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.63446.asok status 2024-04-20T21:55:15.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:15 smithi164 ceph-mon[23506]: pgmap v247: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:15.626 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T21:55:15.626 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": { 2024-04-20T21:55:15.626 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_sha1": "9d98999acebbad2663cc4938e94c9ffd83485cbd", 2024-04-20T21:55:15.626 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_version": "ceph version 18.2.2 (9d98999acebbad2663cc4938e94c9ffd83485cbd) reef (stable)", 2024-04-20T21:55:15.627 INFO:teuthology.orchestra.run.smithi142.stdout: "entity_id": "0", 2024-04-20T21:55:15.627 INFO:teuthology.orchestra.run.smithi142.stdout: "hostname": "smithi142", 2024-04-20T21:55:15.627 INFO:teuthology.orchestra.run.smithi142.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-20T21:55:15.627 INFO:teuthology.orchestra.run.smithi142.stdout: "pid": "63446", 2024-04-20T21:55:15.627 INFO:teuthology.orchestra.run.smithi142.stdout: "root": "/" 2024-04-20T21:55:15.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:55:15.627 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_count": 0, 2024-04-20T21:55:15.627 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_pinned_count": 0, 2024-04-20T21:55:15.627 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 14536, 2024-04-20T21:55:15.627 INFO:teuthology.orchestra.run.smithi142.stdout: "inst": { 2024-04-20T21:55:15.627 INFO:teuthology.orchestra.run.smithi142.stdout: "name": { 2024-04-20T21:55:15.627 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "client", 2024-04-20T21:55:15.627 INFO:teuthology.orchestra.run.smithi142.stdout: "num": 14536 2024-04-20T21:55:15.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:55:15.628 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2024-04-20T21:55:15.628 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2024-04-20T21:55:15.628 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "192.168.0.1:0", 2024-04-20T21:55:15.628 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 1982029803 2024-04-20T21:55:15.628 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T21:55:15.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:55:15.628 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2024-04-20T21:55:15.628 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2024-04-20T21:55:15.628 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "192.168.0.1:0", 2024-04-20T21:55:15.628 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 1982029803 2024-04-20T21:55:15.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:55:15.628 INFO:teuthology.orchestra.run.smithi142.stdout: "inst_str": "client.14536 192.168.0.1:0/1982029803", 2024-04-20T21:55:15.628 INFO:teuthology.orchestra.run.smithi142.stdout: "addr_str": "192.168.0.1:0/1982029803", 2024-04-20T21:55:15.629 INFO:teuthology.orchestra.run.smithi142.stdout: "inode_count": 1, 2024-04-20T21:55:15.629 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_epoch": 12, 2024-04-20T21:55:15.629 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch": 47, 2024-04-20T21:55:15.629 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch_barrier": 0, 2024-04-20T21:55:15.629 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklisted": false, 2024-04-20T21:55:15.629 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs" 2024-04-20T21:55:15.629 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T21:55:15.640 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- ceph fs ls 2024-04-20T21:55:16.030 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:55:17.211 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:17 smithi142 ceph-mon[15828]: pgmap v248: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:17.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:17 smithi164 ceph-mon[23506]: pgmap v248: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:18.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.168+0000 7fd63a600700 1 -- 172.21.15.142:0/3104831935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd634107520 msgr2=0x7fd634107900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:18.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.168+0000 7fd63a600700 1 --2- 172.21.15.142:0/3104831935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd634107520 0x7fd634107900 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd624009910 tx=0x7fd624009c20 comp rx=0 tx=0).stop 2024-04-20T21:55:18.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.168+0000 7fd63a600700 1 -- 172.21.15.142:0/3104831935 shutdown_connections 2024-04-20T21:55:18.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.168+0000 7fd63a600700 1 --2- 172.21.15.142:0/3104831935 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd634108e10 0x7fd634109290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:18.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.168+0000 7fd63a600700 1 --2- 172.21.15.142:0/3104831935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd634107520 0x7fd634107900 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:18.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.168+0000 7fd63a600700 1 -- 172.21.15.142:0/3104831935 >> 172.21.15.142:0/3104831935 conn(0x7fd6340768f0 msgr2=0x7fd634078d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:18.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.168+0000 7fd63a600700 1 -- 172.21.15.142:0/3104831935 shutdown_connections 2024-04-20T21:55:18.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.168+0000 7fd63a600700 1 -- 172.21.15.142:0/3104831935 wait complete. 2024-04-20T21:55:18.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.170+0000 7fd63a600700 1 Processor -- start 2024-04-20T21:55:18.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.170+0000 7fd63a600700 1 -- start start 2024-04-20T21:55:18.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.170+0000 7fd63a600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd634107520 0x7fd63419d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:18.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.170+0000 7fd63a600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd634108e10 0x7fd63419d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:18.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.170+0000 7fd63a600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63419de90 con 0x7fd634108e10 2024-04-20T21:55:18.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.170+0000 7fd63a600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6341a1b60 con 0x7fd634107520 2024-04-20T21:55:18.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.170+0000 7fd62be00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd634108e10 0x7fd63419d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:18.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.171+0000 7fd62be00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd634108e10 0x7fd63419d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41928/0 (socket says 172.21.15.142:41928) 2024-04-20T21:55:18.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.171+0000 7fd62be00700 1 -- 172.21.15.142:0/2733797432 learned_addr learned my addr 172.21.15.142:0/2733797432 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:18.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.171+0000 7fd633400700 1 --2- 172.21.15.142:0/2733797432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd634107520 0x7fd63419d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:18.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.171+0000 7fd62be00700 1 -- 172.21.15.142:0/2733797432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd634107520 msgr2=0x7fd63419d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:18.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.171+0000 7fd62be00700 1 --2- 172.21.15.142:0/2733797432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd634107520 0x7fd63419d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:18.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.171+0000 7fd62be00700 1 -- 172.21.15.142:0/2733797432 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6240095f0 con 0x7fd634108e10 2024-04-20T21:55:18.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.171+0000 7fd62be00700 1 --2- 172.21.15.142:0/2733797432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd634108e10 0x7fd63419d7b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd61c00b4b0 tx=0x7fd61c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:18.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.172+0000 7fd630c00700 1 -- 172.21.15.142:0/2733797432 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd61c011800 con 0x7fd634108e10 2024-04-20T21:55:18.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.172+0000 7fd630c00700 1 -- 172.21.15.142:0/2733797432 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd61c011e20 con 0x7fd634108e10 2024-04-20T21:55:18.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.172+0000 7fd630c00700 1 -- 172.21.15.142:0/2733797432 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd61c00f2e0 con 0x7fd634108e10 2024-04-20T21:55:18.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.172+0000 7fd63a600700 1 -- 172.21.15.142:0/2733797432 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6341a1e40 con 0x7fd634108e10 2024-04-20T21:55:18.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.172+0000 7fd63a600700 1 -- 172.21.15.142:0/2733797432 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6341a2410 con 0x7fd634108e10 2024-04-20T21:55:18.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.173+0000 7fd63a600700 1 -- 172.21.15.142:0/2733797432 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63410f870 con 0x7fd634108e10 2024-04-20T21:55:18.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.174+0000 7fd630c00700 1 -- 172.21.15.142:0/2733797432 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd61c010380 con 0x7fd634108e10 2024-04-20T21:55:18.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.175+0000 7fd630c00700 1 --2- 172.21.15.142:0/2733797432 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd61806ccf0 0x7fd61806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:18.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.176+0000 7fd630c00700 1 -- 172.21.15.142:0/2733797432 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fd61c08bde0 con 0x7fd634108e10 2024-04-20T21:55:18.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.176+0000 7fd633400700 1 --2- 172.21.15.142:0/2733797432 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd61806ccf0 0x7fd61806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:18.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.176+0000 7fd633400700 1 --2- 172.21.15.142:0/2733797432 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd61806ccf0 0x7fd61806f1b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd62400b5c0 tx=0x7fd62401a040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:18.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.181+0000 7fd630c00700 1 -- 172.21.15.142:0/2733797432 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fd61c0562e0 con 0x7fd634108e10 2024-04-20T21:55:18.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.447+0000 7fd63a600700 1 -- 172.21.15.142:0/2733797432 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd634108920 con 0x7fd634108e10 2024-04-20T21:55:18.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.448+0000 7fd630c00700 1 -- 172.21.15.142:0/2733797432 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) v1 ==== 53+0+83 (secure 0 0 0) 0x7fd61c059900 con 0x7fd634108e10 2024-04-20T21:55:18.448 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-20T21:55:18.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.452+0000 7fd63a600700 1 -- 172.21.15.142:0/2733797432 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd61806ccf0 msgr2=0x7fd61806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:18.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.452+0000 7fd63a600700 1 --2- 172.21.15.142:0/2733797432 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd61806ccf0 0x7fd61806f1b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd62400b5c0 tx=0x7fd62401a040 comp rx=0 tx=0).stop 2024-04-20T21:55:18.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.452+0000 7fd63a600700 1 -- 172.21.15.142:0/2733797432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd634108e10 msgr2=0x7fd63419d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:18.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.452+0000 7fd63a600700 1 --2- 172.21.15.142:0/2733797432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd634108e10 0x7fd63419d7b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd61c00b4b0 tx=0x7fd61c00b870 comp rx=0 tx=0).stop 2024-04-20T21:55:18.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.452+0000 7fd63a600700 1 -- 172.21.15.142:0/2733797432 shutdown_connections 2024-04-20T21:55:18.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.452+0000 7fd63a600700 1 --2- 172.21.15.142:0/2733797432 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd61806ccf0 0x7fd61806f1b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:18.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.452+0000 7fd63a600700 1 --2- 172.21.15.142:0/2733797432 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd634107520 0x7fd63419d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:18.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.452+0000 7fd63a600700 1 --2- 172.21.15.142:0/2733797432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd634108e10 0x7fd63419d7b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:18.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.452+0000 7fd63a600700 1 -- 172.21.15.142:0/2733797432 >> 172.21.15.142:0/2733797432 conn(0x7fd6340768f0 msgr2=0x7fd634078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:18.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.453+0000 7fd63a600700 1 -- 172.21.15.142:0/2733797432 shutdown_connections 2024-04-20T21:55:18.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:18.453+0000 7fd63a600700 1 -- 172.21.15.142:0/2733797432 wait complete. 2024-04-20T21:55:19.227 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-20T21:55:19.227 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-20T21:55:19.227 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2024-04-20T21:55:19.227 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-20T21:55:19.227 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-20T21:55:19.227 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-20T21:55:19.227 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-20T21:55:19.227 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-20T21:55:19.227 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-20T21:55:19.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:19.228 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2024-04-20T21:55:19.285 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-20T21:55:19.285 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-20T21:55:19.285 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2024-04-20T21:55:19.286 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:55:19.286 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2024-04-20T21:55:19.286 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:55:19.286 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:55:19.286 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2024-04-20T21:55:19.286 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2024-04-20T21:55:19.286 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:55:19.286 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2024-04-20T21:55:19.286 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2024-04-20T21:55:19.286 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T21:55:19.286 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2024-04-20T21:55:19.286 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-20T21:55:19.286 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2024-04-20T21:55:19.287 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-20T21:55:19.287 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 42231sec preferred_lft 42231sec 2024-04-20T21:55:19.287 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2024-04-20T21:55:19.287 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-04-20T21:55:19.288 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-20T21:55:19.288 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:55:19.288 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-04-20T21:55:19.288 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add name ceph-brx type bridge 2024-04-20T21:55:19.288 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip addr flush dev ceph-brx 2024-04-20T21:55:19.288 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set ceph-brx up 2024-04-20T21:55:19.288 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-20T21:55:19.288 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-04-20T21:55:19.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:55:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:55:19.418 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:19 smithi164 ceph-mon[23506]: pgmap v249: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-20T21:55:19.418 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:19 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/2733797432' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-20T21:55:19.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:19 smithi142 ceph-mon[15828]: pgmap v249: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-20T21:55:19.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:19 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2733797432' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-20T21:55:19.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:55:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:55:19.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:19.788 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-20T21:55:19.855 INFO:teuthology.orchestra.run.smithi164.stdout:1 2024-04-20T21:55:19.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:19.859 DEBUG:teuthology.orchestra.run.smithi164:> route 2024-04-20T21:55:19.918 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2024-04-20T21:55:19.918 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-20T21:55:19.918 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-20T21:55:19.918 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-20T21:55:19.918 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-20T21:55:19.919 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:55:19.919 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-04-20T21:55:19.919 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-20T21:55:19.919 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-20T21:55:19.919 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-20T21:55:19.919 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-04-20T21:55:20.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:55:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:55:20.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:55:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:55:20.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:20.682 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2024-04-20T21:55:20.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:20.723 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list-id 2024-04-20T21:55:20.813 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:55:20.813 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-04-20T21:55:20.814 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T21:55:20.814 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-20T21:55:20.814 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-04-20T21:55:20.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:55:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:55:20.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:55:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:55:20.982 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-20T21:55:20.982 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:55:20.983 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-04-20T21:55:20.983 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-20T21:55:20.983 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-20T21:55:20.983 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-20T21:55:20.983 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-20T21:55:20.983 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-20T21:55:20.983 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-04-20T21:55:21.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:55:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:55:21.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:21 smithi164 ceph-mon[23506]: pgmap v250: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-20T21:55:21.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:55:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:55:21.277 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T21:55:21.277 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-04-20T21:55:21.277 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2024-04-20T21:55:21.277 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set dev brx.0 master ceph-brx 2024-04-20T21:55:21.277 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-04-20T21:55:21.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:55:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T21:55:21.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:21 smithi142 ceph-mon[15828]: pgmap v250: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-20T21:55:21.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:55:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:55:21.463 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-20T21:55:21.463 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T21:55:21.463 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-20T21:55:21.507 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-20T21:55:21.507 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T21:55:21.507 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-20T21:55:21.596 DEBUG:teuthology.orchestra.run.smithi164:> sudo modprobe fuse 2024-04-20T21:55:21.668 DEBUG:teuthology.orchestra.run.smithi164:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:55:21.716 INFO:teuthology.orchestra.run.smithi164.stdout:/proc 2024-04-20T21:55:21.716 INFO:teuthology.orchestra.run.smithi164.stdout:/sys 2024-04-20T21:55:21.716 INFO:teuthology.orchestra.run.smithi164.stdout:/dev 2024-04-20T21:55:21.717 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/security 2024-04-20T21:55:21.717 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/shm 2024-04-20T21:55:21.717 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/pts 2024-04-20T21:55:21.717 INFO:teuthology.orchestra.run.smithi164.stdout:/run 2024-04-20T21:55:21.717 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup 2024-04-20T21:55:21.717 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/pstore 2024-04-20T21:55:21.717 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/bpf 2024-04-20T21:55:21.717 INFO:teuthology.orchestra.run.smithi164.stdout:/ 2024-04-20T21:55:21.717 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/selinux 2024-04-20T21:55:21.717 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:55:21.717 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/mqueue 2024-04-20T21:55:21.717 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/hugepages 2024-04-20T21:55:21.717 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/debug 2024-04-20T21:55:21.718 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/tracing 2024-04-20T21:55:21.718 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/fuse/connections 2024-04-20T21:55:21.718 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/config 2024-04-20T21:55:21.718 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:55:21.718 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:55:21.718 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:55:21.718 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:55:21.718 INFO:teuthology.orchestra.run.smithi164.stdout:/run/user/1000 2024-04-20T21:55:21.718 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph 2024-04-20T21:55:21.718 INFO:teuthology.orchestra.run.smithi164.stdout:/run/user/0 2024-04-20T21:55:21.718 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:55:21.718 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay 2024-04-20T21:55:21.718 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/ab52785385705ca5f20273ea47e1a3d1ca9280d7fc38fbcc995d6be30780d2ec/merged 2024-04-20T21:55:21.718 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/14923f3b1a8d7456675b966ee43528bf40c28ab2389bde68a7ed84cc6d803629/merged 2024-04-20T21:55:21.719 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/5ef4efd7611377f5f177ae2e48e5071ab4fa6181ea683a538b4ba10db748f302/merged 2024-04-20T21:55:21.719 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/ce6d6636502357070705f2a5b0410f792e354bc8cf1a32cd237f67c384433dbe/merged 2024-04-20T21:55:21.719 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/871d5776c07cbde20b41c4c712807f6f62bf0dee9e840173ff148a01911ff6c6/merged 2024-04-20T21:55:21.719 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/30f3301ddb5678dc2e4a1ec382983da9e9dc761655c45c701af5f930e89344d5/merged 2024-04-20T21:55:21.719 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/06020ed53aa7d9487a0905f217e1134b719495e03e1a3ec781fa4b5cffc426d8/merged 2024-04-20T21:55:21.719 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/76a888b92daba4be53594d8ee2f42ea0b8a857317bb1b4727e5fb772bb87fd3a/merged 2024-04-20T21:55:21.719 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/7930c08b6e979a2037c51607a97ac2f7e2d7db7670b8f73d46aabb8e43197950/merged 2024-04-20T21:55:21.719 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/41fee16323b946c9e09eecc375cac4fa98557a968107e85e20b67e08d54e378e/merged 2024-04-20T21:55:21.719 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns 2024-04-20T21:55:21.719 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T21:55:21.719 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T21:55:21.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:21.720 DEBUG:teuthology.orchestra.run.smithi164:> ls /sys/fs/fuse/connections 2024-04-20T21:55:21.766 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-20T21:55:21.766 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-20T21:55:21.770 DEBUG:teuthology.orchestra.run.smithi164:> sudo modprobe fuse 2024-04-20T21:55:21.839 DEBUG:teuthology.orchestra.run.smithi164:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:55:21.883 INFO:teuthology.orchestra.run.smithi164.stdout:/proc 2024-04-20T21:55:21.883 INFO:teuthology.orchestra.run.smithi164.stdout:/sys 2024-04-20T21:55:21.883 INFO:teuthology.orchestra.run.smithi164.stdout:/dev 2024-04-20T21:55:21.883 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/security 2024-04-20T21:55:21.883 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/shm 2024-04-20T21:55:21.883 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/pts 2024-04-20T21:55:21.884 INFO:teuthology.orchestra.run.smithi164.stdout:/run 2024-04-20T21:55:21.884 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup 2024-04-20T21:55:21.884 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/pstore 2024-04-20T21:55:21.884 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/bpf 2024-04-20T21:55:21.884 INFO:teuthology.orchestra.run.smithi164.stdout:/ 2024-04-20T21:55:21.884 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/selinux 2024-04-20T21:55:21.884 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:55:21.884 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/mqueue 2024-04-20T21:55:21.884 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/hugepages 2024-04-20T21:55:21.884 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/debug 2024-04-20T21:55:21.884 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/tracing 2024-04-20T21:55:21.884 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/fuse/connections 2024-04-20T21:55:21.884 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/config 2024-04-20T21:55:21.884 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:55:21.884 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:55:21.885 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:55:21.885 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:55:21.885 INFO:teuthology.orchestra.run.smithi164.stdout:/run/user/1000 2024-04-20T21:55:21.885 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph 2024-04-20T21:55:21.885 INFO:teuthology.orchestra.run.smithi164.stdout:/run/user/0 2024-04-20T21:55:21.885 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:55:21.885 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay 2024-04-20T21:55:21.885 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/ab52785385705ca5f20273ea47e1a3d1ca9280d7fc38fbcc995d6be30780d2ec/merged 2024-04-20T21:55:21.885 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/14923f3b1a8d7456675b966ee43528bf40c28ab2389bde68a7ed84cc6d803629/merged 2024-04-20T21:55:21.885 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/5ef4efd7611377f5f177ae2e48e5071ab4fa6181ea683a538b4ba10db748f302/merged 2024-04-20T21:55:21.885 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/ce6d6636502357070705f2a5b0410f792e354bc8cf1a32cd237f67c384433dbe/merged 2024-04-20T21:55:21.885 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/871d5776c07cbde20b41c4c712807f6f62bf0dee9e840173ff148a01911ff6c6/merged 2024-04-20T21:55:21.885 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/30f3301ddb5678dc2e4a1ec382983da9e9dc761655c45c701af5f930e89344d5/merged 2024-04-20T21:55:21.885 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/06020ed53aa7d9487a0905f217e1134b719495e03e1a3ec781fa4b5cffc426d8/merged 2024-04-20T21:55:21.886 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/76a888b92daba4be53594d8ee2f42ea0b8a857317bb1b4727e5fb772bb87fd3a/merged 2024-04-20T21:55:21.886 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/7930c08b6e979a2037c51607a97ac2f7e2d7db7670b8f73d46aabb8e43197950/merged 2024-04-20T21:55:21.886 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/41fee16323b946c9e09eecc375cac4fa98557a968107e85e20b67e08d54e378e/merged 2024-04-20T21:55:21.886 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns 2024-04-20T21:55:21.886 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T21:55:21.886 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T21:55:21.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:21.887 DEBUG:teuthology.orchestra.run.smithi164:> ls /sys/fs/fuse/connections 2024-04-20T21:55:21.982 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi164.stderr:2024-04-20T21:55:21.983+0000 7f981540c480 -1 init, newargv = 0x55ff343de160 newargc=15 2024-04-20T21:55:21.983 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi164.stderr:ceph-fuse[49394]: starting ceph client 2024-04-20T21:55:21.992 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi164.stderr:ceph-fuse[49394]: starting fuse 2024-04-20T21:55:23.074 DEBUG:teuthology.orchestra.run.smithi164:> sudo modprobe fuse 2024-04-20T21:55:23.167 DEBUG:teuthology.orchestra.run.smithi164:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T21:55:23.222 INFO:teuthology.orchestra.run.smithi164.stdout:/proc 2024-04-20T21:55:23.222 INFO:teuthology.orchestra.run.smithi164.stdout:/sys 2024-04-20T21:55:23.222 INFO:teuthology.orchestra.run.smithi164.stdout:/dev 2024-04-20T21:55:23.223 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/security 2024-04-20T21:55:23.223 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/shm 2024-04-20T21:55:23.223 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/pts 2024-04-20T21:55:23.223 INFO:teuthology.orchestra.run.smithi164.stdout:/run 2024-04-20T21:55:23.223 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup 2024-04-20T21:55:23.223 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/pstore 2024-04-20T21:55:23.223 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/bpf 2024-04-20T21:55:23.223 INFO:teuthology.orchestra.run.smithi164.stdout:/ 2024-04-20T21:55:23.223 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/selinux 2024-04-20T21:55:23.223 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:55:23.224 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/mqueue 2024-04-20T21:55:23.224 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/hugepages 2024-04-20T21:55:23.224 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/debug 2024-04-20T21:55:23.224 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/tracing 2024-04-20T21:55:23.224 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/fuse/connections 2024-04-20T21:55:23.224 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/config 2024-04-20T21:55:23.224 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T21:55:23.224 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T21:55:23.224 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T21:55:23.224 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T21:55:23.224 INFO:teuthology.orchestra.run.smithi164.stdout:/run/user/1000 2024-04-20T21:55:23.224 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph 2024-04-20T21:55:23.224 INFO:teuthology.orchestra.run.smithi164.stdout:/run/user/0 2024-04-20T21:55:23.224 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T21:55:23.224 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay 2024-04-20T21:55:23.225 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/ab52785385705ca5f20273ea47e1a3d1ca9280d7fc38fbcc995d6be30780d2ec/merged 2024-04-20T21:55:23.225 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/14923f3b1a8d7456675b966ee43528bf40c28ab2389bde68a7ed84cc6d803629/merged 2024-04-20T21:55:23.225 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/5ef4efd7611377f5f177ae2e48e5071ab4fa6181ea683a538b4ba10db748f302/merged 2024-04-20T21:55:23.225 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/ce6d6636502357070705f2a5b0410f792e354bc8cf1a32cd237f67c384433dbe/merged 2024-04-20T21:55:23.225 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/871d5776c07cbde20b41c4c712807f6f62bf0dee9e840173ff148a01911ff6c6/merged 2024-04-20T21:55:23.225 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/30f3301ddb5678dc2e4a1ec382983da9e9dc761655c45c701af5f930e89344d5/merged 2024-04-20T21:55:23.225 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/06020ed53aa7d9487a0905f217e1134b719495e03e1a3ec781fa4b5cffc426d8/merged 2024-04-20T21:55:23.225 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/76a888b92daba4be53594d8ee2f42ea0b8a857317bb1b4727e5fb772bb87fd3a/merged 2024-04-20T21:55:23.225 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/7930c08b6e979a2037c51607a97ac2f7e2d7db7670b8f73d46aabb8e43197950/merged 2024-04-20T21:55:23.225 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/41fee16323b946c9e09eecc375cac4fa98557a968107e85e20b67e08d54e378e/merged 2024-04-20T21:55:23.225 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns 2024-04-20T21:55:23.225 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T21:55:23.225 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T21:55:23.225 INFO:teuthology.orchestra.run.smithi164.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-20T21:55:23.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:23.226 DEBUG:teuthology.orchestra.run.smithi164:> ls /sys/fs/fuse/connections 2024-04-20T21:55:23.275 INFO:teuthology.orchestra.run.smithi164.stdout:122 2024-04-20T21:55:23.276 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [122] 2024-04-20T21:55:23.276 DEBUG:teuthology.orchestra.run.smithi164:> sudo stdin-killer -- python3 -c ' 2024-04-20T21:55:23.276 DEBUG:teuthology.orchestra.run.smithi164:> import glob 2024-04-20T21:55:23.276 DEBUG:teuthology.orchestra.run.smithi164:> import re 2024-04-20T21:55:23.276 DEBUG:teuthology.orchestra.run.smithi164:> import os 2024-04-20T21:55:23.276 DEBUG:teuthology.orchestra.run.smithi164:> import subprocess 2024-04-20T21:55:23.276 DEBUG:teuthology.orchestra.run.smithi164:> 2024-04-20T21:55:23.276 DEBUG:teuthology.orchestra.run.smithi164:> def _find_admin_socket(client_name): 2024-04-20T21:55:23.276 DEBUG:teuthology.orchestra.run.smithi164:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-20T21:55:23.276 DEBUG:teuthology.orchestra.run.smithi164:> files = glob.glob(asok_path) 2024-04-20T21:55:23.276 DEBUG:teuthology.orchestra.run.smithi164:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-20T21:55:23.276 DEBUG:teuthology.orchestra.run.smithi164:> 2024-04-20T21:55:23.276 DEBUG:teuthology.orchestra.run.smithi164:> # Given a non-glob path, it better be there 2024-04-20T21:55:23.276 DEBUG:teuthology.orchestra.run.smithi164:> if "*" not in asok_path: 2024-04-20T21:55:23.277 DEBUG:teuthology.orchestra.run.smithi164:> assert(len(files) == 1) 2024-04-20T21:55:23.277 DEBUG:teuthology.orchestra.run.smithi164:> return files[0] 2024-04-20T21:55:23.277 DEBUG:teuthology.orchestra.run.smithi164:> 2024-04-20T21:55:23.277 DEBUG:teuthology.orchestra.run.smithi164:> for f in files: 2024-04-20T21:55:23.277 DEBUG:teuthology.orchestra.run.smithi164:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-20T21:55:23.277 DEBUG:teuthology.orchestra.run.smithi164:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-20T21:55:23.277 DEBUG:teuthology.orchestra.run.smithi164:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-20T21:55:23.277 DEBUG:teuthology.orchestra.run.smithi164:> contents = proc_f.read() 2024-04-20T21:55:23.277 DEBUG:teuthology.orchestra.run.smithi164:> if mountpoint in contents: 2024-04-20T21:55:23.277 DEBUG:teuthology.orchestra.run.smithi164:> return f 2024-04-20T21:55:23.277 DEBUG:teuthology.orchestra.run.smithi164:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-20T21:55:23.277 DEBUG:teuthology.orchestra.run.smithi164:> 2024-04-20T21:55:23.277 DEBUG:teuthology.orchestra.run.smithi164:> print(_find_admin_socket("client.1")) 2024-04-20T21:55:23.277 DEBUG:teuthology.orchestra.run.smithi164:> ' 2024-04-20T21:55:23.441 INFO:teuthology.orchestra.run.smithi164.stdout:/var/run/ceph/ceph-client.1.49394.asok 2024-04-20T21:55:23.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:23 smithi164 ceph-mon[23506]: pgmap v251: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-20T21:55:23.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:23 smithi142 ceph-mon[15828]: pgmap v251: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-20T21:55:23.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-20T21:55:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T21:55:23.458 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.49394.asok 2024-04-20T21:55:23.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:23.458 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.49394.asok status 2024-04-20T21:55:23.686 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-20T21:55:23.686 INFO:teuthology.orchestra.run.smithi164.stdout: "metadata": { 2024-04-20T21:55:23.686 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_sha1": "9d98999acebbad2663cc4938e94c9ffd83485cbd", 2024-04-20T21:55:23.686 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_version": "ceph version 18.2.2 (9d98999acebbad2663cc4938e94c9ffd83485cbd) reef (stable)", 2024-04-20T21:55:23.687 INFO:teuthology.orchestra.run.smithi164.stdout: "entity_id": "1", 2024-04-20T21:55:23.687 INFO:teuthology.orchestra.run.smithi164.stdout: "hostname": "smithi164", 2024-04-20T21:55:23.687 INFO:teuthology.orchestra.run.smithi164.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-20T21:55:23.687 INFO:teuthology.orchestra.run.smithi164.stdout: "pid": "49394", 2024-04-20T21:55:23.687 INFO:teuthology.orchestra.run.smithi164.stdout: "root": "/" 2024-04-20T21:55:23.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-20T21:55:23.687 INFO:teuthology.orchestra.run.smithi164.stdout: "dentry_count": 0, 2024-04-20T21:55:23.687 INFO:teuthology.orchestra.run.smithi164.stdout: "dentry_pinned_count": 0, 2024-04-20T21:55:23.687 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 24289, 2024-04-20T21:55:23.687 INFO:teuthology.orchestra.run.smithi164.stdout: "inst": { 2024-04-20T21:55:23.687 INFO:teuthology.orchestra.run.smithi164.stdout: "name": { 2024-04-20T21:55:23.687 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "client", 2024-04-20T21:55:23.687 INFO:teuthology.orchestra.run.smithi164.stdout: "num": 24289 2024-04-20T21:55:23.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-20T21:55:23.688 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": { 2024-04-20T21:55:23.688 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v1", 2024-04-20T21:55:23.688 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "192.168.0.1:0", 2024-04-20T21:55:23.688 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 4069521734 2024-04-20T21:55:23.688 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-20T21:55:23.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-20T21:55:23.688 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": { 2024-04-20T21:55:23.688 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v1", 2024-04-20T21:55:23.688 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "192.168.0.1:0", 2024-04-20T21:55:23.688 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 4069521734 2024-04-20T21:55:23.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-20T21:55:23.688 INFO:teuthology.orchestra.run.smithi164.stdout: "inst_str": "client.24289 192.168.0.1:0/4069521734", 2024-04-20T21:55:23.688 INFO:teuthology.orchestra.run.smithi164.stdout: "addr_str": "192.168.0.1:0/4069521734", 2024-04-20T21:55:23.688 INFO:teuthology.orchestra.run.smithi164.stdout: "inode_count": 1, 2024-04-20T21:55:23.688 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_epoch": 12, 2024-04-20T21:55:23.688 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_epoch": 47, 2024-04-20T21:55:23.689 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_epoch_barrier": 0, 2024-04-20T21:55:23.689 INFO:teuthology.orchestra.run.smithi164.stdout: "blocklisted": false, 2024-04-20T21:55:23.689 INFO:teuthology.orchestra.run.smithi164.stdout: "fs_name": "cephfs" 2024-04-20T21:55:23.689 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-20T21:55:23.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:23.702 DEBUG:teuthology.orchestra.run.smithi142:> stat --file-system '--printf=%T 2024-04-20T21:55:23.702 DEBUG:teuthology.orchestra.run.smithi142:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-20T21:55:23.764 INFO:teuthology.orchestra.run.smithi142.stdout:fuseblk 2024-04-20T21:55:23.764 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-20T21:55:23.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:23.764 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-20T21:55:23.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:23.858 DEBUG:teuthology.orchestra.run.smithi164:> stat --file-system '--printf=%T 2024-04-20T21:55:23.858 DEBUG:teuthology.orchestra.run.smithi164:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-20T21:55:23.916 INFO:teuthology.orchestra.run.smithi164.stdout:fuseblk 2024-04-20T21:55:23.916 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-20T21:55:23.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T21:55:23.917 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-20T21:55:24.004 INFO:teuthology.run_tasks:Running task print... 2024-04-20T21:55:24.015 INFO:teuthology.task.print:**** done client 2024-04-20T21:55:24.015 INFO:teuthology.run_tasks:Running task parallel... 2024-04-20T21:55:24.026 INFO:teuthology.task.parallel:starting parallel... 2024-04-20T21:55:24.026 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-20T21:55:24.027 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-20T21:55:24.027 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi142.front.sepia.ceph.com 2024-04-20T21:55:24.027 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -e sha1=a8c84f5997950fd7d008204839253291d52e6eda -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-04-20T21:55:24.028 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-20T21:55:24.028 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-04-20T21:55:24.031 INFO:tasks.workunit:Pulling workunits from ref a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:55:24.032 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-20T21:55:24.032 INFO:tasks.workunit:timeout=3h 2024-04-20T21:55:24.032 INFO:tasks.workunit:cleanup=True 2024-04-20T21:55:24.032 DEBUG:teuthology.orchestra.run.smithi142:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-20T21:55:24.085 INFO:teuthology.orchestra.run.smithi142.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-20T21:55:24.086 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-20T21:55:24.086 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 9bh/155d Inode: 1 Links: 2 2024-04-20T21:55:24.086 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T21:55:24.086 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-20T21:55:24.086 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-20T21:55:24.086 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-20 21:54:35.478905257 +0000 2024-04-20T21:55:24.086 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-20 21:55:23.852496696 +0000 2024-04-20T21:55:24.086 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2024-04-20T21:55:24.086 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-20T21:55:24.087 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-20T21:55:24.216 DEBUG:teuthology.orchestra.run.smithi164:> stat -- /home/ubuntu/cephtest/mnt.1 2024-04-20T21:55:24.278 INFO:teuthology.orchestra.run.smithi164.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-04-20T21:55:24.278 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-20T21:55:24.278 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 7ah/122d Inode: 1 Links: 3 2024-04-20T21:55:24.278 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T21:55:24.278 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-20T21:55:24.278 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-20T21:55:24.278 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-20 21:55:24.203428222 +0000 2024-04-20T21:55:24.278 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-20 21:55:24.203428222 +0000 2024-04-20T21:55:24.279 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2024-04-20T21:55:24.279 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-04-20T21:55:24.279 DEBUG:teuthology.orchestra.run.smithi164:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-04-20T21:55:24.370 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:55:24.371 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:55:24.419 INFO:tasks.workunit.client.0.smithi142.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-20T21:55:24.426 INFO:tasks.workunit.client.1.smithi164.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-04-20T21:55:24.431 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:55:25.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:25 smithi142 ceph-mon[15828]: pgmap v252: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-20T21:55:25.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:25 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:55:25.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:25 smithi164 ceph-mon[23506]: pgmap v252: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-20T21:55:25.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:25 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:55:26.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:26 smithi142 ceph-mon[15828]: pgmap v253: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-20T21:55:26.469 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:26 smithi164 ceph-mon[23506]: pgmap v253: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-20T21:55:26.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.647+0000 7f38a8c00700 1 -- 172.21.15.142:0/3512458331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38a4108440 msgr2=0x7f38a41088a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:26.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.647+0000 7f38a8c00700 1 --2- 172.21.15.142:0/3512458331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38a4108440 0x7f38a41088a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3890009910 tx=0x7f3890009c20 comp rx=0 tx=0).stop 2024-04-20T21:55:26.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.647+0000 7f38a8c00700 1 -- 172.21.15.142:0/3512458331 shutdown_connections 2024-04-20T21:55:26.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.647+0000 7f38a8c00700 1 --2- 172.21.15.142:0/3512458331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38a4108440 0x7f38a41088a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:26.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.647+0000 7f38a8c00700 1 --2- 172.21.15.142:0/3512458331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38a4107240 0x7f38a4107660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:26.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.647+0000 7f38a8c00700 1 -- 172.21.15.142:0/3512458331 >> 172.21.15.142:0/3512458331 conn(0x7f38a4076230 msgr2=0x7f38a4078650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:26.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.647+0000 7f38a8c00700 1 -- 172.21.15.142:0/3512458331 shutdown_connections 2024-04-20T21:55:26.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.647+0000 7f38a8c00700 1 -- 172.21.15.142:0/3512458331 wait complete. 2024-04-20T21:55:26.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.649+0000 7f38a8c00700 1 Processor -- start 2024-04-20T21:55:26.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.649+0000 7f38a8c00700 1 -- start start 2024-04-20T21:55:26.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.649+0000 7f38a8c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38a4107240 0x7f38a419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:26.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.649+0000 7f38a8c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38a4108440 0x7f38a419d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:26.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.649+0000 7f38a8c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a419d8e0 con 0x7f38a4107240 2024-04-20T21:55:26.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.649+0000 7f38a8c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a41a2250 con 0x7f38a4108440 2024-04-20T21:55:26.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.650+0000 7f38a1e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38a4107240 0x7f38a419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:26.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.650+0000 7f38a1e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38a4107240 0x7f38a419cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41936/0 (socket says 172.21.15.142:41936) 2024-04-20T21:55:26.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.650+0000 7f38a1e00700 1 -- 172.21.15.142:0/1867156238 learned_addr learned my addr 172.21.15.142:0/1867156238 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:26.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.650+0000 7f38a1400700 1 --2- 172.21.15.142:0/1867156238 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38a4108440 0x7f38a419d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:26.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.650+0000 7f38a1e00700 1 -- 172.21.15.142:0/1867156238 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38a4108440 msgr2=0x7f38a419d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:26.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.650+0000 7f38a1e00700 1 --2- 172.21.15.142:0/1867156238 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38a4108440 0x7f38a419d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:26.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.650+0000 7f38a1e00700 1 -- 172.21.15.142:0/1867156238 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38900095f0 con 0x7f38a4107240 2024-04-20T21:55:26.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.650+0000 7f38a1e00700 1 --2- 172.21.15.142:0/1867156238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38a4107240 0x7f38a419cd80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f389400b480 tx=0x7f389400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:26.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.651+0000 7f389aa00700 1 -- 172.21.15.142:0/1867156238 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38940118c0 con 0x7f38a4107240 2024-04-20T21:55:26.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.651+0000 7f389aa00700 1 -- 172.21.15.142:0/1867156238 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3894010380 con 0x7f38a4107240 2024-04-20T21:55:26.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.651+0000 7f38a8c00700 1 -- 172.21.15.142:0/1867156238 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a41a2450 con 0x7f38a4107240 2024-04-20T21:55:26.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.651+0000 7f389aa00700 1 -- 172.21.15.142:0/1867156238 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f389400f4f0 con 0x7f38a4107240 2024-04-20T21:55:26.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.651+0000 7f38a8c00700 1 -- 172.21.15.142:0/1867156238 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a41a29f0 con 0x7f38a4107240 2024-04-20T21:55:26.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.652+0000 7f38a8c00700 1 -- 172.21.15.142:0/1867156238 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a4196e60 con 0x7f38a4107240 2024-04-20T21:55:26.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.653+0000 7f389aa00700 1 -- 172.21.15.142:0/1867156238 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f38940104f0 con 0x7f38a4107240 2024-04-20T21:55:26.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.654+0000 7f389aa00700 1 --2- 172.21.15.142:0/1867156238 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f388806ccf0 0x7f388806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:26.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.654+0000 7f389aa00700 1 -- 172.21.15.142:0/1867156238 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f389408bf70 con 0x7f38a4107240 2024-04-20T21:55:26.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.654+0000 7f38a1400700 1 --2- 172.21.15.142:0/1867156238 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f388806ccf0 0x7f388806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:26.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.655+0000 7f38a1400700 1 --2- 172.21.15.142:0/1867156238 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f388806ccf0 0x7f388806f1b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f38900051c0 tx=0x7f389000b540 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:26.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.659+0000 7f389aa00700 1 -- 172.21.15.142:0/1867156238 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f38940562a0 con 0x7f38a4107240 2024-04-20T21:55:26.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.879+0000 7f38a8c00700 1 -- 172.21.15.142:0/1867156238 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f38a404ebb0 con 0x7f38a4107240 2024-04-20T21:55:26.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.887+0000 7f389aa00700 1 -- 172.21.15.142:0/1867156238 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v26)=0 v26) v1 ==== 126+0+0 (secure 0 0 0) 0x7f38a404ebb0 con 0x7f38a4107240 2024-04-20T21:55:26.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.889+0000 7f38a8c00700 1 -- 172.21.15.142:0/1867156238 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f388806ccf0 msgr2=0x7f388806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:26.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.889+0000 7f38a8c00700 1 --2- 172.21.15.142:0/1867156238 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f388806ccf0 0x7f388806f1b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f38900051c0 tx=0x7f389000b540 comp rx=0 tx=0).stop 2024-04-20T21:55:26.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.889+0000 7f38a8c00700 1 -- 172.21.15.142:0/1867156238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38a4107240 msgr2=0x7f38a419cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:26.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.889+0000 7f38a8c00700 1 --2- 172.21.15.142:0/1867156238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38a4107240 0x7f38a419cd80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f389400b480 tx=0x7f389400b840 comp rx=0 tx=0).stop 2024-04-20T21:55:26.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.890+0000 7f38a8c00700 1 -- 172.21.15.142:0/1867156238 shutdown_connections 2024-04-20T21:55:26.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.890+0000 7f38a8c00700 1 --2- 172.21.15.142:0/1867156238 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f388806ccf0 0x7f388806f1b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:26.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.890+0000 7f38a8c00700 1 --2- 172.21.15.142:0/1867156238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38a4107240 0x7f38a419cd80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:26.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.890+0000 7f38a8c00700 1 --2- 172.21.15.142:0/1867156238 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38a4108440 0x7f38a419d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:26.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.890+0000 7f38a8c00700 1 -- 172.21.15.142:0/1867156238 >> 172.21.15.142:0/1867156238 conn(0x7f38a4076230 msgr2=0x7f38a410ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:26.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.890+0000 7f38a8c00700 1 -- 172.21.15.142:0/1867156238 shutdown_connections 2024-04-20T21:55:26.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:26.890+0000 7f38a8c00700 1 -- 172.21.15.142:0/1867156238 wait complete. 2024-04-20T21:55:27.822 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-20T21:55:27.822 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi142.front.sepia.ceph.com 2024-04-20T21:55:27.822 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -e sha1=a8c84f5997950fd7d008204839253291d52e6eda -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-04-20T21:55:27.901 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:27 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1867156238' entity='client.admin' 2024-04-20T21:55:27.902 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:27 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:55:27.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:27 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/1867156238' entity='client.admin' 2024-04-20T21:55:27.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:27 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:55:28.251 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:55:28.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:28 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:55:28.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:28 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:55:28.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:28 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:55:28.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:28 smithi142 ceph-mon[15828]: pgmap v254: 65 pgs: 65 active+clean; 585 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-04-20T21:55:29.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:28 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:55:29.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:28 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:55:29.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:28 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:55:29.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:28 smithi164 ceph-mon[23506]: pgmap v254: 65 pgs: 65 active+clean; 585 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-04-20T21:55:30.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.617+0000 7f4e2f600700 1 -- 172.21.15.142:0/3338110055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e28101e20 msgr2=0x7f4e28102280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:30.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.617+0000 7f4e2f600700 1 --2- 172.21.15.142:0/3338110055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e28101e20 0x7f4e28102280 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009910 tx=0x7f4e14009c20 comp rx=0 tx=0).stop 2024-04-20T21:55:30.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.617+0000 7f4e2f600700 1 -- 172.21.15.142:0/3338110055 shutdown_connections 2024-04-20T21:55:30.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.617+0000 7f4e2f600700 1 --2- 172.21.15.142:0/3338110055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e28101e20 0x7f4e28102280 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:30.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.617+0000 7f4e2f600700 1 --2- 172.21.15.142:0/3338110055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e28100c20 0x7f4e28101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:30.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.617+0000 7f4e2f600700 1 -- 172.21.15.142:0/3338110055 >> 172.21.15.142:0/3338110055 conn(0x7f4e280fc1c0 msgr2=0x7f4e280fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:30.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.617+0000 7f4e2f600700 1 -- 172.21.15.142:0/3338110055 shutdown_connections 2024-04-20T21:55:30.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.617+0000 7f4e2f600700 1 -- 172.21.15.142:0/3338110055 wait complete. 2024-04-20T21:55:30.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.618+0000 7f4e2f600700 1 Processor -- start 2024-04-20T21:55:30.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.619+0000 7f4e2f600700 1 -- start start 2024-04-20T21:55:30.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.619+0000 7f4e2f600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e28100c20 0x7f4e28074be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:30.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.619+0000 7f4e2f600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e28101e20 0x7f4e280732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:30.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.619+0000 7f4e2f600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e28073810 con 0x7f4e28100c20 2024-04-20T21:55:30.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.619+0000 7f4e2f600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e28073950 con 0x7f4e28101e20 2024-04-20T21:55:30.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.619+0000 7f4e2cc00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e28100c20 0x7f4e28074be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:30.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.619+0000 7f4e2cc00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e28100c20 0x7f4e28074be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35476/0 (socket says 172.21.15.142:35476) 2024-04-20T21:55:30.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.619+0000 7f4e2cc00700 1 -- 172.21.15.142:0/2929036963 learned_addr learned my addr 172.21.15.142:0/2929036963 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:30.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.620+0000 7f4e27e00700 1 --2- 172.21.15.142:0/2929036963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e28101e20 0x7f4e280732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:30.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.620+0000 7f4e2cc00700 1 -- 172.21.15.142:0/2929036963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e28101e20 msgr2=0x7f4e280732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:30.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.620+0000 7f4e2cc00700 1 --2- 172.21.15.142:0/2929036963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e28101e20 0x7f4e280732d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:30.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.620+0000 7f4e2cc00700 1 -- 172.21.15.142:0/2929036963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e140095f0 con 0x7f4e28100c20 2024-04-20T21:55:30.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.620+0000 7f4e2cc00700 1 --2- 172.21.15.142:0/2929036963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e28100c20 0x7f4e28074be0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c00c8f0 tx=0x7f4e1c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:30.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.620+0000 7f4e25600700 1 -- 172.21.15.142:0/2929036963 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e1c007a70 con 0x7f4e28100c20 2024-04-20T21:55:30.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.620+0000 7f4e25600700 1 -- 172.21.15.142:0/2929036963 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e1c007bd0 con 0x7f4e28100c20 2024-04-20T21:55:30.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.620+0000 7f4e25600700 1 -- 172.21.15.142:0/2929036963 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e1c018630 con 0x7f4e28100c20 2024-04-20T21:55:30.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.620+0000 7f4e2f600700 1 -- 172.21.15.142:0/2929036963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e28073c30 con 0x7f4e28100c20 2024-04-20T21:55:30.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.621+0000 7f4e2f600700 1 -- 172.21.15.142:0/2929036963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2819e690 con 0x7f4e28100c20 2024-04-20T21:55:30.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.622+0000 7f4e2f600700 1 -- 172.21.15.142:0/2929036963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e281907a0 con 0x7f4e28100c20 2024-04-20T21:55:30.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.623+0000 7f4e25600700 1 -- 172.21.15.142:0/2929036963 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f4e1c00f450 con 0x7f4e28100c20 2024-04-20T21:55:30.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.623+0000 7f4e25600700 1 --2- 172.21.15.142:0/2929036963 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f4e1006cce0 0x7f4e1006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:30.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.624+0000 7f4e25600700 1 -- 172.21.15.142:0/2929036963 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f4e1c08c340 con 0x7f4e28100c20 2024-04-20T21:55:30.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.624+0000 7f4e27e00700 1 --2- 172.21.15.142:0/2929036963 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f4e1006cce0 0x7f4e1006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:30.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.625+0000 7f4e27e00700 1 --2- 172.21.15.142:0/2929036963 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f4e1006cce0 0x7f4e1006f1a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400b5c0 tx=0x7f4e14005160 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:30.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.628+0000 7f4e25600700 1 -- 172.21.15.142:0/2929036963 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f4e1c05a230 con 0x7f4e28100c20 2024-04-20T21:55:30.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.845+0000 7f4e2f600700 1 -- 172.21.15.142:0/2929036963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f4e28062510 con 0x7f4e28100c20 2024-04-20T21:55:30.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.846+0000 7f4e25600700 1 -- 172.21.15.142:0/2929036963 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v26)=0 v26) v1 ==== 155+0+0 (secure 0 0 0) 0x7f4e1c059dc0 con 0x7f4e28100c20 2024-04-20T21:55:30.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.848+0000 7f4e2f600700 1 -- 172.21.15.142:0/2929036963 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f4e1006cce0 msgr2=0x7f4e1006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:30.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.848+0000 7f4e2f600700 1 --2- 172.21.15.142:0/2929036963 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f4e1006cce0 0x7f4e1006f1a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400b5c0 tx=0x7f4e14005160 comp rx=0 tx=0).stop 2024-04-20T21:55:30.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.848+0000 7f4e2f600700 1 -- 172.21.15.142:0/2929036963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e28100c20 msgr2=0x7f4e28074be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:30.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.849+0000 7f4e2f600700 1 --2- 172.21.15.142:0/2929036963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e28100c20 0x7f4e28074be0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c00c8f0 tx=0x7f4e1c00ccb0 comp rx=0 tx=0).stop 2024-04-20T21:55:30.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.849+0000 7f4e2f600700 1 -- 172.21.15.142:0/2929036963 shutdown_connections 2024-04-20T21:55:30.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.849+0000 7f4e2f600700 1 --2- 172.21.15.142:0/2929036963 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f4e1006cce0 0x7f4e1006f1a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:30.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.849+0000 7f4e2f600700 1 --2- 172.21.15.142:0/2929036963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e28100c20 0x7f4e28074be0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:30.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.849+0000 7f4e2f600700 1 --2- 172.21.15.142:0/2929036963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e28101e20 0x7f4e280732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:30.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.849+0000 7f4e2f600700 1 -- 172.21.15.142:0/2929036963 >> 172.21.15.142:0/2929036963 conn(0x7f4e280fc1c0 msgr2=0x7f4e28105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:30.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.849+0000 7f4e2f600700 1 -- 172.21.15.142:0/2929036963 shutdown_connections 2024-04-20T21:55:30.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:30.849+0000 7f4e2f600700 1 -- 172.21.15.142:0/2929036963 wait complete. 2024-04-20T21:55:31.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:31 smithi164 ceph-mon[23506]: pgmap v255: 65 pgs: 65 active+clean; 585 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-20T21:55:31.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:31 smithi142 ceph-mon[15828]: pgmap v255: 65 pgs: 65 active+clean; 585 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-20T21:55:31.745 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -e sha1=a8c84f5997950fd7d008204839253291d52e6eda -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-04-20T21:55:32.162 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:55:33.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:33 smithi164 ceph-mon[23506]: pgmap v256: 65 pgs: 65 active+clean; 585 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-20T21:55:33.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:33 smithi142 ceph-mon[15828]: pgmap v256: 65 pgs: 65 active+clean; 585 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-20T21:55:34.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.381+0000 7f8048a00700 1 -- 172.21.15.142:0/4069798366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8044107260 msgr2=0x7f8044107680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:34.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.381+0000 7f8048a00700 1 --2- 172.21.15.142:0/4069798366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8044107260 0x7f8044107680 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8034009910 tx=0x7f8034009c20 comp rx=0 tx=0).stop 2024-04-20T21:55:34.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.381+0000 7f8048a00700 1 -- 172.21.15.142:0/4069798366 shutdown_connections 2024-04-20T21:55:34.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.381+0000 7f8048a00700 1 --2- 172.21.15.142:0/4069798366 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8044108430 0x7f80441088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:34.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.381+0000 7f8048a00700 1 --2- 172.21.15.142:0/4069798366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8044107260 0x7f8044107680 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:34.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.381+0000 7f8048a00700 1 -- 172.21.15.142:0/4069798366 >> 172.21.15.142:0/4069798366 conn(0x7f8044076400 msgr2=0x7f8044078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:34.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.381+0000 7f8048a00700 1 -- 172.21.15.142:0/4069798366 shutdown_connections 2024-04-20T21:55:34.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.382+0000 7f8048a00700 1 -- 172.21.15.142:0/4069798366 wait complete. 2024-04-20T21:55:34.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.383+0000 7f8048a00700 1 Processor -- start 2024-04-20T21:55:34.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.383+0000 7f8048a00700 1 -- start start 2024-04-20T21:55:34.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.384+0000 7f8048a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8044107260 0x7f804419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:34.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.384+0000 7f8048a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8044108430 0x7f804419d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:34.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.384+0000 7f8048a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804419d790 con 0x7f8044108430 2024-04-20T21:55:34.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.384+0000 7f8048a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804419d8d0 con 0x7f8044107260 2024-04-20T21:55:34.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.384+0000 7f8041400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8044108430 0x7f804419d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:34.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.384+0000 7f8041400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8044108430 0x7f804419d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35494/0 (socket says 172.21.15.142:35494) 2024-04-20T21:55:34.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.384+0000 7f8041400700 1 -- 172.21.15.142:0/2763536157 learned_addr learned my addr 172.21.15.142:0/2763536157 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:34.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.384+0000 7f8041e00700 1 --2- 172.21.15.142:0/2763536157 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8044107260 0x7f804419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:34.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.384+0000 7f8041400700 1 -- 172.21.15.142:0/2763536157 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8044107260 msgr2=0x7f804419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:34.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.384+0000 7f8041400700 1 --2- 172.21.15.142:0/2763536157 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8044107260 0x7f804419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:34.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.384+0000 7f8041400700 1 -- 172.21.15.142:0/2763536157 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80340095f0 con 0x7f8044108430 2024-04-20T21:55:34.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.385+0000 7f8041400700 1 --2- 172.21.15.142:0/2763536157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8044108430 0x7f804419d170 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f803000d8d0 tx=0x7f803000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:34.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.385+0000 7f803aa00700 1 -- 172.21.15.142:0/2763536157 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8030009940 con 0x7f8044108430 2024-04-20T21:55:34.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.385+0000 7f803aa00700 1 -- 172.21.15.142:0/2763536157 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8030010460 con 0x7f8044108430 2024-04-20T21:55:34.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.385+0000 7f8048a00700 1 -- 172.21.15.142:0/2763536157 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80441a22e0 con 0x7f8044108430 2024-04-20T21:55:34.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.385+0000 7f803aa00700 1 -- 172.21.15.142:0/2763536157 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f803000f5f0 con 0x7f8044108430 2024-04-20T21:55:34.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.385+0000 7f8048a00700 1 -- 172.21.15.142:0/2763536157 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80441a28b0 con 0x7f8044108430 2024-04-20T21:55:34.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.387+0000 7f8048a00700 1 -- 172.21.15.142:0/2763536157 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8044196dd0 con 0x7f8044108430 2024-04-20T21:55:34.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.388+0000 7f803aa00700 1 -- 172.21.15.142:0/2763536157 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f80300105d0 con 0x7f8044108430 2024-04-20T21:55:34.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.389+0000 7f803aa00700 1 --2- 172.21.15.142:0/2763536157 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f802806ccf0 0x7f802806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:34.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.390+0000 7f803aa00700 1 -- 172.21.15.142:0/2763536157 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f803008c260 con 0x7f8044108430 2024-04-20T21:55:34.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.390+0000 7f8041e00700 1 --2- 172.21.15.142:0/2763536157 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f802806ccf0 0x7f802806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:34.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.390+0000 7f8041e00700 1 --2- 172.21.15.142:0/2763536157 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f802806ccf0 0x7f802806f1b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f80340051c0 tx=0x7f803400b540 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:34.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.395+0000 7f803aa00700 1 -- 172.21.15.142:0/2763536157 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f803005a0c0 con 0x7f8044108430 2024-04-20T21:55:34.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.617+0000 7f8048a00700 1 -- 172.21.15.142:0/2763536157 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f804404ebb0 con 0x7f8044108430 2024-04-20T21:55:34.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.618+0000 7f803aa00700 1 -- 172.21.15.142:0/2763536157 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v26)=0 v26) v1 ==== 163+0+0 (secure 0 0 0) 0x7f8030059c50 con 0x7f8044108430 2024-04-20T21:55:34.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.621+0000 7f8048a00700 1 -- 172.21.15.142:0/2763536157 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f802806ccf0 msgr2=0x7f802806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:34.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.621+0000 7f8048a00700 1 --2- 172.21.15.142:0/2763536157 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f802806ccf0 0x7f802806f1b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f80340051c0 tx=0x7f803400b540 comp rx=0 tx=0).stop 2024-04-20T21:55:34.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.621+0000 7f8048a00700 1 -- 172.21.15.142:0/2763536157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8044108430 msgr2=0x7f804419d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:34.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.621+0000 7f8048a00700 1 --2- 172.21.15.142:0/2763536157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8044108430 0x7f804419d170 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f803000d8d0 tx=0x7f803000dc90 comp rx=0 tx=0).stop 2024-04-20T21:55:34.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.621+0000 7f8048a00700 1 -- 172.21.15.142:0/2763536157 shutdown_connections 2024-04-20T21:55:34.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.621+0000 7f8048a00700 1 --2- 172.21.15.142:0/2763536157 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f802806ccf0 0x7f802806f1b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:34.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.621+0000 7f8048a00700 1 --2- 172.21.15.142:0/2763536157 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8044107260 0x7f804419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:34.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.621+0000 7f8048a00700 1 --2- 172.21.15.142:0/2763536157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8044108430 0x7f804419d170 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:34.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.621+0000 7f8048a00700 1 -- 172.21.15.142:0/2763536157 >> 172.21.15.142:0/2763536157 conn(0x7f8044076400 msgr2=0x7f804410b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:34.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.622+0000 7f8048a00700 1 -- 172.21.15.142:0/2763536157 shutdown_connections 2024-04-20T21:55:34.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:34.622+0000 7f8048a00700 1 -- 172.21.15.142:0/2763536157 wait complete. 2024-04-20T21:55:35.427 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:35 smithi142 ceph-mon[15828]: pgmap v257: 65 pgs: 65 active+clean; 585 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-20T21:55:35.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:35 smithi164 ceph-mon[23506]: pgmap v257: 65 pgs: 65 active+clean; 585 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-20T21:55:35.476 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -e sha1=a8c84f5997950fd7d008204839253291d52e6eda -- bash -c 'ceph config set global log_to_journald false --force' 2024-04-20T21:55:35.886 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:55:37.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:37 smithi142 ceph-mon[15828]: pgmap v258: 65 pgs: 65 active+clean; 585 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-20T21:55:37.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:37 smithi164 ceph-mon[23506]: pgmap v258: 65 pgs: 65 active+clean; 585 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-20T21:55:38.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.065+0000 7f167fe00700 1 -- 172.21.15.142:0/2910562969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16800ff2f0 msgr2=0x7f1680101720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:38.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.065+0000 7f167fe00700 1 --2- 172.21.15.142:0/2910562969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16800ff2f0 0x7f1680101720 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1670009910 tx=0x7f1670009c20 comp rx=0 tx=0).stop 2024-04-20T21:55:38.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.065+0000 7f167fe00700 1 -- 172.21.15.142:0/2910562969 shutdown_connections 2024-04-20T21:55:38.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.065+0000 7f167fe00700 1 --2- 172.21.15.142:0/2910562969 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1680101c60 0x7f16801040f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:38.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.065+0000 7f167fe00700 1 --2- 172.21.15.142:0/2910562969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16800ff2f0 0x7f1680101720 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:38.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.065+0000 7f167fe00700 1 -- 172.21.15.142:0/2910562969 >> 172.21.15.142:0/2910562969 conn(0x7f16800faf10 msgr2=0x7f16800fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:38.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.065+0000 7f167fe00700 1 -- 172.21.15.142:0/2910562969 shutdown_connections 2024-04-20T21:55:38.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.065+0000 7f167fe00700 1 -- 172.21.15.142:0/2910562969 wait complete. 2024-04-20T21:55:38.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.066+0000 7f167fe00700 1 Processor -- start 2024-04-20T21:55:38.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.066+0000 7f167fe00700 1 -- start start 2024-04-20T21:55:38.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.066+0000 7f167fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16800ff2f0 0x7f168019cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:38.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.067+0000 7f167fe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1680101c60 0x7f168019d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:38.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.067+0000 7f167fe00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168019d660 con 0x7f16800ff2f0 2024-04-20T21:55:38.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.067+0000 7f167fe00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168019d7a0 con 0x7f1680101c60 2024-04-20T21:55:38.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.067+0000 7f167ea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16800ff2f0 0x7f168019cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:38.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.067+0000 7f167ea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16800ff2f0 0x7f168019cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52620/0 (socket says 172.21.15.142:52620) 2024-04-20T21:55:38.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.067+0000 7f167ea00700 1 -- 172.21.15.142:0/803704611 learned_addr learned my addr 172.21.15.142:0/803704611 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:38.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.067+0000 7f167e000700 1 --2- 172.21.15.142:0/803704611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1680101c60 0x7f168019d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:38.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.067+0000 7f167ea00700 1 -- 172.21.15.142:0/803704611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1680101c60 msgr2=0x7f168019d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:38.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.067+0000 7f167ea00700 1 --2- 172.21.15.142:0/803704611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1680101c60 0x7f168019d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:38.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.067+0000 7f167ea00700 1 -- 172.21.15.142:0/803704611 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16700095f0 con 0x7f16800ff2f0 2024-04-20T21:55:38.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.068+0000 7f167ea00700 1 --2- 172.21.15.142:0/803704611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16800ff2f0 0x7f168019cb00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f167000bd70 tx=0x7f167000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:38.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.068+0000 7f1684a00700 1 -- 172.21.15.142:0/803704611 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f167001d070 con 0x7f16800ff2f0 2024-04-20T21:55:38.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.068+0000 7f1684a00700 1 -- 172.21.15.142:0/803704611 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f167000f460 con 0x7f16800ff2f0 2024-04-20T21:55:38.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.068+0000 7f1684a00700 1 -- 172.21.15.142:0/803704611 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1670021620 con 0x7f16800ff2f0 2024-04-20T21:55:38.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.068+0000 7f167fe00700 1 -- 172.21.15.142:0/803704611 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16801a21a0 con 0x7f16800ff2f0 2024-04-20T21:55:38.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.068+0000 7f167fe00700 1 -- 172.21.15.142:0/803704611 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16801a26c0 con 0x7f16800ff2f0 2024-04-20T21:55:38.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.069+0000 7f167fe00700 1 -- 172.21.15.142:0/803704611 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168004f400 con 0x7f16800ff2f0 2024-04-20T21:55:38.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.070+0000 7f1684a00700 1 -- 172.21.15.142:0/803704611 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f167000fa70 con 0x7f16800ff2f0 2024-04-20T21:55:38.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.071+0000 7f1684a00700 1 --2- 172.21.15.142:0/803704611 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f166406ccf0 0x7f166406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:38.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.071+0000 7f1684a00700 1 -- 172.21.15.142:0/803704611 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f167008d5d0 con 0x7f16800ff2f0 2024-04-20T21:55:38.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.071+0000 7f167e000700 1 --2- 172.21.15.142:0/803704611 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f166406ccf0 0x7f166406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:38.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.072+0000 7f167e000700 1 --2- 172.21.15.142:0/803704611 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f166406ccf0 0x7f166406f1b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f166c006fd0 tx=0x7f166c008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:38.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.076+0000 7f1684a00700 1 -- 172.21.15.142:0/803704611 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f167005b410 con 0x7f16800ff2f0 2024-04-20T21:55:38.296 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.296+0000 7f167fe00700 1 -- 172.21.15.142:0/803704611 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f168010fc40 con 0x7f16800ff2f0 2024-04-20T21:55:38.297 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.297+0000 7f1684a00700 1 -- 172.21.15.142:0/803704611 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v26)=0 v26) v1 ==== 135+0+0 (secure 0 0 0) 0x7f167005afa0 con 0x7f16800ff2f0 2024-04-20T21:55:38.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.300+0000 7f167fe00700 1 -- 172.21.15.142:0/803704611 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f166406ccf0 msgr2=0x7f166406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:38.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.300+0000 7f167fe00700 1 --2- 172.21.15.142:0/803704611 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f166406ccf0 0x7f166406f1b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f166c006fd0 tx=0x7f166c008040 comp rx=0 tx=0).stop 2024-04-20T21:55:38.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.300+0000 7f167fe00700 1 -- 172.21.15.142:0/803704611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16800ff2f0 msgr2=0x7f168019cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:38.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.300+0000 7f167fe00700 1 --2- 172.21.15.142:0/803704611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16800ff2f0 0x7f168019cb00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f167000bd70 tx=0x7f167000be50 comp rx=0 tx=0).stop 2024-04-20T21:55:38.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.300+0000 7f167fe00700 1 -- 172.21.15.142:0/803704611 shutdown_connections 2024-04-20T21:55:38.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.300+0000 7f167fe00700 1 --2- 172.21.15.142:0/803704611 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f166406ccf0 0x7f166406f1b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:38.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.300+0000 7f167fe00700 1 --2- 172.21.15.142:0/803704611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16800ff2f0 0x7f168019cb00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:38.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.300+0000 7f167fe00700 1 --2- 172.21.15.142:0/803704611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1680101c60 0x7f168019d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:38.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.300+0000 7f167fe00700 1 -- 172.21.15.142:0/803704611 >> 172.21.15.142:0/803704611 conn(0x7f16800faf10 msgr2=0x7f16800fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:38.300 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.300+0000 7f167fe00700 1 -- 172.21.15.142:0/803704611 shutdown_connections 2024-04-20T21:55:38.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:38.301+0000 7f167fe00700 1 -- 172.21.15.142:0/803704611 wait complete. 2024-04-20T21:55:39.245 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -e sha1=a8c84f5997950fd7d008204839253291d52e6eda -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-04-20T21:55:39.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:39 smithi142 ceph-mon[15828]: pgmap v259: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-04-20T21:55:39.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:39 smithi164 ceph-mon[23506]: pgmap v259: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-04-20T21:55:39.657 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:55:41.419 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:41 smithi142 ceph-mon[15828]: pgmap v260: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-20T21:55:41.419 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:41 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:55:41.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:41 smithi164 ceph-mon[23506]: pgmap v260: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-20T21:55:41.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:41 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:55:41.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.951+0000 7f5393800700 1 -- 172.21.15.142:0/1651970422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f538c101680 msgr2=0x7f538c103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:41.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.951+0000 7f5393800700 1 --2- 172.21.15.142:0/1651970422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f538c101680 0x7f538c103a70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5380009910 tx=0x7f5380009c20 comp rx=0 tx=0).stop 2024-04-20T21:55:41.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.951+0000 7f5393800700 1 -- 172.21.15.142:0/1651970422 shutdown_connections 2024-04-20T21:55:41.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.951+0000 7f5393800700 1 --2- 172.21.15.142:0/1651970422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f538c103fb0 0x7f538c1063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:41.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.951+0000 7f5393800700 1 --2- 172.21.15.142:0/1651970422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f538c101680 0x7f538c103a70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:41.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.951+0000 7f5393800700 1 -- 172.21.15.142:0/1651970422 >> 172.21.15.142:0/1651970422 conn(0x7f538c0fb0d0 msgr2=0x7f538c0fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:41.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.951+0000 7f5393800700 1 -- 172.21.15.142:0/1651970422 shutdown_connections 2024-04-20T21:55:41.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.951+0000 7f5393800700 1 -- 172.21.15.142:0/1651970422 wait complete. 2024-04-20T21:55:41.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.952+0000 7f5393800700 1 Processor -- start 2024-04-20T21:55:41.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.952+0000 7f5393800700 1 -- start start 2024-04-20T21:55:41.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.953+0000 7f5393800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f538c101680 0x7f538c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:41.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.953+0000 7f5393800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f538c103fb0 0x7f538c198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:41.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.953+0000 7f5393800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c199480 con 0x7f538c103fb0 2024-04-20T21:55:41.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.953+0000 7f5393800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c1995c0 con 0x7f538c101680 2024-04-20T21:55:41.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.953+0000 7f538be00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f538c103fb0 0x7f538c198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:41.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.953+0000 7f538be00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f538c103fb0 0x7f538c198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52632/0 (socket says 172.21.15.142:52632) 2024-04-20T21:55:41.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.953+0000 7f538be00700 1 -- 172.21.15.142:0/1466168159 learned_addr learned my addr 172.21.15.142:0/1466168159 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:41.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.953+0000 7f5390e00700 1 --2- 172.21.15.142:0/1466168159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f538c101680 0x7f538c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:41.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.954+0000 7f538be00700 1 -- 172.21.15.142:0/1466168159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f538c101680 msgr2=0x7f538c198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:41.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.954+0000 7f538be00700 1 --2- 172.21.15.142:0/1466168159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f538c101680 0x7f538c198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:41.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.954+0000 7f538be00700 1 -- 172.21.15.142:0/1466168159 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53800095f0 con 0x7f538c103fb0 2024-04-20T21:55:41.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.954+0000 7f538be00700 1 --2- 172.21.15.142:0/1466168159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f538c103fb0 0x7f538c198e60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f537800b4b0 tx=0x7f537800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:41.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.954+0000 7f5389600700 1 -- 172.21.15.142:0/1466168159 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5378011800 con 0x7f538c103fb0 2024-04-20T21:55:41.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.954+0000 7f5389600700 1 -- 172.21.15.142:0/1466168159 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5378011e20 con 0x7f538c103fb0 2024-04-20T21:55:41.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.954+0000 7f5393800700 1 -- 172.21.15.142:0/1466168159 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538c19e020 con 0x7f538c103fb0 2024-04-20T21:55:41.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.954+0000 7f5393800700 1 -- 172.21.15.142:0/1466168159 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538c19e5c0 con 0x7f538c103fb0 2024-04-20T21:55:41.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.955+0000 7f5389600700 1 -- 172.21.15.142:0/1466168159 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f537800f2e0 con 0x7f538c103fb0 2024-04-20T21:55:41.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.956+0000 7f5393800700 1 -- 172.21.15.142:0/1466168159 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538c0fcc50 con 0x7f538c103fb0 2024-04-20T21:55:41.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.957+0000 7f5389600700 1 -- 172.21.15.142:0/1466168159 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f5378010380 con 0x7f538c103fb0 2024-04-20T21:55:41.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.958+0000 7f5389600700 1 --2- 172.21.15.142:0/1466168159 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f537406cce0 0x7f537406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:41.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.958+0000 7f5389600700 1 -- 172.21.15.142:0/1466168159 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f537808bea0 con 0x7f538c103fb0 2024-04-20T21:55:41.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.958+0000 7f5390e00700 1 --2- 172.21.15.142:0/1466168159 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f537406cce0 0x7f537406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:41.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.959+0000 7f5390e00700 1 --2- 172.21.15.142:0/1466168159 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f537406cce0 0x7f537406f1a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5380005100 tx=0x7f5380005090 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:41.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:41.963+0000 7f5389600700 1 -- 172.21.15.142:0/1466168159 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f5378059c60 con 0x7f538c103fb0 2024-04-20T21:55:42.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:42.204+0000 7f5393800700 1 -- 172.21.15.142:0/1466168159 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda", "target": ["mon-mgr", ""]}) v1 -- 0x7f538c02ce00 con 0x7f537406cce0 2024-04-20T21:55:42.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:42.217+0000 7f5389600700 1 -- 172.21.15.142:0/1466168159 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f538c02ce00 con 0x7f537406cce0 2024-04-20T21:55:42.217 INFO:teuthology.orchestra.run.smithi142.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:55:42.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:42.220+0000 7f5393800700 1 -- 172.21.15.142:0/1466168159 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f537406cce0 msgr2=0x7f537406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:42.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:42.220+0000 7f5393800700 1 --2- 172.21.15.142:0/1466168159 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f537406cce0 0x7f537406f1a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5380005100 tx=0x7f5380005090 comp rx=0 tx=0).stop 2024-04-20T21:55:42.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:42.220+0000 7f5393800700 1 -- 172.21.15.142:0/1466168159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f538c103fb0 msgr2=0x7f538c198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:42.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:42.220+0000 7f5393800700 1 --2- 172.21.15.142:0/1466168159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f538c103fb0 0x7f538c198e60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f537800b4b0 tx=0x7f537800b870 comp rx=0 tx=0).stop 2024-04-20T21:55:42.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:42.220+0000 7f5393800700 1 -- 172.21.15.142:0/1466168159 shutdown_connections 2024-04-20T21:55:42.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:42.220+0000 7f5393800700 1 --2- 172.21.15.142:0/1466168159 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f537406cce0 0x7f537406f1a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:42.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:42.220+0000 7f5393800700 1 --2- 172.21.15.142:0/1466168159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f538c101680 0x7f538c198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:42.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:42.220+0000 7f5393800700 1 --2- 172.21.15.142:0/1466168159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f538c103fb0 0x7f538c198e60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:42.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:42.220+0000 7f5393800700 1 -- 172.21.15.142:0/1466168159 >> 172.21.15.142:0/1466168159 conn(0x7f538c0fb0d0 msgr2=0x7f538c1049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:42.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:42.221+0000 7f5393800700 1 -- 172.21.15.142:0/1466168159 shutdown_connections 2024-04-20T21:55:42.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:42.221+0000 7f5393800700 1 -- 172.21.15.142:0/1466168159 wait complete. 2024-04-20T21:55:43.108 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-20T21:55:43.109 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi142.front.sepia.ceph.com 2024-04-20T21:55:43.109 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -e sha1=a8c84f5997950fd7d008204839253291d52e6eda -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-04-20T21:55:43.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:43 smithi142 ceph-mon[15828]: pgmap v261: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-20T21:55:43.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:43 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:55:43.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:43 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:55:43.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:43 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:55:43.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:43 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:55:43.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:43 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:55:43.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:43 smithi164 ceph-mon[23506]: pgmap v261: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-20T21:55:43.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:43 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:55:43.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:43 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:55:43.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:43 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:55:43.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:43 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:55:43.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:43 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:55:43.512 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T21:55:44.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:44 smithi142 ceph-mon[15828]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:55:44.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:44 smithi142 ceph-mon[15828]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:55:44.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:44 smithi142 ceph-mon[15828]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:55:44.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:44 smithi164 ceph-mon[23506]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:55:44.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:44 smithi164 ceph-mon[23506]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:55:44.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:44 smithi164 ceph-mon[23506]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T21:55:45.414 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:45 smithi142 ceph-mon[15828]: pgmap v262: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-20T21:55:45.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:45 smithi164 ceph-mon[23506]: pgmap v262: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-20T21:55:45.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.735+0000 7ff6dbe00700 1 -- 172.21.15.142:0/3755655981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6dc073940 msgr2=0x7ff6dc073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:45.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.735+0000 7ff6dbe00700 1 --2- 172.21.15.142:0/3755655981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6dc073940 0x7ff6dc073dc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009910 tx=0x7ff6c8009c20 comp rx=0 tx=0).stop 2024-04-20T21:55:45.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.735+0000 7ff6dbe00700 1 -- 172.21.15.142:0/3755655981 shutdown_connections 2024-04-20T21:55:45.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.735+0000 7ff6dbe00700 1 --2- 172.21.15.142:0/3755655981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6dc073940 0x7ff6dc073dc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:45.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.735+0000 7ff6dbe00700 1 --2- 172.21.15.142:0/3755655981 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6dc074f10 0x7ff6dc073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:45.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.735+0000 7ff6dbe00700 1 -- 172.21.15.142:0/3755655981 >> 172.21.15.142:0/3755655981 conn(0x7ff6dc0fc000 msgr2=0x7ff6dc0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:45.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.735+0000 7ff6dbe00700 1 -- 172.21.15.142:0/3755655981 shutdown_connections 2024-04-20T21:55:45.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.735+0000 7ff6dbe00700 1 -- 172.21.15.142:0/3755655981 wait complete. 2024-04-20T21:55:45.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.737+0000 7ff6dbe00700 1 Processor -- start 2024-04-20T21:55:45.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.737+0000 7ff6dbe00700 1 -- start start 2024-04-20T21:55:45.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.737+0000 7ff6dbe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6dc073940 0x7ff6dc19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:45.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.737+0000 7ff6dbe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6dc074f10 0x7ff6dc19d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:45.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.737+0000 7ff6dbe00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc19d6d0 con 0x7ff6dc073940 2024-04-20T21:55:45.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.737+0000 7ff6dbe00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc19d810 con 0x7ff6dc074f10 2024-04-20T21:55:45.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.738+0000 7ff6daa00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6dc073940 0x7ff6dc19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:45.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.738+0000 7ff6daa00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6dc073940 0x7ff6dc19cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52658/0 (socket says 172.21.15.142:52658) 2024-04-20T21:55:45.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.738+0000 7ff6daa00700 1 -- 172.21.15.142:0/3290730963 learned_addr learned my addr 172.21.15.142:0/3290730963 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:45.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.738+0000 7ff6da000700 1 --2- 172.21.15.142:0/3290730963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6dc074f10 0x7ff6dc19d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:45.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.738+0000 7ff6daa00700 1 -- 172.21.15.142:0/3290730963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6dc074f10 msgr2=0x7ff6dc19d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:45.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.738+0000 7ff6daa00700 1 --2- 172.21.15.142:0/3290730963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6dc074f10 0x7ff6dc19d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:45.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.738+0000 7ff6daa00700 1 -- 172.21.15.142:0/3290730963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c80095f0 con 0x7ff6dc073940 2024-04-20T21:55:45.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.739+0000 7ff6daa00700 1 --2- 172.21.15.142:0/3290730963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6dc073940 0x7ff6dc19cb70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00b480 tx=0x7ff6cc00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:45.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.739+0000 7ff6d3400700 1 -- 172.21.15.142:0/3290730963 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6cc0118c0 con 0x7ff6dc073940 2024-04-20T21:55:45.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.739+0000 7ff6d3400700 1 -- 172.21.15.142:0/3290730963 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6cc010380 con 0x7ff6dc073940 2024-04-20T21:55:45.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.739+0000 7ff6dbe00700 1 -- 172.21.15.142:0/3290730963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6dc1a2270 con 0x7ff6dc073940 2024-04-20T21:55:45.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.739+0000 7ff6d3400700 1 -- 172.21.15.142:0/3290730963 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6cc00f4f0 con 0x7ff6dc073940 2024-04-20T21:55:45.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.739+0000 7ff6dbe00700 1 -- 172.21.15.142:0/3290730963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6dc1a2840 con 0x7ff6dc073940 2024-04-20T21:55:45.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.740+0000 7ff6dbe00700 1 -- 172.21.15.142:0/3290730963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6dc196c70 con 0x7ff6dc073940 2024-04-20T21:55:45.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.742+0000 7ff6d3400700 1 -- 172.21.15.142:0/3290730963 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff6cc0104f0 con 0x7ff6dc073940 2024-04-20T21:55:45.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.743+0000 7ff6d3400700 1 --2- 172.21.15.142:0/3290730963 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff6c006cce0 0x7ff6c006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:45.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.743+0000 7ff6d3400700 1 -- 172.21.15.142:0/3290730963 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7ff6cc08bf70 con 0x7ff6dc073940 2024-04-20T21:55:45.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.743+0000 7ff6da000700 1 --2- 172.21.15.142:0/3290730963 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff6c006cce0 0x7ff6c006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:45.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.744+0000 7ff6da000700 1 --2- 172.21.15.142:0/3290730963 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff6c006cce0 0x7ff6c006f1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8006010 tx=0x7ff6c800b540 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:45.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:45.752+0000 7ff6d3400700 1 -- 172.21.15.142:0/3290730963 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7ff6cc059d30 con 0x7ff6dc073940 2024-04-20T21:55:46.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.047+0000 7ff6dbe00700 1 -- 172.21.15.142:0/3290730963 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6dc02ce50 con 0x7ff6c006cce0 2024-04-20T21:55:46.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.049+0000 7ff6d3400700 1 -- 172.21.15.142:0/3290730963 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7ff6dc02ce50 con 0x7ff6c006cce0 2024-04-20T21:55:46.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.052+0000 7ff6dbe00700 1 -- 172.21.15.142:0/3290730963 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff6c006cce0 msgr2=0x7ff6c006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:46.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.052+0000 7ff6dbe00700 1 --2- 172.21.15.142:0/3290730963 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff6c006cce0 0x7ff6c006f1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8006010 tx=0x7ff6c800b540 comp rx=0 tx=0).stop 2024-04-20T21:55:46.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.052+0000 7ff6dbe00700 1 -- 172.21.15.142:0/3290730963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6dc073940 msgr2=0x7ff6dc19cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:46.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.052+0000 7ff6dbe00700 1 --2- 172.21.15.142:0/3290730963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6dc073940 0x7ff6dc19cb70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00b480 tx=0x7ff6cc00b840 comp rx=0 tx=0).stop 2024-04-20T21:55:46.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.053+0000 7ff6dbe00700 1 -- 172.21.15.142:0/3290730963 shutdown_connections 2024-04-20T21:55:46.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.053+0000 7ff6dbe00700 1 --2- 172.21.15.142:0/3290730963 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff6c006cce0 0x7ff6c006f1a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:46.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.053+0000 7ff6dbe00700 1 --2- 172.21.15.142:0/3290730963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6dc073940 0x7ff6dc19cb70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:46.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.053+0000 7ff6dbe00700 1 --2- 172.21.15.142:0/3290730963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6dc074f10 0x7ff6dc19d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:46.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.053+0000 7ff6dbe00700 1 -- 172.21.15.142:0/3290730963 >> 172.21.15.142:0/3290730963 conn(0x7ff6dc0fc000 msgr2=0x7ff6dc1028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:46.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.053+0000 7ff6dbe00700 1 -- 172.21.15.142:0/3290730963 shutdown_connections 2024-04-20T21:55:46.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.053+0000 7ff6dbe00700 1 -- 172.21.15.142:0/3290730963 wait complete. 2024-04-20T21:55:46.069 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T21:55:46.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.212+0000 7fcf46c00700 1 -- 172.21.15.142:0/1847960115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf40101530 msgr2=0x7fcf40103920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:46.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.212+0000 7fcf46c00700 1 --2- 172.21.15.142:0/1847960115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf40101530 0x7fcf40103920 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009910 tx=0x7fcf34009c20 comp rx=0 tx=0).stop 2024-04-20T21:55:46.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.212+0000 7fcf46c00700 1 -- 172.21.15.142:0/1847960115 shutdown_connections 2024-04-20T21:55:46.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.212+0000 7fcf46c00700 1 --2- 172.21.15.142:0/1847960115 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf40103e60 0x7fcf40106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:46.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.212+0000 7fcf46c00700 1 --2- 172.21.15.142:0/1847960115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf40101530 0x7fcf40103920 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:46.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.212+0000 7fcf46c00700 1 -- 172.21.15.142:0/1847960115 >> 172.21.15.142:0/1847960115 conn(0x7fcf400faee0 msgr2=0x7fcf400fd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:46.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.213+0000 7fcf46c00700 1 -- 172.21.15.142:0/1847960115 shutdown_connections 2024-04-20T21:55:46.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.213+0000 7fcf46c00700 1 -- 172.21.15.142:0/1847960115 wait complete. 2024-04-20T21:55:46.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.214+0000 7fcf46c00700 1 Processor -- start 2024-04-20T21:55:46.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.214+0000 7fcf46c00700 1 -- start start 2024-04-20T21:55:46.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.214+0000 7fcf46c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf40101530 0x7fcf40198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:46.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.214+0000 7fcf46c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf40103e60 0x7fcf40198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:46.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.214+0000 7fcf46c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf401992b0 con 0x7fcf40101530 2024-04-20T21:55:46.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.214+0000 7fcf46c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf401993f0 con 0x7fcf40103e60 2024-04-20T21:55:46.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.214+0000 7fcf45800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf40101530 0x7fcf40198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:46.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.214+0000 7fcf45800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf40101530 0x7fcf40198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52670/0 (socket says 172.21.15.142:52670) 2024-04-20T21:55:46.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.214+0000 7fcf45800700 1 -- 172.21.15.142:0/3311618284 learned_addr learned my addr 172.21.15.142:0/3311618284 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:46.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.215+0000 7fcf44e00700 1 --2- 172.21.15.142:0/3311618284 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf40103e60 0x7fcf40198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:46.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.215+0000 7fcf45800700 1 -- 172.21.15.142:0/3311618284 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf40103e60 msgr2=0x7fcf40198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:46.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.215+0000 7fcf45800700 1 --2- 172.21.15.142:0/3311618284 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf40103e60 0x7fcf40198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:46.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.215+0000 7fcf45800700 1 -- 172.21.15.142:0/3311618284 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf340095f0 con 0x7fcf40101530 2024-04-20T21:55:46.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.215+0000 7fcf45800700 1 --2- 172.21.15.142:0/3311618284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf40101530 0x7fcf40198750 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400bd70 tx=0x7fcf3400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:46.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.216+0000 7fcf3e000700 1 -- 172.21.15.142:0/3311618284 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf3401d070 con 0x7fcf40101530 2024-04-20T21:55:46.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.216+0000 7fcf3e000700 1 -- 172.21.15.142:0/3311618284 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf3400f460 con 0x7fcf40101530 2024-04-20T21:55:46.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.216+0000 7fcf3e000700 1 -- 172.21.15.142:0/3311618284 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf34021620 con 0x7fcf40101530 2024-04-20T21:55:46.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.216+0000 7fcf46c00700 1 -- 172.21.15.142:0/3311618284 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4019ddf0 con 0x7fcf40101530 2024-04-20T21:55:46.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.216+0000 7fcf46c00700 1 -- 172.21.15.142:0/3311618284 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4019e2d0 con 0x7fcf40101530 2024-04-20T21:55:46.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.217+0000 7fcf46c00700 1 -- 172.21.15.142:0/3311618284 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf40062510 con 0x7fcf40101530 2024-04-20T21:55:46.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.218+0000 7fcf3e000700 1 -- 172.21.15.142:0/3311618284 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fcf3400fa70 con 0x7fcf40101530 2024-04-20T21:55:46.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.219+0000 7fcf3e000700 1 --2- 172.21.15.142:0/3311618284 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fcf2806cce0 0x7fcf2806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:46.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.219+0000 7fcf3e000700 1 -- 172.21.15.142:0/3311618284 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fcf3408d590 con 0x7fcf40101530 2024-04-20T21:55:46.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.219+0000 7fcf44e00700 1 --2- 172.21.15.142:0/3311618284 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fcf2806cce0 0x7fcf2806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:46.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.220+0000 7fcf44e00700 1 --2- 172.21.15.142:0/3311618284 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fcf2806cce0 0x7fcf2806f1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c006fd0 tx=0x7fcf2c008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:46.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.224+0000 7fcf3e000700 1 -- 172.21.15.142:0/3311618284 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fcf3405b410 con 0x7fcf40101530 2024-04-20T21:55:46.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.481+0000 7fcf46c00700 1 -- 172.21.15.142:0/3311618284 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf400ffcd0 con 0x7fcf2806cce0 2024-04-20T21:55:46.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.485+0000 7fcf3e000700 1 -- 172.21.15.142:0/3311618284 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fcf400ffcd0 con 0x7fcf2806cce0 2024-04-20T21:55:46.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.488+0000 7fcf46c00700 1 -- 172.21.15.142:0/3311618284 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fcf2806cce0 msgr2=0x7fcf2806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:46.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.488+0000 7fcf46c00700 1 --2- 172.21.15.142:0/3311618284 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fcf2806cce0 0x7fcf2806f1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c006fd0 tx=0x7fcf2c008040 comp rx=0 tx=0).stop 2024-04-20T21:55:46.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.488+0000 7fcf46c00700 1 -- 172.21.15.142:0/3311618284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf40101530 msgr2=0x7fcf40198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:46.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.488+0000 7fcf46c00700 1 --2- 172.21.15.142:0/3311618284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf40101530 0x7fcf40198750 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400bd70 tx=0x7fcf3400be50 comp rx=0 tx=0).stop 2024-04-20T21:55:46.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.488+0000 7fcf46c00700 1 -- 172.21.15.142:0/3311618284 shutdown_connections 2024-04-20T21:55:46.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.488+0000 7fcf46c00700 1 --2- 172.21.15.142:0/3311618284 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fcf2806cce0 0x7fcf2806f1a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:46.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.488+0000 7fcf46c00700 1 --2- 172.21.15.142:0/3311618284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf40101530 0x7fcf40198750 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:46.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.488+0000 7fcf46c00700 1 --2- 172.21.15.142:0/3311618284 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcf40103e60 0x7fcf40198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:46.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.488+0000 7fcf46c00700 1 -- 172.21.15.142:0/3311618284 >> 172.21.15.142:0/3311618284 conn(0x7fcf400faee0 msgr2=0x7fcf400ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:46.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.488+0000 7fcf46c00700 1 -- 172.21.15.142:0/3311618284 shutdown_connections 2024-04-20T21:55:46.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.488+0000 7fcf46c00700 1 -- 172.21.15.142:0/3311618284 wait complete. 2024-04-20T21:55:46.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.655+0000 7f0ee3200700 1 -- 172.21.15.142:0/1129947675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ee4103e30 msgr2=0x7f0ee4104290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:46.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.655+0000 7f0ee3200700 1 --2- 172.21.15.142:0/1129947675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ee4103e30 0x7f0ee4104290 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009910 tx=0x7f0ed0009c20 comp rx=0 tx=0).stop 2024-04-20T21:55:46.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.655+0000 7f0ee3200700 1 -- 172.21.15.142:0/1129947675 shutdown_connections 2024-04-20T21:55:46.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.655+0000 7f0ee3200700 1 --2- 172.21.15.142:0/1129947675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ee4103e30 0x7f0ee4104290 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:46.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.655+0000 7f0ee3200700 1 --2- 172.21.15.142:0/1129947675 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ee4102c30 0x7f0ee4103050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:46.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.655+0000 7f0ee3200700 1 -- 172.21.15.142:0/1129947675 >> 172.21.15.142:0/1129947675 conn(0x7f0ee40fe1f0 msgr2=0x7f0ee4100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:46.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.655+0000 7f0ee3200700 1 -- 172.21.15.142:0/1129947675 shutdown_connections 2024-04-20T21:55:46.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.655+0000 7f0ee3200700 1 -- 172.21.15.142:0/1129947675 wait complete. 2024-04-20T21:55:46.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.657+0000 7f0ee3200700 1 Processor -- start 2024-04-20T21:55:46.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.657+0000 7f0ee3200700 1 -- start start 2024-04-20T21:55:46.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.657+0000 7f0ee3200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ee4102c30 0x7f0ee4198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:46.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.657+0000 7f0ee3200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ee4103e30 0x7f0ee4198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:46.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.657+0000 7f0ee3200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee41991a0 con 0x7f0ee4102c30 2024-04-20T21:55:46.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.657+0000 7f0ee3200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee41992e0 con 0x7f0ee4103e30 2024-04-20T21:55:46.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.657+0000 7f0ee1e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ee4102c30 0x7f0ee4198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:46.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.657+0000 7f0ee1e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ee4102c30 0x7f0ee4198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52686/0 (socket says 172.21.15.142:52686) 2024-04-20T21:55:46.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.657+0000 7f0ee1e00700 1 -- 172.21.15.142:0/3646048987 learned_addr learned my addr 172.21.15.142:0/3646048987 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:46.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.658+0000 7f0ee1400700 1 --2- 172.21.15.142:0/3646048987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ee4103e30 0x7f0ee4198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:46.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.658+0000 7f0ee1e00700 1 -- 172.21.15.142:0/3646048987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ee4103e30 msgr2=0x7f0ee4198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:46.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.658+0000 7f0ee1e00700 1 --2- 172.21.15.142:0/3646048987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ee4103e30 0x7f0ee4198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:46.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.658+0000 7f0ee1e00700 1 -- 172.21.15.142:0/3646048987 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed00095f0 con 0x7f0ee4102c30 2024-04-20T21:55:46.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.658+0000 7f0ee1400700 1 --2- 172.21.15.142:0/3646048987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ee4103e30 0x7f0ee4198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:55:46.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.658+0000 7f0ee1e00700 1 --2- 172.21.15.142:0/3646048987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ee4102c30 0x7f0ee4198640 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400d900 tx=0x7f0ed400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:46.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.659+0000 7f0edaa00700 1 -- 172.21.15.142:0/3646048987 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ed40041f0 con 0x7f0ee4102c30 2024-04-20T21:55:46.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.659+0000 7f0edaa00700 1 -- 172.21.15.142:0/3646048987 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ed4004350 con 0x7f0ee4102c30 2024-04-20T21:55:46.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.659+0000 7f0edaa00700 1 -- 172.21.15.142:0/3646048987 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ed4003dc0 con 0x7f0ee4102c30 2024-04-20T21:55:46.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.659+0000 7f0ee3200700 1 -- 172.21.15.142:0/3646048987 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee419dcf0 con 0x7f0ee4102c30 2024-04-20T21:55:46.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.659+0000 7f0ee3200700 1 -- 172.21.15.142:0/3646048987 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee419e260 con 0x7f0ee4102c30 2024-04-20T21:55:46.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.660+0000 7f0ee3200700 1 -- 172.21.15.142:0/3646048987 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee4062580 con 0x7f0ee4102c30 2024-04-20T21:55:46.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.662+0000 7f0edaa00700 1 -- 172.21.15.142:0/3646048987 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f0ed4009730 con 0x7f0ee4102c30 2024-04-20T21:55:46.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.663+0000 7f0edaa00700 1 --2- 172.21.15.142:0/3646048987 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f0ec806cce0 0x7f0ec806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:46.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.663+0000 7f0edaa00700 1 -- 172.21.15.142:0/3646048987 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f0ed408c420 con 0x7f0ee4102c30 2024-04-20T21:55:46.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.663+0000 7f0ee1400700 1 --2- 172.21.15.142:0/3646048987 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f0ec806cce0 0x7f0ec806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:46.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.664+0000 7f0ee1400700 1 --2- 172.21.15.142:0/3646048987 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f0ec806cce0 0x7f0ec806f1a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0005950 tx=0x7f0ed00058e0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:46.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.667+0000 7f0edaa00700 1 -- 172.21.15.142:0/3646048987 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f0ee4062580 con 0x7f0ee4102c30 2024-04-20T21:55:46.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.906+0000 7f0ee3200700 1 -- 172.21.15.142:0/3646048987 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ee4062510 con 0x7f0ec806cce0 2024-04-20T21:55:46.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.920+0000 7f0edaa00700 1 -- 172.21.15.142:0/3646048987 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f0ee4062510 con 0x7f0ec806cce0 2024-04-20T21:55:46.921 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T21:55:46.921 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (6m) 39s ago 8m 13.1M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T21:55:46.921 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (8m) 39s ago 8m 7528k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T21:55:46.922 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (7m) 45s ago 7m 7235k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T21:55:46.922 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (8m) 39s ago 8m 6665k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 56f2e41784f8 2024-04-20T21:55:46.922 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (7m) 45s ago 7m 6660k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 bce67525dd3e 2024-04-20T21:55:46.922 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (6m) 39s ago 8m 73.5M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T21:55:46.922 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (72s) 39s ago 71s 14.7M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 b68e279d7945 2024-04-20T21:55:46.922 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (63s) 39s ago 63s 11.7M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T21:55:46.922 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (59s) 45s ago 59s 11.6M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T21:55:46.922 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (68s) 45s ago 67s 11.7M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T21:55:46.922 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:9283,8765,8443 running (10m) 39s ago 10m 499M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d2c979afd250 2024-04-20T21:55:46.922 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (7m) 45s ago 7m 449M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 2e2b1f8dfca1 2024-04-20T21:55:46.922 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (10m) 39s ago 10m 45.0M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c076f7eb00ea 2024-04-20T21:55:46.922 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (6m) 45s ago 6m 34.7M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 2bacdeb02ee0 2024-04-20T21:55:46.922 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (8m) 39s ago 8m 7805k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T21:55:46.922 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (7m) 45s ago 7m 7666k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T21:55:46.923 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (5m) 39s ago 5m 46.7M 3947M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4361ae428e0d 2024-04-20T21:55:46.923 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (5m) 39s ago 5m 48.8M 3947M 18.2.2-1237-g646b8c7d 9900ed1a6b81 dd7e7cf8e8e1 2024-04-20T21:55:46.923 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (4m) 39s ago 4m 53.2M 3947M 18.2.2-1237-g646b8c7d 9900ed1a6b81 8e9165365127 2024-04-20T21:55:46.923 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (4m) 45s ago 4m 51.4M 4971M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c081911f56ab 2024-04-20T21:55:46.923 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (3m) 45s ago 3m 49.0M 4971M 18.2.2-1237-g646b8c7d 9900ed1a6b81 39e09d63d44f 2024-04-20T21:55:46.923 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (2m) 45s ago 2m 48.0M 4971M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4f36124aeb0d 2024-04-20T21:55:46.923 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (6m) 39s ago 7m 50.5M - 2.43.0 a07b618ecd1d a1f0ad25692f 2024-04-20T21:55:46.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.924+0000 7f0ee3200700 1 -- 172.21.15.142:0/3646048987 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f0ec806cce0 msgr2=0x7f0ec806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:46.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.924+0000 7f0ee3200700 1 --2- 172.21.15.142:0/3646048987 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f0ec806cce0 0x7f0ec806f1a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0005950 tx=0x7f0ed00058e0 comp rx=0 tx=0).stop 2024-04-20T21:55:46.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.924+0000 7f0ee3200700 1 -- 172.21.15.142:0/3646048987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ee4102c30 msgr2=0x7f0ee4198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:46.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.924+0000 7f0ee3200700 1 --2- 172.21.15.142:0/3646048987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ee4102c30 0x7f0ee4198640 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400d900 tx=0x7f0ed400dcc0 comp rx=0 tx=0).stop 2024-04-20T21:55:46.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.924+0000 7f0ee3200700 1 -- 172.21.15.142:0/3646048987 shutdown_connections 2024-04-20T21:55:46.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.924+0000 7f0ee3200700 1 --2- 172.21.15.142:0/3646048987 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f0ec806cce0 0x7f0ec806f1a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:46.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.924+0000 7f0ee3200700 1 --2- 172.21.15.142:0/3646048987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ee4102c30 0x7f0ee4198640 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:46.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.924+0000 7f0ee3200700 1 --2- 172.21.15.142:0/3646048987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ee4103e30 0x7f0ee4198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:46.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.924+0000 7f0ee3200700 1 -- 172.21.15.142:0/3646048987 >> 172.21.15.142:0/3646048987 conn(0x7f0ee40fe1f0 msgr2=0x7f0ee4107520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:46.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.925+0000 7f0ee3200700 1 -- 172.21.15.142:0/3646048987 shutdown_connections 2024-04-20T21:55:46.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:46.925+0000 7f0ee3200700 1 -- 172.21.15.142:0/3646048987 wait complete. 2024-04-20T21:55:47.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.085+0000 7ff0bd800700 1 -- 172.21.15.142:0/2942618401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0b8103e50 msgr2=0x7ff0b8106240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:47.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.085+0000 7ff0bd800700 1 --2- 172.21.15.142:0/2942618401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0b8103e50 0x7ff0b8106240 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4009910 tx=0x7ff0a4009c20 comp rx=0 tx=0).stop 2024-04-20T21:55:47.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.086+0000 7ff0bd800700 1 -- 172.21.15.142:0/2942618401 shutdown_connections 2024-04-20T21:55:47.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.086+0000 7ff0bd800700 1 --2- 172.21.15.142:0/2942618401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0b8103e50 0x7ff0b8106240 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:47.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.086+0000 7ff0bd800700 1 --2- 172.21.15.142:0/2942618401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff0b8101520 0x7ff0b8103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:47.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.086+0000 7ff0bd800700 1 -- 172.21.15.142:0/2942618401 >> 172.21.15.142:0/2942618401 conn(0x7ff0b80faef0 msgr2=0x7ff0b80fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:47.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.086+0000 7ff0bd800700 1 -- 172.21.15.142:0/2942618401 shutdown_connections 2024-04-20T21:55:47.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.086+0000 7ff0bd800700 1 -- 172.21.15.142:0/2942618401 wait complete. 2024-04-20T21:55:47.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.087+0000 7ff0bd800700 1 Processor -- start 2024-04-20T21:55:47.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.087+0000 7ff0bd800700 1 -- start start 2024-04-20T21:55:47.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.088+0000 7ff0bd800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff0b8101520 0x7ff0b8198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:47.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.088+0000 7ff0bd800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0b8103e50 0x7ff0b8198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:47.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.088+0000 7ff0bd800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b8199290 con 0x7ff0b8103e50 2024-04-20T21:55:47.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.088+0000 7ff0bd800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b81993d0 con 0x7ff0b8101520 2024-04-20T21:55:47.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.088+0000 7ff0b7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0b8103e50 0x7ff0b8198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:47.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.088+0000 7ff0b7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0b8103e50 0x7ff0b8198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33378/0 (socket says 172.21.15.142:33378) 2024-04-20T21:55:47.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.088+0000 7ff0b7400700 1 -- 172.21.15.142:0/4213829352 learned_addr learned my addr 172.21.15.142:0/4213829352 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:47.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.088+0000 7ff0b7e00700 1 --2- 172.21.15.142:0/4213829352 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff0b8101520 0x7ff0b8198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:47.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.088+0000 7ff0b7400700 1 -- 172.21.15.142:0/4213829352 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff0b8101520 msgr2=0x7ff0b8198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:47.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.088+0000 7ff0b7400700 1 --2- 172.21.15.142:0/4213829352 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff0b8101520 0x7ff0b8198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:47.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.088+0000 7ff0b7400700 1 -- 172.21.15.142:0/4213829352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a40095f0 con 0x7ff0b8103e50 2024-04-20T21:55:47.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.089+0000 7ff0b7400700 1 --2- 172.21.15.142:0/4213829352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0b8103e50 0x7ff0b8198c70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4006010 tx=0x7ff0a400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:47.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.089+0000 7ff0b4c00700 1 -- 172.21.15.142:0/4213829352 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0a401d070 con 0x7ff0b8103e50 2024-04-20T21:55:47.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.089+0000 7ff0b4c00700 1 -- 172.21.15.142:0/4213829352 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff0a400f460 con 0x7ff0b8103e50 2024-04-20T21:55:47.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.089+0000 7ff0bd800700 1 -- 172.21.15.142:0/4213829352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b819ddd0 con 0x7ff0b8103e50 2024-04-20T21:55:47.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.089+0000 7ff0b4c00700 1 -- 172.21.15.142:0/4213829352 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0a4021640 con 0x7ff0b8103e50 2024-04-20T21:55:47.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.089+0000 7ff0bd800700 1 -- 172.21.15.142:0/4213829352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b819e340 con 0x7ff0b8103e50 2024-04-20T21:55:47.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.091+0000 7ff0bd800700 1 -- 172.21.15.142:0/4213829352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b80fca70 con 0x7ff0b8103e50 2024-04-20T21:55:47.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.094+0000 7ff0b4c00700 1 -- 172.21.15.142:0/4213829352 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff0a400fad0 con 0x7ff0b8103e50 2024-04-20T21:55:47.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.095+0000 7ff0b4c00700 1 --2- 172.21.15.142:0/4213829352 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff09c06cce0 0x7ff09c06f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:47.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.095+0000 7ff0b4c00700 1 -- 172.21.15.142:0/4213829352 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7ff0a408d5a0 con 0x7ff0b8103e50 2024-04-20T21:55:47.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.095+0000 7ff0b7e00700 1 --2- 172.21.15.142:0/4213829352 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff09c06cce0 0x7ff09c06f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:47.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.096+0000 7ff0b7e00700 1 --2- 172.21.15.142:0/4213829352 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff09c06cce0 0x7ff09c06f1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8006fd0 tx=0x7ff0a8008040 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:47.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.100+0000 7ff0b4c00700 1 -- 172.21.15.142:0/4213829352 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7ff0a405b3e0 con 0x7ff0b8103e50 2024-04-20T21:55:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:47 smithi142 ceph-mon[15828]: pgmap v263: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-20T21:55:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:47 smithi142 ceph-mon[15828]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:55:47.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:47 smithi164 ceph-mon[23506]: pgmap v263: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-20T21:55:47.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:47 smithi164 ceph-mon[23506]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:55:47.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.463+0000 7ff0bd800700 1 -- 172.21.15.142:0/4213829352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff0b8109610 con 0x7ff0b8103e50 2024-04-20T21:55:47.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.464+0000 7ff0b4c00700 1 -- 172.21.15.142:0/4213829352 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7ff0a405af70 con 0x7ff0b8103e50 2024-04-20T21:55:47.465 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T21:55:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T21:55:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 2 2024-04-20T21:55:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:55:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T21:55:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 2 2024-04-20T21:55:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:55:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T21:55:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 6 2024-04-20T21:55:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:55:47.466 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T21:55:47.466 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4 2024-04-20T21:55:47.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:55:47.466 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T21:55:47.466 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 14 2024-04-20T21:55:47.466 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T21:55:47.466 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T21:55:47.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.467+0000 7ff0bd800700 1 -- 172.21.15.142:0/4213829352 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff09c06cce0 msgr2=0x7ff09c06f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:47.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.467+0000 7ff0bd800700 1 --2- 172.21.15.142:0/4213829352 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff09c06cce0 0x7ff09c06f1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8006fd0 tx=0x7ff0a8008040 comp rx=0 tx=0).stop 2024-04-20T21:55:47.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.467+0000 7ff0bd800700 1 -- 172.21.15.142:0/4213829352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0b8103e50 msgr2=0x7ff0b8198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:47.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.467+0000 7ff0bd800700 1 --2- 172.21.15.142:0/4213829352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0b8103e50 0x7ff0b8198c70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4006010 tx=0x7ff0a400be20 comp rx=0 tx=0).stop 2024-04-20T21:55:47.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.468+0000 7ff0bd800700 1 -- 172.21.15.142:0/4213829352 shutdown_connections 2024-04-20T21:55:47.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.468+0000 7ff0bd800700 1 --2- 172.21.15.142:0/4213829352 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff09c06cce0 0x7ff09c06f1a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:47.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.468+0000 7ff0bd800700 1 --2- 172.21.15.142:0/4213829352 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff0b8101520 0x7ff0b8198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:47.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.468+0000 7ff0bd800700 1 --2- 172.21.15.142:0/4213829352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0b8103e50 0x7ff0b8198c70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:47.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.468+0000 7ff0bd800700 1 -- 172.21.15.142:0/4213829352 >> 172.21.15.142:0/4213829352 conn(0x7ff0b80faef0 msgr2=0x7ff0b8104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:47.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.468+0000 7ff0bd800700 1 -- 172.21.15.142:0/4213829352 shutdown_connections 2024-04-20T21:55:47.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.468+0000 7ff0bd800700 1 -- 172.21.15.142:0/4213829352 wait complete. 2024-04-20T21:55:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.632+0000 7fc578a00700 1 -- 172.21.15.142:0/452045380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc574074eb0 msgr2=0x7fc574073310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.632+0000 7fc578a00700 1 --2- 172.21.15.142:0/452045380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc574074eb0 0x7fc574073310 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc564009910 tx=0x7fc564009c20 comp rx=0 tx=0).stop 2024-04-20T21:55:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.633+0000 7fc578a00700 1 -- 172.21.15.142:0/452045380 shutdown_connections 2024-04-20T21:55:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.633+0000 7fc578a00700 1 --2- 172.21.15.142:0/452045380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5740738e0 0x7fc574073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.633+0000 7fc578a00700 1 --2- 172.21.15.142:0/452045380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc574074eb0 0x7fc574073310 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.633+0000 7fc578a00700 1 -- 172.21.15.142:0/452045380 >> 172.21.15.142:0/452045380 conn(0x7fc5740fc000 msgr2=0x7fc5740fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.633+0000 7fc578a00700 1 -- 172.21.15.142:0/452045380 shutdown_connections 2024-04-20T21:55:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.633+0000 7fc578a00700 1 -- 172.21.15.142:0/452045380 wait complete. 2024-04-20T21:55:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.634+0000 7fc578a00700 1 Processor -- start 2024-04-20T21:55:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.634+0000 7fc578a00700 1 -- start start 2024-04-20T21:55:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.634+0000 7fc578a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5740738e0 0x7fc5741986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.635+0000 7fc578a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc574074eb0 0x7fc574198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.635+0000 7fc578a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc574199200 con 0x7fc574074eb0 2024-04-20T21:55:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.635+0000 7fc578a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57419db60 con 0x7fc5740738e0 2024-04-20T21:55:47.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.635+0000 7fc571e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc574074eb0 0x7fc574198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:47.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.635+0000 7fc571e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc574074eb0 0x7fc574198be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33386/0 (socket says 172.21.15.142:33386) 2024-04-20T21:55:47.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.635+0000 7fc571e00700 1 -- 172.21.15.142:0/4208771340 learned_addr learned my addr 172.21.15.142:0/4208771340 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:47.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.635+0000 7fc572800700 1 --2- 172.21.15.142:0/4208771340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5740738e0 0x7fc5741986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:47.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.635+0000 7fc571e00700 1 -- 172.21.15.142:0/4208771340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5740738e0 msgr2=0x7fc5741986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:47.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.635+0000 7fc571e00700 1 --2- 172.21.15.142:0/4208771340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5740738e0 0x7fc5741986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:47.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.635+0000 7fc571e00700 1 -- 172.21.15.142:0/4208771340 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5640095f0 con 0x7fc574074eb0 2024-04-20T21:55:47.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.636+0000 7fc571e00700 1 --2- 172.21.15.142:0/4208771340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc574074eb0 0x7fc574198be0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc56000d8d0 tx=0x7fc56000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:47.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.636+0000 7fc56b400700 1 -- 172.21.15.142:0/4208771340 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc560009940 con 0x7fc574074eb0 2024-04-20T21:55:47.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.636+0000 7fc578a00700 1 -- 172.21.15.142:0/4208771340 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57419dd60 con 0x7fc574074eb0 2024-04-20T21:55:47.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.636+0000 7fc56b400700 1 -- 172.21.15.142:0/4208771340 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc560010460 con 0x7fc574074eb0 2024-04-20T21:55:47.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.636+0000 7fc56b400700 1 -- 172.21.15.142:0/4208771340 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc56000f5f0 con 0x7fc574074eb0 2024-04-20T21:55:47.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.636+0000 7fc578a00700 1 -- 172.21.15.142:0/4208771340 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57419e2b0 con 0x7fc574074eb0 2024-04-20T21:55:47.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.638+0000 7fc578a00700 1 -- 172.21.15.142:0/4208771340 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5741927b0 con 0x7fc574074eb0 2024-04-20T21:55:47.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.639+0000 7fc56b400700 1 -- 172.21.15.142:0/4208771340 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc5600105d0 con 0x7fc574074eb0 2024-04-20T21:55:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.641+0000 7fc56b400700 1 --2- 172.21.15.142:0/4208771340 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc55806cce0 0x7fc55806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.641+0000 7fc56b400700 1 -- 172.21.15.142:0/4208771340 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fc56008c150 con 0x7fc574074eb0 2024-04-20T21:55:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.641+0000 7fc572800700 1 --2- 172.21.15.142:0/4208771340 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc55806cce0 0x7fc55806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.642+0000 7fc572800700 1 --2- 172.21.15.142:0/4208771340 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc55806cce0 0x7fc55806f1a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc564006010 tx=0x7fc56400b540 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:47.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.646+0000 7fc56b400700 1 -- 172.21.15.142:0/4208771340 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fc5600565a0 con 0x7fc574074eb0 2024-04-20T21:55:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.924+0000 7fc578a00700 1 -- 172.21.15.142:0/4208771340 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc57410b820 con 0x7fc574074eb0 2024-04-20T21:55:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.925+0000 7fc56b400700 1 -- 172.21.15.142:0/4208771340 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1853 (secure 0 0 0) 0x7fc560059bc0 con 0x7fc574074eb0 2024-04-20T21:55:47.927 INFO:teuthology.orchestra.run.smithi142.stdout:e12 2024-04-20T21:55:47.927 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T21:55:47.927 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:55:47.927 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T21:55:47.927 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:55:47.927 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T21:55:47.927 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T21:55:47.928 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 12 2024-04-20T21:55:47.928 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T21:55:47.928 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T21:55:47.928 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:51.692699+0000 2024-04-20T21:55:47.928 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T21:55:47.928 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T21:55:47.928 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T21:55:47.928 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T21:55:47.928 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T21:55:47.928 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T21:55:47.928 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T21:55:47.928 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T21:55:47.928 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T21:55:47.928 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:55:47.929 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T21:55:47.929 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T21:55:47.929 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T21:55:47.929 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T21:55:47.929 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T21:55:47.929 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T21:55:47.929 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T21:55:47.929 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T21:55:47.929 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T21:55:47.929 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T21:55:47.929 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T21:55:47.929 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T21:55:47.929 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:55:47.929 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:55:47.930 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:55:47.930 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T21:55:47.930 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:55:47.930 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:55:47.930 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:55:47.930 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:55:47.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.928+0000 7fc578a00700 1 -- 172.21.15.142:0/4208771340 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc55806cce0 msgr2=0x7fc55806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.928+0000 7fc578a00700 1 --2- 172.21.15.142:0/4208771340 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc55806cce0 0x7fc55806f1a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc564006010 tx=0x7fc56400b540 comp rx=0 tx=0).stop 2024-04-20T21:55:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.928+0000 7fc578a00700 1 -- 172.21.15.142:0/4208771340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc574074eb0 msgr2=0x7fc574198be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.928+0000 7fc578a00700 1 --2- 172.21.15.142:0/4208771340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc574074eb0 0x7fc574198be0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc56000d8d0 tx=0x7fc56000dc90 comp rx=0 tx=0).stop 2024-04-20T21:55:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.929+0000 7fc578a00700 1 -- 172.21.15.142:0/4208771340 shutdown_connections 2024-04-20T21:55:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.929+0000 7fc578a00700 1 --2- 172.21.15.142:0/4208771340 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc55806cce0 0x7fc55806f1a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.929+0000 7fc578a00700 1 --2- 172.21.15.142:0/4208771340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5740738e0 0x7fc5741986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.929+0000 7fc578a00700 1 --2- 172.21.15.142:0/4208771340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc574074eb0 0x7fc574198be0 secure :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc56000d8d0 tx=0x7fc56000dc90 comp rx=0 tx=0).stop 2024-04-20T21:55:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.929+0000 7fc578a00700 1 -- 172.21.15.142:0/4208771340 >> 172.21.15.142:0/4208771340 conn(0x7fc5740fc000 msgr2=0x7fc574106ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.929+0000 7fc578a00700 1 -- 172.21.15.142:0/4208771340 shutdown_connections 2024-04-20T21:55:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:47.929+0000 7fc578a00700 1 -- 172.21.15.142:0/4208771340 wait complete. 2024-04-20T21:55:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T21:55:48.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.099+0000 7f1d5a000700 1 -- 172.21.15.142:0/1779318890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d541016c0 msgr2=0x7f1d54103ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:48.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.099+0000 7f1d5a000700 1 --2- 172.21.15.142:0/1779318890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d541016c0 0x7f1d54103ab0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1d44009910 tx=0x7f1d44009c20 comp rx=0 tx=0).stop 2024-04-20T21:55:48.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.099+0000 7f1d5a000700 1 -- 172.21.15.142:0/1779318890 shutdown_connections 2024-04-20T21:55:48.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.099+0000 7f1d5a000700 1 --2- 172.21.15.142:0/1779318890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d54103ff0 0x7f1d541063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:48.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.099+0000 7f1d5a000700 1 --2- 172.21.15.142:0/1779318890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d541016c0 0x7f1d54103ab0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:48.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.099+0000 7f1d5a000700 1 -- 172.21.15.142:0/1779318890 >> 172.21.15.142:0/1779318890 conn(0x7f1d540fb0d0 msgr2=0x7f1d540fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:48.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.099+0000 7f1d5a000700 1 -- 172.21.15.142:0/1779318890 shutdown_connections 2024-04-20T21:55:48.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.099+0000 7f1d5a000700 1 -- 172.21.15.142:0/1779318890 wait complete. 2024-04-20T21:55:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.100+0000 7f1d5a000700 1 Processor -- start 2024-04-20T21:55:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.100+0000 7f1d5a000700 1 -- start start 2024-04-20T21:55:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.101+0000 7f1d5a000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d541016c0 0x7f1d54100fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.101+0000 7f1d5a000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d54103ff0 0x7f1d540ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:48.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.101+0000 7f1d5a000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d540ffbb0 con 0x7f1d541016c0 2024-04-20T21:55:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.101+0000 7f1d5a000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d540ffcf0 con 0x7f1d54103ff0 2024-04-20T21:55:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.101+0000 7f1d53400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d541016c0 0x7f1d54100fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.101+0000 7f1d53400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d541016c0 0x7f1d54100fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33406/0 (socket says 172.21.15.142:33406) 2024-04-20T21:55:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.101+0000 7f1d53400700 1 -- 172.21.15.142:0/3553974294 learned_addr learned my addr 172.21.15.142:0/3553974294 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.101+0000 7f1d53400700 1 -- 172.21.15.142:0/3553974294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d54103ff0 msgr2=0x7f1d540ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.101+0000 7f1d53400700 1 --2- 172.21.15.142:0/3553974294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d54103ff0 0x7f1d540ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.101+0000 7f1d53400700 1 -- 172.21.15.142:0/3553974294 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d440095f0 con 0x7f1d541016c0 2024-04-20T21:55:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.102+0000 7f1d53400700 1 --2- 172.21.15.142:0/3553974294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d541016c0 0x7f1d54100fd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1d44006010 tx=0x7f1d4400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.102+0000 7f1d4be00700 1 -- 172.21.15.142:0/3553974294 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d4401d070 con 0x7f1d541016c0 2024-04-20T21:55:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.102+0000 7f1d4be00700 1 -- 172.21.15.142:0/3553974294 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d4400f460 con 0x7f1d541016c0 2024-04-20T21:55:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.102+0000 7f1d4be00700 1 -- 172.21.15.142:0/3553974294 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d44021640 con 0x7f1d541016c0 2024-04-20T21:55:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.102+0000 7f1d5a000700 1 -- 172.21.15.142:0/3553974294 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d540fff70 con 0x7f1d541016c0 2024-04-20T21:55:48.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.102+0000 7f1d5a000700 1 -- 172.21.15.142:0/3553974294 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d541004e0 con 0x7f1d541016c0 2024-04-20T21:55:48.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.103+0000 7f1d5a000700 1 -- 172.21.15.142:0/3553974294 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d54062510 con 0x7f1d541016c0 2024-04-20T21:55:48.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.105+0000 7f1d4be00700 1 -- 172.21.15.142:0/3553974294 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1d4400fab0 con 0x7f1d541016c0 2024-04-20T21:55:48.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.106+0000 7f1d4be00700 1 --2- 172.21.15.142:0/3553974294 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1d3806cce0 0x7f1d3806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:48.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.106+0000 7f1d4be00700 1 -- 172.21.15.142:0/3553974294 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f1d4408d7f0 con 0x7f1d541016c0 2024-04-20T21:55:48.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.106+0000 7f1d52a00700 1 --2- 172.21.15.142:0/3553974294 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1d3806cce0 0x7f1d3806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:48.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.107+0000 7f1d52a00700 1 --2- 172.21.15.142:0/3553974294 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1d3806cce0 0x7f1d3806f1a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000a990 tx=0x7f1d40005c80 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:48.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.109+0000 7f1d4be00700 1 -- 172.21.15.142:0/3553974294 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f1d4405b770 con 0x7f1d541016c0 2024-04-20T21:55:48.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:48 smithi142 ceph-mon[15828]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:55:48.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:48 smithi142 ceph-mon[15828]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:55:48.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:48 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/4213829352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T21:55:48.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:48 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/4208771340' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:55:48.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.380+0000 7f1d5a000700 1 -- 172.21.15.142:0/3553974294 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d541004e0 con 0x7f1d3806cce0 2024-04-20T21:55:48.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.382+0000 7f1d4be00700 1 -- 172.21.15.142:0/3553974294 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f1d541004e0 con 0x7f1d3806cce0 2024-04-20T21:55:48.383 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T21:55:48.383 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda", 2024-04-20T21:55:48.383 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T21:55:48.383 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T21:55:48.383 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [], 2024-04-20T21:55:48.383 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "", 2024-04-20T21:55:48.383 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda image", 2024-04-20T21:55:48.383 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T21:55:48.383 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T21:55:48.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.387+0000 7f1d5a000700 1 -- 172.21.15.142:0/3553974294 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1d3806cce0 msgr2=0x7f1d3806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:48.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.387+0000 7f1d5a000700 1 --2- 172.21.15.142:0/3553974294 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1d3806cce0 0x7f1d3806f1a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000a990 tx=0x7f1d40005c80 comp rx=0 tx=0).stop 2024-04-20T21:55:48.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.387+0000 7f1d5a000700 1 -- 172.21.15.142:0/3553974294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d541016c0 msgr2=0x7f1d54100fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:48.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.387+0000 7f1d5a000700 1 --2- 172.21.15.142:0/3553974294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d541016c0 0x7f1d54100fd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1d44006010 tx=0x7f1d4400be20 comp rx=0 tx=0).stop 2024-04-20T21:55:48.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.388+0000 7f1d5a000700 1 -- 172.21.15.142:0/3553974294 shutdown_connections 2024-04-20T21:55:48.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.388+0000 7f1d5a000700 1 --2- 172.21.15.142:0/3553974294 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1d3806cce0 0x7f1d3806f1a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:48.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.388+0000 7f1d5a000700 1 --2- 172.21.15.142:0/3553974294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d541016c0 0x7f1d54100fd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:48.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.388+0000 7f1d5a000700 1 --2- 172.21.15.142:0/3553974294 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d54103ff0 0x7f1d540ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:48.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.388+0000 7f1d5a000700 1 -- 172.21.15.142:0/3553974294 >> 172.21.15.142:0/3553974294 conn(0x7f1d540fb0d0 msgr2=0x7f1d540fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:48.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.388+0000 7f1d5a000700 1 -- 172.21.15.142:0/3553974294 shutdown_connections 2024-04-20T21:55:48.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.388+0000 7f1d5a000700 1 -- 172.21.15.142:0/3553974294 wait complete. 2024-04-20T21:55:48.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:48 smithi164 ceph-mon[23506]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:55:48.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:48 smithi164 ceph-mon[23506]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:55:48.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:48 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/4213829352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T21:55:48.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:48 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/4208771340' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:55:48.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.564+0000 7fe343e00700 1 -- 172.21.15.142:0/3156007628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3440738e0 msgr2=0x7fe344073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:48.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.564+0000 7fe343e00700 1 --2- 172.21.15.142:0/3156007628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3440738e0 0x7fe344073d60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe330009910 tx=0x7fe330009c20 comp rx=0 tx=0).stop 2024-04-20T21:55:48.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.564+0000 7fe343e00700 1 -- 172.21.15.142:0/3156007628 shutdown_connections 2024-04-20T21:55:48.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.564+0000 7fe343e00700 1 --2- 172.21.15.142:0/3156007628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3440738e0 0x7fe344073d60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:48.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.564+0000 7fe343e00700 1 --2- 172.21.15.142:0/3156007628 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe344074eb0 0x7fe344073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:48.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.564+0000 7fe343e00700 1 -- 172.21.15.142:0/3156007628 >> 172.21.15.142:0/3156007628 conn(0x7fe3440fc000 msgr2=0x7fe3440fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:48.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.565+0000 7fe343e00700 1 -- 172.21.15.142:0/3156007628 shutdown_connections 2024-04-20T21:55:48.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.565+0000 7fe343e00700 1 -- 172.21.15.142:0/3156007628 wait complete. 2024-04-20T21:55:48.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.566+0000 7fe343e00700 1 Processor -- start 2024-04-20T21:55:48.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.566+0000 7fe343e00700 1 -- start start 2024-04-20T21:55:48.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.566+0000 7fe343e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3440738e0 0x7fe344198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:48.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.566+0000 7fe343e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe344074eb0 0x7fe344198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:48.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.566+0000 7fe343e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3441991a0 con 0x7fe344074eb0 2024-04-20T21:55:48.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.566+0000 7fe343e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3441992e0 con 0x7fe3440738e0 2024-04-20T21:55:48.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.567+0000 7fe342000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe344074eb0 0x7fe344198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:48.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.567+0000 7fe342000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe344074eb0 0x7fe344198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33426/0 (socket says 172.21.15.142:33426) 2024-04-20T21:55:48.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.567+0000 7fe342000700 1 -- 172.21.15.142:0/3350246271 learned_addr learned my addr 172.21.15.142:0/3350246271 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:55:48.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.567+0000 7fe342a00700 1 --2- 172.21.15.142:0/3350246271 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3440738e0 0x7fe344198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:48.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.567+0000 7fe342000700 1 -- 172.21.15.142:0/3350246271 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3440738e0 msgr2=0x7fe344198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.567+0000 7fe342000700 1 --2- 172.21.15.142:0/3350246271 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3440738e0 0x7fe344198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.567+0000 7fe342000700 1 -- 172.21.15.142:0/3350246271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3300095f0 con 0x7fe344074eb0 2024-04-20T21:55:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.568+0000 7fe342000700 1 --2- 172.21.15.142:0/3350246271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe344074eb0 0x7fe344198b80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe33000bd70 tx=0x7fe33000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.568+0000 7fe33b400700 1 -- 172.21.15.142:0/3350246271 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe33001d070 con 0x7fe344074eb0 2024-04-20T21:55:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.568+0000 7fe343e00700 1 -- 172.21.15.142:0/3350246271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe34419dc90 con 0x7fe344074eb0 2024-04-20T21:55:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.568+0000 7fe33b400700 1 -- 172.21.15.142:0/3350246271 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe33000f460 con 0x7fe344074eb0 2024-04-20T21:55:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.568+0000 7fe33b400700 1 -- 172.21.15.142:0/3350246271 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe330021620 con 0x7fe344074eb0 2024-04-20T21:55:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.568+0000 7fe343e00700 1 -- 172.21.15.142:0/3350246271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34419e200 con 0x7fe344074eb0 2024-04-20T21:55:48.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.570+0000 7fe343e00700 1 -- 172.21.15.142:0/3350246271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3441927b0 con 0x7fe344074eb0 2024-04-20T21:55:48.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.572+0000 7fe33b400700 1 -- 172.21.15.142:0/3350246271 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fe33000fa70 con 0x7fe344074eb0 2024-04-20T21:55:48.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.573+0000 7fe33b400700 1 --2- 172.21.15.142:0/3350246271 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fe32806cce0 0x7fe32806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:55:48.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.574+0000 7fe33b400700 1 -- 172.21.15.142:0/3350246271 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fe33008d440 con 0x7fe344074eb0 2024-04-20T21:55:48.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.574+0000 7fe342a00700 1 --2- 172.21.15.142:0/3350246271 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fe32806cce0 0x7fe32806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:55:48.575 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.575+0000 7fe342a00700 1 --2- 172.21.15.142:0/3350246271 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fe32806cce0 0x7fe32806f1a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe334005fd0 tx=0x7fe33400a560 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:55:48.579 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.579+0000 7fe33b400700 1 -- 172.21.15.142:0/3350246271 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fe33005b210 con 0x7fe344074eb0 2024-04-20T21:55:48.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.926+0000 7fe343e00700 1 -- 172.21.15.142:0/3350246271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe344062560 con 0x7fe344074eb0 2024-04-20T21:55:48.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.927+0000 7fe33b400700 1 -- 172.21.15.142:0/3350246271 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe33005ada0 con 0x7fe344074eb0 2024-04-20T21:55:48.927 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_OK 2024-04-20T21:55:48.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.931+0000 7fe343e00700 1 -- 172.21.15.142:0/3350246271 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fe32806cce0 msgr2=0x7fe32806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:48.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.931+0000 7fe343e00700 1 --2- 172.21.15.142:0/3350246271 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fe32806cce0 0x7fe32806f1a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe334005fd0 tx=0x7fe33400a560 comp rx=0 tx=0).stop 2024-04-20T21:55:48.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.931+0000 7fe343e00700 1 -- 172.21.15.142:0/3350246271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe344074eb0 msgr2=0x7fe344198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:55:48.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.931+0000 7fe343e00700 1 --2- 172.21.15.142:0/3350246271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe344074eb0 0x7fe344198b80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe33000bd70 tx=0x7fe33000be50 comp rx=0 tx=0).stop 2024-04-20T21:55:48.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.931+0000 7fe343e00700 1 -- 172.21.15.142:0/3350246271 shutdown_connections 2024-04-20T21:55:48.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.931+0000 7fe343e00700 1 --2- 172.21.15.142:0/3350246271 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fe32806cce0 0x7fe32806f1a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:48.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.931+0000 7fe343e00700 1 --2- 172.21.15.142:0/3350246271 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3440738e0 0x7fe344198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:48.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.931+0000 7fe343e00700 1 --2- 172.21.15.142:0/3350246271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe344074eb0 0x7fe344198b80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:55:48.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.931+0000 7fe343e00700 1 -- 172.21.15.142:0/3350246271 >> 172.21.15.142:0/3350246271 conn(0x7fe3440fc000 msgr2=0x7fe344106ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:55:48.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.931+0000 7fe343e00700 1 -- 172.21.15.142:0/3350246271 shutdown_connections 2024-04-20T21:55:48.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:55:48.932+0000 7fe343e00700 1 -- 172.21.15.142:0/3350246271 wait complete. 2024-04-20T21:55:49.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:49 smithi142 ceph-mon[15828]: pgmap v264: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-20T21:55:49.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:49 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/3350246271' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T21:55:49.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:49 smithi164 ceph-mon[23506]: pgmap v264: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-20T21:55:49.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:49 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/3350246271' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T21:55:50.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:50 smithi142 ceph-mon[15828]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:55:50.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:50 smithi164 ceph-mon[23506]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:55:51.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:51 smithi142 ceph-mon[15828]: pgmap v265: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:51.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:51 smithi164 ceph-mon[23506]: pgmap v265: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:52.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:52 smithi142 ceph-mon[15828]: pgmap v266: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:52.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:52 smithi164 ceph-mon[23506]: pgmap v266: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:55.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:55 smithi142 ceph-mon[15828]: pgmap v267: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:55.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:55 smithi164 ceph-mon[23506]: pgmap v267: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:56.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:56 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:55:56.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:56 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:55:57.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:57 smithi142 ceph-mon[15828]: pgmap v268: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:57.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:57 smithi164 ceph-mon[23506]: pgmap v268: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:59.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:55:59 smithi164 ceph-mon[23506]: pgmap v269: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:55:59.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:55:59 smithi142 ceph-mon[15828]: pgmap v269: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:01.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:01 smithi142 ceph-mon[15828]: pgmap v270: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:01.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:01 smithi164 ceph-mon[23506]: pgmap v270: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:03.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:03 smithi142 ceph-mon[15828]: pgmap v271: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:03.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:03 smithi164 ceph-mon[23506]: pgmap v271: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:05.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:05 smithi142 ceph-mon[15828]: pgmap v272: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:05.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:05 smithi164 ceph-mon[23506]: pgmap v272: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:07.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:07 smithi142 ceph-mon[15828]: pgmap v273: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:07.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:07 smithi164 ceph-mon[23506]: pgmap v273: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:09.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:09 smithi142 ceph-mon[15828]: pgmap v274: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:09 smithi164 ceph-mon[23506]: pgmap v274: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:10.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:10 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:56:10.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:10 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:56:11.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:11 smithi142 ceph-mon[15828]: pgmap v275: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:11.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:11 smithi164 ceph-mon[23506]: pgmap v275: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:13.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:13 smithi142 ceph-mon[15828]: pgmap v276: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:13.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:13 smithi164 ceph-mon[23506]: pgmap v276: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:15.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:15 smithi142 ceph-mon[15828]: pgmap v277: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:15.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:15 smithi164 ceph-mon[23506]: pgmap v277: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:17.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:17 smithi142 ceph-mon[15828]: pgmap v278: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:17.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:17 smithi164 ceph-mon[23506]: pgmap v278: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:19.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.125+0000 7fc8a4c00700 1 -- 172.21.15.142:0/4233711942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a0103fb0 msgr2=0x7fc8a01063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:19.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.125+0000 7fc8a4c00700 1 --2- 172.21.15.142:0/4233711942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a0103fb0 0x7fc8a01063a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009910 tx=0x7fc88c009c20 comp rx=0 tx=0).stop 2024-04-20T21:56:19.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.126+0000 7fc8a4c00700 1 -- 172.21.15.142:0/4233711942 shutdown_connections 2024-04-20T21:56:19.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.126+0000 7fc8a4c00700 1 --2- 172.21.15.142:0/4233711942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a0103fb0 0x7fc8a01063a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:19.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.126+0000 7fc8a4c00700 1 --2- 172.21.15.142:0/4233711942 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8a0101680 0x7fc8a0103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:19.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.126+0000 7fc8a4c00700 1 -- 172.21.15.142:0/4233711942 >> 172.21.15.142:0/4233711942 conn(0x7fc8a00fb0d0 msgr2=0x7fc8a00fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:19.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.126+0000 7fc8a4c00700 1 -- 172.21.15.142:0/4233711942 shutdown_connections 2024-04-20T21:56:19.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.126+0000 7fc8a4c00700 1 -- 172.21.15.142:0/4233711942 wait complete. 2024-04-20T21:56:19.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.127+0000 7fc8a4c00700 1 Processor -- start 2024-04-20T21:56:19.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.128+0000 7fc8a4c00700 1 -- start start 2024-04-20T21:56:19.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.128+0000 7fc8a4c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8a0101680 0x7fc8a0071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:19.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.128+0000 7fc8a4c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a0103fb0 0x7fc8a0072530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:19.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.128+0000 7fc8a4c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a0072b50 con 0x7fc8a0103fb0 2024-04-20T21:56:19.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.128+0000 7fc8a4c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a0072c90 con 0x7fc8a0101680 2024-04-20T21:56:19.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.129+0000 7fc89d400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a0103fb0 0x7fc8a0072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:19.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.129+0000 7fc89d400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a0103fb0 0x7fc8a0072530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51702/0 (socket says 172.21.15.142:51702) 2024-04-20T21:56:19.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.129+0000 7fc89d400700 1 -- 172.21.15.142:0/4280898152 learned_addr learned my addr 172.21.15.142:0/4280898152 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:56:19.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.129+0000 7fc89de00700 1 --2- 172.21.15.142:0/4280898152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8a0101680 0x7fc8a0071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:19.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.129+0000 7fc89d400700 1 -- 172.21.15.142:0/4280898152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8a0101680 msgr2=0x7fc8a0071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:19.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.129+0000 7fc89d400700 1 --2- 172.21.15.142:0/4280898152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8a0101680 0x7fc8a0071ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:19.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.130+0000 7fc89d400700 1 -- 172.21.15.142:0/4280898152 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c0095f0 con 0x7fc8a0103fb0 2024-04-20T21:56:19.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.130+0000 7fc89d400700 1 --2- 172.21.15.142:0/4280898152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a0103fb0 0x7fc8a0072530 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00bd70 tx=0x7fc88c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:19.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.131+0000 7fc896a00700 1 -- 172.21.15.142:0/4280898152 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc88c01d070 con 0x7fc8a0103fb0 2024-04-20T21:56:19.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.131+0000 7fc8a4c00700 1 -- 172.21.15.142:0/4280898152 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a01a67a0 con 0x7fc8a0103fb0 2024-04-20T21:56:19.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.131+0000 7fc8a4c00700 1 -- 172.21.15.142:0/4280898152 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a01a6d10 con 0x7fc8a0103fb0 2024-04-20T21:56:19.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.131+0000 7fc896a00700 1 -- 172.21.15.142:0/4280898152 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc88c00f460 con 0x7fc8a0103fb0 2024-04-20T21:56:19.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.131+0000 7fc896a00700 1 -- 172.21.15.142:0/4280898152 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc88c021640 con 0x7fc8a0103fb0 2024-04-20T21:56:19.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.132+0000 7fc8a4c00700 1 -- 172.21.15.142:0/4280898152 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc880005320 con 0x7fc8a0103fb0 2024-04-20T21:56:19.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.136+0000 7fc896a00700 1 -- 172.21.15.142:0/4280898152 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc88c003a60 con 0x7fc8a0103fb0 2024-04-20T21:56:19.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.137+0000 7fc896a00700 1 --2- 172.21.15.142:0/4280898152 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc88406cce0 0x7fc88406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:19.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.137+0000 7fc896a00700 1 -- 172.21.15.142:0/4280898152 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fc88c08d7e0 con 0x7fc8a0103fb0 2024-04-20T21:56:19.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.139+0000 7fc89de00700 1 --2- 172.21.15.142:0/4280898152 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc88406cce0 0x7fc88406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:19.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.140+0000 7fc89de00700 1 --2- 172.21.15.142:0/4280898152 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc88406cce0 0x7fc88406f1a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc890009a10 tx=0x7fc890009190 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:19.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.148+0000 7fc896a00700 1 -- 172.21.15.142:0/4280898152 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fc88c05b760 con 0x7fc8a0103fb0 2024-04-20T21:56:19.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:19 smithi142 ceph-mon[15828]: pgmap v279: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:19.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:19 smithi164 ceph-mon[23506]: pgmap v279: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:19.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.485+0000 7fc8a4c00700 1 -- 172.21.15.142:0/4280898152 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc880000bf0 con 0x7fc88406cce0 2024-04-20T21:56:19.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.486+0000 7fc896a00700 1 -- 172.21.15.142:0/4280898152 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fc880000bf0 con 0x7fc88406cce0 2024-04-20T21:56:19.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.490+0000 7fc8a4c00700 1 -- 172.21.15.142:0/4280898152 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc88406cce0 msgr2=0x7fc88406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:19.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.490+0000 7fc8a4c00700 1 --2- 172.21.15.142:0/4280898152 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc88406cce0 0x7fc88406f1a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc890009a10 tx=0x7fc890009190 comp rx=0 tx=0).stop 2024-04-20T21:56:19.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.490+0000 7fc8a4c00700 1 -- 172.21.15.142:0/4280898152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a0103fb0 msgr2=0x7fc8a0072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:19.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.490+0000 7fc8a4c00700 1 --2- 172.21.15.142:0/4280898152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a0103fb0 0x7fc8a0072530 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00bd70 tx=0x7fc88c00bda0 comp rx=0 tx=0).stop 2024-04-20T21:56:19.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.490+0000 7fc8a4c00700 1 -- 172.21.15.142:0/4280898152 shutdown_connections 2024-04-20T21:56:19.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.490+0000 7fc8a4c00700 1 --2- 172.21.15.142:0/4280898152 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc88406cce0 0x7fc88406f1a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:19.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.490+0000 7fc8a4c00700 1 --2- 172.21.15.142:0/4280898152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8a0101680 0x7fc8a0071ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:19.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.490+0000 7fc8a4c00700 1 --2- 172.21.15.142:0/4280898152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8a0103fb0 0x7fc8a0072530 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:19.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.490+0000 7fc8a4c00700 1 -- 172.21.15.142:0/4280898152 >> 172.21.15.142:0/4280898152 conn(0x7fc8a00fb0d0 msgr2=0x7fc8a00fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:19.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.490+0000 7fc8a4c00700 1 -- 172.21.15.142:0/4280898152 shutdown_connections 2024-04-20T21:56:19.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.490+0000 7fc8a4c00700 1 -- 172.21.15.142:0/4280898152 wait complete. 2024-04-20T21:56:19.504 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T21:56:19.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.688+0000 7f8152200700 1 -- 172.21.15.142:0/1495293950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f814c100b30 msgr2=0x7f814c100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:19.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.688+0000 7f8152200700 1 --2- 172.21.15.142:0/1495293950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f814c100b30 0x7f814c100f90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8138009910 tx=0x7f8138009c20 comp rx=0 tx=0).stop 2024-04-20T21:56:19.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.689+0000 7f8152200700 1 -- 172.21.15.142:0/1495293950 shutdown_connections 2024-04-20T21:56:19.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.689+0000 7f8152200700 1 --2- 172.21.15.142:0/1495293950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f814c100b30 0x7f814c100f90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:19.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.689+0000 7f8152200700 1 --2- 172.21.15.142:0/1495293950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f814c0ff930 0x7f814c0ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:19.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.689+0000 7f8152200700 1 -- 172.21.15.142:0/1495293950 >> 172.21.15.142:0/1495293950 conn(0x7f814c0faef0 msgr2=0x7f814c0fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:19.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.689+0000 7f8152200700 1 -- 172.21.15.142:0/1495293950 shutdown_connections 2024-04-20T21:56:19.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.689+0000 7f8152200700 1 -- 172.21.15.142:0/1495293950 wait complete. 2024-04-20T21:56:19.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.691+0000 7f8152200700 1 Processor -- start 2024-04-20T21:56:19.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.691+0000 7f8152200700 1 -- start start 2024-04-20T21:56:19.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.691+0000 7f8152200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f814c0ff930 0x7f814c196690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:19.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.691+0000 7f8152200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f814c196bd0 0x7f814c19bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:19.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.691+0000 7f8152200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c1970e0 con 0x7f814c0ff930 2024-04-20T21:56:19.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.691+0000 7f8152200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c197250 con 0x7f814c196bd0 2024-04-20T21:56:19.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.692+0000 7f8150e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f814c0ff930 0x7f814c196690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:19.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.692+0000 7f8150e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f814c0ff930 0x7f814c196690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51718/0 (socket says 172.21.15.142:51718) 2024-04-20T21:56:19.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.692+0000 7f8150e00700 1 -- 172.21.15.142:0/2861311447 learned_addr learned my addr 172.21.15.142:0/2861311447 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:56:19.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.693+0000 7f8150e00700 1 -- 172.21.15.142:0/2861311447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f814c196bd0 msgr2=0x7f814c19bbf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-20T21:56:19.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.693+0000 7f8150e00700 1 --2- 172.21.15.142:0/2861311447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f814c196bd0 0x7f814c19bbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:19.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.693+0000 7f8150e00700 1 -- 172.21.15.142:0/2861311447 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81380095f0 con 0x7f814c0ff930 2024-04-20T21:56:19.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.693+0000 7f8150e00700 1 --2- 172.21.15.142:0/2861311447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f814c0ff930 0x7f814c196690 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f814000e8f0 tx=0x7f814000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:19.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.694+0000 7f8149600700 1 -- 172.21.15.142:0/2861311447 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8140009790 con 0x7f814c0ff930 2024-04-20T21:56:19.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.694+0000 7f8149600700 1 -- 172.21.15.142:0/2861311447 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f81400044e0 con 0x7f814c0ff930 2024-04-20T21:56:19.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.694+0000 7f8149600700 1 -- 172.21.15.142:0/2861311447 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8140003e00 con 0x7f814c0ff930 2024-04-20T21:56:19.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.694+0000 7f8152200700 1 -- 172.21.15.142:0/2861311447 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814c105dd0 con 0x7f814c0ff930 2024-04-20T21:56:19.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.694+0000 7f8152200700 1 -- 172.21.15.142:0/2861311447 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814c1063a0 con 0x7f814c0ff930 2024-04-20T21:56:19.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.696+0000 7f8152200700 1 -- 172.21.15.142:0/2861311447 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f814c062510 con 0x7f814c0ff930 2024-04-20T21:56:19.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.698+0000 7f8149600700 1 -- 172.21.15.142:0/2861311447 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f814000cba0 con 0x7f814c0ff930 2024-04-20T21:56:19.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.699+0000 7f8149600700 1 --2- 172.21.15.142:0/2861311447 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f81340710f0 0x7f81340735b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:19.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.700+0000 7f8149600700 1 -- 172.21.15.142:0/2861311447 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f8140014070 con 0x7f814c0ff930 2024-04-20T21:56:19.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.701+0000 7f814be00700 1 --2- 172.21.15.142:0/2861311447 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f81340710f0 0x7f81340735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:19.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.702+0000 7f814be00700 1 --2- 172.21.15.142:0/2861311447 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f81340710f0 0x7f81340735b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8138006010 tx=0x7f8138005bc0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:19.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:19.706+0000 7f8149600700 1 -- 172.21.15.142:0/2861311447 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f814005a3e0 con 0x7f814c0ff930 2024-04-20T21:56:20.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.045+0000 7f8152200700 1 -- 172.21.15.142:0/2861311447 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f814c105480 con 0x7f81340710f0 2024-04-20T21:56:20.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.047+0000 7f8149600700 1 -- 172.21.15.142:0/2861311447 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f814c105480 con 0x7f81340710f0 2024-04-20T21:56:20.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.050+0000 7f8152200700 1 -- 172.21.15.142:0/2861311447 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f81340710f0 msgr2=0x7f81340735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:20.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.050+0000 7f8152200700 1 --2- 172.21.15.142:0/2861311447 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f81340710f0 0x7f81340735b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8138006010 tx=0x7f8138005bc0 comp rx=0 tx=0).stop 2024-04-20T21:56:20.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.050+0000 7f8152200700 1 -- 172.21.15.142:0/2861311447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f814c0ff930 msgr2=0x7f814c196690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:20.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.050+0000 7f8152200700 1 --2- 172.21.15.142:0/2861311447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f814c0ff930 0x7f814c196690 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f814000e8f0 tx=0x7f814000ecb0 comp rx=0 tx=0).stop 2024-04-20T21:56:20.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.051+0000 7f8152200700 1 -- 172.21.15.142:0/2861311447 shutdown_connections 2024-04-20T21:56:20.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.051+0000 7f8152200700 1 --2- 172.21.15.142:0/2861311447 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f81340710f0 0x7f81340735b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:20.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.051+0000 7f8152200700 1 --2- 172.21.15.142:0/2861311447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f814c0ff930 0x7f814c196690 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:20.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.051+0000 7f8152200700 1 --2- 172.21.15.142:0/2861311447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f814c196bd0 0x7f814c19bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:20.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.051+0000 7f8152200700 1 -- 172.21.15.142:0/2861311447 >> 172.21.15.142:0/2861311447 conn(0x7f814c0faef0 msgr2=0x7f814c103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:20.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.051+0000 7f8152200700 1 -- 172.21.15.142:0/2861311447 shutdown_connections 2024-04-20T21:56:20.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.051+0000 7f8152200700 1 -- 172.21.15.142:0/2861311447 wait complete. 2024-04-20T21:56:20.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.238+0000 7fb354600700 1 -- 172.21.15.142:0/146395485 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb34c101de0 msgr2=0x7fb34c104270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:20.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.238+0000 7fb354600700 1 --2- 172.21.15.142:0/146395485 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb34c101de0 0x7fb34c104270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb338009910 tx=0x7fb338009c20 comp rx=0 tx=0).stop 2024-04-20T21:56:20.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.238+0000 7fb354600700 1 -- 172.21.15.142:0/146395485 shutdown_connections 2024-04-20T21:56:20.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.238+0000 7fb354600700 1 --2- 172.21.15.142:0/146395485 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb34c101de0 0x7fb34c104270 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:20.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.238+0000 7fb354600700 1 --2- 172.21.15.142:0/146395485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb34c0ff470 0x7fb34c1018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:20.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.238+0000 7fb354600700 1 -- 172.21.15.142:0/146395485 >> 172.21.15.142:0/146395485 conn(0x7fb34c0fb0d0 msgr2=0x7fb34c0fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:20.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.238+0000 7fb354600700 1 -- 172.21.15.142:0/146395485 shutdown_connections 2024-04-20T21:56:20.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.238+0000 7fb354600700 1 -- 172.21.15.142:0/146395485 wait complete. 2024-04-20T21:56:20.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.239+0000 7fb354600700 1 Processor -- start 2024-04-20T21:56:20.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.240+0000 7fb354600700 1 -- start start 2024-04-20T21:56:20.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.240+0000 7fb354600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb34c0ff470 0x7fb34c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:20.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.240+0000 7fb354600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb34c101de0 0x7fb34c19d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:20.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.240+0000 7fb354600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c19d830 con 0x7fb34c101de0 2024-04-20T21:56:20.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.240+0000 7fb354600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c19d9a0 con 0x7fb34c0ff470 2024-04-20T21:56:20.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.241+0000 7fb351c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb34c0ff470 0x7fb34c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:20.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.241+0000 7fb351200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb34c101de0 0x7fb34c19d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:20.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.241+0000 7fb351c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb34c0ff470 0x7fb34c19ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:57726/0 (socket says 172.21.15.142:57726) 2024-04-20T21:56:20.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.241+0000 7fb351c00700 1 -- 172.21.15.142:0/3840675655 learned_addr learned my addr 172.21.15.142:0/3840675655 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:56:20.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.241+0000 7fb351200700 1 -- 172.21.15.142:0/3840675655 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb34c0ff470 msgr2=0x7fb34c19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:20.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.241+0000 7fb351200700 1 --2- 172.21.15.142:0/3840675655 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb34c0ff470 0x7fb34c19ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:20.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.241+0000 7fb351200700 1 -- 172.21.15.142:0/3840675655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3380095f0 con 0x7fb34c101de0 2024-04-20T21:56:20.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.242+0000 7fb351200700 1 --2- 172.21.15.142:0/3840675655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb34c101de0 0x7fb34c19d230 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb338005950 tx=0x7fb33800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:20.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.242+0000 7fb34a000700 1 -- 172.21.15.142:0/3840675655 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb33801d070 con 0x7fb34c101de0 2024-04-20T21:56:20.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.242+0000 7fb354600700 1 -- 172.21.15.142:0/3840675655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34c1a2380 con 0x7fb34c101de0 2024-04-20T21:56:20.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.242+0000 7fb354600700 1 -- 172.21.15.142:0/3840675655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34c1a28f0 con 0x7fb34c101de0 2024-04-20T21:56:20.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.242+0000 7fb34a000700 1 -- 172.21.15.142:0/3840675655 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb33800f460 con 0x7fb34c101de0 2024-04-20T21:56:20.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.244+0000 7fb34a000700 1 -- 172.21.15.142:0/3840675655 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb338021640 con 0x7fb34c101de0 2024-04-20T21:56:20.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.244+0000 7fb354600700 1 -- 172.21.15.142:0/3840675655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32c005320 con 0x7fb34c101de0 2024-04-20T21:56:20.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.246+0000 7fb34a000700 1 -- 172.21.15.142:0/3840675655 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fb338003a60 con 0x7fb34c101de0 2024-04-20T21:56:20.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.247+0000 7fb34a000700 1 --2- 172.21.15.142:0/3840675655 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb33406cd30 0x7fb33406f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:20.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.247+0000 7fb34a000700 1 -- 172.21.15.142:0/3840675655 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fb33808d2b0 con 0x7fb34c101de0 2024-04-20T21:56:20.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.248+0000 7fb351c00700 1 --2- 172.21.15.142:0/3840675655 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb33406cd30 0x7fb33406f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:20.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.249+0000 7fb351c00700 1 --2- 172.21.15.142:0/3840675655 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb33406cd30 0x7fb33406f1f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb34c104600 tx=0x7fb340009290 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:20.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.252+0000 7fb34a000700 1 -- 172.21.15.142:0/3840675655 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fb338057660 con 0x7fb34c101de0 2024-04-20T21:56:20.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.501+0000 7fb354600700 1 -- 172.21.15.142:0/3840675655 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb32c000bf0 con 0x7fb33406cd30 2024-04-20T21:56:20.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.520+0000 7fb34a000700 1 -- 172.21.15.142:0/3840675655 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3864 (secure 0 0 0) 0x7fb32c000bf0 con 0x7fb33406cd30 2024-04-20T21:56:20.520 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T21:56:20.520 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (7m) 73s ago 8m 13.1M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T21:56:20.520 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (9m) 73s ago 9m 7528k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T21:56:20.520 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (7m) 79s ago 7m 7235k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T21:56:20.520 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (9m) 73s ago 9m 6665k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 56f2e41784f8 2024-04-20T21:56:20.520 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (7m) 79s ago 7m 6660k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 bce67525dd3e 2024-04-20T21:56:20.520 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (6m) 73s ago 8m 73.5M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T21:56:20.520 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (106s) 73s ago 105s 14.7M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 b68e279d7945 2024-04-20T21:56:20.520 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (97s) 73s ago 96s 11.7M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T21:56:20.521 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (93s) 79s ago 92s 11.6M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T21:56:20.521 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (101s) 79s ago 101s 11.7M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T21:56:20.521 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:9283,8765,8443 running (10m) 73s ago 10m 499M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d2c979afd250 2024-04-20T21:56:20.521 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (7m) 79s ago 7m 449M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 2e2b1f8dfca1 2024-04-20T21:56:20.521 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (10m) 73s ago 10m 45.0M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c076f7eb00ea 2024-04-20T21:56:20.521 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (7m) 79s ago 7m 34.7M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 2bacdeb02ee0 2024-04-20T21:56:20.521 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (9m) 73s ago 9m 7805k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T21:56:20.521 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (7m) 79s ago 7m 7666k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T21:56:20.521 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (6m) 73s ago 6m 46.7M 3947M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4361ae428e0d 2024-04-20T21:56:20.521 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (5m) 73s ago 5m 48.8M 3947M 18.2.2-1237-g646b8c7d 9900ed1a6b81 dd7e7cf8e8e1 2024-04-20T21:56:20.521 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (5m) 73s ago 5m 53.2M 3947M 18.2.2-1237-g646b8c7d 9900ed1a6b81 8e9165365127 2024-04-20T21:56:20.521 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (4m) 79s ago 4m 51.4M 4971M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c081911f56ab 2024-04-20T21:56:20.521 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (4m) 79s ago 4m 49.0M 4971M 18.2.2-1237-g646b8c7d 9900ed1a6b81 39e09d63d44f 2024-04-20T21:56:20.521 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (3m) 79s ago 3m 48.0M 4971M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4f36124aeb0d 2024-04-20T21:56:20.522 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (6m) 73s ago 8m 50.5M - 2.43.0 a07b618ecd1d a1f0ad25692f 2024-04-20T21:56:20.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.523+0000 7fb354600700 1 -- 172.21.15.142:0/3840675655 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb33406cd30 msgr2=0x7fb33406f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:20.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.523+0000 7fb354600700 1 --2- 172.21.15.142:0/3840675655 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb33406cd30 0x7fb33406f1f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb34c104600 tx=0x7fb340009290 comp rx=0 tx=0).stop 2024-04-20T21:56:20.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.523+0000 7fb354600700 1 -- 172.21.15.142:0/3840675655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb34c101de0 msgr2=0x7fb34c19d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:20.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.523+0000 7fb354600700 1 --2- 172.21.15.142:0/3840675655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb34c101de0 0x7fb34c19d230 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb338005950 tx=0x7fb33800bd70 comp rx=0 tx=0).stop 2024-04-20T21:56:20.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.523+0000 7fb354600700 1 -- 172.21.15.142:0/3840675655 shutdown_connections 2024-04-20T21:56:20.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.523+0000 7fb354600700 1 --2- 172.21.15.142:0/3840675655 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fb33406cd30 0x7fb33406f1f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:20.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.523+0000 7fb354600700 1 --2- 172.21.15.142:0/3840675655 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb34c0ff470 0x7fb34c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:20.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.523+0000 7fb354600700 1 --2- 172.21.15.142:0/3840675655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb34c101de0 0x7fb34c19d230 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:20.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.523+0000 7fb354600700 1 -- 172.21.15.142:0/3840675655 >> 172.21.15.142:0/3840675655 conn(0x7fb34c0fb0d0 msgr2=0x7fb34c0fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:20.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.523+0000 7fb354600700 1 -- 172.21.15.142:0/3840675655 shutdown_connections 2024-04-20T21:56:20.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.523+0000 7fb354600700 1 -- 172.21.15.142:0/3840675655 wait complete. 2024-04-20T21:56:20.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.684+0000 7f0426600700 1 -- 172.21.15.142:0/3163347675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0420103fb0 msgr2=0x7f04201063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:20.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.684+0000 7f0426600700 1 --2- 172.21.15.142:0/3163347675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0420103fb0 0x7f04201063a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f040c009910 tx=0x7f040c009c20 comp rx=0 tx=0).stop 2024-04-20T21:56:20.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.684+0000 7f0426600700 1 -- 172.21.15.142:0/3163347675 shutdown_connections 2024-04-20T21:56:20.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.684+0000 7f0426600700 1 --2- 172.21.15.142:0/3163347675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0420103fb0 0x7f04201063a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:20.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.684+0000 7f0426600700 1 --2- 172.21.15.142:0/3163347675 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0420101680 0x7f0420103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:20.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.684+0000 7f0426600700 1 -- 172.21.15.142:0/3163347675 >> 172.21.15.142:0/3163347675 conn(0x7f04200fb0d0 msgr2=0x7f04200fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:20.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.685+0000 7f0426600700 1 -- 172.21.15.142:0/3163347675 shutdown_connections 2024-04-20T21:56:20.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.685+0000 7f0426600700 1 -- 172.21.15.142:0/3163347675 wait complete. 2024-04-20T21:56:20.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.686+0000 7f0426600700 1 Processor -- start 2024-04-20T21:56:20.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.686+0000 7f0426600700 1 -- start start 2024-04-20T21:56:20.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.686+0000 7f0426600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0420101680 0x7f0420198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:20.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.686+0000 7f0426600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0420103fb0 0x7f0420198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:20.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.686+0000 7f0426600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04201993f0 con 0x7f0420101680 2024-04-20T21:56:20.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.686+0000 7f0426600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0420199530 con 0x7f0420103fb0 2024-04-20T21:56:20.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.686+0000 7f041f400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0420101680 0x7f0420198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:20.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.686+0000 7f041f400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0420101680 0x7f0420198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51752/0 (socket says 172.21.15.142:51752) 2024-04-20T21:56:20.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.687+0000 7f041f400700 1 -- 172.21.15.142:0/1395117750 learned_addr learned my addr 172.21.15.142:0/1395117750 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:56:20.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.687+0000 7f041ea00700 1 --2- 172.21.15.142:0/1395117750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0420103fb0 0x7f0420198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:20.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.687+0000 7f041f400700 1 -- 172.21.15.142:0/1395117750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0420103fb0 msgr2=0x7f0420198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:20.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.687+0000 7f041f400700 1 --2- 172.21.15.142:0/1395117750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0420103fb0 0x7f0420198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:20.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.687+0000 7f041f400700 1 -- 172.21.15.142:0/1395117750 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c0095f0 con 0x7f0420101680 2024-04-20T21:56:20.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.687+0000 7f041f400700 1 --2- 172.21.15.142:0/1395117750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0420101680 0x7f0420198890 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f041000d8d0 tx=0x7f041000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:20.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.688+0000 7f0417e00700 1 -- 172.21.15.142:0/1395117750 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04100098a0 con 0x7f0420101680 2024-04-20T21:56:20.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.688+0000 7f0417e00700 1 -- 172.21.15.142:0/1395117750 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0410010460 con 0x7f0420101680 2024-04-20T21:56:20.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.688+0000 7f0426600700 1 -- 172.21.15.142:0/1395117750 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f042019def0 con 0x7f0420101680 2024-04-20T21:56:20.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.688+0000 7f0426600700 1 -- 172.21.15.142:0/1395117750 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042019e430 con 0x7f0420101680 2024-04-20T21:56:20.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.688+0000 7f0417e00700 1 -- 172.21.15.142:0/1395117750 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f041000f5f0 con 0x7f0420101680 2024-04-20T21:56:20.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.689+0000 7f0426600700 1 -- 172.21.15.142:0/1395117750 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04000052f0 con 0x7f0420101680 2024-04-20T21:56:20.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.690+0000 7f0417e00700 1 -- 172.21.15.142:0/1395117750 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f0410009a00 con 0x7f0420101680 2024-04-20T21:56:20.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.692+0000 7f0417e00700 1 --2- 172.21.15.142:0/1395117750 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f040406cce0 0x7f040406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:20.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.692+0000 7f0417e00700 1 -- 172.21.15.142:0/1395117750 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f041008bff0 con 0x7f0420101680 2024-04-20T21:56:20.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.692+0000 7f041ea00700 1 --2- 172.21.15.142:0/1395117750 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f040406cce0 0x7f040406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:20.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.693+0000 7f041ea00700 1 --2- 172.21.15.142:0/1395117750 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f040406cce0 0x7f040406f1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f040c006010 tx=0x7f040c005180 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:20.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:20.697+0000 7f0417e00700 1 -- 172.21.15.142:0/1395117750 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f0410059e90 con 0x7f0420101680 2024-04-20T21:56:21.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.118+0000 7f0426600700 1 -- 172.21.15.142:0/1395117750 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0400005db0 con 0x7f0420101680 2024-04-20T21:56:21.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.119+0000 7f0417e00700 1 -- 172.21.15.142:0/1395117750 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f0410059a20 con 0x7f0420101680 2024-04-20T21:56:21.118 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T21:56:21.118 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T21:56:21.118 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 2 2024-04-20T21:56:21.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:56:21.119 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T21:56:21.119 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 2 2024-04-20T21:56:21.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:56:21.119 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T21:56:21.119 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 6 2024-04-20T21:56:21.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:56:21.119 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T21:56:21.119 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4 2024-04-20T21:56:21.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:56:21.119 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T21:56:21.119 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 14 2024-04-20T21:56:21.119 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T21:56:21.119 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T21:56:21.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.122+0000 7f0426600700 1 -- 172.21.15.142:0/1395117750 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f040406cce0 msgr2=0x7f040406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:21.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.122+0000 7f0426600700 1 --2- 172.21.15.142:0/1395117750 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f040406cce0 0x7f040406f1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f040c006010 tx=0x7f040c005180 comp rx=0 tx=0).stop 2024-04-20T21:56:21.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.122+0000 7f0426600700 1 -- 172.21.15.142:0/1395117750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0420101680 msgr2=0x7f0420198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:21.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.122+0000 7f0426600700 1 --2- 172.21.15.142:0/1395117750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0420101680 0x7f0420198890 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f041000d8d0 tx=0x7f041000dbe0 comp rx=0 tx=0).stop 2024-04-20T21:56:21.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.122+0000 7f0426600700 1 -- 172.21.15.142:0/1395117750 shutdown_connections 2024-04-20T21:56:21.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.122+0000 7f0426600700 1 --2- 172.21.15.142:0/1395117750 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f040406cce0 0x7f040406f1a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:21.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.122+0000 7f0426600700 1 --2- 172.21.15.142:0/1395117750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0420101680 0x7f0420198890 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:21.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.122+0000 7f0426600700 1 --2- 172.21.15.142:0/1395117750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0420103fb0 0x7f0420198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:21.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.122+0000 7f0426600700 1 -- 172.21.15.142:0/1395117750 >> 172.21.15.142:0/1395117750 conn(0x7f04200fb0d0 msgr2=0x7f04200ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:21.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.123+0000 7f0426600700 1 -- 172.21.15.142:0/1395117750 shutdown_connections 2024-04-20T21:56:21.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.123+0000 7f0426600700 1 -- 172.21.15.142:0/1395117750 wait complete. 2024-04-20T21:56:21.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.276+0000 7fc468c00700 1 -- 172.21.15.142:0/70193956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc464101680 msgr2=0x7fc464103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:21.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.276+0000 7fc468c00700 1 --2- 172.21.15.142:0/70193956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc464101680 0x7fc464103a70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc454009910 tx=0x7fc454009c20 comp rx=0 tx=0).stop 2024-04-20T21:56:21.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.277+0000 7fc468c00700 1 -- 172.21.15.142:0/70193956 shutdown_connections 2024-04-20T21:56:21.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.277+0000 7fc468c00700 1 --2- 172.21.15.142:0/70193956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc464103fb0 0x7fc4641063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:21.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.277+0000 7fc468c00700 1 --2- 172.21.15.142:0/70193956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc464101680 0x7fc464103a70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:21.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.277+0000 7fc468c00700 1 -- 172.21.15.142:0/70193956 >> 172.21.15.142:0/70193956 conn(0x7fc4640fb0d0 msgr2=0x7fc4640fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:21.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.277+0000 7fc468c00700 1 -- 172.21.15.142:0/70193956 shutdown_connections 2024-04-20T21:56:21.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.277+0000 7fc468c00700 1 -- 172.21.15.142:0/70193956 wait complete. 2024-04-20T21:56:21.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.278+0000 7fc468c00700 1 Processor -- start 2024-04-20T21:56:21.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.278+0000 7fc468c00700 1 -- start start 2024-04-20T21:56:21.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.279+0000 7fc468c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc464101680 0x7fc46419cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:21.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.279+0000 7fc468c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc464103fb0 0x7fc46419d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:21.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.279+0000 7fc468c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46419d710 con 0x7fc464101680 2024-04-20T21:56:21.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.279+0000 7fc468c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46419d850 con 0x7fc464103fb0 2024-04-20T21:56:21.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.280+0000 7fc461e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc464101680 0x7fc46419cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:21.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.280+0000 7fc461e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc464101680 0x7fc46419cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51770/0 (socket says 172.21.15.142:51770) 2024-04-20T21:56:21.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.280+0000 7fc461e00700 1 -- 172.21.15.142:0/537193829 learned_addr learned my addr 172.21.15.142:0/537193829 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:56:21.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.280+0000 7fc461400700 1 --2- 172.21.15.142:0/537193829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc464103fb0 0x7fc46419d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:21.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.281+0000 7fc461e00700 1 -- 172.21.15.142:0/537193829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc464103fb0 msgr2=0x7fc46419d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:21.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.281+0000 7fc461e00700 1 --2- 172.21.15.142:0/537193829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc464103fb0 0x7fc46419d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:21.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.281+0000 7fc461e00700 1 -- 172.21.15.142:0/537193829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4540095f0 con 0x7fc464101680 2024-04-20T21:56:21.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.281+0000 7fc461e00700 1 --2- 172.21.15.142:0/537193829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc464101680 0x7fc46419cbb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc45400bd70 tx=0x7fc45400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:21.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.281+0000 7fc45aa00700 1 -- 172.21.15.142:0/537193829 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc45401d070 con 0x7fc464101680 2024-04-20T21:56:21.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.281+0000 7fc45aa00700 1 -- 172.21.15.142:0/537193829 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc454005dc0 con 0x7fc464101680 2024-04-20T21:56:21.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.281+0000 7fc45aa00700 1 -- 172.21.15.142:0/537193829 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc454021410 con 0x7fc464101680 2024-04-20T21:56:21.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.281+0000 7fc468c00700 1 -- 172.21.15.142:0/537193829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4641a2250 con 0x7fc464101680 2024-04-20T21:56:21.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.282+0000 7fc468c00700 1 -- 172.21.15.142:0/537193829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4641a27c0 con 0x7fc464101680 2024-04-20T21:56:21.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.283+0000 7fc468c00700 1 -- 172.21.15.142:0/537193829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc464062510 con 0x7fc464101680 2024-04-20T21:56:21.287 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.285+0000 7fc45aa00700 1 -- 172.21.15.142:0/537193829 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc45400f810 con 0x7fc464101680 2024-04-20T21:56:21.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.287+0000 7fc45aa00700 1 --2- 172.21.15.142:0/537193829 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc44806cd50 0x7fc44806f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:21.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.287+0000 7fc45aa00700 1 -- 172.21.15.142:0/537193829 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fc45408d400 con 0x7fc464101680 2024-04-20T21:56:21.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.289+0000 7fc461400700 1 --2- 172.21.15.142:0/537193829 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc44806cd50 0x7fc44806f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:21.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.290+0000 7fc461400700 1 --2- 172.21.15.142:0/537193829 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc44806cd50 0x7fc44806f210 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc450005950 tx=0x7fc45000b410 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:21.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.296+0000 7fc45aa00700 1 -- 172.21.15.142:0/537193829 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fc45405b240 con 0x7fc464101680 2024-04-20T21:56:21.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:21 smithi164 ceph-mon[23506]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:56:21.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:21 smithi164 ceph-mon[23506]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:56:21.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:21 smithi164 ceph-mon[23506]: pgmap v280: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:21.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:21 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:56:21.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:21 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:56:21.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:21 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:56:21.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:21 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/1395117750' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T21:56:21.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:21 smithi142 ceph-mon[15828]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:56:21.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:21 smithi142 ceph-mon[15828]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:56:21.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:21 smithi142 ceph-mon[15828]: pgmap v280: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:21.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:21 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:56:21.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:21 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:56:21.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:21 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:56:21.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:21 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1395117750' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T21:56:21.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.680+0000 7fc468c00700 1 -- 172.21.15.142:0/537193829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc4641a2cb0 con 0x7fc464101680 2024-04-20T21:56:21.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.680+0000 7fc45aa00700 1 -- 172.21.15.142:0/537193829 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1853 (secure 0 0 0) 0x7fc45405add0 con 0x7fc464101680 2024-04-20T21:56:21.680 INFO:teuthology.orchestra.run.smithi142.stdout:e12 2024-04-20T21:56:21.680 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T21:56:21.680 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:56:21.680 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T21:56:21.680 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:56:21.680 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T21:56:21.680 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T21:56:21.680 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 12 2024-04-20T21:56:21.680 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T21:56:21.681 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T21:56:21.681 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:51.692699+0000 2024-04-20T21:56:21.681 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T21:56:21.681 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T21:56:21.681 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T21:56:21.681 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T21:56:21.681 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T21:56:21.681 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T21:56:21.681 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T21:56:21.681 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T21:56:21.681 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T21:56:21.681 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:56:21.681 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T21:56:21.681 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T21:56:21.681 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T21:56:21.681 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T21:56:21.682 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T21:56:21.682 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T21:56:21.682 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T21:56:21.682 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T21:56:21.682 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T21:56:21.682 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T21:56:21.682 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T21:56:21.682 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T21:56:21.682 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:56:21.682 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:56:21.682 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:56:21.682 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T21:56:21.682 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:56:21.682 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:56:21.682 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:56:21.683 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:56:21.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.683+0000 7fc468c00700 1 -- 172.21.15.142:0/537193829 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc44806cd50 msgr2=0x7fc44806f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:21.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.683+0000 7fc468c00700 1 --2- 172.21.15.142:0/537193829 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc44806cd50 0x7fc44806f210 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc450005950 tx=0x7fc45000b410 comp rx=0 tx=0).stop 2024-04-20T21:56:21.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.683+0000 7fc468c00700 1 -- 172.21.15.142:0/537193829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc464101680 msgr2=0x7fc46419cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:21.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.683+0000 7fc468c00700 1 --2- 172.21.15.142:0/537193829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc464101680 0x7fc46419cbb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc45400bd70 tx=0x7fc45400bda0 comp rx=0 tx=0).stop 2024-04-20T21:56:21.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.683+0000 7fc468c00700 1 -- 172.21.15.142:0/537193829 shutdown_connections 2024-04-20T21:56:21.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.683+0000 7fc468c00700 1 --2- 172.21.15.142:0/537193829 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc44806cd50 0x7fc44806f210 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:21.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.683+0000 7fc468c00700 1 --2- 172.21.15.142:0/537193829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc464101680 0x7fc46419cbb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:21.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.683+0000 7fc468c00700 1 --2- 172.21.15.142:0/537193829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc464103fb0 0x7fc46419d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:21.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.683+0000 7fc468c00700 1 -- 172.21.15.142:0/537193829 >> 172.21.15.142:0/537193829 conn(0x7fc4640fb0d0 msgr2=0x7fc4640fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:21.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.683+0000 7fc468c00700 1 -- 172.21.15.142:0/537193829 shutdown_connections 2024-04-20T21:56:21.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.683+0000 7fc468c00700 1 -- 172.21.15.142:0/537193829 wait complete. 2024-04-20T21:56:21.684 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T21:56:21.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.852+0000 7fc718400700 1 -- 172.21.15.142:0/3460786516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc710101680 msgr2=0x7fc710103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:21.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.852+0000 7fc718400700 1 --2- 172.21.15.142:0/3460786516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc710101680 0x7fc710103a70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc704009910 tx=0x7fc704009c20 comp rx=0 tx=0).stop 2024-04-20T21:56:21.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.852+0000 7fc718400700 1 -- 172.21.15.142:0/3460786516 shutdown_connections 2024-04-20T21:56:21.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.852+0000 7fc718400700 1 --2- 172.21.15.142:0/3460786516 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc710103fb0 0x7fc7101063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:21.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.852+0000 7fc718400700 1 --2- 172.21.15.142:0/3460786516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc710101680 0x7fc710103a70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:21.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.852+0000 7fc718400700 1 -- 172.21.15.142:0/3460786516 >> 172.21.15.142:0/3460786516 conn(0x7fc7100fb0d0 msgr2=0x7fc7100fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:21.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.852+0000 7fc718400700 1 -- 172.21.15.142:0/3460786516 shutdown_connections 2024-04-20T21:56:21.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.853+0000 7fc718400700 1 -- 172.21.15.142:0/3460786516 wait complete. 2024-04-20T21:56:21.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.854+0000 7fc718400700 1 Processor -- start 2024-04-20T21:56:21.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.854+0000 7fc718400700 1 -- start start 2024-04-20T21:56:21.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.855+0000 7fc718400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc710101680 0x7fc710196590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:21.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.855+0000 7fc718400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc710103fb0 0x7fc710196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:21.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.855+0000 7fc718400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7101970f0 con 0x7fc710101680 2024-04-20T21:56:21.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.855+0000 7fc718400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc710197230 con 0x7fc710103fb0 2024-04-20T21:56:21.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.855+0000 7fc715a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc710101680 0x7fc710196590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:21.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.855+0000 7fc715a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc710101680 0x7fc710196590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51788/0 (socket says 172.21.15.142:51788) 2024-04-20T21:56:21.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.855+0000 7fc715a00700 1 -- 172.21.15.142:0/2730604979 learned_addr learned my addr 172.21.15.142:0/2730604979 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:56:21.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.855+0000 7fc715000700 1 --2- 172.21.15.142:0/2730604979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc710103fb0 0x7fc710196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:21.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.856+0000 7fc715a00700 1 -- 172.21.15.142:0/2730604979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc710103fb0 msgr2=0x7fc710196ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:21.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.856+0000 7fc715a00700 1 --2- 172.21.15.142:0/2730604979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc710103fb0 0x7fc710196ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:21.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.856+0000 7fc715a00700 1 -- 172.21.15.142:0/2730604979 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7040095f0 con 0x7fc710101680 2024-04-20T21:56:21.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.856+0000 7fc715000700 1 --2- 172.21.15.142:0/2730604979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc710103fb0 0x7fc710196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:56:21.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.856+0000 7fc715a00700 1 --2- 172.21.15.142:0/2730604979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc710101680 0x7fc710196590 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc70400bd70 tx=0x7fc70400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:21.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.857+0000 7fc70e000700 1 -- 172.21.15.142:0/2730604979 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc70401d070 con 0x7fc710101680 2024-04-20T21:56:21.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.857+0000 7fc70e000700 1 -- 172.21.15.142:0/2730604979 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc704005dc0 con 0x7fc710101680 2024-04-20T21:56:21.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.857+0000 7fc70e000700 1 -- 172.21.15.142:0/2730604979 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc704021410 con 0x7fc710101680 2024-04-20T21:56:21.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.857+0000 7fc718400700 1 -- 172.21.15.142:0/2730604979 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc71019bc30 con 0x7fc710101680 2024-04-20T21:56:21.857 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.857+0000 7fc718400700 1 -- 172.21.15.142:0/2730604979 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc71019c120 con 0x7fc710101680 2024-04-20T21:56:21.858 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.859+0000 7fc718400700 1 -- 172.21.15.142:0/2730604979 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc710062510 con 0x7fc710101680 2024-04-20T21:56:21.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.861+0000 7fc70e000700 1 -- 172.21.15.142:0/2730604979 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fc70400f820 con 0x7fc710101680 2024-04-20T21:56:21.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.862+0000 7fc70e000700 1 --2- 172.21.15.142:0/2730604979 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc6f806cd30 0x7fc6f806f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:21.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.863+0000 7fc70e000700 1 -- 172.21.15.142:0/2730604979 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fc70408d8f0 con 0x7fc710101680 2024-04-20T21:56:21.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.865+0000 7fc715000700 1 --2- 172.21.15.142:0/2730604979 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc6f806cd30 0x7fc6f806f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:21.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.867+0000 7fc715000700 1 --2- 172.21.15.142:0/2730604979 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc6f806cd30 0x7fc6f806f1f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc005fd0 tx=0x7fc6fc005ee0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:21.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:21.869+0000 7fc70e000700 1 -- 172.21.15.142:0/2730604979 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fc70405b7b0 con 0x7fc710101680 2024-04-20T21:56:22.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.248+0000 7fc718400700 1 -- 172.21.15.142:0/2730604979 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc710105e90 con 0x7fc6f806cd30 2024-04-20T21:56:22.250 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T21:56:22.250 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T21:56:22.250 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T21:56:22.250 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T21:56:22.250 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [], 2024-04-20T21:56:22.250 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "0/23 daemons upgraded", 2024-04-20T21:56:22.250 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 image on host smithi164", 2024-04-20T21:56:22.250 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T21:56:22.250 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T21:56:22.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.250+0000 7fc70e000700 1 -- 172.21.15.142:0/2730604979 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fc710105e90 con 0x7fc6f806cd30 2024-04-20T21:56:22.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.254+0000 7fc718400700 1 -- 172.21.15.142:0/2730604979 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc6f806cd30 msgr2=0x7fc6f806f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:22.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.254+0000 7fc718400700 1 --2- 172.21.15.142:0/2730604979 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc6f806cd30 0x7fc6f806f1f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc005fd0 tx=0x7fc6fc005ee0 comp rx=0 tx=0).stop 2024-04-20T21:56:22.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.254+0000 7fc718400700 1 -- 172.21.15.142:0/2730604979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc710101680 msgr2=0x7fc710196590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:22.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.254+0000 7fc718400700 1 --2- 172.21.15.142:0/2730604979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc710101680 0x7fc710196590 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc70400bd70 tx=0x7fc70400be50 comp rx=0 tx=0).stop 2024-04-20T21:56:22.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.254+0000 7fc718400700 1 -- 172.21.15.142:0/2730604979 shutdown_connections 2024-04-20T21:56:22.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.254+0000 7fc718400700 1 --2- 172.21.15.142:0/2730604979 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fc6f806cd30 0x7fc6f806f1f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:22.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.254+0000 7fc718400700 1 --2- 172.21.15.142:0/2730604979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc710101680 0x7fc710196590 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:22.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.254+0000 7fc718400700 1 --2- 172.21.15.142:0/2730604979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc710103fb0 0x7fc710196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:22.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.254+0000 7fc718400700 1 -- 172.21.15.142:0/2730604979 >> 172.21.15.142:0/2730604979 conn(0x7fc7100fb0d0 msgr2=0x7fc7100fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:22.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.255+0000 7fc718400700 1 -- 172.21.15.142:0/2730604979 shutdown_connections 2024-04-20T21:56:22.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.255+0000 7fc718400700 1 -- 172.21.15.142:0/2730604979 wait complete. 2024-04-20T21:56:22.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.447+0000 7f1dcbe00700 1 -- 172.21.15.142:0/1585336710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dcc100a40 msgr2=0x7f1dcc100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:22.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.447+0000 7f1dcbe00700 1 --2- 172.21.15.142:0/1585336710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dcc100a40 0x7f1dcc100e60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc009910 tx=0x7f1dbc009c20 comp rx=0 tx=0).stop 2024-04-20T21:56:22.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.448+0000 7f1dcbe00700 1 -- 172.21.15.142:0/1585336710 shutdown_connections 2024-04-20T21:56:22.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.448+0000 7f1dcbe00700 1 --2- 172.21.15.142:0/1585336710 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1dcc101c40 0x7f1dcc1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:22.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.448+0000 7f1dcbe00700 1 --2- 172.21.15.142:0/1585336710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dcc100a40 0x7f1dcc100e60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:22.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.448+0000 7f1dcbe00700 1 -- 172.21.15.142:0/1585336710 >> 172.21.15.142:0/1585336710 conn(0x7f1dcc0fc000 msgr2=0x7f1dcc0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:22.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.448+0000 7f1dcbe00700 1 -- 172.21.15.142:0/1585336710 shutdown_connections 2024-04-20T21:56:22.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.448+0000 7f1dcbe00700 1 -- 172.21.15.142:0/1585336710 wait complete. 2024-04-20T21:56:22.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.449+0000 7f1dcbe00700 1 Processor -- start 2024-04-20T21:56:22.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.450+0000 7f1dcbe00700 1 -- start start 2024-04-20T21:56:22.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.450+0000 7f1dcbe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dcc100a40 0x7f1dcc1986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:22.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.450+0000 7f1dcbe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1dcc101c40 0x7f1dcc198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:22.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.450+0000 7f1dcbe00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc199230 con 0x7f1dcc100a40 2024-04-20T21:56:22.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.450+0000 7f1dcbe00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc199370 con 0x7f1dcc101c40 2024-04-20T21:56:22.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.451+0000 7f1dca000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1dcc101c40 0x7f1dcc198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:22.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.451+0000 7f1dcaa00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dcc100a40 0x7f1dcc1986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:22.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.451+0000 7f1dca000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1dcc101c40 0x7f1dcc198c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:57800/0 (socket says 172.21.15.142:57800) 2024-04-20T21:56:22.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.451+0000 7f1dca000700 1 -- 172.21.15.142:0/920890780 learned_addr learned my addr 172.21.15.142:0/920890780 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:56:22.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.452+0000 7f1dca000700 1 -- 172.21.15.142:0/920890780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dcc100a40 msgr2=0x7f1dcc1986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:22.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.452+0000 7f1dca000700 1 --2- 172.21.15.142:0/920890780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dcc100a40 0x7f1dcc1986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:22.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.452+0000 7f1dca000700 1 -- 172.21.15.142:0/920890780 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dbc0095f0 con 0x7f1dcc101c40 2024-04-20T21:56:22.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.452+0000 7f1dcaa00700 1 --2- 172.21.15.142:0/920890780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dcc100a40 0x7f1dcc1986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:56:22.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:22 smithi142 ceph-mon[15828]: Upgrade: Target is version 19.0.0-3133-ga8c84f59 (unknown) 2024-04-20T21:56:22.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:22 smithi142 ceph-mon[15828]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1'] 2024-04-20T21:56:22.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:22 smithi142 ceph-mon[15828]: Upgrade: Need to upgrade myself (mgr.smithi142.zzmcfz) 2024-04-20T21:56:22.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:22 smithi142 ceph-mon[15828]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:56:22.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:22 smithi142 ceph-mon[15828]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 on smithi164 2024-04-20T21:56:22.452 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:22 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/537193829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:56:22.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.453+0000 7f1dca000700 1 --2- 172.21.15.142:0/920890780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1dcc101c40 0x7f1dcc198c10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1db800e920 tx=0x7f1db800ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:22.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.453+0000 7f1dc3400700 1 -- 172.21.15.142:0/920890780 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1db800c9d0 con 0x7f1dcc101c40 2024-04-20T21:56:22.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.454+0000 7f1dc3400700 1 -- 172.21.15.142:0/920890780 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1db8010430 con 0x7f1dcc101c40 2024-04-20T21:56:22.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.454+0000 7f1dc3400700 1 -- 172.21.15.142:0/920890780 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1db8018630 con 0x7f1dcc101c40 2024-04-20T21:56:22.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.454+0000 7f1dcbe00700 1 -- 172.21.15.142:0/920890780 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc19ddd0 con 0x7f1dcc101c40 2024-04-20T21:56:22.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.454+0000 7f1dcbe00700 1 -- 172.21.15.142:0/920890780 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc19e370 con 0x7f1dcc101c40 2024-04-20T21:56:22.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.458+0000 7f1dcbe00700 1 -- 172.21.15.142:0/920890780 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dcc106610 con 0x7f1dcc101c40 2024-04-20T21:56:22.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.461+0000 7f1dc3400700 1 -- 172.21.15.142:0/920890780 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1db80105a0 con 0x7f1dcc101c40 2024-04-20T21:56:22.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.462+0000 7f1dc3400700 1 --2- 172.21.15.142:0/920890780 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1db006ce00 0x7f1db006f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:22.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.463+0000 7f1dc3400700 1 -- 172.21.15.142:0/920890780 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f1db8014070 con 0x7f1dcc101c40 2024-04-20T21:56:22.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.463+0000 7f1dcaa00700 1 --2- 172.21.15.142:0/920890780 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1db006ce00 0x7f1db006f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:22.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.465+0000 7f1dcaa00700 1 --2- 172.21.15.142:0/920890780 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1db006ce00 0x7f1db006f2c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc00b6f0 tx=0x7f1dbc005fb0 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:22.470 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:22.471+0000 7f1dc3400700 1 -- 172.21.15.142:0/920890780 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f1db805a4c0 con 0x7f1dcc101c40 2024-04-20T21:56:22.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:22 smithi164 ceph-mon[23506]: Upgrade: Target is version 19.0.0-3133-ga8c84f59 (unknown) 2024-04-20T21:56:22.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:22 smithi164 ceph-mon[23506]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, digests ['quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1'] 2024-04-20T21:56:22.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:22 smithi164 ceph-mon[23506]: Upgrade: Need to upgrade myself (mgr.smithi142.zzmcfz) 2024-04-20T21:56:22.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:22 smithi164 ceph-mon[23506]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:56:22.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:22 smithi164 ceph-mon[23506]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 on smithi164 2024-04-20T21:56:22.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:22 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/537193829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:56:23.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:23.034+0000 7f1dcbe00700 1 -- 172.21.15.142:0/920890780 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1dcc02cd40 con 0x7f1dcc101c40 2024-04-20T21:56:23.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:23.035+0000 7f1dc3400700 1 -- 172.21.15.142:0/920890780 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f1db805a050 con 0x7f1dcc101c40 2024-04-20T21:56:23.034 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_OK 2024-04-20T21:56:23.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:23.038+0000 7f1dcbe00700 1 -- 172.21.15.142:0/920890780 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1db006ce00 msgr2=0x7f1db006f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:23.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:23.038+0000 7f1dcbe00700 1 --2- 172.21.15.142:0/920890780 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1db006ce00 0x7f1db006f2c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc00b6f0 tx=0x7f1dbc005fb0 comp rx=0 tx=0).stop 2024-04-20T21:56:23.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:23.038+0000 7f1dcbe00700 1 -- 172.21.15.142:0/920890780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1dcc101c40 msgr2=0x7f1dcc198c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:23.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:23.038+0000 7f1dcbe00700 1 --2- 172.21.15.142:0/920890780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1dcc101c40 0x7f1dcc198c10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1db800e920 tx=0x7f1db800ec30 comp rx=0 tx=0).stop 2024-04-20T21:56:23.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:23.039+0000 7f1dcbe00700 1 -- 172.21.15.142:0/920890780 shutdown_connections 2024-04-20T21:56:23.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:23.039+0000 7f1dcbe00700 1 --2- 172.21.15.142:0/920890780 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1db006ce00 0x7f1db006f2c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:23.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:23.039+0000 7f1dcbe00700 1 --2- 172.21.15.142:0/920890780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dcc100a40 0x7f1dcc1986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:23.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:23.039+0000 7f1dcbe00700 1 --2- 172.21.15.142:0/920890780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1dcc101c40 0x7f1dcc198c10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:23.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:23.039+0000 7f1dcbe00700 1 -- 172.21.15.142:0/920890780 >> 172.21.15.142:0/920890780 conn(0x7f1dcc0fc000 msgr2=0x7f1dcc0734b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:23.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:23.039+0000 7f1dcbe00700 1 -- 172.21.15.142:0/920890780 shutdown_connections 2024-04-20T21:56:23.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:23.039+0000 7f1dcbe00700 1 -- 172.21.15.142:0/920890780 wait complete. 2024-04-20T21:56:23.333 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:23 smithi142 ceph-mon[15828]: pgmap v281: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:23.333 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:23 smithi142 ceph-mon[15828]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:56:23.333 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:23 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/920890780' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T21:56:23.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:23 smithi164 ceph-mon[23506]: pgmap v281: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:23.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:23 smithi164 ceph-mon[23506]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:56:23.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:23 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/920890780' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T21:56:24.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:24 smithi164 ceph-mon[23506]: pgmap v282: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:24.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:24 smithi142 ceph-mon[15828]: pgmap v282: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:25.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:25 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:56:25.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:25 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:56:26.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:26 smithi142 ceph-mon[15828]: pgmap v283: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:26.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:26 smithi164 ceph-mon[23506]: pgmap v283: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:29.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:29 smithi142 ceph-mon[15828]: pgmap v284: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:29.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:29 smithi164 ceph-mon[23506]: pgmap v284: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:31.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:31 smithi142 ceph-mon[15828]: pgmap v285: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:31.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:31 smithi164 ceph-mon[23506]: pgmap v285: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:33.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:33 smithi142 ceph-mon[15828]: pgmap v286: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:33.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:33 smithi164 ceph-mon[23506]: pgmap v286: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:35.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:35 smithi142 ceph-mon[15828]: pgmap v287: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:35.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:35 smithi164 ceph-mon[23506]: pgmap v287: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:37.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:37 smithi142 ceph-mon[15828]: pgmap v288: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:37.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:37 smithi164 ceph-mon[23506]: pgmap v288: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:39.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:39 smithi142 ceph-mon[15828]: pgmap v289: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:39.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:39 smithi164 ceph-mon[23506]: pgmap v289: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:41.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:41 smithi142 ceph-mon[15828]: pgmap v290: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:41.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:41 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:56:41.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:41 smithi164 ceph-mon[23506]: pgmap v290: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:41.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:41 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:56:43.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:43 smithi142 ceph-mon[15828]: pgmap v291: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:43.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:43 smithi164 ceph-mon[23506]: pgmap v291: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:45.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:45 smithi142 ceph-mon[15828]: pgmap v292: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:45.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:45 smithi164 ceph-mon[23506]: pgmap v292: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:47.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:47 smithi142 ceph-mon[15828]: pgmap v293: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:47.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:47 smithi164 ceph-mon[23506]: pgmap v293: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:49.428 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:49 smithi142 ceph-mon[15828]: pgmap v294: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:49.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:49 smithi164 ceph-mon[23506]: pgmap v294: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:51.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:51 smithi164 ceph-mon[23506]: pgmap v295: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:51.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:51 smithi142 ceph-mon[15828]: pgmap v295: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:53.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.210+0000 7f9f11800700 1 -- 172.21.15.142:0/3388533927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f0c103ff0 msgr2=0x7f9f0c1063e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:53.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.210+0000 7f9f11800700 1 --2- 172.21.15.142:0/3388533927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f0c103ff0 0x7f9f0c1063e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009910 tx=0x7f9ef8009c20 comp rx=0 tx=0).stop 2024-04-20T21:56:53.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.211+0000 7f9f11800700 1 -- 172.21.15.142:0/3388533927 shutdown_connections 2024-04-20T21:56:53.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.211+0000 7f9f11800700 1 --2- 172.21.15.142:0/3388533927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f0c103ff0 0x7f9f0c1063e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:53.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.211+0000 7f9f11800700 1 --2- 172.21.15.142:0/3388533927 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f0c1016c0 0x7f9f0c103ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:53.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.211+0000 7f9f11800700 1 -- 172.21.15.142:0/3388533927 >> 172.21.15.142:0/3388533927 conn(0x7f9f0c0fb0d0 msgr2=0x7f9f0c0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:53.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.211+0000 7f9f11800700 1 -- 172.21.15.142:0/3388533927 shutdown_connections 2024-04-20T21:56:53.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.211+0000 7f9f11800700 1 -- 172.21.15.142:0/3388533927 wait complete. 2024-04-20T21:56:53.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.212+0000 7f9f11800700 1 Processor -- start 2024-04-20T21:56:53.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.212+0000 7f9f11800700 1 -- start start 2024-04-20T21:56:53.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.212+0000 7f9f11800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f0c1016c0 0x7f9f0c100fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:53.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.212+0000 7f9f11800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f0c103ff0 0x7f9f0c0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:53.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.212+0000 7f9f11800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c0ffbb0 con 0x7f9f0c103ff0 2024-04-20T21:56:53.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.213+0000 7f9f11800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c0ffcf0 con 0x7f9f0c1016c0 2024-04-20T21:56:53.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.213+0000 7f9f0a000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f0c103ff0 0x7f9f0c0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:53.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.213+0000 7f9f0a000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f0c103ff0 0x7f9f0c0ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39234/0 (socket says 172.21.15.142:39234) 2024-04-20T21:56:53.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.213+0000 7f9f0a000700 1 -- 172.21.15.142:0/742076659 learned_addr learned my addr 172.21.15.142:0/742076659 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:56:53.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.213+0000 7f9f0aa00700 1 --2- 172.21.15.142:0/742076659 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f0c1016c0 0x7f9f0c100fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:53.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.213+0000 7f9f0a000700 1 -- 172.21.15.142:0/742076659 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f0c1016c0 msgr2=0x7f9f0c100fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:53.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.213+0000 7f9f0a000700 1 --2- 172.21.15.142:0/742076659 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f0c1016c0 0x7f9f0c100fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:53.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.213+0000 7f9f0a000700 1 -- 172.21.15.142:0/742076659 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef80095f0 con 0x7f9f0c103ff0 2024-04-20T21:56:53.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.213+0000 7f9f0a000700 1 --2- 172.21.15.142:0/742076659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f0c103ff0 0x7f9f0c0ff670 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800bd70 tx=0x7f9ef800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:53.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.214+0000 7f9f03400700 1 -- 172.21.15.142:0/742076659 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ef801d070 con 0x7f9f0c103ff0 2024-04-20T21:56:53.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.214+0000 7f9f03400700 1 -- 172.21.15.142:0/742076659 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ef8005dc0 con 0x7f9f0c103ff0 2024-04-20T21:56:53.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.214+0000 7f9f03400700 1 -- 172.21.15.142:0/742076659 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ef8021410 con 0x7f9f0c103ff0 2024-04-20T21:56:53.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.214+0000 7f9f11800700 1 -- 172.21.15.142:0/742076659 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0c0fff70 con 0x7f9f0c103ff0 2024-04-20T21:56:53.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.214+0000 7f9f11800700 1 -- 172.21.15.142:0/742076659 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0c1004e0 con 0x7f9f0c103ff0 2024-04-20T21:56:53.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.215+0000 7f9f11800700 1 -- 172.21.15.142:0/742076659 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0c062510 con 0x7f9f0c103ff0 2024-04-20T21:56:53.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.217+0000 7f9f03400700 1 -- 172.21.15.142:0/742076659 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f9ef800f810 con 0x7f9f0c103ff0 2024-04-20T21:56:53.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.217+0000 7f9f03400700 1 --2- 172.21.15.142:0/742076659 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f9ef006cce0 0x7f9ef006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:53.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.217+0000 7f9f03400700 1 -- 172.21.15.142:0/742076659 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f9ef808d280 con 0x7f9f0c103ff0 2024-04-20T21:56:53.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.218+0000 7f9f0aa00700 1 --2- 172.21.15.142:0/742076659 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f9ef006cce0 0x7f9ef006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:53.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.218+0000 7f9f0aa00700 1 --2- 172.21.15.142:0/742076659 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f9ef006cce0 0x7f9ef006f1a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9efc005950 tx=0x7f9efc00b410 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:53.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.222+0000 7f9f03400700 1 -- 172.21.15.142:0/742076659 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f9ef805b0c0 con 0x7f9f0c103ff0 2024-04-20T21:56:53.443 INFO:tasks.workunit.client.0.smithi142.stderr:Updating files: 61% (7533/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-20T21:56:53.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:53 smithi164 ceph-mon[23506]: pgmap v296: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:53.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:53 smithi142 ceph-mon[15828]: pgmap v296: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:53.458 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.459+0000 7f9f11800700 1 -- 172.21.15.142:0/742076659 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f0c1004e0 con 0x7f9ef006cce0 2024-04-20T21:56:53.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.461+0000 7f9f03400700 1 -- 172.21.15.142:0/742076659 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f9f0c1004e0 con 0x7f9ef006cce0 2024-04-20T21:56:53.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.464+0000 7f9f11800700 1 -- 172.21.15.142:0/742076659 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f9ef006cce0 msgr2=0x7f9ef006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:53.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.464+0000 7f9f11800700 1 --2- 172.21.15.142:0/742076659 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f9ef006cce0 0x7f9ef006f1a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9efc005950 tx=0x7f9efc00b410 comp rx=0 tx=0).stop 2024-04-20T21:56:53.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.464+0000 7f9f11800700 1 -- 172.21.15.142:0/742076659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f0c103ff0 msgr2=0x7f9f0c0ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:53.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.464+0000 7f9f11800700 1 --2- 172.21.15.142:0/742076659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f0c103ff0 0x7f9f0c0ff670 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800bd70 tx=0x7f9ef800bda0 comp rx=0 tx=0).stop 2024-04-20T21:56:53.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.464+0000 7f9f11800700 1 -- 172.21.15.142:0/742076659 shutdown_connections 2024-04-20T21:56:53.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.464+0000 7f9f11800700 1 --2- 172.21.15.142:0/742076659 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f9ef006cce0 0x7f9ef006f1a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:53.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.464+0000 7f9f11800700 1 --2- 172.21.15.142:0/742076659 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f0c1016c0 0x7f9f0c100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:53.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.464+0000 7f9f11800700 1 --2- 172.21.15.142:0/742076659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f0c103ff0 0x7f9f0c0ff670 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:53.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.464+0000 7f9f11800700 1 -- 172.21.15.142:0/742076659 >> 172.21.15.142:0/742076659 conn(0x7f9f0c0fb0d0 msgr2=0x7f9f0c0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:53.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.464+0000 7f9f11800700 1 -- 172.21.15.142:0/742076659 shutdown_connections 2024-04-20T21:56:53.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.464+0000 7f9f11800700 1 -- 172.21.15.142:0/742076659 wait complete. 2024-04-20T21:56:53.479 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T21:56:53.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.630+0000 7f7901a00700 1 -- 172.21.15.142:0/3006196575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78fc103fb0 msgr2=0x7f78fc1063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:53.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.630+0000 7f7901a00700 1 --2- 172.21.15.142:0/3006196575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78fc103fb0 0x7f78fc1063a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f78e8009910 tx=0x7f78e8009c20 comp rx=0 tx=0).stop 2024-04-20T21:56:53.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.630+0000 7f7901a00700 1 -- 172.21.15.142:0/3006196575 shutdown_connections 2024-04-20T21:56:53.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.630+0000 7f7901a00700 1 --2- 172.21.15.142:0/3006196575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78fc103fb0 0x7f78fc1063a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:53.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.630+0000 7f7901a00700 1 --2- 172.21.15.142:0/3006196575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78fc101680 0x7f78fc103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:53.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.630+0000 7f7901a00700 1 -- 172.21.15.142:0/3006196575 >> 172.21.15.142:0/3006196575 conn(0x7f78fc0fb0d0 msgr2=0x7f78fc0fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:53.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.630+0000 7f7901a00700 1 -- 172.21.15.142:0/3006196575 shutdown_connections 2024-04-20T21:56:53.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.630+0000 7f7901a00700 1 -- 172.21.15.142:0/3006196575 wait complete. 2024-04-20T21:56:53.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.631+0000 7f7901a00700 1 Processor -- start 2024-04-20T21:56:53.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.631+0000 7f7901a00700 1 -- start start 2024-04-20T21:56:53.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.632+0000 7f7901a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78fc101680 0x7f78fc196600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:53.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.632+0000 7f7901a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78fc103fb0 0x7f78fc196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:53.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.632+0000 7f7901a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc197160 con 0x7f78fc103fb0 2024-04-20T21:56:53.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.632+0000 7f7901a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc1972a0 con 0x7f78fc101680 2024-04-20T21:56:53.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.632+0000 7f78fa000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78fc103fb0 0x7f78fc196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:53.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.632+0000 7f78faa00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78fc101680 0x7f78fc196600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:53.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.632+0000 7f78faa00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78fc101680 0x7f78fc196600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:48436/0 (socket says 172.21.15.142:48436) 2024-04-20T21:56:53.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.632+0000 7f78faa00700 1 -- 172.21.15.142:0/645105249 learned_addr learned my addr 172.21.15.142:0/645105249 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:56:53.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.632+0000 7f78fa000700 1 -- 172.21.15.142:0/645105249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78fc101680 msgr2=0x7f78fc196600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:53.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.632+0000 7f78fa000700 1 --2- 172.21.15.142:0/645105249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78fc101680 0x7f78fc196600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:53.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.632+0000 7f78fa000700 1 -- 172.21.15.142:0/645105249 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e80095f0 con 0x7f78fc103fb0 2024-04-20T21:56:53.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.633+0000 7f78fa000700 1 --2- 172.21.15.142:0/645105249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78fc103fb0 0x7f78fc196b40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f78e8000c00 tx=0x7f78e8005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:53.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.633+0000 7f78f3400700 1 -- 172.21.15.142:0/645105249 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78e801d070 con 0x7f78fc103fb0 2024-04-20T21:56:53.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.633+0000 7f78f3400700 1 -- 172.21.15.142:0/645105249 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f78e80052a0 con 0x7f78fc103fb0 2024-04-20T21:56:53.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.633+0000 7f78f3400700 1 -- 172.21.15.142:0/645105249 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78e8017400 con 0x7f78fc103fb0 2024-04-20T21:56:53.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.633+0000 7f7901a00700 1 -- 172.21.15.142:0/645105249 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78fc19bca0 con 0x7f78fc103fb0 2024-04-20T21:56:53.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.633+0000 7f7901a00700 1 -- 172.21.15.142:0/645105249 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78fc19c210 con 0x7f78fc103fb0 2024-04-20T21:56:53.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.634+0000 7f7901a00700 1 -- 172.21.15.142:0/645105249 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78fc062510 con 0x7f78fc103fb0 2024-04-20T21:56:53.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.635+0000 7f78f3400700 1 -- 172.21.15.142:0/645105249 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f78e8003780 con 0x7f78fc103fb0 2024-04-20T21:56:53.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.636+0000 7f78f3400700 1 --2- 172.21.15.142:0/645105249 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f78e006cd30 0x7f78e006f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:53.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.636+0000 7f78f3400700 1 -- 172.21.15.142:0/645105249 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f78e808d610 con 0x7f78fc103fb0 2024-04-20T21:56:53.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.636+0000 7f78faa00700 1 --2- 172.21.15.142:0/645105249 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f78e006cd30 0x7f78e006f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:53.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.637+0000 7f78faa00700 1 --2- 172.21.15.142:0/645105249 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f78e006cd30 0x7f78e006f1f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009d60 tx=0x7f78ec009260 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:53.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.641+0000 7f78f3400700 1 -- 172.21.15.142:0/645105249 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f78e805b450 con 0x7f78fc103fb0 2024-04-20T21:56:53.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.879+0000 7f7901a00700 1 -- 172.21.15.142:0/645105249 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f78fc105ed0 con 0x7f78e006cd30 2024-04-20T21:56:53.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.881+0000 7f78f3400700 1 -- 172.21.15.142:0/645105249 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f78fc105ed0 con 0x7f78e006cd30 2024-04-20T21:56:53.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.883+0000 7f7901a00700 1 -- 172.21.15.142:0/645105249 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f78e006cd30 msgr2=0x7f78e006f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:53.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.883+0000 7f7901a00700 1 --2- 172.21.15.142:0/645105249 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f78e006cd30 0x7f78e006f1f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009d60 tx=0x7f78ec009260 comp rx=0 tx=0).stop 2024-04-20T21:56:53.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.883+0000 7f7901a00700 1 -- 172.21.15.142:0/645105249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78fc103fb0 msgr2=0x7f78fc196b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:53.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.883+0000 7f7901a00700 1 --2- 172.21.15.142:0/645105249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78fc103fb0 0x7f78fc196b40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f78e8000c00 tx=0x7f78e8005f00 comp rx=0 tx=0).stop 2024-04-20T21:56:53.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.884+0000 7f7901a00700 1 -- 172.21.15.142:0/645105249 shutdown_connections 2024-04-20T21:56:53.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.884+0000 7f7901a00700 1 --2- 172.21.15.142:0/645105249 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f78e006cd30 0x7f78e006f1f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:53.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.884+0000 7f7901a00700 1 --2- 172.21.15.142:0/645105249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78fc101680 0x7f78fc196600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:53.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.884+0000 7f7901a00700 1 --2- 172.21.15.142:0/645105249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78fc103fb0 0x7f78fc196b40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:53.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.884+0000 7f7901a00700 1 -- 172.21.15.142:0/645105249 >> 172.21.15.142:0/645105249 conn(0x7f78fc0fb0d0 msgr2=0x7f78fc0fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:53.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.884+0000 7f7901a00700 1 -- 172.21.15.142:0/645105249 shutdown_connections 2024-04-20T21:56:53.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:53.884+0000 7f7901a00700 1 -- 172.21.15.142:0/645105249 wait complete. 2024-04-20T21:56:54.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.046+0000 7ff131000700 1 -- 172.21.15.142:0/2734534313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff12c107260 msgr2=0x7ff12c107680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:54.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.046+0000 7ff131000700 1 --2- 172.21.15.142:0/2734534313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff12c107260 0x7ff12c107680 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009910 tx=0x7ff11c009c20 comp rx=0 tx=0).stop 2024-04-20T21:56:54.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.046+0000 7ff131000700 1 -- 172.21.15.142:0/2734534313 shutdown_connections 2024-04-20T21:56:54.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.046+0000 7ff131000700 1 --2- 172.21.15.142:0/2734534313 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff12c108430 0x7ff12c1088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:54.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.046+0000 7ff131000700 1 --2- 172.21.15.142:0/2734534313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff12c107260 0x7ff12c107680 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:54.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.046+0000 7ff131000700 1 -- 172.21.15.142:0/2734534313 >> 172.21.15.142:0/2734534313 conn(0x7ff12c076400 msgr2=0x7ff12c078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:54.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.046+0000 7ff131000700 1 -- 172.21.15.142:0/2734534313 shutdown_connections 2024-04-20T21:56:54.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.047+0000 7ff131000700 1 -- 172.21.15.142:0/2734534313 wait complete. 2024-04-20T21:56:54.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.048+0000 7ff131000700 1 Processor -- start 2024-04-20T21:56:54.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.048+0000 7ff131000700 1 -- start start 2024-04-20T21:56:54.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.048+0000 7ff131000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff12c107260 0x7ff12c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:54.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.048+0000 7ff131000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff12c108430 0x7ff12c19d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:54.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.048+0000 7ff131000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c19d790 con 0x7ff12c108430 2024-04-20T21:56:54.048 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.048+0000 7ff131000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c19d8d0 con 0x7ff12c107260 2024-04-20T21:56:54.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.049+0000 7ff129400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff12c108430 0x7ff12c19d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:54.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.049+0000 7ff129e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff12c107260 0x7ff12c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:54.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.049+0000 7ff129400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff12c108430 0x7ff12c19d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39276/0 (socket says 172.21.15.142:39276) 2024-04-20T21:56:54.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.049+0000 7ff129400700 1 -- 172.21.15.142:0/2922559625 learned_addr learned my addr 172.21.15.142:0/2922559625 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:56:54.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.049+0000 7ff129400700 1 -- 172.21.15.142:0/2922559625 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff12c107260 msgr2=0x7ff12c19cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:54.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.049+0000 7ff129400700 1 --2- 172.21.15.142:0/2922559625 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff12c107260 0x7ff12c19cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:54.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.049+0000 7ff129400700 1 -- 172.21.15.142:0/2922559625 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c0095f0 con 0x7ff12c108430 2024-04-20T21:56:54.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.049+0000 7ff129400700 1 --2- 172.21.15.142:0/2922559625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff12c108430 0x7ff12c19d170 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff11800e940 tx=0x7ff11800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:54.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.050+0000 7ff122a00700 1 -- 172.21.15.142:0/2922559625 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff11800cba0 con 0x7ff12c108430 2024-04-20T21:56:54.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.050+0000 7ff122a00700 1 -- 172.21.15.142:0/2922559625 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff11800ee90 con 0x7ff12c108430 2024-04-20T21:56:54.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.050+0000 7ff131000700 1 -- 172.21.15.142:0/2922559625 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12c1a2330 con 0x7ff12c108430 2024-04-20T21:56:54.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.050+0000 7ff122a00700 1 -- 172.21.15.142:0/2922559625 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1180055d0 con 0x7ff12c108430 2024-04-20T21:56:54.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.050+0000 7ff131000700 1 -- 172.21.15.142:0/2922559625 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12c1a2900 con 0x7ff12c108430 2024-04-20T21:56:54.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.051+0000 7ff131000700 1 -- 172.21.15.142:0/2922559625 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12c196df0 con 0x7ff12c108430 2024-04-20T21:56:54.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.053+0000 7ff122a00700 1 -- 172.21.15.142:0/2922559625 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7ff118004750 con 0x7ff12c108430 2024-04-20T21:56:54.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.053+0000 7ff122a00700 1 --2- 172.21.15.142:0/2922559625 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff11006ccf0 0x7ff11006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:54.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.053+0000 7ff122a00700 1 -- 172.21.15.142:0/2922559625 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7ff118014070 con 0x7ff12c108430 2024-04-20T21:56:54.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.054+0000 7ff129e00700 1 --2- 172.21.15.142:0/2922559625 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff11006ccf0 0x7ff11006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:54.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.054+0000 7ff129e00700 1 --2- 172.21.15.142:0/2922559625 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff11006ccf0 0x7ff11006f1b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00b800 tx=0x7ff11c009f70 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:54.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.058+0000 7ff122a00700 1 -- 172.21.15.142:0/2922559625 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7ff11805a420 con 0x7ff12c108430 2024-04-20T21:56:54.278 INFO:tasks.workunit.client.0.smithi142.stderr:Note: switching to 'a8c84f5997950fd7d008204839253291d52e6eda'. 2024-04-20T21:56:54.278 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-20T21:56:54.278 INFO:tasks.workunit.client.0.smithi142.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-20T21:56:54.278 INFO:tasks.workunit.client.0.smithi142.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-20T21:56:54.278 INFO:tasks.workunit.client.0.smithi142.stderr:state without impacting any branches by switching back to a branch. 2024-04-20T21:56:54.278 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-20T21:56:54.278 INFO:tasks.workunit.client.0.smithi142.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-20T21:56:54.278 INFO:tasks.workunit.client.0.smithi142.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-20T21:56:54.278 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-20T21:56:54.278 INFO:tasks.workunit.client.0.smithi142.stderr: git switch -c 2024-04-20T21:56:54.279 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-20T21:56:54.279 INFO:tasks.workunit.client.0.smithi142.stderr:Or undo this operation with: 2024-04-20T21:56:54.279 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-20T21:56:54.279 INFO:tasks.workunit.client.0.smithi142.stderr: git switch - 2024-04-20T21:56:54.279 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-20T21:56:54.279 INFO:tasks.workunit.client.0.smithi142.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-20T21:56:54.279 INFO:tasks.workunit.client.0.smithi142.stderr: 2024-04-20T21:56:54.279 INFO:tasks.workunit.client.0.smithi142.stderr:HEAD is now at a8c84f59979 Merge PR #51659 into wip-rishabh-testing-20240416.193735 2024-04-20T21:56:54.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.284+0000 7ff131000700 1 -- 172.21.15.142:0/2922559625 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff12c02ce50 con 0x7ff11006ccf0 2024-04-20T21:56:54.293 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-20T21:56:54.299 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T21:56:54.299 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (7m) 106s ago 9m 13.1M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T21:56:54.299 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (9m) 106s ago 9m 7528k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T21:56:54.299 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (8m) 113s ago 8m 7235k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T21:56:54.300 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (9m) 106s ago 9m 6665k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 56f2e41784f8 2024-04-20T21:56:54.300 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (8m) 113s ago 8m 6660k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 bce67525dd3e 2024-04-20T21:56:54.300 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (7m) 106s ago 9m 73.5M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T21:56:54.300 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (2m) 106s ago 2m 14.7M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 b68e279d7945 2024-04-20T21:56:54.300 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (2m) 106s ago 2m 11.7M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T21:56:54.300 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (2m) 113s ago 2m 11.6M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T21:56:54.300 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (2m) 113s ago 2m 11.7M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T21:56:54.300 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:9283,8765,8443 running (11m) 106s ago 11m 499M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d2c979afd250 2024-04-20T21:56:54.300 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (8m) 113s ago 8m 449M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 2e2b1f8dfca1 2024-04-20T21:56:54.300 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (11m) 106s ago 11m 45.0M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c076f7eb00ea 2024-04-20T21:56:54.300 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (8m) 113s ago 8m 34.7M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 2bacdeb02ee0 2024-04-20T21:56:54.300 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (9m) 106s ago 9m 7805k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T21:56:54.300 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (8m) 113s ago 8m 7666k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T21:56:54.300 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (7m) 106s ago 7m 46.7M 3947M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4361ae428e0d 2024-04-20T21:56:54.301 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (6m) 106s ago 6m 48.8M 3947M 18.2.2-1237-g646b8c7d 9900ed1a6b81 dd7e7cf8e8e1 2024-04-20T21:56:54.301 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (5m) 106s ago 5m 53.2M 3947M 18.2.2-1237-g646b8c7d 9900ed1a6b81 8e9165365127 2024-04-20T21:56:54.301 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (5m) 113s ago 5m 51.4M 4971M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c081911f56ab 2024-04-20T21:56:54.301 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (4m) 113s ago 4m 49.0M 4971M 18.2.2-1237-g646b8c7d 9900ed1a6b81 39e09d63d44f 2024-04-20T21:56:54.301 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (4m) 113s ago 4m 48.0M 4971M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4f36124aeb0d 2024-04-20T21:56:54.301 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (7m) 106s ago 8m 50.5M - 2.43.0 a07b618ecd1d a1f0ad25692f 2024-04-20T21:56:54.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.296+0000 7ff122a00700 1 -- 172.21.15.142:0/2922559625 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7ff12c02ce50 con 0x7ff11006ccf0 2024-04-20T21:56:54.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.299+0000 7ff131000700 1 -- 172.21.15.142:0/2922559625 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff11006ccf0 msgr2=0x7ff11006f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:54.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.299+0000 7ff131000700 1 --2- 172.21.15.142:0/2922559625 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff11006ccf0 0x7ff11006f1b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00b800 tx=0x7ff11c009f70 comp rx=0 tx=0).stop 2024-04-20T21:56:54.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.299+0000 7ff131000700 1 -- 172.21.15.142:0/2922559625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff12c108430 msgr2=0x7ff12c19d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:54.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.299+0000 7ff131000700 1 --2- 172.21.15.142:0/2922559625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff12c108430 0x7ff12c19d170 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff11800e940 tx=0x7ff11800ec50 comp rx=0 tx=0).stop 2024-04-20T21:56:54.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.299+0000 7ff131000700 1 -- 172.21.15.142:0/2922559625 shutdown_connections 2024-04-20T21:56:54.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.299+0000 7ff131000700 1 --2- 172.21.15.142:0/2922559625 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7ff11006ccf0 0x7ff11006f1b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:54.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.299+0000 7ff131000700 1 --2- 172.21.15.142:0/2922559625 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff12c107260 0x7ff12c19cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:54.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.299+0000 7ff131000700 1 --2- 172.21.15.142:0/2922559625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff12c108430 0x7ff12c19d170 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:54.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.299+0000 7ff131000700 1 -- 172.21.15.142:0/2922559625 >> 172.21.15.142:0/2922559625 conn(0x7ff12c076400 msgr2=0x7ff12c10ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:54.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.300+0000 7ff131000700 1 -- 172.21.15.142:0/2922559625 shutdown_connections 2024-04-20T21:56:54.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.300+0000 7ff131000700 1 -- 172.21.15.142:0/2922559625 wait complete. 2024-04-20T21:56:54.422 INFO:tasks.workunit.client.0.smithi142.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-20T21:56:54.430 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-20T21:56:54.430 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-20T21:56:54.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.446+0000 7f1fb0000700 1 -- 172.21.15.142:0/2197567234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fa8074f10 msgr2=0x7f1fa8073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:54.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.446+0000 7f1fb0000700 1 --2- 172.21.15.142:0/2197567234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fa8074f10 0x7f1fa8073370 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c009910 tx=0x7f1f9c009c20 comp rx=0 tx=0).stop 2024-04-20T21:56:54.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.446+0000 7f1fb0000700 1 -- 172.21.15.142:0/2197567234 shutdown_connections 2024-04-20T21:56:54.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.446+0000 7f1fb0000700 1 --2- 172.21.15.142:0/2197567234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1fa8073940 0x7f1fa8073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:54.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.446+0000 7f1fb0000700 1 --2- 172.21.15.142:0/2197567234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fa8074f10 0x7f1fa8073370 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:54.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.446+0000 7f1fb0000700 1 -- 172.21.15.142:0/2197567234 >> 172.21.15.142:0/2197567234 conn(0x7f1fa80fc1c0 msgr2=0x7f1fa80fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:54.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.446+0000 7f1fb0000700 1 -- 172.21.15.142:0/2197567234 shutdown_connections 2024-04-20T21:56:54.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.446+0000 7f1fb0000700 1 -- 172.21.15.142:0/2197567234 wait complete. 2024-04-20T21:56:54.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.447+0000 7f1fb0000700 1 Processor -- start 2024-04-20T21:56:54.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.448+0000 7f1fb0000700 1 -- start start 2024-04-20T21:56:54.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.448+0000 7f1fb0000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1fa8073940 0x7f1fa8198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:54.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.448+0000 7f1fb0000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fa8074f10 0x7f1fa8198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:54.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.448+0000 7f1fb0000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa81993d0 con 0x7f1fa8074f10 2024-04-20T21:56:54.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.448+0000 7f1fb0000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8199510 con 0x7f1fa8073940 2024-04-20T21:56:54.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.448+0000 7f1facc00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fa8074f10 0x7f1fa8198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:54.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.448+0000 7f1facc00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fa8074f10 0x7f1fa8198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39294/0 (socket says 172.21.15.142:39294) 2024-04-20T21:56:54.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.448+0000 7f1facc00700 1 -- 172.21.15.142:0/332029072 learned_addr learned my addr 172.21.15.142:0/332029072 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:56:54.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.448+0000 7f1fad600700 1 --2- 172.21.15.142:0/332029072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1fa8073940 0x7f1fa8198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:54.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.449+0000 7f1facc00700 1 -- 172.21.15.142:0/332029072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1fa8073940 msgr2=0x7f1fa8198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:54.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.449+0000 7f1facc00700 1 --2- 172.21.15.142:0/332029072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1fa8073940 0x7f1fa8198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:54.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.449+0000 7f1facc00700 1 -- 172.21.15.142:0/332029072 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9c0095f0 con 0x7f1fa8074f10 2024-04-20T21:56:54.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.449+0000 7f1facc00700 1 --2- 172.21.15.142:0/332029072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fa8074f10 0x7f1fa8198db0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400d900 tx=0x7f1f9400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:54.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.449+0000 7f1fa6000700 1 -- 172.21.15.142:0/332029072 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f940041f0 con 0x7f1fa8074f10 2024-04-20T21:56:54.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.449+0000 7f1fa6000700 1 -- 172.21.15.142:0/332029072 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f94004350 con 0x7f1fa8074f10 2024-04-20T21:56:54.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.449+0000 7f1fb0000700 1 -- 172.21.15.142:0/332029072 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa819df20 con 0x7f1fa8074f10 2024-04-20T21:56:54.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.449+0000 7f1fa6000700 1 -- 172.21.15.142:0/332029072 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f94003cf0 con 0x7f1fa8074f10 2024-04-20T21:56:54.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.449+0000 7f1fb0000700 1 -- 172.21.15.142:0/332029072 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa819e4c0 con 0x7f1fa8074f10 2024-04-20T21:56:54.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.450+0000 7f1fb0000700 1 -- 172.21.15.142:0/332029072 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa8192990 con 0x7f1fa8074f10 2024-04-20T21:56:54.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.451+0000 7f1fa6000700 1 -- 172.21.15.142:0/332029072 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f1f94009730 con 0x7f1fa8074f10 2024-04-20T21:56:54.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.452+0000 7f1fa6000700 1 --2- 172.21.15.142:0/332029072 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1f9006cce0 0x7f1f9006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:54.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.452+0000 7f1fa6000700 1 -- 172.21.15.142:0/332029072 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f1f9408c1a0 con 0x7f1fa8074f10 2024-04-20T21:56:54.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.453+0000 7f1fad600700 1 --2- 172.21.15.142:0/332029072 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1f9006cce0 0x7f1f9006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:54.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.453+0000 7f1fad600700 1 --2- 172.21.15.142:0/332029072 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1f9006cce0 0x7f1f9006f1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c005090 tx=0x7f1f9c00b540 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:54.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.457+0000 7f1fa6000700 1 -- 172.21.15.142:0/332029072 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f1f94059f60 con 0x7f1fa8074f10 2024-04-20T21:56:54.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.771+0000 7f1fb0000700 1 -- 172.21.15.142:0/332029072 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1fa802cde0 con 0x7f1fa8074f10 2024-04-20T21:56:54.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.773+0000 7f1fa6000700 1 -- 172.21.15.142:0/332029072 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f1f94059af0 con 0x7f1fa8074f10 2024-04-20T21:56:54.772 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T21:56:54.773 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T21:56:54.773 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 2 2024-04-20T21:56:54.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:56:54.773 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T21:56:54.773 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 2 2024-04-20T21:56:54.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:56:54.773 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T21:56:54.773 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 6 2024-04-20T21:56:54.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:56:54.773 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T21:56:54.773 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4 2024-04-20T21:56:54.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:56:54.773 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T21:56:54.773 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 14 2024-04-20T21:56:54.774 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T21:56:54.774 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T21:56:54.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.776+0000 7f1fb0000700 1 -- 172.21.15.142:0/332029072 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1f9006cce0 msgr2=0x7f1f9006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:54.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.776+0000 7f1fb0000700 1 --2- 172.21.15.142:0/332029072 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1f9006cce0 0x7f1f9006f1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c005090 tx=0x7f1f9c00b540 comp rx=0 tx=0).stop 2024-04-20T21:56:54.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.776+0000 7f1fb0000700 1 -- 172.21.15.142:0/332029072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fa8074f10 msgr2=0x7f1fa8198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:54.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.776+0000 7f1fb0000700 1 --2- 172.21.15.142:0/332029072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fa8074f10 0x7f1fa8198db0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400d900 tx=0x7f1f9400dc10 comp rx=0 tx=0).stop 2024-04-20T21:56:54.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.776+0000 7f1fb0000700 1 -- 172.21.15.142:0/332029072 shutdown_connections 2024-04-20T21:56:54.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.776+0000 7f1fb0000700 1 --2- 172.21.15.142:0/332029072 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f1f9006cce0 0x7f1f9006f1a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:54.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.776+0000 7f1fb0000700 1 --2- 172.21.15.142:0/332029072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1fa8073940 0x7f1fa8198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:54.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.776+0000 7f1fb0000700 1 --2- 172.21.15.142:0/332029072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fa8074f10 0x7f1fa8198db0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:54.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.776+0000 7f1fb0000700 1 -- 172.21.15.142:0/332029072 >> 172.21.15.142:0/332029072 conn(0x7f1fa80fc1c0 msgr2=0x7f1fa8106e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:54.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.776+0000 7f1fb0000700 1 -- 172.21.15.142:0/332029072 shutdown_connections 2024-04-20T21:56:54.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.776+0000 7f1fb0000700 1 -- 172.21.15.142:0/332029072 wait complete. 2024-04-20T21:56:54.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.934+0000 7fd580200700 1 -- 172.21.15.142:0/528351760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd578101e20 msgr2=0x7fd578102280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:54.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.934+0000 7fd580200700 1 --2- 172.21.15.142:0/528351760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd578101e20 0x7fd578102280 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd564009910 tx=0x7fd564009c20 comp rx=0 tx=0).stop 2024-04-20T21:56:54.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.934+0000 7fd580200700 1 -- 172.21.15.142:0/528351760 shutdown_connections 2024-04-20T21:56:54.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.934+0000 7fd580200700 1 --2- 172.21.15.142:0/528351760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd578101e20 0x7fd578102280 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:54.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.934+0000 7fd580200700 1 --2- 172.21.15.142:0/528351760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd578100c20 0x7fd578101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:54.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.934+0000 7fd580200700 1 -- 172.21.15.142:0/528351760 >> 172.21.15.142:0/528351760 conn(0x7fd5780fc1e0 msgr2=0x7fd5780fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:54.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.934+0000 7fd580200700 1 -- 172.21.15.142:0/528351760 shutdown_connections 2024-04-20T21:56:54.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.934+0000 7fd580200700 1 -- 172.21.15.142:0/528351760 wait complete. 2024-04-20T21:56:54.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.935+0000 7fd580200700 1 Processor -- start 2024-04-20T21:56:54.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.936+0000 7fd580200700 1 -- start start 2024-04-20T21:56:54.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.936+0000 7fd580200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd578100c20 0x7fd5781928d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:54.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.936+0000 7fd580200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd578101e20 0x7fd578192e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:54.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.936+0000 7fd580200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57818f460 con 0x7fd578100c20 2024-04-20T21:56:54.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.936+0000 7fd580200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57818f5a0 con 0x7fd578101e20 2024-04-20T21:56:54.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.936+0000 7fd57d800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd578100c20 0x7fd5781928d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:54.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.936+0000 7fd57d800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd578100c20 0x7fd5781928d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39302/0 (socket says 172.21.15.142:39302) 2024-04-20T21:56:54.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.936+0000 7fd57d800700 1 -- 172.21.15.142:0/2820678837 learned_addr learned my addr 172.21.15.142:0/2820678837 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:56:54.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.936+0000 7fd57ce00700 1 --2- 172.21.15.142:0/2820678837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd578101e20 0x7fd578192e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:54.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.937+0000 7fd57d800700 1 -- 172.21.15.142:0/2820678837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd578101e20 msgr2=0x7fd578192e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:54.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.937+0000 7fd57d800700 1 --2- 172.21.15.142:0/2820678837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd578101e20 0x7fd578192e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:54.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.937+0000 7fd57d800700 1 -- 172.21.15.142:0/2820678837 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5640095f0 con 0x7fd578100c20 2024-04-20T21:56:54.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.937+0000 7fd57d800700 1 --2- 172.21.15.142:0/2820678837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd578100c20 0x7fd5781928d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd56c00d900 tx=0x7fd56c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:54.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.937+0000 7fd576000700 1 -- 172.21.15.142:0/2820678837 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd56c0041f0 con 0x7fd578100c20 2024-04-20T21:56:54.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.937+0000 7fd576000700 1 -- 172.21.15.142:0/2820678837 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd56c004350 con 0x7fd578100c20 2024-04-20T21:56:54.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.937+0000 7fd580200700 1 -- 172.21.15.142:0/2820678837 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd57818f880 con 0x7fd578100c20 2024-04-20T21:56:54.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.937+0000 7fd576000700 1 -- 172.21.15.142:0/2820678837 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd56c003cf0 con 0x7fd578100c20 2024-04-20T21:56:54.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.937+0000 7fd580200700 1 -- 172.21.15.142:0/2820678837 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57818fe50 con 0x7fd578100c20 2024-04-20T21:56:54.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.938+0000 7fd580200700 1 -- 172.21.15.142:0/2820678837 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5781067f0 con 0x7fd578100c20 2024-04-20T21:56:54.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.939+0000 7fd576000700 1 -- 172.21.15.142:0/2820678837 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7fd56c009730 con 0x7fd578100c20 2024-04-20T21:56:54.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.940+0000 7fd576000700 1 --2- 172.21.15.142:0/2820678837 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd56006cce0 0x7fd56006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:54.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.940+0000 7fd576000700 1 -- 172.21.15.142:0/2820678837 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fd56c08c010 con 0x7fd578100c20 2024-04-20T21:56:54.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.940+0000 7fd57ce00700 1 --2- 172.21.15.142:0/2820678837 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd56006cce0 0x7fd56006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:54.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.941+0000 7fd57ce00700 1 --2- 172.21.15.142:0/2820678837 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd56006cce0 0x7fd56006f1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd564006010 tx=0x7fd564005180 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:54.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:54.945+0000 7fd576000700 1 -- 172.21.15.142:0/2820678837 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7fd56c059ef0 con 0x7fd578100c20 2024-04-20T21:56:55.203 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-20T21:56:55.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.207+0000 7fd580200700 1 -- 172.21.15.142:0/2820678837 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd5781061d0 con 0x7fd578100c20 2024-04-20T21:56:55.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.208+0000 7fd576000700 1 -- 172.21.15.142:0/2820678837 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1853 (secure 0 0 0) 0x7fd56c059a80 con 0x7fd578100c20 2024-04-20T21:56:55.207 INFO:teuthology.orchestra.run.smithi142.stdout:e12 2024-04-20T21:56:55.207 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T21:56:55.207 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:56:55.207 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T21:56:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:56:55.208 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T21:56:55.208 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T21:56:55.208 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 12 2024-04-20T21:56:55.208 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T21:56:55.208 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T21:56:55.208 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:51.692699+0000 2024-04-20T21:56:55.208 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T21:56:55.208 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T21:56:55.208 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T21:56:55.208 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T21:56:55.208 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T21:56:55.208 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T21:56:55.208 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T21:56:55.208 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T21:56:55.209 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T21:56:55.209 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:56:55.209 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T21:56:55.209 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T21:56:55.209 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T21:56:55.209 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T21:56:55.209 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T21:56:55.209 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T21:56:55.209 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T21:56:55.209 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T21:56:55.209 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T21:56:55.209 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T21:56:55.209 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T21:56:55.209 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T21:56:55.210 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:56:55.210 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:56:55.210 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:56:55.210 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T21:56:55.210 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:56:55.210 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:56:55.210 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:56:55.210 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:56:55.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.210+0000 7fd580200700 1 -- 172.21.15.142:0/2820678837 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd56006cce0 msgr2=0x7fd56006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:55.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.210+0000 7fd580200700 1 --2- 172.21.15.142:0/2820678837 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd56006cce0 0x7fd56006f1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd564006010 tx=0x7fd564005180 comp rx=0 tx=0).stop 2024-04-20T21:56:55.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.210+0000 7fd580200700 1 -- 172.21.15.142:0/2820678837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd578100c20 msgr2=0x7fd5781928d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:55.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.210+0000 7fd580200700 1 --2- 172.21.15.142:0/2820678837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd578100c20 0x7fd5781928d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd56c00d900 tx=0x7fd56c00dc10 comp rx=0 tx=0).stop 2024-04-20T21:56:55.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.210+0000 7fd580200700 1 -- 172.21.15.142:0/2820678837 shutdown_connections 2024-04-20T21:56:55.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.211+0000 7fd580200700 1 --2- 172.21.15.142:0/2820678837 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7fd56006cce0 0x7fd56006f1a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:55.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.211+0000 7fd580200700 1 --2- 172.21.15.142:0/2820678837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd578100c20 0x7fd5781928d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:55.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.211+0000 7fd580200700 1 --2- 172.21.15.142:0/2820678837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd578101e20 0x7fd578192e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:55.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.211+0000 7fd580200700 1 -- 172.21.15.142:0/2820678837 >> 172.21.15.142:0/2820678837 conn(0x7fd5780fc1e0 msgr2=0x7fd578073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:55.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.211+0000 7fd580200700 1 -- 172.21.15.142:0/2820678837 shutdown_connections 2024-04-20T21:56:55.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.211+0000 7fd580200700 1 -- 172.21.15.142:0/2820678837 wait complete. 2024-04-20T21:56:55.212 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T21:56:55.301 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-20T21:56:55.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.360+0000 7f2812600700 1 -- 172.21.15.142:0/553474998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c074f10 msgr2=0x7f280c073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:55.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.360+0000 7f2812600700 1 --2- 172.21.15.142:0/553474998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c074f10 0x7f280c073370 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009910 tx=0x7f27fc009c20 comp rx=0 tx=0).stop 2024-04-20T21:56:55.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.360+0000 7f2812600700 1 -- 172.21.15.142:0/553474998 shutdown_connections 2024-04-20T21:56:55.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.360+0000 7f2812600700 1 --2- 172.21.15.142:0/553474998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f280c073940 0x7f280c073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:55.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.360+0000 7f2812600700 1 --2- 172.21.15.142:0/553474998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c074f10 0x7f280c073370 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:55.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.360+0000 7f2812600700 1 -- 172.21.15.142:0/553474998 >> 172.21.15.142:0/553474998 conn(0x7f280c0fc1c0 msgr2=0x7f280c0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:55.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.360+0000 7f2812600700 1 -- 172.21.15.142:0/553474998 shutdown_connections 2024-04-20T21:56:55.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.360+0000 7f2812600700 1 -- 172.21.15.142:0/553474998 wait complete. 2024-04-20T21:56:55.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.362+0000 7f2812600700 1 Processor -- start 2024-04-20T21:56:55.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.362+0000 7f2812600700 1 -- start start 2024-04-20T21:56:55.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.362+0000 7f2812600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c073940 0x7f280c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:55.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.363+0000 7f2812600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f280c074f10 0x7f280c198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:55.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.363+0000 7f2812600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c199480 con 0x7f280c073940 2024-04-20T21:56:55.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.363+0000 7f2812600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c1995c0 con 0x7f280c074f10 2024-04-20T21:56:55.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.363+0000 7f280b400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c073940 0x7f280c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:55.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.363+0000 7f280b400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c073940 0x7f280c198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39322/0 (socket says 172.21.15.142:39322) 2024-04-20T21:56:55.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.363+0000 7f280b400700 1 -- 172.21.15.142:0/3558495168 learned_addr learned my addr 172.21.15.142:0/3558495168 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:56:55.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.363+0000 7f280b400700 1 -- 172.21.15.142:0/3558495168 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f280c074f10 msgr2=0x7f280c198e60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-20T21:56:55.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.363+0000 7f280b400700 1 --2- 172.21.15.142:0/3558495168 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f280c074f10 0x7f280c198e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:55.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.363+0000 7f280b400700 1 -- 172.21.15.142:0/3558495168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc0095f0 con 0x7f280c073940 2024-04-20T21:56:55.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.364+0000 7f280b400700 1 --2- 172.21.15.142:0/3558495168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c073940 0x7f280c198920 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f27fc005950 tx=0x7f27fc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:55.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.364+0000 7f2808c00700 1 -- 172.21.15.142:0/3558495168 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27fc01d070 con 0x7f280c073940 2024-04-20T21:56:55.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.364+0000 7f2808c00700 1 -- 172.21.15.142:0/3558495168 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f27fc022470 con 0x7f280c073940 2024-04-20T21:56:55.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.364+0000 7f2812600700 1 -- 172.21.15.142:0/3558495168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280c19dfc0 con 0x7f280c073940 2024-04-20T21:56:55.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.364+0000 7f2808c00700 1 -- 172.21.15.142:0/3558495168 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27fc00f650 con 0x7f280c073940 2024-04-20T21:56:55.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.364+0000 7f2812600700 1 -- 172.21.15.142:0/3558495168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280c19e4b0 con 0x7f280c073940 2024-04-20T21:56:55.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.365+0000 7f2812600700 1 -- 172.21.15.142:0/3558495168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280c192a30 con 0x7f280c073940 2024-04-20T21:56:55.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.366+0000 7f2808c00700 1 -- 172.21.15.142:0/3558495168 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f27fc0225e0 con 0x7f280c073940 2024-04-20T21:56:55.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.367+0000 7f2808c00700 1 --2- 172.21.15.142:0/3558495168 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f27f006cce0 0x7f27f006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:55.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.367+0000 7f2808c00700 1 -- 172.21.15.142:0/3558495168 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f27fc08dcc0 con 0x7f280c073940 2024-04-20T21:56:55.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.367+0000 7f2803e00700 1 --2- 172.21.15.142:0/3558495168 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f27f006cce0 0x7f27f006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:55.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.368+0000 7f2803e00700 1 --2- 172.21.15.142:0/3558495168 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f27f006cce0 0x7f27f006f1a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f280c074c40 tx=0x7f27f4006c60 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:55.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.372+0000 7f2808c00700 1 -- 172.21.15.142:0/3558495168 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f27fc093020 con 0x7f280c073940 2024-04-20T21:56:55.376 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-20T21:56:55.381 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-20T21:56:55.381 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-20T21:56:55.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:55 smithi164 ceph-mon[23506]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:56:55.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:55 smithi164 ceph-mon[23506]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:56:55.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:55 smithi164 ceph-mon[23506]: pgmap v297: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:55.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:55 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/332029072' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T21:56:55.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:55 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:56:55.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:55 smithi142 ceph-mon[15828]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:56:55.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:55 smithi142 ceph-mon[15828]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:56:55.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:55 smithi142 ceph-mon[15828]: pgmap v297: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:55.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:55 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/332029072' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T21:56:55.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:55 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:56:55.450 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-20T21:56:55.459 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-20T21:56:55.459 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-20T21:56:55.505 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-20T21:56:55.508 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-20T21:56:55.508 DEBUG:teuthology.orchestra.run.smithi142:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c84f5997950fd7d008204839253291d52e6eda TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-20T21:56:55.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.614+0000 7f2812600700 1 -- 172.21.15.142:0/3558495168 --> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f280c02ce30 con 0x7f27f006cce0 2024-04-20T21:56:55.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.616+0000 7f2808c00700 1 -- 172.21.15.142:0/3558495168 <== mgr.14215 v2:172.21.15.142:6800/3610638500 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f280c02ce30 con 0x7f27f006cce0 2024-04-20T21:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T21:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T21:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T21:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T21:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [], 2024-04-20T21:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "0/23 daemons upgraded", 2024-04-20T21:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 image on host smithi164", 2024-04-20T21:56:55.615 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T21:56:55.616 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T21:56:55.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.618+0000 7f2812600700 1 -- 172.21.15.142:0/3558495168 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f27f006cce0 msgr2=0x7f27f006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:55.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.618+0000 7f2812600700 1 --2- 172.21.15.142:0/3558495168 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f27f006cce0 0x7f27f006f1a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f280c074c40 tx=0x7f27f4006c60 comp rx=0 tx=0).stop 2024-04-20T21:56:55.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.618+0000 7f2812600700 1 -- 172.21.15.142:0/3558495168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c073940 msgr2=0x7f280c198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:55.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.618+0000 7f2812600700 1 --2- 172.21.15.142:0/3558495168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c073940 0x7f280c198920 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f27fc005950 tx=0x7f27fc00be20 comp rx=0 tx=0).stop 2024-04-20T21:56:55.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.619+0000 7f2812600700 1 -- 172.21.15.142:0/3558495168 shutdown_connections 2024-04-20T21:56:55.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.619+0000 7f2812600700 1 --2- 172.21.15.142:0/3558495168 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f27f006cce0 0x7f27f006f1a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:55.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.619+0000 7f2812600700 1 --2- 172.21.15.142:0/3558495168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c073940 0x7f280c198920 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:55.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.619+0000 7f2812600700 1 --2- 172.21.15.142:0/3558495168 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f280c074f10 0x7f280c198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:55.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.619+0000 7f2812600700 1 -- 172.21.15.142:0/3558495168 >> 172.21.15.142:0/3558495168 conn(0x7f280c0fc1c0 msgr2=0x7f280c106ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:55.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.619+0000 7f2812600700 1 -- 172.21.15.142:0/3558495168 shutdown_connections 2024-04-20T21:56:55.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.619+0000 7f2812600700 1 -- 172.21.15.142:0/3558495168 wait complete. 2024-04-20T21:56:55.627 INFO:tasks.workunit.client.0.smithi142.stderr:+ mkdir -p fsstress 2024-04-20T21:56:55.635 INFO:tasks.workunit.client.0.smithi142.stderr:+ pushd fsstress 2024-04-20T21:56:55.639 INFO:tasks.workunit.client.0.smithi142.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-20T21:56:55.639 INFO:tasks.workunit.client.0.smithi142.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-20T21:56:55.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.764+0000 7f0953200700 1 -- 172.21.15.142:0/3215124760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f094c108430 msgr2=0x7f094c1088b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:55.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.764+0000 7f0953200700 1 --2- 172.21.15.142:0/3215124760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f094c108430 0x7f094c1088b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0938009910 tx=0x7f0938009c20 comp rx=0 tx=0).stop 2024-04-20T21:56:55.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.764+0000 7f0953200700 1 -- 172.21.15.142:0/3215124760 shutdown_connections 2024-04-20T21:56:55.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.764+0000 7f0953200700 1 --2- 172.21.15.142:0/3215124760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f094c108430 0x7f094c1088b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:55.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.764+0000 7f0953200700 1 --2- 172.21.15.142:0/3215124760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f094c107260 0x7f094c107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:55.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.764+0000 7f0953200700 1 -- 172.21.15.142:0/3215124760 >> 172.21.15.142:0/3215124760 conn(0x7f094c076400 msgr2=0x7f094c078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:55.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.765+0000 7f0953200700 1 -- 172.21.15.142:0/3215124760 shutdown_connections 2024-04-20T21:56:55.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.765+0000 7f0953200700 1 -- 172.21.15.142:0/3215124760 wait complete. 2024-04-20T21:56:55.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.766+0000 7f0953200700 1 Processor -- start 2024-04-20T21:56:55.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.766+0000 7f0953200700 1 -- start start 2024-04-20T21:56:55.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.766+0000 7f0953200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f094c107260 0x7f094c19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:55.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.766+0000 7f0953200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f094c108430 0x7f094c19d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:55.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.766+0000 7f0953200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c19d730 con 0x7f094c107260 2024-04-20T21:56:55.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.766+0000 7f0953200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c19d870 con 0x7f094c108430 2024-04-20T21:56:55.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.766+0000 7f094be00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f094c107260 0x7f094c19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:55.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.766+0000 7f094be00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f094c107260 0x7f094c19cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39334/0 (socket says 172.21.15.142:39334) 2024-04-20T21:56:55.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.766+0000 7f094be00700 1 -- 172.21.15.142:0/3957702943 learned_addr learned my addr 172.21.15.142:0/3957702943 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:56:55.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.767+0000 7f094b400700 1 --2- 172.21.15.142:0/3957702943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f094c108430 0x7f094c19d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:55.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.767+0000 7f094be00700 1 -- 172.21.15.142:0/3957702943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f094c108430 msgr2=0x7f094c19d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:55.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.767+0000 7f094be00700 1 --2- 172.21.15.142:0/3957702943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f094c108430 0x7f094c19d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:55.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.767+0000 7f094be00700 1 -- 172.21.15.142:0/3957702943 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09380095f0 con 0x7f094c107260 2024-04-20T21:56:55.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.767+0000 7f094b400700 1 --2- 172.21.15.142:0/3957702943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f094c108430 0x7f094c19d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:56:55.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.767+0000 7f094be00700 1 --2- 172.21.15.142:0/3957702943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f094c107260 0x7f094c19cbd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f093c00e920 tx=0x7f093c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:55.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.767+0000 7f0948c00700 1 -- 172.21.15.142:0/3957702943 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f093c009790 con 0x7f094c107260 2024-04-20T21:56:55.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.767+0000 7f0948c00700 1 -- 172.21.15.142:0/3957702943 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f093c00cba0 con 0x7f094c107260 2024-04-20T21:56:55.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.767+0000 7f0948c00700 1 -- 172.21.15.142:0/3957702943 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f093c018650 con 0x7f094c107260 2024-04-20T21:56:55.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.767+0000 7f0953200700 1 -- 172.21.15.142:0/3957702943 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094c1a22d0 con 0x7f094c107260 2024-04-20T21:56:55.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.768+0000 7f0953200700 1 -- 172.21.15.142:0/3957702943 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094c1a28a0 con 0x7f094c107260 2024-04-20T21:56:55.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.768+0000 7f0953200700 1 -- 172.21.15.142:0/3957702943 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094c196dd0 con 0x7f094c107260 2024-04-20T21:56:55.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.769+0000 7f0948c00700 1 -- 172.21.15.142:0/3957702943 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) v1 ==== 90852+0+0 (secure 0 0 0) 0x7f093c00cd10 con 0x7f094c107260 2024-04-20T21:56:55.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.770+0000 7f0948c00700 1 --2- 172.21.15.142:0/3957702943 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f093006ccf0 0x7f093006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:56:55.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.770+0000 7f0948c00700 1 -- 172.21.15.142:0/3957702943 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f093c014070 con 0x7f094c107260 2024-04-20T21:56:55.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.771+0000 7f094b400700 1 --2- 172.21.15.142:0/3957702943 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f093006ccf0 0x7f093006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:56:55.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.771+0000 7f094b400700 1 --2- 172.21.15.142:0/3957702943 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f093006ccf0 0x7f093006f1b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0938006010 tx=0x7f0938009f70 comp rx=0 tx=0).ready entity=mgr.14215 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:56:55.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:55.774+0000 7f0948c00700 1 -- 172.21.15.142:0/3957702943 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183351 (secure 0 0 0) 0x7f093c052c50 con 0x7f094c107260 2024-04-20T21:56:56.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:56.096+0000 7f0953200700 1 -- 172.21.15.142:0/3957702943 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f094c04ebb0 con 0x7f094c107260 2024-04-20T21:56:56.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:56.097+0000 7f0948c00700 1 -- 172.21.15.142:0/3957702943 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f093c05a230 con 0x7f094c107260 2024-04-20T21:56:56.096 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_OK 2024-04-20T21:56:56.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:56.100+0000 7f0953200700 1 -- 172.21.15.142:0/3957702943 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f093006ccf0 msgr2=0x7f093006f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:56.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:56.100+0000 7f0953200700 1 --2- 172.21.15.142:0/3957702943 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f093006ccf0 0x7f093006f1b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0938006010 tx=0x7f0938009f70 comp rx=0 tx=0).stop 2024-04-20T21:56:56.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:56.100+0000 7f0953200700 1 -- 172.21.15.142:0/3957702943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f094c107260 msgr2=0x7f094c19cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:56:56.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:56.100+0000 7f0953200700 1 --2- 172.21.15.142:0/3957702943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f094c107260 0x7f094c19cbd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f093c00e920 tx=0x7f093c00ece0 comp rx=0 tx=0).stop 2024-04-20T21:56:56.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:56.100+0000 7f0953200700 1 -- 172.21.15.142:0/3957702943 shutdown_connections 2024-04-20T21:56:56.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:56.100+0000 7f0953200700 1 --2- 172.21.15.142:0/3957702943 >> [v2:172.21.15.142:6800/3610638500,v1:172.21.15.142:6801/3610638500] conn(0x7f093006ccf0 0x7f093006f1b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:56.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:56.100+0000 7f0953200700 1 --2- 172.21.15.142:0/3957702943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f094c107260 0x7f094c19cbd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:56.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:56.100+0000 7f0953200700 1 --2- 172.21.15.142:0/3957702943 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f094c108430 0x7f094c19d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:56:56.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:56.100+0000 7f0953200700 1 -- 172.21.15.142:0/3957702943 >> 172.21.15.142:0/3957702943 conn(0x7f094c076400 msgr2=0x7f094c10b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:56:56.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:56.100+0000 7f0953200700 1 -- 172.21.15.142:0/3957702943 shutdown_connections 2024-04-20T21:56:56.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:56:56.100+0000 7f0953200700 1 -- 172.21.15.142:0/3957702943 wait complete. 2024-04-20T21:56:56.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:56 smithi164 ceph-mon[23506]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:56:56.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:56 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/2820678837' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:56:56.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:56 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:56:56.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:56 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi164.oejajr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T21:56:56.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:56 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T21:56:56.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:56 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:56:56.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:56 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/3957702943' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T21:56:56.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:56 smithi142 ceph-mon[15828]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:56:56.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:56 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2820678837' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:56:56.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:56 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:56:56.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:56 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi164.oejajr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T21:56:56.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:56 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T21:56:56.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:56 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:56:56.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:56 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/3957702943' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T21:56:57.344 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:57 smithi164 ceph-mon[23506]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:56:57.344 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:57 smithi164 ceph-mon[23506]: Upgrade: Updating mgr.smithi164.oejajr 2024-04-20T21:56:57.344 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:57 smithi164 ceph-mon[23506]: Deploying daemon mgr.smithi164.oejajr on smithi164 2024-04-20T21:56:57.344 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:57 smithi164 ceph-mon[23506]: pgmap v298: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:57.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:57 smithi142 ceph-mon[15828]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:56:57.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:57 smithi142 ceph-mon[15828]: Upgrade: Updating mgr.smithi164.oejajr 2024-04-20T21:56:57.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:57 smithi142 ceph-mon[15828]: Deploying daemon mgr.smithi164.oejajr on smithi164 2024-04-20T21:56:57.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:57 smithi142 ceph-mon[15828]: pgmap v298: 65 pgs: 65 active+clean; 588 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:56:57.776 INFO:tasks.workunit.client.0.smithi142.stderr:+ tar xzf ltp-full.tgz 2024-04-20T21:56:59.442 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:56:59 smithi164 ceph-mon[23506]: pgmap v299: 65 pgs: 65 active+clean; 601 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-04-20T21:56:59.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:56:59 smithi142 ceph-mon[15828]: pgmap v299: 65 pgs: 65 active+clean; 601 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-04-20T21:57:01.350 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:01 smithi164 ceph-mon[23506]: pgmap v300: 65 pgs: 65 active+clean; 4.6 MiB data, 191 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s wr, 0 op/s 2024-04-20T21:57:01.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:01 smithi142 ceph-mon[15828]: pgmap v300: 65 pgs: 65 active+clean; 4.6 MiB data, 191 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s wr, 0 op/s 2024-04-20T21:57:02.124 INFO:tasks.workunit.client.1.smithi164.stderr:Updating files: 52% (6480/12271) Updating files: 53% (6504/12271) Updating files: 54% (6627/12271) Updating files: 55% (6750/12271) Updating files: 56% (6872/12271) Updating files: 57% (6995/12271) Updating files: 58% (7118/12271) Updating files: 59% (7240/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 86% (10598/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-20T21:57:02.811 INFO:tasks.workunit.client.1.smithi164.stderr:Note: switching to 'a8c84f5997950fd7d008204839253291d52e6eda'. 2024-04-20T21:57:02.812 INFO:tasks.workunit.client.1.smithi164.stderr: 2024-04-20T21:57:02.812 INFO:tasks.workunit.client.1.smithi164.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-20T21:57:02.812 INFO:tasks.workunit.client.1.smithi164.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-20T21:57:02.812 INFO:tasks.workunit.client.1.smithi164.stderr:state without impacting any branches by switching back to a branch. 2024-04-20T21:57:02.812 INFO:tasks.workunit.client.1.smithi164.stderr: 2024-04-20T21:57:02.812 INFO:tasks.workunit.client.1.smithi164.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-20T21:57:02.812 INFO:tasks.workunit.client.1.smithi164.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-20T21:57:02.812 INFO:tasks.workunit.client.1.smithi164.stderr: 2024-04-20T21:57:02.812 INFO:tasks.workunit.client.1.smithi164.stderr: git switch -c 2024-04-20T21:57:02.812 INFO:tasks.workunit.client.1.smithi164.stderr: 2024-04-20T21:57:02.812 INFO:tasks.workunit.client.1.smithi164.stderr:Or undo this operation with: 2024-04-20T21:57:02.812 INFO:tasks.workunit.client.1.smithi164.stderr: 2024-04-20T21:57:02.812 INFO:tasks.workunit.client.1.smithi164.stderr: git switch - 2024-04-20T21:57:02.812 INFO:tasks.workunit.client.1.smithi164.stderr: 2024-04-20T21:57:02.812 INFO:tasks.workunit.client.1.smithi164.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-20T21:57:02.813 INFO:tasks.workunit.client.1.smithi164.stderr: 2024-04-20T21:57:02.813 INFO:tasks.workunit.client.1.smithi164.stderr:HEAD is now at a8c84f59979 Merge PR #51659 into wip-rishabh-testing-20240416.193735 2024-04-20T21:57:02.829 DEBUG:teuthology.orchestra.run.smithi164:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-04-20T21:57:02.923 INFO:tasks.workunit.client.1.smithi164.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-20T21:57:02.931 INFO:tasks.workunit.client.1.smithi164.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-20T21:57:02.931 INFO:tasks.workunit.client.1.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-20T21:57:02.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:02 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:02.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:02 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:02.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:02 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:57:02.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:02 smithi164 ceph-mon[23506]: pgmap v301: 65 pgs: 65 active+clean; 9.3 MiB data, 212 MiB used, 536 GiB / 536 GiB avail; 752 KiB/s wr, 12 op/s 2024-04-20T21:57:02.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:02 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:02.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:02 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:02.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:02 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:02.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:02 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:02.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:02 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:57:02.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:02 smithi142 ceph-mon[15828]: pgmap v301: 65 pgs: 65 active+clean; 9.3 MiB data, 212 MiB used, 536 GiB / 536 GiB avail; 752 KiB/s wr, 12 op/s 2024-04-20T21:57:02.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:02 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:02.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:02 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:05.027 INFO:tasks.workunit.client.1.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-20T21:57:05.155 INFO:tasks.workunit.client.1.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-20T21:57:05.238 INFO:tasks.workunit.client.1.smithi164.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-20T21:57:05.242 INFO:tasks.workunit.client.1.smithi164.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-20T21:57:05.242 INFO:tasks.workunit.client.1.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-20T21:57:05.326 INFO:tasks.workunit.client.1.smithi164.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-20T21:57:05.335 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-20T21:57:05.335 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-04-20T21:57:05.373 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-04-20T21:57:05.375 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-20T21:57:05.375 DEBUG:teuthology.orchestra.run.smithi164:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c84f5997950fd7d008204839253291d52e6eda TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-04-20T21:57:05.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:05 smithi142 ceph-mon[15828]: pgmap v302: 65 pgs: 65 active+clean; 13 MiB data, 234 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s wr, 35 op/s 2024-04-20T21:57:05.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:05 smithi164 ceph-mon[23506]: pgmap v302: 65 pgs: 65 active+clean; 13 MiB data, 234 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s wr, 35 op/s 2024-04-20T21:57:05.482 INFO:tasks.workunit.client.1.smithi164.stderr:+ mkdir -p fsstress 2024-04-20T21:57:05.487 INFO:tasks.workunit.client.1.smithi164.stderr:+ pushd fsstress 2024-04-20T21:57:05.490 INFO:tasks.workunit.client.1.smithi164.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-20T21:57:05.490 INFO:tasks.workunit.client.1.smithi164.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-20T21:57:06.361 INFO:tasks.workunit.client.1.smithi164.stderr:+ tar xzf ltp-full.tgz 2024-04-20T21:57:07.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:07 smithi142 ceph-mon[15828]: pgmap v303: 65 pgs: 65 active+clean; 13 MiB data, 236 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s wr, 43 op/s 2024-04-20T21:57:07.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:07 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:07.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:07 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:07.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:07 smithi164 ceph-mon[23506]: pgmap v303: 65 pgs: 65 active+clean; 13 MiB data, 236 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s wr, 43 op/s 2024-04-20T21:57:07.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:07 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:07.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:07 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:09.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:09 smithi142 ceph-mon[15828]: pgmap v304: 65 pgs: 65 active+clean; 23 MiB data, 268 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s wr, 77 op/s 2024-04-20T21:57:09.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:09 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:09.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:09 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:09 smithi164 ceph-mon[23506]: pgmap v304: 65 pgs: 65 active+clean; 23 MiB data, 268 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s wr, 77 op/s 2024-04-20T21:57:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:09 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:09 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:11.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:11 smithi164 ceph-mon[23506]: pgmap v305: 65 pgs: 65 active+clean; 28 MiB data, 280 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 94 op/s 2024-04-20T21:57:11.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:11 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:57:11.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:11 smithi142 ceph-mon[15828]: pgmap v305: 65 pgs: 65 active+clean; 28 MiB data, 280 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 94 op/s 2024-04-20T21:57:11.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:11 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:57:13.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:13 smithi142 ceph-mon[15828]: pgmap v306: 65 pgs: 65 active+clean; 34 MiB data, 310 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s wr, 156 op/s 2024-04-20T21:57:13.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:13 smithi142 ceph-mon[15828]: Standby manager daemon smithi164.oejajr restarted 2024-04-20T21:57:13.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:13 smithi142 ceph-mon[15828]: Standby manager daemon smithi164.oejajr started 2024-04-20T21:57:13.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:13 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/crt"}]: dispatch 2024-04-20T21:57:13.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:13 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T21:57:13.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:13 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/key"}]: dispatch 2024-04-20T21:57:13.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:13 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T21:57:13.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:13 smithi164 ceph-mon[23506]: pgmap v306: 65 pgs: 65 active+clean; 34 MiB data, 310 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s wr, 156 op/s 2024-04-20T21:57:13.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:13 smithi164 ceph-mon[23506]: Standby manager daemon smithi164.oejajr restarted 2024-04-20T21:57:13.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:13 smithi164 ceph-mon[23506]: Standby manager daemon smithi164.oejajr started 2024-04-20T21:57:13.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:13 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/crt"}]: dispatch 2024-04-20T21:57:13.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:13 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T21:57:13.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:13 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/key"}]: dispatch 2024-04-20T21:57:13.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:13 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T21:57:14.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:14 smithi164 ceph-mon[23506]: mgrmap e20: smithi142.zzmcfz(active, since 9m), standbys: smithi164.oejajr 2024-04-20T21:57:14.449 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:14 smithi142 ceph-mon[15828]: mgrmap e20: smithi142.zzmcfz(active, since 9m), standbys: smithi164.oejajr 2024-04-20T21:57:15.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:15 smithi142 ceph-mon[15828]: pgmap v307: 65 pgs: 65 active+clean; 38 MiB data, 341 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s wr, 212 op/s 2024-04-20T21:57:15.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:15 smithi164 ceph-mon[23506]: pgmap v307: 65 pgs: 65 active+clean; 38 MiB data, 341 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s wr, 212 op/s 2024-04-20T21:57:17.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:17 smithi142 ceph-mon[15828]: pgmap v308: 65 pgs: 65 active+clean; 39 MiB data, 349 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 209 op/s 2024-04-20T21:57:17.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:17 smithi164 ceph-mon[23506]: pgmap v308: 65 pgs: 65 active+clean; 39 MiB data, 349 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 209 op/s 2024-04-20T21:57:19.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:19 smithi142 ceph-mon[15828]: pgmap v309: 65 pgs: 65 active+clean; 44 MiB data, 377 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s wr, 236 op/s 2024-04-20T21:57:19.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:19 smithi164 ceph-mon[23506]: pgmap v309: 65 pgs: 65 active+clean; 44 MiB data, 377 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s wr, 236 op/s 2024-04-20T21:57:21.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:21 smithi142 ceph-mon[15828]: pgmap v310: 65 pgs: 65 active+clean; 45 MiB data, 382 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s wr, 212 op/s 2024-04-20T21:57:21.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:21 smithi164 ceph-mon[23506]: pgmap v310: 65 pgs: 65 active+clean; 45 MiB data, 382 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s wr, 212 op/s 2024-04-20T21:57:22.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:22.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:22.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:57:22.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:57:22.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:22.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:57:22.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr fail", "who": "smithi142.zzmcfz"}]: dispatch 2024-04-20T21:57:22.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: Activating manager daemon smithi164.oejajr 2024-04-20T21:57:22.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: osdmap e48: 6 total, 6 up, 6 in 2024-04-20T21:57:22.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "mgr fail", "who": "smithi142.zzmcfz"}]': finished 2024-04-20T21:57:22.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: mgrmap e21: smithi164.oejajr(active, starting, since 0.0130983s) 2024-04-20T21:57:22.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T21:57:22.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:57:22.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lirkws"}]: dispatch 2024-04-20T21:57:22.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lrvfgg"}]: dispatch 2024-04-20T21:57:22.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.ybvzha"}]: dispatch 2024-04-20T21:57:22.932 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.gmmrfu"}]: dispatch 2024-04-20T21:57:22.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mgr metadata", "who": "smithi164.oejajr", "id": "smithi164.oejajr"}]: dispatch 2024-04-20T21:57:22.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T21:57:22.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T21:57:22.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T21:57:22.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:57:22.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T21:57:22.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T21:57:22.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-20T21:57:22.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-20T21:57:22.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-20T21:57:22.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: Manager daemon smithi164.oejajr is now available 2024-04-20T21:57:22.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:57:22.933 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:57:22.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi164.oejajr/mirror_snapshot_schedule"}]: dispatch 2024-04-20T21:57:22.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi164.oejajr/mirror_snapshot_schedule"}]: dispatch 2024-04-20T21:57:22.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi164.oejajr/trash_purge_schedule"}]: dispatch 2024-04-20T21:57:22.934 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:22 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi164.oejajr/trash_purge_schedule"}]: dispatch 2024-04-20T21:57:22.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:22.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:22.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:57:22.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:57:22.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:57:22.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:57:22.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr fail", "who": "smithi142.zzmcfz"}]: dispatch 2024-04-20T21:57:22.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: Activating manager daemon smithi164.oejajr 2024-04-20T21:57:22.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: osdmap e48: 6 total, 6 up, 6 in 2024-04-20T21:57:22.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.14215 172.21.15.142:0/1204033855' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "mgr fail", "who": "smithi142.zzmcfz"}]': finished 2024-04-20T21:57:22.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: mgrmap e21: smithi164.oejajr(active, starting, since 0.0130983s) 2024-04-20T21:57:22.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T21:57:22.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:57:22.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lirkws"}]: dispatch 2024-04-20T21:57:22.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lrvfgg"}]: dispatch 2024-04-20T21:57:22.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.ybvzha"}]: dispatch 2024-04-20T21:57:22.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.gmmrfu"}]: dispatch 2024-04-20T21:57:22.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mgr metadata", "who": "smithi164.oejajr", "id": "smithi164.oejajr"}]: dispatch 2024-04-20T21:57:22.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T21:57:22.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T21:57:22.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T21:57:22.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:57:22.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T21:57:22.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T21:57:22.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-20T21:57:22.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-20T21:57:22.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-20T21:57:22.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: Manager daemon smithi164.oejajr is now available 2024-04-20T21:57:22.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:57:22.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:57:22.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi164.oejajr/mirror_snapshot_schedule"}]: dispatch 2024-04-20T21:57:22.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi164.oejajr/mirror_snapshot_schedule"}]: dispatch 2024-04-20T21:57:22.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi164.oejajr/trash_purge_schedule"}]: dispatch 2024-04-20T21:57:22.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:22 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi164.oejajr/trash_purge_schedule"}]: dispatch 2024-04-20T21:57:24.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:23 smithi164 ceph-mon[23506]: [20/Apr/2024:21:57:22] ENGINE Bus STARTING 2024-04-20T21:57:24.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:23 smithi164 ceph-mon[23506]: [20/Apr/2024:21:57:22] ENGINE Serving on https://172.21.15.164:7150 2024-04-20T21:57:24.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:23 smithi164 ceph-mon[23506]: [20/Apr/2024:21:57:22] ENGINE Serving on http://172.21.15.164:8765 2024-04-20T21:57:24.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:23 smithi164 ceph-mon[23506]: [20/Apr/2024:21:57:22] ENGINE Bus STARTED 2024-04-20T21:57:24.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:23 smithi164 ceph-mon[23506]: Deploying cephadm binary to smithi164 2024-04-20T21:57:24.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:23 smithi164 ceph-mon[23506]: Deploying cephadm binary to smithi142 2024-04-20T21:57:24.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:23 smithi164 ceph-mon[23506]: mgrmap e22: smithi164.oejajr(active, since 1.01448s) 2024-04-20T21:57:24.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:23 smithi164 ceph-mon[23506]: pgmap v3: 65 pgs: 65 active+clean; 57 MiB data, 413 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:57:24.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:23 smithi142 ceph-mon[15828]: [20/Apr/2024:21:57:22] ENGINE Bus STARTING 2024-04-20T21:57:24.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:23 smithi142 ceph-mon[15828]: [20/Apr/2024:21:57:22] ENGINE Serving on https://172.21.15.164:7150 2024-04-20T21:57:24.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:23 smithi142 ceph-mon[15828]: [20/Apr/2024:21:57:22] ENGINE Serving on http://172.21.15.164:8765 2024-04-20T21:57:24.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:23 smithi142 ceph-mon[15828]: [20/Apr/2024:21:57:22] ENGINE Bus STARTED 2024-04-20T21:57:24.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:23 smithi142 ceph-mon[15828]: Deploying cephadm binary to smithi164 2024-04-20T21:57:24.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:23 smithi142 ceph-mon[15828]: Deploying cephadm binary to smithi142 2024-04-20T21:57:24.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:23 smithi142 ceph-mon[15828]: mgrmap e22: smithi164.oejajr(active, since 1.01448s) 2024-04-20T21:57:24.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:23 smithi142 ceph-mon[15828]: pgmap v3: 65 pgs: 65 active+clean; 57 MiB data, 413 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:57:25.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:24 smithi142 ceph-mon[15828]: pgmap v4: 65 pgs: 65 active+clean; 57 MiB data, 413 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:57:25.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:24 smithi164 ceph-mon[23506]: pgmap v4: 65 pgs: 65 active+clean; 57 MiB data, 413 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:57:26.170 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:25 smithi142 ceph-mon[15828]: mgrmap e23: smithi164.oejajr(active, since 3s) 2024-04-20T21:57:26.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:25 smithi164 ceph-mon[23506]: mgrmap e23: smithi164.oejajr(active, since 3s) 2024-04-20T21:57:26.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.305+0000 7f8aad400700 1 -- 172.21.15.142:0/3686870601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aa8102e20 msgr2=0x7f8aa8103240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:26.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.305+0000 7f8aad400700 1 --2- 172.21.15.142:0/3686870601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aa8102e20 0x7f8aa8103240 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009910 tx=0x7f8aa0009c20 comp rx=0 tx=0).stop 2024-04-20T21:57:26.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.306+0000 7f8aad400700 1 -- 172.21.15.142:0/3686870601 shutdown_connections 2024-04-20T21:57:26.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.306+0000 7f8aad400700 1 --2- 172.21.15.142:0/3686870601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8aa8103f80 0x7f8aa8104400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:26.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.306+0000 7f8aad400700 1 --2- 172.21.15.142:0/3686870601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aa8102e20 0x7f8aa8103240 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:26.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.306+0000 7f8aad400700 1 -- 172.21.15.142:0/3686870601 >> 172.21.15.142:0/3686870601 conn(0x7f8aa80fe3a0 msgr2=0x7f8aa8100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:57:26.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.306+0000 7f8aad400700 1 -- 172.21.15.142:0/3686870601 shutdown_connections 2024-04-20T21:57:26.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.306+0000 7f8aad400700 1 -- 172.21.15.142:0/3686870601 wait complete. 2024-04-20T21:57:26.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.308+0000 7f8aad400700 1 Processor -- start 2024-04-20T21:57:26.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.309+0000 7f8aad400700 1 -- start start 2024-04-20T21:57:26.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.309+0000 7f8aad400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8aa8102e20 0x7f8aa8194420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:26.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.309+0000 7f8aad400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aa8103f80 0x7f8aa8194960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:26.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.309+0000 7f8aad400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa8194f30 con 0x7f8aa8103f80 2024-04-20T21:57:26.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.309+0000 7f8aad400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa8195070 con 0x7f8aa8102e20 2024-04-20T21:57:26.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.310+0000 7f8aa6800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8aa8102e20 0x7f8aa8194420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:26.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.310+0000 7f8aa6800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8aa8102e20 0x7f8aa8194420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:37584/0 (socket says 172.21.15.142:37584) 2024-04-20T21:57:26.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.310+0000 7f8aa6800700 1 -- 172.21.15.142:0/103814195 learned_addr learned my addr 172.21.15.142:0/103814195 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:57:26.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.311+0000 7f8aa5e00700 1 --2- 172.21.15.142:0/103814195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aa8103f80 0x7f8aa8194960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:26.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.311+0000 7f8aa6800700 1 -- 172.21.15.142:0/103814195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aa8103f80 msgr2=0x7f8aa8194960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:26.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.311+0000 7f8aa6800700 1 --2- 172.21.15.142:0/103814195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aa8103f80 0x7f8aa8194960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:26.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.311+0000 7f8aa6800700 1 -- 172.21.15.142:0/103814195 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa00095f0 con 0x7f8aa8102e20 2024-04-20T21:57:26.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.312+0000 7f8aa6800700 1 --2- 172.21.15.142:0/103814195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8aa8102e20 0x7f8aa8194420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00098e0 tx=0x7f8aa000be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:57:26.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.313+0000 7f8a9f400700 1 -- 172.21.15.142:0/103814195 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8aa001d070 con 0x7f8aa8102e20 2024-04-20T21:57:26.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.313+0000 7f8aad400700 1 -- 172.21.15.142:0/103814195 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa81aaa90 con 0x7f8aa8102e20 2024-04-20T21:57:26.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.313+0000 7f8a9f400700 1 -- 172.21.15.142:0/103814195 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8aa000f460 con 0x7f8aa8102e20 2024-04-20T21:57:26.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.313+0000 7f8aad400700 1 -- 172.21.15.142:0/103814195 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa81aaf80 con 0x7f8aa8102e20 2024-04-20T21:57:26.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.313+0000 7f8a9f400700 1 -- 172.21.15.142:0/103814195 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8aa0021640 con 0x7f8aa8102e20 2024-04-20T21:57:26.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.315+0000 7f8aad400700 1 -- 172.21.15.142:0/103814195 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa8076ac0 con 0x7f8aa8102e20 2024-04-20T21:57:26.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.318+0000 7f8a9f400700 1 -- 172.21.15.142:0/103814195 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 23) v1 ==== 46707+0+0 (secure 0 0 0) 0x7f8aa000fad0 con 0x7f8aa8102e20 2024-04-20T21:57:26.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.318+0000 7f8a9f400700 1 --2- 172.21.15.142:0/103814195 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8a8c039910 0x7f8a8c03bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:26.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.318+0000 7f8a9f400700 1 -- 172.21.15.142:0/103814195 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f8aa004ee20 con 0x7f8aa8102e20 2024-04-20T21:57:26.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.319+0000 7f8aa5e00700 1 --2- 172.21.15.142:0/103814195 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8a8c039910 0x7f8a8c03bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:26.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.319+0000 7f8aa5e00700 1 --2- 172.21.15.142:0/103814195 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8a8c039910 0x7f8a8c03bdd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8a94005fd0 tx=0x7f8a94005f60 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:57:26.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.338+0000 7f8a9f400700 1 -- 172.21.15.142:0/103814195 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f8aa0029540 con 0x7f8aa8102e20 2024-04-20T21:57:26.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.721+0000 7f8aad400700 1 -- 172.21.15.142:0/103814195 --> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8aa802cde0 con 0x7f8a8c039910 2024-04-20T21:57:26.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.730+0000 7f8a9f400700 1 -- 172.21.15.142:0/103814195 <== mgr.24359 v2:172.21.15.164:6828/929524464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f8aa802cde0 con 0x7f8a8c039910 2024-04-20T21:57:26.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.734+0000 7f8aad400700 1 -- 172.21.15.142:0/103814195 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8a8c039910 msgr2=0x7f8a8c03bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:26.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.734+0000 7f8aad400700 1 --2- 172.21.15.142:0/103814195 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8a8c039910 0x7f8a8c03bdd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8a94005fd0 tx=0x7f8a94005f60 comp rx=0 tx=0).stop 2024-04-20T21:57:26.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.734+0000 7f8aad400700 1 -- 172.21.15.142:0/103814195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8aa8102e20 msgr2=0x7f8aa8194420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:26.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.734+0000 7f8aad400700 1 --2- 172.21.15.142:0/103814195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8aa8102e20 0x7f8aa8194420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00098e0 tx=0x7f8aa000be20 comp rx=0 tx=0).stop 2024-04-20T21:57:26.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.734+0000 7f8aad400700 1 -- 172.21.15.142:0/103814195 shutdown_connections 2024-04-20T21:57:26.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.734+0000 7f8aad400700 1 --2- 172.21.15.142:0/103814195 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8a8c039910 0x7f8a8c03bdd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:26.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.734+0000 7f8aad400700 1 --2- 172.21.15.142:0/103814195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8aa8102e20 0x7f8aa8194420 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:26.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.734+0000 7f8aad400700 1 --2- 172.21.15.142:0/103814195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8aa8103f80 0x7f8aa8194960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:26.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.734+0000 7f8aad400700 1 -- 172.21.15.142:0/103814195 >> 172.21.15.142:0/103814195 conn(0x7f8aa80fe3a0 msgr2=0x7f8aa8107660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:57:26.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.734+0000 7f8aad400700 1 -- 172.21.15.142:0/103814195 shutdown_connections 2024-04-20T21:57:26.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.734+0000 7f8aad400700 1 -- 172.21.15.142:0/103814195 wait complete. 2024-04-20T21:57:26.755 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T21:57:26.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.925+0000 7f0e40200700 1 -- 172.21.15.142:0/219157230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e38073940 msgr2=0x7f0e38073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:26.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.925+0000 7f0e40200700 1 --2- 172.21.15.142:0/219157230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e38073940 0x7f0e38073dc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0e24009910 tx=0x7f0e24009c20 comp rx=0 tx=0).stop 2024-04-20T21:57:26.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.925+0000 7f0e40200700 1 -- 172.21.15.142:0/219157230 shutdown_connections 2024-04-20T21:57:26.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.925+0000 7f0e40200700 1 --2- 172.21.15.142:0/219157230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e38073940 0x7f0e38073dc0 secure :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0e24009910 tx=0x7f0e24009c20 comp rx=0 tx=0).stop 2024-04-20T21:57:26.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.925+0000 7f0e40200700 1 --2- 172.21.15.142:0/219157230 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e38074f10 0x7f0e38073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:26.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.925+0000 7f0e40200700 1 -- 172.21.15.142:0/219157230 >> 172.21.15.142:0/219157230 conn(0x7f0e380fc1c0 msgr2=0x7f0e380fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:57:26.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.926+0000 7f0e40200700 1 -- 172.21.15.142:0/219157230 shutdown_connections 2024-04-20T21:57:26.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.927+0000 7f0e40200700 1 -- 172.21.15.142:0/219157230 wait complete. 2024-04-20T21:57:26.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.929+0000 7f0e40200700 1 Processor -- start 2024-04-20T21:57:26.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.929+0000 7f0e40200700 1 -- start start 2024-04-20T21:57:26.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.929+0000 7f0e40200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e38074f10 0x7f0e3819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:26.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.929+0000 7f0e40200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e3819d390 0x7f0e381a23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:26.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.929+0000 7f0e40200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3819d8a0 con 0x7f0e38074f10 2024-04-20T21:57:26.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.929+0000 7f0e40200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3819da10 con 0x7f0e3819d390 2024-04-20T21:57:26.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.930+0000 7f0e3ce00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e3819d390 0x7f0e381a23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:26.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.930+0000 7f0e3ce00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e3819d390 0x7f0e381a23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:36818/0 (socket says 172.21.15.142:36818) 2024-04-20T21:57:26.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.930+0000 7f0e3ce00700 1 -- 172.21.15.142:0/3976901498 learned_addr learned my addr 172.21.15.142:0/3976901498 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:57:26.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.930+0000 7f0e3d800700 1 --2- 172.21.15.142:0/3976901498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e38074f10 0x7f0e3819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:26.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.931+0000 7f0e3ce00700 1 -- 172.21.15.142:0/3976901498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e38074f10 msgr2=0x7f0e3819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:26.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.931+0000 7f0e3ce00700 1 --2- 172.21.15.142:0/3976901498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e38074f10 0x7f0e3819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:26.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.931+0000 7f0e3ce00700 1 -- 172.21.15.142:0/3976901498 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e240095f0 con 0x7f0e3819d390 2024-04-20T21:57:26.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.932+0000 7f0e3ce00700 1 --2- 172.21.15.142:0/3976901498 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e3819d390 0x7f0e381a23b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0e24000c00 tx=0x7f0e2400be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:57:26.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.932+0000 7f0e36000700 1 -- 172.21.15.142:0/3976901498 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e2401d070 con 0x7f0e3819d390 2024-04-20T21:57:26.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.932+0000 7f0e36000700 1 -- 172.21.15.142:0/3976901498 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e24005dc0 con 0x7f0e3819d390 2024-04-20T21:57:26.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.932+0000 7f0e36000700 1 -- 172.21.15.142:0/3976901498 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e24021410 con 0x7f0e3819d390 2024-04-20T21:57:26.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.933+0000 7f0e40200700 1 -- 172.21.15.142:0/3976901498 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e381a28f0 con 0x7f0e3819d390 2024-04-20T21:57:26.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.933+0000 7f0e40200700 1 -- 172.21.15.142:0/3976901498 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e381a2e60 con 0x7f0e3819d390 2024-04-20T21:57:26.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.935+0000 7f0e36000700 1 -- 172.21.15.142:0/3976901498 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 23) v1 ==== 46707+0+0 (secure 0 0 0) 0x7f0e2400f6f0 con 0x7f0e3819d390 2024-04-20T21:57:26.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.935+0000 7f0e36000700 1 --2- 172.21.15.142:0/3976901498 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f0e20039910 0x7f0e2003bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:26.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.935+0000 7f0e40200700 1 -- 172.21.15.142:0/3976901498 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e38062510 con 0x7f0e3819d390 2024-04-20T21:57:26.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.935+0000 7f0e36000700 1 -- 172.21.15.142:0/3976901498 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f0e2404ecd0 con 0x7f0e3819d390 2024-04-20T21:57:26.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.936+0000 7f0e3d800700 1 --2- 172.21.15.142:0/3976901498 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f0e20039910 0x7f0e2003bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:26.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.937+0000 7f0e3d800700 1 --2- 172.21.15.142:0/3976901498 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f0e20039910 0x7f0e2003bdd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c005950 tx=0x7f0e2c0058e0 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:57:26.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:26.944+0000 7f0e36000700 1 -- 172.21.15.142:0/3976901498 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f0e24026070 con 0x7f0e3819d390 2024-04-20T21:57:26.986 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:26 smithi142 ceph-mon[15828]: pgmap v5: 65 pgs: 65 active+clean; 57 MiB data, 413 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:57:27.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:26 smithi164 ceph-mon[23506]: pgmap v5: 65 pgs: 65 active+clean; 57 MiB data, 413 MiB used, 536 GiB / 536 GiB avail 2024-04-20T21:57:27.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.318+0000 7f0e40200700 1 -- 172.21.15.142:0/3976901498 --> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e38103c60 con 0x7f0e20039910 2024-04-20T21:57:27.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.323+0000 7f0e36000700 1 -- 172.21.15.142:0/3976901498 <== mgr.24359 v2:172.21.15.164:6828/929524464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f0e38103c60 con 0x7f0e20039910 2024-04-20T21:57:27.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.328+0000 7f0e40200700 1 -- 172.21.15.142:0/3976901498 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f0e20039910 msgr2=0x7f0e2003bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:27.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.328+0000 7f0e40200700 1 --2- 172.21.15.142:0/3976901498 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f0e20039910 0x7f0e2003bdd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c005950 tx=0x7f0e2c0058e0 comp rx=0 tx=0).stop 2024-04-20T21:57:27.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.328+0000 7f0e40200700 1 -- 172.21.15.142:0/3976901498 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e3819d390 msgr2=0x7f0e381a23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:27.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.328+0000 7f0e40200700 1 --2- 172.21.15.142:0/3976901498 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e3819d390 0x7f0e381a23b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0e24000c00 tx=0x7f0e2400be20 comp rx=0 tx=0).stop 2024-04-20T21:57:27.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.328+0000 7f0e40200700 1 -- 172.21.15.142:0/3976901498 shutdown_connections 2024-04-20T21:57:27.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.328+0000 7f0e40200700 1 --2- 172.21.15.142:0/3976901498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e38074f10 0x7f0e3819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:27.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.328+0000 7f0e40200700 1 --2- 172.21.15.142:0/3976901498 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f0e20039910 0x7f0e2003bdd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:27.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.328+0000 7f0e40200700 1 --2- 172.21.15.142:0/3976901498 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e3819d390 0x7f0e381a23b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:27.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.328+0000 7f0e40200700 1 -- 172.21.15.142:0/3976901498 >> 172.21.15.142:0/3976901498 conn(0x7f0e380fc1c0 msgr2=0x7f0e38102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:57:27.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.329+0000 7f0e40200700 1 -- 172.21.15.142:0/3976901498 shutdown_connections 2024-04-20T21:57:27.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.329+0000 7f0e40200700 1 -- 172.21.15.142:0/3976901498 wait complete. 2024-04-20T21:57:27.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.530+0000 7f2c87c00700 1 -- 172.21.15.142:0/4108308202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c80103fb0 msgr2=0x7f2c801063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:27.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.530+0000 7f2c87c00700 1 --2- 172.21.15.142:0/4108308202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c80103fb0 0x7f2c801063a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009910 tx=0x7f2c6c009c20 comp rx=0 tx=0).stop 2024-04-20T21:57:27.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.530+0000 7f2c87c00700 1 -- 172.21.15.142:0/4108308202 shutdown_connections 2024-04-20T21:57:27.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.530+0000 7f2c87c00700 1 --2- 172.21.15.142:0/4108308202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c80103fb0 0x7f2c801063a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:27.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.530+0000 7f2c87c00700 1 --2- 172.21.15.142:0/4108308202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c80101680 0x7f2c80103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:27.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.530+0000 7f2c87c00700 1 -- 172.21.15.142:0/4108308202 >> 172.21.15.142:0/4108308202 conn(0x7f2c800fb0d0 msgr2=0x7f2c800fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:57:27.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.531+0000 7f2c87c00700 1 -- 172.21.15.142:0/4108308202 shutdown_connections 2024-04-20T21:57:27.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.531+0000 7f2c87c00700 1 -- 172.21.15.142:0/4108308202 wait complete. 2024-04-20T21:57:27.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.532+0000 7f2c87c00700 1 Processor -- start 2024-04-20T21:57:27.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.532+0000 7f2c87c00700 1 -- start start 2024-04-20T21:57:27.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.533+0000 7f2c87c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c80101680 0x7f2c801965b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:27.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.533+0000 7f2c87c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c80103fb0 0x7f2c80196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:27.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.533+0000 7f2c87c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c80197110 con 0x7f2c80103fb0 2024-04-20T21:57:27.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.533+0000 7f2c87c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c80197250 con 0x7f2c80101680 2024-04-20T21:57:27.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.533+0000 7f2c7fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c80103fb0 0x7f2c80196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:27.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.533+0000 7f2c7fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c80103fb0 0x7f2c80196af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34502/0 (socket says 172.21.15.142:34502) 2024-04-20T21:57:27.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.533+0000 7f2c7fe00700 1 -- 172.21.15.142:0/771956809 learned_addr learned my addr 172.21.15.142:0/771956809 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:57:27.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.534+0000 7f2c85200700 1 --2- 172.21.15.142:0/771956809 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c80101680 0x7f2c801965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:27.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.534+0000 7f2c7fe00700 1 -- 172.21.15.142:0/771956809 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c80101680 msgr2=0x7f2c801965b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:27.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.534+0000 7f2c7fe00700 1 --2- 172.21.15.142:0/771956809 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c80101680 0x7f2c801965b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:27.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.534+0000 7f2c7fe00700 1 -- 172.21.15.142:0/771956809 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c0095f0 con 0x7f2c80103fb0 2024-04-20T21:57:27.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.535+0000 7f2c7fe00700 1 --2- 172.21.15.142:0/771956809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c80103fb0 0x7f2c80196af0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00b650 tx=0x7f2c6c005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:57:27.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.535+0000 7f2c7d600700 1 -- 172.21.15.142:0/771956809 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c6c01d070 con 0x7f2c80103fb0 2024-04-20T21:57:27.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.535+0000 7f2c7d600700 1 -- 172.21.15.142:0/771956809 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2c6c0052a0 con 0x7f2c80103fb0 2024-04-20T21:57:27.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.535+0000 7f2c7d600700 1 -- 172.21.15.142:0/771956809 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c6c017400 con 0x7f2c80103fb0 2024-04-20T21:57:27.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.535+0000 7f2c87c00700 1 -- 172.21.15.142:0/771956809 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c8019bc50 con 0x7f2c80103fb0 2024-04-20T21:57:27.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.535+0000 7f2c87c00700 1 -- 172.21.15.142:0/771956809 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8019c1c0 con 0x7f2c80103fb0 2024-04-20T21:57:27.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.537+0000 7f2c87c00700 1 -- 172.21.15.142:0/771956809 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c80062510 con 0x7f2c80103fb0 2024-04-20T21:57:27.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.537+0000 7f2c7d600700 1 -- 172.21.15.142:0/771956809 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 23) v1 ==== 46707+0+0 (secure 0 0 0) 0x7f2c6c003810 con 0x7f2c80103fb0 2024-04-20T21:57:27.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.538+0000 7f2c7d600700 1 --2- 172.21.15.142:0/771956809 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f2c68039910 0x7f2c6803bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:27.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.538+0000 7f2c7d600700 1 -- 172.21.15.142:0/771956809 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f2c6c04efd0 con 0x7f2c80103fb0 2024-04-20T21:57:27.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.539+0000 7f2c85200700 1 --2- 172.21.15.142:0/771956809 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f2c68039910 0x7f2c6803bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:27.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.540+0000 7f2c85200700 1 --2- 172.21.15.142:0/771956809 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f2c68039910 0x7f2c6803bdd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2c74009c40 tx=0x7f2c74009260 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:57:27.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.545+0000 7f2c7d600700 1 -- 172.21.15.142:0/771956809 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f2c6c0163b0 con 0x7f2c80103fb0 2024-04-20T21:57:27.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.949+0000 7f2c87c00700 1 -- 172.21.15.142:0/771956809 --> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c80105eb0 con 0x7f2c68039910 2024-04-20T21:57:27.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.983+0000 7f2c7d600700 1 -- 172.21.15.142:0/771956809 <== mgr.24359 v2:172.21.15.164:6828/929524464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f2c80105eb0 con 0x7f2c68039910 2024-04-20T21:57:27.983 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T21:57:27.983 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (8m) 2m ago 10m 13.1M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T21:57:27.983 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (10m) 2m ago 10m 7528k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T21:57:27.983 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (9m) 21s ago 9m 7398k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T21:57:27.983 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (10m) 2m ago 10m 6665k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 56f2e41784f8 2024-04-20T21:57:27.983 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (8m) 21s ago 8m 6660k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 bce67525dd3e 2024-04-20T21:57:27.983 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (7m) 2m ago 9m 73.5M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T21:57:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (2m) 2m ago 2m 14.7M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 b68e279d7945 2024-04-20T21:57:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (2m) 2m ago 2m 11.7M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T21:57:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (2m) 21s ago 2m 12.7M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T21:57:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (2m) 21s ago 2m 13.2M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T21:57:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:9283,8765,8443 running (11m) 2m ago 11m 499M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d2c979afd250 2024-04-20T21:57:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (27s) 21s ago 8m 57.9M - 19.0.0-3133-ga8c84f59 76bc6b91b726 b8f1c0f4899b 2024-04-20T21:57:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (11m) 2m ago 12m 45.0M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c076f7eb00ea 2024-04-20T21:57:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (8m) 21s ago 8m 34.5M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 2bacdeb02ee0 2024-04-20T21:57:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (10m) 2m ago 10m 7805k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T21:57:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (8m) 21s ago 8m 7990k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T21:57:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (7m) 2m ago 7m 46.7M 3947M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4361ae428e0d 2024-04-20T21:57:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (7m) 2m ago 7m 48.8M 3947M 18.2.2-1237-g646b8c7d 9900ed1a6b81 dd7e7cf8e8e1 2024-04-20T21:57:27.985 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (6m) 2m ago 6m 53.2M 3947M 18.2.2-1237-g646b8c7d 9900ed1a6b81 8e9165365127 2024-04-20T21:57:27.985 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (5m) 21s ago 5m 58.4M 4971M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c081911f56ab 2024-04-20T21:57:27.985 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (5m) 21s ago 5m 56.0M 4971M 18.2.2-1237-g646b8c7d 9900ed1a6b81 39e09d63d44f 2024-04-20T21:57:27.985 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (4m) 21s ago 4m 55.3M 4971M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4f36124aeb0d 2024-04-20T21:57:27.985 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (7m) 2m ago 9m 50.5M - 2.43.0 a07b618ecd1d a1f0ad25692f 2024-04-20T21:57:27.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.987+0000 7f2c87c00700 1 -- 172.21.15.142:0/771956809 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f2c68039910 msgr2=0x7f2c6803bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:27.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.987+0000 7f2c87c00700 1 --2- 172.21.15.142:0/771956809 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f2c68039910 0x7f2c6803bdd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2c74009c40 tx=0x7f2c74009260 comp rx=0 tx=0).stop 2024-04-20T21:57:27.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.987+0000 7f2c87c00700 1 -- 172.21.15.142:0/771956809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c80103fb0 msgr2=0x7f2c80196af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:27.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.987+0000 7f2c87c00700 1 --2- 172.21.15.142:0/771956809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c80103fb0 0x7f2c80196af0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00b650 tx=0x7f2c6c005f00 comp rx=0 tx=0).stop 2024-04-20T21:57:27.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.988+0000 7f2c87c00700 1 -- 172.21.15.142:0/771956809 shutdown_connections 2024-04-20T21:57:27.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.988+0000 7f2c87c00700 1 --2- 172.21.15.142:0/771956809 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f2c68039910 0x7f2c6803bdd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:27.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.988+0000 7f2c87c00700 1 --2- 172.21.15.142:0/771956809 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c80101680 0x7f2c801965b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:27.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.988+0000 7f2c87c00700 1 --2- 172.21.15.142:0/771956809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c80103fb0 0x7f2c80196af0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:27.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.988+0000 7f2c87c00700 1 -- 172.21.15.142:0/771956809 >> 172.21.15.142:0/771956809 conn(0x7f2c800fb0d0 msgr2=0x7f2c800fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:57:27.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.988+0000 7f2c87c00700 1 -- 172.21.15.142:0/771956809 shutdown_connections 2024-04-20T21:57:27.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:27.989+0000 7f2c87c00700 1 -- 172.21.15.142:0/771956809 wait complete. 2024-04-20T21:57:28.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:27 smithi142 ceph-mon[15828]: from='client.24387 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:57:28.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:27 smithi142 ceph-mon[15828]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:57:28.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.205+0000 7fb976c00700 1 -- 172.21.15.142:0/2310046506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb970073940 msgr2=0x7fb970073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:28.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.205+0000 7fb976c00700 1 --2- 172.21.15.142:0/2310046506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb970073940 0x7fb970073dc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb958009910 tx=0x7fb958009c20 comp rx=0 tx=0).stop 2024-04-20T21:57:28.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.206+0000 7fb976c00700 1 -- 172.21.15.142:0/2310046506 shutdown_connections 2024-04-20T21:57:28.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.206+0000 7fb976c00700 1 --2- 172.21.15.142:0/2310046506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb970073940 0x7fb970073dc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:28.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.206+0000 7fb976c00700 1 --2- 172.21.15.142:0/2310046506 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb970074f10 0x7fb970073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:28.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.206+0000 7fb976c00700 1 -- 172.21.15.142:0/2310046506 >> 172.21.15.142:0/2310046506 conn(0x7fb9700fc1c0 msgr2=0x7fb9700fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:57:28.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.207+0000 7fb976c00700 1 -- 172.21.15.142:0/2310046506 shutdown_connections 2024-04-20T21:57:28.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.207+0000 7fb976c00700 1 -- 172.21.15.142:0/2310046506 wait complete. 2024-04-20T21:57:28.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.208+0000 7fb976c00700 1 Processor -- start 2024-04-20T21:57:28.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.209+0000 7fb976c00700 1 -- start start 2024-04-20T21:57:28.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.209+0000 7fb976c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb970074f10 0x7fb97019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:28.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.209+0000 7fb976c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb97019d3f0 0x7fb9701a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:28.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.209+0000 7fb976c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97019d870 con 0x7fb970074f10 2024-04-20T21:57:28.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.209+0000 7fb976c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97019d9e0 con 0x7fb97019d3f0 2024-04-20T21:57:28.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.209+0000 7fb96fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb970074f10 0x7fb97019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:28.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.210+0000 7fb967e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb97019d3f0 0x7fb9701a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:28.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.210+0000 7fb967e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb97019d3f0 0x7fb9701a2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:36872/0 (socket says 172.21.15.142:36872) 2024-04-20T21:57:28.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.210+0000 7fb967e00700 1 -- 172.21.15.142:0/4118892600 learned_addr learned my addr 172.21.15.142:0/4118892600 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:57:28.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.211+0000 7fb96fe00700 1 -- 172.21.15.142:0/4118892600 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb97019d3f0 msgr2=0x7fb9701a2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:28.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.211+0000 7fb96fe00700 1 --2- 172.21.15.142:0/4118892600 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb97019d3f0 0x7fb9701a2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:28.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.211+0000 7fb96fe00700 1 -- 172.21.15.142:0/4118892600 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9580095f0 con 0x7fb970074f10 2024-04-20T21:57:28.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.212+0000 7fb96fe00700 1 --2- 172.21.15.142:0/4118892600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb970074f10 0x7fb97019ceb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb96000cfa0 tx=0x7fb960007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:57:28.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.212+0000 7fb96d600700 1 -- 172.21.15.142:0/4118892600 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb96000ab10 con 0x7fb970074f10 2024-04-20T21:57:28.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.212+0000 7fb96d600700 1 -- 172.21.15.142:0/4118892600 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb96000ac70 con 0x7fb970074f10 2024-04-20T21:57:28.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.212+0000 7fb96d600700 1 -- 172.21.15.142:0/4118892600 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9600116b0 con 0x7fb970074f10 2024-04-20T21:57:28.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.212+0000 7fb976c00700 1 -- 172.21.15.142:0/4118892600 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9701049f0 con 0x7fb970074f10 2024-04-20T21:57:28.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.213+0000 7fb976c00700 1 -- 172.21.15.142:0/4118892600 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb970104fc0 con 0x7fb970074f10 2024-04-20T21:57:28.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.214+0000 7fb976c00700 1 -- 172.21.15.142:0/4118892600 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb970062510 con 0x7fb970074f10 2024-04-20T21:57:28.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.215+0000 7fb96d600700 1 -- 172.21.15.142:0/4118892600 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 23) v1 ==== 46707+0+0 (secure 0 0 0) 0x7fb960012420 con 0x7fb970074f10 2024-04-20T21:57:28.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.216+0000 7fb96d600700 1 --2- 172.21.15.142:0/4118892600 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fb954039910 0x7fb95403bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:28.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.216+0000 7fb96d600700 1 -- 172.21.15.142:0/4118892600 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fb96004dcc0 con 0x7fb970074f10 2024-04-20T21:57:28.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.216+0000 7fb967e00700 1 --2- 172.21.15.142:0/4118892600 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fb954039910 0x7fb95403bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:28.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.219+0000 7fb967e00700 1 --2- 172.21.15.142:0/4118892600 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fb954039910 0x7fb95403bdd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb958005090 tx=0x7fb958005fb0 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:57:28.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.227+0000 7fb96d600700 1 -- 172.21.15.142:0/4118892600 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fb960012b70 con 0x7fb970074f10 2024-04-20T21:57:28.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:27 smithi164 ceph-mon[23506]: from='client.24387 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:57:28.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:27 smithi164 ceph-mon[23506]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:57:28.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.688+0000 7fb976c00700 1 -- 172.21.15.142:0/4118892600 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb97010fff0 con 0x7fb970074f10 2024-04-20T21:57:28.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.691+0000 7fb96d600700 1 -- 172.21.15.142:0/4118892600 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fb96001ae60 con 0x7fb970074f10 2024-04-20T21:57:28.690 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T21:57:28.690 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T21:57:28.690 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 2 2024-04-20T21:57:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:57:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T21:57:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 1 2024-04-20T21:57:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:57:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T21:57:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 6 2024-04-20T21:57:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:57:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T21:57:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4 2024-04-20T21:57:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:57:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T21:57:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 12, 2024-04-20T21:57:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 1 2024-04-20T21:57:28.691 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T21:57:28.691 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T21:57:28.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.696+0000 7fb976c00700 1 -- 172.21.15.142:0/4118892600 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fb954039910 msgr2=0x7fb95403bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:28.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.696+0000 7fb976c00700 1 --2- 172.21.15.142:0/4118892600 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fb954039910 0x7fb95403bdd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb958005090 tx=0x7fb958005fb0 comp rx=0 tx=0).stop 2024-04-20T21:57:28.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.696+0000 7fb976c00700 1 -- 172.21.15.142:0/4118892600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb970074f10 msgr2=0x7fb97019ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:28.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.696+0000 7fb976c00700 1 --2- 172.21.15.142:0/4118892600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb970074f10 0x7fb97019ceb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb96000cfa0 tx=0x7fb960007f90 comp rx=0 tx=0).stop 2024-04-20T21:57:28.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.696+0000 7fb976c00700 1 -- 172.21.15.142:0/4118892600 shutdown_connections 2024-04-20T21:57:28.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.696+0000 7fb976c00700 1 --2- 172.21.15.142:0/4118892600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb970074f10 0x7fb97019ceb0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:28.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.696+0000 7fb976c00700 1 --2- 172.21.15.142:0/4118892600 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fb954039910 0x7fb95403bdd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:28.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.696+0000 7fb976c00700 1 --2- 172.21.15.142:0/4118892600 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb97019d3f0 0x7fb9701a2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:28.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.696+0000 7fb976c00700 1 -- 172.21.15.142:0/4118892600 >> 172.21.15.142:0/4118892600 conn(0x7fb9700fc1c0 msgr2=0x7fb970102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:57:28.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.697+0000 7fb976c00700 1 -- 172.21.15.142:0/4118892600 shutdown_connections 2024-04-20T21:57:28.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.697+0000 7fb976c00700 1 -- 172.21.15.142:0/4118892600 wait complete. 2024-04-20T21:57:28.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.893+0000 7fa411e00700 1 -- 172.21.15.142:0/4169526213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa40c1016e0 msgr2=0x7fa40c103ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:28.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.893+0000 7fa411e00700 1 --2- 172.21.15.142:0/4169526213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa40c1016e0 0x7fa40c103ad0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc009910 tx=0x7fa3fc009c20 comp rx=0 tx=0).stop 2024-04-20T21:57:28.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.893+0000 7fa411e00700 1 -- 172.21.15.142:0/4169526213 shutdown_connections 2024-04-20T21:57:28.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.893+0000 7fa411e00700 1 --2- 172.21.15.142:0/4169526213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa40c104010 0x7fa40c106400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:28.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.893+0000 7fa411e00700 1 --2- 172.21.15.142:0/4169526213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa40c1016e0 0x7fa40c103ad0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:28.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.893+0000 7fa411e00700 1 -- 172.21.15.142:0/4169526213 >> 172.21.15.142:0/4169526213 conn(0x7fa40c0fb0d0 msgr2=0x7fa40c0fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:57:28.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.893+0000 7fa411e00700 1 -- 172.21.15.142:0/4169526213 shutdown_connections 2024-04-20T21:57:28.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.893+0000 7fa411e00700 1 -- 172.21.15.142:0/4169526213 wait complete. 2024-04-20T21:57:28.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.894+0000 7fa411e00700 1 Processor -- start 2024-04-20T21:57:28.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.895+0000 7fa411e00700 1 -- start start 2024-04-20T21:57:28.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.895+0000 7fa411e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa40c1016e0 0x7fa40c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:28.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.895+0000 7fa411e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa40c104010 0x7fa40c19d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:28.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.895+0000 7fa411e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c19d790 con 0x7fa40c1016e0 2024-04-20T21:57:28.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.895+0000 7fa411e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c19d8d0 con 0x7fa40c104010 2024-04-20T21:57:28.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.895+0000 7fa40aa00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa40c1016e0 0x7fa40c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:28.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.896+0000 7fa40aa00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa40c1016e0 0x7fa40c19cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34560/0 (socket says 172.21.15.142:34560) 2024-04-20T21:57:28.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.896+0000 7fa40aa00700 1 -- 172.21.15.142:0/2081628829 learned_addr learned my addr 172.21.15.142:0/2081628829 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:57:28.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.896+0000 7fa40a000700 1 --2- 172.21.15.142:0/2081628829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa40c104010 0x7fa40c19d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:28.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.896+0000 7fa40aa00700 1 -- 172.21.15.142:0/2081628829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa40c104010 msgr2=0x7fa40c19d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:28.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.896+0000 7fa40aa00700 1 --2- 172.21.15.142:0/2081628829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa40c104010 0x7fa40c19d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:28.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.897+0000 7fa40aa00700 1 -- 172.21.15.142:0/2081628829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3fc0095f0 con 0x7fa40c1016e0 2024-04-20T21:57:28.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.897+0000 7fa40aa00700 1 --2- 172.21.15.142:0/2081628829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa40c1016e0 0x7fa40c19cc30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00b600 tx=0x7fa3fc00bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:57:28.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.898+0000 7fa410a00700 1 -- 172.21.15.142:0/2081628829 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3fc01d070 con 0x7fa40c1016e0 2024-04-20T21:57:28.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.898+0000 7fa410a00700 1 -- 172.21.15.142:0/2081628829 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3fc003d10 con 0x7fa40c1016e0 2024-04-20T21:57:28.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.898+0000 7fa411e00700 1 -- 172.21.15.142:0/2081628829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40c1a2260 con 0x7fa40c1016e0 2024-04-20T21:57:28.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.898+0000 7fa410a00700 1 -- 172.21.15.142:0/2081628829 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3fc021410 con 0x7fa40c1016e0 2024-04-20T21:57:28.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.898+0000 7fa411e00700 1 -- 172.21.15.142:0/2081628829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40c1a2770 con 0x7fa40c1016e0 2024-04-20T21:57:28.899 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.900+0000 7fa411e00700 1 -- 172.21.15.142:0/2081628829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40c062510 con 0x7fa40c1016e0 2024-04-20T21:57:28.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.902+0000 7fa410a00700 1 -- 172.21.15.142:0/2081628829 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 23) v1 ==== 46707+0+0 (secure 0 0 0) 0x7fa3fc00f6f0 con 0x7fa40c1016e0 2024-04-20T21:57:28.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.904+0000 7fa410a00700 1 --2- 172.21.15.142:0/2081628829 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fa3f00399a0 0x7fa3f003be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:28.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.904+0000 7fa410a00700 1 -- 172.21.15.142:0/2081628829 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fa3fc04fa10 con 0x7fa40c1016e0 2024-04-20T21:57:28.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.905+0000 7fa40a000700 1 --2- 172.21.15.142:0/2081628829 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fa3f00399a0 0x7fa3f003be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:28.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.905+0000 7fa40a000700 1 --2- 172.21.15.142:0/2081628829 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fa3f00399a0 0x7fa3f003be60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009c60 tx=0x7fa3f8009260 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:57:28.911 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:28.912+0000 7fa410a00700 1 -- 172.21.15.142:0/2081628829 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fa3fc016de0 con 0x7fa40c1016e0 2024-04-20T21:57:29.314 INFO:teuthology.orchestra.run.smithi142.stdout:e12 2024-04-20T21:57:29.314 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T21:57:29.314 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:57:29.314 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T21:57:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:57:29.314 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T21:57:29.314 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T21:57:29.315 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 12 2024-04-20T21:57:29.315 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T21:57:29.315 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T21:57:29.315 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:51.692699+0000 2024-04-20T21:57:29.315 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T21:57:29.315 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T21:57:29.315 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T21:57:29.315 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T21:57:29.315 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T21:57:29.315 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T21:57:29.315 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T21:57:29.315 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T21:57:29.316 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T21:57:29.316 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:57:29.316 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T21:57:29.316 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T21:57:29.316 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T21:57:29.316 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T21:57:29.316 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T21:57:29.316 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T21:57:29.316 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T21:57:29.316 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T21:57:29.316 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T21:57:29.316 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T21:57:29.316 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T21:57:29.316 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T21:57:29.316 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:57:29.316 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:57:29.317 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:57:29.317 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T21:57:29.317 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:57:29.317 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:57:29.317 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:57:29.317 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:57:29.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.313+0000 7fa411e00700 1 -- 172.21.15.142:0/2081628829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa40c1a2c20 con 0x7fa40c1016e0 2024-04-20T21:57:29.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.313+0000 7fa410a00700 1 -- 172.21.15.142:0/2081628829 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1853 (secure 0 0 0) 0x7fa3fc016c00 con 0x7fa40c1016e0 2024-04-20T21:57:29.318 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:28 smithi142 ceph-mon[15828]: pgmap v6: 65 pgs: 65 active+clean; 67 MiB data, 437 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s wr, 136 op/s 2024-04-20T21:57:29.318 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:28 smithi142 ceph-mon[15828]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:57:29.318 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:28 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/4118892600' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T21:57:29.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.317+0000 7fa411e00700 1 -- 172.21.15.142:0/2081628829 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fa3f00399a0 msgr2=0x7fa3f003be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:29.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.317+0000 7fa411e00700 1 --2- 172.21.15.142:0/2081628829 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fa3f00399a0 0x7fa3f003be60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009c60 tx=0x7fa3f8009260 comp rx=0 tx=0).stop 2024-04-20T21:57:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.317+0000 7fa411e00700 1 -- 172.21.15.142:0/2081628829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa40c1016e0 msgr2=0x7fa40c19cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.317+0000 7fa411e00700 1 --2- 172.21.15.142:0/2081628829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa40c1016e0 0x7fa40c19cc30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00b600 tx=0x7fa3fc00bac0 comp rx=0 tx=0).stop 2024-04-20T21:57:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.318+0000 7fa411e00700 1 -- 172.21.15.142:0/2081628829 shutdown_connections 2024-04-20T21:57:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.318+0000 7fa411e00700 1 --2- 172.21.15.142:0/2081628829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa40c1016e0 0x7fa40c19cc30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.318+0000 7fa411e00700 1 --2- 172.21.15.142:0/2081628829 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fa3f00399a0 0x7fa3f003be60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.318+0000 7fa411e00700 1 --2- 172.21.15.142:0/2081628829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa40c104010 0x7fa40c19d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.318+0000 7fa411e00700 1 -- 172.21.15.142:0/2081628829 >> 172.21.15.142:0/2081628829 conn(0x7fa40c0fb0d0 msgr2=0x7fa40c0fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:57:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.318+0000 7fa411e00700 1 -- 172.21.15.142:0/2081628829 shutdown_connections 2024-04-20T21:57:29.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.318+0000 7fa411e00700 1 -- 172.21.15.142:0/2081628829 wait complete. 2024-04-20T21:57:29.322 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T21:57:29.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:28 smithi164 ceph-mon[23506]: pgmap v6: 65 pgs: 65 active+clean; 67 MiB data, 437 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s wr, 136 op/s 2024-04-20T21:57:29.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:28 smithi164 ceph-mon[23506]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:57:29.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:28 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/4118892600' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T21:57:29.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.490+0000 7f0c05600700 1 -- 172.21.15.142:0/1790922830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c00103fb0 msgr2=0x7f0c00104430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:29.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.490+0000 7f0c05600700 1 --2- 172.21.15.142:0/1790922830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c00103fb0 0x7f0c00104430 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009910 tx=0x7f0bec009c20 comp rx=0 tx=0).stop 2024-04-20T21:57:29.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.490+0000 7f0c05600700 1 -- 172.21.15.142:0/1790922830 shutdown_connections 2024-04-20T21:57:29.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.490+0000 7f0c05600700 1 --2- 172.21.15.142:0/1790922830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c00103fb0 0x7f0c00104430 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:29.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.490+0000 7f0c05600700 1 --2- 172.21.15.142:0/1790922830 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c00102e50 0x7f0c00103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:29.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.490+0000 7f0c05600700 1 -- 172.21.15.142:0/1790922830 >> 172.21.15.142:0/1790922830 conn(0x7f0c000fe3f0 msgr2=0x7f0c00100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:57:29.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.490+0000 7f0c05600700 1 -- 172.21.15.142:0/1790922830 shutdown_connections 2024-04-20T21:57:29.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.491+0000 7f0c05600700 1 -- 172.21.15.142:0/1790922830 wait complete. 2024-04-20T21:57:29.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.491+0000 7f0c05600700 1 Processor -- start 2024-04-20T21:57:29.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.492+0000 7f0c05600700 1 -- start start 2024-04-20T21:57:29.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.492+0000 7f0c05600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c00102e50 0x7f0c00198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:29.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.492+0000 7f0c05600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c00103fb0 0x7f0c00198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:29.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.492+0000 7f0c05600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c00199360 con 0x7f0c00102e50 2024-04-20T21:57:29.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.492+0000 7f0c05600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c001994a0 con 0x7f0c00103fb0 2024-04-20T21:57:29.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.492+0000 7f0bfea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c00102e50 0x7f0c00198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:29.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.492+0000 7f0bfea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c00102e50 0x7f0c00198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34570/0 (socket says 172.21.15.142:34570) 2024-04-20T21:57:29.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.492+0000 7f0bfea00700 1 -- 172.21.15.142:0/1405551436 learned_addr learned my addr 172.21.15.142:0/1405551436 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:57:29.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.493+0000 7f0bfe000700 1 --2- 172.21.15.142:0/1405551436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c00103fb0 0x7f0c00198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:29.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.493+0000 7f0bfea00700 1 -- 172.21.15.142:0/1405551436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c00103fb0 msgr2=0x7f0c00198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:29.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.493+0000 7f0bfea00700 1 --2- 172.21.15.142:0/1405551436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c00103fb0 0x7f0c00198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:29.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.493+0000 7f0bfea00700 1 -- 172.21.15.142:0/1405551436 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bec0095f0 con 0x7f0c00102e50 2024-04-20T21:57:29.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.493+0000 7f0bfea00700 1 --2- 172.21.15.142:0/1405551436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c00102e50 0x7f0c00198800 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000d8d0 tx=0x7f0bf000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:57:29.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.493+0000 7f0bf7400700 1 -- 172.21.15.142:0/1405551436 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bf0009940 con 0x7f0c00102e50 2024-04-20T21:57:29.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.494+0000 7f0bf7400700 1 -- 172.21.15.142:0/1405551436 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0bf0010460 con 0x7f0c00102e50 2024-04-20T21:57:29.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.494+0000 7f0bf7400700 1 -- 172.21.15.142:0/1405551436 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bf000f5f0 con 0x7f0c00102e50 2024-04-20T21:57:29.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.494+0000 7f0c05600700 1 -- 172.21.15.142:0/1405551436 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c0019df00 con 0x7f0c00102e50 2024-04-20T21:57:29.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.494+0000 7f0c05600700 1 -- 172.21.15.142:0/1405551436 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0019e440 con 0x7f0c00102e50 2024-04-20T21:57:29.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.495+0000 7f0bf7400700 1 -- 172.21.15.142:0/1405551436 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 23) v1 ==== 46707+0+0 (secure 0 0 0) 0x7f0bf0009aa0 con 0x7f0c00102e50 2024-04-20T21:57:29.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.495+0000 7f0c05600700 1 -- 172.21.15.142:0/1405551436 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c00192950 con 0x7f0c00102e50 2024-04-20T21:57:29.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.496+0000 7f0bf7400700 1 --2- 172.21.15.142:0/1405551436 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f0be40398c0 0x7f0be403bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:29.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.496+0000 7f0bf7400700 1 -- 172.21.15.142:0/1405551436 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f0bf004db30 con 0x7f0c00102e50 2024-04-20T21:57:29.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.496+0000 7f0bfe000700 1 --2- 172.21.15.142:0/1405551436 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f0be40398c0 0x7f0be403bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:29.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.498+0000 7f0bfe000700 1 --2- 172.21.15.142:0/1405551436 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f0be40398c0 0x7f0be403bd80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00b5c0 tx=0x7f0bec005160 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:57:29.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.505+0000 7f0bf7400700 1 -- 172.21.15.142:0/1405551436 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f0bf001ae90 con 0x7f0c00102e50 2024-04-20T21:57:29.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.928+0000 7f0c05600700 1 -- 172.21.15.142:0/1405551436 --> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c0002cf30 con 0x7f0be40398c0 2024-04-20T21:57:29.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.930+0000 7f0bf7400700 1 -- 172.21.15.142:0/1405551436 <== mgr.24359 v2:172.21.15.164:6828/929524464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f0c0002cf30 con 0x7f0be40398c0 2024-04-20T21:57:29.929 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T21:57:29.930 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T21:57:29.930 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T21:57:29.930 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T21:57:29.930 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [], 2024-04-20T21:57:29.930 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "1/23 daemons upgraded", 2024-04-20T21:57:29.930 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "", 2024-04-20T21:57:29.930 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T21:57:29.930 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T21:57:29.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.934+0000 7f0c05600700 1 -- 172.21.15.142:0/1405551436 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f0be40398c0 msgr2=0x7f0be403bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:29.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.934+0000 7f0c05600700 1 --2- 172.21.15.142:0/1405551436 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f0be40398c0 0x7f0be403bd80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00b5c0 tx=0x7f0bec005160 comp rx=0 tx=0).stop 2024-04-20T21:57:29.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.934+0000 7f0c05600700 1 -- 172.21.15.142:0/1405551436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c00102e50 msgr2=0x7f0c00198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:29.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.934+0000 7f0c05600700 1 --2- 172.21.15.142:0/1405551436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c00102e50 0x7f0c00198800 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000d8d0 tx=0x7f0bf000dc90 comp rx=0 tx=0).stop 2024-04-20T21:57:29.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.935+0000 7f0c05600700 1 -- 172.21.15.142:0/1405551436 shutdown_connections 2024-04-20T21:57:29.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.935+0000 7f0c05600700 1 --2- 172.21.15.142:0/1405551436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c00102e50 0x7f0c00198800 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:29.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.935+0000 7f0c05600700 1 --2- 172.21.15.142:0/1405551436 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f0be40398c0 0x7f0be403bd80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:29.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.935+0000 7f0c05600700 1 --2- 172.21.15.142:0/1405551436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c00103fb0 0x7f0c00198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:29.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.935+0000 7f0c05600700 1 -- 172.21.15.142:0/1405551436 >> 172.21.15.142:0/1405551436 conn(0x7f0c000fe3f0 msgr2=0x7f0c001074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:57:29.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.935+0000 7f0c05600700 1 -- 172.21.15.142:0/1405551436 shutdown_connections 2024-04-20T21:57:29.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:29.935+0000 7f0c05600700 1 -- 172.21.15.142:0/1405551436 wait complete. 2024-04-20T21:57:30.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.185+0000 7fdc22000700 1 -- 172.21.15.142:0/1370230523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc1c103fb0 msgr2=0x7fdc1c1063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:30.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.185+0000 7fdc22000700 1 --2- 172.21.15.142:0/1370230523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc1c103fb0 0x7fdc1c1063a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009870 tx=0x7fdc08009b80 comp rx=0 tx=0).stop 2024-04-20T21:57:30.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:29 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2081628829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:57:30.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.188+0000 7fdc22000700 1 -- 172.21.15.142:0/1370230523 shutdown_connections 2024-04-20T21:57:30.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.188+0000 7fdc22000700 1 --2- 172.21.15.142:0/1370230523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc1c103fb0 0x7fdc1c1063a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:30.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.188+0000 7fdc22000700 1 --2- 172.21.15.142:0/1370230523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc1c101680 0x7fdc1c103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:30.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.188+0000 7fdc22000700 1 -- 172.21.15.142:0/1370230523 >> 172.21.15.142:0/1370230523 conn(0x7fdc1c0fb0d0 msgr2=0x7fdc1c0fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:57:30.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.188+0000 7fdc22000700 1 -- 172.21.15.142:0/1370230523 shutdown_connections 2024-04-20T21:57:30.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.188+0000 7fdc22000700 1 -- 172.21.15.142:0/1370230523 wait complete. 2024-04-20T21:57:30.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.190+0000 7fdc22000700 1 Processor -- start 2024-04-20T21:57:30.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.192+0000 7fdc22000700 1 -- start start 2024-04-20T21:57:30.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.192+0000 7fdc22000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc1c101680 0x7fdc1c198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.192+0000 7fdc22000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc1c103fb0 0x7fdc1c198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.192+0000 7fdc22000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c199180 con 0x7fdc1c103fb0 2024-04-20T21:57:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.192+0000 7fdc22000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c1992c0 con 0x7fdc1c101680 2024-04-20T21:57:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.193+0000 7fdc1b400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc1c101680 0x7fdc1c198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.193+0000 7fdc1b400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc1c101680 0x7fdc1c198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:36910/0 (socket says 172.21.15.142:36910) 2024-04-20T21:57:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.193+0000 7fdc1b400700 1 -- 172.21.15.142:0/2795322016 learned_addr learned my addr 172.21.15.142:0/2795322016 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:57:30.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.194+0000 7fdc1b400700 1 -- 172.21.15.142:0/2795322016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc1c103fb0 msgr2=0x7fdc1c198b60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T21:57:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.194+0000 7fdc1b400700 1 --2- 172.21.15.142:0/2795322016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc1c103fb0 0x7fdc1c198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:30.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.195+0000 7fdc1b400700 1 -- 172.21.15.142:0/2795322016 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc08009520 con 0x7fdc1c101680 2024-04-20T21:57:30.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.195+0000 7fdc1b400700 1 --2- 172.21.15.142:0/2795322016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc1c101680 0x7fdc1c198620 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00e940 tx=0x7fdc0c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:57:30.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.196+0000 7fdc13e00700 1 -- 172.21.15.142:0/2795322016 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc0c00eee0 con 0x7fdc1c101680 2024-04-20T21:57:30.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.196+0000 7fdc13e00700 1 -- 172.21.15.142:0/2795322016 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdc0c004cf0 con 0x7fdc1c101680 2024-04-20T21:57:30.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.196+0000 7fdc13e00700 1 -- 172.21.15.142:0/2795322016 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc0c005650 con 0x7fdc1c101680 2024-04-20T21:57:30.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.196+0000 7fdc22000700 1 -- 172.21.15.142:0/2795322016 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1c19dd20 con 0x7fdc1c101680 2024-04-20T21:57:30.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.197+0000 7fdc22000700 1 -- 172.21.15.142:0/2795322016 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1c19e240 con 0x7fdc1c101680 2024-04-20T21:57:30.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.198+0000 7fdc13e00700 1 -- 172.21.15.142:0/2795322016 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 23) v1 ==== 46707+0+0 (secure 0 0 0) 0x7fdc0c004750 con 0x7fdc1c101680 2024-04-20T21:57:30.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.199+0000 7fdc13e00700 1 --2- 172.21.15.142:0/2795322016 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fdc00039910 0x7fdc0003bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:57:30.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.199+0000 7fdc13e00700 1 -- 172.21.15.142:0/2795322016 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fdc0c014070 con 0x7fdc1c101680 2024-04-20T21:57:30.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.200+0000 7fdc22000700 1 -- 172.21.15.142:0/2795322016 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc1c062580 con 0x7fdc1c101680 2024-04-20T21:57:30.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.200+0000 7fdc1aa00700 1 --2- 172.21.15.142:0/2795322016 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fdc00039910 0x7fdc0003bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:57:30.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.201+0000 7fdc1aa00700 1 --2- 172.21.15.142:0/2795322016 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fdc00039910 0x7fdc0003bdd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdc08000c00 tx=0x7fdc08005b80 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:57:30.217 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.218+0000 7fdc13e00700 1 -- 172.21.15.142:0/2795322016 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fdc1c062580 con 0x7fdc1c101680 2024-04-20T21:57:30.287 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:29 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/2081628829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:57:30.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.788+0000 7fdc22000700 1 -- 172.21.15.142:0/2795322016 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdc1c0fcc50 con 0x7fdc1c101680 2024-04-20T21:57:30.790 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_OK 2024-04-20T21:57:30.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.790+0000 7fdc13e00700 1 -- 172.21.15.142:0/2795322016 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fdc0c01ebd0 con 0x7fdc1c101680 2024-04-20T21:57:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.792+0000 7fdc22000700 1 -- 172.21.15.142:0/2795322016 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fdc00039910 msgr2=0x7fdc0003bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.792+0000 7fdc22000700 1 --2- 172.21.15.142:0/2795322016 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fdc00039910 0x7fdc0003bdd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdc08000c00 tx=0x7fdc08005b80 comp rx=0 tx=0).stop 2024-04-20T21:57:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.792+0000 7fdc22000700 1 -- 172.21.15.142:0/2795322016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc1c101680 msgr2=0x7fdc1c198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:57:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.792+0000 7fdc22000700 1 --2- 172.21.15.142:0/2795322016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc1c101680 0x7fdc1c198620 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00e940 tx=0x7fdc0c00ed00 comp rx=0 tx=0).stop 2024-04-20T21:57:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.793+0000 7fdc22000700 1 -- 172.21.15.142:0/2795322016 shutdown_connections 2024-04-20T21:57:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.793+0000 7fdc22000700 1 --2- 172.21.15.142:0/2795322016 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fdc00039910 0x7fdc0003bdd0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.793+0000 7fdc22000700 1 --2- 172.21.15.142:0/2795322016 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc1c101680 0x7fdc1c198620 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:30.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.793+0000 7fdc22000700 1 --2- 172.21.15.142:0/2795322016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc1c103fb0 0x7fdc1c198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:57:30.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.793+0000 7fdc22000700 1 -- 172.21.15.142:0/2795322016 >> 172.21.15.142:0/2795322016 conn(0x7fdc1c0fb0d0 msgr2=0x7fdc1c100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:57:30.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.795+0000 7fdc22000700 1 -- 172.21.15.142:0/2795322016 shutdown_connections 2024-04-20T21:57:30.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:57:30.796+0000 7fdc22000700 1 -- 172.21.15.142:0/2795322016 wait complete. 2024-04-20T21:57:31.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:31 smithi142 ceph-mon[15828]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:57:31.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:31 smithi142 ceph-mon[15828]: pgmap v7: 65 pgs: 65 active+clean; 77 MiB data, 460 MiB used, 536 GiB / 536 GiB avail; 29 KiB/s rd, 3.0 MiB/s wr, 246 op/s 2024-04-20T21:57:31.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:31 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2795322016' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T21:57:31.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:31 smithi164 ceph-mon[23506]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:57:31.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:31 smithi164 ceph-mon[23506]: pgmap v7: 65 pgs: 65 active+clean; 77 MiB data, 460 MiB used, 536 GiB / 536 GiB avail; 29 KiB/s rd, 3.0 MiB/s wr, 246 op/s 2024-04-20T21:57:31.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:31 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/2795322016' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T21:57:33.359 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:33 smithi164 ceph-mon[23506]: pgmap v8: 65 pgs: 65 active+clean; 77 MiB data, 460 MiB used, 536 GiB / 536 GiB avail; 23 KiB/s rd, 2.3 MiB/s wr, 191 op/s 2024-04-20T21:57:33.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:33 smithi142 ceph-mon[15828]: pgmap v8: 65 pgs: 65 active+clean; 77 MiB data, 460 MiB used, 536 GiB / 536 GiB avail; 23 KiB/s rd, 2.3 MiB/s wr, 191 op/s 2024-04-20T21:57:35.014 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:35 smithi142 ceph-mon[15828]: pgmap v9: 65 pgs: 65 active+clean; 89 MiB data, 516 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 3.1 MiB/s wr, 291 op/s 2024-04-20T21:57:35.015 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:35 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:35.319 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:35 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:35.319 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:35 smithi142 ceph-mon[15828]: Standby manager daemon smithi142.zzmcfz started 2024-04-20T21:57:35.319 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:35 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.142:0/2059374378' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.zzmcfz/crt"}]: dispatch 2024-04-20T21:57:35.319 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:35 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.142:0/2059374378' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T21:57:35.319 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:35 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.142:0/2059374378' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.zzmcfz/key"}]: dispatch 2024-04-20T21:57:35.319 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:35 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.142:0/2059374378' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T21:57:35.362 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:35 smithi164 ceph-mon[23506]: pgmap v9: 65 pgs: 65 active+clean; 89 MiB data, 516 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 3.1 MiB/s wr, 291 op/s 2024-04-20T21:57:35.362 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:35 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:35.362 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:35 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:35.362 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:35 smithi164 ceph-mon[23506]: Standby manager daemon smithi142.zzmcfz started 2024-04-20T21:57:35.362 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:35 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.142:0/2059374378' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.zzmcfz/crt"}]: dispatch 2024-04-20T21:57:35.362 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:35 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.142:0/2059374378' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T21:57:35.362 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:35 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.142:0/2059374378' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.zzmcfz/key"}]: dispatch 2024-04-20T21:57:35.362 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:35 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.142:0/2059374378' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T21:57:36.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:36 smithi142 ceph-mon[15828]: mgrmap e24: smithi164.oejajr(active, since 13s), standbys: smithi142.zzmcfz 2024-04-20T21:57:36.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:36 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mgr metadata", "who": "smithi142.zzmcfz", "id": "smithi142.zzmcfz"}]: dispatch 2024-04-20T21:57:36.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:36 smithi142 ceph-mon[15828]: pgmap v10: 65 pgs: 65 active+clean; 89 MiB data, 516 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 267 op/s 2024-04-20T21:57:36.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:36 smithi164 ceph-mon[23506]: mgrmap e24: smithi164.oejajr(active, since 13s), standbys: smithi142.zzmcfz 2024-04-20T21:57:36.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:36 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mgr metadata", "who": "smithi142.zzmcfz", "id": "smithi142.zzmcfz"}]: dispatch 2024-04-20T21:57:36.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:36 smithi164 ceph-mon[23506]: pgmap v10: 65 pgs: 65 active+clean; 89 MiB data, 516 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 267 op/s 2024-04-20T21:57:37.987 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:37 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:37.987 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:37 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:37.987 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:37 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:57:37.988 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:37 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:37.988 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:37 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:38.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:37 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:38.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:37 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:38.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:37 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:57:38.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:37 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:38.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:37 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:38.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:38 smithi164 ceph-mon[23506]: pgmap v11: 65 pgs: 65 active+clean; 92 MiB data, 534 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 3.1 MiB/s wr, 325 op/s 2024-04-20T21:57:39.122 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:38 smithi142 ceph-mon[15828]: pgmap v11: 65 pgs: 65 active+clean; 92 MiB data, 534 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 3.1 MiB/s wr, 325 op/s 2024-04-20T21:57:40.762 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:40 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:40.763 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:40 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:40.763 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:40 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:40.763 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:40 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:40.763 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:40 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:40.763 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:40 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:40.763 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:40 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:40.763 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:40 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:40.763 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:40 smithi164 ceph-mon[23506]: Adjusting osd_memory_target on smithi142 to 1216M 2024-04-20T21:57:40.763 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:40 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:40.763 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:40 smithi164 ceph-mon[23506]: pgmap v12: 65 pgs: 65 active+clean; 104 MiB data, 580 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 3.3 MiB/s wr, 360 op/s 2024-04-20T21:57:40.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:40 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:40.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:40 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:40.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:40 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:40.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:40 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:40.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:40 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:40.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:40 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:40.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:40 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:40.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:40 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:40.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:40 smithi142 ceph-mon[15828]: Adjusting osd_memory_target on smithi142 to 1216M 2024-04-20T21:57:40.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:40 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:40.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:40 smithi142 ceph-mon[15828]: pgmap v12: 65 pgs: 65 active+clean; 104 MiB data, 580 MiB used, 536 GiB / 536 GiB avail; 17 KiB/s rd, 3.3 MiB/s wr, 360 op/s 2024-04-20T21:57:43.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:42 smithi164 ceph-mon[23506]: pgmap v13: 65 pgs: 65 active+clean; 104 MiB data, 580 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s wr, 274 op/s 2024-04-20T21:57:43.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:42 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:43.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:42 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:43.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:42 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:43.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:42 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:43.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:42 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:43.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:42 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:43.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:42 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:43.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:42 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:43.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:42 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:43.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:42 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:57:43.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:42 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:57:43.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:42 smithi142 ceph-mon[15828]: pgmap v13: 65 pgs: 65 active+clean; 104 MiB data, 580 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s wr, 274 op/s 2024-04-20T21:57:43.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:42 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:43.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:42 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:43.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:42 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:43.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:42 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:43.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:42 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:43.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:42 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:43.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:42 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:43.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:42 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T21:57:43.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:42 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:43.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:42 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:57:43.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:42 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:57:44.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:43 smithi142 ceph-mon[15828]: Adjusting osd_memory_target on smithi164 to 2240M 2024-04-20T21:57:44.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:43 smithi142 ceph-mon[15828]: Updating smithi142:/etc/ceph/ceph.conf 2024-04-20T21:57:44.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:43 smithi142 ceph-mon[15828]: Updating smithi164:/etc/ceph/ceph.conf 2024-04-20T21:57:44.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:43 smithi164 ceph-mon[23506]: Adjusting osd_memory_target on smithi164 to 2240M 2024-04-20T21:57:44.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:43 smithi164 ceph-mon[23506]: Updating smithi142:/etc/ceph/ceph.conf 2024-04-20T21:57:44.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:43 smithi164 ceph-mon[23506]: Updating smithi164:/etc/ceph/ceph.conf 2024-04-20T21:57:45.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:45 smithi164 ceph-mon[23506]: Updating smithi164:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T21:57:45.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:45 smithi164 ceph-mon[23506]: Updating smithi142:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T21:57:45.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:45 smithi164 ceph-mon[23506]: pgmap v14: 65 pgs: 65 active+clean; 112 MiB data, 613 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s wr, 385 op/s 2024-04-20T21:57:45.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:45 smithi164 ceph-mon[23506]: Updating smithi164:/etc/ceph/ceph.client.admin.keyring 2024-04-20T21:57:45.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:45 smithi142 ceph-mon[15828]: Updating smithi164:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T21:57:45.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:45 smithi142 ceph-mon[15828]: Updating smithi142:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T21:57:45.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:45 smithi142 ceph-mon[15828]: pgmap v14: 65 pgs: 65 active+clean; 112 MiB data, 613 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s wr, 385 op/s 2024-04-20T21:57:45.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:45 smithi142 ceph-mon[15828]: Updating smithi164:/etc/ceph/ceph.client.admin.keyring 2024-04-20T21:57:46.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:46 smithi142 ceph-mon[15828]: Updating smithi164:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T21:57:46.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:46 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:46.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:46 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:46.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:46 smithi164 ceph-mon[23506]: Updating smithi164:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T21:57:46.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:46 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:46.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:46 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:47.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:47 smithi142 ceph-mon[15828]: pgmap v15: 65 pgs: 65 active+clean; 112 MiB data, 613 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s wr, 261 op/s 2024-04-20T21:57:47.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:47 smithi164 ceph-mon[23506]: pgmap v15: 65 pgs: 65 active+clean; 112 MiB data, 613 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s wr, 261 op/s 2024-04-20T21:57:48.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:48 smithi142 ceph-mon[15828]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-04-20T21:57:48.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:48 smithi164 ceph-mon[23506]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-04-20T21:57:49.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:49 smithi164 ceph-mon[23506]: Updating smithi142:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T21:57:49.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:49 smithi164 ceph-mon[23506]: pgmap v16: 65 pgs: 65 active+clean; 114 MiB data, 656 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 325 op/s 2024-04-20T21:57:49.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:49 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:49.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:49 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:49.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:49 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:49.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:49 smithi142 ceph-mon[15828]: Updating smithi142:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T21:57:49.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:49 smithi142 ceph-mon[15828]: pgmap v16: 65 pgs: 65 active+clean; 114 MiB data, 656 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s wr, 325 op/s 2024-04-20T21:57:49.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:49 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:49.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:49 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:49.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:49 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:51.667 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:51 smithi142 ceph-mon[15828]: Reconfiguring prometheus.smithi142 (dependencies changed)... 2024-04-20T21:57:51.667 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:51 smithi142 ceph-mon[15828]: Reconfiguring daemon prometheus.smithi142 on smithi142 2024-04-20T21:57:51.667 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:51 smithi142 ceph-mon[15828]: pgmap v17: 65 pgs: 65 active+clean; 122 MiB data, 658 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s wr, 322 op/s 2024-04-20T21:57:51.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:51 smithi164 ceph-mon[23506]: Reconfiguring prometheus.smithi142 (dependencies changed)... 2024-04-20T21:57:51.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:51 smithi164 ceph-mon[23506]: Reconfiguring daemon prometheus.smithi142 on smithi142 2024-04-20T21:57:51.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:51 smithi164 ceph-mon[23506]: pgmap v17: 65 pgs: 65 active+clean; 122 MiB data, 658 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s wr, 322 op/s 2024-04-20T21:57:52.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:52 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:57:52.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:52 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:57:53.541 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:53 smithi142 ceph-mon[15828]: pgmap v18: 65 pgs: 65 active+clean; 122 MiB data, 658 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s wr, 229 op/s 2024-04-20T21:57:53.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:53 smithi164 ceph-mon[23506]: pgmap v18: 65 pgs: 65 active+clean; 122 MiB data, 658 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s wr, 229 op/s 2024-04-20T21:57:55.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:55 smithi142 ceph-mon[15828]: pgmap v19: 65 pgs: 65 active+clean; 135 MiB data, 710 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s wr, 331 op/s 2024-04-20T21:57:55.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:55 smithi164 ceph-mon[23506]: pgmap v19: 65 pgs: 65 active+clean; 135 MiB data, 710 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s wr, 331 op/s 2024-04-20T21:57:57.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:57 smithi142 ceph-mon[15828]: pgmap v20: 65 pgs: 65 active+clean; 135 MiB data, 710 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s wr, 219 op/s 2024-04-20T21:57:57.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:57 smithi164 ceph-mon[23506]: pgmap v20: 65 pgs: 65 active+clean; 135 MiB data, 710 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s wr, 219 op/s 2024-04-20T21:57:59.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:59 smithi164 ceph-mon[23506]: pgmap v21: 65 pgs: 65 active+clean; 141 MiB data, 706 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s wr, 302 op/s 2024-04-20T21:57:59.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:59 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:59.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:57:59 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:59.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:59 smithi142 ceph-mon[15828]: pgmap v21: 65 pgs: 65 active+clean; 141 MiB data, 706 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s wr, 302 op/s 2024-04-20T21:57:59.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:59 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:57:59.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:57:59 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:00.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:00 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-20T21:58:00.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:00 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:58:00.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:00 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-20T21:58:00.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:00 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:58:00.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.988+0000 7fedd2800700 1 -- 172.21.15.142:0/2648637159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedcc072be0 msgr2=0x7fedcc109ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:00.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.988+0000 7fedd2800700 1 --2- 172.21.15.142:0/2648637159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedcc072be0 0x7fedcc109ef0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fedbc009910 tx=0x7fedbc009c20 comp rx=0 tx=0).stop 2024-04-20T21:58:00.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.989+0000 7fedd2800700 1 -- 172.21.15.142:0/2648637159 shutdown_connections 2024-04-20T21:58:00.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.989+0000 7fedd2800700 1 --2- 172.21.15.142:0/2648637159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedcc10a430 0x7fedcc10a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:00.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.989+0000 7fedd2800700 1 --2- 172.21.15.142:0/2648637159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedcc072be0 0x7fedcc109ef0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:00.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.989+0000 7fedd2800700 1 -- 172.21.15.142:0/2648637159 >> 172.21.15.142:0/2648637159 conn(0x7fedcc06de40 msgr2=0x7fedcc070260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:00.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.989+0000 7fedd2800700 1 -- 172.21.15.142:0/2648637159 shutdown_connections 2024-04-20T21:58:00.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.989+0000 7fedd2800700 1 -- 172.21.15.142:0/2648637159 wait complete. 2024-04-20T21:58:00.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.990+0000 7fedd2800700 1 Processor -- start 2024-04-20T21:58:00.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.991+0000 7fedd2800700 1 -- start start 2024-04-20T21:58:00.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.991+0000 7fedd2800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedcc072be0 0x7fedcc1a1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:00.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.992+0000 7fedd2800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedcc10a430 0x7fedcc1a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:00.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.992+0000 7fedd2800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc1a1b70 con 0x7fedcc072be0 2024-04-20T21:58:00.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.992+0000 7fedd2800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc1a1cb0 con 0x7fedcc10a430 2024-04-20T21:58:00.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.992+0000 7fedcb400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedcc072be0 0x7fedcc1a1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:00.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.992+0000 7fedcb400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedcc072be0 0x7fedcc1a1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47084/0 (socket says 172.21.15.142:47084) 2024-04-20T21:58:00.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.992+0000 7fedcb400700 1 -- 172.21.15.142:0/2846399265 learned_addr learned my addr 172.21.15.142:0/2846399265 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:58:00.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.993+0000 7fedcb400700 1 -- 172.21.15.142:0/2846399265 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedcc10a430 msgr2=0x7fedcc1a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:00.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.993+0000 7fedcb400700 1 --2- 172.21.15.142:0/2846399265 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedcc10a430 0x7fedcc1a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:00.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.993+0000 7fedcb400700 1 -- 172.21.15.142:0/2846399265 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedbc0095f0 con 0x7fedcc072be0 2024-04-20T21:58:00.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.993+0000 7fedcb400700 1 --2- 172.21.15.142:0/2846399265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedcc072be0 0x7fedcc1a1010 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00bd70 tx=0x7fedbc00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:00.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.993+0000 7fedc3e00700 1 -- 172.21.15.142:0/2846399265 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedbc01d070 con 0x7fedcc072be0 2024-04-20T21:58:00.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.993+0000 7fedd2800700 1 -- 172.21.15.142:0/2846399265 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedcc1a66b0 con 0x7fedcc072be0 2024-04-20T21:58:00.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.993+0000 7fedc3e00700 1 -- 172.21.15.142:0/2846399265 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fedbc00f460 con 0x7fedcc072be0 2024-04-20T21:58:00.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.993+0000 7fedc3e00700 1 -- 172.21.15.142:0/2846399265 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedbc021620 con 0x7fedcc072be0 2024-04-20T21:58:00.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.994+0000 7fedd2800700 1 -- 172.21.15.142:0/2846399265 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedcc1a6c20 con 0x7fedcc072be0 2024-04-20T21:58:00.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.996+0000 7fedd2800700 1 -- 172.21.15.142:0/2846399265 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedcc04ebb0 con 0x7fedcc072be0 2024-04-20T21:58:00.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:00.997+0000 7fedc3e00700 1 -- 172.21.15.142:0/2846399265 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 24) v1 ==== 91832+0+0 (secure 0 0 0) 0x7fedbc00f5d0 con 0x7fedcc072be0 2024-04-20T21:58:01.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.000+0000 7fedc3e00700 1 --2- 172.21.15.142:0/2846399265 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fedb006dc90 0x7fedb0070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:01.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.000+0000 7fedc3e00700 1 -- 172.21.15.142:0/2846399265 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fedbc08ea70 con 0x7fedcc072be0 2024-04-20T21:58:01.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.001+0000 7fedcaa00700 1 --2- 172.21.15.142:0/2846399265 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fedb006dc90 0x7fedb0070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:01.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.003+0000 7fedcaa00700 1 --2- 172.21.15.142:0/2846399265 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fedb006dc90 0x7fedb0070150 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fedb8005950 tx=0x7fedb80058e0 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:01.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.006+0000 7fedc3e00700 1 -- 172.21.15.142:0/2846399265 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fedbc05b7a0 con 0x7fedcc072be0 2024-04-20T21:58:01.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.354+0000 7fedd2800700 1 -- 172.21.15.142:0/2846399265 --> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fedcc1084e0 con 0x7fedb006dc90 2024-04-20T21:58:01.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.358+0000 7fedc3e00700 1 -- 172.21.15.142:0/2846399265 <== mgr.24359 v2:172.21.15.164:6828/929524464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fedcc1084e0 con 0x7fedb006dc90 2024-04-20T21:58:01.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.362+0000 7fedd2800700 1 -- 172.21.15.142:0/2846399265 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fedb006dc90 msgr2=0x7fedb0070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:01.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.362+0000 7fedd2800700 1 --2- 172.21.15.142:0/2846399265 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fedb006dc90 0x7fedb0070150 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fedb8005950 tx=0x7fedb80058e0 comp rx=0 tx=0).stop 2024-04-20T21:58:01.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.362+0000 7fedd2800700 1 -- 172.21.15.142:0/2846399265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedcc072be0 msgr2=0x7fedcc1a1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:01.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.362+0000 7fedd2800700 1 --2- 172.21.15.142:0/2846399265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedcc072be0 0x7fedcc1a1010 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00bd70 tx=0x7fedbc00be50 comp rx=0 tx=0).stop 2024-04-20T21:58:01.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.362+0000 7fedd2800700 1 -- 172.21.15.142:0/2846399265 shutdown_connections 2024-04-20T21:58:01.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.362+0000 7fedd2800700 1 --2- 172.21.15.142:0/2846399265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedcc072be0 0x7fedcc1a1010 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:01.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.362+0000 7fedd2800700 1 --2- 172.21.15.142:0/2846399265 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fedb006dc90 0x7fedb0070150 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:01.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.362+0000 7fedd2800700 1 --2- 172.21.15.142:0/2846399265 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fedcc10a430 0x7fedcc1a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:01.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.362+0000 7fedd2800700 1 -- 172.21.15.142:0/2846399265 >> 172.21.15.142:0/2846399265 conn(0x7fedcc06de40 msgr2=0x7fedcc070230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:01.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.362+0000 7fedd2800700 1 -- 172.21.15.142:0/2846399265 shutdown_connections 2024-04-20T21:58:01.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.362+0000 7fedd2800700 1 -- 172.21.15.142:0/2846399265 wait complete. 2024-04-20T21:58:01.380 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T21:58:01.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.552+0000 7f8b9aa00700 1 -- 172.21.15.142:0/2537956212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b94100cf0 msgr2=0x7f8b94101150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:01.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.552+0000 7f8b9aa00700 1 --2- 172.21.15.142:0/2537956212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b94100cf0 0x7f8b94101150 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009910 tx=0x7f8b80009c20 comp rx=0 tx=0).stop 2024-04-20T21:58:01.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.552+0000 7f8b9aa00700 1 -- 172.21.15.142:0/2537956212 shutdown_connections 2024-04-20T21:58:01.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.552+0000 7f8b9aa00700 1 --2- 172.21.15.142:0/2537956212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b94100cf0 0x7f8b94101150 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:01.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.552+0000 7f8b9aa00700 1 --2- 172.21.15.142:0/2537956212 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b940ffaf0 0x7f8b940fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:01.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.552+0000 7f8b9aa00700 1 -- 172.21.15.142:0/2537956212 >> 172.21.15.142:0/2537956212 conn(0x7f8b940fb0d0 msgr2=0x7f8b940fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:01.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.553+0000 7f8b9aa00700 1 -- 172.21.15.142:0/2537956212 shutdown_connections 2024-04-20T21:58:01.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.553+0000 7f8b9aa00700 1 -- 172.21.15.142:0/2537956212 wait complete. 2024-04-20T21:58:01.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.554+0000 7f8b9aa00700 1 Processor -- start 2024-04-20T21:58:01.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.554+0000 7f8b9aa00700 1 -- start start 2024-04-20T21:58:01.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.554+0000 7f8b9aa00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b940ffaf0 0x7f8b94192950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:01.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.555+0000 7f8b9aa00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b94192e90 0x7f8b9418f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:01.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.555+0000 7f8b9aa00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9418f940 con 0x7f8b940ffaf0 2024-04-20T21:58:01.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.555+0000 7f8b9aa00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9418fab0 con 0x7f8b94192e90 2024-04-20T21:58:01.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.555+0000 7f8b93400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b94192e90 0x7f8b9418f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:01.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.555+0000 7f8b93e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b940ffaf0 0x7f8b94192950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:01.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.555+0000 7f8b93e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b940ffaf0 0x7f8b94192950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47116/0 (socket says 172.21.15.142:47116) 2024-04-20T21:58:01.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.555+0000 7f8b93e00700 1 -- 172.21.15.142:0/3596518012 learned_addr learned my addr 172.21.15.142:0/3596518012 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:58:01.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.556+0000 7f8b93400700 1 -- 172.21.15.142:0/3596518012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b940ffaf0 msgr2=0x7f8b94192950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:01.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.556+0000 7f8b93400700 1 --2- 172.21.15.142:0/3596518012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b940ffaf0 0x7f8b94192950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:01.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.556+0000 7f8b93400700 1 -- 172.21.15.142:0/3596518012 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b800095f0 con 0x7f8b94192e90 2024-04-20T21:58:01.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.556+0000 7f8b93400700 1 --2- 172.21.15.142:0/3596518012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b94192e90 0x7f8b9418f400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8b80008000 tx=0x7f8b8000bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:01.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.557+0000 7f8b90c00700 1 -- 172.21.15.142:0/3596518012 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b8001d070 con 0x7f8b94192e90 2024-04-20T21:58:01.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.557+0000 7f8b90c00700 1 -- 172.21.15.142:0/3596518012 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b80005dc0 con 0x7f8b94192e90 2024-04-20T21:58:01.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.557+0000 7f8b90c00700 1 -- 172.21.15.142:0/3596518012 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b8000fe50 con 0x7f8b94192e90 2024-04-20T21:58:01.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.557+0000 7f8b9aa00700 1 -- 172.21.15.142:0/3596518012 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9418fd30 con 0x7f8b94192e90 2024-04-20T21:58:01.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.558+0000 7f8b9aa00700 1 -- 172.21.15.142:0/3596518012 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b941a2ec0 con 0x7f8b94192e90 2024-04-20T21:58:01.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.560+0000 7f8b9aa00700 1 -- 172.21.15.142:0/3596518012 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b740052f0 con 0x7f8b94192e90 2024-04-20T21:58:01.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.562+0000 7f8b90c00700 1 -- 172.21.15.142:0/3596518012 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 24) v1 ==== 91832+0+0 (secure 0 0 0) 0x7f8b8000f460 con 0x7f8b94192e90 2024-04-20T21:58:01.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.563+0000 7f8b90c00700 1 --2- 172.21.15.142:0/3596518012 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8b7806dc40 0x7f8b78070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:01.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.563+0000 7f8b90c00700 1 -- 172.21.15.142:0/3596518012 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f8b8008e5a0 con 0x7f8b94192e90 2024-04-20T21:58:01.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.564+0000 7f8b93e00700 1 --2- 172.21.15.142:0/3596518012 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8b7806dc40 0x7f8b78070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:01.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.565+0000 7f8b93e00700 1 --2- 172.21.15.142:0/3596518012 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8b7806dc40 0x7f8b78070100 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400bd70 tx=0x7f8b8400b4a0 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:01.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.575+0000 7f8b90c00700 1 -- 172.21.15.142:0/3596518012 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f8b8005b4c0 con 0x7f8b94192e90 2024-04-20T21:58:01.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:01 smithi142 ceph-mon[15828]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-20T21:58:01.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:01 smithi142 ceph-mon[15828]: Upgrade: Need to upgrade myself (mgr.smithi164.oejajr) 2024-04-20T21:58:01.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:01 smithi142 ceph-mon[15828]: Upgrade: Need to upgrade myself (mgr.smithi164.oejajr) 2024-04-20T21:58:01.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:01 smithi142 ceph-mon[15828]: pgmap v22: 65 pgs: 65 active+clean; 146 MiB data, 718 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s wr, 264 op/s 2024-04-20T21:58:01.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:01 smithi142 ceph-mon[15828]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:58:01.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:01 smithi164 ceph-mon[23506]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-20T21:58:01.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:01 smithi164 ceph-mon[23506]: Upgrade: Need to upgrade myself (mgr.smithi164.oejajr) 2024-04-20T21:58:01.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:01 smithi164 ceph-mon[23506]: Upgrade: Need to upgrade myself (mgr.smithi164.oejajr) 2024-04-20T21:58:01.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:01 smithi164 ceph-mon[23506]: pgmap v22: 65 pgs: 65 active+clean; 146 MiB data, 718 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s wr, 264 op/s 2024-04-20T21:58:01.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:01 smithi164 ceph-mon[23506]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:58:01.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.938+0000 7f8b9aa00700 1 -- 172.21.15.142:0/3596518012 --> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b74000bc0 con 0x7f8b7806dc40 2024-04-20T21:58:01.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.943+0000 7f8b90c00700 1 -- 172.21.15.142:0/3596518012 <== mgr.24359 v2:172.21.15.164:6828/929524464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f8b74000bc0 con 0x7f8b7806dc40 2024-04-20T21:58:01.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.945+0000 7f8b9aa00700 1 -- 172.21.15.142:0/3596518012 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8b7806dc40 msgr2=0x7f8b78070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:01.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.945+0000 7f8b9aa00700 1 --2- 172.21.15.142:0/3596518012 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8b7806dc40 0x7f8b78070100 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400bd70 tx=0x7f8b8400b4a0 comp rx=0 tx=0).stop 2024-04-20T21:58:01.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.945+0000 7f8b9aa00700 1 -- 172.21.15.142:0/3596518012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b94192e90 msgr2=0x7f8b9418f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:01.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.945+0000 7f8b9aa00700 1 --2- 172.21.15.142:0/3596518012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b94192e90 0x7f8b9418f400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8b80008000 tx=0x7f8b8000bd70 comp rx=0 tx=0).stop 2024-04-20T21:58:01.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.946+0000 7f8b9aa00700 1 -- 172.21.15.142:0/3596518012 shutdown_connections 2024-04-20T21:58:01.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.946+0000 7f8b9aa00700 1 --2- 172.21.15.142:0/3596518012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b940ffaf0 0x7f8b94192950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:01.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.946+0000 7f8b9aa00700 1 --2- 172.21.15.142:0/3596518012 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8b7806dc40 0x7f8b78070100 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:01.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.946+0000 7f8b9aa00700 1 --2- 172.21.15.142:0/3596518012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b94192e90 0x7f8b9418f400 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:01.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.946+0000 7f8b9aa00700 1 -- 172.21.15.142:0/3596518012 >> 172.21.15.142:0/3596518012 conn(0x7f8b940fb0d0 msgr2=0x7f8b94102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:01.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.946+0000 7f8b9aa00700 1 -- 172.21.15.142:0/3596518012 shutdown_connections 2024-04-20T21:58:01.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:01.946+0000 7f8b9aa00700 1 -- 172.21.15.142:0/3596518012 wait complete. 2024-04-20T21:58:02.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.134+0000 7f6d15600700 1 -- 172.21.15.142:0/882078545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d10102e20 msgr2=0x7f6d10103240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:02.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.134+0000 7f6d15600700 1 --2- 172.21.15.142:0/882078545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d10102e20 0x7f6d10103240 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6d00009870 tx=0x7f6d00009b80 comp rx=0 tx=0).stop 2024-04-20T21:58:02.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.134+0000 7f6d15600700 1 -- 172.21.15.142:0/882078545 shutdown_connections 2024-04-20T21:58:02.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.134+0000 7f6d15600700 1 --2- 172.21.15.142:0/882078545 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d10103f80 0x7f6d10104400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:02.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.134+0000 7f6d15600700 1 --2- 172.21.15.142:0/882078545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d10102e20 0x7f6d10103240 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:02.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.134+0000 7f6d15600700 1 -- 172.21.15.142:0/882078545 >> 172.21.15.142:0/882078545 conn(0x7f6d100fe3a0 msgr2=0x7f6d10100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:02.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.134+0000 7f6d15600700 1 -- 172.21.15.142:0/882078545 shutdown_connections 2024-04-20T21:58:02.134 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.134+0000 7f6d15600700 1 -- 172.21.15.142:0/882078545 wait complete. 2024-04-20T21:58:02.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.136+0000 7f6d15600700 1 Processor -- start 2024-04-20T21:58:02.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.136+0000 7f6d15600700 1 -- start start 2024-04-20T21:58:02.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.136+0000 7f6d15600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d10102e20 0x7f6d10078bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:02.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.136+0000 7f6d15600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d10103f80 0x7f6d10079130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:02.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.136+0000 7f6d15600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d10075780 con 0x7f6d10102e20 2024-04-20T21:58:02.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.136+0000 7f6d15600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d100758c0 con 0x7f6d10103f80 2024-04-20T21:58:02.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.137+0000 7f6d0ea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d10102e20 0x7f6d10078bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:02.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.137+0000 7f6d0ea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d10102e20 0x7f6d10078bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47124/0 (socket says 172.21.15.142:47124) 2024-04-20T21:58:02.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.137+0000 7f6d0e000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d10103f80 0x7f6d10079130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:02.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.137+0000 7f6d0e000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d10103f80 0x7f6d10079130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:55316/0 (socket says 172.21.15.142:55316) 2024-04-20T21:58:02.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.137+0000 7f6d0e000700 1 -- 172.21.15.142:0/3570018015 learned_addr learned my addr 172.21.15.142:0/3570018015 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:58:02.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.138+0000 7f6d0ea00700 1 -- 172.21.15.142:0/3570018015 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d10103f80 msgr2=0x7f6d10079130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:02.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.138+0000 7f6d0ea00700 1 --2- 172.21.15.142:0/3570018015 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d10103f80 0x7f6d10079130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:02.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.138+0000 7f6d0ea00700 1 -- 172.21.15.142:0/3570018015 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d00009520 con 0x7f6d10102e20 2024-04-20T21:58:02.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.138+0000 7f6d0ea00700 1 --2- 172.21.15.142:0/3570018015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d10102e20 0x7f6d10078bf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6d00000c00 tx=0x7f6d0000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:02.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.138+0000 7f6d07400700 1 -- 172.21.15.142:0/3570018015 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d0001c070 con 0x7f6d10102e20 2024-04-20T21:58:02.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.138+0000 7f6d07400700 1 -- 172.21.15.142:0/3570018015 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d0000be40 con 0x7f6d10102e20 2024-04-20T21:58:02.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.138+0000 7f6d07400700 1 -- 172.21.15.142:0/3570018015 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d00022dd0 con 0x7f6d10102e20 2024-04-20T21:58:02.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.139+0000 7f6d15600700 1 -- 172.21.15.142:0/3570018015 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d10075af0 con 0x7f6d10102e20 2024-04-20T21:58:02.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.139+0000 7f6d15600700 1 -- 172.21.15.142:0/3570018015 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d10076030 con 0x7f6d10102e20 2024-04-20T21:58:02.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.141+0000 7f6d15600700 1 -- 172.21.15.142:0/3570018015 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d10192920 con 0x7f6d10102e20 2024-04-20T21:58:02.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.143+0000 7f6d07400700 1 -- 172.21.15.142:0/3570018015 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 24) v1 ==== 91832+0+0 (secure 0 0 0) 0x7f6d00020070 con 0x7f6d10102e20 2024-04-20T21:58:02.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.144+0000 7f6d07400700 1 --2- 172.21.15.142:0/3570018015 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f6cf406dd50 0x7f6cf4070210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:02.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.144+0000 7f6d07400700 1 -- 172.21.15.142:0/3570018015 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f6d0008e700 con 0x7f6d10102e20 2024-04-20T21:58:02.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.145+0000 7f6d0e000700 1 --2- 172.21.15.142:0/3570018015 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f6cf406dd50 0x7f6cf4070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:02.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.146+0000 7f6d0e000700 1 --2- 172.21.15.142:0/3570018015 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f6cf406dd50 0x7f6cf4070210 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc005950 tx=0x7f6cfc009310 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:02.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.150+0000 7f6d07400700 1 -- 172.21.15.142:0/3570018015 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f6d0005b5d0 con 0x7f6d10102e20 2024-04-20T21:58:02.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.463+0000 7f6d15600700 1 -- 172.21.15.142:0/3570018015 --> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d10061320 con 0x7f6cf406dd50 2024-04-20T21:58:02.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.488+0000 7f6d07400700 1 -- 172.21.15.142:0/3570018015 <== mgr.24359 v2:172.21.15.164:6828/929524464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f6d10061320 con 0x7f6cf406dd50 2024-04-20T21:58:02.489 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T21:58:02.489 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (8m) 25s ago 10m 13.5M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T21:58:02.489 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (10m) 25s ago 10m 7792k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T21:58:02.489 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (9m) 27s ago 9m 7440k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T21:58:02.489 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (10m) 25s ago 10m 6665k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 56f2e41784f8 2024-04-20T21:58:02.490 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (9m) 27s ago 9m 6660k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 bce67525dd3e 2024-04-20T21:58:02.490 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (8m) 25s ago 10m 75.1M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T21:58:02.490 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (3m) 25s ago 3m 108M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 b68e279d7945 2024-04-20T21:58:02.490 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (3m) 25s ago 3m 13.4M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T21:58:02.490 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (3m) 27s ago 3m 13.5M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T21:58:02.490 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (3m) 27s ago 3m 13.6M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T21:58:02.490 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:9283,8765,8443 running (12m) 25s ago 12m 322M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d2c979afd250 2024-04-20T21:58:02.490 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (61s) 27s ago 9m 492M - 19.0.0-3133-ga8c84f59 76bc6b91b726 b8f1c0f4899b 2024-04-20T21:58:02.490 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (12m) 25s ago 12m 50.4M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c076f7eb00ea 2024-04-20T21:58:02.490 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (9m) 27s ago 9m 39.5M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 2bacdeb02ee0 2024-04-20T21:58:02.490 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (10m) 25s ago 10m 8074k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T21:58:02.490 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (9m) 27s ago 9m 8006k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T21:58:02.490 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (8m) 25s ago 8m 81.3M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4361ae428e0d 2024-04-20T21:58:02.490 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (7m) 25s ago 7m 86.2M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 dd7e7cf8e8e1 2024-04-20T21:58:02.490 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (7m) 25s ago 6m 82.7M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 8e9165365127 2024-04-20T21:58:02.491 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (6m) 27s ago 6m 98.6M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c081911f56ab 2024-04-20T21:58:02.491 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (5m) 27s ago 5m 86.6M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 39e09d63d44f 2024-04-20T21:58:02.491 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (5m) 27s ago 5m 83.9M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4f36124aeb0d 2024-04-20T21:58:02.491 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 starting - - - - 2024-04-20T21:58:02.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.492+0000 7f6d15600700 1 -- 172.21.15.142:0/3570018015 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f6cf406dd50 msgr2=0x7f6cf4070210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:02.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.492+0000 7f6d15600700 1 --2- 172.21.15.142:0/3570018015 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f6cf406dd50 0x7f6cf4070210 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc005950 tx=0x7f6cfc009310 comp rx=0 tx=0).stop 2024-04-20T21:58:02.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.492+0000 7f6d15600700 1 -- 172.21.15.142:0/3570018015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d10102e20 msgr2=0x7f6d10078bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:02.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.492+0000 7f6d15600700 1 --2- 172.21.15.142:0/3570018015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d10102e20 0x7f6d10078bf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6d00000c00 tx=0x7f6d0000f690 comp rx=0 tx=0).stop 2024-04-20T21:58:02.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.492+0000 7f6d15600700 1 -- 172.21.15.142:0/3570018015 shutdown_connections 2024-04-20T21:58:02.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.492+0000 7f6d15600700 1 --2- 172.21.15.142:0/3570018015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d10102e20 0x7f6d10078bf0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:02.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.492+0000 7f6d15600700 1 --2- 172.21.15.142:0/3570018015 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f6cf406dd50 0x7f6cf4070210 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:02.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.492+0000 7f6d15600700 1 --2- 172.21.15.142:0/3570018015 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d10103f80 0x7f6d10079130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:02.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.492+0000 7f6d15600700 1 -- 172.21.15.142:0/3570018015 >> 172.21.15.142:0/3570018015 conn(0x7f6d100fe3a0 msgr2=0x7f6d10107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:02.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.492+0000 7f6d15600700 1 -- 172.21.15.142:0/3570018015 shutdown_connections 2024-04-20T21:58:02.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.493+0000 7f6d15600700 1 -- 172.21.15.142:0/3570018015 wait complete. 2024-04-20T21:58:02.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.685+0000 7fdc67e00700 1 -- 172.21.15.142:0/1584625198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc600ff470 msgr2=0x7fdc600ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:02.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.685+0000 7fdc67e00700 1 --2- 172.21.15.142:0/1584625198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc600ff470 0x7fdc600ff890 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdc54009910 tx=0x7fdc54009c20 comp rx=0 tx=0).stop 2024-04-20T21:58:02.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.685+0000 7fdc67e00700 1 -- 172.21.15.142:0/1584625198 shutdown_connections 2024-04-20T21:58:02.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.685+0000 7fdc67e00700 1 --2- 172.21.15.142:0/1584625198 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc600ffdd0 0x7fdc60100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:02.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.685+0000 7fdc67e00700 1 --2- 172.21.15.142:0/1584625198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc600ff470 0x7fdc600ff890 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:02.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.685+0000 7fdc67e00700 1 -- 172.21.15.142:0/1584625198 >> 172.21.15.142:0/1584625198 conn(0x7fdc600fb0d0 msgr2=0x7fdc600fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:02.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.685+0000 7fdc67e00700 1 -- 172.21.15.142:0/1584625198 shutdown_connections 2024-04-20T21:58:02.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.686+0000 7fdc67e00700 1 -- 172.21.15.142:0/1584625198 wait complete. 2024-04-20T21:58:02.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.687+0000 7fdc67e00700 1 Processor -- start 2024-04-20T21:58:02.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.687+0000 7fdc67e00700 1 -- start start 2024-04-20T21:58:02.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.687+0000 7fdc67e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc600ff470 0x7fdc60198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:02.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.687+0000 7fdc67e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc600ffdd0 0x7fdc60198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:02.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.687+0000 7fdc67e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc60199380 con 0x7fdc600ffdd0 2024-04-20T21:58:02.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.687+0000 7fdc67e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc601994c0 con 0x7fdc600ff470 2024-04-20T21:58:02.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.688+0000 7fdc64a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc600ffdd0 0x7fdc60198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:02.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.688+0000 7fdc64a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc600ffdd0 0x7fdc60198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47134/0 (socket says 172.21.15.142:47134) 2024-04-20T21:58:02.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.688+0000 7fdc64a00700 1 -- 172.21.15.142:0/1679219861 learned_addr learned my addr 172.21.15.142:0/1679219861 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:58:02.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.688+0000 7fdc65400700 1 --2- 172.21.15.142:0/1679219861 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc600ff470 0x7fdc60198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:02.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.688+0000 7fdc64a00700 1 -- 172.21.15.142:0/1679219861 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc600ff470 msgr2=0x7fdc60198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:02.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.688+0000 7fdc64a00700 1 --2- 172.21.15.142:0/1679219861 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc600ff470 0x7fdc60198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:02.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.688+0000 7fdc64a00700 1 -- 172.21.15.142:0/1679219861 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc540095f0 con 0x7fdc600ffdd0 2024-04-20T21:58:02.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.688+0000 7fdc64a00700 1 --2- 172.21.15.142:0/1679219861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc600ffdd0 0x7fdc60198d60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00e920 tx=0x7fdc4c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:02.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.689+0000 7fdc5e000700 1 -- 172.21.15.142:0/1679219861 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc4c009790 con 0x7fdc600ffdd0 2024-04-20T21:58:02.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.689+0000 7fdc5e000700 1 -- 172.21.15.142:0/1679219861 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdc4c00cba0 con 0x7fdc600ffdd0 2024-04-20T21:58:02.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.689+0000 7fdc5e000700 1 -- 172.21.15.142:0/1679219861 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc4c018650 con 0x7fdc600ffdd0 2024-04-20T21:58:02.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.689+0000 7fdc67e00700 1 -- 172.21.15.142:0/1679219861 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc6019ded0 con 0x7fdc600ffdd0 2024-04-20T21:58:02.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.689+0000 7fdc67e00700 1 -- 172.21.15.142:0/1679219861 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6019e470 con 0x7fdc600ffdd0 2024-04-20T21:58:02.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.691+0000 7fdc67e00700 1 -- 172.21.15.142:0/1679219861 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc60192960 con 0x7fdc600ffdd0 2024-04-20T21:58:02.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.692+0000 7fdc5e000700 1 -- 172.21.15.142:0/1679219861 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 24) v1 ==== 91832+0+0 (secure 0 0 0) 0x7fdc4c00cd10 con 0x7fdc600ffdd0 2024-04-20T21:58:02.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.694+0000 7fdc5e000700 1 --2- 172.21.15.142:0/1679219861 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fdc4806dc40 0x7fdc48070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:02.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.694+0000 7fdc5e000700 1 -- 172.21.15.142:0/1679219861 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fdc4c014070 con 0x7fdc600ffdd0 2024-04-20T21:58:02.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.694+0000 7fdc65400700 1 --2- 172.21.15.142:0/1679219861 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fdc4806dc40 0x7fdc48070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:02.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.696+0000 7fdc65400700 1 --2- 172.21.15.142:0/1679219861 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fdc4806dc40 0x7fdc48070100 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdc54006010 tx=0x7fdc54009f70 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:02.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:02.699+0000 7fdc5e000700 1 -- 172.21.15.142:0/1679219861 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fdc4c053f60 con 0x7fdc600ffdd0 2024-04-20T21:58:02.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:02 smithi142 ceph-mon[15828]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:58:02.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:02 smithi142 ceph-mon[15828]: pgmap v23: 65 pgs: 65 active+clean; 146 MiB data, 718 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s wr, 209 op/s 2024-04-20T21:58:02.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:02 smithi164 ceph-mon[23506]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:58:02.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:02 smithi164 ceph-mon[23506]: pgmap v23: 65 pgs: 65 active+clean; 146 MiB data, 718 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s wr, 209 op/s 2024-04-20T21:58:03.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.152+0000 7fdc67e00700 1 -- 172.21.15.142:0/1679219861 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdc6010b940 con 0x7fdc600ffdd0 2024-04-20T21:58:03.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.153+0000 7fdc5e000700 1 -- 172.21.15.142:0/1679219861 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+841 (secure 0 0 0) 0x7fdc4c05a650 con 0x7fdc600ffdd0 2024-04-20T21:58:03.154 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T21:58:03.155 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T21:58:03.155 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 2 2024-04-20T21:58:03.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:58:03.155 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T21:58:03.155 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 1, 2024-04-20T21:58:03.155 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 1 2024-04-20T21:58:03.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:58:03.155 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T21:58:03.155 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 6 2024-04-20T21:58:03.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:58:03.155 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T21:58:03.155 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4 2024-04-20T21:58:03.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:58:03.155 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T21:58:03.156 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 13, 2024-04-20T21:58:03.156 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 1 2024-04-20T21:58:03.156 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T21:58:03.156 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T21:58:03.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.157+0000 7fdc67e00700 1 -- 172.21.15.142:0/1679219861 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fdc4806dc40 msgr2=0x7fdc48070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:03.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.157+0000 7fdc67e00700 1 --2- 172.21.15.142:0/1679219861 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fdc4806dc40 0x7fdc48070100 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdc54006010 tx=0x7fdc54009f70 comp rx=0 tx=0).stop 2024-04-20T21:58:03.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.157+0000 7fdc67e00700 1 -- 172.21.15.142:0/1679219861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc600ffdd0 msgr2=0x7fdc60198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:03.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.157+0000 7fdc67e00700 1 --2- 172.21.15.142:0/1679219861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc600ffdd0 0x7fdc60198d60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00e920 tx=0x7fdc4c00ece0 comp rx=0 tx=0).stop 2024-04-20T21:58:03.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.157+0000 7fdc67e00700 1 -- 172.21.15.142:0/1679219861 shutdown_connections 2024-04-20T21:58:03.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.157+0000 7fdc67e00700 1 --2- 172.21.15.142:0/1679219861 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fdc4806dc40 0x7fdc48070100 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:03.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.157+0000 7fdc67e00700 1 --2- 172.21.15.142:0/1679219861 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc600ff470 0x7fdc60198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:03.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.157+0000 7fdc67e00700 1 --2- 172.21.15.142:0/1679219861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc600ffdd0 0x7fdc60198d60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:03.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.157+0000 7fdc67e00700 1 -- 172.21.15.142:0/1679219861 >> 172.21.15.142:0/1679219861 conn(0x7fdc600fb0d0 msgr2=0x7fdc60107e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:03.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.157+0000 7fdc67e00700 1 -- 172.21.15.142:0/1679219861 shutdown_connections 2024-04-20T21:58:03.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.157+0000 7fdc67e00700 1 -- 172.21.15.142:0/1679219861 wait complete. 2024-04-20T21:58:03.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.340+0000 7f8ace200700 1 -- 172.21.15.142:0/2150805700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac8074f10 msgr2=0x7f8ac8073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:03.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.340+0000 7f8ace200700 1 --2- 172.21.15.142:0/2150805700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac8074f10 0x7f8ac8073370 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009910 tx=0x7f8ab8009c20 comp rx=0 tx=0).stop 2024-04-20T21:58:03.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.340+0000 7f8ace200700 1 -- 172.21.15.142:0/2150805700 shutdown_connections 2024-04-20T21:58:03.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.340+0000 7f8ace200700 1 --2- 172.21.15.142:0/2150805700 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ac8073940 0x7f8ac8073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:03.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.340+0000 7f8ace200700 1 --2- 172.21.15.142:0/2150805700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac8074f10 0x7f8ac8073370 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:03.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.340+0000 7f8ace200700 1 -- 172.21.15.142:0/2150805700 >> 172.21.15.142:0/2150805700 conn(0x7f8ac80fc1d0 msgr2=0x7f8ac80fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:03.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.340+0000 7f8ace200700 1 -- 172.21.15.142:0/2150805700 shutdown_connections 2024-04-20T21:58:03.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.340+0000 7f8ace200700 1 -- 172.21.15.142:0/2150805700 wait complete. 2024-04-20T21:58:03.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.341+0000 7f8ace200700 1 Processor -- start 2024-04-20T21:58:03.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.341+0000 7f8ace200700 1 -- start start 2024-04-20T21:58:03.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.341+0000 7f8ace200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ac8073940 0x7f8ac81988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:03.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.342+0000 7f8ace200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac8074f10 0x7f8ac8198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:03.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.342+0000 7f8ace200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac8199400 con 0x7f8ac8074f10 2024-04-20T21:58:03.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.342+0000 7f8ace200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac819dd60 con 0x7f8ac8073940 2024-04-20T21:58:03.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.342+0000 7f8ac6a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac8074f10 0x7f8ac8198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:03.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.342+0000 7f8ac6a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac8074f10 0x7f8ac8198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47142/0 (socket says 172.21.15.142:47142) 2024-04-20T21:58:03.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.342+0000 7f8ac7400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ac8073940 0x7f8ac81988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:03.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.342+0000 7f8ac6a00700 1 -- 172.21.15.142:0/2164316159 learned_addr learned my addr 172.21.15.142:0/2164316159 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:58:03.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.343+0000 7f8ac6a00700 1 -- 172.21.15.142:0/2164316159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ac8073940 msgr2=0x7f8ac81988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:03.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.343+0000 7f8ac6a00700 1 --2- 172.21.15.142:0/2164316159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ac8073940 0x7f8ac81988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:03.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.343+0000 7f8ac6a00700 1 -- 172.21.15.142:0/2164316159 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab80095f0 con 0x7f8ac8074f10 2024-04-20T21:58:03.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.343+0000 7f8ac6a00700 1 --2- 172.21.15.142:0/2164316159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac8074f10 0x7f8ac8198de0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400c8f0 tx=0x7f8ab400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:03.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.343+0000 7f8abfe00700 1 -- 172.21.15.142:0/2164316159 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ab40078e0 con 0x7f8ac8074f10 2024-04-20T21:58:03.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.343+0000 7f8abfe00700 1 -- 172.21.15.142:0/2164316159 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ab400f450 con 0x7f8ac8074f10 2024-04-20T21:58:03.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.343+0000 7f8abfe00700 1 -- 172.21.15.142:0/2164316159 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ab4018610 con 0x7f8ac8074f10 2024-04-20T21:58:03.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.344+0000 7f8ace200700 1 -- 172.21.15.142:0/2164316159 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac819df60 con 0x7f8ac8074f10 2024-04-20T21:58:03.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.344+0000 7f8ace200700 1 -- 172.21.15.142:0/2164316159 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac819e4b0 con 0x7f8ac8074f10 2024-04-20T21:58:03.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.345+0000 7f8ace200700 1 -- 172.21.15.142:0/2164316159 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac81929a0 con 0x7f8ac8074f10 2024-04-20T21:58:03.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.347+0000 7f8abfe00700 1 -- 172.21.15.142:0/2164316159 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 24) v1 ==== 91832+0+0 (secure 0 0 0) 0x7f8ab400f5c0 con 0x7f8ac8074f10 2024-04-20T21:58:03.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.348+0000 7f8abfe00700 1 --2- 172.21.15.142:0/2164316159 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8aac06dc40 0x7f8aac070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:03.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.349+0000 7f8abfe00700 1 -- 172.21.15.142:0/2164316159 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f8ab408d660 con 0x7f8ac8074f10 2024-04-20T21:58:03.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.349+0000 7f8ac7400700 1 --2- 172.21.15.142:0/2164316159 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8aac06dc40 0x7f8aac070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:03.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.350+0000 7f8ac7400700 1 --2- 172.21.15.142:0/2164316159 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8aac06dc40 0x7f8aac070100 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009fd0 tx=0x7f8ab8005180 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:03.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.357+0000 7f8abfe00700 1 -- 172.21.15.142:0/2164316159 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f8ab4056860 con 0x7f8ac8074f10 2024-04-20T21:58:03.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.736+0000 7f8ace200700 1 -- 172.21.15.142:0/2164316159 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8ac810b9d0 con 0x7f8ac8074f10 2024-04-20T21:58:03.735 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:03 smithi142 ceph-mon[15828]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:58:03.735 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:03 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1679219861' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T21:58:03.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.736+0000 7f8abfe00700 1 -- 172.21.15.142:0/2164316159 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1853 (secure 0 0 0) 0x7f8ab4059f20 con 0x7f8ac8074f10 2024-04-20T21:58:03.737 INFO:teuthology.orchestra.run.smithi142.stdout:e12 2024-04-20T21:58:03.737 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T21:58:03.737 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:58:03.737 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T21:58:03.737 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:58:03.737 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T21:58:03.737 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T21:58:03.737 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 12 2024-04-20T21:58:03.737 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T21:58:03.737 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T21:58:03.737 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:51.692699+0000 2024-04-20T21:58:03.737 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T21:58:03.737 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T21:58:03.737 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T21:58:03.738 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T21:58:03.738 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T21:58:03.738 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T21:58:03.738 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T21:58:03.738 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T21:58:03.738 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T21:58:03.738 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:58:03.738 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T21:58:03.738 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T21:58:03.738 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T21:58:03.738 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T21:58:03.738 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T21:58:03.738 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T21:58:03.739 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T21:58:03.739 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T21:58:03.739 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T21:58:03.739 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T21:58:03.739 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T21:58:03.739 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T21:58:03.739 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:58:03.739 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:58:03.739 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:58:03.739 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T21:58:03.739 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:58:03.739 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:58:03.739 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:58:03.739 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:58:03.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.739+0000 7f8ace200700 1 -- 172.21.15.142:0/2164316159 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8aac06dc40 msgr2=0x7f8aac070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:03.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.739+0000 7f8ace200700 1 --2- 172.21.15.142:0/2164316159 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8aac06dc40 0x7f8aac070100 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009fd0 tx=0x7f8ab8005180 comp rx=0 tx=0).stop 2024-04-20T21:58:03.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.740+0000 7f8ace200700 1 -- 172.21.15.142:0/2164316159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac8074f10 msgr2=0x7f8ac8198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:03.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.740+0000 7f8ace200700 1 --2- 172.21.15.142:0/2164316159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac8074f10 0x7f8ac8198de0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400c8f0 tx=0x7f8ab400cc00 comp rx=0 tx=0).stop 2024-04-20T21:58:03.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.740+0000 7f8ace200700 1 -- 172.21.15.142:0/2164316159 shutdown_connections 2024-04-20T21:58:03.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.740+0000 7f8ace200700 1 --2- 172.21.15.142:0/2164316159 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8aac06dc40 0x7f8aac070100 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:03.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.740+0000 7f8ace200700 1 --2- 172.21.15.142:0/2164316159 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ac8073940 0x7f8ac81988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:03.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.740+0000 7f8ace200700 1 --2- 172.21.15.142:0/2164316159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ac8074f10 0x7f8ac8198de0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:03.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.740+0000 7f8ace200700 1 -- 172.21.15.142:0/2164316159 >> 172.21.15.142:0/2164316159 conn(0x7f8ac80fc1d0 msgr2=0x7f8ac8106e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:03.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.740+0000 7f8ace200700 1 -- 172.21.15.142:0/2164316159 shutdown_connections 2024-04-20T21:58:03.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.740+0000 7f8ace200700 1 -- 172.21.15.142:0/2164316159 wait complete. 2024-04-20T21:58:03.742 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T21:58:03.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:03 smithi164 ceph-mon[23506]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:58:03.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:03 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/1679219861' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T21:58:03.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.952+0000 7f8d8be00700 1 -- 172.21.15.142:0/1864743502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d84100c00 msgr2=0x7f8d84101020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:03.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.952+0000 7f8d8be00700 1 --2- 172.21.15.142:0/1864743502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d84100c00 0x7f8d84101020 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8d78009910 tx=0x7f8d78009c20 comp rx=0 tx=0).stop 2024-04-20T21:58:03.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.952+0000 7f8d8be00700 1 -- 172.21.15.142:0/1864743502 shutdown_connections 2024-04-20T21:58:03.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.952+0000 7f8d8be00700 1 --2- 172.21.15.142:0/1864743502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d84101e00 0x7f8d84102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:03.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.952+0000 7f8d8be00700 1 --2- 172.21.15.142:0/1864743502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d84100c00 0x7f8d84101020 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:03.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.952+0000 7f8d8be00700 1 -- 172.21.15.142:0/1864743502 >> 172.21.15.142:0/1864743502 conn(0x7f8d840fc1c0 msgr2=0x7f8d840fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:03.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.952+0000 7f8d8be00700 1 -- 172.21.15.142:0/1864743502 shutdown_connections 2024-04-20T21:58:03.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.953+0000 7f8d8be00700 1 -- 172.21.15.142:0/1864743502 wait complete. 2024-04-20T21:58:03.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.954+0000 7f8d8be00700 1 Processor -- start 2024-04-20T21:58:03.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.954+0000 7f8d8be00700 1 -- start start 2024-04-20T21:58:03.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.955+0000 7f8d8be00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d84100c00 0x7f8d84194460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:03.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.955+0000 7f8d8be00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d84101e00 0x7f8d841949a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:03.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.955+0000 7f8d8be00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d84194fc0 con 0x7f8d84101e00 2024-04-20T21:58:03.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.955+0000 7f8d8be00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d84195100 con 0x7f8d84100c00 2024-04-20T21:58:03.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.955+0000 7f8d88a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d84101e00 0x7f8d841949a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:03.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.955+0000 7f8d88a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d84101e00 0x7f8d841949a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47172/0 (socket says 172.21.15.142:47172) 2024-04-20T21:58:03.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.955+0000 7f8d88a00700 1 -- 172.21.15.142:0/2783047776 learned_addr learned my addr 172.21.15.142:0/2783047776 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:58:03.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.956+0000 7f8d88a00700 1 -- 172.21.15.142:0/2783047776 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d84100c00 msgr2=0x7f8d84194460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:03.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.956+0000 7f8d88a00700 1 --2- 172.21.15.142:0/2783047776 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d84100c00 0x7f8d84194460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:03.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.956+0000 7f8d88a00700 1 -- 172.21.15.142:0/2783047776 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d780095f0 con 0x7f8d84101e00 2024-04-20T21:58:03.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.956+0000 7f8d88a00700 1 --2- 172.21.15.142:0/2783047776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d84101e00 0x7f8d841949a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000d8d0 tx=0x7f8d7000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:03.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.956+0000 7f8d82000700 1 -- 172.21.15.142:0/2783047776 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d70009940 con 0x7f8d84101e00 2024-04-20T21:58:03.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.957+0000 7f8d82000700 1 -- 172.21.15.142:0/2783047776 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d70010460 con 0x7f8d84101e00 2024-04-20T21:58:03.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.957+0000 7f8d8be00700 1 -- 172.21.15.142:0/2783047776 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d84199b10 con 0x7f8d84101e00 2024-04-20T21:58:03.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.957+0000 7f8d82000700 1 -- 172.21.15.142:0/2783047776 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d7000f5f0 con 0x7f8d84101e00 2024-04-20T21:58:03.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.958+0000 7f8d8be00700 1 -- 172.21.15.142:0/2783047776 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8419a0e0 con 0x7f8d84101e00 2024-04-20T21:58:03.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.959+0000 7f8d8be00700 1 -- 172.21.15.142:0/2783047776 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d84062510 con 0x7f8d84101e00 2024-04-20T21:58:03.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.960+0000 7f8d82000700 1 -- 172.21.15.142:0/2783047776 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 24) v1 ==== 91832+0+0 (secure 0 0 0) 0x7f8d700105d0 con 0x7f8d84101e00 2024-04-20T21:58:03.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.961+0000 7f8d82000700 1 --2- 172.21.15.142:0/2783047776 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8d6c06dc40 0x7f8d6c070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:03.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.961+0000 7f8d82000700 1 -- 172.21.15.142:0/2783047776 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f8d7008ee30 con 0x7f8d84101e00 2024-04-20T21:58:03.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.962+0000 7f8d89400700 1 --2- 172.21.15.142:0/2783047776 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8d6c06dc40 0x7f8d6c070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:03.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.963+0000 7f8d89400700 1 --2- 172.21.15.142:0/2783047776 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8d6c06dc40 0x7f8d6c070100 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8d780051c0 tx=0x7f8d78005fd0 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:03.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:03.969+0000 7f8d82000700 1 -- 172.21.15.142:0/2783047776 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f8d70092060 con 0x7f8d84101e00 2024-04-20T21:58:04.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.317+0000 7f8d8be00700 1 -- 172.21.15.142:0/2783047776 --> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d8402d050 con 0x7f8d6c06dc40 2024-04-20T21:58:04.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.320+0000 7f8d82000700 1 -- 172.21.15.142:0/2783047776 <== mgr.24359 v2:172.21.15.164:6828/929524464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f8d8402d050 con 0x7f8d6c06dc40 2024-04-20T21:58:04.320 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T21:58:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T21:58:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T21:58:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T21:58:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [], 2024-04-20T21:58:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "1/23 daemons upgraded", 2024-04-20T21:58:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading mgr daemons", 2024-04-20T21:58:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T21:58:04.320 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T21:58:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.323+0000 7f8d8be00700 1 -- 172.21.15.142:0/2783047776 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8d6c06dc40 msgr2=0x7f8d6c070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.323+0000 7f8d8be00700 1 --2- 172.21.15.142:0/2783047776 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8d6c06dc40 0x7f8d6c070100 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8d780051c0 tx=0x7f8d78005fd0 comp rx=0 tx=0).stop 2024-04-20T21:58:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.323+0000 7f8d8be00700 1 -- 172.21.15.142:0/2783047776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d84101e00 msgr2=0x7f8d841949a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:04.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.323+0000 7f8d8be00700 1 --2- 172.21.15.142:0/2783047776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d84101e00 0x7f8d841949a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000d8d0 tx=0x7f8d7000dc90 comp rx=0 tx=0).stop 2024-04-20T21:58:04.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.324+0000 7f8d8be00700 1 -- 172.21.15.142:0/2783047776 shutdown_connections 2024-04-20T21:58:04.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.324+0000 7f8d8be00700 1 --2- 172.21.15.142:0/2783047776 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f8d6c06dc40 0x7f8d6c070100 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:04.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.324+0000 7f8d8be00700 1 --2- 172.21.15.142:0/2783047776 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d84100c00 0x7f8d84194460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:04.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.324+0000 7f8d8be00700 1 --2- 172.21.15.142:0/2783047776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d84101e00 0x7f8d841949a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:04.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.324+0000 7f8d8be00700 1 -- 172.21.15.142:0/2783047776 >> 172.21.15.142:0/2783047776 conn(0x7f8d840fc1c0 msgr2=0x7f8d840734e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:04.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.324+0000 7f8d8be00700 1 -- 172.21.15.142:0/2783047776 shutdown_connections 2024-04-20T21:58:04.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.324+0000 7f8d8be00700 1 -- 172.21.15.142:0/2783047776 wait complete. 2024-04-20T21:58:04.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.512+0000 7ff125e00700 1 -- 172.21.15.142:0/3802030868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1200ffe70 msgr2=0x7ff1201002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:04.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.512+0000 7ff125e00700 1 --2- 172.21.15.142:0/3802030868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1200ffe70 0x7ff1201002f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff10c009910 tx=0x7ff10c009c20 comp rx=0 tx=0).stop 2024-04-20T21:58:04.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.512+0000 7ff125e00700 1 -- 172.21.15.142:0/3802030868 shutdown_connections 2024-04-20T21:58:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.512+0000 7ff125e00700 1 --2- 172.21.15.142:0/3802030868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1200ffe70 0x7ff1201002f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.512+0000 7ff125e00700 1 --2- 172.21.15.142:0/3802030868 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1200ff510 0x7ff1200ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.512+0000 7ff125e00700 1 -- 172.21.15.142:0/3802030868 >> 172.21.15.142:0/3802030868 conn(0x7ff1200fb0d0 msgr2=0x7ff1200fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.512+0000 7ff125e00700 1 -- 172.21.15.142:0/3802030868 shutdown_connections 2024-04-20T21:58:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.512+0000 7ff125e00700 1 -- 172.21.15.142:0/3802030868 wait complete. 2024-04-20T21:58:04.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.513+0000 7ff125e00700 1 Processor -- start 2024-04-20T21:58:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.513+0000 7ff125e00700 1 -- start start 2024-04-20T21:58:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.514+0000 7ff125e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1200ff510 0x7ff1201987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.514+0000 7ff125e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1200ffe70 0x7ff120198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.514+0000 7ff125e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff120199350 con 0x7ff1200ffe70 2024-04-20T21:58:04.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.514+0000 7ff125e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff120199490 con 0x7ff1200ff510 2024-04-20T21:58:04.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.514+0000 7ff11e000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1200ffe70 0x7ff120198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:04.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.515+0000 7ff11e000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1200ffe70 0x7ff120198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47186/0 (socket says 172.21.15.142:47186) 2024-04-20T21:58:04.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.515+0000 7ff11e000700 1 -- 172.21.15.142:0/3947104834 learned_addr learned my addr 172.21.15.142:0/3947104834 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:58:04.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.515+0000 7ff11ea00700 1 --2- 172.21.15.142:0/3947104834 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1200ff510 0x7ff1201987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:04.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.515+0000 7ff11e000700 1 -- 172.21.15.142:0/3947104834 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1200ff510 msgr2=0x7ff1201987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:04.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.515+0000 7ff11e000700 1 --2- 172.21.15.142:0/3947104834 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1200ff510 0x7ff1201987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:04.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.515+0000 7ff11e000700 1 -- 172.21.15.142:0/3947104834 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c0095f0 con 0x7ff1200ffe70 2024-04-20T21:58:04.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.516+0000 7ff11e000700 1 --2- 172.21.15.142:0/3947104834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1200ffe70 0x7ff120198d30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00b650 tx=0x7ff10c005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.517+0000 7ff124a00700 1 -- 172.21.15.142:0/3947104834 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff10c01d070 con 0x7ff1200ffe70 2024-04-20T21:58:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.517+0000 7ff124a00700 1 -- 172.21.15.142:0/3947104834 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff10c0052a0 con 0x7ff1200ffe70 2024-04-20T21:58:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.517+0000 7ff124a00700 1 -- 172.21.15.142:0/3947104834 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff10c017400 con 0x7ff1200ffe70 2024-04-20T21:58:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.517+0000 7ff125e00700 1 -- 172.21.15.142:0/3947104834 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12019de40 con 0x7ff1200ffe70 2024-04-20T21:58:04.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.517+0000 7ff125e00700 1 -- 172.21.15.142:0/3947104834 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12019e380 con 0x7ff1200ffe70 2024-04-20T21:58:04.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.520+0000 7ff125e00700 1 -- 172.21.15.142:0/3947104834 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1201929b0 con 0x7ff1200ffe70 2024-04-20T21:58:04.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.522+0000 7ff124a00700 1 -- 172.21.15.142:0/3947104834 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 24) v1 ==== 91832+0+0 (secure 0 0 0) 0x7ff10c003810 con 0x7ff1200ffe70 2024-04-20T21:58:04.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.522+0000 7ff124a00700 1 --2- 172.21.15.142:0/3947104834 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7ff10406dc40 0x7ff104070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:04.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.523+0000 7ff124a00700 1 -- 172.21.15.142:0/3947104834 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7ff10c08ea40 con 0x7ff1200ffe70 2024-04-20T21:58:04.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.523+0000 7ff11ea00700 1 --2- 172.21.15.142:0/3947104834 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7ff10406dc40 0x7ff104070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:04.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.524+0000 7ff11ea00700 1 --2- 172.21.15.142:0/3947104834 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7ff10406dc40 0x7ff104070100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff110009c60 tx=0x7ff110009260 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:04.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.532+0000 7ff124a00700 1 -- 172.21.15.142:0/3947104834 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7ff10c05b810 con 0x7ff1200ffe70 2024-04-20T21:58:04.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:04 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/2164316159' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:58:04.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:04 smithi142 ceph-mon[15828]: Upgrade: Updating mgr.smithi142.zzmcfz 2024-04-20T21:58:04.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:04 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:04.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:04 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.zzmcfz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T21:58:04.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:04 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.zzmcfz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T21:58:04.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:04 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T21:58:04.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:04 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:58:04.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:04 smithi142 ceph-mon[15828]: Deploying daemon mgr.smithi142.zzmcfz on smithi142 2024-04-20T21:58:04.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:04 smithi142 ceph-mon[15828]: pgmap v24: 65 pgs: 65 active+clean; 156 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s wr, 312 op/s 2024-04-20T21:58:04.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:04 smithi142 ceph-mon[15828]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:58:04.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:04 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/2164316159' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:58:04.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:04 smithi164 ceph-mon[23506]: Upgrade: Updating mgr.smithi142.zzmcfz 2024-04-20T21:58:04.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:04 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:04.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:04 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.zzmcfz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T21:58:04.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:04 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.zzmcfz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T21:58:04.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:04 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T21:58:04.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:04 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:58:04.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:04 smithi164 ceph-mon[23506]: Deploying daemon mgr.smithi142.zzmcfz on smithi142 2024-04-20T21:58:04.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:04 smithi164 ceph-mon[23506]: pgmap v24: 65 pgs: 65 active+clean; 156 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s wr, 312 op/s 2024-04-20T21:58:04.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:04 smithi164 ceph-mon[23506]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:58:04.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.967+0000 7ff125e00700 1 -- 172.21.15.142:0/3947104834 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff12010b990 con 0x7ff1200ffe70 2024-04-20T21:58:04.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.968+0000 7ff124a00700 1 -- 172.21.15.142:0/3947104834 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff10c05b3a0 con 0x7ff1200ffe70 2024-04-20T21:58:04.969 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_OK 2024-04-20T21:58:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.971+0000 7ff125e00700 1 -- 172.21.15.142:0/3947104834 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7ff10406dc40 msgr2=0x7ff104070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.971+0000 7ff125e00700 1 --2- 172.21.15.142:0/3947104834 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7ff10406dc40 0x7ff104070100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff110009c60 tx=0x7ff110009260 comp rx=0 tx=0).stop 2024-04-20T21:58:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.971+0000 7ff125e00700 1 -- 172.21.15.142:0/3947104834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1200ffe70 msgr2=0x7ff120198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.971+0000 7ff125e00700 1 --2- 172.21.15.142:0/3947104834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1200ffe70 0x7ff120198d30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00b650 tx=0x7ff10c005f00 comp rx=0 tx=0).stop 2024-04-20T21:58:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.971+0000 7ff125e00700 1 -- 172.21.15.142:0/3947104834 shutdown_connections 2024-04-20T21:58:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.971+0000 7ff125e00700 1 --2- 172.21.15.142:0/3947104834 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7ff10406dc40 0x7ff104070100 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.971+0000 7ff125e00700 1 --2- 172.21.15.142:0/3947104834 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff1200ff510 0x7ff1201987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.971+0000 7ff125e00700 1 --2- 172.21.15.142:0/3947104834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1200ffe70 0x7ff120198d30 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.971+0000 7ff125e00700 1 -- 172.21.15.142:0/3947104834 >> 172.21.15.142:0/3947104834 conn(0x7ff1200fb0d0 msgr2=0x7ff120107ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.972+0000 7ff125e00700 1 -- 172.21.15.142:0/3947104834 shutdown_connections 2024-04-20T21:58:04.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:04.972+0000 7ff125e00700 1 -- 172.21.15.142:0/3947104834 wait complete. 2024-04-20T21:58:06.131 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:05 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/3947104834' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T21:58:06.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:05 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/3947104834' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T21:58:07.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:06 smithi142 ceph-mon[15828]: pgmap v25: 65 pgs: 65 active+clean; 156 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s wr, 210 op/s 2024-04-20T21:58:07.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:06 smithi164 ceph-mon[23506]: pgmap v25: 65 pgs: 65 active+clean; 156 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s wr, 210 op/s 2024-04-20T21:58:08.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:07 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:58:08.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:07 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:58:09.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:08 smithi164 ceph-mon[23506]: pgmap v26: 65 pgs: 65 active+clean; 170 MiB data, 841 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s wr, 310 op/s 2024-04-20T21:58:09.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:08 smithi142 ceph-mon[15828]: pgmap v26: 65 pgs: 65 active+clean; 170 MiB data, 841 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s wr, 310 op/s 2024-04-20T21:58:11.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:11 smithi142 ceph-mon[15828]: pgmap v27: 65 pgs: 65 active+clean; 170 MiB data, 841 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s wr, 226 op/s 2024-04-20T21:58:11.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:11 smithi164 ceph-mon[23506]: pgmap v27: 65 pgs: 65 active+clean; 170 MiB data, 841 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s wr, 226 op/s 2024-04-20T21:58:12.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:12 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:12 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:12 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:58:12.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:12 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:12.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:12 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:12.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:12 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:58:13.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:13 smithi142 ceph-mon[15828]: pgmap v28: 65 pgs: 65 active+clean; 170 MiB data, 841 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s wr, 202 op/s 2024-04-20T21:58:13.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:13 smithi164 ceph-mon[23506]: pgmap v28: 65 pgs: 65 active+clean; 170 MiB data, 841 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s wr, 202 op/s 2024-04-20T21:58:14.301 INFO:tasks.workunit.client.0.smithi142.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-20T21:58:14.314 INFO:tasks.workunit.client.0.smithi142.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-20T21:58:14.315 INFO:tasks.workunit.client.0.smithi142.stderr:+ make 2024-04-20T21:58:14.913 INFO:tasks.workunit.client.0.smithi142.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-20T21:58:15.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:15 smithi142 ceph-mon[15828]: pgmap v29: 65 pgs: 65 active+clean; 188 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s wr, 310 op/s 2024-04-20T21:58:15.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:15 smithi164 ceph-mon[23506]: pgmap v29: 65 pgs: 65 active+clean; 188 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s wr, 310 op/s 2024-04-20T21:58:16.198 INFO:tasks.workunit.client.0.smithi142.stderr:++ readlink -f fsstress 2024-04-20T21:58:16.203 INFO:tasks.workunit.client.0.smithi142.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-20T21:58:16.203 INFO:tasks.workunit.client.0.smithi142.stderr:+ popd 2024-04-20T21:58:16.206 INFO:tasks.workunit.client.0.smithi142.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-20T21:58:16.206 INFO:tasks.workunit.client.0.smithi142.stderr:+ popd 2024-04-20T21:58:16.208 INFO:tasks.workunit.client.0.smithi142.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-20T21:58:16.208 INFO:tasks.workunit.client.0.smithi142.stderr:++ mktemp -d -p . 2024-04-20T21:58:16.214 INFO:tasks.workunit.client.0.smithi142.stderr:+ T=./tmp.2FRQRDUOi6 2024-04-20T21:58:16.214 INFO:tasks.workunit.client.0.smithi142.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.2FRQRDUOi6 -l 1 -n 1000 -p 10 -v 2024-04-20T21:58:16.221 INFO:tasks.workunit.client.0.smithi142.stdout:seed = 1713852431 2024-04-20T21:58:16.227 INFO:tasks.workunit.client.0.smithi142.stdout:0/0: dread - no filename 2024-04-20T21:58:16.227 INFO:tasks.workunit.client.0.smithi142.stdout:0/1: chown . 5 1 2024-04-20T21:58:16.228 INFO:tasks.workunit.client.0.smithi142.stdout:0/2: write - no filename 2024-04-20T21:58:16.231 INFO:tasks.workunit.client.0.smithi142.stdout:0/3: symlink l0 0 2024-04-20T21:58:16.231 INFO:tasks.workunit.client.0.smithi142.stdout:0/4: dwrite - no filename 2024-04-20T21:58:16.231 INFO:tasks.workunit.client.0.smithi142.stdout:2/0: fsync - no filename 2024-04-20T21:58:16.233 INFO:tasks.workunit.client.0.smithi142.stdout:1/0: getdents . 0 2024-04-20T21:58:16.234 INFO:tasks.workunit.client.0.smithi142.stdout:1/1: fdatasync - no filename 2024-04-20T21:58:16.234 INFO:tasks.workunit.client.0.smithi142.stdout:1/2: dwrite - no filename 2024-04-20T21:58:16.234 INFO:tasks.workunit.client.0.smithi142.stdout:0/5: mknod c1 0 2024-04-20T21:58:16.234 INFO:tasks.workunit.client.0.smithi142.stdout:0/6: write - no filename 2024-04-20T21:58:16.234 INFO:tasks.workunit.client.0.smithi142.stdout:0/7: write - no filename 2024-04-20T21:58:16.235 INFO:tasks.workunit.client.0.smithi142.stdout:3/0: fsync - no filename 2024-04-20T21:58:16.235 INFO:tasks.workunit.client.0.smithi142.stdout:3/1: write - no filename 2024-04-20T21:58:16.235 INFO:tasks.workunit.client.0.smithi142.stdout:3/2: rename - no filename 2024-04-20T21:58:16.235 INFO:tasks.workunit.client.0.smithi142.stdout:3/3: write - no filename 2024-04-20T21:58:16.235 INFO:tasks.workunit.client.0.smithi142.stdout:2/1: creat f0 x:0 0 0 2024-04-20T21:58:16.235 INFO:tasks.workunit.client.0.smithi142.stdout:3/4: chown . 16041 1 2024-04-20T21:58:16.235 INFO:tasks.workunit.client.0.smithi142.stdout:3/5: dwrite - no filename 2024-04-20T21:58:16.235 INFO:tasks.workunit.client.0.smithi142.stdout:3/6: dread - no filename 2024-04-20T21:58:16.236 INFO:tasks.workunit.client.0.smithi142.stdout:0/8: mknod c2 0 2024-04-20T21:58:16.238 INFO:tasks.workunit.client.0.smithi142.stdout:2/2: write f0 [64633,106997] 0 2024-04-20T21:58:16.239 INFO:tasks.workunit.client.0.smithi142.stdout:4/0: unlink - no file 2024-04-20T21:58:16.239 INFO:tasks.workunit.client.0.smithi142.stdout:4/1: read - no filename 2024-04-20T21:58:16.239 INFO:tasks.workunit.client.0.smithi142.stdout:1/3: symlink l0 0 2024-04-20T21:58:16.239 INFO:tasks.workunit.client.0.smithi142.stdout:1/4: write - no filename 2024-04-20T21:58:16.239 INFO:tasks.workunit.client.0.smithi142.stdout:1/5: chown l0 22 1 2024-04-20T21:58:16.241 INFO:tasks.workunit.client.0.smithi142.stdout:0/9: symlink l3 0 2024-04-20T21:58:16.243 INFO:tasks.workunit.client.0.smithi142.stdout:5/0: readlink - no filename 2024-04-20T21:58:16.243 INFO:tasks.workunit.client.0.smithi142.stdout:3/7: creat f0 x:0 0 0 2024-04-20T21:58:16.243 INFO:tasks.workunit.client.0.smithi142.stdout:5/1: dwrite - no filename 2024-04-20T21:58:16.243 INFO:tasks.workunit.client.0.smithi142.stdout:5/2: write - no filename 2024-04-20T21:58:16.243 INFO:tasks.workunit.client.0.smithi142.stdout:2/3: mknod c1 0 2024-04-20T21:58:16.245 INFO:tasks.workunit.client.0.smithi142.stdout:3/8: write f0 [67813,85488] 0 2024-04-20T21:58:16.246 INFO:tasks.workunit.client.0.smithi142.stdout:1/6: rename l0 to l1 0 2024-04-20T21:58:16.246 INFO:tasks.workunit.client.0.smithi142.stdout:0/10: symlink l4 0 2024-04-20T21:58:16.246 INFO:tasks.workunit.client.0.smithi142.stdout:0/11: truncate - no filename 2024-04-20T21:58:16.248 INFO:tasks.workunit.client.0.smithi142.stdout:0/12: readlink l4 0 2024-04-20T21:58:16.248 INFO:tasks.workunit.client.0.smithi142.stdout:6/0: dwrite - no filename 2024-04-20T21:58:16.249 INFO:tasks.workunit.client.0.smithi142.stdout:6/1: dwrite - no filename 2024-04-20T21:58:16.249 INFO:tasks.workunit.client.0.smithi142.stdout:6/2: readlink - no filename 2024-04-20T21:58:16.249 INFO:tasks.workunit.client.0.smithi142.stdout:6/3: fsync - no filename 2024-04-20T21:58:16.249 INFO:tasks.workunit.client.0.smithi142.stdout:6/4: stat - no entries 2024-04-20T21:58:16.249 INFO:tasks.workunit.client.0.smithi142.stdout:4/2: creat f0 x:0 0 0 2024-04-20T21:58:16.250 INFO:tasks.workunit.client.0.smithi142.stdout:0/13: mkdir d5 0 2024-04-20T21:58:16.250 INFO:tasks.workunit.client.0.smithi142.stdout:5/3: creat f0 x:0 0 0 2024-04-20T21:58:16.254 INFO:tasks.workunit.client.0.smithi142.stdout:5/4: fdatasync f0 0 2024-04-20T21:58:16.254 INFO:tasks.workunit.client.0.smithi142.stdout:7/0: fsync - no filename 2024-04-20T21:58:16.254 INFO:tasks.workunit.client.0.smithi142.stdout:7/1: dwrite - no filename 2024-04-20T21:58:16.254 INFO:tasks.workunit.client.0.smithi142.stdout:7/2: dread - no filename 2024-04-20T21:58:16.254 INFO:tasks.workunit.client.0.smithi142.stdout:7/3: rename - no filename 2024-04-20T21:58:16.254 INFO:tasks.workunit.client.0.smithi142.stdout:4/3: mkdir d1 0 2024-04-20T21:58:16.414 INFO:tasks.workunit.client.0.smithi142.stdout:6/5: mknod c0 0 2024-04-20T21:58:16.415 INFO:tasks.workunit.client.0.smithi142.stdout:8/0: dwrite - no filename 2024-04-20T21:58:16.415 INFO:tasks.workunit.client.0.smithi142.stdout:8/1: link - no file 2024-04-20T21:58:16.416 INFO:tasks.workunit.client.0.smithi142.stdout:0/14: symlink d5/l6 0 2024-04-20T21:58:16.417 INFO:tasks.workunit.client.0.smithi142.stdout:5/5: rename f0 to f1 0 2024-04-20T21:58:16.419 INFO:tasks.workunit.client.0.smithi142.stdout:0/15: chown d5/l6 474467 1 2024-04-20T21:58:16.419 INFO:tasks.workunit.client.0.smithi142.stdout:5/6: chown f1 160 1 2024-04-20T21:58:16.420 INFO:tasks.workunit.client.0.smithi142.stdout:7/4: creat f0 x:0 0 0 2024-04-20T21:58:16.422 INFO:tasks.workunit.client.0.smithi142.stdout:6/6: mkdir d1 0 2024-04-20T21:58:16.422 INFO:tasks.workunit.client.0.smithi142.stdout:7/5: dread - f0 zero size 2024-04-20T21:58:16.424 INFO:tasks.workunit.client.0.smithi142.stdout:9/0: truncate - no filename 2024-04-20T21:58:16.424 INFO:tasks.workunit.client.0.smithi142.stdout:9/1: dwrite - no filename 2024-04-20T21:58:16.424 INFO:tasks.workunit.client.0.smithi142.stdout:9/2: truncate - no filename 2024-04-20T21:58:16.424 INFO:tasks.workunit.client.0.smithi142.stdout:9/3: dwrite - no filename 2024-04-20T21:58:16.424 INFO:tasks.workunit.client.0.smithi142.stdout:9/4: write - no filename 2024-04-20T21:58:16.424 INFO:tasks.workunit.client.0.smithi142.stdout:9/5: truncate - no filename 2024-04-20T21:58:16.424 INFO:tasks.workunit.client.0.smithi142.stdout:7/6: dread - f0 zero size 2024-04-20T21:58:16.425 INFO:tasks.workunit.client.0.smithi142.stdout:9/6: chown . 1019 1 2024-04-20T21:58:16.480 INFO:tasks.workunit.client.0.smithi142.stdout:4/4: symlink d1/l2 0 2024-04-20T21:58:16.481 INFO:tasks.workunit.client.0.smithi142.stdout:0/16: symlink d5/l7 0 2024-04-20T21:58:16.485 INFO:tasks.workunit.client.0.smithi142.stdout:5/7: creat f2 x:0 0 0 2024-04-20T21:58:16.486 INFO:tasks.workunit.client.0.smithi142.stdout:8/2: getdents . 0 2024-04-20T21:58:16.488 INFO:tasks.workunit.client.0.smithi142.stdout:5/8: dread - f2 zero size 2024-04-20T21:58:16.489 INFO:tasks.workunit.client.0.smithi142.stdout:0/17: creat d5/f8 x:0 0 0 2024-04-20T21:58:16.492 INFO:tasks.workunit.client.0.smithi142.stdout:6/7: mknod d1/c2 0 2024-04-20T21:58:16.492 INFO:tasks.workunit.client.0.smithi142.stdout:6/8: write - no filename 2024-04-20T21:58:16.494 INFO:tasks.workunit.client.0.smithi142.stdout:9/7: mkdir d0 0 2024-04-20T21:58:16.494 INFO:tasks.workunit.client.0.smithi142.stdout:9/8: truncate - no filename 2024-04-20T21:58:16.498 INFO:tasks.workunit.client.0.smithi142.stdout:8/3: mkdir d0 0 2024-04-20T21:58:16.498 INFO:tasks.workunit.client.0.smithi142.stdout:7/7: dwrite f0 [0,4194304] 0 2024-04-20T21:58:16.501 INFO:tasks.workunit.client.0.smithi142.stdout:5/9: link f2 f3 0 2024-04-20T21:58:16.502 INFO:tasks.workunit.client.0.smithi142.stdout:8/4: rename d0 to d0/d1 22 2024-04-20T21:58:16.503 INFO:tasks.workunit.client.0.smithi142.stdout:6/9: rename d1/c2 to d1/c3 0 2024-04-20T21:58:16.503 INFO:tasks.workunit.client.0.smithi142.stdout:6/10: read - no filename 2024-04-20T21:58:16.504 INFO:tasks.workunit.client.0.smithi142.stdout:9/9: symlink d0/l1 0 2024-04-20T21:58:16.508 INFO:tasks.workunit.client.0.smithi142.stdout:7/8: rename f0 to f1 0 2024-04-20T21:58:16.509 INFO:tasks.workunit.client.0.smithi142.stdout:5/10: creat f4 x:0 0 0 2024-04-20T21:58:16.513 INFO:tasks.workunit.client.0.smithi142.stdout:6/11: creat d1/f4 x:0 0 0 2024-04-20T21:58:16.515 INFO:tasks.workunit.client.0.smithi142.stdout:5/11: truncate f1 623412 0 2024-04-20T21:58:16.518 INFO:tasks.workunit.client.0.smithi142.stdout:9/10: symlink d0/l2 0 2024-04-20T21:58:16.521 INFO:tasks.workunit.client.0.smithi142.stdout:8/5: creat d0/f2 x:0 0 0 2024-04-20T21:58:16.527 INFO:tasks.workunit.client.0.smithi142.stdout:0/18: dwrite d5/f8 [0,4194304] 0 2024-04-20T21:58:16.528 INFO:tasks.workunit.client.0.smithi142.stdout:8/6: creat d0/f3 x:0 0 0 2024-04-20T21:58:16.528 INFO:tasks.workunit.client.0.smithi142.stdout:6/12: write d1/f4 [1001623,127593] 0 2024-04-20T21:58:16.530 INFO:tasks.workunit.client.0.smithi142.stdout:7/9: link f1 f2 0 2024-04-20T21:58:16.532 INFO:tasks.workunit.client.0.smithi142.stdout:7/10: chown f1 1236779 1 2024-04-20T21:58:16.535 INFO:tasks.workunit.client.0.smithi142.stdout:8/7: write d0/f3 [131834,43331] 0 2024-04-20T21:58:16.535 INFO:tasks.workunit.client.0.smithi142.stdout:6/13: mkdir d1/d5 0 2024-04-20T21:58:16.538 INFO:tasks.workunit.client.0.smithi142.stdout:6/14: write d1/f4 [523235,79228] 0 2024-04-20T21:58:16.539 INFO:tasks.workunit.client.0.smithi142.stdout:7/11: rename f2 to f3 0 2024-04-20T21:58:16.541 INFO:tasks.workunit.client.0.smithi142.stdout:8/8: mknod d0/c4 0 2024-04-20T21:58:16.543 INFO:tasks.workunit.client.0.smithi142.stdout:7/12: chown f3 45773 1 2024-04-20T21:58:16.545 INFO:tasks.workunit.client.0.smithi142.stdout:8/9: write d0/f3 [417595,42165] 0 2024-04-20T21:58:16.546 INFO:tasks.workunit.client.0.smithi142.stdout:8/10: readlink - no filename 2024-04-20T21:58:16.548 INFO:tasks.workunit.client.0.smithi142.stdout:7/13: mkdir d4 0 2024-04-20T21:58:16.552 INFO:tasks.workunit.client.0.smithi142.stdout:8/11: creat d0/f5 x:0 0 0 2024-04-20T21:58:16.554 INFO:tasks.workunit.client.0.smithi142.stdout:7/14: symlink d4/l5 0 2024-04-20T21:58:16.556 INFO:tasks.workunit.client.0.smithi142.stdout:8/12: creat d0/f6 x:0 0 0 2024-04-20T21:58:16.558 INFO:tasks.workunit.client.0.smithi142.stdout:5/12: dwrite f3 [0,4194304] 0 2024-04-20T21:58:16.559 INFO:tasks.workunit.client.0.smithi142.stdout:7/15: symlink d4/l6 0 2024-04-20T21:58:16.561 INFO:tasks.workunit.client.0.smithi142.stdout:8/13: unlink d0/f2 0 2024-04-20T21:58:16.561 INFO:tasks.workunit.client.0.smithi142.stdout:8/14: readlink - no filename 2024-04-20T21:58:16.562 INFO:tasks.workunit.client.0.smithi142.stdout:8/15: read - d0/f6 zero size 2024-04-20T21:58:16.565 INFO:tasks.workunit.client.0.smithi142.stdout:8/16: write d0/f3 [1113136,40238] 0 2024-04-20T21:58:16.566 INFO:tasks.workunit.client.0.smithi142.stdout:7/16: mkdir d4/d7 0 2024-04-20T21:58:16.573 INFO:tasks.workunit.client.0.smithi142.stdout:8/17: rename d0/f5 to d0/f7 0 2024-04-20T21:58:16.576 INFO:tasks.workunit.client.0.smithi142.stdout:8/18: write d0/f3 [1233486,95531] 0 2024-04-20T21:58:16.582 INFO:tasks.workunit.client.0.smithi142.stdout:8/19: mkdir d0/d8 0 2024-04-20T21:58:16.589 INFO:tasks.workunit.client.0.smithi142.stdout:8/20: rmdir d0/d8 0 2024-04-20T21:58:16.592 INFO:tasks.workunit.client.0.smithi142.stdout:8/21: creat d0/f9 x:0 0 0 2024-04-20T21:58:16.594 INFO:tasks.workunit.client.0.smithi142.stdout:8/22: creat d0/fa x:0 0 0 2024-04-20T21:58:16.618 INFO:tasks.workunit.client.0.smithi142.stdout:8/23: dwrite d0/f3 [0,4194304] 0 2024-04-20T21:58:16.620 INFO:tasks.workunit.client.0.smithi142.stdout:8/24: read - d0/f6 zero size 2024-04-20T21:58:16.647 INFO:tasks.workunit.client.0.smithi142.stdout:8/25: dwrite d0/f3 [0,4194304] 0 2024-04-20T21:58:16.654 INFO:tasks.workunit.client.0.smithi142.stdout:8/26: link d0/c4 d0/cb 0 2024-04-20T21:58:16.657 INFO:tasks.workunit.client.0.smithi142.stdout:8/27: creat d0/fc x:0 0 0 2024-04-20T21:58:16.664 INFO:tasks.workunit.client.0.smithi142.stdout:8/28: rename d0/fa to d0/fd 0 2024-04-20T21:58:16.686 INFO:tasks.workunit.client.0.smithi142.stdout:8/29: dwrite d0/f7 [0,4194304] 0 2024-04-20T21:58:16.689 INFO:tasks.workunit.client.0.smithi142.stdout:8/30: mknod d0/ce 0 2024-04-20T21:58:16.751 INFO:tasks.workunit.client.0.smithi142.stdout:2/4: getdents . 0 2024-04-20T21:58:16.751 INFO:tasks.workunit.client.0.smithi142.stdout:1/7: chown l1 230284 1 2024-04-20T21:58:16.752 INFO:tasks.workunit.client.0.smithi142.stdout:2/5: truncate f0 1023368 0 2024-04-20T21:58:16.754 INFO:tasks.workunit.client.0.smithi142.stdout:2/6: creat f2 x:0 0 0 2024-04-20T21:58:16.755 INFO:tasks.workunit.client.0.smithi142.stdout:2/7: chown c1 101 1 2024-04-20T21:58:16.756 INFO:tasks.workunit.client.0.smithi142.stdout:2/8: chown f0 1 1 2024-04-20T21:58:16.764 INFO:tasks.workunit.client.0.smithi142.stdout:0/19: rmdir d5 39 2024-04-20T21:58:16.771 INFO:tasks.workunit.client.0.smithi142.stdout:0/20: creat d5/f9 x:0 0 0 2024-04-20T21:58:16.775 INFO:tasks.workunit.client.0.smithi142.stdout:6/15: rename d1/c3 to d1/d5/c6 0 2024-04-20T21:58:16.780 INFO:tasks.workunit.client.0.smithi142.stdout:2/9: dwrite f2 [0,4194304] 0 2024-04-20T21:58:16.780 INFO:tasks.workunit.client.0.smithi142.stdout:2/10: rmdir - no directory 2024-04-20T21:58:16.782 INFO:tasks.workunit.client.0.smithi142.stdout:6/16: mkdir d1/d7 0 2024-04-20T21:58:16.818 INFO:tasks.workunit.client.0.smithi142.stdout:8/31: getdents d0 0 2024-04-20T21:58:16.822 INFO:tasks.workunit.client.0.smithi142.stdout:6/17: dwrite d1/f4 [0,4194304] 0 2024-04-20T21:58:16.822 INFO:tasks.workunit.client.0.smithi142.stdout:6/18: readlink - no filename 2024-04-20T21:58:16.823 INFO:tasks.workunit.client.0.smithi142.stdout:5/13: dwrite f3 [4194304,4194304] 0 2024-04-20T21:58:16.833 INFO:tasks.workunit.client.0.smithi142.stdout:5/14: truncate f4 664778 0 2024-04-20T21:58:16.834 INFO:tasks.workunit.client.0.smithi142.stdout:2/11: dwrite f0 [0,4194304] 0 2024-04-20T21:58:16.834 INFO:tasks.workunit.client.0.smithi142.stdout:0/21: truncate d5/f8 1085104 0 2024-04-20T21:58:16.834 INFO:tasks.workunit.client.0.smithi142.stdout:8/32: truncate d0/fc 330333 0 2024-04-20T21:58:16.842 INFO:tasks.workunit.client.0.smithi142.stdout:0/22: dread - d5/f9 zero size 2024-04-20T21:58:16.843 INFO:tasks.workunit.client.0.smithi142.stdout:0/23: read - d5/f9 zero size 2024-04-20T21:58:16.843 INFO:tasks.workunit.client.0.smithi142.stdout:5/15: mknod c5 0 2024-04-20T21:58:16.844 INFO:tasks.workunit.client.0.smithi142.stdout:6/19: symlink d1/d7/l8 0 2024-04-20T21:58:16.854 INFO:tasks.workunit.client.0.smithi142.stdout:0/24: unlink l4 0 2024-04-20T21:58:16.859 INFO:tasks.workunit.client.0.smithi142.stdout:6/20: chown d1/d5/c6 2189714 1 2024-04-20T21:58:16.859 INFO:tasks.workunit.client.0.smithi142.stdout:2/12: dread f2 [0,4194304] 0 2024-04-20T21:58:16.871 INFO:tasks.workunit.client.0.smithi142.stdout:8/33: dwrite d0/f9 [0,4194304] 0 2024-04-20T21:58:16.883 INFO:tasks.workunit.client.0.smithi142.stdout:8/34: creat d0/ff x:0 0 0 2024-04-20T21:58:16.887 INFO:tasks.workunit.client.0.smithi142.stdout:5/16: dwrite f1 [0,4194304] 0 2024-04-20T21:58:16.888 INFO:tasks.workunit.client.0.smithi142.stdout:0/25: write d5/f8 [1376132,1332] 0 2024-04-20T21:58:16.889 INFO:tasks.workunit.client.0.smithi142.stdout:2/13: dread f2 [0,4194304] 0 2024-04-20T21:58:16.892 INFO:tasks.workunit.client.0.smithi142.stdout:2/14: chown f2 148 1 2024-04-20T21:58:16.894 INFO:tasks.workunit.client.0.smithi142.stdout:0/26: write d5/f9 [197353,88036] 0 2024-04-20T21:58:16.897 INFO:tasks.workunit.client.0.smithi142.stdout:2/15: fdatasync f0 0 2024-04-20T21:58:16.905 INFO:tasks.workunit.client.0.smithi142.stdout:2/16: write f0 [1553416,67268] 0 2024-04-20T21:58:16.912 INFO:tasks.workunit.client.0.smithi142.stdout:2/17: unlink f2 0 2024-04-20T21:58:16.914 INFO:tasks.workunit.client.0.smithi142.stdout:0/27: dread d5/f8 [0,4194304] 0 2024-04-20T21:58:16.915 INFO:tasks.workunit.client.0.smithi142.stdout:6/21: dwrite d1/f4 [4194304,4194304] 0 2024-04-20T21:58:16.918 INFO:tasks.workunit.client.0.smithi142.stdout:6/22: write d1/f4 [44564,15613] 0 2024-04-20T21:58:16.919 INFO:tasks.workunit.client.0.smithi142.stdout:5/17: dread f2 [4194304,4194304] 0 2024-04-20T21:58:16.922 INFO:tasks.workunit.client.0.smithi142.stdout:5/18: stat f2 0 2024-04-20T21:58:16.923 INFO:tasks.workunit.client.0.smithi142.stdout:2/18: unlink c1 0 2024-04-20T21:58:16.927 INFO:tasks.workunit.client.0.smithi142.stdout:8/35: dwrite d0/f9 [0,4194304] 0 2024-04-20T21:58:16.931 INFO:tasks.workunit.client.0.smithi142.stdout:0/28: creat d5/fa x:0 0 0 2024-04-20T21:58:16.939 INFO:tasks.workunit.client.0.smithi142.stdout:5/19: creat f6 x:0 0 0 2024-04-20T21:58:16.941 INFO:tasks.workunit.client.0.smithi142.stdout:2/19: mkdir d3 0 2024-04-20T21:58:16.944 INFO:tasks.workunit.client.0.smithi142.stdout:2/20: rename d3 to d3/d4 22 2024-04-20T21:58:16.946 INFO:tasks.workunit.client.0.smithi142.stdout:6/23: dwrite d1/f4 [4194304,4194304] 0 2024-04-20T21:58:16.956 INFO:tasks.workunit.client.0.smithi142.stdout:6/24: mknod d1/c9 0 2024-04-20T21:58:16.959 INFO:tasks.workunit.client.0.smithi142.stdout:0/29: dwrite d5/f9 [0,4194304] 0 2024-04-20T21:58:16.962 INFO:tasks.workunit.client.0.smithi142.stdout:0/30: truncate d5/f8 2056822 0 2024-04-20T21:58:16.963 INFO:tasks.workunit.client.0.smithi142.stdout:0/31: readlink l0 0 2024-04-20T21:58:16.965 INFO:tasks.workunit.client.0.smithi142.stdout:8/36: getdents d0 0 2024-04-20T21:58:16.968 INFO:tasks.workunit.client.0.smithi142.stdout:8/37: write d0/ff [685020,28504] 0 2024-04-20T21:58:16.975 INFO:tasks.workunit.client.0.smithi142.stdout:8/38: creat d0/f10 x:0 0 0 2024-04-20T21:58:16.995 INFO:tasks.workunit.client.0.smithi142.stdout:2/21: truncate f0 2479355 0 2024-04-20T21:58:16.998 INFO:tasks.workunit.client.0.smithi142.stdout:0/32: write d5/f9 [4819617,68491] 0 2024-04-20T21:58:17.117 INFO:tasks.workunit.client.0.smithi142.stdout:0/33: mkdir d5/db 0 2024-04-20T21:58:17.140 INFO:tasks.workunit.client.0.smithi142.stdout:0/34: dwrite d5/f8 [0,4194304] 0 2024-04-20T21:58:17.141 INFO:tasks.workunit.client.0.smithi142.stdout:0/35: dread - d5/fa zero size 2024-04-20T21:58:17.158 INFO:tasks.workunit.client.0.smithi142.stdout:0/36: dread d5/f9 [0,4194304] 0 2024-04-20T21:58:17.160 INFO:tasks.workunit.client.0.smithi142.stdout:0/37: write d5/f8 [3696788,21800] 0 2024-04-20T21:58:17.183 INFO:tasks.workunit.client.0.smithi142.stdout:0/38: dwrite d5/fa [0,4194304] 0 2024-04-20T21:58:17.187 INFO:tasks.workunit.client.0.smithi142.stdout:0/39: read d5/f9 [4803004,109104] 0 2024-04-20T21:58:17.188 INFO:tasks.workunit.client.0.smithi142.stdout:0/40: chown l3 7 1 2024-04-20T21:58:17.189 INFO:tasks.workunit.client.0.smithi142.stdout:0/41: readlink l3 0 2024-04-20T21:58:17.196 INFO:tasks.workunit.client.0.smithi142.stdout:0/42: symlink d5/db/lc 0 2024-04-20T21:58:17.199 INFO:tasks.workunit.client.0.smithi142.stdout:0/43: symlink d5/ld 0 2024-04-20T21:58:17.202 INFO:tasks.workunit.client.0.smithi142.stdout:0/44: mknod d5/db/ce 0 2024-04-20T21:58:17.204 INFO:tasks.workunit.client.0.smithi142.stdout:0/45: creat d5/ff x:0 0 0 2024-04-20T21:58:17.206 INFO:tasks.workunit.client.0.smithi142.stdout:0/46: read d5/f8 [66088,118944] 0 2024-04-20T21:58:17.225 INFO:tasks.workunit.client.0.smithi142.stdout:0/47: dwrite d5/fa [0,4194304] 0 2024-04-20T21:58:17.249 INFO:tasks.workunit.client.0.smithi142.stdout:2/22: write f0 [2334495,79237] 0 2024-04-20T21:58:17.253 INFO:tasks.workunit.client.0.smithi142.stdout:2/23: mkdir d3/d5 0 2024-04-20T21:58:17.254 INFO:tasks.workunit.client.0.smithi142.stdout:2/24: chown f0 9151 1 2024-04-20T21:58:17.255 INFO:tasks.workunit.client.0.smithi142.stdout:2/25: chown d3/d5 33450 1 2024-04-20T21:58:17.260 INFO:tasks.workunit.client.0.smithi142.stdout:2/26: mkdir d3/d6 0 2024-04-20T21:58:17.263 INFO:tasks.workunit.client.0.smithi142.stdout:2/27: write f0 [125296,30449] 0 2024-04-20T21:58:17.265 INFO:tasks.workunit.client.0.smithi142.stdout:0/48: dwrite d5/fa [4194304,4194304] 0 2024-04-20T21:58:17.266 INFO:tasks.workunit.client.0.smithi142.stdout:2/28: read f0 [1431932,27294] 0 2024-04-20T21:58:17.266 INFO:tasks.workunit.client.0.smithi142.stdout:0/49: stat c2 0 2024-04-20T21:58:17.268 INFO:tasks.workunit.client.0.smithi142.stdout:0/50: write d5/ff [193426,119252] 0 2024-04-20T21:58:17.270 INFO:tasks.workunit.client.0.smithi142.stdout:0/51: chown d5/l6 260362712 1 2024-04-20T21:58:17.277 INFO:tasks.workunit.client.0.smithi142.stdout:0/52: rename c1 to d5/c10 0 2024-04-20T21:58:17.279 INFO:tasks.workunit.client.0.smithi142.stdout:2/29: dread f0 [0,4194304] 0 2024-04-20T21:58:17.283 INFO:tasks.workunit.client.0.smithi142.stdout:0/53: symlink d5/db/l11 0 2024-04-20T21:58:17.285 INFO:tasks.workunit.client.0.smithi142.stdout:2/30: symlink d3/l7 0 2024-04-20T21:58:17.289 INFO:tasks.workunit.client.0.smithi142.stdout:2/31: symlink d3/d5/l8 0 2024-04-20T21:58:17.291 INFO:tasks.workunit.client.0.smithi142.stdout:2/32: mkdir d3/d9 0 2024-04-20T21:58:17.294 INFO:tasks.workunit.client.0.smithi142.stdout:2/33: creat d3/d6/fa x:0 0 0 2024-04-20T21:58:17.298 INFO:tasks.workunit.client.0.smithi142.stdout:0/54: getdents d5/db 0 2024-04-20T21:58:17.300 INFO:tasks.workunit.client.0.smithi142.stdout:0/55: creat d5/f12 x:0 0 0 2024-04-20T21:58:17.302 INFO:tasks.workunit.client.0.smithi142.stdout:0/56: write d5/f12 [90585,33612] 0 2024-04-20T21:58:17.311 INFO:tasks.workunit.client.0.smithi142.stdout:0/57: truncate d5/f12 22518 0 2024-04-20T21:58:17.312 INFO:tasks.workunit.client.0.smithi142.stdout:2/34: dwrite f0 [0,4194304] 0 2024-04-20T21:58:17.316 INFO:tasks.workunit.client.0.smithi142.stdout:0/58: mkdir d5/d13 0 2024-04-20T21:58:17.317 INFO:tasks.workunit.client.0.smithi142.stdout:2/35: mknod d3/d9/cb 0 2024-04-20T21:58:17.319 INFO:tasks.workunit.client.0.smithi142.stdout:0/59: creat d5/d13/f14 x:0 0 0 2024-04-20T21:58:17.323 INFO:tasks.workunit.client.0.smithi142.stdout:0/60: symlink d5/d13/l15 0 2024-04-20T21:58:17.330 INFO:tasks.workunit.client.0.smithi142.stdout:2/36: dread f0 [0,4194304] 0 2024-04-20T21:58:17.331 INFO:tasks.workunit.client.0.smithi142.stdout:2/37: dread - d3/d6/fa zero size 2024-04-20T21:58:17.334 INFO:tasks.workunit.client.0.smithi142.stdout:2/38: mkdir d3/d9/dc 0 2024-04-20T21:58:17.335 INFO:tasks.workunit.client.0.smithi142.stdout:0/61: dread d5/f9 [0,4194304] 0 2024-04-20T21:58:17.339 INFO:tasks.workunit.client.0.smithi142.stdout:0/62: rename d5/db/l11 to d5/l16 0 2024-04-20T21:58:17.341 INFO:tasks.workunit.client.0.smithi142.stdout:0/63: creat d5/f17 x:0 0 0 2024-04-20T21:58:17.342 INFO:tasks.workunit.client.0.smithi142.stdout:0/64: chown d5/d13 1919842906 1 2024-04-20T21:58:17.344 INFO:tasks.workunit.client.0.smithi142.stdout:0/65: creat d5/f18 x:0 0 0 2024-04-20T21:58:17.345 INFO:tasks.workunit.client.0.smithi142.stdout:2/39: dread f0 [0,4194304] 0 2024-04-20T21:58:17.347 INFO:tasks.workunit.client.0.smithi142.stdout:2/40: write f0 [1764581,91960] 0 2024-04-20T21:58:17.348 INFO:tasks.workunit.client.0.smithi142.stdout:2/41: fsync d3/d6/fa 0 2024-04-20T21:58:17.351 INFO:tasks.workunit.client.0.smithi142.stdout:2/42: creat d3/d9/fd x:0 0 0 2024-04-20T21:58:17.353 INFO:tasks.workunit.client.0.smithi142.stdout:2/43: truncate d3/d6/fa 720357 0 2024-04-20T21:58:17.372 INFO:tasks.workunit.client.0.smithi142.stdout:2/44: dwrite d3/d9/fd [0,4194304] 0 2024-04-20T21:58:17.379 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:17 smithi142 ceph-mon[15828]: pgmap v30: 65 pgs: 65 active+clean; 188 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s wr, 207 op/s 2024-04-20T21:58:17.391 INFO:tasks.workunit.client.0.smithi142.stdout:2/45: truncate f0 2984066 0 2024-04-20T21:58:17.395 INFO:tasks.workunit.client.0.smithi142.stdout:2/46: dread d3/d6/fa [0,4194304] 0 2024-04-20T21:58:17.412 INFO:tasks.workunit.client.0.smithi142.stdout:2/47: dwrite f0 [0,4194304] 0 2024-04-20T21:58:17.414 INFO:tasks.workunit.client.0.smithi142.stdout:2/48: chown d3/d9/fd 6095 1 2024-04-20T21:58:17.416 INFO:tasks.workunit.client.0.smithi142.stdout:2/49: fdatasync d3/d6/fa 0 2024-04-20T21:58:17.419 INFO:tasks.workunit.client.0.smithi142.stdout:2/50: unlink d3/d6/fa 0 2024-04-20T21:58:17.421 INFO:tasks.workunit.client.0.smithi142.stdout:2/51: mknod d3/ce 0 2024-04-20T21:58:17.428 INFO:tasks.workunit.client.0.smithi142.stdout:2/52: link f0 d3/d6/ff 0 2024-04-20T21:58:17.440 INFO:tasks.workunit.client.0.smithi142.stdout:2/53: dread d3/d9/fd [0,4194304] 0 2024-04-20T21:58:17.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:17 smithi164 ceph-mon[23506]: pgmap v30: 65 pgs: 65 active+clean; 188 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s wr, 207 op/s 2024-04-20T21:58:17.455 INFO:tasks.workunit.client.0.smithi142.stdout:2/54: dwrite d3/d6/ff [0,4194304] 0 2024-04-20T21:58:17.458 INFO:tasks.workunit.client.0.smithi142.stdout:2/55: mknod d3/c10 0 2024-04-20T21:58:17.460 INFO:tasks.workunit.client.0.smithi142.stdout:2/56: chown d3/l7 266185 1 2024-04-20T21:58:17.463 INFO:tasks.workunit.client.0.smithi142.stdout:2/57: creat d3/d9/dc/f11 x:0 0 0 2024-04-20T21:58:17.465 INFO:tasks.workunit.client.0.smithi142.stdout:2/58: mknod d3/d9/c12 0 2024-04-20T21:58:17.477 INFO:tasks.workunit.client.0.smithi142.stdout:2/59: dread f0 [0,4194304] 0 2024-04-20T21:58:17.497 INFO:tasks.workunit.client.0.smithi142.stdout:2/60: dwrite d3/d9/dc/f11 [0,4194304] 0 2024-04-20T21:58:17.500 INFO:tasks.workunit.client.0.smithi142.stdout:2/61: write d3/d6/ff [3620851,88421] 0 2024-04-20T21:58:17.503 INFO:tasks.workunit.client.0.smithi142.stdout:2/62: write d3/d9/fd [3449667,55842] 0 2024-04-20T21:58:17.506 INFO:tasks.workunit.client.0.smithi142.stdout:2/63: symlink d3/d9/dc/l13 0 2024-04-20T21:58:17.509 INFO:tasks.workunit.client.0.smithi142.stdout:2/64: mknod d3/d9/c14 0 2024-04-20T21:58:17.511 INFO:tasks.workunit.client.0.smithi142.stdout:2/65: symlink d3/d9/dc/l15 0 2024-04-20T21:58:17.514 INFO:tasks.workunit.client.0.smithi142.stdout:2/66: unlink d3/d9/c12 0 2024-04-20T21:58:17.516 INFO:tasks.workunit.client.0.smithi142.stdout:2/67: mknod d3/d6/c16 0 2024-04-20T21:58:17.535 INFO:tasks.workunit.client.0.smithi142.stdout:2/68: fsync d3/d9/dc/f11 0 2024-04-20T21:58:17.539 INFO:tasks.workunit.client.0.smithi142.stdout:2/69: unlink d3/d9/dc/f11 0 2024-04-20T21:58:17.556 INFO:tasks.workunit.client.0.smithi142.stdout:2/70: dwrite d3/d9/fd [0,4194304] 0 2024-04-20T21:58:17.574 INFO:tasks.workunit.client.0.smithi142.stdout:2/71: rmdir d3/d9/dc 39 2024-04-20T21:58:17.580 INFO:tasks.workunit.client.0.smithi142.stdout:2/72: rename d3/d9/fd to d3/d5/f17 0 2024-04-20T21:58:17.603 INFO:tasks.workunit.client.0.smithi142.stdout:2/73: dwrite f0 [4194304,4194304] 0 2024-04-20T21:58:17.605 INFO:tasks.workunit.client.0.smithi142.stdout:2/74: write f0 [9094414,82606] 0 2024-04-20T21:58:17.629 INFO:tasks.workunit.client.0.smithi142.stdout:2/75: dwrite d3/d6/ff [4194304,4194304] 0 2024-04-20T21:58:17.652 INFO:tasks.workunit.client.0.smithi142.stdout:2/76: fsync d3/d6/ff 0 2024-04-20T21:58:17.669 INFO:tasks.workunit.client.0.smithi142.stdout:2/77: dwrite d3/d6/ff [0,4194304] 0 2024-04-20T21:58:17.673 INFO:tasks.workunit.client.0.smithi142.stdout:2/78: mknod d3/d6/c18 0 2024-04-20T21:58:17.674 INFO:tasks.workunit.client.0.smithi142.stdout:2/79: chown d3/d9 83172660 1 2024-04-20T21:58:17.675 INFO:tasks.workunit.client.0.smithi142.stdout:2/80: rmdir d3 39 2024-04-20T21:58:17.695 INFO:tasks.workunit.client.0.smithi142.stdout:2/81: dwrite d3/d5/f17 [0,4194304] 0 2024-04-20T21:58:17.697 INFO:tasks.workunit.client.0.smithi142.stdout:2/82: readlink d3/d5/l8 0 2024-04-20T21:58:17.716 INFO:tasks.workunit.client.0.smithi142.stdout:2/83: dwrite f0 [8388608,4194304] 0 2024-04-20T21:58:17.729 INFO:tasks.workunit.client.0.smithi142.stdout:2/84: dread d3/d5/f17 [0,4194304] 0 2024-04-20T21:58:18.854 INFO:tasks.workunit.client.0.smithi142.stdout:3/9: sync 2024-04-20T21:58:18.879 INFO:tasks.workunit.client.0.smithi142.stdout:3/10: dwrite f0 [0,4194304] 0 2024-04-20T21:58:18.979 INFO:tasks.workunit.client.0.smithi142.stdout:3/11: creat f1 x:0 0 0 2024-04-20T21:58:18.987 INFO:tasks.workunit.client.0.smithi142.stdout:3/12: rename f0 to f2 0 2024-04-20T21:58:19.006 INFO:tasks.workunit.client.0.smithi142.stdout:4/5: sync 2024-04-20T21:58:19.034 INFO:tasks.workunit.client.0.smithi142.stdout:3/13: dwrite f1 [0,4194304] 0 2024-04-20T21:58:19.034 INFO:tasks.workunit.client.0.smithi142.stdout:3/14: rmdir - no directory 2024-04-20T21:58:19.036 INFO:tasks.workunit.client.0.smithi142.stdout:3/15: write f1 [2210192,14920] 0 2024-04-20T21:58:19.044 INFO:tasks.workunit.client.0.smithi142.stdout:3/16: mkdir d3 0 2024-04-20T21:58:19.117 INFO:tasks.workunit.client.0.smithi142.stdout:7/17: sync 2024-04-20T21:58:19.117 INFO:tasks.workunit.client.0.smithi142.stdout:9/11: sync 2024-04-20T21:58:19.123 INFO:tasks.workunit.client.0.smithi142.stdout:7/18: write f3 [3730036,16132] 0 2024-04-20T21:58:19.127 INFO:tasks.workunit.client.0.smithi142.stdout:9/12: rmdir d0 39 2024-04-20T21:58:19.129 INFO:tasks.workunit.client.0.smithi142.stdout:7/19: rmdir d4 39 2024-04-20T21:58:19.131 INFO:tasks.workunit.client.0.smithi142.stdout:7/20: write f1 [4505977,5139] 0 2024-04-20T21:58:19.132 INFO:tasks.workunit.client.0.smithi142.stdout:7/21: chown f1 1313473 1 2024-04-20T21:58:19.136 INFO:tasks.workunit.client.0.smithi142.stdout:6/25: sync 2024-04-20T21:58:19.136 INFO:tasks.workunit.client.0.smithi142.stdout:1/8: sync 2024-04-20T21:58:19.136 INFO:tasks.workunit.client.0.smithi142.stdout:4/6: sync 2024-04-20T21:58:19.137 INFO:tasks.workunit.client.0.smithi142.stdout:2/85: sync 2024-04-20T21:58:19.137 INFO:tasks.workunit.client.0.smithi142.stdout:5/20: sync 2024-04-20T21:58:19.137 INFO:tasks.workunit.client.0.smithi142.stdout:0/66: sync 2024-04-20T21:58:19.137 INFO:tasks.workunit.client.0.smithi142.stdout:8/39: sync 2024-04-20T21:58:19.152 INFO:tasks.workunit.client.0.smithi142.stdout:7/22: rename d4 to d4/d7/d8 22 2024-04-20T21:58:19.154 INFO:tasks.workunit.client.0.smithi142.stdout:8/40: write d0/f7 [4765826,29026] 0 2024-04-20T21:58:19.154 INFO:tasks.workunit.client.0.smithi142.stdout:6/26: read d1/f4 [4182350,128232] 0 2024-04-20T21:58:19.181 INFO:tasks.workunit.client.0.smithi142.stdout:8/41: dwrite d0/f3 [0,4194304] 0 2024-04-20T21:58:19.182 INFO:tasks.workunit.client.0.smithi142.stdout:4/7: dwrite f0 [0,4194304] 0 2024-04-20T21:58:19.185 INFO:tasks.workunit.client.0.smithi142.stdout:4/8: write f0 [2889345,101578] 0 2024-04-20T21:58:19.189 INFO:tasks.workunit.client.0.smithi142.stdout:4/9: truncate f0 4658408 0 2024-04-20T21:58:19.192 INFO:tasks.workunit.client.0.smithi142.stdout:8/42: dread d0/ff [0,4194304] 0 2024-04-20T21:58:19.193 INFO:tasks.workunit.client.0.smithi142.stdout:8/43: dread - d0/f6 zero size 2024-04-20T21:58:19.370 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:19 smithi142 ceph-mon[15828]: pgmap v31: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 75 KiB/s rd, 14 MiB/s wr, 279 op/s 2024-04-20T21:58:19.380 INFO:tasks.workunit.client.0.smithi142.stdout:9/13: symlink d0/l3 0 2024-04-20T21:58:19.382 INFO:tasks.workunit.client.0.smithi142.stdout:1/9: mkdir d2 0 2024-04-20T21:58:19.382 INFO:tasks.workunit.client.0.smithi142.stdout:1/10: dwrite - no filename 2024-04-20T21:58:19.382 INFO:tasks.workunit.client.0.smithi142.stdout:1/11: read - no filename 2024-04-20T21:58:19.384 INFO:tasks.workunit.client.0.smithi142.stdout:0/67: mknod d5/c19 0 2024-04-20T21:58:19.384 INFO:tasks.workunit.client.0.smithi142.stdout:1/12: stat l1 0 2024-04-20T21:58:19.391 INFO:tasks.workunit.client.0.smithi142.stdout:7/23: unlink f3 0 2024-04-20T21:58:19.397 INFO:tasks.workunit.client.0.smithi142.stdout:5/21: rename f6 to f7 0 2024-04-20T21:58:19.400 INFO:tasks.workunit.client.0.smithi142.stdout:5/22: chown f4 112716107 1 2024-04-20T21:58:19.405 INFO:tasks.workunit.client.0.smithi142.stdout:4/10: creat d1/f3 x:0 0 0 2024-04-20T21:58:19.413 INFO:tasks.workunit.client.0.smithi142.stdout:0/68: dread d5/fa [0,4194304] 0 2024-04-20T21:58:19.414 INFO:tasks.workunit.client.0.smithi142.stdout:9/14: creat d0/f4 x:0 0 0 2024-04-20T21:58:19.422 INFO:tasks.workunit.client.0.smithi142.stdout:0/69: write d5/f18 [929816,13313] 0 2024-04-20T21:58:19.423 INFO:tasks.workunit.client.0.smithi142.stdout:8/44: unlink d0/cb 0 2024-04-20T21:58:19.426 INFO:tasks.workunit.client.0.smithi142.stdout:5/23: link f7 f8 0 2024-04-20T21:58:19.427 INFO:tasks.workunit.client.0.smithi142.stdout:7/24: rmdir d4/d7 0 2024-04-20T21:58:19.433 INFO:tasks.workunit.client.0.smithi142.stdout:8/45: creat d0/f11 x:0 0 0 2024-04-20T21:58:19.434 INFO:tasks.workunit.client.0.smithi142.stdout:5/24: chown f8 236075 1 2024-04-20T21:58:19.434 INFO:tasks.workunit.client.0.smithi142.stdout:0/70: rename l0 to d5/l1a 0 2024-04-20T21:58:19.436 INFO:tasks.workunit.client.0.smithi142.stdout:8/46: stat d0/fd 0 2024-04-20T21:58:19.438 INFO:tasks.workunit.client.0.smithi142.stdout:5/25: dread - f8 zero size 2024-04-20T21:58:19.441 INFO:tasks.workunit.client.0.smithi142.stdout:4/11: dwrite d1/f3 [0,4194304] 0 2024-04-20T21:58:19.443 INFO:tasks.workunit.client.0.smithi142.stdout:0/71: fsync d5/f18 0 2024-04-20T21:58:19.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:19 smithi164 ceph-mon[23506]: pgmap v31: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 75 KiB/s rd, 14 MiB/s wr, 279 op/s 2024-04-20T21:58:19.454 INFO:tasks.workunit.client.0.smithi142.stdout:8/47: unlink d0/f7 0 2024-04-20T21:58:19.456 INFO:tasks.workunit.client.0.smithi142.stdout:9/15: dwrite d0/f4 [0,4194304] 0 2024-04-20T21:58:19.465 INFO:tasks.workunit.client.0.smithi142.stdout:4/12: mkdir d1/d4 0 2024-04-20T21:58:19.466 INFO:tasks.workunit.client.0.smithi142.stdout:5/26: creat f9 x:0 0 0 2024-04-20T21:58:19.469 INFO:tasks.workunit.client.0.smithi142.stdout:4/13: write d1/f3 [3223402,7505] 0 2024-04-20T21:58:19.473 INFO:tasks.workunit.client.0.smithi142.stdout:0/72: creat d5/db/f1b x:0 0 0 2024-04-20T21:58:19.474 INFO:tasks.workunit.client.0.smithi142.stdout:3/17: dwrite f1 [4194304,4194304] 0 2024-04-20T21:58:19.475 INFO:tasks.workunit.client.0.smithi142.stdout:4/14: chown d1 20 1 2024-04-20T21:58:19.477 INFO:tasks.workunit.client.0.smithi142.stdout:5/27: write f9 [931861,86917] 0 2024-04-20T21:58:19.477 INFO:tasks.workunit.client.0.smithi142.stdout:8/48: mknod d0/c12 0 2024-04-20T21:58:19.479 INFO:tasks.workunit.client.0.smithi142.stdout:9/16: symlink d0/l5 0 2024-04-20T21:58:19.489 INFO:tasks.workunit.client.0.smithi142.stdout:5/28: mknod ca 0 2024-04-20T21:58:19.492 INFO:tasks.workunit.client.0.smithi142.stdout:8/49: rename d0/f9 to d0/f13 0 2024-04-20T21:58:19.492 INFO:tasks.workunit.client.0.smithi142.stdout:0/73: write d5/f12 [385344,53142] 0 2024-04-20T21:58:19.494 INFO:tasks.workunit.client.0.smithi142.stdout:0/74: write d5/f18 [1830156,46388] 0 2024-04-20T21:58:19.497 INFO:tasks.workunit.client.0.smithi142.stdout:5/29: mknod cb 0 2024-04-20T21:58:19.502 INFO:tasks.workunit.client.0.smithi142.stdout:8/50: symlink d0/l14 0 2024-04-20T21:58:19.505 INFO:tasks.workunit.client.0.smithi142.stdout:3/18: rmdir d3 0 2024-04-20T21:58:19.505 INFO:tasks.workunit.client.0.smithi142.stdout:5/30: mkdir dc 0 2024-04-20T21:58:19.506 INFO:tasks.workunit.client.0.smithi142.stdout:3/19: stat f2 0 2024-04-20T21:58:19.507 INFO:tasks.workunit.client.0.smithi142.stdout:5/31: chown f3 25 1 2024-04-20T21:58:19.507 INFO:tasks.workunit.client.0.smithi142.stdout:5/32: dread - f7 zero size 2024-04-20T21:58:19.514 INFO:tasks.workunit.client.0.smithi142.stdout:5/33: getdents dc 0 2024-04-20T21:58:19.519 INFO:tasks.workunit.client.0.smithi142.stdout:5/34: mknod dc/cd 0 2024-04-20T21:58:19.522 INFO:tasks.workunit.client.0.smithi142.stdout:5/35: fdatasync f3 0 2024-04-20T21:58:19.524 INFO:tasks.workunit.client.0.smithi142.stdout:3/20: dread f2 [0,4194304] 0 2024-04-20T21:58:19.527 INFO:tasks.workunit.client.0.smithi142.stdout:5/36: rename c5 to dc/ce 0 2024-04-20T21:58:19.533 INFO:tasks.workunit.client.0.smithi142.stdout:8/51: dwrite d0/fd [0,4194304] 0 2024-04-20T21:58:19.534 INFO:tasks.workunit.client.0.smithi142.stdout:8/52: readlink d0/l14 0 2024-04-20T21:58:19.535 INFO:tasks.workunit.client.0.smithi142.stdout:8/53: read - d0/f10 zero size 2024-04-20T21:58:19.536 INFO:tasks.workunit.client.0.smithi142.stdout:5/37: rename f1 to dc/ff 0 2024-04-20T21:58:19.539 INFO:tasks.workunit.client.0.smithi142.stdout:8/54: symlink d0/l15 0 2024-04-20T21:58:19.564 INFO:tasks.workunit.client.0.smithi142.stdout:8/55: dwrite d0/f13 [0,4194304] 0 2024-04-20T21:58:19.565 INFO:tasks.workunit.client.0.smithi142.stdout:8/56: fdatasync d0/fd 0 2024-04-20T21:58:19.627 INFO:tasks.workunit.client.0.smithi142.stdout:2/86: truncate d3/d6/ff 5169788 0 2024-04-20T21:58:19.628 INFO:tasks.workunit.client.0.smithi142.stdout:6/27: truncate d1/f4 5084376 0 2024-04-20T21:58:19.630 INFO:tasks.workunit.client.0.smithi142.stdout:2/87: mkdir d3/d5/d19 0 2024-04-20T21:58:19.631 INFO:tasks.workunit.client.0.smithi142.stdout:6/28: creat d1/d7/fa x:0 0 0 2024-04-20T21:58:19.633 INFO:tasks.workunit.client.0.smithi142.stdout:7/25: getdents d4 0 2024-04-20T21:58:19.635 INFO:tasks.workunit.client.0.smithi142.stdout:4/15: write d1/f3 [5023455,66682] 0 2024-04-20T21:58:19.638 INFO:tasks.workunit.client.0.smithi142.stdout:2/88: rmdir d3/d9/dc 39 2024-04-20T21:58:19.640 INFO:tasks.workunit.client.0.smithi142.stdout:0/75: getdents d5 0 2024-04-20T21:58:19.647 INFO:tasks.workunit.client.0.smithi142.stdout:0/76: mkdir d5/d1c 0 2024-04-20T21:58:19.651 INFO:tasks.workunit.client.0.smithi142.stdout:6/29: getdents d1/d5 0 2024-04-20T21:58:19.652 INFO:tasks.workunit.client.0.smithi142.stdout:6/30: read - d1/d7/fa zero size 2024-04-20T21:58:19.653 INFO:tasks.workunit.client.0.smithi142.stdout:0/77: mkdir d5/d1d 0 2024-04-20T21:58:19.657 INFO:tasks.workunit.client.0.smithi142.stdout:6/31: creat d1/d5/fb x:0 0 0 2024-04-20T21:58:19.659 INFO:tasks.workunit.client.0.smithi142.stdout:0/78: mkdir d5/d13/d1e 0 2024-04-20T21:58:19.661 INFO:tasks.workunit.client.0.smithi142.stdout:6/32: mknod d1/d7/cc 0 2024-04-20T21:58:19.662 INFO:tasks.workunit.client.0.smithi142.stdout:9/17: truncate d0/f4 2122960 0 2024-04-20T21:58:19.662 INFO:tasks.workunit.client.0.smithi142.stdout:1/13: sync 2024-04-20T21:58:19.665 INFO:tasks.workunit.client.0.smithi142.stdout:2/89: dwrite d3/d5/f17 [4194304,4194304] 0 2024-04-20T21:58:19.670 INFO:tasks.workunit.client.0.smithi142.stdout:9/18: symlink d0/l6 0 2024-04-20T21:58:19.677 INFO:tasks.workunit.client.0.smithi142.stdout:2/90: rename d3/c10 to d3/d5/d19/c1a 0 2024-04-20T21:58:19.677 INFO:tasks.workunit.client.0.smithi142.stdout:0/79: dread d5/f8 [0,4194304] 0 2024-04-20T21:58:19.680 INFO:tasks.workunit.client.0.smithi142.stdout:3/21: truncate f1 7966564 0 2024-04-20T21:58:19.681 INFO:tasks.workunit.client.0.smithi142.stdout:1/14: symlink d2/l3 0 2024-04-20T21:58:19.681 INFO:tasks.workunit.client.0.smithi142.stdout:1/15: dread - no filename 2024-04-20T21:58:19.681 INFO:tasks.workunit.client.0.smithi142.stdout:1/16: fdatasync - no filename 2024-04-20T21:58:19.681 INFO:tasks.workunit.client.0.smithi142.stdout:1/17: write - no filename 2024-04-20T21:58:19.685 INFO:tasks.workunit.client.0.smithi142.stdout:6/33: dwrite d1/d7/fa [0,4194304] 0 2024-04-20T21:58:19.689 INFO:tasks.workunit.client.0.smithi142.stdout:0/80: creat d5/db/f1f x:0 0 0 2024-04-20T21:58:19.690 INFO:tasks.workunit.client.0.smithi142.stdout:3/22: symlink l4 0 2024-04-20T21:58:19.692 INFO:tasks.workunit.client.0.smithi142.stdout:1/18: mknod d2/c4 0 2024-04-20T21:58:19.695 INFO:tasks.workunit.client.0.smithi142.stdout:0/81: symlink d5/d13/l20 0 2024-04-20T21:58:19.699 INFO:tasks.workunit.client.0.smithi142.stdout:1/19: mknod d2/c5 0 2024-04-20T21:58:19.699 INFO:tasks.workunit.client.0.smithi142.stdout:1/20: dwrite - no filename 2024-04-20T21:58:19.699 INFO:tasks.workunit.client.0.smithi142.stdout:1/21: dread - no filename 2024-04-20T21:58:19.699 INFO:tasks.workunit.client.0.smithi142.stdout:1/22: write - no filename 2024-04-20T21:58:19.706 INFO:tasks.workunit.client.0.smithi142.stdout:0/82: creat d5/f21 x:0 0 0 2024-04-20T21:58:19.707 INFO:tasks.workunit.client.0.smithi142.stdout:1/23: rmdir d2 39 2024-04-20T21:58:19.711 INFO:tasks.workunit.client.0.smithi142.stdout:1/24: stat d2/l3 0 2024-04-20T21:58:19.715 INFO:tasks.workunit.client.0.smithi142.stdout:2/91: rename d3/d6/ff to d3/d9/dc/f1b 0 2024-04-20T21:58:19.716 INFO:tasks.workunit.client.0.smithi142.stdout:0/83: creat d5/d1d/f22 x:0 0 0 2024-04-20T21:58:19.717 INFO:tasks.workunit.client.0.smithi142.stdout:2/92: chown d3/d9/dc/l13 45000406 1 2024-04-20T21:58:19.718 INFO:tasks.workunit.client.0.smithi142.stdout:1/25: creat d2/f6 x:0 0 0 2024-04-20T21:58:19.719 INFO:tasks.workunit.client.0.smithi142.stdout:2/93: chown d3/ce 12 1 2024-04-20T21:58:19.721 INFO:tasks.workunit.client.0.smithi142.stdout:1/26: write d2/f6 [630225,66517] 0 2024-04-20T21:58:19.722 INFO:tasks.workunit.client.0.smithi142.stdout:1/27: readlink d2/l3 0 2024-04-20T21:58:19.722 INFO:tasks.workunit.client.0.smithi142.stdout:7/26: write f1 [5301890,63345] 0 2024-04-20T21:58:19.725 INFO:tasks.workunit.client.0.smithi142.stdout:0/84: mkdir d5/d13/d1e/d23 0 2024-04-20T21:58:19.726 INFO:tasks.workunit.client.0.smithi142.stdout:2/94: creat d3/d5/d19/f1c x:0 0 0 2024-04-20T21:58:19.726 INFO:tasks.workunit.client.0.smithi142.stdout:1/28: truncate d2/f6 1314979 0 2024-04-20T21:58:19.727 INFO:tasks.workunit.client.0.smithi142.stdout:4/16: truncate d1/f3 4950984 0 2024-04-20T21:58:19.732 INFO:tasks.workunit.client.0.smithi142.stdout:1/29: creat d2/f7 x:0 0 0 2024-04-20T21:58:19.734 INFO:tasks.workunit.client.0.smithi142.stdout:1/30: chown d2/c4 379 1 2024-04-20T21:58:19.735 INFO:tasks.workunit.client.0.smithi142.stdout:7/27: dread f1 [4194304,4194304] 0 2024-04-20T21:58:19.736 INFO:tasks.workunit.client.0.smithi142.stdout:9/19: write d0/f4 [3080347,61824] 0 2024-04-20T21:58:19.738 INFO:tasks.workunit.client.0.smithi142.stdout:0/85: mkdir d5/d13/d1e/d23/d24 0 2024-04-20T21:58:19.740 INFO:tasks.workunit.client.0.smithi142.stdout:1/31: mknod d2/c8 0 2024-04-20T21:58:19.741 INFO:tasks.workunit.client.0.smithi142.stdout:9/20: fsync d0/f4 0 2024-04-20T21:58:19.742 INFO:tasks.workunit.client.0.smithi142.stdout:7/28: mkdir d4/d9 0 2024-04-20T21:58:19.743 INFO:tasks.workunit.client.0.smithi142.stdout:7/29: rename d4 to d4/da 22 2024-04-20T21:58:19.744 INFO:tasks.workunit.client.0.smithi142.stdout:7/30: chown d4/l5 76 1 2024-04-20T21:58:19.747 INFO:tasks.workunit.client.0.smithi142.stdout:0/86: fsync d5/f9 0 2024-04-20T21:58:19.748 INFO:tasks.workunit.client.0.smithi142.stdout:0/87: fsync d5/f9 0 2024-04-20T21:58:19.750 INFO:tasks.workunit.client.0.smithi142.stdout:7/31: creat d4/fb x:0 0 0 2024-04-20T21:58:19.752 INFO:tasks.workunit.client.0.smithi142.stdout:7/32: chown d4/l6 0 1 2024-04-20T21:58:19.756 INFO:tasks.workunit.client.0.smithi142.stdout:3/23: dread f1 [0,4194304] 0 2024-04-20T21:58:19.756 INFO:tasks.workunit.client.0.smithi142.stdout:0/88: creat d5/d13/d1e/d23/f25 x:0 0 0 2024-04-20T21:58:19.757 INFO:tasks.workunit.client.0.smithi142.stdout:1/32: link d2/c5 d2/c9 0 2024-04-20T21:58:19.758 INFO:tasks.workunit.client.0.smithi142.stdout:0/89: dread - d5/d1d/f22 zero size 2024-04-20T21:58:19.758 INFO:tasks.workunit.client.0.smithi142.stdout:9/21: link d0/l6 d0/l7 0 2024-04-20T21:58:19.761 INFO:tasks.workunit.client.0.smithi142.stdout:3/24: truncate f2 4447633 0 2024-04-20T21:58:19.765 INFO:tasks.workunit.client.0.smithi142.stdout:1/33: rename d2/l3 to d2/la 0 2024-04-20T21:58:19.766 INFO:tasks.workunit.client.0.smithi142.stdout:1/34: chown d2/c4 6182 1 2024-04-20T21:58:19.770 INFO:tasks.workunit.client.0.smithi142.stdout:3/25: fdatasync f2 0 2024-04-20T21:58:19.774 INFO:tasks.workunit.client.0.smithi142.stdout:0/90: creat d5/d1c/f26 x:0 0 0 2024-04-20T21:58:19.774 INFO:tasks.workunit.client.0.smithi142.stdout:7/33: dwrite f1 [0,4194304] 0 2024-04-20T21:58:19.776 INFO:tasks.workunit.client.0.smithi142.stdout:0/91: fdatasync d5/f12 0 2024-04-20T21:58:19.780 INFO:tasks.workunit.client.0.smithi142.stdout:0/92: read - d5/d1d/f22 zero size 2024-04-20T21:58:19.783 INFO:tasks.workunit.client.0.smithi142.stdout:3/26: fsync f1 0 2024-04-20T21:58:19.789 INFO:tasks.workunit.client.0.smithi142.stdout:7/34: unlink d4/l5 0 2024-04-20T21:58:19.791 INFO:tasks.workunit.client.0.smithi142.stdout:1/35: dwrite d2/f6 [0,4194304] 0 2024-04-20T21:58:19.793 INFO:tasks.workunit.client.0.smithi142.stdout:1/36: read - d2/f7 zero size 2024-04-20T21:58:19.795 INFO:tasks.workunit.client.0.smithi142.stdout:1/37: chown d2 1226759 1 2024-04-20T21:58:19.797 INFO:tasks.workunit.client.0.smithi142.stdout:4/17: dread d1/f3 [0,4194304] 0 2024-04-20T21:58:19.805 INFO:tasks.workunit.client.0.smithi142.stdout:3/27: mknod c5 0 2024-04-20T21:58:19.808 INFO:tasks.workunit.client.0.smithi142.stdout:7/35: creat d4/fc x:0 0 0 2024-04-20T21:58:19.811 INFO:tasks.workunit.client.0.smithi142.stdout:3/28: fsync f2 0 2024-04-20T21:58:19.815 INFO:tasks.workunit.client.0.smithi142.stdout:1/38: stat d2/c9 0 2024-04-20T21:58:19.815 INFO:tasks.workunit.client.0.smithi142.stdout:7/36: write f1 [6378255,95933] 0 2024-04-20T21:58:19.815 INFO:tasks.workunit.client.0.smithi142.stdout:0/93: dread d5/f18 [0,4194304] 0 2024-04-20T21:58:19.816 INFO:tasks.workunit.client.0.smithi142.stdout:9/22: getdents d0 0 2024-04-20T21:58:19.818 INFO:tasks.workunit.client.0.smithi142.stdout:4/18: dread f0 [0,4194304] 0 2024-04-20T21:58:19.821 INFO:tasks.workunit.client.0.smithi142.stdout:4/19: chown f0 197418541 1 2024-04-20T21:58:19.830 INFO:tasks.workunit.client.0.smithi142.stdout:3/29: mkdir d6 0 2024-04-20T21:58:19.834 INFO:tasks.workunit.client.0.smithi142.stdout:9/23: creat d0/f8 x:0 0 0 2024-04-20T21:58:19.838 INFO:tasks.workunit.client.0.smithi142.stdout:2/95: truncate f0 5672529 0 2024-04-20T21:58:19.840 INFO:tasks.workunit.client.0.smithi142.stdout:7/37: symlink d4/d9/ld 0 2024-04-20T21:58:19.842 INFO:tasks.workunit.client.0.smithi142.stdout:4/20: link f0 d1/f5 0 2024-04-20T21:58:19.844 INFO:tasks.workunit.client.0.smithi142.stdout:2/96: write d3/d5/d19/f1c [486465,89029] 0 2024-04-20T21:58:19.845 INFO:tasks.workunit.client.0.smithi142.stdout:4/21: chown d1 106 1 2024-04-20T21:58:19.846 INFO:tasks.workunit.client.0.smithi142.stdout:4/22: read d1/f3 [1332412,20859] 0 2024-04-20T21:58:19.846 INFO:tasks.workunit.client.0.smithi142.stdout:1/39: dwrite d2/f6 [0,4194304] 0 2024-04-20T21:58:19.849 INFO:tasks.workunit.client.0.smithi142.stdout:3/30: creat d6/f7 x:0 0 0 2024-04-20T21:58:19.849 INFO:tasks.workunit.client.0.smithi142.stdout:1/40: truncate d2/f7 30346 0 2024-04-20T21:58:19.853 INFO:tasks.workunit.client.0.smithi142.stdout:2/97: symlink d3/d5/l1d 0 2024-04-20T21:58:19.857 INFO:tasks.workunit.client.0.smithi142.stdout:9/24: truncate d0/f4 283729 0 2024-04-20T21:58:19.864 INFO:tasks.workunit.client.0.smithi142.stdout:9/25: write d0/f8 [483061,86848] 0 2024-04-20T21:58:19.865 INFO:tasks.workunit.client.0.smithi142.stdout:4/23: write d1/f5 [1177022,57363] 0 2024-04-20T21:58:19.865 INFO:tasks.workunit.client.0.smithi142.stdout:0/94: getdents d5/d13 0 2024-04-20T21:58:19.866 INFO:tasks.workunit.client.0.smithi142.stdout:1/41: symlink d2/lb 0 2024-04-20T21:58:19.871 INFO:tasks.workunit.client.0.smithi142.stdout:1/42: dread d2/f7 [0,4194304] 0 2024-04-20T21:58:19.873 INFO:tasks.workunit.client.0.smithi142.stdout:7/38: dwrite f1 [4194304,4194304] 0 2024-04-20T21:58:19.876 INFO:tasks.workunit.client.0.smithi142.stdout:0/95: dread - d5/d13/f14 zero size 2024-04-20T21:58:19.880 INFO:tasks.workunit.client.0.smithi142.stdout:7/39: chown d4/d9/ld 297578 1 2024-04-20T21:58:19.885 INFO:tasks.workunit.client.0.smithi142.stdout:7/40: fdatasync d4/fb 0 2024-04-20T21:58:19.888 INFO:tasks.workunit.client.0.smithi142.stdout:1/43: dread d2/f7 [0,4194304] 0 2024-04-20T21:58:19.892 INFO:tasks.workunit.client.0.smithi142.stdout:2/98: dwrite d3/d5/d19/f1c [0,4194304] 0 2024-04-20T21:58:19.893 INFO:tasks.workunit.client.0.smithi142.stdout:0/96: dread d5/f9 [4194304,4194304] 0 2024-04-20T21:58:19.896 INFO:tasks.workunit.client.0.smithi142.stdout:0/97: stat d5/ff 0 2024-04-20T21:58:19.899 INFO:tasks.workunit.client.0.smithi142.stdout:0/98: chown d5/ff 1187 1 2024-04-20T21:58:19.910 INFO:tasks.workunit.client.0.smithi142.stdout:4/24: dread d1/f5 [0,4194304] 0 2024-04-20T21:58:19.915 INFO:tasks.workunit.client.0.smithi142.stdout:7/41: dwrite f1 [0,4194304] 0 2024-04-20T21:58:19.920 INFO:tasks.workunit.client.0.smithi142.stdout:9/26: creat d0/f9 x:0 0 0 2024-04-20T21:58:19.921 INFO:tasks.workunit.client.0.smithi142.stdout:7/42: readlink d4/d9/ld 0 2024-04-20T21:58:19.922 INFO:tasks.workunit.client.0.smithi142.stdout:9/27: write d0/f8 [630678,52705] 0 2024-04-20T21:58:19.936 INFO:tasks.workunit.client.0.smithi142.stdout:1/44: symlink d2/lc 0 2024-04-20T21:58:19.938 INFO:tasks.workunit.client.0.smithi142.stdout:4/25: mkdir d1/d6 0 2024-04-20T21:58:19.943 INFO:tasks.workunit.client.0.smithi142.stdout:7/43: symlink d4/le 0 2024-04-20T21:58:19.951 INFO:tasks.workunit.client.0.smithi142.stdout:1/45: mkdir d2/dd 0 2024-04-20T21:58:19.952 INFO:tasks.workunit.client.0.smithi142.stdout:1/46: fsync d2/f6 0 2024-04-20T21:58:19.954 INFO:tasks.workunit.client.0.smithi142.stdout:1/47: write d2/f6 [2534310,60405] 0 2024-04-20T21:58:19.957 INFO:tasks.workunit.client.0.smithi142.stdout:7/44: unlink d4/fc 0 2024-04-20T21:58:19.964 INFO:tasks.workunit.client.0.smithi142.stdout:4/26: mknod d1/d6/c7 0 2024-04-20T21:58:19.968 INFO:tasks.workunit.client.0.smithi142.stdout:7/45: dread f1 [4194304,4194304] 0 2024-04-20T21:58:19.970 INFO:tasks.workunit.client.0.smithi142.stdout:1/48: dread d2/f7 [0,4194304] 0 2024-04-20T21:58:19.984 INFO:tasks.workunit.client.0.smithi142.stdout:4/27: getdents d1/d4 0 2024-04-20T21:58:19.986 INFO:tasks.workunit.client.0.smithi142.stdout:4/28: read d1/f3 [2643235,100868] 0 2024-04-20T21:58:19.986 INFO:tasks.workunit.client.0.smithi142.stdout:1/49: creat d2/dd/fe x:0 0 0 2024-04-20T21:58:19.992 INFO:tasks.workunit.client.0.smithi142.stdout:4/29: link d1/f5 d1/f8 0 2024-04-20T21:58:19.996 INFO:tasks.workunit.client.0.smithi142.stdout:4/30: write d1/f3 [2378568,32113] 0 2024-04-20T21:58:19.998 INFO:tasks.workunit.client.0.smithi142.stdout:9/28: write d0/f4 [64302,64307] 0 2024-04-20T21:58:19.999 INFO:tasks.workunit.client.0.smithi142.stdout:6/34: sync 2024-04-20T21:58:20.000 INFO:tasks.workunit.client.0.smithi142.stdout:5/38: sync 2024-04-20T21:58:20.000 INFO:tasks.workunit.client.0.smithi142.stdout:8/57: sync 2024-04-20T21:58:20.008 INFO:tasks.workunit.client.0.smithi142.stdout:5/39: creat dc/f10 x:0 0 0 2024-04-20T21:58:20.010 INFO:tasks.workunit.client.0.smithi142.stdout:6/35: mknod d1/d7/cd 0 2024-04-20T21:58:20.015 INFO:tasks.workunit.client.0.smithi142.stdout:2/99: dwrite f0 [0,4194304] 0 2024-04-20T21:58:20.026 INFO:tasks.workunit.client.0.smithi142.stdout:2/100: mknod d3/d5/c1e 0 2024-04-20T21:58:20.030 INFO:tasks.workunit.client.0.smithi142.stdout:9/29: dwrite d0/f9 [0,4194304] 0 2024-04-20T21:58:20.035 INFO:tasks.workunit.client.0.smithi142.stdout:2/101: creat d3/f1f x:0 0 0 2024-04-20T21:58:20.040 INFO:tasks.workunit.client.0.smithi142.stdout:5/40: dwrite f3 [8388608,4194304] 0 2024-04-20T21:58:20.040 INFO:tasks.workunit.client.0.smithi142.stdout:9/30: dread d0/f4 [0,4194304] 0 2024-04-20T21:58:20.044 INFO:tasks.workunit.client.0.smithi142.stdout:1/50: getdents d2/dd 0 2024-04-20T21:58:20.048 INFO:tasks.workunit.client.0.smithi142.stdout:1/51: write d2/f6 [1590455,85710] 0 2024-04-20T21:58:20.050 INFO:tasks.workunit.client.0.smithi142.stdout:4/31: truncate d1/f8 666268 0 2024-04-20T21:58:20.051 INFO:tasks.workunit.client.0.smithi142.stdout:1/52: stat d2/f6 0 2024-04-20T21:58:20.051 INFO:tasks.workunit.client.0.smithi142.stdout:6/36: dwrite d1/d5/fb [0,4194304] 0 2024-04-20T21:58:20.053 INFO:tasks.workunit.client.0.smithi142.stdout:9/31: creat d0/fa x:0 0 0 2024-04-20T21:58:20.054 INFO:tasks.workunit.client.0.smithi142.stdout:9/32: write d0/f9 [744345,65938] 0 2024-04-20T21:58:20.057 INFO:tasks.workunit.client.0.smithi142.stdout:1/53: dread d2/f7 [0,4194304] 0 2024-04-20T21:58:20.059 INFO:tasks.workunit.client.0.smithi142.stdout:2/102: dread f0 [0,4194304] 0 2024-04-20T21:58:20.064 INFO:tasks.workunit.client.0.smithi142.stdout:4/32: fdatasync d1/f5 0 2024-04-20T21:58:20.079 INFO:tasks.workunit.client.0.smithi142.stdout:1/54: rename d2/c9 to d2/cf 0 2024-04-20T21:58:20.083 INFO:tasks.workunit.client.0.smithi142.stdout:2/103: dread d3/d5/f17 [0,4194304] 0 2024-04-20T21:58:20.089 INFO:tasks.workunit.client.0.smithi142.stdout:4/33: dread d1/f3 [0,4194304] 0 2024-04-20T21:58:20.089 INFO:tasks.workunit.client.0.smithi142.stdout:6/37: dread d1/f4 [0,4194304] 0 2024-04-20T21:58:20.090 INFO:tasks.workunit.client.0.smithi142.stdout:2/104: write d3/d5/d19/f1c [3099520,50225] 0 2024-04-20T21:58:20.099 INFO:tasks.workunit.client.0.smithi142.stdout:9/33: dwrite d0/f4 [0,4194304] 0 2024-04-20T21:58:20.099 INFO:tasks.workunit.client.0.smithi142.stdout:4/34: rename d1/l2 to d1/d6/l9 0 2024-04-20T21:58:20.102 INFO:tasks.workunit.client.0.smithi142.stdout:2/105: creat d3/d5/f20 x:0 0 0 2024-04-20T21:58:20.105 INFO:tasks.workunit.client.0.smithi142.stdout:2/106: chown d3/d5 14 1 2024-04-20T21:58:20.105 INFO:tasks.workunit.client.0.smithi142.stdout:6/38: dread d1/d5/fb [0,4194304] 0 2024-04-20T21:58:20.107 INFO:tasks.workunit.client.0.smithi142.stdout:9/34: creat d0/fb x:0 0 0 2024-04-20T21:58:20.111 INFO:tasks.workunit.client.0.smithi142.stdout:2/107: creat d3/d5/d19/f21 x:0 0 0 2024-04-20T21:58:20.116 INFO:tasks.workunit.client.0.smithi142.stdout:9/35: creat d0/fc x:0 0 0 2024-04-20T21:58:20.116 INFO:tasks.workunit.client.0.smithi142.stdout:2/108: mkdir d3/d9/dc/d22 0 2024-04-20T21:58:20.117 INFO:tasks.workunit.client.0.smithi142.stdout:4/35: dread d1/f3 [0,4194304] 0 2024-04-20T21:58:20.120 INFO:tasks.workunit.client.0.smithi142.stdout:6/39: link d1/d7/cc d1/d5/ce 0 2024-04-20T21:58:20.120 INFO:tasks.workunit.client.0.smithi142.stdout:2/109: mknod d3/d6/c23 0 2024-04-20T21:58:20.123 INFO:tasks.workunit.client.0.smithi142.stdout:4/36: chown d1/f3 0 1 2024-04-20T21:58:20.132 INFO:tasks.workunit.client.0.smithi142.stdout:4/37: mkdir d1/d4/da 0 2024-04-20T21:58:20.134 INFO:tasks.workunit.client.0.smithi142.stdout:5/41: truncate f4 488187 0 2024-04-20T21:58:20.139 INFO:tasks.workunit.client.0.smithi142.stdout:4/38: mkdir d1/db 0 2024-04-20T21:58:20.139 INFO:tasks.workunit.client.0.smithi142.stdout:9/36: dwrite d0/fc [0,4194304] 0 2024-04-20T21:58:20.143 INFO:tasks.workunit.client.0.smithi142.stdout:2/110: dread d3/d5/f17 [4194304,4194304] 0 2024-04-20T21:58:20.144 INFO:tasks.workunit.client.0.smithi142.stdout:5/42: creat dc/f11 x:0 0 0 2024-04-20T21:58:20.145 INFO:tasks.workunit.client.0.smithi142.stdout:4/39: fdatasync d1/f3 0 2024-04-20T21:58:20.145 INFO:tasks.workunit.client.0.smithi142.stdout:2/111: chown d3/d9/c14 20228146 1 2024-04-20T21:58:20.148 INFO:tasks.workunit.client.0.smithi142.stdout:6/40: dwrite d1/d5/fb [0,4194304] 0 2024-04-20T21:58:20.148 INFO:tasks.workunit.client.0.smithi142.stdout:9/37: chown d0/l6 167780404 1 2024-04-20T21:58:20.150 INFO:tasks.workunit.client.0.smithi142.stdout:2/112: truncate d3/d5/f20 1007239 0 2024-04-20T21:58:20.162 INFO:tasks.workunit.client.0.smithi142.stdout:5/43: creat dc/f12 x:0 0 0 2024-04-20T21:58:20.164 INFO:tasks.workunit.client.0.smithi142.stdout:5/44: stat cb 0 2024-04-20T21:58:20.164 INFO:tasks.workunit.client.0.smithi142.stdout:6/41: creat d1/d7/ff x:0 0 0 2024-04-20T21:58:20.176 INFO:tasks.workunit.client.0.smithi142.stdout:2/113: dwrite d3/d5/d19/f1c [0,4194304] 0 2024-04-20T21:58:20.194 INFO:tasks.workunit.client.0.smithi142.stdout:4/40: dwrite d1/f8 [0,4194304] 0 2024-04-20T21:58:20.214 INFO:tasks.workunit.client.0.smithi142.stdout:6/42: symlink d1/d5/l10 0 2024-04-20T21:58:20.216 INFO:tasks.workunit.client.0.smithi142.stdout:2/114: fsync f0 0 2024-04-20T21:58:20.222 INFO:tasks.workunit.client.0.smithi142.stdout:4/41: rename d1/f5 to d1/d6/fc 0 2024-04-20T21:58:20.223 INFO:tasks.workunit.client.0.smithi142.stdout:4/42: read d1/f8 [317006,46253] 0 2024-04-20T21:58:20.224 INFO:tasks.workunit.client.0.smithi142.stdout:4/43: stat f0 0 2024-04-20T21:58:20.228 INFO:tasks.workunit.client.0.smithi142.stdout:6/43: dread d1/d5/fb [0,4194304] 0 2024-04-20T21:58:20.231 INFO:tasks.workunit.client.0.smithi142.stdout:4/44: rmdir d1/d6 39 2024-04-20T21:58:20.233 INFO:tasks.workunit.client.0.smithi142.stdout:5/45: getdents dc 0 2024-04-20T21:58:20.233 INFO:tasks.workunit.client.0.smithi142.stdout:5/46: readlink - no filename 2024-04-20T21:58:20.238 INFO:tasks.workunit.client.0.smithi142.stdout:2/115: rmdir d3/d9/dc/d22 0 2024-04-20T21:58:20.244 INFO:tasks.workunit.client.0.smithi142.stdout:2/116: write d3/d5/f17 [3581051,109859] 0 2024-04-20T21:58:20.248 INFO:tasks.workunit.client.0.smithi142.stdout:2/117: mkdir d3/d24 0 2024-04-20T21:58:20.251 INFO:tasks.workunit.client.0.smithi142.stdout:2/118: creat d3/f25 x:0 0 0 2024-04-20T21:58:20.364 INFO:tasks.workunit.client.0.smithi142.stdout:4/45: dwrite d1/d6/fc [0,4194304] 0 2024-04-20T21:58:20.369 INFO:tasks.workunit.client.0.smithi142.stdout:2/119: rename d3/d9/dc/l13 to d3/d24/l26 0 2024-04-20T21:58:20.373 INFO:tasks.workunit.client.0.smithi142.stdout:2/120: write d3/f1f [270782,10823] 0 2024-04-20T21:58:20.375 INFO:tasks.workunit.client.0.smithi142.stdout:4/46: getdents d1 0 2024-04-20T21:58:20.375 INFO:tasks.workunit.client.0.smithi142.stdout:6/44: dwrite d1/f4 [0,4194304] 0 2024-04-20T21:58:20.377 INFO:tasks.workunit.client.0.smithi142.stdout:4/47: write d1/f8 [3300538,23312] 0 2024-04-20T21:58:20.378 INFO:tasks.workunit.client.0.smithi142.stdout:2/121: rmdir d3/d5 39 2024-04-20T21:58:20.384 INFO:tasks.workunit.client.0.smithi142.stdout:4/48: symlink d1/d4/ld 0 2024-04-20T21:58:20.386 INFO:tasks.workunit.client.0.smithi142.stdout:4/49: write d1/d6/fc [431381,50935] 0 2024-04-20T21:58:20.392 INFO:tasks.workunit.client.0.smithi142.stdout:2/122: mknod d3/d5/d19/c27 0 2024-04-20T21:58:20.397 INFO:tasks.workunit.client.0.smithi142.stdout:4/50: rename d1/d6/c7 to d1/d6/ce 0 2024-04-20T21:58:20.404 INFO:tasks.workunit.client.0.smithi142.stdout:6/45: dwrite d1/d7/fa [0,4194304] 0 2024-04-20T21:58:20.412 INFO:tasks.workunit.client.0.smithi142.stdout:6/46: rename d1/d7 to d1/d11 0 2024-04-20T21:58:20.414 INFO:tasks.workunit.client.0.smithi142.stdout:3/31: sync 2024-04-20T21:58:20.414 INFO:tasks.workunit.client.0.smithi142.stdout:0/99: sync 2024-04-20T21:58:20.416 INFO:tasks.workunit.client.0.smithi142.stdout:0/100: stat d5/l16 0 2024-04-20T21:58:20.416 INFO:tasks.workunit.client.0.smithi142.stdout:6/47: creat d1/d5/f12 x:0 0 0 2024-04-20T21:58:20.422 INFO:tasks.workunit.client.0.smithi142.stdout:4/51: dwrite d1/f8 [0,4194304] 0 2024-04-20T21:58:20.425 INFO:tasks.workunit.client.0.smithi142.stdout:2/123: truncate d3/d5/d19/f1c 3677223 0 2024-04-20T21:58:20.427 INFO:tasks.workunit.client.0.smithi142.stdout:6/48: mknod d1/d11/c13 0 2024-04-20T21:58:20.427 INFO:tasks.workunit.client.0.smithi142.stdout:0/101: rename d5/l16 to d5/d13/d1e/d23/d24/l27 0 2024-04-20T21:58:20.433 INFO:tasks.workunit.client.0.smithi142.stdout:3/32: getdents d6 0 2024-04-20T21:58:20.433 INFO:tasks.workunit.client.0.smithi142.stdout:2/124: creat d3/d5/d19/f28 x:0 0 0 2024-04-20T21:58:20.437 INFO:tasks.workunit.client.0.smithi142.stdout:3/33: unlink l4 0 2024-04-20T21:58:20.441 INFO:tasks.workunit.client.0.smithi142.stdout:2/125: rmdir d3/d9/dc 39 2024-04-20T21:58:20.442 INFO:tasks.workunit.client.0.smithi142.stdout:2/126: fdatasync d3/f1f 0 2024-04-20T21:58:20.446 INFO:tasks.workunit.client.0.smithi142.stdout:4/52: dwrite d1/d6/fc [0,4194304] 0 2024-04-20T21:58:20.448 INFO:tasks.workunit.client.0.smithi142.stdout:4/53: readlink d1/d4/ld 0 2024-04-20T21:58:20.453 INFO:tasks.workunit.client.0.smithi142.stdout:2/127: mknod d3/d9/dc/c29 0 2024-04-20T21:58:20.454 INFO:tasks.workunit.client.0.smithi142.stdout:3/34: dread f1 [4194304,4194304] 0 2024-04-20T21:58:20.466 INFO:tasks.workunit.client.0.smithi142.stdout:2/128: unlink d3/d5/d19/f1c 0 2024-04-20T21:58:20.469 INFO:tasks.workunit.client.0.smithi142.stdout:4/54: dwrite f0 [0,4194304] 0 2024-04-20T21:58:20.472 INFO:tasks.workunit.client.0.smithi142.stdout:2/129: creat d3/d5/f2a x:0 0 0 2024-04-20T21:58:20.472 INFO:tasks.workunit.client.0.smithi142.stdout:3/35: write f1 [7874541,16752] 0 2024-04-20T21:58:20.474 INFO:tasks.workunit.client.0.smithi142.stdout:4/55: creat d1/ff x:0 0 0 2024-04-20T21:58:20.477 INFO:tasks.workunit.client.0.smithi142.stdout:2/130: unlink d3/d9/dc/c29 0 2024-04-20T21:58:20.490 INFO:tasks.workunit.client.0.smithi142.stdout:4/56: chown d1/d6/fc 6046839 1 2024-04-20T21:58:20.494 INFO:tasks.workunit.client.0.smithi142.stdout:2/131: dwrite d3/d5/f17 [0,4194304] 0 2024-04-20T21:58:20.511 INFO:tasks.workunit.client.0.smithi142.stdout:2/132: truncate d3/d5/f20 15729 0 2024-04-20T21:58:20.513 INFO:tasks.workunit.client.0.smithi142.stdout:2/133: symlink d3/d24/l2b 0 2024-04-20T21:58:20.514 INFO:tasks.workunit.client.0.smithi142.stdout:2/134: chown d3/d5/l8 60 1 2024-04-20T21:58:20.516 INFO:tasks.workunit.client.0.smithi142.stdout:2/135: read - d3/d5/f2a zero size 2024-04-20T21:58:20.518 INFO:tasks.workunit.client.0.smithi142.stdout:2/136: mknod d3/d6/c2c 0 2024-04-20T21:58:20.526 INFO:tasks.workunit.client.0.smithi142.stdout:2/137: dread f0 [0,4194304] 0 2024-04-20T21:58:20.530 INFO:tasks.workunit.client.0.smithi142.stdout:2/138: dread f0 [4194304,4194304] 0 2024-04-20T21:58:20.532 INFO:tasks.workunit.client.0.smithi142.stdout:2/139: creat d3/d6/f2d x:0 0 0 2024-04-20T21:58:20.535 INFO:tasks.workunit.client.0.smithi142.stdout:2/140: symlink d3/d9/l2e 0 2024-04-20T21:58:20.539 INFO:tasks.workunit.client.0.smithi142.stdout:2/141: rename d3/d6/c16 to d3/c2f 0 2024-04-20T21:58:20.542 INFO:tasks.workunit.client.0.smithi142.stdout:2/142: creat d3/d5/d19/f30 x:0 0 0 2024-04-20T21:58:20.544 INFO:tasks.workunit.client.0.smithi142.stdout:2/143: mkdir d3/d6/d31 0 2024-04-20T21:58:20.546 INFO:tasks.workunit.client.0.smithi142.stdout:2/144: mknod d3/d5/d19/c32 0 2024-04-20T21:58:20.549 INFO:tasks.workunit.client.0.smithi142.stdout:2/145: truncate d3/d5/d19/f30 600791 0 2024-04-20T21:58:20.551 INFO:tasks.workunit.client.0.smithi142.stdout:2/146: stat d3/d5/f20 0 2024-04-20T21:58:20.553 INFO:tasks.workunit.client.0.smithi142.stdout:2/147: write d3/d9/dc/f1b [681915,31716] 0 2024-04-20T21:58:20.562 INFO:tasks.workunit.client.0.smithi142.stdout:2/148: read d3/d5/f20 [5191,82196] 0 2024-04-20T21:58:20.568 INFO:tasks.workunit.client.0.smithi142.stdout:2/149: creat d3/d9/f33 x:0 0 0 2024-04-20T21:58:20.571 INFO:tasks.workunit.client.0.smithi142.stdout:2/150: truncate d3/d5/d19/f21 460457 0 2024-04-20T21:58:20.575 INFO:tasks.workunit.client.0.smithi142.stdout:2/151: mkdir d3/d9/d34 0 2024-04-20T21:58:20.578 INFO:tasks.workunit.client.0.smithi142.stdout:2/152: write d3/d5/f20 [737284,112090] 0 2024-04-20T21:58:20.580 INFO:tasks.workunit.client.0.smithi142.stdout:2/153: readlink d3/d9/dc/l15 0 2024-04-20T21:58:20.582 INFO:tasks.workunit.client.0.smithi142.stdout:2/154: rmdir d3/d6 39 2024-04-20T21:58:20.600 INFO:tasks.workunit.client.0.smithi142.stdout:2/155: dwrite d3/d5/d19/f30 [0,4194304] 0 2024-04-20T21:58:20.605 INFO:tasks.workunit.client.0.smithi142.stdout:2/156: creat d3/d9/d34/f35 x:0 0 0 2024-04-20T21:58:20.609 INFO:tasks.workunit.client.0.smithi142.stdout:2/157: link f0 d3/d9/dc/f36 0 2024-04-20T21:58:20.614 INFO:tasks.workunit.client.0.smithi142.stdout:2/158: rename d3/d24/l26 to d3/l37 0 2024-04-20T21:58:20.616 INFO:tasks.workunit.client.0.smithi142.stdout:2/159: creat d3/d9/dc/f38 x:0 0 0 2024-04-20T21:58:20.619 INFO:tasks.workunit.client.0.smithi142.stdout:2/160: unlink d3/d5/d19/f28 0 2024-04-20T21:58:20.622 INFO:tasks.workunit.client.0.smithi142.stdout:2/161: mknod d3/d5/d19/c39 0 2024-04-20T21:58:20.635 INFO:tasks.workunit.client.0.smithi142.stdout:2/162: dread d3/d5/d19/f30 [0,4194304] 0 2024-04-20T21:58:20.638 INFO:tasks.workunit.client.0.smithi142.stdout:2/163: truncate d3/d9/dc/f38 419164 0 2024-04-20T21:58:20.641 INFO:tasks.workunit.client.0.smithi142.stdout:2/164: write d3/d6/f2d [527281,108226] 0 2024-04-20T21:58:20.642 INFO:tasks.workunit.client.0.smithi142.stdout:2/165: chown d3/d5/d19/f30 140218821 1 2024-04-20T21:58:20.646 INFO:tasks.workunit.client.0.smithi142.stdout:2/166: dread - d3/d9/d34/f35 zero size 2024-04-20T21:58:20.646 INFO:tasks.workunit.client.0.smithi142.stdout:2/167: write d3/f1f [875273,23515] 0 2024-04-20T21:58:20.647 INFO:tasks.workunit.client.0.smithi142.stdout:2/168: mknod d3/d5/d19/c3a 0 2024-04-20T21:58:20.649 INFO:tasks.workunit.client.0.smithi142.stdout:2/169: write d3/d9/dc/f38 [1076111,34280] 0 2024-04-20T21:58:20.650 INFO:tasks.workunit.client.0.smithi142.stdout:2/170: chown d3 974565 1 2024-04-20T21:58:20.651 INFO:tasks.workunit.client.0.smithi142.stdout:2/171: readlink d3/d5/l8 0 2024-04-20T21:58:20.653 INFO:tasks.workunit.client.0.smithi142.stdout:2/172: truncate f0 2692535 0 2024-04-20T21:58:20.656 INFO:tasks.workunit.client.0.smithi142.stdout:2/173: creat d3/d9/d34/f3b x:0 0 0 2024-04-20T21:58:20.658 INFO:tasks.workunit.client.0.smithi142.stdout:2/174: truncate d3/d5/f20 1421899 0 2024-04-20T21:58:20.663 INFO:tasks.workunit.client.0.smithi142.stdout:2/175: rename d3/d9/dc to d3/d24/d3c 0 2024-04-20T21:58:20.679 INFO:tasks.workunit.client.0.smithi142.stdout:2/176: dwrite d3/d5/f17 [8388608,4194304] 0 2024-04-20T21:58:20.682 INFO:tasks.workunit.client.0.smithi142.stdout:2/177: unlink d3/d24/l2b 0 2024-04-20T21:58:20.688 INFO:tasks.workunit.client.0.smithi142.stdout:2/178: dread d3/d5/f20 [0,4194304] 0 2024-04-20T21:58:20.692 INFO:tasks.workunit.client.0.smithi142.stdout:2/179: mknod d3/d9/c3d 0 2024-04-20T21:58:20.695 INFO:tasks.workunit.client.0.smithi142.stdout:2/180: symlink d3/d5/l3e 0 2024-04-20T21:58:20.698 INFO:tasks.workunit.client.0.smithi142.stdout:2/181: creat d3/d24/f3f x:0 0 0 2024-04-20T21:58:20.700 INFO:tasks.workunit.client.0.smithi142.stdout:2/182: creat d3/d5/f40 x:0 0 0 2024-04-20T21:58:20.703 INFO:tasks.workunit.client.0.smithi142.stdout:2/183: creat d3/d9/d34/f41 x:0 0 0 2024-04-20T21:58:20.705 INFO:tasks.workunit.client.0.smithi142.stdout:2/184: write d3/d9/f33 [805327,120383] 0 2024-04-20T21:58:20.715 INFO:tasks.workunit.client.0.smithi142.stdout:2/185: dread d3/d24/d3c/f38 [0,4194304] 0 2024-04-20T21:58:20.717 INFO:tasks.workunit.client.0.smithi142.stdout:2/186: dread - d3/d9/d34/f3b zero size 2024-04-20T21:58:20.732 INFO:tasks.workunit.client.0.smithi142.stdout:2/187: dwrite d3/d9/d34/f41 [0,4194304] 0 2024-04-20T21:58:20.740 INFO:tasks.workunit.client.0.smithi142.stdout:2/188: link d3/d5/d19/f30 d3/f42 0 2024-04-20T21:58:20.742 INFO:tasks.workunit.client.0.smithi142.stdout:2/189: chown d3/d5/f40 653969514 1 2024-04-20T21:58:20.742 INFO:tasks.workunit.client.0.smithi142.stdout:2/190: readlink d3/d5/l8 0 2024-04-20T21:58:20.744 INFO:tasks.workunit.client.0.smithi142.stdout:2/191: creat d3/d24/f43 x:0 0 0 2024-04-20T21:58:20.765 INFO:tasks.workunit.client.0.smithi142.stdout:2/192: dwrite d3/d24/d3c/f38 [0,4194304] 0 2024-04-20T21:58:20.768 INFO:tasks.workunit.client.0.smithi142.stdout:2/193: read d3/d5/d19/f30 [4087960,86414] 0 2024-04-20T21:58:20.771 INFO:tasks.workunit.client.0.smithi142.stdout:1/55: sync 2024-04-20T21:58:20.771 INFO:tasks.workunit.client.0.smithi142.stdout:7/46: sync 2024-04-20T21:58:20.771 INFO:tasks.workunit.client.0.smithi142.stdout:8/58: sync 2024-04-20T21:58:20.771 INFO:tasks.workunit.client.0.smithi142.stdout:9/38: sync 2024-04-20T21:58:20.772 INFO:tasks.workunit.client.0.smithi142.stdout:2/194: fdatasync d3/d5/d19/f30 0 2024-04-20T21:58:20.774 INFO:tasks.workunit.client.0.smithi142.stdout:8/59: symlink d0/l16 0 2024-04-20T21:58:20.775 INFO:tasks.workunit.client.0.smithi142.stdout:8/60: stat d0/l15 0 2024-04-20T21:58:20.776 INFO:tasks.workunit.client.0.smithi142.stdout:1/56: mknod d2/dd/c10 0 2024-04-20T21:58:20.779 INFO:tasks.workunit.client.0.smithi142.stdout:2/195: rename d3/d9/c3d to d3/d24/c44 0 2024-04-20T21:58:20.781 INFO:tasks.workunit.client.0.smithi142.stdout:8/61: mkdir d0/d17 0 2024-04-20T21:58:20.783 INFO:tasks.workunit.client.0.smithi142.stdout:2/196: chown d3/d5/f40 444 1 2024-04-20T21:58:20.786 INFO:tasks.workunit.client.0.smithi142.stdout:1/57: mknod d2/c11 0 2024-04-20T21:58:20.792 INFO:tasks.workunit.client.0.smithi142.stdout:1/58: mkdir d2/d12 0 2024-04-20T21:58:20.797 INFO:tasks.workunit.client.0.smithi142.stdout:9/39: link d0/l3 d0/ld 0 2024-04-20T21:58:20.798 INFO:tasks.workunit.client.0.smithi142.stdout:2/197: dread d3/d5/d19/f30 [0,4194304] 0 2024-04-20T21:58:20.801 INFO:tasks.workunit.client.0.smithi142.stdout:8/62: truncate d0/fd 1275661 0 2024-04-20T21:58:20.802 INFO:tasks.workunit.client.0.smithi142.stdout:8/63: write d0/f13 [4198547,94109] 0 2024-04-20T21:58:20.805 INFO:tasks.workunit.client.0.smithi142.stdout:7/47: write f1 [6270421,31484] 0 2024-04-20T21:58:20.805 INFO:tasks.workunit.client.0.smithi142.stdout:9/40: creat d0/fe x:0 0 0 2024-04-20T21:58:20.807 INFO:tasks.workunit.client.0.smithi142.stdout:7/48: chown d4 25 1 2024-04-20T21:58:20.807 INFO:tasks.workunit.client.0.smithi142.stdout:3/36: sync 2024-04-20T21:58:20.807 INFO:tasks.workunit.client.0.smithi142.stdout:6/49: sync 2024-04-20T21:58:20.807 INFO:tasks.workunit.client.0.smithi142.stdout:4/57: sync 2024-04-20T21:58:20.807 INFO:tasks.workunit.client.0.smithi142.stdout:5/47: sync 2024-04-20T21:58:20.807 INFO:tasks.workunit.client.0.smithi142.stdout:0/102: sync 2024-04-20T21:58:20.808 INFO:tasks.workunit.client.0.smithi142.stdout:8/64: rename d0/c12 to d0/d17/c18 0 2024-04-20T21:58:20.813 INFO:tasks.workunit.client.0.smithi142.stdout:3/37: creat d6/f8 x:0 0 0 2024-04-20T21:58:20.822 INFO:tasks.workunit.client.0.smithi142.stdout:5/48: getdents dc 0 2024-04-20T21:58:20.822 INFO:tasks.workunit.client.0.smithi142.stdout:0/103: symlink d5/d13/d1e/d23/l28 0 2024-04-20T21:58:20.823 INFO:tasks.workunit.client.0.smithi142.stdout:6/50: creat d1/d5/f14 x:0 0 0 2024-04-20T21:58:20.823 INFO:tasks.workunit.client.0.smithi142.stdout:3/38: rename f1 to d6/f9 0 2024-04-20T21:58:20.828 INFO:tasks.workunit.client.0.smithi142.stdout:4/58: symlink d1/l10 0 2024-04-20T21:58:20.831 INFO:tasks.workunit.client.0.smithi142.stdout:2/198: dwrite d3/d24/f43 [0,4194304] 0 2024-04-20T21:58:20.833 INFO:tasks.workunit.client.0.smithi142.stdout:0/104: chown l3 307940533 1 2024-04-20T21:58:20.834 INFO:tasks.workunit.client.0.smithi142.stdout:3/39: dread - d6/f8 zero size 2024-04-20T21:58:20.841 INFO:tasks.workunit.client.0.smithi142.stdout:0/105: read - d5/db/f1f zero size 2024-04-20T21:58:20.843 INFO:tasks.workunit.client.0.smithi142.stdout:3/40: rename d6 to d6/da 22 2024-04-20T21:58:20.844 INFO:tasks.workunit.client.0.smithi142.stdout:6/51: rmdir d1 39 2024-04-20T21:58:20.846 INFO:tasks.workunit.client.0.smithi142.stdout:2/199: mknod d3/d9/d34/c45 0 2024-04-20T21:58:20.850 INFO:tasks.workunit.client.0.smithi142.stdout:7/49: dwrite d4/fb [0,4194304] 0 2024-04-20T21:58:20.852 INFO:tasks.workunit.client.0.smithi142.stdout:4/59: creat d1/d6/f11 x:0 0 0 2024-04-20T21:58:20.852 INFO:tasks.workunit.client.0.smithi142.stdout:0/106: readlink d5/d13/d1e/d23/l28 0 2024-04-20T21:58:20.854 INFO:tasks.workunit.client.0.smithi142.stdout:8/65: write d0/ff [956407,84197] 0 2024-04-20T21:58:20.855 INFO:tasks.workunit.client.0.smithi142.stdout:3/41: chown f2 0 1 2024-04-20T21:58:20.858 INFO:tasks.workunit.client.0.smithi142.stdout:3/42: chown d6 7024 1 2024-04-20T21:58:20.860 INFO:tasks.workunit.client.0.smithi142.stdout:2/200: write d3/d24/d3c/f38 [2418239,50838] 0 2024-04-20T21:58:20.861 INFO:tasks.workunit.client.0.smithi142.stdout:6/52: write d1/f4 [4920744,8909] 0 2024-04-20T21:58:20.867 INFO:tasks.workunit.client.0.smithi142.stdout:0/107: mkdir d5/d1c/d29 0 2024-04-20T21:58:20.868 INFO:tasks.workunit.client.0.smithi142.stdout:8/66: creat d0/d17/f19 x:0 0 0 2024-04-20T21:58:20.870 INFO:tasks.workunit.client.0.smithi142.stdout:5/49: dwrite dc/f11 [0,4194304] 0 2024-04-20T21:58:20.871 INFO:tasks.workunit.client.0.smithi142.stdout:0/108: chown d5/l6 85593031 1 2024-04-20T21:58:20.873 INFO:tasks.workunit.client.0.smithi142.stdout:8/67: chown d0/d17 269465852 1 2024-04-20T21:58:20.876 INFO:tasks.workunit.client.0.smithi142.stdout:7/50: mknod d4/d9/cf 0 2024-04-20T21:58:20.877 INFO:tasks.workunit.client.0.smithi142.stdout:8/68: chown d0/l14 1509 1 2024-04-20T21:58:20.881 INFO:tasks.workunit.client.0.smithi142.stdout:8/69: chown d0/d17 783939 1 2024-04-20T21:58:20.881 INFO:tasks.workunit.client.0.smithi142.stdout:6/53: rmdir d1/d5 39 2024-04-20T21:58:20.894 INFO:tasks.workunit.client.0.smithi142.stdout:2/201: dread d3/d9/d34/f41 [0,4194304] 0 2024-04-20T21:58:20.902 INFO:tasks.workunit.client.0.smithi142.stdout:0/109: creat d5/d13/d1e/d23/d24/f2a x:0 0 0 2024-04-20T21:58:20.903 INFO:tasks.workunit.client.0.smithi142.stdout:7/51: dread d4/fb [0,4194304] 0 2024-04-20T21:58:20.908 INFO:tasks.workunit.client.0.smithi142.stdout:8/70: rename d0/f10 to d0/d17/f1a 0 2024-04-20T21:58:20.909 INFO:tasks.workunit.client.0.smithi142.stdout:7/52: read f1 [469910,37303] 0 2024-04-20T21:58:20.909 INFO:tasks.workunit.client.0.smithi142.stdout:8/71: fsync d0/f6 0 2024-04-20T21:58:20.910 INFO:tasks.workunit.client.0.smithi142.stdout:6/54: dwrite d1/f4 [0,4194304] 0 2024-04-20T21:58:20.911 INFO:tasks.workunit.client.0.smithi142.stdout:7/53: chown f1 32 1 2024-04-20T21:58:20.911 INFO:tasks.workunit.client.0.smithi142.stdout:4/60: rename d1/d4 to d1/d12 0 2024-04-20T21:58:20.912 INFO:tasks.workunit.client.0.smithi142.stdout:7/54: readlink d4/l6 0 2024-04-20T21:58:20.913 INFO:tasks.workunit.client.0.smithi142.stdout:7/55: fdatasync f1 0 2024-04-20T21:58:20.919 INFO:tasks.workunit.client.0.smithi142.stdout:3/43: truncate d6/f9 1415405 0 2024-04-20T21:58:20.919 INFO:tasks.workunit.client.0.smithi142.stdout:3/44: rename d6 to d6/db 22 2024-04-20T21:58:20.923 INFO:tasks.workunit.client.0.smithi142.stdout:5/50: link cb dc/c13 0 2024-04-20T21:58:20.926 INFO:tasks.workunit.client.0.smithi142.stdout:0/110: dwrite d5/f21 [0,4194304] 0 2024-04-20T21:58:20.929 INFO:tasks.workunit.client.0.smithi142.stdout:8/72: chown d0/c4 13698481 1 2024-04-20T21:58:20.932 INFO:tasks.workunit.client.0.smithi142.stdout:7/56: unlink d4/fb 0 2024-04-20T21:58:20.933 INFO:tasks.workunit.client.0.smithi142.stdout:7/57: chown d4/l6 1 1 2024-04-20T21:58:20.936 INFO:tasks.workunit.client.0.smithi142.stdout:3/45: creat d6/fc x:0 0 0 2024-04-20T21:58:20.937 INFO:tasks.workunit.client.0.smithi142.stdout:3/46: readlink - no filename 2024-04-20T21:58:20.939 INFO:tasks.workunit.client.0.smithi142.stdout:3/47: truncate f2 4936719 0 2024-04-20T21:58:20.945 INFO:tasks.workunit.client.0.smithi142.stdout:0/111: rename d5/f12 to d5/d13/f2b 0 2024-04-20T21:58:20.951 INFO:tasks.workunit.client.0.smithi142.stdout:8/73: creat d0/f1b x:0 0 0 2024-04-20T21:58:20.951 INFO:tasks.workunit.client.0.smithi142.stdout:6/55: dwrite d1/d5/f12 [0,4194304] 0 2024-04-20T21:58:20.952 INFO:tasks.workunit.client.0.smithi142.stdout:8/74: fsync d0/fc 0 2024-04-20T21:58:20.954 INFO:tasks.workunit.client.0.smithi142.stdout:6/56: write d1/f4 [558719,71155] 0 2024-04-20T21:58:20.956 INFO:tasks.workunit.client.0.smithi142.stdout:6/57: fsync d1/d11/fa 0 2024-04-20T21:58:20.968 INFO:tasks.workunit.client.0.smithi142.stdout:0/112: dwrite d5/f17 [0,4194304] 0 2024-04-20T21:58:20.970 INFO:tasks.workunit.client.0.smithi142.stdout:0/113: read d5/f9 [2637096,106720] 0 2024-04-20T21:58:20.973 INFO:tasks.workunit.client.0.smithi142.stdout:0/114: truncate d5/d1c/f26 74706 0 2024-04-20T21:58:20.976 INFO:tasks.workunit.client.0.smithi142.stdout:2/202: truncate d3/d5/d19/f30 3175605 0 2024-04-20T21:58:20.977 INFO:tasks.workunit.client.0.smithi142.stdout:8/75: chown d0/d17/c18 2 1 2024-04-20T21:58:20.983 INFO:tasks.workunit.client.0.smithi142.stdout:2/203: write d3/d24/f3f [847718,61932] 0 2024-04-20T21:58:20.987 INFO:tasks.workunit.client.0.smithi142.stdout:4/61: truncate d1/d6/fc 3189915 0 2024-04-20T21:58:20.988 INFO:tasks.workunit.client.0.smithi142.stdout:0/115: mkdir d5/d13/d1e/d23/d2c 0 2024-04-20T21:58:20.994 INFO:tasks.workunit.client.0.smithi142.stdout:0/116: chown d5/d13/d1e/d23/f25 3436 1 2024-04-20T21:58:20.997 INFO:tasks.workunit.client.0.smithi142.stdout:6/58: creat d1/f15 x:0 0 0 2024-04-20T21:58:20.999 INFO:tasks.workunit.client.0.smithi142.stdout:3/48: fdatasync d6/f9 0 2024-04-20T21:58:21.000 INFO:tasks.workunit.client.0.smithi142.stdout:7/58: getdents d4 0 2024-04-20T21:58:21.002 INFO:tasks.workunit.client.0.smithi142.stdout:6/59: truncate d1/f4 5168952 0 2024-04-20T21:58:21.003 INFO:tasks.workunit.client.0.smithi142.stdout:3/49: write d6/f8 [505194,22336] 0 2024-04-20T21:58:21.003 INFO:tasks.workunit.client.0.smithi142.stdout:4/62: fdatasync f0 0 2024-04-20T21:58:21.005 INFO:tasks.workunit.client.0.smithi142.stdout:8/76: dwrite d0/d17/f19 [0,4194304] 0 2024-04-20T21:58:21.009 INFO:tasks.workunit.client.0.smithi142.stdout:3/50: write d6/f9 [1762891,9857] 0 2024-04-20T21:58:21.010 INFO:tasks.workunit.client.0.smithi142.stdout:6/60: truncate d1/d11/fa 4618709 0 2024-04-20T21:58:21.011 INFO:tasks.workunit.client.0.smithi142.stdout:6/61: readlink d1/d5/l10 0 2024-04-20T21:58:21.018 INFO:tasks.workunit.client.0.smithi142.stdout:0/117: symlink d5/d13/l2d 0 2024-04-20T21:58:21.021 INFO:tasks.workunit.client.0.smithi142.stdout:7/59: mknod d4/d9/c10 0 2024-04-20T21:58:21.027 INFO:tasks.workunit.client.0.smithi142.stdout:8/77: mkdir d0/d1c 0 2024-04-20T21:58:21.036 INFO:tasks.workunit.client.0.smithi142.stdout:0/118: creat d5/d13/d1e/d23/d2c/f2e x:0 0 0 2024-04-20T21:58:21.041 INFO:tasks.workunit.client.0.smithi142.stdout:1/59: sync 2024-04-20T21:58:21.043 INFO:tasks.workunit.client.0.smithi142.stdout:1/60: readlink l1 0 2024-04-20T21:58:21.044 INFO:tasks.workunit.client.0.smithi142.stdout:3/51: dwrite d6/fc [0,4194304] 0 2024-04-20T21:58:21.044 INFO:tasks.workunit.client.0.smithi142.stdout:0/119: write d5/d1c/f26 [58534,53989] 0 2024-04-20T21:58:21.049 INFO:tasks.workunit.client.0.smithi142.stdout:6/62: dwrite d1/d5/f12 [0,4194304] 0 2024-04-20T21:58:21.050 INFO:tasks.workunit.client.0.smithi142.stdout:4/63: dread f0 [0,4194304] 0 2024-04-20T21:58:21.057 INFO:tasks.workunit.client.0.smithi142.stdout:3/52: creat d6/fd x:0 0 0 2024-04-20T21:58:21.059 INFO:tasks.workunit.client.0.smithi142.stdout:4/64: dread - d1/ff zero size 2024-04-20T21:58:21.061 INFO:tasks.workunit.client.0.smithi142.stdout:0/120: creat d5/d13/f2f x:0 0 0 2024-04-20T21:58:21.065 INFO:tasks.workunit.client.0.smithi142.stdout:2/204: dwrite f0 [0,4194304] 0 2024-04-20T21:58:21.067 INFO:tasks.workunit.client.0.smithi142.stdout:7/60: write f1 [3832657,102995] 0 2024-04-20T21:58:21.070 INFO:tasks.workunit.client.0.smithi142.stdout:3/53: truncate d6/f7 149120 0 2024-04-20T21:58:21.070 INFO:tasks.workunit.client.0.smithi142.stdout:3/54: readlink - no filename 2024-04-20T21:58:21.070 INFO:tasks.workunit.client.0.smithi142.stdout:0/121: read d5/f8 [175826,36380] 0 2024-04-20T21:58:21.072 INFO:tasks.workunit.client.0.smithi142.stdout:8/78: write d0/fd [1183462,24091] 0 2024-04-20T21:58:21.076 INFO:tasks.workunit.client.0.smithi142.stdout:3/55: read - d6/fd zero size 2024-04-20T21:58:21.078 INFO:tasks.workunit.client.0.smithi142.stdout:8/79: write d0/f13 [2184471,128710] 0 2024-04-20T21:58:21.078 INFO:tasks.workunit.client.0.smithi142.stdout:3/56: fdatasync f2 0 2024-04-20T21:58:21.083 INFO:tasks.workunit.client.0.smithi142.stdout:8/80: chown d0/d17/c18 25506178 1 2024-04-20T21:58:21.083 INFO:tasks.workunit.client.0.smithi142.stdout:1/61: dwrite d2/dd/fe [0,4194304] 0 2024-04-20T21:58:21.083 INFO:tasks.workunit.client.0.smithi142.stdout:4/65: chown d1/d6/l9 7 1 2024-04-20T21:58:21.089 INFO:tasks.workunit.client.0.smithi142.stdout:3/57: dread d6/f7 [0,4194304] 0 2024-04-20T21:58:21.090 INFO:tasks.workunit.client.0.smithi142.stdout:6/63: rename d1/d11/l8 to d1/l16 0 2024-04-20T21:58:21.092 INFO:tasks.workunit.client.0.smithi142.stdout:3/58: chown d6/f9 28 1 2024-04-20T21:58:21.097 INFO:tasks.workunit.client.0.smithi142.stdout:2/205: symlink d3/l46 0 2024-04-20T21:58:21.098 INFO:tasks.workunit.client.0.smithi142.stdout:0/122: dwrite d5/f17 [0,4194304] 0 2024-04-20T21:58:21.115 INFO:tasks.workunit.client.0.smithi142.stdout:2/206: rename f0 to d3/d6/f47 0 2024-04-20T21:58:21.116 INFO:tasks.workunit.client.0.smithi142.stdout:8/81: creat d0/d1c/f1d x:0 0 0 2024-04-20T21:58:21.118 INFO:tasks.workunit.client.0.smithi142.stdout:4/66: creat d1/f13 x:0 0 0 2024-04-20T21:58:21.121 INFO:tasks.workunit.client.0.smithi142.stdout:0/123: rename d5/c19 to d5/d13/d1e/d23/d24/c30 0 2024-04-20T21:58:21.122 INFO:tasks.workunit.client.0.smithi142.stdout:8/82: creat d0/d1c/f1e x:0 0 0 2024-04-20T21:58:21.122 INFO:tasks.workunit.client.0.smithi142.stdout:4/67: write f0 [128840,123604] 0 2024-04-20T21:58:21.122 INFO:tasks.workunit.client.0.smithi142.stdout:6/64: creat d1/f17 x:0 0 0 2024-04-20T21:58:21.124 INFO:tasks.workunit.client.0.smithi142.stdout:8/83: readlink d0/l14 0 2024-04-20T21:58:21.124 INFO:tasks.workunit.client.0.smithi142.stdout:6/65: fsync d1/d5/f14 0 2024-04-20T21:58:21.126 INFO:tasks.workunit.client.0.smithi142.stdout:4/68: stat d1/f3 0 2024-04-20T21:58:21.129 INFO:tasks.workunit.client.0.smithi142.stdout:0/124: dread d5/ff [0,4194304] 0 2024-04-20T21:58:21.132 INFO:tasks.workunit.client.0.smithi142.stdout:8/84: rename d0/fd to d0/d17/f1f 0 2024-04-20T21:58:21.137 INFO:tasks.workunit.client.0.smithi142.stdout:0/125: write d5/fa [2317487,8836] 0 2024-04-20T21:58:21.144 INFO:tasks.workunit.client.0.smithi142.stdout:0/126: dread d5/f18 [0,4194304] 0 2024-04-20T21:58:21.148 INFO:tasks.workunit.client.0.smithi142.stdout:4/69: creat d1/db/f14 x:0 0 0 2024-04-20T21:58:21.153 INFO:tasks.workunit.client.0.smithi142.stdout:0/127: rename d5/l7 to d5/d13/d1e/d23/d24/l31 0 2024-04-20T21:58:21.154 INFO:tasks.workunit.client.0.smithi142.stdout:4/70: stat d1/d6/ce 0 2024-04-20T21:58:21.154 INFO:tasks.workunit.client.0.smithi142.stdout:1/62: write d2/f7 [639470,60313] 0 2024-04-20T21:58:21.161 INFO:tasks.workunit.client.0.smithi142.stdout:4/71: symlink d1/d12/l15 0 2024-04-20T21:58:21.163 INFO:tasks.workunit.client.0.smithi142.stdout:8/85: dwrite d0/f13 [4194304,4194304] 0 2024-04-20T21:58:21.165 INFO:tasks.workunit.client.0.smithi142.stdout:1/63: mkdir d2/d12/d13 0 2024-04-20T21:58:21.166 INFO:tasks.workunit.client.0.smithi142.stdout:4/72: readlink d1/d6/l9 0 2024-04-20T21:58:21.168 INFO:tasks.workunit.client.0.smithi142.stdout:1/64: write d2/f7 [858844,52563] 0 2024-04-20T21:58:21.170 INFO:tasks.workunit.client.0.smithi142.stdout:4/73: dread - d1/db/f14 zero size 2024-04-20T21:58:21.171 INFO:tasks.workunit.client.0.smithi142.stdout:8/86: creat d0/f20 x:0 0 0 2024-04-20T21:58:21.172 INFO:tasks.workunit.client.0.smithi142.stdout:8/87: symlink d0/d17/l21 0 2024-04-20T21:58:21.173 INFO:tasks.workunit.client.0.smithi142.stdout:1/65: creat d2/d12/d13/f14 x:0 0 0 2024-04-20T21:58:21.177 INFO:tasks.workunit.client.0.smithi142.stdout:0/128: dread d5/f8 [0,4194304] 0 2024-04-20T21:58:21.177 INFO:tasks.workunit.client.0.smithi142.stdout:4/74: creat d1/f16 x:0 0 0 2024-04-20T21:58:21.177 INFO:tasks.workunit.client.0.smithi142.stdout:1/66: mknod d2/dd/c15 0 2024-04-20T21:58:21.182 INFO:tasks.workunit.client.0.smithi142.stdout:4/75: mkdir d1/db/d17 0 2024-04-20T21:58:21.183 INFO:tasks.workunit.client.0.smithi142.stdout:0/129: mkdir d5/d1c/d29/d32 0 2024-04-20T21:58:21.188 INFO:tasks.workunit.client.0.smithi142.stdout:0/130: creat d5/d13/d1e/d23/d24/f33 x:0 0 0 2024-04-20T21:58:21.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:21 smithi142 ceph-mon[15828]: pgmap v32: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 75 KiB/s rd, 13 MiB/s wr, 180 op/s 2024-04-20T21:58:21.196 INFO:tasks.workunit.client.0.smithi142.stdout:1/67: dread d2/f6 [0,4194304] 0 2024-04-20T21:58:21.202 INFO:tasks.workunit.client.0.smithi142.stdout:8/88: rmdir d0 39 2024-04-20T21:58:21.207 INFO:tasks.workunit.client.0.smithi142.stdout:4/76: dwrite f0 [0,4194304] 0 2024-04-20T21:58:21.219 INFO:tasks.workunit.client.0.smithi142.stdout:1/68: dwrite d2/f6 [0,4194304] 0 2024-04-20T21:58:21.222 INFO:tasks.workunit.client.0.smithi142.stdout:1/69: chown d2/c4 6369 1 2024-04-20T21:58:21.222 INFO:tasks.workunit.client.0.smithi142.stdout:1/70: readlink l1 0 2024-04-20T21:58:21.222 INFO:tasks.workunit.client.0.smithi142.stdout:4/77: dread d1/d6/fc [0,4194304] 0 2024-04-20T21:58:21.223 INFO:tasks.workunit.client.0.smithi142.stdout:4/78: chown d1/db/d17 2 1 2024-04-20T21:58:21.224 INFO:tasks.workunit.client.0.smithi142.stdout:4/79: stat d1/d12 0 2024-04-20T21:58:21.225 INFO:tasks.workunit.client.0.smithi142.stdout:4/80: chown d1/f3 913 1 2024-04-20T21:58:21.226 INFO:tasks.workunit.client.0.smithi142.stdout:1/71: mknod d2/d12/d13/c16 0 2024-04-20T21:58:21.228 INFO:tasks.workunit.client.0.smithi142.stdout:4/81: rename d1/f16 to d1/d12/da/f18 0 2024-04-20T21:58:21.232 INFO:tasks.workunit.client.0.smithi142.stdout:4/82: chown d1/d12/da 10228784 1 2024-04-20T21:58:21.234 INFO:tasks.workunit.client.0.smithi142.stdout:4/83: truncate d1/db/f14 525974 0 2024-04-20T21:58:21.239 INFO:tasks.workunit.client.0.smithi142.stdout:4/84: rename d1/db/f14 to d1/db/d17/f19 0 2024-04-20T21:58:21.242 INFO:tasks.workunit.client.0.smithi142.stdout:4/85: stat d1/f8 0 2024-04-20T21:58:21.242 INFO:tasks.workunit.client.0.smithi142.stdout:9/41: sync 2024-04-20T21:58:21.242 INFO:tasks.workunit.client.0.smithi142.stdout:5/51: sync 2024-04-20T21:58:21.246 INFO:tasks.workunit.client.0.smithi142.stdout:9/42: chown d0/fa 582118229 1 2024-04-20T21:58:21.247 INFO:tasks.workunit.client.0.smithi142.stdout:1/72: dwrite d2/f7 [0,4194304] 0 2024-04-20T21:58:21.249 INFO:tasks.workunit.client.0.smithi142.stdout:1/73: stat d2/dd/c10 0 2024-04-20T21:58:21.258 INFO:tasks.workunit.client.0.smithi142.stdout:9/43: link d0/fc d0/ff 0 2024-04-20T21:58:21.259 INFO:tasks.workunit.client.0.smithi142.stdout:1/74: chown d2/cf 60439 1 2024-04-20T21:58:21.262 INFO:tasks.workunit.client.0.smithi142.stdout:9/44: mknod d0/c10 0 2024-04-20T21:58:21.264 INFO:tasks.workunit.client.0.smithi142.stdout:1/75: rmdir d2/dd 39 2024-04-20T21:58:21.268 INFO:tasks.workunit.client.0.smithi142.stdout:9/45: readlink d0/l2 0 2024-04-20T21:58:21.271 INFO:tasks.workunit.client.0.smithi142.stdout:1/76: stat d2/dd/fe 0 2024-04-20T21:58:21.271 INFO:tasks.workunit.client.0.smithi142.stdout:9/46: creat d0/f11 x:0 0 0 2024-04-20T21:58:21.274 INFO:tasks.workunit.client.0.smithi142.stdout:5/52: dwrite f9 [0,4194304] 0 2024-04-20T21:58:21.275 INFO:tasks.workunit.client.0.smithi142.stdout:9/47: chown d0/f4 414 1 2024-04-20T21:58:21.276 INFO:tasks.workunit.client.0.smithi142.stdout:4/86: dwrite d1/d6/fc [0,4194304] 0 2024-04-20T21:58:21.277 INFO:tasks.workunit.client.0.smithi142.stdout:1/77: chown d2/d12/d13/f14 10868 1 2024-04-20T21:58:21.278 INFO:tasks.workunit.client.0.smithi142.stdout:5/53: fsync dc/f10 0 2024-04-20T21:58:21.280 INFO:tasks.workunit.client.0.smithi142.stdout:1/78: read d2/f6 [148612,107893] 0 2024-04-20T21:58:21.284 INFO:tasks.workunit.client.0.smithi142.stdout:4/87: creat d1/d6/f1a x:0 0 0 2024-04-20T21:58:21.285 INFO:tasks.workunit.client.0.smithi142.stdout:5/54: mkdir dc/d14 0 2024-04-20T21:58:21.287 INFO:tasks.workunit.client.0.smithi142.stdout:1/79: mkdir d2/dd/d17 0 2024-04-20T21:58:21.290 INFO:tasks.workunit.client.0.smithi142.stdout:1/80: stat d2/d12/d13/c16 0 2024-04-20T21:58:21.293 INFO:tasks.workunit.client.0.smithi142.stdout:5/55: rename f8 to dc/f15 0 2024-04-20T21:58:21.296 INFO:tasks.workunit.client.0.smithi142.stdout:1/81: mknod d2/d12/d13/c18 0 2024-04-20T21:58:21.298 INFO:tasks.workunit.client.0.smithi142.stdout:5/56: rmdir dc 39 2024-04-20T21:58:21.298 INFO:tasks.workunit.client.0.smithi142.stdout:1/82: write d2/dd/fe [3631085,107472] 0 2024-04-20T21:58:21.301 INFO:tasks.workunit.client.0.smithi142.stdout:4/88: dread d1/f8 [0,4194304] 0 2024-04-20T21:58:21.303 INFO:tasks.workunit.client.0.smithi142.stdout:5/57: truncate dc/f12 761335 0 2024-04-20T21:58:21.307 INFO:tasks.workunit.client.0.smithi142.stdout:4/89: symlink d1/db/d17/l1b 0 2024-04-20T21:58:21.312 INFO:tasks.workunit.client.0.smithi142.stdout:9/48: getdents d0 0 2024-04-20T21:58:21.318 INFO:tasks.workunit.client.0.smithi142.stdout:9/49: symlink d0/l12 0 2024-04-20T21:58:21.321 INFO:tasks.workunit.client.0.smithi142.stdout:9/50: mknod d0/c13 0 2024-04-20T21:58:21.322 INFO:tasks.workunit.client.0.smithi142.stdout:9/51: fdatasync d0/fa 0 2024-04-20T21:58:21.325 INFO:tasks.workunit.client.0.smithi142.stdout:4/90: getdents d1/db/d17 0 2024-04-20T21:58:21.326 INFO:tasks.workunit.client.0.smithi142.stdout:1/83: dwrite d2/dd/fe [0,4194304] 0 2024-04-20T21:58:21.327 INFO:tasks.workunit.client.0.smithi142.stdout:9/52: creat d0/f14 x:0 0 0 2024-04-20T21:58:21.328 INFO:tasks.workunit.client.0.smithi142.stdout:5/58: truncate f3 9393815 0 2024-04-20T21:58:21.330 INFO:tasks.workunit.client.0.smithi142.stdout:1/84: dread - d2/d12/d13/f14 zero size 2024-04-20T21:58:21.330 INFO:tasks.workunit.client.0.smithi142.stdout:9/53: truncate d0/fe 864004 0 2024-04-20T21:58:21.332 INFO:tasks.workunit.client.0.smithi142.stdout:4/91: mkdir d1/d12/da/d1c 0 2024-04-20T21:58:21.335 INFO:tasks.workunit.client.0.smithi142.stdout:5/59: creat dc/f16 x:0 0 0 2024-04-20T21:58:21.336 INFO:tasks.workunit.client.0.smithi142.stdout:4/92: truncate d1/d12/da/f18 539867 0 2024-04-20T21:58:21.336 INFO:tasks.workunit.client.0.smithi142.stdout:9/54: creat d0/f15 x:0 0 0 2024-04-20T21:58:21.337 INFO:tasks.workunit.client.0.smithi142.stdout:9/55: stat d0/f15 0 2024-04-20T21:58:21.337 INFO:tasks.workunit.client.0.smithi142.stdout:5/60: chown dc/cd 656023 1 2024-04-20T21:58:21.338 INFO:tasks.workunit.client.0.smithi142.stdout:5/61: chown dc 38 1 2024-04-20T21:58:21.340 INFO:tasks.workunit.client.0.smithi142.stdout:1/85: rename l1 to d2/d12/d13/l19 0 2024-04-20T21:58:21.341 INFO:tasks.workunit.client.0.smithi142.stdout:5/62: write dc/f12 [838079,115344] 0 2024-04-20T21:58:21.343 INFO:tasks.workunit.client.0.smithi142.stdout:1/86: write d2/d12/d13/f14 [544714,9700] 0 2024-04-20T21:58:21.352 INFO:tasks.workunit.client.0.smithi142.stdout:9/56: write d0/fc [1862838,88590] 0 2024-04-20T21:58:21.356 INFO:tasks.workunit.client.0.smithi142.stdout:9/57: symlink d0/l16 0 2024-04-20T21:58:21.361 INFO:tasks.workunit.client.0.smithi142.stdout:4/93: dwrite d1/ff [0,4194304] 0 2024-04-20T21:58:21.363 INFO:tasks.workunit.client.0.smithi142.stdout:9/58: symlink d0/l17 0 2024-04-20T21:58:21.364 INFO:tasks.workunit.client.0.smithi142.stdout:4/94: readlink d1/d12/ld 0 2024-04-20T21:58:21.365 INFO:tasks.workunit.client.0.smithi142.stdout:9/59: dread - d0/fb zero size 2024-04-20T21:58:21.366 INFO:tasks.workunit.client.0.smithi142.stdout:4/95: stat d1/f13 0 2024-04-20T21:58:21.368 INFO:tasks.workunit.client.0.smithi142.stdout:9/60: mknod d0/c18 0 2024-04-20T21:58:21.372 INFO:tasks.workunit.client.0.smithi142.stdout:4/96: creat d1/d12/f1d x:0 0 0 2024-04-20T21:58:21.373 INFO:tasks.workunit.client.0.smithi142.stdout:1/87: dwrite d2/d12/d13/f14 [0,4194304] 0 2024-04-20T21:58:21.376 INFO:tasks.workunit.client.0.smithi142.stdout:1/88: chown d2/cf 27500 1 2024-04-20T21:58:21.376 INFO:tasks.workunit.client.0.smithi142.stdout:9/61: creat d0/f19 x:0 0 0 2024-04-20T21:58:21.379 INFO:tasks.workunit.client.0.smithi142.stdout:4/97: link d1/f13 d1/db/f1e 0 2024-04-20T21:58:21.381 INFO:tasks.workunit.client.0.smithi142.stdout:4/98: read - d1/d6/f11 zero size 2024-04-20T21:58:21.383 INFO:tasks.workunit.client.0.smithi142.stdout:4/99: chown d1/d6/f11 109 1 2024-04-20T21:58:21.386 INFO:tasks.workunit.client.0.smithi142.stdout:4/100: write d1/d12/f1d [84222,16499] 0 2024-04-20T21:58:21.393 INFO:tasks.workunit.client.0.smithi142.stdout:9/62: dread d0/ff [0,4194304] 0 2024-04-20T21:58:21.395 INFO:tasks.workunit.client.0.smithi142.stdout:1/89: dread d2/d12/d13/f14 [0,4194304] 0 2024-04-20T21:58:21.395 INFO:tasks.workunit.client.0.smithi142.stdout:4/101: creat d1/d6/f1f x:0 0 0 2024-04-20T21:58:21.397 INFO:tasks.workunit.client.0.smithi142.stdout:9/63: symlink d0/l1a 0 2024-04-20T21:58:21.399 INFO:tasks.workunit.client.0.smithi142.stdout:4/102: symlink d1/db/l20 0 2024-04-20T21:58:21.400 INFO:tasks.workunit.client.0.smithi142.stdout:9/64: write d0/fb [726253,75128] 0 2024-04-20T21:58:21.401 INFO:tasks.workunit.client.0.smithi142.stdout:1/90: creat d2/dd/d17/f1a x:0 0 0 2024-04-20T21:58:21.402 INFO:tasks.workunit.client.0.smithi142.stdout:1/91: fdatasync d2/f7 0 2024-04-20T21:58:21.403 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:21 smithi164 ceph-mon[23506]: pgmap v32: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 75 KiB/s rd, 13 MiB/s wr, 180 op/s 2024-04-20T21:58:21.408 INFO:tasks.workunit.client.0.smithi142.stdout:4/103: dread d1/d12/da/f18 [0,4194304] 0 2024-04-20T21:58:21.408 INFO:tasks.workunit.client.0.smithi142.stdout:1/92: mkdir d2/dd/d17/d1b 0 2024-04-20T21:58:21.415 INFO:tasks.workunit.client.0.smithi142.stdout:9/65: rmdir d0 39 2024-04-20T21:58:21.419 INFO:tasks.workunit.client.0.smithi142.stdout:9/66: write d0/f19 [930922,116222] 0 2024-04-20T21:58:21.419 INFO:tasks.workunit.client.0.smithi142.stdout:1/93: truncate d2/dd/fe 3579140 0 2024-04-20T21:58:21.422 INFO:tasks.workunit.client.0.smithi142.stdout:9/67: chown d0/fb 5292948 1 2024-04-20T21:58:21.423 INFO:tasks.workunit.client.0.smithi142.stdout:1/94: mkdir d2/dd/d1c 0 2024-04-20T21:58:21.424 INFO:tasks.workunit.client.0.smithi142.stdout:9/68: mknod d0/c1b 0 2024-04-20T21:58:21.428 INFO:tasks.workunit.client.0.smithi142.stdout:9/69: write d0/fe [69490,62555] 0 2024-04-20T21:58:21.429 INFO:tasks.workunit.client.0.smithi142.stdout:1/95: creat d2/dd/d17/d1b/f1d x:0 0 0 2024-04-20T21:58:21.430 INFO:tasks.workunit.client.0.smithi142.stdout:9/70: read - d0/f14 zero size 2024-04-20T21:58:21.431 INFO:tasks.workunit.client.0.smithi142.stdout:1/96: chown d2/dd/d17/d1b 763357283 1 2024-04-20T21:58:21.434 INFO:tasks.workunit.client.0.smithi142.stdout:4/104: dwrite d1/f13 [0,4194304] 0 2024-04-20T21:58:21.438 INFO:tasks.workunit.client.0.smithi142.stdout:4/105: dread d1/d12/f1d [0,4194304] 0 2024-04-20T21:58:21.440 INFO:tasks.workunit.client.0.smithi142.stdout:4/106: dread - d1/d6/f1a zero size 2024-04-20T21:58:21.446 INFO:tasks.workunit.client.0.smithi142.stdout:1/97: write d2/dd/fe [2317259,74611] 0 2024-04-20T21:58:21.447 INFO:tasks.workunit.client.0.smithi142.stdout:1/98: stat d2/f7 0 2024-04-20T21:58:21.450 INFO:tasks.workunit.client.0.smithi142.stdout:9/71: truncate d0/fb 641453 0 2024-04-20T21:58:21.453 INFO:tasks.workunit.client.0.smithi142.stdout:9/72: mknod d0/c1c 0 2024-04-20T21:58:21.465 INFO:tasks.workunit.client.0.smithi142.stdout:4/107: dwrite d1/d6/fc [0,4194304] 0 2024-04-20T21:58:21.472 INFO:tasks.workunit.client.0.smithi142.stdout:1/99: dwrite d2/dd/fe [0,4194304] 0 2024-04-20T21:58:21.476 INFO:tasks.workunit.client.0.smithi142.stdout:4/108: dread d1/d12/da/f18 [0,4194304] 0 2024-04-20T21:58:21.478 INFO:tasks.workunit.client.0.smithi142.stdout:9/73: dwrite d0/f19 [0,4194304] 0 2024-04-20T21:58:21.486 INFO:tasks.workunit.client.0.smithi142.stdout:9/74: mknod d0/c1d 0 2024-04-20T21:58:21.486 INFO:tasks.workunit.client.0.smithi142.stdout:9/75: truncate d0/f15 797566 0 2024-04-20T21:58:21.492 INFO:tasks.workunit.client.0.smithi142.stdout:9/76: creat d0/f1e x:0 0 0 2024-04-20T21:58:21.494 INFO:tasks.workunit.client.0.smithi142.stdout:1/100: dread d2/f7 [0,4194304] 0 2024-04-20T21:58:21.497 INFO:tasks.workunit.client.0.smithi142.stdout:1/101: creat d2/d12/f1e x:0 0 0 2024-04-20T21:58:21.515 INFO:tasks.workunit.client.0.smithi142.stdout:1/102: dread d2/d12/d13/f14 [0,4194304] 0 2024-04-20T21:58:21.517 INFO:tasks.workunit.client.0.smithi142.stdout:9/77: dwrite d0/ff [4194304,4194304] 0 2024-04-20T21:58:21.519 INFO:tasks.workunit.client.0.smithi142.stdout:1/103: mknod d2/dd/d17/c1f 0 2024-04-20T21:58:21.521 INFO:tasks.workunit.client.0.smithi142.stdout:1/104: chown d2/lb 12444 1 2024-04-20T21:58:21.522 INFO:tasks.workunit.client.0.smithi142.stdout:1/105: fdatasync d2/d12/f1e 0 2024-04-20T21:58:21.527 INFO:tasks.workunit.client.0.smithi142.stdout:1/106: readlink d2/d12/d13/l19 0 2024-04-20T21:58:21.531 INFO:tasks.workunit.client.0.smithi142.stdout:1/107: mkdir d2/d12/d20 0 2024-04-20T21:58:21.534 INFO:tasks.workunit.client.0.smithi142.stdout:9/78: dread d0/f9 [0,4194304] 0 2024-04-20T21:58:21.535 INFO:tasks.workunit.client.0.smithi142.stdout:1/108: creat d2/dd/d17/f21 x:0 0 0 2024-04-20T21:58:21.536 INFO:tasks.workunit.client.0.smithi142.stdout:9/79: write d0/fa [1036542,67751] 0 2024-04-20T21:58:21.537 INFO:tasks.workunit.client.0.smithi142.stdout:1/109: dread - d2/dd/d17/f1a zero size 2024-04-20T21:58:21.541 INFO:tasks.workunit.client.0.smithi142.stdout:1/110: write d2/d12/d13/f14 [2017588,50884] 0 2024-04-20T21:58:21.544 INFO:tasks.workunit.client.0.smithi142.stdout:1/111: readlink d2/d12/d13/l19 0 2024-04-20T21:58:21.550 INFO:tasks.workunit.client.0.smithi142.stdout:1/112: rename d2/d12 to d2/dd/d17/d1b/d22 0 2024-04-20T21:58:21.553 INFO:tasks.workunit.client.0.smithi142.stdout:1/113: mknod d2/dd/d17/c23 0 2024-04-20T21:58:21.560 INFO:tasks.workunit.client.0.smithi142.stdout:1/114: creat d2/dd/d17/f24 x:0 0 0 2024-04-20T21:58:21.568 INFO:tasks.workunit.client.0.smithi142.stdout:9/80: dread d0/fb [0,4194304] 0 2024-04-20T21:58:21.586 INFO:tasks.workunit.client.0.smithi142.stdout:1/115: dwrite d2/dd/d17/f1a [0,4194304] 0 2024-04-20T21:58:21.590 INFO:tasks.workunit.client.0.smithi142.stdout:1/116: dread - d2/dd/d17/f21 zero size 2024-04-20T21:58:21.593 INFO:tasks.workunit.client.0.smithi142.stdout:1/117: chown d2/c8 184008804 1 2024-04-20T21:58:21.595 INFO:tasks.workunit.client.0.smithi142.stdout:9/81: dwrite d0/fb [0,4194304] 0 2024-04-20T21:58:21.599 INFO:tasks.workunit.client.0.smithi142.stdout:9/82: rmdir d0 39 2024-04-20T21:58:21.607 INFO:tasks.workunit.client.0.smithi142.stdout:9/83: mknod d0/c1f 0 2024-04-20T21:58:21.610 INFO:tasks.workunit.client.0.smithi142.stdout:9/84: unlink d0/f15 0 2024-04-20T21:58:21.613 INFO:tasks.workunit.client.0.smithi142.stdout:9/85: symlink d0/l20 0 2024-04-20T21:58:21.614 INFO:tasks.workunit.client.0.smithi142.stdout:9/86: fsync d0/f4 0 2024-04-20T21:58:21.615 INFO:tasks.workunit.client.0.smithi142.stdout:9/87: write d0/f19 [12416,21701] 0 2024-04-20T21:58:21.617 INFO:tasks.workunit.client.0.smithi142.stdout:9/88: chown d0/f19 14006404 1 2024-04-20T21:58:21.622 INFO:tasks.workunit.client.0.smithi142.stdout:1/118: truncate d2/dd/d17/f1a 249387 0 2024-04-20T21:58:21.625 INFO:tasks.workunit.client.0.smithi142.stdout:1/119: getdents d2/dd/d1c 0 2024-04-20T21:58:21.631 INFO:tasks.workunit.client.0.smithi142.stdout:1/120: link d2/c8 d2/dd/d17/d1b/d22/d13/c25 0 2024-04-20T21:58:21.637 INFO:tasks.workunit.client.0.smithi142.stdout:9/89: dwrite d0/f14 [0,4194304] 0 2024-04-20T21:58:21.646 INFO:tasks.workunit.client.0.smithi142.stdout:1/121: creat d2/dd/d17/d1b/d22/d20/f26 x:0 0 0 2024-04-20T21:58:21.648 INFO:tasks.workunit.client.0.smithi142.stdout:2/207: sync 2024-04-20T21:58:21.648 INFO:tasks.workunit.client.0.smithi142.stdout:3/59: sync 2024-04-20T21:58:21.648 INFO:tasks.workunit.client.0.smithi142.stdout:7/61: sync 2024-04-20T21:58:21.650 INFO:tasks.workunit.client.0.smithi142.stdout:2/208: readlink d3/d5/l1d 0 2024-04-20T21:58:21.651 INFO:tasks.workunit.client.0.smithi142.stdout:3/60: stat d6/f7 0 2024-04-20T21:58:21.653 INFO:tasks.workunit.client.0.smithi142.stdout:7/62: mkdir d4/d9/d11 0 2024-04-20T21:58:21.656 INFO:tasks.workunit.client.0.smithi142.stdout:1/122: mknod d2/dd/c27 0 2024-04-20T21:58:21.658 INFO:tasks.workunit.client.0.smithi142.stdout:3/61: creat d6/fe x:0 0 0 2024-04-20T21:58:21.663 INFO:tasks.workunit.client.0.smithi142.stdout:2/209: rename d3/d9/c14 to d3/c48 0 2024-04-20T21:58:21.663 INFO:tasks.workunit.client.0.smithi142.stdout:9/90: dwrite d0/f8 [0,4194304] 0 2024-04-20T21:58:21.666 INFO:tasks.workunit.client.0.smithi142.stdout:1/123: write d2/dd/d17/d1b/d22/f1e [361444,15373] 0 2024-04-20T21:58:21.666 INFO:tasks.workunit.client.0.smithi142.stdout:7/63: creat d4/d9/d11/f12 x:0 0 0 2024-04-20T21:58:21.671 INFO:tasks.workunit.client.0.smithi142.stdout:3/62: dread d6/f8 [0,4194304] 0 2024-04-20T21:58:21.673 INFO:tasks.workunit.client.0.smithi142.stdout:1/124: chown d2/la 115043 1 2024-04-20T21:58:21.676 INFO:tasks.workunit.client.0.smithi142.stdout:3/63: creat d6/ff x:0 0 0 2024-04-20T21:58:21.679 INFO:tasks.workunit.client.0.smithi142.stdout:1/125: symlink d2/dd/d17/l28 0 2024-04-20T21:58:21.679 INFO:tasks.workunit.client.0.smithi142.stdout:2/210: creat d3/d9/f49 x:0 0 0 2024-04-20T21:58:21.683 INFO:tasks.workunit.client.0.smithi142.stdout:1/126: stat d2/c11 0 2024-04-20T21:58:21.686 INFO:tasks.workunit.client.0.smithi142.stdout:3/64: rename d6/fe to d6/f10 0 2024-04-20T21:58:21.689 INFO:tasks.workunit.client.0.smithi142.stdout:1/127: chown d2/dd/d17 30239417 1 2024-04-20T21:58:21.691 INFO:tasks.workunit.client.0.smithi142.stdout:2/211: rename d3/l7 to d3/d9/d34/l4a 0 2024-04-20T21:58:21.696 INFO:tasks.workunit.client.0.smithi142.stdout:3/65: write d6/f9 [1227526,85727] 0 2024-04-20T21:58:21.697 INFO:tasks.workunit.client.0.smithi142.stdout:2/212: creat d3/d5/f4b x:0 0 0 2024-04-20T21:58:21.697 INFO:tasks.workunit.client.0.smithi142.stdout:7/64: dwrite f1 [0,4194304] 0 2024-04-20T21:58:21.702 INFO:tasks.workunit.client.0.smithi142.stdout:1/128: truncate d2/dd/d17/f1a 893413 0 2024-04-20T21:58:21.703 INFO:tasks.workunit.client.0.smithi142.stdout:9/91: dwrite d0/f11 [0,4194304] 0 2024-04-20T21:58:21.709 INFO:tasks.workunit.client.0.smithi142.stdout:0/131: sync 2024-04-20T21:58:21.709 INFO:tasks.workunit.client.0.smithi142.stdout:3/66: creat d6/f11 x:0 0 0 2024-04-20T21:58:21.710 INFO:tasks.workunit.client.0.smithi142.stdout:2/213: mknod d3/d9/d34/c4c 0 2024-04-20T21:58:21.713 INFO:tasks.workunit.client.0.smithi142.stdout:7/65: rename d4/d9/c10 to d4/c13 0 2024-04-20T21:58:21.716 INFO:tasks.workunit.client.0.smithi142.stdout:7/66: chown d4/d9/d11/f12 3386852 1 2024-04-20T21:58:21.721 INFO:tasks.workunit.client.0.smithi142.stdout:2/214: unlink d3/f25 0 2024-04-20T21:58:21.728 INFO:tasks.workunit.client.0.smithi142.stdout:9/92: dread d0/f14 [0,4194304] 0 2024-04-20T21:58:21.736 INFO:tasks.workunit.client.0.smithi142.stdout:2/215: creat d3/d24/f4d x:0 0 0 2024-04-20T21:58:21.742 INFO:tasks.workunit.client.0.smithi142.stdout:9/93: rename d0/f4 to d0/f21 0 2024-04-20T21:58:21.747 INFO:tasks.workunit.client.0.smithi142.stdout:8/89: sync 2024-04-20T21:58:21.747 INFO:tasks.workunit.client.0.smithi142.stdout:4/109: sync 2024-04-20T21:58:21.747 INFO:tasks.workunit.client.0.smithi142.stdout:6/66: sync 2024-04-20T21:58:21.747 INFO:tasks.workunit.client.0.smithi142.stdout:5/63: sync 2024-04-20T21:58:21.750 INFO:tasks.workunit.client.0.smithi142.stdout:7/67: dread f1 [4194304,4194304] 0 2024-04-20T21:58:21.751 INFO:tasks.workunit.client.0.smithi142.stdout:9/94: symlink d0/l22 0 2024-04-20T21:58:21.754 INFO:tasks.workunit.client.0.smithi142.stdout:3/67: rmdir d6 39 2024-04-20T21:58:21.755 INFO:tasks.workunit.client.0.smithi142.stdout:9/95: readlink d0/l7 0 2024-04-20T21:58:21.757 INFO:tasks.workunit.client.0.smithi142.stdout:6/67: readlink d1/d5/l10 0 2024-04-20T21:58:21.759 INFO:tasks.workunit.client.0.smithi142.stdout:0/132: dwrite d5/d13/d1e/d23/f25 [0,4194304] 0 2024-04-20T21:58:21.766 INFO:tasks.workunit.client.0.smithi142.stdout:1/129: write d2/f6 [1690095,90821] 0 2024-04-20T21:58:21.773 INFO:tasks.workunit.client.0.smithi142.stdout:2/216: mknod d3/d6/d31/c4e 0 2024-04-20T21:58:21.774 INFO:tasks.workunit.client.0.smithi142.stdout:3/68: unlink c5 0 2024-04-20T21:58:21.774 INFO:tasks.workunit.client.0.smithi142.stdout:3/69: readlink - no filename 2024-04-20T21:58:21.782 INFO:tasks.workunit.client.0.smithi142.stdout:0/133: unlink d5/d13/d1e/d23/f25 0 2024-04-20T21:58:21.783 INFO:tasks.workunit.client.0.smithi142.stdout:8/90: mkdir d0/d22 0 2024-04-20T21:58:21.787 INFO:tasks.workunit.client.0.smithi142.stdout:5/64: truncate f7 208084 0 2024-04-20T21:58:21.788 INFO:tasks.workunit.client.0.smithi142.stdout:2/217: symlink d3/d5/d19/l4f 0 2024-04-20T21:58:21.790 INFO:tasks.workunit.client.0.smithi142.stdout:4/110: link d1/f3 d1/db/f21 0 2024-04-20T21:58:21.790 INFO:tasks.workunit.client.0.smithi142.stdout:3/70: fsync d6/f11 0 2024-04-20T21:58:21.790 INFO:tasks.workunit.client.0.smithi142.stdout:0/134: fsync d5/db/f1f 0 2024-04-20T21:58:21.792 INFO:tasks.workunit.client.0.smithi142.stdout:1/130: rename d2/dd/d17/l28 to d2/dd/d1c/l29 0 2024-04-20T21:58:21.797 INFO:tasks.workunit.client.0.smithi142.stdout:0/135: write d5/d13/f14 [710287,1590] 0 2024-04-20T21:58:21.798 INFO:tasks.workunit.client.0.smithi142.stdout:9/96: dwrite d0/f1e [0,4194304] 0 2024-04-20T21:58:21.800 INFO:tasks.workunit.client.0.smithi142.stdout:2/218: mkdir d3/d5/d19/d50 0 2024-04-20T21:58:21.801 INFO:tasks.workunit.client.0.smithi142.stdout:0/136: fsync d5/db/f1f 0 2024-04-20T21:58:21.801 INFO:tasks.workunit.client.0.smithi142.stdout:3/71: mknod d6/c12 0 2024-04-20T21:58:21.802 INFO:tasks.workunit.client.0.smithi142.stdout:1/131: symlink d2/dd/d1c/l2a 0 2024-04-20T21:58:21.804 INFO:tasks.workunit.client.0.smithi142.stdout:0/137: fdatasync d5/f9 0 2024-04-20T21:58:21.804 INFO:tasks.workunit.client.0.smithi142.stdout:7/68: getdents d4 0 2024-04-20T21:58:21.807 INFO:tasks.workunit.client.0.smithi142.stdout:9/97: rmdir d0 39 2024-04-20T21:58:21.823 INFO:tasks.workunit.client.0.smithi142.stdout:3/72: symlink d6/l13 0 2024-04-20T21:58:21.824 INFO:tasks.workunit.client.0.smithi142.stdout:1/132: rename d2/lb to d2/dd/d17/d1b/d22/d13/l2b 0 2024-04-20T21:58:21.830 INFO:tasks.workunit.client.0.smithi142.stdout:2/219: truncate d3/d5/f20 935346 0 2024-04-20T21:58:21.833 INFO:tasks.workunit.client.0.smithi142.stdout:9/98: dread d0/fa [0,4194304] 0 2024-04-20T21:58:21.837 INFO:tasks.workunit.client.0.smithi142.stdout:3/73: mkdir d6/d14 0 2024-04-20T21:58:21.842 INFO:tasks.workunit.client.0.smithi142.stdout:6/68: dwrite d1/d5/fb [0,4194304] 0 2024-04-20T21:58:21.843 INFO:tasks.workunit.client.0.smithi142.stdout:1/133: fsync d2/dd/d17/d1b/d22/d13/f14 0 2024-04-20T21:58:21.848 INFO:tasks.workunit.client.0.smithi142.stdout:2/220: rmdir d3/d6 39 2024-04-20T21:58:21.851 INFO:tasks.workunit.client.0.smithi142.stdout:4/111: dwrite d1/d6/f11 [0,4194304] 0 2024-04-20T21:58:21.853 INFO:tasks.workunit.client.0.smithi142.stdout:0/138: rename d5/d13/d1e/d23/d24/c30 to d5/db/c34 0 2024-04-20T21:58:21.856 INFO:tasks.workunit.client.0.smithi142.stdout:6/69: chown c0 121 1 2024-04-20T21:58:21.857 INFO:tasks.workunit.client.0.smithi142.stdout:1/134: chown d2/dd/d17/d1b 838 1 2024-04-20T21:58:21.858 INFO:tasks.workunit.client.0.smithi142.stdout:8/91: dwrite d0/f3 [0,4194304] 0 2024-04-20T21:58:21.864 INFO:tasks.workunit.client.0.smithi142.stdout:7/69: dread f1 [0,4194304] 0 2024-04-20T21:58:21.865 INFO:tasks.workunit.client.0.smithi142.stdout:4/112: read - d1/d6/f1a zero size 2024-04-20T21:58:21.865 INFO:tasks.workunit.client.0.smithi142.stdout:5/65: truncate dc/f12 26516 0 2024-04-20T21:58:21.867 INFO:tasks.workunit.client.0.smithi142.stdout:4/113: chown d1/d6/l9 15748 1 2024-04-20T21:58:21.868 INFO:tasks.workunit.client.0.smithi142.stdout:7/70: chown d4/d9/d11 844966 1 2024-04-20T21:58:21.873 INFO:tasks.workunit.client.0.smithi142.stdout:4/114: fdatasync d1/d6/f1a 0 2024-04-20T21:58:21.873 INFO:tasks.workunit.client.0.smithi142.stdout:7/71: chown d4/d9/d11/f12 0 1 2024-04-20T21:58:21.876 INFO:tasks.workunit.client.0.smithi142.stdout:5/66: chown f3 8215 1 2024-04-20T21:58:21.878 INFO:tasks.workunit.client.0.smithi142.stdout:0/139: dread d5/f18 [0,4194304] 0 2024-04-20T21:58:21.882 INFO:tasks.workunit.client.0.smithi142.stdout:9/99: dread d0/f14 [0,4194304] 0 2024-04-20T21:58:21.887 INFO:tasks.workunit.client.0.smithi142.stdout:3/74: dwrite d6/fc [0,4194304] 0 2024-04-20T21:58:21.887 INFO:tasks.workunit.client.0.smithi142.stdout:9/100: write d0/f1e [2154946,36356] 0 2024-04-20T21:58:21.888 INFO:tasks.workunit.client.0.smithi142.stdout:2/221: rename d3/d6 to d3/d9/d34/d51 0 2024-04-20T21:58:21.890 INFO:tasks.workunit.client.0.smithi142.stdout:3/75: chown d6/c12 951203 1 2024-04-20T21:58:21.890 INFO:tasks.workunit.client.0.smithi142.stdout:7/72: rename d4/d9 to d4/d9/d14 22 2024-04-20T21:58:21.895 INFO:tasks.workunit.client.0.smithi142.stdout:9/101: write d0/fc [1265457,6148] 0 2024-04-20T21:58:21.906 INFO:tasks.workunit.client.0.smithi142.stdout:1/135: mknod d2/dd/d17/d1b/d22/c2c 0 2024-04-20T21:58:21.907 INFO:tasks.workunit.client.0.smithi142.stdout:8/92: dwrite d0/f3 [0,4194304] 0 2024-04-20T21:58:21.918 INFO:tasks.workunit.client.0.smithi142.stdout:8/93: chown d0/d17/c18 0 1 2024-04-20T21:58:21.920 INFO:tasks.workunit.client.0.smithi142.stdout:6/70: rename d1/d11/cc to d1/d11/c18 0 2024-04-20T21:58:21.922 INFO:tasks.workunit.client.0.smithi142.stdout:1/136: readlink d2/dd/d17/d1b/d22/d13/l19 0 2024-04-20T21:58:21.923 INFO:tasks.workunit.client.0.smithi142.stdout:0/140: dwrite d5/d1d/f22 [0,4194304] 0 2024-04-20T21:58:21.936 INFO:tasks.workunit.client.0.smithi142.stdout:5/67: fdatasync f3 0 2024-04-20T21:58:21.940 INFO:tasks.workunit.client.0.smithi142.stdout:2/222: dwrite d3/d24/f4d [0,4194304] 0 2024-04-20T21:58:21.946 INFO:tasks.workunit.client.0.smithi142.stdout:3/76: dwrite d6/fd [0,4194304] 0 2024-04-20T21:58:21.951 INFO:tasks.workunit.client.0.smithi142.stdout:7/73: mkdir d4/d9/d15 0 2024-04-20T21:58:21.952 INFO:tasks.workunit.client.0.smithi142.stdout:9/102: rename d0/fa to d0/f23 0 2024-04-20T21:58:21.966 INFO:tasks.workunit.client.0.smithi142.stdout:4/115: unlink d1/d6/f11 0 2024-04-20T21:58:21.967 INFO:tasks.workunit.client.0.smithi142.stdout:3/77: write d6/ff [638010,68721] 0 2024-04-20T21:58:21.968 INFO:tasks.workunit.client.0.smithi142.stdout:7/74: dread - d4/d9/d11/f12 zero size 2024-04-20T21:58:21.972 INFO:tasks.workunit.client.0.smithi142.stdout:8/94: dwrite d0/f3 [0,4194304] 0 2024-04-20T21:58:21.973 INFO:tasks.workunit.client.0.smithi142.stdout:0/141: dread d5/f21 [0,4194304] 0 2024-04-20T21:58:21.974 INFO:tasks.workunit.client.0.smithi142.stdout:3/78: chown d6/f11 1753 1 2024-04-20T21:58:21.976 INFO:tasks.workunit.client.0.smithi142.stdout:1/137: dwrite d2/dd/fe [0,4194304] 0 2024-04-20T21:58:21.976 INFO:tasks.workunit.client.0.smithi142.stdout:7/75: dread - d4/d9/d11/f12 zero size 2024-04-20T21:58:21.986 INFO:tasks.workunit.client.0.smithi142.stdout:6/71: dwrite d1/f17 [0,4194304] 0 2024-04-20T21:58:22.010 INFO:tasks.workunit.client.0.smithi142.stdout:0/142: dwrite d5/f17 [0,4194304] 0 2024-04-20T21:58:22.015 INFO:tasks.workunit.client.0.smithi142.stdout:9/103: creat d0/f24 x:0 0 0 2024-04-20T21:58:22.022 INFO:tasks.workunit.client.0.smithi142.stdout:4/116: creat d1/d12/da/f22 x:0 0 0 2024-04-20T21:58:22.040 INFO:tasks.workunit.client.0.smithi142.stdout:1/138: creat d2/dd/d17/d1b/d22/d20/f2d x:0 0 0 2024-04-20T21:58:22.040 INFO:tasks.workunit.client.0.smithi142.stdout:1/139: dread - d2/dd/d17/f21 zero size 2024-04-20T21:58:22.041 INFO:tasks.workunit.client.0.smithi142.stdout:6/72: rmdir d1/d11 39 2024-04-20T21:58:22.044 INFO:tasks.workunit.client.0.smithi142.stdout:6/73: write d1/d5/f12 [339527,112155] 0 2024-04-20T21:58:22.045 INFO:tasks.workunit.client.0.smithi142.stdout:5/68: mkdir dc/d14/d17 0 2024-04-20T21:58:22.051 INFO:tasks.workunit.client.0.smithi142.stdout:9/104: rename d0/fb to d0/f25 0 2024-04-20T21:58:22.054 INFO:tasks.workunit.client.0.smithi142.stdout:2/223: link d3/d24/f3f d3/d5/d19/f52 0 2024-04-20T21:58:22.056 INFO:tasks.workunit.client.0.smithi142.stdout:4/117: symlink d1/d12/da/l23 0 2024-04-20T21:58:22.063 INFO:tasks.workunit.client.0.smithi142.stdout:5/69: dwrite dc/f11 [0,4194304] 0 2024-04-20T21:58:22.068 INFO:tasks.workunit.client.0.smithi142.stdout:6/74: rmdir d1/d5 39 2024-04-20T21:58:22.072 INFO:tasks.workunit.client.0.smithi142.stdout:0/143: symlink d5/d1c/d29/d32/l35 0 2024-04-20T21:58:22.076 INFO:tasks.workunit.client.0.smithi142.stdout:9/105: symlink d0/l26 0 2024-04-20T21:58:22.077 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:22 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:58:22.078 INFO:tasks.workunit.client.0.smithi142.stdout:4/118: mknod d1/d6/c24 0 2024-04-20T21:58:22.080 INFO:tasks.workunit.client.0.smithi142.stdout:2/224: rename d3/d9/d34/c4c to d3/d9/d34/d51/d31/c53 0 2024-04-20T21:58:22.082 INFO:tasks.workunit.client.0.smithi142.stdout:4/119: read - d1/d12/da/f22 zero size 2024-04-20T21:58:22.082 INFO:tasks.workunit.client.0.smithi142.stdout:3/79: rmdir d6/d14 0 2024-04-20T21:58:22.090 INFO:tasks.workunit.client.0.smithi142.stdout:8/95: link d0/l16 d0/d1c/l23 0 2024-04-20T21:58:22.097 INFO:tasks.workunit.client.0.smithi142.stdout:2/225: dread d3/d24/d3c/f36 [0,4194304] 0 2024-04-20T21:58:22.104 INFO:tasks.workunit.client.0.smithi142.stdout:0/144: dwrite d5/d1c/f26 [0,4194304] 0 2024-04-20T21:58:22.106 INFO:tasks.workunit.client.0.smithi142.stdout:6/75: dread - d1/d5/f14 zero size 2024-04-20T21:58:22.108 INFO:tasks.workunit.client.0.smithi142.stdout:0/145: chown d5/db/lc 0 1 2024-04-20T21:58:22.114 INFO:tasks.workunit.client.0.smithi142.stdout:9/106: write d0/f23 [1442822,113661] 0 2024-04-20T21:58:22.115 INFO:tasks.workunit.client.0.smithi142.stdout:3/80: mkdir d6/d15 0 2024-04-20T21:58:22.116 INFO:tasks.workunit.client.0.smithi142.stdout:4/120: dwrite d1/d6/f1f [0,4194304] 0 2024-04-20T21:58:22.117 INFO:tasks.workunit.client.0.smithi142.stdout:8/96: dread d0/f13 [4194304,4194304] 0 2024-04-20T21:58:22.119 INFO:tasks.workunit.client.0.smithi142.stdout:4/121: fdatasync d1/f13 0 2024-04-20T21:58:22.123 INFO:tasks.workunit.client.0.smithi142.stdout:8/97: write d0/f11 [641944,80427] 0 2024-04-20T21:58:22.126 INFO:tasks.workunit.client.0.smithi142.stdout:0/146: dread d5/f8 [0,4194304] 0 2024-04-20T21:58:22.126 INFO:tasks.workunit.client.0.smithi142.stdout:7/76: getdents d4/d9 0 2024-04-20T21:58:22.128 INFO:tasks.workunit.client.0.smithi142.stdout:7/77: read - d4/d9/d11/f12 zero size 2024-04-20T21:58:22.129 INFO:tasks.workunit.client.0.smithi142.stdout:7/78: fsync d4/d9/d11/f12 0 2024-04-20T21:58:22.130 INFO:tasks.workunit.client.0.smithi142.stdout:7/79: read - d4/d9/d11/f12 zero size 2024-04-20T21:58:22.143 INFO:tasks.workunit.client.0.smithi142.stdout:6/76: mknod d1/d5/c19 0 2024-04-20T21:58:22.143 INFO:tasks.workunit.client.0.smithi142.stdout:6/77: stat d1/f15 0 2024-04-20T21:58:22.151 INFO:tasks.workunit.client.0.smithi142.stdout:1/140: truncate d2/f6 1634857 0 2024-04-20T21:58:22.153 INFO:tasks.workunit.client.0.smithi142.stdout:7/80: mknod d4/d9/d11/c16 0 2024-04-20T21:58:22.161 INFO:tasks.workunit.client.0.smithi142.stdout:6/78: dwrite d1/f4 [0,4194304] 0 2024-04-20T21:58:22.161 INFO:tasks.workunit.client.0.smithi142.stdout:5/70: rmdir dc/d14/d17 0 2024-04-20T21:58:22.165 INFO:tasks.workunit.client.0.smithi142.stdout:3/81: symlink d6/d15/l16 0 2024-04-20T21:58:22.169 INFO:tasks.workunit.client.0.smithi142.stdout:9/107: unlink d0/l3 0 2024-04-20T21:58:22.172 INFO:tasks.workunit.client.0.smithi142.stdout:3/82: write d6/ff [1091107,81486] 0 2024-04-20T21:58:22.177 INFO:tasks.workunit.client.0.smithi142.stdout:1/141: mknod d2/dd/d17/d1b/d22/c2e 0 2024-04-20T21:58:22.179 INFO:tasks.workunit.client.0.smithi142.stdout:7/81: write f1 [1940489,99972] 0 2024-04-20T21:58:22.180 INFO:tasks.workunit.client.0.smithi142.stdout:4/122: link d1/ff d1/d12/da/d1c/f25 0 2024-04-20T21:58:22.181 INFO:tasks.workunit.client.0.smithi142.stdout:6/79: mkdir d1/d5/d1a 0 2024-04-20T21:58:22.183 INFO:tasks.workunit.client.0.smithi142.stdout:1/142: write d2/f7 [4050497,3855] 0 2024-04-20T21:58:22.185 INFO:tasks.workunit.client.0.smithi142.stdout:7/82: write d4/d9/d11/f12 [605761,50578] 0 2024-04-20T21:58:22.185 INFO:tasks.workunit.client.0.smithi142.stdout:0/147: link c2 d5/d13/c36 0 2024-04-20T21:58:22.194 INFO:tasks.workunit.client.0.smithi142.stdout:3/83: dwrite d6/fd [0,4194304] 0 2024-04-20T21:58:22.202 INFO:tasks.workunit.client.0.smithi142.stdout:2/226: write d3/d5/f20 [559278,11547] 0 2024-04-20T21:58:22.202 INFO:tasks.workunit.client.0.smithi142.stdout:1/143: fdatasync d2/dd/d17/f1a 0 2024-04-20T21:58:22.212 INFO:tasks.workunit.client.0.smithi142.stdout:0/148: symlink d5/d1c/l37 0 2024-04-20T21:58:22.217 INFO:tasks.workunit.client.0.smithi142.stdout:7/83: dwrite d4/d9/d11/f12 [0,4194304] 0 2024-04-20T21:58:22.218 INFO:tasks.workunit.client.0.smithi142.stdout:3/84: mknod d6/d15/c17 0 2024-04-20T21:58:22.219 INFO:tasks.workunit.client.0.smithi142.stdout:6/80: mkdir d1/d1b 0 2024-04-20T21:58:22.221 INFO:tasks.workunit.client.0.smithi142.stdout:1/144: creat d2/dd/d17/d1b/d22/f2f x:0 0 0 2024-04-20T21:58:22.224 INFO:tasks.workunit.client.0.smithi142.stdout:1/145: read d2/dd/d17/d1b/d22/d13/f14 [3786516,56031] 0 2024-04-20T21:58:22.227 INFO:tasks.workunit.client.0.smithi142.stdout:2/227: creat d3/d9/d34/d51/d31/f54 x:0 0 0 2024-04-20T21:58:22.236 INFO:tasks.workunit.client.0.smithi142.stdout:4/123: link d1/d6/fc d1/d12/da/d1c/f26 0 2024-04-20T21:58:22.236 INFO:tasks.workunit.client.0.smithi142.stdout:9/108: link d0/c1f d0/c27 0 2024-04-20T21:58:22.237 INFO:tasks.workunit.client.0.smithi142.stdout:7/84: dwrite f1 [0,4194304] 0 2024-04-20T21:58:22.246 INFO:tasks.workunit.client.0.smithi142.stdout:3/85: unlink d6/f7 0 2024-04-20T21:58:22.250 INFO:tasks.workunit.client.0.smithi142.stdout:1/146: creat d2/dd/d17/d1b/f30 x:0 0 0 2024-04-20T21:58:22.250 INFO:tasks.workunit.client.0.smithi142.stdout:2/228: readlink d3/l37 0 2024-04-20T21:58:22.255 INFO:tasks.workunit.client.0.smithi142.stdout:6/81: mknod d1/d5/d1a/c1c 0 2024-04-20T21:58:22.257 INFO:tasks.workunit.client.0.smithi142.stdout:3/86: creat d6/f18 x:0 0 0 2024-04-20T21:58:22.260 INFO:tasks.workunit.client.0.smithi142.stdout:3/87: dread - d6/f11 zero size 2024-04-20T21:58:22.261 INFO:tasks.workunit.client.0.smithi142.stdout:6/82: dread - d1/d5/f14 zero size 2024-04-20T21:58:22.263 INFO:tasks.workunit.client.0.smithi142.stdout:6/83: fsync d1/d5/f14 0 2024-04-20T21:58:22.264 INFO:tasks.workunit.client.0.smithi142.stdout:7/85: dwrite d4/d9/d11/f12 [0,4194304] 0 2024-04-20T21:58:22.267 INFO:tasks.workunit.client.0.smithi142.stdout:9/109: fsync d0/f24 0 2024-04-20T21:58:22.270 INFO:tasks.workunit.client.0.smithi142.stdout:0/149: getdents d5 0 2024-04-20T21:58:22.275 INFO:tasks.workunit.client.0.smithi142.stdout:3/88: creat d6/d15/f19 x:0 0 0 2024-04-20T21:58:22.277 INFO:tasks.workunit.client.0.smithi142.stdout:3/89: readlink d6/l13 0 2024-04-20T21:58:22.283 INFO:tasks.workunit.client.0.smithi142.stdout:4/124: dwrite d1/f8 [0,4194304] 0 2024-04-20T21:58:22.284 INFO:tasks.workunit.client.0.smithi142.stdout:0/150: rename d5/db to d5/d1c/d29/d38 0 2024-04-20T21:58:22.285 INFO:tasks.workunit.client.0.smithi142.stdout:2/229: rmdir d3/d5/d19/d50 0 2024-04-20T21:58:22.286 INFO:tasks.workunit.client.0.smithi142.stdout:1/147: creat d2/f31 x:0 0 0 2024-04-20T21:58:22.286 INFO:tasks.workunit.client.0.smithi142.stdout:7/86: symlink d4/d9/d15/l17 0 2024-04-20T21:58:22.295 INFO:tasks.workunit.client.0.smithi142.stdout:9/110: mknod d0/c28 0 2024-04-20T21:58:22.299 INFO:tasks.workunit.client.0.smithi142.stdout:0/151: creat d5/d13/d1e/d23/f39 x:0 0 0 2024-04-20T21:58:22.304 INFO:tasks.workunit.client.0.smithi142.stdout:3/90: dread d6/ff [0,4194304] 0 2024-04-20T21:58:22.308 INFO:tasks.workunit.client.0.smithi142.stdout:9/111: write d0/f14 [2516496,36598] 0 2024-04-20T21:58:22.309 INFO:tasks.workunit.client.0.smithi142.stdout:4/125: write d1/d12/f1d [95660,34735] 0 2024-04-20T21:58:22.309 INFO:tasks.workunit.client.0.smithi142.stdout:3/91: fdatasync d6/fd 0 2024-04-20T21:58:22.309 INFO:tasks.workunit.client.0.smithi142.stdout:6/84: dwrite d1/d11/fa [4194304,4194304] 0 2024-04-20T21:58:22.318 INFO:tasks.workunit.client.0.smithi142.stdout:1/148: link d2/dd/d17/d1b/d22/d13/l2b d2/dd/d17/l32 0 2024-04-20T21:58:22.319 INFO:tasks.workunit.client.0.smithi142.stdout:0/152: chown d5/d1c/d29/d38/c34 12213036 1 2024-04-20T21:58:22.321 INFO:tasks.workunit.client.0.smithi142.stdout:2/230: dwrite d3/d9/f33 [0,4194304] 0 2024-04-20T21:58:22.321 INFO:tasks.workunit.client.0.smithi142.stdout:6/85: mkdir d1/d1d 0 2024-04-20T21:58:22.321 INFO:tasks.workunit.client.0.smithi142.stdout:3/92: write d6/f8 [265016,129269] 0 2024-04-20T21:58:22.322 INFO:tasks.workunit.client.0.smithi142.stdout:4/126: write d1/d12/da/f18 [1037170,120314] 0 2024-04-20T21:58:22.325 INFO:tasks.workunit.client.0.smithi142.stdout:6/86: chown d1/d1b 6003667 1 2024-04-20T21:58:22.325 INFO:tasks.workunit.client.0.smithi142.stdout:7/87: dwrite f1 [0,4194304] 0 2024-04-20T21:58:22.325 INFO:tasks.workunit.client.0.smithi142.stdout:1/149: read - d2/dd/d17/d1b/f30 zero size 2024-04-20T21:58:22.326 INFO:tasks.workunit.client.0.smithi142.stdout:3/93: write d6/f9 [1706948,109621] 0 2024-04-20T21:58:22.326 INFO:tasks.workunit.client.0.smithi142.stdout:6/87: fsync d1/f15 0 2024-04-20T21:58:22.327 INFO:tasks.workunit.client.0.smithi142.stdout:9/112: creat d0/f29 x:0 0 0 2024-04-20T21:58:22.333 INFO:tasks.workunit.client.0.smithi142.stdout:9/113: dread - d0/f24 zero size 2024-04-20T21:58:22.335 INFO:tasks.workunit.client.0.smithi142.stdout:6/88: write d1/f17 [1010705,2376] 0 2024-04-20T21:58:22.337 INFO:tasks.workunit.client.0.smithi142.stdout:3/94: creat d6/f1a x:0 0 0 2024-04-20T21:58:22.339 INFO:tasks.workunit.client.0.smithi142.stdout:3/95: dread - d6/d15/f19 zero size 2024-04-20T21:58:22.339 INFO:tasks.workunit.client.0.smithi142.stdout:2/231: mknod d3/d5/d19/c55 0 2024-04-20T21:58:22.340 INFO:tasks.workunit.client.0.smithi142.stdout:6/89: write d1/d5/f14 [1027072,61923] 0 2024-04-20T21:58:22.341 INFO:tasks.workunit.client.0.smithi142.stdout:7/88: creat d4/d9/d15/f18 x:0 0 0 2024-04-20T21:58:22.351 INFO:tasks.workunit.client.0.smithi142.stdout:9/114: readlink d0/l22 0 2024-04-20T21:58:22.358 INFO:tasks.workunit.client.0.smithi142.stdout:7/89: mknod d4/c19 0 2024-04-20T21:58:22.358 INFO:tasks.workunit.client.0.smithi142.stdout:0/153: dread d5/f21 [0,4194304] 0 2024-04-20T21:58:22.363 INFO:tasks.workunit.client.0.smithi142.stdout:1/150: dwrite d2/dd/fe [0,4194304] 0 2024-04-20T21:58:22.369 INFO:tasks.workunit.client.0.smithi142.stdout:4/127: truncate f0 3684415 0 2024-04-20T21:58:22.372 INFO:tasks.workunit.client.0.smithi142.stdout:2/232: dwrite d3/d9/f33 [0,4194304] 0 2024-04-20T21:58:22.374 INFO:tasks.workunit.client.0.smithi142.stdout:3/96: link d6/c12 d6/c1b 0 2024-04-20T21:58:22.375 INFO:tasks.workunit.client.0.smithi142.stdout:9/115: dread d0/f25 [0,4194304] 0 2024-04-20T21:58:22.378 INFO:tasks.workunit.client.0.smithi142.stdout:2/233: write d3/d9/f33 [2722211,43506] 0 2024-04-20T21:58:22.378 INFO:tasks.workunit.client.0.smithi142.stdout:0/154: symlink d5/d1c/d29/l3a 0 2024-04-20T21:58:22.379 INFO:tasks.workunit.client.0.smithi142.stdout:1/151: symlink d2/dd/l33 0 2024-04-20T21:58:22.381 INFO:tasks.workunit.client.0.smithi142.stdout:0/155: stat d5/d13 0 2024-04-20T21:58:22.394 INFO:tasks.workunit.client.0.smithi142.stdout:3/97: dwrite d6/f8 [0,4194304] 0 2024-04-20T21:58:22.395 INFO:tasks.workunit.client.0.smithi142.stdout:9/116: chown d0/l7 57137100 1 2024-04-20T21:58:22.395 INFO:tasks.workunit.client.0.smithi142.stdout:7/90: link d4/l6 d4/d9/d11/l1a 0 2024-04-20T21:58:22.396 INFO:tasks.workunit.client.0.smithi142.stdout:3/98: fdatasync d6/fd 0 2024-04-20T21:58:22.397 INFO:tasks.workunit.client.0.smithi142.stdout:6/90: truncate d1/d5/f12 1298287 0 2024-04-20T21:58:22.400 INFO:tasks.workunit.client.0.smithi142.stdout:2/234: creat d3/d9/d34/f56 x:0 0 0 2024-04-20T21:58:22.402 INFO:tasks.workunit.client.0.smithi142.stdout:0/156: mknod d5/d1c/c3b 0 2024-04-20T21:58:22.403 INFO:tasks.workunit.client.0.smithi142.stdout:2/235: write d3/d9/d34/d51/f2d [175600,113491] 0 2024-04-20T21:58:22.404 INFO:tasks.workunit.client.0.smithi142.stdout:1/152: symlink d2/dd/d17/d1b/l34 0 2024-04-20T21:58:22.413 INFO:tasks.workunit.client.0.smithi142.stdout:7/91: rename d4/d9/d15 to d4/d9/d1b 0 2024-04-20T21:58:22.418 INFO:tasks.workunit.client.0.smithi142.stdout:4/128: dwrite d1/d12/da/d1c/f25 [4194304,4194304] 0 2024-04-20T21:58:22.419 INFO:tasks.workunit.client.0.smithi142.stdout:0/157: dread d5/f21 [0,4194304] 0 2024-04-20T21:58:22.420 INFO:tasks.workunit.client.0.smithi142.stdout:9/117: mkdir d0/d2a 0 2024-04-20T21:58:22.423 INFO:tasks.workunit.client.0.smithi142.stdout:2/236: rmdir d3/d9/d34 39 2024-04-20T21:58:22.424 INFO:tasks.workunit.client.0.smithi142.stdout:2/237: chown d3/d24/d3c 519157 1 2024-04-20T21:58:22.428 INFO:tasks.workunit.client.0.smithi142.stdout:1/153: creat d2/dd/d17/d1b/d22/d13/f35 x:0 0 0 2024-04-20T21:58:22.435 INFO:tasks.workunit.client.0.smithi142.stdout:7/92: mkdir d4/d9/d1c 0 2024-04-20T21:58:22.437 INFO:tasks.workunit.client.0.smithi142.stdout:9/118: dread d0/f14 [0,4194304] 0 2024-04-20T21:58:22.440 INFO:tasks.workunit.client.0.smithi142.stdout:4/129: rmdir d1/d12/da/d1c 39 2024-04-20T21:58:22.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:22 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:58:22.445 INFO:tasks.workunit.client.0.smithi142.stdout:0/158: dwrite d5/d13/d1e/d23/d2c/f2e [0,4194304] 0 2024-04-20T21:58:22.451 INFO:tasks.workunit.client.0.smithi142.stdout:2/238: dwrite d3/d24/f43 [4194304,4194304] 0 2024-04-20T21:58:22.451 INFO:tasks.workunit.client.0.smithi142.stdout:1/154: mknod d2/dd/d17/d1b/d22/d20/c36 0 2024-04-20T21:58:22.454 INFO:tasks.workunit.client.0.smithi142.stdout:7/93: mknod d4/c1d 0 2024-04-20T21:58:22.455 INFO:tasks.workunit.client.0.smithi142.stdout:3/99: getdents d6 0 2024-04-20T21:58:22.458 INFO:tasks.workunit.client.0.smithi142.stdout:9/119: write d0/f8 [3197177,123612] 0 2024-04-20T21:58:22.460 INFO:tasks.workunit.client.0.smithi142.stdout:4/130: mkdir d1/db/d27 0 2024-04-20T21:58:22.461 INFO:tasks.workunit.client.0.smithi142.stdout:0/159: unlink d5/d1c/c3b 0 2024-04-20T21:58:22.465 INFO:tasks.workunit.client.0.smithi142.stdout:0/160: dread - d5/d13/d1e/d23/d24/f2a zero size 2024-04-20T21:58:22.467 INFO:tasks.workunit.client.0.smithi142.stdout:1/155: unlink d2/dd/d17/d1b/d22/d20/f26 0 2024-04-20T21:58:22.472 INFO:tasks.workunit.client.0.smithi142.stdout:9/120: fdatasync d0/f8 0 2024-04-20T21:58:22.475 INFO:tasks.workunit.client.0.smithi142.stdout:1/156: dread - d2/dd/d17/d1b/d22/f2f zero size 2024-04-20T21:58:22.477 INFO:tasks.workunit.client.0.smithi142.stdout:6/91: dwrite d1/d5/f12 [0,4194304] 0 2024-04-20T21:58:22.481 INFO:tasks.workunit.client.0.smithi142.stdout:1/157: dread - d2/dd/d17/d1b/d22/f2f zero size 2024-04-20T21:58:22.484 INFO:tasks.workunit.client.0.smithi142.stdout:1/158: fdatasync d2/dd/d17/d1b/d22/d13/f14 0 2024-04-20T21:58:22.487 INFO:tasks.workunit.client.0.smithi142.stdout:4/131: creat d1/db/d17/f28 x:0 0 0 2024-04-20T21:58:22.488 INFO:tasks.workunit.client.0.smithi142.stdout:0/161: mkdir d5/d1c/d3c 0 2024-04-20T21:58:22.488 INFO:tasks.workunit.client.0.smithi142.stdout:4/132: readlink d1/d12/l15 0 2024-04-20T21:58:22.491 INFO:tasks.workunit.client.0.smithi142.stdout:4/133: write d1/db/f1e [1531435,90932] 0 2024-04-20T21:58:22.492 INFO:tasks.workunit.client.0.smithi142.stdout:2/239: mknod d3/d9/d34/c57 0 2024-04-20T21:58:22.493 INFO:tasks.workunit.client.0.smithi142.stdout:4/134: stat d1/d12/da/l23 0 2024-04-20T21:58:22.495 INFO:tasks.workunit.client.0.smithi142.stdout:2/240: truncate d3/d9/f49 335964 0 2024-04-20T21:58:22.496 INFO:tasks.workunit.client.0.smithi142.stdout:1/159: chown d2/f6 100740 1 2024-04-20T21:58:22.503 INFO:tasks.workunit.client.0.smithi142.stdout:9/121: symlink d0/l2b 0 2024-04-20T21:58:22.506 INFO:tasks.workunit.client.0.smithi142.stdout:6/92: creat d1/d1b/f1e x:0 0 0 2024-04-20T21:58:22.506 INFO:tasks.workunit.client.0.smithi142.stdout:7/94: link d4/le d4/d9/l1e 0 2024-04-20T21:58:22.507 INFO:tasks.workunit.client.0.smithi142.stdout:3/100: link d6/l13 d6/d15/l1c 0 2024-04-20T21:58:22.508 INFO:tasks.workunit.client.0.smithi142.stdout:2/241: dread d3/f1f [0,4194304] 0 2024-04-20T21:58:22.509 INFO:tasks.workunit.client.0.smithi142.stdout:3/101: truncate d6/f11 592581 0 2024-04-20T21:58:22.510 INFO:tasks.workunit.client.0.smithi142.stdout:2/242: dread - d3/d5/f2a zero size 2024-04-20T21:58:22.511 INFO:tasks.workunit.client.0.smithi142.stdout:1/160: chown d2/dd/d17/l32 2705943 1 2024-04-20T21:58:22.511 INFO:tasks.workunit.client.0.smithi142.stdout:0/162: rename d5/d13/d1e/d23/d24/l31 to d5/d13/l3d 0 2024-04-20T21:58:22.514 INFO:tasks.workunit.client.0.smithi142.stdout:4/135: mknod d1/c29 0 2024-04-20T21:58:22.517 INFO:tasks.workunit.client.0.smithi142.stdout:2/243: write d3/d24/d3c/f1b [4693334,62380] 0 2024-04-20T21:58:22.518 INFO:tasks.workunit.client.0.smithi142.stdout:4/136: chown d1/d12/l15 8968 1 2024-04-20T21:58:22.520 INFO:tasks.workunit.client.0.smithi142.stdout:0/163: mknod d5/d13/d1e/d23/d24/c3e 0 2024-04-20T21:58:22.525 INFO:tasks.workunit.client.0.smithi142.stdout:5/71: sync 2024-04-20T21:58:22.525 INFO:tasks.workunit.client.0.smithi142.stdout:8/98: sync 2024-04-20T21:58:22.528 INFO:tasks.workunit.client.0.smithi142.stdout:6/93: getdents d1/d11 0 2024-04-20T21:58:22.529 INFO:tasks.workunit.client.0.smithi142.stdout:7/95: getdents d4/d9/d11 0 2024-04-20T21:58:22.540 INFO:tasks.workunit.client.0.smithi142.stdout:7/96: unlink d4/c1d 0 2024-04-20T21:58:22.541 INFO:tasks.workunit.client.0.smithi142.stdout:3/102: dwrite d6/fc [0,4194304] 0 2024-04-20T21:58:22.543 INFO:tasks.workunit.client.0.smithi142.stdout:6/94: truncate d1/f15 131581 0 2024-04-20T21:58:22.546 INFO:tasks.workunit.client.0.smithi142.stdout:4/137: link d1/c29 d1/d12/da/d1c/c2a 0 2024-04-20T21:58:22.550 INFO:tasks.workunit.client.0.smithi142.stdout:6/95: write d1/f15 [200751,73899] 0 2024-04-20T21:58:22.556 INFO:tasks.workunit.client.0.smithi142.stdout:9/122: dwrite d0/fe [0,4194304] 0 2024-04-20T21:58:22.560 INFO:tasks.workunit.client.0.smithi142.stdout:5/72: link dc/ce dc/d14/c18 0 2024-04-20T21:58:22.561 INFO:tasks.workunit.client.0.smithi142.stdout:5/73: readlink - no filename 2024-04-20T21:58:22.563 INFO:tasks.workunit.client.0.smithi142.stdout:2/244: dwrite d3/d5/f40 [0,4194304] 0 2024-04-20T21:58:22.564 INFO:tasks.workunit.client.0.smithi142.stdout:9/123: write d0/f8 [3007916,45365] 0 2024-04-20T21:58:22.565 INFO:tasks.workunit.client.0.smithi142.stdout:5/74: stat dc 0 2024-04-20T21:58:22.568 INFO:tasks.workunit.client.0.smithi142.stdout:7/97: creat d4/d9/d1b/f1f x:0 0 0 2024-04-20T21:58:22.570 INFO:tasks.workunit.client.0.smithi142.stdout:8/99: dwrite d0/d17/f19 [0,4194304] 0 2024-04-20T21:58:22.578 INFO:tasks.workunit.client.0.smithi142.stdout:0/164: getdents d5/d1c/d29/d32 0 2024-04-20T21:58:22.583 INFO:tasks.workunit.client.0.smithi142.stdout:2/245: dread d3/d5/f20 [0,4194304] 0 2024-04-20T21:58:22.583 INFO:tasks.workunit.client.0.smithi142.stdout:7/98: unlink d4/d9/d11/f12 0 2024-04-20T21:58:22.587 INFO:tasks.workunit.client.0.smithi142.stdout:7/99: write f1 [1603148,50148] 0 2024-04-20T21:58:22.590 INFO:tasks.workunit.client.0.smithi142.stdout:2/246: write d3/d24/f4d [3448782,108712] 0 2024-04-20T21:58:22.592 INFO:tasks.workunit.client.0.smithi142.stdout:9/124: symlink d0/l2c 0 2024-04-20T21:58:22.597 INFO:tasks.workunit.client.0.smithi142.stdout:6/96: dwrite d1/f17 [0,4194304] 0 2024-04-20T21:58:22.598 INFO:tasks.workunit.client.0.smithi142.stdout:3/103: dwrite d6/f11 [0,4194304] 0 2024-04-20T21:58:22.599 INFO:tasks.workunit.client.0.smithi142.stdout:8/100: symlink d0/d22/l24 0 2024-04-20T21:58:22.602 INFO:tasks.workunit.client.0.smithi142.stdout:0/165: mknod d5/d13/d1e/d23/c3f 0 2024-04-20T21:58:22.609 INFO:tasks.workunit.client.0.smithi142.stdout:0/166: dread d5/ff [0,4194304] 0 2024-04-20T21:58:22.609 INFO:tasks.workunit.client.0.smithi142.stdout:3/104: write d6/f11 [2566771,47646] 0 2024-04-20T21:58:22.620 INFO:tasks.workunit.client.0.smithi142.stdout:5/75: getdents dc 0 2024-04-20T21:58:22.632 INFO:tasks.workunit.client.0.smithi142.stdout:9/125: creat d0/d2a/f2d x:0 0 0 2024-04-20T21:58:22.632 INFO:tasks.workunit.client.0.smithi142.stdout:7/100: dwrite d4/d9/d1b/f18 [0,4194304] 0 2024-04-20T21:58:22.635 INFO:tasks.workunit.client.0.smithi142.stdout:4/138: dwrite d1/d12/da/d1c/f26 [0,4194304] 0 2024-04-20T21:58:22.635 INFO:tasks.workunit.client.0.smithi142.stdout:3/105: mknod d6/d15/c1d 0 2024-04-20T21:58:22.639 INFO:tasks.workunit.client.0.smithi142.stdout:2/247: dread d3/f42 [0,4194304] 0 2024-04-20T21:58:22.642 INFO:tasks.workunit.client.0.smithi142.stdout:3/106: stat d6/fd 0 2024-04-20T21:58:22.646 INFO:tasks.workunit.client.0.smithi142.stdout:4/139: mknod d1/d6/c2b 0 2024-04-20T21:58:22.646 INFO:tasks.workunit.client.0.smithi142.stdout:7/101: symlink d4/d9/d1b/l20 0 2024-04-20T21:58:22.647 INFO:tasks.workunit.client.0.smithi142.stdout:2/248: truncate d3/d5/d19/f21 1056968 0 2024-04-20T21:58:22.647 INFO:tasks.workunit.client.0.smithi142.stdout:8/101: dwrite d0/ff [0,4194304] 0 2024-04-20T21:58:22.649 INFO:tasks.workunit.client.0.smithi142.stdout:5/76: fsync f4 0 2024-04-20T21:58:22.649 INFO:tasks.workunit.client.0.smithi142.stdout:4/140: stat d1/d6/f1f 0 2024-04-20T21:58:22.649 INFO:tasks.workunit.client.0.smithi142.stdout:0/167: link d5/d13/l15 d5/d13/d1e/l40 0 2024-04-20T21:58:22.658 INFO:tasks.workunit.client.0.smithi142.stdout:9/126: symlink d0/l2e 0 2024-04-20T21:58:22.662 INFO:tasks.workunit.client.0.smithi142.stdout:6/97: getdents d1 0 2024-04-20T21:58:22.668 INFO:tasks.workunit.client.0.smithi142.stdout:5/77: unlink dc/f11 0 2024-04-20T21:58:22.669 INFO:tasks.workunit.client.0.smithi142.stdout:8/102: creat d0/d22/f25 x:0 0 0 2024-04-20T21:58:22.682 INFO:tasks.workunit.client.0.smithi142.stdout:2/249: mknod d3/d9/d34/d51/c58 0 2024-04-20T21:58:22.683 INFO:tasks.workunit.client.0.smithi142.stdout:6/98: rename c0 to d1/d1b/c1f 0 2024-04-20T21:58:22.688 INFO:tasks.workunit.client.0.smithi142.stdout:2/250: dread - d3/d5/f4b zero size 2024-04-20T21:58:22.688 INFO:tasks.workunit.client.0.smithi142.stdout:3/107: dwrite d6/f10 [0,4194304] 0 2024-04-20T21:58:22.690 INFO:tasks.workunit.client.0.smithi142.stdout:4/141: dwrite d1/ff [0,4194304] 0 2024-04-20T21:58:22.691 INFO:tasks.workunit.client.0.smithi142.stdout:6/99: symlink d1/l20 0 2024-04-20T21:58:22.694 INFO:tasks.workunit.client.0.smithi142.stdout:9/127: dwrite d0/fe [0,4194304] 0 2024-04-20T21:58:22.703 INFO:tasks.workunit.client.0.smithi142.stdout:3/108: write d6/ff [2070538,93986] 0 2024-04-20T21:58:22.704 INFO:tasks.workunit.client.0.smithi142.stdout:8/103: dread d0/f13 [4194304,4194304] 0 2024-04-20T21:58:22.706 INFO:tasks.workunit.client.0.smithi142.stdout:7/102: fdatasync d4/d9/d1b/f18 0 2024-04-20T21:58:22.706 INFO:tasks.workunit.client.0.smithi142.stdout:9/128: unlink d0/l22 0 2024-04-20T21:58:22.709 INFO:tasks.workunit.client.0.smithi142.stdout:2/251: rmdir d3 39 2024-04-20T21:58:22.720 INFO:tasks.workunit.client.0.smithi142.stdout:8/104: dread d0/fc [0,4194304] 0 2024-04-20T21:58:22.722 INFO:tasks.workunit.client.0.smithi142.stdout:0/168: dwrite d5/ff [0,4194304] 0 2024-04-20T21:58:22.723 INFO:tasks.workunit.client.0.smithi142.stdout:5/78: write f3 [6245296,105379] 0 2024-04-20T21:58:22.727 INFO:tasks.workunit.client.0.smithi142.stdout:8/105: write d0/f6 [10880,97322] 0 2024-04-20T21:58:22.728 INFO:tasks.workunit.client.0.smithi142.stdout:4/142: dwrite d1/d12/da/f18 [0,4194304] 0 2024-04-20T21:58:22.729 INFO:tasks.workunit.client.0.smithi142.stdout:9/129: stat d0/l26 0 2024-04-20T21:58:22.736 INFO:tasks.workunit.client.0.smithi142.stdout:6/100: chown d1/l20 8 1 2024-04-20T21:58:22.736 INFO:tasks.workunit.client.0.smithi142.stdout:3/109: dwrite f2 [4194304,4194304] 0 2024-04-20T21:58:22.738 INFO:tasks.workunit.client.0.smithi142.stdout:7/103: dread f1 [0,4194304] 0 2024-04-20T21:58:22.741 INFO:tasks.workunit.client.0.smithi142.stdout:7/104: truncate d4/d9/d1b/f1f 308843 0 2024-04-20T21:58:22.743 INFO:tasks.workunit.client.0.smithi142.stdout:5/79: creat dc/f19 x:0 0 0 2024-04-20T21:58:22.744 INFO:tasks.workunit.client.0.smithi142.stdout:2/252: creat d3/d5/d19/f59 x:0 0 0 2024-04-20T21:58:22.747 INFO:tasks.workunit.client.0.smithi142.stdout:0/169: creat d5/d13/d1e/d23/d2c/f41 x:0 0 0 2024-04-20T21:58:22.749 INFO:tasks.workunit.client.0.smithi142.stdout:2/253: write d3/d24/d3c/f36 [1351107,26419] 0 2024-04-20T21:58:22.750 INFO:tasks.workunit.client.0.smithi142.stdout:8/106: creat d0/f26 x:0 0 0 2024-04-20T21:58:22.751 INFO:tasks.workunit.client.0.smithi142.stdout:6/101: chown d1/d1b 10 1 2024-04-20T21:58:22.751 INFO:tasks.workunit.client.0.smithi142.stdout:4/143: rename d1/d12/f1d to d1/d6/f2c 0 2024-04-20T21:58:22.752 INFO:tasks.workunit.client.0.smithi142.stdout:3/110: mkdir d6/d15/d1e 0 2024-04-20T21:58:22.759 INFO:tasks.workunit.client.0.smithi142.stdout:0/170: rmdir d5/d13/d1e/d23/d24 39 2024-04-20T21:58:22.760 INFO:tasks.workunit.client.0.smithi142.stdout:4/144: write d1/d12/da/d1c/f25 [5892815,21821] 0 2024-04-20T21:58:22.762 INFO:tasks.workunit.client.0.smithi142.stdout:0/171: chown d5/d13/d1e/d23 467 1 2024-04-20T21:58:22.767 INFO:tasks.workunit.client.0.smithi142.stdout:8/107: unlink d0/d22/f25 0 2024-04-20T21:58:22.770 INFO:tasks.workunit.client.0.smithi142.stdout:3/111: symlink d6/d15/l1f 0 2024-04-20T21:58:22.771 INFO:tasks.workunit.client.0.smithi142.stdout:3/112: dread - d6/f18 zero size 2024-04-20T21:58:22.776 INFO:tasks.workunit.client.0.smithi142.stdout:4/145: creat d1/d6/f2d x:0 0 0 2024-04-20T21:58:22.782 INFO:tasks.workunit.client.0.smithi142.stdout:4/146: write d1/d12/da/d1c/f25 [2566449,30333] 0 2024-04-20T21:58:22.786 INFO:tasks.workunit.client.0.smithi142.stdout:8/108: mknod d0/c27 0 2024-04-20T21:58:22.787 INFO:tasks.workunit.client.0.smithi142.stdout:3/113: mknod d6/d15/c20 0 2024-04-20T21:58:22.787 INFO:tasks.workunit.client.0.smithi142.stdout:2/254: dwrite d3/f1f [0,4194304] 0 2024-04-20T21:58:22.787 INFO:tasks.workunit.client.0.smithi142.stdout:6/102: mknod d1/d1d/c21 0 2024-04-20T21:58:22.788 INFO:tasks.workunit.client.0.smithi142.stdout:7/105: getdents d4 0 2024-04-20T21:58:22.788 INFO:tasks.workunit.client.0.smithi142.stdout:8/109: creat d0/f28 x:0 0 0 2024-04-20T21:58:22.789 INFO:tasks.workunit.client.0.smithi142.stdout:0/172: write d5/d13/d1e/d23/d24/f33 [354019,30283] 0 2024-04-20T21:58:22.791 INFO:tasks.workunit.client.0.smithi142.stdout:0/173: chown l3 476274123 1 2024-04-20T21:58:22.797 INFO:tasks.workunit.client.0.smithi142.stdout:6/103: fsync d1/d5/f12 0 2024-04-20T21:58:22.797 INFO:tasks.workunit.client.0.smithi142.stdout:8/110: mkdir d0/d29 0 2024-04-20T21:58:22.800 INFO:tasks.workunit.client.0.smithi142.stdout:8/111: truncate d0/f6 243645 0 2024-04-20T21:58:22.801 INFO:tasks.workunit.client.0.smithi142.stdout:0/174: creat d5/d1c/d29/d38/f42 x:0 0 0 2024-04-20T21:58:22.803 INFO:tasks.workunit.client.0.smithi142.stdout:9/130: dread d0/fc [0,4194304] 0 2024-04-20T21:58:22.803 INFO:tasks.workunit.client.0.smithi142.stdout:0/175: fsync d5/fa 0 2024-04-20T21:58:22.809 INFO:tasks.workunit.client.0.smithi142.stdout:8/112: write d0/f6 [191920,130395] 0 2024-04-20T21:58:22.810 INFO:tasks.workunit.client.0.smithi142.stdout:9/131: chown d0/l2e 6541 1 2024-04-20T21:58:22.811 INFO:tasks.workunit.client.0.smithi142.stdout:5/80: dread f9 [0,4194304] 0 2024-04-20T21:58:22.815 INFO:tasks.workunit.client.0.smithi142.stdout:4/147: symlink d1/d12/da/l2e 0 2024-04-20T21:58:22.815 INFO:tasks.workunit.client.0.smithi142.stdout:3/114: mknod d6/d15/d1e/c21 0 2024-04-20T21:58:22.816 INFO:tasks.workunit.client.0.smithi142.stdout:7/106: creat d4/d9/d1c/f21 x:0 0 0 2024-04-20T21:58:22.821 INFO:tasks.workunit.client.0.smithi142.stdout:4/148: read d1/db/f21 [2234442,114188] 0 2024-04-20T21:58:22.826 INFO:tasks.workunit.client.0.smithi142.stdout:9/132: read d0/f9 [1469256,70019] 0 2024-04-20T21:58:22.828 INFO:tasks.workunit.client.0.smithi142.stdout:2/255: creat d3/f5a x:0 0 0 2024-04-20T21:58:22.831 INFO:tasks.workunit.client.0.smithi142.stdout:8/113: dwrite d0/f3 [0,4194304] 0 2024-04-20T21:58:22.831 INFO:tasks.workunit.client.0.smithi142.stdout:3/115: creat d6/d15/d1e/f22 x:0 0 0 2024-04-20T21:58:22.834 INFO:tasks.workunit.client.0.smithi142.stdout:3/116: readlink d6/d15/l16 0 2024-04-20T21:58:22.835 INFO:tasks.workunit.client.0.smithi142.stdout:0/176: creat d5/d1c/d3c/f43 x:0 0 0 2024-04-20T21:58:22.840 INFO:tasks.workunit.client.0.smithi142.stdout:0/177: write d5/d1c/f26 [636599,18083] 0 2024-04-20T21:58:22.857 INFO:tasks.workunit.client.0.smithi142.stdout:2/256: rmdir d3/d24 39 2024-04-20T21:58:22.868 INFO:tasks.workunit.client.0.smithi142.stdout:3/117: mknod d6/d15/c23 0 2024-04-20T21:58:22.868 INFO:tasks.workunit.client.0.smithi142.stdout:6/104: link d1/f15 d1/d1d/f22 0 2024-04-20T21:58:22.869 INFO:tasks.workunit.client.0.smithi142.stdout:3/118: fsync d6/ff 0 2024-04-20T21:58:22.872 INFO:tasks.workunit.client.0.smithi142.stdout:5/81: dread f2 [4194304,4194304] 0 2024-04-20T21:58:22.874 INFO:tasks.workunit.client.0.smithi142.stdout:0/178: dwrite d5/d13/d1e/d23/d2c/f2e [0,4194304] 0 2024-04-20T21:58:22.875 INFO:tasks.workunit.client.0.smithi142.stdout:5/82: chown f2 14632960 1 2024-04-20T21:58:22.877 INFO:tasks.workunit.client.0.smithi142.stdout:0/179: write d5/fa [5323054,63237] 0 2024-04-20T21:58:22.878 INFO:tasks.workunit.client.0.smithi142.stdout:9/133: dread d0/f9 [0,4194304] 0 2024-04-20T21:58:22.880 INFO:tasks.workunit.client.0.smithi142.stdout:2/257: symlink d3/l5b 0 2024-04-20T21:58:22.889 INFO:tasks.workunit.client.0.smithi142.stdout:3/119: creat d6/f24 x:0 0 0 2024-04-20T21:58:22.890 INFO:tasks.workunit.client.0.smithi142.stdout:7/107: getdents d4/d9/d1c 0 2024-04-20T21:58:22.892 INFO:tasks.workunit.client.0.smithi142.stdout:5/83: creat dc/d14/f1a x:0 0 0 2024-04-20T21:58:22.893 INFO:tasks.workunit.client.0.smithi142.stdout:8/114: link d0/d1c/l23 d0/d22/l2a 0 2024-04-20T21:58:22.897 INFO:tasks.workunit.client.0.smithi142.stdout:3/120: rename d6/f24 to d6/f25 0 2024-04-20T21:58:22.898 INFO:tasks.workunit.client.0.smithi142.stdout:0/180: dwrite d5/d13/f2f [0,4194304] 0 2024-04-20T21:58:22.899 INFO:tasks.workunit.client.0.smithi142.stdout:7/108: mkdir d4/d9/d11/d22 0 2024-04-20T21:58:22.902 INFO:tasks.workunit.client.0.smithi142.stdout:5/84: write f9 [1882218,28593] 0 2024-04-20T21:58:22.903 INFO:tasks.workunit.client.0.smithi142.stdout:7/109: write d4/d9/d1b/f18 [2426121,46333] 0 2024-04-20T21:58:22.906 INFO:tasks.workunit.client.0.smithi142.stdout:8/115: symlink d0/d1c/l2b 0 2024-04-20T21:58:22.911 INFO:tasks.workunit.client.0.smithi142.stdout:5/85: write f9 [1514542,130293] 0 2024-04-20T21:58:22.911 INFO:tasks.workunit.client.0.smithi142.stdout:0/181: symlink d5/d1c/d29/d32/l44 0 2024-04-20T21:58:22.911 INFO:tasks.workunit.client.0.smithi142.stdout:3/121: unlink d6/f1a 0 2024-04-20T21:58:22.912 INFO:tasks.workunit.client.0.smithi142.stdout:7/110: truncate d4/d9/d1c/f21 123965 0 2024-04-20T21:58:22.912 INFO:tasks.workunit.client.0.smithi142.stdout:8/116: write d0/fc [682825,111548] 0 2024-04-20T21:58:22.914 INFO:tasks.workunit.client.0.smithi142.stdout:5/86: fdatasync dc/d14/f1a 0 2024-04-20T21:58:22.916 INFO:tasks.workunit.client.0.smithi142.stdout:9/134: dwrite d0/f25 [0,4194304] 0 2024-04-20T21:58:22.918 INFO:tasks.workunit.client.0.smithi142.stdout:5/87: truncate dc/f10 233542 0 2024-04-20T21:58:22.920 INFO:tasks.workunit.client.0.smithi142.stdout:6/105: rename d1/f17 to d1/f23 0 2024-04-20T21:58:22.926 INFO:tasks.workunit.client.0.smithi142.stdout:0/182: readlink d5/d13/d1e/l40 0 2024-04-20T21:58:22.927 INFO:tasks.workunit.client.0.smithi142.stdout:8/117: mknod d0/d22/c2c 0 2024-04-20T21:58:22.929 INFO:tasks.workunit.client.0.smithi142.stdout:8/118: dread - d0/d1c/f1e zero size 2024-04-20T21:58:22.933 INFO:tasks.workunit.client.0.smithi142.stdout:7/111: rename d4/d9/d1b/f18 to d4/d9/d1c/f23 0 2024-04-20T21:58:22.934 INFO:tasks.workunit.client.0.smithi142.stdout:7/112: chown d4/d9/cf 16533724 1 2024-04-20T21:58:22.934 INFO:tasks.workunit.client.0.smithi142.stdout:9/135: rmdir d0/d2a 39 2024-04-20T21:58:22.937 INFO:tasks.workunit.client.0.smithi142.stdout:5/88: creat dc/f1b x:0 0 0 2024-04-20T21:58:22.938 INFO:tasks.workunit.client.0.smithi142.stdout:7/113: write d4/d9/d1c/f21 [214262,121076] 0 2024-04-20T21:58:22.941 INFO:tasks.workunit.client.0.smithi142.stdout:3/122: rename d6/d15/l1c to d6/d15/l26 0 2024-04-20T21:58:22.950 INFO:tasks.workunit.client.0.smithi142.stdout:3/123: mknod d6/c27 0 2024-04-20T21:58:22.954 INFO:tasks.workunit.client.0.smithi142.stdout:3/124: write d6/f8 [629668,42704] 0 2024-04-20T21:58:22.958 INFO:tasks.workunit.client.0.smithi142.stdout:9/136: dwrite d0/f9 [0,4194304] 0 2024-04-20T21:58:22.962 INFO:tasks.workunit.client.0.smithi142.stdout:3/125: mknod d6/d15/d1e/c28 0 2024-04-20T21:58:22.967 INFO:tasks.workunit.client.0.smithi142.stdout:7/114: dwrite d4/d9/d1c/f23 [0,4194304] 0 2024-04-20T21:58:22.968 INFO:tasks.workunit.client.0.smithi142.stdout:6/106: symlink d1/d5/l24 0 2024-04-20T21:58:22.972 INFO:tasks.workunit.client.0.smithi142.stdout:5/89: rmdir dc 39 2024-04-20T21:58:22.973 INFO:tasks.workunit.client.0.smithi142.stdout:6/107: write d1/d5/f12 [3742906,95017] 0 2024-04-20T21:58:22.973 INFO:tasks.workunit.client.0.smithi142.stdout:7/115: write d4/d9/d1b/f1f [565583,37427] 0 2024-04-20T21:58:22.975 INFO:tasks.workunit.client.0.smithi142.stdout:9/137: rmdir d0/d2a 39 2024-04-20T21:58:22.977 INFO:tasks.workunit.client.0.smithi142.stdout:6/108: write d1/d5/f12 [446680,102859] 0 2024-04-20T21:58:22.985 INFO:tasks.workunit.client.0.smithi142.stdout:7/116: chown d4/d9/l1e 449744635 1 2024-04-20T21:58:22.988 INFO:tasks.workunit.client.0.smithi142.stdout:7/117: write d4/d9/d1c/f21 [661459,19637] 0 2024-04-20T21:58:22.991 INFO:tasks.workunit.client.0.smithi142.stdout:3/126: link d6/c27 d6/c29 0 2024-04-20T21:58:22.994 INFO:tasks.workunit.client.0.smithi142.stdout:3/127: chown d6/fc 21222 1 2024-04-20T21:58:22.996 INFO:tasks.workunit.client.0.smithi142.stdout:6/109: dread d1/d1d/f22 [0,4194304] 0 2024-04-20T21:58:22.997 INFO:tasks.workunit.client.0.smithi142.stdout:9/138: symlink d0/d2a/l2f 0 2024-04-20T21:58:22.999 INFO:tasks.workunit.client.0.smithi142.stdout:7/118: mkdir d4/d9/d11/d24 0 2024-04-20T21:58:23.005 INFO:tasks.workunit.client.0.smithi142.stdout:6/110: mknod d1/d1d/c25 0 2024-04-20T21:58:23.008 INFO:tasks.workunit.client.0.smithi142.stdout:9/139: truncate d0/f14 2245805 0 2024-04-20T21:58:23.011 INFO:tasks.workunit.client.0.smithi142.stdout:6/111: creat d1/d5/f26 x:0 0 0 2024-04-20T21:58:23.013 INFO:tasks.workunit.client.0.smithi142.stdout:9/140: creat d0/d2a/f30 x:0 0 0 2024-04-20T21:58:23.015 INFO:tasks.workunit.client.0.smithi142.stdout:7/119: mkdir d4/d9/d11/d22/d25 0 2024-04-20T21:58:23.017 INFO:tasks.workunit.client.0.smithi142.stdout:6/112: mkdir d1/d5/d27 0 2024-04-20T21:58:23.020 INFO:tasks.workunit.client.0.smithi142.stdout:7/120: read d4/d9/d1c/f21 [292020,55537] 0 2024-04-20T21:58:23.022 INFO:tasks.workunit.client.0.smithi142.stdout:7/121: write d4/d9/d1c/f23 [3711656,79583] 0 2024-04-20T21:58:23.028 INFO:tasks.workunit.client.0.smithi142.stdout:7/122: write d4/d9/d1c/f23 [3480168,114245] 0 2024-04-20T21:58:23.029 INFO:tasks.workunit.client.0.smithi142.stdout:5/90: dwrite dc/f12 [0,4194304] 0 2024-04-20T21:58:23.031 INFO:tasks.workunit.client.0.smithi142.stdout:6/113: write d1/d11/fa [3228568,15543] 0 2024-04-20T21:58:23.033 INFO:tasks.workunit.client.0.smithi142.stdout:6/114: dread - d1/d5/f26 zero size 2024-04-20T21:58:23.037 INFO:tasks.workunit.client.0.smithi142.stdout:1/161: sync 2024-04-20T21:58:23.037 INFO:tasks.workunit.client.0.smithi142.stdout:6/115: truncate d1/d5/f12 5182825 0 2024-04-20T21:58:23.037 INFO:tasks.workunit.client.0.smithi142.stdout:5/91: symlink dc/d14/l1c 0 2024-04-20T21:58:23.039 INFO:tasks.workunit.client.0.smithi142.stdout:7/123: symlink d4/d9/d11/d22/l26 0 2024-04-20T21:58:23.043 INFO:tasks.workunit.client.0.smithi142.stdout:1/162: mknod d2/dd/d17/d1b/c37 0 2024-04-20T21:58:23.051 INFO:tasks.workunit.client.0.smithi142.stdout:1/163: unlink d2/dd/d17/d1b/f30 0 2024-04-20T21:58:23.056 INFO:tasks.workunit.client.0.smithi142.stdout:1/164: write d2/dd/d17/d1b/d22/f2f [651651,85236] 0 2024-04-20T21:58:23.062 INFO:tasks.workunit.client.0.smithi142.stdout:1/165: rename d2/dd/d17/d1b to d2/dd/d17/d1b/d38 22 2024-04-20T21:58:23.063 INFO:tasks.workunit.client.0.smithi142.stdout:6/116: dwrite d1/d5/f26 [0,4194304] 0 2024-04-20T21:58:23.070 INFO:tasks.workunit.client.0.smithi142.stdout:9/141: dread d0/f1e [0,4194304] 0 2024-04-20T21:58:23.091 INFO:tasks.workunit.client.0.smithi142.stdout:1/166: dread d2/f6 [0,4194304] 0 2024-04-20T21:58:23.093 INFO:tasks.workunit.client.0.smithi142.stdout:9/142: creat d0/f31 x:0 0 0 2024-04-20T21:58:23.093 INFO:tasks.workunit.client.0.smithi142.stdout:5/92: write f7 [1066217,62745] 0 2024-04-20T21:58:23.094 INFO:tasks.workunit.client.0.smithi142.stdout:1/167: chown d2/dd/d17/f1a 91583 1 2024-04-20T21:58:23.097 INFO:tasks.workunit.client.0.smithi142.stdout:1/168: chown d2/dd/d17/d1b/d22/d20/f2d 24025 1 2024-04-20T21:58:23.098 INFO:tasks.workunit.client.0.smithi142.stdout:1/169: chown d2/dd/c27 235847 1 2024-04-20T21:58:23.099 INFO:tasks.workunit.client.0.smithi142.stdout:1/170: stat d2/dd/d1c 0 2024-04-20T21:58:23.099 INFO:tasks.workunit.client.0.smithi142.stdout:7/124: truncate d4/d9/d1c/f23 1911160 0 2024-04-20T21:58:23.101 INFO:tasks.workunit.client.0.smithi142.stdout:5/93: fsync f4 0 2024-04-20T21:58:23.103 INFO:tasks.workunit.client.0.smithi142.stdout:1/171: read d2/dd/d17/d1b/d22/f1e [193675,111415] 0 2024-04-20T21:58:23.106 INFO:tasks.workunit.client.0.smithi142.stdout:5/94: dread f2 [8388608,4194304] 0 2024-04-20T21:58:23.106 INFO:tasks.workunit.client.0.smithi142.stdout:1/172: dread - d2/dd/d17/d1b/f1d zero size 2024-04-20T21:58:23.109 INFO:tasks.workunit.client.0.smithi142.stdout:5/95: write f3 [5792705,6553] 0 2024-04-20T21:58:23.111 INFO:tasks.workunit.client.0.smithi142.stdout:5/96: chown dc/d14/f1a 0 1 2024-04-20T21:58:23.118 INFO:tasks.workunit.client.0.smithi142.stdout:1/173: creat d2/dd/d17/d1b/d22/d13/f39 x:0 0 0 2024-04-20T21:58:23.119 INFO:tasks.workunit.client.0.smithi142.stdout:9/143: fsync d0/f31 0 2024-04-20T21:58:23.119 INFO:tasks.workunit.client.0.smithi142.stdout:6/117: dwrite d1/f15 [0,4194304] 0 2024-04-20T21:58:23.121 INFO:tasks.workunit.client.0.smithi142.stdout:1/174: truncate d2/dd/d17/f24 355725 0 2024-04-20T21:58:23.123 INFO:tasks.workunit.client.0.smithi142.stdout:1/175: write d2/dd/fe [2070352,27755] 0 2024-04-20T21:58:23.125 INFO:tasks.workunit.client.0.smithi142.stdout:9/144: chown d0/c13 88 1 2024-04-20T21:58:23.135 INFO:tasks.workunit.client.0.smithi142.stdout:9/145: mknod d0/d2a/c32 0 2024-04-20T21:58:23.136 INFO:tasks.workunit.client.0.smithi142.stdout:7/125: truncate d4/d9/d1b/f1f 389808 0 2024-04-20T21:58:23.138 INFO:tasks.workunit.client.0.smithi142.stdout:9/146: mknod d0/d2a/c33 0 2024-04-20T21:58:23.140 INFO:tasks.workunit.client.0.smithi142.stdout:7/126: creat d4/f27 x:0 0 0 2024-04-20T21:58:23.142 INFO:tasks.workunit.client.0.smithi142.stdout:6/118: dwrite d1/d5/f26 [0,4194304] 0 2024-04-20T21:58:23.147 INFO:tasks.workunit.client.0.smithi142.stdout:7/127: mknod d4/d9/d1b/c28 0 2024-04-20T21:58:23.148 INFO:tasks.workunit.client.0.smithi142.stdout:1/176: dwrite d2/dd/d17/d1b/d22/f2f [0,4194304] 0 2024-04-20T21:58:23.151 INFO:tasks.workunit.client.0.smithi142.stdout:6/119: creat d1/d1d/f28 x:0 0 0 2024-04-20T21:58:23.151 INFO:tasks.workunit.client.0.smithi142.stdout:5/97: dread dc/ff [0,4194304] 0 2024-04-20T21:58:23.152 INFO:tasks.workunit.client.0.smithi142.stdout:7/128: mknod d4/c29 0 2024-04-20T21:58:23.155 INFO:tasks.workunit.client.0.smithi142.stdout:5/98: rmdir dc 39 2024-04-20T21:58:23.158 INFO:tasks.workunit.client.0.smithi142.stdout:7/129: write f1 [4064885,84993] 0 2024-04-20T21:58:23.162 INFO:tasks.workunit.client.0.smithi142.stdout:1/177: getdents d2/dd 0 2024-04-20T21:58:23.162 INFO:tasks.workunit.client.0.smithi142.stdout:5/99: chown dc/f19 637335 1 2024-04-20T21:58:23.164 INFO:tasks.workunit.client.0.smithi142.stdout:5/100: truncate dc/f16 505194 0 2024-04-20T21:58:23.166 INFO:tasks.workunit.client.0.smithi142.stdout:1/178: mknod d2/dd/d17/d1b/d22/d13/c3a 0 2024-04-20T21:58:23.168 INFO:tasks.workunit.client.0.smithi142.stdout:6/120: dread d1/d5/f26 [0,4194304] 0 2024-04-20T21:58:23.171 INFO:tasks.workunit.client.0.smithi142.stdout:1/179: fdatasync d2/dd/d17/f1a 0 2024-04-20T21:58:23.172 INFO:tasks.workunit.client.0.smithi142.stdout:5/101: rename dc/ff to dc/f1d 0 2024-04-20T21:58:23.174 INFO:tasks.workunit.client.0.smithi142.stdout:6/121: read d1/d5/f26 [3123013,27646] 0 2024-04-20T21:58:23.174 INFO:tasks.workunit.client.0.smithi142.stdout:5/102: fsync f7 0 2024-04-20T21:58:23.176 INFO:tasks.workunit.client.0.smithi142.stdout:9/147: truncate d0/fc 7112 0 2024-04-20T21:58:23.177 INFO:tasks.workunit.client.0.smithi142.stdout:6/122: write d1/d5/f12 [686471,67928] 0 2024-04-20T21:58:23.181 INFO:tasks.workunit.client.0.smithi142.stdout:7/130: read d4/d9/d1c/f23 [1555462,30824] 0 2024-04-20T21:58:23.181 INFO:tasks.workunit.client.0.smithi142.stdout:5/103: creat dc/d14/f1e x:0 0 0 2024-04-20T21:58:23.185 INFO:tasks.workunit.client.0.smithi142.stdout:6/123: mknod d1/d5/d1a/c29 0 2024-04-20T21:58:23.194 INFO:tasks.workunit.client.0.smithi142.stdout:5/104: link dc/f12 dc/d14/f1f 0 2024-04-20T21:58:23.194 INFO:tasks.workunit.client.0.smithi142.stdout:9/148: dwrite d0/f24 [0,4194304] 0 2024-04-20T21:58:23.197 INFO:tasks.workunit.client.0.smithi142.stdout:7/131: rmdir d4/d9/d11/d24 0 2024-04-20T21:58:23.197 INFO:tasks.workunit.client.0.smithi142.stdout:5/105: write f2 [8192105,38678] 0 2024-04-20T21:58:23.204 INFO:tasks.workunit.client.0.smithi142.stdout:5/106: creat dc/d14/f20 x:0 0 0 2024-04-20T21:58:23.205 INFO:tasks.workunit.client.0.smithi142.stdout:9/149: fsync d0/ff 0 2024-04-20T21:58:23.207 INFO:tasks.workunit.client.0.smithi142.stdout:5/107: unlink dc/f12 0 2024-04-20T21:58:23.210 INFO:tasks.workunit.client.0.smithi142.stdout:9/150: fsync d0/f23 0 2024-04-20T21:58:23.210 INFO:tasks.workunit.client.0.smithi142.stdout:5/108: dread dc/f16 [0,4194304] 0 2024-04-20T21:58:23.215 INFO:tasks.workunit.client.0.smithi142.stdout:9/151: truncate d0/d2a/f30 892244 0 2024-04-20T21:58:23.215 INFO:tasks.workunit.client.0.smithi142.stdout:5/109: truncate dc/d14/f20 119483 0 2024-04-20T21:58:23.215 INFO:tasks.workunit.client.0.smithi142.stdout:9/152: truncate d0/f29 143962 0 2024-04-20T21:58:23.216 INFO:tasks.workunit.client.0.smithi142.stdout:9/153: write d0/f8 [3030554,17620] 0 2024-04-20T21:58:23.220 INFO:tasks.workunit.client.0.smithi142.stdout:6/124: dread d1/d5/fb [0,4194304] 0 2024-04-20T21:58:23.221 INFO:tasks.workunit.client.0.smithi142.stdout:7/132: fsync d4/d9/d1b/f1f 0 2024-04-20T21:58:23.230 INFO:tasks.workunit.client.0.smithi142.stdout:5/110: rmdir dc 39 2024-04-20T21:58:23.231 INFO:tasks.workunit.client.0.smithi142.stdout:7/133: dread d4/d9/d1c/f21 [0,4194304] 0 2024-04-20T21:58:23.232 INFO:tasks.workunit.client.0.smithi142.stdout:7/134: fdatasync f1 0 2024-04-20T21:58:23.238 INFO:tasks.workunit.client.0.smithi142.stdout:7/135: dread d4/d9/d1b/f1f [0,4194304] 0 2024-04-20T21:58:23.239 INFO:tasks.workunit.client.0.smithi142.stdout:9/154: dwrite d0/f21 [0,4194304] 0 2024-04-20T21:58:23.239 INFO:tasks.workunit.client.0.smithi142.stdout:6/125: truncate d1/d11/fa 3571469 0 2024-04-20T21:58:23.244 INFO:tasks.workunit.client.0.smithi142.stdout:6/126: fsync d1/d5/f12 0 2024-04-20T21:58:23.245 INFO:tasks.workunit.client.0.smithi142.stdout:9/155: creat d0/d2a/f34 x:0 0 0 2024-04-20T21:58:23.245 INFO:tasks.workunit.client.0.smithi142.stdout:5/111: chown dc/d14/f1f 1462600 1 2024-04-20T21:58:23.248 INFO:tasks.workunit.client.0.smithi142.stdout:7/136: rmdir d4/d9/d11/d22/d25 0 2024-04-20T21:58:23.249 INFO:tasks.workunit.client.0.smithi142.stdout:6/127: creat d1/d5/d27/f2a x:0 0 0 2024-04-20T21:58:23.249 INFO:tasks.workunit.client.0.smithi142.stdout:5/112: mkdir dc/d14/d21 0 2024-04-20T21:58:23.291 INFO:tasks.workunit.client.0.smithi142.stdout:6/128: rename d1/d5/d27 to d1/d1d/d2b 0 2024-04-20T21:58:23.291 INFO:tasks.workunit.client.0.smithi142.stdout:9/156: link d0/d2a/l2f d0/l35 0 2024-04-20T21:58:23.292 INFO:tasks.workunit.client.0.smithi142.stdout:5/113: getdents dc/d14/d21 0 2024-04-20T21:58:23.292 INFO:tasks.workunit.client.0.smithi142.stdout:6/129: readlink d1/d5/l10 0 2024-04-20T21:58:23.294 INFO:tasks.workunit.client.0.smithi142.stdout:7/137: getdents d4 0 2024-04-20T21:58:23.298 INFO:tasks.workunit.client.0.smithi142.stdout:6/130: write d1/d1b/f1e [560358,112508] 0 2024-04-20T21:58:23.299 INFO:tasks.workunit.client.0.smithi142.stdout:7/138: creat d4/d9/d11/d22/f2a x:0 0 0 2024-04-20T21:58:23.300 INFO:tasks.workunit.client.0.smithi142.stdout:9/157: mkdir d0/d36 0 2024-04-20T21:58:23.301 INFO:tasks.workunit.client.0.smithi142.stdout:9/158: dread - d0/d2a/f2d zero size 2024-04-20T21:58:23.303 INFO:tasks.workunit.client.0.smithi142.stdout:6/131: symlink d1/d1d/d2b/l2c 0 2024-04-20T21:58:23.303 INFO:tasks.workunit.client.0.smithi142.stdout:5/114: creat dc/d14/f22 x:0 0 0 2024-04-20T21:58:23.306 INFO:tasks.workunit.client.0.smithi142.stdout:7/139: rename d4/d9/d11/d22/f2a to d4/d9/d11/d22/f2b 0 2024-04-20T21:58:23.306 INFO:tasks.workunit.client.0.smithi142.stdout:9/159: creat d0/d2a/f37 x:0 0 0 2024-04-20T21:58:23.320 INFO:tasks.workunit.client.0.smithi142.stdout:6/132: dwrite d1/d5/f14 [0,4194304] 0 2024-04-20T21:58:23.320 INFO:tasks.workunit.client.0.smithi142.stdout:9/160: dread d0/f21 [0,4194304] 0 2024-04-20T21:58:23.323 INFO:tasks.workunit.client.0.smithi142.stdout:6/133: fdatasync d1/d11/ff 0 2024-04-20T21:58:23.325 INFO:tasks.workunit.client.0.smithi142.stdout:9/161: mknod d0/d2a/c38 0 2024-04-20T21:58:23.326 INFO:tasks.workunit.client.0.smithi142.stdout:7/140: dwrite d4/d9/d1c/f23 [0,4194304] 0 2024-04-20T21:58:23.328 INFO:tasks.workunit.client.0.smithi142.stdout:9/162: unlink d0/l2c 0 2024-04-20T21:58:23.329 INFO:tasks.workunit.client.0.smithi142.stdout:6/134: creat d1/d1b/f2d x:0 0 0 2024-04-20T21:58:23.335 INFO:tasks.workunit.client.0.smithi142.stdout:6/135: creat d1/d5/d1a/f2e x:0 0 0 2024-04-20T21:58:23.336 INFO:tasks.workunit.client.0.smithi142.stdout:9/163: dread d0/d2a/f30 [0,4194304] 0 2024-04-20T21:58:23.337 INFO:tasks.workunit.client.0.smithi142.stdout:7/141: write d4/d9/d1c/f23 [4694042,116110] 0 2024-04-20T21:58:23.342 INFO:tasks.workunit.client.0.smithi142.stdout:7/142: truncate d4/d9/d11/d22/f2b 1032791 0 2024-04-20T21:58:23.342 INFO:tasks.workunit.client.0.smithi142.stdout:9/164: mkdir d0/d2a/d39 0 2024-04-20T21:58:23.344 INFO:tasks.workunit.client.0.smithi142.stdout:6/136: mkdir d1/d2f 0 2024-04-20T21:58:23.346 INFO:tasks.workunit.client.0.smithi142.stdout:9/165: write d0/f11 [689328,86942] 0 2024-04-20T21:58:23.347 INFO:tasks.workunit.client.0.smithi142.stdout:7/143: creat d4/d9/d1b/f2c x:0 0 0 2024-04-20T21:58:23.349 INFO:tasks.workunit.client.0.smithi142.stdout:7/144: write d4/d9/d1b/f2c [682820,43476] 0 2024-04-20T21:58:23.352 INFO:tasks.workunit.client.0.smithi142.stdout:9/166: mknod d0/c3a 0 2024-04-20T21:58:23.353 INFO:tasks.workunit.client.0.smithi142.stdout:7/145: truncate d4/d9/d1b/f2c 1465390 0 2024-04-20T21:58:23.354 INFO:tasks.workunit.client.0.smithi142.stdout:6/137: rename d1/d1d/c25 to d1/d5/d1a/c30 0 2024-04-20T21:58:23.354 INFO:tasks.workunit.client.0.smithi142.stdout:7/146: fsync d4/f27 0 2024-04-20T21:58:23.356 INFO:tasks.workunit.client.0.smithi142.stdout:9/167: readlink d0/l1a 0 2024-04-20T21:58:23.359 INFO:tasks.workunit.client.0.smithi142.stdout:7/147: creat d4/f2d x:0 0 0 2024-04-20T21:58:23.362 INFO:tasks.workunit.client.0.smithi142.stdout:9/168: mknod d0/d2a/d39/c3b 0 2024-04-20T21:58:23.362 INFO:tasks.workunit.client.0.smithi142.stdout:7/148: mknod d4/d9/d11/c2e 0 2024-04-20T21:58:23.365 INFO:tasks.workunit.client.0.smithi142.stdout:9/169: mkdir d0/d3c 0 2024-04-20T21:58:23.366 INFO:tasks.workunit.client.0.smithi142.stdout:6/138: getdents d1/d1b 0 2024-04-20T21:58:23.366 INFO:tasks.workunit.client.0.smithi142.stdout:7/149: creat d4/d9/d1b/f2f x:0 0 0 2024-04-20T21:58:23.368 INFO:tasks.workunit.client.0.smithi142.stdout:7/150: chown d4/f27 1417078 1 2024-04-20T21:58:23.369 INFO:tasks.workunit.client.0.smithi142.stdout:6/139: mknod d1/d1b/c31 0 2024-04-20T21:58:23.372 INFO:tasks.workunit.client.0.smithi142.stdout:7/151: creat d4/d9/f30 x:0 0 0 2024-04-20T21:58:23.373 INFO:tasks.workunit.client.0.smithi142.stdout:6/140: symlink d1/d1d/d2b/l32 0 2024-04-20T21:58:23.377 INFO:tasks.workunit.client.0.smithi142.stdout:7/152: dread d4/d9/d1c/f21 [0,4194304] 0 2024-04-20T21:58:23.378 INFO:tasks.workunit.client.0.smithi142.stdout:6/141: getdents d1/d5/d1a 0 2024-04-20T21:58:23.382 INFO:tasks.workunit.client.0.smithi142.stdout:7/153: unlink d4/d9/d1b/f2f 0 2024-04-20T21:58:23.383 INFO:tasks.workunit.client.0.smithi142.stdout:9/170: dwrite d0/d2a/f37 [0,4194304] 0 2024-04-20T21:58:23.384 INFO:tasks.workunit.client.0.smithi142.stdout:7/154: chown f1 13974358 1 2024-04-20T21:58:23.385 INFO:tasks.workunit.client.0.smithi142.stdout:6/142: symlink d1/d11/l33 0 2024-04-20T21:58:23.387 INFO:tasks.workunit.client.0.smithi142.stdout:9/171: chown d0/l12 102780 1 2024-04-20T21:58:23.389 INFO:tasks.workunit.client.0.smithi142.stdout:7/155: symlink d4/d9/d11/d22/l31 0 2024-04-20T21:58:23.394 INFO:tasks.workunit.client.0.smithi142.stdout:7/156: mkdir d4/d9/d1c/d32 0 2024-04-20T21:58:23.396 INFO:tasks.workunit.client.0.smithi142.stdout:7/157: read d4/d9/d1c/f21 [353247,62512] 0 2024-04-20T21:58:23.398 INFO:tasks.workunit.client.0.smithi142.stdout:6/143: dread d1/d1d/f22 [0,4194304] 0 2024-04-20T21:58:23.399 INFO:tasks.workunit.client.0.smithi142.stdout:7/158: chown d4/d9/ld 8502 1 2024-04-20T21:58:23.402 INFO:tasks.workunit.client.0.smithi142.stdout:6/144: write d1/d1d/f28 [643863,114457] 0 2024-04-20T21:58:23.407 INFO:tasks.workunit.client.0.smithi142.stdout:9/172: dwrite d0/f29 [0,4194304] 0 2024-04-20T21:58:23.425 INFO:tasks.workunit.client.0.smithi142.stdout:6/145: dwrite d1/d5/f12 [4194304,4194304] 0 2024-04-20T21:58:23.428 INFO:tasks.workunit.client.0.smithi142.stdout:9/173: dwrite d0/f8 [0,4194304] 0 2024-04-20T21:58:23.429 INFO:tasks.workunit.client.0.smithi142.stdout:6/146: mkdir d1/d1d/d2b/d34 0 2024-04-20T21:58:23.431 INFO:tasks.workunit.client.0.smithi142.stdout:6/147: mkdir d1/d2f/d35 0 2024-04-20T21:58:23.432 INFO:tasks.workunit.client.0.smithi142.stdout:9/174: creat d0/d36/f3d x:0 0 0 2024-04-20T21:58:23.433 INFO:tasks.workunit.client.0.smithi142.stdout:9/175: stat d0/d36 0 2024-04-20T21:58:23.435 INFO:tasks.workunit.client.0.smithi142.stdout:6/148: creat d1/d2f/d35/f36 x:0 0 0 2024-04-20T21:58:23.438 INFO:tasks.workunit.client.0.smithi142.stdout:6/149: rmdir d1/d2f 39 2024-04-20T21:58:23.438 INFO:tasks.workunit.client.0.smithi142.stdout:9/176: symlink d0/d36/l3e 0 2024-04-20T21:58:23.439 INFO:tasks.workunit.client.0.smithi142.stdout:9/177: stat d0/d2a/f34 0 2024-04-20T21:58:23.441 INFO:tasks.workunit.client.0.smithi142.stdout:6/150: creat d1/d5/f37 x:0 0 0 2024-04-20T21:58:23.442 INFO:tasks.workunit.client.0.smithi142.stdout:6/151: chown d1/d5 117406329 1 2024-04-20T21:58:23.444 INFO:tasks.workunit.client.0.smithi142.stdout:6/152: creat d1/d5/f38 x:0 0 0 2024-04-20T21:58:23.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:23 smithi142 ceph-mon[15828]: pgmap v33: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 75 KiB/s rd, 13 MiB/s wr, 180 op/s 2024-04-20T21:58:23.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:23 smithi142 ceph-mon[15828]: Standby manager daemon smithi142.zzmcfz restarted 2024-04-20T21:58:23.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:23 smithi142 ceph-mon[15828]: Standby manager daemon smithi142.zzmcfz started 2024-04-20T21:58:23.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:23 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.zzmcfz/crt"}]: dispatch 2024-04-20T21:58:23.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:23 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T21:58:23.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:23 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.zzmcfz/key"}]: dispatch 2024-04-20T21:58:23.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:23 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T21:58:23.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:23 smithi164 ceph-mon[23506]: pgmap v33: 65 pgs: 65 active+clean; 275 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 75 KiB/s rd, 13 MiB/s wr, 180 op/s 2024-04-20T21:58:23.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:23 smithi164 ceph-mon[23506]: Standby manager daemon smithi142.zzmcfz restarted 2024-04-20T21:58:23.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:23 smithi164 ceph-mon[23506]: Standby manager daemon smithi142.zzmcfz started 2024-04-20T21:58:23.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:23 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.zzmcfz/crt"}]: dispatch 2024-04-20T21:58:23.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:23 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T21:58:23.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:23 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi142.zzmcfz/key"}]: dispatch 2024-04-20T21:58:23.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:23 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T21:58:23.447 INFO:tasks.workunit.client.0.smithi142.stdout:6/153: mkdir d1/d5/d1a/d39 0 2024-04-20T21:58:23.452 INFO:tasks.workunit.client.0.smithi142.stdout:6/154: unlink d1/f4 0 2024-04-20T21:58:23.456 INFO:tasks.workunit.client.0.smithi142.stdout:6/155: mkdir d1/d5/d3a 0 2024-04-20T21:58:23.459 INFO:tasks.workunit.client.0.smithi142.stdout:6/156: unlink d1/d1b/f2d 0 2024-04-20T21:58:23.473 INFO:tasks.workunit.client.0.smithi142.stdout:6/157: dwrite d1/d5/f38 [0,4194304] 0 2024-04-20T21:58:23.476 INFO:tasks.workunit.client.0.smithi142.stdout:9/178: dread d0/f19 [0,4194304] 0 2024-04-20T21:58:23.483 INFO:tasks.workunit.client.0.smithi142.stdout:6/158: fsync d1/d5/f37 0 2024-04-20T21:58:23.488 INFO:tasks.workunit.client.0.smithi142.stdout:6/159: creat d1/d5/d1a/d39/f3b x:0 0 0 2024-04-20T21:58:23.492 INFO:tasks.workunit.client.0.smithi142.stdout:6/160: write d1/d5/f38 [728924,114349] 0 2024-04-20T21:58:23.494 INFO:tasks.workunit.client.0.smithi142.stdout:9/179: dwrite d0/f31 [0,4194304] 0 2024-04-20T21:58:23.498 INFO:tasks.workunit.client.0.smithi142.stdout:6/161: read d1/d11/fa [829518,73156] 0 2024-04-20T21:58:23.502 INFO:tasks.workunit.client.0.smithi142.stdout:6/162: creat d1/d5/f3c x:0 0 0 2024-04-20T21:58:23.503 INFO:tasks.workunit.client.0.smithi142.stdout:6/163: readlink d1/d11/l33 0 2024-04-20T21:58:23.505 INFO:tasks.workunit.client.0.smithi142.stdout:6/164: fdatasync d1/d1d/d2b/f2a 0 2024-04-20T21:58:23.510 INFO:tasks.workunit.client.0.smithi142.stdout:9/180: dread d0/f19 [0,4194304] 0 2024-04-20T21:58:23.511 INFO:tasks.workunit.client.0.smithi142.stdout:6/165: link d1/d5/f38 d1/d5/f3d 0 2024-04-20T21:58:23.511 INFO:tasks.workunit.client.0.smithi142.stdout:6/166: chown d1/d5 2440764 1 2024-04-20T21:58:23.517 INFO:tasks.workunit.client.0.smithi142.stdout:6/167: dread d1/d1d/f28 [0,4194304] 0 2024-04-20T21:58:23.520 INFO:tasks.workunit.client.0.smithi142.stdout:9/181: write d0/d2a/f30 [1900285,31758] 0 2024-04-20T21:58:23.522 INFO:tasks.workunit.client.0.smithi142.stdout:9/182: write d0/f19 [3774814,97773] 0 2024-04-20T21:58:23.530 INFO:tasks.workunit.client.0.smithi142.stdout:6/168: dread d1/d1d/f22 [0,4194304] 0 2024-04-20T21:58:23.531 INFO:tasks.workunit.client.0.smithi142.stdout:6/169: dread - d1/d11/ff zero size 2024-04-20T21:58:23.538 INFO:tasks.workunit.client.0.smithi142.stdout:6/170: getdents d1/d2f/d35 0 2024-04-20T21:58:23.538 INFO:tasks.workunit.client.0.smithi142.stdout:9/183: dwrite d0/d36/f3d [0,4194304] 0 2024-04-20T21:58:23.545 INFO:tasks.workunit.client.0.smithi142.stdout:9/184: symlink d0/d3c/l3f 0 2024-04-20T21:58:23.547 INFO:tasks.workunit.client.0.smithi142.stdout:9/185: creat d0/d2a/f40 x:0 0 0 2024-04-20T21:58:23.548 INFO:tasks.workunit.client.0.smithi142.stdout:9/186: chown d0/l2e 820 1 2024-04-20T21:58:23.550 INFO:tasks.workunit.client.0.smithi142.stdout:6/171: dread d1/d5/f12 [4194304,4194304] 0 2024-04-20T21:58:23.552 INFO:tasks.workunit.client.0.smithi142.stdout:9/187: getdents d0 0 2024-04-20T21:58:23.561 INFO:tasks.workunit.client.0.smithi142.stdout:6/172: mkdir d1/d5/d1a/d3e 0 2024-04-20T21:58:23.562 INFO:tasks.workunit.client.0.smithi142.stdout:9/188: rename d0/f19 to d0/d36/f41 0 2024-04-20T21:58:23.562 INFO:tasks.workunit.client.0.smithi142.stdout:4/149: sync 2024-04-20T21:58:23.564 INFO:tasks.workunit.client.0.smithi142.stdout:6/173: stat d1/d1d/d2b/l2c 0 2024-04-20T21:58:23.567 INFO:tasks.workunit.client.0.smithi142.stdout:4/150: mkdir d1/db/d17/d2f 0 2024-04-20T21:58:23.583 INFO:tasks.workunit.client.0.smithi142.stdout:7/159: dread d4/d9/d1b/f2c [0,4194304] 0 2024-04-20T21:58:23.590 INFO:tasks.workunit.client.0.smithi142.stdout:4/151: dwrite d1/d6/f1f [4194304,4194304] 0 2024-04-20T21:58:23.594 INFO:tasks.workunit.client.0.smithi142.stdout:4/152: write d1/d6/f1a [647716,67988] 0 2024-04-20T21:58:23.595 INFO:tasks.workunit.client.0.smithi142.stdout:9/189: dwrite d0/d2a/f2d [0,4194304] 0 2024-04-20T21:58:23.598 INFO:tasks.workunit.client.0.smithi142.stdout:4/153: chown d1/d12/da/d1c/f26 1975 1 2024-04-20T21:58:23.602 INFO:tasks.workunit.client.0.smithi142.stdout:4/154: mkdir d1/d6/d30 0 2024-04-20T21:58:23.607 INFO:tasks.workunit.client.0.smithi142.stdout:4/155: chown d1/d12/da/d1c/f25 5 1 2024-04-20T21:58:23.607 INFO:tasks.workunit.client.0.smithi142.stdout:7/160: dwrite d4/d9/d1b/f2c [0,4194304] 0 2024-04-20T21:58:23.608 INFO:tasks.workunit.client.0.smithi142.stdout:9/190: rename d0/d36/f3d to d0/d2a/f42 0 2024-04-20T21:58:23.610 INFO:tasks.workunit.client.0.smithi142.stdout:7/161: dread - d4/d9/f30 zero size 2024-04-20T21:58:23.613 INFO:tasks.workunit.client.0.smithi142.stdout:9/191: rmdir d0/d3c 39 2024-04-20T21:58:23.619 INFO:tasks.workunit.client.0.smithi142.stdout:7/162: creat d4/d9/d1c/f33 x:0 0 0 2024-04-20T21:58:23.621 INFO:tasks.workunit.client.0.smithi142.stdout:7/163: chown d4/d9/cf 436097 1 2024-04-20T21:58:23.626 INFO:tasks.workunit.client.0.smithi142.stdout:7/164: creat d4/d9/d1b/f34 x:0 0 0 2024-04-20T21:58:23.629 INFO:tasks.workunit.client.0.smithi142.stdout:7/165: chown d4/d9/d11/d22/l31 6 1 2024-04-20T21:58:23.630 INFO:tasks.workunit.client.0.smithi142.stdout:4/156: dwrite d1/db/d17/f28 [0,4194304] 0 2024-04-20T21:58:23.631 INFO:tasks.workunit.client.0.smithi142.stdout:7/166: read - d4/d9/f30 zero size 2024-04-20T21:58:23.634 INFO:tasks.workunit.client.0.smithi142.stdout:7/167: chown d4/c19 311 1 2024-04-20T21:58:23.639 INFO:tasks.workunit.client.0.smithi142.stdout:9/192: dread d0/fe [0,4194304] 0 2024-04-20T21:58:23.642 INFO:tasks.workunit.client.0.smithi142.stdout:9/193: write d0/f29 [4055900,451] 0 2024-04-20T21:58:23.644 INFO:tasks.workunit.client.0.smithi142.stdout:4/157: truncate d1/db/d17/f19 121487 0 2024-04-20T21:58:23.654 INFO:tasks.workunit.client.0.smithi142.stdout:9/194: dread d0/f1e [0,4194304] 0 2024-04-20T21:58:23.668 INFO:tasks.workunit.client.0.smithi142.stdout:9/195: dwrite d0/f21 [0,4194304] 0 2024-04-20T21:58:23.675 INFO:tasks.workunit.client.0.smithi142.stdout:9/196: rename d0/c1b to d0/d36/c43 0 2024-04-20T21:58:23.679 INFO:tasks.workunit.client.0.smithi142.stdout:9/197: creat d0/d2a/f44 x:0 0 0 2024-04-20T21:58:23.694 INFO:tasks.workunit.client.0.smithi142.stdout:9/198: dwrite d0/fc [0,4194304] 0 2024-04-20T21:58:23.698 INFO:tasks.workunit.client.0.smithi142.stdout:9/199: chown d0/c1f 13593495 1 2024-04-20T21:58:23.703 INFO:tasks.workunit.client.0.smithi142.stdout:9/200: stat d0/ff 0 2024-04-20T21:58:23.717 INFO:tasks.workunit.client.0.smithi142.stdout:9/201: dwrite d0/f9 [0,4194304] 0 2024-04-20T21:58:23.720 INFO:tasks.workunit.client.0.smithi142.stdout:9/202: mknod d0/d2a/d39/c45 0 2024-04-20T21:58:23.735 INFO:tasks.workunit.client.0.smithi142.stdout:9/203: dwrite d0/f25 [0,4194304] 0 2024-04-20T21:58:23.744 INFO:tasks.workunit.client.0.smithi142.stdout:9/204: getdents d0 0 2024-04-20T21:58:23.747 INFO:tasks.workunit.client.0.smithi142.stdout:9/205: creat d0/d3c/f46 x:0 0 0 2024-04-20T21:58:23.749 INFO:tasks.workunit.client.0.smithi142.stdout:9/206: creat d0/d2a/f47 x:0 0 0 2024-04-20T21:58:23.750 INFO:tasks.workunit.client.0.smithi142.stdout:9/207: dread - d0/d2a/f34 zero size 2024-04-20T21:58:23.752 INFO:tasks.workunit.client.0.smithi142.stdout:9/208: symlink d0/d36/l48 0 2024-04-20T21:58:23.768 INFO:tasks.workunit.client.0.smithi142.stdout:9/209: truncate d0/f29 369922 0 2024-04-20T21:58:23.773 INFO:tasks.workunit.client.0.smithi142.stdout:9/210: link d0/d2a/d39/c45 d0/d36/c49 0 2024-04-20T21:58:23.774 INFO:tasks.workunit.client.0.smithi142.stdout:9/211: dread - d0/d2a/f47 zero size 2024-04-20T21:58:23.786 INFO:tasks.workunit.client.0.smithi142.stdout:9/212: truncate d0/d2a/f42 2023761 0 2024-04-20T21:58:23.790 INFO:tasks.workunit.client.0.smithi142.stdout:9/213: creat d0/d2a/f4a x:0 0 0 2024-04-20T21:58:23.793 INFO:tasks.workunit.client.0.smithi142.stdout:9/214: write d0/fc [2826949,90009] 0 2024-04-20T21:58:23.795 INFO:tasks.workunit.client.0.smithi142.stdout:9/215: write d0/d36/f41 [507635,63113] 0 2024-04-20T21:58:23.813 INFO:tasks.workunit.client.0.smithi142.stdout:9/216: dwrite d0/f24 [0,4194304] 0 2024-04-20T21:58:23.816 INFO:tasks.workunit.client.0.smithi142.stdout:9/217: mkdir d0/d2a/d39/d4b 0 2024-04-20T21:58:23.817 INFO:tasks.workunit.client.0.smithi142.stdout:9/218: chown d0/f24 0 1 2024-04-20T21:58:23.830 INFO:tasks.workunit.client.0.smithi142.stdout:9/219: dwrite d0/f21 [4194304,4194304] 0 2024-04-20T21:58:23.831 INFO:tasks.workunit.client.0.smithi142.stdout:9/220: write d0/d2a/f47 [1039247,13045] 0 2024-04-20T21:58:23.850 INFO:tasks.workunit.client.0.smithi142.stdout:9/221: truncate d0/f31 303989 0 2024-04-20T21:58:23.863 INFO:tasks.workunit.client.0.smithi142.stdout:9/222: dread d0/d2a/f2d [0,4194304] 0 2024-04-20T21:58:23.870 INFO:tasks.workunit.client.0.smithi142.stdout:2/258: sync 2024-04-20T21:58:23.872 INFO:tasks.workunit.client.0.smithi142.stdout:2/259: dread - d3/d5/d19/f59 zero size 2024-04-20T21:58:23.877 INFO:tasks.workunit.client.0.smithi142.stdout:9/223: dwrite d0/f14 [0,4194304] 0 2024-04-20T21:58:23.881 INFO:tasks.workunit.client.0.smithi142.stdout:9/224: dread d0/f29 [0,4194304] 0 2024-04-20T21:58:23.884 INFO:tasks.workunit.client.0.smithi142.stdout:9/225: write d0/f9 [4108150,121502] 0 2024-04-20T21:58:23.890 INFO:tasks.workunit.client.0.smithi142.stdout:2/260: dwrite d3/d5/f2a [0,4194304] 0 2024-04-20T21:58:23.892 INFO:tasks.workunit.client.0.smithi142.stdout:2/261: chown d3/d5/d19/c55 3060454 1 2024-04-20T21:58:23.899 INFO:tasks.workunit.client.0.smithi142.stdout:9/226: dread d0/f9 [0,4194304] 0 2024-04-20T21:58:23.903 INFO:tasks.workunit.client.0.smithi142.stdout:9/227: creat d0/d36/f4c x:0 0 0 2024-04-20T21:58:23.906 INFO:tasks.workunit.client.0.smithi142.stdout:9/228: truncate d0/d2a/f4a 904507 0 2024-04-20T21:58:23.910 INFO:tasks.workunit.client.0.smithi142.stdout:2/262: dwrite d3/d5/d19/f21 [0,4194304] 0 2024-04-20T21:58:23.914 INFO:tasks.workunit.client.0.smithi142.stdout:9/229: mkdir d0/d3c/d4d 0 2024-04-20T21:58:23.914 INFO:tasks.workunit.client.0.smithi142.stdout:2/263: truncate d3/d5/f4b 732252 0 2024-04-20T21:58:23.916 INFO:tasks.workunit.client.0.smithi142.stdout:9/230: readlink d0/ld 0 2024-04-20T21:58:23.919 INFO:tasks.workunit.client.0.smithi142.stdout:2/264: symlink d3/d9/d34/d51/d31/l5c 0 2024-04-20T21:58:23.920 INFO:tasks.workunit.client.0.smithi142.stdout:2/265: chown d3/d9/d34/c45 4515 1 2024-04-20T21:58:23.922 INFO:tasks.workunit.client.0.smithi142.stdout:2/266: read d3/d5/f40 [3724710,93405] 0 2024-04-20T21:58:23.926 INFO:tasks.workunit.client.0.smithi142.stdout:2/267: stat d3/d9/d34/d51/d31/c53 0 2024-04-20T21:58:23.928 INFO:tasks.workunit.client.0.smithi142.stdout:9/231: rmdir d0/d2a/d39/d4b 0 2024-04-20T21:58:23.929 INFO:tasks.workunit.client.0.smithi142.stdout:2/268: chown d3/d9/d34/d51/d31/c4e 0 1 2024-04-20T21:58:23.934 INFO:tasks.workunit.client.0.smithi142.stdout:2/269: unlink d3/d9/d34/c45 0 2024-04-20T21:58:23.944 INFO:tasks.workunit.client.0.smithi142.stdout:9/232: dwrite d0/d3c/f46 [0,4194304] 0 2024-04-20T21:58:23.949 INFO:tasks.workunit.client.0.smithi142.stdout:2/270: dread d3/d5/f40 [0,4194304] 0 2024-04-20T21:58:23.952 INFO:tasks.workunit.client.0.smithi142.stdout:2/271: write d3/d9/d34/d51/f47 [1150606,35411] 0 2024-04-20T21:58:23.955 INFO:tasks.workunit.client.0.smithi142.stdout:9/233: write d0/f29 [974100,40174] 0 2024-04-20T21:58:23.957 INFO:tasks.workunit.client.0.smithi142.stdout:2/272: rename d3/ce to d3/d9/d34/d51/d31/c5d 0 2024-04-20T21:58:23.957 INFO:tasks.workunit.client.0.smithi142.stdout:9/234: rmdir d0 39 2024-04-20T21:58:23.970 INFO:tasks.workunit.client.0.smithi142.stdout:9/235: dread d0/f8 [0,4194304] 0 2024-04-20T21:58:23.971 INFO:tasks.workunit.client.0.smithi142.stdout:2/273: dwrite d3/d24/d3c/f1b [0,4194304] 0 2024-04-20T21:58:23.975 INFO:tasks.workunit.client.0.smithi142.stdout:2/274: write d3/d9/d34/f3b [121415,85250] 0 2024-04-20T21:58:23.976 INFO:tasks.workunit.client.0.smithi142.stdout:9/236: getdents d0/d3c 0 2024-04-20T21:58:23.986 INFO:tasks.workunit.client.0.smithi142.stdout:9/237: symlink d0/d3c/d4d/l4e 0 2024-04-20T21:58:23.990 INFO:tasks.workunit.client.0.smithi142.stdout:9/238: creat d0/d2a/f4f x:0 0 0 2024-04-20T21:58:23.992 INFO:tasks.workunit.client.0.smithi142.stdout:9/239: write d0/fc [3159991,66661] 0 2024-04-20T21:58:23.992 INFO:tasks.workunit.client.0.smithi142.stdout:2/275: dwrite d3/d5/d19/f21 [0,4194304] 0 2024-04-20T21:58:23.997 INFO:tasks.workunit.client.0.smithi142.stdout:9/240: unlink d0/l26 0 2024-04-20T21:58:23.997 INFO:tasks.workunit.client.0.smithi142.stdout:2/276: creat d3/d5/f5e x:0 0 0 2024-04-20T21:58:24.000 INFO:tasks.workunit.client.0.smithi142.stdout:2/277: write d3/d24/d3c/f36 [5531298,46884] 0 2024-04-20T21:58:24.013 INFO:tasks.workunit.client.0.smithi142.stdout:9/241: dwrite d0/d2a/f4f [0,4194304] 0 2024-04-20T21:58:24.015 INFO:tasks.workunit.client.0.smithi142.stdout:9/242: fsync d0/fc 0 2024-04-20T21:58:24.018 INFO:tasks.workunit.client.0.smithi142.stdout:9/243: mkdir d0/d2a/d39/d50 0 2024-04-20T21:58:24.022 INFO:tasks.workunit.client.0.smithi142.stdout:9/244: mknod d0/d2a/c51 0 2024-04-20T21:58:24.023 INFO:tasks.workunit.client.0.smithi142.stdout:9/245: chown d0/d2a/f40 192 1 2024-04-20T21:58:24.214 INFO:tasks.workunit.client.0.smithi142.stdout:1/180: sync 2024-04-20T21:58:24.214 INFO:tasks.workunit.client.0.smithi142.stdout:4/158: sync 2024-04-20T21:58:24.214 INFO:tasks.workunit.client.0.smithi142.stdout:8/119: sync 2024-04-20T21:58:24.214 INFO:tasks.workunit.client.0.smithi142.stdout:6/174: sync 2024-04-20T21:58:24.214 INFO:tasks.workunit.client.0.smithi142.stdout:7/168: sync 2024-04-20T21:58:24.214 INFO:tasks.workunit.client.0.smithi142.stdout:0/183: sync 2024-04-20T21:58:24.215 INFO:tasks.workunit.client.0.smithi142.stdout:5/115: sync 2024-04-20T21:58:24.215 INFO:tasks.workunit.client.0.smithi142.stdout:3/128: sync 2024-04-20T21:58:24.220 INFO:tasks.workunit.client.0.smithi142.stdout:3/129: chown d6/f8 33 1 2024-04-20T21:58:24.220 INFO:tasks.workunit.client.0.smithi142.stdout:4/159: chown d1/d12/da/l2e 5 1 2024-04-20T21:58:24.220 INFO:tasks.workunit.client.0.smithi142.stdout:0/184: fdatasync d5/d13/d1e/d23/d24/f2a 0 2024-04-20T21:58:24.221 INFO:tasks.workunit.client.0.smithi142.stdout:8/120: fsync d0/d1c/f1e 0 2024-04-20T21:58:24.222 INFO:tasks.workunit.client.0.smithi142.stdout:7/169: creat d4/f35 x:0 0 0 2024-04-20T21:58:24.223 INFO:tasks.workunit.client.0.smithi142.stdout:6/175: mknod d1/c3f 0 2024-04-20T21:58:24.224 INFO:tasks.workunit.client.0.smithi142.stdout:3/130: chown d6/d15/f19 27656 1 2024-04-20T21:58:24.227 INFO:tasks.workunit.client.0.smithi142.stdout:4/160: mknod d1/db/c31 0 2024-04-20T21:58:24.230 INFO:tasks.workunit.client.0.smithi142.stdout:0/185: mkdir d5/d45 0 2024-04-20T21:58:24.232 INFO:tasks.workunit.client.0.smithi142.stdout:7/170: fdatasync d4/d9/d1b/f1f 0 2024-04-20T21:58:24.233 INFO:tasks.workunit.client.0.smithi142.stdout:9/246: sync 2024-04-20T21:58:24.233 INFO:tasks.workunit.client.0.smithi142.stdout:2/278: sync 2024-04-20T21:58:24.236 INFO:tasks.workunit.client.0.smithi142.stdout:4/161: unlink d1/d6/f2c 0 2024-04-20T21:58:24.236 INFO:tasks.workunit.client.0.smithi142.stdout:6/176: write d1/d5/f26 [1180532,81568] 0 2024-04-20T21:58:24.236 INFO:tasks.workunit.client.0.smithi142.stdout:3/131: readlink d6/d15/l26 0 2024-04-20T21:58:24.239 INFO:tasks.workunit.client.0.smithi142.stdout:8/121: getdents d0/d29 0 2024-04-20T21:58:24.240 INFO:tasks.workunit.client.0.smithi142.stdout:8/122: dread - d0/f20 zero size 2024-04-20T21:58:24.241 INFO:tasks.workunit.client.0.smithi142.stdout:0/186: rmdir d5/d1c/d29/d32 39 2024-04-20T21:58:24.242 INFO:tasks.workunit.client.0.smithi142.stdout:8/123: stat d0/fc 0 2024-04-20T21:58:24.244 INFO:tasks.workunit.client.0.smithi142.stdout:5/116: dwrite f2 [8388608,4194304] 0 2024-04-20T21:58:24.246 INFO:tasks.workunit.client.0.smithi142.stdout:5/117: read - dc/f19 zero size 2024-04-20T21:58:24.247 INFO:tasks.workunit.client.0.smithi142.stdout:2/279: creat d3/d24/f5f x:0 0 0 2024-04-20T21:58:24.249 INFO:tasks.workunit.client.0.smithi142.stdout:2/280: write d3/d9/f33 [4303920,21400] 0 2024-04-20T21:58:24.252 INFO:tasks.workunit.client.0.smithi142.stdout:3/132: chown d6/c1b 3614161 1 2024-04-20T21:58:24.252 INFO:tasks.workunit.client.0.smithi142.stdout:2/281: chown d3/d9/d34/c57 56395138 1 2024-04-20T21:58:24.253 INFO:tasks.workunit.client.0.smithi142.stdout:7/171: creat d4/d9/d1b/f36 x:0 0 0 2024-04-20T21:58:24.253 INFO:tasks.workunit.client.0.smithi142.stdout:2/282: chown d3/d9 600137823 1 2024-04-20T21:58:24.254 INFO:tasks.workunit.client.0.smithi142.stdout:3/133: write d6/f9 [1033950,53536] 0 2024-04-20T21:58:24.255 INFO:tasks.workunit.client.0.smithi142.stdout:2/283: dread - d3/d9/d34/f35 zero size 2024-04-20T21:58:24.257 INFO:tasks.workunit.client.0.smithi142.stdout:4/162: mkdir d1/d12/da/d1c/d32 0 2024-04-20T21:58:24.258 INFO:tasks.workunit.client.0.smithi142.stdout:2/284: write d3/d24/d3c/f1b [4006536,80634] 0 2024-04-20T21:58:24.263 INFO:tasks.workunit.client.0.smithi142.stdout:0/187: rmdir d5/d13 39 2024-04-20T21:58:24.264 INFO:tasks.workunit.client.0.smithi142.stdout:8/124: rename d0/d1c/f1d to d0/d1c/f2d 0 2024-04-20T21:58:24.268 INFO:tasks.workunit.client.0.smithi142.stdout:9/247: symlink d0/d2a/d39/d50/l52 0 2024-04-20T21:58:24.272 INFO:tasks.workunit.client.0.smithi142.stdout:7/172: creat d4/d9/f37 x:0 0 0 2024-04-20T21:58:24.278 INFO:tasks.workunit.client.0.smithi142.stdout:6/177: dwrite d1/d1d/f28 [0,4194304] 0 2024-04-20T21:58:24.286 INFO:tasks.workunit.client.0.smithi142.stdout:5/118: mkdir dc/d14/d21/d23 0 2024-04-20T21:58:24.286 INFO:tasks.workunit.client.0.smithi142.stdout:4/163: dwrite d1/f8 [4194304,4194304] 0 2024-04-20T21:58:24.288 INFO:tasks.workunit.client.0.smithi142.stdout:0/188: chown d5/d13/d1e/d23/l28 7 1 2024-04-20T21:58:24.291 INFO:tasks.workunit.client.0.smithi142.stdout:8/125: rename d0/fc to d0/d29/f2e 0 2024-04-20T21:58:24.294 INFO:tasks.workunit.client.0.smithi142.stdout:0/189: truncate d5/d1c/d3c/f43 997767 0 2024-04-20T21:58:24.294 INFO:tasks.workunit.client.0.smithi142.stdout:8/126: truncate d0/d17/f1a 321200 0 2024-04-20T21:58:24.296 INFO:tasks.workunit.client.0.smithi142.stdout:8/127: write d0/f6 [1054245,59457] 0 2024-04-20T21:58:24.296 INFO:tasks.workunit.client.0.smithi142.stdout:0/190: chown d5/d13/l20 798859 1 2024-04-20T21:58:24.298 INFO:tasks.workunit.client.0.smithi142.stdout:8/128: chown d0/d17/c18 73667 1 2024-04-20T21:58:24.298 INFO:tasks.workunit.client.0.smithi142.stdout:3/134: dread d6/f9 [0,4194304] 0 2024-04-20T21:58:24.303 INFO:tasks.workunit.client.0.smithi142.stdout:7/173: mknod d4/d9/d1c/c38 0 2024-04-20T21:58:24.303 INFO:tasks.workunit.client.0.smithi142.stdout:1/181: write d2/dd/d17/d1b/d22/f1e [586461,65701] 0 2024-04-20T21:58:24.307 INFO:tasks.workunit.client.0.smithi142.stdout:1/182: fsync d2/dd/d17/f24 0 2024-04-20T21:58:24.312 INFO:tasks.workunit.client.0.smithi142.stdout:4/164: rename d1/d12/da/l2e to d1/d12/l33 0 2024-04-20T21:58:24.313 INFO:tasks.workunit.client.0.smithi142.stdout:7/174: rename d4 to d4/d9/d11/d39 22 2024-04-20T21:58:24.316 INFO:tasks.workunit.client.0.smithi142.stdout:5/119: dwrite f7 [0,4194304] 0 2024-04-20T21:58:24.322 INFO:tasks.workunit.client.0.smithi142.stdout:3/135: unlink d6/f9 0 2024-04-20T21:58:24.333 INFO:tasks.workunit.client.0.smithi142.stdout:1/183: mkdir d2/dd/d17/d3b 0 2024-04-20T21:58:24.335 INFO:tasks.workunit.client.0.smithi142.stdout:1/184: readlink d2/dd/l33 0 2024-04-20T21:58:24.336 INFO:tasks.workunit.client.0.smithi142.stdout:0/191: dwrite d5/f18 [0,4194304] 0 2024-04-20T21:58:24.337 INFO:tasks.workunit.client.0.smithi142.stdout:9/248: dread d0/f11 [0,4194304] 0 2024-04-20T21:58:24.340 INFO:tasks.workunit.client.0.smithi142.stdout:7/175: rmdir d4/d9/d11/d22 39 2024-04-20T21:58:24.345 INFO:tasks.workunit.client.0.smithi142.stdout:8/129: rmdir d0 39 2024-04-20T21:58:24.345 INFO:tasks.workunit.client.0.smithi142.stdout:1/185: creat d2/dd/d17/d1b/f3c x:0 0 0 2024-04-20T21:58:24.347 INFO:tasks.workunit.client.0.smithi142.stdout:9/249: unlink d0/l20 0 2024-04-20T21:58:24.351 INFO:tasks.workunit.client.0.smithi142.stdout:5/120: creat dc/d14/d21/d23/f24 x:0 0 0 2024-04-20T21:58:24.352 INFO:tasks.workunit.client.0.smithi142.stdout:6/178: write d1/d11/fa [423255,40713] 0 2024-04-20T21:58:24.354 INFO:tasks.workunit.client.0.smithi142.stdout:2/285: dwrite d3/d24/f3f [0,4194304] 0 2024-04-20T21:58:24.360 INFO:tasks.workunit.client.0.smithi142.stdout:1/186: rmdir d2/dd/d17/d1b/d22/d20 39 2024-04-20T21:58:24.361 INFO:tasks.workunit.client.0.smithi142.stdout:6/179: read d1/d5/f12 [286570,12500] 0 2024-04-20T21:58:24.363 INFO:tasks.workunit.client.0.smithi142.stdout:4/165: dread d1/d12/da/d1c/f26 [0,4194304] 0 2024-04-20T21:58:24.365 INFO:tasks.workunit.client.0.smithi142.stdout:9/250: creat d0/d36/f53 x:0 0 0 2024-04-20T21:58:24.366 INFO:tasks.workunit.client.0.smithi142.stdout:0/192: mkdir d5/d13/d1e/d23/d46 0 2024-04-20T21:58:24.372 INFO:tasks.workunit.client.0.smithi142.stdout:3/136: link d6/d15/l26 d6/l2a 0 2024-04-20T21:58:24.375 INFO:tasks.workunit.client.0.smithi142.stdout:7/176: rename f1 to d4/d9/d11/d22/f3a 0 2024-04-20T21:58:24.375 INFO:tasks.workunit.client.0.smithi142.stdout:3/137: write d6/f8 [3232221,127297] 0 2024-04-20T21:58:24.377 INFO:tasks.workunit.client.0.smithi142.stdout:2/286: creat d3/d5/f60 x:0 0 0 2024-04-20T21:58:24.378 INFO:tasks.workunit.client.0.smithi142.stdout:7/177: write d4/d9/d1c/f33 [645784,81927] 0 2024-04-20T21:58:24.379 INFO:tasks.workunit.client.0.smithi142.stdout:8/130: unlink d0/d17/l21 0 2024-04-20T21:58:24.382 INFO:tasks.workunit.client.0.smithi142.stdout:7/178: truncate d4/f2d 944612 0 2024-04-20T21:58:24.383 INFO:tasks.workunit.client.0.smithi142.stdout:9/251: dwrite d0/d2a/f34 [0,4194304] 0 2024-04-20T21:58:24.384 INFO:tasks.workunit.client.0.smithi142.stdout:1/187: symlink d2/dd/d17/l3d 0 2024-04-20T21:58:24.384 INFO:tasks.workunit.client.0.smithi142.stdout:6/180: mknod d1/d5/c40 0 2024-04-20T21:58:24.388 INFO:tasks.workunit.client.0.smithi142.stdout:0/193: readlink d5/d13/l3d 0 2024-04-20T21:58:24.388 INFO:tasks.workunit.client.0.smithi142.stdout:5/121: write f4 [1012689,114682] 0 2024-04-20T21:58:24.391 INFO:tasks.workunit.client.0.smithi142.stdout:3/138: rename d6/d15/c17 to d6/d15/c2b 0 2024-04-20T21:58:24.395 INFO:tasks.workunit.client.0.smithi142.stdout:7/179: unlink d4/d9/cf 0 2024-04-20T21:58:24.403 INFO:tasks.workunit.client.0.smithi142.stdout:0/194: rmdir d5/d13/d1e/d23 39 2024-04-20T21:58:24.411 INFO:tasks.workunit.client.0.smithi142.stdout:0/195: read - d5/d1c/d29/d38/f42 zero size 2024-04-20T21:58:24.412 INFO:tasks.workunit.client.0.smithi142.stdout:9/252: dwrite d0/fc [4194304,4194304] 0 2024-04-20T21:58:24.413 INFO:tasks.workunit.client.0.smithi142.stdout:7/180: rename d4/c29 to d4/d9/c3b 0 2024-04-20T21:58:24.416 INFO:tasks.workunit.client.0.smithi142.stdout:5/122: mkdir dc/d14/d25 0 2024-04-20T21:58:24.421 INFO:tasks.workunit.client.0.smithi142.stdout:2/287: truncate d3/d9/f33 248121 0 2024-04-20T21:58:24.422 INFO:tasks.workunit.client.0.smithi142.stdout:1/188: creat d2/f3e x:0 0 0 2024-04-20T21:58:24.422 INFO:tasks.workunit.client.0.smithi142.stdout:8/131: dwrite d0/d1c/f2d [0,4194304] 0 2024-04-20T21:58:24.425 INFO:tasks.workunit.client.0.smithi142.stdout:4/166: getdents d1/d6 0 2024-04-20T21:58:24.428 INFO:tasks.workunit.client.0.smithi142.stdout:0/196: dread - d5/d13/d1e/d23/f39 zero size 2024-04-20T21:58:24.429 INFO:tasks.workunit.client.0.smithi142.stdout:0/197: fsync d5/d1d/f22 0 2024-04-20T21:58:24.429 INFO:tasks.workunit.client.0.smithi142.stdout:4/167: chown d1/d6/f1f 59201228 1 2024-04-20T21:58:24.438 INFO:tasks.workunit.client.0.smithi142.stdout:2/288: symlink d3/d24/d3c/l61 0 2024-04-20T21:58:24.441 INFO:tasks.workunit.client.0.smithi142.stdout:5/123: dread dc/f16 [0,4194304] 0 2024-04-20T21:58:24.442 INFO:tasks.workunit.client.0.smithi142.stdout:8/132: creat d0/f2f x:0 0 0 2024-04-20T21:58:24.444 INFO:tasks.workunit.client.0.smithi142.stdout:1/189: creat d2/dd/d1c/f3f x:0 0 0 2024-04-20T21:58:24.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:24 smithi164 ceph-mon[23506]: mgrmap e25: smithi164.oejajr(active, since 61s), standbys: smithi142.zzmcfz 2024-04-20T21:58:24.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:24 smithi142 ceph-mon[15828]: mgrmap e25: smithi164.oejajr(active, since 61s), standbys: smithi142.zzmcfz 2024-04-20T21:58:24.446 INFO:tasks.workunit.client.0.smithi142.stdout:6/181: dread d1/d11/fa [0,4194304] 0 2024-04-20T21:58:24.447 INFO:tasks.workunit.client.0.smithi142.stdout:0/198: dread d5/d13/f14 [0,4194304] 0 2024-04-20T21:58:24.450 INFO:tasks.workunit.client.0.smithi142.stdout:3/139: link d6/c27 d6/d15/c2c 0 2024-04-20T21:58:24.450 INFO:tasks.workunit.client.0.smithi142.stdout:9/253: dwrite d0/f14 [0,4194304] 0 2024-04-20T21:58:24.453 INFO:tasks.workunit.client.0.smithi142.stdout:4/168: dread d1/d6/fc [4194304,4194304] 0 2024-04-20T21:58:24.456 INFO:tasks.workunit.client.0.smithi142.stdout:8/133: mknod d0/c30 0 2024-04-20T21:58:24.459 INFO:tasks.workunit.client.0.smithi142.stdout:7/181: creat d4/d9/d11/f3c x:0 0 0 2024-04-20T21:58:24.467 INFO:tasks.workunit.client.0.smithi142.stdout:0/199: rename d5/d13/d1e/d23/d2c/f2e to d5/d45/f47 0 2024-04-20T21:58:24.474 INFO:tasks.workunit.client.0.smithi142.stdout:7/182: creat d4/d9/f3d x:0 0 0 2024-04-20T21:58:24.474 INFO:tasks.workunit.client.0.smithi142.stdout:9/254: write d0/f1e [565024,11044] 0 2024-04-20T21:58:24.480 INFO:tasks.workunit.client.0.smithi142.stdout:1/190: dwrite d2/dd/d17/d1b/d22/f1e [0,4194304] 0 2024-04-20T21:58:24.482 INFO:tasks.workunit.client.0.smithi142.stdout:0/200: mkdir d5/d13/d1e/d23/d24/d48 0 2024-04-20T21:58:24.482 INFO:tasks.workunit.client.0.smithi142.stdout:9/255: dread - d0/d2a/f40 zero size 2024-04-20T21:58:24.484 INFO:tasks.workunit.client.0.smithi142.stdout:1/191: chown d2 841 1 2024-04-20T21:58:24.486 INFO:tasks.workunit.client.0.smithi142.stdout:9/256: chown d0/f8 219083950 1 2024-04-20T21:58:24.487 INFO:tasks.workunit.client.0.smithi142.stdout:8/134: dwrite d0/f26 [0,4194304] 0 2024-04-20T21:58:24.488 INFO:tasks.workunit.client.0.smithi142.stdout:3/140: link d6/c27 d6/d15/c2d 0 2024-04-20T21:58:24.489 INFO:tasks.workunit.client.0.smithi142.stdout:8/135: chown d0 16589239 1 2024-04-20T21:58:24.491 INFO:tasks.workunit.client.0.smithi142.stdout:2/289: getdents d3/d5/d19 0 2024-04-20T21:58:24.498 INFO:tasks.workunit.client.0.smithi142.stdout:5/124: getdents dc/d14 0 2024-04-20T21:58:24.502 INFO:tasks.workunit.client.0.smithi142.stdout:6/182: dread d1/d5/f12 [0,4194304] 0 2024-04-20T21:58:24.505 INFO:tasks.workunit.client.0.smithi142.stdout:9/257: dread d0/d2a/f47 [0,4194304] 0 2024-04-20T21:58:24.512 INFO:tasks.workunit.client.0.smithi142.stdout:2/290: symlink d3/d9/d34/d51/d31/l62 0 2024-04-20T21:58:24.512 INFO:tasks.workunit.client.0.smithi142.stdout:1/192: unlink d2/dd/d1c/l29 0 2024-04-20T21:58:24.514 INFO:tasks.workunit.client.0.smithi142.stdout:4/169: truncate d1/ff 4203638 0 2024-04-20T21:58:24.518 INFO:tasks.workunit.client.0.smithi142.stdout:4/170: chown d1/d12/da 919159054 1 2024-04-20T21:58:24.518 INFO:tasks.workunit.client.0.smithi142.stdout:7/183: creat d4/d9/d11/f3e x:0 0 0 2024-04-20T21:58:24.519 INFO:tasks.workunit.client.0.smithi142.stdout:0/201: link d5/d13/l15 d5/d1d/l49 0 2024-04-20T21:58:24.520 INFO:tasks.workunit.client.0.smithi142.stdout:7/184: fdatasync d4/d9/d1b/f34 0 2024-04-20T21:58:24.522 INFO:tasks.workunit.client.0.smithi142.stdout:9/258: creat d0/f54 x:0 0 0 2024-04-20T21:58:24.530 INFO:tasks.workunit.client.0.smithi142.stdout:5/125: write dc/f16 [1059849,61992] 0 2024-04-20T21:58:24.530 INFO:tasks.workunit.client.0.smithi142.stdout:9/259: chown d0/ff 24309611 1 2024-04-20T21:58:24.531 INFO:tasks.workunit.client.0.smithi142.stdout:0/202: mkdir d5/d1c/d3c/d4a 0 2024-04-20T21:58:24.533 INFO:tasks.workunit.client.0.smithi142.stdout:1/193: dread d2/dd/d17/f1a [0,4194304] 0 2024-04-20T21:58:24.534 INFO:tasks.workunit.client.0.smithi142.stdout:8/136: truncate d0/f26 2724119 0 2024-04-20T21:58:24.537 INFO:tasks.workunit.client.0.smithi142.stdout:4/171: rename d1/db/d17/f19 to d1/d12/da/d1c/f34 0 2024-04-20T21:58:24.539 INFO:tasks.workunit.client.0.smithi142.stdout:4/172: write d1/f13 [1228010,33011] 0 2024-04-20T21:58:24.541 INFO:tasks.workunit.client.0.smithi142.stdout:9/260: mkdir d0/d36/d55 0 2024-04-20T21:58:24.542 INFO:tasks.workunit.client.0.smithi142.stdout:2/291: dwrite d3/d9/d34/d51/f47 [0,4194304] 0 2024-04-20T21:58:24.544 INFO:tasks.workunit.client.0.smithi142.stdout:2/292: dread - d3/d5/f5e zero size 2024-04-20T21:58:24.544 INFO:tasks.workunit.client.0.smithi142.stdout:5/126: mkdir dc/d14/d26 0 2024-04-20T21:58:24.545 INFO:tasks.workunit.client.0.smithi142.stdout:2/293: stat d3/d5/d19/c55 0 2024-04-20T21:58:24.547 INFO:tasks.workunit.client.0.smithi142.stdout:5/127: chown dc/f15 14744 1 2024-04-20T21:58:24.547 INFO:tasks.workunit.client.0.smithi142.stdout:8/137: creat d0/d1c/f31 x:0 0 0 2024-04-20T21:58:24.549 INFO:tasks.workunit.client.0.smithi142.stdout:3/141: dread d6/fd [0,4194304] 0 2024-04-20T21:58:24.549 INFO:tasks.workunit.client.0.smithi142.stdout:7/185: getdents d4/d9/d1c/d32 0 2024-04-20T21:58:24.551 INFO:tasks.workunit.client.0.smithi142.stdout:4/173: stat d1/d12/da/d1c/c2a 0 2024-04-20T21:58:24.552 INFO:tasks.workunit.client.0.smithi142.stdout:9/261: fsync d0/f11 0 2024-04-20T21:58:24.554 INFO:tasks.workunit.client.0.smithi142.stdout:0/203: mknod d5/d13/d1e/d23/d24/d48/c4b 0 2024-04-20T21:58:24.554 INFO:tasks.workunit.client.0.smithi142.stdout:3/142: write d6/fd [1721406,16725] 0 2024-04-20T21:58:24.555 INFO:tasks.workunit.client.0.smithi142.stdout:1/194: symlink d2/dd/d17/d1b/d22/l40 0 2024-04-20T21:58:24.556 INFO:tasks.workunit.client.0.smithi142.stdout:4/174: chown d1/d12/da/f22 29652 1 2024-04-20T21:58:24.556 INFO:tasks.workunit.client.0.smithi142.stdout:8/138: symlink d0/l32 0 2024-04-20T21:58:24.559 INFO:tasks.workunit.client.0.smithi142.stdout:7/186: symlink d4/d9/d11/d22/l3f 0 2024-04-20T21:58:24.561 INFO:tasks.workunit.client.0.smithi142.stdout:8/139: creat d0/d1c/f33 x:0 0 0 2024-04-20T21:58:24.561 INFO:tasks.workunit.client.0.smithi142.stdout:1/195: mknod d2/dd/d17/c41 0 2024-04-20T21:58:24.562 INFO:tasks.workunit.client.0.smithi142.stdout:3/143: chown d6/d15/c2d 3859157 1 2024-04-20T21:58:24.565 INFO:tasks.workunit.client.0.smithi142.stdout:8/140: readlink d0/d22/l24 0 2024-04-20T21:58:24.566 INFO:tasks.workunit.client.0.smithi142.stdout:7/187: symlink d4/d9/d1b/l40 0 2024-04-20T21:58:24.568 INFO:tasks.workunit.client.0.smithi142.stdout:8/141: stat d0/f1b 0 2024-04-20T21:58:24.569 INFO:tasks.workunit.client.0.smithi142.stdout:1/196: symlink d2/dd/d17/l42 0 2024-04-20T21:58:24.573 INFO:tasks.workunit.client.0.smithi142.stdout:2/294: dread d3/d5/f2a [0,4194304] 0 2024-04-20T21:58:24.573 INFO:tasks.workunit.client.0.smithi142.stdout:7/188: read d4/d9/d1b/f1f [4763,104804] 0 2024-04-20T21:58:24.574 INFO:tasks.workunit.client.0.smithi142.stdout:0/204: creat d5/d13/d1e/d23/d46/f4c x:0 0 0 2024-04-20T21:58:24.575 INFO:tasks.workunit.client.0.smithi142.stdout:7/189: read d4/f2d [460802,65391] 0 2024-04-20T21:58:24.578 INFO:tasks.workunit.client.0.smithi142.stdout:1/197: mkdir d2/dd/d1c/d43 0 2024-04-20T21:58:24.579 INFO:tasks.workunit.client.0.smithi142.stdout:7/190: chown d4/d9/d1c/f21 334128039 1 2024-04-20T21:58:24.580 INFO:tasks.workunit.client.0.smithi142.stdout:8/142: creat d0/d17/f34 x:0 0 0 2024-04-20T21:58:24.582 INFO:tasks.workunit.client.0.smithi142.stdout:8/143: write d0/d1c/f1e [416584,124365] 0 2024-04-20T21:58:24.587 INFO:tasks.workunit.client.0.smithi142.stdout:0/205: mkdir d5/d13/d4d 0 2024-04-20T21:58:24.590 INFO:tasks.workunit.client.0.smithi142.stdout:1/198: dread - d2/dd/d17/d1b/d22/d20/f2d zero size 2024-04-20T21:58:24.596 INFO:tasks.workunit.client.0.smithi142.stdout:1/199: readlink d2/dd/d17/d1b/l34 0 2024-04-20T21:58:24.598 INFO:tasks.workunit.client.0.smithi142.stdout:9/262: truncate d0/fe 2162027 0 2024-04-20T21:58:24.601 INFO:tasks.workunit.client.0.smithi142.stdout:0/206: creat d5/d1d/f4e x:0 0 0 2024-04-20T21:58:24.601 INFO:tasks.workunit.client.0.smithi142.stdout:3/144: dread f2 [0,4194304] 0 2024-04-20T21:58:24.603 INFO:tasks.workunit.client.0.smithi142.stdout:3/145: stat d6/c12 0 2024-04-20T21:58:24.607 INFO:tasks.workunit.client.0.smithi142.stdout:5/128: link f4 dc/d14/d21/f27 0 2024-04-20T21:58:24.610 INFO:tasks.workunit.client.0.smithi142.stdout:1/200: dwrite d2/dd/d1c/f3f [0,4194304] 0 2024-04-20T21:58:24.619 INFO:tasks.workunit.client.0.smithi142.stdout:7/191: link d4/le d4/d9/l41 0 2024-04-20T21:58:24.623 INFO:tasks.workunit.client.0.smithi142.stdout:4/175: write d1/ff [1746987,29105] 0 2024-04-20T21:58:24.623 INFO:tasks.workunit.client.0.smithi142.stdout:8/144: truncate d0/d17/f1a 83499 0 2024-04-20T21:58:24.623 INFO:tasks.workunit.client.0.smithi142.stdout:3/146: creat d6/f2e x:0 0 0 2024-04-20T21:58:24.627 INFO:tasks.workunit.client.0.smithi142.stdout:5/129: symlink dc/d14/d26/l28 0 2024-04-20T21:58:24.629 INFO:tasks.workunit.client.0.smithi142.stdout:7/192: readlink d4/d9/l1e 0 2024-04-20T21:58:24.629 INFO:tasks.workunit.client.0.smithi142.stdout:3/147: chown d6/d15/d1e/c28 130066 1 2024-04-20T21:58:24.629 INFO:tasks.workunit.client.0.smithi142.stdout:1/201: mkdir d2/dd/d17/d3b/d44 0 2024-04-20T21:58:24.633 INFO:tasks.workunit.client.0.smithi142.stdout:0/207: rename d5/ff to d5/d1c/d29/f4f 0 2024-04-20T21:58:24.633 INFO:tasks.workunit.client.0.smithi142.stdout:8/145: chown d0/d22/c2c 212965 1 2024-04-20T21:58:24.633 INFO:tasks.workunit.client.0.smithi142.stdout:5/130: stat dc/d14/d26/l28 0 2024-04-20T21:58:24.635 INFO:tasks.workunit.client.0.smithi142.stdout:4/176: symlink d1/db/l35 0 2024-04-20T21:58:24.636 INFO:tasks.workunit.client.0.smithi142.stdout:3/148: write d6/d15/f19 [829014,64507] 0 2024-04-20T21:58:24.637 INFO:tasks.workunit.client.0.smithi142.stdout:1/202: truncate d2/f31 1028967 0 2024-04-20T21:58:24.641 INFO:tasks.workunit.client.0.smithi142.stdout:8/146: chown d0/f1b 478130 1 2024-04-20T21:58:24.648 INFO:tasks.workunit.client.0.smithi142.stdout:3/149: readlink d6/l13 0 2024-04-20T21:58:24.652 INFO:tasks.workunit.client.0.smithi142.stdout:5/131: dread dc/f16 [0,4194304] 0 2024-04-20T21:58:24.655 INFO:tasks.workunit.client.0.smithi142.stdout:2/295: dwrite d3/f42 [0,4194304] 0 2024-04-20T21:58:24.657 INFO:tasks.workunit.client.0.smithi142.stdout:9/263: dread d0/fe [0,4194304] 0 2024-04-20T21:58:24.658 INFO:tasks.workunit.client.0.smithi142.stdout:1/203: rmdir d2/dd/d17/d3b 39 2024-04-20T21:58:24.659 INFO:tasks.workunit.client.0.smithi142.stdout:7/193: link d4/d9/d1c/f21 d4/d9/f42 0 2024-04-20T21:58:24.659 INFO:tasks.workunit.client.0.smithi142.stdout:4/177: link d1/db/c31 d1/d12/c36 0 2024-04-20T21:58:24.665 INFO:tasks.workunit.client.0.smithi142.stdout:7/194: write d4/d9/f30 [143277,68498] 0 2024-04-20T21:58:24.667 INFO:tasks.workunit.client.0.smithi142.stdout:0/208: dwrite d5/d1c/d3c/f43 [0,4194304] 0 2024-04-20T21:58:24.668 INFO:tasks.workunit.client.0.smithi142.stdout:2/296: mknod d3/c63 0 2024-04-20T21:58:24.669 INFO:tasks.workunit.client.0.smithi142.stdout:5/132: rename dc/c13 to dc/d14/d21/d23/c29 0 2024-04-20T21:58:24.673 INFO:tasks.workunit.client.0.smithi142.stdout:7/195: chown d4/d9/d11/d22/f2b 196706 1 2024-04-20T21:58:24.674 INFO:tasks.workunit.client.0.smithi142.stdout:9/264: creat d0/d2a/d39/f56 x:0 0 0 2024-04-20T21:58:24.675 INFO:tasks.workunit.client.0.smithi142.stdout:8/147: getdents d0/d17 0 2024-04-20T21:58:24.676 INFO:tasks.workunit.client.0.smithi142.stdout:8/148: readlink d0/l32 0 2024-04-20T21:58:24.678 INFO:tasks.workunit.client.0.smithi142.stdout:8/149: fdatasync d0/f11 0 2024-04-20T21:58:24.679 INFO:tasks.workunit.client.0.smithi142.stdout:5/133: dread dc/f10 [0,4194304] 0 2024-04-20T21:58:24.679 INFO:tasks.workunit.client.0.smithi142.stdout:2/297: unlink d3/d5/l8 0 2024-04-20T21:58:24.681 INFO:tasks.workunit.client.0.smithi142.stdout:0/209: creat d5/d45/f50 x:0 0 0 2024-04-20T21:58:24.683 INFO:tasks.workunit.client.0.smithi142.stdout:8/150: chown d0/d1c/f2d 106474 1 2024-04-20T21:58:24.684 INFO:tasks.workunit.client.0.smithi142.stdout:4/178: mkdir d1/d12/da/d37 0 2024-04-20T21:58:24.685 INFO:tasks.workunit.client.0.smithi142.stdout:2/298: fsync d3/d9/d34/f3b 0 2024-04-20T21:58:24.687 INFO:tasks.workunit.client.0.smithi142.stdout:7/196: symlink d4/l43 0 2024-04-20T21:58:24.688 INFO:tasks.workunit.client.0.smithi142.stdout:5/134: mkdir dc/d14/d21/d23/d2a 0 2024-04-20T21:58:24.694 INFO:tasks.workunit.client.0.smithi142.stdout:8/151: mkdir d0/d17/d35 0 2024-04-20T21:58:24.695 INFO:tasks.workunit.client.0.smithi142.stdout:1/204: rename d2/dd/d17/d1b/d22/f1e to d2/f45 0 2024-04-20T21:58:24.699 INFO:tasks.workunit.client.0.smithi142.stdout:1/205: readlink d2/dd/d17/d1b/d22/d13/l19 0 2024-04-20T21:58:24.699 INFO:tasks.workunit.client.0.smithi142.stdout:9/265: dwrite d0/d2a/f4f [0,4194304] 0 2024-04-20T21:58:24.704 INFO:tasks.workunit.client.0.smithi142.stdout:2/299: mkdir d3/d24/d3c/d64 0 2024-04-20T21:58:24.704 INFO:tasks.workunit.client.0.smithi142.stdout:5/135: creat dc/f2b x:0 0 0 2024-04-20T21:58:24.705 INFO:tasks.workunit.client.0.smithi142.stdout:4/179: mkdir d1/db/d17/d38 0 2024-04-20T21:58:24.710 INFO:tasks.workunit.client.0.smithi142.stdout:8/152: mkdir d0/d29/d36 0 2024-04-20T21:58:24.710 INFO:tasks.workunit.client.0.smithi142.stdout:3/150: dread d6/f10 [0,4194304] 0 2024-04-20T21:58:24.710 INFO:tasks.workunit.client.0.smithi142.stdout:9/266: mknod d0/d2a/c57 0 2024-04-20T21:58:24.716 INFO:tasks.workunit.client.0.smithi142.stdout:7/197: dwrite d4/d9/f37 [0,4194304] 0 2024-04-20T21:58:24.718 INFO:tasks.workunit.client.0.smithi142.stdout:8/153: fsync d0/f6 0 2024-04-20T21:58:24.720 INFO:tasks.workunit.client.0.smithi142.stdout:7/198: rename d4 to d4/d44 22 2024-04-20T21:58:24.724 INFO:tasks.workunit.client.0.smithi142.stdout:5/136: write dc/f10 [570885,117187] 0 2024-04-20T21:58:24.726 INFO:tasks.workunit.client.0.smithi142.stdout:0/210: link d5/d13/l3d d5/d13/d1e/d23/d46/l51 0 2024-04-20T21:58:24.728 INFO:tasks.workunit.client.0.smithi142.stdout:6/183: sync 2024-04-20T21:58:24.730 INFO:tasks.workunit.client.0.smithi142.stdout:5/137: dread - dc/f2b zero size 2024-04-20T21:58:24.734 INFO:tasks.workunit.client.0.smithi142.stdout:8/154: readlink d0/l16 0 2024-04-20T21:58:24.735 INFO:tasks.workunit.client.0.smithi142.stdout:1/206: creat d2/dd/d17/d1b/d22/f46 x:0 0 0 2024-04-20T21:58:24.737 INFO:tasks.workunit.client.0.smithi142.stdout:2/300: dread d3/d5/f2a [0,4194304] 0 2024-04-20T21:58:24.738 INFO:tasks.workunit.client.0.smithi142.stdout:0/211: creat d5/d1c/f52 x:0 0 0 2024-04-20T21:58:24.739 INFO:tasks.workunit.client.0.smithi142.stdout:5/138: unlink dc/f15 0 2024-04-20T21:58:24.743 INFO:tasks.workunit.client.0.smithi142.stdout:6/184: mknod d1/d5/d1a/d39/c41 0 2024-04-20T21:58:24.751 INFO:tasks.workunit.client.0.smithi142.stdout:0/212: stat d5/d13/d1e/d23/d24/f33 0 2024-04-20T21:58:24.751 INFO:tasks.workunit.client.0.smithi142.stdout:4/180: dread d1/d12/da/d1c/f26 [0,4194304] 0 2024-04-20T21:58:24.751 INFO:tasks.workunit.client.0.smithi142.stdout:0/213: write d5/f17 [4812164,84935] 0 2024-04-20T21:58:24.754 INFO:tasks.workunit.client.0.smithi142.stdout:6/185: write d1/d1d/d2b/f2a [93945,52125] 0 2024-04-20T21:58:24.755 INFO:tasks.workunit.client.0.smithi142.stdout:2/301: rename d3/d9/d34/d51/f47 to d3/d9/d34/d51/f65 0 2024-04-20T21:58:24.760 INFO:tasks.workunit.client.0.smithi142.stdout:5/139: rename dc/d14/d26/l28 to dc/d14/d21/d23/l2c 0 2024-04-20T21:58:24.766 INFO:tasks.workunit.client.0.smithi142.stdout:3/151: dread d6/f8 [0,4194304] 0 2024-04-20T21:58:24.769 INFO:tasks.workunit.client.0.smithi142.stdout:1/207: dwrite d2/dd/d17/d1b/f3c [0,4194304] 0 2024-04-20T21:58:24.772 INFO:tasks.workunit.client.0.smithi142.stdout:9/267: dwrite d0/f9 [0,4194304] 0 2024-04-20T21:58:24.773 INFO:tasks.workunit.client.0.smithi142.stdout:0/214: write d5/d13/d1e/d23/d24/f2a [886331,67075] 0 2024-04-20T21:58:24.775 INFO:tasks.workunit.client.0.smithi142.stdout:1/208: readlink d2/lc 0 2024-04-20T21:58:24.778 INFO:tasks.workunit.client.0.smithi142.stdout:9/268: write d0/ff [7305243,45726] 0 2024-04-20T21:58:24.778 INFO:tasks.workunit.client.0.smithi142.stdout:3/152: write d6/d15/d1e/f22 [127611,51912] 0 2024-04-20T21:58:24.781 INFO:tasks.workunit.client.0.smithi142.stdout:1/209: chown d2/dd/fe 2028 1 2024-04-20T21:58:24.796 INFO:tasks.workunit.client.0.smithi142.stdout:3/153: write d6/f11 [4384805,87242] 0 2024-04-20T21:58:24.796 INFO:tasks.workunit.client.0.smithi142.stdout:8/155: dwrite d0/d17/f1f [0,4194304] 0 2024-04-20T21:58:24.801 INFO:tasks.workunit.client.0.smithi142.stdout:2/302: dread d3/d24/f3f [0,4194304] 0 2024-04-20T21:58:24.801 INFO:tasks.workunit.client.0.smithi142.stdout:7/199: dread d4/d9/d11/d22/f3a [4194304,4194304] 0 2024-04-20T21:58:24.803 INFO:tasks.workunit.client.0.smithi142.stdout:4/181: dwrite d1/db/d17/f28 [4194304,4194304] 0 2024-04-20T21:58:24.806 INFO:tasks.workunit.client.0.smithi142.stdout:4/182: stat d1/db/f1e 0 2024-04-20T21:58:24.807 INFO:tasks.workunit.client.0.smithi142.stdout:6/186: creat d1/d5/d3a/f42 x:0 0 0 2024-04-20T21:58:24.808 INFO:tasks.workunit.client.0.smithi142.stdout:9/269: symlink d0/d36/d55/l58 0 2024-04-20T21:58:24.810 INFO:tasks.workunit.client.0.smithi142.stdout:5/140: creat dc/d14/d25/f2d x:0 0 0 2024-04-20T21:58:24.814 INFO:tasks.workunit.client.0.smithi142.stdout:7/200: mknod d4/d9/d11/d22/c45 0 2024-04-20T21:58:24.816 INFO:tasks.workunit.client.0.smithi142.stdout:8/156: getdents d0/d17/d35 0 2024-04-20T21:58:24.817 INFO:tasks.workunit.client.0.smithi142.stdout:5/141: dread dc/f16 [0,4194304] 0 2024-04-20T21:58:24.820 INFO:tasks.workunit.client.0.smithi142.stdout:1/210: dread d2/dd/d1c/f3f [0,4194304] 0 2024-04-20T21:58:24.823 INFO:tasks.workunit.client.0.smithi142.stdout:0/215: dwrite d5/d1c/f26 [0,4194304] 0 2024-04-20T21:58:24.825 INFO:tasks.workunit.client.0.smithi142.stdout:5/142: rename dc to dc/d14/d21/d23/d2a/d2e 22 2024-04-20T21:58:24.826 INFO:tasks.workunit.client.0.smithi142.stdout:3/154: link d6/d15/d1e/c28 d6/d15/c2f 0 2024-04-20T21:58:24.829 INFO:tasks.workunit.client.0.smithi142.stdout:4/183: creat d1/f39 x:0 0 0 2024-04-20T21:58:24.832 INFO:tasks.workunit.client.0.smithi142.stdout:5/143: readlink dc/d14/d21/d23/l2c 0 2024-04-20T21:58:24.832 INFO:tasks.workunit.client.0.smithi142.stdout:4/184: fsync d1/f13 0 2024-04-20T21:58:24.834 INFO:tasks.workunit.client.0.smithi142.stdout:4/185: readlink d1/db/d17/l1b 0 2024-04-20T21:58:24.838 INFO:tasks.workunit.client.0.smithi142.stdout:3/155: mkdir d6/d15/d30 0 2024-04-20T21:58:24.848 INFO:tasks.workunit.client.0.smithi142.stdout:9/270: dwrite d0/fc [4194304,4194304] 0 2024-04-20T21:58:24.858 INFO:tasks.workunit.client.0.smithi142.stdout:1/211: creat d2/dd/d17/f47 x:0 0 0 2024-04-20T21:58:24.859 INFO:tasks.workunit.client.0.smithi142.stdout:5/144: dread dc/d14/d21/f27 [0,4194304] 0 2024-04-20T21:58:24.860 INFO:tasks.workunit.client.0.smithi142.stdout:6/187: dwrite d1/d5/f12 [4194304,4194304] 0 2024-04-20T21:58:24.865 INFO:tasks.workunit.client.0.smithi142.stdout:2/303: truncate d3/d24/f3f 2278790 0 2024-04-20T21:58:24.865 INFO:tasks.workunit.client.0.smithi142.stdout:7/201: dwrite d4/d9/d1c/f23 [0,4194304] 0 2024-04-20T21:58:24.866 INFO:tasks.workunit.client.0.smithi142.stdout:4/186: dwrite d1/d6/f1a [0,4194304] 0 2024-04-20T21:58:24.867 INFO:tasks.workunit.client.0.smithi142.stdout:3/156: getdents d6/d15/d30 0 2024-04-20T21:58:24.867 INFO:tasks.workunit.client.0.smithi142.stdout:9/271: rename d0/l2e to d0/d3c/l59 0 2024-04-20T21:58:24.870 INFO:tasks.workunit.client.0.smithi142.stdout:6/188: stat d1/d5/c40 0 2024-04-20T21:58:24.871 INFO:tasks.workunit.client.0.smithi142.stdout:4/187: fdatasync d1/f13 0 2024-04-20T21:58:24.878 INFO:tasks.workunit.client.0.smithi142.stdout:3/157: fdatasync d6/d15/d1e/f22 0 2024-04-20T21:58:24.878 INFO:tasks.workunit.client.0.smithi142.stdout:7/202: dread d4/d9/d1b/f1f [0,4194304] 0 2024-04-20T21:58:24.878 INFO:tasks.workunit.client.0.smithi142.stdout:9/272: stat d0/d2a/f2d 0 2024-04-20T21:58:24.880 INFO:tasks.workunit.client.0.smithi142.stdout:5/145: chown dc/d14/d25/f2d 1 1 2024-04-20T21:58:24.899 INFO:tasks.workunit.client.0.smithi142.stdout:0/216: dread d5/f9 [0,4194304] 0 2024-04-20T21:58:24.900 INFO:tasks.workunit.client.0.smithi142.stdout:9/273: dread d0/f24 [0,4194304] 0 2024-04-20T21:58:24.902 INFO:tasks.workunit.client.0.smithi142.stdout:9/274: fdatasync d0/d2a/d39/f56 0 2024-04-20T21:58:24.905 INFO:tasks.workunit.client.0.smithi142.stdout:9/275: write d0/d2a/f40 [103714,85407] 0 2024-04-20T21:58:24.906 INFO:tasks.workunit.client.0.smithi142.stdout:1/212: dwrite d2/dd/d17/d1b/d22/f46 [0,4194304] 0 2024-04-20T21:58:24.906 INFO:tasks.workunit.client.0.smithi142.stdout:0/217: dread d5/d13/f14 [0,4194304] 0 2024-04-20T21:58:24.910 INFO:tasks.workunit.client.0.smithi142.stdout:8/157: truncate d0/d17/f19 868061 0 2024-04-20T21:58:24.912 INFO:tasks.workunit.client.0.smithi142.stdout:2/304: mkdir d3/d24/d3c/d66 0 2024-04-20T21:58:24.922 INFO:tasks.workunit.client.0.smithi142.stdout:3/158: creat d6/f31 x:0 0 0 2024-04-20T21:58:24.926 INFO:tasks.workunit.client.0.smithi142.stdout:6/189: mkdir d1/d5/d3a/d43 0 2024-04-20T21:58:24.932 INFO:tasks.workunit.client.0.smithi142.stdout:1/213: dwrite d2/dd/d17/d1b/f1d [0,4194304] 0 2024-04-20T21:58:24.942 INFO:tasks.workunit.client.0.smithi142.stdout:4/188: dwrite f0 [4194304,4194304] 0 2024-04-20T21:58:24.942 INFO:tasks.workunit.client.0.smithi142.stdout:5/146: read f7 [985171,99657] 0 2024-04-20T21:58:24.944 INFO:tasks.workunit.client.0.smithi142.stdout:5/147: write f2 [4445869,57803] 0 2024-04-20T21:58:24.949 INFO:tasks.workunit.client.0.smithi142.stdout:3/159: dwrite d6/fc [0,4194304] 0 2024-04-20T21:58:24.954 INFO:tasks.workunit.client.0.smithi142.stdout:9/276: creat d0/d3c/f5a x:0 0 0 2024-04-20T21:58:24.960 INFO:tasks.workunit.client.0.smithi142.stdout:2/305: dread d3/d24/f43 [4194304,4194304] 0 2024-04-20T21:58:24.960 INFO:tasks.workunit.client.0.smithi142.stdout:8/158: creat d0/d29/f37 x:0 0 0 2024-04-20T21:58:24.973 INFO:tasks.workunit.client.0.smithi142.stdout:1/214: creat d2/dd/d17/d1b/d22/d13/f48 x:0 0 0 2024-04-20T21:58:24.976 INFO:tasks.workunit.client.0.smithi142.stdout:6/190: read d1/f23 [4048401,51826] 0 2024-04-20T21:58:24.978 INFO:tasks.workunit.client.0.smithi142.stdout:6/191: stat d1/d2f 0 2024-04-20T21:58:24.983 INFO:tasks.workunit.client.0.smithi142.stdout:3/160: unlink d6/c29 0 2024-04-20T21:58:24.985 INFO:tasks.workunit.client.0.smithi142.stdout:9/277: creat d0/d2a/d39/d50/f5b x:0 0 0 2024-04-20T21:58:24.986 INFO:tasks.workunit.client.0.smithi142.stdout:2/306: dwrite d3/d5/f4b [0,4194304] 0 2024-04-20T21:58:24.994 INFO:tasks.workunit.client.0.smithi142.stdout:2/307: truncate d3/d5/d19/f59 136517 0 2024-04-20T21:58:24.995 INFO:tasks.workunit.client.0.smithi142.stdout:5/148: dwrite dc/d14/f1e [0,4194304] 0 2024-04-20T21:58:24.995 INFO:tasks.workunit.client.0.smithi142.stdout:2/308: read - d3/d9/d34/f56 zero size 2024-04-20T21:58:24.997 INFO:tasks.workunit.client.0.smithi142.stdout:2/309: dread - d3/d24/f5f zero size 2024-04-20T21:58:24.999 INFO:tasks.workunit.client.0.smithi142.stdout:8/159: creat d0/d29/f38 x:0 0 0 2024-04-20T21:58:25.000 INFO:tasks.workunit.client.0.smithi142.stdout:2/310: truncate d3/d5/f60 262470 0 2024-04-20T21:58:25.003 INFO:tasks.workunit.client.0.smithi142.stdout:7/203: link d4/d9/l1e d4/d9/l46 0 2024-04-20T21:58:25.006 INFO:tasks.workunit.client.0.smithi142.stdout:7/204: write d4/d9/d1c/f33 [1728663,129101] 0 2024-04-20T21:58:25.011 INFO:tasks.workunit.client.0.smithi142.stdout:6/192: stat d1/f15 0 2024-04-20T21:58:25.015 INFO:tasks.workunit.client.0.smithi142.stdout:2/311: dread d3/d5/f4b [0,4194304] 0 2024-04-20T21:58:25.016 INFO:tasks.workunit.client.0.smithi142.stdout:3/161: mkdir d6/d32 0 2024-04-20T21:58:25.023 INFO:tasks.workunit.client.0.smithi142.stdout:5/149: rename dc/f19 to dc/f2f 0 2024-04-20T21:58:25.027 INFO:tasks.workunit.client.0.smithi142.stdout:8/160: creat d0/d22/f39 x:0 0 0 2024-04-20T21:58:25.033 INFO:tasks.workunit.client.0.smithi142.stdout:3/162: dwrite d6/f18 [0,4194304] 0 2024-04-20T21:58:25.034 INFO:tasks.workunit.client.0.smithi142.stdout:6/193: dwrite d1/d5/f3c [0,4194304] 0 2024-04-20T21:58:25.039 INFO:tasks.workunit.client.0.smithi142.stdout:5/150: rmdir dc/d14/d21/d23 39 2024-04-20T21:58:25.040 INFO:tasks.workunit.client.0.smithi142.stdout:0/218: creat d5/f53 x:0 0 0 2024-04-20T21:58:25.046 INFO:tasks.workunit.client.0.smithi142.stdout:7/205: mkdir d4/d9/d11/d47 0 2024-04-20T21:58:25.053 INFO:tasks.workunit.client.0.smithi142.stdout:6/194: creat d1/d11/f44 x:0 0 0 2024-04-20T21:58:25.062 INFO:tasks.workunit.client.0.smithi142.stdout:0/219: mkdir d5/d1c/d3c/d54 0 2024-04-20T21:58:25.065 INFO:tasks.workunit.client.0.smithi142.stdout:8/161: creat d0/d17/d35/f3a x:0 0 0 2024-04-20T21:58:25.065 INFO:tasks.workunit.client.0.smithi142.stdout:0/220: chown d5/d13/d1e/d23/d24/d48/c4b 255229 1 2024-04-20T21:58:25.068 INFO:tasks.workunit.client.0.smithi142.stdout:7/206: creat d4/f48 x:0 0 0 2024-04-20T21:58:25.069 INFO:tasks.workunit.client.0.smithi142.stdout:3/163: dwrite f2 [4194304,4194304] 0 2024-04-20T21:58:25.071 INFO:tasks.workunit.client.0.smithi142.stdout:1/215: link d2/dd/d17/d1b/d22/d13/c3a d2/dd/d17/d1b/d22/c49 0 2024-04-20T21:58:25.071 INFO:tasks.workunit.client.0.smithi142.stdout:0/221: write d5/d1c/d3c/f43 [3227383,33720] 0 2024-04-20T21:58:25.074 INFO:tasks.workunit.client.0.smithi142.stdout:6/195: dwrite d1/d5/f3c [0,4194304] 0 2024-04-20T21:58:25.077 INFO:tasks.workunit.client.0.smithi142.stdout:2/312: unlink d3/l46 0 2024-04-20T21:58:25.079 INFO:tasks.workunit.client.0.smithi142.stdout:9/278: getdents d0/d3c 0 2024-04-20T21:58:25.082 INFO:tasks.workunit.client.0.smithi142.stdout:9/279: truncate d0/d3c/f5a 556524 0 2024-04-20T21:58:25.094 INFO:tasks.workunit.client.0.smithi142.stdout:1/216: mknod d2/dd/d1c/c4a 0 2024-04-20T21:58:25.096 INFO:tasks.workunit.client.0.smithi142.stdout:7/207: mknod d4/d9/d1b/c49 0 2024-04-20T21:58:25.096 INFO:tasks.workunit.client.0.smithi142.stdout:1/217: dread - d2/dd/d17/d1b/d22/d13/f48 zero size 2024-04-20T21:58:25.098 INFO:tasks.workunit.client.0.smithi142.stdout:6/196: rmdir d1/d1d/d2b 39 2024-04-20T21:58:25.100 INFO:tasks.workunit.client.0.smithi142.stdout:6/197: dread - d1/d5/d1a/f2e zero size 2024-04-20T21:58:25.100 INFO:tasks.workunit.client.0.smithi142.stdout:1/218: dread d2/dd/d17/f24 [0,4194304] 0 2024-04-20T21:58:25.101 INFO:tasks.workunit.client.0.smithi142.stdout:2/313: mkdir d3/d5/d67 0 2024-04-20T21:58:25.102 INFO:tasks.workunit.client.0.smithi142.stdout:5/151: mkdir dc/d14/d21/d23/d2a/d30 0 2024-04-20T21:58:25.104 INFO:tasks.workunit.client.0.smithi142.stdout:9/280: creat d0/d2a/d39/f5c x:0 0 0 2024-04-20T21:58:25.106 INFO:tasks.workunit.client.0.smithi142.stdout:9/281: dread - d0/d36/f4c zero size 2024-04-20T21:58:25.107 INFO:tasks.workunit.client.0.smithi142.stdout:3/164: mkdir d6/d32/d33 0 2024-04-20T21:58:25.108 INFO:tasks.workunit.client.0.smithi142.stdout:7/208: fdatasync d4/d9/d11/d22/f2b 0 2024-04-20T21:58:25.108 INFO:tasks.workunit.client.0.smithi142.stdout:3/165: dread - d6/f25 zero size 2024-04-20T21:58:25.110 INFO:tasks.workunit.client.0.smithi142.stdout:6/198: readlink d1/d1d/d2b/l2c 0 2024-04-20T21:58:25.112 INFO:tasks.workunit.client.0.smithi142.stdout:2/314: symlink d3/d9/d34/l68 0 2024-04-20T21:58:25.116 INFO:tasks.workunit.client.0.smithi142.stdout:9/282: creat d0/d36/d55/f5d x:0 0 0 2024-04-20T21:58:25.122 INFO:tasks.workunit.client.0.smithi142.stdout:6/199: creat d1/d5/d3a/f45 x:0 0 0 2024-04-20T21:58:25.122 INFO:tasks.workunit.client.0.smithi142.stdout:7/209: dread d4/f2d [0,4194304] 0 2024-04-20T21:58:25.123 INFO:tasks.workunit.client.0.smithi142.stdout:7/210: read - d4/f35 zero size 2024-04-20T21:58:25.123 INFO:tasks.workunit.client.0.smithi142.stdout:3/166: dread d6/f18 [0,4194304] 0 2024-04-20T21:58:25.127 INFO:tasks.workunit.client.0.smithi142.stdout:1/219: creat d2/dd/d17/d1b/d22/f4b x:0 0 0 2024-04-20T21:58:25.130 INFO:tasks.workunit.client.0.smithi142.stdout:1/220: write d2/dd/d17/f24 [757816,127930] 0 2024-04-20T21:58:25.130 INFO:tasks.workunit.client.0.smithi142.stdout:3/167: creat d6/f34 x:0 0 0 2024-04-20T21:58:25.134 INFO:tasks.workunit.client.0.smithi142.stdout:3/168: truncate d6/d15/d1e/f22 986109 0 2024-04-20T21:58:25.135 INFO:tasks.workunit.client.0.smithi142.stdout:0/222: rmdir d5 39 2024-04-20T21:58:25.135 INFO:tasks.workunit.client.0.smithi142.stdout:7/211: creat d4/d9/d1c/f4a x:0 0 0 2024-04-20T21:58:25.140 INFO:tasks.workunit.client.0.smithi142.stdout:1/221: creat d2/dd/d17/d1b/d22/d20/f4c x:0 0 0 2024-04-20T21:58:25.147 INFO:tasks.workunit.client.0.smithi142.stdout:2/315: dread d3/d24/d3c/f38 [0,4194304] 0 2024-04-20T21:58:25.147 INFO:tasks.workunit.client.0.smithi142.stdout:1/222: symlink d2/dd/d17/d1b/l4d 0 2024-04-20T21:58:25.148 INFO:tasks.workunit.client.0.smithi142.stdout:3/169: getdents d6/d32/d33 0 2024-04-20T21:58:25.148 INFO:tasks.workunit.client.0.smithi142.stdout:6/200: dwrite d1/d11/fa [0,4194304] 0 2024-04-20T21:58:25.153 INFO:tasks.workunit.client.0.smithi142.stdout:0/223: mkdir d5/d13/d1e/d23/d24/d48/d55 0 2024-04-20T21:58:25.155 INFO:tasks.workunit.client.0.smithi142.stdout:8/162: truncate d0/d1c/f2d 2274300 0 2024-04-20T21:58:25.156 INFO:tasks.workunit.client.0.smithi142.stdout:3/170: creat d6/f35 x:0 0 0 2024-04-20T21:58:25.158 INFO:tasks.workunit.client.0.smithi142.stdout:7/212: dwrite d4/d9/d1b/f2c [0,4194304] 0 2024-04-20T21:58:25.164 INFO:tasks.workunit.client.0.smithi142.stdout:7/213: stat d4/d9/d1b/c49 0 2024-04-20T21:58:25.164 INFO:tasks.workunit.client.0.smithi142.stdout:9/283: rmdir d0/d36/d55 39 2024-04-20T21:58:25.165 INFO:tasks.workunit.client.0.smithi142.stdout:5/152: truncate dc/f1d 1505728 0 2024-04-20T21:58:25.166 INFO:tasks.workunit.client.0.smithi142.stdout:7/214: fsync d4/d9/d11/f3c 0 2024-04-20T21:58:25.168 INFO:tasks.workunit.client.0.smithi142.stdout:8/163: creat d0/d17/f3b x:0 0 0 2024-04-20T21:58:25.178 INFO:tasks.workunit.client.0.smithi142.stdout:9/284: creat d0/d2a/d39/f5e x:0 0 0 2024-04-20T21:58:25.183 INFO:tasks.workunit.client.0.smithi142.stdout:7/215: chown d4/d9/d11/l1a 151800499 1 2024-04-20T21:58:25.184 INFO:tasks.workunit.client.0.smithi142.stdout:9/285: mknod d0/d3c/d4d/c5f 0 2024-04-20T21:58:25.186 INFO:tasks.workunit.client.0.smithi142.stdout:0/224: dwrite d5/d1c/d29/f4f [0,4194304] 0 2024-04-20T21:58:25.196 INFO:tasks.workunit.client.0.smithi142.stdout:0/225: dread - d5/d13/d1e/d23/d2c/f41 zero size 2024-04-20T21:58:25.200 INFO:tasks.workunit.client.0.smithi142.stdout:3/171: truncate d6/f11 3321709 0 2024-04-20T21:58:25.200 INFO:tasks.workunit.client.0.smithi142.stdout:8/164: rmdir d0/d17 39 2024-04-20T21:58:25.203 INFO:tasks.workunit.client.0.smithi142.stdout:3/172: fdatasync d6/f31 0 2024-04-20T21:58:25.210 INFO:tasks.workunit.client.0.smithi142.stdout:7/216: dwrite d4/d9/d1c/f4a [0,4194304] 0 2024-04-20T21:58:25.210 INFO:tasks.workunit.client.0.smithi142.stdout:6/201: dread d1/d1d/f22 [0,4194304] 0 2024-04-20T21:58:25.211 INFO:tasks.workunit.client.0.smithi142.stdout:0/226: mknod d5/d13/d1e/d23/d24/c56 0 2024-04-20T21:58:25.211 INFO:tasks.workunit.client.0.smithi142.stdout:9/286: link d0/l17 d0/d2a/d39/d50/l60 0 2024-04-20T21:58:25.211 INFO:tasks.workunit.client.0.smithi142.stdout:2/316: dread d3/f1f [0,4194304] 0 2024-04-20T21:58:25.213 INFO:tasks.workunit.client.0.smithi142.stdout:8/165: creat d0/d29/f3c x:0 0 0 2024-04-20T21:58:25.219 INFO:tasks.workunit.client.0.smithi142.stdout:0/227: creat d5/d1d/f57 x:0 0 0 2024-04-20T21:58:25.223 INFO:tasks.workunit.client.0.smithi142.stdout:2/317: rmdir d3/d5 39 2024-04-20T21:58:25.234 INFO:tasks.workunit.client.0.smithi142.stdout:3/173: dwrite d6/f35 [0,4194304] 0 2024-04-20T21:58:25.236 INFO:tasks.workunit.client.0.smithi142.stdout:2/318: write d3/d5/d19/f30 [2887636,112688] 0 2024-04-20T21:58:25.239 INFO:tasks.workunit.client.0.smithi142.stdout:9/287: dwrite d0/d36/f41 [4194304,4194304] 0 2024-04-20T21:58:25.243 INFO:tasks.workunit.client.0.smithi142.stdout:6/202: rename d1/d1d to d1/d46 0 2024-04-20T21:58:25.251 INFO:tasks.workunit.client.0.smithi142.stdout:3/174: rename d6/d15/l1f to d6/d32/l36 0 2024-04-20T21:58:25.252 INFO:tasks.workunit.client.0.smithi142.stdout:7/217: truncate d4/d9/d1c/f4a 1259790 0 2024-04-20T21:58:25.252 INFO:tasks.workunit.client.0.smithi142.stdout:8/166: dread d0/d17/f1f [0,4194304] 0 2024-04-20T21:58:25.255 INFO:tasks.workunit.client.0.smithi142.stdout:7/218: chown d4/d9/d11/f3c 1955 1 2024-04-20T21:58:25.255 INFO:tasks.workunit.client.0.smithi142.stdout:8/167: chown d0/ce 5542 1 2024-04-20T21:58:25.262 INFO:tasks.workunit.client.0.smithi142.stdout:6/203: creat d1/d2f/d35/f47 x:0 0 0 2024-04-20T21:58:25.263 INFO:tasks.workunit.client.0.smithi142.stdout:3/175: unlink d6/ff 0 2024-04-20T21:58:25.264 INFO:tasks.workunit.client.0.smithi142.stdout:9/288: mkdir d0/d36/d61 0 2024-04-20T21:58:25.267 INFO:tasks.workunit.client.0.smithi142.stdout:6/204: mkdir d1/d2f/d35/d48 0 2024-04-20T21:58:25.270 INFO:tasks.workunit.client.0.smithi142.stdout:3/176: mkdir d6/d15/d30/d37 0 2024-04-20T21:58:25.273 INFO:tasks.workunit.client.0.smithi142.stdout:7/219: dread d4/d9/f42 [0,4194304] 0 2024-04-20T21:58:25.273 INFO:tasks.workunit.client.0.smithi142.stdout:8/168: truncate d0/d1c/f2d 3115658 0 2024-04-20T21:58:25.275 INFO:tasks.workunit.client.0.smithi142.stdout:9/289: rename d0/d2a/d39/d50/l60 to d0/d3c/l62 0 2024-04-20T21:58:25.277 INFO:tasks.workunit.client.0.smithi142.stdout:6/205: creat d1/f49 x:0 0 0 2024-04-20T21:58:25.278 INFO:tasks.workunit.client.0.smithi142.stdout:8/169: creat d0/d29/f3d x:0 0 0 2024-04-20T21:58:25.279 INFO:tasks.workunit.client.0.smithi142.stdout:3/177: creat d6/d15/d30/d37/f38 x:0 0 0 2024-04-20T21:58:25.279 INFO:tasks.workunit.client.0.smithi142.stdout:0/228: dread d5/f21 [0,4194304] 0 2024-04-20T21:58:25.280 INFO:tasks.workunit.client.0.smithi142.stdout:7/220: mknod d4/d9/d1c/d32/c4b 0 2024-04-20T21:58:25.281 INFO:tasks.workunit.client.0.smithi142.stdout:6/206: creat d1/d5/d1a/f4a x:0 0 0 2024-04-20T21:58:25.283 INFO:tasks.workunit.client.0.smithi142.stdout:8/170: symlink d0/d29/d36/l3e 0 2024-04-20T21:58:25.283 INFO:tasks.workunit.client.0.smithi142.stdout:3/178: truncate d6/f10 5049677 0 2024-04-20T21:58:25.284 INFO:tasks.workunit.client.0.smithi142.stdout:6/207: mkdir d1/d46/d2b/d4b 0 2024-04-20T21:58:25.285 INFO:tasks.workunit.client.0.smithi142.stdout:3/179: write d6/f2e [123181,117324] 0 2024-04-20T21:58:25.287 INFO:tasks.workunit.client.0.smithi142.stdout:7/221: rename d4/d9/d11/d22/c45 to d4/d9/d1c/c4c 0 2024-04-20T21:58:25.292 INFO:tasks.workunit.client.0.smithi142.stdout:6/208: rename d1/d5/d1a/f4a to d1/d46/d2b/d34/f4c 0 2024-04-20T21:58:25.292 INFO:tasks.workunit.client.0.smithi142.stdout:3/180: mkdir d6/d32/d39 0 2024-04-20T21:58:25.295 INFO:tasks.workunit.client.0.smithi142.stdout:3/181: write d6/f35 [2511528,107193] 0 2024-04-20T21:58:25.298 INFO:tasks.workunit.client.0.smithi142.stdout:6/209: creat d1/d2f/d35/f4d x:0 0 0 2024-04-20T21:58:25.300 INFO:tasks.workunit.client.0.smithi142.stdout:3/182: unlink d6/l13 0 2024-04-20T21:58:25.302 INFO:tasks.workunit.client.0.smithi142.stdout:0/229: dwrite d5/d13/f14 [0,4194304] 0 2024-04-20T21:58:25.306 INFO:tasks.workunit.client.0.smithi142.stdout:6/210: dread d1/d46/d2b/f2a [0,4194304] 0 2024-04-20T21:58:25.311 INFO:tasks.workunit.client.0.smithi142.stdout:7/222: dwrite d4/d9/d1b/f34 [0,4194304] 0 2024-04-20T21:58:25.313 INFO:tasks.workunit.client.0.smithi142.stdout:7/223: fdatasync d4/d9/f37 0 2024-04-20T21:58:25.326 INFO:tasks.workunit.client.0.smithi142.stdout:0/230: creat d5/f58 x:0 0 0 2024-04-20T21:58:25.331 INFO:tasks.workunit.client.0.smithi142.stdout:7/224: mkdir d4/d9/d1b/d4d 0 2024-04-20T21:58:25.332 INFO:tasks.workunit.client.0.smithi142.stdout:8/171: truncate d0/d17/f1f 682880 0 2024-04-20T21:58:25.333 INFO:tasks.workunit.client.0.smithi142.stdout:0/231: fdatasync d5/f21 0 2024-04-20T21:58:25.337 INFO:tasks.workunit.client.0.smithi142.stdout:8/172: mkdir d0/d22/d3f 0 2024-04-20T21:58:25.339 INFO:tasks.workunit.client.0.smithi142.stdout:3/183: rmdir d6 39 2024-04-20T21:58:25.341 INFO:tasks.workunit.client.0.smithi142.stdout:8/173: mknod d0/d29/c40 0 2024-04-20T21:58:25.347 INFO:tasks.workunit.client.0.smithi142.stdout:6/211: truncate d1/d5/f26 2052562 0 2024-04-20T21:58:25.350 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:25 smithi164 ceph-mon[23506]: pgmap v34: 65 pgs: 65 active+clean; 519 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 55 MiB/s wr, 259 op/s 2024-04-20T21:58:25.350 INFO:tasks.workunit.client.0.smithi142.stdout:0/232: getdents d5/d13 0 2024-04-20T21:58:25.351 INFO:tasks.workunit.client.0.smithi142.stdout:7/225: dwrite d4/d9/d1c/f33 [0,4194304] 0 2024-04-20T21:58:25.357 INFO:tasks.workunit.client.0.smithi142.stdout:0/233: chown d5/d13/l15 15699 1 2024-04-20T21:58:25.358 INFO:tasks.workunit.client.0.smithi142.stdout:7/226: symlink d4/d9/d11/d22/l4e 0 2024-04-20T21:58:25.359 INFO:tasks.workunit.client.0.smithi142.stdout:3/184: rmdir d6/d32/d33 0 2024-04-20T21:58:25.360 INFO:tasks.workunit.client.0.smithi142.stdout:8/174: getdents d0/d17/d35 0 2024-04-20T21:58:25.361 INFO:tasks.workunit.client.0.smithi142.stdout:8/175: chown d0/f26 2358710 1 2024-04-20T21:58:25.363 INFO:tasks.workunit.client.0.smithi142.stdout:6/212: link d1/d5/f12 d1/d2f/f4e 0 2024-04-20T21:58:25.371 INFO:tasks.workunit.client.0.smithi142.stdout:3/185: creat d6/f3a x:0 0 0 2024-04-20T21:58:25.372 INFO:tasks.workunit.client.0.smithi142.stdout:8/176: rename d0/f11 to d0/d1c/f41 0 2024-04-20T21:58:25.378 INFO:tasks.workunit.client.0.smithi142.stdout:7/227: link d4/f27 d4/d9/d1c/f4f 0 2024-04-20T21:58:25.381 INFO:tasks.workunit.client.0.smithi142.stdout:3/186: rmdir d6/d32 39 2024-04-20T21:58:25.381 INFO:tasks.workunit.client.0.smithi142.stdout:7/228: dread d4/d9/d1c/f21 [0,4194304] 0 2024-04-20T21:58:25.383 INFO:tasks.workunit.client.0.smithi142.stdout:0/234: creat d5/d13/d1e/f59 x:0 0 0 2024-04-20T21:58:25.384 INFO:tasks.workunit.client.0.smithi142.stdout:7/229: write d4/d9/d11/f3c [865916,64] 0 2024-04-20T21:58:25.386 INFO:tasks.workunit.client.0.smithi142.stdout:8/177: mkdir d0/d42 0 2024-04-20T21:58:25.386 INFO:tasks.workunit.client.0.smithi142.stdout:0/235: write d5/d13/d1e/d23/d2c/f41 [78185,6712] 0 2024-04-20T21:58:25.392 INFO:tasks.workunit.client.0.smithi142.stdout:7/230: unlink d4/l43 0 2024-04-20T21:58:25.392 INFO:tasks.workunit.client.0.smithi142.stdout:8/178: symlink d0/d22/l43 0 2024-04-20T21:58:25.392 INFO:tasks.workunit.client.0.smithi142.stdout:6/213: link d1/d11/c18 d1/d5/d1a/d39/c4f 0 2024-04-20T21:58:25.393 INFO:tasks.workunit.client.0.smithi142.stdout:8/179: readlink d0/l16 0 2024-04-20T21:58:25.393 INFO:tasks.workunit.client.0.smithi142.stdout:6/214: stat d1/d5/c40 0 2024-04-20T21:58:25.394 INFO:tasks.workunit.client.0.smithi142.stdout:6/215: chown d1/d11/cd 2053961 1 2024-04-20T21:58:25.394 INFO:tasks.workunit.client.0.smithi142.stdout:0/236: creat d5/d1c/d3c/f5a x:0 0 0 2024-04-20T21:58:25.396 INFO:tasks.workunit.client.0.smithi142.stdout:8/180: mkdir d0/d1c/d44 0 2024-04-20T21:58:25.396 INFO:tasks.workunit.client.0.smithi142.stdout:7/231: chown d4/le 87095 1 2024-04-20T21:58:25.398 INFO:tasks.workunit.client.0.smithi142.stdout:3/187: rename d6/d15/c2c to d6/d32/d39/c3b 0 2024-04-20T21:58:25.399 INFO:tasks.workunit.client.0.smithi142.stdout:7/232: chown d4/d9/l46 515913 1 2024-04-20T21:58:25.401 INFO:tasks.workunit.client.0.smithi142.stdout:6/216: mknod d1/d5/d1a/d3e/c50 0 2024-04-20T21:58:25.402 INFO:tasks.workunit.client.0.smithi142.stdout:0/237: creat d5/d1c/d3c/d54/f5b x:0 0 0 2024-04-20T21:58:25.403 INFO:tasks.workunit.client.0.smithi142.stdout:8/181: read d0/d1c/f2d [335538,59248] 0 2024-04-20T21:58:25.403 INFO:tasks.workunit.client.0.smithi142.stdout:3/188: mknod d6/d32/d39/c3c 0 2024-04-20T21:58:25.404 INFO:tasks.workunit.client.0.smithi142.stdout:0/238: fdatasync d5/d1c/d29/f4f 0 2024-04-20T21:58:25.405 INFO:tasks.workunit.client.0.smithi142.stdout:6/217: creat d1/d1b/f51 x:0 0 0 2024-04-20T21:58:25.405 INFO:tasks.workunit.client.0.smithi142.stdout:0/239: fdatasync d5/f21 0 2024-04-20T21:58:25.406 INFO:tasks.workunit.client.0.smithi142.stdout:7/233: creat d4/d9/d11/d47/f50 x:0 0 0 2024-04-20T21:58:25.406 INFO:tasks.workunit.client.0.smithi142.stdout:3/189: stat d6/l2a 0 2024-04-20T21:58:25.408 INFO:tasks.workunit.client.0.smithi142.stdout:8/182: mkdir d0/d29/d36/d45 0 2024-04-20T21:58:25.409 INFO:tasks.workunit.client.0.smithi142.stdout:6/218: creat d1/d5/d1a/d39/f52 x:0 0 0 2024-04-20T21:58:25.410 INFO:tasks.workunit.client.0.smithi142.stdout:7/234: creat d4/d9/d1b/f51 x:0 0 0 2024-04-20T21:58:25.412 INFO:tasks.workunit.client.0.smithi142.stdout:0/240: rename d5/fa to d5/d1c/f5c 0 2024-04-20T21:58:25.412 INFO:tasks.workunit.client.0.smithi142.stdout:7/235: write d4/d9/f30 [452431,17682] 0 2024-04-20T21:58:25.415 INFO:tasks.workunit.client.0.smithi142.stdout:0/241: chown d5/d13/d1e/d23/d2c/f41 7209911 1 2024-04-20T21:58:25.415 INFO:tasks.workunit.client.0.smithi142.stdout:8/183: fsync d0/d17/f1a 0 2024-04-20T21:58:25.416 INFO:tasks.workunit.client.0.smithi142.stdout:3/190: creat d6/d15/d30/d37/f3d x:0 0 0 2024-04-20T21:58:25.417 INFO:tasks.workunit.client.0.smithi142.stdout:0/242: write d5/f58 [239972,59189] 0 2024-04-20T21:58:25.418 INFO:tasks.workunit.client.0.smithi142.stdout:7/236: creat d4/d9/d1c/d32/f52 x:0 0 0 2024-04-20T21:58:25.419 INFO:tasks.workunit.client.0.smithi142.stdout:8/184: write d0/d22/f39 [172561,67334] 0 2024-04-20T21:58:25.422 INFO:tasks.workunit.client.0.smithi142.stdout:3/191: mknod d6/d32/c3e 0 2024-04-20T21:58:25.423 INFO:tasks.workunit.client.0.smithi142.stdout:7/237: write d4/d9/d11/d22/f2b [1650501,28638] 0 2024-04-20T21:58:25.429 INFO:tasks.workunit.client.0.smithi142.stdout:3/192: symlink d6/d15/d30/l3f 0 2024-04-20T21:58:25.430 INFO:tasks.workunit.client.0.smithi142.stdout:6/219: dwrite d1/d5/d1a/f2e [0,4194304] 0 2024-04-20T21:58:25.432 INFO:tasks.workunit.client.0.smithi142.stdout:8/185: creat d0/d1c/d44/f46 x:0 0 0 2024-04-20T21:58:25.436 INFO:tasks.workunit.client.0.smithi142.stdout:8/186: read d0/f3 [3563254,55978] 0 2024-04-20T21:58:25.437 INFO:tasks.workunit.client.0.smithi142.stdout:0/243: dread d5/d1c/f26 [0,4194304] 0 2024-04-20T21:58:25.438 INFO:tasks.workunit.client.0.smithi142.stdout:7/238: creat d4/d9/d1b/d4d/f53 x:0 0 0 2024-04-20T21:58:25.439 INFO:tasks.workunit.client.0.smithi142.stdout:6/220: mknod d1/d5/d3a/d43/c53 0 2024-04-20T21:58:25.442 INFO:tasks.workunit.client.0.smithi142.stdout:8/187: read d0/d17/f1f [75069,72331] 0 2024-04-20T21:58:25.444 INFO:tasks.workunit.client.0.smithi142.stdout:7/239: mknod d4/d9/d1b/d4d/c54 0 2024-04-20T21:58:25.445 INFO:tasks.workunit.client.0.smithi142.stdout:3/193: dread d6/f8 [0,4194304] 0 2024-04-20T21:58:25.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:25 smithi142 ceph-mon[15828]: pgmap v34: 65 pgs: 65 active+clean; 519 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 55 MiB/s wr, 259 op/s 2024-04-20T21:58:25.446 INFO:tasks.workunit.client.0.smithi142.stdout:6/221: rename d1/d5/d1a/f2e to d1/d46/d2b/f54 0 2024-04-20T21:58:25.449 INFO:tasks.workunit.client.0.smithi142.stdout:8/188: creat d0/d29/d36/f47 x:0 0 0 2024-04-20T21:58:25.453 INFO:tasks.workunit.client.0.smithi142.stdout:7/240: creat d4/d9/d1b/f55 x:0 0 0 2024-04-20T21:58:25.455 INFO:tasks.workunit.client.0.smithi142.stdout:3/194: creat d6/d15/d30/f40 x:0 0 0 2024-04-20T21:58:25.456 INFO:tasks.workunit.client.0.smithi142.stdout:3/195: fdatasync d6/f31 0 2024-04-20T21:58:25.458 INFO:tasks.workunit.client.0.smithi142.stdout:3/196: truncate d6/f31 606126 0 2024-04-20T21:58:25.458 INFO:tasks.workunit.client.0.smithi142.stdout:8/189: unlink d0/d1c/f33 0 2024-04-20T21:58:25.459 INFO:tasks.workunit.client.0.smithi142.stdout:3/197: chown d6/d15/d30/d37 7430566 1 2024-04-20T21:58:25.460 INFO:tasks.workunit.client.0.smithi142.stdout:3/198: readlink d6/l2a 0 2024-04-20T21:58:25.460 INFO:tasks.workunit.client.0.smithi142.stdout:8/190: write d0/f20 [862156,117399] 0 2024-04-20T21:58:25.467 INFO:tasks.workunit.client.0.smithi142.stdout:6/222: dwrite d1/d5/f14 [0,4194304] 0 2024-04-20T21:58:25.467 INFO:tasks.workunit.client.0.smithi142.stdout:4/189: sync 2024-04-20T21:58:25.469 INFO:tasks.workunit.client.0.smithi142.stdout:0/244: dread d5/f8 [0,4194304] 0 2024-04-20T21:58:25.472 INFO:tasks.workunit.client.0.smithi142.stdout:3/199: rename d6/d15/c20 to d6/d15/d30/d37/c41 0 2024-04-20T21:58:25.475 INFO:tasks.workunit.client.0.smithi142.stdout:3/200: fsync f2 0 2024-04-20T21:58:25.475 INFO:tasks.workunit.client.0.smithi142.stdout:6/223: symlink d1/d46/d2b/l55 0 2024-04-20T21:58:25.478 INFO:tasks.workunit.client.0.smithi142.stdout:4/190: creat d1/d6/d30/f3a x:0 0 0 2024-04-20T21:58:25.480 INFO:tasks.workunit.client.0.smithi142.stdout:3/201: write d6/d15/d1e/f22 [1149319,100523] 0 2024-04-20T21:58:25.482 INFO:tasks.workunit.client.0.smithi142.stdout:3/202: fsync d6/d15/d30/d37/f38 0 2024-04-20T21:58:25.484 INFO:tasks.workunit.client.0.smithi142.stdout:4/191: creat d1/d12/da/d1c/f3b x:0 0 0 2024-04-20T21:58:25.486 INFO:tasks.workunit.client.0.smithi142.stdout:8/191: rmdir d0/d29/d36 39 2024-04-20T21:58:25.495 INFO:tasks.workunit.client.0.smithi142.stdout:8/192: symlink d0/d29/d36/d45/l48 0 2024-04-20T21:58:25.499 INFO:tasks.workunit.client.0.smithi142.stdout:8/193: symlink d0/d29/l49 0 2024-04-20T21:58:25.502 INFO:tasks.workunit.client.0.smithi142.stdout:8/194: truncate d0/d17/f34 2515 0 2024-04-20T21:58:25.502 INFO:tasks.workunit.client.0.smithi142.stdout:3/203: dwrite d6/f18 [0,4194304] 0 2024-04-20T21:58:25.504 INFO:tasks.workunit.client.0.smithi142.stdout:3/204: dread - d6/d15/d30/d37/f3d zero size 2024-04-20T21:58:25.509 INFO:tasks.workunit.client.0.smithi142.stdout:8/195: creat d0/d29/f4a x:0 0 0 2024-04-20T21:58:25.509 INFO:tasks.workunit.client.0.smithi142.stdout:6/224: dread d1/d5/f3d [0,4194304] 0 2024-04-20T21:58:25.509 INFO:tasks.workunit.client.0.smithi142.stdout:3/205: creat d6/d32/f42 x:0 0 0 2024-04-20T21:58:25.512 INFO:tasks.workunit.client.0.smithi142.stdout:6/225: write d1/d5/f37 [1012840,114173] 0 2024-04-20T21:58:25.512 INFO:tasks.workunit.client.0.smithi142.stdout:3/206: truncate d6/f34 787632 0 2024-04-20T21:58:25.514 INFO:tasks.workunit.client.0.smithi142.stdout:8/196: creat d0/f4b x:0 0 0 2024-04-20T21:58:25.514 INFO:tasks.workunit.client.0.smithi142.stdout:3/207: chown d6/d32 4023894 1 2024-04-20T21:58:25.517 INFO:tasks.workunit.client.0.smithi142.stdout:6/226: symlink d1/d5/d3a/l56 0 2024-04-20T21:58:25.518 INFO:tasks.workunit.client.0.smithi142.stdout:8/197: fsync d0/d1c/f41 0 2024-04-20T21:58:25.518 INFO:tasks.workunit.client.0.smithi142.stdout:4/192: dwrite d1/d12/da/d1c/f34 [0,4194304] 0 2024-04-20T21:58:25.521 INFO:tasks.workunit.client.0.smithi142.stdout:3/208: mkdir d6/d15/d1e/d43 0 2024-04-20T21:58:25.524 INFO:tasks.workunit.client.0.smithi142.stdout:4/193: write d1/ff [4010204,91359] 0 2024-04-20T21:58:25.534 INFO:tasks.workunit.client.0.smithi142.stdout:4/194: rmdir d1 39 2024-04-20T21:58:25.535 INFO:tasks.workunit.client.0.smithi142.stdout:3/209: link d6/fd d6/d15/d30/f44 0 2024-04-20T21:58:25.538 INFO:tasks.workunit.client.0.smithi142.stdout:3/210: read d6/f8 [1834929,92617] 0 2024-04-20T21:58:25.539 INFO:tasks.workunit.client.0.smithi142.stdout:3/211: chown d6/f35 212814 1 2024-04-20T21:58:25.541 INFO:tasks.workunit.client.0.smithi142.stdout:8/198: dwrite d0/d17/f3b [0,4194304] 0 2024-04-20T21:58:25.544 INFO:tasks.workunit.client.0.smithi142.stdout:4/195: chown d1/c29 42933 1 2024-04-20T21:58:25.547 INFO:tasks.workunit.client.0.smithi142.stdout:3/212: creat d6/d32/f45 x:0 0 0 2024-04-20T21:58:25.548 INFO:tasks.workunit.client.0.smithi142.stdout:8/199: mkdir d0/d29/d36/d45/d4c 0 2024-04-20T21:58:25.548 INFO:tasks.workunit.client.0.smithi142.stdout:3/213: dread - d6/d32/f45 zero size 2024-04-20T21:58:25.550 INFO:tasks.workunit.client.0.smithi142.stdout:4/196: symlink d1/d12/l3c 0 2024-04-20T21:58:25.554 INFO:tasks.workunit.client.0.smithi142.stdout:3/214: fdatasync d6/d15/d30/f44 0 2024-04-20T21:58:25.560 INFO:tasks.workunit.client.0.smithi142.stdout:4/197: rmdir d1/db/d27 0 2024-04-20T21:58:25.565 INFO:tasks.workunit.client.0.smithi142.stdout:4/198: rename d1/db/d17 to d1/d12/da/d1c/d32/d3d 0 2024-04-20T21:58:25.567 INFO:tasks.workunit.client.0.smithi142.stdout:4/199: stat d1/d6/f2d 0 2024-04-20T21:58:25.570 INFO:tasks.workunit.client.0.smithi142.stdout:8/200: dwrite d0/d29/f4a [0,4194304] 0 2024-04-20T21:58:25.571 INFO:tasks.workunit.client.0.smithi142.stdout:4/200: write d1/d12/da/d1c/f25 [686390,127543] 0 2024-04-20T21:58:25.573 INFO:tasks.workunit.client.0.smithi142.stdout:8/201: chown d0/d1c 9 1 2024-04-20T21:58:25.577 INFO:tasks.workunit.client.0.smithi142.stdout:8/202: creat d0/d29/d36/d45/f4d x:0 0 0 2024-04-20T21:58:25.579 INFO:tasks.workunit.client.0.smithi142.stdout:8/203: write d0/f6 [1664436,16173] 0 2024-04-20T21:58:25.582 INFO:tasks.workunit.client.0.smithi142.stdout:3/215: dwrite d6/f11 [0,4194304] 0 2024-04-20T21:58:25.584 INFO:tasks.workunit.client.0.smithi142.stdout:3/216: chown d6/d32/f42 582520 1 2024-04-20T21:58:25.587 INFO:tasks.workunit.client.0.smithi142.stdout:3/217: write d6/d15/d30/f40 [635440,21038] 0 2024-04-20T21:58:25.593 INFO:tasks.workunit.client.0.smithi142.stdout:3/218: creat d6/d15/d30/f46 x:0 0 0 2024-04-20T21:58:25.599 INFO:tasks.workunit.client.0.smithi142.stdout:3/219: mkdir d6/d15/d47 0 2024-04-20T21:58:25.601 INFO:tasks.workunit.client.0.smithi142.stdout:3/220: dread - d6/f25 zero size 2024-04-20T21:58:25.602 INFO:tasks.workunit.client.0.smithi142.stdout:8/204: dwrite d0/f26 [0,4194304] 0 2024-04-20T21:58:25.606 INFO:tasks.workunit.client.0.smithi142.stdout:3/221: symlink d6/d15/d47/l48 0 2024-04-20T21:58:25.611 INFO:tasks.workunit.client.0.smithi142.stdout:3/222: mknod d6/d15/d1e/c49 0 2024-04-20T21:58:25.617 INFO:tasks.workunit.client.0.smithi142.stdout:3/223: rename d6/d15/d1e/f22 to d6/d15/d47/f4a 0 2024-04-20T21:58:25.619 INFO:tasks.workunit.client.0.smithi142.stdout:3/224: rmdir d6/d32/d39 39 2024-04-20T21:58:25.620 INFO:tasks.workunit.client.0.smithi142.stdout:4/201: dread d1/f13 [0,4194304] 0 2024-04-20T21:58:25.623 INFO:tasks.workunit.client.0.smithi142.stdout:3/225: unlink d6/d15/c1d 0 2024-04-20T21:58:25.625 INFO:tasks.workunit.client.0.smithi142.stdout:3/226: write d6/f2e [825811,24313] 0 2024-04-20T21:58:25.635 INFO:tasks.workunit.client.0.smithi142.stdout:8/205: dread d0/d1c/f2d [0,4194304] 0 2024-04-20T21:58:25.638 INFO:tasks.workunit.client.0.smithi142.stdout:8/206: mknod d0/d42/c4e 0 2024-04-20T21:58:25.639 INFO:tasks.workunit.client.0.smithi142.stdout:3/227: dwrite f2 [0,4194304] 0 2024-04-20T21:58:25.647 INFO:tasks.workunit.client.0.smithi142.stdout:3/228: link d6/d15/d30/f44 d6/f4b 0 2024-04-20T21:58:25.651 INFO:tasks.workunit.client.0.smithi142.stdout:8/207: dread d0/d1c/f41 [0,4194304] 0 2024-04-20T21:58:25.653 INFO:tasks.workunit.client.0.smithi142.stdout:4/202: dread d1/ff [0,4194304] 0 2024-04-20T21:58:25.653 INFO:tasks.workunit.client.0.smithi142.stdout:8/208: write d0/f6 [2287982,84929] 0 2024-04-20T21:58:25.655 INFO:tasks.workunit.client.0.smithi142.stdout:4/203: read - d1/d6/d30/f3a zero size 2024-04-20T21:58:25.656 INFO:tasks.workunit.client.0.smithi142.stdout:8/209: unlink d0/f28 0 2024-04-20T21:58:25.661 INFO:tasks.workunit.client.0.smithi142.stdout:8/210: creat d0/f4f x:0 0 0 2024-04-20T21:58:25.663 INFO:tasks.workunit.client.0.smithi142.stdout:3/229: dwrite d6/f3a [0,4194304] 0 2024-04-20T21:58:25.670 INFO:tasks.workunit.client.0.smithi142.stdout:8/211: creat d0/d29/f50 x:0 0 0 2024-04-20T21:58:25.673 INFO:tasks.workunit.client.0.smithi142.stdout:3/230: dread d6/f2e [0,4194304] 0 2024-04-20T21:58:25.676 INFO:tasks.workunit.client.0.smithi142.stdout:3/231: write d6/f18 [687400,119310] 0 2024-04-20T21:58:25.677 INFO:tasks.workunit.client.0.smithi142.stdout:4/204: dwrite d1/d12/da/f22 [0,4194304] 0 2024-04-20T21:58:25.679 INFO:tasks.workunit.client.0.smithi142.stdout:4/205: stat d1/db 0 2024-04-20T21:58:25.688 INFO:tasks.workunit.client.0.smithi142.stdout:3/232: read d6/d15/d30/f40 [592070,119890] 0 2024-04-20T21:58:25.696 INFO:tasks.workunit.client.0.smithi142.stdout:4/206: link d1/db/l20 d1/d12/da/d1c/d32/d3d/d38/l3e 0 2024-04-20T21:58:25.697 INFO:tasks.workunit.client.0.smithi142.stdout:8/212: dwrite d0/d29/f38 [0,4194304] 0 2024-04-20T21:58:25.701 INFO:tasks.workunit.client.0.smithi142.stdout:8/213: creat d0/d22/f51 x:0 0 0 2024-04-20T21:58:25.707 INFO:tasks.workunit.client.0.smithi142.stdout:8/214: creat d0/d22/f52 x:0 0 0 2024-04-20T21:58:25.715 INFO:tasks.workunit.client.0.smithi142.stdout:4/207: rename d1/db to d1/d6/d30/d3f 0 2024-04-20T21:58:25.716 INFO:tasks.workunit.client.0.smithi142.stdout:3/233: dwrite d6/fd [0,4194304] 0 2024-04-20T21:58:25.718 INFO:tasks.workunit.client.0.smithi142.stdout:3/234: write d6/f4b [3764259,2473] 0 2024-04-20T21:58:25.729 INFO:tasks.workunit.client.0.smithi142.stdout:3/235: symlink d6/d15/d30/d37/l4c 0 2024-04-20T21:58:25.731 INFO:tasks.workunit.client.0.smithi142.stdout:8/215: dwrite d0/d29/d36/f47 [0,4194304] 0 2024-04-20T21:58:25.732 INFO:tasks.workunit.client.0.smithi142.stdout:3/236: read - d6/d15/d30/d37/f3d zero size 2024-04-20T21:58:25.740 INFO:tasks.workunit.client.0.smithi142.stdout:4/208: dwrite d1/d6/d30/d3f/f1e [0,4194304] 0 2024-04-20T21:58:25.758 INFO:tasks.workunit.client.0.smithi142.stdout:3/237: dwrite d6/f11 [0,4194304] 0 2024-04-20T21:58:25.762 INFO:tasks.workunit.client.0.smithi142.stdout:3/238: stat d6/d32/l36 0 2024-04-20T21:58:25.770 INFO:tasks.workunit.client.0.smithi142.stdout:4/209: dwrite d1/d6/f1a [4194304,4194304] 0 2024-04-20T21:58:25.784 INFO:tasks.workunit.client.0.smithi142.stdout:3/239: dread d6/f8 [0,4194304] 0 2024-04-20T21:58:25.785 INFO:tasks.workunit.client.0.smithi142.stdout:3/240: readlink d6/d32/l36 0 2024-04-20T21:58:25.789 INFO:tasks.workunit.client.0.smithi142.stdout:3/241: write d6/d15/d30/f44 [4985030,122173] 0 2024-04-20T21:58:25.789 INFO:tasks.workunit.client.0.smithi142.stdout:4/210: dread d1/d6/d30/d3f/f1e [0,4194304] 0 2024-04-20T21:58:25.790 INFO:tasks.workunit.client.0.smithi142.stdout:3/242: chown d6/d15/d47/f4a 3539479 1 2024-04-20T21:58:25.790 INFO:tasks.workunit.client.0.smithi142.stdout:3/243: stat d6/f34 0 2024-04-20T21:58:25.794 INFO:tasks.workunit.client.0.smithi142.stdout:4/211: unlink d1/d12/ld 0 2024-04-20T21:58:25.797 INFO:tasks.workunit.client.0.smithi142.stdout:4/212: chown d1/d6/d30/d3f/f21 3 1 2024-04-20T21:58:25.797 INFO:tasks.workunit.client.0.smithi142.stdout:3/244: mkdir d6/d15/d1e/d43/d4d 0 2024-04-20T21:58:25.798 INFO:tasks.workunit.client.0.smithi142.stdout:4/213: read - d1/d6/d30/f3a zero size 2024-04-20T21:58:25.799 INFO:tasks.workunit.client.0.smithi142.stdout:8/216: dread d0/f3 [0,4194304] 0 2024-04-20T21:58:25.801 INFO:tasks.workunit.client.0.smithi142.stdout:8/217: chown d0/l32 414 1 2024-04-20T21:58:25.803 INFO:tasks.workunit.client.0.smithi142.stdout:8/218: write d0/d1c/d44/f46 [758117,50581] 0 2024-04-20T21:58:25.804 INFO:tasks.workunit.client.0.smithi142.stdout:4/214: creat d1/d12/da/d1c/d32/f40 x:0 0 0 2024-04-20T21:58:25.811 INFO:tasks.workunit.client.0.smithi142.stdout:4/215: rmdir d1/d12/da 39 2024-04-20T21:58:25.817 INFO:tasks.workunit.client.0.smithi142.stdout:4/216: mknod d1/d6/c41 0 2024-04-20T21:58:25.818 INFO:tasks.workunit.client.0.smithi142.stdout:3/245: dwrite d6/f8 [0,4194304] 0 2024-04-20T21:58:25.823 INFO:tasks.workunit.client.0.smithi142.stdout:4/217: creat d1/d6/d30/d3f/f42 x:0 0 0 2024-04-20T21:58:25.828 INFO:tasks.workunit.client.0.smithi142.stdout:8/219: write d0/f3 [3023722,26309] 0 2024-04-20T21:58:25.829 INFO:tasks.workunit.client.0.smithi142.stdout:4/218: fdatasync d1/d6/f1a 0 2024-04-20T21:58:25.836 INFO:tasks.workunit.client.0.smithi142.stdout:8/220: rename d0/f3 to d0/d29/d36/f53 0 2024-04-20T21:58:25.842 INFO:tasks.workunit.client.0.smithi142.stdout:8/221: mknod d0/d29/d36/c54 0 2024-04-20T21:58:25.843 INFO:tasks.workunit.client.0.smithi142.stdout:3/246: dwrite d6/d15/d47/f4a [0,4194304] 0 2024-04-20T21:58:25.853 INFO:tasks.workunit.client.0.smithi142.stdout:8/222: mknod d0/d22/d3f/c55 0 2024-04-20T21:58:25.855 INFO:tasks.workunit.client.0.smithi142.stdout:4/219: write d1/d6/d30/d3f/f21 [1868379,98907] 0 2024-04-20T21:58:25.859 INFO:tasks.workunit.client.0.smithi142.stdout:4/220: write d1/f3 [3472361,98459] 0 2024-04-20T21:58:25.861 INFO:tasks.workunit.client.0.smithi142.stdout:3/247: dread d6/f18 [0,4194304] 0 2024-04-20T21:58:25.866 INFO:tasks.workunit.client.0.smithi142.stdout:1/223: sync 2024-04-20T21:58:25.870 INFO:tasks.workunit.client.0.smithi142.stdout:1/224: chown d2/dd/c27 212 1 2024-04-20T21:58:25.876 INFO:tasks.workunit.client.0.smithi142.stdout:4/221: link f0 d1/d12/da/d1c/d32/f43 0 2024-04-20T21:58:25.878 INFO:tasks.workunit.client.0.smithi142.stdout:3/248: dread d6/fd [0,4194304] 0 2024-04-20T21:58:25.878 INFO:tasks.workunit.client.0.smithi142.stdout:3/249: readlink d6/l2a 0 2024-04-20T21:58:25.880 INFO:tasks.workunit.client.0.smithi142.stdout:4/222: chown d1/d12/da/d1c/f26 3024759 1 2024-04-20T21:58:25.882 INFO:tasks.workunit.client.0.smithi142.stdout:4/223: write d1/f3 [923203,123995] 0 2024-04-20T21:58:25.889 INFO:tasks.workunit.client.0.smithi142.stdout:4/224: creat d1/d6/d30/d3f/f44 x:0 0 0 2024-04-20T21:58:25.892 INFO:tasks.workunit.client.0.smithi142.stdout:8/223: dread d0/ff [0,4194304] 0 2024-04-20T21:58:25.896 INFO:tasks.workunit.client.0.smithi142.stdout:8/224: dread - d0/d29/f3d zero size 2024-04-20T21:58:25.897 INFO:tasks.workunit.client.0.smithi142.stdout:1/225: dwrite d2/f31 [0,4194304] 0 2024-04-20T21:58:25.900 INFO:tasks.workunit.client.0.smithi142.stdout:8/225: creat d0/d29/d36/d45/f56 x:0 0 0 2024-04-20T21:58:25.902 INFO:tasks.workunit.client.0.smithi142.stdout:3/250: dwrite d6/f25 [0,4194304] 0 2024-04-20T21:58:25.927 INFO:tasks.workunit.client.0.smithi142.stdout:8/226: fdatasync d0/d29/f3d 0 2024-04-20T21:58:25.927 INFO:tasks.workunit.client.0.smithi142.stdout:1/226: mkdir d2/d4e 0 2024-04-20T21:58:25.929 INFO:tasks.workunit.client.0.smithi142.stdout:3/251: chown d6/f31 26991 1 2024-04-20T21:58:25.931 INFO:tasks.workunit.client.0.smithi142.stdout:8/227: write d0/d29/d36/d45/f56 [1001085,108445] 0 2024-04-20T21:58:25.931 INFO:tasks.workunit.client.0.smithi142.stdout:1/227: unlink d2/c11 0 2024-04-20T21:58:25.934 INFO:tasks.workunit.client.0.smithi142.stdout:8/228: chown d0/d22/l43 304 1 2024-04-20T21:58:25.936 INFO:tasks.workunit.client.0.smithi142.stdout:3/252: dread d6/f34 [0,4194304] 0 2024-04-20T21:58:25.939 INFO:tasks.workunit.client.0.smithi142.stdout:1/228: fsync d2/dd/d17/d1b/d22/d13/f39 0 2024-04-20T21:58:25.940 INFO:tasks.workunit.client.0.smithi142.stdout:3/253: symlink d6/d15/d47/l4e 0 2024-04-20T21:58:25.941 INFO:tasks.workunit.client.0.smithi142.stdout:1/229: write d2/f31 [227242,8787] 0 2024-04-20T21:58:25.944 INFO:tasks.workunit.client.0.smithi142.stdout:1/230: dread - d2/dd/d17/d1b/d22/d20/f2d zero size 2024-04-20T21:58:25.945 INFO:tasks.workunit.client.0.smithi142.stdout:3/254: creat d6/d15/d47/f4f x:0 0 0 2024-04-20T21:58:25.947 INFO:tasks.workunit.client.0.smithi142.stdout:1/231: chown d2/dd/d1c/c4a 3540 1 2024-04-20T21:58:25.948 INFO:tasks.workunit.client.0.smithi142.stdout:3/255: fdatasync d6/f18 0 2024-04-20T21:58:25.950 INFO:tasks.workunit.client.0.smithi142.stdout:1/232: write d2/dd/d17/d1b/f3c [1366929,41416] 0 2024-04-20T21:58:25.954 INFO:tasks.workunit.client.0.smithi142.stdout:1/233: chown d2/dd/d17/d1b/c37 604316 1 2024-04-20T21:58:25.954 INFO:tasks.workunit.client.0.smithi142.stdout:1/234: chown d2/dd/d17 615878 1 2024-04-20T21:58:25.957 INFO:tasks.workunit.client.0.smithi142.stdout:1/235: creat d2/dd/d1c/f4f x:0 0 0 2024-04-20T21:58:25.958 INFO:tasks.workunit.client.0.smithi142.stdout:1/236: stat d2/dd/d17/d1b/d22/d20/f2d 0 2024-04-20T21:58:25.962 INFO:tasks.workunit.client.0.smithi142.stdout:1/237: stat d2/dd/d1c/d43 0 2024-04-20T21:58:26.021 INFO:tasks.workunit.client.0.smithi142.stdout:5/153: sync 2024-04-20T21:58:26.021 INFO:tasks.workunit.client.0.smithi142.stdout:7/241: sync 2024-04-20T21:58:26.021 INFO:tasks.workunit.client.0.smithi142.stdout:9/290: sync 2024-04-20T21:58:26.021 INFO:tasks.workunit.client.0.smithi142.stdout:2/319: sync 2024-04-20T21:58:26.021 INFO:tasks.workunit.client.0.smithi142.stdout:0/245: sync 2024-04-20T21:58:26.021 INFO:tasks.workunit.client.0.smithi142.stdout:6/227: sync 2024-04-20T21:58:26.024 INFO:tasks.workunit.client.0.smithi142.stdout:6/228: write d1/d46/f28 [4548656,3506] 0 2024-04-20T21:58:26.027 INFO:tasks.workunit.client.0.smithi142.stdout:6/229: dread - d1/d11/ff zero size 2024-04-20T21:58:26.030 INFO:tasks.workunit.client.0.smithi142.stdout:6/230: write d1/d2f/d35/f36 [853871,85807] 0 2024-04-20T21:58:26.046 INFO:tasks.workunit.client.0.smithi142.stdout:6/231: dread d1/d5/f3d [0,4194304] 0 2024-04-20T21:58:26.047 INFO:tasks.workunit.client.0.smithi142.stdout:2/320: dwrite d3/f42 [0,4194304] 0 2024-04-20T21:58:26.052 INFO:tasks.workunit.client.0.smithi142.stdout:5/154: symlink dc/l31 0 2024-04-20T21:58:26.058 INFO:tasks.workunit.client.0.smithi142.stdout:9/291: mkdir d0/d3c/d4d/d63 0 2024-04-20T21:58:26.060 INFO:tasks.workunit.client.0.smithi142.stdout:0/246: creat d5/d1c/d3c/d54/f5d x:0 0 0 2024-04-20T21:58:26.062 INFO:tasks.workunit.client.0.smithi142.stdout:0/247: fsync d5/d13/f14 0 2024-04-20T21:58:26.063 INFO:tasks.workunit.client.0.smithi142.stdout:7/242: symlink d4/d9/d1b/d4d/l56 0 2024-04-20T21:58:26.066 INFO:tasks.workunit.client.0.smithi142.stdout:0/248: write d5/d13/d1e/f59 [245874,73514] 0 2024-04-20T21:58:26.067 INFO:tasks.workunit.client.0.smithi142.stdout:1/238: mkdir d2/dd/d17/d3b/d50 0 2024-04-20T21:58:26.070 INFO:tasks.workunit.client.0.smithi142.stdout:1/239: chown d2/dd/d17/d1b/d22/c2c 466 1 2024-04-20T21:58:26.073 INFO:tasks.workunit.client.0.smithi142.stdout:2/321: write d3/d24/d3c/f38 [2368235,27235] 0 2024-04-20T21:58:26.075 INFO:tasks.workunit.client.0.smithi142.stdout:5/155: creat dc/f32 x:0 0 0 2024-04-20T21:58:26.083 INFO:tasks.workunit.client.0.smithi142.stdout:7/243: symlink d4/d9/d11/d47/l57 0 2024-04-20T21:58:26.085 INFO:tasks.workunit.client.0.smithi142.stdout:7/244: dread - d4/f35 zero size 2024-04-20T21:58:26.086 INFO:tasks.workunit.client.0.smithi142.stdout:0/249: symlink d5/d13/d1e/d23/d46/l5e 0 2024-04-20T21:58:26.088 INFO:tasks.workunit.client.0.smithi142.stdout:0/250: fdatasync d5/d13/f14 0 2024-04-20T21:58:26.103 INFO:tasks.workunit.client.0.smithi142.stdout:1/240: symlink d2/dd/d1c/d43/l51 0 2024-04-20T21:58:26.104 INFO:tasks.workunit.client.0.smithi142.stdout:7/245: dwrite d4/d9/d1c/f23 [4194304,4194304] 0 2024-04-20T21:58:26.107 INFO:tasks.workunit.client.0.smithi142.stdout:7/246: fsync d4/d9/d1b/f36 0 2024-04-20T21:58:26.108 INFO:tasks.workunit.client.0.smithi142.stdout:0/251: rename d5/d1d/f57 to d5/d13/d1e/d23/d46/f5f 0 2024-04-20T21:58:26.111 INFO:tasks.workunit.client.0.smithi142.stdout:7/247: fdatasync d4/d9/d1b/f51 0 2024-04-20T21:58:26.115 INFO:tasks.workunit.client.0.smithi142.stdout:0/252: chown d5/d13/d1e/d23/d46/l5e 11127 1 2024-04-20T21:58:26.115 INFO:tasks.workunit.client.0.smithi142.stdout:5/156: dwrite dc/f2f [0,4194304] 0 2024-04-20T21:58:26.117 INFO:tasks.workunit.client.0.smithi142.stdout:2/322: mkdir d3/d9/d69 0 2024-04-20T21:58:26.119 INFO:tasks.workunit.client.0.smithi142.stdout:6/232: getdents d1/d5/d1a/d39 0 2024-04-20T21:58:26.122 INFO:tasks.workunit.client.0.smithi142.stdout:6/233: write d1/d2f/d35/f4d [746804,75551] 0 2024-04-20T21:58:26.129 INFO:tasks.workunit.client.0.smithi142.stdout:7/248: rename d4/d9/d1b/l17 to d4/d9/l58 0 2024-04-20T21:58:26.131 INFO:tasks.workunit.client.0.smithi142.stdout:7/249: write d4/f48 [510423,33258] 0 2024-04-20T21:58:26.137 INFO:tasks.workunit.client.0.smithi142.stdout:5/157: mknod dc/d14/d21/d23/d2a/c33 0 2024-04-20T21:58:26.142 INFO:tasks.workunit.client.0.smithi142.stdout:7/250: creat d4/d9/d11/d22/f59 x:0 0 0 2024-04-20T21:58:26.143 INFO:tasks.workunit.client.0.smithi142.stdout:6/234: dwrite d1/f49 [0,4194304] 0 2024-04-20T21:58:26.146 INFO:tasks.workunit.client.0.smithi142.stdout:6/235: chown d1/d5/f37 133644758 1 2024-04-20T21:58:26.146 INFO:tasks.workunit.client.0.smithi142.stdout:7/251: fsync d4/d9/d1c/d32/f52 0 2024-04-20T21:58:26.149 INFO:tasks.workunit.client.0.smithi142.stdout:6/236: chown d1/d5/d1a/d3e 245197 1 2024-04-20T21:58:26.149 INFO:tasks.workunit.client.0.smithi142.stdout:5/158: unlink dc/d14/f20 0 2024-04-20T21:58:26.153 INFO:tasks.workunit.client.0.smithi142.stdout:7/252: mkdir d4/d9/d11/d47/d5a 0 2024-04-20T21:58:26.155 INFO:tasks.workunit.client.0.smithi142.stdout:1/241: dread d2/dd/d17/d1b/d22/f46 [0,4194304] 0 2024-04-20T21:58:26.158 INFO:tasks.workunit.client.0.smithi142.stdout:7/253: symlink d4/d9/d11/d22/l5b 0 2024-04-20T21:58:26.158 INFO:tasks.workunit.client.0.smithi142.stdout:1/242: write d2/dd/d17/d1b/f1d [4510269,30333] 0 2024-04-20T21:58:26.160 INFO:tasks.workunit.client.0.smithi142.stdout:5/159: symlink dc/d14/d21/d23/l34 0 2024-04-20T21:58:26.162 INFO:tasks.workunit.client.0.smithi142.stdout:1/243: dread - d2/dd/d17/d1b/d22/d20/f2d zero size 2024-04-20T21:58:26.166 INFO:tasks.workunit.client.0.smithi142.stdout:5/160: chown dc/d14/d21/d23/f24 5 1 2024-04-20T21:58:26.166 INFO:tasks.workunit.client.0.smithi142.stdout:6/237: getdents d1/d5/d3a/d43 0 2024-04-20T21:58:26.166 INFO:tasks.workunit.client.0.smithi142.stdout:5/161: write dc/f2f [1780532,53293] 0 2024-04-20T21:58:26.170 INFO:tasks.workunit.client.0.smithi142.stdout:1/244: creat d2/dd/d17/d3b/d50/f52 x:0 0 0 2024-04-20T21:58:26.170 INFO:tasks.workunit.client.0.smithi142.stdout:5/162: dread - dc/d14/d21/d23/f24 zero size 2024-04-20T21:58:26.172 INFO:tasks.workunit.client.0.smithi142.stdout:7/254: dread d4/d9/f30 [0,4194304] 0 2024-04-20T21:58:26.172 INFO:tasks.workunit.client.0.smithi142.stdout:5/163: write dc/f10 [1618032,54420] 0 2024-04-20T21:58:26.176 INFO:tasks.workunit.client.0.smithi142.stdout:7/255: write d4/d9/d1b/f36 [711518,59228] 0 2024-04-20T21:58:26.177 INFO:tasks.workunit.client.0.smithi142.stdout:5/164: write f9 [3977524,21907] 0 2024-04-20T21:58:26.183 INFO:tasks.workunit.client.0.smithi142.stdout:5/165: stat dc/f32 0 2024-04-20T21:58:26.185 INFO:tasks.workunit.client.0.smithi142.stdout:5/166: fdatasync dc/f32 0 2024-04-20T21:58:26.185 INFO:tasks.workunit.client.0.smithi142.stdout:9/292: dwrite d0/fe [0,4194304] 0 2024-04-20T21:58:26.186 INFO:tasks.workunit.client.0.smithi142.stdout:7/256: write d4/d9/d1b/d4d/f53 [152741,73129] 0 2024-04-20T21:58:26.187 INFO:tasks.workunit.client.0.smithi142.stdout:0/253: rmdir d5/d13/d1e 39 2024-04-20T21:58:26.191 INFO:tasks.workunit.client.0.smithi142.stdout:0/254: dread - d5/d13/d1e/d23/f39 zero size 2024-04-20T21:58:26.192 INFO:tasks.workunit.client.0.smithi142.stdout:7/257: creat d4/d9/d1c/d32/f5c x:0 0 0 2024-04-20T21:58:26.193 INFO:tasks.workunit.client.0.smithi142.stdout:1/245: dwrite d2/dd/d17/f24 [0,4194304] 0 2024-04-20T21:58:26.195 INFO:tasks.workunit.client.0.smithi142.stdout:0/255: write d5/d45/f50 [39102,126410] 0 2024-04-20T21:58:26.195 INFO:tasks.workunit.client.0.smithi142.stdout:7/258: dread - d4/d9/d11/d47/f50 zero size 2024-04-20T21:58:26.306 INFO:tasks.workunit.client.0.smithi142.stdout:9/293: getdents d0 0 2024-04-20T21:58:26.309 INFO:tasks.workunit.client.0.smithi142.stdout:1/246: mknod d2/c53 0 2024-04-20T21:58:26.318 INFO:tasks.workunit.client.0.smithi142.stdout:2/323: dwrite d3/d9/f33 [0,4194304] 0 2024-04-20T21:58:26.322 INFO:tasks.workunit.client.0.smithi142.stdout:7/259: dwrite d4/d9/d1b/d4d/f53 [0,4194304] 0 2024-04-20T21:58:26.326 INFO:tasks.workunit.client.0.smithi142.stdout:2/324: creat d3/d9/d34/d51/d31/f6a x:0 0 0 2024-04-20T21:58:26.329 INFO:tasks.workunit.client.0.smithi142.stdout:1/247: link d2/dd/d17/f47 d2/dd/d17/d1b/d22/d20/f54 0 2024-04-20T21:58:26.336 INFO:tasks.workunit.client.0.smithi142.stdout:2/325: mknod d3/d9/d34/d51/d31/c6b 0 2024-04-20T21:58:26.338 INFO:tasks.workunit.client.0.smithi142.stdout:2/326: fdatasync d3/d5/f5e 0 2024-04-20T21:58:26.338 INFO:tasks.workunit.client.0.smithi142.stdout:9/294: dwrite d0/d2a/d39/f5c [0,4194304] 0 2024-04-20T21:58:26.341 INFO:tasks.workunit.client.0.smithi142.stdout:9/295: readlink d0/d2a/d39/d50/l52 0 2024-04-20T21:58:26.342 INFO:tasks.workunit.client.0.smithi142.stdout:1/248: mkdir d2/dd/d17/d1b/d22/d55 0 2024-04-20T21:58:26.345 INFO:tasks.workunit.client.0.smithi142.stdout:7/260: getdents d4/d9 0 2024-04-20T21:58:26.346 INFO:tasks.workunit.client.0.smithi142.stdout:2/327: truncate d3/d5/f4b 5016718 0 2024-04-20T21:58:26.347 INFO:tasks.workunit.client.0.smithi142.stdout:0/256: truncate d5/f58 299117 0 2024-04-20T21:58:26.349 INFO:tasks.workunit.client.0.smithi142.stdout:1/249: rmdir d2/dd/d17/d3b 39 2024-04-20T21:58:26.352 INFO:tasks.workunit.client.0.smithi142.stdout:9/296: rename d0/c13 to d0/d36/d55/c64 0 2024-04-20T21:58:26.353 INFO:tasks.workunit.client.0.smithi142.stdout:4/225: sync 2024-04-20T21:58:26.355 INFO:tasks.workunit.client.0.smithi142.stdout:2/328: mkdir d3/d24/d3c/d66/d6c 0 2024-04-20T21:58:26.356 INFO:tasks.workunit.client.0.smithi142.stdout:9/297: write d0/d2a/f4f [1679779,11939] 0 2024-04-20T21:58:26.358 INFO:tasks.workunit.client.0.smithi142.stdout:0/257: dread d5/d13/d1e/d23/d2c/f41 [0,4194304] 0 2024-04-20T21:58:26.360 INFO:tasks.workunit.client.0.smithi142.stdout:9/298: fsync d0/d3c/f46 0 2024-04-20T21:58:26.361 INFO:tasks.workunit.client.0.smithi142.stdout:1/250: write d2/dd/d17/d3b/d50/f52 [356714,113092] 0 2024-04-20T21:58:26.361 INFO:tasks.workunit.client.0.smithi142.stdout:0/258: chown d5/d13/d1e/d23/d2c 1 1 2024-04-20T21:58:26.363 INFO:tasks.workunit.client.0.smithi142.stdout:9/299: write d0/fc [6899972,105303] 0 2024-04-20T21:58:26.366 INFO:tasks.workunit.client.0.smithi142.stdout:0/259: chown d5/d13/d1e/d23/d24/f2a 1 1 2024-04-20T21:58:26.368 INFO:tasks.workunit.client.0.smithi142.stdout:7/261: link d4/d9/d1b/l20 d4/d9/d1c/l5d 0 2024-04-20T21:58:26.374 INFO:tasks.workunit.client.0.smithi142.stdout:4/226: rename d1/d12/da/d1c/d32/d3d/d38/l3e to d1/d12/da/d1c/l45 0 2024-04-20T21:58:26.374 INFO:tasks.workunit.client.0.smithi142.stdout:9/300: creat d0/d3c/d4d/d63/f65 x:0 0 0 2024-04-20T21:58:26.376 INFO:tasks.workunit.client.0.smithi142.stdout:0/260: symlink d5/d13/l60 0 2024-04-20T21:58:26.378 INFO:tasks.workunit.client.0.smithi142.stdout:9/301: chown d0/d2a/f47 6248874 1 2024-04-20T21:58:26.384 INFO:tasks.workunit.client.0.smithi142.stdout:0/261: truncate d5/d13/d1e/d23/d24/f2a 1445430 0 2024-04-20T21:58:26.387 INFO:tasks.workunit.client.0.smithi142.stdout:1/251: dwrite d2/dd/d17/d1b/d22/f2f [0,4194304] 0 2024-04-20T21:58:26.387 INFO:tasks.workunit.client.0.smithi142.stdout:4/227: symlink d1/d12/l46 0 2024-04-20T21:58:26.387 INFO:tasks.workunit.client.0.smithi142.stdout:0/262: write d5/d1c/d3c/d54/f5d [995319,25195] 0 2024-04-20T21:58:26.387 INFO:tasks.workunit.client.0.smithi142.stdout:7/262: rename d4/d9/d1b to d4/d9/d1c/d5e 0 2024-04-20T21:58:26.390 INFO:tasks.workunit.client.0.smithi142.stdout:8/229: sync 2024-04-20T21:58:26.391 INFO:tasks.workunit.client.0.smithi142.stdout:0/263: read d5/f8 [3992658,29935] 0 2024-04-20T21:58:26.394 INFO:tasks.workunit.client.0.smithi142.stdout:8/230: read - d0/d22/f52 zero size 2024-04-20T21:58:26.394 INFO:tasks.workunit.client.0.smithi142.stdout:4/228: unlink d1/f3 0 2024-04-20T21:58:26.395 INFO:tasks.workunit.client.0.smithi142.stdout:2/329: dread d3/d5/d19/f21 [0,4194304] 0 2024-04-20T21:58:26.396 INFO:tasks.workunit.client.0.smithi142.stdout:0/264: dread - d5/d1c/d29/d38/f42 zero size 2024-04-20T21:58:26.397 INFO:tasks.workunit.client.0.smithi142.stdout:9/302: rename d0/l7 to d0/d36/d55/l66 0 2024-04-20T21:58:26.398 INFO:tasks.workunit.client.0.smithi142.stdout:2/330: fsync d3/d9/d34/f35 0 2024-04-20T21:58:26.404 INFO:tasks.workunit.client.0.smithi142.stdout:8/231: creat d0/d42/f57 x:0 0 0 2024-04-20T21:58:26.404 INFO:tasks.workunit.client.0.smithi142.stdout:4/229: fsync d1/d12/da/d1c/f25 0 2024-04-20T21:58:26.405 INFO:tasks.workunit.client.0.smithi142.stdout:0/265: creat d5/d1c/d3c/f61 x:0 0 0 2024-04-20T21:58:26.406 INFO:tasks.workunit.client.0.smithi142.stdout:0/266: fdatasync d5/d1c/d29/d38/f42 0 2024-04-20T21:58:26.407 INFO:tasks.workunit.client.0.smithi142.stdout:7/263: rename d4/d9/d11/d47/f50 to d4/d9/d1c/f5f 0 2024-04-20T21:58:26.410 INFO:tasks.workunit.client.0.smithi142.stdout:2/331: mknod d3/d5/c6d 0 2024-04-20T21:58:26.412 INFO:tasks.workunit.client.0.smithi142.stdout:2/332: write d3/d5/f5e [420716,23404] 0 2024-04-20T21:58:26.414 INFO:tasks.workunit.client.0.smithi142.stdout:4/230: creat d1/d6/f47 x:0 0 0 2024-04-20T21:58:26.425 INFO:tasks.workunit.client.0.smithi142.stdout:9/303: rmdir d0/d36/d61 0 2024-04-20T21:58:26.427 INFO:tasks.workunit.client.0.smithi142.stdout:4/231: dread d1/f13 [0,4194304] 0 2024-04-20T21:58:26.429 INFO:tasks.workunit.client.0.smithi142.stdout:1/252: dwrite d2/dd/d17/d1b/d22/d20/f54 [0,4194304] 0 2024-04-20T21:58:26.430 INFO:tasks.workunit.client.0.smithi142.stdout:8/232: creat d0/f58 x:0 0 0 2024-04-20T21:58:26.436 INFO:tasks.workunit.client.0.smithi142.stdout:9/304: creat d0/d3c/d4d/f67 x:0 0 0 2024-04-20T21:58:26.441 INFO:tasks.workunit.client.0.smithi142.stdout:7/264: dwrite d4/f2d [0,4194304] 0 2024-04-20T21:58:26.441 INFO:tasks.workunit.client.0.smithi142.stdout:8/233: mkdir d0/d29/d36/d45/d59 0 2024-04-20T21:58:26.445 INFO:tasks.workunit.client.0.smithi142.stdout:0/267: getdents d5/d13/d1e/d23/d24/d48 0 2024-04-20T21:58:26.449 INFO:tasks.workunit.client.0.smithi142.stdout:9/305: write d0/d2a/f2d [4576028,106440] 0 2024-04-20T21:58:26.450 INFO:tasks.workunit.client.0.smithi142.stdout:2/333: getdents d3 0 2024-04-20T21:58:26.452 INFO:tasks.workunit.client.0.smithi142.stdout:0/268: mkdir d5/d1c/d29/d38/d62 0 2024-04-20T21:58:26.456 INFO:tasks.workunit.client.0.smithi142.stdout:4/232: rename d1/c29 to d1/c48 0 2024-04-20T21:58:26.456 INFO:tasks.workunit.client.0.smithi142.stdout:7/265: link d4/d9/d11/f3c d4/d9/d1c/d5e/d4d/f60 0 2024-04-20T21:58:26.457 INFO:tasks.workunit.client.0.smithi142.stdout:8/234: dread d0/d29/d36/f47 [0,4194304] 0 2024-04-20T21:58:26.458 INFO:tasks.workunit.client.0.smithi142.stdout:0/269: truncate d5/d13/d1e/d23/d24/f33 413677 0 2024-04-20T21:58:26.460 INFO:tasks.workunit.client.0.smithi142.stdout:1/253: rename d2/dd/d17/d1b/d22/d20/f54 to d2/dd/d17/d1b/d22/f56 0 2024-04-20T21:58:26.462 INFO:tasks.workunit.client.0.smithi142.stdout:8/235: write d0/d29/d36/d45/f4d [112053,86781] 0 2024-04-20T21:58:26.463 INFO:tasks.workunit.client.0.smithi142.stdout:8/236: fdatasync d0/d1c/f41 0 2024-04-20T21:58:26.464 INFO:tasks.workunit.client.0.smithi142.stdout:9/306: creat d0/d2a/d39/d50/f68 x:0 0 0 2024-04-20T21:58:26.465 INFO:tasks.workunit.client.0.smithi142.stdout:8/237: dread - d0/d22/f52 zero size 2024-04-20T21:58:26.466 INFO:tasks.workunit.client.0.smithi142.stdout:8/238: dread - d0/f4f zero size 2024-04-20T21:58:26.471 INFO:tasks.workunit.client.0.smithi142.stdout:2/334: symlink d3/d5/d67/l6e 0 2024-04-20T21:58:26.471 INFO:tasks.workunit.client.0.smithi142.stdout:0/270: write d5/d13/d1e/d23/d2c/f41 [17128,6834] 0 2024-04-20T21:58:26.471 INFO:tasks.workunit.client.0.smithi142.stdout:7/266: mknod d4/d9/d11/d47/d5a/c61 0 2024-04-20T21:58:26.471 INFO:tasks.workunit.client.0.smithi142.stdout:4/233: mkdir d1/d12/da/d1c/d32/d3d/d2f/d49 0 2024-04-20T21:58:26.482 INFO:tasks.workunit.client.0.smithi142.stdout:8/239: creat d0/d29/d36/d45/d59/f5a x:0 0 0 2024-04-20T21:58:26.482 INFO:tasks.workunit.client.0.smithi142.stdout:4/234: mkdir d1/d6/d4a 0 2024-04-20T21:58:26.485 INFO:tasks.workunit.client.0.smithi142.stdout:7/267: mkdir d4/d9/d11/d47/d5a/d62 0 2024-04-20T21:58:26.487 INFO:tasks.workunit.client.0.smithi142.stdout:8/240: stat d0/d1c/l2b 0 2024-04-20T21:58:26.487 INFO:tasks.workunit.client.0.smithi142.stdout:2/335: unlink d3/d9/d34/d51/c2c 0 2024-04-20T21:58:26.489 INFO:tasks.workunit.client.0.smithi142.stdout:4/235: stat d1/d12/da/d1c/d32/d3d/d2f 0 2024-04-20T21:58:26.493 INFO:tasks.workunit.client.0.smithi142.stdout:8/241: readlink d0/d1c/l2b 0 2024-04-20T21:58:26.493 INFO:tasks.workunit.client.0.smithi142.stdout:7/268: dread d4/d9/d1c/d5e/f1f [0,4194304] 0 2024-04-20T21:58:26.493 INFO:tasks.workunit.client.0.smithi142.stdout:4/236: chown d1/d12/da/d1c 37304 1 2024-04-20T21:58:26.496 INFO:tasks.workunit.client.0.smithi142.stdout:4/237: chown d1/d12/da/d37 5504 1 2024-04-20T21:58:26.497 INFO:tasks.workunit.client.0.smithi142.stdout:7/269: stat d4/d9/d11/d47/d5a/c61 0 2024-04-20T21:58:26.498 INFO:tasks.workunit.client.0.smithi142.stdout:0/271: dwrite d5/d13/d1e/d23/d24/f33 [0,4194304] 0 2024-04-20T21:58:26.503 INFO:tasks.workunit.client.0.smithi142.stdout:0/272: stat d5/d1c/d29/l3a 0 2024-04-20T21:58:26.505 INFO:tasks.workunit.client.0.smithi142.stdout:9/307: dwrite d0/d2a/d39/f5e [0,4194304] 0 2024-04-20T21:58:26.509 INFO:tasks.workunit.client.0.smithi142.stdout:7/270: creat d4/d9/d11/d47/d5a/f63 x:0 0 0 2024-04-20T21:58:26.511 INFO:tasks.workunit.client.0.smithi142.stdout:4/238: getdents d1/d12/da/d1c/d32 0 2024-04-20T21:58:26.512 INFO:tasks.workunit.client.0.smithi142.stdout:9/308: dread - d0/d3c/d4d/d63/f65 zero size 2024-04-20T21:58:26.513 INFO:tasks.workunit.client.0.smithi142.stdout:0/273: mkdir d5/d1c/d29/d63 0 2024-04-20T21:58:26.520 INFO:tasks.workunit.client.0.smithi142.stdout:0/274: fsync d5/d13/d1e/d23/d2c/f41 0 2024-04-20T21:58:26.520 INFO:tasks.workunit.client.0.smithi142.stdout:2/336: dwrite d3/d24/d3c/f1b [0,4194304] 0 2024-04-20T21:58:26.521 INFO:tasks.workunit.client.0.smithi142.stdout:4/239: mkdir d1/d6/d4b 0 2024-04-20T21:58:26.525 INFO:tasks.workunit.client.0.smithi142.stdout:9/309: write d0/d2a/f34 [2414207,44556] 0 2024-04-20T21:58:26.527 INFO:tasks.workunit.client.0.smithi142.stdout:8/242: dwrite d0/d29/d36/d45/f4d [0,4194304] 0 2024-04-20T21:58:26.528 INFO:tasks.workunit.client.0.smithi142.stdout:2/337: write d3/d9/d34/d51/d31/f54 [488426,70545] 0 2024-04-20T21:58:26.531 INFO:tasks.workunit.client.0.smithi142.stdout:8/243: chown d0/d1c/f1e 4 1 2024-04-20T21:58:26.532 INFO:tasks.workunit.client.0.smithi142.stdout:4/240: dread - d1/d6/d30/f3a zero size 2024-04-20T21:58:26.535 INFO:tasks.workunit.client.0.smithi142.stdout:9/310: mknod d0/d36/c69 0 2024-04-20T21:58:26.539 INFO:tasks.workunit.client.0.smithi142.stdout:8/244: symlink d0/d42/l5b 0 2024-04-20T21:58:26.541 INFO:tasks.workunit.client.0.smithi142.stdout:2/338: symlink d3/d24/d3c/d64/l6f 0 2024-04-20T21:58:26.541 INFO:tasks.workunit.client.0.smithi142.stdout:9/311: chown d0/f14 4733131 1 2024-04-20T21:58:26.542 INFO:tasks.workunit.client.0.smithi142.stdout:8/245: stat d0/f1b 0 2024-04-20T21:58:26.547 INFO:tasks.workunit.client.0.smithi142.stdout:2/339: chown d3/d9/d34/d51/d31/c6b 499 1 2024-04-20T21:58:26.548 INFO:tasks.workunit.client.0.smithi142.stdout:9/312: chown d0/d36/f53 897 1 2024-04-20T21:58:26.548 INFO:tasks.workunit.client.0.smithi142.stdout:7/271: dwrite d4/d9/d1c/d5e/d4d/f53 [0,4194304] 0 2024-04-20T21:58:26.553 INFO:tasks.workunit.client.0.smithi142.stdout:9/313: mknod d0/c6a 0 2024-04-20T21:58:26.553 INFO:tasks.workunit.client.0.smithi142.stdout:7/272: fsync d4/d9/d1c/f23 0 2024-04-20T21:58:26.553 INFO:tasks.workunit.client.0.smithi142.stdout:0/275: dwrite d5/d1d/f4e [0,4194304] 0 2024-04-20T21:58:26.560 INFO:tasks.workunit.client.0.smithi142.stdout:7/273: dread - d4/d9/d1c/d32/f52 zero size 2024-04-20T21:58:26.560 INFO:tasks.workunit.client.0.smithi142.stdout:4/241: dread d1/ff [0,4194304] 0 2024-04-20T21:58:26.566 INFO:tasks.workunit.client.0.smithi142.stdout:9/314: creat d0/d2a/d39/d50/f6b x:0 0 0 2024-04-20T21:58:26.566 INFO:tasks.workunit.client.0.smithi142.stdout:0/276: creat d5/d1c/d29/d63/f64 x:0 0 0 2024-04-20T21:58:26.569 INFO:tasks.workunit.client.0.smithi142.stdout:7/274: write d4/d9/d11/d22/f2b [1166474,12798] 0 2024-04-20T21:58:26.572 INFO:tasks.workunit.client.0.smithi142.stdout:8/246: dwrite d0/f4f [0,4194304] 0 2024-04-20T21:58:26.573 INFO:tasks.workunit.client.0.smithi142.stdout:4/242: chown d1/d6/d30/d3f/f21 0 1 2024-04-20T21:58:26.575 INFO:tasks.workunit.client.0.smithi142.stdout:9/315: mknod d0/d2a/c6c 0 2024-04-20T21:58:26.576 INFO:tasks.workunit.client.0.smithi142.stdout:8/247: fdatasync d0/d29/d36/d45/f4d 0 2024-04-20T21:58:26.576 INFO:tasks.workunit.client.0.smithi142.stdout:7/275: rmdir d4/d9 39 2024-04-20T21:58:26.578 INFO:tasks.workunit.client.0.smithi142.stdout:9/316: chown d0/d2a/d39/d50/f5b 13911686 1 2024-04-20T21:58:26.580 INFO:tasks.workunit.client.0.smithi142.stdout:4/243: symlink d1/d6/l4c 0 2024-04-20T21:58:26.581 INFO:tasks.workunit.client.0.smithi142.stdout:0/277: creat d5/d13/d1e/d23/d24/d48/f65 x:0 0 0 2024-04-20T21:58:26.581 INFO:tasks.workunit.client.0.smithi142.stdout:7/276: fdatasync d4/f27 0 2024-04-20T21:58:26.581 INFO:tasks.workunit.client.0.smithi142.stdout:8/248: fdatasync d0/d29/d36/f53 0 2024-04-20T21:58:26.583 INFO:tasks.workunit.client.0.smithi142.stdout:4/244: dread - d1/d6/d30/f3a zero size 2024-04-20T21:58:26.584 INFO:tasks.workunit.client.0.smithi142.stdout:8/249: chown d0/d29/d36/d45/f56 4003 1 2024-04-20T21:58:26.584 INFO:tasks.workunit.client.0.smithi142.stdout:4/245: read d1/f13 [3828830,62143] 0 2024-04-20T21:58:26.588 INFO:tasks.workunit.client.0.smithi142.stdout:9/317: link d0/fe d0/d2a/d39/f6d 0 2024-04-20T21:58:26.590 INFO:tasks.workunit.client.0.smithi142.stdout:8/250: symlink d0/d1c/d44/l5c 0 2024-04-20T21:58:26.591 INFO:tasks.workunit.client.0.smithi142.stdout:2/340: rename d3/d24 to d3/d5/d19/d70 0 2024-04-20T21:58:26.594 INFO:tasks.workunit.client.0.smithi142.stdout:8/251: chown d0/d29/d36/l3e 116177760 1 2024-04-20T21:58:26.595 INFO:tasks.workunit.client.0.smithi142.stdout:7/277: mkdir d4/d9/d1c/d5e/d64 0 2024-04-20T21:58:26.598 INFO:tasks.workunit.client.0.smithi142.stdout:8/252: chown d0/d1c/d44/f46 60 1 2024-04-20T21:58:26.599 INFO:tasks.workunit.client.0.smithi142.stdout:4/246: creat d1/d12/da/d1c/d32/f4d x:0 0 0 2024-04-20T21:58:26.601 INFO:tasks.workunit.client.0.smithi142.stdout:9/318: rename d0/d3c/d4d/l4e to d0/d3c/l6e 0 2024-04-20T21:58:26.602 INFO:tasks.workunit.client.0.smithi142.stdout:9/319: read d0/fe [2243629,47538] 0 2024-04-20T21:58:26.605 INFO:tasks.workunit.client.0.smithi142.stdout:4/247: mkdir d1/d6/d30/d4e 0 2024-04-20T21:58:26.606 INFO:tasks.workunit.client.0.smithi142.stdout:5/167: sync 2024-04-20T21:58:26.606 INFO:tasks.workunit.client.0.smithi142.stdout:6/238: sync 2024-04-20T21:58:26.606 INFO:tasks.workunit.client.0.smithi142.stdout:3/256: sync 2024-04-20T21:58:26.608 INFO:tasks.workunit.client.0.smithi142.stdout:7/278: creat d4/d9/d1c/d5e/d64/f65 x:0 0 0 2024-04-20T21:58:26.609 INFO:tasks.workunit.client.0.smithi142.stdout:5/168: readlink dc/d14/d21/d23/l2c 0 2024-04-20T21:58:26.610 INFO:tasks.workunit.client.0.smithi142.stdout:9/320: creat d0/d3c/f6f x:0 0 0 2024-04-20T21:58:26.613 INFO:tasks.workunit.client.0.smithi142.stdout:7/279: fsync d4/d9/d1c/d5e/f51 0 2024-04-20T21:58:26.616 INFO:tasks.workunit.client.0.smithi142.stdout:0/278: dread d5/d1c/d29/f4f [0,4194304] 0 2024-04-20T21:58:26.621 INFO:tasks.workunit.client.0.smithi142.stdout:0/279: dread - d5/d13/d1e/d23/d46/f5f zero size 2024-04-20T21:58:26.621 INFO:tasks.workunit.client.0.smithi142.stdout:5/169: mknod dc/d14/c35 0 2024-04-20T21:58:26.629 INFO:tasks.workunit.client.0.smithi142.stdout:4/248: link d1/d6/d30/d3f/c31 d1/d12/da/d1c/d32/c4f 0 2024-04-20T21:58:26.631 INFO:tasks.workunit.client.0.smithi142.stdout:6/239: dwrite d1/d46/f28 [0,4194304] 0 2024-04-20T21:58:26.634 INFO:tasks.workunit.client.0.smithi142.stdout:9/321: dread d0/d2a/d39/f5c [0,4194304] 0 2024-04-20T21:58:26.634 INFO:tasks.workunit.client.0.smithi142.stdout:3/257: dwrite f2 [0,4194304] 0 2024-04-20T21:58:26.637 INFO:tasks.workunit.client.0.smithi142.stdout:6/240: readlink d1/d5/d3a/l56 0 2024-04-20T21:58:26.638 INFO:tasks.workunit.client.0.smithi142.stdout:6/241: chown d1/d2f/d35/f47 27910199 1 2024-04-20T21:58:26.639 INFO:tasks.workunit.client.0.smithi142.stdout:6/242: chown d1/d2f 247415 1 2024-04-20T21:58:26.640 INFO:tasks.workunit.client.0.smithi142.stdout:5/170: mknod dc/d14/c36 0 2024-04-20T21:58:26.642 INFO:tasks.workunit.client.0.smithi142.stdout:0/280: symlink d5/d1c/d3c/d4a/l66 0 2024-04-20T21:58:26.643 INFO:tasks.workunit.client.0.smithi142.stdout:3/258: readlink d6/d15/d47/l4e 0 2024-04-20T21:58:26.650 INFO:tasks.workunit.client.0.smithi142.stdout:5/171: stat dc/d14/d21/d23/d2a/d30 0 2024-04-20T21:58:26.652 INFO:tasks.workunit.client.0.smithi142.stdout:7/280: dwrite d4/d9/f3d [0,4194304] 0 2024-04-20T21:58:26.678 INFO:tasks.workunit.client.0.smithi142.stdout:2/341: creat d3/d9/f71 x:0 0 0 2024-04-20T21:58:26.680 INFO:tasks.workunit.client.0.smithi142.stdout:3/259: unlink d6/d15/c2f 0 2024-04-20T21:58:26.681 INFO:tasks.workunit.client.0.smithi142.stdout:7/281: chown d4/d9/d11/f3e 4 1 2024-04-20T21:58:26.682 INFO:tasks.workunit.client.0.smithi142.stdout:8/253: dwrite d0/d17/f1f [0,4194304] 0 2024-04-20T21:58:26.685 INFO:tasks.workunit.client.0.smithi142.stdout:7/282: readlink d4/d9/l1e 0 2024-04-20T21:58:26.688 INFO:tasks.workunit.client.0.smithi142.stdout:3/260: read d6/f8 [1252346,66349] 0 2024-04-20T21:58:26.688 INFO:tasks.workunit.client.0.smithi142.stdout:5/172: creat dc/d14/f37 x:0 0 0 2024-04-20T21:58:26.690 INFO:tasks.workunit.client.0.smithi142.stdout:8/254: chown d0/d29/d36/f53 0 1 2024-04-20T21:58:26.691 INFO:tasks.workunit.client.0.smithi142.stdout:7/283: unlink d4/d9/f3d 0 2024-04-20T21:58:26.691 INFO:tasks.workunit.client.0.smithi142.stdout:4/249: dread d1/d6/d30/d3f/f1e [0,4194304] 0 2024-04-20T21:58:26.694 INFO:tasks.workunit.client.0.smithi142.stdout:7/284: chown d4/d9/d1c/d32 197179124 1 2024-04-20T21:58:26.695 INFO:tasks.workunit.client.0.smithi142.stdout:8/255: truncate d0/d17/d35/f3a 67270 0 2024-04-20T21:58:26.697 INFO:tasks.workunit.client.0.smithi142.stdout:4/250: write d1/d6/f1f [8330439,72715] 0 2024-04-20T21:58:26.697 INFO:tasks.workunit.client.0.smithi142.stdout:2/342: symlink d3/d5/d19/d70/d3c/d66/d6c/l72 0 2024-04-20T21:58:26.700 INFO:tasks.workunit.client.0.smithi142.stdout:3/261: mknod d6/d32/c50 0 2024-04-20T21:58:26.702 INFO:tasks.workunit.client.0.smithi142.stdout:6/243: dwrite d1/d5/f3d [0,4194304] 0 2024-04-20T21:58:26.705 INFO:tasks.workunit.client.0.smithi142.stdout:5/173: rename dc/d14/d21/d23/c29 to dc/d14/d26/c38 0 2024-04-20T21:58:26.708 INFO:tasks.workunit.client.0.smithi142.stdout:2/343: creat d3/d9/d34/d51/d31/f73 x:0 0 0 2024-04-20T21:58:26.712 INFO:tasks.workunit.client.0.smithi142.stdout:5/174: write dc/d14/f1a [178781,126434] 0 2024-04-20T21:58:26.714 INFO:tasks.workunit.client.0.smithi142.stdout:8/256: link d0/f20 d0/d29/f5d 0 2024-04-20T21:58:26.715 INFO:tasks.workunit.client.0.smithi142.stdout:3/262: creat d6/d32/f51 x:0 0 0 2024-04-20T21:58:26.719 INFO:tasks.workunit.client.0.smithi142.stdout:6/244: rename d1/d2f/d35/f4d to d1/d5/d1a/d3e/f57 0 2024-04-20T21:58:26.722 INFO:tasks.workunit.client.0.smithi142.stdout:7/285: getdents d4 0 2024-04-20T21:58:26.723 INFO:tasks.workunit.client.0.smithi142.stdout:5/175: chown dc/d14/f1f 13 1 2024-04-20T21:58:26.729 INFO:tasks.workunit.client.0.smithi142.stdout:2/344: dwrite d3/d5/d19/d70/f5f [0,4194304] 0 2024-04-20T21:58:26.732 INFO:tasks.workunit.client.0.smithi142.stdout:6/245: rename d1/d5/d3a/l56 to d1/d5/d1a/d39/l58 0 2024-04-20T21:58:26.732 INFO:tasks.workunit.client.0.smithi142.stdout:7/286: rmdir d4/d9/d11/d47/d5a 39 2024-04-20T21:58:26.733 INFO:tasks.workunit.client.0.smithi142.stdout:8/257: mkdir d0/d5e 0 2024-04-20T21:58:26.743 INFO:tasks.workunit.client.0.smithi142.stdout:2/345: mkdir d3/d5/d74 0 2024-04-20T21:58:26.746 INFO:tasks.workunit.client.0.smithi142.stdout:6/246: write d1/f15 [1928578,69663] 0 2024-04-20T21:58:26.747 INFO:tasks.workunit.client.0.smithi142.stdout:3/263: dwrite d6/f10 [4194304,4194304] 0 2024-04-20T21:58:26.749 INFO:tasks.workunit.client.0.smithi142.stdout:4/251: write d1/f8 [7526546,78018] 0 2024-04-20T21:58:26.750 INFO:tasks.workunit.client.0.smithi142.stdout:2/346: symlink d3/d5/d19/d70/d3c/l75 0 2024-04-20T21:58:26.754 INFO:tasks.workunit.client.0.smithi142.stdout:3/264: unlink d6/d15/d47/l4e 0 2024-04-20T21:58:26.757 INFO:tasks.workunit.client.0.smithi142.stdout:4/252: mkdir d1/d12/da/d1c/d32/d50 0 2024-04-20T21:58:26.758 INFO:tasks.workunit.client.0.smithi142.stdout:2/347: creat d3/d5/d19/f76 x:0 0 0 2024-04-20T21:58:26.760 INFO:tasks.workunit.client.0.smithi142.stdout:4/253: chown d1/d6/d30/f3a 352 1 2024-04-20T21:58:26.762 INFO:tasks.workunit.client.0.smithi142.stdout:4/254: truncate d1/f39 375576 0 2024-04-20T21:58:26.763 INFO:tasks.workunit.client.0.smithi142.stdout:2/348: dread d3/d9/f49 [0,4194304] 0 2024-04-20T21:58:26.764 INFO:tasks.workunit.client.0.smithi142.stdout:6/247: read d1/d5/f26 [1139131,100994] 0 2024-04-20T21:58:26.766 INFO:tasks.workunit.client.0.smithi142.stdout:8/258: getdents d0/d29 0 2024-04-20T21:58:26.772 INFO:tasks.workunit.client.0.smithi142.stdout:4/255: symlink d1/d12/da/d1c/l51 0 2024-04-20T21:58:26.774 INFO:tasks.workunit.client.0.smithi142.stdout:3/265: dwrite d6/f10 [4194304,4194304] 0 2024-04-20T21:58:26.782 INFO:tasks.workunit.client.0.smithi142.stdout:1/254: sync 2024-04-20T21:58:26.784 INFO:tasks.workunit.client.0.smithi142.stdout:8/259: symlink d0/d29/d36/d45/d4c/l5f 0 2024-04-20T21:58:26.788 INFO:tasks.workunit.client.0.smithi142.stdout:2/349: creat d3/d9/f77 x:0 0 0 2024-04-20T21:58:26.789 INFO:tasks.workunit.client.0.smithi142.stdout:1/255: dread - d2/dd/d17/d1b/d22/d13/f35 zero size 2024-04-20T21:58:26.790 INFO:tasks.workunit.client.0.smithi142.stdout:5/176: dwrite dc/d14/d21/f27 [0,4194304] 0 2024-04-20T21:58:26.795 INFO:tasks.workunit.client.0.smithi142.stdout:5/177: write dc/f32 [345325,79319] 0 2024-04-20T21:58:26.795 INFO:tasks.workunit.client.0.smithi142.stdout:2/350: fdatasync d3/d5/d19/d70/f43 0 2024-04-20T21:58:26.797 INFO:tasks.workunit.client.0.smithi142.stdout:8/260: link d0/d22/l2a d0/d22/l60 0 2024-04-20T21:58:26.798 INFO:tasks.workunit.client.0.smithi142.stdout:5/178: fdatasync dc/f2f 0 2024-04-20T21:58:26.798 INFO:tasks.workunit.client.0.smithi142.stdout:1/256: write d2/dd/d17/d1b/d22/d13/f14 [4790372,27612] 0 2024-04-20T21:58:26.803 INFO:tasks.workunit.client.0.smithi142.stdout:6/248: dwrite d1/d5/f3c [0,4194304] 0 2024-04-20T21:58:26.806 INFO:tasks.workunit.client.0.smithi142.stdout:2/351: write d3/d9/d34/f35 [722138,116206] 0 2024-04-20T21:58:26.807 INFO:tasks.workunit.client.0.smithi142.stdout:3/266: dread d6/f18 [0,4194304] 0 2024-04-20T21:58:26.809 INFO:tasks.workunit.client.0.smithi142.stdout:8/261: creat d0/d1c/f61 x:0 0 0 2024-04-20T21:58:26.809 INFO:tasks.workunit.client.0.smithi142.stdout:1/257: symlink d2/dd/d1c/d43/l57 0 2024-04-20T21:58:26.810 INFO:tasks.workunit.client.0.smithi142.stdout:2/352: fsync d3/d5/d19/d70/f4d 0 2024-04-20T21:58:26.812 INFO:tasks.workunit.client.0.smithi142.stdout:6/249: rmdir d1/d46/d2b/d34 39 2024-04-20T21:58:26.812 INFO:tasks.workunit.client.0.smithi142.stdout:3/267: dread - d6/d32/f51 zero size 2024-04-20T21:58:26.815 INFO:tasks.workunit.client.0.smithi142.stdout:8/262: chown d0/d29/f38 11963 1 2024-04-20T21:58:26.815 INFO:tasks.workunit.client.0.smithi142.stdout:1/258: dread - d2/dd/d17/d1b/d22/d13/f48 zero size 2024-04-20T21:58:26.819 INFO:tasks.workunit.client.0.smithi142.stdout:8/263: chown d0/d22/f39 53785 1 2024-04-20T21:58:26.820 INFO:tasks.workunit.client.0.smithi142.stdout:6/250: read - d1/d46/d2b/d34/f4c zero size 2024-04-20T21:58:26.823 INFO:tasks.workunit.client.0.smithi142.stdout:1/259: fdatasync d2/dd/d17/d1b/d22/f2f 0 2024-04-20T21:58:26.828 INFO:tasks.workunit.client.0.smithi142.stdout:3/268: creat d6/d32/f52 x:0 0 0 2024-04-20T21:58:26.834 INFO:tasks.workunit.client.0.smithi142.stdout:4/256: dread d1/d12/da/d1c/f34 [0,4194304] 0 2024-04-20T21:58:26.835 INFO:tasks.workunit.client.0.smithi142.stdout:6/251: dread d1/d46/d2b/f2a [0,4194304] 0 2024-04-20T21:58:26.838 INFO:tasks.workunit.client.0.smithi142.stdout:5/179: dwrite dc/f2f [0,4194304] 0 2024-04-20T21:58:26.839 INFO:tasks.workunit.client.0.smithi142.stdout:4/257: fsync d1/d6/f1f 0 2024-04-20T21:58:26.839 INFO:tasks.workunit.client.0.smithi142.stdout:6/252: rmdir d1/d5/d1a/d3e 39 2024-04-20T21:58:26.846 INFO:tasks.workunit.client.0.smithi142.stdout:3/269: rename d6/d15/c23 to d6/d15/c53 0 2024-04-20T21:58:26.847 INFO:tasks.workunit.client.0.smithi142.stdout:2/353: dwrite d3/d5/f5e [0,4194304] 0 2024-04-20T21:58:26.850 INFO:tasks.workunit.client.0.smithi142.stdout:6/253: creat d1/d11/f59 x:0 0 0 2024-04-20T21:58:26.855 INFO:tasks.workunit.client.0.smithi142.stdout:4/258: truncate d1/d12/da/d1c/d32/f4d 1042370 0 2024-04-20T21:58:26.855 INFO:tasks.workunit.client.0.smithi142.stdout:8/264: dwrite d0/d1c/f1e [0,4194304] 0 2024-04-20T21:58:26.859 INFO:tasks.workunit.client.0.smithi142.stdout:3/270: creat d6/d15/d30/d37/f54 x:0 0 0 2024-04-20T21:58:26.866 INFO:tasks.workunit.client.0.smithi142.stdout:4/259: mkdir d1/d12/da/d1c/d32/d3d/d2f/d52 0 2024-04-20T21:58:26.871 INFO:tasks.workunit.client.0.smithi142.stdout:3/271: unlink f2 0 2024-04-20T21:58:26.871 INFO:tasks.workunit.client.0.smithi142.stdout:6/254: rename d1/f15 to d1/d5/d1a/d3e/f5a 0 2024-04-20T21:58:26.878 INFO:tasks.workunit.client.0.smithi142.stdout:1/260: truncate d2/f45 2421739 0 2024-04-20T21:58:26.879 INFO:tasks.workunit.client.0.smithi142.stdout:8/265: dwrite d0/d29/f2e [0,4194304] 0 2024-04-20T21:58:26.880 INFO:tasks.workunit.client.0.smithi142.stdout:3/272: mknod d6/d15/d30/d37/c55 0 2024-04-20T21:58:26.882 INFO:tasks.workunit.client.0.smithi142.stdout:5/180: link dc/d14/d21/d23/l34 dc/d14/d21/l39 0 2024-04-20T21:58:26.889 INFO:tasks.workunit.client.0.smithi142.stdout:3/273: creat d6/d15/d1e/d43/d4d/f56 x:0 0 0 2024-04-20T21:58:26.891 INFO:tasks.workunit.client.0.smithi142.stdout:8/266: creat d0/d1c/d44/f62 x:0 0 0 2024-04-20T21:58:26.896 INFO:tasks.workunit.client.0.smithi142.stdout:8/267: chown d0/d29/d36/d45/l48 479603 1 2024-04-20T21:58:26.898 INFO:tasks.workunit.client.0.smithi142.stdout:8/268: dread - d0/d1c/f31 zero size 2024-04-20T21:58:26.898 INFO:tasks.workunit.client.0.smithi142.stdout:6/255: dwrite d1/d5/d1a/d39/f52 [0,4194304] 0 2024-04-20T21:58:26.898 INFO:tasks.workunit.client.0.smithi142.stdout:3/274: dread - d6/d32/f42 zero size 2024-04-20T21:58:26.898 INFO:tasks.workunit.client.0.smithi142.stdout:4/260: dwrite d1/d6/f2d [0,4194304] 0 2024-04-20T21:58:26.900 INFO:tasks.workunit.client.0.smithi142.stdout:6/256: chown d1/d1b/c1f 31 1 2024-04-20T21:58:26.901 INFO:tasks.workunit.client.0.smithi142.stdout:8/269: chown d0/d29/d36/d45/f4d 783902 1 2024-04-20T21:58:26.902 INFO:tasks.workunit.client.0.smithi142.stdout:3/275: fdatasync d6/f10 0 2024-04-20T21:58:26.902 INFO:tasks.workunit.client.0.smithi142.stdout:6/257: stat d1/d5 0 2024-04-20T21:58:26.906 INFO:tasks.workunit.client.0.smithi142.stdout:5/181: rename dc/f1b to dc/d14/d25/f3a 0 2024-04-20T21:58:26.915 INFO:tasks.workunit.client.0.smithi142.stdout:9/322: sync 2024-04-20T21:58:26.915 INFO:tasks.workunit.client.0.smithi142.stdout:7/287: sync 2024-04-20T21:58:26.920 INFO:tasks.workunit.client.0.smithi142.stdout:8/270: mknod d0/d29/d36/d45/d59/c63 0 2024-04-20T21:58:26.925 INFO:tasks.workunit.client.0.smithi142.stdout:3/276: mknod d6/d15/d1e/d43/d4d/c57 0 2024-04-20T21:58:26.925 INFO:tasks.workunit.client.0.smithi142.stdout:1/261: dwrite d2/dd/d17/f21 [0,4194304] 0 2024-04-20T21:58:26.925 INFO:tasks.workunit.client.0.smithi142.stdout:4/261: getdents d1/d12/da/d1c/d32/d50 0 2024-04-20T21:58:26.928 INFO:tasks.workunit.client.0.smithi142.stdout:9/323: symlink d0/d2a/d39/d50/l70 0 2024-04-20T21:58:26.930 INFO:tasks.workunit.client.0.smithi142.stdout:1/262: chown d2/dd/d17/d3b 13 1 2024-04-20T21:58:26.932 INFO:tasks.workunit.client.0.smithi142.stdout:6/258: dread d1/d46/f28 [0,4194304] 0 2024-04-20T21:58:26.934 INFO:tasks.workunit.client.0.smithi142.stdout:2/354: dread d3/d5/d19/d70/d3c/f38 [0,4194304] 0 2024-04-20T21:58:26.935 INFO:tasks.workunit.client.0.smithi142.stdout:9/324: write d0/d36/f53 [753403,8648] 0 2024-04-20T21:58:26.941 INFO:tasks.workunit.client.0.smithi142.stdout:7/288: rmdir d4/d9/d11/d47/d5a 39 2024-04-20T21:58:26.941 INFO:tasks.workunit.client.0.smithi142.stdout:9/325: chown d0/l5 58799743 1 2024-04-20T21:58:26.946 INFO:tasks.workunit.client.0.smithi142.stdout:5/182: dwrite dc/d14/d25/f2d [0,4194304] 0 2024-04-20T21:58:26.947 INFO:tasks.workunit.client.0.smithi142.stdout:3/277: symlink d6/d32/l58 0 2024-04-20T21:58:26.949 INFO:tasks.workunit.client.0.smithi142.stdout:3/278: dread - d6/d32/f52 zero size 2024-04-20T21:58:26.951 INFO:tasks.workunit.client.0.smithi142.stdout:2/355: symlink d3/d5/d19/l78 0 2024-04-20T21:58:26.953 INFO:tasks.workunit.client.0.smithi142.stdout:7/289: truncate d4/d9/d1c/d5e/d4d/f60 877324 0 2024-04-20T21:58:26.954 INFO:tasks.workunit.client.0.smithi142.stdout:6/259: rename d1/d5/d1a to d1/d2f/d35/d5b 0 2024-04-20T21:58:26.957 INFO:tasks.workunit.client.0.smithi142.stdout:4/262: getdents d1/d12/da/d1c/d32/d50 0 2024-04-20T21:58:26.960 INFO:tasks.workunit.client.0.smithi142.stdout:4/263: write d1/d6/f2d [5133754,15381] 0 2024-04-20T21:58:26.960 INFO:tasks.workunit.client.0.smithi142.stdout:9/326: chown d0/d36/c49 258433 1 2024-04-20T21:58:26.960 INFO:tasks.workunit.client.0.smithi142.stdout:8/271: dwrite d0/d17/f3b [0,4194304] 0 2024-04-20T21:58:26.961 INFO:tasks.workunit.client.0.smithi142.stdout:1/263: mknod d2/dd/d17/d1b/d22/c58 0 2024-04-20T21:58:26.962 INFO:tasks.workunit.client.0.smithi142.stdout:4/264: fsync d1/d12/da/d1c/f25 0 2024-04-20T21:58:26.963 INFO:tasks.workunit.client.0.smithi142.stdout:4/265: dread - d1/d6/f47 zero size 2024-04-20T21:58:26.966 INFO:tasks.workunit.client.0.smithi142.stdout:1/264: dread - d2/f3e zero size 2024-04-20T21:58:26.966 INFO:tasks.workunit.client.0.smithi142.stdout:5/183: mknod dc/d14/d26/c3b 0 2024-04-20T21:58:26.967 INFO:tasks.workunit.client.0.smithi142.stdout:8/272: read d0/d29/d36/d45/f4d [1782076,72654] 0 2024-04-20T21:58:26.968 INFO:tasks.workunit.client.0.smithi142.stdout:3/279: mkdir d6/d15/d1e/d43/d4d/d59 0 2024-04-20T21:58:26.970 INFO:tasks.workunit.client.0.smithi142.stdout:0/281: sync 2024-04-20T21:58:26.972 INFO:tasks.workunit.client.0.smithi142.stdout:3/280: write d6/f18 [865237,74320] 0 2024-04-20T21:58:26.973 INFO:tasks.workunit.client.0.smithi142.stdout:2/356: rename d3/d5/f20 to d3/d5/d19/f79 0 2024-04-20T21:58:26.973 INFO:tasks.workunit.client.0.smithi142.stdout:1/265: chown d2/dd/d17/d1b/d22/d20/f2d 56674445 1 2024-04-20T21:58:26.975 INFO:tasks.workunit.client.0.smithi142.stdout:7/290: write d4/d9/d1c/f5f [152085,38135] 0 2024-04-20T21:58:26.978 INFO:tasks.workunit.client.0.smithi142.stdout:9/327: mknod d0/d36/d55/c71 0 2024-04-20T21:58:26.979 INFO:tasks.workunit.client.0.smithi142.stdout:7/291: read d4/d9/f30 [288677,77485] 0 2024-04-20T21:58:26.980 INFO:tasks.workunit.client.0.smithi142.stdout:5/184: mkdir dc/d14/d21/d23/d2a/d3c 0 2024-04-20T21:58:26.980 INFO:tasks.workunit.client.0.smithi142.stdout:1/266: read - d2/dd/d17/d1b/d22/d13/f39 zero size 2024-04-20T21:58:26.981 INFO:tasks.workunit.client.0.smithi142.stdout:9/328: dread - d0/d2a/d39/d50/f6b zero size 2024-04-20T21:58:26.982 INFO:tasks.workunit.client.0.smithi142.stdout:8/273: mknod d0/d17/d35/c64 0 2024-04-20T21:58:26.990 INFO:tasks.workunit.client.0.smithi142.stdout:0/282: symlink d5/d1c/d29/d38/l67 0 2024-04-20T21:58:26.993 INFO:tasks.workunit.client.0.smithi142.stdout:3/281: rename d6/d32/c3e to d6/d15/d1e/d43/c5a 0 2024-04-20T21:58:26.994 INFO:tasks.workunit.client.0.smithi142.stdout:7/292: symlink d4/d9/d1c/d5e/d4d/l66 0 2024-04-20T21:58:26.996 INFO:tasks.workunit.client.0.smithi142.stdout:1/267: creat d2/dd/d17/d1b/f59 x:0 0 0 2024-04-20T21:58:26.998 INFO:tasks.workunit.client.0.smithi142.stdout:1/268: chown d2/dd/d17/d1b/d22/f56 2766 1 2024-04-20T21:58:27.000 INFO:tasks.workunit.client.0.smithi142.stdout:1/269: write d2/dd/d17/d1b/f1d [2332818,48531] 0 2024-04-20T21:58:27.003 INFO:tasks.workunit.client.0.smithi142.stdout:1/270: fdatasync d2/dd/d17/d1b/d22/f4b 0 2024-04-20T21:58:27.004 INFO:tasks.workunit.client.0.smithi142.stdout:5/185: rename f7 to dc/d14/d26/f3d 0 2024-04-20T21:58:27.004 INFO:tasks.workunit.client.0.smithi142.stdout:6/260: truncate d1/d46/f28 2197420 0 2024-04-20T21:58:27.004 INFO:tasks.workunit.client.0.smithi142.stdout:8/274: rename d0/d1c to d0/d1c/d44/d65 22 2024-04-20T21:58:27.006 INFO:tasks.workunit.client.0.smithi142.stdout:1/271: dread - d2/dd/d17/d1b/f59 zero size 2024-04-20T21:58:27.007 INFO:tasks.workunit.client.0.smithi142.stdout:2/357: write d3/d9/f49 [7547,7516] 0 2024-04-20T21:58:27.012 INFO:tasks.workunit.client.0.smithi142.stdout:7/293: fdatasync d4/d9/d1c/d5e/f1f 0 2024-04-20T21:58:27.012 INFO:tasks.workunit.client.0.smithi142.stdout:4/266: getdents d1/d6/d30/d3f 0 2024-04-20T21:58:27.017 INFO:tasks.workunit.client.0.smithi142.stdout:0/283: rename d5/d1c/d29/d38/c34 to d5/d45/c68 0 2024-04-20T21:58:27.021 INFO:tasks.workunit.client.0.smithi142.stdout:0/284: dread d5/d13/d1e/d23/d2c/f41 [0,4194304] 0 2024-04-20T21:58:27.021 INFO:tasks.workunit.client.0.smithi142.stdout:6/261: mkdir d1/d5/d3a/d43/d5c 0 2024-04-20T21:58:27.022 INFO:tasks.workunit.client.0.smithi142.stdout:2/358: dwrite d3/d5/f60 [0,4194304] 0 2024-04-20T21:58:27.024 INFO:tasks.workunit.client.0.smithi142.stdout:6/262: write d1/d5/d3a/f42 [125087,21642] 0 2024-04-20T21:58:27.025 INFO:tasks.workunit.client.0.smithi142.stdout:8/275: creat d0/d17/f66 x:0 0 0 2024-04-20T21:58:27.026 INFO:tasks.workunit.client.0.smithi142.stdout:2/359: dread - d3/d9/d34/f56 zero size 2024-04-20T21:58:27.031 INFO:tasks.workunit.client.0.smithi142.stdout:9/329: link d0/d3c/l3f d0/d2a/d39/l72 0 2024-04-20T21:58:27.032 INFO:tasks.workunit.client.0.smithi142.stdout:2/360: dread d3/d5/d19/f59 [0,4194304] 0 2024-04-20T21:58:27.036 INFO:tasks.workunit.client.0.smithi142.stdout:9/330: write d0/f54 [352043,84380] 0 2024-04-20T21:58:27.037 INFO:tasks.workunit.client.0.smithi142.stdout:4/267: symlink d1/d12/da/d1c/d32/d3d/d2f/l53 0 2024-04-20T21:58:27.044 INFO:tasks.workunit.client.0.smithi142.stdout:5/186: rename dc/f16 to dc/d14/d21/d23/d2a/d30/f3e 0 2024-04-20T21:58:27.046 INFO:tasks.workunit.client.0.smithi142.stdout:3/282: creat d6/d15/f5b x:0 0 0 2024-04-20T21:58:27.049 INFO:tasks.workunit.client.0.smithi142.stdout:0/285: unlink d5/d13/d1e/d23/d46/f5f 0 2024-04-20T21:58:27.051 INFO:tasks.workunit.client.0.smithi142.stdout:4/268: dread d1/d12/da/d1c/f34 [0,4194304] 0 2024-04-20T21:58:27.051 INFO:tasks.workunit.client.0.smithi142.stdout:6/263: creat d1/d11/f5d x:0 0 0 2024-04-20T21:58:27.052 INFO:tasks.workunit.client.0.smithi142.stdout:4/269: readlink d1/d12/l46 0 2024-04-20T21:58:27.053 INFO:tasks.workunit.client.0.smithi142.stdout:8/276: mknod d0/d22/d3f/c67 0 2024-04-20T21:58:27.054 INFO:tasks.workunit.client.0.smithi142.stdout:8/277: chown d0/f13 34536 1 2024-04-20T21:58:27.055 INFO:tasks.workunit.client.0.smithi142.stdout:8/278: chown d0/f58 3949146 1 2024-04-20T21:58:27.057 INFO:tasks.workunit.client.0.smithi142.stdout:8/279: dread - d0/d1c/d44/f62 zero size 2024-04-20T21:58:27.060 INFO:tasks.workunit.client.0.smithi142.stdout:1/272: truncate d2/dd/d17/f1a 635027 0 2024-04-20T21:58:27.063 INFO:tasks.workunit.client.0.smithi142.stdout:0/286: dwrite d5/f21 [0,4194304] 0 2024-04-20T21:58:27.064 INFO:tasks.workunit.client.0.smithi142.stdout:7/294: mknod d4/d9/d11/d47/d5a/c67 0 2024-04-20T21:58:27.075 INFO:tasks.workunit.client.0.smithi142.stdout:3/283: creat d6/d15/d30/f5c x:0 0 0 2024-04-20T21:58:27.076 INFO:tasks.workunit.client.0.smithi142.stdout:0/287: dread d5/f21 [0,4194304] 0 2024-04-20T21:58:27.080 INFO:tasks.workunit.client.0.smithi142.stdout:4/270: unlink d1/d12/l46 0 2024-04-20T21:58:27.087 INFO:tasks.workunit.client.0.smithi142.stdout:8/280: mkdir d0/d29/d36/d45/d4c/d68 0 2024-04-20T21:58:27.089 INFO:tasks.workunit.client.0.smithi142.stdout:1/273: mknod d2/dd/d17/d3b/d50/c5a 0 2024-04-20T21:58:27.090 INFO:tasks.workunit.client.0.smithi142.stdout:1/274: chown d2/c53 16773 1 2024-04-20T21:58:27.091 INFO:tasks.workunit.client.0.smithi142.stdout:7/295: creat d4/d9/d1c/d5e/d64/f68 x:0 0 0 2024-04-20T21:58:27.093 INFO:tasks.workunit.client.0.smithi142.stdout:9/331: link d0/f23 d0/d3c/d4d/d63/f73 0 2024-04-20T21:58:27.093 INFO:tasks.workunit.client.0.smithi142.stdout:7/296: write d4/d9/d1c/d5e/f34 [4011607,87997] 0 2024-04-20T21:58:27.095 INFO:tasks.workunit.client.0.smithi142.stdout:0/288: chown d5/f58 0 1 2024-04-20T21:58:27.096 INFO:tasks.workunit.client.0.smithi142.stdout:9/332: write d0/fc [4935311,111311] 0 2024-04-20T21:58:27.096 INFO:tasks.workunit.client.0.smithi142.stdout:3/284: mknod d6/d15/d1e/c5d 0 2024-04-20T21:58:27.098 INFO:tasks.workunit.client.0.smithi142.stdout:6/264: mknod d1/d5/d3a/d43/d5c/c5e 0 2024-04-20T21:58:27.100 INFO:tasks.workunit.client.0.smithi142.stdout:6/265: chown d1/d1b/f51 6 1 2024-04-20T21:58:27.103 INFO:tasks.workunit.client.0.smithi142.stdout:1/275: creat d2/dd/d17/d1b/f5b x:0 0 0 2024-04-20T21:58:27.106 INFO:tasks.workunit.client.0.smithi142.stdout:7/297: dread d4/d9/d1c/d5e/d4d/f60 [0,4194304] 0 2024-04-20T21:58:27.109 INFO:tasks.workunit.client.0.smithi142.stdout:0/289: mknod d5/d1c/d3c/d54/c69 0 2024-04-20T21:58:27.112 INFO:tasks.workunit.client.0.smithi142.stdout:8/281: getdents d0/d5e 0 2024-04-20T21:58:27.114 INFO:tasks.workunit.client.0.smithi142.stdout:8/282: fsync d0/d1c/f1e 0 2024-04-20T21:58:27.116 INFO:tasks.workunit.client.0.smithi142.stdout:5/187: getdents dc/d14/d21 0 2024-04-20T21:58:27.121 INFO:tasks.workunit.client.0.smithi142.stdout:1/276: rename d2/dd/d1c/l2a to d2/dd/d1c/d43/l5c 0 2024-04-20T21:58:27.122 INFO:tasks.workunit.client.0.smithi142.stdout:7/298: creat d4/d9/f69 x:0 0 0 2024-04-20T21:58:27.122 INFO:tasks.workunit.client.0.smithi142.stdout:1/277: chown d2/c53 89490378 1 2024-04-20T21:58:27.126 INFO:tasks.workunit.client.0.smithi142.stdout:0/290: dwrite d5/f53 [0,4194304] 0 2024-04-20T21:58:27.128 INFO:tasks.workunit.client.0.smithi142.stdout:6/266: link d1/d5/f38 d1/d2f/d35/d5b/d3e/f5f 0 2024-04-20T21:58:27.130 INFO:tasks.workunit.client.0.smithi142.stdout:8/283: symlink d0/d42/l69 0 2024-04-20T21:58:27.132 INFO:tasks.workunit.client.0.smithi142.stdout:5/188: mkdir dc/d14/d26/d3f 0 2024-04-20T21:58:27.138 INFO:tasks.workunit.client.0.smithi142.stdout:9/333: dread d0/f24 [0,4194304] 0 2024-04-20T21:58:27.140 INFO:tasks.workunit.client.0.smithi142.stdout:8/284: mknod d0/d29/c6a 0 2024-04-20T21:58:27.142 INFO:tasks.workunit.client.0.smithi142.stdout:5/189: mknod dc/d14/d21/c40 0 2024-04-20T21:58:27.143 INFO:tasks.workunit.client.0.smithi142.stdout:8/285: stat d0/d1c/l2b 0 2024-04-20T21:58:27.144 INFO:tasks.workunit.client.0.smithi142.stdout:3/285: getdents d6/d15/d1e/d43 0 2024-04-20T21:58:27.145 INFO:tasks.workunit.client.0.smithi142.stdout:6/267: dread d1/d2f/d35/d5b/d39/f52 [0,4194304] 0 2024-04-20T21:58:27.147 INFO:tasks.workunit.client.0.smithi142.stdout:0/291: dwrite d5/d13/f14 [0,4194304] 0 2024-04-20T21:58:27.147 INFO:tasks.workunit.client.0.smithi142.stdout:9/334: unlink d0/d2a/d39/d50/l52 0 2024-04-20T21:58:27.148 INFO:tasks.workunit.client.0.smithi142.stdout:5/190: dread dc/f32 [0,4194304] 0 2024-04-20T21:58:27.148 INFO:tasks.workunit.client.0.smithi142.stdout:5/191: fdatasync f4 0 2024-04-20T21:58:27.151 INFO:tasks.workunit.client.0.smithi142.stdout:0/292: read d5/f9 [3320485,38775] 0 2024-04-20T21:58:27.153 INFO:tasks.workunit.client.0.smithi142.stdout:3/286: unlink d6/d15/d1e/d43/d4d/c57 0 2024-04-20T21:58:27.156 INFO:tasks.workunit.client.0.smithi142.stdout:3/287: fsync d6/d15/d30/f46 0 2024-04-20T21:58:27.164 INFO:tasks.workunit.client.0.smithi142.stdout:0/293: dread d5/d1d/f4e [0,4194304] 0 2024-04-20T21:58:27.173 INFO:tasks.workunit.client.0.smithi142.stdout:5/192: creat dc/d14/f41 x:0 0 0 2024-04-20T21:58:27.174 INFO:tasks.workunit.client.0.smithi142.stdout:3/288: link d6/f35 d6/d15/f5e 0 2024-04-20T21:58:27.176 INFO:tasks.workunit.client.0.smithi142.stdout:0/294: mknod d5/d1c/d29/c6a 0 2024-04-20T21:58:27.184 INFO:tasks.workunit.client.0.smithi142.stdout:3/289: write d6/f4b [457568,14278] 0 2024-04-20T21:58:27.185 INFO:tasks.workunit.client.0.smithi142.stdout:4/271: truncate d1/d12/da/d1c/d32/f43 5369281 0 2024-04-20T21:58:27.188 INFO:tasks.workunit.client.0.smithi142.stdout:0/295: mknod d5/d13/d1e/d23/d24/d48/c6b 0 2024-04-20T21:58:27.188 INFO:tasks.workunit.client.0.smithi142.stdout:0/296: write d5/f9 [3622703,65861] 0 2024-04-20T21:58:27.202 INFO:tasks.workunit.client.0.smithi142.stdout:0/297: unlink d5/d13/f2b 0 2024-04-20T21:58:27.204 INFO:tasks.workunit.client.0.smithi142.stdout:7/299: write d4/d9/d1c/f21 [1280910,126585] 0 2024-04-20T21:58:27.209 INFO:tasks.workunit.client.0.smithi142.stdout:6/268: dread d1/d11/fa [0,4194304] 0 2024-04-20T21:58:27.212 INFO:tasks.workunit.client.0.smithi142.stdout:7/300: rename d4/d9/d11/d22/f59 to d4/d9/d11/d47/d5a/d62/f6a 0 2024-04-20T21:58:27.213 INFO:tasks.workunit.client.0.smithi142.stdout:0/298: creat d5/f6c x:0 0 0 2024-04-20T21:58:27.215 INFO:tasks.workunit.client.0.smithi142.stdout:7/301: write d4/d9/f69 [495443,2308] 0 2024-04-20T21:58:27.218 INFO:tasks.workunit.client.0.smithi142.stdout:0/299: dread - d5/d13/d1e/d23/d24/d48/f65 zero size 2024-04-20T21:58:27.218 INFO:tasks.workunit.client.0.smithi142.stdout:4/272: dread d1/d12/da/f22 [0,4194304] 0 2024-04-20T21:58:27.219 INFO:tasks.workunit.client.0.smithi142.stdout:7/302: write d4/f48 [250165,19270] 0 2024-04-20T21:58:27.225 INFO:tasks.workunit.client.0.smithi142.stdout:7/303: write d4/d9/d11/d22/f2b [1453621,106301] 0 2024-04-20T21:58:27.225 INFO:tasks.workunit.client.0.smithi142.stdout:8/286: dwrite d0/f1b [0,4194304] 0 2024-04-20T21:58:27.226 INFO:tasks.workunit.client.0.smithi142.stdout:0/300: write d5/d1d/f4e [2139063,87929] 0 2024-04-20T21:58:27.227 INFO:tasks.workunit.client.0.smithi142.stdout:5/193: write dc/d14/f1f [1033185,127928] 0 2024-04-20T21:58:27.231 INFO:tasks.workunit.client.0.smithi142.stdout:0/301: chown d5/d13/d1e/d23/f39 26590 1 2024-04-20T21:58:27.231 INFO:tasks.workunit.client.0.smithi142.stdout:4/273: mkdir d1/d6/d30/d3f/d54 0 2024-04-20T21:58:27.234 INFO:tasks.workunit.client.0.smithi142.stdout:8/287: symlink d0/d22/d3f/l6b 0 2024-04-20T21:58:27.239 INFO:tasks.workunit.client.0.smithi142.stdout:4/274: write d1/f13 [128945,20084] 0 2024-04-20T21:58:27.241 INFO:tasks.workunit.client.0.smithi142.stdout:7/304: fsync d4/d9/d11/d47/d5a/d62/f6a 0 2024-04-20T21:58:27.246 INFO:tasks.workunit.client.0.smithi142.stdout:0/302: mkdir d5/d6d 0 2024-04-20T21:58:27.247 INFO:tasks.workunit.client.0.smithi142.stdout:3/290: dwrite d6/f8 [0,4194304] 0 2024-04-20T21:58:27.251 INFO:tasks.workunit.client.0.smithi142.stdout:5/194: creat dc/d14/d21/d23/d2a/d30/f42 x:0 0 0 2024-04-20T21:58:27.251 INFO:tasks.workunit.client.0.smithi142.stdout:3/291: dread - d6/d15/d30/f5c zero size 2024-04-20T21:58:27.253 INFO:tasks.workunit.client.0.smithi142.stdout:7/305: write d4/d9/d11/d22/f3a [8936997,106916] 0 2024-04-20T21:58:27.253 INFO:tasks.workunit.client.0.smithi142.stdout:0/303: symlink d5/d1d/l6e 0 2024-04-20T21:58:27.254 INFO:tasks.workunit.client.0.smithi142.stdout:4/275: mknod d1/d12/da/d1c/d32/d3d/d2f/d52/c55 0 2024-04-20T21:58:27.257 INFO:tasks.workunit.client.0.smithi142.stdout:5/195: creat dc/f43 x:0 0 0 2024-04-20T21:58:27.258 INFO:tasks.workunit.client.0.smithi142.stdout:6/269: dwrite d1/d2f/f4e [0,4194304] 0 2024-04-20T21:58:27.261 INFO:tasks.workunit.client.0.smithi142.stdout:0/304: stat d5/d1c/d29/d32/l35 0 2024-04-20T21:58:27.262 INFO:tasks.workunit.client.0.smithi142.stdout:8/288: truncate d0/f13 5034506 0 2024-04-20T21:58:27.267 INFO:tasks.workunit.client.0.smithi142.stdout:8/289: fsync d0/f58 0 2024-04-20T21:58:27.269 INFO:tasks.workunit.client.0.smithi142.stdout:3/292: rename d6/d15/d30/d37/l4c to d6/d15/d1e/d43/d4d/l5f 0 2024-04-20T21:58:27.271 INFO:tasks.workunit.client.0.smithi142.stdout:0/305: fdatasync d5/d1c/d29/d38/f1f 0 2024-04-20T21:58:27.272 INFO:tasks.workunit.client.0.smithi142.stdout:5/196: creat dc/d14/d21/d23/d2a/d3c/f44 x:0 0 0 2024-04-20T21:58:27.272 INFO:tasks.workunit.client.0.smithi142.stdout:3/293: fsync d6/d15/f19 0 2024-04-20T21:58:27.281 INFO:tasks.workunit.client.0.smithi142.stdout:4/276: dread d1/d12/da/d1c/f25 [0,4194304] 0 2024-04-20T21:58:27.282 INFO:tasks.workunit.client.0.smithi142.stdout:0/306: readlink d5/d13/d1e/d23/d24/l27 0 2024-04-20T21:58:27.284 INFO:tasks.workunit.client.0.smithi142.stdout:6/270: dread d1/d2f/f4e [0,4194304] 0 2024-04-20T21:58:27.284 INFO:tasks.workunit.client.0.smithi142.stdout:8/290: creat d0/d29/f6c x:0 0 0 2024-04-20T21:58:27.290 INFO:tasks.workunit.client.0.smithi142.stdout:0/307: rmdir d5/d1d 39 2024-04-20T21:58:27.290 INFO:tasks.workunit.client.0.smithi142.stdout:0/308: chown d5/d1c 9958 1 2024-04-20T21:58:27.292 INFO:tasks.workunit.client.0.smithi142.stdout:5/197: rename dc/d14/d21/l39 to dc/d14/d21/d23/d2a/l45 0 2024-04-20T21:58:27.293 INFO:tasks.workunit.client.0.smithi142.stdout:6/271: chown d1/d5/d3a/f42 8877296 1 2024-04-20T21:58:27.293 INFO:tasks.workunit.client.0.smithi142.stdout:7/306: dwrite d4/d9/d1c/d5e/f51 [0,4194304] 0 2024-04-20T21:58:27.294 INFO:tasks.workunit.client.0.smithi142.stdout:4/277: chown d1/d12/da/d1c/d32/f40 6565 1 2024-04-20T21:58:27.297 INFO:tasks.workunit.client.0.smithi142.stdout:4/278: chown d1/d6/f47 3283 1 2024-04-20T21:58:27.299 INFO:tasks.workunit.client.0.smithi142.stdout:5/198: fsync dc/d14/f22 0 2024-04-20T21:58:27.302 INFO:tasks.workunit.client.0.smithi142.stdout:6/272: write d1/d11/fa [3987878,178] 0 2024-04-20T21:58:27.307 INFO:tasks.workunit.client.0.smithi142.stdout:6/273: symlink d1/d2f/l60 0 2024-04-20T21:58:27.310 INFO:tasks.workunit.client.0.smithi142.stdout:0/309: fsync d5/d13/d1e/d23/d46/f4c 0 2024-04-20T21:58:27.311 INFO:tasks.workunit.client.0.smithi142.stdout:3/294: dwrite d6/d15/d30/f46 [0,4194304] 0 2024-04-20T21:58:27.316 INFO:tasks.workunit.client.0.smithi142.stdout:6/274: unlink d1/f23 0 2024-04-20T21:58:27.316 INFO:tasks.workunit.client.0.smithi142.stdout:0/310: fsync d5/d13/d1e/d23/f39 0 2024-04-20T21:58:27.317 INFO:tasks.workunit.client.0.smithi142.stdout:8/291: truncate d0/d17/f3b 3309082 0 2024-04-20T21:58:27.327 INFO:tasks.workunit.client.0.smithi142.stdout:4/279: creat d1/d6/d30/d3f/d54/f56 x:0 0 0 2024-04-20T21:58:27.328 INFO:tasks.workunit.client.0.smithi142.stdout:7/307: link d4/d9/d1c/d5e/d4d/l56 d4/d9/d11/l6b 0 2024-04-20T21:58:27.329 INFO:tasks.workunit.client.0.smithi142.stdout:5/199: dwrite dc/f43 [0,4194304] 0 2024-04-20T21:58:27.329 INFO:tasks.workunit.client.0.smithi142.stdout:6/275: mkdir d1/d46/d2b/d4b/d61 0 2024-04-20T21:58:27.337 INFO:tasks.workunit.client.0.smithi142.stdout:6/276: dread - d1/d2f/d35/f47 zero size 2024-04-20T21:58:27.337 INFO:tasks.workunit.client.0.smithi142.stdout:8/292: rename d0/f4b to d0/d17/f6d 0 2024-04-20T21:58:27.344 INFO:tasks.workunit.client.0.smithi142.stdout:4/280: symlink d1/d12/da/d1c/d32/l57 0 2024-04-20T21:58:27.346 INFO:tasks.workunit.client.0.smithi142.stdout:3/295: write d6/f35 [2644781,67964] 0 2024-04-20T21:58:27.352 INFO:tasks.workunit.client.0.smithi142.stdout:7/308: mknod d4/d9/d11/c6c 0 2024-04-20T21:58:27.353 INFO:tasks.workunit.client.0.smithi142.stdout:3/296: dread d6/f31 [0,4194304] 0 2024-04-20T21:58:27.354 INFO:tasks.workunit.client.0.smithi142.stdout:7/309: read - d4/f27 zero size 2024-04-20T21:58:27.356 INFO:tasks.workunit.client.0.smithi142.stdout:8/293: unlink d0/d17/f1a 0 2024-04-20T21:58:27.357 INFO:tasks.workunit.client.0.smithi142.stdout:0/311: dwrite d5/d1c/d3c/f43 [0,4194304] 0 2024-04-20T21:58:27.360 INFO:tasks.workunit.client.0.smithi142.stdout:3/297: read - d6/d15/f5b zero size 2024-04-20T21:58:27.367 INFO:tasks.workunit.client.0.smithi142.stdout:5/200: rename dc/d14/d21/d23 to dc/d14/d21/d46 0 2024-04-20T21:58:27.371 INFO:tasks.workunit.client.0.smithi142.stdout:8/294: unlink d0/d22/d3f/c67 0 2024-04-20T21:58:27.375 INFO:tasks.workunit.client.0.smithi142.stdout:7/310: creat d4/d9/d1c/f6d x:0 0 0 2024-04-20T21:58:27.379 INFO:tasks.workunit.client.0.smithi142.stdout:4/281: dwrite d1/ff [0,4194304] 0 2024-04-20T21:58:27.379 INFO:tasks.workunit.client.0.smithi142.stdout:6/277: getdents d1/d46/d2b 0 2024-04-20T21:58:27.381 INFO:tasks.workunit.client.0.smithi142.stdout:3/298: dwrite d6/f10 [0,4194304] 0 2024-04-20T21:58:27.382 INFO:tasks.workunit.client.0.smithi142.stdout:4/282: chown d1/d6/d30/f3a 0 1 2024-04-20T21:58:27.385 INFO:tasks.workunit.client.0.smithi142.stdout:8/295: write d0/d29/f38 [3842078,23296] 0 2024-04-20T21:58:27.386 INFO:tasks.workunit.client.0.smithi142.stdout:7/311: creat d4/d9/d1c/f6e x:0 0 0 2024-04-20T21:58:27.394 INFO:tasks.workunit.client.0.smithi142.stdout:0/312: write d5/f21 [2417481,3184] 0 2024-04-20T21:58:27.394 INFO:tasks.workunit.client.0.smithi142.stdout:8/296: mkdir d0/d17/d6e 0 2024-04-20T21:58:27.396 INFO:tasks.workunit.client.0.smithi142.stdout:8/297: fdatasync d0/f2f 0 2024-04-20T21:58:27.397 INFO:tasks.workunit.client.0.smithi142.stdout:3/299: creat d6/d15/d30/d37/f60 x:0 0 0 2024-04-20T21:58:27.401 INFO:tasks.workunit.client.0.smithi142.stdout:4/283: truncate d1/d6/fc 3774287 0 2024-04-20T21:58:27.403 INFO:tasks.workunit.client.0.smithi142.stdout:0/313: rename d5/d1c/d3c/d54 to d5/d45/d6f 0 2024-04-20T21:58:27.406 INFO:tasks.workunit.client.0.smithi142.stdout:5/201: write dc/d14/d26/f3d [1128970,7221] 0 2024-04-20T21:58:27.406 INFO:tasks.workunit.client.0.smithi142.stdout:0/314: fsync d5/d13/d1e/f59 0 2024-04-20T21:58:27.408 INFO:tasks.workunit.client.0.smithi142.stdout:3/300: creat d6/d15/d47/f61 x:0 0 0 2024-04-20T21:58:27.408 INFO:tasks.workunit.client.0.smithi142.stdout:6/278: link d1/d46/d2b/l32 d1/d46/d2b/d34/l62 0 2024-04-20T21:58:27.411 INFO:tasks.workunit.client.0.smithi142.stdout:8/298: rmdir d0/d29/d36/d45/d59 39 2024-04-20T21:58:27.412 INFO:tasks.workunit.client.0.smithi142.stdout:6/279: stat d1/d5/d3a 0 2024-04-20T21:58:27.414 INFO:tasks.workunit.client.0.smithi142.stdout:0/315: mkdir d5/d45/d6f/d70 0 2024-04-20T21:58:27.414 INFO:tasks.workunit.client.0.smithi142.stdout:8/299: fdatasync d0/f26 0 2024-04-20T21:58:27.416 INFO:tasks.workunit.client.0.smithi142.stdout:5/202: mkdir dc/d14/d26/d3f/d47 0 2024-04-20T21:58:27.418 INFO:tasks.workunit.client.0.smithi142.stdout:0/316: stat d5/d13/c36 0 2024-04-20T21:58:27.421 INFO:tasks.workunit.client.0.smithi142.stdout:8/300: symlink d0/l6f 0 2024-04-20T21:58:27.422 INFO:tasks.workunit.client.0.smithi142.stdout:3/301: creat d6/d15/d1e/d43/d4d/d59/f62 x:0 0 0 2024-04-20T21:58:27.422 INFO:tasks.workunit.client.0.smithi142.stdout:7/312: dread d4/d9/d1c/d5e/f2c [0,4194304] 0 2024-04-20T21:58:27.424 INFO:tasks.workunit.client.0.smithi142.stdout:3/302: readlink d6/d32/l58 0 2024-04-20T21:58:27.424 INFO:tasks.workunit.client.0.smithi142.stdout:4/284: dwrite d1/d6/f1a [0,4194304] 0 2024-04-20T21:58:27.426 INFO:tasks.workunit.client.0.smithi142.stdout:0/317: truncate d5/d13/d1e/d23/d46/f4c 210861 0 2024-04-20T21:58:27.427 INFO:tasks.workunit.client.0.smithi142.stdout:5/203: mknod dc/d14/d21/d46/d2a/c48 0 2024-04-20T21:58:27.427 INFO:tasks.workunit.client.0.smithi142.stdout:4/285: chown d1/d6/ce 14 1 2024-04-20T21:58:27.429 INFO:tasks.workunit.client.0.smithi142.stdout:8/301: creat d0/d42/f70 x:0 0 0 2024-04-20T21:58:27.430 INFO:tasks.workunit.client.0.smithi142.stdout:3/303: fsync d6/f34 0 2024-04-20T21:58:27.432 INFO:tasks.workunit.client.0.smithi142.stdout:4/286: chown d1/d6/c41 935593944 1 2024-04-20T21:58:27.433 INFO:tasks.workunit.client.0.smithi142.stdout:0/318: creat d5/d1c/f71 x:0 0 0 2024-04-20T21:58:27.434 INFO:tasks.workunit.client.0.smithi142.stdout:6/280: rename d1/d46/d2b to d1/d2f/d35/d5b/d63 0 2024-04-20T21:58:27.436 INFO:tasks.workunit.client.0.smithi142.stdout:0/319: chown d5/d1c/f71 514655113 1 2024-04-20T21:58:27.443 INFO:tasks.workunit.client.0.smithi142.stdout:2/361: sync 2024-04-20T21:58:27.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:27 smithi164 ceph-mon[23506]: pgmap v35: 65 pgs: 65 active+clean; 519 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 53 MiB/s wr, 151 op/s 2024-04-20T21:58:27.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:27 smithi142 ceph-mon[15828]: pgmap v35: 65 pgs: 65 active+clean; 519 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 53 MiB/s wr, 151 op/s 2024-04-20T21:58:27.449 INFO:tasks.workunit.client.0.smithi142.stdout:5/204: dwrite dc/d14/d21/d46/d2a/d30/f42 [0,4194304] 0 2024-04-20T21:58:27.452 INFO:tasks.workunit.client.0.smithi142.stdout:6/281: mkdir d1/d2f/d35/d5b/d63/d64 0 2024-04-20T21:58:27.456 INFO:tasks.workunit.client.0.smithi142.stdout:0/320: unlink d5/f58 0 2024-04-20T21:58:27.461 INFO:tasks.workunit.client.0.smithi142.stdout:0/321: write d5/d1c/d29/f4f [3976031,14211] 0 2024-04-20T21:58:27.462 INFO:tasks.workunit.client.0.smithi142.stdout:8/302: creat d0/d5e/f71 x:0 0 0 2024-04-20T21:58:27.462 INFO:tasks.workunit.client.0.smithi142.stdout:7/313: link d4/d9/d11/d47/d5a/c61 d4/d9/d1c/c6f 0 2024-04-20T21:58:27.468 INFO:tasks.workunit.client.0.smithi142.stdout:6/282: mkdir d1/d5/d3a/d43/d5c/d65 0 2024-04-20T21:58:27.469 INFO:tasks.workunit.client.0.smithi142.stdout:2/362: getdents d3/d5/d74 0 2024-04-20T21:58:27.470 INFO:tasks.workunit.client.0.smithi142.stdout:7/314: unlink d4/d9/l46 0 2024-04-20T21:58:27.478 INFO:tasks.workunit.client.0.smithi142.stdout:5/205: dwrite dc/d14/d21/d46/f24 [0,4194304] 0 2024-04-20T21:58:27.480 INFO:tasks.workunit.client.0.smithi142.stdout:6/283: write d1/d5/fb [3290750,19451] 0 2024-04-20T21:58:27.480 INFO:tasks.workunit.client.0.smithi142.stdout:4/287: dread d1/d12/da/d1c/d32/d3d/f28 [4194304,4194304] 0 2024-04-20T21:58:27.480 INFO:tasks.workunit.client.0.smithi142.stdout:5/206: fdatasync f9 0 2024-04-20T21:58:27.482 INFO:tasks.workunit.client.0.smithi142.stdout:2/363: rename d3/d5/d19/l78 to d3/d5/d67/l7a 0 2024-04-20T21:58:27.483 INFO:tasks.workunit.client.0.smithi142.stdout:7/315: mknod d4/d9/d1c/d5e/d4d/c70 0 2024-04-20T21:58:27.492 INFO:tasks.workunit.client.0.smithi142.stdout:6/284: creat d1/d5/f66 x:0 0 0 2024-04-20T21:58:27.495 INFO:tasks.workunit.client.0.smithi142.stdout:2/364: chown d3/d9/d34/d51/d31/c5d 0 1 2024-04-20T21:58:27.498 INFO:tasks.workunit.client.0.smithi142.stdout:4/288: mknod d1/d12/da/c58 0 2024-04-20T21:58:27.500 INFO:tasks.workunit.client.0.smithi142.stdout:0/322: getdents d5/d13/d1e/d23 0 2024-04-20T21:58:27.505 INFO:tasks.workunit.client.0.smithi142.stdout:4/289: rmdir d1/d6/d30/d3f/d54 39 2024-04-20T21:58:27.509 INFO:tasks.workunit.client.0.smithi142.stdout:6/285: unlink d1/d2f/d35/d5b/d63/f54 0 2024-04-20T21:58:27.509 INFO:tasks.workunit.client.0.smithi142.stdout:0/323: write d5/d13/f14 [87251,21496] 0 2024-04-20T21:58:27.514 INFO:tasks.workunit.client.0.smithi142.stdout:5/207: dread dc/f1d [0,4194304] 0 2024-04-20T21:58:27.517 INFO:tasks.workunit.client.0.smithi142.stdout:6/286: write d1/d5/f66 [555131,97942] 0 2024-04-20T21:58:27.518 INFO:tasks.workunit.client.0.smithi142.stdout:8/303: dwrite d0/d29/f5d [0,4194304] 0 2024-04-20T21:58:27.519 INFO:tasks.workunit.client.0.smithi142.stdout:0/324: mknod d5/c72 0 2024-04-20T21:58:27.521 INFO:tasks.workunit.client.0.smithi142.stdout:5/208: write dc/d14/d25/f2d [765724,86696] 0 2024-04-20T21:58:27.522 INFO:tasks.workunit.client.0.smithi142.stdout:7/316: dwrite d4/d9/d1c/f4a [0,4194304] 0 2024-04-20T21:58:27.529 INFO:tasks.workunit.client.0.smithi142.stdout:5/209: creat dc/d14/d21/d46/d2a/f49 x:0 0 0 2024-04-20T21:58:27.531 INFO:tasks.workunit.client.0.smithi142.stdout:7/317: mknod d4/d9/d11/d47/d5a/c71 0 2024-04-20T21:58:27.534 INFO:tasks.workunit.client.0.smithi142.stdout:8/304: getdents d0/d17/d6e 0 2024-04-20T21:58:27.540 INFO:tasks.workunit.client.0.smithi142.stdout:2/365: dwrite d3/d9/d34/f41 [0,4194304] 0 2024-04-20T21:58:27.541 INFO:tasks.workunit.client.0.smithi142.stdout:6/287: creat d1/d2f/d35/d5b/d63/d4b/d61/f67 x:0 0 0 2024-04-20T21:58:27.544 INFO:tasks.workunit.client.0.smithi142.stdout:2/366: stat d3/d5/d19/c27 0 2024-04-20T21:58:27.545 INFO:tasks.workunit.client.0.smithi142.stdout:7/318: unlink d4/d9/l41 0 2024-04-20T21:58:27.546 INFO:tasks.workunit.client.0.smithi142.stdout:4/290: dwrite d1/d12/da/d1c/f34 [4194304,4194304] 0 2024-04-20T21:58:27.546 INFO:tasks.workunit.client.0.smithi142.stdout:8/305: rename d0/d29/d36/f47 to d0/d1c/f72 0 2024-04-20T21:58:27.550 INFO:tasks.workunit.client.0.smithi142.stdout:4/291: fdatasync d1/d6/f1a 0 2024-04-20T21:58:27.554 INFO:tasks.workunit.client.0.smithi142.stdout:6/288: dread d1/d5/d3a/f42 [0,4194304] 0 2024-04-20T21:58:27.554 INFO:tasks.workunit.client.0.smithi142.stdout:6/289: stat d1/d5/fb 0 2024-04-20T21:58:27.554 INFO:tasks.workunit.client.0.smithi142.stdout:7/319: fdatasync d4/d9/d1c/d5e/f1f 0 2024-04-20T21:58:27.556 INFO:tasks.workunit.client.0.smithi142.stdout:8/306: rename d0/d42/l5b to d0/d17/d6e/l73 0 2024-04-20T21:58:27.558 INFO:tasks.workunit.client.0.smithi142.stdout:4/292: truncate d1/d12/da/f18 4665401 0 2024-04-20T21:58:27.563 INFO:tasks.workunit.client.0.smithi142.stdout:2/367: rename d3/d5/d19/f76 to d3/d5/d19/d70/d3c/d64/f7b 0 2024-04-20T21:58:27.565 INFO:tasks.workunit.client.0.smithi142.stdout:2/368: write d3/d9/d34/f56 [242835,34896] 0 2024-04-20T21:58:27.570 INFO:tasks.workunit.client.0.smithi142.stdout:2/369: chown d3/d9/d34/d51 123 1 2024-04-20T21:58:27.573 INFO:tasks.workunit.client.0.smithi142.stdout:8/307: creat d0/f74 x:0 0 0 2024-04-20T21:58:27.575 INFO:tasks.workunit.client.0.smithi142.stdout:4/293: mknod d1/d6/d4b/c59 0 2024-04-20T21:58:27.580 INFO:tasks.workunit.client.0.smithi142.stdout:8/308: symlink d0/d1c/l75 0 2024-04-20T21:58:27.586 INFO:tasks.workunit.client.0.smithi142.stdout:8/309: write d0/f1b [2058730,19463] 0 2024-04-20T21:58:27.586 INFO:tasks.workunit.client.0.smithi142.stdout:6/290: dwrite d1/d1b/f51 [0,4194304] 0 2024-04-20T21:58:27.586 INFO:tasks.workunit.client.0.smithi142.stdout:5/210: dread dc/d14/f1e [0,4194304] 0 2024-04-20T21:58:27.587 INFO:tasks.workunit.client.0.smithi142.stdout:7/320: dwrite d4/d9/d1c/f5f [0,4194304] 0 2024-04-20T21:58:27.598 INFO:tasks.workunit.client.0.smithi142.stdout:4/294: rename d1/d6/d30/d3f/d54 to d1/d6/d4a/d5a 0 2024-04-20T21:58:27.598 INFO:tasks.workunit.client.0.smithi142.stdout:8/310: mkdir d0/d17/d76 0 2024-04-20T21:58:27.598 INFO:tasks.workunit.client.0.smithi142.stdout:7/321: fdatasync d4/d9/d1c/f23 0 2024-04-20T21:58:27.599 INFO:tasks.workunit.client.0.smithi142.stdout:2/370: write d3/d5/f17 [13225593,83290] 0 2024-04-20T21:58:27.602 INFO:tasks.workunit.client.0.smithi142.stdout:6/291: mknod d1/d2f/d35/d5b/d63/c68 0 2024-04-20T21:58:27.605 INFO:tasks.workunit.client.0.smithi142.stdout:4/295: mkdir d1/d5b 0 2024-04-20T21:58:27.609 INFO:tasks.workunit.client.0.smithi142.stdout:8/311: creat d0/d29/d36/d45/d4c/f77 x:0 0 0 2024-04-20T21:58:27.609 INFO:tasks.workunit.client.0.smithi142.stdout:2/371: rename d3/d5/l1d to d3/d9/d34/l7c 0 2024-04-20T21:58:27.610 INFO:tasks.workunit.client.0.smithi142.stdout:7/322: symlink d4/d9/d11/d22/l72 0 2024-04-20T21:58:27.612 INFO:tasks.workunit.client.0.smithi142.stdout:2/372: fsync d3/d9/d34/d51/f2d 0 2024-04-20T21:58:27.614 INFO:tasks.workunit.client.0.smithi142.stdout:4/296: read - d1/d6/d30/d3f/f44 zero size 2024-04-20T21:58:27.615 INFO:tasks.workunit.client.0.smithi142.stdout:7/323: mknod d4/d9/d1c/d5e/c73 0 2024-04-20T21:58:27.617 INFO:tasks.workunit.client.0.smithi142.stdout:8/312: write d0/d29/f3c [536300,117230] 0 2024-04-20T21:58:27.619 INFO:tasks.workunit.client.0.smithi142.stdout:2/373: creat d3/d9/d34/f7d x:0 0 0 2024-04-20T21:58:27.621 INFO:tasks.workunit.client.0.smithi142.stdout:5/211: dwrite f9 [0,4194304] 0 2024-04-20T21:58:27.621 INFO:tasks.workunit.client.0.smithi142.stdout:7/324: symlink d4/d9/d1c/l74 0 2024-04-20T21:58:27.636 INFO:tasks.workunit.client.0.smithi142.stdout:5/212: getdents dc/d14/d21/d46/d2a/d30 0 2024-04-20T21:58:27.637 INFO:tasks.workunit.client.0.smithi142.stdout:5/213: read f9 [2961459,24699] 0 2024-04-20T21:58:27.640 INFO:tasks.workunit.client.0.smithi142.stdout:5/214: write dc/f2b [781823,111256] 0 2024-04-20T21:58:27.645 INFO:tasks.workunit.client.0.smithi142.stdout:7/325: dwrite d4/d9/d1c/f5f [0,4194304] 0 2024-04-20T21:58:27.645 INFO:tasks.workunit.client.0.smithi142.stdout:5/215: symlink dc/d14/d21/d46/d2a/d30/l4a 0 2024-04-20T21:58:27.649 INFO:tasks.workunit.client.0.smithi142.stdout:4/297: truncate d1/d12/da/d1c/f25 2298551 0 2024-04-20T21:58:27.651 INFO:tasks.workunit.client.0.smithi142.stdout:7/326: creat d4/d9/f75 x:0 0 0 2024-04-20T21:58:27.655 INFO:tasks.workunit.client.0.smithi142.stdout:2/374: truncate d3/d5/d19/f21 3564874 0 2024-04-20T21:58:27.657 INFO:tasks.workunit.client.0.smithi142.stdout:7/327: creat d4/d9/d11/d47/d5a/f76 x:0 0 0 2024-04-20T21:58:27.660 INFO:tasks.workunit.client.0.smithi142.stdout:5/216: dread f4 [0,4194304] 0 2024-04-20T21:58:27.661 INFO:tasks.workunit.client.0.smithi142.stdout:7/328: write d4/d9/d11/f3e [407705,62756] 0 2024-04-20T21:58:27.664 INFO:tasks.workunit.client.0.smithi142.stdout:5/217: mknod dc/c4b 0 2024-04-20T21:58:27.666 INFO:tasks.workunit.client.0.smithi142.stdout:7/329: mkdir d4/d9/d1c/d5e/d4d/d77 0 2024-04-20T21:58:27.671 INFO:tasks.workunit.client.0.smithi142.stdout:4/298: dread d1/d6/f2d [0,4194304] 0 2024-04-20T21:58:27.672 INFO:tasks.workunit.client.0.smithi142.stdout:5/218: rmdir dc/d14/d26/d3f/d47 0 2024-04-20T21:58:27.673 INFO:tasks.workunit.client.0.smithi142.stdout:4/299: rmdir d1/d6/d4a 39 2024-04-20T21:58:27.674 INFO:tasks.workunit.client.0.smithi142.stdout:5/219: chown dc/f1d 1 1 2024-04-20T21:58:27.677 INFO:tasks.workunit.client.0.smithi142.stdout:5/220: symlink dc/d14/d26/l4c 0 2024-04-20T21:58:27.677 INFO:tasks.workunit.client.0.smithi142.stdout:4/300: chown d1/d12/da/d1c/f25 1960792 1 2024-04-20T21:58:27.682 INFO:tasks.workunit.client.0.smithi142.stdout:5/221: dread dc/d14/f1a [0,4194304] 0 2024-04-20T21:58:27.686 INFO:tasks.workunit.client.0.smithi142.stdout:4/301: getdents d1/d12/da/d1c/d32/d3d/d2f/d52 0 2024-04-20T21:58:27.688 INFO:tasks.workunit.client.0.smithi142.stdout:5/222: creat dc/d14/f4d x:0 0 0 2024-04-20T21:58:27.688 INFO:tasks.workunit.client.0.smithi142.stdout:7/330: dwrite d4/d9/d1c/d32/f52 [0,4194304] 0 2024-04-20T21:58:27.692 INFO:tasks.workunit.client.0.smithi142.stdout:5/223: write dc/d14/d25/f3a [748846,82684] 0 2024-04-20T21:58:27.692 INFO:tasks.workunit.client.0.smithi142.stdout:2/375: dread d3/f1f [0,4194304] 0 2024-04-20T21:58:27.706 INFO:tasks.workunit.client.0.smithi142.stdout:5/224: creat dc/d14/d21/d46/d2a/d30/f4e x:0 0 0 2024-04-20T21:58:27.720 INFO:tasks.workunit.client.0.smithi142.stdout:7/331: dread d4/f2d [0,4194304] 0 2024-04-20T21:58:27.722 INFO:tasks.workunit.client.0.smithi142.stdout:7/332: unlink d4/d9/f30 0 2024-04-20T21:58:27.725 INFO:tasks.workunit.client.0.smithi142.stdout:9/335: sync 2024-04-20T21:58:27.725 INFO:tasks.workunit.client.0.smithi142.stdout:1/278: sync 2024-04-20T21:58:27.727 INFO:tasks.workunit.client.0.smithi142.stdout:7/333: mkdir d4/d9/d1c/d5e/d4d/d77/d78 0 2024-04-20T21:58:27.727 INFO:tasks.workunit.client.0.smithi142.stdout:2/376: dread d3/d9/d34/d51/f65 [0,4194304] 0 2024-04-20T21:58:27.729 INFO:tasks.workunit.client.0.smithi142.stdout:7/334: write d4/d9/f69 [685544,65658] 0 2024-04-20T21:58:27.730 INFO:tasks.workunit.client.0.smithi142.stdout:9/336: fsync d0/f31 0 2024-04-20T21:58:27.730 INFO:tasks.workunit.client.0.smithi142.stdout:1/279: symlink d2/dd/l5d 0 2024-04-20T21:58:27.731 INFO:tasks.workunit.client.0.smithi142.stdout:7/335: chown d4/d9/f75 417865526 1 2024-04-20T21:58:27.733 INFO:tasks.workunit.client.0.smithi142.stdout:9/337: write d0/d3c/d4d/f67 [944546,125085] 0 2024-04-20T21:58:27.733 INFO:tasks.workunit.client.0.smithi142.stdout:7/336: creat d4/d9/f79 x:0 0 0 2024-04-20T21:58:27.736 INFO:tasks.workunit.client.0.smithi142.stdout:2/377: creat d3/f7e x:0 0 0 2024-04-20T21:58:27.740 INFO:tasks.workunit.client.0.smithi142.stdout:2/378: stat d3/d9/d34/d51/d31/f73 0 2024-04-20T21:58:27.742 INFO:tasks.workunit.client.0.smithi142.stdout:2/379: chown d3/f7e 111295 1 2024-04-20T21:58:27.742 INFO:tasks.workunit.client.0.smithi142.stdout:7/337: link d4/f27 d4/d9/d11/d22/f7a 0 2024-04-20T21:58:27.748 INFO:tasks.workunit.client.0.smithi142.stdout:7/338: mknod d4/d9/d11/d47/d5a/d62/c7b 0 2024-04-20T21:58:27.750 INFO:tasks.workunit.client.0.smithi142.stdout:7/339: stat d4/d9/d1c/f5f 0 2024-04-20T21:58:27.751 INFO:tasks.workunit.client.0.smithi142.stdout:2/380: rename d3/d9/d34/f7d to d3/d5/d19/d70/f7f 0 2024-04-20T21:58:27.751 INFO:tasks.workunit.client.0.smithi142.stdout:1/280: dwrite d2/dd/d17/d1b/d22/d13/f14 [0,4194304] 0 2024-04-20T21:58:27.753 INFO:tasks.workunit.client.0.smithi142.stdout:1/281: dread - d2/f3e zero size 2024-04-20T21:58:27.755 INFO:tasks.workunit.client.0.smithi142.stdout:7/340: truncate d4/d9/d1c/d32/f5c 17003 0 2024-04-20T21:58:27.759 INFO:tasks.workunit.client.0.smithi142.stdout:2/381: write d3/d5/d19/d70/f7f [500223,36909] 0 2024-04-20T21:58:27.759 INFO:tasks.workunit.client.0.smithi142.stdout:1/282: creat d2/dd/d17/d3b/d50/f5e x:0 0 0 2024-04-20T21:58:27.763 INFO:tasks.workunit.client.0.smithi142.stdout:1/283: dread - d2/dd/d17/d1b/d22/d20/f2d zero size 2024-04-20T21:58:27.767 INFO:tasks.workunit.client.0.smithi142.stdout:2/382: dread d3/d9/f49 [0,4194304] 0 2024-04-20T21:58:27.767 INFO:tasks.workunit.client.0.smithi142.stdout:9/338: dread d0/f8 [0,4194304] 0 2024-04-20T21:58:27.768 INFO:tasks.workunit.client.0.smithi142.stdout:1/284: write d2/dd/d17/d1b/d22/d20/f4c [696838,110216] 0 2024-04-20T21:58:27.768 INFO:tasks.workunit.client.0.smithi142.stdout:7/341: truncate d4/d9/d1c/f4f 810678 0 2024-04-20T21:58:27.769 INFO:tasks.workunit.client.0.smithi142.stdout:9/339: fsync d0/d2a/f34 0 2024-04-20T21:58:27.770 INFO:tasks.workunit.client.0.smithi142.stdout:1/285: chown d2/dd/d17/f21 12400 1 2024-04-20T21:58:27.771 INFO:tasks.workunit.client.0.smithi142.stdout:2/383: mknod d3/d5/d19/d70/c80 0 2024-04-20T21:58:27.771 INFO:tasks.workunit.client.0.smithi142.stdout:9/340: chown d0/d2a/c32 56802 1 2024-04-20T21:58:27.773 INFO:tasks.workunit.client.0.smithi142.stdout:7/342: creat d4/d9/d1c/d5e/d64/f7c x:0 0 0 2024-04-20T21:58:27.773 INFO:tasks.workunit.client.0.smithi142.stdout:1/286: write d2/f7 [650446,45717] 0 2024-04-20T21:58:27.775 INFO:tasks.workunit.client.0.smithi142.stdout:2/384: write d3/d5/d19/d70/d3c/f36 [368425,5678] 0 2024-04-20T21:58:27.794 INFO:tasks.workunit.client.0.smithi142.stdout:2/385: dwrite d3/d5/d19/d70/d3c/d64/f7b [0,4194304] 0 2024-04-20T21:58:27.806 INFO:tasks.workunit.client.0.smithi142.stdout:9/341: dread d0/d2a/f34 [0,4194304] 0 2024-04-20T21:58:27.811 INFO:tasks.workunit.client.0.smithi142.stdout:9/342: write d0/d2a/d39/f5c [3553332,120848] 0 2024-04-20T21:58:27.816 INFO:tasks.workunit.client.0.smithi142.stdout:9/343: creat d0/d36/f74 x:0 0 0 2024-04-20T21:58:27.817 INFO:tasks.workunit.client.0.smithi142.stdout:1/287: dread d2/dd/d17/d1b/d22/f2f [0,4194304] 0 2024-04-20T21:58:27.834 INFO:tasks.workunit.client.0.smithi142.stdout:9/344: dwrite d0/d36/d55/f5d [0,4194304] 0 2024-04-20T21:58:27.842 INFO:tasks.workunit.client.0.smithi142.stdout:9/345: link d0/d2a/f42 d0/d3c/d4d/f75 0 2024-04-20T21:58:27.843 INFO:tasks.workunit.client.0.smithi142.stdout:9/346: fdatasync d0/fe 0 2024-04-20T21:58:27.846 INFO:tasks.workunit.client.0.smithi142.stdout:9/347: creat d0/d36/d55/f76 x:0 0 0 2024-04-20T21:58:27.852 INFO:tasks.workunit.client.0.smithi142.stdout:9/348: write d0/fe [5121369,129501] 0 2024-04-20T21:58:27.856 INFO:tasks.workunit.client.0.smithi142.stdout:9/349: creat d0/d3c/d4d/f77 x:0 0 0 2024-04-20T21:58:27.862 INFO:tasks.workunit.client.0.smithi142.stdout:1/288: dread d2/dd/d17/d1b/d22/f56 [0,4194304] 0 2024-04-20T21:58:27.865 INFO:tasks.workunit.client.0.smithi142.stdout:9/350: truncate d0/d2a/d39/f5c 1718229 0 2024-04-20T21:58:27.867 INFO:tasks.workunit.client.0.smithi142.stdout:9/351: rmdir d0/d36 39 2024-04-20T21:58:27.882 INFO:tasks.workunit.client.0.smithi142.stdout:9/352: dwrite d0/fc [0,4194304] 0 2024-04-20T21:58:27.885 INFO:tasks.workunit.client.0.smithi142.stdout:9/353: write d0/d2a/f47 [2079486,8349] 0 2024-04-20T21:58:27.890 INFO:tasks.workunit.client.0.smithi142.stdout:9/354: creat d0/d36/f78 x:0 0 0 2024-04-20T21:58:27.891 INFO:tasks.workunit.client.0.smithi142.stdout:9/355: truncate d0/d2a/f2d 4790278 0 2024-04-20T21:58:27.893 INFO:tasks.workunit.client.0.smithi142.stdout:9/356: mknod d0/d2a/d39/c79 0 2024-04-20T21:58:27.897 INFO:tasks.workunit.client.0.smithi142.stdout:9/357: creat d0/d36/f7a x:0 0 0 2024-04-20T21:58:27.899 INFO:tasks.workunit.client.0.smithi142.stdout:9/358: write d0/d2a/d39/d50/f5b [900,12457] 0 2024-04-20T21:58:27.901 INFO:tasks.workunit.client.0.smithi142.stdout:9/359: mknod d0/d3c/d4d/c7b 0 2024-04-20T21:58:27.904 INFO:tasks.workunit.client.0.smithi142.stdout:9/360: dread d0/d2a/d39/d50/f5b [0,4194304] 0 2024-04-20T21:58:27.920 INFO:tasks.workunit.client.0.smithi142.stdout:9/361: dwrite d0/d2a/f4a [0,4194304] 0 2024-04-20T21:58:27.922 INFO:tasks.workunit.client.0.smithi142.stdout:9/362: creat d0/d2a/f7c x:0 0 0 2024-04-20T21:58:27.927 INFO:tasks.workunit.client.0.smithi142.stdout:9/363: write d0/d36/f53 [1079427,18356] 0 2024-04-20T21:58:27.933 INFO:tasks.workunit.client.0.smithi142.stdout:9/364: readlink d0/d3c/l62 0 2024-04-20T21:58:27.934 INFO:tasks.workunit.client.0.smithi142.stdout:9/365: chown d0/l1 751279657 1 2024-04-20T21:58:27.935 INFO:tasks.workunit.client.0.smithi142.stdout:9/366: chown d0/d3c/d4d/c5f 362942 1 2024-04-20T21:58:27.943 INFO:tasks.workunit.client.0.smithi142.stdout:9/367: getdents d0 0 2024-04-20T21:58:27.944 INFO:tasks.workunit.client.0.smithi142.stdout:9/368: chown d0/f25 170029336 1 2024-04-20T21:58:28.006 INFO:tasks.workunit.client.0.smithi142.stdout:3/304: sync 2024-04-20T21:58:28.038 INFO:tasks.workunit.client.0.smithi142.stdout:9/369: mknod d0/d3c/d4d/c7d 0 2024-04-20T21:58:28.042 INFO:tasks.workunit.client.0.smithi142.stdout:3/305: mknod d6/d15/c63 0 2024-04-20T21:58:28.046 INFO:tasks.workunit.client.0.smithi142.stdout:9/370: rename d0/d36/c69 to d0/d3c/d4d/c7e 0 2024-04-20T21:58:28.055 INFO:tasks.workunit.client.0.smithi142.stdout:3/306: rename d6/c12 to d6/d15/d1e/d43/c64 0 2024-04-20T21:58:28.079 INFO:tasks.workunit.client.0.smithi142.stdout:3/307: link d6/d15/d1e/d43/d4d/f56 d6/d15/f65 0 2024-04-20T21:58:28.160 INFO:tasks.workunit.client.0.smithi142.stdout:9/371: dwrite d0/f31 [0,4194304] 0 2024-04-20T21:58:28.195 INFO:tasks.workunit.client.0.smithi142.stdout:9/372: creat d0/d3c/d4d/d63/f7f x:0 0 0 2024-04-20T21:58:28.198 INFO:tasks.workunit.client.0.smithi142.stdout:9/373: write d0/d2a/f44 [241694,40405] 0 2024-04-20T21:58:28.201 INFO:tasks.workunit.client.0.smithi142.stdout:9/374: stat d0/d2a/c32 0 2024-04-20T21:58:28.206 INFO:tasks.workunit.client.0.smithi142.stdout:3/308: rmdir d6/d15/d1e/d43/d4d 39 2024-04-20T21:58:28.227 INFO:tasks.workunit.client.0.smithi142.stdout:9/375: dwrite d0/d2a/f47 [0,4194304] 0 2024-04-20T21:58:28.232 INFO:tasks.workunit.client.0.smithi142.stdout:9/376: unlink d0/d3c/d4d/d63/f73 0 2024-04-20T21:58:28.238 INFO:tasks.workunit.client.0.smithi142.stdout:9/377: read d0/f21 [6553900,118822] 0 2024-04-20T21:58:28.243 INFO:tasks.workunit.client.0.smithi142.stdout:9/378: mkdir d0/d3c/d4d/d63/d80 0 2024-04-20T21:58:28.248 INFO:tasks.workunit.client.0.smithi142.stdout:9/379: mknod d0/d3c/d4d/c81 0 2024-04-20T21:58:28.260 INFO:tasks.workunit.client.0.smithi142.stdout:9/380: dread d0/d3c/d4d/f67 [0,4194304] 0 2024-04-20T21:58:28.261 INFO:tasks.workunit.client.0.smithi142.stdout:0/325: sync 2024-04-20T21:58:28.264 INFO:tasks.workunit.client.0.smithi142.stdout:9/381: read d0/d2a/f40 [39928,56175] 0 2024-04-20T21:58:28.265 INFO:tasks.workunit.client.0.smithi142.stdout:3/309: dread d6/fd [0,4194304] 0 2024-04-20T21:58:28.267 INFO:tasks.workunit.client.0.smithi142.stdout:0/326: write d5/d13/d1e/d23/d46/f4c [1000154,69919] 0 2024-04-20T21:58:28.269 INFO:tasks.workunit.client.0.smithi142.stdout:9/382: mknod d0/d3c/d4d/c82 0 2024-04-20T21:58:28.271 INFO:tasks.workunit.client.0.smithi142.stdout:0/327: write d5/d1c/f71 [149281,112554] 0 2024-04-20T21:58:28.273 INFO:tasks.workunit.client.0.smithi142.stdout:3/310: dread - d6/d15/d1e/d43/d4d/d59/f62 zero size 2024-04-20T21:58:28.274 INFO:tasks.workunit.client.0.smithi142.stdout:3/311: fsync d6/d15/f5b 0 2024-04-20T21:58:28.276 INFO:tasks.workunit.client.0.smithi142.stdout:3/312: fdatasync d6/d15/f19 0 2024-04-20T21:58:28.278 INFO:tasks.workunit.client.0.smithi142.stdout:0/328: rmdir d5/d13/d4d 0 2024-04-20T21:58:28.279 INFO:tasks.workunit.client.0.smithi142.stdout:0/329: chown d5/d1c/d29/d38/d62 124336477 1 2024-04-20T21:58:28.285 INFO:tasks.workunit.client.0.smithi142.stdout:9/383: truncate d0/f25 374080 0 2024-04-20T21:58:28.288 INFO:tasks.workunit.client.0.smithi142.stdout:9/384: write d0/d2a/f40 [947530,14113] 0 2024-04-20T21:58:28.292 INFO:tasks.workunit.client.0.smithi142.stdout:9/385: write d0/d36/f7a [355186,75308] 0 2024-04-20T21:58:28.294 INFO:tasks.workunit.client.0.smithi142.stdout:9/386: rmdir d0 39 2024-04-20T21:58:28.295 INFO:tasks.workunit.client.0.smithi142.stdout:0/330: dread d5/d1d/f4e [0,4194304] 0 2024-04-20T21:58:28.296 INFO:tasks.workunit.client.0.smithi142.stdout:3/313: dwrite d6/d15/d1e/d43/d4d/d59/f62 [0,4194304] 0 2024-04-20T21:58:28.297 INFO:tasks.workunit.client.0.smithi142.stdout:9/387: dread - d0/d2a/d39/f56 zero size 2024-04-20T21:58:28.303 INFO:tasks.workunit.client.0.smithi142.stdout:9/388: mknod d0/c83 0 2024-04-20T21:58:28.303 INFO:tasks.workunit.client.0.smithi142.stdout:3/314: write d6/f4b [6055838,3373] 0 2024-04-20T21:58:28.306 INFO:tasks.workunit.client.0.smithi142.stdout:3/315: write d6/d15/d47/f4a [3709421,53959] 0 2024-04-20T21:58:28.309 INFO:tasks.workunit.client.0.smithi142.stdout:0/331: dread d5/d13/d1e/d23/d24/f2a [0,4194304] 0 2024-04-20T21:58:28.311 INFO:tasks.workunit.client.0.smithi142.stdout:3/316: symlink d6/d15/d1e/d43/d4d/l66 0 2024-04-20T21:58:28.316 INFO:tasks.workunit.client.0.smithi142.stdout:3/317: link d6/f10 d6/d15/d30/d37/f67 0 2024-04-20T21:58:28.318 INFO:tasks.workunit.client.0.smithi142.stdout:3/318: chown d6/d15/d30/f46 248478 1 2024-04-20T21:58:28.321 INFO:tasks.workunit.client.0.smithi142.stdout:3/319: write d6/f25 [3438147,22050] 0 2024-04-20T21:58:28.325 INFO:tasks.workunit.client.0.smithi142.stdout:9/389: unlink d0/f29 0 2024-04-20T21:58:28.327 INFO:tasks.workunit.client.0.smithi142.stdout:4/302: sync 2024-04-20T21:58:28.327 INFO:tasks.workunit.client.0.smithi142.stdout:8/313: sync 2024-04-20T21:58:28.327 INFO:tasks.workunit.client.0.smithi142.stdout:1/289: sync 2024-04-20T21:58:28.327 INFO:tasks.workunit.client.0.smithi142.stdout:3/320: symlink d6/d15/d1e/d43/d4d/l68 0 2024-04-20T21:58:28.328 INFO:tasks.workunit.client.0.smithi142.stdout:5/225: sync 2024-04-20T21:58:28.328 INFO:tasks.workunit.client.0.smithi142.stdout:6/292: sync 2024-04-20T21:58:28.328 INFO:tasks.workunit.client.0.smithi142.stdout:2/386: sync 2024-04-20T21:58:28.328 INFO:tasks.workunit.client.0.smithi142.stdout:7/343: sync 2024-04-20T21:58:28.330 INFO:tasks.workunit.client.0.smithi142.stdout:1/290: readlink d2/lc 0 2024-04-20T21:58:28.331 INFO:tasks.workunit.client.0.smithi142.stdout:9/390: write d0/d2a/f2d [4700562,60152] 0 2024-04-20T21:58:28.333 INFO:tasks.workunit.client.0.smithi142.stdout:5/226: chown dc/d14/d25/f2d 46 1 2024-04-20T21:58:28.337 INFO:tasks.workunit.client.0.smithi142.stdout:5/227: write dc/f2f [1537070,65278] 0 2024-04-20T21:58:28.337 INFO:tasks.workunit.client.0.smithi142.stdout:4/303: chown d1/d6/d30/d3f/f1e 10 1 2024-04-20T21:58:28.340 INFO:tasks.workunit.client.0.smithi142.stdout:8/314: symlink d0/d1c/l78 0 2024-04-20T21:58:28.341 INFO:tasks.workunit.client.0.smithi142.stdout:3/321: mkdir d6/d32/d39/d69 0 2024-04-20T21:58:28.343 INFO:tasks.workunit.client.0.smithi142.stdout:4/304: write d1/d6/d30/f3a [672173,104446] 0 2024-04-20T21:58:28.344 INFO:tasks.workunit.client.0.smithi142.stdout:1/291: rmdir d2/dd/d17/d3b/d50 39 2024-04-20T21:58:28.345 INFO:tasks.workunit.client.0.smithi142.stdout:3/322: fsync d6/d15/d30/d37/f3d 0 2024-04-20T21:58:28.352 INFO:tasks.workunit.client.0.smithi142.stdout:0/332: dread d5/f9 [0,4194304] 0 2024-04-20T21:58:28.354 INFO:tasks.workunit.client.0.smithi142.stdout:3/323: unlink d6/d15/d47/f4f 0 2024-04-20T21:58:28.356 INFO:tasks.workunit.client.0.smithi142.stdout:9/391: rename d0/d2a/c6c to d0/d36/c84 0 2024-04-20T21:58:28.361 INFO:tasks.workunit.client.0.smithi142.stdout:1/292: rename d2/dd/d17/d1b/f1d to d2/dd/d17/d1b/f5f 0 2024-04-20T21:58:28.361 INFO:tasks.workunit.client.0.smithi142.stdout:2/387: dwrite d3/d5/d19/d70/f4d [4194304,4194304] 0 2024-04-20T21:58:28.364 INFO:tasks.workunit.client.0.smithi142.stdout:4/305: creat d1/d12/da/f5c x:0 0 0 2024-04-20T21:58:28.365 INFO:tasks.workunit.client.0.smithi142.stdout:7/344: write d4/d9/d1c/f4f [1239191,30241] 0 2024-04-20T21:58:28.375 INFO:tasks.workunit.client.0.smithi142.stdout:5/228: rename dc/d14/d21/d46/d2a/d30/l4a to dc/d14/l4f 0 2024-04-20T21:58:28.375 INFO:tasks.workunit.client.0.smithi142.stdout:2/388: link d3/d5/f2a d3/d5/d19/d70/d3c/d64/f81 0 2024-04-20T21:58:28.377 INFO:tasks.workunit.client.0.smithi142.stdout:4/306: creat d1/d6/d4a/d5a/f5d x:0 0 0 2024-04-20T21:58:28.381 INFO:tasks.workunit.client.0.smithi142.stdout:9/392: creat d0/d3c/d4d/d63/d80/f85 x:0 0 0 2024-04-20T21:58:28.382 INFO:tasks.workunit.client.0.smithi142.stdout:8/315: dread d0/d29/d36/d45/f4d [0,4194304] 0 2024-04-20T21:58:28.386 INFO:tasks.workunit.client.0.smithi142.stdout:9/393: read d0/d2a/d39/f6d [4921731,27520] 0 2024-04-20T21:58:28.390 INFO:tasks.workunit.client.0.smithi142.stdout:7/345: getdents d4/d9/d11 0 2024-04-20T21:58:28.394 INFO:tasks.workunit.client.0.smithi142.stdout:0/333: dwrite d5/f8 [4194304,4194304] 0 2024-04-20T21:58:28.398 INFO:tasks.workunit.client.0.smithi142.stdout:9/394: write d0/fc [4317940,67147] 0 2024-04-20T21:58:28.399 INFO:tasks.workunit.client.0.smithi142.stdout:3/324: rename d6/d15/f65 to d6/f6a 0 2024-04-20T21:58:28.404 INFO:tasks.workunit.client.0.smithi142.stdout:0/334: creat d5/d1c/d3c/f73 x:0 0 0 2024-04-20T21:58:28.405 INFO:tasks.workunit.client.0.smithi142.stdout:8/316: rmdir d0/d17/d76 0 2024-04-20T21:58:28.410 INFO:tasks.workunit.client.0.smithi142.stdout:5/229: getdents dc 0 2024-04-20T21:58:28.413 INFO:tasks.workunit.client.0.smithi142.stdout:1/293: rename d2/dd/d17/d3b/d44 to d2/dd/d1c/d60 0 2024-04-20T21:58:28.415 INFO:tasks.workunit.client.0.smithi142.stdout:3/325: symlink d6/d15/d30/d37/l6b 0 2024-04-20T21:58:28.417 INFO:tasks.workunit.client.0.smithi142.stdout:4/307: link d1/d6/d30/d3f/c31 d1/d12/da/d1c/d32/d3d/d2f/d52/c5e 0 2024-04-20T21:58:28.422 INFO:tasks.workunit.client.0.smithi142.stdout:5/230: symlink dc/d14/d26/d3f/l50 0 2024-04-20T21:58:28.423 INFO:tasks.workunit.client.0.smithi142.stdout:2/389: rename d3/d5/l3e to d3/d5/d74/l82 0 2024-04-20T21:58:28.426 INFO:tasks.workunit.client.0.smithi142.stdout:8/317: dwrite d0/f58 [0,4194304] 0 2024-04-20T21:58:28.426 INFO:tasks.workunit.client.0.smithi142.stdout:9/395: link d0/d2a/f4f d0/f86 0 2024-04-20T21:58:28.428 INFO:tasks.workunit.client.0.smithi142.stdout:8/318: truncate d0/d17/f34 598970 0 2024-04-20T21:58:28.430 INFO:tasks.workunit.client.0.smithi142.stdout:2/390: rmdir d3/d9 39 2024-04-20T21:58:28.431 INFO:tasks.workunit.client.0.smithi142.stdout:8/319: write d0/d5e/f71 [823418,16355] 0 2024-04-20T21:58:28.434 INFO:tasks.workunit.client.0.smithi142.stdout:7/346: rename d4/d9/d1c/d32 to d4/d7d 0 2024-04-20T21:58:28.439 INFO:tasks.workunit.client.0.smithi142.stdout:5/231: symlink dc/d14/d25/l51 0 2024-04-20T21:58:28.440 INFO:tasks.workunit.client.0.smithi142.stdout:3/326: dwrite d6/d15/f5e [4194304,4194304] 0 2024-04-20T21:58:28.440 INFO:tasks.workunit.client.0.smithi142.stdout:4/308: getdents d1/d12/da/d37 0 2024-04-20T21:58:28.442 INFO:tasks.workunit.client.0.smithi142.stdout:3/327: fdatasync d6/f18 0 2024-04-20T21:58:28.442 INFO:tasks.workunit.client.0.smithi142.stdout:5/232: write dc/d14/f41 [546406,46354] 0 2024-04-20T21:58:28.443 INFO:tasks.workunit.client.0.smithi142.stdout:9/396: unlink d0/d36/f74 0 2024-04-20T21:58:28.446 INFO:tasks.workunit.client.0.smithi142.stdout:8/320: truncate d0/d29/f3d 969435 0 2024-04-20T21:58:28.449 INFO:tasks.workunit.client.0.smithi142.stdout:0/335: truncate d5/f8 6871892 0 2024-04-20T21:58:28.451 INFO:tasks.workunit.client.0.smithi142.stdout:1/294: rename d2/dd/c15 to d2/dd/d17/d3b/d50/c61 0 2024-04-20T21:58:28.453 INFO:tasks.workunit.client.0.smithi142.stdout:1/295: chown d2/dd/d1c/c4a 237689066 1 2024-04-20T21:58:28.455 INFO:tasks.workunit.client.0.smithi142.stdout:3/328: mkdir d6/d15/d30/d37/d6c 0 2024-04-20T21:58:28.457 INFO:tasks.workunit.client.0.smithi142.stdout:9/397: mkdir d0/d2a/d39/d87 0 2024-04-20T21:58:28.461 INFO:tasks.workunit.client.0.smithi142.stdout:4/309: symlink d1/d12/da/d37/l5f 0 2024-04-20T21:58:28.463 INFO:tasks.workunit.client.0.smithi142.stdout:1/296: mkdir d2/dd/d17/d3b/d50/d62 0 2024-04-20T21:58:28.465 INFO:tasks.workunit.client.0.smithi142.stdout:9/398: symlink d0/d3c/d4d/l88 0 2024-04-20T21:58:28.468 INFO:tasks.workunit.client.0.smithi142.stdout:9/399: write d0/d36/f7a [919477,74267] 0 2024-04-20T21:58:28.470 INFO:tasks.workunit.client.0.smithi142.stdout:5/233: dwrite dc/d14/f1a [0,4194304] 0 2024-04-20T21:58:28.471 INFO:tasks.workunit.client.0.smithi142.stdout:9/400: truncate d0/d2a/f40 1599725 0 2024-04-20T21:58:28.473 INFO:tasks.workunit.client.0.smithi142.stdout:5/234: dread - dc/d14/d21/d46/d2a/f49 zero size 2024-04-20T21:58:28.474 INFO:tasks.workunit.client.0.smithi142.stdout:3/329: creat d6/d15/d1e/d43/d4d/f6d x:0 0 0 2024-04-20T21:58:28.475 INFO:tasks.workunit.client.0.smithi142.stdout:5/235: fsync dc/d14/d21/d46/d2a/f49 0 2024-04-20T21:58:28.476 INFO:tasks.workunit.client.0.smithi142.stdout:4/310: creat d1/d12/da/d1c/d32/f60 x:0 0 0 2024-04-20T21:58:28.477 INFO:tasks.workunit.client.0.smithi142.stdout:9/401: truncate d0/d36/f7a 1993876 0 2024-04-20T21:58:28.478 INFO:tasks.workunit.client.0.smithi142.stdout:3/330: fsync d6/f4b 0 2024-04-20T21:58:28.479 INFO:tasks.workunit.client.0.smithi142.stdout:1/297: creat d2/dd/d17/d1b/d22/d13/f63 x:0 0 0 2024-04-20T21:58:28.480 INFO:tasks.workunit.client.0.smithi142.stdout:3/331: fsync d6/f18 0 2024-04-20T21:58:28.483 INFO:tasks.workunit.client.0.smithi142.stdout:2/391: rename d3/d5/d19/d70/f7f to d3/d9/f83 0 2024-04-20T21:58:28.486 INFO:tasks.workunit.client.0.smithi142.stdout:7/347: mkdir d4/d9/d1c/d5e/d4d/d77/d7e 0 2024-04-20T21:58:28.487 INFO:tasks.workunit.client.0.smithi142.stdout:8/321: truncate d0/d29/f38 2124891 0 2024-04-20T21:58:28.488 INFO:tasks.workunit.client.0.smithi142.stdout:7/348: dread - d4/d9/d1c/f6d zero size 2024-04-20T21:58:28.489 INFO:tasks.workunit.client.0.smithi142.stdout:4/311: chown d1/d6/d30/d3f/f21 54 1 2024-04-20T21:58:28.492 INFO:tasks.workunit.client.0.smithi142.stdout:3/332: mkdir d6/d15/d1e/d43/d4d/d6e 0 2024-04-20T21:58:28.496 INFO:tasks.workunit.client.0.smithi142.stdout:5/236: creat dc/d14/d21/d46/d2a/f52 x:0 0 0 2024-04-20T21:58:28.499 INFO:tasks.workunit.client.0.smithi142.stdout:0/336: rename d5/d13/d1e/d23/d2c/f41 to d5/d13/d1e/d23/d24/d48/d55/f74 0 2024-04-20T21:58:28.501 INFO:tasks.workunit.client.0.smithi142.stdout:9/402: mkdir d0/d89 0 2024-04-20T21:58:28.501 INFO:tasks.workunit.client.0.smithi142.stdout:0/337: chown d5/d1d/f4e 864103311 1 2024-04-20T21:58:28.503 INFO:tasks.workunit.client.0.smithi142.stdout:6/293: sync 2024-04-20T21:58:28.506 INFO:tasks.workunit.client.0.smithi142.stdout:1/298: getdents d2/dd/d17/d1b/d22/d55 0 2024-04-20T21:58:28.507 INFO:tasks.workunit.client.0.smithi142.stdout:5/237: mkdir dc/d14/d26/d3f/d53 0 2024-04-20T21:58:28.510 INFO:tasks.workunit.client.0.smithi142.stdout:9/403: mknod d0/d3c/c8a 0 2024-04-20T21:58:28.510 INFO:tasks.workunit.client.0.smithi142.stdout:4/312: getdents d1/d12/da/d1c/d32/d3d/d2f/d49 0 2024-04-20T21:58:28.510 INFO:tasks.workunit.client.0.smithi142.stdout:7/349: dwrite d4/d9/d11/d22/f3a [0,4194304] 0 2024-04-20T21:58:28.513 INFO:tasks.workunit.client.0.smithi142.stdout:8/322: symlink d0/d29/d36/d45/d59/l79 0 2024-04-20T21:58:28.513 INFO:tasks.workunit.client.0.smithi142.stdout:2/392: dread d3/d5/d19/d70/f5f [0,4194304] 0 2024-04-20T21:58:28.515 INFO:tasks.workunit.client.0.smithi142.stdout:6/294: symlink d1/d5/d3a/d43/d5c/l69 0 2024-04-20T21:58:28.515 INFO:tasks.workunit.client.0.smithi142.stdout:7/350: write d4/d9/d11/f3e [208356,65712] 0 2024-04-20T21:58:28.523 INFO:tasks.workunit.client.0.smithi142.stdout:0/338: rename d5/d1c/d29/d38/f1f to d5/d1c/d29/d38/d62/f75 0 2024-04-20T21:58:28.532 INFO:tasks.workunit.client.0.smithi142.stdout:4/313: creat d1/d12/da/d1c/f61 x:0 0 0 2024-04-20T21:58:28.536 INFO:tasks.workunit.client.0.smithi142.stdout:3/333: creat d6/d15/d1e/d43/f6f x:0 0 0 2024-04-20T21:58:28.539 INFO:tasks.workunit.client.0.smithi142.stdout:1/299: creat d2/d4e/f64 x:0 0 0 2024-04-20T21:58:28.539 INFO:tasks.workunit.client.0.smithi142.stdout:3/334: fdatasync d6/d15/d47/f61 0 2024-04-20T21:58:28.540 INFO:tasks.workunit.client.0.smithi142.stdout:2/393: dwrite d3/d9/d34/d51/d31/f54 [0,4194304] 0 2024-04-20T21:58:28.542 INFO:tasks.workunit.client.0.smithi142.stdout:9/404: dread d0/f8 [0,4194304] 0 2024-04-20T21:58:28.542 INFO:tasks.workunit.client.0.smithi142.stdout:5/238: mknod dc/d14/c54 0 2024-04-20T21:58:28.547 INFO:tasks.workunit.client.0.smithi142.stdout:5/239: fsync dc/d14/d25/f2d 0 2024-04-20T21:58:28.548 INFO:tasks.workunit.client.0.smithi142.stdout:8/323: rename d0/d42/c4e to d0/d29/d36/d45/c7a 0 2024-04-20T21:58:28.549 INFO:tasks.workunit.client.0.smithi142.stdout:9/405: unlink d0/d2a/d39/c79 0 2024-04-20T21:58:28.553 INFO:tasks.workunit.client.0.smithi142.stdout:6/295: getdents d1/d2f 0 2024-04-20T21:58:28.567 INFO:tasks.workunit.client.0.smithi142.stdout:3/335: dwrite d6/f11 [0,4194304] 0 2024-04-20T21:58:28.567 INFO:tasks.workunit.client.0.smithi142.stdout:7/351: rename d4/d9/d1c/d5e/d4d to d4/d7f 0 2024-04-20T21:58:28.570 INFO:tasks.workunit.client.0.smithi142.stdout:1/300: dwrite d2/dd/d17/d1b/d22/f4b [0,4194304] 0 2024-04-20T21:58:28.570 INFO:tasks.workunit.client.0.smithi142.stdout:2/394: getdents d3/d5/d19/d70/d3c/d66/d6c 0 2024-04-20T21:58:28.573 INFO:tasks.workunit.client.0.smithi142.stdout:5/240: link dc/d14/d21/d46/d2a/c33 dc/d14/d21/c55 0 2024-04-20T21:58:28.576 INFO:tasks.workunit.client.0.smithi142.stdout:8/324: dread d0/d29/d36/d45/f56 [0,4194304] 0 2024-04-20T21:58:28.576 INFO:tasks.workunit.client.0.smithi142.stdout:4/314: dwrite d1/d12/da/d1c/d32/d3d/f28 [0,4194304] 0 2024-04-20T21:58:28.579 INFO:tasks.workunit.client.0.smithi142.stdout:3/336: unlink d6/d32/f45 0 2024-04-20T21:58:28.580 INFO:tasks.workunit.client.0.smithi142.stdout:1/301: readlink d2/dd/l5d 0 2024-04-20T21:58:28.580 INFO:tasks.workunit.client.0.smithi142.stdout:6/296: symlink d1/d5/d3a/d43/d5c/d65/l6a 0 2024-04-20T21:58:28.581 INFO:tasks.workunit.client.0.smithi142.stdout:4/315: fsync d1/d12/da/d1c/d32/f4d 0 2024-04-20T21:58:28.581 INFO:tasks.workunit.client.0.smithi142.stdout:7/352: symlink d4/d7f/l80 0 2024-04-20T21:58:28.582 INFO:tasks.workunit.client.0.smithi142.stdout:5/241: dread - dc/d14/d21/d46/d2a/d30/f4e zero size 2024-04-20T21:58:28.586 INFO:tasks.workunit.client.0.smithi142.stdout:6/297: write d1/d11/f5d [546975,122757] 0 2024-04-20T21:58:28.586 INFO:tasks.workunit.client.0.smithi142.stdout:2/395: unlink d3/d9/d34/d51/d31/c53 0 2024-04-20T21:58:28.591 INFO:tasks.workunit.client.0.smithi142.stdout:3/337: fsync d6/f10 0 2024-04-20T21:58:28.593 INFO:tasks.workunit.client.0.smithi142.stdout:2/396: write d3/d5/d19/d70/d3c/f1b [5032074,28042] 0 2024-04-20T21:58:28.598 INFO:tasks.workunit.client.0.smithi142.stdout:4/316: truncate d1/d12/da/d1c/d32/f40 286501 0 2024-04-20T21:58:28.601 INFO:tasks.workunit.client.0.smithi142.stdout:5/242: readlink dc/d14/l1c 0 2024-04-20T21:58:28.604 INFO:tasks.workunit.client.0.smithi142.stdout:0/339: rename d5/d1c/f26 to d5/d1c/d29/f76 0 2024-04-20T21:58:28.606 INFO:tasks.workunit.client.0.smithi142.stdout:9/406: dread d0/d2a/d39/f6d [4194304,4194304] 0 2024-04-20T21:58:28.606 INFO:tasks.workunit.client.0.smithi142.stdout:8/325: creat d0/f7b x:0 0 0 2024-04-20T21:58:28.607 INFO:tasks.workunit.client.0.smithi142.stdout:1/302: mknod d2/dd/d17/d3b/d50/d62/c65 0 2024-04-20T21:58:28.607 INFO:tasks.workunit.client.0.smithi142.stdout:2/397: readlink d3/l37 0 2024-04-20T21:58:28.608 INFO:tasks.workunit.client.0.smithi142.stdout:3/338: truncate d6/d15/d30/d37/f3d 525880 0 2024-04-20T21:58:28.611 INFO:tasks.workunit.client.0.smithi142.stdout:1/303: rename d2/dd to d2/dd/d17/d1b/d66 22 2024-04-20T21:58:28.617 INFO:tasks.workunit.client.0.smithi142.stdout:4/317: dread - d1/d6/f47 zero size 2024-04-20T21:58:28.619 INFO:tasks.workunit.client.0.smithi142.stdout:3/339: creat d6/d15/d1e/d43/f70 x:0 0 0 2024-04-20T21:58:28.619 INFO:tasks.workunit.client.0.smithi142.stdout:8/326: chown d0/d42/l69 415930958 1 2024-04-20T21:58:28.621 INFO:tasks.workunit.client.0.smithi142.stdout:0/340: getdents d5/d1c/d29/d32 0 2024-04-20T21:58:28.626 INFO:tasks.workunit.client.0.smithi142.stdout:2/398: dread d3/d9/f83 [0,4194304] 0 2024-04-20T21:58:28.628 INFO:tasks.workunit.client.0.smithi142.stdout:5/243: dread dc/d14/d21/f27 [0,4194304] 0 2024-04-20T21:58:28.629 INFO:tasks.workunit.client.0.smithi142.stdout:8/327: truncate d0/d17/f6d 540441 0 2024-04-20T21:58:28.630 INFO:tasks.workunit.client.0.smithi142.stdout:0/341: write d5/d1c/d29/d63/f64 [405787,110910] 0 2024-04-20T21:58:28.631 INFO:tasks.workunit.client.0.smithi142.stdout:5/244: fsync dc/d14/f37 0 2024-04-20T21:58:28.635 INFO:tasks.workunit.client.0.smithi142.stdout:3/340: creat d6/d15/d1e/d43/d4d/d6e/f71 x:0 0 0 2024-04-20T21:58:28.638 INFO:tasks.workunit.client.0.smithi142.stdout:5/245: rename dc/d14/l1c to dc/d14/d26/d3f/l56 0 2024-04-20T21:58:28.644 INFO:tasks.workunit.client.0.smithi142.stdout:2/399: mkdir d3/d9/d34/d51/d31/d84 0 2024-04-20T21:58:28.646 INFO:tasks.workunit.client.0.smithi142.stdout:9/407: dread d0/d2a/f34 [0,4194304] 0 2024-04-20T21:58:28.647 INFO:tasks.workunit.client.0.smithi142.stdout:1/304: dread d2/dd/d17/d1b/d22/f56 [0,4194304] 0 2024-04-20T21:58:28.652 INFO:tasks.workunit.client.0.smithi142.stdout:8/328: mkdir d0/d29/d36/d45/d7c 0 2024-04-20T21:58:28.652 INFO:tasks.workunit.client.0.smithi142.stdout:3/341: mknod d6/d15/c72 0 2024-04-20T21:58:28.655 INFO:tasks.workunit.client.0.smithi142.stdout:4/318: link d1/d6/d4a/d5a/f5d d1/d12/da/d1c/d32/d3d/d2f/d49/f62 0 2024-04-20T21:58:28.656 INFO:tasks.workunit.client.0.smithi142.stdout:3/342: stat d6/d15/d1e/c21 0 2024-04-20T21:58:28.660 INFO:tasks.workunit.client.0.smithi142.stdout:8/329: write d0/d29/d36/d45/f4d [894436,86250] 0 2024-04-20T21:58:28.661 INFO:tasks.workunit.client.0.smithi142.stdout:4/319: readlink d1/d12/da/d37/l5f 0 2024-04-20T21:58:28.661 INFO:tasks.workunit.client.0.smithi142.stdout:0/342: dwrite d5/d1c/d29/d38/f42 [0,4194304] 0 2024-04-20T21:58:28.661 INFO:tasks.workunit.client.0.smithi142.stdout:2/400: creat d3/d5/d19/d70/d3c/d64/f85 x:0 0 0 2024-04-20T21:58:28.665 INFO:tasks.workunit.client.0.smithi142.stdout:8/330: stat d0/f2f 0 2024-04-20T21:58:28.667 INFO:tasks.workunit.client.0.smithi142.stdout:9/408: mkdir d0/d2a/d8b 0 2024-04-20T21:58:28.667 INFO:tasks.workunit.client.0.smithi142.stdout:1/305: stat d2/dd/d17/f1a 0 2024-04-20T21:58:28.668 INFO:tasks.workunit.client.0.smithi142.stdout:9/409: stat d0/d2a 0 2024-04-20T21:58:28.669 INFO:tasks.workunit.client.0.smithi142.stdout:4/320: write d1/d6/f47 [546046,116059] 0 2024-04-20T21:58:28.672 INFO:tasks.workunit.client.0.smithi142.stdout:8/331: stat d0/d1c/d44 0 2024-04-20T21:58:28.673 INFO:tasks.workunit.client.0.smithi142.stdout:7/353: truncate d4/d9/d11/d22/f3a 7269270 0 2024-04-20T21:58:28.675 INFO:tasks.workunit.client.0.smithi142.stdout:6/298: dwrite d1/d5/f3d [0,4194304] 0 2024-04-20T21:58:28.677 INFO:tasks.workunit.client.0.smithi142.stdout:0/343: creat d5/d1d/f77 x:0 0 0 2024-04-20T21:58:28.681 INFO:tasks.workunit.client.0.smithi142.stdout:9/410: symlink d0/d36/d55/l8c 0 2024-04-20T21:58:28.684 INFO:tasks.workunit.client.0.smithi142.stdout:5/246: dread dc/d14/f1f [0,4194304] 0 2024-04-20T21:58:28.689 INFO:tasks.workunit.client.0.smithi142.stdout:7/354: creat d4/d9/d1c/f81 x:0 0 0 2024-04-20T21:58:28.695 INFO:tasks.workunit.client.0.smithi142.stdout:8/332: symlink d0/d29/d36/l7d 0 2024-04-20T21:58:28.695 INFO:tasks.workunit.client.0.smithi142.stdout:7/355: write d4/d9/d1c/f21 [1874385,54389] 0 2024-04-20T21:58:28.699 INFO:tasks.workunit.client.0.smithi142.stdout:3/343: dwrite d6/d15/d30/f5c [0,4194304] 0 2024-04-20T21:58:28.704 INFO:tasks.workunit.client.0.smithi142.stdout:0/344: mkdir d5/d1c/d3c/d4a/d78 0 2024-04-20T21:58:28.704 INFO:tasks.workunit.client.0.smithi142.stdout:2/401: dwrite d3/d5/f17 [4194304,4194304] 0 2024-04-20T21:58:28.707 INFO:tasks.workunit.client.0.smithi142.stdout:7/356: unlink d4/d9/d1c/f6d 0 2024-04-20T21:58:28.707 INFO:tasks.workunit.client.0.smithi142.stdout:9/411: creat d0/d2a/d39/d87/f8d x:0 0 0 2024-04-20T21:58:28.710 INFO:tasks.workunit.client.0.smithi142.stdout:6/299: dread d1/d1b/f1e [0,4194304] 0 2024-04-20T21:58:28.711 INFO:tasks.workunit.client.0.smithi142.stdout:1/306: dwrite d2/dd/d17/d1b/d22/d13/f14 [0,4194304] 0 2024-04-20T21:58:28.712 INFO:tasks.workunit.client.0.smithi142.stdout:8/333: symlink d0/d22/d3f/l7e 0 2024-04-20T21:58:28.712 INFO:tasks.workunit.client.0.smithi142.stdout:2/402: readlink d3/d9/d34/l4a 0 2024-04-20T21:58:28.716 INFO:tasks.workunit.client.0.smithi142.stdout:7/357: chown d4/d9/d11/d47/d5a/f76 34489394 1 2024-04-20T21:58:28.720 INFO:tasks.workunit.client.0.smithi142.stdout:9/412: creat d0/d2a/f8e x:0 0 0 2024-04-20T21:58:28.731 INFO:tasks.workunit.client.0.smithi142.stdout:8/334: mkdir d0/d22/d3f/d7f 0 2024-04-20T21:58:28.731 INFO:tasks.workunit.client.0.smithi142.stdout:5/247: dwrite dc/f43 [0,4194304] 0 2024-04-20T21:58:28.732 INFO:tasks.workunit.client.0.smithi142.stdout:5/248: fdatasync dc/f2f 0 2024-04-20T21:58:28.735 INFO:tasks.workunit.client.0.smithi142.stdout:5/249: chown dc/d14/d21/d46/d2a/f49 5161 1 2024-04-20T21:58:28.736 INFO:tasks.workunit.client.0.smithi142.stdout:5/250: chown f3 0 1 2024-04-20T21:58:28.739 INFO:tasks.workunit.client.0.smithi142.stdout:6/300: read - d1/d2f/d35/d5b/d63/d34/f4c zero size 2024-04-20T21:58:28.754 INFO:tasks.workunit.client.0.smithi142.stdout:4/321: dread d1/d6/d30/d3f/f1e [0,4194304] 0 2024-04-20T21:58:28.757 INFO:tasks.workunit.client.0.smithi142.stdout:8/335: creat d0/d17/d35/f80 x:0 0 0 2024-04-20T21:58:28.761 INFO:tasks.workunit.client.0.smithi142.stdout:6/301: mknod d1/d1b/c6b 0 2024-04-20T21:58:28.765 INFO:tasks.workunit.client.0.smithi142.stdout:5/251: dwrite dc/d14/d21/d46/d2a/d3c/f44 [0,4194304] 0 2024-04-20T21:58:28.767 INFO:tasks.workunit.client.0.smithi142.stdout:5/252: fdatasync dc/d14/f1a 0 2024-04-20T21:58:28.770 INFO:tasks.workunit.client.0.smithi142.stdout:5/253: write f4 [1068483,36403] 0 2024-04-20T21:58:28.770 INFO:tasks.workunit.client.0.smithi142.stdout:7/358: rename d4/d9/d1c/l5d to d4/d9/d11/d47/d5a/l82 0 2024-04-20T21:58:28.775 INFO:tasks.workunit.client.0.smithi142.stdout:5/254: fsync dc/d14/d21/d46/d2a/d30/f4e 0 2024-04-20T21:58:28.777 INFO:tasks.workunit.client.0.smithi142.stdout:8/336: write d0/d29/f4a [3330836,28775] 0 2024-04-20T21:58:28.778 INFO:tasks.workunit.client.0.smithi142.stdout:5/255: write f2 [1488842,24762] 0 2024-04-20T21:58:28.780 INFO:tasks.workunit.client.0.smithi142.stdout:7/359: mknod d4/d9/d11/c83 0 2024-04-20T21:58:28.782 INFO:tasks.workunit.client.0.smithi142.stdout:8/337: write d0/d29/f4a [2728331,35305] 0 2024-04-20T21:58:28.784 INFO:tasks.workunit.client.0.smithi142.stdout:3/344: truncate d6/d15/d1e/d43/d4d/d59/f62 3271927 0 2024-04-20T21:58:28.787 INFO:tasks.workunit.client.0.smithi142.stdout:8/338: write d0/d1c/d44/f46 [1080942,66520] 0 2024-04-20T21:58:28.791 INFO:tasks.workunit.client.0.smithi142.stdout:8/339: write d0/d17/d35/f80 [75839,15558] 0 2024-04-20T21:58:28.792 INFO:tasks.workunit.client.0.smithi142.stdout:5/256: mkdir dc/d14/d21/d46/d2a/d57 0 2024-04-20T21:58:28.794 INFO:tasks.workunit.client.0.smithi142.stdout:5/257: fsync dc/f10 0 2024-04-20T21:58:28.794 INFO:tasks.workunit.client.0.smithi142.stdout:9/413: write d0/d3c/d4d/f75 [773600,93481] 0 2024-04-20T21:58:28.794 INFO:tasks.workunit.client.0.smithi142.stdout:7/360: symlink d4/d7f/d77/l84 0 2024-04-20T21:58:28.794 INFO:tasks.workunit.client.0.smithi142.stdout:2/403: truncate d3/d5/d19/d70/f5f 2075133 0 2024-04-20T21:58:28.797 INFO:tasks.workunit.client.0.smithi142.stdout:7/361: fsync d4/d9/d1c/f23 0 2024-04-20T21:58:28.799 INFO:tasks.workunit.client.0.smithi142.stdout:7/362: fdatasync d4/d9/d1c/f81 0 2024-04-20T21:58:28.804 INFO:tasks.workunit.client.0.smithi142.stdout:1/307: rename d2/dd/d17/d3b/d50/c5a to d2/dd/d17/d1b/d22/c67 0 2024-04-20T21:58:28.807 INFO:tasks.workunit.client.0.smithi142.stdout:8/340: chown d0/d29/d36/d45/c7a 27 1 2024-04-20T21:58:28.812 INFO:tasks.workunit.client.0.smithi142.stdout:2/404: unlink d3/d5/c6d 0 2024-04-20T21:58:28.815 INFO:tasks.workunit.client.0.smithi142.stdout:7/363: mknod d4/d9/d1c/d5e/c85 0 2024-04-20T21:58:28.820 INFO:tasks.workunit.client.0.smithi142.stdout:6/302: getdents d1/d5/d3a/d43/d5c 0 2024-04-20T21:58:28.823 INFO:tasks.workunit.client.0.smithi142.stdout:1/308: creat d2/d4e/f68 x:0 0 0 2024-04-20T21:58:28.825 INFO:tasks.workunit.client.0.smithi142.stdout:8/341: unlink d0/f58 0 2024-04-20T21:58:28.826 INFO:tasks.workunit.client.0.smithi142.stdout:1/309: write d2/f3e [206099,104931] 0 2024-04-20T21:58:28.826 INFO:tasks.workunit.client.0.smithi142.stdout:3/345: write d6/f6a [153332,122082] 0 2024-04-20T21:58:28.834 INFO:tasks.workunit.client.0.smithi142.stdout:2/405: creat d3/d5/d19/f86 x:0 0 0 2024-04-20T21:58:28.834 INFO:tasks.workunit.client.0.smithi142.stdout:5/258: dread dc/d14/d21/d46/d2a/d30/f42 [0,4194304] 0 2024-04-20T21:58:28.836 INFO:tasks.workunit.client.0.smithi142.stdout:6/303: fsync d1/d5/d3a/f42 0 2024-04-20T21:58:28.846 INFO:tasks.workunit.client.0.smithi142.stdout:3/346: readlink d6/d15/l16 0 2024-04-20T21:58:28.850 INFO:tasks.workunit.client.0.smithi142.stdout:3/347: truncate d6/f2e 1384392 0 2024-04-20T21:58:28.855 INFO:tasks.workunit.client.0.smithi142.stdout:6/304: dread d1/d2f/d35/f36 [0,4194304] 0 2024-04-20T21:58:28.856 INFO:tasks.workunit.client.0.smithi142.stdout:4/322: rename d1/f8 to d1/d6/d30/d3f/f63 0 2024-04-20T21:58:28.858 INFO:tasks.workunit.client.0.smithi142.stdout:9/414: rename d0/d3c to d0/d3c/d4d/d63/d80/d8f 22 2024-04-20T21:58:28.862 INFO:tasks.workunit.client.0.smithi142.stdout:4/323: stat d1/d12/da/c58 0 2024-04-20T21:58:28.862 INFO:tasks.workunit.client.0.smithi142.stdout:7/364: symlink d4/d9/d11/d47/d5a/d62/l86 0 2024-04-20T21:58:28.863 INFO:tasks.workunit.client.0.smithi142.stdout:2/406: write d3/d5/d19/f59 [551053,55260] 0 2024-04-20T21:58:28.867 INFO:tasks.workunit.client.0.smithi142.stdout:9/415: mknod d0/d2a/c90 0 2024-04-20T21:58:28.868 INFO:tasks.workunit.client.0.smithi142.stdout:5/259: truncate f3 4884420 0 2024-04-20T21:58:28.869 INFO:tasks.workunit.client.0.smithi142.stdout:8/342: getdents d0/d42 0 2024-04-20T21:58:28.870 INFO:tasks.workunit.client.0.smithi142.stdout:5/260: stat dc/d14 0 2024-04-20T21:58:28.870 INFO:tasks.workunit.client.0.smithi142.stdout:4/324: read d1/d12/da/f22 [2764210,56948] 0 2024-04-20T21:58:28.871 INFO:tasks.workunit.client.0.smithi142.stdout:3/348: write d6/f31 [1146828,81860] 0 2024-04-20T21:58:28.874 INFO:tasks.workunit.client.0.smithi142.stdout:9/416: mkdir d0/d91 0 2024-04-20T21:58:28.881 INFO:tasks.workunit.client.0.smithi142.stdout:9/417: creat d0/d2a/d39/d87/f92 x:0 0 0 2024-04-20T21:58:28.883 INFO:tasks.workunit.client.0.smithi142.stdout:4/325: read d1/d12/da/d1c/d32/f4d [346357,41384] 0 2024-04-20T21:58:28.885 INFO:tasks.workunit.client.0.smithi142.stdout:1/310: dread d2/dd/d17/d1b/f5f [0,4194304] 0 2024-04-20T21:58:28.886 INFO:tasks.workunit.client.0.smithi142.stdout:8/343: rename d0/d42/f57 to d0/d5e/f81 0 2024-04-20T21:58:28.889 INFO:tasks.workunit.client.0.smithi142.stdout:8/344: read - d0/d1c/f61 zero size 2024-04-20T21:58:28.889 INFO:tasks.workunit.client.0.smithi142.stdout:3/349: link d6/f2e d6/d15/d30/f73 0 2024-04-20T21:58:28.895 INFO:tasks.workunit.client.0.smithi142.stdout:5/261: write f2 [690850,103267] 0 2024-04-20T21:58:28.897 INFO:tasks.workunit.client.0.smithi142.stdout:1/311: creat d2/dd/d1c/f69 x:0 0 0 2024-04-20T21:58:28.901 INFO:tasks.workunit.client.0.smithi142.stdout:2/407: dread d3/d5/f17 [4194304,4194304] 0 2024-04-20T21:58:28.903 INFO:tasks.workunit.client.0.smithi142.stdout:1/312: chown d2/dd/d17/d1b/d22/f46 73060 1 2024-04-20T21:58:28.904 INFO:tasks.workunit.client.0.smithi142.stdout:9/418: dread d0/d36/f53 [0,4194304] 0 2024-04-20T21:58:28.906 INFO:tasks.workunit.client.0.smithi142.stdout:4/326: creat d1/d6/d30/d3f/f64 x:0 0 0 2024-04-20T21:58:28.911 INFO:tasks.workunit.client.0.smithi142.stdout:1/313: readlink d2/dd/d17/d1b/d22/l40 0 2024-04-20T21:58:28.915 INFO:tasks.workunit.client.0.smithi142.stdout:9/419: read d0/d36/f7a [1963798,57675] 0 2024-04-20T21:58:28.916 INFO:tasks.workunit.client.0.smithi142.stdout:8/345: rename d0/c30 to d0/d29/c82 0 2024-04-20T21:58:28.919 INFO:tasks.workunit.client.0.smithi142.stdout:7/365: dwrite d4/d9/d11/d22/f3a [0,4194304] 0 2024-04-20T21:58:28.925 INFO:tasks.workunit.client.0.smithi142.stdout:9/420: creat d0/d3c/d4d/d63/d80/f93 x:0 0 0 2024-04-20T21:58:28.929 INFO:tasks.workunit.client.0.smithi142.stdout:5/262: dread f9 [0,4194304] 0 2024-04-20T21:58:28.929 INFO:tasks.workunit.client.0.smithi142.stdout:9/421: fdatasync d0/fc 0 2024-04-20T21:58:28.929 INFO:tasks.workunit.client.0.smithi142.stdout:3/350: dwrite d6/f11 [0,4194304] 0 2024-04-20T21:58:28.931 INFO:tasks.workunit.client.0.smithi142.stdout:4/327: rename d1/d12/da/d1c/d32/d3d/d2f/d52/c55 to d1/d12/da/c65 0 2024-04-20T21:58:28.933 INFO:tasks.workunit.client.0.smithi142.stdout:9/422: read - d0/d2a/d39/f56 zero size 2024-04-20T21:58:28.935 INFO:tasks.workunit.client.0.smithi142.stdout:7/366: creat d4/d7f/d77/d7e/f87 x:0 0 0 2024-04-20T21:58:28.936 INFO:tasks.workunit.client.0.smithi142.stdout:3/351: dread - d6/d15/d30/d37/f54 zero size 2024-04-20T21:58:28.937 INFO:tasks.workunit.client.0.smithi142.stdout:2/408: dwrite d3/d5/f17 [4194304,4194304] 0 2024-04-20T21:58:28.940 INFO:tasks.workunit.client.0.smithi142.stdout:5/263: write dc/d14/d21/d46/d2a/f49 [767426,11284] 0 2024-04-20T21:58:28.942 INFO:tasks.workunit.client.0.smithi142.stdout:4/328: read d1/d6/d30/d3f/f1e [409856,44555] 0 2024-04-20T21:58:28.950 INFO:tasks.workunit.client.0.smithi142.stdout:7/367: mkdir d4/d9/d11/d22/d88 0 2024-04-20T21:58:28.952 INFO:tasks.workunit.client.0.smithi142.stdout:5/264: write f3 [4500300,93702] 0 2024-04-20T21:58:28.960 INFO:tasks.workunit.client.0.smithi142.stdout:8/346: dwrite d0/f2f [0,4194304] 0 2024-04-20T21:58:28.960 INFO:tasks.workunit.client.0.smithi142.stdout:3/352: creat d6/d15/d30/d37/d6c/f74 x:0 0 0 2024-04-20T21:58:28.963 INFO:tasks.workunit.client.0.smithi142.stdout:3/353: chown d6/d15/d30/d37/c55 1079271 1 2024-04-20T21:58:28.965 INFO:tasks.workunit.client.0.smithi142.stdout:5/265: mkdir dc/d14/d21/d46/d58 0 2024-04-20T21:58:28.967 INFO:tasks.workunit.client.0.smithi142.stdout:9/423: dwrite d0/d2a/f44 [0,4194304] 0 2024-04-20T21:58:28.973 INFO:tasks.workunit.client.0.smithi142.stdout:5/266: read dc/d14/d21/d46/d2a/d30/f3e [615504,110642] 0 2024-04-20T21:58:28.975 INFO:tasks.workunit.client.0.smithi142.stdout:3/354: chown d6/d15/d1e/d43/d4d/l5f 4 1 2024-04-20T21:58:28.982 INFO:tasks.workunit.client.0.smithi142.stdout:4/329: creat d1/d12/f66 x:0 0 0 2024-04-20T21:58:28.984 INFO:tasks.workunit.client.0.smithi142.stdout:8/347: write d0/d29/d36/d45/f4d [2945788,88084] 0 2024-04-20T21:58:28.990 INFO:tasks.workunit.client.0.smithi142.stdout:2/409: dwrite d3/d9/d34/d51/f65 [0,4194304] 0 2024-04-20T21:58:28.996 INFO:tasks.workunit.client.0.smithi142.stdout:3/355: chown d6/d15/d1e/d43/d4d/d59/f62 1 1 2024-04-20T21:58:29.001 INFO:tasks.workunit.client.0.smithi142.stdout:3/356: write d6/d15/d47/f61 [281594,69611] 0 2024-04-20T21:58:29.002 INFO:tasks.workunit.client.0.smithi142.stdout:5/267: dwrite dc/d14/f1a [0,4194304] 0 2024-04-20T21:58:29.009 INFO:tasks.workunit.client.0.smithi142.stdout:9/424: getdents d0/d3c 0 2024-04-20T21:58:29.011 INFO:tasks.workunit.client.0.smithi142.stdout:4/330: fsync d1/d12/da/d1c/f25 0 2024-04-20T21:58:29.016 INFO:tasks.workunit.client.0.smithi142.stdout:2/410: mknod d3/c87 0 2024-04-20T21:58:29.019 INFO:tasks.workunit.client.0.smithi142.stdout:2/411: dread - d3/d9/d34/d51/d31/f6a zero size 2024-04-20T21:58:29.021 INFO:tasks.workunit.client.0.smithi142.stdout:3/357: dread d6/fd [0,4194304] 0 2024-04-20T21:58:29.030 INFO:tasks.workunit.client.0.smithi142.stdout:8/348: link d0/d29/d36/l7d d0/d29/d36/d45/d59/l83 0 2024-04-20T21:58:29.034 INFO:tasks.workunit.client.0.smithi142.stdout:3/358: rmdir d6/d15/d30 39 2024-04-20T21:58:29.038 INFO:tasks.workunit.client.0.smithi142.stdout:5/268: link dc/f43 dc/d14/f59 0 2024-04-20T21:58:29.039 INFO:tasks.workunit.client.0.smithi142.stdout:9/425: dwrite d0/f8 [4194304,4194304] 0 2024-04-20T21:58:29.043 INFO:tasks.workunit.client.0.smithi142.stdout:5/269: write dc/d14/d21/d46/f24 [1814780,66525] 0 2024-04-20T21:58:29.043 INFO:tasks.workunit.client.0.smithi142.stdout:2/412: dread d3/d5/d19/d70/f5f [0,4194304] 0 2024-04-20T21:58:29.043 INFO:tasks.workunit.client.0.smithi142.stdout:8/349: symlink d0/d29/d36/l84 0 2024-04-20T21:58:29.052 INFO:tasks.workunit.client.0.smithi142.stdout:4/331: creat d1/d6/d30/d3f/f67 x:0 0 0 2024-04-20T21:58:29.053 INFO:tasks.workunit.client.0.smithi142.stdout:8/350: truncate d0/d17/f34 635256 0 2024-04-20T21:58:29.055 INFO:tasks.workunit.client.0.smithi142.stdout:9/426: write d0/d2a/f37 [3257764,121625] 0 2024-04-20T21:58:29.055 INFO:tasks.workunit.client.0.smithi142.stdout:3/359: mkdir d6/d15/d30/d37/d75 0 2024-04-20T21:58:29.060 INFO:tasks.workunit.client.0.smithi142.stdout:4/332: read d1/d6/fc [1290992,102550] 0 2024-04-20T21:58:29.061 INFO:tasks.workunit.client.0.smithi142.stdout:3/360: chown d6/d15/d30/d37/d6c/f74 13 1 2024-04-20T21:58:29.064 INFO:tasks.workunit.client.0.smithi142.stdout:5/270: truncate dc/f10 810928 0 2024-04-20T21:58:29.065 INFO:tasks.workunit.client.0.smithi142.stdout:4/333: write d1/d6/d30/d3f/f44 [869905,88357] 0 2024-04-20T21:58:29.067 INFO:tasks.workunit.client.0.smithi142.stdout:9/427: rmdir d0/d3c/d4d 39 2024-04-20T21:58:29.067 INFO:tasks.workunit.client.0.smithi142.stdout:4/334: dread - d1/d12/da/d1c/f3b zero size 2024-04-20T21:58:29.069 INFO:tasks.workunit.client.0.smithi142.stdout:4/335: stat d1/d6/c2b 0 2024-04-20T21:58:29.070 INFO:tasks.workunit.client.0.smithi142.stdout:4/336: readlink d1/d6/l9 0 2024-04-20T21:58:29.072 INFO:tasks.workunit.client.0.smithi142.stdout:2/413: creat d3/d9/d34/d51/d31/d84/f88 x:0 0 0 2024-04-20T21:58:29.073 INFO:tasks.workunit.client.0.smithi142.stdout:2/414: fdatasync d3/d5/f17 0 2024-04-20T21:58:29.074 INFO:tasks.workunit.client.0.smithi142.stdout:8/351: symlink d0/d29/l85 0 2024-04-20T21:58:29.077 INFO:tasks.workunit.client.0.smithi142.stdout:0/345: sync 2024-04-20T21:58:29.085 INFO:tasks.workunit.client.0.smithi142.stdout:5/271: rename dc/d14/d21/d46/d2a/d30/f3e to dc/f5a 0 2024-04-20T21:58:29.088 INFO:tasks.workunit.client.0.smithi142.stdout:9/428: write d0/d3c/d4d/d63/d80/f93 [38233,84573] 0 2024-04-20T21:58:29.088 INFO:tasks.workunit.client.0.smithi142.stdout:4/337: dwrite d1/d12/da/d1c/f61 [0,4194304] 0 2024-04-20T21:58:29.092 INFO:tasks.workunit.client.0.smithi142.stdout:8/352: fsync d0/d1c/f2d 0 2024-04-20T21:58:29.094 INFO:tasks.workunit.client.0.smithi142.stdout:0/346: fdatasync d5/d45/f47 0 2024-04-20T21:58:29.095 INFO:tasks.workunit.client.0.smithi142.stdout:3/361: mknod d6/d32/c76 0 2024-04-20T21:58:29.097 INFO:tasks.workunit.client.0.smithi142.stdout:4/338: truncate d1/d6/d4a/d5a/f5d 401502 0 2024-04-20T21:58:29.097 INFO:tasks.workunit.client.0.smithi142.stdout:3/362: fsync d6/f11 0 2024-04-20T21:58:29.109 INFO:tasks.workunit.client.0.smithi142.stdout:9/429: rename d0/d3c/d4d/c5f to d0/d3c/d4d/c94 0 2024-04-20T21:58:29.110 INFO:tasks.workunit.client.0.smithi142.stdout:9/430: chown d0/d2a/d39 0 1 2024-04-20T21:58:29.116 INFO:tasks.workunit.client.0.smithi142.stdout:0/347: dwrite d5/d1c/f71 [0,4194304] 0 2024-04-20T21:58:29.118 INFO:tasks.workunit.client.0.smithi142.stdout:4/339: creat d1/d6/d4b/f68 x:0 0 0 2024-04-20T21:58:29.132 INFO:tasks.workunit.client.0.smithi142.stdout:2/415: rename d3/d9/d34/d51 to d3/d9/d89 0 2024-04-20T21:58:29.134 INFO:tasks.workunit.client.0.smithi142.stdout:9/431: dwrite d0/d2a/f44 [0,4194304] 0 2024-04-20T21:58:29.136 INFO:tasks.workunit.client.0.smithi142.stdout:4/340: mknod d1/d6/d4b/c69 0 2024-04-20T21:58:29.143 INFO:tasks.workunit.client.0.smithi142.stdout:5/272: dwrite dc/f1d [0,4194304] 0 2024-04-20T21:58:29.144 INFO:tasks.workunit.client.0.smithi142.stdout:8/353: getdents d0/d29/d36 0 2024-04-20T21:58:29.145 INFO:tasks.workunit.client.0.smithi142.stdout:2/416: write d3/d5/d19/d70/d3c/d64/f85 [38612,12952] 0 2024-04-20T21:58:29.155 INFO:tasks.workunit.client.0.smithi142.stdout:3/363: rename d6/d15/d1e/d43/d4d/l5f to d6/d32/l77 0 2024-04-20T21:58:29.161 INFO:tasks.workunit.client.0.smithi142.stdout:2/417: creat d3/d5/d19/f8a x:0 0 0 2024-04-20T21:58:29.163 INFO:tasks.workunit.client.0.smithi142.stdout:2/418: chown d3/d9/d89/d31 12240 1 2024-04-20T21:58:29.173 INFO:tasks.workunit.client.0.smithi142.stdout:3/364: rename d6/d15/d47/f4a to d6/d32/d39/d69/f78 0 2024-04-20T21:58:29.174 INFO:tasks.workunit.client.0.smithi142.stdout:0/348: dwrite d5/d13/f2f [0,4194304] 0 2024-04-20T21:58:29.174 INFO:tasks.workunit.client.0.smithi142.stdout:8/354: dwrite d0/ff [0,4194304] 0 2024-04-20T21:58:29.181 INFO:tasks.workunit.client.0.smithi142.stdout:2/419: fsync d3/d5/f2a 0 2024-04-20T21:58:29.181 INFO:tasks.workunit.client.0.smithi142.stdout:8/355: readlink d0/d22/d3f/l7e 0 2024-04-20T21:58:29.182 INFO:tasks.workunit.client.0.smithi142.stdout:4/341: link d1/d6/fc d1/d6/d4a/d5a/f6a 0 2024-04-20T21:58:29.182 INFO:tasks.workunit.client.0.smithi142.stdout:3/365: read d6/fc [2455534,70888] 0 2024-04-20T21:58:29.183 INFO:tasks.workunit.client.0.smithi142.stdout:8/356: fdatasync d0/d22/f52 0 2024-04-20T21:58:29.191 INFO:tasks.workunit.client.0.smithi142.stdout:5/273: link dc/d14/d26/l4c dc/d14/d21/d46/d2a/d30/l5b 0 2024-04-20T21:58:29.197 INFO:tasks.workunit.client.0.smithi142.stdout:2/420: mkdir d3/d5/d19/d70/d3c/d66/d8b 0 2024-04-20T21:58:29.200 INFO:tasks.workunit.client.0.smithi142.stdout:8/357: truncate d0/d22/f52 618046 0 2024-04-20T21:58:29.213 INFO:tasks.workunit.client.0.smithi142.stdout:3/366: dwrite d6/d15/f5b [0,4194304] 0 2024-04-20T21:58:29.216 INFO:tasks.workunit.client.0.smithi142.stdout:9/432: dread d0/d3c/f46 [0,4194304] 0 2024-04-20T21:58:29.217 INFO:tasks.workunit.client.0.smithi142.stdout:9/433: stat d0/d2a/d39/c3b 0 2024-04-20T21:58:29.220 INFO:tasks.workunit.client.0.smithi142.stdout:6/305: sync 2024-04-20T21:58:29.227 INFO:tasks.workunit.client.0.smithi142.stdout:0/349: creat d5/d13/d1e/d23/d24/f79 x:0 0 0 2024-04-20T21:58:29.231 INFO:tasks.workunit.client.0.smithi142.stdout:8/358: dwrite d0/d17/d35/f3a [0,4194304] 0 2024-04-20T21:58:29.231 INFO:tasks.workunit.client.0.smithi142.stdout:4/342: truncate d1/d6/d30/d3f/f21 5504116 0 2024-04-20T21:58:29.356 INFO:tasks.workunit.client.0.smithi142.stdout:6/306: mkdir d1/d2f/d6c 0 2024-04-20T21:58:29.356 INFO:tasks.workunit.client.0.smithi142.stdout:0/350: symlink d5/d1d/l7a 0 2024-04-20T21:58:29.361 INFO:tasks.workunit.client.0.smithi142.stdout:4/343: creat d1/d12/da/d1c/d32/d3d/f6b x:0 0 0 2024-04-20T21:58:29.363 INFO:tasks.workunit.client.0.smithi142.stdout:3/367: link d6/d15/f5e d6/d15/d1e/d43/d4d/f79 0 2024-04-20T21:58:29.366 INFO:tasks.workunit.client.0.smithi142.stdout:0/351: symlink d5/d13/d1e/d23/d2c/l7b 0 2024-04-20T21:58:29.368 INFO:tasks.workunit.client.0.smithi142.stdout:4/344: unlink d1/d6/d4b/c59 0 2024-04-20T21:58:29.371 INFO:tasks.workunit.client.0.smithi142.stdout:4/345: readlink d1/d12/da/d1c/l51 0 2024-04-20T21:58:29.372 INFO:tasks.workunit.client.0.smithi142.stdout:3/368: creat d6/d15/d1e/d43/d4d/d6e/f7a x:0 0 0 2024-04-20T21:58:29.374 INFO:tasks.workunit.client.0.smithi142.stdout:4/346: chown d1/d6/d30/d3f/f67 3000541 1 2024-04-20T21:58:29.376 INFO:tasks.workunit.client.0.smithi142.stdout:4/347: readlink d1/d6/l4c 0 2024-04-20T21:58:29.377 INFO:tasks.workunit.client.0.smithi142.stdout:0/352: creat d5/d1c/d3c/d4a/f7c x:0 0 0 2024-04-20T21:58:29.381 INFO:tasks.workunit.client.0.smithi142.stdout:0/353: chown d5/d13/d1e/d23/d24/c3e 368878 1 2024-04-20T21:58:29.381 INFO:tasks.workunit.client.0.smithi142.stdout:8/359: dwrite d0/d17/f6d [0,4194304] 0 2024-04-20T21:58:29.384 INFO:tasks.workunit.client.0.smithi142.stdout:3/369: rename d6/d15/d30/d37/f38 to d6/d32/d39/f7b 0 2024-04-20T21:58:29.386 INFO:tasks.workunit.client.0.smithi142.stdout:0/354: read d5/d13/d1e/d23/d24/d48/d55/f74 [79744,1218] 0 2024-04-20T21:58:29.388 INFO:tasks.workunit.client.0.smithi142.stdout:8/360: creat d0/d29/d36/d45/d4c/f86 x:0 0 0 2024-04-20T21:58:29.388 INFO:tasks.workunit.client.0.smithi142.stdout:0/355: chown d5/ld 56615488 1 2024-04-20T21:58:29.391 INFO:tasks.workunit.client.0.smithi142.stdout:1/314: sync 2024-04-20T21:58:29.391 INFO:tasks.workunit.client.0.smithi142.stdout:7/368: sync 2024-04-20T21:58:29.392 INFO:tasks.workunit.client.0.smithi142.stdout:4/348: rename d1/d6/d4b/f68 to d1/d12/da/d1c/d32/d3d/f6c 0 2024-04-20T21:58:29.394 INFO:tasks.workunit.client.0.smithi142.stdout:3/370: creat d6/d15/d30/d37/d6c/f7c x:0 0 0 2024-04-20T21:58:29.397 INFO:tasks.workunit.client.0.smithi142.stdout:7/369: chown d4/d9/d11/d47/d5a/f76 49168982 1 2024-04-20T21:58:29.397 INFO:tasks.workunit.client.0.smithi142.stdout:6/307: dread d1/d2f/f4e [0,4194304] 0 2024-04-20T21:58:29.397 INFO:tasks.workunit.client.0.smithi142.stdout:3/371: chown d6/d15/d47 12210 1 2024-04-20T21:58:29.399 INFO:tasks.workunit.client.0.smithi142.stdout:8/361: rename d0/d17/f1f to d0/d5e/f87 0 2024-04-20T21:58:29.401 INFO:tasks.workunit.client.0.smithi142.stdout:4/349: write d1/d12/da/d1c/d32/f40 [270312,105338] 0 2024-04-20T21:58:29.405 INFO:tasks.workunit.client.0.smithi142.stdout:1/315: truncate d2/dd/fe 1938238 0 2024-04-20T21:58:29.409 INFO:tasks.workunit.client.0.smithi142.stdout:8/362: symlink d0/d1c/l88 0 2024-04-20T21:58:29.412 INFO:tasks.workunit.client.0.smithi142.stdout:4/350: unlink d1/d6/d30/d3f/f67 0 2024-04-20T21:58:29.414 INFO:tasks.workunit.client.0.smithi142.stdout:0/356: link d5/d1d/f4e d5/d13/f7d 0 2024-04-20T21:58:29.417 INFO:tasks.workunit.client.0.smithi142.stdout:1/316: symlink d2/dd/l6a 0 2024-04-20T21:58:29.428 INFO:tasks.workunit.client.0.smithi142.stdout:4/351: getdents d1/d6/d30/d4e 0 2024-04-20T21:58:29.428 INFO:tasks.workunit.client.0.smithi142.stdout:2/421: dwrite d3/f5a [0,4194304] 0 2024-04-20T21:58:29.429 INFO:tasks.workunit.client.0.smithi142.stdout:6/308: dread d1/d5/f26 [0,4194304] 0 2024-04-20T21:58:29.435 INFO:tasks.workunit.client.0.smithi142.stdout:2/422: rename d3/d9/cb to d3/d9/d89/c8c 0 2024-04-20T21:58:29.436 INFO:tasks.workunit.client.0.smithi142.stdout:3/372: dread d6/f8 [0,4194304] 0 2024-04-20T21:58:29.437 INFO:tasks.workunit.client.0.smithi142.stdout:2/423: chown d3/d9/f77 7 1 2024-04-20T21:58:29.438 INFO:tasks.workunit.client.0.smithi142.stdout:1/317: creat d2/dd/d17/d3b/f6b x:0 0 0 2024-04-20T21:58:29.442 INFO:tasks.workunit.client.0.smithi142.stdout:3/373: chown d6/d15/d1e/d43/d4d 11351 1 2024-04-20T21:58:29.446 INFO:tasks.workunit.client.0.smithi142.stdout:7/370: dread d4/d9/d1c/d5e/f34 [0,4194304] 0 2024-04-20T21:58:29.446 INFO:tasks.workunit.client.0.smithi142.stdout:6/309: dread d1/d5/f66 [0,4194304] 0 2024-04-20T21:58:29.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:29 smithi142 ceph-mon[15828]: pgmap v36: 65 pgs: 65 active+clean; 897 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 19 MiB/s rd, 111 MiB/s wr, 292 op/s 2024-04-20T21:58:29.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:29 smithi164 ceph-mon[23506]: pgmap v36: 65 pgs: 65 active+clean; 897 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 19 MiB/s rd, 111 MiB/s wr, 292 op/s 2024-04-20T21:58:29.451 INFO:tasks.workunit.client.0.smithi142.stdout:3/374: truncate d6/d15/d30/d37/d6c/f7c 46521 0 2024-04-20T21:58:29.452 INFO:tasks.workunit.client.0.smithi142.stdout:4/352: dwrite d1/d12/f66 [0,4194304] 0 2024-04-20T21:58:29.453 INFO:tasks.workunit.client.0.smithi142.stdout:6/310: symlink d1/d5/d3a/d43/d5c/l6d 0 2024-04-20T21:58:29.456 INFO:tasks.workunit.client.0.smithi142.stdout:6/311: write d1/d2f/d35/f47 [575154,130569] 0 2024-04-20T21:58:29.460 INFO:tasks.workunit.client.0.smithi142.stdout:1/318: rename d2/dd/d17/d1b/d22/d20/c36 to d2/dd/d17/d3b/d50/c6c 0 2024-04-20T21:58:29.462 INFO:tasks.workunit.client.0.smithi142.stdout:4/353: write d1/d12/da/f22 [2315942,42740] 0 2024-04-20T21:58:29.465 INFO:tasks.workunit.client.0.smithi142.stdout:3/375: creat d6/d15/d1e/d43/d4d/d59/f7d x:0 0 0 2024-04-20T21:58:29.467 INFO:tasks.workunit.client.0.smithi142.stdout:6/312: mknod d1/d2f/d35/d5b/d39/c6e 0 2024-04-20T21:58:29.470 INFO:tasks.workunit.client.0.smithi142.stdout:0/357: truncate d5/d1c/f71 1290098 0 2024-04-20T21:58:29.472 INFO:tasks.workunit.client.0.smithi142.stdout:1/319: creat d2/dd/d1c/d43/f6d x:0 0 0 2024-04-20T21:58:29.476 INFO:tasks.workunit.client.0.smithi142.stdout:3/376: unlink d6/d15/d1e/d43/d4d/f79 0 2024-04-20T21:58:29.478 INFO:tasks.workunit.client.0.smithi142.stdout:0/358: mkdir d5/d1d/d7e 0 2024-04-20T21:58:29.482 INFO:tasks.workunit.client.0.smithi142.stdout:3/377: mkdir d6/d15/d30/d37/d6c/d7e 0 2024-04-20T21:58:29.483 INFO:tasks.workunit.client.0.smithi142.stdout:2/424: truncate d3/d9/f83 527393 0 2024-04-20T21:58:29.485 INFO:tasks.workunit.client.0.smithi142.stdout:1/320: link d2/dd/d17/d1b/d22/d13/f35 d2/dd/d17/d1b/d22/d55/f6e 0 2024-04-20T21:58:29.486 INFO:tasks.workunit.client.0.smithi142.stdout:2/425: stat d3/d5/d19/d70/f43 0 2024-04-20T21:58:29.491 INFO:tasks.workunit.client.0.smithi142.stdout:3/378: unlink d6/f11 0 2024-04-20T21:58:29.497 INFO:tasks.workunit.client.0.smithi142.stdout:7/371: dread d4/d7d/f52 [0,4194304] 0 2024-04-20T21:58:29.497 INFO:tasks.workunit.client.0.smithi142.stdout:5/274: sync 2024-04-20T21:58:29.499 INFO:tasks.workunit.client.0.smithi142.stdout:2/426: mknod d3/d5/d19/d70/d3c/d66/d6c/c8d 0 2024-04-20T21:58:29.500 INFO:tasks.workunit.client.0.smithi142.stdout:0/359: link d5/d13/l2d d5/d45/l7f 0 2024-04-20T21:58:29.502 INFO:tasks.workunit.client.0.smithi142.stdout:4/354: write d1/d6/d4a/d5a/f5d [1015043,84339] 0 2024-04-20T21:58:29.503 INFO:tasks.workunit.client.0.smithi142.stdout:1/321: symlink d2/dd/d17/d1b/d22/l6f 0 2024-04-20T21:58:29.504 INFO:tasks.workunit.client.0.smithi142.stdout:0/360: truncate d5/d1c/d3c/f5a 700827 0 2024-04-20T21:58:29.506 INFO:tasks.workunit.client.0.smithi142.stdout:0/361: truncate d5/d1c/d3c/f73 759665 0 2024-04-20T21:58:29.514 INFO:tasks.workunit.client.0.smithi142.stdout:5/275: mkdir dc/d14/d21/d46/d2a/d30/d5c 0 2024-04-20T21:58:29.516 INFO:tasks.workunit.client.0.smithi142.stdout:2/427: dwrite d3/d9/d34/f56 [0,4194304] 0 2024-04-20T21:58:29.518 INFO:tasks.workunit.client.0.smithi142.stdout:2/428: chown d3/d9/d89/c18 5527435 1 2024-04-20T21:58:29.519 INFO:tasks.workunit.client.0.smithi142.stdout:1/322: mknod d2/d4e/c70 0 2024-04-20T21:58:29.519 INFO:tasks.workunit.client.0.smithi142.stdout:3/379: link d6/d15/d1e/c49 d6/d32/d39/d69/c7f 0 2024-04-20T21:58:29.521 INFO:tasks.workunit.client.0.smithi142.stdout:0/362: write d5/f9 [2170620,119080] 0 2024-04-20T21:58:29.525 INFO:tasks.workunit.client.0.smithi142.stdout:0/363: write d5/d1c/d3c/d4a/f7c [595987,77739] 0 2024-04-20T21:58:29.527 INFO:tasks.workunit.client.0.smithi142.stdout:1/323: creat d2/dd/d17/d1b/f71 x:0 0 0 2024-04-20T21:58:29.529 INFO:tasks.workunit.client.0.smithi142.stdout:3/380: rename d6/d15/d30/d37/f54 to d6/d15/d1e/f80 0 2024-04-20T21:58:29.532 INFO:tasks.workunit.client.0.smithi142.stdout:4/355: getdents d1/d6/d4b 0 2024-04-20T21:58:29.532 INFO:tasks.workunit.client.0.smithi142.stdout:1/324: creat d2/dd/d1c/d60/f72 x:0 0 0 2024-04-20T21:58:29.535 INFO:tasks.workunit.client.0.smithi142.stdout:0/364: rename d5/d13/d1e/d23/d46/l5e to d5/d6d/l80 0 2024-04-20T21:58:29.536 INFO:tasks.workunit.client.0.smithi142.stdout:5/276: link dc/d14/d26/d3f/l56 dc/d14/d21/d46/d2a/d30/d5c/l5d 0 2024-04-20T21:58:29.536 INFO:tasks.workunit.client.0.smithi142.stdout:0/365: fsync d5/f17 0 2024-04-20T21:58:29.537 INFO:tasks.workunit.client.0.smithi142.stdout:1/325: truncate d2/dd/d17/d1b/d22/d13/f63 829508 0 2024-04-20T21:58:29.541 INFO:tasks.workunit.client.0.smithi142.stdout:4/356: chown d1/d12/c36 11028789 1 2024-04-20T21:58:29.546 INFO:tasks.workunit.client.0.smithi142.stdout:5/277: creat dc/d14/d21/d46/d2a/d30/f5e x:0 0 0 2024-04-20T21:58:29.548 INFO:tasks.workunit.client.0.smithi142.stdout:5/278: write dc/f2f [4395933,20686] 0 2024-04-20T21:58:29.549 INFO:tasks.workunit.client.0.smithi142.stdout:3/381: link d6/d15/d30/f40 d6/d32/d39/f81 0 2024-04-20T21:58:29.550 INFO:tasks.workunit.client.0.smithi142.stdout:2/429: write d3/d5/d19/f79 [1935459,34501] 0 2024-04-20T21:58:29.554 INFO:tasks.workunit.client.0.smithi142.stdout:1/326: mknod d2/dd/d17/d1b/c73 0 2024-04-20T21:58:29.556 INFO:tasks.workunit.client.0.smithi142.stdout:4/357: mkdir d1/d12/da/d1c/d32/d3d/d2f/d52/d6d 0 2024-04-20T21:58:29.562 INFO:tasks.workunit.client.0.smithi142.stdout:3/382: rename d6/d15/d30/d37/l6b to d6/d32/d39/d69/l82 0 2024-04-20T21:58:29.569 INFO:tasks.workunit.client.0.smithi142.stdout:0/366: write d5/d13/f7d [2614802,56307] 0 2024-04-20T21:58:29.571 INFO:tasks.workunit.client.0.smithi142.stdout:5/279: dwrite dc/d14/f1a [4194304,4194304] 0 2024-04-20T21:58:29.573 INFO:tasks.workunit.client.0.smithi142.stdout:0/367: write d5/d13/d1e/d23/f39 [651602,119036] 0 2024-04-20T21:58:29.575 INFO:tasks.workunit.client.0.smithi142.stdout:1/327: dread d2/dd/d17/f47 [0,4194304] 0 2024-04-20T21:58:29.580 INFO:tasks.workunit.client.0.smithi142.stdout:3/383: write d6/f10 [670489,75062] 0 2024-04-20T21:58:29.580 INFO:tasks.workunit.client.0.smithi142.stdout:5/280: truncate dc/d14/d25/f3a 1203396 0 2024-04-20T21:58:29.580 INFO:tasks.workunit.client.0.smithi142.stdout:1/328: fdatasync d2/d4e/f64 0 2024-04-20T21:58:29.580 INFO:tasks.workunit.client.0.smithi142.stdout:0/368: chown d5/d1c/d29/f4f 19 1 2024-04-20T21:58:29.586 INFO:tasks.workunit.client.0.smithi142.stdout:3/384: mkdir d6/d15/d47/d83 0 2024-04-20T21:58:29.587 INFO:tasks.workunit.client.0.smithi142.stdout:0/369: write d5/d13/f7d [1500494,15525] 0 2024-04-20T21:58:29.587 INFO:tasks.workunit.client.0.smithi142.stdout:5/281: chown dc/d14/c35 7074 1 2024-04-20T21:58:29.591 INFO:tasks.workunit.client.0.smithi142.stdout:1/329: write d2/dd/d1c/f3f [470609,56078] 0 2024-04-20T21:58:29.594 INFO:tasks.workunit.client.0.smithi142.stdout:0/370: creat d5/d45/d6f/f81 x:0 0 0 2024-04-20T21:58:29.595 INFO:tasks.workunit.client.0.smithi142.stdout:3/385: mknod d6/c84 0 2024-04-20T21:58:29.596 INFO:tasks.workunit.client.0.smithi142.stdout:2/430: dwrite d3/d5/d19/d70/d3c/d64/f81 [0,4194304] 0 2024-04-20T21:58:29.599 INFO:tasks.workunit.client.0.smithi142.stdout:4/358: dread d1/d6/f1f [0,4194304] 0 2024-04-20T21:58:29.600 INFO:tasks.workunit.client.0.smithi142.stdout:5/282: mknod dc/d14/d21/d46/d2a/d57/c5f 0 2024-04-20T21:58:29.601 INFO:tasks.workunit.client.0.smithi142.stdout:1/330: fdatasync d2/dd/d17/d1b/d22/d20/f4c 0 2024-04-20T21:58:29.606 INFO:tasks.workunit.client.0.smithi142.stdout:5/283: write dc/d14/f1a [6197553,80462] 0 2024-04-20T21:58:29.606 INFO:tasks.workunit.client.0.smithi142.stdout:3/386: creat d6/d32/d39/d69/f85 x:0 0 0 2024-04-20T21:58:29.616 INFO:tasks.workunit.client.0.smithi142.stdout:2/431: link d3/d5/d19/l4f d3/d9/d69/l8e 0 2024-04-20T21:58:29.620 INFO:tasks.workunit.client.0.smithi142.stdout:3/387: creat d6/d15/d1e/d43/d4d/d59/f86 x:0 0 0 2024-04-20T21:58:29.622 INFO:tasks.workunit.client.0.smithi142.stdout:0/371: dread d5/d1c/d29/d38/f42 [0,4194304] 0 2024-04-20T21:58:29.623 INFO:tasks.workunit.client.0.smithi142.stdout:0/372: stat d5/d45 0 2024-04-20T21:58:29.627 INFO:tasks.workunit.client.0.smithi142.stdout:1/331: mkdir d2/dd/d17/d3b/d74 0 2024-04-20T21:58:29.630 INFO:tasks.workunit.client.0.smithi142.stdout:2/432: rename d3/d5/f2a to d3/d5/d74/f8f 0 2024-04-20T21:58:29.631 INFO:tasks.workunit.client.0.smithi142.stdout:3/388: chown d6/d32/l77 842808 1 2024-04-20T21:58:29.635 INFO:tasks.workunit.client.0.smithi142.stdout:9/434: sync 2024-04-20T21:58:29.638 INFO:tasks.workunit.client.0.smithi142.stdout:3/389: creat d6/d15/d1e/f87 x:0 0 0 2024-04-20T21:58:29.639 INFO:tasks.workunit.client.0.smithi142.stdout:1/332: mknod d2/dd/d17/d3b/c75 0 2024-04-20T21:58:29.639 INFO:tasks.workunit.client.0.smithi142.stdout:5/284: truncate dc/f1d 1083839 0 2024-04-20T21:58:29.640 INFO:tasks.workunit.client.0.smithi142.stdout:9/435: truncate d0/d36/f4c 538064 0 2024-04-20T21:58:29.643 INFO:tasks.workunit.client.0.smithi142.stdout:1/333: chown d2/dd/d1c/d60/f72 69113 1 2024-04-20T21:58:29.647 INFO:tasks.workunit.client.0.smithi142.stdout:4/359: dwrite d1/d12/da/d1c/f26 [0,4194304] 0 2024-04-20T21:58:29.650 INFO:tasks.workunit.client.0.smithi142.stdout:2/433: write d3/d5/d19/d70/f5f [2680197,26363] 0 2024-04-20T21:58:29.651 INFO:tasks.workunit.client.0.smithi142.stdout:1/334: creat d2/dd/d1c/d43/f76 x:0 0 0 2024-04-20T21:58:29.653 INFO:tasks.workunit.client.0.smithi142.stdout:9/436: mkdir d0/d89/d95 0 2024-04-20T21:58:29.653 INFO:tasks.workunit.client.0.smithi142.stdout:5/285: mkdir dc/d14/d21/d46/d58/d60 0 2024-04-20T21:58:29.655 INFO:tasks.workunit.client.0.smithi142.stdout:5/286: stat dc/d14/f1a 0 2024-04-20T21:58:29.658 INFO:tasks.workunit.client.0.smithi142.stdout:3/390: link d6/d32/d39/d69/c7f d6/d32/c88 0 2024-04-20T21:58:29.658 INFO:tasks.workunit.client.0.smithi142.stdout:5/287: read dc/f2b [558359,83743] 0 2024-04-20T21:58:29.659 INFO:tasks.workunit.client.0.smithi142.stdout:1/335: symlink d2/dd/d17/d1b/d22/d55/l77 0 2024-04-20T21:58:29.661 INFO:tasks.workunit.client.0.smithi142.stdout:9/437: mknod d0/d3c/d4d/c96 0 2024-04-20T21:58:29.665 INFO:tasks.workunit.client.0.smithi142.stdout:3/391: creat d6/d15/d1e/f89 x:0 0 0 2024-04-20T21:58:29.673 INFO:tasks.workunit.client.0.smithi142.stdout:9/438: link d0/f9 d0/d91/f97 0 2024-04-20T21:58:29.674 INFO:tasks.workunit.client.0.smithi142.stdout:5/288: getdents dc/d14/d21/d46/d2a/d30 0 2024-04-20T21:58:29.677 INFO:tasks.workunit.client.0.smithi142.stdout:4/360: dwrite d1/d6/f2d [0,4194304] 0 2024-04-20T21:58:29.678 INFO:tasks.workunit.client.0.smithi142.stdout:2/434: dwrite d3/d5/d19/f86 [0,4194304] 0 2024-04-20T21:58:29.686 INFO:tasks.workunit.client.0.smithi142.stdout:9/439: rename d0/d2a/f40 to d0/d2a/d39/f98 0 2024-04-20T21:58:29.690 INFO:tasks.workunit.client.0.smithi142.stdout:1/336: dwrite d2/dd/d1c/f3f [0,4194304] 0 2024-04-20T21:58:29.694 INFO:tasks.workunit.client.0.smithi142.stdout:2/435: creat d3/d5/d19/d70/d3c/d66/f90 x:0 0 0 2024-04-20T21:58:29.694 INFO:tasks.workunit.client.0.smithi142.stdout:1/337: readlink d2/dd/d17/d1b/d22/d13/l2b 0 2024-04-20T21:58:29.697 INFO:tasks.workunit.client.0.smithi142.stdout:1/338: chown d2/dd/d17/l3d 252171050 1 2024-04-20T21:58:29.701 INFO:tasks.workunit.client.0.smithi142.stdout:9/440: mknod d0/d36/d55/c99 0 2024-04-20T21:58:29.703 INFO:tasks.workunit.client.0.smithi142.stdout:4/361: dwrite d1/d12/da/d1c/d32/f40 [0,4194304] 0 2024-04-20T21:58:29.704 INFO:tasks.workunit.client.0.smithi142.stdout:2/436: rename d3/d5/d19/d70/d3c/l61 to d3/d5/l91 0 2024-04-20T21:58:29.706 INFO:tasks.workunit.client.0.smithi142.stdout:1/339: truncate d2/dd/d1c/f69 206354 0 2024-04-20T21:58:29.707 INFO:tasks.workunit.client.0.smithi142.stdout:4/362: fsync d1/d6/d30/d3f/f64 0 2024-04-20T21:58:29.712 INFO:tasks.workunit.client.0.smithi142.stdout:9/441: rename d0/d2a/c33 to d0/d2a/d39/c9a 0 2024-04-20T21:58:29.717 INFO:tasks.workunit.client.0.smithi142.stdout:5/289: truncate dc/d14/f1e 199315 0 2024-04-20T21:58:29.717 INFO:tasks.workunit.client.0.smithi142.stdout:4/363: fdatasync d1/d12/da/f18 0 2024-04-20T21:58:29.720 INFO:tasks.workunit.client.0.smithi142.stdout:1/340: read d2/f7 [130611,111886] 0 2024-04-20T21:58:29.722 INFO:tasks.workunit.client.0.smithi142.stdout:9/442: link d0/d2a/d39/f98 d0/d3c/d4d/f9b 0 2024-04-20T21:58:29.724 INFO:tasks.workunit.client.0.smithi142.stdout:1/341: rmdir d2/d4e 39 2024-04-20T21:58:29.724 INFO:tasks.workunit.client.0.smithi142.stdout:9/443: stat d0/d2a/d39 0 2024-04-20T21:58:29.726 INFO:tasks.workunit.client.0.smithi142.stdout:9/444: readlink d0/d36/l48 0 2024-04-20T21:58:29.727 INFO:tasks.workunit.client.0.smithi142.stdout:5/290: link f2 dc/d14/d21/d46/d2a/d3c/f61 0 2024-04-20T21:58:29.730 INFO:tasks.workunit.client.0.smithi142.stdout:2/437: dwrite d3/d9/d34/f3b [0,4194304] 0 2024-04-20T21:58:29.731 INFO:tasks.workunit.client.0.smithi142.stdout:9/445: write d0/f14 [945927,61335] 0 2024-04-20T21:58:29.737 INFO:tasks.workunit.client.0.smithi142.stdout:9/446: mkdir d0/d2a/d9c 0 2024-04-20T21:58:29.739 INFO:tasks.workunit.client.0.smithi142.stdout:5/291: creat dc/d14/f62 x:0 0 0 2024-04-20T21:58:29.753 INFO:tasks.workunit.client.0.smithi142.stdout:6/313: sync 2024-04-20T21:58:29.753 INFO:tasks.workunit.client.0.smithi142.stdout:8/363: sync 2024-04-20T21:58:29.753 INFO:tasks.workunit.client.0.smithi142.stdout:7/372: sync 2024-04-20T21:58:29.753 INFO:tasks.workunit.client.0.smithi142.stdout:9/447: mknod d0/d2a/d9c/c9d 0 2024-04-20T21:58:29.754 INFO:tasks.workunit.client.0.smithi142.stdout:4/364: truncate d1/d6/fc 2471654 0 2024-04-20T21:58:29.760 INFO:tasks.workunit.client.0.smithi142.stdout:7/373: stat d4/d9/d11/d47/d5a/c71 0 2024-04-20T21:58:29.772 INFO:tasks.workunit.client.0.smithi142.stdout:2/438: getdents d3/d5/d19/d70/d3c/d66/d6c 0 2024-04-20T21:58:29.775 INFO:tasks.workunit.client.0.smithi142.stdout:6/314: dwrite d1/d5/f3d [0,4194304] 0 2024-04-20T21:58:29.775 INFO:tasks.workunit.client.0.smithi142.stdout:7/374: unlink d4/d9/d1c/d5e/f2c 0 2024-04-20T21:58:29.781 INFO:tasks.workunit.client.0.smithi142.stdout:4/365: mknod d1/d6/c6e 0 2024-04-20T21:58:29.782 INFO:tasks.workunit.client.0.smithi142.stdout:2/439: creat d3/d9/d89/d31/f92 x:0 0 0 2024-04-20T21:58:29.783 INFO:tasks.workunit.client.0.smithi142.stdout:9/448: dwrite d0/d36/f4c [0,4194304] 0 2024-04-20T21:58:29.783 INFO:tasks.workunit.client.0.smithi142.stdout:1/342: dread d2/dd/d17/d1b/f3c [0,4194304] 0 2024-04-20T21:58:29.794 INFO:tasks.workunit.client.0.smithi142.stdout:7/375: mknod d4/d9/d11/d22/c89 0 2024-04-20T21:58:29.795 INFO:tasks.workunit.client.0.smithi142.stdout:7/376: chown d4/d9/d1c/d5e 51 1 2024-04-20T21:58:29.801 INFO:tasks.workunit.client.0.smithi142.stdout:4/366: symlink d1/d12/da/d1c/l6f 0 2024-04-20T21:58:29.802 INFO:tasks.workunit.client.0.smithi142.stdout:2/440: symlink d3/d5/d19/d70/l93 0 2024-04-20T21:58:29.808 INFO:tasks.workunit.client.0.smithi142.stdout:8/364: dwrite d0/d17/f3b [0,4194304] 0 2024-04-20T21:58:29.810 INFO:tasks.workunit.client.0.smithi142.stdout:1/343: creat d2/dd/d17/d3b/f78 x:0 0 0 2024-04-20T21:58:29.813 INFO:tasks.workunit.client.0.smithi142.stdout:9/449: getdents d0/d36 0 2024-04-20T21:58:29.816 INFO:tasks.workunit.client.0.smithi142.stdout:4/367: write d1/d6/d4a/d5a/f56 [485837,23333] 0 2024-04-20T21:58:29.823 INFO:tasks.workunit.client.0.smithi142.stdout:6/315: dwrite d1/d5/f12 [4194304,4194304] 0 2024-04-20T21:58:29.824 INFO:tasks.workunit.client.0.smithi142.stdout:8/365: write d0/d29/f37 [402095,78595] 0 2024-04-20T21:58:29.825 INFO:tasks.workunit.client.0.smithi142.stdout:4/368: fdatasync d1/d12/da/d1c/d32/f60 0 2024-04-20T21:58:29.828 INFO:tasks.workunit.client.0.smithi142.stdout:7/377: dwrite d4/d9/f79 [0,4194304] 0 2024-04-20T21:58:29.834 INFO:tasks.workunit.client.0.smithi142.stdout:7/378: fdatasync d4/d9/d1c/d5e/f55 0 2024-04-20T21:58:29.837 INFO:tasks.workunit.client.0.smithi142.stdout:7/379: fsync d4/d9/d1c/d5e/d64/f7c 0 2024-04-20T21:58:29.839 INFO:tasks.workunit.client.0.smithi142.stdout:2/441: dread d3/d5/d74/f8f [0,4194304] 0 2024-04-20T21:58:29.839 INFO:tasks.workunit.client.0.smithi142.stdout:1/344: getdents d2/dd/d17/d1b 0 2024-04-20T21:58:29.844 INFO:tasks.workunit.client.0.smithi142.stdout:4/369: symlink d1/d5b/l70 0 2024-04-20T21:58:29.846 INFO:tasks.workunit.client.0.smithi142.stdout:9/450: dread d0/f25 [0,4194304] 0 2024-04-20T21:58:29.846 INFO:tasks.workunit.client.0.smithi142.stdout:7/380: write d4/d9/d11/d22/f3a [7346719,129889] 0 2024-04-20T21:58:29.849 INFO:tasks.workunit.client.0.smithi142.stdout:9/451: chown d0/d3c/d4d/c96 0 1 2024-04-20T21:58:29.849 INFO:tasks.workunit.client.0.smithi142.stdout:7/381: stat d4/d9/d11/d47/d5a/c67 0 2024-04-20T21:58:29.850 INFO:tasks.workunit.client.0.smithi142.stdout:1/345: rename d2/dd/d17/d1b/d22/l6f to d2/dd/d17/d1b/l79 0 2024-04-20T21:58:29.851 INFO:tasks.workunit.client.0.smithi142.stdout:7/382: readlink d4/d9/d11/d22/l4e 0 2024-04-20T21:58:29.857 INFO:tasks.workunit.client.0.smithi142.stdout:8/366: truncate d0/d17/f3b 2499201 0 2024-04-20T21:58:29.868 INFO:tasks.workunit.client.0.smithi142.stdout:1/346: dread d2/dd/d17/d1b/d22/f56 [0,4194304] 0 2024-04-20T21:58:29.869 INFO:tasks.workunit.client.0.smithi142.stdout:2/442: write d3/d5/d19/d70/f3f [331604,13672] 0 2024-04-20T21:58:29.869 INFO:tasks.workunit.client.0.smithi142.stdout:4/370: rmdir d1/d12/da/d1c/d32/d50 0 2024-04-20T21:58:29.872 INFO:tasks.workunit.client.0.smithi142.stdout:6/316: dread d1/d1b/f51 [0,4194304] 0 2024-04-20T21:58:29.873 INFO:tasks.workunit.client.0.smithi142.stdout:6/317: chown d1/d1b 6097 1 2024-04-20T21:58:29.876 INFO:tasks.workunit.client.0.smithi142.stdout:6/318: truncate d1/d11/ff 353303 0 2024-04-20T21:58:29.876 INFO:tasks.workunit.client.0.smithi142.stdout:8/367: dwrite d0/f26 [0,4194304] 0 2024-04-20T21:58:29.877 INFO:tasks.workunit.client.0.smithi142.stdout:8/368: write d0/d22/f39 [17919,89796] 0 2024-04-20T21:58:29.879 INFO:tasks.workunit.client.0.smithi142.stdout:6/319: write d1/d5/f12 [138017,121648] 0 2024-04-20T21:58:29.914 INFO:tasks.workunit.client.0.smithi142.stdout:4/371: creat d1/d6/d4a/f71 x:0 0 0 2024-04-20T21:58:29.916 INFO:tasks.workunit.client.0.smithi142.stdout:2/443: rename d3/d5/d19/d70/d3c/d66/d8b to d3/d5/d19/d94 0 2024-04-20T21:58:29.922 INFO:tasks.workunit.client.0.smithi142.stdout:2/444: read d3/d5/d19/d70/d3c/f38 [3306990,54768] 0 2024-04-20T21:58:29.924 INFO:tasks.workunit.client.0.smithi142.stdout:9/452: getdents d0/d36/d55 0 2024-04-20T21:58:29.927 INFO:tasks.workunit.client.0.smithi142.stdout:9/453: dread - d0/d3c/d4d/d63/f65 zero size 2024-04-20T21:58:29.930 INFO:tasks.workunit.client.0.smithi142.stdout:8/369: rename d0/d29/d36 to d0/d1c/d44/d89 0 2024-04-20T21:58:29.933 INFO:tasks.workunit.client.0.smithi142.stdout:9/454: rmdir d0/d3c/d4d/d63/d80 39 2024-04-20T21:58:29.935 INFO:tasks.workunit.client.0.smithi142.stdout:2/445: dread d3/d9/d34/f3b [0,4194304] 0 2024-04-20T21:58:29.937 INFO:tasks.workunit.client.0.smithi142.stdout:2/446: chown d3/d5/d19/d70/d3c/d64/f81 1578 1 2024-04-20T21:58:29.938 INFO:tasks.workunit.client.0.smithi142.stdout:2/447: stat d3/d5/d19/f86 0 2024-04-20T21:58:29.942 INFO:tasks.workunit.client.0.smithi142.stdout:6/320: getdents d1/d2f/d35/d5b/d63 0 2024-04-20T21:58:29.945 INFO:tasks.workunit.client.0.smithi142.stdout:8/370: rmdir d0/d1c/d44/d89/d45/d7c 0 2024-04-20T21:58:29.951 INFO:tasks.workunit.client.0.smithi142.stdout:8/371: mknod d0/d1c/d44/d89/c8a 0 2024-04-20T21:58:29.957 INFO:tasks.workunit.client.0.smithi142.stdout:6/321: creat d1/d2f/d35/d5b/f6f x:0 0 0 2024-04-20T21:58:29.960 INFO:tasks.workunit.client.0.smithi142.stdout:6/322: read d1/d2f/d35/f36 [275881,30398] 0 2024-04-20T21:58:29.962 INFO:tasks.workunit.client.0.smithi142.stdout:9/455: dread d0/f21 [0,4194304] 0 2024-04-20T21:58:29.962 INFO:tasks.workunit.client.0.smithi142.stdout:6/323: write d1/d5/d3a/f45 [400602,40999] 0 2024-04-20T21:58:29.968 INFO:tasks.workunit.client.0.smithi142.stdout:2/448: getdents d3/d9/d89/d31 0 2024-04-20T21:58:29.969 INFO:tasks.workunit.client.0.smithi142.stdout:9/456: mkdir d0/d2a/d39/d87/d9e 0 2024-04-20T21:58:29.976 INFO:tasks.workunit.client.0.smithi142.stdout:2/449: creat d3/d5/d19/d70/f95 x:0 0 0 2024-04-20T21:58:29.979 INFO:tasks.workunit.client.0.smithi142.stdout:7/383: truncate d4/d9/f69 286372 0 2024-04-20T21:58:29.981 INFO:tasks.workunit.client.0.smithi142.stdout:8/372: dwrite d0/d5e/f81 [0,4194304] 0 2024-04-20T21:58:29.986 INFO:tasks.workunit.client.0.smithi142.stdout:6/324: dwrite d1/d11/f44 [0,4194304] 0 2024-04-20T21:58:29.989 INFO:tasks.workunit.client.0.smithi142.stdout:6/325: fsync d1/d11/f59 0 2024-04-20T21:58:29.996 INFO:tasks.workunit.client.0.smithi142.stdout:6/326: chown d1/d2f/d35/d5b/c29 139 1 2024-04-20T21:58:30.007 INFO:tasks.workunit.client.0.smithi142.stdout:2/450: dwrite d3/d9/d89/f2d [0,4194304] 0 2024-04-20T21:58:30.008 INFO:tasks.workunit.client.0.smithi142.stdout:9/457: dwrite d0/d3c/d4d/d63/d80/f93 [0,4194304] 0 2024-04-20T21:58:30.014 INFO:tasks.workunit.client.0.smithi142.stdout:9/458: chown d0/d3c/d4d/f67 969602315 1 2024-04-20T21:58:30.015 INFO:tasks.workunit.client.0.smithi142.stdout:6/327: mkdir d1/d2f/d35/d5b/d70 0 2024-04-20T21:58:30.024 INFO:tasks.workunit.client.0.smithi142.stdout:1/347: symlink d2/l7a 0 2024-04-20T21:58:30.026 INFO:tasks.workunit.client.0.smithi142.stdout:1/348: readlink d2/dd/d17/d1b/l34 0 2024-04-20T21:58:30.027 INFO:tasks.workunit.client.0.smithi142.stdout:0/373: sync 2024-04-20T21:58:30.028 INFO:tasks.workunit.client.0.smithi142.stdout:6/328: unlink d1/d2f/d35/d5b/d3e/f5f 0 2024-04-20T21:58:30.030 INFO:tasks.workunit.client.0.smithi142.stdout:7/384: rmdir d4/d9/d11 39 2024-04-20T21:58:30.031 INFO:tasks.workunit.client.0.smithi142.stdout:2/451: dwrite d3/d9/f77 [0,4194304] 0 2024-04-20T21:58:30.035 INFO:tasks.workunit.client.0.smithi142.stdout:6/329: mkdir d1/d11/d71 0 2024-04-20T21:58:30.037 INFO:tasks.workunit.client.0.smithi142.stdout:2/452: write d3/d5/d19/d70/f95 [894626,116638] 0 2024-04-20T21:58:30.040 INFO:tasks.workunit.client.0.smithi142.stdout:6/330: write d1/d5/d3a/f42 [674526,130836] 0 2024-04-20T21:58:30.040 INFO:tasks.workunit.client.0.smithi142.stdout:0/374: creat d5/d1c/d29/d63/f82 x:0 0 0 2024-04-20T21:58:30.043 INFO:tasks.workunit.client.0.smithi142.stdout:1/349: creat d2/dd/d17/d1b/d22/d20/f7b x:0 0 0 2024-04-20T21:58:30.044 INFO:tasks.workunit.client.0.smithi142.stdout:9/459: mknod d0/d2a/c9f 0 2024-04-20T21:58:30.045 INFO:tasks.workunit.client.0.smithi142.stdout:6/331: fsync d1/d2f/d35/f47 0 2024-04-20T21:58:30.047 INFO:tasks.workunit.client.0.smithi142.stdout:6/332: fsync d1/f49 0 2024-04-20T21:58:30.050 INFO:tasks.workunit.client.0.smithi142.stdout:1/350: chown d2/dd/d17/l32 3 1 2024-04-20T21:58:30.050 INFO:tasks.workunit.client.0.smithi142.stdout:9/460: fsync d0/d36/f4c 0 2024-04-20T21:58:30.053 INFO:tasks.workunit.client.0.smithi142.stdout:6/333: write d1/d5/f12 [4779153,91499] 0 2024-04-20T21:58:30.057 INFO:tasks.workunit.client.0.smithi142.stdout:2/453: dread d3/d5/d19/d70/d3c/f36 [4194304,4194304] 0 2024-04-20T21:58:30.066 INFO:tasks.workunit.client.0.smithi142.stdout:6/334: symlink d1/d1b/l72 0 2024-04-20T21:58:30.068 INFO:tasks.workunit.client.0.smithi142.stdout:1/351: fdatasync d2/f45 0 2024-04-20T21:58:30.070 INFO:tasks.workunit.client.0.smithi142.stdout:1/352: write d2/dd/d17/d3b/f78 [734387,58164] 0 2024-04-20T21:58:30.071 INFO:tasks.workunit.client.0.smithi142.stdout:9/461: mkdir d0/d91/da0 0 2024-04-20T21:58:30.077 INFO:tasks.workunit.client.0.smithi142.stdout:6/335: creat d1/d2f/d35/d48/f73 x:0 0 0 2024-04-20T21:58:30.078 INFO:tasks.workunit.client.0.smithi142.stdout:9/462: rmdir d0/d3c/d4d 39 2024-04-20T21:58:30.080 INFO:tasks.workunit.client.0.smithi142.stdout:9/463: write d0/fc [827451,18854] 0 2024-04-20T21:58:30.088 INFO:tasks.workunit.client.0.smithi142.stdout:1/353: dwrite d2/dd/d1c/d43/f6d [0,4194304] 0 2024-04-20T21:58:30.089 INFO:tasks.workunit.client.0.smithi142.stdout:9/464: truncate d0/d2a/d39/f6d 4012471 0 2024-04-20T21:58:30.093 INFO:tasks.workunit.client.0.smithi142.stdout:9/465: chown d0/d2a/d39/d87/f8d 123050 1 2024-04-20T21:58:30.094 INFO:tasks.workunit.client.0.smithi142.stdout:1/354: mkdir d2/dd/d1c/d43/d7c 0 2024-04-20T21:58:30.094 INFO:tasks.workunit.client.0.smithi142.stdout:9/466: chown d0/d3c/f46 12590 1 2024-04-20T21:58:30.099 INFO:tasks.workunit.client.0.smithi142.stdout:9/467: write d0/d3c/f5a [675679,9997] 0 2024-04-20T21:58:30.099 INFO:tasks.workunit.client.0.smithi142.stdout:6/336: dwrite d1/d2f/d35/d5b/d39/f52 [4194304,4194304] 0 2024-04-20T21:58:30.100 INFO:tasks.workunit.client.0.smithi142.stdout:1/355: truncate d2/dd/d17/d1b/d22/f2f 4736384 0 2024-04-20T21:58:30.102 INFO:tasks.workunit.client.0.smithi142.stdout:9/468: chown d0/d2a/c9f 3938520 1 2024-04-20T21:58:30.111 INFO:tasks.workunit.client.0.smithi142.stdout:9/469: truncate d0/d2a/d39/d50/f68 282497 0 2024-04-20T21:58:30.113 INFO:tasks.workunit.client.0.smithi142.stdout:6/337: dread d1/d1b/f1e [0,4194304] 0 2024-04-20T21:58:30.115 INFO:tasks.workunit.client.0.smithi142.stdout:7/385: dwrite d4/d7f/f60 [0,4194304] 0 2024-04-20T21:58:30.126 INFO:tasks.workunit.client.0.smithi142.stdout:9/470: read d0/f23 [240915,53435] 0 2024-04-20T21:58:30.127 INFO:tasks.workunit.client.0.smithi142.stdout:6/338: write d1/d2f/d35/d5b/d63/d34/f4c [267435,117026] 0 2024-04-20T21:58:30.128 INFO:tasks.workunit.client.0.smithi142.stdout:9/471: stat d0/d36/c49 0 2024-04-20T21:58:30.129 INFO:tasks.workunit.client.0.smithi142.stdout:9/472: chown d0/d2a/c38 97855 1 2024-04-20T21:58:30.130 INFO:tasks.workunit.client.0.smithi142.stdout:6/339: chown d1/d5/d3a/f42 481275 1 2024-04-20T21:58:30.140 INFO:tasks.workunit.client.0.smithi142.stdout:0/375: truncate d5/d1c/d29/d38/f42 2029235 0 2024-04-20T21:58:30.141 INFO:tasks.workunit.client.0.smithi142.stdout:7/386: creat d4/d7f/d77/d78/f8a x:0 0 0 2024-04-20T21:58:30.146 INFO:tasks.workunit.client.0.smithi142.stdout:1/356: link d2/dd/d17/d1b/d22/d13/c25 d2/dd/d17/d3b/d50/d62/c7d 0 2024-04-20T21:58:30.152 INFO:tasks.workunit.client.0.smithi142.stdout:9/473: unlink d0/c3a 0 2024-04-20T21:58:30.158 INFO:tasks.workunit.client.0.smithi142.stdout:6/340: dwrite d1/d1b/f51 [4194304,4194304] 0 2024-04-20T21:58:30.160 INFO:tasks.workunit.client.0.smithi142.stdout:6/341: chown d1/d5/d3a 18 1 2024-04-20T21:58:30.160 INFO:tasks.workunit.client.0.smithi142.stdout:1/357: getdents d2/dd/d1c/d43/d7c 0 2024-04-20T21:58:30.163 INFO:tasks.workunit.client.0.smithi142.stdout:6/342: write d1/d5/f12 [5015465,123725] 0 2024-04-20T21:58:30.165 INFO:tasks.workunit.client.0.smithi142.stdout:6/343: stat d1/d5/f3c 0 2024-04-20T21:58:30.167 INFO:tasks.workunit.client.0.smithi142.stdout:7/387: creat d4/d9/d11/d22/d88/f8b x:0 0 0 2024-04-20T21:58:30.168 INFO:tasks.workunit.client.0.smithi142.stdout:6/344: truncate d1/d11/f59 502602 0 2024-04-20T21:58:30.175 INFO:tasks.workunit.client.0.smithi142.stdout:9/474: mknod d0/d2a/d8b/ca1 0 2024-04-20T21:58:30.177 INFO:tasks.workunit.client.0.smithi142.stdout:9/475: stat d0/d36/f4c 0 2024-04-20T21:58:30.179 INFO:tasks.workunit.client.0.smithi142.stdout:0/376: getdents d5/d1c/d29/d38 0 2024-04-20T21:58:30.182 INFO:tasks.workunit.client.0.smithi142.stdout:6/345: unlink d1/d2f/l60 0 2024-04-20T21:58:30.184 INFO:tasks.workunit.client.0.smithi142.stdout:1/358: mkdir d2/d4e/d7e 0 2024-04-20T21:58:30.184 INFO:tasks.workunit.client.0.smithi142.stdout:7/388: dwrite d4/d9/d1c/f23 [4194304,4194304] 0 2024-04-20T21:58:30.187 INFO:tasks.workunit.client.0.smithi142.stdout:9/476: creat d0/d89/fa2 x:0 0 0 2024-04-20T21:58:30.192 INFO:tasks.workunit.client.0.smithi142.stdout:1/359: creat d2/d4e/f7f x:0 0 0 2024-04-20T21:58:30.203 INFO:tasks.workunit.client.0.smithi142.stdout:0/377: dwrite d5/d13/d1e/d23/d24/d48/f65 [0,4194304] 0 2024-04-20T21:58:30.209 INFO:tasks.workunit.client.0.smithi142.stdout:4/372: sync 2024-04-20T21:58:30.209 INFO:tasks.workunit.client.0.smithi142.stdout:5/292: sync 2024-04-20T21:58:30.209 INFO:tasks.workunit.client.0.smithi142.stdout:3/392: sync 2024-04-20T21:58:30.210 INFO:tasks.workunit.client.0.smithi142.stdout:5/293: fsync dc/d14/d25/f3a 0 2024-04-20T21:58:30.210 INFO:tasks.workunit.client.0.smithi142.stdout:4/373: chown d1/d12/da/d1c/d32 87269864 1 2024-04-20T21:58:30.213 INFO:tasks.workunit.client.0.smithi142.stdout:4/374: write d1/d6/d30/d3f/f64 [355311,21458] 0 2024-04-20T21:58:30.215 INFO:tasks.workunit.client.0.smithi142.stdout:4/375: readlink d1/d6/l9 0 2024-04-20T21:58:30.225 INFO:tasks.workunit.client.0.smithi142.stdout:9/477: symlink d0/d89/d95/la3 0 2024-04-20T21:58:30.229 INFO:tasks.workunit.client.0.smithi142.stdout:1/360: unlink d2/dd/d17/d1b/l79 0 2024-04-20T21:58:30.232 INFO:tasks.workunit.client.0.smithi142.stdout:1/361: fsync d2/dd/d17/d1b/f59 0 2024-04-20T21:58:30.232 INFO:tasks.workunit.client.0.smithi142.stdout:4/376: dwrite d1/d12/da/d1c/d32/d3d/d2f/d49/f62 [0,4194304] 0 2024-04-20T21:58:30.234 INFO:tasks.workunit.client.0.smithi142.stdout:1/362: fdatasync d2/dd/d17/d3b/d50/f5e 0 2024-04-20T21:58:30.236 INFO:tasks.workunit.client.0.smithi142.stdout:5/294: mknod dc/d14/d25/c63 0 2024-04-20T21:58:30.236 INFO:tasks.workunit.client.0.smithi142.stdout:4/377: write d1/d6/f2d [147956,117845] 0 2024-04-20T21:58:30.237 INFO:tasks.workunit.client.0.smithi142.stdout:1/363: fsync d2/dd/d17/f21 0 2024-04-20T21:58:30.239 INFO:tasks.workunit.client.0.smithi142.stdout:7/389: link d4/d9/d11/d22/l31 d4/d7d/l8c 0 2024-04-20T21:58:30.239 INFO:tasks.workunit.client.0.smithi142.stdout:2/454: sync 2024-04-20T21:58:30.240 INFO:tasks.workunit.client.0.smithi142.stdout:8/373: sync 2024-04-20T21:58:30.242 INFO:tasks.workunit.client.0.smithi142.stdout:0/378: mknod d5/d45/d6f/d70/c83 0 2024-04-20T21:58:30.244 INFO:tasks.workunit.client.0.smithi142.stdout:6/346: truncate d1/d2f/f4e 2894733 0 2024-04-20T21:58:30.249 INFO:tasks.workunit.client.0.smithi142.stdout:4/378: write d1/d6/d4a/d5a/f56 [1104888,75277] 0 2024-04-20T21:58:30.252 INFO:tasks.workunit.client.0.smithi142.stdout:3/393: creat d6/d15/d30/d37/d75/f8a x:0 0 0 2024-04-20T21:58:30.253 INFO:tasks.workunit.client.0.smithi142.stdout:1/364: rmdir d2/dd/d17/d1b/d22 39 2024-04-20T21:58:30.255 INFO:tasks.workunit.client.0.smithi142.stdout:3/394: write d6/f4b [62267,128776] 0 2024-04-20T21:58:30.256 INFO:tasks.workunit.client.0.smithi142.stdout:8/374: creat d0/d1c/d44/f8b x:0 0 0 2024-04-20T21:58:30.260 INFO:tasks.workunit.client.0.smithi142.stdout:8/375: fdatasync d0/d5e/f81 0 2024-04-20T21:58:30.262 INFO:tasks.workunit.client.0.smithi142.stdout:0/379: rename d5/d13/d1e/f59 to d5/d13/d1e/d23/d2c/f84 0 2024-04-20T21:58:30.266 INFO:tasks.workunit.client.0.smithi142.stdout:1/365: write d2/dd/d17/d3b/d50/f52 [756079,35238] 0 2024-04-20T21:58:30.268 INFO:tasks.workunit.client.0.smithi142.stdout:6/347: creat d1/d2f/d35/d5b/d3e/f74 x:0 0 0 2024-04-20T21:58:30.271 INFO:tasks.workunit.client.0.smithi142.stdout:9/478: dwrite d0/d3c/d4d/d63/f65 [0,4194304] 0 2024-04-20T21:58:30.275 INFO:tasks.workunit.client.0.smithi142.stdout:9/479: write d0/d3c/d4d/f75 [2167817,45050] 0 2024-04-20T21:58:30.276 INFO:tasks.workunit.client.0.smithi142.stdout:3/395: creat d6/d15/d1e/d43/d4d/f8b x:0 0 0 2024-04-20T21:58:30.277 INFO:tasks.workunit.client.0.smithi142.stdout:1/366: symlink d2/d4e/l80 0 2024-04-20T21:58:30.277 INFO:tasks.workunit.client.0.smithi142.stdout:9/480: fsync d0/d36/d55/f5d 0 2024-04-20T21:58:30.278 INFO:tasks.workunit.client.0.smithi142.stdout:1/367: readlink d2/la 0 2024-04-20T21:58:30.281 INFO:tasks.workunit.client.0.smithi142.stdout:3/396: dread - d6/d15/d30/d37/d6c/f74 zero size 2024-04-20T21:58:30.283 INFO:tasks.workunit.client.0.smithi142.stdout:1/368: write d2/f3e [1289179,109009] 0 2024-04-20T21:58:30.284 INFO:tasks.workunit.client.0.smithi142.stdout:0/380: rename d5/d1c/d29 to d5/d1c/d3c/d85 0 2024-04-20T21:58:30.287 INFO:tasks.workunit.client.0.smithi142.stdout:7/390: creat d4/d9/f8d x:0 0 0 2024-04-20T21:58:30.291 INFO:tasks.workunit.client.0.smithi142.stdout:7/391: write d4/d9/d11/d22/f7a [964441,10099] 0 2024-04-20T21:58:30.294 INFO:tasks.workunit.client.0.smithi142.stdout:7/392: dread - d4/d9/d11/d47/d5a/f63 zero size 2024-04-20T21:58:30.301 INFO:tasks.workunit.client.0.smithi142.stdout:6/348: mkdir d1/d75 0 2024-04-20T21:58:30.306 INFO:tasks.workunit.client.0.smithi142.stdout:6/349: readlink d1/d1b/l72 0 2024-04-20T21:58:30.307 INFO:tasks.workunit.client.0.smithi142.stdout:0/381: dwrite d5/d45/d6f/f81 [0,4194304] 0 2024-04-20T21:58:30.310 INFO:tasks.workunit.client.0.smithi142.stdout:3/397: chown d6/d15/d30/d37/c41 708 1 2024-04-20T21:58:30.313 INFO:tasks.workunit.client.0.smithi142.stdout:9/481: truncate d0/d2a/d39/f98 699231 0 2024-04-20T21:58:30.320 INFO:tasks.workunit.client.0.smithi142.stdout:6/350: creat d1/d11/f76 x:0 0 0 2024-04-20T21:58:30.321 INFO:tasks.workunit.client.0.smithi142.stdout:3/398: write d6/f6a [716274,25746] 0 2024-04-20T21:58:30.321 INFO:tasks.workunit.client.0.smithi142.stdout:8/376: link d0/d1c/d44/d89/l3e d0/d1c/d44/d89/d45/l8c 0 2024-04-20T21:58:30.326 INFO:tasks.workunit.client.0.smithi142.stdout:9/482: creat d0/d3c/d4d/d63/d80/fa4 x:0 0 0 2024-04-20T21:58:30.327 INFO:tasks.workunit.client.0.smithi142.stdout:3/399: chown d6/d15/d1e 6 1 2024-04-20T21:58:30.330 INFO:tasks.workunit.client.0.smithi142.stdout:6/351: symlink d1/d11/l77 0 2024-04-20T21:58:30.331 INFO:tasks.workunit.client.0.smithi142.stdout:5/295: dwrite dc/d14/f1e [0,4194304] 0 2024-04-20T21:58:30.333 INFO:tasks.workunit.client.0.smithi142.stdout:1/369: dwrite d2/dd/d1c/d60/f72 [0,4194304] 0 2024-04-20T21:58:30.334 INFO:tasks.workunit.client.0.smithi142.stdout:8/377: link d0/d5e/f87 d0/d17/f8d 0 2024-04-20T21:58:30.339 INFO:tasks.workunit.client.0.smithi142.stdout:8/378: stat d0/d1c/d44/d89/f53 0 2024-04-20T21:58:30.346 INFO:tasks.workunit.client.0.smithi142.stdout:6/352: dread - d1/d2f/d35/d5b/d39/f3b zero size 2024-04-20T21:58:30.348 INFO:tasks.workunit.client.0.smithi142.stdout:7/393: dwrite d4/d9/d11/d47/d5a/f76 [0,4194304] 0 2024-04-20T21:58:30.349 INFO:tasks.workunit.client.0.smithi142.stdout:1/370: write d2/dd/d17/d3b/f6b [849350,20228] 0 2024-04-20T21:58:30.351 INFO:tasks.workunit.client.0.smithi142.stdout:0/382: dwrite d5/f17 [4194304,4194304] 0 2024-04-20T21:58:30.353 INFO:tasks.workunit.client.0.smithi142.stdout:8/379: write d0/d17/d35/f80 [924622,8558] 0 2024-04-20T21:58:30.354 INFO:tasks.workunit.client.0.smithi142.stdout:3/400: creat d6/d15/f8c x:0 0 0 2024-04-20T21:58:30.359 INFO:tasks.workunit.client.0.smithi142.stdout:5/296: symlink dc/d14/d21/d46/d2a/d57/l64 0 2024-04-20T21:58:30.359 INFO:tasks.workunit.client.0.smithi142.stdout:6/353: symlink d1/d5/d3a/l78 0 2024-04-20T21:58:30.361 INFO:tasks.workunit.client.0.smithi142.stdout:5/297: write dc/d14/d25/f2d [3795070,101083] 0 2024-04-20T21:58:30.366 INFO:tasks.workunit.client.0.smithi142.stdout:0/383: creat d5/d45/d6f/f86 x:0 0 0 2024-04-20T21:58:30.373 INFO:tasks.workunit.client.0.smithi142.stdout:3/401: symlink d6/d32/d39/d69/l8d 0 2024-04-20T21:58:30.376 INFO:tasks.workunit.client.0.smithi142.stdout:7/394: rename d4/d9/d11/d22 to d4/d9/d1c/d8e 0 2024-04-20T21:58:30.377 INFO:tasks.workunit.client.0.smithi142.stdout:1/371: symlink d2/dd/d17/d1b/d22/d13/l81 0 2024-04-20T21:58:30.382 INFO:tasks.workunit.client.0.smithi142.stdout:3/402: mknod d6/d15/d47/c8e 0 2024-04-20T21:58:30.390 INFO:tasks.workunit.client.0.smithi142.stdout:7/395: symlink d4/d9/d1c/d5e/l8f 0 2024-04-20T21:58:30.391 INFO:tasks.workunit.client.0.smithi142.stdout:9/483: dwrite d0/d36/f7a [0,4194304] 0 2024-04-20T21:58:30.391 INFO:tasks.workunit.client.0.smithi142.stdout:3/403: stat d6/d15/d30/d37/c55 0 2024-04-20T21:58:30.396 INFO:tasks.workunit.client.0.smithi142.stdout:5/298: dwrite dc/d14/f41 [0,4194304] 0 2024-04-20T21:58:30.399 INFO:tasks.workunit.client.0.smithi142.stdout:7/396: mkdir d4/d9/d11/d47/d5a/d90 0 2024-04-20T21:58:30.404 INFO:tasks.workunit.client.0.smithi142.stdout:3/404: mknod d6/d15/d30/d37/d6c/c8f 0 2024-04-20T21:58:30.405 INFO:tasks.workunit.client.0.smithi142.stdout:8/380: dread d0/d1c/d44/d89/d45/f4d [0,4194304] 0 2024-04-20T21:58:30.415 INFO:tasks.workunit.client.0.smithi142.stdout:0/384: truncate d5/f21 1546494 0 2024-04-20T21:58:30.415 INFO:tasks.workunit.client.0.smithi142.stdout:7/397: write d4/d9/d1c/d5e/f34 [1801595,2236] 0 2024-04-20T21:58:30.421 INFO:tasks.workunit.client.0.smithi142.stdout:8/381: unlink d0/d1c/d44/d89/f53 0 2024-04-20T21:58:30.423 INFO:tasks.workunit.client.0.smithi142.stdout:8/382: stat d0/l15 0 2024-04-20T21:58:30.423 INFO:tasks.workunit.client.0.smithi142.stdout:5/299: dwrite dc/d14/d26/f3d [0,4194304] 0 2024-04-20T21:58:30.424 INFO:tasks.workunit.client.0.smithi142.stdout:7/398: chown d4/d9/d1c/d5e/d64/f7c 13314320 1 2024-04-20T21:58:30.429 INFO:tasks.workunit.client.0.smithi142.stdout:0/385: symlink d5/d13/d1e/d23/l87 0 2024-04-20T21:58:30.431 INFO:tasks.workunit.client.0.smithi142.stdout:3/405: symlink d6/l90 0 2024-04-20T21:58:30.433 INFO:tasks.workunit.client.0.smithi142.stdout:9/484: write d0/d2a/d39/f6d [2279768,64924] 0 2024-04-20T21:58:30.436 INFO:tasks.workunit.client.0.smithi142.stdout:7/399: creat d4/d7f/f91 x:0 0 0 2024-04-20T21:58:30.437 INFO:tasks.workunit.client.0.smithi142.stdout:5/300: chown dc/d14/d26/l4c 19033 1 2024-04-20T21:58:30.438 INFO:tasks.workunit.client.0.smithi142.stdout:8/383: mknod d0/d1c/d44/c8e 0 2024-04-20T21:58:30.439 INFO:tasks.workunit.client.0.smithi142.stdout:9/485: symlink d0/d2a/la5 0 2024-04-20T21:58:30.443 INFO:tasks.workunit.client.0.smithi142.stdout:7/400: chown d4/f48 305048 1 2024-04-20T21:58:30.444 INFO:tasks.workunit.client.0.smithi142.stdout:3/406: truncate d6/d15/f19 320173 0 2024-04-20T21:58:30.447 INFO:tasks.workunit.client.0.smithi142.stdout:7/401: fdatasync d4/d7d/f5c 0 2024-04-20T21:58:30.454 INFO:tasks.workunit.client.0.smithi142.stdout:9/486: symlink d0/d2a/la6 0 2024-04-20T21:58:30.459 INFO:tasks.workunit.client.0.smithi142.stdout:7/402: write d4/f35 [467538,72208] 0 2024-04-20T21:58:30.461 INFO:tasks.workunit.client.0.smithi142.stdout:9/487: chown d0/d36/d55/l58 100 1 2024-04-20T21:58:30.461 INFO:tasks.workunit.client.0.smithi142.stdout:3/407: rmdir d6/d15/d1e/d43/d4d 39 2024-04-20T21:58:30.461 INFO:tasks.workunit.client.0.smithi142.stdout:1/372: dread d2/dd/d17/d1b/d22/d13/f14 [0,4194304] 0 2024-04-20T21:58:30.470 INFO:tasks.workunit.client.0.smithi142.stdout:1/373: fsync d2/dd/d17/f21 0 2024-04-20T21:58:30.471 INFO:tasks.workunit.client.0.smithi142.stdout:8/384: truncate d0/f4f 2902900 0 2024-04-20T21:58:30.471 INFO:tasks.workunit.client.0.smithi142.stdout:0/386: rename d5/d45/d6f/f5d to d5/d13/d1e/d23/d24/d48/d55/f88 0 2024-04-20T21:58:30.473 INFO:tasks.workunit.client.0.smithi142.stdout:1/374: chown d2/dd/d17/d1b/d22/d13/c18 198 1 2024-04-20T21:58:30.474 INFO:tasks.workunit.client.0.smithi142.stdout:5/301: dwrite dc/d14/d21/d46/d2a/d30/f5e [0,4194304] 0 2024-04-20T21:58:30.474 INFO:tasks.workunit.client.0.smithi142.stdout:8/385: chown d0/d1c/d44/d89/d45/d4c/f86 496721 1 2024-04-20T21:58:30.478 INFO:tasks.workunit.client.0.smithi142.stdout:3/408: mkdir d6/d32/d39/d69/d91 0 2024-04-20T21:58:30.479 INFO:tasks.workunit.client.0.smithi142.stdout:7/403: symlink d4/d9/d11/d47/d5a/l92 0 2024-04-20T21:58:30.480 INFO:tasks.workunit.client.0.smithi142.stdout:7/404: dread - d4/d9/d1c/d5e/d64/f7c zero size 2024-04-20T21:58:30.483 INFO:tasks.workunit.client.0.smithi142.stdout:7/405: chown d4/d7f/f91 218048400 1 2024-04-20T21:58:30.486 INFO:tasks.workunit.client.0.smithi142.stdout:0/387: fsync d5/d13/d1e/d23/d46/f4c 0 2024-04-20T21:58:30.494 INFO:tasks.workunit.client.0.smithi142.stdout:8/386: rmdir d0/d1c/d44/d89 39 2024-04-20T21:58:30.499 INFO:tasks.workunit.client.0.smithi142.stdout:9/488: dread d0/d2a/d39/f6d [0,4194304] 0 2024-04-20T21:58:30.499 INFO:tasks.workunit.client.0.smithi142.stdout:7/406: mknod d4/d7f/d77/d7e/c93 0 2024-04-20T21:58:30.500 INFO:tasks.workunit.client.0.smithi142.stdout:0/388: fsync d5/d1c/f52 0 2024-04-20T21:58:30.505 INFO:tasks.workunit.client.0.smithi142.stdout:1/375: mknod d2/dd/d17/d1b/d22/c82 0 2024-04-20T21:58:30.509 INFO:tasks.workunit.client.0.smithi142.stdout:4/379: sync 2024-04-20T21:58:30.510 INFO:tasks.workunit.client.0.smithi142.stdout:2/455: sync 2024-04-20T21:58:30.510 INFO:tasks.workunit.client.0.smithi142.stdout:8/387: rmdir d0/d22/d3f 39 2024-04-20T21:58:30.513 INFO:tasks.workunit.client.0.smithi142.stdout:8/388: chown d0/d29/c6a 3 1 2024-04-20T21:58:30.513 INFO:tasks.workunit.client.0.smithi142.stdout:3/409: mknod d6/d32/d39/d69/d91/c92 0 2024-04-20T21:58:30.515 INFO:tasks.workunit.client.0.smithi142.stdout:9/489: creat d0/d89/fa7 x:0 0 0 2024-04-20T21:58:30.520 INFO:tasks.workunit.client.0.smithi142.stdout:3/410: write d6/d15/d47/f61 [66600,8978] 0 2024-04-20T21:58:30.520 INFO:tasks.workunit.client.0.smithi142.stdout:8/389: write d0/d17/d35/f80 [1056442,62918] 0 2024-04-20T21:58:30.528 INFO:tasks.workunit.client.0.smithi142.stdout:2/456: rename d3/d5/d19/d70/d3c/l75 to d3/d5/l96 0 2024-04-20T21:58:30.532 INFO:tasks.workunit.client.0.smithi142.stdout:5/302: dwrite dc/f1d [0,4194304] 0 2024-04-20T21:58:30.534 INFO:tasks.workunit.client.0.smithi142.stdout:7/407: dwrite d4/d9/d1c/f4a [0,4194304] 0 2024-04-20T21:58:30.536 INFO:tasks.workunit.client.0.smithi142.stdout:1/376: truncate d2/dd/fe 2161059 0 2024-04-20T21:58:30.537 INFO:tasks.workunit.client.0.smithi142.stdout:6/354: sync 2024-04-20T21:58:30.546 INFO:tasks.workunit.client.0.smithi142.stdout:5/303: mkdir dc/d14/d21/d46/d2a/d65 0 2024-04-20T21:58:30.548 INFO:tasks.workunit.client.0.smithi142.stdout:7/408: readlink d4/d9/d11/d47/d5a/l92 0 2024-04-20T21:58:30.550 INFO:tasks.workunit.client.0.smithi142.stdout:9/490: write d0/d2a/d39/f98 [237275,76237] 0 2024-04-20T21:58:30.562 INFO:tasks.workunit.client.0.smithi142.stdout:3/411: rename d6/f35 to d6/d15/d1e/d43/d4d/d6e/f93 0 2024-04-20T21:58:30.565 INFO:tasks.workunit.client.0.smithi142.stdout:0/389: dwrite d5/d1c/d3c/d85/d38/f1b [0,4194304] 0 2024-04-20T21:58:30.567 INFO:tasks.workunit.client.0.smithi142.stdout:5/304: mknod dc/d14/d21/d46/d2a/d3c/c66 0 2024-04-20T21:58:30.571 INFO:tasks.workunit.client.0.smithi142.stdout:7/409: creat d4/d7f/d77/d7e/f94 x:0 0 0 2024-04-20T21:58:30.574 INFO:tasks.workunit.client.0.smithi142.stdout:3/412: symlink d6/d15/d30/l94 0 2024-04-20T21:58:30.577 INFO:tasks.workunit.client.0.smithi142.stdout:4/380: dwrite d1/d6/d30/d3f/f1e [0,4194304] 0 2024-04-20T21:58:30.580 INFO:tasks.workunit.client.0.smithi142.stdout:0/390: chown d5/d13/f7d 5 1 2024-04-20T21:58:30.580 INFO:tasks.workunit.client.0.smithi142.stdout:6/355: getdents d1/d2f/d35/d5b 0 2024-04-20T21:58:30.584 INFO:tasks.workunit.client.0.smithi142.stdout:4/381: readlink d1/d6/l4c 0 2024-04-20T21:58:30.586 INFO:tasks.workunit.client.0.smithi142.stdout:8/390: dwrite d0/d17/d35/f80 [0,4194304] 0 2024-04-20T21:58:30.590 INFO:tasks.workunit.client.0.smithi142.stdout:8/391: chown d0/d29 1351052903 1 2024-04-20T21:58:30.590 INFO:tasks.workunit.client.0.smithi142.stdout:4/382: chown d1/d6/d4a/f71 124008279 1 2024-04-20T21:58:30.590 INFO:tasks.workunit.client.0.smithi142.stdout:0/391: chown d5/f21 174518895 1 2024-04-20T21:58:30.590 INFO:tasks.workunit.client.0.smithi142.stdout:3/413: creat d6/d15/f95 x:0 0 0 2024-04-20T21:58:30.593 INFO:tasks.workunit.client.0.smithi142.stdout:6/356: mknod d1/d2f/d35/d5b/d3e/c79 0 2024-04-20T21:58:30.593 INFO:tasks.workunit.client.0.smithi142.stdout:3/414: read - d6/d15/f95 zero size 2024-04-20T21:58:30.594 INFO:tasks.workunit.client.0.smithi142.stdout:7/410: creat d4/d9/d11/d47/f95 x:0 0 0 2024-04-20T21:58:30.599 INFO:tasks.workunit.client.0.smithi142.stdout:1/377: dread d2/f45 [0,4194304] 0 2024-04-20T21:58:30.603 INFO:tasks.workunit.client.0.smithi142.stdout:4/383: mkdir d1/d12/da/d72 0 2024-04-20T21:58:30.607 INFO:tasks.workunit.client.0.smithi142.stdout:6/357: mknod d1/d2f/d35/d5b/d3e/c7a 0 2024-04-20T21:58:30.607 INFO:tasks.workunit.client.0.smithi142.stdout:5/305: dread dc/d14/d26/f3d [0,4194304] 0 2024-04-20T21:58:30.609 INFO:tasks.workunit.client.0.smithi142.stdout:1/378: read d2/f6 [316874,47342] 0 2024-04-20T21:58:30.610 INFO:tasks.workunit.client.0.smithi142.stdout:4/384: write d1/d12/da/d1c/d32/d3d/f28 [8733028,110367] 0 2024-04-20T21:58:30.612 INFO:tasks.workunit.client.0.smithi142.stdout:7/411: dread d4/d9/d1c/d5e/f1f [0,4194304] 0 2024-04-20T21:58:30.615 INFO:tasks.workunit.client.0.smithi142.stdout:5/306: read - dc/d14/d21/d46/d2a/d30/f4e zero size 2024-04-20T21:58:30.616 INFO:tasks.workunit.client.0.smithi142.stdout:3/415: creat d6/d15/d1e/d43/f96 x:0 0 0 2024-04-20T21:58:30.620 INFO:tasks.workunit.client.0.smithi142.stdout:0/392: write d5/d1c/d3c/d85/d38/f42 [384497,7238] 0 2024-04-20T21:58:30.628 INFO:tasks.workunit.client.0.smithi142.stdout:3/416: dread - d6/d15/d1e/f80 zero size 2024-04-20T21:58:30.630 INFO:tasks.workunit.client.0.smithi142.stdout:1/379: dread d2/f3e [0,4194304] 0 2024-04-20T21:58:30.635 INFO:tasks.workunit.client.0.smithi142.stdout:7/412: getdents d4/d9 0 2024-04-20T21:58:30.636 INFO:tasks.workunit.client.0.smithi142.stdout:0/393: truncate d5/d13/f7d 5011168 0 2024-04-20T21:58:30.637 INFO:tasks.workunit.client.0.smithi142.stdout:8/392: dwrite d0/d1c/d44/d89/d45/d59/f5a [0,4194304] 0 2024-04-20T21:58:30.638 INFO:tasks.workunit.client.0.smithi142.stdout:1/380: chown d2/dd/d17/d1b 120 1 2024-04-20T21:58:30.642 INFO:tasks.workunit.client.0.smithi142.stdout:4/385: dwrite d1/d6/d4a/d5a/f6a [0,4194304] 0 2024-04-20T21:58:30.643 INFO:tasks.workunit.client.0.smithi142.stdout:8/393: fsync d0/d1c/f31 0 2024-04-20T21:58:30.645 INFO:tasks.workunit.client.0.smithi142.stdout:4/386: chown d1/d12/da/d1c/f26 10 1 2024-04-20T21:58:30.647 INFO:tasks.workunit.client.0.smithi142.stdout:3/417: creat d6/d15/d1e/d43/d4d/f97 x:0 0 0 2024-04-20T21:58:30.650 INFO:tasks.workunit.client.0.smithi142.stdout:4/387: write d1/f13 [1521017,95356] 0 2024-04-20T21:58:30.650 INFO:tasks.workunit.client.0.smithi142.stdout:3/418: dread - d6/d15/d1e/f87 zero size 2024-04-20T21:58:30.651 INFO:tasks.workunit.client.0.smithi142.stdout:0/394: creat d5/d1c/d3c/d85/d38/d62/f89 x:0 0 0 2024-04-20T21:58:30.655 INFO:tasks.workunit.client.0.smithi142.stdout:1/381: symlink d2/dd/d17/d1b/l83 0 2024-04-20T21:58:30.656 INFO:tasks.workunit.client.0.smithi142.stdout:5/307: rename dc/d14/d21/d46/d2a/d57/c5f to dc/d14/d21/c67 0 2024-04-20T21:58:30.660 INFO:tasks.workunit.client.0.smithi142.stdout:6/358: dread d1/d5/f3c [0,4194304] 0 2024-04-20T21:58:30.661 INFO:tasks.workunit.client.0.smithi142.stdout:3/419: write d6/d15/d30/d37/f3d [1147558,23081] 0 2024-04-20T21:58:30.664 INFO:tasks.workunit.client.0.smithi142.stdout:6/359: dread - d1/d11/f76 zero size 2024-04-20T21:58:30.666 INFO:tasks.workunit.client.0.smithi142.stdout:8/394: mkdir d0/d22/d3f/d7f/d8f 0 2024-04-20T21:58:30.674 INFO:tasks.workunit.client.0.smithi142.stdout:3/420: creat d6/d15/d1e/d43/d4d/d6e/f98 x:0 0 0 2024-04-20T21:58:30.674 INFO:tasks.workunit.client.0.smithi142.stdout:5/308: mkdir dc/d14/d21/d46/d2a/d30/d5c/d68 0 2024-04-20T21:58:30.676 INFO:tasks.workunit.client.0.smithi142.stdout:8/395: mkdir d0/d42/d90 0 2024-04-20T21:58:30.676 INFO:tasks.workunit.client.0.smithi142.stdout:0/395: dwrite d5/f9 [4194304,4194304] 0 2024-04-20T21:58:30.678 INFO:tasks.workunit.client.0.smithi142.stdout:3/421: mkdir d6/d15/d1e/d43/d4d/d6e/d99 0 2024-04-20T21:58:30.678 INFO:tasks.workunit.client.0.smithi142.stdout:8/396: chown d0/d1c/f61 0 1 2024-04-20T21:58:30.679 INFO:tasks.workunit.client.0.smithi142.stdout:1/382: rename d2/dd/d17/d1b/d22/d13/l81 to d2/dd/d17/d1b/l84 0 2024-04-20T21:58:30.682 INFO:tasks.workunit.client.0.smithi142.stdout:0/396: fdatasync d5/d1c/d3c/f73 0 2024-04-20T21:58:30.686 INFO:tasks.workunit.client.0.smithi142.stdout:1/383: write d2/dd/d17/d3b/d50/f5e [123918,93338] 0 2024-04-20T21:58:30.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:30 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:30.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:30 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:30.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:30 smithi164 ceph-mon[23506]: pgmap v37: 65 pgs: 65 active+clean; 897 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 19 MiB/s rd, 100 MiB/s wr, 220 op/s 2024-04-20T21:58:30.696 INFO:tasks.workunit.client.0.smithi142.stdout:1/384: write d2/dd/d17/d3b/f6b [1027452,109452] 0 2024-04-20T21:58:30.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:30 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:30.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:30 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:30.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:30 smithi142 ceph-mon[15828]: pgmap v37: 65 pgs: 65 active+clean; 897 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 19 MiB/s rd, 100 MiB/s wr, 220 op/s 2024-04-20T21:58:30.698 INFO:tasks.workunit.client.0.smithi142.stdout:0/397: creat d5/d1c/f8a x:0 0 0 2024-04-20T21:58:30.700 INFO:tasks.workunit.client.0.smithi142.stdout:1/385: truncate d2/dd/d17/d1b/f5f 4997696 0 2024-04-20T21:58:30.702 INFO:tasks.workunit.client.0.smithi142.stdout:6/360: getdents d1/d2f/d35/d5b/d63/d4b/d61 0 2024-04-20T21:58:30.705 INFO:tasks.workunit.client.0.smithi142.stdout:4/388: truncate d1/d6/d4a/d5a/f6a 2183132 0 2024-04-20T21:58:30.705 INFO:tasks.workunit.client.0.smithi142.stdout:0/398: write d5/d1c/d3c/f61 [414004,23140] 0 2024-04-20T21:58:30.712 INFO:tasks.workunit.client.0.smithi142.stdout:1/386: symlink d2/dd/d1c/d60/l85 0 2024-04-20T21:58:30.713 INFO:tasks.workunit.client.0.smithi142.stdout:5/309: dread dc/d14/d21/d46/d2a/d30/f42 [0,4194304] 0 2024-04-20T21:58:30.716 INFO:tasks.workunit.client.0.smithi142.stdout:4/389: mkdir d1/d12/da/d1c/d32/d3d/d2f/d73 0 2024-04-20T21:58:30.718 INFO:tasks.workunit.client.0.smithi142.stdout:3/422: dwrite d6/f8 [0,4194304] 0 2024-04-20T21:58:30.721 INFO:tasks.workunit.client.0.smithi142.stdout:8/397: dread d0/d17/f6d [0,4194304] 0 2024-04-20T21:58:30.724 INFO:tasks.workunit.client.0.smithi142.stdout:5/310: unlink dc/d14/d21/c55 0 2024-04-20T21:58:30.725 INFO:tasks.workunit.client.0.smithi142.stdout:1/387: mkdir d2/dd/d17/d3b/d74/d86 0 2024-04-20T21:58:30.725 INFO:tasks.workunit.client.0.smithi142.stdout:8/398: write d0/d22/f51 [444802,11670] 0 2024-04-20T21:58:30.727 INFO:tasks.workunit.client.0.smithi142.stdout:4/390: symlink d1/d6/l74 0 2024-04-20T21:58:30.728 INFO:tasks.workunit.client.0.smithi142.stdout:8/399: fdatasync d0/f74 0 2024-04-20T21:58:30.730 INFO:tasks.workunit.client.0.smithi142.stdout:5/311: mknod dc/d14/d25/c69 0 2024-04-20T21:58:30.735 INFO:tasks.workunit.client.0.smithi142.stdout:0/399: dwrite d5/d13/d1e/d23/d2c/f84 [0,4194304] 0 2024-04-20T21:58:30.759 INFO:tasks.workunit.client.0.smithi142.stdout:9/491: sync 2024-04-20T21:58:30.759 INFO:tasks.workunit.client.0.smithi142.stdout:2/457: sync 2024-04-20T21:58:30.770 INFO:tasks.workunit.client.0.smithi142.stdout:2/458: dwrite d3/f5a [0,4194304] 0 2024-04-20T21:58:30.772 INFO:tasks.workunit.client.0.smithi142.stdout:2/459: stat d3/d9/d89/d31/f54 0 2024-04-20T21:58:30.789 INFO:tasks.workunit.client.0.smithi142.stdout:1/388: mkdir d2/dd/d1c/d43/d87 0 2024-04-20T21:58:30.791 INFO:tasks.workunit.client.0.smithi142.stdout:6/361: truncate d1/d5/f3c 98430 0 2024-04-20T21:58:30.793 INFO:tasks.workunit.client.0.smithi142.stdout:0/400: fdatasync d5/d13/d1e/d23/d24/d48/d55/f74 0 2024-04-20T21:58:30.796 INFO:tasks.workunit.client.0.smithi142.stdout:2/460: rename d3/d9/d89/d31/l5c to d3/d9/d69/l97 0 2024-04-20T21:58:30.797 INFO:tasks.workunit.client.0.smithi142.stdout:4/391: creat d1/d12/da/d1c/d32/d3d/d2f/d49/f75 x:0 0 0 2024-04-20T21:58:30.798 INFO:tasks.workunit.client.0.smithi142.stdout:6/362: rmdir d1/d2f/d35/d48 39 2024-04-20T21:58:30.801 INFO:tasks.workunit.client.0.smithi142.stdout:6/363: write d1/d2f/d35/d5b/f6f [559321,115536] 0 2024-04-20T21:58:30.803 INFO:tasks.workunit.client.0.smithi142.stdout:0/401: mkdir d5/d1c/d3c/d8b 0 2024-04-20T21:58:30.806 INFO:tasks.workunit.client.0.smithi142.stdout:6/364: read d1/d2f/d35/d5b/d3e/f57 [33038,46219] 0 2024-04-20T21:58:30.807 INFO:tasks.workunit.client.0.smithi142.stdout:2/461: chown d3/d5/l91 13341 1 2024-04-20T21:58:30.807 INFO:tasks.workunit.client.0.smithi142.stdout:5/312: write f2 [2393148,1123] 0 2024-04-20T21:58:30.809 INFO:tasks.workunit.client.0.smithi142.stdout:0/402: readlink d5/d13/d1e/d23/l28 0 2024-04-20T21:58:30.811 INFO:tasks.workunit.client.0.smithi142.stdout:2/462: chown d3/d9/d89/d31/f92 1667115 1 2024-04-20T21:58:30.811 INFO:tasks.workunit.client.0.smithi142.stdout:5/313: write dc/d14/f37 [455390,109695] 0 2024-04-20T21:58:30.813 INFO:tasks.workunit.client.0.smithi142.stdout:4/392: rename d1/d6/d30/d3f/f21 to d1/d12/da/d1c/d32/d3d/d2f/d49/f76 0 2024-04-20T21:58:30.815 INFO:tasks.workunit.client.0.smithi142.stdout:2/463: chown d3/d5/d19/c3a 1616229 1 2024-04-20T21:58:30.817 INFO:tasks.workunit.client.0.smithi142.stdout:6/365: rename d1/f49 to d1/d2f/d35/d5b/d63/d4b/f7b 0 2024-04-20T21:58:30.818 INFO:tasks.workunit.client.0.smithi142.stdout:5/314: rename dc/d14 to dc/d14/d21/d46/d6a 22 2024-04-20T21:58:30.818 INFO:tasks.workunit.client.0.smithi142.stdout:4/393: write d1/d12/da/f18 [5277334,58579] 0 2024-04-20T21:58:30.819 INFO:tasks.workunit.client.0.smithi142.stdout:8/400: truncate d0/d1c/d44/d89/d45/f56 823784 0 2024-04-20T21:58:30.820 INFO:tasks.workunit.client.0.smithi142.stdout:5/315: write f4 [4665381,36666] 0 2024-04-20T21:58:30.824 INFO:tasks.workunit.client.0.smithi142.stdout:5/316: chown dc/d14/d21/d46 200038444 1 2024-04-20T21:58:30.825 INFO:tasks.workunit.client.0.smithi142.stdout:2/464: unlink d3/d5/d19/d70/f5f 0 2024-04-20T21:58:30.829 INFO:tasks.workunit.client.0.smithi142.stdout:0/403: getdents d5/d1c/d3c/d85/d38/d62 0 2024-04-20T21:58:30.832 INFO:tasks.workunit.client.0.smithi142.stdout:0/404: truncate d5/d1c/d3c/f61 618524 0 2024-04-20T21:58:30.835 INFO:tasks.workunit.client.0.smithi142.stdout:4/394: chown d1/c48 14655305 1 2024-04-20T21:58:30.836 INFO:tasks.workunit.client.0.smithi142.stdout:0/405: chown d5/d1c/d3c/d85/f76 1571817 1 2024-04-20T21:58:30.838 INFO:tasks.workunit.client.0.smithi142.stdout:8/401: readlink d0/d22/l2a 0 2024-04-20T21:58:30.840 INFO:tasks.workunit.client.0.smithi142.stdout:4/395: write d1/d6/f47 [1410188,82634] 0 2024-04-20T21:58:30.847 INFO:tasks.workunit.client.0.smithi142.stdout:6/366: rename d1/d5/f3c to d1/d5/d3a/d43/d5c/f7c 0 2024-04-20T21:58:30.848 INFO:tasks.workunit.client.0.smithi142.stdout:4/396: fsync d1/d6/fc 0 2024-04-20T21:58:30.851 INFO:tasks.workunit.client.0.smithi142.stdout:4/397: chown d1/d12/da/d1c/d32/d3d/f6b 1187 1 2024-04-20T21:58:30.851 INFO:tasks.workunit.client.0.smithi142.stdout:2/465: dwrite d3/d5/d19/d70/f95 [0,4194304] 0 2024-04-20T21:58:30.854 INFO:tasks.workunit.client.0.smithi142.stdout:4/398: write d1/d6/f1a [1198607,96568] 0 2024-04-20T21:58:30.860 INFO:tasks.workunit.client.0.smithi142.stdout:4/399: stat d1/d12/da/d1c/f3b 0 2024-04-20T21:58:30.860 INFO:tasks.workunit.client.0.smithi142.stdout:0/406: rename d5/l1a to d5/d1c/d3c/l8c 0 2024-04-20T21:58:30.862 INFO:tasks.workunit.client.0.smithi142.stdout:5/317: dread f2 [0,4194304] 0 2024-04-20T21:58:30.862 INFO:tasks.workunit.client.0.smithi142.stdout:4/400: write d1/d6/d30/d3f/f64 [500422,10095] 0 2024-04-20T21:58:30.862 INFO:tasks.workunit.client.0.smithi142.stdout:6/367: mknod d1/d5/d3a/d43/c7d 0 2024-04-20T21:58:30.871 INFO:tasks.workunit.client.0.smithi142.stdout:0/407: symlink d5/d13/d1e/d23/d24/l8d 0 2024-04-20T21:58:30.878 INFO:tasks.workunit.client.0.smithi142.stdout:5/318: unlink dc/d14/d21/d46/l34 0 2024-04-20T21:58:30.878 INFO:tasks.workunit.client.0.smithi142.stdout:6/368: mkdir d1/d2f/d6c/d7e 0 2024-04-20T21:58:30.880 INFO:tasks.workunit.client.0.smithi142.stdout:0/408: creat d5/d1c/d3c/f8e x:0 0 0 2024-04-20T21:58:30.880 INFO:tasks.workunit.client.0.smithi142.stdout:2/466: dwrite d3/d9/d89/d31/f73 [0,4194304] 0 2024-04-20T21:58:30.934 INFO:tasks.workunit.client.0.smithi142.stdout:7/413: sync 2024-04-20T21:58:30.943 INFO:tasks.workunit.client.0.smithi142.stdout:6/369: fdatasync d1/d2f/d35/f36 0 2024-04-20T21:58:30.943 INFO:tasks.workunit.client.0.smithi142.stdout:4/401: getdents d1 0 2024-04-20T21:58:30.944 INFO:tasks.workunit.client.0.smithi142.stdout:8/402: truncate d0/f20 3031381 0 2024-04-20T21:58:30.949 INFO:tasks.workunit.client.0.smithi142.stdout:2/467: chown d3/d5/d19/d70/f43 1982 1 2024-04-20T21:58:30.949 INFO:tasks.workunit.client.0.smithi142.stdout:8/403: fsync d0/d1c/d44/f46 0 2024-04-20T21:58:31.040 INFO:tasks.workunit.client.0.smithi142.stdout:4/402: readlink d1/d6/d30/d3f/l20 0 2024-04-20T21:58:31.040 INFO:tasks.workunit.client.0.smithi142.stdout:8/404: unlink d0/d1c/f72 0 2024-04-20T21:58:31.042 INFO:tasks.workunit.client.0.smithi142.stdout:2/468: getdents d3/d5/d19/d94 0 2024-04-20T21:58:31.044 INFO:tasks.workunit.client.0.smithi142.stdout:4/403: read - d1/d6/d30/d3f/f42 zero size 2024-04-20T21:58:31.049 INFO:tasks.workunit.client.0.smithi142.stdout:4/404: write d1/d6/f2d [1794496,45383] 0 2024-04-20T21:58:31.050 INFO:tasks.workunit.client.0.smithi142.stdout:0/409: dread d5/d1c/d3c/d85/d38/f1b [0,4194304] 0 2024-04-20T21:58:31.050 INFO:tasks.workunit.client.0.smithi142.stdout:5/319: dwrite dc/d14/d21/d46/d2a/d3c/f61 [0,4194304] 0 2024-04-20T21:58:31.055 INFO:tasks.workunit.client.0.smithi142.stdout:4/405: chown d1/d6/d30/f3a 1232501 1 2024-04-20T21:58:31.060 INFO:tasks.workunit.client.0.smithi142.stdout:5/320: mkdir dc/d6b 0 2024-04-20T21:58:31.061 INFO:tasks.workunit.client.0.smithi142.stdout:0/410: mkdir d5/d13/d1e/d8f 0 2024-04-20T21:58:31.063 INFO:tasks.workunit.client.0.smithi142.stdout:4/406: rename d1/d6/d30/d3f/f64 to d1/d5b/f77 0 2024-04-20T21:58:31.063 INFO:tasks.workunit.client.0.smithi142.stdout:8/405: dread d0/d1c/d44/d89/d45/f4d [0,4194304] 0 2024-04-20T21:58:31.069 INFO:tasks.workunit.client.0.smithi142.stdout:2/469: dwrite d3/f7e [0,4194304] 0 2024-04-20T21:58:31.074 INFO:tasks.workunit.client.0.smithi142.stdout:8/406: rmdir d0/d1c/d44/d89 39 2024-04-20T21:58:31.076 INFO:tasks.workunit.client.0.smithi142.stdout:4/407: creat d1/d12/da/d1c/d32/d3d/d2f/d49/f78 x:0 0 0 2024-04-20T21:58:31.076 INFO:tasks.workunit.client.0.smithi142.stdout:3/423: sync 2024-04-20T21:58:31.078 INFO:tasks.workunit.client.0.smithi142.stdout:2/470: readlink d3/d9/d69/l97 0 2024-04-20T21:58:31.082 INFO:tasks.workunit.client.0.smithi142.stdout:3/424: readlink d6/d15/d47/l48 0 2024-04-20T21:58:31.082 INFO:tasks.workunit.client.0.smithi142.stdout:8/407: rename d0/d22/d3f/d7f to d0/d22/d3f/d7f/d8f/d91 22 2024-04-20T21:58:31.087 INFO:tasks.workunit.client.0.smithi142.stdout:3/425: chown d6/d15/d1e/d43/d4d/f6d 3079662 1 2024-04-20T21:58:31.089 INFO:tasks.workunit.client.0.smithi142.stdout:5/321: dwrite dc/d14/d26/f3d [0,4194304] 0 2024-04-20T21:58:31.095 INFO:tasks.workunit.client.0.smithi142.stdout:4/408: dread d1/d6/d4a/d5a/f56 [0,4194304] 0 2024-04-20T21:58:31.099 INFO:tasks.workunit.client.0.smithi142.stdout:0/411: dwrite d5/d1c/d3c/d85/d63/f82 [0,4194304] 0 2024-04-20T21:58:31.100 INFO:tasks.workunit.client.0.smithi142.stdout:4/409: readlink d1/d12/da/d1c/l45 0 2024-04-20T21:58:31.112 INFO:tasks.workunit.client.0.smithi142.stdout:2/471: dwrite d3/d5/d19/f59 [0,4194304] 0 2024-04-20T21:58:31.112 INFO:tasks.workunit.client.0.smithi142.stdout:0/412: chown d5/d13/l2d 37953 1 2024-04-20T21:58:31.120 INFO:tasks.workunit.client.0.smithi142.stdout:4/410: creat d1/d6/d4b/f79 x:0 0 0 2024-04-20T21:58:31.123 INFO:tasks.workunit.client.0.smithi142.stdout:0/413: creat d5/d1c/d3c/d85/d38/f90 x:0 0 0 2024-04-20T21:58:31.124 INFO:tasks.workunit.client.0.smithi142.stdout:2/472: mknod d3/d5/d19/c98 0 2024-04-20T21:58:31.126 INFO:tasks.workunit.client.0.smithi142.stdout:6/370: write d1/d5/d3a/d43/d5c/f7c [997099,68946] 0 2024-04-20T21:58:31.128 INFO:tasks.workunit.client.0.smithi142.stdout:3/426: dwrite d6/d15/d1e/d43/d4d/f56 [0,4194304] 0 2024-04-20T21:58:31.129 INFO:tasks.workunit.client.0.smithi142.stdout:2/473: write d3/d9/f77 [1508644,80270] 0 2024-04-20T21:58:31.131 INFO:tasks.workunit.client.0.smithi142.stdout:0/414: readlink d5/d13/d1e/d23/d46/l51 0 2024-04-20T21:58:31.139 INFO:tasks.workunit.client.0.smithi142.stdout:5/322: dread dc/d14/f59 [0,4194304] 0 2024-04-20T21:58:31.143 INFO:tasks.workunit.client.0.smithi142.stdout:5/323: write f4 [2657470,2283] 0 2024-04-20T21:58:31.144 INFO:tasks.workunit.client.0.smithi142.stdout:7/414: sync 2024-04-20T21:58:31.144 INFO:tasks.workunit.client.0.smithi142.stdout:9/492: sync 2024-04-20T21:58:31.144 INFO:tasks.workunit.client.0.smithi142.stdout:1/389: sync 2024-04-20T21:58:31.145 INFO:tasks.workunit.client.0.smithi142.stdout:2/474: unlink d3/d5/d19/f52 0 2024-04-20T21:58:31.152 INFO:tasks.workunit.client.0.smithi142.stdout:4/411: rmdir d1/d12/da/d1c/d32/d3d/d38 0 2024-04-20T21:58:31.154 INFO:tasks.workunit.client.0.smithi142.stdout:0/415: dread d5/d1c/d3c/d85/d63/f82 [0,4194304] 0 2024-04-20T21:58:31.158 INFO:tasks.workunit.client.0.smithi142.stdout:4/412: stat d1/d6/d4a/d5a 0 2024-04-20T21:58:31.158 INFO:tasks.workunit.client.0.smithi142.stdout:3/427: dwrite d6/f10 [0,4194304] 0 2024-04-20T21:58:31.161 INFO:tasks.workunit.client.0.smithi142.stdout:1/390: mkdir d2/dd/d1c/d88 0 2024-04-20T21:58:31.163 INFO:tasks.workunit.client.0.smithi142.stdout:3/428: fdatasync d6/f4b 0 2024-04-20T21:58:31.166 INFO:tasks.workunit.client.0.smithi142.stdout:0/416: rmdir d5/d1c/d3c/d85/d32 39 2024-04-20T21:58:31.171 INFO:tasks.workunit.client.0.smithi142.stdout:4/413: mkdir d1/d12/da/d1c/d32/d3d/d2f/d7a 0 2024-04-20T21:58:31.171 INFO:tasks.workunit.client.0.smithi142.stdout:8/408: dwrite d0/d1c/f2d [0,4194304] 0 2024-04-20T21:58:31.173 INFO:tasks.workunit.client.0.smithi142.stdout:2/475: dwrite d3/d5/f5e [0,4194304] 0 2024-04-20T21:58:31.177 INFO:tasks.workunit.client.0.smithi142.stdout:1/391: unlink d2/dd/d17/d1b/d22/d13/c18 0 2024-04-20T21:58:31.180 INFO:tasks.workunit.client.0.smithi142.stdout:5/324: creat dc/d14/d21/f6c x:0 0 0 2024-04-20T21:58:31.182 INFO:tasks.workunit.client.0.smithi142.stdout:1/392: chown d2/dd/c27 0 1 2024-04-20T21:58:31.186 INFO:tasks.workunit.client.0.smithi142.stdout:3/429: creat d6/d15/d1e/d43/d4d/d59/f9a x:0 0 0 2024-04-20T21:58:31.186 INFO:tasks.workunit.client.0.smithi142.stdout:9/493: link d0/d2a/la6 d0/d2a/d39/la8 0 2024-04-20T21:58:31.187 INFO:tasks.workunit.client.0.smithi142.stdout:4/414: mknod d1/d6/d4a/c7b 0 2024-04-20T21:58:31.188 INFO:tasks.workunit.client.0.smithi142.stdout:8/409: stat d0/d29/f50 0 2024-04-20T21:58:31.195 INFO:tasks.workunit.client.0.smithi142.stdout:3/430: dread - d6/d15/d1e/d43/d4d/f97 zero size 2024-04-20T21:58:31.199 INFO:tasks.workunit.client.0.smithi142.stdout:0/417: rename d5/d1c/d3c/f43 to d5/d1c/d3c/d85/f91 0 2024-04-20T21:58:31.205 INFO:tasks.workunit.client.0.smithi142.stdout:9/494: read d0/d2a/f44 [943558,4829] 0 2024-04-20T21:58:31.213 INFO:tasks.workunit.client.0.smithi142.stdout:6/371: dwrite d1/d2f/f4e [0,4194304] 0 2024-04-20T21:58:31.216 INFO:tasks.workunit.client.0.smithi142.stdout:5/325: unlink dc/d14/d21/d46/d2a/f49 0 2024-04-20T21:58:31.217 INFO:tasks.workunit.client.0.smithi142.stdout:6/372: fsync d1/d11/f44 0 2024-04-20T21:58:31.218 INFO:tasks.workunit.client.0.smithi142.stdout:8/410: mkdir d0/d1c/d44/d89/d45/d92 0 2024-04-20T21:58:31.218 INFO:tasks.workunit.client.0.smithi142.stdout:3/431: mkdir d6/d32/d9b 0 2024-04-20T21:58:31.228 INFO:tasks.workunit.client.0.smithi142.stdout:6/373: rmdir d1/d2f/d35/d5b/d63 39 2024-04-20T21:58:31.228 INFO:tasks.workunit.client.0.smithi142.stdout:0/418: truncate d5/d45/f47 1766665 0 2024-04-20T21:58:31.234 INFO:tasks.workunit.client.0.smithi142.stdout:8/411: mknod d0/d1c/d44/d89/d45/d4c/d68/c93 0 2024-04-20T21:58:31.235 INFO:tasks.workunit.client.0.smithi142.stdout:2/476: dwrite d3/d9/d34/f3b [0,4194304] 0 2024-04-20T21:58:31.242 INFO:tasks.workunit.client.0.smithi142.stdout:8/412: rename d0 to d0/d5e/d94 22 2024-04-20T21:58:31.242 INFO:tasks.workunit.client.0.smithi142.stdout:0/419: dread d5/d13/f7d [4194304,4194304] 0 2024-04-20T21:58:31.248 INFO:tasks.workunit.client.0.smithi142.stdout:3/432: rename d6/fd to d6/f9c 0 2024-04-20T21:58:31.249 INFO:tasks.workunit.client.0.smithi142.stdout:1/393: dread d2/dd/d1c/f3f [0,4194304] 0 2024-04-20T21:58:31.252 INFO:tasks.workunit.client.0.smithi142.stdout:5/326: dwrite dc/f1d [4194304,4194304] 0 2024-04-20T21:58:31.252 INFO:tasks.workunit.client.0.smithi142.stdout:6/374: write d1/d2f/d35/d5b/d39/f52 [7209553,118212] 0 2024-04-20T21:58:31.256 INFO:tasks.workunit.client.0.smithi142.stdout:8/413: chown d0/d29/f4a 397581267 1 2024-04-20T21:58:31.256 INFO:tasks.workunit.client.0.smithi142.stdout:0/420: creat d5/d13/d1e/d23/d46/f92 x:0 0 0 2024-04-20T21:58:31.256 INFO:tasks.workunit.client.0.smithi142.stdout:9/495: dwrite d0/ff [0,4194304] 0 2024-04-20T21:58:31.263 INFO:tasks.workunit.client.0.smithi142.stdout:0/421: chown d5/d1c/d3c/f5a 24499 1 2024-04-20T21:58:31.264 INFO:tasks.workunit.client.0.smithi142.stdout:1/394: dread d2/dd/d17/d3b/d50/f5e [0,4194304] 0 2024-04-20T21:58:31.264 INFO:tasks.workunit.client.0.smithi142.stdout:6/375: creat d1/d11/f7f x:0 0 0 2024-04-20T21:58:31.271 INFO:tasks.workunit.client.0.smithi142.stdout:5/327: symlink dc/d14/d25/l6d 0 2024-04-20T21:58:31.274 INFO:tasks.workunit.client.0.smithi142.stdout:4/415: dread d1/d12/da/d1c/f34 [4194304,4194304] 0 2024-04-20T21:58:31.281 INFO:tasks.workunit.client.0.smithi142.stdout:3/433: rename d6/f10 to d6/d15/f9d 0 2024-04-20T21:58:31.287 INFO:tasks.workunit.client.0.smithi142.stdout:1/395: dread d2/dd/d17/d3b/f6b [0,4194304] 0 2024-04-20T21:58:31.287 INFO:tasks.workunit.client.0.smithi142.stdout:2/477: getdents d3/d5/d74 0 2024-04-20T21:58:31.287 INFO:tasks.workunit.client.0.smithi142.stdout:9/496: truncate d0/f1e 3563147 0 2024-04-20T21:58:31.289 INFO:tasks.workunit.client.0.smithi142.stdout:2/478: fdatasync d3/d5/d19/d70/f43 0 2024-04-20T21:58:31.295 INFO:tasks.workunit.client.0.smithi142.stdout:0/422: mknod d5/c93 0 2024-04-20T21:58:31.296 INFO:tasks.workunit.client.0.smithi142.stdout:5/328: creat dc/d14/d21/d46/d2a/d30/f6e x:0 0 0 2024-04-20T21:58:31.298 INFO:tasks.workunit.client.0.smithi142.stdout:0/423: write d5/d13/f2f [4380983,40901] 0 2024-04-20T21:58:31.299 INFO:tasks.workunit.client.0.smithi142.stdout:5/329: readlink dc/d14/d25/l6d 0 2024-04-20T21:58:31.300 INFO:tasks.workunit.client.0.smithi142.stdout:4/416: dwrite d1/d12/da/d1c/d32/f40 [0,4194304] 0 2024-04-20T21:58:31.304 INFO:tasks.workunit.client.0.smithi142.stdout:8/414: write d0/d29/f50 [785981,50013] 0 2024-04-20T21:58:31.306 INFO:tasks.workunit.client.0.smithi142.stdout:0/424: chown d5/d13/d1e/d23/d24/f79 9568 1 2024-04-20T21:58:31.307 INFO:tasks.workunit.client.0.smithi142.stdout:8/415: dread - d0/f7b zero size 2024-04-20T21:58:31.308 INFO:tasks.workunit.client.0.smithi142.stdout:2/479: mknod d3/d5/d19/d70/d3c/d66/c99 0 2024-04-20T21:58:31.313 INFO:tasks.workunit.client.0.smithi142.stdout:9/497: symlink d0/d3c/d4d/d63/la9 0 2024-04-20T21:58:31.314 INFO:tasks.workunit.client.0.smithi142.stdout:8/416: dread d0/d22/f52 [0,4194304] 0 2024-04-20T21:58:31.317 INFO:tasks.workunit.client.0.smithi142.stdout:1/396: truncate d2/dd/d17/f21 3271918 0 2024-04-20T21:58:31.322 INFO:tasks.workunit.client.0.smithi142.stdout:0/425: read d5/d45/f50 [150531,105658] 0 2024-04-20T21:58:31.324 INFO:tasks.workunit.client.0.smithi142.stdout:6/376: link d1/d2f/d35/d5b/d3e/f5a d1/d2f/d35/d5b/d63/d64/f80 0 2024-04-20T21:58:31.324 INFO:tasks.workunit.client.0.smithi142.stdout:0/426: fdatasync d5/d13/f2f 0 2024-04-20T21:58:31.324 INFO:tasks.workunit.client.0.smithi142.stdout:4/417: fsync d1/d6/d4a/d5a/f56 0 2024-04-20T21:58:31.328 INFO:tasks.workunit.client.0.smithi142.stdout:3/434: rename d6/d15/d30/l3f to d6/d32/l9e 0 2024-04-20T21:58:31.329 INFO:tasks.workunit.client.0.smithi142.stdout:2/480: mkdir d3/d9/d89/d9a 0 2024-04-20T21:58:31.332 INFO:tasks.workunit.client.0.smithi142.stdout:9/498: truncate d0/d36/f41 3316092 0 2024-04-20T21:58:31.339 INFO:tasks.workunit.client.0.smithi142.stdout:0/427: truncate d5/d1c/d3c/f73 1469142 0 2024-04-20T21:58:31.339 INFO:tasks.workunit.client.0.smithi142.stdout:2/481: chown d3/d5/d19/d70/l93 2615 1 2024-04-20T21:58:31.340 INFO:tasks.workunit.client.0.smithi142.stdout:3/435: rmdir d6/d15/d47 39 2024-04-20T21:58:31.342 INFO:tasks.workunit.client.0.smithi142.stdout:4/418: fdatasync d1/d12/da/d1c/d32/d3d/d2f/d49/f62 0 2024-04-20T21:58:31.342 INFO:tasks.workunit.client.0.smithi142.stdout:1/397: mkdir d2/dd/d1c/d88/d89 0 2024-04-20T21:58:31.345 INFO:tasks.workunit.client.0.smithi142.stdout:8/417: dwrite d0/d29/f37 [0,4194304] 0 2024-04-20T21:58:31.345 INFO:tasks.workunit.client.0.smithi142.stdout:5/330: creat dc/d14/d21/f6f x:0 0 0 2024-04-20T21:58:31.350 INFO:tasks.workunit.client.0.smithi142.stdout:7/415: sync 2024-04-20T21:58:31.354 INFO:tasks.workunit.client.0.smithi142.stdout:1/398: fsync d2/dd/d17/d3b/d50/f5e 0 2024-04-20T21:58:31.356 INFO:tasks.workunit.client.0.smithi142.stdout:0/428: rmdir d5/d13/d1e/d23/d46 39 2024-04-20T21:58:31.361 INFO:tasks.workunit.client.0.smithi142.stdout:3/436: rename d6/d15/d47/c8e to d6/d32/d39/c9f 0 2024-04-20T21:58:31.364 INFO:tasks.workunit.client.0.smithi142.stdout:1/399: read d2/dd/d17/d1b/f5f [4553863,98886] 0 2024-04-20T21:58:31.366 INFO:tasks.workunit.client.0.smithi142.stdout:4/419: dread d1/f39 [0,4194304] 0 2024-04-20T21:58:31.369 INFO:tasks.workunit.client.0.smithi142.stdout:5/331: symlink dc/d14/d21/d46/d2a/d30/l70 0 2024-04-20T21:58:31.376 INFO:tasks.workunit.client.0.smithi142.stdout:6/377: dwrite d1/d5/d3a/d43/d5c/f7c [0,4194304] 0 2024-04-20T21:58:31.385 INFO:tasks.workunit.client.0.smithi142.stdout:0/429: rmdir d5/d13/d1e/d23 39 2024-04-20T21:58:31.386 INFO:tasks.workunit.client.0.smithi142.stdout:8/418: dwrite d0/d1c/f2d [4194304,4194304] 0 2024-04-20T21:58:31.395 INFO:tasks.workunit.client.0.smithi142.stdout:2/482: truncate d3/d5/d19/d70/d3c/d64/f7b 92455 0 2024-04-20T21:58:31.395 INFO:tasks.workunit.client.0.smithi142.stdout:7/416: creat d4/f96 x:0 0 0 2024-04-20T21:58:31.395 INFO:tasks.workunit.client.0.smithi142.stdout:7/417: readlink d4/d7f/l80 0 2024-04-20T21:58:31.397 INFO:tasks.workunit.client.0.smithi142.stdout:1/400: dread d2/dd/d1c/f3f [0,4194304] 0 2024-04-20T21:58:31.399 INFO:tasks.workunit.client.0.smithi142.stdout:5/332: rename dc/d14/d21/d46/d2a/d30 to dc/d71 0 2024-04-20T21:58:31.403 INFO:tasks.workunit.client.0.smithi142.stdout:9/499: dread d0/d2a/f37 [0,4194304] 0 2024-04-20T21:58:31.403 INFO:tasks.workunit.client.0.smithi142.stdout:0/430: symlink d5/d6d/l94 0 2024-04-20T21:58:31.408 INFO:tasks.workunit.client.0.smithi142.stdout:7/418: dread d4/f35 [0,4194304] 0 2024-04-20T21:58:31.408 INFO:tasks.workunit.client.0.smithi142.stdout:6/378: mknod d1/d2f/d35/d5b/d39/c81 0 2024-04-20T21:58:31.415 INFO:tasks.workunit.client.0.smithi142.stdout:2/483: mknod d3/d9/d89/d9a/c9b 0 2024-04-20T21:58:31.418 INFO:tasks.workunit.client.0.smithi142.stdout:3/437: dwrite d6/d15/f19 [0,4194304] 0 2024-04-20T21:58:31.419 INFO:tasks.workunit.client.0.smithi142.stdout:4/420: dread d1/d12/da/d1c/f25 [0,4194304] 0 2024-04-20T21:58:31.423 INFO:tasks.workunit.client.0.smithi142.stdout:4/421: read d1/d12/da/d1c/d32/f43 [961539,107022] 0 2024-04-20T21:58:31.431 INFO:tasks.workunit.client.0.smithi142.stdout:7/419: write d4/f35 [1359187,69306] 0 2024-04-20T21:58:31.440 INFO:tasks.workunit.client.0.smithi142.stdout:9/500: dwrite d0/ff [4194304,4194304] 0 2024-04-20T21:58:31.442 INFO:tasks.workunit.client.0.smithi142.stdout:6/379: mknod d1/d2f/d6c/c82 0 2024-04-20T21:58:31.443 INFO:tasks.workunit.client.0.smithi142.stdout:0/431: mkdir d5/d1c/d3c/d95 0 2024-04-20T21:58:31.446 INFO:tasks.workunit.client.0.smithi142.stdout:8/419: truncate d0/d29/f37 433512 0 2024-04-20T21:58:31.449 INFO:tasks.workunit.client.0.smithi142.stdout:2/484: mknod d3/d9/d89/d31/d84/c9c 0 2024-04-20T21:58:31.449 INFO:tasks.workunit.client.0.smithi142.stdout:3/438: symlink d6/d15/d30/d37/d75/la0 0 2024-04-20T21:58:31.451 INFO:tasks.workunit.client.0.smithi142.stdout:8/420: fdatasync d0/d42/f70 0 2024-04-20T21:58:31.452 INFO:tasks.workunit.client.0.smithi142.stdout:2/485: fdatasync d3/d5/d19/d70/f43 0 2024-04-20T21:58:31.453 INFO:tasks.workunit.client.0.smithi142.stdout:5/333: dread dc/d14/d25/f2d [0,4194304] 0 2024-04-20T21:58:31.459 INFO:tasks.workunit.client.0.smithi142.stdout:3/439: creat d6/d15/d30/d37/fa1 x:0 0 0 2024-04-20T21:58:31.459 INFO:tasks.workunit.client.0.smithi142.stdout:8/421: fsync d0/d17/f6d 0 2024-04-20T21:58:31.462 INFO:tasks.workunit.client.0.smithi142.stdout:3/440: chown d6/d15/d1e/d43/d4d/d59 2940401 1 2024-04-20T21:58:31.467 INFO:tasks.workunit.client.0.smithi142.stdout:2/486: rename d3/d5/d19/d70/d3c/d64/l6f to d3/d5/l9d 0 2024-04-20T21:58:31.472 INFO:tasks.workunit.client.0.smithi142.stdout:0/432: stat d5/d13/d1e/d23/d2c/f84 0 2024-04-20T21:58:31.472 INFO:tasks.workunit.client.0.smithi142.stdout:1/401: truncate d2/dd/d17/d1b/d22/f56 3779758 0 2024-04-20T21:58:31.475 INFO:tasks.workunit.client.0.smithi142.stdout:8/422: creat d0/d17/f95 x:0 0 0 2024-04-20T21:58:31.476 INFO:tasks.workunit.client.0.smithi142.stdout:2/487: write d3/d5/d19/d70/d3c/d66/f90 [853906,109233] 0 2024-04-20T21:58:31.480 INFO:tasks.workunit.client.0.smithi142.stdout:5/334: unlink dc/d14/c18 0 2024-04-20T21:58:31.486 INFO:tasks.workunit.client.0.smithi142.stdout:8/423: write d0/d1c/d44/f46 [111920,120592] 0 2024-04-20T21:58:31.490 INFO:tasks.workunit.client.0.smithi142.stdout:6/380: truncate d1/d11/fa 111604 0 2024-04-20T21:58:31.493 INFO:tasks.workunit.client.0.smithi142.stdout:7/420: dwrite d4/d9/d1c/d5e/f36 [0,4194304] 0 2024-04-20T21:58:31.494 INFO:tasks.workunit.client.0.smithi142.stdout:2/488: symlink d3/d5/d19/d94/l9e 0 2024-04-20T21:58:31.495 INFO:tasks.workunit.client.0.smithi142.stdout:1/402: dread d2/dd/d17/d3b/d50/f52 [0,4194304] 0 2024-04-20T21:58:31.495 INFO:tasks.workunit.client.0.smithi142.stdout:9/501: dread d0/d3c/d4d/d63/d80/f93 [0,4194304] 0 2024-04-20T21:58:31.495 INFO:tasks.workunit.client.0.smithi142.stdout:3/441: dwrite d6/d15/d1e/d43/f96 [0,4194304] 0 2024-04-20T21:58:31.498 INFO:tasks.workunit.client.0.smithi142.stdout:5/335: mkdir dc/d14/d72 0 2024-04-20T21:58:31.498 INFO:tasks.workunit.client.0.smithi142.stdout:1/403: stat d2/dd/d17/d1b/d22 0 2024-04-20T21:58:31.503 INFO:tasks.workunit.client.0.smithi142.stdout:5/336: dread - dc/d14/f4d zero size 2024-04-20T21:58:31.503 INFO:tasks.workunit.client.0.smithi142.stdout:3/442: chown d6/d15/d1e/d43/d4d/d59/f86 3 1 2024-04-20T21:58:31.503 INFO:tasks.workunit.client.0.smithi142.stdout:0/433: dread d5/d1c/f71 [0,4194304] 0 2024-04-20T21:58:31.505 INFO:tasks.workunit.client.0.smithi142.stdout:3/443: chown d6/d15 178 1 2024-04-20T21:58:31.505 INFO:tasks.workunit.client.0.smithi142.stdout:5/337: chown dc/f2b 0 1 2024-04-20T21:58:31.505 INFO:tasks.workunit.client.0.smithi142.stdout:2/489: creat d3/d5/d19/d70/d3c/f9f x:0 0 0 2024-04-20T21:58:31.507 INFO:tasks.workunit.client.0.smithi142.stdout:6/381: rename d1/d46 to d1/d2f/d35/d5b/d63/d4b/d83 0 2024-04-20T21:58:31.509 INFO:tasks.workunit.client.0.smithi142.stdout:3/444: fsync d6/d15/d30/d37/fa1 0 2024-04-20T21:58:31.509 INFO:tasks.workunit.client.0.smithi142.stdout:2/490: read d3/d5/d19/f59 [3346460,21801] 0 2024-04-20T21:58:31.513 INFO:tasks.workunit.client.0.smithi142.stdout:6/382: dread - d1/d2f/d35/d5b/d63/d4b/d61/f67 zero size 2024-04-20T21:58:31.521 INFO:tasks.workunit.client.0.smithi142.stdout:8/424: creat d0/f96 x:0 0 0 2024-04-20T21:58:31.523 INFO:tasks.workunit.client.0.smithi142.stdout:5/338: write dc/f5a [1936398,39434] 0 2024-04-20T21:58:31.523 INFO:tasks.workunit.client.0.smithi142.stdout:3/445: mkdir d6/d32/d39/da2 0 2024-04-20T21:58:31.523 INFO:tasks.workunit.client.0.smithi142.stdout:7/421: write d4/d9/d11/f3c [2974287,5564] 0 2024-04-20T21:58:31.529 INFO:tasks.workunit.client.0.smithi142.stdout:1/404: mknod d2/dd/d17/d1b/d22/c8a 0 2024-04-20T21:58:31.529 INFO:tasks.workunit.client.0.smithi142.stdout:9/502: symlink d0/d3c/laa 0 2024-04-20T21:58:31.530 INFO:tasks.workunit.client.0.smithi142.stdout:6/383: chown d1/d2f/d35/d5b/f6f 47 1 2024-04-20T21:58:31.531 INFO:tasks.workunit.client.0.smithi142.stdout:6/384: fdatasync d1/d11/f7f 0 2024-04-20T21:58:31.532 INFO:tasks.workunit.client.0.smithi142.stdout:9/503: write d0/d2a/d39/f5e [4067869,94214] 0 2024-04-20T21:58:31.539 INFO:tasks.workunit.client.0.smithi142.stdout:8/425: dread d0/d22/f52 [0,4194304] 0 2024-04-20T21:58:31.541 INFO:tasks.workunit.client.0.smithi142.stdout:8/426: write d0/f26 [3161474,1597] 0 2024-04-20T21:58:31.543 INFO:tasks.workunit.client.0.smithi142.stdout:0/434: dread d5/d13/d1e/d23/d24/f2a [0,4194304] 0 2024-04-20T21:58:31.543 INFO:tasks.workunit.client.0.smithi142.stdout:5/339: unlink dc/d14/d25/l6d 0 2024-04-20T21:58:31.546 INFO:tasks.workunit.client.0.smithi142.stdout:8/427: write d0/d1c/d44/f62 [1008979,91721] 0 2024-04-20T21:58:31.546 INFO:tasks.workunit.client.0.smithi142.stdout:7/422: mkdir d4/d7f/d77/d78/d97 0 2024-04-20T21:58:31.549 INFO:tasks.workunit.client.0.smithi142.stdout:0/435: write d5/d1c/d3c/d85/f4f [3256426,88587] 0 2024-04-20T21:58:31.552 INFO:tasks.workunit.client.0.smithi142.stdout:2/491: mkdir d3/d9/da0 0 2024-04-20T21:58:31.557 INFO:tasks.workunit.client.0.smithi142.stdout:5/340: readlink dc/d14/l4f 0 2024-04-20T21:58:31.563 INFO:tasks.workunit.client.0.smithi142.stdout:8/428: symlink d0/d22/d3f/l97 0 2024-04-20T21:58:31.567 INFO:tasks.workunit.client.0.smithi142.stdout:6/385: symlink d1/d2f/d35/l84 0 2024-04-20T21:58:31.570 INFO:tasks.workunit.client.0.smithi142.stdout:3/446: dwrite d6/d32/d39/d69/f78 [0,4194304] 0 2024-04-20T21:58:31.571 INFO:tasks.workunit.client.0.smithi142.stdout:1/405: dwrite d2/f3e [0,4194304] 0 2024-04-20T21:58:31.571 INFO:tasks.workunit.client.0.smithi142.stdout:9/504: mknod d0/d3c/d4d/d63/cab 0 2024-04-20T21:58:31.573 INFO:tasks.workunit.client.0.smithi142.stdout:7/423: creat d4/d9/d11/d47/d5a/d90/f98 x:0 0 0 2024-04-20T21:58:31.574 INFO:tasks.workunit.client.0.smithi142.stdout:8/429: truncate d0/f6 2456124 0 2024-04-20T21:58:31.577 INFO:tasks.workunit.client.0.smithi142.stdout:6/386: write d1/d2f/d35/d5b/d63/d34/f4c [962240,118454] 0 2024-04-20T21:58:31.577 INFO:tasks.workunit.client.0.smithi142.stdout:0/436: link d5/d45/f50 d5/d1c/d3c/d85/d38/d62/f96 0 2024-04-20T21:58:31.579 INFO:tasks.workunit.client.0.smithi142.stdout:9/505: chown d0/d2a/d39/d87/f8d 11242756 1 2024-04-20T21:58:31.585 INFO:tasks.workunit.client.0.smithi142.stdout:8/430: chown d0/d22/l60 33 1 2024-04-20T21:58:31.585 INFO:tasks.workunit.client.0.smithi142.stdout:1/406: write d2/dd/d17/d1b/d22/f2f [1919985,67627] 0 2024-04-20T21:58:31.586 INFO:tasks.workunit.client.0.smithi142.stdout:2/492: dwrite d3/d9/d89/d31/f92 [0,4194304] 0 2024-04-20T21:58:31.586 INFO:tasks.workunit.client.0.smithi142.stdout:9/506: stat d0/l6 0 2024-04-20T21:58:31.588 INFO:tasks.workunit.client.0.smithi142.stdout:0/437: dread - d5/d1c/d3c/d85/d38/d62/f75 zero size 2024-04-20T21:58:31.588 INFO:tasks.workunit.client.0.smithi142.stdout:3/447: fdatasync d6/d15/d1e/d43/d4d/d6e/f98 0 2024-04-20T21:58:31.591 INFO:tasks.workunit.client.0.smithi142.stdout:6/387: rename d1/d2f/d35/d48 to d1/d2f/d35/d48/d85 22 2024-04-20T21:58:31.592 INFO:tasks.workunit.client.0.smithi142.stdout:6/388: chown d1/d5 591974952 1 2024-04-20T21:58:31.595 INFO:tasks.workunit.client.0.smithi142.stdout:3/448: write d6/d15/f19 [1465623,10139] 0 2024-04-20T21:58:31.595 INFO:tasks.workunit.client.0.smithi142.stdout:7/424: symlink d4/d9/d11/l99 0 2024-04-20T21:58:31.595 INFO:tasks.workunit.client.0.smithi142.stdout:2/493: dread - d3/d5/d19/d70/d3c/f9f zero size 2024-04-20T21:58:31.596 INFO:tasks.workunit.client.0.smithi142.stdout:7/425: readlink d4/d7f/l66 0 2024-04-20T21:58:31.597 INFO:tasks.workunit.client.0.smithi142.stdout:8/431: chown d0/d17/f19 235308478 1 2024-04-20T21:58:31.598 INFO:tasks.workunit.client.0.smithi142.stdout:7/426: stat d4/d9/d1c/d8e/c89 0 2024-04-20T21:58:31.606 INFO:tasks.workunit.client.0.smithi142.stdout:0/438: write d5/d13/d1e/d23/f39 [1015847,6457] 0 2024-04-20T21:58:31.607 INFO:tasks.workunit.client.0.smithi142.stdout:9/507: symlink d0/lac 0 2024-04-20T21:58:31.608 INFO:tasks.workunit.client.0.smithi142.stdout:8/432: unlink d0/d22/d3f/l97 0 2024-04-20T21:58:31.610 INFO:tasks.workunit.client.0.smithi142.stdout:2/494: chown d3/d5/l96 3816733 1 2024-04-20T21:58:31.613 INFO:tasks.workunit.client.0.smithi142.stdout:3/449: symlink d6/d15/d47/d83/la3 0 2024-04-20T21:58:31.618 INFO:tasks.workunit.client.0.smithi142.stdout:6/389: mknod d1/c86 0 2024-04-20T21:58:31.626 INFO:tasks.workunit.client.0.smithi142.stdout:1/407: dwrite d2/f45 [0,4194304] 0 2024-04-20T21:58:31.626 INFO:tasks.workunit.client.0.smithi142.stdout:8/433: creat d0/d42/f98 x:0 0 0 2024-04-20T21:58:31.629 INFO:tasks.workunit.client.0.smithi142.stdout:2/495: creat d3/d9/d34/fa1 x:0 0 0 2024-04-20T21:58:31.638 INFO:tasks.workunit.client.0.smithi142.stdout:0/439: link d5/d1c/d3c/f5a d5/d1c/d3c/d8b/f97 0 2024-04-20T21:58:31.638 INFO:tasks.workunit.client.0.smithi142.stdout:6/390: creat d1/d2f/d35/d5b/d3e/f87 x:0 0 0 2024-04-20T21:58:31.639 INFO:tasks.workunit.client.0.smithi142.stdout:2/496: mkdir d3/d9/d89/d31/da2 0 2024-04-20T21:58:31.641 INFO:tasks.workunit.client.0.smithi142.stdout:1/408: mkdir d2/dd/d17/d8b 0 2024-04-20T21:58:31.642 INFO:tasks.workunit.client.0.smithi142.stdout:9/508: link d0/d3c/l62 d0/d2a/d8b/lad 0 2024-04-20T21:58:31.642 INFO:tasks.workunit.client.0.smithi142.stdout:3/450: mkdir d6/d15/da4 0 2024-04-20T21:58:31.645 INFO:tasks.workunit.client.0.smithi142.stdout:6/391: chown d1/l16 132191 1 2024-04-20T21:58:31.647 INFO:tasks.workunit.client.0.smithi142.stdout:8/434: symlink d0/d1c/d44/d89/d45/l99 0 2024-04-20T21:58:31.647 INFO:tasks.workunit.client.0.smithi142.stdout:1/409: write d2/dd/d1c/d43/f76 [864026,61269] 0 2024-04-20T21:58:31.648 INFO:tasks.workunit.client.0.smithi142.stdout:6/392: readlink d1/d5/l24 0 2024-04-20T21:58:31.649 INFO:tasks.workunit.client.0.smithi142.stdout:7/427: dread d4/d9/d11/d47/d5a/f76 [0,4194304] 0 2024-04-20T21:58:31.649 INFO:tasks.workunit.client.0.smithi142.stdout:9/509: creat d0/d3c/d4d/d63/d80/fae x:0 0 0 2024-04-20T21:58:31.650 INFO:tasks.workunit.client.0.smithi142.stdout:0/440: symlink d5/d1d/d7e/l98 0 2024-04-20T21:58:31.652 INFO:tasks.workunit.client.0.smithi142.stdout:2/497: mkdir d3/d9/da3 0 2024-04-20T21:58:31.654 INFO:tasks.workunit.client.0.smithi142.stdout:9/510: chown d0/d91/f97 1153082632 1 2024-04-20T21:58:31.654 INFO:tasks.workunit.client.0.smithi142.stdout:0/441: stat d5/d13/d1e/d23/d24/d48/c4b 0 2024-04-20T21:58:31.655 INFO:tasks.workunit.client.0.smithi142.stdout:1/410: creat d2/dd/d17/d1b/d22/d20/f8c x:0 0 0 2024-04-20T21:58:31.656 INFO:tasks.workunit.client.0.smithi142.stdout:1/411: stat d2/d4e 0 2024-04-20T21:58:31.656 INFO:tasks.workunit.client.0.smithi142.stdout:9/511: write d0/d2a/f8e [45293,23762] 0 2024-04-20T21:58:31.657 INFO:tasks.workunit.client.0.smithi142.stdout:3/451: creat d6/d15/d1e/d43/fa5 x:0 0 0 2024-04-20T21:58:31.657 INFO:tasks.workunit.client.0.smithi142.stdout:0/442: fdatasync d5/d1d/f77 0 2024-04-20T21:58:31.658 INFO:tasks.workunit.client.0.smithi142.stdout:8/435: creat d0/f9a x:0 0 0 2024-04-20T21:58:31.660 INFO:tasks.workunit.client.0.smithi142.stdout:6/393: creat d1/d2f/d35/d5b/d63/d4b/f88 x:0 0 0 2024-04-20T21:58:31.663 INFO:tasks.workunit.client.0.smithi142.stdout:7/428: mkdir d4/d7f/d77/d78/d97/d9a 0 2024-04-20T21:58:31.664 INFO:tasks.workunit.client.0.smithi142.stdout:9/512: unlink d0/d2a/la5 0 2024-04-20T21:58:31.666 INFO:tasks.workunit.client.0.smithi142.stdout:2/498: fdatasync d3/f42 0 2024-04-20T21:58:31.667 INFO:tasks.workunit.client.0.smithi142.stdout:8/436: chown d0/d29/f3c 14339004 1 2024-04-20T21:58:31.668 INFO:tasks.workunit.client.0.smithi142.stdout:3/452: mknod d6/d32/ca6 0 2024-04-20T21:58:31.669 INFO:tasks.workunit.client.0.smithi142.stdout:6/394: creat d1/d5/d3a/d43/f89 x:0 0 0 2024-04-20T21:58:31.669 INFO:tasks.workunit.client.0.smithi142.stdout:2/499: write d3/d5/d19/f8a [530766,47001] 0 2024-04-20T21:58:31.671 INFO:tasks.workunit.client.0.smithi142.stdout:8/437: write d0/d1c/f1e [1901330,87968] 0 2024-04-20T21:58:31.672 INFO:tasks.workunit.client.0.smithi142.stdout:0/443: stat d5/d13/d1e/d23/d46/f4c 0 2024-04-20T21:58:31.674 INFO:tasks.workunit.client.0.smithi142.stdout:7/429: unlink d4/d9/d1c/d5e/f36 0 2024-04-20T21:58:31.675 INFO:tasks.workunit.client.0.smithi142.stdout:3/453: truncate d6/d15/d1e/d43/f6f 202248 0 2024-04-20T21:58:31.675 INFO:tasks.workunit.client.0.smithi142.stdout:4/422: sync 2024-04-20T21:58:31.680 INFO:tasks.workunit.client.0.smithi142.stdout:0/444: dread d5/d1c/d3c/f61 [0,4194304] 0 2024-04-20T21:58:31.681 INFO:tasks.workunit.client.0.smithi142.stdout:9/513: write d0/d36/f53 [747551,122484] 0 2024-04-20T21:58:31.685 INFO:tasks.workunit.client.0.smithi142.stdout:6/395: read d1/d5/f14 [3722416,126672] 0 2024-04-20T21:58:31.696 INFO:tasks.workunit.client.0.smithi142.stdout:5/341: sync 2024-04-20T21:58:31.698 INFO:tasks.workunit.client.0.smithi142.stdout:7/430: rename d4/d9/d11/d47 to d4/d7f/d77/d78/d9b 0 2024-04-20T21:58:31.700 INFO:tasks.workunit.client.0.smithi142.stdout:6/396: dwrite d1/d5/d3a/d43/f89 [0,4194304] 0 2024-04-20T21:58:31.707 INFO:tasks.workunit.client.0.smithi142.stdout:4/423: mknod d1/d12/c7c 0 2024-04-20T21:58:31.712 INFO:tasks.workunit.client.0.smithi142.stdout:7/431: rmdir d4/d7f/d77/d7e 39 2024-04-20T21:58:31.713 INFO:tasks.workunit.client.0.smithi142.stdout:0/445: getdents d5/d1c/d3c/d95 0 2024-04-20T21:58:31.717 INFO:tasks.workunit.client.0.smithi142.stdout:1/412: truncate d2/dd/d1c/d43/f6d 227682 0 2024-04-20T21:58:31.720 INFO:tasks.workunit.client.0.smithi142.stdout:8/438: creat d0/d29/f9b x:0 0 0 2024-04-20T21:58:31.721 INFO:tasks.workunit.client.0.smithi142.stdout:1/413: dread - d2/dd/d17/d1b/d22/d13/f48 zero size 2024-04-20T21:58:31.724 INFO:tasks.workunit.client.0.smithi142.stdout:8/439: dread - d0/d1c/d44/f8b zero size 2024-04-20T21:58:31.730 INFO:tasks.workunit.client.0.smithi142.stdout:6/397: mknod d1/d11/d71/c8a 0 2024-04-20T21:58:31.731 INFO:tasks.workunit.client.0.smithi142.stdout:7/432: dwrite d4/d9/f79 [0,4194304] 0 2024-04-20T21:58:31.735 INFO:tasks.workunit.client.0.smithi142.stdout:9/514: truncate d0/f21 1119081 0 2024-04-20T21:58:31.736 INFO:tasks.workunit.client.0.smithi142.stdout:3/454: getdents d6/d32/d39/d69 0 2024-04-20T21:58:31.740 INFO:tasks.workunit.client.0.smithi142.stdout:0/446: dread d5/d1c/d3c/d85/d38/f42 [0,4194304] 0 2024-04-20T21:58:31.742 INFO:tasks.workunit.client.0.smithi142.stdout:2/500: dwrite d3/d5/f4b [0,4194304] 0 2024-04-20T21:58:31.743 INFO:tasks.workunit.client.0.smithi142.stdout:0/447: chown d5/d13/d1e/d23/d46/f92 1235500 1 2024-04-20T21:58:31.743 INFO:tasks.workunit.client.0.smithi142.stdout:5/342: rename dc/d14/c54 to dc/d14/c73 0 2024-04-20T21:58:31.745 INFO:tasks.workunit.client.0.smithi142.stdout:8/440: symlink d0/d1c/d44/d89/l9c 0 2024-04-20T21:58:31.746 INFO:tasks.workunit.client.0.smithi142.stdout:5/343: read dc/d14/d25/f2d [2079706,49248] 0 2024-04-20T21:58:31.746 INFO:tasks.workunit.client.0.smithi142.stdout:6/398: mkdir d1/d5/d8b 0 2024-04-20T21:58:31.758 INFO:tasks.workunit.client.0.smithi142.stdout:4/424: creat d1/d12/f7d x:0 0 0 2024-04-20T21:58:31.765 INFO:tasks.workunit.client.0.smithi142.stdout:1/414: rename d2/dd/fe to d2/dd/d1c/d88/f8d 0 2024-04-20T21:58:31.768 INFO:tasks.workunit.client.0.smithi142.stdout:2/501: dwrite d3/d5/d19/d70/f4d [0,4194304] 0 2024-04-20T21:58:31.768 INFO:tasks.workunit.client.0.smithi142.stdout:0/448: creat d5/d1c/d3c/d85/d63/f99 x:0 0 0 2024-04-20T21:58:31.774 INFO:tasks.workunit.client.0.smithi142.stdout:4/425: creat d1/d12/da/d1c/d32/d3d/f7e x:0 0 0 2024-04-20T21:58:31.775 INFO:tasks.workunit.client.0.smithi142.stdout:6/399: dwrite d1/d5/d3a/f42 [0,4194304] 0 2024-04-20T21:58:31.779 INFO:tasks.workunit.client.0.smithi142.stdout:6/400: chown d1/d5/f26 514131002 1 2024-04-20T21:58:31.780 INFO:tasks.workunit.client.0.smithi142.stdout:7/433: unlink d4/d7f/d77/d78/d9b/d5a/l82 0 2024-04-20T21:58:31.783 INFO:tasks.workunit.client.0.smithi142.stdout:9/515: truncate d0/d2a/d39/f5c 295517 0 2024-04-20T21:58:31.783 INFO:tasks.workunit.client.0.smithi142.stdout:3/455: mkdir d6/d32/d39/da2/da7 0 2024-04-20T21:58:31.783 INFO:tasks.workunit.client.0.smithi142.stdout:6/401: read - d1/d11/f76 zero size 2024-04-20T21:58:31.790 INFO:tasks.workunit.client.0.smithi142.stdout:7/434: write d4/d9/f75 [779076,33673] 0 2024-04-20T21:58:31.790 INFO:tasks.workunit.client.0.smithi142.stdout:1/415: rename d2/dd/d17/f21 to d2/dd/f8e 0 2024-04-20T21:58:31.792 INFO:tasks.workunit.client.0.smithi142.stdout:5/344: creat dc/d14/d21/d46/d2a/f74 x:0 0 0 2024-04-20T21:58:31.796 INFO:tasks.workunit.client.0.smithi142.stdout:7/435: write d4/d7f/d77/d78/d9b/d5a/f63 [511392,117660] 0 2024-04-20T21:58:31.800 INFO:tasks.workunit.client.0.smithi142.stdout:3/456: creat d6/d32/d9b/fa8 x:0 0 0 2024-04-20T21:58:31.800 INFO:tasks.workunit.client.0.smithi142.stdout:0/449: getdents d5/d45/d6f 0 2024-04-20T21:58:31.802 INFO:tasks.workunit.client.0.smithi142.stdout:4/426: dwrite d1/d6/f47 [0,4194304] 0 2024-04-20T21:58:31.802 INFO:tasks.workunit.client.0.smithi142.stdout:2/502: getdents d3/d5/d19/d70/d3c/d66 0 2024-04-20T21:58:31.804 INFO:tasks.workunit.client.0.smithi142.stdout:6/402: creat d1/f8c x:0 0 0 2024-04-20T21:58:31.807 INFO:tasks.workunit.client.0.smithi142.stdout:6/403: write d1/d5/fb [2254731,80401] 0 2024-04-20T21:58:31.807 INFO:tasks.workunit.client.0.smithi142.stdout:7/436: truncate d4/d9/d1c/d5e/d64/f68 173634 0 2024-04-20T21:58:31.807 INFO:tasks.workunit.client.0.smithi142.stdout:4/427: write d1/d12/da/d1c/d32/f4d [750388,27435] 0 2024-04-20T21:58:31.809 INFO:tasks.workunit.client.0.smithi142.stdout:7/437: readlink d4/d9/d1c/d8e/l72 0 2024-04-20T21:58:31.810 INFO:tasks.workunit.client.0.smithi142.stdout:4/428: chown d1/d6/d4a 29 1 2024-04-20T21:58:31.810 INFO:tasks.workunit.client.0.smithi142.stdout:5/345: mkdir dc/d14/d21/d46/d58/d60/d75 0 2024-04-20T21:58:31.811 INFO:tasks.workunit.client.0.smithi142.stdout:4/429: fsync d1/d6/f2d 0 2024-04-20T21:58:31.813 INFO:tasks.workunit.client.0.smithi142.stdout:5/346: chown dc/d14/f41 0 1 2024-04-20T21:58:31.815 INFO:tasks.workunit.client.0.smithi142.stdout:4/430: dread - d1/d12/da/d1c/d32/f60 zero size 2024-04-20T21:58:31.817 INFO:tasks.workunit.client.0.smithi142.stdout:2/503: mknod d3/d9/d69/ca4 0 2024-04-20T21:58:31.821 INFO:tasks.workunit.client.0.smithi142.stdout:2/504: truncate d3/d9/f49 1039397 0 2024-04-20T21:58:31.821 INFO:tasks.workunit.client.0.smithi142.stdout:9/516: rename d0/d3c/d4d/f77 to d0/faf 0 2024-04-20T21:58:31.832 INFO:tasks.workunit.client.0.smithi142.stdout:3/457: symlink d6/d32/d39/da2/da7/la9 0 2024-04-20T21:58:31.834 INFO:tasks.workunit.client.0.smithi142.stdout:5/347: dread dc/d71/f42 [0,4194304] 0 2024-04-20T21:58:31.837 INFO:tasks.workunit.client.0.smithi142.stdout:2/505: creat d3/d9/d89/d31/d84/fa5 x:0 0 0 2024-04-20T21:58:31.840 INFO:tasks.workunit.client.0.smithi142.stdout:0/450: dwrite d5/d1c/d3c/d85/d38/f1b [0,4194304] 0 2024-04-20T21:58:31.842 INFO:tasks.workunit.client.0.smithi142.stdout:0/451: chown d5/d13/d1e/d23/d24/l27 10 1 2024-04-20T21:58:31.843 INFO:tasks.workunit.client.0.smithi142.stdout:0/452: chown d5/d1d 10465805 1 2024-04-20T21:58:31.856 INFO:tasks.workunit.client.0.smithi142.stdout:4/431: rename d1/d12/f66 to d1/d12/da/f7f 0 2024-04-20T21:58:31.862 INFO:tasks.workunit.client.0.smithi142.stdout:3/458: creat d6/d15/da4/faa x:0 0 0 2024-04-20T21:58:31.862 INFO:tasks.workunit.client.0.smithi142.stdout:6/404: truncate d1/d5/f66 94656 0 2024-04-20T21:58:31.863 INFO:tasks.workunit.client.0.smithi142.stdout:5/348: dwrite dc/d71/f6e [0,4194304] 0 2024-04-20T21:58:31.863 INFO:tasks.workunit.client.0.smithi142.stdout:0/453: mkdir d5/d1c/d3c/d85/d38/d62/d9a 0 2024-04-20T21:58:31.864 INFO:tasks.workunit.client.0.smithi142.stdout:2/506: fsync d3/d5/d19/d70/f3f 0 2024-04-20T21:58:31.866 INFO:tasks.workunit.client.0.smithi142.stdout:0/454: chown l3 141375 1 2024-04-20T21:58:31.868 INFO:tasks.workunit.client.0.smithi142.stdout:2/507: fsync d3/d9/d34/f41 0 2024-04-20T21:58:31.869 INFO:tasks.workunit.client.0.smithi142.stdout:4/432: mkdir d1/d6/d4a/d5a/d80 0 2024-04-20T21:58:31.871 INFO:tasks.workunit.client.0.smithi142.stdout:6/405: dread - d1/d2f/d35/d5b/d3e/f74 zero size 2024-04-20T21:58:31.876 INFO:tasks.workunit.client.0.smithi142.stdout:0/455: symlink d5/d1d/l9b 0 2024-04-20T21:58:31.883 INFO:tasks.workunit.client.0.smithi142.stdout:5/349: rename dc/d14/c36 to dc/d71/d5c/c76 0 2024-04-20T21:58:31.887 INFO:tasks.workunit.client.0.smithi142.stdout:7/438: dread d4/d9/d1c/d8e/f3a [0,4194304] 0 2024-04-20T21:58:31.887 INFO:tasks.workunit.client.0.smithi142.stdout:4/433: symlink d1/d6/d4b/l81 0 2024-04-20T21:58:31.891 INFO:tasks.workunit.client.0.smithi142.stdout:6/406: mknod d1/d2f/d35/d5b/d63/d34/c8d 0 2024-04-20T21:58:31.894 INFO:tasks.workunit.client.0.smithi142.stdout:3/459: dwrite d6/d15/d1e/d43/d4d/d59/f86 [0,4194304] 0 2024-04-20T21:58:31.902 INFO:tasks.workunit.client.0.smithi142.stdout:6/407: read - d1/d2f/d35/d5b/d39/f3b zero size 2024-04-20T21:58:31.902 INFO:tasks.workunit.client.0.smithi142.stdout:5/350: dread dc/d14/f59 [0,4194304] 0 2024-04-20T21:58:31.909 INFO:tasks.workunit.client.0.smithi142.stdout:3/460: mkdir d6/d15/d1e/dab 0 2024-04-20T21:58:31.910 INFO:tasks.workunit.client.0.smithi142.stdout:2/508: dread d3/d9/d89/f65 [0,4194304] 0 2024-04-20T21:58:31.913 INFO:tasks.workunit.client.0.smithi142.stdout:7/439: creat d4/d9/d11/f9c x:0 0 0 2024-04-20T21:58:31.916 INFO:tasks.workunit.client.0.smithi142.stdout:6/408: creat d1/d2f/d35/d5b/d63/d64/f8e x:0 0 0 2024-04-20T21:58:31.916 INFO:tasks.workunit.client.0.smithi142.stdout:4/434: dread d1/d12/da/f18 [4194304,4194304] 0 2024-04-20T21:58:31.919 INFO:tasks.workunit.client.0.smithi142.stdout:3/461: link d6/d15/d1e/d43/d4d/f97 d6/d15/d47/fac 0 2024-04-20T21:58:31.923 INFO:tasks.workunit.client.0.smithi142.stdout:4/435: rename d1/d5b/f77 to d1/d6/d4b/f82 0 2024-04-20T21:58:31.925 INFO:tasks.workunit.client.0.smithi142.stdout:5/351: dwrite dc/d14/f4d [0,4194304] 0 2024-04-20T21:58:31.927 INFO:tasks.workunit.client.0.smithi142.stdout:3/462: write d6/d15/d47/fac [868195,23495] 0 2024-04-20T21:58:31.929 INFO:tasks.workunit.client.0.smithi142.stdout:6/409: getdents d1/d1b 0 2024-04-20T21:58:31.933 INFO:tasks.workunit.client.0.smithi142.stdout:6/410: read d1/d5/d3a/d43/f89 [2798846,75041] 0 2024-04-20T21:58:31.933 INFO:tasks.workunit.client.0.smithi142.stdout:3/463: truncate d6/d15/d1e/d43/d4d/f6d 992529 0 2024-04-20T21:58:31.943 INFO:tasks.workunit.client.0.smithi142.stdout:6/411: fdatasync d1/d2f/d35/d5b/d3e/f57 0 2024-04-20T21:58:31.945 INFO:tasks.workunit.client.0.smithi142.stdout:3/464: mknod d6/d15/cad 0 2024-04-20T21:58:31.948 INFO:tasks.workunit.client.0.smithi142.stdout:3/465: stat d6/d15/d1e/d43/d4d/f6d 0 2024-04-20T21:58:31.950 INFO:tasks.workunit.client.0.smithi142.stdout:4/436: dwrite d1/d12/da/f5c [0,4194304] 0 2024-04-20T21:58:31.951 INFO:tasks.workunit.client.0.smithi142.stdout:3/466: write d6/d15/d30/d37/d75/f8a [283276,113464] 0 2024-04-20T21:58:31.955 INFO:tasks.workunit.client.0.smithi142.stdout:5/352: write dc/f2b [1373224,24276] 0 2024-04-20T21:58:31.957 INFO:tasks.workunit.client.0.smithi142.stdout:4/437: mknod d1/d6/d30/d4e/c83 0 2024-04-20T21:58:31.966 INFO:tasks.workunit.client.0.smithi142.stdout:4/438: creat d1/d5b/f84 x:0 0 0 2024-04-20T21:58:31.971 INFO:tasks.workunit.client.0.smithi142.stdout:6/412: dwrite d1/d1b/f1e [0,4194304] 0 2024-04-20T21:58:31.977 INFO:tasks.workunit.client.0.smithi142.stdout:4/439: creat d1/d12/da/d1c/d32/d3d/f85 x:0 0 0 2024-04-20T21:58:31.978 INFO:tasks.workunit.client.0.smithi142.stdout:3/467: dwrite d6/d15/d30/f44 [0,4194304] 0 2024-04-20T21:58:31.979 INFO:tasks.workunit.client.0.smithi142.stdout:6/413: write d1/d2f/d35/d48/f73 [1005388,51131] 0 2024-04-20T21:58:31.981 INFO:tasks.workunit.client.0.smithi142.stdout:4/440: dread - d1/d12/da/d1c/d32/d3d/f85 zero size 2024-04-20T21:58:31.982 INFO:tasks.workunit.client.0.smithi142.stdout:3/468: write d6/d15/d1e/f89 [1001333,8490] 0 2024-04-20T21:58:31.984 INFO:tasks.workunit.client.0.smithi142.stdout:4/441: stat d1/d12/da/d1c 0 2024-04-20T21:58:31.984 INFO:tasks.workunit.client.0.smithi142.stdout:5/353: dwrite dc/d14/d21/f27 [0,4194304] 0 2024-04-20T21:58:31.990 INFO:tasks.workunit.client.0.smithi142.stdout:6/414: mkdir d1/d5/d3a/d43/d5c/d8f 0 2024-04-20T21:58:31.994 INFO:tasks.workunit.client.0.smithi142.stdout:3/469: mkdir d6/d15/d30/dae 0 2024-04-20T21:58:32.001 INFO:tasks.workunit.client.0.smithi142.stdout:6/415: creat d1/d2f/d35/d5b/d63/d4b/f90 x:0 0 0 2024-04-20T21:58:32.001 INFO:tasks.workunit.client.0.smithi142.stdout:4/442: mknod d1/d12/da/c86 0 2024-04-20T21:58:32.004 INFO:tasks.workunit.client.0.smithi142.stdout:4/443: write d1/d6/f2d [5144402,73382] 0 2024-04-20T21:58:32.010 INFO:tasks.workunit.client.0.smithi142.stdout:4/444: unlink d1/d6/d4b/c69 0 2024-04-20T21:58:32.015 INFO:tasks.workunit.client.0.smithi142.stdout:3/470: dwrite d6/d32/d9b/fa8 [0,4194304] 0 2024-04-20T21:58:32.017 INFO:tasks.workunit.client.0.smithi142.stdout:4/445: truncate d1/d12/da/d1c/f3b 271248 0 2024-04-20T21:58:32.022 INFO:tasks.workunit.client.0.smithi142.stdout:6/416: dwrite d1/d5/d3a/f42 [0,4194304] 0 2024-04-20T21:58:32.025 INFO:tasks.workunit.client.0.smithi142.stdout:3/471: rename d6/f31 to d6/d15/d1e/dab/faf 0 2024-04-20T21:58:32.025 INFO:tasks.workunit.client.0.smithi142.stdout:8/441: sync 2024-04-20T21:58:32.029 INFO:tasks.workunit.client.0.smithi142.stdout:4/446: mknod d1/d12/c87 0 2024-04-20T21:58:32.031 INFO:tasks.workunit.client.0.smithi142.stdout:6/417: write d1/d2f/d35/d5b/f6f [170561,47660] 0 2024-04-20T21:58:32.033 INFO:tasks.workunit.client.0.smithi142.stdout:5/354: truncate dc/d14/d21/f27 2082157 0 2024-04-20T21:58:32.036 INFO:tasks.workunit.client.0.smithi142.stdout:5/355: chown dc/d14/d25/f3a 168356454 1 2024-04-20T21:58:32.038 INFO:tasks.workunit.client.0.smithi142.stdout:3/472: symlink d6/d15/d1e/lb0 0 2024-04-20T21:58:32.041 INFO:tasks.workunit.client.0.smithi142.stdout:6/418: mknod d1/d11/c91 0 2024-04-20T21:58:32.045 INFO:tasks.workunit.client.0.smithi142.stdout:8/442: mkdir d0/d17/d35/d9d 0 2024-04-20T21:58:32.047 INFO:tasks.workunit.client.0.smithi142.stdout:8/443: dread - d0/d1c/d44/d89/d45/d4c/f77 zero size 2024-04-20T21:58:32.054 INFO:tasks.workunit.client.0.smithi142.stdout:6/419: unlink d1/d2f/d35/d5b/d3e/f5a 0 2024-04-20T21:58:32.059 INFO:tasks.workunit.client.0.smithi142.stdout:4/447: getdents d1/d12/da/d1c/d32/d3d/d2f/d49 0 2024-04-20T21:58:32.061 INFO:tasks.workunit.client.0.smithi142.stdout:4/448: write d1/d6/d30/f3a [742279,28942] 0 2024-04-20T21:58:32.066 INFO:tasks.workunit.client.0.smithi142.stdout:4/449: write d1/f13 [2442996,17409] 0 2024-04-20T21:58:32.068 INFO:tasks.workunit.client.0.smithi142.stdout:8/444: dwrite d0/d1c/d44/f62 [0,4194304] 0 2024-04-20T21:58:32.074 INFO:tasks.workunit.client.0.smithi142.stdout:8/445: write d0/d1c/d44/d89/d45/d4c/f86 [965008,54693] 0 2024-04-20T21:58:32.079 INFO:tasks.workunit.client.0.smithi142.stdout:8/446: chown d0/f96 2 1 2024-04-20T21:58:32.080 INFO:tasks.workunit.client.0.smithi142.stdout:4/450: dread d1/d6/fc [0,4194304] 0 2024-04-20T21:58:32.081 INFO:tasks.workunit.client.0.smithi142.stdout:6/420: dwrite d1/d2f/d35/d48/f73 [0,4194304] 0 2024-04-20T21:58:32.083 INFO:tasks.workunit.client.0.smithi142.stdout:3/473: write d6/d15/d1e/d43/d4d/d59/f62 [45581,100772] 0 2024-04-20T21:58:32.088 INFO:tasks.workunit.client.0.smithi142.stdout:4/451: dread - d1/d12/da/d1c/d32/d3d/d2f/d49/f78 zero size 2024-04-20T21:58:32.088 INFO:tasks.workunit.client.0.smithi142.stdout:8/447: rename d0/d29/f9b to d0/d1c/f9e 0 2024-04-20T21:58:32.091 INFO:tasks.workunit.client.0.smithi142.stdout:3/474: mknod d6/d32/d9b/cb1 0 2024-04-20T21:58:32.096 INFO:tasks.workunit.client.0.smithi142.stdout:6/421: creat d1/d2f/d35/d5b/d63/f92 x:0 0 0 2024-04-20T21:58:32.097 INFO:tasks.workunit.client.0.smithi142.stdout:8/448: read d0/d1c/d44/d89/d45/f4d [96742,58574] 0 2024-04-20T21:58:32.103 INFO:tasks.workunit.client.0.smithi142.stdout:5/356: dwrite dc/d14/f59 [0,4194304] 0 2024-04-20T21:58:32.103 INFO:tasks.workunit.client.0.smithi142.stdout:3/475: creat d6/d15/d1e/fb2 x:0 0 0 2024-04-20T21:58:32.105 INFO:tasks.workunit.client.0.smithi142.stdout:8/449: write d0/d1c/d44/f8b [698098,96247] 0 2024-04-20T21:58:32.106 INFO:tasks.workunit.client.0.smithi142.stdout:6/422: symlink d1/d5/d3a/l93 0 2024-04-20T21:58:32.110 INFO:tasks.workunit.client.0.smithi142.stdout:6/423: fsync d1/d11/f7f 0 2024-04-20T21:58:32.111 INFO:tasks.workunit.client.0.smithi142.stdout:3/476: write d6/d15/d1e/d43/f96 [4754841,75589] 0 2024-04-20T21:58:32.114 INFO:tasks.workunit.client.0.smithi142.stdout:8/450: creat d0/d42/f9f x:0 0 0 2024-04-20T21:58:32.115 INFO:tasks.workunit.client.0.smithi142.stdout:5/357: creat dc/d14/d21/d46/d2a/d57/f77 x:0 0 0 2024-04-20T21:58:32.116 INFO:tasks.workunit.client.0.smithi142.stdout:6/424: chown d1/d2f/d35/d5b/d3e/c79 33267 1 2024-04-20T21:58:32.119 INFO:tasks.workunit.client.0.smithi142.stdout:4/452: dwrite d1/d12/da/d1c/f3b [0,4194304] 0 2024-04-20T21:58:32.119 INFO:tasks.workunit.client.0.smithi142.stdout:8/451: creat d0/d1c/fa0 x:0 0 0 2024-04-20T21:58:32.121 INFO:tasks.workunit.client.0.smithi142.stdout:8/452: chown d0/c27 58 1 2024-04-20T21:58:32.121 INFO:tasks.workunit.client.0.smithi142.stdout:4/453: stat d1/d12/da/d37 0 2024-04-20T21:58:32.122 INFO:tasks.workunit.client.0.smithi142.stdout:5/358: fdatasync f4 0 2024-04-20T21:58:32.127 INFO:tasks.workunit.client.0.smithi142.stdout:5/359: fsync dc/d71/f6e 0 2024-04-20T21:58:32.135 INFO:tasks.workunit.client.0.smithi142.stdout:5/360: mkdir dc/d14/d25/d78 0 2024-04-20T21:58:32.141 INFO:tasks.workunit.client.0.smithi142.stdout:6/425: link d1/d11/c18 d1/d11/c94 0 2024-04-20T21:58:32.146 INFO:tasks.workunit.client.0.smithi142.stdout:3/477: dwrite d6/d15/d1e/d43/d4d/d59/f7d [0,4194304] 0 2024-04-20T21:58:32.155 INFO:tasks.workunit.client.0.smithi142.stdout:3/478: symlink d6/d15/d30/d37/d75/lb3 0 2024-04-20T21:58:32.156 INFO:tasks.workunit.client.0.smithi142.stdout:5/361: mkdir dc/d14/d21/d46/d2a/d65/d79 0 2024-04-20T21:58:32.158 INFO:tasks.workunit.client.0.smithi142.stdout:6/426: dwrite d1/d5/d3a/f42 [0,4194304] 0 2024-04-20T21:58:32.160 INFO:tasks.workunit.client.0.smithi142.stdout:3/479: mkdir d6/d15/d30/db4 0 2024-04-20T21:58:32.166 INFO:tasks.workunit.client.0.smithi142.stdout:3/480: chown d6/d15/d30/d37/d6c/f74 61 1 2024-04-20T21:58:32.169 INFO:tasks.workunit.client.0.smithi142.stdout:5/362: mkdir dc/d71/d7a 0 2024-04-20T21:58:32.172 INFO:tasks.workunit.client.0.smithi142.stdout:3/481: readlink d6/d15/l26 0 2024-04-20T21:58:32.174 INFO:tasks.workunit.client.0.smithi142.stdout:3/482: chown d6/d15/d1e/d43/d4d/l66 22489 1 2024-04-20T21:58:32.175 INFO:tasks.workunit.client.0.smithi142.stdout:8/453: dread d0/d5e/f87 [0,4194304] 0 2024-04-20T21:58:32.175 INFO:tasks.workunit.client.0.smithi142.stdout:6/427: symlink d1/d2f/d6c/d7e/l95 0 2024-04-20T21:58:32.176 INFO:tasks.workunit.client.0.smithi142.stdout:3/483: readlink d6/d32/l58 0 2024-04-20T21:58:32.182 INFO:tasks.workunit.client.0.smithi142.stdout:5/363: chown dc/d14/d21/c67 81750 1 2024-04-20T21:58:32.185 INFO:tasks.workunit.client.0.smithi142.stdout:8/454: symlink d0/d1c/d44/d89/d45/d4c/d68/la1 0 2024-04-20T21:58:32.188 INFO:tasks.workunit.client.0.smithi142.stdout:5/364: creat dc/d14/d25/f7b x:0 0 0 2024-04-20T21:58:32.192 INFO:tasks.workunit.client.0.smithi142.stdout:3/484: link d6/d15/d30/f5c d6/d15/d30/d37/d75/fb5 0 2024-04-20T21:58:32.193 INFO:tasks.workunit.client.0.smithi142.stdout:8/455: creat d0/d42/fa2 x:0 0 0 2024-04-20T21:58:32.195 INFO:tasks.workunit.client.0.smithi142.stdout:6/428: dwrite d1/d2f/d35/d5b/d39/f52 [4194304,4194304] 0 2024-04-20T21:58:32.195 INFO:tasks.workunit.client.0.smithi142.stdout:5/365: rename dc/d71/d7a to dc/d14/d26/d3f/d53/d7c 0 2024-04-20T21:58:32.197 INFO:tasks.workunit.client.0.smithi142.stdout:3/485: chown d6/d32/d39/da2/da7/la9 6479532 1 2024-04-20T21:58:32.201 INFO:tasks.workunit.client.0.smithi142.stdout:5/366: mkdir dc/d14/d21/d46/d7d 0 2024-04-20T21:58:32.201 INFO:tasks.workunit.client.0.smithi142.stdout:3/486: write d6/d15/d47/f61 [277872,29867] 0 2024-04-20T21:58:32.202 INFO:tasks.workunit.client.0.smithi142.stdout:6/429: symlink d1/l96 0 2024-04-20T21:58:32.220 INFO:tasks.workunit.client.0.smithi142.stdout:8/456: fsync d0/d42/fa2 0 2024-04-20T21:58:32.226 INFO:tasks.workunit.client.0.smithi142.stdout:5/367: mknod dc/d14/d26/d3f/d53/c7e 0 2024-04-20T21:58:32.227 INFO:tasks.workunit.client.0.smithi142.stdout:6/430: creat d1/d5/d8b/f97 x:0 0 0 2024-04-20T21:58:32.227 INFO:tasks.workunit.client.0.smithi142.stdout:3/487: mkdir d6/d15/d1e/d43/d4d/d59/db6 0 2024-04-20T21:58:32.228 INFO:tasks.workunit.client.0.smithi142.stdout:8/457: fdatasync d0/d29/f3d 0 2024-04-20T21:58:32.232 INFO:tasks.workunit.client.0.smithi142.stdout:6/431: symlink d1/d2f/d35/d5b/d63/d34/l98 0 2024-04-20T21:58:32.232 INFO:tasks.workunit.client.0.smithi142.stdout:8/458: read d0/f13 [3469237,41023] 0 2024-04-20T21:58:32.233 INFO:tasks.workunit.client.0.smithi142.stdout:3/488: mknod d6/d32/d39/d69/d91/cb7 0 2024-04-20T21:58:32.235 INFO:tasks.workunit.client.0.smithi142.stdout:3/489: chown d6/d15/l16 2021 1 2024-04-20T21:58:32.237 INFO:tasks.workunit.client.0.smithi142.stdout:3/490: write d6/d15/d1e/d43/f6f [22191,107032] 0 2024-04-20T21:58:32.238 INFO:tasks.workunit.client.0.smithi142.stdout:1/416: sync 2024-04-20T21:58:32.241 INFO:tasks.workunit.client.0.smithi142.stdout:3/491: mknod d6/d32/d39/cb8 0 2024-04-20T21:58:32.242 INFO:tasks.workunit.client.0.smithi142.stdout:8/459: dread d0/d29/f3c [0,4194304] 0 2024-04-20T21:58:32.248 INFO:tasks.workunit.client.0.smithi142.stdout:3/492: write d6/d32/f42 [973676,40208] 0 2024-04-20T21:58:32.249 INFO:tasks.workunit.client.0.smithi142.stdout:8/460: creat d0/d1c/d44/d89/fa3 x:0 0 0 2024-04-20T21:58:32.251 INFO:tasks.workunit.client.0.smithi142.stdout:3/493: dread - d6/d15/d30/d37/f60 zero size 2024-04-20T21:58:32.256 INFO:tasks.workunit.client.0.smithi142.stdout:8/461: creat d0/d17/d35/d9d/fa4 x:0 0 0 2024-04-20T21:58:32.257 INFO:tasks.workunit.client.0.smithi142.stdout:3/494: rmdir d6/d32/d39/da2/da7 39 2024-04-20T21:58:32.262 INFO:tasks.workunit.client.0.smithi142.stdout:3/495: mknod d6/d15/d47/d83/cb9 0 2024-04-20T21:58:32.264 INFO:tasks.workunit.client.0.smithi142.stdout:3/496: dread - d6/d15/d30/d37/d6c/f74 zero size 2024-04-20T21:58:32.266 INFO:tasks.workunit.client.0.smithi142.stdout:3/497: readlink d6/d15/l16 0 2024-04-20T21:58:32.273 INFO:tasks.workunit.client.0.smithi142.stdout:3/498: creat d6/d15/d30/fba x:0 0 0 2024-04-20T21:58:32.284 INFO:tasks.workunit.client.0.smithi142.stdout:6/432: dwrite d1/d2f/d35/d5b/d63/f2a [0,4194304] 0 2024-04-20T21:58:32.290 INFO:tasks.workunit.client.0.smithi142.stdout:8/462: dwrite d0/d17/d35/f80 [0,4194304] 0 2024-04-20T21:58:32.292 INFO:tasks.workunit.client.0.smithi142.stdout:6/433: creat d1/d5/d8b/f99 x:0 0 0 2024-04-20T21:58:32.293 INFO:tasks.workunit.client.0.smithi142.stdout:1/417: dwrite d2/dd/d17/f24 [0,4194304] 0 2024-04-20T21:58:32.303 INFO:tasks.workunit.client.0.smithi142.stdout:1/418: mknod d2/dd/d17/d3b/d74/d86/c8f 0 2024-04-20T21:58:32.308 INFO:tasks.workunit.client.0.smithi142.stdout:3/499: dread d6/d15/f19 [0,4194304] 0 2024-04-20T21:58:32.315 INFO:tasks.workunit.client.0.smithi142.stdout:3/500: chown d6/d15/d1e/c49 14014882 1 2024-04-20T21:58:32.316 INFO:tasks.workunit.client.0.smithi142.stdout:6/434: truncate d1/d2f/d35/d5b/d63/d64/f80 1479061 0 2024-04-20T21:58:32.319 INFO:tasks.workunit.client.0.smithi142.stdout:3/501: mknod d6/d15/d1e/d43/d4d/cbb 0 2024-04-20T21:58:32.321 INFO:tasks.workunit.client.0.smithi142.stdout:3/502: chown d6/d15/d30/d37/d75 0 1 2024-04-20T21:58:32.323 INFO:tasks.workunit.client.0.smithi142.stdout:8/463: write d0/d1c/d44/d89/d45/f56 [571718,123440] 0 2024-04-20T21:58:32.324 INFO:tasks.workunit.client.0.smithi142.stdout:3/503: readlink d6/d15/l26 0 2024-04-20T21:58:32.330 INFO:tasks.workunit.client.0.smithi142.stdout:6/435: write d1/d5/f26 [2179142,5711] 0 2024-04-20T21:58:32.331 INFO:tasks.workunit.client.0.smithi142.stdout:8/464: mkdir d0/d1c/d44/d89/d45/d4c/d68/da5 0 2024-04-20T21:58:32.335 INFO:tasks.workunit.client.0.smithi142.stdout:1/419: dwrite d2/dd/d1c/d88/f8d [0,4194304] 0 2024-04-20T21:58:32.337 INFO:tasks.workunit.client.0.smithi142.stdout:8/465: chown d0/d1c/d44/d89/l7d 770314 1 2024-04-20T21:58:32.338 INFO:tasks.workunit.client.0.smithi142.stdout:8/466: readlink d0/d22/l2a 0 2024-04-20T21:58:32.339 INFO:tasks.workunit.client.0.smithi142.stdout:1/420: creat d2/dd/d17/d1b/d22/d55/f90 x:0 0 0 2024-04-20T21:58:32.340 INFO:tasks.workunit.client.0.smithi142.stdout:8/467: chown d0/d1c/d44/d89/d45/d4c/d68/c93 0 1 2024-04-20T21:58:32.344 INFO:tasks.workunit.client.0.smithi142.stdout:8/468: creat d0/d1c/d44/d89/d45/d4c/d68/fa6 x:0 0 0 2024-04-20T21:58:32.348 INFO:tasks.workunit.client.0.smithi142.stdout:8/469: mkdir d0/da7 0 2024-04-20T21:58:32.353 INFO:tasks.workunit.client.0.smithi142.stdout:8/470: creat d0/d1c/d44/d89/d45/d92/fa8 x:0 0 0 2024-04-20T21:58:32.357 INFO:tasks.workunit.client.0.smithi142.stdout:8/471: symlink d0/d1c/d44/d89/d45/d59/la9 0 2024-04-20T21:58:32.360 INFO:tasks.workunit.client.0.smithi142.stdout:8/472: symlink d0/d22/d3f/d7f/laa 0 2024-04-20T21:58:32.362 INFO:tasks.workunit.client.0.smithi142.stdout:8/473: chown d0/d1c/d44/d89/d45/d4c/d68 114 1 2024-04-20T21:58:32.363 INFO:tasks.workunit.client.0.smithi142.stdout:3/504: dread d6/d15/d30/d37/f3d [0,4194304] 0 2024-04-20T21:58:32.365 INFO:tasks.workunit.client.0.smithi142.stdout:8/474: symlink d0/d5e/lab 0 2024-04-20T21:58:32.366 INFO:tasks.workunit.client.0.smithi142.stdout:3/505: mkdir d6/d15/d30/d37/d75/dbc 0 2024-04-20T21:58:32.374 INFO:tasks.workunit.client.0.smithi142.stdout:2/509: sync 2024-04-20T21:58:32.374 INFO:tasks.workunit.client.0.smithi142.stdout:4/454: sync 2024-04-20T21:58:32.374 INFO:tasks.workunit.client.0.smithi142.stdout:7/440: sync 2024-04-20T21:58:32.374 INFO:tasks.workunit.client.0.smithi142.stdout:9/517: sync 2024-04-20T21:58:32.374 INFO:tasks.workunit.client.0.smithi142.stdout:0/456: sync 2024-04-20T21:58:32.377 INFO:tasks.workunit.client.0.smithi142.stdout:3/506: dread d6/d32/f42 [0,4194304] 0 2024-04-20T21:58:32.377 INFO:tasks.workunit.client.0.smithi142.stdout:0/457: write d5/d13/f2f [4390072,87979] 0 2024-04-20T21:58:32.383 INFO:tasks.workunit.client.0.smithi142.stdout:9/518: truncate d0/d2a/f7c 309627 0 2024-04-20T21:58:32.383 INFO:tasks.workunit.client.0.smithi142.stdout:2/510: chown d3/d5/d19/f21 232 1 2024-04-20T21:58:32.383 INFO:tasks.workunit.client.0.smithi142.stdout:4/455: creat d1/d12/da/d1c/f88 x:0 0 0 2024-04-20T21:58:32.383 INFO:tasks.workunit.client.0.smithi142.stdout:7/441: write d4/d9/d1c/d5e/f51 [3065870,103686] 0 2024-04-20T21:58:32.388 INFO:tasks.workunit.client.0.smithi142.stdout:4/456: dread - d1/d12/da/d1c/d32/d3d/f6c zero size 2024-04-20T21:58:32.388 INFO:tasks.workunit.client.0.smithi142.stdout:0/458: dread d5/d1c/f71 [0,4194304] 0 2024-04-20T21:58:32.391 INFO:tasks.workunit.client.0.smithi142.stdout:8/475: write d0/f20 [2251472,62771] 0 2024-04-20T21:58:32.392 INFO:tasks.workunit.client.0.smithi142.stdout:2/511: rename d3/d9/f33 to d3/d9/da0/fa6 0 2024-04-20T21:58:32.397 INFO:tasks.workunit.client.0.smithi142.stdout:8/476: readlink d0/l16 0 2024-04-20T21:58:32.400 INFO:tasks.workunit.client.0.smithi142.stdout:9/519: write d0/d36/f41 [822722,37659] 0 2024-04-20T21:58:32.401 INFO:tasks.workunit.client.0.smithi142.stdout:0/459: mkdir d5/d13/d1e/d23/d24/d48/d55/d9c 0 2024-04-20T21:58:32.401 INFO:tasks.workunit.client.0.smithi142.stdout:7/442: dread d4/d9/f75 [0,4194304] 0 2024-04-20T21:58:32.403 INFO:tasks.workunit.client.0.smithi142.stdout:9/520: readlink d0/d36/d55/l8c 0 2024-04-20T21:58:32.405 INFO:tasks.workunit.client.0.smithi142.stdout:3/507: dwrite d6/d32/d39/d69/f78 [0,4194304] 0 2024-04-20T21:58:32.406 INFO:tasks.workunit.client.0.smithi142.stdout:8/477: rename d0/d1c/d44/d89/l84 to d0/d22/lac 0 2024-04-20T21:58:32.408 INFO:tasks.workunit.client.0.smithi142.stdout:3/508: dread - d6/d32/d39/f7b zero size 2024-04-20T21:58:32.408 INFO:tasks.workunit.client.0.smithi142.stdout:4/457: dread d1/d12/da/d1c/f26 [0,4194304] 0 2024-04-20T21:58:32.411 INFO:tasks.workunit.client.0.smithi142.stdout:9/521: truncate d0/d2a/d39/d87/f92 44150 0 2024-04-20T21:58:32.411 INFO:tasks.workunit.client.0.smithi142.stdout:8/478: write d0/d1c/fa0 [125634,94682] 0 2024-04-20T21:58:32.414 INFO:tasks.workunit.client.0.smithi142.stdout:0/460: mknod d5/d1c/d3c/d85/d32/c9d 0 2024-04-20T21:58:32.415 INFO:tasks.workunit.client.0.smithi142.stdout:4/458: chown d1/d12/da/d1c/d32/d3d/d2f/d49/f75 12 1 2024-04-20T21:58:32.416 INFO:tasks.workunit.client.0.smithi142.stdout:3/509: read d6/f2e [782630,127487] 0 2024-04-20T21:58:32.418 INFO:tasks.workunit.client.0.smithi142.stdout:8/479: stat d0/d1c/d44/d89/d45/d4c/d68/fa6 0 2024-04-20T21:58:32.425 INFO:tasks.workunit.client.0.smithi142.stdout:4/459: mkdir d1/d12/da/d37/d89 0 2024-04-20T21:58:32.425 INFO:tasks.workunit.client.0.smithi142.stdout:3/510: truncate d6/d15/d1e/d43/d4d/d6e/f93 8828080 0 2024-04-20T21:58:32.428 INFO:tasks.workunit.client.0.smithi142.stdout:0/461: mknod d5/d1c/d3c/d85/d38/d62/d9a/c9e 0 2024-04-20T21:58:32.428 INFO:tasks.workunit.client.0.smithi142.stdout:4/460: chown d1/d12/da/d1c/f26 609648283 1 2024-04-20T21:58:32.431 INFO:tasks.workunit.client.0.smithi142.stdout:7/443: dread d4/d9/d1c/d8e/f7a [0,4194304] 0 2024-04-20T21:58:32.432 INFO:tasks.workunit.client.0.smithi142.stdout:8/480: mkdir d0/d1c/d44/dad 0 2024-04-20T21:58:32.433 INFO:tasks.workunit.client.0.smithi142.stdout:9/522: write d0/f21 [641869,97669] 0 2024-04-20T21:58:32.433 INFO:tasks.workunit.client.0.smithi142.stdout:3/511: mknod d6/d15/d30/d37/cbd 0 2024-04-20T21:58:32.435 INFO:tasks.workunit.client.0.smithi142.stdout:0/462: mknod d5/d1c/d3c/d95/c9f 0 2024-04-20T21:58:32.435 INFO:tasks.workunit.client.0.smithi142.stdout:2/512: dread d3/d9/d34/f41 [0,4194304] 0 2024-04-20T21:58:32.436 INFO:tasks.workunit.client.0.smithi142.stdout:7/444: dread - d4/d7f/d77/d78/d9b/d5a/d62/f6a zero size 2024-04-20T21:58:32.438 INFO:tasks.workunit.client.0.smithi142.stdout:0/463: chown d5/d13/l20 2863448 1 2024-04-20T21:58:32.441 INFO:tasks.workunit.client.0.smithi142.stdout:9/523: creat d0/fb0 x:0 0 0 2024-04-20T21:58:32.441 INFO:tasks.workunit.client.0.smithi142.stdout:7/445: creat d4/d9/d1c/d5e/f9d x:0 0 0 2024-04-20T21:58:32.445 INFO:tasks.workunit.client.0.smithi142.stdout:3/512: creat d6/d15/d30/d37/d75/fbe x:0 0 0 2024-04-20T21:58:32.445 INFO:tasks.workunit.client.0.smithi142.stdout:2/513: mkdir d3/d9/d89/d31/da7 0 2024-04-20T21:58:32.446 INFO:tasks.workunit.client.0.smithi142.stdout:0/464: write d5/f8 [5464886,11424] 0 2024-04-20T21:58:32.447 INFO:tasks.workunit.client.0.smithi142.stdout:2/514: chown d3/d5/d19/c3a 57749 1 2024-04-20T21:58:32.449 INFO:tasks.workunit.client.0.smithi142.stdout:3/513: write d6/d15/d30/d37/d75/fbe [769021,56106] 0 2024-04-20T21:58:32.455 INFO:tasks.workunit.client.0.smithi142.stdout:8/481: dwrite d0/d42/fa2 [0,4194304] 0 2024-04-20T21:58:32.458 INFO:tasks.workunit.client.0.smithi142.stdout:9/524: link d0/c1f d0/cb1 0 2024-04-20T21:58:32.462 INFO:tasks.workunit.client.0.smithi142.stdout:3/514: mknod d6/d15/d30/db4/cbf 0 2024-04-20T21:58:32.463 INFO:tasks.workunit.client.0.smithi142.stdout:8/482: stat d0/d22/l60 0 2024-04-20T21:58:32.464 INFO:tasks.workunit.client.0.smithi142.stdout:9/525: symlink d0/d91/lb2 0 2024-04-20T21:58:32.474 INFO:tasks.workunit.client.0.smithi142.stdout:8/483: creat d0/d17/d35/fae x:0 0 0 2024-04-20T21:58:32.475 INFO:tasks.workunit.client.0.smithi142.stdout:2/515: dwrite d3/d9/d89/d31/f73 [0,4194304] 0 2024-04-20T21:58:32.475 INFO:tasks.workunit.client.0.smithi142.stdout:7/446: truncate d4/d7f/f60 863330 0 2024-04-20T21:58:32.481 INFO:tasks.workunit.client.0.smithi142.stdout:8/484: creat d0/d22/d3f/faf x:0 0 0 2024-04-20T21:58:32.489 INFO:tasks.workunit.client.0.smithi142.stdout:9/526: dwrite d0/d3c/d4d/d63/f65 [0,4194304] 0 2024-04-20T21:58:32.490 INFO:tasks.workunit.client.0.smithi142.stdout:2/516: fdatasync d3/d5/d19/f59 0 2024-04-20T21:58:32.494 INFO:tasks.workunit.client.0.smithi142.stdout:7/447: write d4/f2d [1125599,60531] 0 2024-04-20T21:58:32.495 INFO:tasks.workunit.client.0.smithi142.stdout:8/485: truncate d0/d29/f37 1296146 0 2024-04-20T21:58:32.499 INFO:tasks.workunit.client.0.smithi142.stdout:8/486: fsync d0/d1c/f31 0 2024-04-20T21:58:32.501 INFO:tasks.workunit.client.0.smithi142.stdout:0/465: dwrite d5/d1d/f4e [4194304,4194304] 0 2024-04-20T21:58:32.502 INFO:tasks.workunit.client.0.smithi142.stdout:2/517: creat d3/d9/d89/d31/da2/fa8 x:0 0 0 2024-04-20T21:58:32.503 INFO:tasks.workunit.client.0.smithi142.stdout:7/448: chown d4/d7f/d77/d78/d9b/l57 41959684 1 2024-04-20T21:58:32.507 INFO:tasks.workunit.client.0.smithi142.stdout:0/466: write d5/f8 [2992126,65097] 0 2024-04-20T21:58:32.511 INFO:tasks.workunit.client.0.smithi142.stdout:8/487: rename d0/d5e/lab to d0/d42/d90/lb0 0 2024-04-20T21:58:32.516 INFO:tasks.workunit.client.0.smithi142.stdout:2/518: creat d3/d9/da3/fa9 x:0 0 0 2024-04-20T21:58:32.518 INFO:tasks.workunit.client.0.smithi142.stdout:8/488: chown d0/d1c/d44/c8e 362 1 2024-04-20T21:58:32.519 INFO:tasks.workunit.client.0.smithi142.stdout:7/449: creat d4/d9/d1c/d8e/d88/f9e x:0 0 0 2024-04-20T21:58:32.523 INFO:tasks.workunit.client.0.smithi142.stdout:8/489: readlink d0/d17/d6e/l73 0 2024-04-20T21:58:32.528 INFO:tasks.workunit.client.0.smithi142.stdout:7/450: read - d4/d7f/d77/d78/d9b/d5a/d90/f98 zero size 2024-04-20T21:58:32.533 INFO:tasks.workunit.client.0.smithi142.stdout:9/527: dwrite d0/d3c/d4d/d63/f7f [0,4194304] 0 2024-04-20T21:58:32.533 INFO:tasks.workunit.client.0.smithi142.stdout:3/515: dread d6/f8 [0,4194304] 0 2024-04-20T21:58:32.537 INFO:tasks.workunit.client.0.smithi142.stdout:3/516: dread - d6/d15/d1e/d43/f70 zero size 2024-04-20T21:58:32.538 INFO:tasks.workunit.client.0.smithi142.stdout:0/467: truncate d5/f8 431934 0 2024-04-20T21:58:32.539 INFO:tasks.workunit.client.0.smithi142.stdout:9/528: write d0/d2a/f42 [2630068,11622] 0 2024-04-20T21:58:32.544 INFO:tasks.workunit.client.0.smithi142.stdout:8/490: rename d0/d29/c6a to d0/d22/d3f/cb1 0 2024-04-20T21:58:32.544 INFO:tasks.workunit.client.0.smithi142.stdout:7/451: creat d4/d9/d1c/d8e/d88/f9f x:0 0 0 2024-04-20T21:58:32.545 INFO:tasks.workunit.client.0.smithi142.stdout:8/491: dread - d0/d42/f9f zero size 2024-04-20T21:58:32.552 INFO:tasks.workunit.client.0.smithi142.stdout:9/529: mkdir d0/d2a/d39/d87/d9e/db3 0 2024-04-20T21:58:32.552 INFO:tasks.workunit.client.0.smithi142.stdout:7/452: creat d4/d7f/d77/d78/d9b/d5a/d90/fa0 x:0 0 0 2024-04-20T21:58:32.553 INFO:tasks.workunit.client.0.smithi142.stdout:8/492: rmdir d0/d1c/d44/d89/d45 39 2024-04-20T21:58:32.558 INFO:tasks.workunit.client.0.smithi142.stdout:0/468: write d5/d1c/f52 [344118,48205] 0 2024-04-20T21:58:32.560 INFO:tasks.workunit.client.0.smithi142.stdout:8/493: write d0/f1b [2246627,13492] 0 2024-04-20T21:58:32.560 INFO:tasks.workunit.client.0.smithi142.stdout:9/530: mkdir d0/d91/db4 0 2024-04-20T21:58:32.564 INFO:tasks.workunit.client.0.smithi142.stdout:7/453: mkdir d4/d7d/da1 0 2024-04-20T21:58:32.565 INFO:tasks.workunit.client.0.smithi142.stdout:2/519: dread d3/d5/f17 [4194304,4194304] 0 2024-04-20T21:58:32.568 INFO:tasks.workunit.client.0.smithi142.stdout:5/368: sync 2024-04-20T21:58:32.572 INFO:tasks.workunit.client.0.smithi142.stdout:3/517: dwrite d6/d15/d1e/d43/d4d/f8b [0,4194304] 0 2024-04-20T21:58:32.573 INFO:tasks.workunit.client.0.smithi142.stdout:9/531: rename d0/d2a/la6 to d0/d2a/d39/d87/lb5 0 2024-04-20T21:58:32.576 INFO:tasks.workunit.client.0.smithi142.stdout:9/532: chown d0/d3c/d4d/d63/cab 429629466 1 2024-04-20T21:58:32.577 INFO:tasks.workunit.client.0.smithi142.stdout:0/469: mkdir d5/d1c/d3c/d85/da0 0 2024-04-20T21:58:32.580 INFO:tasks.workunit.client.0.smithi142.stdout:3/518: truncate d6/d15/d1e/f87 884421 0 2024-04-20T21:58:32.583 INFO:tasks.workunit.client.0.smithi142.stdout:9/533: read d0/f25 [59804,118722] 0 2024-04-20T21:58:32.583 INFO:tasks.workunit.client.0.smithi142.stdout:2/520: mknod d3/d5/d74/caa 0 2024-04-20T21:58:32.583 INFO:tasks.workunit.client.0.smithi142.stdout:8/494: creat d0/d1c/d44/d89/fb2 x:0 0 0 2024-04-20T21:58:32.583 INFO:tasks.workunit.client.0.smithi142.stdout:6/436: sync 2024-04-20T21:58:32.583 INFO:tasks.workunit.client.0.smithi142.stdout:1/421: sync 2024-04-20T21:58:32.583 INFO:tasks.workunit.client.0.smithi142.stdout:4/461: sync 2024-04-20T21:58:32.595 INFO:tasks.workunit.client.0.smithi142.stdout:8/495: write d0/d5e/f87 [2911779,113855] 0 2024-04-20T21:58:32.596 INFO:tasks.workunit.client.0.smithi142.stdout:9/534: write d0/f31 [726321,10106] 0 2024-04-20T21:58:32.596 INFO:tasks.workunit.client.0.smithi142.stdout:3/519: symlink d6/d15/d1e/d43/d4d/d59/db6/lc0 0 2024-04-20T21:58:32.596 INFO:tasks.workunit.client.0.smithi142.stdout:6/437: fdatasync d1/d2f/d35/d5b/d39/f52 0 2024-04-20T21:58:32.602 INFO:tasks.workunit.client.0.smithi142.stdout:7/454: rename d4/d7f/d77/d78/d9b/d5a/c71 to d4/ca2 0 2024-04-20T21:58:32.604 INFO:tasks.workunit.client.0.smithi142.stdout:5/369: dwrite dc/d14/d21/f6c [0,4194304] 0 2024-04-20T21:58:32.607 INFO:tasks.workunit.client.0.smithi142.stdout:3/520: read d6/d15/d1e/d43/d4d/f6d [322883,118835] 0 2024-04-20T21:58:32.611 INFO:tasks.workunit.client.0.smithi142.stdout:6/438: write d1/d5/d3a/d43/d5c/f7c [409130,26676] 0 2024-04-20T21:58:32.613 INFO:tasks.workunit.client.0.smithi142.stdout:4/462: mknod d1/d12/da/d1c/d32/d3d/d2f/d7a/c8a 0 2024-04-20T21:58:32.619 INFO:tasks.workunit.client.0.smithi142.stdout:5/370: dread dc/d14/f37 [0,4194304] 0 2024-04-20T21:58:32.619 INFO:tasks.workunit.client.0.smithi142.stdout:1/422: creat d2/dd/d17/d1b/d22/f91 x:0 0 0 2024-04-20T21:58:32.623 INFO:tasks.workunit.client.0.smithi142.stdout:5/371: dread - dc/d14/d21/f6f zero size 2024-04-20T21:58:32.627 INFO:tasks.workunit.client.0.smithi142.stdout:3/521: creat d6/d15/d1e/d43/d4d/d59/db6/fc1 x:0 0 0 2024-04-20T21:58:32.628 INFO:tasks.workunit.client.0.smithi142.stdout:8/496: rename d0/d22 to d0/d1c/d44/dad/db3 0 2024-04-20T21:58:32.632 INFO:tasks.workunit.client.0.smithi142.stdout:0/470: dwrite d5/d45/f50 [0,4194304] 0 2024-04-20T21:58:32.632 INFO:tasks.workunit.client.0.smithi142.stdout:4/463: mknod d1/d12/da/d72/c8b 0 2024-04-20T21:58:32.645 INFO:tasks.workunit.client.0.smithi142.stdout:2/521: dread d3/d9/d89/d31/f54 [0,4194304] 0 2024-04-20T21:58:32.645 INFO:tasks.workunit.client.0.smithi142.stdout:1/423: rename d2/dd/d17/d1b/d22/l40 to d2/dd/d1c/d88/d89/l92 0 2024-04-20T21:58:32.649 INFO:tasks.workunit.client.0.smithi142.stdout:6/439: dwrite d1/d1b/f51 [4194304,4194304] 0 2024-04-20T21:58:32.654 INFO:tasks.workunit.client.0.smithi142.stdout:6/440: fdatasync d1/d5/d8b/f97 0 2024-04-20T21:58:32.657 INFO:tasks.workunit.client.0.smithi142.stdout:0/471: dread d5/d1c/d3c/d85/d63/f64 [0,4194304] 0 2024-04-20T21:58:32.659 INFO:tasks.workunit.client.0.smithi142.stdout:1/424: mknod d2/d4e/c93 0 2024-04-20T21:58:32.659 INFO:tasks.workunit.client.0.smithi142.stdout:2/522: symlink d3/d9/d89/d9a/lab 0 2024-04-20T21:58:32.659 INFO:tasks.workunit.client.0.smithi142.stdout:3/522: dread d6/f9c [4194304,4194304] 0 2024-04-20T21:58:32.665 INFO:tasks.workunit.client.0.smithi142.stdout:9/535: dwrite d0/d2a/d39/d50/f6b [0,4194304] 0 2024-04-20T21:58:32.669 INFO:tasks.workunit.client.0.smithi142.stdout:0/472: fdatasync d5/d1c/f5c 0 2024-04-20T21:58:32.672 INFO:tasks.workunit.client.0.smithi142.stdout:5/372: dread dc/d14/f4d [0,4194304] 0 2024-04-20T21:58:32.673 INFO:tasks.workunit.client.0.smithi142.stdout:0/473: symlink d5/d45/la1 0 2024-04-20T21:58:32.678 INFO:tasks.workunit.client.0.smithi142.stdout:1/425: creat d2/dd/d17/d3b/d50/d62/f94 x:0 0 0 2024-04-20T21:58:32.678 INFO:tasks.workunit.client.0.smithi142.stdout:8/497: dwrite d0/d17/d35/f80 [0,4194304] 0 2024-04-20T21:58:32.678 INFO:tasks.workunit.client.0.smithi142.stdout:3/523: creat d6/d15/d1e/dab/fc2 x:0 0 0 2024-04-20T21:58:32.680 INFO:tasks.workunit.client.0.smithi142.stdout:2/523: getdents d3/d5/d67 0 2024-04-20T21:58:32.680 INFO:tasks.workunit.client.0.smithi142.stdout:9/536: mknod d0/d91/da0/cb6 0 2024-04-20T21:58:32.685 INFO:tasks.workunit.client.0.smithi142.stdout:6/441: write d1/d5/f38 [2457541,89322] 0 2024-04-20T21:58:32.685 INFO:tasks.workunit.client.0.smithi142.stdout:9/537: creat d0/d91/fb7 x:0 0 0 2024-04-20T21:58:32.692 INFO:tasks.workunit.client.0.smithi142.stdout:0/474: rename d5/d1c/f8a to d5/d45/d6f/d70/fa2 0 2024-04-20T21:58:32.692 INFO:tasks.workunit.client.0.smithi142.stdout:3/524: truncate d6/fc 2116975 0 2024-04-20T21:58:32.693 INFO:tasks.workunit.client.0.smithi142.stdout:2/524: rename d3/d5 to d3/d5/d19/d70/dac 22 2024-04-20T21:58:32.695 INFO:tasks.workunit.client.0.smithi142.stdout:3/525: chown d6/d32/l58 736996424 1 2024-04-20T21:58:32.697 INFO:tasks.workunit.client.0.smithi142.stdout:9/538: readlink d0/l5 0 2024-04-20T21:58:32.698 INFO:tasks.workunit.client.0.smithi142.stdout:3/526: chown d6/d32/l77 36 1 2024-04-20T21:58:32.699 INFO:tasks.workunit.client.0.smithi142.stdout:1/426: rmdir d2/dd/d1c/d43/d87 0 2024-04-20T21:58:32.700 INFO:tasks.workunit.client.0.smithi142.stdout:6/442: rename d1/d2f/d35/d5b/d63/d34/c8d to d1/d2f/d35/d5b/d63/c9a 0 2024-04-20T21:58:32.701 INFO:tasks.workunit.client.0.smithi142.stdout:3/527: fdatasync d6/d15/d47/f61 0 2024-04-20T21:58:32.703 INFO:tasks.workunit.client.0.smithi142.stdout:3/528: fdatasync d6/d15/d1e/d43/fa5 0 2024-04-20T21:58:32.704 INFO:tasks.workunit.client.0.smithi142.stdout:9/539: symlink d0/d2a/d9c/lb8 0 2024-04-20T21:58:32.705 INFO:tasks.workunit.client.0.smithi142.stdout:3/529: readlink d6/d15/d30/l94 0 2024-04-20T21:58:32.707 INFO:tasks.workunit.client.0.smithi142.stdout:3/530: write d6/d15/f8c [834393,104323] 0 2024-04-20T21:58:32.709 INFO:tasks.workunit.client.0.smithi142.stdout:6/443: rmdir d1/d1b 39 2024-04-20T21:58:32.711 INFO:tasks.workunit.client.0.smithi142.stdout:5/373: truncate dc/d14/f1a 5840402 0 2024-04-20T21:58:32.712 INFO:tasks.workunit.client.0.smithi142.stdout:1/427: fsync d2/dd/d17/d1b/d22/f46 0 2024-04-20T21:58:32.715 INFO:tasks.workunit.client.0.smithi142.stdout:8/498: creat d0/d1c/d44/d89/d45/fb4 x:0 0 0 2024-04-20T21:58:32.723 INFO:tasks.workunit.client.0.smithi142.stdout:2/525: write d3/d5/f40 [2921000,94994] 0 2024-04-20T21:58:32.723 INFO:tasks.workunit.client.0.smithi142.stdout:3/531: mknod d6/d32/d39/d69/cc3 0 2024-04-20T21:58:32.723 INFO:tasks.workunit.client.0.smithi142.stdout:6/444: fdatasync d1/d5/f14 0 2024-04-20T21:58:32.732 INFO:tasks.workunit.client.0.smithi142.stdout:1/428: dwrite d2/dd/d17/d1b/d22/f91 [0,4194304] 0 2024-04-20T21:58:32.732 INFO:tasks.workunit.client.0.smithi142.stdout:2/526: fsync d3/d5/f60 0 2024-04-20T21:58:32.734 INFO:tasks.workunit.client.0.smithi142.stdout:8/499: rmdir d0/d1c/d44 39 2024-04-20T21:58:32.738 INFO:tasks.workunit.client.0.smithi142.stdout:0/475: truncate d5/d45/d6f/f81 1205130 0 2024-04-20T21:58:32.741 INFO:tasks.workunit.client.0.smithi142.stdout:5/374: mkdir dc/d14/d21/d7f 0 2024-04-20T21:58:32.741 INFO:tasks.workunit.client.0.smithi142.stdout:6/445: write d1/d1b/f51 [2823649,83623] 0 2024-04-20T21:58:32.743 INFO:tasks.workunit.client.0.smithi142.stdout:1/429: dread d2/dd/d17/d1b/d22/d13/f63 [0,4194304] 0 2024-04-20T21:58:32.745 INFO:tasks.workunit.client.0.smithi142.stdout:9/540: link d0/d91/da0/cb6 d0/d2a/d8b/cb9 0 2024-04-20T21:58:32.749 INFO:tasks.workunit.client.0.smithi142.stdout:6/446: chown d1/d2f/d35/d5b/d63/c68 45 1 2024-04-20T21:58:32.751 INFO:tasks.workunit.client.0.smithi142.stdout:6/447: dread - d1/d5/d8b/f97 zero size 2024-04-20T21:58:32.754 INFO:tasks.workunit.client.0.smithi142.stdout:2/527: dwrite d3/d5/f40 [0,4194304] 0 2024-04-20T21:58:32.755 INFO:tasks.workunit.client.0.smithi142.stdout:8/500: mkdir d0/d17/d35/db5 0 2024-04-20T21:58:32.756 INFO:tasks.workunit.client.0.smithi142.stdout:8/501: fsync d0/d29/f6c 0 2024-04-20T21:58:32.775 INFO:tasks.workunit.client.0.smithi142.stdout:8/502: stat d0/d1c/d44/dad/db3/l43 0 2024-04-20T21:58:32.776 INFO:tasks.workunit.client.0.smithi142.stdout:9/541: dread d0/f86 [0,4194304] 0 2024-04-20T21:58:32.776 INFO:tasks.workunit.client.0.smithi142.stdout:3/532: truncate d6/d32/f42 465006 0 2024-04-20T21:58:32.778 INFO:tasks.workunit.client.0.smithi142.stdout:0/476: symlink d5/la3 0 2024-04-20T21:58:32.778 INFO:tasks.workunit.client.0.smithi142.stdout:9/542: chown d0/d2a/f4f 299951515 1 2024-04-20T21:58:32.781 INFO:tasks.workunit.client.0.smithi142.stdout:0/477: dread - d5/d1c/d3c/d85/d63/f99 zero size 2024-04-20T21:58:32.783 INFO:tasks.workunit.client.0.smithi142.stdout:5/375: link dc/d71/f5e dc/d14/d26/d3f/d53/f80 0 2024-04-20T21:58:32.786 INFO:tasks.workunit.client.0.smithi142.stdout:5/376: write dc/f1d [2647026,52151] 0 2024-04-20T21:58:32.792 INFO:tasks.workunit.client.0.smithi142.stdout:1/430: creat d2/dd/d17/d3b/f95 x:0 0 0 2024-04-20T21:58:32.793 INFO:tasks.workunit.client.0.smithi142.stdout:9/543: creat d0/d89/fba x:0 0 0 2024-04-20T21:58:32.793 INFO:tasks.workunit.client.0.smithi142.stdout:0/478: mknod d5/d13/d1e/d23/d24/ca4 0 2024-04-20T21:58:32.794 INFO:tasks.workunit.client.0.smithi142.stdout:6/448: unlink d1/d2f/d35/d5b/d63/d4b/d83/f22 0 2024-04-20T21:58:32.796 INFO:tasks.workunit.client.0.smithi142.stdout:7/455: sync 2024-04-20T21:58:32.799 INFO:tasks.workunit.client.0.smithi142.stdout:8/503: dwrite d0/d29/f4a [4194304,4194304] 0 2024-04-20T21:58:32.801 INFO:tasks.workunit.client.0.smithi142.stdout:2/528: link d3/d9/d34/f3b d3/fad 0 2024-04-20T21:58:32.804 INFO:tasks.workunit.client.0.smithi142.stdout:8/504: write d0/d17/d35/d9d/fa4 [706472,59195] 0 2024-04-20T21:58:32.804 INFO:tasks.workunit.client.0.smithi142.stdout:2/529: fsync d3/d9/d89/d31/f6a 0 2024-04-20T21:58:32.806 INFO:tasks.workunit.client.0.smithi142.stdout:5/377: rename dc/d14/d21/c67 to dc/d14/d21/d46/d2a/d57/c81 0 2024-04-20T21:58:32.809 INFO:tasks.workunit.client.0.smithi142.stdout:2/530: fsync d3/d5/d19/d70/f43 0 2024-04-20T21:58:32.809 INFO:tasks.workunit.client.0.smithi142.stdout:8/505: chown d0/d1c/d44/d89/c8a 8 1 2024-04-20T21:58:32.810 INFO:tasks.workunit.client.0.smithi142.stdout:7/456: creat d4/d7f/fa3 x:0 0 0 2024-04-20T21:58:32.813 INFO:tasks.workunit.client.0.smithi142.stdout:0/479: creat d5/d1c/d3c/fa5 x:0 0 0 2024-04-20T21:58:32.816 INFO:tasks.workunit.client.0.smithi142.stdout:1/431: unlink d2/dd/d17/f47 0 2024-04-20T21:58:32.821 INFO:tasks.workunit.client.0.smithi142.stdout:5/378: rename ca to dc/d14/d21/d46/d7d/c82 0 2024-04-20T21:58:32.821 INFO:tasks.workunit.client.0.smithi142.stdout:2/531: dread - d3/d9/d89/d31/da2/fa8 zero size 2024-04-20T21:58:32.825 INFO:tasks.workunit.client.0.smithi142.stdout:8/506: creat d0/d1c/d44/dad/fb6 x:0 0 0 2024-04-20T21:58:32.832 INFO:tasks.workunit.client.0.smithi142.stdout:5/379: creat dc/d71/f83 x:0 0 0 2024-04-20T21:58:32.836 INFO:tasks.workunit.client.0.smithi142.stdout:5/380: stat dc/d14/f1e 0 2024-04-20T21:58:32.836 INFO:tasks.workunit.client.0.smithi142.stdout:2/532: dread - d3/d5/d19/d70/d3c/f9f zero size 2024-04-20T21:58:32.836 INFO:tasks.workunit.client.0.smithi142.stdout:6/449: dread d1/d11/f44 [0,4194304] 0 2024-04-20T21:58:32.838 INFO:tasks.workunit.client.0.smithi142.stdout:3/533: dwrite d6/d32/d39/f81 [0,4194304] 0 2024-04-20T21:58:32.838 INFO:tasks.workunit.client.0.smithi142.stdout:1/432: rmdir d2/dd/d17/d3b/d50/d62 39 2024-04-20T21:58:32.845 INFO:tasks.workunit.client.0.smithi142.stdout:9/544: dwrite d0/d2a/f37 [0,4194304] 0 2024-04-20T21:58:32.845 INFO:tasks.workunit.client.0.smithi142.stdout:8/507: symlink d0/d42/d90/lb7 0 2024-04-20T21:58:32.848 INFO:tasks.workunit.client.0.smithi142.stdout:7/457: dwrite d4/d9/d1c/d8e/d88/f9e [0,4194304] 0 2024-04-20T21:58:32.858 INFO:tasks.workunit.client.0.smithi142.stdout:6/450: creat d1/d2f/d35/d5b/d3e/f9b x:0 0 0 2024-04-20T21:58:32.859 INFO:tasks.workunit.client.0.smithi142.stdout:1/433: symlink d2/dd/d17/d3b/d74/l96 0 2024-04-20T21:58:32.862 INFO:tasks.workunit.client.0.smithi142.stdout:0/480: creat d5/d13/d1e/d23/fa6 x:0 0 0 2024-04-20T21:58:32.864 INFO:tasks.workunit.client.0.smithi142.stdout:8/508: truncate d0/d17/f19 1476516 0 2024-04-20T21:58:32.867 INFO:tasks.workunit.client.0.smithi142.stdout:8/509: dread - d0/d1c/d44/d89/d45/fb4 zero size 2024-04-20T21:58:32.868 INFO:tasks.workunit.client.0.smithi142.stdout:7/458: creat d4/d9/d1c/d8e/fa4 x:0 0 0 2024-04-20T21:58:32.872 INFO:tasks.workunit.client.0.smithi142.stdout:1/434: unlink d2/dd/d1c/d43/l57 0 2024-04-20T21:58:32.875 INFO:tasks.workunit.client.0.smithi142.stdout:6/451: readlink d1/d2f/d35/d5b/d63/d34/l62 0 2024-04-20T21:58:32.875 INFO:tasks.workunit.client.0.smithi142.stdout:1/435: chown d2/dd/d1c/f69 10 1 2024-04-20T21:58:32.879 INFO:tasks.workunit.client.0.smithi142.stdout:1/436: dread - d2/dd/d17/d1b/f71 zero size 2024-04-20T21:58:32.881 INFO:tasks.workunit.client.0.smithi142.stdout:0/481: mknod d5/d45/d6f/ca7 0 2024-04-20T21:58:32.883 INFO:tasks.workunit.client.0.smithi142.stdout:7/459: creat d4/d7f/d77/d78/d9b/d5a/d62/fa5 x:0 0 0 2024-04-20T21:58:32.888 INFO:tasks.workunit.client.0.smithi142.stdout:6/452: dread d1/d11/f5d [0,4194304] 0 2024-04-20T21:58:32.888 INFO:tasks.workunit.client.0.smithi142.stdout:8/510: creat d0/d1c/d44/dad/db3/d3f/d7f/d8f/fb8 x:0 0 0 2024-04-20T21:58:32.889 INFO:tasks.workunit.client.0.smithi142.stdout:7/460: write d4/d9/d1c/f23 [8074309,58427] 0 2024-04-20T21:58:32.897 INFO:tasks.workunit.client.0.smithi142.stdout:6/453: write d1/d5/f12 [1533024,104941] 0 2024-04-20T21:58:32.900 INFO:tasks.workunit.client.0.smithi142.stdout:6/454: write d1/f8c [89891,100233] 0 2024-04-20T21:58:32.900 INFO:tasks.workunit.client.0.smithi142.stdout:2/533: dwrite d3/d9/f49 [0,4194304] 0 2024-04-20T21:58:32.902 INFO:tasks.workunit.client.0.smithi142.stdout:6/455: readlink d1/d5/d3a/l93 0 2024-04-20T21:58:32.905 INFO:tasks.workunit.client.0.smithi142.stdout:7/461: creat d4/d7d/fa6 x:0 0 0 2024-04-20T21:58:32.905 INFO:tasks.workunit.client.0.smithi142.stdout:1/437: link d2/d4e/f68 d2/dd/d1c/d88/d89/f97 0 2024-04-20T21:58:32.907 INFO:tasks.workunit.client.0.smithi142.stdout:1/438: fdatasync d2/dd/d1c/f69 0 2024-04-20T21:58:32.909 INFO:tasks.workunit.client.0.smithi142.stdout:1/439: fsync d2/dd/d17/d3b/f95 0 2024-04-20T21:58:32.914 INFO:tasks.workunit.client.0.smithi142.stdout:1/440: chown d2/dd/d17/d8b 8355175 1 2024-04-20T21:58:32.915 INFO:tasks.workunit.client.0.smithi142.stdout:2/534: read d3/d9/d34/f35 [386659,89162] 0 2024-04-20T21:58:32.917 INFO:tasks.workunit.client.0.smithi142.stdout:6/456: creat d1/d2f/d35/d48/f9c x:0 0 0 2024-04-20T21:58:32.922 INFO:tasks.workunit.client.0.smithi142.stdout:0/482: link l3 d5/d13/d1e/d23/d24/la8 0 2024-04-20T21:58:32.925 INFO:tasks.workunit.client.0.smithi142.stdout:6/457: symlink d1/d5/d3a/d43/l9d 0 2024-04-20T21:58:32.927 INFO:tasks.workunit.client.0.smithi142.stdout:3/534: dread d6/f25 [0,4194304] 0 2024-04-20T21:58:32.929 INFO:tasks.workunit.client.0.smithi142.stdout:0/483: mkdir d5/d45/d6f/d70/da9 0 2024-04-20T21:58:32.931 INFO:tasks.workunit.client.0.smithi142.stdout:6/458: rmdir d1/d5 39 2024-04-20T21:58:32.933 INFO:tasks.workunit.client.0.smithi142.stdout:8/511: dwrite d0/d1c/d44/d89/d45/f4d [0,4194304] 0 2024-04-20T21:58:32.933 INFO:tasks.workunit.client.0.smithi142.stdout:1/441: mknod d2/dd/d17/d1b/d22/d20/c98 0 2024-04-20T21:58:32.939 INFO:tasks.workunit.client.0.smithi142.stdout:2/535: getdents d3/d9/da0 0 2024-04-20T21:58:32.942 INFO:tasks.workunit.client.0.smithi142.stdout:6/459: truncate d1/d2f/d35/d5b/d63/d34/f4c 1258315 0 2024-04-20T21:58:32.945 INFO:tasks.workunit.client.0.smithi142.stdout:1/442: mknod d2/dd/d1c/c99 0 2024-04-20T21:58:32.952 INFO:tasks.workunit.client.0.smithi142.stdout:0/484: write d5/d1c/d3c/d8b/f97 [1685587,118234] 0 2024-04-20T21:58:32.954 INFO:tasks.workunit.client.0.smithi142.stdout:2/536: write d3/d5/d19/f30 [4281017,49849] 0 2024-04-20T21:58:32.956 INFO:tasks.workunit.client.0.smithi142.stdout:8/512: truncate d0/d29/f3d 352068 0 2024-04-20T21:58:32.956 INFO:tasks.workunit.client.0.smithi142.stdout:7/462: dread d4/d7d/f52 [0,4194304] 0 2024-04-20T21:58:32.956 INFO:tasks.workunit.client.0.smithi142.stdout:3/535: dwrite d6/d15/d1e/d43/fa5 [0,4194304] 0 2024-04-20T21:58:32.958 INFO:tasks.workunit.client.0.smithi142.stdout:6/460: mkdir d1/d9e 0 2024-04-20T21:58:32.964 INFO:tasks.workunit.client.0.smithi142.stdout:7/463: fdatasync d4/d9/d1c/f21 0 2024-04-20T21:58:32.965 INFO:tasks.workunit.client.0.smithi142.stdout:8/513: creat d0/d42/d90/fb9 x:0 0 0 2024-04-20T21:58:32.965 INFO:tasks.workunit.client.0.smithi142.stdout:3/536: fsync d6/d32/d39/d69/f85 0 2024-04-20T21:58:32.966 INFO:tasks.workunit.client.0.smithi142.stdout:1/443: link d2/lc d2/dd/l9a 0 2024-04-20T21:58:32.968 INFO:tasks.workunit.client.0.smithi142.stdout:7/464: chown d4/d9/f69 1737785 1 2024-04-20T21:58:32.972 INFO:tasks.workunit.client.0.smithi142.stdout:2/537: truncate d3/d5/d19/d70/d3c/d64/f85 536040 0 2024-04-20T21:58:32.973 INFO:tasks.workunit.client.0.smithi142.stdout:0/485: dread d5/d13/d1e/d23/d24/f2a [0,4194304] 0 2024-04-20T21:58:32.973 INFO:tasks.workunit.client.0.smithi142.stdout:1/444: unlink d2/c53 0 2024-04-20T21:58:32.974 INFO:tasks.workunit.client.0.smithi142.stdout:6/461: mkdir d1/d2f/d6c/d7e/d9f 0 2024-04-20T21:58:32.980 INFO:tasks.workunit.client.0.smithi142.stdout:2/538: mkdir d3/d9/da3/dae 0 2024-04-20T21:58:32.981 INFO:tasks.workunit.client.0.smithi142.stdout:2/539: fsync d3/d9/d89/d31/f92 0 2024-04-20T21:58:32.982 INFO:tasks.workunit.client.0.smithi142.stdout:3/537: write d6/d15/f9d [4889053,20553] 0 2024-04-20T21:58:32.982 INFO:tasks.workunit.client.0.smithi142.stdout:3/538: readlink d6/l2a 0 2024-04-20T21:58:32.985 INFO:tasks.workunit.client.0.smithi142.stdout:3/539: read d6/d15/d30/f44 [4520465,49157] 0 2024-04-20T21:58:32.989 INFO:tasks.workunit.client.0.smithi142.stdout:4/464: sync 2024-04-20T21:58:32.994 INFO:tasks.workunit.client.0.smithi142.stdout:7/465: dwrite d4/d7f/d77/d78/d9b/d5a/d62/f6a [0,4194304] 0 2024-04-20T21:58:33.002 INFO:tasks.workunit.client.0.smithi142.stdout:2/540: creat d3/d9/d69/faf x:0 0 0 2024-04-20T21:58:33.003 INFO:tasks.workunit.client.0.smithi142.stdout:3/540: symlink d6/d15/d1e/d43/d4d/d6e/lc4 0 2024-04-20T21:58:33.008 INFO:tasks.workunit.client.0.smithi142.stdout:1/445: dread d2/dd/d1c/f3f [0,4194304] 0 2024-04-20T21:58:33.011 INFO:tasks.workunit.client.0.smithi142.stdout:6/462: creat d1/d75/fa0 x:0 0 0 2024-04-20T21:58:33.012 INFO:tasks.workunit.client.0.smithi142.stdout:4/465: dwrite d1/d12/da/d1c/d32/f43 [0,4194304] 0 2024-04-20T21:58:33.012 INFO:tasks.workunit.client.0.smithi142.stdout:8/514: truncate d0/d29/f5d 847759 0 2024-04-20T21:58:33.019 INFO:tasks.workunit.client.0.smithi142.stdout:2/541: creat d3/d5/d19/d70/d3c/d66/fb0 x:0 0 0 2024-04-20T21:58:33.020 INFO:tasks.workunit.client.0.smithi142.stdout:2/542: chown d3/d9/d89/d31/f73 839184 1 2024-04-20T21:58:33.024 INFO:tasks.workunit.client.0.smithi142.stdout:3/541: truncate d6/d15/d1e/d43/d4d/f6d 1158425 0 2024-04-20T21:58:33.025 INFO:tasks.workunit.client.0.smithi142.stdout:1/446: symlink d2/dd/d1c/l9b 0 2024-04-20T21:58:33.028 INFO:tasks.workunit.client.0.smithi142.stdout:7/466: mknod d4/d9/d11/ca7 0 2024-04-20T21:58:33.029 INFO:tasks.workunit.client.0.smithi142.stdout:4/466: dwrite d1/d12/da/d1c/d32/d3d/f85 [0,4194304] 0 2024-04-20T21:58:33.031 INFO:tasks.workunit.client.0.smithi142.stdout:7/467: read d4/d9/f75 [460465,100590] 0 2024-04-20T21:58:33.031 INFO:tasks.workunit.client.0.smithi142.stdout:4/467: chown d1/d12/da/d1c/d32/d3d 8126620 1 2024-04-20T21:58:33.032 INFO:tasks.workunit.client.0.smithi142.stdout:4/468: chown d1 1001533 1 2024-04-20T21:58:33.034 INFO:tasks.workunit.client.0.smithi142.stdout:6/463: mknod d1/d2f/d35/d5b/d63/d34/ca1 0 2024-04-20T21:58:33.034 INFO:tasks.workunit.client.0.smithi142.stdout:8/515: unlink d0/d17/d6e/l73 0 2024-04-20T21:58:33.036 INFO:tasks.workunit.client.0.smithi142.stdout:7/468: read d4/f2d [482950,85097] 0 2024-04-20T21:58:33.037 INFO:tasks.workunit.client.0.smithi142.stdout:0/486: getdents d5/d1c/d3c/d4a 0 2024-04-20T21:58:33.038 INFO:tasks.workunit.client.0.smithi142.stdout:8/516: chown d0/d1c/d44/dad/db3/f39 1619268542 1 2024-04-20T21:58:33.051 INFO:tasks.workunit.client.0.smithi142.stdout:4/469: rmdir d1/d6/d4b 39 2024-04-20T21:58:33.055 INFO:tasks.workunit.client.0.smithi142.stdout:4/470: chown d1/d12/da/d1c/d32/d3d/d2f/d49/f75 19540861 1 2024-04-20T21:58:33.056 INFO:tasks.workunit.client.0.smithi142.stdout:2/543: dwrite d3/d5/d19/d70/d3c/d64/f81 [0,4194304] 0 2024-04-20T21:58:33.056 INFO:tasks.workunit.client.0.smithi142.stdout:6/464: rename d1/d11/f7f to d1/d2f/d35/d5b/d63/d34/fa2 0 2024-04-20T21:58:33.060 INFO:tasks.workunit.client.0.smithi142.stdout:0/487: creat d5/d1c/d3c/d4a/faa x:0 0 0 2024-04-20T21:58:33.062 INFO:tasks.workunit.client.0.smithi142.stdout:1/447: mknod d2/dd/d17/d1b/d22/d13/c9c 0 2024-04-20T21:58:33.064 INFO:tasks.workunit.client.0.smithi142.stdout:1/448: fsync d2/dd/d1c/f69 0 2024-04-20T21:58:33.064 INFO:tasks.workunit.client.0.smithi142.stdout:8/517: symlink d0/d1c/d44/dad/db3/d3f/d7f/lba 0 2024-04-20T21:58:33.066 INFO:tasks.workunit.client.0.smithi142.stdout:8/518: readlink d0/l15 0 2024-04-20T21:58:33.068 INFO:tasks.workunit.client.0.smithi142.stdout:8/519: write d0/d1c/d44/d89/fa3 [699771,74181] 0 2024-04-20T21:58:33.078 INFO:tasks.workunit.client.0.smithi142.stdout:7/469: rename d4/d9/d1c/d5e to d4/d7f/d77/d78/da8 0 2024-04-20T21:58:33.079 INFO:tasks.workunit.client.0.smithi142.stdout:2/544: mknod d3/d5/d67/cb1 0 2024-04-20T21:58:33.089 INFO:tasks.workunit.client.0.smithi142.stdout:6/465: mknod d1/d5/ca3 0 2024-04-20T21:58:33.093 INFO:tasks.workunit.client.0.smithi142.stdout:0/488: mknod d5/d1c/d3c/d4a/d78/cab 0 2024-04-20T21:58:33.094 INFO:tasks.workunit.client.0.smithi142.stdout:2/545: dwrite d3/d9/d34/f56 [0,4194304] 0 2024-04-20T21:58:33.101 INFO:tasks.workunit.client.0.smithi142.stdout:6/466: mknod d1/d5/ca4 0 2024-04-20T21:58:33.103 INFO:tasks.workunit.client.0.smithi142.stdout:6/467: readlink d1/d2f/d35/d5b/d63/l2c 0 2024-04-20T21:58:33.103 INFO:tasks.workunit.client.0.smithi142.stdout:7/470: unlink d4/c13 0 2024-04-20T21:58:33.104 INFO:tasks.workunit.client.0.smithi142.stdout:4/471: dread d1/d12/da/f5c [0,4194304] 0 2024-04-20T21:58:33.111 INFO:tasks.workunit.client.0.smithi142.stdout:1/449: creat d2/dd/d17/d3b/f9d x:0 0 0 2024-04-20T21:58:33.118 INFO:tasks.workunit.client.0.smithi142.stdout:1/450: truncate d2/dd/d17/d1b/d22/d20/f8c 708860 0 2024-04-20T21:58:33.121 INFO:tasks.workunit.client.0.smithi142.stdout:0/489: creat d5/d1c/d3c/d8b/fac x:0 0 0 2024-04-20T21:58:33.121 INFO:tasks.workunit.client.0.smithi142.stdout:7/471: dwrite d4/d7f/f91 [0,4194304] 0 2024-04-20T21:58:33.126 INFO:tasks.workunit.client.0.smithi142.stdout:8/520: getdents d0/d1c/d44/d89 0 2024-04-20T21:58:33.130 INFO:tasks.workunit.client.0.smithi142.stdout:8/521: truncate d0/d1c/d44/d89/fa3 1494860 0 2024-04-20T21:58:33.138 INFO:tasks.workunit.client.0.smithi142.stdout:1/451: rmdir d2/dd/d17/d1b/d22/d13 39 2024-04-20T21:58:33.140 INFO:tasks.workunit.client.0.smithi142.stdout:7/472: fsync d4/d9/d1c/f33 0 2024-04-20T21:58:33.142 INFO:tasks.workunit.client.0.smithi142.stdout:2/546: link d3/d9/d34/l68 d3/d5/d19/lb2 0 2024-04-20T21:58:33.143 INFO:tasks.workunit.client.0.smithi142.stdout:7/473: fdatasync d4/d7f/d77/d78/d9b/f95 0 2024-04-20T21:58:33.143 INFO:tasks.workunit.client.0.smithi142.stdout:6/468: write d1/d5/f37 [482938,34749] 0 2024-04-20T21:58:33.145 INFO:tasks.workunit.client.0.smithi142.stdout:4/472: dread d1/d6/d30/d3f/f1e [0,4194304] 0 2024-04-20T21:58:33.148 INFO:tasks.workunit.client.0.smithi142.stdout:6/469: chown d1/d2f/d35/d5b/d63/f2a 50 1 2024-04-20T21:58:33.148 INFO:tasks.workunit.client.0.smithi142.stdout:0/490: truncate d5/d1c/d3c/d85/f76 3701043 0 2024-04-20T21:58:33.151 INFO:tasks.workunit.client.0.smithi142.stdout:6/470: chown d1/d2f/d6c/d7e/d9f 10350714 1 2024-04-20T21:58:33.152 INFO:tasks.workunit.client.0.smithi142.stdout:0/491: write d5/d1c/d3c/f8e [1001656,93202] 0 2024-04-20T21:58:33.157 INFO:tasks.workunit.client.0.smithi142.stdout:8/522: symlink d0/d1c/d44/dad/db3/lbb 0 2024-04-20T21:58:33.160 INFO:tasks.workunit.client.0.smithi142.stdout:2/547: dwrite d3/f7e [0,4194304] 0 2024-04-20T21:58:33.161 INFO:tasks.workunit.client.0.smithi142.stdout:2/548: stat d3/c87 0 2024-04-20T21:58:33.163 INFO:tasks.workunit.client.0.smithi142.stdout:8/523: truncate d0/d1c/d44/dad/fb6 391325 0 2024-04-20T21:58:33.164 INFO:tasks.workunit.client.0.smithi142.stdout:2/549: write d3/d9/f49 [4741403,36658] 0 2024-04-20T21:58:33.173 INFO:tasks.workunit.client.0.smithi142.stdout:8/524: dread d0/d5e/f71 [0,4194304] 0 2024-04-20T21:58:33.174 INFO:tasks.workunit.client.0.smithi142.stdout:7/474: mknod d4/d7f/d77/d7e/ca9 0 2024-04-20T21:58:33.175 INFO:tasks.workunit.client.0.smithi142.stdout:7/475: fsync d4/d9/f8d 0 2024-04-20T21:58:33.184 INFO:tasks.workunit.client.0.smithi142.stdout:8/525: creat d0/d1c/d44/dad/fbc x:0 0 0 2024-04-20T21:58:33.187 INFO:tasks.workunit.client.0.smithi142.stdout:5/381: sync 2024-04-20T21:58:33.187 INFO:tasks.workunit.client.0.smithi142.stdout:1/452: write d2/dd/d17/d1b/d22/d55/f6e [487099,100674] 0 2024-04-20T21:58:33.194 INFO:tasks.workunit.client.0.smithi142.stdout:7/476: mknod d4/d7f/d77/caa 0 2024-04-20T21:58:33.196 INFO:tasks.workunit.client.0.smithi142.stdout:6/471: dread d1/d2f/d35/d48/f73 [0,4194304] 0 2024-04-20T21:58:33.197 INFO:tasks.workunit.client.0.smithi142.stdout:7/477: fdatasync d4/d7f/d77/d78/da8/d64/f7c 0 2024-04-20T21:58:33.199 INFO:tasks.workunit.client.0.smithi142.stdout:5/382: creat dc/d14/d21/d46/d7d/f84 x:0 0 0 2024-04-20T21:58:33.203 INFO:tasks.workunit.client.0.smithi142.stdout:8/526: rename d0/d17/f66 to d0/d1c/d44/d89/d45/d4c/fbd 0 2024-04-20T21:58:33.204 INFO:tasks.workunit.client.0.smithi142.stdout:7/478: chown d4/d9/d1c/d8e/l5b 47 1 2024-04-20T21:58:33.206 INFO:tasks.workunit.client.0.smithi142.stdout:5/383: dread - dc/d14/d21/d46/d2a/d57/f77 zero size 2024-04-20T21:58:33.206 INFO:tasks.workunit.client.0.smithi142.stdout:4/473: dwrite d1/d12/da/d1c/d32/d3d/d2f/d49/f76 [4194304,4194304] 0 2024-04-20T21:58:33.207 INFO:tasks.workunit.client.0.smithi142.stdout:0/492: truncate d5/d1c/d3c/d4a/f7c 128122 0 2024-04-20T21:58:33.208 INFO:tasks.workunit.client.0.smithi142.stdout:8/527: write d0/d17/f34 [92074,37110] 0 2024-04-20T21:58:33.219 INFO:tasks.workunit.client.0.smithi142.stdout:4/474: fdatasync d1/d6/d4a/d5a/f6a 0 2024-04-20T21:58:33.219 INFO:tasks.workunit.client.0.smithi142.stdout:5/384: unlink dc/f5a 0 2024-04-20T21:58:33.225 INFO:tasks.workunit.client.0.smithi142.stdout:2/550: dread d3/d5/f60 [0,4194304] 0 2024-04-20T21:58:33.226 INFO:tasks.workunit.client.0.smithi142.stdout:1/453: write d2/dd/d17/d1b/f5b [242690,20785] 0 2024-04-20T21:58:33.227 INFO:tasks.workunit.client.0.smithi142.stdout:6/472: dwrite d1/d5/f26 [0,4194304] 0 2024-04-20T21:58:33.228 INFO:tasks.workunit.client.0.smithi142.stdout:2/551: write d3/d9/d89/d31/f6a [936957,4558] 0 2024-04-20T21:58:33.231 INFO:tasks.workunit.client.0.smithi142.stdout:2/552: readlink d3/d5/d19/d70/d3c/d66/d6c/l72 0 2024-04-20T21:58:33.240 INFO:tasks.workunit.client.0.smithi142.stdout:0/493: mknod d5/d6d/cad 0 2024-04-20T21:58:33.242 INFO:tasks.workunit.client.0.smithi142.stdout:0/494: chown d5/d1c/d3c/d85/d63/f99 33 1 2024-04-20T21:58:33.243 INFO:tasks.workunit.client.0.smithi142.stdout:6/473: mknod d1/d2f/d35/d48/ca5 0 2024-04-20T21:58:33.244 INFO:tasks.workunit.client.0.smithi142.stdout:1/454: stat d2/dd/d17/d3b/d50/d62 0 2024-04-20T21:58:33.249 INFO:tasks.workunit.client.0.smithi142.stdout:5/385: truncate dc/d71/f5e 4121464 0 2024-04-20T21:58:33.249 INFO:tasks.workunit.client.0.smithi142.stdout:4/475: mknod d1/d6/d4b/c8c 0 2024-04-20T21:58:33.249 INFO:tasks.workunit.client.0.smithi142.stdout:2/553: rename d3/d5/c1e to d3/d9/da3/cb3 0 2024-04-20T21:58:33.254 INFO:tasks.workunit.client.0.smithi142.stdout:1/455: symlink d2/dd/d17/d3b/l9e 0 2024-04-20T21:58:33.256 INFO:tasks.workunit.client.0.smithi142.stdout:2/554: write d3/d5/d19/d70/d3c/f36 [5979670,90997] 0 2024-04-20T21:58:33.262 INFO:tasks.workunit.client.0.smithi142.stdout:4/476: mknod d1/d12/da/d1c/d32/d3d/d2f/c8d 0 2024-04-20T21:58:33.264 INFO:tasks.workunit.client.0.smithi142.stdout:0/495: creat d5/d1c/d3c/d85/fae x:0 0 0 2024-04-20T21:58:33.264 INFO:tasks.workunit.client.0.smithi142.stdout:5/386: dread dc/f2b [0,4194304] 0 2024-04-20T21:58:33.266 INFO:tasks.workunit.client.0.smithi142.stdout:2/555: symlink d3/d5/d19/d94/lb4 0 2024-04-20T21:58:33.269 INFO:tasks.workunit.client.0.smithi142.stdout:5/387: chown dc/d14/d26/f3d 235 1 2024-04-20T21:58:33.269 INFO:tasks.workunit.client.0.smithi142.stdout:0/496: rename d5/d1c/d3c to d5/d1c/d3c/d8b/daf 22 2024-04-20T21:58:33.271 INFO:tasks.workunit.client.0.smithi142.stdout:6/474: dwrite d1/d5/d8b/f97 [0,4194304] 0 2024-04-20T21:58:33.271 INFO:tasks.workunit.client.0.smithi142.stdout:5/388: chown dc/d14/f1e 0 1 2024-04-20T21:58:33.271 INFO:tasks.workunit.client.0.smithi142.stdout:0/497: chown d5/d1c/f52 407869300 1 2024-04-20T21:58:33.274 INFO:tasks.workunit.client.0.smithi142.stdout:1/456: link d2/dd/d17/d1b/d22/d20/f2d d2/dd/d17/d3b/d50/d62/f9f 0 2024-04-20T21:58:33.275 INFO:tasks.workunit.client.0.smithi142.stdout:4/477: rename d1/d6/d30/d3f to d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e 0 2024-04-20T21:58:33.278 INFO:tasks.workunit.client.0.smithi142.stdout:2/556: read d3/d5/d19/d70/d3c/d64/f7b [75471,61601] 0 2024-04-20T21:58:33.283 INFO:tasks.workunit.client.0.smithi142.stdout:6/475: mkdir d1/d5/d8b/da6 0 2024-04-20T21:58:33.283 INFO:tasks.workunit.client.0.smithi142.stdout:2/557: write d3/d9/d34/fa1 [558896,97067] 0 2024-04-20T21:58:33.284 INFO:tasks.workunit.client.0.smithi142.stdout:0/498: truncate d5/d13/f14 1597115 0 2024-04-20T21:58:33.291 INFO:tasks.workunit.client.0.smithi142.stdout:5/389: creat dc/d14/d72/f85 x:0 0 0 2024-04-20T21:58:33.292 INFO:tasks.workunit.client.0.smithi142.stdout:7/479: write d4/d7f/f60 [845151,129979] 0 2024-04-20T21:58:33.295 INFO:tasks.workunit.client.0.smithi142.stdout:6/476: symlink d1/la7 0 2024-04-20T21:58:33.300 INFO:tasks.workunit.client.0.smithi142.stdout:7/480: fsync d4/d7f/d77/d7e/f94 0 2024-04-20T21:58:33.301 INFO:tasks.workunit.client.0.smithi142.stdout:5/390: mkdir dc/d14/d26/d3f/d53/d7c/d86 0 2024-04-20T21:58:33.309 INFO:tasks.workunit.client.0.smithi142.stdout:6/477: chown d1/d2f/d35/d5b/d63/d34/ca1 205039 1 2024-04-20T21:58:33.309 INFO:tasks.workunit.client.0.smithi142.stdout:1/457: dwrite d2/dd/d1c/d88/f8d [4194304,4194304] 0 2024-04-20T21:58:33.316 INFO:tasks.workunit.client.0.smithi142.stdout:7/481: mknod d4/cab 0 2024-04-20T21:58:33.317 INFO:tasks.workunit.client.0.smithi142.stdout:2/558: dread d3/d9/d34/f41 [0,4194304] 0 2024-04-20T21:58:33.322 INFO:tasks.workunit.client.0.smithi142.stdout:4/478: dread d1/d12/da/d1c/f34 [4194304,4194304] 0 2024-04-20T21:58:33.322 INFO:tasks.workunit.client.0.smithi142.stdout:7/482: chown d4/d7f/d77/d78/d9b/d5a 9 1 2024-04-20T21:58:33.323 INFO:tasks.workunit.client.0.smithi142.stdout:2/559: read d3/d5/d19/d70/f3f [761771,73043] 0 2024-04-20T21:58:33.327 INFO:tasks.workunit.client.0.smithi142.stdout:6/478: chown d1/d2f/d35/d5b/d63/d64/f80 776 1 2024-04-20T21:58:33.330 INFO:tasks.workunit.client.0.smithi142.stdout:6/479: truncate d1/d11/f76 346881 0 2024-04-20T21:58:33.330 INFO:tasks.workunit.client.0.smithi142.stdout:2/560: mkdir d3/d9/d34/db5 0 2024-04-20T21:58:33.332 INFO:tasks.workunit.client.0.smithi142.stdout:7/483: symlink d4/d7f/d77/d78/da8/d64/lac 0 2024-04-20T21:58:33.336 INFO:tasks.workunit.client.0.smithi142.stdout:7/484: stat d4/d9/d1c/f5f 0 2024-04-20T21:58:33.336 INFO:tasks.workunit.client.0.smithi142.stdout:0/499: dread d5/f9 [0,4194304] 0 2024-04-20T21:58:33.339 INFO:tasks.workunit.client.0.smithi142.stdout:7/485: chown d4/d9/d1c/d8e/l5b 3359 1 2024-04-20T21:58:33.339 INFO:tasks.workunit.client.0.smithi142.stdout:1/458: rename d2/dd/d1c/d43/l5c to d2/dd/d17/d1b/d22/la0 0 2024-04-20T21:58:33.343 INFO:tasks.workunit.client.0.smithi142.stdout:1/459: chown d2/dd/d1c/d88/d89 110645 1 2024-04-20T21:58:33.346 INFO:tasks.workunit.client.0.smithi142.stdout:0/500: read - d5/f6c zero size 2024-04-20T21:58:33.346 INFO:tasks.workunit.client.0.smithi142.stdout:1/460: fsync d2/d4e/f7f 0 2024-04-20T21:58:33.359 INFO:tasks.workunit.client.0.smithi142.stdout:4/479: write d1/d6/f1f [2582159,118688] 0 2024-04-20T21:58:33.362 INFO:tasks.workunit.client.0.smithi142.stdout:0/501: write d5/f9 [8749614,7898] 0 2024-04-20T21:58:33.364 INFO:tasks.workunit.client.0.smithi142.stdout:0/502: fdatasync d5/d1c/f52 0 2024-04-20T21:58:33.367 INFO:tasks.workunit.client.0.smithi142.stdout:2/561: dread d3/d5/d19/d70/d3c/f36 [0,4194304] 0 2024-04-20T21:58:33.369 INFO:tasks.workunit.client.0.smithi142.stdout:6/480: link d1/d2f/d35/d5b/d3e/c79 d1/d2f/d35/d48/ca8 0 2024-04-20T21:58:33.370 INFO:tasks.workunit.client.0.smithi142.stdout:1/461: symlink d2/d4e/d7e/la1 0 2024-04-20T21:58:33.371 INFO:tasks.workunit.client.0.smithi142.stdout:4/480: creat d1/d6/d30/f8f x:0 0 0 2024-04-20T21:58:33.374 INFO:tasks.workunit.client.0.smithi142.stdout:2/562: mkdir d3/d9/db6 0 2024-04-20T21:58:33.375 INFO:tasks.workunit.client.0.smithi142.stdout:4/481: write d1/d5b/f84 [377964,85464] 0 2024-04-20T21:58:33.375 INFO:tasks.workunit.client.0.smithi142.stdout:1/462: creat d2/dd/d1c/d60/fa2 x:0 0 0 2024-04-20T21:58:33.380 INFO:tasks.workunit.client.0.smithi142.stdout:2/563: rmdir d3/d9/d89/d9a 39 2024-04-20T21:58:33.381 INFO:tasks.workunit.client.0.smithi142.stdout:1/463: dread - d2/dd/d1c/d60/fa2 zero size 2024-04-20T21:58:33.384 INFO:tasks.workunit.client.0.smithi142.stdout:6/481: write d1/d2f/d35/d5b/d63/d64/f8e [499543,90948] 0 2024-04-20T21:58:33.386 INFO:tasks.workunit.client.0.smithi142.stdout:7/486: dread d4/d7f/d77/d78/da8/f34 [0,4194304] 0 2024-04-20T21:58:33.387 INFO:tasks.workunit.client.0.smithi142.stdout:2/564: mkdir d3/d5/d67/db7 0 2024-04-20T21:58:33.387 INFO:tasks.workunit.client.0.smithi142.stdout:4/482: mkdir d1/d12/da/d1c/d32/d3d/d2f/d7a/d90 0 2024-04-20T21:58:33.390 INFO:tasks.workunit.client.0.smithi142.stdout:0/503: dwrite d5/d1c/f5c [0,4194304] 0 2024-04-20T21:58:33.391 INFO:tasks.workunit.client.0.smithi142.stdout:6/482: truncate d1/d75/fa0 229243 0 2024-04-20T21:58:33.394 INFO:tasks.workunit.client.0.smithi142.stdout:2/565: creat d3/d9/d34/fb8 x:0 0 0 2024-04-20T21:58:33.396 INFO:tasks.workunit.client.0.smithi142.stdout:9/545: sync 2024-04-20T21:58:33.397 INFO:tasks.workunit.client.0.smithi142.stdout:6/483: stat d1/d2f/d35/d5b/d39/f52 0 2024-04-20T21:58:33.398 INFO:tasks.workunit.client.0.smithi142.stdout:7/487: creat d4/d9/d11/fad x:0 0 0 2024-04-20T21:58:33.400 INFO:tasks.workunit.client.0.smithi142.stdout:7/488: stat d4/d7f/d77/d78/da8/f1f 0 2024-04-20T21:58:33.402 INFO:tasks.workunit.client.0.smithi142.stdout:7/489: chown d4/d7d/f5c 15304 1 2024-04-20T21:58:33.403 INFO:tasks.workunit.client.0.smithi142.stdout:4/483: getdents d1/d12/da/d1c/d32/d3d/d2f/d52/d6d 0 2024-04-20T21:58:33.405 INFO:tasks.workunit.client.0.smithi142.stdout:2/566: write d3/d9/d89/f65 [4622387,119382] 0 2024-04-20T21:58:33.407 INFO:tasks.workunit.client.0.smithi142.stdout:0/504: rmdir d5/d13/d1e/d23/d24/d48/d55/d9c 0 2024-04-20T21:58:33.411 INFO:tasks.workunit.client.0.smithi142.stdout:9/546: truncate d0/d36/f4c 595505 0 2024-04-20T21:58:33.412 INFO:tasks.workunit.client.0.smithi142.stdout:5/391: dread dc/d71/f5e [0,4194304] 0 2024-04-20T21:58:33.415 INFO:tasks.workunit.client.0.smithi142.stdout:5/392: chown dc/f43 78574 1 2024-04-20T21:58:33.418 INFO:tasks.workunit.client.0.smithi142.stdout:6/484: link d1/d1b/c31 d1/ca9 0 2024-04-20T21:58:33.419 INFO:tasks.workunit.client.0.smithi142.stdout:9/547: mknod d0/d3c/d4d/d63/d80/cbb 0 2024-04-20T21:58:33.421 INFO:tasks.workunit.client.0.smithi142.stdout:4/484: rename d1/d6/c6e to d1/d12/da/c91 0 2024-04-20T21:58:33.423 INFO:tasks.workunit.client.0.smithi142.stdout:7/490: dread d4/f48 [0,4194304] 0 2024-04-20T21:58:33.433 INFO:tasks.workunit.client.0.smithi142.stdout:4/485: write d1/d12/da/f7f [4135415,51290] 0 2024-04-20T21:58:33.436 INFO:tasks.workunit.client.0.smithi142.stdout:5/393: dwrite dc/d14/d25/f3a [0,4194304] 0 2024-04-20T21:58:33.438 INFO:tasks.workunit.client.0.smithi142.stdout:8/528: sync 2024-04-20T21:58:33.438 INFO:tasks.workunit.client.0.smithi142.stdout:3/542: sync 2024-04-20T21:58:33.439 INFO:tasks.workunit.client.0.smithi142.stdout:5/394: readlink dc/d14/d21/d46/d2a/d57/l64 0 2024-04-20T21:58:33.440 INFO:tasks.workunit.client.0.smithi142.stdout:8/529: fsync d0/d1c/d44/f8b 0 2024-04-20T21:58:33.442 INFO:tasks.workunit.client.0.smithi142.stdout:7/491: unlink d4/d7f/d77/d78/da8/f1f 0 2024-04-20T21:58:33.444 INFO:tasks.workunit.client.0.smithi142.stdout:1/464: dread d2/dd/d17/d1b/d22/f56 [0,4194304] 0 2024-04-20T21:58:33.444 INFO:tasks.workunit.client.0.smithi142.stdout:9/548: write d0/fe [3194124,79289] 0 2024-04-20T21:58:33.448 INFO:tasks.workunit.client.0.smithi142.stdout:4/486: mknod d1/d6/d30/c92 0 2024-04-20T21:58:33.461 INFO:tasks.workunit.client.0.smithi142.stdout:9/549: mknod d0/d36/d55/cbc 0 2024-04-20T21:58:33.461 INFO:tasks.workunit.client.0.smithi142.stdout:8/530: dread d0/d29/f3c [0,4194304] 0 2024-04-20T21:58:33.461 INFO:tasks.workunit.client.0.smithi142.stdout:9/550: stat d0/d89/fba 0 2024-04-20T21:58:33.461 INFO:tasks.workunit.client.0.smithi142.stdout:8/531: chown d0/d29 12796856 1 2024-04-20T21:58:33.461 INFO:tasks.workunit.client.0.smithi142.stdout:5/395: truncate dc/f10 776406 0 2024-04-20T21:58:33.464 INFO:tasks.workunit.client.0.smithi142.stdout:3/543: mknod d6/d15/d30/d37/d6c/d7e/cc5 0 2024-04-20T21:58:33.464 INFO:tasks.workunit.client.0.smithi142.stdout:2/567: write d3/d5/d19/f59 [397804,36287] 0 2024-04-20T21:58:33.464 INFO:tasks.workunit.client.0.smithi142.stdout:9/551: dread d0/d2a/d39/d87/f92 [0,4194304] 0 2024-04-20T21:58:33.466 INFO:tasks.workunit.client.0.smithi142.stdout:9/552: write d0/fc [1297573,1889] 0 2024-04-20T21:58:33.469 INFO:tasks.workunit.client.0.smithi142.stdout:0/505: write d5/d1c/d3c/d85/d38/d62/f75 [1029712,102688] 0 2024-04-20T21:58:33.470 INFO:tasks.workunit.client.0.smithi142.stdout:9/553: chown d0/d2a/d39/f5e 1596 1 2024-04-20T21:58:33.474 INFO:tasks.workunit.client.0.smithi142.stdout:6/485: write d1/d5/f14 [1768090,83051] 0 2024-04-20T21:58:33.477 INFO:tasks.workunit.client.0.smithi142.stdout:5/396: stat dc/d14/d21/d46/d2a/d3c 0 2024-04-20T21:58:33.486 INFO:tasks.workunit.client.0.smithi142.stdout:1/465: link d2/dd/d17/d3b/d50/d62/c65 d2/dd/d1c/d88/ca3 0 2024-04-20T21:58:33.487 INFO:tasks.workunit.client.0.smithi142.stdout:5/397: dread dc/f32 [0,4194304] 0 2024-04-20T21:58:33.490 INFO:tasks.workunit.client.0.smithi142.stdout:2/568: rename d3/d9/d34/f3b to d3/d9/d34/fb9 0 2024-04-20T21:58:33.491 INFO:tasks.workunit.client.0.smithi142.stdout:9/554: creat d0/d2a/fbd x:0 0 0 2024-04-20T21:58:33.494 INFO:tasks.workunit.client.0.smithi142.stdout:4/487: truncate d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/f1e 1958271 0 2024-04-20T21:58:33.499 INFO:tasks.workunit.client.0.smithi142.stdout:4/488: chown d1/d12/da/d1c/f25 161567 1 2024-04-20T21:58:33.499 INFO:tasks.workunit.client.0.smithi142.stdout:8/532: unlink d0/d17/f19 0 2024-04-20T21:58:33.500 INFO:tasks.workunit.client.0.smithi142.stdout:6/486: rmdir d1/d11 39 2024-04-20T21:58:33.501 INFO:tasks.workunit.client.0.smithi142.stdout:7/492: dwrite d4/d7f/f53 [0,4194304] 0 2024-04-20T21:58:33.504 INFO:tasks.workunit.client.0.smithi142.stdout:5/398: mknod dc/d14/d26/d3f/c87 0 2024-04-20T21:58:33.505 INFO:tasks.workunit.client.0.smithi142.stdout:5/399: readlink dc/l31 0 2024-04-20T21:58:33.512 INFO:tasks.workunit.client.0.smithi142.stdout:2/569: mknod d3/d9/d69/cba 0 2024-04-20T21:58:33.515 INFO:tasks.workunit.client.0.smithi142.stdout:8/533: creat d0/d1c/d44/d89/d45/d92/fbe x:0 0 0 2024-04-20T21:58:33.518 INFO:tasks.workunit.client.0.smithi142.stdout:3/544: dwrite d6/f25 [0,4194304] 0 2024-04-20T21:58:33.519 INFO:tasks.workunit.client.0.smithi142.stdout:0/506: write d5/d1c/d3c/d85/f76 [2195319,80196] 0 2024-04-20T21:58:33.523 INFO:tasks.workunit.client.0.smithi142.stdout:7/493: rename d4/d7f/d77/d78/d9b/d5a/d62 to d4/d7f/d77/d78/da8/dae 0 2024-04-20T21:58:33.524 INFO:tasks.workunit.client.0.smithi142.stdout:8/534: readlink d0/d1c/d44/dad/db3/lbb 0 2024-04-20T21:58:33.529 INFO:tasks.workunit.client.0.smithi142.stdout:1/466: getdents d2/d4e/d7e 0 2024-04-20T21:58:33.530 INFO:tasks.workunit.client.0.smithi142.stdout:2/570: chown d3/d9/d69/l97 318641 1 2024-04-20T21:58:33.530 INFO:tasks.workunit.client.0.smithi142.stdout:6/487: mknod d1/d2f/d35/d5b/caa 0 2024-04-20T21:58:33.537 INFO:tasks.workunit.client.0.smithi142.stdout:6/488: write d1/d2f/d35/f47 [229271,109859] 0 2024-04-20T21:58:33.538 INFO:tasks.workunit.client.0.smithi142.stdout:5/400: rename dc/d14/f4d to dc/d14/d21/d46/d58/d60/d75/f88 0 2024-04-20T21:58:33.546 INFO:tasks.workunit.client.0.smithi142.stdout:7/494: rename d4/d9/d1c/d8e/l26 to d4/d9/d1c/d8e/d88/laf 0 2024-04-20T21:58:33.549 INFO:tasks.workunit.client.0.smithi142.stdout:8/535: mknod d0/d1c/d44/dad/db3/cbf 0 2024-04-20T21:58:33.549 INFO:tasks.workunit.client.0.smithi142.stdout:2/571: creat d3/d9/d34/db5/fbb x:0 0 0 2024-04-20T21:58:33.552 INFO:tasks.workunit.client.0.smithi142.stdout:9/555: dwrite d0/d3c/f6f [0,4194304] 0 2024-04-20T21:58:33.553 INFO:tasks.workunit.client.0.smithi142.stdout:4/489: dwrite d1/d12/da/d1c/d32/f60 [0,4194304] 0 2024-04-20T21:58:33.566 INFO:tasks.workunit.client.0.smithi142.stdout:3/545: rename d6/d15/f9d to d6/d15/d30/d37/fc6 0 2024-04-20T21:58:33.566 INFO:tasks.workunit.client.0.smithi142.stdout:5/401: truncate dc/d14/d25/f7b 12981 0 2024-04-20T21:58:33.566 INFO:tasks.workunit.client.0.smithi142.stdout:6/489: creat d1/d5/d3a/d43/d5c/fab x:0 0 0 2024-04-20T21:58:33.567 INFO:tasks.workunit.client.0.smithi142.stdout:3/546: readlink d6/d32/l58 0 2024-04-20T21:58:33.567 INFO:tasks.workunit.client.0.smithi142.stdout:7/495: write d4/d7d/fa6 [826294,17472] 0 2024-04-20T21:58:33.567 INFO:tasks.workunit.client.0.smithi142.stdout:0/507: dread d5/d13/d1e/d23/d46/f4c [0,4194304] 0 2024-04-20T21:58:33.571 INFO:tasks.workunit.client.0.smithi142.stdout:2/572: rmdir d3/d9/d89/d31 39 2024-04-20T21:58:33.572 INFO:tasks.workunit.client.0.smithi142.stdout:5/402: mkdir dc/d14/d25/d89 0 2024-04-20T21:58:33.574 INFO:tasks.workunit.client.0.smithi142.stdout:3/547: dread - d6/d15/d1e/d43/d4d/d6e/f7a zero size 2024-04-20T21:58:33.579 INFO:tasks.workunit.client.0.smithi142.stdout:0/508: read d5/d1c/d3c/f8e [737311,23718] 0 2024-04-20T21:58:33.585 INFO:tasks.workunit.client.0.smithi142.stdout:9/556: creat d0/d2a/d39/d87/fbe x:0 0 0 2024-04-20T21:58:33.588 INFO:tasks.workunit.client.0.smithi142.stdout:9/557: chown d0/d36/l48 57479516 1 2024-04-20T21:58:33.588 INFO:tasks.workunit.client.0.smithi142.stdout:6/490: dread d1/d2f/d35/f47 [0,4194304] 0 2024-04-20T21:58:33.591 INFO:tasks.workunit.client.0.smithi142.stdout:6/491: readlink d1/d2f/d6c/d7e/l95 0 2024-04-20T21:58:33.593 INFO:tasks.workunit.client.0.smithi142.stdout:2/573: creat d3/d5/d67/fbc x:0 0 0 2024-04-20T21:58:33.597 INFO:tasks.workunit.client.0.smithi142.stdout:0/509: mkdir d5/d1d/d7e/db0 0 2024-04-20T21:58:33.598 INFO:tasks.workunit.client.0.smithi142.stdout:1/467: dread d2/dd/d1c/d60/f72 [0,4194304] 0 2024-04-20T21:58:33.599 INFO:tasks.workunit.client.0.smithi142.stdout:9/558: creat d0/d2a/d39/fbf x:0 0 0 2024-04-20T21:58:33.601 INFO:tasks.workunit.client.0.smithi142.stdout:0/510: write d5/d45/f50 [791933,19107] 0 2024-04-20T21:58:33.601 INFO:tasks.workunit.client.0.smithi142.stdout:9/559: chown d0/f25 1 1 2024-04-20T21:58:33.607 INFO:tasks.workunit.client.0.smithi142.stdout:8/536: creat d0/d1c/d44/d89/d45/fc0 x:0 0 0 2024-04-20T21:58:33.607 INFO:tasks.workunit.client.0.smithi142.stdout:6/492: write d1/d11/ff [608351,18462] 0 2024-04-20T21:58:33.608 INFO:tasks.workunit.client.0.smithi142.stdout:9/560: dread - d0/d3c/d4d/d63/d80/f85 zero size 2024-04-20T21:58:33.615 INFO:tasks.workunit.client.0.smithi142.stdout:3/548: rename d6/d15/d1e/d43/f6f to d6/d32/d39/da2/da7/fc7 0 2024-04-20T21:58:33.619 INFO:tasks.workunit.client.0.smithi142.stdout:7/496: creat d4/fb0 x:0 0 0 2024-04-20T21:58:33.620 INFO:tasks.workunit.client.0.smithi142.stdout:4/490: getdents d1/d12 0 2024-04-20T21:58:33.625 INFO:tasks.workunit.client.0.smithi142.stdout:1/468: creat d2/dd/d1c/d60/fa4 x:0 0 0 2024-04-20T21:58:33.626 INFO:tasks.workunit.client.0.smithi142.stdout:4/491: write d1/d12/da/d1c/f3b [1873673,33334] 0 2024-04-20T21:58:33.627 INFO:tasks.workunit.client.0.smithi142.stdout:8/537: dread d0/d17/d35/d9d/fa4 [0,4194304] 0 2024-04-20T21:58:33.627 INFO:tasks.workunit.client.0.smithi142.stdout:0/511: dwrite d5/f9 [0,4194304] 0 2024-04-20T21:58:33.629 INFO:tasks.workunit.client.0.smithi142.stdout:1/469: fdatasync d2/d4e/f64 0 2024-04-20T21:58:33.637 INFO:tasks.workunit.client.0.smithi142.stdout:2/574: dread d3/d9/d89/f2d [0,4194304] 0 2024-04-20T21:58:33.638 INFO:tasks.workunit.client.0.smithi142.stdout:9/561: creat d0/d91/fc0 x:0 0 0 2024-04-20T21:58:33.644 INFO:tasks.workunit.client.0.smithi142.stdout:6/493: unlink d1/d2f/d35/d5b/c29 0 2024-04-20T21:58:33.644 INFO:tasks.workunit.client.0.smithi142.stdout:4/492: write d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/f44 [1548311,98281] 0 2024-04-20T21:58:33.649 INFO:tasks.workunit.client.0.smithi142.stdout:2/575: write d3/d5/d19/d70/d3c/d66/fb0 [210762,17482] 0 2024-04-20T21:58:33.650 INFO:tasks.workunit.client.0.smithi142.stdout:8/538: mknod d0/d1c/d44/d89/d45/cc1 0 2024-04-20T21:58:33.653 INFO:tasks.workunit.client.0.smithi142.stdout:6/494: dread d1/d11/f76 [0,4194304] 0 2024-04-20T21:58:33.653 INFO:tasks.workunit.client.0.smithi142.stdout:7/497: dread d4/d7f/d77/d78/da8/dae/f6a [0,4194304] 0 2024-04-20T21:58:33.655 INFO:tasks.workunit.client.0.smithi142.stdout:3/549: dread d6/d15/d1e/d43/fa5 [0,4194304] 0 2024-04-20T21:58:33.656 INFO:tasks.workunit.client.0.smithi142.stdout:6/495: write d1/d1b/f1e [1438676,116833] 0 2024-04-20T21:58:33.661 INFO:tasks.workunit.client.0.smithi142.stdout:9/562: unlink d0/f1e 0 2024-04-20T21:58:33.665 INFO:tasks.workunit.client.0.smithi142.stdout:9/563: chown d0/d3c/d4d/d63/f65 6 1 2024-04-20T21:58:33.667 INFO:tasks.workunit.client.0.smithi142.stdout:9/564: chown d0/d36/f53 904946647 1 2024-04-20T21:58:33.672 INFO:tasks.workunit.client.0.smithi142.stdout:6/496: write d1/d2f/d35/f47 [1618597,793] 0 2024-04-20T21:58:33.684 INFO:tasks.workunit.client.0.smithi142.stdout:8/539: unlink d0/d29/l49 0 2024-04-20T21:58:33.685 INFO:tasks.workunit.client.0.smithi142.stdout:7/498: dwrite d4/d7f/f53 [4194304,4194304] 0 2024-04-20T21:58:33.687 INFO:tasks.workunit.client.0.smithi142.stdout:4/493: dwrite d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/f63 [4194304,4194304] 0 2024-04-20T21:58:33.687 INFO:tasks.workunit.client.0.smithi142.stdout:9/565: mkdir d0/d2a/d8b/dc1 0 2024-04-20T21:58:33.687 INFO:tasks.workunit.client.0.smithi142.stdout:6/497: rmdir d1/d2f 39 2024-04-20T21:58:33.691 INFO:tasks.workunit.client.0.smithi142.stdout:0/512: dread d5/d1c/d3c/d85/d63/f82 [0,4194304] 0 2024-04-20T21:58:33.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:33 smithi164 ceph-mon[23506]: pgmap v38: 65 pgs: 65 active+clean; 897 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 19 MiB/s rd, 100 MiB/s wr, 220 op/s 2024-04-20T21:58:33.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:33 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:33.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:33 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:33.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:33 smithi142 ceph-mon[15828]: pgmap v38: 65 pgs: 65 active+clean; 897 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 19 MiB/s rd, 100 MiB/s wr, 220 op/s 2024-04-20T21:58:33.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:33 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:33.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:33 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:33.697 INFO:tasks.workunit.client.0.smithi142.stdout:1/470: dread d2/dd/d17/d1b/f3c [0,4194304] 0 2024-04-20T21:58:33.700 INFO:tasks.workunit.client.0.smithi142.stdout:2/576: getdents d3/d5/d19/d70/d3c 0 2024-04-20T21:58:33.701 INFO:tasks.workunit.client.0.smithi142.stdout:7/499: creat d4/d7f/d77/d78/d9b/d5a/d90/fb1 x:0 0 0 2024-04-20T21:58:33.706 INFO:tasks.workunit.client.0.smithi142.stdout:9/566: rename d0/d2a/d8b/ca1 to d0/d2a/d39/d87/d9e/cc2 0 2024-04-20T21:58:33.710 INFO:tasks.workunit.client.0.smithi142.stdout:3/550: dwrite d6/d15/d30/d37/fc6 [0,4194304] 0 2024-04-20T21:58:33.715 INFO:tasks.workunit.client.0.smithi142.stdout:7/500: mkdir d4/d7f/d77/d7e/db2 0 2024-04-20T21:58:33.717 INFO:tasks.workunit.client.0.smithi142.stdout:1/471: creat d2/dd/d1c/d43/d7c/fa5 x:0 0 0 2024-04-20T21:58:33.717 INFO:tasks.workunit.client.0.smithi142.stdout:6/498: link d1/d5/d3a/l78 d1/d9e/lac 0 2024-04-20T21:58:33.719 INFO:tasks.workunit.client.0.smithi142.stdout:4/494: link d1/d12/da/d1c/l6f d1/d12/da/d1c/d32/d3d/d2f/d73/l93 0 2024-04-20T21:58:33.720 INFO:tasks.workunit.client.0.smithi142.stdout:8/540: dwrite d0/d17/d35/f80 [4194304,4194304] 0 2024-04-20T21:58:33.724 INFO:tasks.workunit.client.0.smithi142.stdout:7/501: mkdir d4/d7f/d77/d78/da8/dae/db3 0 2024-04-20T21:58:33.727 INFO:tasks.workunit.client.0.smithi142.stdout:4/495: chown d1/d12/da/d1c/f3b 0 1 2024-04-20T21:58:33.727 INFO:tasks.workunit.client.0.smithi142.stdout:0/513: rename d5/d1c/f71 to d5/d13/d1e/fb1 0 2024-04-20T21:58:33.728 INFO:tasks.workunit.client.0.smithi142.stdout:1/472: mknod d2/dd/d17/d3b/d50/d62/ca6 0 2024-04-20T21:58:33.731 INFO:tasks.workunit.client.0.smithi142.stdout:8/541: readlink d0/d1c/d44/d89/d45/l8c 0 2024-04-20T21:58:33.734 INFO:tasks.workunit.client.0.smithi142.stdout:7/502: truncate d4/d9/f37 2531 0 2024-04-20T21:58:33.734 INFO:tasks.workunit.client.0.smithi142.stdout:3/551: getdents d6/d15/d47 0 2024-04-20T21:58:33.735 INFO:tasks.workunit.client.0.smithi142.stdout:4/496: mkdir d1/d12/da/d1c/d32/d3d/d2f/d52/d94 0 2024-04-20T21:58:33.745 INFO:tasks.workunit.client.0.smithi142.stdout:3/552: mkdir d6/d15/d1e/dc8 0 2024-04-20T21:58:33.745 INFO:tasks.workunit.client.0.smithi142.stdout:8/542: creat d0/d1c/d44/d89/d45/d4c/d68/da5/fc2 x:0 0 0 2024-04-20T21:58:33.748 INFO:tasks.workunit.client.0.smithi142.stdout:1/473: getdents d2/dd/d17/d1b/d22/d55 0 2024-04-20T21:58:33.749 INFO:tasks.workunit.client.0.smithi142.stdout:6/499: creat d1/d2f/d35/d5b/d70/fad x:0 0 0 2024-04-20T21:58:33.749 INFO:tasks.workunit.client.0.smithi142.stdout:0/514: getdents d5/d13/d1e/d23/d24/d48/d55 0 2024-04-20T21:58:33.757 INFO:tasks.workunit.client.0.smithi142.stdout:8/543: creat d0/d1c/d44/dad/db3/d3f/d7f/fc3 x:0 0 0 2024-04-20T21:58:33.764 INFO:tasks.workunit.client.0.smithi142.stdout:3/553: rename d6/d32/d39/da2 to d6/d15/d47/d83/dc9 0 2024-04-20T21:58:33.766 INFO:tasks.workunit.client.0.smithi142.stdout:0/515: dread d5/d1c/d3c/f73 [0,4194304] 0 2024-04-20T21:58:33.766 INFO:tasks.workunit.client.0.smithi142.stdout:4/497: dwrite d1/d6/f1a [4194304,4194304] 0 2024-04-20T21:58:33.769 INFO:tasks.workunit.client.0.smithi142.stdout:1/474: symlink d2/dd/d17/d3b/d50/la7 0 2024-04-20T21:58:33.774 INFO:tasks.workunit.client.0.smithi142.stdout:7/503: dwrite d4/d9/f75 [0,4194304] 0 2024-04-20T21:58:33.777 INFO:tasks.workunit.client.0.smithi142.stdout:4/498: read d1/d12/da/d1c/f26 [5284682,61019] 0 2024-04-20T21:58:33.784 INFO:tasks.workunit.client.0.smithi142.stdout:0/516: mkdir d5/d1c/d3c/db2 0 2024-04-20T21:58:33.788 INFO:tasks.workunit.client.0.smithi142.stdout:1/475: symlink d2/dd/d17/d1b/d22/d55/la8 0 2024-04-20T21:58:33.789 INFO:tasks.workunit.client.0.smithi142.stdout:7/504: symlink d4/d7d/lb4 0 2024-04-20T21:58:33.794 INFO:tasks.workunit.client.0.smithi142.stdout:6/500: link d1/d5/d3a/d43/c53 d1/d5/d8b/cae 0 2024-04-20T21:58:33.798 INFO:tasks.workunit.client.0.smithi142.stdout:7/505: chown d4/d9/d11/c83 1967 1 2024-04-20T21:58:33.806 INFO:tasks.workunit.client.0.smithi142.stdout:7/506: chown d4/d9/d1c/f5f 74 1 2024-04-20T21:58:33.809 INFO:tasks.workunit.client.0.smithi142.stdout:8/544: dwrite d0/d5e/f71 [0,4194304] 0 2024-04-20T21:58:33.813 INFO:tasks.workunit.client.0.smithi142.stdout:4/499: dwrite d1/d12/da/d1c/d32/d3d/d2f/d49/f78 [0,4194304] 0 2024-04-20T21:58:33.823 INFO:tasks.workunit.client.0.smithi142.stdout:3/554: dwrite d6/d15/f19 [4194304,4194304] 0 2024-04-20T21:58:33.824 INFO:tasks.workunit.client.0.smithi142.stdout:7/507: write d4/d7f/d77/d78/da8/d64/f7c [91996,104420] 0 2024-04-20T21:58:33.837 INFO:tasks.workunit.client.0.smithi142.stdout:4/500: fdatasync d1/d12/da/d1c/f34 0 2024-04-20T21:58:33.838 INFO:tasks.workunit.client.0.smithi142.stdout:3/555: read d6/d15/d1e/d43/d4d/f97 [513389,107349] 0 2024-04-20T21:58:33.842 INFO:tasks.workunit.client.0.smithi142.stdout:8/545: dwrite d0/d29/f4a [0,4194304] 0 2024-04-20T21:58:33.849 INFO:tasks.workunit.client.0.smithi142.stdout:7/508: mknod d4/d9/d1c/cb5 0 2024-04-20T21:58:33.852 INFO:tasks.workunit.client.0.smithi142.stdout:8/546: chown d0/d1c/d44/d89/d45/d4c/d68/da5 131 1 2024-04-20T21:58:33.865 INFO:tasks.workunit.client.0.smithi142.stdout:3/556: rename d6/d15/d1e/d43/d4d/d6e/f71 to d6/d15/d47/fca 0 2024-04-20T21:58:33.867 INFO:tasks.workunit.client.0.smithi142.stdout:1/476: dread d2/dd/d17/d1b/d22/f91 [0,4194304] 0 2024-04-20T21:58:33.869 INFO:tasks.workunit.client.0.smithi142.stdout:5/403: sync 2024-04-20T21:58:33.879 INFO:tasks.workunit.client.0.smithi142.stdout:8/547: rename d0/d1c/l23 to d0/d1c/d44/d89/d45/d4c/lc4 0 2024-04-20T21:58:33.887 INFO:tasks.workunit.client.0.smithi142.stdout:6/501: dread d1/d2f/d35/d5b/d63/d4b/f7b [0,4194304] 0 2024-04-20T21:58:33.893 INFO:tasks.workunit.client.0.smithi142.stdout:3/557: getdents d6 0 2024-04-20T21:58:33.901 INFO:tasks.workunit.client.0.smithi142.stdout:6/502: mknod d1/d2f/d35/d5b/d63/d34/caf 0 2024-04-20T21:58:33.904 INFO:tasks.workunit.client.0.smithi142.stdout:7/509: dread d4/d7f/d77/d78/da8/f51 [0,4194304] 0 2024-04-20T21:58:33.911 INFO:tasks.workunit.client.0.smithi142.stdout:5/404: truncate dc/f2f 886894 0 2024-04-20T21:58:33.912 INFO:tasks.workunit.client.0.smithi142.stdout:1/477: truncate d2/dd/d17/d1b/d22/d55/f6e 453395 0 2024-04-20T21:58:33.915 INFO:tasks.workunit.client.0.smithi142.stdout:6/503: unlink d1/d2f/d35/d5b/d39/c4f 0 2024-04-20T21:58:33.918 INFO:tasks.workunit.client.0.smithi142.stdout:4/501: dwrite d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/f1e [0,4194304] 0 2024-04-20T21:58:33.918 INFO:tasks.workunit.client.0.smithi142.stdout:3/558: dread d6/d15/d30/f73 [0,4194304] 0 2024-04-20T21:58:33.921 INFO:tasks.workunit.client.0.smithi142.stdout:1/478: write d2/dd/d17/d1b/d22/d20/f4c [411854,17883] 0 2024-04-20T21:58:33.923 INFO:tasks.workunit.client.0.smithi142.stdout:8/548: dread d0/d1c/d44/d89/d45/d59/f5a [0,4194304] 0 2024-04-20T21:58:33.924 INFO:tasks.workunit.client.0.smithi142.stdout:1/479: chown d2/d4e/f68 1015014 1 2024-04-20T21:58:33.926 INFO:tasks.workunit.client.0.smithi142.stdout:7/510: dread d4/d7f/f60 [0,4194304] 0 2024-04-20T21:58:33.926 INFO:tasks.workunit.client.0.smithi142.stdout:6/504: chown d1/d2f/d35/d5b/c1c 195112885 1 2024-04-20T21:58:33.930 INFO:tasks.workunit.client.0.smithi142.stdout:5/405: creat dc/d14/d21/d46/d2a/f8a x:0 0 0 2024-04-20T21:58:33.930 INFO:tasks.workunit.client.0.smithi142.stdout:4/502: creat d1/d6/d4b/f95 x:0 0 0 2024-04-20T21:58:33.931 INFO:tasks.workunit.client.0.smithi142.stdout:6/505: readlink d1/d2f/d6c/d7e/l95 0 2024-04-20T21:58:33.939 INFO:tasks.workunit.client.0.smithi142.stdout:4/503: creat d1/d12/da/d37/f96 x:0 0 0 2024-04-20T21:58:33.941 INFO:tasks.workunit.client.0.smithi142.stdout:3/559: dwrite d6/d15/d30/fba [0,4194304] 0 2024-04-20T21:58:33.942 INFO:tasks.workunit.client.0.smithi142.stdout:4/504: fdatasync d1/d12/da/f22 0 2024-04-20T21:58:33.942 INFO:tasks.workunit.client.0.smithi142.stdout:1/480: symlink d2/dd/d17/la9 0 2024-04-20T21:58:33.944 INFO:tasks.workunit.client.0.smithi142.stdout:1/481: chown d2/dd/d17/l32 3324069 1 2024-04-20T21:58:33.946 INFO:tasks.workunit.client.0.smithi142.stdout:6/506: rename d1/d5/f14 to d1/d1b/fb0 0 2024-04-20T21:58:33.950 INFO:tasks.workunit.client.0.smithi142.stdout:7/511: mknod d4/d7f/d77/d78/d9b/cb6 0 2024-04-20T21:58:33.954 INFO:tasks.workunit.client.0.smithi142.stdout:1/482: creat d2/d4e/d7e/faa x:0 0 0 2024-04-20T21:58:33.958 INFO:tasks.workunit.client.0.smithi142.stdout:7/512: write d4/d7f/d77/d78/da8/d64/f7c [1089654,120532] 0 2024-04-20T21:58:33.959 INFO:tasks.workunit.client.0.smithi142.stdout:1/483: stat d2/dd/d1c/d43/d7c/fa5 0 2024-04-20T21:58:33.960 INFO:tasks.workunit.client.0.smithi142.stdout:7/513: write d4/d7f/d77/d78/d9b/d5a/f63 [430798,102103] 0 2024-04-20T21:58:33.964 INFO:tasks.workunit.client.0.smithi142.stdout:4/505: creat d1/d6/d4a/d5a/d80/f97 x:0 0 0 2024-04-20T21:58:33.965 INFO:tasks.workunit.client.0.smithi142.stdout:3/560: mknod d6/d15/d1e/d43/d4d/d6e/d99/ccb 0 2024-04-20T21:58:33.967 INFO:tasks.workunit.client.0.smithi142.stdout:6/507: dwrite d1/d5/f37 [0,4194304] 0 2024-04-20T21:58:33.969 INFO:tasks.workunit.client.0.smithi142.stdout:1/484: mknod d2/dd/d17/d3b/d74/d86/cab 0 2024-04-20T21:58:33.971 INFO:tasks.workunit.client.0.smithi142.stdout:8/549: getdents d0/d1c/d44 0 2024-04-20T21:58:33.972 INFO:tasks.workunit.client.0.smithi142.stdout:4/506: creat d1/d12/f98 x:0 0 0 2024-04-20T21:58:33.974 INFO:tasks.workunit.client.0.smithi142.stdout:3/561: rmdir d6/d15/d1e/dab 39 2024-04-20T21:58:33.974 INFO:tasks.workunit.client.0.smithi142.stdout:1/485: dread - d2/dd/d17/d1b/d22/d55/f90 zero size 2024-04-20T21:58:33.982 INFO:tasks.workunit.client.0.smithi142.stdout:7/514: dwrite d4/d9/d1c/d8e/d88/f8b [0,4194304] 0 2024-04-20T21:58:33.988 INFO:tasks.workunit.client.0.smithi142.stdout:7/515: write d4/d7f/d77/d78/d9b/d5a/d90/fa0 [244528,115145] 0 2024-04-20T21:58:33.993 INFO:tasks.workunit.client.0.smithi142.stdout:6/508: dwrite d1/d5/f26 [0,4194304] 0 2024-04-20T21:58:34.001 INFO:tasks.workunit.client.0.smithi142.stdout:1/486: dread d2/dd/d17/d1b/d22/d13/f35 [0,4194304] 0 2024-04-20T21:58:34.001 INFO:tasks.workunit.client.0.smithi142.stdout:8/550: creat d0/d29/fc5 x:0 0 0 2024-04-20T21:58:34.006 INFO:tasks.workunit.client.0.smithi142.stdout:8/551: chown d0/d1c/d44/d89/d45/d59/f5a 8 1 2024-04-20T21:58:34.012 INFO:tasks.workunit.client.0.smithi142.stdout:1/487: truncate d2/dd/d17/f1a 1274126 0 2024-04-20T21:58:34.012 INFO:tasks.workunit.client.0.smithi142.stdout:7/516: link d4/d7f/d77/d7e/c93 d4/d7f/d77/d78/da8/d64/cb7 0 2024-04-20T21:58:34.015 INFO:tasks.workunit.client.0.smithi142.stdout:3/562: dwrite d6/d15/d30/f46 [4194304,4194304] 0 2024-04-20T21:58:34.019 INFO:tasks.workunit.client.0.smithi142.stdout:7/517: creat d4/d9/d1c/d8e/d88/fb8 x:0 0 0 2024-04-20T21:58:34.019 INFO:tasks.workunit.client.0.smithi142.stdout:8/552: symlink d0/d1c/d44/d89/d45/d92/lc6 0 2024-04-20T21:58:34.020 INFO:tasks.workunit.client.0.smithi142.stdout:1/488: mknod d2/dd/d17/d3b/d74/d86/cac 0 2024-04-20T21:58:34.023 INFO:tasks.workunit.client.0.smithi142.stdout:3/563: creat d6/d15/d1e/d43/d4d/fcc x:0 0 0 2024-04-20T21:58:34.024 INFO:tasks.workunit.client.0.smithi142.stdout:7/518: write d4/d7f/d77/d78/da8/f55 [1027871,12389] 0 2024-04-20T21:58:34.032 INFO:tasks.workunit.client.0.smithi142.stdout:4/507: dwrite d1/d12/da/d37/f96 [0,4194304] 0 2024-04-20T21:58:34.035 INFO:tasks.workunit.client.0.smithi142.stdout:1/489: symlink d2/dd/d17/d1b/lad 0 2024-04-20T21:58:34.037 INFO:tasks.workunit.client.0.smithi142.stdout:1/490: fdatasync d2/dd/d1c/d43/f76 0 2024-04-20T21:58:34.041 INFO:tasks.workunit.client.0.smithi142.stdout:3/564: rename d6/d15/d1e/d43/d4d/d6e to d6/d15/d30/d37/d6c/dcd 0 2024-04-20T21:58:34.048 INFO:tasks.workunit.client.0.smithi142.stdout:7/519: mkdir d4/d9/d11/db9 0 2024-04-20T21:58:34.053 INFO:tasks.workunit.client.0.smithi142.stdout:8/553: link d0/l6f d0/d29/lc7 0 2024-04-20T21:58:34.055 INFO:tasks.workunit.client.0.smithi142.stdout:3/565: creat d6/d15/d30/d37/d6c/dcd/d99/fce x:0 0 0 2024-04-20T21:58:34.058 INFO:tasks.workunit.client.0.smithi142.stdout:7/520: symlink d4/d7f/d77/d7e/lba 0 2024-04-20T21:58:34.061 INFO:tasks.workunit.client.0.smithi142.stdout:1/491: symlink d2/dd/d17/d1b/lae 0 2024-04-20T21:58:34.063 INFO:tasks.workunit.client.0.smithi142.stdout:3/566: mknod d6/d15/d1e/d43/d4d/d59/db6/ccf 0 2024-04-20T21:58:34.065 INFO:tasks.workunit.client.0.smithi142.stdout:4/508: link d1/d12/da/d1c/d32/f43 d1/d6/d4a/d5a/f99 0 2024-04-20T21:58:34.067 INFO:tasks.workunit.client.0.smithi142.stdout:7/521: mknod d4/d7f/cbb 0 2024-04-20T21:58:34.070 INFO:tasks.workunit.client.0.smithi142.stdout:3/567: mknod d6/d15/d1e/d43/d4d/d59/cd0 0 2024-04-20T21:58:34.072 INFO:tasks.workunit.client.0.smithi142.stdout:3/568: dread - d6/d15/d1e/f80 zero size 2024-04-20T21:58:34.073 INFO:tasks.workunit.client.0.smithi142.stdout:1/492: mkdir d2/dd/d17/d8b/daf 0 2024-04-20T21:58:34.079 INFO:tasks.workunit.client.0.smithi142.stdout:1/493: creat d2/fb0 x:0 0 0 2024-04-20T21:58:34.082 INFO:tasks.workunit.client.0.smithi142.stdout:7/522: dread d4/d9/f42 [0,4194304] 0 2024-04-20T21:58:34.096 INFO:tasks.workunit.client.0.smithi142.stdout:2/577: sync 2024-04-20T21:58:34.098 INFO:tasks.workunit.client.0.smithi142.stdout:4/509: dread d1/d6/f1f [4194304,4194304] 0 2024-04-20T21:58:34.099 INFO:tasks.workunit.client.0.smithi142.stdout:4/510: chown d1/d6/d30 3 1 2024-04-20T21:58:34.108 INFO:tasks.workunit.client.0.smithi142.stdout:1/494: getdents d2/dd/d1c/d43 0 2024-04-20T21:58:34.112 INFO:tasks.workunit.client.0.smithi142.stdout:7/523: getdents d4 0 2024-04-20T21:58:34.116 INFO:tasks.workunit.client.0.smithi142.stdout:1/495: mkdir d2/dd/d1c/d88/d89/db1 0 2024-04-20T21:58:34.116 INFO:tasks.workunit.client.0.smithi142.stdout:4/511: dwrite d1/d6/d30/f8f [0,4194304] 0 2024-04-20T21:58:34.119 INFO:tasks.workunit.client.0.smithi142.stdout:7/524: unlink d4/f27 0 2024-04-20T21:58:34.120 INFO:tasks.workunit.client.0.smithi142.stdout:4/512: write d1/d12/da/d1c/d32/d3d/f85 [406164,41392] 0 2024-04-20T21:58:34.121 INFO:tasks.workunit.client.0.smithi142.stdout:1/496: dread d2/dd/d17/d1b/d22/d13/f35 [0,4194304] 0 2024-04-20T21:58:34.126 INFO:tasks.workunit.client.0.smithi142.stdout:4/513: chown d1/d6/d4a/d5a/d80/f97 3 1 2024-04-20T21:58:34.127 INFO:tasks.workunit.client.0.smithi142.stdout:4/514: chown d1/d6 1 1 2024-04-20T21:58:34.127 INFO:tasks.workunit.client.0.smithi142.stdout:1/497: truncate d2/dd/d1c/d43/f6d 1177552 0 2024-04-20T21:58:34.134 INFO:tasks.workunit.client.0.smithi142.stdout:3/569: dwrite d6/f3a [0,4194304] 0 2024-04-20T21:58:34.146 INFO:tasks.workunit.client.0.smithi142.stdout:2/578: dwrite d3/d5/d19/d70/d3c/d64/f7b [0,4194304] 0 2024-04-20T21:58:34.146 INFO:tasks.workunit.client.0.smithi142.stdout:3/570: creat d6/d15/d47/d83/dc9/da7/fd1 x:0 0 0 2024-04-20T21:58:34.147 INFO:tasks.workunit.client.0.smithi142.stdout:3/571: readlink d6/d15/d30/l94 0 2024-04-20T21:58:34.154 INFO:tasks.workunit.client.0.smithi142.stdout:2/579: creat d3/d5/d74/fbd x:0 0 0 2024-04-20T21:58:34.159 INFO:tasks.workunit.client.0.smithi142.stdout:3/572: rename d6/d15/d1e/d43/d4d/d59/db6/ccf to d6/cd2 0 2024-04-20T21:58:34.160 INFO:tasks.workunit.client.0.smithi142.stdout:7/525: mkdir d4/d7f/d77/d78/d9b/d5a/d90/dbc 0 2024-04-20T21:58:34.161 INFO:tasks.workunit.client.0.smithi142.stdout:1/498: dwrite d2/dd/d17/d1b/d22/f56 [0,4194304] 0 2024-04-20T21:58:34.166 INFO:tasks.workunit.client.0.smithi142.stdout:4/515: dwrite d1/d12/da/d1c/d32/f43 [0,4194304] 0 2024-04-20T21:58:34.166 INFO:tasks.workunit.client.0.smithi142.stdout:2/580: mkdir d3/d9/d89/d31/da7/dbe 0 2024-04-20T21:58:34.168 INFO:tasks.workunit.client.0.smithi142.stdout:2/581: fdatasync d3/d5/d19/d70/d3c/f1b 0 2024-04-20T21:58:34.169 INFO:tasks.workunit.client.0.smithi142.stdout:4/516: chown d1/d6/d30/d4e/c83 1155989766 1 2024-04-20T21:58:34.170 INFO:tasks.workunit.client.0.smithi142.stdout:2/582: chown d3/d5/d19/d94 110 1 2024-04-20T21:58:34.173 INFO:tasks.workunit.client.0.smithi142.stdout:4/517: write d1/d6/d4a/d5a/f56 [360359,115621] 0 2024-04-20T21:58:34.177 INFO:tasks.workunit.client.0.smithi142.stdout:7/526: write d4/d9/d1c/f21 [2758360,8216] 0 2024-04-20T21:58:34.177 INFO:tasks.workunit.client.0.smithi142.stdout:1/499: rename d2/dd/d17/d1b/d22/d13/c16 to d2/dd/d1c/d88/d89/db1/cb2 0 2024-04-20T21:58:34.180 INFO:tasks.workunit.client.0.smithi142.stdout:3/573: readlink d6/d15/d47/d83/dc9/da7/la9 0 2024-04-20T21:58:34.180 INFO:tasks.workunit.client.0.smithi142.stdout:7/527: stat d4/d9/d1c/l74 0 2024-04-20T21:58:34.182 INFO:tasks.workunit.client.0.smithi142.stdout:1/500: write d2/f7 [2261294,7649] 0 2024-04-20T21:58:34.182 INFO:tasks.workunit.client.0.smithi142.stdout:4/518: truncate d1/d6/d4a/d5a/f56 1813941 0 2024-04-20T21:58:34.188 INFO:tasks.workunit.client.0.smithi142.stdout:7/528: creat d4/d7f/d77/d78/da8/fbd x:0 0 0 2024-04-20T21:58:34.189 INFO:tasks.workunit.client.0.smithi142.stdout:7/529: read - d4/d7f/fa3 zero size 2024-04-20T21:58:34.190 INFO:tasks.workunit.client.0.smithi142.stdout:2/583: dread d3/d9/d89/f2d [0,4194304] 0 2024-04-20T21:58:34.191 INFO:tasks.workunit.client.0.smithi142.stdout:7/530: stat d4/d7f/d77/d7e/f87 0 2024-04-20T21:58:34.192 INFO:tasks.workunit.client.0.smithi142.stdout:7/531: fsync d4/d7f/d77/d78/d9b/d5a/d90/fb1 0 2024-04-20T21:58:34.192 INFO:tasks.workunit.client.0.smithi142.stdout:3/574: rename d6/d15/f8c to d6/d15/d1e/d43/d4d/d59/fd3 0 2024-04-20T21:58:34.193 INFO:tasks.workunit.client.0.smithi142.stdout:4/519: creat d1/d6/d4a/f9a x:0 0 0 2024-04-20T21:58:34.196 INFO:tasks.workunit.client.0.smithi142.stdout:2/584: mknod d3/d9/d89/cbf 0 2024-04-20T21:58:34.197 INFO:tasks.workunit.client.0.smithi142.stdout:4/520: write d1/d12/da/d37/f96 [1897529,76623] 0 2024-04-20T21:58:34.199 INFO:tasks.workunit.client.0.smithi142.stdout:1/501: rename d2/dd/d1c/d88/d89/l92 to d2/dd/d1c/d88/d89/db1/lb3 0 2024-04-20T21:58:34.200 INFO:tasks.workunit.client.0.smithi142.stdout:7/532: symlink d4/d9/d1c/lbe 0 2024-04-20T21:58:34.201 INFO:tasks.workunit.client.0.smithi142.stdout:3/575: symlink d6/d15/d30/d37/d6c/dcd/ld4 0 2024-04-20T21:58:34.206 INFO:tasks.workunit.client.0.smithi142.stdout:7/533: chown d4/d9/l1e 65959988 1 2024-04-20T21:58:34.207 INFO:tasks.workunit.client.0.smithi142.stdout:1/502: symlink d2/dd/d1c/d43/lb4 0 2024-04-20T21:58:34.208 INFO:tasks.workunit.client.0.smithi142.stdout:7/534: dread - d4/d9/f8d zero size 2024-04-20T21:58:34.209 INFO:tasks.workunit.client.0.smithi142.stdout:2/585: getdents d3/d5/d67/db7 0 2024-04-20T21:58:34.211 INFO:tasks.workunit.client.0.smithi142.stdout:4/521: dread d1/d6/d4a/d5a/f6a [4194304,4194304] 0 2024-04-20T21:58:34.216 INFO:tasks.workunit.client.0.smithi142.stdout:3/576: getdents d6/d15/d30/dae 0 2024-04-20T21:58:34.217 INFO:tasks.workunit.client.0.smithi142.stdout:1/503: fdatasync d2/dd/d17/d1b/d22/f4b 0 2024-04-20T21:58:34.222 INFO:tasks.workunit.client.0.smithi142.stdout:7/535: rename d4/d7f/d77/d78/d9b/cb6 to d4/d7f/d77/d78/da8/dae/cbf 0 2024-04-20T21:58:34.229 INFO:tasks.workunit.client.0.smithi142.stdout:2/586: dwrite d3/d5/d19/d70/d3c/d64/f81 [0,4194304] 0 2024-04-20T21:58:34.239 INFO:tasks.workunit.client.0.smithi142.stdout:3/577: mknod d6/d15/d47/d83/dc9/cd5 0 2024-04-20T21:58:34.240 INFO:tasks.workunit.client.0.smithi142.stdout:7/536: mknod d4/d7d/cc0 0 2024-04-20T21:58:34.244 INFO:tasks.workunit.client.0.smithi142.stdout:7/537: chown d4/d7f/d77/d78/d9b/d5a/d90/fb1 14504 1 2024-04-20T21:58:34.246 INFO:tasks.workunit.client.0.smithi142.stdout:3/578: rename d6/d15/d1e/c21 to d6/d15/d1e/cd6 0 2024-04-20T21:58:34.247 INFO:tasks.workunit.client.0.smithi142.stdout:2/587: dread d3/d9/d34/f41 [0,4194304] 0 2024-04-20T21:58:34.250 INFO:tasks.workunit.client.0.smithi142.stdout:7/538: unlink d4/d7f/d77/d78/da8/d64/f68 0 2024-04-20T21:58:34.254 INFO:tasks.workunit.client.0.smithi142.stdout:3/579: dread d6/d15/d1e/f87 [0,4194304] 0 2024-04-20T21:58:34.259 INFO:tasks.workunit.client.0.smithi142.stdout:2/588: rename d3/d5/d74/f8f to d3/d9/da0/fc0 0 2024-04-20T21:58:34.260 INFO:tasks.workunit.client.0.smithi142.stdout:7/539: mkdir d4/d7f/d77/d78/d9b/dc1 0 2024-04-20T21:58:34.264 INFO:tasks.workunit.client.0.smithi142.stdout:2/589: rmdir d3/d9/d34 39 2024-04-20T21:58:34.265 INFO:tasks.workunit.client.0.smithi142.stdout:3/580: creat d6/d15/d30/d37/d75/dbc/fd7 x:0 0 0 2024-04-20T21:58:34.267 INFO:tasks.workunit.client.0.smithi142.stdout:7/540: write d4/d7d/f52 [2833572,62257] 0 2024-04-20T21:58:34.267 INFO:tasks.workunit.client.0.smithi142.stdout:2/590: symlink d3/d9/da0/lc1 0 2024-04-20T21:58:34.274 INFO:tasks.workunit.client.0.smithi142.stdout:3/581: creat d6/fd8 x:0 0 0 2024-04-20T21:58:34.276 INFO:tasks.workunit.client.0.smithi142.stdout:2/591: mkdir d3/d9/d34/db5/dc2 0 2024-04-20T21:58:34.277 INFO:tasks.workunit.client.0.smithi142.stdout:7/541: creat d4/d7f/d77/fc2 x:0 0 0 2024-04-20T21:58:34.280 INFO:tasks.workunit.client.0.smithi142.stdout:1/504: dwrite d2/dd/d17/d1b/d22/d13/f63 [0,4194304] 0 2024-04-20T21:58:34.282 INFO:tasks.workunit.client.0.smithi142.stdout:7/542: rmdir d4/d7d 39 2024-04-20T21:58:34.287 INFO:tasks.workunit.client.0.smithi142.stdout:1/505: rmdir d2/dd/d17/d1b/d22/d55 39 2024-04-20T21:58:34.294 INFO:tasks.workunit.client.0.smithi142.stdout:3/582: getdents d6/d15/d30/d37 0 2024-04-20T21:58:34.295 INFO:tasks.workunit.client.0.smithi142.stdout:5/406: sync 2024-04-20T21:58:34.295 INFO:tasks.workunit.client.0.smithi142.stdout:9/567: sync 2024-04-20T21:58:34.295 INFO:tasks.workunit.client.0.smithi142.stdout:0/517: sync 2024-04-20T21:58:34.295 INFO:tasks.workunit.client.0.smithi142.stdout:7/543: chown d4/d9/d1c/d8e/l72 493591 1 2024-04-20T21:58:34.296 INFO:tasks.workunit.client.0.smithi142.stdout:1/506: getdents d2/dd/d1c/d88 0 2024-04-20T21:58:34.298 INFO:tasks.workunit.client.0.smithi142.stdout:3/583: truncate d6/d15/d1e/f80 368034 0 2024-04-20T21:58:34.299 INFO:tasks.workunit.client.0.smithi142.stdout:9/568: read d0/d91/f97 [1221554,48763] 0 2024-04-20T21:58:34.300 INFO:tasks.workunit.client.0.smithi142.stdout:1/507: read d2/f45 [2237907,85322] 0 2024-04-20T21:58:34.300 INFO:tasks.workunit.client.0.smithi142.stdout:7/544: fsync d4/d7f/fa3 0 2024-04-20T21:58:34.301 INFO:tasks.workunit.client.0.smithi142.stdout:0/518: truncate d5/d13/d1e/d23/d2c/f84 4333723 0 2024-04-20T21:58:34.304 INFO:tasks.workunit.client.0.smithi142.stdout:9/569: write d0/d89/fba [699257,36695] 0 2024-04-20T21:58:34.304 INFO:tasks.workunit.client.0.smithi142.stdout:2/592: write d3/d9/da0/fa6 [1449147,64359] 0 2024-04-20T21:58:34.304 INFO:tasks.workunit.client.0.smithi142.stdout:5/407: write dc/d71/f42 [968530,100392] 0 2024-04-20T21:58:34.309 INFO:tasks.workunit.client.0.smithi142.stdout:9/570: write d0/d36/d55/f5d [751526,70831] 0 2024-04-20T21:58:34.311 INFO:tasks.workunit.client.0.smithi142.stdout:7/545: write d4/d7f/d77/d78/d9b/d5a/f76 [2677926,130268] 0 2024-04-20T21:58:34.313 INFO:tasks.workunit.client.0.smithi142.stdout:2/593: mkdir d3/d9/d89/d31/dc3 0 2024-04-20T21:58:34.316 INFO:tasks.workunit.client.0.smithi142.stdout:9/571: symlink d0/d2a/d39/d87/d9e/lc3 0 2024-04-20T21:58:34.318 INFO:tasks.workunit.client.0.smithi142.stdout:1/508: dread d2/dd/d17/d3b/f6b [0,4194304] 0 2024-04-20T21:58:34.320 INFO:tasks.workunit.client.0.smithi142.stdout:5/408: mknod dc/d14/d26/d3f/d53/d7c/d86/c8b 0 2024-04-20T21:58:34.325 INFO:tasks.workunit.client.0.smithi142.stdout:1/509: read d2/dd/d17/d3b/f6b [958443,27793] 0 2024-04-20T21:58:34.325 INFO:tasks.workunit.client.0.smithi142.stdout:9/572: rename d0/d2a/f37 to d0/d2a/d39/fc4 0 2024-04-20T21:58:34.326 INFO:tasks.workunit.client.0.smithi142.stdout:0/519: write d5/d13/f14 [1140437,52149] 0 2024-04-20T21:58:34.329 INFO:tasks.workunit.client.0.smithi142.stdout:9/573: creat d0/d89/fc5 x:0 0 0 2024-04-20T21:58:34.330 INFO:tasks.workunit.client.0.smithi142.stdout:7/546: link d4/d7f/d77/l84 d4/d7f/d77/d78/d9b/d5a/lc3 0 2024-04-20T21:58:34.331 INFO:tasks.workunit.client.0.smithi142.stdout:1/510: creat d2/dd/d17/d1b/d22/d55/fb5 x:0 0 0 2024-04-20T21:58:34.337 INFO:tasks.workunit.client.0.smithi142.stdout:9/574: fdatasync d0/d2a/f8e 0 2024-04-20T21:58:34.338 INFO:tasks.workunit.client.0.smithi142.stdout:7/547: mkdir d4/d7f/d77/d78/d97/d9a/dc4 0 2024-04-20T21:58:34.340 INFO:tasks.workunit.client.0.smithi142.stdout:1/511: read d2/dd/d17/d1b/d22/f91 [1227973,76574] 0 2024-04-20T21:58:34.344 INFO:tasks.workunit.client.0.smithi142.stdout:3/584: dread d6/d15/d30/d37/d6c/dcd/f93 [4194304,4194304] 0 2024-04-20T21:58:34.349 INFO:tasks.workunit.client.0.smithi142.stdout:2/594: dread d3/d5/d19/f21 [0,4194304] 0 2024-04-20T21:58:34.354 INFO:tasks.workunit.client.0.smithi142.stdout:5/409: dwrite dc/d14/f62 [0,4194304] 0 2024-04-20T21:58:34.357 INFO:tasks.workunit.client.0.smithi142.stdout:3/585: chown d6/d32/d39/d69/l82 74 1 2024-04-20T21:58:34.360 INFO:tasks.workunit.client.0.smithi142.stdout:0/520: dwrite d5/d1c/d3c/d8b/f97 [0,4194304] 0 2024-04-20T21:58:34.362 INFO:tasks.workunit.client.0.smithi142.stdout:9/575: dread d0/d2a/f30 [0,4194304] 0 2024-04-20T21:58:34.363 INFO:tasks.workunit.client.0.smithi142.stdout:1/512: link d2/d4e/d7e/la1 d2/d4e/lb6 0 2024-04-20T21:58:34.372 INFO:tasks.workunit.client.0.smithi142.stdout:1/513: stat d2/d4e/f68 0 2024-04-20T21:58:34.372 INFO:tasks.workunit.client.0.smithi142.stdout:2/595: dread d3/d5/d19/d70/d3c/d66/fb0 [0,4194304] 0 2024-04-20T21:58:34.372 INFO:tasks.workunit.client.0.smithi142.stdout:0/521: fdatasync d5/d13/d1e/d23/d24/f2a 0 2024-04-20T21:58:34.373 INFO:tasks.workunit.client.0.smithi142.stdout:5/410: dread dc/d14/d25/f7b [0,4194304] 0 2024-04-20T21:58:34.375 INFO:tasks.workunit.client.0.smithi142.stdout:1/514: chown d2/dd/d17/d1b/c73 9263672 1 2024-04-20T21:58:34.378 INFO:tasks.workunit.client.0.smithi142.stdout:7/548: dwrite d4/d9/d11/f3c [0,4194304] 0 2024-04-20T21:58:34.384 INFO:tasks.workunit.client.0.smithi142.stdout:6/509: sync 2024-04-20T21:58:34.384 INFO:tasks.workunit.client.0.smithi142.stdout:8/554: sync 2024-04-20T21:58:34.389 INFO:tasks.workunit.client.0.smithi142.stdout:5/411: read dc/d14/d25/f2d [823285,92334] 0 2024-04-20T21:58:34.389 INFO:tasks.workunit.client.0.smithi142.stdout:4/522: dread d1/d12/da/d1c/d32/d3d/f85 [0,4194304] 0 2024-04-20T21:58:34.389 INFO:tasks.workunit.client.0.smithi142.stdout:2/596: rename d3/d5/d19/d70/d3c/d66 to d3/d5/d67/dc4 0 2024-04-20T21:58:34.393 INFO:tasks.workunit.client.0.smithi142.stdout:6/510: creat d1/d75/fb1 x:0 0 0 2024-04-20T21:58:34.394 INFO:tasks.workunit.client.0.smithi142.stdout:4/523: readlink d1/d12/da/d1c/d32/d3d/d2f/l53 0 2024-04-20T21:58:34.395 INFO:tasks.workunit.client.0.smithi142.stdout:9/576: dwrite d0/d36/f7a [0,4194304] 0 2024-04-20T21:58:34.397 INFO:tasks.workunit.client.0.smithi142.stdout:6/511: readlink d1/d11/l33 0 2024-04-20T21:58:34.399 INFO:tasks.workunit.client.0.smithi142.stdout:8/555: creat d0/d1c/d44/dad/fc8 x:0 0 0 2024-04-20T21:58:34.400 INFO:tasks.workunit.client.0.smithi142.stdout:0/522: write d5/d1c/d3c/f8e [1896534,93251] 0 2024-04-20T21:58:34.401 INFO:tasks.workunit.client.0.smithi142.stdout:2/597: fdatasync d3/d5/d19/f21 0 2024-04-20T21:58:34.402 INFO:tasks.workunit.client.0.smithi142.stdout:4/524: mknod d1/d12/da/d1c/d32/d3d/d2f/c9b 0 2024-04-20T21:58:34.404 INFO:tasks.workunit.client.0.smithi142.stdout:1/515: getdents d2/dd/d17/d3b/d50/d62 0 2024-04-20T21:58:34.408 INFO:tasks.workunit.client.0.smithi142.stdout:5/412: creat dc/d71/d5c/d68/f8c x:0 0 0 2024-04-20T21:58:34.409 INFO:tasks.workunit.client.0.smithi142.stdout:0/523: read d5/d13/f2f [2885228,99316] 0 2024-04-20T21:58:34.413 INFO:tasks.workunit.client.0.smithi142.stdout:5/413: stat dc/d14/d21/d46/d58/d60/d75 0 2024-04-20T21:58:34.414 INFO:tasks.workunit.client.0.smithi142.stdout:9/577: creat d0/d36/d55/fc6 x:0 0 0 2024-04-20T21:58:34.415 INFO:tasks.workunit.client.0.smithi142.stdout:7/549: dwrite d4/d9/d1c/d8e/d88/f8b [0,4194304] 0 2024-04-20T21:58:34.417 INFO:tasks.workunit.client.0.smithi142.stdout:5/414: chown dc/d71 48047524 1 2024-04-20T21:58:34.419 INFO:tasks.workunit.client.0.smithi142.stdout:4/525: dread d1/d6/d30/f3a [0,4194304] 0 2024-04-20T21:58:34.421 INFO:tasks.workunit.client.0.smithi142.stdout:5/415: chown dc/d14/d21/f6c 0 1 2024-04-20T21:58:34.421 INFO:tasks.workunit.client.0.smithi142.stdout:8/556: symlink d0/d1c/d44/d89/lc9 0 2024-04-20T21:58:34.430 INFO:tasks.workunit.client.0.smithi142.stdout:2/598: dwrite d3/d5/d19/f86 [4194304,4194304] 0 2024-04-20T21:58:34.431 INFO:tasks.workunit.client.0.smithi142.stdout:6/512: creat d1/d5/d3a/d43/d5c/d65/fb2 x:0 0 0 2024-04-20T21:58:34.432 INFO:tasks.workunit.client.0.smithi142.stdout:0/524: rmdir d5/d1c 39 2024-04-20T21:58:34.435 INFO:tasks.workunit.client.0.smithi142.stdout:6/513: chown d1/c86 14 1 2024-04-20T21:58:34.436 INFO:tasks.workunit.client.0.smithi142.stdout:9/578: creat d0/d91/fc7 x:0 0 0 2024-04-20T21:58:34.438 INFO:tasks.workunit.client.0.smithi142.stdout:6/514: write d1/d5/f37 [1608662,42166] 0 2024-04-20T21:58:34.439 INFO:tasks.workunit.client.0.smithi142.stdout:1/516: write d2/d4e/f68 [101837,70247] 0 2024-04-20T21:58:34.441 INFO:tasks.workunit.client.0.smithi142.stdout:7/550: mkdir d4/d7f/d77/d78/da8/dae/dc5 0 2024-04-20T21:58:34.441 INFO:tasks.workunit.client.0.smithi142.stdout:6/515: write d1/d5/f26 [3570723,59313] 0 2024-04-20T21:58:34.450 INFO:tasks.workunit.client.0.smithi142.stdout:2/599: creat d3/d9/d34/fc5 x:0 0 0 2024-04-20T21:58:34.454 INFO:tasks.workunit.client.0.smithi142.stdout:1/517: symlink d2/dd/lb7 0 2024-04-20T21:58:34.455 INFO:tasks.workunit.client.0.smithi142.stdout:1/518: chown d2/d4e/c70 18403671 1 2024-04-20T21:58:34.457 INFO:tasks.workunit.client.0.smithi142.stdout:1/519: dread - d2/d4e/d7e/faa zero size 2024-04-20T21:58:34.461 INFO:tasks.workunit.client.0.smithi142.stdout:1/520: truncate d2/dd/d17/d1b/d22/f91 4356866 0 2024-04-20T21:58:34.462 INFO:tasks.workunit.client.0.smithi142.stdout:4/526: link d1/d12/da/d1c/d32/d3d/d2f/d49/f76 d1/d12/da/d1c/d32/d3d/d2f/d7a/d90/f9c 0 2024-04-20T21:58:34.467 INFO:tasks.workunit.client.0.smithi142.stdout:5/416: truncate dc/d71/f42 186573 0 2024-04-20T21:58:34.468 INFO:tasks.workunit.client.0.smithi142.stdout:8/557: write d0/d29/f38 [1859341,37922] 0 2024-04-20T21:58:34.473 INFO:tasks.workunit.client.0.smithi142.stdout:8/558: write d0/d1c/d44/dad/db3/d3f/d7f/d8f/fb8 [171506,121449] 0 2024-04-20T21:58:34.473 INFO:tasks.workunit.client.0.smithi142.stdout:2/600: write d3/d9/d34/f35 [435383,92738] 0 2024-04-20T21:58:34.475 INFO:tasks.workunit.client.0.smithi142.stdout:7/551: mknod d4/d7f/d77/d78/d9b/d5a/d90/dbc/cc6 0 2024-04-20T21:58:34.477 INFO:tasks.workunit.client.0.smithi142.stdout:2/601: write d3/d9/f77 [3153538,7987] 0 2024-04-20T21:58:34.480 INFO:tasks.workunit.client.0.smithi142.stdout:9/579: truncate d0/f14 2932229 0 2024-04-20T21:58:34.481 INFO:tasks.workunit.client.0.smithi142.stdout:4/527: rmdir d1/d6/d4a/d5a/d80 39 2024-04-20T21:58:34.483 INFO:tasks.workunit.client.0.smithi142.stdout:6/516: truncate d1/d5/fb 2370849 0 2024-04-20T21:58:34.483 INFO:tasks.workunit.client.0.smithi142.stdout:0/525: dwrite d5/d45/d6f/f81 [0,4194304] 0 2024-04-20T21:58:34.489 INFO:tasks.workunit.client.0.smithi142.stdout:1/521: write d2/dd/d17/d1b/d22/d13/f35 [622533,119746] 0 2024-04-20T21:58:34.494 INFO:tasks.workunit.client.0.smithi142.stdout:5/417: fdatasync dc/f2f 0 2024-04-20T21:58:34.496 INFO:tasks.workunit.client.0.smithi142.stdout:4/528: mkdir d1/d12/da/d1c/d32/d3d/d9d 0 2024-04-20T21:58:34.498 INFO:tasks.workunit.client.0.smithi142.stdout:6/517: rename d1/d1b/f51 to d1/d2f/d6c/d7e/fb3 0 2024-04-20T21:58:34.499 INFO:tasks.workunit.client.0.smithi142.stdout:8/559: fdatasync d0/d29/f5d 0 2024-04-20T21:58:34.500 INFO:tasks.workunit.client.0.smithi142.stdout:8/560: chown d0/d17/d35 1724 1 2024-04-20T21:58:34.502 INFO:tasks.workunit.client.0.smithi142.stdout:0/526: truncate d5/d1d/f22 1973193 0 2024-04-20T21:58:34.503 INFO:tasks.workunit.client.0.smithi142.stdout:8/561: chown d0/d1c/d44/d89/d45/f4d 106 1 2024-04-20T21:58:34.504 INFO:tasks.workunit.client.0.smithi142.stdout:1/522: write d2/dd/d17/d3b/d50/f52 [1028200,10908] 0 2024-04-20T21:58:34.505 INFO:tasks.workunit.client.0.smithi142.stdout:2/602: unlink d3/d9/d34/l7c 0 2024-04-20T21:58:34.512 INFO:tasks.workunit.client.0.smithi142.stdout:4/529: unlink d1/d12/da/f5c 0 2024-04-20T21:58:34.513 INFO:tasks.workunit.client.0.smithi142.stdout:7/552: rename d4/d7f/d77/d78/da8/f51 to d4/d7d/fc7 0 2024-04-20T21:58:34.514 INFO:tasks.workunit.client.0.smithi142.stdout:4/530: read d1/d12/da/d1c/d32/f43 [241866,33918] 0 2024-04-20T21:58:34.516 INFO:tasks.workunit.client.0.smithi142.stdout:9/580: fsync d0/f14 0 2024-04-20T21:58:34.518 INFO:tasks.workunit.client.0.smithi142.stdout:2/603: creat d3/d5/d19/d70/fc6 x:0 0 0 2024-04-20T21:58:34.518 INFO:tasks.workunit.client.0.smithi142.stdout:2/604: chown d3/d9 228288 1 2024-04-20T21:58:34.524 INFO:tasks.workunit.client.0.smithi142.stdout:0/527: symlink d5/d13/d1e/d8f/lb3 0 2024-04-20T21:58:34.529 INFO:tasks.workunit.client.0.smithi142.stdout:4/531: rename d1/d12/da/c58 to d1/d12/da/d1c/d32/c9e 0 2024-04-20T21:58:34.530 INFO:tasks.workunit.client.0.smithi142.stdout:8/562: write d0/d1c/f41 [538095,89705] 0 2024-04-20T21:58:34.535 INFO:tasks.workunit.client.0.smithi142.stdout:5/418: creat dc/d14/f8d x:0 0 0 2024-04-20T21:58:34.536 INFO:tasks.workunit.client.0.smithi142.stdout:5/419: chown dc/d14/d21/d46/d58 2526039 1 2024-04-20T21:58:34.541 INFO:tasks.workunit.client.0.smithi142.stdout:4/532: truncate d1/d12/f7d 11446 0 2024-04-20T21:58:34.542 INFO:tasks.workunit.client.0.smithi142.stdout:2/605: write d3/d5/d19/d70/f3f [1096318,11655] 0 2024-04-20T21:58:34.543 INFO:tasks.workunit.client.0.smithi142.stdout:4/533: fdatasync d1/d12/da/f7f 0 2024-04-20T21:58:34.545 INFO:tasks.workunit.client.0.smithi142.stdout:1/523: truncate d2/dd/d1c/f3f 3920614 0 2024-04-20T21:58:34.548 INFO:tasks.workunit.client.0.smithi142.stdout:1/524: stat d2/dd/d17/d3b/d50/d62/f94 0 2024-04-20T21:58:34.549 INFO:tasks.workunit.client.0.smithi142.stdout:0/528: creat d5/d1c/d3c/d8b/fb4 x:0 0 0 2024-04-20T21:58:34.549 INFO:tasks.workunit.client.0.smithi142.stdout:9/581: truncate d0/d3c/d4d/d63/f7f 3099207 0 2024-04-20T21:58:34.553 INFO:tasks.workunit.client.0.smithi142.stdout:7/553: link d4/d9/d1c/lbe d4/d7f/d77/d78/d9b/lc8 0 2024-04-20T21:58:34.558 INFO:tasks.workunit.client.0.smithi142.stdout:1/525: symlink d2/dd/d17/d8b/lb8 0 2024-04-20T21:58:34.560 INFO:tasks.workunit.client.0.smithi142.stdout:2/606: creat d3/d9/d89/fc7 x:0 0 0 2024-04-20T21:58:34.563 INFO:tasks.workunit.client.0.smithi142.stdout:7/554: creat d4/d9/d11/db9/fc9 x:0 0 0 2024-04-20T21:58:34.564 INFO:tasks.workunit.client.0.smithi142.stdout:1/526: stat d2/dd/d17/d1b/d22/c82 0 2024-04-20T21:58:34.564 INFO:tasks.workunit.client.0.smithi142.stdout:5/420: dread dc/d14/d21/d46/d2a/d3c/f61 [0,4194304] 0 2024-04-20T21:58:34.567 INFO:tasks.workunit.client.0.smithi142.stdout:5/421: fdatasync dc/d14/d25/f3a 0 2024-04-20T21:58:34.568 INFO:tasks.workunit.client.0.smithi142.stdout:2/607: rmdir d3/d9/d89/d31/d84 39 2024-04-20T21:58:34.571 INFO:tasks.workunit.client.0.smithi142.stdout:0/529: dwrite d5/d13/f14 [0,4194304] 0 2024-04-20T21:58:34.572 INFO:tasks.workunit.client.0.smithi142.stdout:1/527: truncate d2/dd/d1c/d43/f76 1786502 0 2024-04-20T21:58:34.572 INFO:tasks.workunit.client.0.smithi142.stdout:2/608: chown d3/d5/d19/d70/fc6 9209 1 2024-04-20T21:58:34.576 INFO:tasks.workunit.client.0.smithi142.stdout:8/563: truncate d0/d1c/d44/f62 437602 0 2024-04-20T21:58:34.576 INFO:tasks.workunit.client.0.smithi142.stdout:5/422: write dc/d14/d25/f2d [1962995,77749] 0 2024-04-20T21:58:34.578 INFO:tasks.workunit.client.0.smithi142.stdout:1/528: rmdir d2/dd/d1c/d88/d89 39 2024-04-20T21:58:34.581 INFO:tasks.workunit.client.0.smithi142.stdout:4/534: truncate d1/d6/f1f 5968940 0 2024-04-20T21:58:34.581 INFO:tasks.workunit.client.0.smithi142.stdout:2/609: symlink d3/d5/d19/d70/d3c/d64/lc8 0 2024-04-20T21:58:34.582 INFO:tasks.workunit.client.0.smithi142.stdout:8/564: readlink d0/d1c/d44/d89/d45/d59/l79 0 2024-04-20T21:58:34.586 INFO:tasks.workunit.client.0.smithi142.stdout:2/610: mknod d3/d5/cc9 0 2024-04-20T21:58:34.588 INFO:tasks.workunit.client.0.smithi142.stdout:5/423: truncate dc/d14/f37 937641 0 2024-04-20T21:58:34.589 INFO:tasks.workunit.client.0.smithi142.stdout:1/529: dread - d2/dd/d17/d1b/d22/d20/f2d zero size 2024-04-20T21:58:34.595 INFO:tasks.workunit.client.0.smithi142.stdout:7/555: dwrite d4/d9/d1c/d8e/d88/f9e [0,4194304] 0 2024-04-20T21:58:34.595 INFO:tasks.workunit.client.0.smithi142.stdout:0/530: write d5/d13/d1e/d23/d24/f33 [4577126,101192] 0 2024-04-20T21:58:34.597 INFO:tasks.workunit.client.0.smithi142.stdout:0/531: read d5/d45/d6f/f81 [2157191,14771] 0 2024-04-20T21:58:34.599 INFO:tasks.workunit.client.0.smithi142.stdout:5/424: unlink dc/d14/f22 0 2024-04-20T21:58:34.605 INFO:tasks.workunit.client.0.smithi142.stdout:1/530: creat d2/dd/d17/d1b/d22/d55/fb9 x:0 0 0 2024-04-20T21:58:34.611 INFO:tasks.workunit.client.0.smithi142.stdout:8/565: dread d0/d17/f3b [0,4194304] 0 2024-04-20T21:58:34.613 INFO:tasks.workunit.client.0.smithi142.stdout:0/532: unlink d5/d13/l20 0 2024-04-20T21:58:34.618 INFO:tasks.workunit.client.0.smithi142.stdout:5/425: write f2 [179932,119620] 0 2024-04-20T21:58:34.621 INFO:tasks.workunit.client.0.smithi142.stdout:5/426: chown dc/d14/d25/f2d 1377 1 2024-04-20T21:58:34.621 INFO:tasks.workunit.client.0.smithi142.stdout:2/611: symlink d3/d9/d89/d31/lca 0 2024-04-20T21:58:34.629 INFO:tasks.workunit.client.0.smithi142.stdout:1/531: truncate d2/dd/d17/d3b/d50/d62/f9f 1008971 0 2024-04-20T21:58:34.630 INFO:tasks.workunit.client.0.smithi142.stdout:8/566: dwrite d0/d5e/f87 [0,4194304] 0 2024-04-20T21:58:34.631 INFO:tasks.workunit.client.0.smithi142.stdout:4/535: truncate d1/d12/da/d1c/d32/f60 3948646 0 2024-04-20T21:58:34.632 INFO:tasks.workunit.client.0.smithi142.stdout:7/556: dwrite d4/f96 [0,4194304] 0 2024-04-20T21:58:34.635 INFO:tasks.workunit.client.0.smithi142.stdout:5/427: creat dc/d71/d5c/f8e x:0 0 0 2024-04-20T21:58:34.636 INFO:tasks.workunit.client.0.smithi142.stdout:2/612: creat d3/d5/d67/dc4/d6c/fcb x:0 0 0 2024-04-20T21:58:34.642 INFO:tasks.workunit.client.0.smithi142.stdout:7/557: mknod d4/d9/d1c/d8e/cca 0 2024-04-20T21:58:34.644 INFO:tasks.workunit.client.0.smithi142.stdout:5/428: symlink dc/d14/d21/d46/l8f 0 2024-04-20T21:58:34.647 INFO:tasks.workunit.client.0.smithi142.stdout:1/532: symlink d2/dd/d17/d3b/lba 0 2024-04-20T21:58:34.647 INFO:tasks.workunit.client.0.smithi142.stdout:0/533: link d5/f6c d5/d1c/d3c/d8b/fb5 0 2024-04-20T21:58:34.648 INFO:tasks.workunit.client.0.smithi142.stdout:7/558: fdatasync d4/fb0 0 2024-04-20T21:58:34.649 INFO:tasks.workunit.client.0.smithi142.stdout:5/429: fsync dc/d71/d5c/d68/f8c 0 2024-04-20T21:58:34.651 INFO:tasks.workunit.client.0.smithi142.stdout:1/533: chown d2/dd/d17/d1b/c37 1915641930 1 2024-04-20T21:58:34.651 INFO:tasks.workunit.client.0.smithi142.stdout:8/567: creat d0/d1c/fca x:0 0 0 2024-04-20T21:58:34.655 INFO:tasks.workunit.client.0.smithi142.stdout:4/536: dread d1/d12/da/d1c/d32/d3d/f85 [0,4194304] 0 2024-04-20T21:58:34.657 INFO:tasks.workunit.client.0.smithi142.stdout:8/568: chown d0/d29/f3c 4631233 1 2024-04-20T21:58:34.657 INFO:tasks.workunit.client.0.smithi142.stdout:0/534: chown d5/d1c/d3c/d85/d38/d62/f75 1 1 2024-04-20T21:58:34.660 INFO:tasks.workunit.client.0.smithi142.stdout:7/559: rename d4/d7f/l80 to d4/d7f/d77/d7e/db2/lcb 0 2024-04-20T21:58:34.661 INFO:tasks.workunit.client.0.smithi142.stdout:1/534: mknod d2/d4e/cbb 0 2024-04-20T21:58:34.664 INFO:tasks.workunit.client.0.smithi142.stdout:4/537: creat d1/d12/da/d1c/f9f x:0 0 0 2024-04-20T21:58:34.667 INFO:tasks.workunit.client.0.smithi142.stdout:7/560: fdatasync d4/d7f/d77/d78/da8/dae/fa5 0 2024-04-20T21:58:34.669 INFO:tasks.workunit.client.0.smithi142.stdout:0/535: mkdir d5/d13/d1e/d23/d24/d48/db6 0 2024-04-20T21:58:34.669 INFO:tasks.workunit.client.0.smithi142.stdout:2/613: dwrite d3/d5/d67/dc4/f90 [0,4194304] 0 2024-04-20T21:58:34.669 INFO:tasks.workunit.client.0.smithi142.stdout:7/561: chown d4/d9 1968 1 2024-04-20T21:58:34.669 INFO:tasks.workunit.client.0.smithi142.stdout:8/569: symlink d0/d17/d35/d9d/lcb 0 2024-04-20T21:58:34.671 INFO:tasks.workunit.client.0.smithi142.stdout:1/535: fdatasync d2/dd/d17/d3b/d50/d62/f94 0 2024-04-20T21:58:34.684 INFO:tasks.workunit.client.0.smithi142.stdout:5/430: dwrite dc/d14/d21/d46/d2a/d3c/f61 [0,4194304] 0 2024-04-20T21:58:34.685 INFO:tasks.workunit.client.0.smithi142.stdout:4/538: write d1/d12/da/d1c/d32/d3d/f85 [3828748,38563] 0 2024-04-20T21:58:34.687 INFO:tasks.workunit.client.0.smithi142.stdout:1/536: chown d2/dd/d17/d1b/d22/d55/f6e 0 1 2024-04-20T21:58:34.690 INFO:tasks.workunit.client.0.smithi142.stdout:7/562: write d4/d7f/d77/d78/da8/fbd [144092,119241] 0 2024-04-20T21:58:34.693 INFO:tasks.workunit.client.0.smithi142.stdout:8/570: symlink d0/d17/d35/d9d/lcc 0 2024-04-20T21:58:34.695 INFO:tasks.workunit.client.0.smithi142.stdout:0/536: link d5/f9 d5/d45/d6f/d70/fb7 0 2024-04-20T21:58:34.696 INFO:tasks.workunit.client.0.smithi142.stdout:7/563: rmdir d4/d7f/d77/d7e/db2 39 2024-04-20T21:58:34.701 INFO:tasks.workunit.client.0.smithi142.stdout:2/614: dwrite d3/d9/d34/fb8 [0,4194304] 0 2024-04-20T21:58:34.710 INFO:tasks.workunit.client.0.smithi142.stdout:7/564: rmdir d4/d7f/d77/d78/d9b/d5a 39 2024-04-20T21:58:34.710 INFO:tasks.workunit.client.0.smithi142.stdout:5/431: dwrite dc/d14/f1e [0,4194304] 0 2024-04-20T21:58:34.725 INFO:tasks.workunit.client.0.smithi142.stdout:4/539: truncate d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/f1e 4033365 0 2024-04-20T21:58:34.726 INFO:tasks.workunit.client.0.smithi142.stdout:1/537: dwrite d2/f45 [0,4194304] 0 2024-04-20T21:58:34.727 INFO:tasks.workunit.client.0.smithi142.stdout:5/432: link dc/d14/d21/d46/d58/d60/d75/f88 dc/d14/d21/d46/d2a/d65/d79/f90 0 2024-04-20T21:58:34.730 INFO:tasks.workunit.client.0.smithi142.stdout:7/565: creat d4/d7f/d77/d7e/fcc x:0 0 0 2024-04-20T21:58:34.732 INFO:tasks.workunit.client.0.smithi142.stdout:5/433: chown dc/d14/d26/d3f/d53/f80 126 1 2024-04-20T21:58:34.735 INFO:tasks.workunit.client.0.smithi142.stdout:8/571: dwrite d0/d1c/d44/f62 [0,4194304] 0 2024-04-20T21:58:34.736 INFO:tasks.workunit.client.0.smithi142.stdout:4/540: fsync d1/d6/d4a/d5a/f99 0 2024-04-20T21:58:34.736 INFO:tasks.workunit.client.0.smithi142.stdout:0/537: dwrite d5/d45/f47 [0,4194304] 0 2024-04-20T21:58:34.740 INFO:tasks.workunit.client.0.smithi142.stdout:0/538: chown d5/d1d/d7e/db0 15 1 2024-04-20T21:58:34.744 INFO:tasks.workunit.client.0.smithi142.stdout:0/539: chown d5/d45/f47 1652706315 1 2024-04-20T21:58:34.746 INFO:tasks.workunit.client.0.smithi142.stdout:5/434: rename dc/d14/d21/d46/d58/d60/d75/f88 to dc/d14/f91 0 2024-04-20T21:58:34.747 INFO:tasks.workunit.client.0.smithi142.stdout:5/435: stat dc/d6b 0 2024-04-20T21:58:34.751 INFO:tasks.workunit.client.0.smithi142.stdout:2/615: dread d3/f1f [0,4194304] 0 2024-04-20T21:58:34.758 INFO:tasks.workunit.client.0.smithi142.stdout:1/538: link d2/dd/d17/d3b/d50/c61 d2/dd/d1c/d88/cbc 0 2024-04-20T21:58:34.758 INFO:tasks.workunit.client.0.smithi142.stdout:0/540: dread d5/d1c/d3c/d8b/f97 [0,4194304] 0 2024-04-20T21:58:34.758 INFO:tasks.workunit.client.0.smithi142.stdout:8/572: dread d0/d29/f4a [0,4194304] 0 2024-04-20T21:58:34.762 INFO:tasks.workunit.client.0.smithi142.stdout:0/541: fdatasync d5/d1c/d3c/d85/d38/d62/f96 0 2024-04-20T21:58:34.762 INFO:tasks.workunit.client.0.smithi142.stdout:1/539: stat d2/dd/d17/d3b/d50/d62/ca6 0 2024-04-20T21:58:34.763 INFO:tasks.workunit.client.0.smithi142.stdout:5/436: stat dc/d14/d21/d46/d2a/c33 0 2024-04-20T21:58:34.765 INFO:tasks.workunit.client.0.smithi142.stdout:1/540: write d2/d4e/f68 [672608,12685] 0 2024-04-20T21:58:34.767 INFO:tasks.workunit.client.0.smithi142.stdout:5/437: stat dc/d14/d21/d46/d2a/f8a 0 2024-04-20T21:58:34.768 INFO:tasks.workunit.client.0.smithi142.stdout:4/541: link d1/d12/da/d1c/d32/f43 d1/d6/d30/fa0 0 2024-04-20T21:58:34.769 INFO:tasks.workunit.client.0.smithi142.stdout:8/573: fsync d0/d1c/f61 0 2024-04-20T21:58:34.776 INFO:tasks.workunit.client.0.smithi142.stdout:2/616: dwrite d3/d9/d69/faf [0,4194304] 0 2024-04-20T21:58:34.777 INFO:tasks.workunit.client.0.smithi142.stdout:2/617: chown d3/d5/d19/f21 106928213 1 2024-04-20T21:58:34.779 INFO:tasks.workunit.client.0.smithi142.stdout:5/438: creat dc/d6b/f92 x:0 0 0 2024-04-20T21:58:34.782 INFO:tasks.workunit.client.0.smithi142.stdout:2/618: dread - d3/d9/d34/fc5 zero size 2024-04-20T21:58:34.783 INFO:tasks.workunit.client.0.smithi142.stdout:4/542: mknod d1/d6/d4a/d5a/d80/ca1 0 2024-04-20T21:58:34.788 INFO:tasks.workunit.client.0.smithi142.stdout:0/542: truncate d5/d13/f7d 1516813 0 2024-04-20T21:58:34.791 INFO:tasks.workunit.client.0.smithi142.stdout:2/619: mknod d3/d5/d67/dc4/ccc 0 2024-04-20T21:58:34.793 INFO:tasks.workunit.client.0.smithi142.stdout:1/541: getdents d2/dd/d17/d3b/d74 0 2024-04-20T21:58:34.794 INFO:tasks.workunit.client.0.smithi142.stdout:2/620: stat d3/d5/d19/c39 0 2024-04-20T21:58:34.796 INFO:tasks.workunit.client.0.smithi142.stdout:4/543: creat d1/d12/da/d1c/d32/d3d/d9d/fa2 x:0 0 0 2024-04-20T21:58:34.797 INFO:tasks.workunit.client.0.smithi142.stdout:8/574: dwrite d0/d29/f3c [0,4194304] 0 2024-04-20T21:58:34.798 INFO:tasks.workunit.client.0.smithi142.stdout:1/542: chown d2/dd/d17/c1f 3987520 1 2024-04-20T21:58:34.801 INFO:tasks.workunit.client.0.smithi142.stdout:2/621: write d3/d5/d19/d70/f4d [7307225,41036] 0 2024-04-20T21:58:34.803 INFO:tasks.workunit.client.0.smithi142.stdout:4/544: fdatasync d1/d12/da/d1c/d32/d3d/d2f/d49/f75 0 2024-04-20T21:58:34.809 INFO:tasks.workunit.client.0.smithi142.stdout:4/545: chown d1/d6/d4a/c7b 15 1 2024-04-20T21:58:34.809 INFO:tasks.workunit.client.0.smithi142.stdout:2/622: read d3/f7e [1807996,118987] 0 2024-04-20T21:58:34.812 INFO:tasks.workunit.client.0.smithi142.stdout:1/543: rename d2/dd/d17/d1b/f59 to d2/d4e/d7e/fbd 0 2024-04-20T21:58:34.815 INFO:tasks.workunit.client.0.smithi142.stdout:5/439: dread dc/d71/f6e [0,4194304] 0 2024-04-20T21:58:34.816 INFO:tasks.workunit.client.0.smithi142.stdout:2/623: truncate d3/d9/da3/fa9 585463 0 2024-04-20T21:58:34.819 INFO:tasks.workunit.client.0.smithi142.stdout:5/440: readlink dc/l31 0 2024-04-20T21:58:34.821 INFO:tasks.workunit.client.0.smithi142.stdout:5/441: fdatasync dc/d71/f83 0 2024-04-20T21:58:34.824 INFO:tasks.workunit.client.0.smithi142.stdout:8/575: dread d0/d1c/d44/d89/fa3 [0,4194304] 0 2024-04-20T21:58:34.827 INFO:tasks.workunit.client.0.smithi142.stdout:1/544: getdents d2/dd/d1c/d88 0 2024-04-20T21:58:34.829 INFO:tasks.workunit.client.0.smithi142.stdout:2/624: creat d3/d5/d67/fcd x:0 0 0 2024-04-20T21:58:34.830 INFO:tasks.workunit.client.0.smithi142.stdout:0/543: dread d5/f9 [4194304,4194304] 0 2024-04-20T21:58:34.830 INFO:tasks.workunit.client.0.smithi142.stdout:5/442: mkdir dc/d71/d93 0 2024-04-20T21:58:34.836 INFO:tasks.workunit.client.0.smithi142.stdout:2/625: truncate d3/d9/d69/faf 4997082 0 2024-04-20T21:58:34.838 INFO:tasks.workunit.client.0.smithi142.stdout:0/544: chown d5/d45/d6f/f86 1 1 2024-04-20T21:58:34.841 INFO:tasks.workunit.client.0.smithi142.stdout:5/443: creat dc/d14/d21/d46/d2a/d57/f94 x:0 0 0 2024-04-20T21:58:34.843 INFO:tasks.workunit.client.0.smithi142.stdout:4/546: dwrite d1/d6/d4a/d5a/f99 [0,4194304] 0 2024-04-20T21:58:34.846 INFO:tasks.workunit.client.0.smithi142.stdout:0/545: write d5/d1c/d3c/d4a/faa [946039,29893] 0 2024-04-20T21:58:34.851 INFO:tasks.workunit.client.0.smithi142.stdout:8/576: dwrite d0/d1c/f31 [0,4194304] 0 2024-04-20T21:58:34.852 INFO:tasks.workunit.client.0.smithi142.stdout:4/547: dread - d1/d12/da/d1c/d32/d3d/f7e zero size 2024-04-20T21:58:34.853 INFO:tasks.workunit.client.0.smithi142.stdout:5/444: truncate dc/d14/d21/d46/d2a/f8a 583301 0 2024-04-20T21:58:34.854 INFO:tasks.workunit.client.0.smithi142.stdout:0/546: mknod d5/d45/d6f/d70/cb8 0 2024-04-20T21:58:34.856 INFO:tasks.workunit.client.0.smithi142.stdout:4/548: write d1/d12/da/d1c/f9f [878291,36062] 0 2024-04-20T21:58:34.866 INFO:tasks.workunit.client.0.smithi142.stdout:5/445: creat dc/d14/d21/d46/d58/d60/f95 x:0 0 0 2024-04-20T21:58:34.868 INFO:tasks.workunit.client.0.smithi142.stdout:0/547: getdents d5/d13/d1e/d23/d2c 0 2024-04-20T21:58:34.873 INFO:tasks.workunit.client.0.smithi142.stdout:1/545: dread d2/dd/d17/d1b/f3c [0,4194304] 0 2024-04-20T21:58:34.875 INFO:tasks.workunit.client.0.smithi142.stdout:8/577: dwrite d0/d42/f70 [0,4194304] 0 2024-04-20T21:58:34.875 INFO:tasks.workunit.client.0.smithi142.stdout:3/586: sync 2024-04-20T21:58:34.882 INFO:tasks.workunit.client.0.smithi142.stdout:2/626: dread d3/d5/f4b [0,4194304] 0 2024-04-20T21:58:34.903 INFO:tasks.workunit.client.0.smithi142.stdout:0/548: dread d5/d1c/d3c/d85/d38/d62/f96 [0,4194304] 0 2024-04-20T21:58:34.920 INFO:tasks.workunit.client.0.smithi142.stdout:1/546: unlink d2/dd/d17/d1b/l83 0 2024-04-20T21:58:34.923 INFO:tasks.workunit.client.0.smithi142.stdout:2/627: readlink d3/d9/d34/l68 0 2024-04-20T21:58:34.925 INFO:tasks.workunit.client.0.smithi142.stdout:3/587: dread d6/f34 [0,4194304] 0 2024-04-20T21:58:34.926 INFO:tasks.workunit.client.0.smithi142.stdout:3/588: chown d6/d15/d1e/d43 4646907 1 2024-04-20T21:58:34.926 INFO:tasks.workunit.client.0.smithi142.stdout:1/547: creat d2/dd/d17/d3b/d74/d86/fbe x:0 0 0 2024-04-20T21:58:34.930 INFO:tasks.workunit.client.0.smithi142.stdout:5/446: creat dc/d14/d21/f96 x:0 0 0 2024-04-20T21:58:34.971 INFO:tasks.workunit.client.0.smithi142.stdout:3/589: symlink d6/d15/d30/db4/ld9 0 2024-04-20T21:58:34.972 INFO:tasks.workunit.client.0.smithi142.stdout:8/578: write d0/d29/f5d [356962,108957] 0 2024-04-20T21:58:34.973 INFO:tasks.workunit.client.0.smithi142.stdout:5/447: mkdir dc/d14/d26/d3f/d53/d7c/d97 0 2024-04-20T21:58:34.976 INFO:tasks.workunit.client.0.smithi142.stdout:8/579: stat d0/d29/lc7 0 2024-04-20T21:58:34.980 INFO:tasks.workunit.client.0.smithi142.stdout:3/590: rename d6/d32/d39/f81 to d6/d32/d9b/fda 0 2024-04-20T21:58:34.982 INFO:tasks.workunit.client.0.smithi142.stdout:2/628: dwrite d3/d9/d69/faf [4194304,4194304] 0 2024-04-20T21:58:34.983 INFO:tasks.workunit.client.0.smithi142.stdout:1/548: dwrite d2/dd/d17/d1b/d22/f56 [0,4194304] 0 2024-04-20T21:58:34.985 INFO:tasks.workunit.client.0.smithi142.stdout:3/591: readlink d6/l90 0 2024-04-20T21:58:34.987 INFO:tasks.workunit.client.0.smithi142.stdout:8/580: creat d0/d1c/d44/dad/db3/d3f/fcd x:0 0 0 2024-04-20T21:58:34.987 INFO:tasks.workunit.client.0.smithi142.stdout:1/549: write d2/dd/d17/d3b/f78 [1817217,96515] 0 2024-04-20T21:58:34.989 INFO:tasks.workunit.client.0.smithi142.stdout:5/448: mkdir dc/d14/d21/d46/d2a/d65/d79/d98 0 2024-04-20T21:58:34.992 INFO:tasks.workunit.client.0.smithi142.stdout:8/581: write d0/f74 [205378,16297] 0 2024-04-20T21:58:34.992 INFO:tasks.workunit.client.0.smithi142.stdout:1/550: readlink d2/dd/d1c/d43/lb4 0 2024-04-20T21:58:34.992 INFO:tasks.workunit.client.0.smithi142.stdout:3/592: mknod d6/d32/d9b/cdb 0 2024-04-20T21:58:34.997 INFO:tasks.workunit.client.0.smithi142.stdout:1/551: dread - d2/dd/d17/d3b/d50/d62/f94 zero size 2024-04-20T21:58:35.001 INFO:tasks.workunit.client.0.smithi142.stdout:1/552: dread - d2/dd/d17/d1b/d22/d55/f90 zero size 2024-04-20T21:58:35.001 INFO:tasks.workunit.client.0.smithi142.stdout:1/553: chown d2/dd/d17 17 1 2024-04-20T21:58:35.007 INFO:tasks.workunit.client.0.smithi142.stdout:5/449: link dc/d71/f6e dc/d14/d21/d7f/f99 0 2024-04-20T21:58:35.014 INFO:tasks.workunit.client.0.smithi142.stdout:5/450: read dc/d14/d21/f6c [230476,12453] 0 2024-04-20T21:58:35.014 INFO:tasks.workunit.client.0.smithi142.stdout:3/593: read d6/d15/d30/f44 [404264,59916] 0 2024-04-20T21:58:35.018 INFO:tasks.workunit.client.0.smithi142.stdout:8/582: dwrite d0/d42/f9f [0,4194304] 0 2024-04-20T21:58:35.025 INFO:tasks.workunit.client.0.smithi142.stdout:7/566: sync 2024-04-20T21:58:35.025 INFO:tasks.workunit.client.0.smithi142.stdout:6/518: sync 2024-04-20T21:58:35.025 INFO:tasks.workunit.client.0.smithi142.stdout:9/582: sync 2024-04-20T21:58:35.036 INFO:tasks.workunit.client.0.smithi142.stdout:5/451: truncate dc/d71/f42 13093 0 2024-04-20T21:58:35.038 INFO:tasks.workunit.client.0.smithi142.stdout:2/629: truncate d3/d9/d34/fb8 38864 0 2024-04-20T21:58:35.041 INFO:tasks.workunit.client.0.smithi142.stdout:1/554: dwrite d2/dd/d17/d3b/f9d [0,4194304] 0 2024-04-20T21:58:35.043 INFO:tasks.workunit.client.0.smithi142.stdout:5/452: dread - dc/d14/d21/d46/d2a/d57/f77 zero size 2024-04-20T21:58:35.045 INFO:tasks.workunit.client.0.smithi142.stdout:9/583: symlink d0/d89/lc8 0 2024-04-20T21:58:35.047 INFO:tasks.workunit.client.0.smithi142.stdout:1/555: write d2/dd/d17/d3b/f9d [1473649,59790] 0 2024-04-20T21:58:35.053 INFO:tasks.workunit.client.0.smithi142.stdout:8/583: dread d0/d1c/f31 [0,4194304] 0 2024-04-20T21:58:35.054 INFO:tasks.workunit.client.0.smithi142.stdout:6/519: creat d1/d5/fb4 x:0 0 0 2024-04-20T21:58:35.063 INFO:tasks.workunit.client.0.smithi142.stdout:5/453: unlink dc/d14/f62 0 2024-04-20T21:58:35.063 INFO:tasks.workunit.client.0.smithi142.stdout:1/556: mkdir d2/d4e/d7e/dbf 0 2024-04-20T21:58:35.067 INFO:tasks.workunit.client.0.smithi142.stdout:7/567: creat d4/d7f/d77/d78/d9b/d5a/d90/dbc/fcd x:0 0 0 2024-04-20T21:58:35.070 INFO:tasks.workunit.client.0.smithi142.stdout:4/549: sync 2024-04-20T21:58:35.073 INFO:tasks.workunit.client.0.smithi142.stdout:3/594: link d6/d32/d9b/fa8 d6/d15/d1e/dab/fdc 0 2024-04-20T21:58:35.073 INFO:tasks.workunit.client.0.smithi142.stdout:8/584: dwrite d0/d42/f70 [4194304,4194304] 0 2024-04-20T21:58:35.077 INFO:tasks.workunit.client.0.smithi142.stdout:2/630: mkdir d3/d9/d89/d31/dc3/dce 0 2024-04-20T21:58:35.085 INFO:tasks.workunit.client.0.smithi142.stdout:1/557: rmdir d2/dd/d17/d3b/d50 39 2024-04-20T21:58:35.086 INFO:tasks.workunit.client.0.smithi142.stdout:1/558: read - d2/d4e/d7e/fbd zero size 2024-04-20T21:58:35.091 INFO:tasks.workunit.client.0.smithi142.stdout:7/568: rename d4/d7f/fa3 to d4/d7f/d77/d78/da8/d64/fce 0 2024-04-20T21:58:35.094 INFO:tasks.workunit.client.0.smithi142.stdout:7/569: write d4/d9/d1c/d8e/d88/f9e [3949857,121275] 0 2024-04-20T21:58:35.102 INFO:tasks.workunit.client.0.smithi142.stdout:5/454: mkdir dc/d14/d25/d89/d9a 0 2024-04-20T21:58:35.105 INFO:tasks.workunit.client.0.smithi142.stdout:1/559: symlink d2/d4e/d7e/lc0 0 2024-04-20T21:58:35.106 INFO:tasks.workunit.client.0.smithi142.stdout:8/585: dread d0/d29/f37 [0,4194304] 0 2024-04-20T21:58:35.107 INFO:tasks.workunit.client.0.smithi142.stdout:1/560: stat d2/d4e/cbb 0 2024-04-20T21:58:35.108 INFO:tasks.workunit.client.0.smithi142.stdout:8/586: read - d0/d42/f98 zero size 2024-04-20T21:58:35.112 INFO:tasks.workunit.client.0.smithi142.stdout:9/584: truncate d0/d2a/d39/d50/f6b 2989847 0 2024-04-20T21:58:35.112 INFO:tasks.workunit.client.0.smithi142.stdout:3/595: dwrite d6/d15/d47/d83/dc9/da7/fc7 [0,4194304] 0 2024-04-20T21:58:35.119 INFO:tasks.workunit.client.0.smithi142.stdout:7/570: creat d4/d7d/fcf x:0 0 0 2024-04-20T21:58:35.122 INFO:tasks.workunit.client.0.smithi142.stdout:6/520: truncate d1/d2f/d35/d5b/d63/d4b/f7b 3089254 0 2024-04-20T21:58:35.125 INFO:tasks.workunit.client.0.smithi142.stdout:6/521: read - d1/d2f/d35/d5b/d3e/f87 zero size 2024-04-20T21:58:35.126 INFO:tasks.workunit.client.0.smithi142.stdout:5/455: rename dc/d14/d26/d3f/d53/f80 to dc/d14/d26/d3f/f9b 0 2024-04-20T21:58:35.128 INFO:tasks.workunit.client.0.smithi142.stdout:6/522: chown d1/d2f/d35/d5b/d63/d4b/d61/f67 3 1 2024-04-20T21:58:35.131 INFO:tasks.workunit.client.0.smithi142.stdout:9/585: rmdir d0/d36/d55 39 2024-04-20T21:58:35.133 INFO:tasks.workunit.client.0.smithi142.stdout:6/523: creat d1/d5/d8b/fb5 x:0 0 0 2024-04-20T21:58:35.140 INFO:tasks.workunit.client.0.smithi142.stdout:8/587: getdents d0/d1c/d44/d89/d45/d4c/d68/da5 0 2024-04-20T21:58:35.142 INFO:tasks.workunit.client.0.smithi142.stdout:6/524: write d1/d2f/d35/d48/f73 [711776,57730] 0 2024-04-20T21:58:35.148 INFO:tasks.workunit.client.0.smithi142.stdout:5/456: dwrite dc/d71/d5c/d68/f8c [0,4194304] 0 2024-04-20T21:58:35.150 INFO:tasks.workunit.client.0.smithi142.stdout:7/571: link d4/d9/d11/l6b d4/d7d/da1/ld0 0 2024-04-20T21:58:35.153 INFO:tasks.workunit.client.0.smithi142.stdout:6/525: rename d1/d5/d3a/f42 to d1/d5/d8b/fb6 0 2024-04-20T21:58:35.155 INFO:tasks.workunit.client.0.smithi142.stdout:5/457: symlink dc/d14/d21/d46/d2a/d65/d79/l9c 0 2024-04-20T21:58:35.163 INFO:tasks.workunit.client.0.smithi142.stdout:2/631: truncate d3/d5/f4b 2484627 0 2024-04-20T21:58:35.163 INFO:tasks.workunit.client.0.smithi142.stdout:7/572: symlink d4/d9/d1c/ld1 0 2024-04-20T21:58:35.167 INFO:tasks.workunit.client.0.smithi142.stdout:9/586: write d0/d3c/f46 [1785533,19410] 0 2024-04-20T21:58:35.168 INFO:tasks.workunit.client.0.smithi142.stdout:6/526: mkdir d1/d2f/d35/d5b/d63/d4b/d61/db7 0 2024-04-20T21:58:35.178 INFO:tasks.workunit.client.0.smithi142.stdout:8/588: dwrite d0/d42/f70 [4194304,4194304] 0 2024-04-20T21:58:35.178 INFO:tasks.workunit.client.0.smithi142.stdout:6/527: write d1/d5/d3a/d43/d5c/f7c [44861,102298] 0 2024-04-20T21:58:35.185 INFO:tasks.workunit.client.0.smithi142.stdout:8/589: chown d0/d1c/d44/d89/d45/d4c/d68/c93 223794 1 2024-04-20T21:58:35.186 INFO:tasks.workunit.client.0.smithi142.stdout:9/587: chown d0/d36/d55/cbc 307 1 2024-04-20T21:58:35.186 INFO:tasks.workunit.client.0.smithi142.stdout:2/632: rename d3/d9/d89/d31/da2/fa8 to d3/d5/d19/d94/fcf 0 2024-04-20T21:58:35.188 INFO:tasks.workunit.client.0.smithi142.stdout:3/596: dwrite d6/d15/d30/f5c [0,4194304] 0 2024-04-20T21:58:35.190 INFO:tasks.workunit.client.0.smithi142.stdout:7/573: fdatasync d4/d9/d11/f3e 0 2024-04-20T21:58:35.193 INFO:tasks.workunit.client.0.smithi142.stdout:9/588: fdatasync d0/d2a/f47 0 2024-04-20T21:58:35.200 INFO:tasks.workunit.client.0.smithi142.stdout:8/590: mknod d0/da7/cce 0 2024-04-20T21:58:35.204 INFO:tasks.workunit.client.0.smithi142.stdout:5/458: dwrite dc/d14/d21/d46/d58/d60/f95 [0,4194304] 0 2024-04-20T21:58:35.213 INFO:tasks.workunit.client.0.smithi142.stdout:2/633: symlink d3/d9/d89/d31/d84/ld0 0 2024-04-20T21:58:35.214 INFO:tasks.workunit.client.0.smithi142.stdout:3/597: rmdir d6/d15/d1e/dc8 0 2024-04-20T21:58:35.216 INFO:tasks.workunit.client.0.smithi142.stdout:7/574: creat d4/fd2 x:0 0 0 2024-04-20T21:58:35.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.221+0000 7f5d14c00700 1 -- 172.21.15.142:0/1650234631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d08007200 msgr2=0x7f5d08007680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:35.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.221+0000 7f5d14c00700 1 --2- 172.21.15.142:0/1650234631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d08007200 0x7f5d08007680 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009910 tx=0x7f5cfc009c20 comp rx=0 tx=0).stop 2024-04-20T21:58:35.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.222+0000 7f5d14c00700 1 -- 172.21.15.142:0/1650234631 shutdown_connections 2024-04-20T21:58:35.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.222+0000 7f5d14c00700 1 --2- 172.21.15.142:0/1650234631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d08007200 0x7f5d08007680 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:35.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.222+0000 7f5d14c00700 1 --2- 172.21.15.142:0/1650234631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d080087d0 0x7f5d08006c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:35.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.222+0000 7f5d14c00700 1 -- 172.21.15.142:0/1650234631 >> 172.21.15.142:0/1650234631 conn(0x7f5d080910d0 msgr2=0x7f5d08093530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:35.222 INFO:tasks.workunit.client.0.smithi142.stdout:5/459: rename dc/d14/d26/f3d to dc/d6b/f9d 0 2024-04-20T21:58:35.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.223+0000 7f5d14c00700 1 -- 172.21.15.142:0/1650234631 shutdown_connections 2024-04-20T21:58:35.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.224+0000 7f5d14c00700 1 -- 172.21.15.142:0/1650234631 wait complete. 2024-04-20T21:58:35.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.225+0000 7f5d14c00700 1 Processor -- start 2024-04-20T21:58:35.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.226+0000 7f5d14c00700 1 -- start start 2024-04-20T21:58:35.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.226+0000 7f5d14c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d08007200 0x7f5d08131af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:35.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.226+0000 7f5d14c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d080087d0 0x7f5d08132030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:35.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.226+0000 7f5d14c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d08132650 con 0x7f5d08007200 2024-04-20T21:58:35.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.226+0000 7f5d14c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d08132790 con 0x7f5d080087d0 2024-04-20T21:58:35.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.227+0000 7f5d0f400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d08007200 0x7f5d08131af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:35.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.227+0000 7f5d0f400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d08007200 0x7f5d08131af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44068/0 (socket says 172.21.15.142:44068) 2024-04-20T21:58:35.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.227+0000 7f5d0f400700 1 -- 172.21.15.142:0/3790135802 learned_addr learned my addr 172.21.15.142:0/3790135802 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:58:35.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.227+0000 7f5d0ea00700 1 --2- 172.21.15.142:0/3790135802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d080087d0 0x7f5d08132030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:35.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.227+0000 7f5d0ea00700 1 -- 172.21.15.142:0/3790135802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d08007200 msgr2=0x7f5d08131af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:35.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.227+0000 7f5d0ea00700 1 --2- 172.21.15.142:0/3790135802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d08007200 0x7f5d08131af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:35.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.228+0000 7f5d0ea00700 1 -- 172.21.15.142:0/3790135802 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc0095f0 con 0x7f5d080087d0 2024-04-20T21:58:35.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.229+0000 7f5d0ea00700 1 --2- 172.21.15.142:0/3790135802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d080087d0 0x7f5d08132030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc000c00 tx=0x7f5cfc00bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:35.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.230+0000 7f5d03e00700 1 -- 172.21.15.142:0/3790135802 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cfc01d070 con 0x7f5d080087d0 2024-04-20T21:58:35.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.230+0000 7f5d03e00700 1 -- 172.21.15.142:0/3790135802 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5cfc003d50 con 0x7f5d080087d0 2024-04-20T21:58:35.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.230+0000 7f5d03e00700 1 -- 172.21.15.142:0/3790135802 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cfc021410 con 0x7f5d080087d0 2024-04-20T21:58:35.230 INFO:tasks.workunit.client.0.smithi142.stdout:2/634: chown d3/d9/da3/fa9 460939993 1 2024-04-20T21:58:35.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.231+0000 7f5d14c00700 1 -- 172.21.15.142:0/3790135802 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d08137190 con 0x7f5d080087d0 2024-04-20T21:58:35.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.232+0000 7f5d14c00700 1 -- 172.21.15.142:0/3790135802 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d08137700 con 0x7f5d080087d0 2024-04-20T21:58:35.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.235+0000 7f5d14c00700 1 -- 172.21.15.142:0/3790135802 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0812bd00 con 0x7f5d080087d0 2024-04-20T21:58:35.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.235+0000 7f5d03e00700 1 -- 172.21.15.142:0/3790135802 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 25) v1 ==== 92710+0+0 (secure 0 0 0) 0x7f5cfc00f6f0 con 0x7f5d080087d0 2024-04-20T21:58:35.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.237+0000 7f5d03e00700 1 --2- 172.21.15.142:0/3790135802 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f5cf806eac0 0x7f5cf8070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:35.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.237+0000 7f5d03e00700 1 -- 172.21.15.142:0/3790135802 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f5cfc08f5f0 con 0x7f5d080087d0 2024-04-20T21:58:35.237 INFO:tasks.workunit.client.0.smithi142.stdout:6/528: dwrite d1/f8c [0,4194304] 0 2024-04-20T21:58:35.237 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.238+0000 7f5d0f400700 1 --2- 172.21.15.142:0/3790135802 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f5cf806eac0 0x7f5cf8070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:35.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.240+0000 7f5d0f400700 1 --2- 172.21.15.142:0/3790135802 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f5cf806eac0 0x7f5cf8070f80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5d0400bd10 tx=0x7f5d0400b480 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:35.242 INFO:tasks.workunit.client.0.smithi142.stdout:5/460: write dc/d14/d21/d46/d7d/f84 [106849,107003] 0 2024-04-20T21:58:35.243 INFO:tasks.workunit.client.0.smithi142.stdout:6/529: stat d1/f8c 0 2024-04-20T21:58:35.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.244+0000 7f5d03e00700 1 -- 172.21.15.142:0/3790135802 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f5cfc05c3c0 con 0x7f5d080087d0 2024-04-20T21:58:35.244 INFO:tasks.workunit.client.0.smithi142.stdout:3/598: creat d6/d15/d30/db4/fdd x:0 0 0 2024-04-20T21:58:35.244 INFO:tasks.workunit.client.0.smithi142.stdout:8/591: dwrite d0/d1c/fca [0,4194304] 0 2024-04-20T21:58:35.252 INFO:tasks.workunit.client.0.smithi142.stdout:7/575: unlink d4/d7f/d77/d78/da8/f9d 0 2024-04-20T21:58:35.257 INFO:tasks.workunit.client.0.smithi142.stdout:5/461: readlink dc/d71/l5b 0 2024-04-20T21:58:35.259 INFO:tasks.workunit.client.0.smithi142.stdout:9/589: dwrite d0/d2a/f2d [4194304,4194304] 0 2024-04-20T21:58:35.262 INFO:tasks.workunit.client.0.smithi142.stdout:5/462: read - dc/d14/d21/d46/d2a/f74 zero size 2024-04-20T21:58:35.263 INFO:tasks.workunit.client.0.smithi142.stdout:9/590: fdatasync d0/fb0 0 2024-04-20T21:58:35.265 INFO:tasks.workunit.client.0.smithi142.stdout:7/576: mkdir d4/dd3 0 2024-04-20T21:58:35.265 INFO:tasks.workunit.client.0.smithi142.stdout:2/635: dwrite d3/d5/d19/f30 [0,4194304] 0 2024-04-20T21:58:35.266 INFO:tasks.workunit.client.0.smithi142.stdout:3/599: dread d6/d15/d47/f61 [0,4194304] 0 2024-04-20T21:58:35.267 INFO:tasks.workunit.client.0.smithi142.stdout:8/592: truncate d0/d1c/d44/dad/db3/f51 746797 0 2024-04-20T21:58:35.269 INFO:tasks.workunit.client.0.smithi142.stdout:5/463: dread - dc/d6b/f92 zero size 2024-04-20T21:58:35.282 INFO:tasks.workunit.client.0.smithi142.stdout:2/636: creat d3/d9/d69/fd1 x:0 0 0 2024-04-20T21:58:35.284 INFO:tasks.workunit.client.0.smithi142.stdout:8/593: symlink d0/d1c/d44/d89/d45/d4c/d68/lcf 0 2024-04-20T21:58:35.285 INFO:tasks.workunit.client.0.smithi142.stdout:0/549: sync 2024-04-20T21:58:35.292 INFO:tasks.workunit.client.0.smithi142.stdout:8/594: chown d0/d1c/d44/dad/db3/d3f/d7f/d8f 91 1 2024-04-20T21:58:35.292 INFO:tasks.workunit.client.0.smithi142.stdout:0/550: write d5/d1c/d3c/d85/d38/f90 [129464,84224] 0 2024-04-20T21:58:35.296 INFO:tasks.workunit.client.0.smithi142.stdout:7/577: mkdir d4/d7f/d77/d78/d9b/dc1/dd4 0 2024-04-20T21:58:35.299 INFO:tasks.workunit.client.0.smithi142.stdout:6/530: write d1/d5/fb [2626103,102989] 0 2024-04-20T21:58:35.299 INFO:tasks.workunit.client.0.smithi142.stdout:9/591: rename d0/d3c/l59 to d0/d36/lc9 0 2024-04-20T21:58:35.300 INFO:tasks.workunit.client.0.smithi142.stdout:2/637: mknod d3/d9/d34/db5/dc2/cd2 0 2024-04-20T21:58:35.300 INFO:tasks.workunit.client.0.smithi142.stdout:8/595: mknod d0/d1c/d44/d89/d45/d4c/cd0 0 2024-04-20T21:58:35.301 INFO:tasks.workunit.client.0.smithi142.stdout:3/600: link d6/d15/d30/d37/cbd d6/d15/d30/cde 0 2024-04-20T21:58:35.304 INFO:tasks.workunit.client.0.smithi142.stdout:6/531: unlink d1/d5/c19 0 2024-04-20T21:58:35.305 INFO:tasks.workunit.client.0.smithi142.stdout:7/578: truncate d4/d9/f8d 1004520 0 2024-04-20T21:58:35.306 INFO:tasks.workunit.client.0.smithi142.stdout:9/592: fsync d0/d3c/d4d/d63/d80/fa4 0 2024-04-20T21:58:35.306 INFO:tasks.workunit.client.0.smithi142.stdout:3/601: creat d6/d32/d9b/fdf x:0 0 0 2024-04-20T21:58:35.316 INFO:tasks.workunit.client.0.smithi142.stdout:0/551: link d5/d1c/d3c/d85/f4f d5/d1c/d3c/d4a/d78/fb9 0 2024-04-20T21:58:35.317 INFO:tasks.workunit.client.0.smithi142.stdout:2/638: fsync d3/d5/f4b 0 2024-04-20T21:58:35.317 INFO:tasks.workunit.client.0.smithi142.stdout:7/579: rmdir d4/d7d/da1 39 2024-04-20T21:58:35.320 INFO:tasks.workunit.client.0.smithi142.stdout:9/593: mkdir d0/d3c/d4d/d63/d80/dca 0 2024-04-20T21:58:35.322 INFO:tasks.workunit.client.0.smithi142.stdout:3/602: mkdir d6/d32/d39/d69/de0 0 2024-04-20T21:58:35.330 INFO:tasks.workunit.client.0.smithi142.stdout:0/552: rmdir d5/d1c/d3c/d85/d38/d62 39 2024-04-20T21:58:35.330 INFO:tasks.workunit.client.0.smithi142.stdout:5/464: dread dc/d14/d25/f2d [0,4194304] 0 2024-04-20T21:58:35.330 INFO:tasks.workunit.client.0.smithi142.stdout:6/532: dwrite d1/d11/ff [0,4194304] 0 2024-04-20T21:58:35.331 INFO:tasks.workunit.client.0.smithi142.stdout:7/580: write d4/d7f/d77/d78/d9b/d5a/f76 [4909249,110627] 0 2024-04-20T21:58:35.332 INFO:tasks.workunit.client.0.smithi142.stdout:5/465: write f3 [567562,110712] 0 2024-04-20T21:58:35.336 INFO:tasks.workunit.client.0.smithi142.stdout:9/594: mkdir d0/d91/da0/dcb 0 2024-04-20T21:58:35.340 INFO:tasks.workunit.client.0.smithi142.stdout:5/466: chown dc/d71/f4e 41760077 1 2024-04-20T21:58:35.344 INFO:tasks.workunit.client.0.smithi142.stdout:8/596: dread d0/f13 [0,4194304] 0 2024-04-20T21:58:35.393 INFO:tasks.workunit.client.0.smithi142.stdout:2/639: link d3/d9/d34/fc5 d3/d5/d19/d70/fd3 0 2024-04-20T21:58:35.393 INFO:tasks.workunit.client.0.smithi142.stdout:7/581: fdatasync d4/f48 0 2024-04-20T21:58:35.395 INFO:tasks.workunit.client.0.smithi142.stdout:6/533: fsync d1/d11/fa 0 2024-04-20T21:58:35.396 INFO:tasks.workunit.client.0.smithi142.stdout:7/582: read d4/d7f/f60 [790894,10817] 0 2024-04-20T21:58:35.397 INFO:tasks.workunit.client.0.smithi142.stdout:9/595: mkdir d0/d3c/d4d/d63/d80/dca/dcc 0 2024-04-20T21:58:35.398 INFO:tasks.workunit.client.0.smithi142.stdout:5/467: write dc/d14/f1f [201183,70712] 0 2024-04-20T21:58:35.398 INFO:tasks.workunit.client.0.smithi142.stdout:8/597: rmdir d0/d42 39 2024-04-20T21:58:35.398 INFO:tasks.workunit.client.0.smithi142.stdout:7/583: fdatasync d4/f96 0 2024-04-20T21:58:35.401 INFO:tasks.workunit.client.0.smithi142.stdout:3/603: link d6/d15/d1e/c28 d6/d15/d30/dae/ce1 0 2024-04-20T21:58:35.412 INFO:tasks.workunit.client.0.smithi142.stdout:2/640: dwrite d3/d5/d67/fbc [0,4194304] 0 2024-04-20T21:58:35.417 INFO:tasks.workunit.client.0.smithi142.stdout:7/584: mkdir d4/d9/d1c/dd5 0 2024-04-20T21:58:35.419 INFO:tasks.workunit.client.0.smithi142.stdout:8/598: dwrite d0/d1c/d44/d89/d45/f4d [0,4194304] 0 2024-04-20T21:58:35.422 INFO:tasks.workunit.client.0.smithi142.stdout:3/604: unlink d6/l2a 0 2024-04-20T21:58:35.424 INFO:tasks.workunit.client.0.smithi142.stdout:9/596: creat d0/fcd x:0 0 0 2024-04-20T21:58:35.425 INFO:tasks.workunit.client.0.smithi142.stdout:9/597: chown d0/d36 43 1 2024-04-20T21:58:35.426 INFO:tasks.workunit.client.0.smithi142.stdout:2/641: rename d3/d5/d19/d94/fcf to d3/d5/d19/d70/d3c/fd4 0 2024-04-20T21:58:35.429 INFO:tasks.workunit.client.0.smithi142.stdout:5/468: link dc/c4b dc/d6b/c9e 0 2024-04-20T21:58:35.429 INFO:tasks.workunit.client.0.smithi142.stdout:7/585: chown d4/d7f/d77/d78/da8/d64/cb7 381533 1 2024-04-20T21:58:35.431 INFO:tasks.workunit.client.0.smithi142.stdout:5/469: write dc/d71/f83 [536904,14032] 0 2024-04-20T21:58:35.432 INFO:tasks.workunit.client.0.smithi142.stdout:3/605: mknod d6/d15/d1e/d43/d4d/ce2 0 2024-04-20T21:58:35.434 INFO:tasks.workunit.client.0.smithi142.stdout:9/598: mknod d0/d36/d55/cce 0 2024-04-20T21:58:35.439 INFO:tasks.workunit.client.0.smithi142.stdout:2/642: creat d3/d5/d74/fd5 x:0 0 0 2024-04-20T21:58:35.439 INFO:tasks.workunit.client.0.smithi142.stdout:8/599: mkdir d0/d1c/dd1 0 2024-04-20T21:58:35.442 INFO:tasks.workunit.client.0.smithi142.stdout:5/470: rmdir dc/d14/d21/d46/d2a/d3c 39 2024-04-20T21:58:35.442 INFO:tasks.workunit.client.0.smithi142.stdout:8/600: stat d0/d1c/d44/d89/d45/c7a 0 2024-04-20T21:58:35.445 INFO:tasks.workunit.client.0.smithi142.stdout:9/599: rename d0/d36/l48 to d0/d91/da0/lcf 0 2024-04-20T21:58:35.452 INFO:tasks.workunit.client.0.smithi142.stdout:7/586: creat d4/d9/d1c/fd6 x:0 0 0 2024-04-20T21:58:35.452 INFO:tasks.workunit.client.0.smithi142.stdout:8/601: creat d0/d17/d35/fd2 x:0 0 0 2024-04-20T21:58:35.455 INFO:tasks.workunit.client.0.smithi142.stdout:3/606: dwrite d6/d15/d1e/d43/d4d/d59/db6/fc1 [0,4194304] 0 2024-04-20T21:58:35.456 INFO:tasks.workunit.client.0.smithi142.stdout:9/600: chown d0/d2a/d39/l72 1 1 2024-04-20T21:58:35.457 INFO:tasks.workunit.client.0.smithi142.stdout:5/471: truncate dc/d71/f42 275997 0 2024-04-20T21:58:35.458 INFO:tasks.workunit.client.0.smithi142.stdout:2/643: truncate d3/d9/d89/f65 5708738 0 2024-04-20T21:58:35.462 INFO:tasks.workunit.client.0.smithi142.stdout:8/602: rename d0/d1c/d44/d89/d45/d59/f5a to d0/d17/d35/fd3 0 2024-04-20T21:58:35.466 INFO:tasks.workunit.client.0.smithi142.stdout:8/603: truncate d0/d29/f38 2286404 0 2024-04-20T21:58:35.467 INFO:tasks.workunit.client.0.smithi142.stdout:5/472: symlink dc/d14/d26/d3f/d53/d7c/l9f 0 2024-04-20T21:58:35.475 INFO:tasks.workunit.client.0.smithi142.stdout:3/607: link d6/d15/d1e/d43/fa5 d6/d15/d30/d37/fe3 0 2024-04-20T21:58:35.484 INFO:tasks.workunit.client.0.smithi142.stdout:3/608: unlink d6/d15/f19 0 2024-04-20T21:58:35.485 INFO:tasks.workunit.client.0.smithi142.stdout:7/587: write d4/d9/d11/f3c [870274,3999] 0 2024-04-20T21:58:35.486 INFO:tasks.workunit.client.0.smithi142.stdout:5/473: link dc/d14/d21/f27 dc/d14/d26/fa0 0 2024-04-20T21:58:35.495 INFO:tasks.workunit.client.0.smithi142.stdout:3/609: rename d6/d15 to d6/d15/d1e/de4 22 2024-04-20T21:58:35.495 INFO:tasks.workunit.client.0.smithi142.stdout:9/601: dread d0/d3c/d4d/d63/f65 [0,4194304] 0 2024-04-20T21:58:35.496 INFO:tasks.workunit.client.0.smithi142.stdout:3/610: dread - d6/d15/f95 zero size 2024-04-20T21:58:35.497 INFO:tasks.workunit.client.0.smithi142.stdout:8/604: link d0/l14 d0/d42/ld4 0 2024-04-20T21:58:35.497 INFO:tasks.workunit.client.0.smithi142.stdout:5/474: symlink dc/d14/d25/la1 0 2024-04-20T21:58:35.498 INFO:tasks.workunit.client.0.smithi142.stdout:7/588: mkdir d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7 0 2024-04-20T21:58:35.500 INFO:tasks.workunit.client.0.smithi142.stdout:3/611: chown d6/d15/d47/fac 0 1 2024-04-20T21:58:35.501 INFO:tasks.workunit.client.0.smithi142.stdout:2/644: dread d3/d5/d19/d70/d3c/d64/f7b [0,4194304] 0 2024-04-20T21:58:35.502 INFO:tasks.workunit.client.0.smithi142.stdout:9/602: symlink d0/d2a/d39/d87/d9e/db3/ld0 0 2024-04-20T21:58:35.504 INFO:tasks.workunit.client.0.smithi142.stdout:7/589: unlink d4/d7f/d77/fc2 0 2024-04-20T21:58:35.510 INFO:tasks.workunit.client.0.smithi142.stdout:5/475: rename dc/d14/d21/d46/d2a/d57 to dc/d14/d21/d46/d2a/d65/d79/da2 0 2024-04-20T21:58:35.511 INFO:tasks.workunit.client.0.smithi142.stdout:7/590: dread - d4/d7f/d77/d78/da8/d64/f65 zero size 2024-04-20T21:58:35.512 INFO:tasks.workunit.client.0.smithi142.stdout:8/605: dread d0/d1c/d44/f46 [0,4194304] 0 2024-04-20T21:58:35.521 INFO:tasks.workunit.client.0.smithi142.stdout:8/606: mknod d0/d1c/d44/d89/cd5 0 2024-04-20T21:58:35.522 INFO:tasks.workunit.client.0.smithi142.stdout:8/607: chown d0/da7 0 1 2024-04-20T21:58:35.524 INFO:tasks.workunit.client.0.smithi142.stdout:7/591: rename d4/d9/d11/db9 to d4/d7f/d77/d78/da8/dae/dd8 0 2024-04-20T21:58:35.525 INFO:tasks.workunit.client.0.smithi142.stdout:7/592: chown d4/f48 54 1 2024-04-20T21:58:35.525 INFO:tasks.workunit.client.0.smithi142.stdout:2/645: dwrite d3/d5/d19/d70/d3c/f9f [0,4194304] 0 2024-04-20T21:58:35.529 INFO:tasks.workunit.client.0.smithi142.stdout:5/476: rename dc/d14/d21/d46/d58 to dc/d14/d21/d46/d2a/d65/da3 0 2024-04-20T21:58:35.531 INFO:tasks.workunit.client.0.smithi142.stdout:5/477: chown dc/d71/f83 983255629 1 2024-04-20T21:58:35.535 INFO:tasks.workunit.client.0.smithi142.stdout:3/612: dread d6/d32/d9b/fa8 [0,4194304] 0 2024-04-20T21:58:35.537 INFO:tasks.workunit.client.0.smithi142.stdout:7/593: write d4/d9/d1c/f4a [946963,23718] 0 2024-04-20T21:58:35.541 INFO:tasks.workunit.client.0.smithi142.stdout:2/646: rename d3/d9/d69/cba to d3/d5/d67/db7/cd6 0 2024-04-20T21:58:35.542 INFO:tasks.workunit.client.0.smithi142.stdout:9/603: write d0/d89/fa2 [1035129,37013] 0 2024-04-20T21:58:35.543 INFO:tasks.workunit.client.0.smithi142.stdout:7/594: dread - d4/d7f/d77/d78/d9b/d5a/d90/fb1 zero size 2024-04-20T21:58:35.548 INFO:tasks.workunit.client.0.smithi142.stdout:5/478: rename dc/d14/d21/f6c to dc/d14/d26/d3f/d53/fa4 0 2024-04-20T21:58:35.550 INFO:tasks.workunit.client.0.smithi142.stdout:2/647: mkdir d3/d9/d89/d31/da7/dd7 0 2024-04-20T21:58:35.553 INFO:tasks.workunit.client.0.smithi142.stdout:2/648: readlink d3/d5/d67/l7a 0 2024-04-20T21:58:35.553 INFO:tasks.workunit.client.0.smithi142.stdout:7/595: fdatasync d4/d9/d1c/f4f 0 2024-04-20T21:58:35.555 INFO:tasks.workunit.client.0.smithi142.stdout:2/649: fdatasync d3/d9/d34/fa1 0 2024-04-20T21:58:35.556 INFO:tasks.workunit.client.0.smithi142.stdout:5/479: symlink dc/d14/d26/d3f/d53/d7c/la5 0 2024-04-20T21:58:35.560 INFO:tasks.workunit.client.0.smithi142.stdout:2/650: readlink d3/d9/d89/d31/l62 0 2024-04-20T21:58:35.567 INFO:tasks.workunit.client.0.smithi142.stdout:9/604: write d0/d2a/d39/d87/f92 [423983,86856] 0 2024-04-20T21:58:35.568 INFO:tasks.workunit.client.0.smithi142.stdout:5/480: mkdir dc/d14/d26/d3f/d53/d7c/d97/da6 0 2024-04-20T21:58:35.568 INFO:tasks.workunit.client.0.smithi142.stdout:8/608: dwrite d0/d1c/d44/d89/d45/d4c/fbd [0,4194304] 0 2024-04-20T21:58:35.571 INFO:tasks.workunit.client.0.smithi142.stdout:5/481: fdatasync dc/d14/d25/f3a 0 2024-04-20T21:58:35.572 INFO:tasks.workunit.client.0.smithi142.stdout:2/651: rename d3/d5/d67/dc4/d6c/fcb to d3/d9/d89/d31/da2/fd8 0 2024-04-20T21:58:35.577 INFO:tasks.workunit.client.0.smithi142.stdout:2/652: chown d3/d9/d69/l97 68327922 1 2024-04-20T21:58:35.578 INFO:tasks.workunit.client.0.smithi142.stdout:3/613: dread d6/d15/f5e [0,4194304] 0 2024-04-20T21:58:35.586 INFO:tasks.workunit.client.0.smithi142.stdout:5/482: creat dc/d14/d26/d3f/d53/d7c/fa7 x:0 0 0 2024-04-20T21:58:35.586 INFO:tasks.workunit.client.0.smithi142.stdout:8/609: mknod d0/d1c/cd6 0 2024-04-20T21:58:35.587 INFO:tasks.workunit.client.0.smithi142.stdout:2/653: stat d3/d9/da0/lc1 0 2024-04-20T21:58:35.588 INFO:tasks.workunit.client.0.smithi142.stdout:7/596: dwrite d4/d7f/d77/d7e/f87 [0,4194304] 0 2024-04-20T21:58:35.589 INFO:tasks.workunit.client.0.smithi142.stdout:8/610: write d0/f1b [4404185,90559] 0 2024-04-20T21:58:35.595 INFO:tasks.workunit.client.0.smithi142.stdout:5/483: mknod dc/d14/d21/d46/d2a/d65/d79/d98/ca8 0 2024-04-20T21:58:35.598 INFO:tasks.workunit.client.0.smithi142.stdout:5/484: readlink dc/l31 0 2024-04-20T21:58:35.599 INFO:tasks.workunit.client.0.smithi142.stdout:8/611: rmdir d0/d17/d35 39 2024-04-20T21:58:35.599 INFO:tasks.workunit.client.0.smithi142.stdout:5/485: chown dc/f2f 85 1 2024-04-20T21:58:35.603 INFO:tasks.workunit.client.0.smithi142.stdout:7/597: unlink d4/d7f/d77/d78/d9b/d5a/d90/fa0 0 2024-04-20T21:58:35.607 INFO:tasks.workunit.client.0.smithi142.stdout:7/598: dread - d4/d7f/d77/d78/d9b/f95 zero size 2024-04-20T21:58:35.611 INFO:tasks.workunit.client.0.smithi142.stdout:5/486: rename dc/d14/d21/d46/d2a/d65/da3/d60 to dc/d14/d26/d3f/d53/d7c/da9 0 2024-04-20T21:58:35.619 INFO:tasks.workunit.client.0.smithi142.stdout:5/487: creat dc/d14/d26/faa x:0 0 0 2024-04-20T21:58:35.619 INFO:tasks.workunit.client.0.smithi142.stdout:7/599: creat d4/d7f/d77/d78/d9b/dc1/dd4/fd9 x:0 0 0 2024-04-20T21:58:35.620 INFO:tasks.workunit.client.0.smithi142.stdout:9/605: dread d0/d2a/d39/f6d [0,4194304] 0 2024-04-20T21:58:35.621 INFO:tasks.workunit.client.0.smithi142.stdout:7/600: dread - d4/d9/d11/f9c zero size 2024-04-20T21:58:35.622 INFO:tasks.workunit.client.0.smithi142.stdout:9/606: fsync d0/d36/f41 0 2024-04-20T21:58:35.626 INFO:tasks.workunit.client.0.smithi142.stdout:5/488: unlink dc/d14/d26/d3f/d53/fa4 0 2024-04-20T21:58:35.626 INFO:tasks.workunit.client.0.smithi142.stdout:9/607: mkdir d0/d2a/d39/d87/dd1 0 2024-04-20T21:58:35.634 INFO:tasks.workunit.client.0.smithi142.stdout:2/654: dread d3/d5/d19/d70/d3c/f38 [0,4194304] 0 2024-04-20T21:58:35.638 INFO:tasks.workunit.client.0.smithi142.stdout:2/655: mknod d3/d9/d89/d31/dc3/dce/cd9 0 2024-04-20T21:58:35.639 INFO:tasks.workunit.client.0.smithi142.stdout:9/608: dread d0/d36/f53 [0,4194304] 0 2024-04-20T21:58:35.640 INFO:tasks.workunit.client.0.smithi142.stdout:2/656: readlink d3/d5/d67/l6e 0 2024-04-20T21:58:35.640 INFO:tasks.workunit.client.0.smithi142.stdout:7/601: dwrite d4/d7f/d77/d78/d9b/d5a/d90/f98 [0,4194304] 0 2024-04-20T21:58:35.641 INFO:tasks.workunit.client.0.smithi142.stdout:9/609: chown d0/d2a/d39/f6d 124461 1 2024-04-20T21:58:35.642 INFO:tasks.workunit.client.0.smithi142.stdout:7/602: stat d4/fd2 0 2024-04-20T21:58:35.642 INFO:tasks.workunit.client.0.smithi142.stdout:2/657: chown d3/d5/d67/dc4/d6c/l72 470602126 1 2024-04-20T21:58:35.646 INFO:tasks.workunit.client.0.smithi142.stdout:9/610: rmdir d0/d3c/d4d 39 2024-04-20T21:58:35.648 INFO:tasks.workunit.client.0.smithi142.stdout:7/603: dread d4/d9/f8d [0,4194304] 0 2024-04-20T21:58:35.654 INFO:tasks.workunit.client.0.smithi142.stdout:2/658: rmdir d3/d9/d69 39 2024-04-20T21:58:35.658 INFO:tasks.workunit.client.0.smithi142.stdout:2/659: write d3/d9/d89/d31/f92 [737578,2196] 0 2024-04-20T21:58:35.664 INFO:tasks.workunit.client.0.smithi142.stdout:5/489: dread f2 [0,4194304] 0 2024-04-20T21:58:35.664 INFO:tasks.workunit.client.0.smithi142.stdout:7/604: rmdir d4/d7f/d77/d78 39 2024-04-20T21:58:35.666 INFO:tasks.workunit.client.0.smithi142.stdout:9/611: symlink d0/d2a/d8b/dc1/ld2 0 2024-04-20T21:58:35.667 INFO:tasks.workunit.client.0.smithi142.stdout:9/612: chown d0/f86 546 1 2024-04-20T21:58:35.672 INFO:tasks.workunit.client.0.smithi142.stdout:5/490: fdatasync dc/d14/d21/d46/f24 0 2024-04-20T21:58:35.672 INFO:tasks.workunit.client.0.smithi142.stdout:7/605: creat d4/d7d/da1/fda x:0 0 0 2024-04-20T21:58:35.676 INFO:tasks.workunit.client.0.smithi142.stdout:9/613: creat d0/d2a/fd3 x:0 0 0 2024-04-20T21:58:35.678 INFO:tasks.workunit.client.0.smithi142.stdout:7/606: dread - d4/d9/d1c/f81 zero size 2024-04-20T21:58:35.679 INFO:tasks.workunit.client.0.smithi142.stdout:5/491: mknod dc/d14/d25/d89/d9a/cab 0 2024-04-20T21:58:35.681 INFO:tasks.workunit.client.0.smithi142.stdout:9/614: mkdir d0/d2a/dd4 0 2024-04-20T21:58:35.684 INFO:tasks.workunit.client.0.smithi142.stdout:9/615: chown d0/d89/fc5 49414495 1 2024-04-20T21:58:35.685 INFO:tasks.workunit.client.0.smithi142.stdout:5/492: mkdir dc/d14/d26/d3f/d53/d7c/da9/d75/dac 0 2024-04-20T21:58:35.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.686+0000 7f5d14c00700 1 -- 172.21.15.142:0/3790135802 --> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d08002490 con 0x7f5cf806eac0 2024-04-20T21:58:35.686 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:35 smithi142 ceph-mon[15828]: pgmap v39: 65 pgs: 65 active+clean; 1.2 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 39 MiB/s rd, 155 MiB/s wr, 357 op/s 2024-04-20T21:58:35.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.689+0000 7f5d03e00700 1 -- 172.21.15.142:0/3790135802 <== mgr.24359 v2:172.21.15.164:6828/929524464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f5d08002490 con 0x7f5cf806eac0 2024-04-20T21:58:35.689 INFO:tasks.workunit.client.0.smithi142.stdout:2/660: dwrite d3/f7e [0,4194304] 0 2024-04-20T21:58:35.689 INFO:tasks.workunit.client.0.smithi142.stdout:9/616: dread - d0/d3c/d4d/d63/d80/fa4 zero size 2024-04-20T21:58:35.691 INFO:tasks.workunit.client.0.smithi142.stdout:5/493: mknod dc/d14/d21/d7f/cad 0 2024-04-20T21:58:35.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.692+0000 7f5d14c00700 1 -- 172.21.15.142:0/3790135802 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f5cf806eac0 msgr2=0x7f5cf8070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:35.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.692+0000 7f5d14c00700 1 --2- 172.21.15.142:0/3790135802 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f5cf806eac0 0x7f5cf8070f80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5d0400bd10 tx=0x7f5d0400b480 comp rx=0 tx=0).stop 2024-04-20T21:58:35.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.692+0000 7f5d14c00700 1 -- 172.21.15.142:0/3790135802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d080087d0 msgr2=0x7f5d08132030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:35.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.692+0000 7f5d14c00700 1 --2- 172.21.15.142:0/3790135802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d080087d0 0x7f5d08132030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc000c00 tx=0x7f5cfc00bd70 comp rx=0 tx=0).stop 2024-04-20T21:58:35.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.695+0000 7f5d14c00700 1 -- 172.21.15.142:0/3790135802 shutdown_connections 2024-04-20T21:58:35.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.695+0000 7f5d14c00700 1 --2- 172.21.15.142:0/3790135802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d08007200 0x7f5d08131af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:35.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.695+0000 7f5d14c00700 1 --2- 172.21.15.142:0/3790135802 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f5cf806eac0 0x7f5cf8070f80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:35.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.695+0000 7f5d14c00700 1 --2- 172.21.15.142:0/3790135802 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d080087d0 0x7f5d08132030 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:35.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.695+0000 7f5d14c00700 1 -- 172.21.15.142:0/3790135802 >> 172.21.15.142:0/3790135802 conn(0x7f5d080910d0 msgr2=0x7f5d08097890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:35.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:35 smithi164 ceph-mon[23506]: pgmap v39: 65 pgs: 65 active+clean; 1.2 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 39 MiB/s rd, 155 MiB/s wr, 357 op/s 2024-04-20T21:58:35.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.696+0000 7f5d14c00700 1 -- 172.21.15.142:0/3790135802 shutdown_connections 2024-04-20T21:58:35.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.696+0000 7f5d14c00700 1 -- 172.21.15.142:0/3790135802 wait complete. 2024-04-20T21:58:35.700 INFO:tasks.workunit.client.0.smithi142.stdout:5/494: symlink dc/d14/d26/d3f/d53/d7c/d86/lae 0 2024-04-20T21:58:35.700 INFO:tasks.workunit.client.0.smithi142.stdout:5/495: chown dc/d14/c35 37620615 1 2024-04-20T21:58:35.702 INFO:tasks.workunit.client.0.smithi142.stdout:5/496: fdatasync dc/d71/d5c/f8e 0 2024-04-20T21:58:35.702 INFO:tasks.workunit.client.0.smithi142.stdout:7/607: dwrite d4/d9/d1c/d8e/fa4 [0,4194304] 0 2024-04-20T21:58:35.707 INFO:tasks.workunit.client.0.smithi142.stdout:2/661: dwrite d3/d9/d89/d31/f73 [0,4194304] 0 2024-04-20T21:58:35.712 INFO:tasks.workunit.client.0.smithi142.stdout:9/617: rmdir d0/d2a 39 2024-04-20T21:58:35.712 INFO:tasks.workunit.client.0.smithi142.stdout:7/608: chown d4/d9/d11/c6c 774705 1 2024-04-20T21:58:35.715 INFO:tasks.workunit.client.0.smithi142.stdout:2/662: write d3/d9/d89/f2d [2546505,58538] 0 2024-04-20T21:58:35.719 INFO:tasks.workunit.client.0.smithi142.stdout:9/618: mkdir d0/dd5 0 2024-04-20T21:58:35.722 INFO:tasks.workunit.client.0.smithi142.stdout:4/550: sync 2024-04-20T21:58:35.723 INFO:tasks.workunit.client.0.smithi142.stdout:1/561: sync 2024-04-20T21:58:35.725 INFO:tasks.workunit.client.0.smithi142.stdout:1/562: dread - d2/d4e/f7f zero size 2024-04-20T21:58:35.726 INFO:tasks.workunit.client.0.smithi142.stdout:7/609: dread d4/d7f/d77/d78/d9b/d5a/f76 [4194304,4194304] 0 2024-04-20T21:58:35.728 INFO:tasks.workunit.client.0.smithi142.stdout:2/663: mkdir d3/d9/da3/dae/dda 0 2024-04-20T21:58:35.731 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T21:58:35.731 INFO:tasks.workunit.client.0.smithi142.stdout:9/619: mknod d0/d91/db4/cd6 0 2024-04-20T21:58:35.731 INFO:tasks.workunit.client.0.smithi142.stdout:5/497: write f9 [1228313,52033] 0 2024-04-20T21:58:35.736 INFO:tasks.workunit.client.0.smithi142.stdout:4/551: creat d1/d12/da/d1c/d32/d3d/d2f/d52/d94/fa3 x:0 0 0 2024-04-20T21:58:35.738 INFO:tasks.workunit.client.0.smithi142.stdout:7/610: symlink d4/d7f/d77/d78/da8/dae/dd8/ldb 0 2024-04-20T21:58:35.740 INFO:tasks.workunit.client.0.smithi142.stdout:5/498: creat dc/d14/d25/faf x:0 0 0 2024-04-20T21:58:35.744 INFO:tasks.workunit.client.0.smithi142.stdout:4/552: fsync d1/d12/da/d1c/d32/d3d/f6c 0 2024-04-20T21:58:35.745 INFO:tasks.workunit.client.0.smithi142.stdout:5/499: mkdir dc/d14/d21/d46/d7d/db0 0 2024-04-20T21:58:35.747 INFO:tasks.workunit.client.0.smithi142.stdout:4/553: write d1/d12/da/d1c/d32/d3d/f28 [939372,101909] 0 2024-04-20T21:58:35.747 INFO:tasks.workunit.client.0.smithi142.stdout:7/611: rename d4/d7f/d77/d78/da8/fbd to d4/d7f/d77/d78/da8/d64/fdc 0 2024-04-20T21:58:35.751 INFO:tasks.workunit.client.0.smithi142.stdout:9/620: link d0/d36/d55/c71 d0/dd5/cd7 0 2024-04-20T21:58:35.752 INFO:tasks.workunit.client.0.smithi142.stdout:7/612: read d4/d7f/d77/d78/d9b/d5a/f63 [198067,629] 0 2024-04-20T21:58:35.757 INFO:tasks.workunit.client.0.smithi142.stdout:4/554: symlink d1/la4 0 2024-04-20T21:58:35.762 INFO:tasks.workunit.client.0.smithi142.stdout:2/664: write d3/d5/d19/d70/d3c/f38 [2692895,104262] 0 2024-04-20T21:58:35.763 INFO:tasks.workunit.client.0.smithi142.stdout:5/500: dwrite dc/d71/f83 [0,4194304] 0 2024-04-20T21:58:35.766 INFO:tasks.workunit.client.0.smithi142.stdout:7/613: symlink d4/d7f/d77/ldd 0 2024-04-20T21:58:35.767 INFO:tasks.workunit.client.0.smithi142.stdout:4/555: write d1/d6/d4a/d5a/f99 [1272317,60613] 0 2024-04-20T21:58:35.773 INFO:tasks.workunit.client.0.smithi142.stdout:9/621: rename d0/f23 to d0/fd8 0 2024-04-20T21:58:35.773 INFO:tasks.workunit.client.0.smithi142.stdout:4/556: creat d1/d6/d4b/fa5 x:0 0 0 2024-04-20T21:58:35.773 INFO:tasks.workunit.client.0.smithi142.stdout:7/614: symlink d4/d9/d1c/lde 0 2024-04-20T21:58:35.779 INFO:tasks.workunit.client.0.smithi142.stdout:5/501: rename dc/d14/f37 to dc/d14/d21/d46/d7d/db0/fb1 0 2024-04-20T21:58:35.786 INFO:tasks.workunit.client.0.smithi142.stdout:7/615: creat d4/d7f/d77/d78/d97/d9a/dc4/fdf x:0 0 0 2024-04-20T21:58:35.786 INFO:tasks.workunit.client.0.smithi142.stdout:7/616: chown d4/fb0 457 1 2024-04-20T21:58:35.786 INFO:tasks.workunit.client.0.smithi142.stdout:5/502: creat dc/d14/d21/d46/fb2 x:0 0 0 2024-04-20T21:58:35.794 INFO:tasks.workunit.client.0.smithi142.stdout:7/617: creat d4/d9/d1c/d8e/fe0 x:0 0 0 2024-04-20T21:58:35.795 INFO:tasks.workunit.client.0.smithi142.stdout:4/557: link d1/d12/da/d1c/l6f d1/d12/da/d1c/d32/d3d/d2f/d52/d6d/la6 0 2024-04-20T21:58:35.805 INFO:tasks.workunit.client.0.smithi142.stdout:4/558: creat d1/d6/fa7 x:0 0 0 2024-04-20T21:58:35.809 INFO:tasks.workunit.client.0.smithi142.stdout:7/618: link d4/d9/d1c/c6f d4/d7f/d77/d78/da8/dae/db3/ce1 0 2024-04-20T21:58:35.814 INFO:tasks.workunit.client.0.smithi142.stdout:5/503: dwrite f2 [0,4194304] 0 2024-04-20T21:58:35.815 INFO:tasks.workunit.client.0.smithi142.stdout:2/665: dread d3/d5/d19/f86 [0,4194304] 0 2024-04-20T21:58:35.821 INFO:tasks.workunit.client.0.smithi142.stdout:7/619: symlink d4/d9/d1c/dd5/le2 0 2024-04-20T21:58:35.825 INFO:tasks.workunit.client.0.smithi142.stdout:2/666: mkdir d3/d9/d89/d31/da2/ddb 0 2024-04-20T21:58:35.826 INFO:tasks.workunit.client.0.smithi142.stdout:9/622: dwrite d0/d3c/f5a [0,4194304] 0 2024-04-20T21:58:35.831 INFO:tasks.workunit.client.0.smithi142.stdout:5/504: rename dc/d14/d26/d3f/d53/d7c/d86 to dc/d14/d26/d3f/db3 0 2024-04-20T21:58:35.844 INFO:tasks.workunit.client.0.smithi142.stdout:4/559: write d1/d12/da/d1c/d32/d3d/f6b [959584,57080] 0 2024-04-20T21:58:35.854 INFO:tasks.workunit.client.0.smithi142.stdout:7/620: dwrite d4/d9/d1c/d8e/d88/f9f [0,4194304] 0 2024-04-20T21:58:35.858 INFO:tasks.workunit.client.0.smithi142.stdout:7/621: stat d4/d7f/d77/d78/da8/d64 0 2024-04-20T21:58:35.858 INFO:tasks.workunit.client.0.smithi142.stdout:4/560: getdents d1/d12/da/d1c/d32/d3d/d2f/d73 0 2024-04-20T21:58:35.864 INFO:tasks.workunit.client.0.smithi142.stdout:4/561: chown d1/d6/d30/f8f 2 1 2024-04-20T21:58:35.864 INFO:tasks.workunit.client.0.smithi142.stdout:7/622: creat d4/dd3/fe3 x:0 0 0 2024-04-20T21:58:35.866 INFO:tasks.workunit.client.0.smithi142.stdout:9/623: dread d0/d36/f4c [0,4194304] 0 2024-04-20T21:58:35.873 INFO:tasks.workunit.client.0.smithi142.stdout:2/667: dwrite d3/d9/d34/fb9 [0,4194304] 0 2024-04-20T21:58:35.874 INFO:tasks.workunit.client.0.smithi142.stdout:7/623: creat d4/d7f/d77/d78/da8/d64/fe4 x:0 0 0 2024-04-20T21:58:35.878 INFO:tasks.workunit.client.0.smithi142.stdout:9/624: truncate d0/d3c/d4d/f67 1162505 0 2024-04-20T21:58:35.879 INFO:tasks.workunit.client.0.smithi142.stdout:4/562: write d1/d12/da/d1c/f25 [150129,45970] 0 2024-04-20T21:58:35.880 INFO:tasks.workunit.client.0.smithi142.stdout:7/624: dread - d4/d7f/d77/d7e/fcc zero size 2024-04-20T21:58:35.881 INFO:tasks.workunit.client.0.smithi142.stdout:2/668: write d3/d5/d19/d70/fc6 [569574,12146] 0 2024-04-20T21:58:35.888 INFO:tasks.workunit.client.0.smithi142.stdout:2/669: creat d3/d9/d89/d31/d84/fdc x:0 0 0 2024-04-20T21:58:35.888 INFO:tasks.workunit.client.0.smithi142.stdout:5/505: dread dc/d14/d21/d46/d2a/d65/d79/f90 [0,4194304] 0 2024-04-20T21:58:35.888 INFO:tasks.workunit.client.0.smithi142.stdout:7/625: creat d4/d7f/d77/d78/da8/dae/dc5/fe5 x:0 0 0 2024-04-20T21:58:35.891 INFO:tasks.workunit.client.0.smithi142.stdout:2/670: chown d3/d5/d19/f59 107574 1 2024-04-20T21:58:35.892 INFO:tasks.workunit.client.0.smithi142.stdout:2/671: chown d3/d9/d89/d31 12381 1 2024-04-20T21:58:35.894 INFO:tasks.workunit.client.0.smithi142.stdout:4/563: mknod d1/d12/da/d1c/d32/d3d/d2f/d7a/d90/ca8 0 2024-04-20T21:58:35.898 INFO:tasks.workunit.client.0.smithi142.stdout:4/564: stat d1/f13 0 2024-04-20T21:58:35.898 INFO:tasks.workunit.client.0.smithi142.stdout:7/626: read d4/d7f/d77/d78/da8/f55 [398514,91497] 0 2024-04-20T21:58:35.899 INFO:tasks.workunit.client.0.smithi142.stdout:5/506: write dc/d14/d21/d46/d2a/d3c/f61 [2215067,45651] 0 2024-04-20T21:58:35.902 INFO:tasks.workunit.client.0.smithi142.stdout:0/553: sync 2024-04-20T21:58:35.903 INFO:tasks.workunit.client.0.smithi142.stdout:6/534: sync 2024-04-20T21:58:35.903 INFO:tasks.workunit.client.0.smithi142.stdout:4/565: mkdir d1/d12/da/d1c/da9 0 2024-04-20T21:58:35.904 INFO:tasks.workunit.client.0.smithi142.stdout:5/507: mkdir dc/d14/d25/db4 0 2024-04-20T21:58:35.906 INFO:tasks.workunit.client.0.smithi142.stdout:7/627: fdatasync d4/d7f/d77/d78/f8a 0 2024-04-20T21:58:35.907 INFO:tasks.workunit.client.0.smithi142.stdout:7/628: stat d4/d7f/f91 0 2024-04-20T21:58:35.910 INFO:tasks.workunit.client.0.smithi142.stdout:2/672: getdents d3/d9/da3/dae 0 2024-04-20T21:58:35.912 INFO:tasks.workunit.client.0.smithi142.stdout:2/673: fsync d3/d9/d34/fb9 0 2024-04-20T21:58:35.915 INFO:tasks.workunit.client.0.smithi142.stdout:5/508: mknod dc/d14/d72/cb5 0 2024-04-20T21:58:35.916 INFO:tasks.workunit.client.0.smithi142.stdout:4/566: creat d1/d12/faa x:0 0 0 2024-04-20T21:58:35.920 INFO:tasks.workunit.client.0.smithi142.stdout:9/625: dread d0/d36/f41 [0,4194304] 0 2024-04-20T21:58:35.921 INFO:tasks.workunit.client.0.smithi142.stdout:4/567: read d1/d6/d30/f8f [87148,125486] 0 2024-04-20T21:58:35.926 INFO:tasks.workunit.client.0.smithi142.stdout:7/629: rename d4/le to d4/d7f/d77/d78/d9b/le6 0 2024-04-20T21:58:35.929 INFO:tasks.workunit.client.0.smithi142.stdout:5/509: symlink dc/d14/d26/d3f/d53/d7c/da9/d75/dac/lb6 0 2024-04-20T21:58:35.937 INFO:tasks.workunit.client.0.smithi142.stdout:2/674: rename d3/d5/d19/f21 to d3/d5/fdd 0 2024-04-20T21:58:35.940 INFO:tasks.workunit.client.0.smithi142.stdout:7/630: chown d4/d9/d11/l1a 38509 1 2024-04-20T21:58:35.941 INFO:tasks.workunit.client.0.smithi142.stdout:5/510: truncate dc/d14/d21/d46/d2a/d3c/f44 1126415 0 2024-04-20T21:58:35.945 INFO:tasks.workunit.client.0.smithi142.stdout:5/511: fdatasync dc/d71/d5c/f8e 0 2024-04-20T21:58:35.945 INFO:tasks.workunit.client.0.smithi142.stdout:2/675: unlink d3/d9/da0/lc1 0 2024-04-20T21:58:35.946 INFO:tasks.workunit.client.0.smithi142.stdout:6/535: dwrite d1/d5/fb4 [0,4194304] 0 2024-04-20T21:58:35.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.952+0000 7fd9f4e00700 1 -- 172.21.15.142:0/3872731740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f00ffaf0 msgr2=0x7fd9f00fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:35.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.952+0000 7fd9f4e00700 1 --2- 172.21.15.142:0/3872731740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f00ffaf0 0x7fd9f00fff10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009910 tx=0x7fd9e0009c20 comp rx=0 tx=0).stop 2024-04-20T21:58:35.953 INFO:tasks.workunit.client.0.smithi142.stdout:7/631: write d4/d7f/d77/d78/da8/f34 [837950,65449] 0 2024-04-20T21:58:35.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.953+0000 7fd9f4e00700 1 -- 172.21.15.142:0/3872731740 shutdown_connections 2024-04-20T21:58:35.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.953+0000 7fd9f4e00700 1 --2- 172.21.15.142:0/3872731740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9f0100cf0 0x7fd9f0101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:35.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.953+0000 7fd9f4e00700 1 --2- 172.21.15.142:0/3872731740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f00ffaf0 0x7fd9f00fff10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:35.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.953+0000 7fd9f4e00700 1 -- 172.21.15.142:0/3872731740 >> 172.21.15.142:0/3872731740 conn(0x7fd9f00fb0d0 msgr2=0x7fd9f00fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:35.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.955+0000 7fd9f4e00700 1 -- 172.21.15.142:0/3872731740 shutdown_connections 2024-04-20T21:58:35.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.955+0000 7fd9f4e00700 1 -- 172.21.15.142:0/3872731740 wait complete. 2024-04-20T21:58:35.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.956+0000 7fd9f4e00700 1 Processor -- start 2024-04-20T21:58:35.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.957+0000 7fd9f4e00700 1 -- start start 2024-04-20T21:58:35.958 INFO:tasks.workunit.client.0.smithi142.stdout:2/676: rename d3/d9/d89/f65 to d3/d5/d67/fde 0 2024-04-20T21:58:35.959 INFO:tasks.workunit.client.0.smithi142.stdout:0/554: dread d5/d13/d1e/d23/d2c/f84 [0,4194304] 0 2024-04-20T21:58:35.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.959+0000 7fd9f4e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f00ffaf0 0x7fd9f006ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:35.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.959+0000 7fd9f4e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9f0100cf0 0x7fd9f006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:35.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.960+0000 7fd9f4e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f006da10 con 0x7fd9f00ffaf0 2024-04-20T21:58:35.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.960+0000 7fd9f4e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f006db50 con 0x7fd9f0100cf0 2024-04-20T21:58:35.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.960+0000 7fd9ed400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9f0100cf0 0x7fd9f006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:35.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.960+0000 7fd9ed400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9f0100cf0 0x7fd9f006d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:37406/0 (socket says 172.21.15.142:37406) 2024-04-20T21:58:35.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.960+0000 7fd9ed400700 1 -- 172.21.15.142:0/4055296083 learned_addr learned my addr 172.21.15.142:0/4055296083 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:58:35.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.960+0000 7fd9ede00700 1 --2- 172.21.15.142:0/4055296083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f00ffaf0 0x7fd9f006ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:35.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.961+0000 7fd9ed400700 1 -- 172.21.15.142:0/4055296083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f00ffaf0 msgr2=0x7fd9f006ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:35.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.961+0000 7fd9ed400700 1 --2- 172.21.15.142:0/4055296083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f00ffaf0 0x7fd9f006ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:35.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.961+0000 7fd9ed400700 1 -- 172.21.15.142:0/4055296083 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e00095f0 con 0x7fd9f0100cf0 2024-04-20T21:58:35.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.962+0000 7fd9ed400700 1 --2- 172.21.15.142:0/4055296083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9f0100cf0 0x7fd9f006d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc00e920 tx=0x7fd9dc00ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:35.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.962+0000 7fd9e6a00700 1 -- 172.21.15.142:0/4055296083 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9dc00c9d0 con 0x7fd9f0100cf0 2024-04-20T21:58:35.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.963+0000 7fd9e6a00700 1 -- 172.21.15.142:0/4055296083 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd9dc010430 con 0x7fd9f0100cf0 2024-04-20T21:58:35.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.963+0000 7fd9e6a00700 1 -- 172.21.15.142:0/4055296083 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9dc018630 con 0x7fd9f0100cf0 2024-04-20T21:58:35.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.965+0000 7fd9f4e00700 1 -- 172.21.15.142:0/4055296083 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f00725b0 con 0x7fd9f0100cf0 2024-04-20T21:58:35.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.966+0000 7fd9f4e00700 1 -- 172.21.15.142:0/4055296083 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f0072b80 con 0x7fd9f0100cf0 2024-04-20T21:58:35.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.968+0000 7fd9f4e00700 1 -- 172.21.15.142:0/4055296083 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f0072dc0 con 0x7fd9f0100cf0 2024-04-20T21:58:35.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.970+0000 7fd9e6a00700 1 -- 172.21.15.142:0/4055296083 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 25) v1 ==== 92710+0+0 (secure 0 0 0) 0x7fd9dc0105a0 con 0x7fd9f0100cf0 2024-04-20T21:58:35.970 INFO:tasks.workunit.client.0.smithi142.stdout:4/568: dwrite d1/f13 [4194304,4194304] 0 2024-04-20T21:58:35.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.971+0000 7fd9e6a00700 1 --2- 172.21.15.142:0/4055296083 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fd9d406ead0 0x7fd9d4070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:35.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.971+0000 7fd9e6a00700 1 -- 172.21.15.142:0/4055296083 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7fd9dc014070 con 0x7fd9f0100cf0 2024-04-20T21:58:35.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.972+0000 7fd9ede00700 1 --2- 172.21.15.142:0/4055296083 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fd9d406ead0 0x7fd9d4070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:35.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.973+0000 7fd9ede00700 1 --2- 172.21.15.142:0/4055296083 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fd9d406ead0 0x7fd9d4070f90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000b800 tx=0x7fd9e0009f70 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:35.974 INFO:tasks.workunit.client.0.smithi142.stdout:0/555: write d5/d1c/d3c/d85/d38/f42 [939218,13940] 0 2024-04-20T21:58:35.977 INFO:tasks.workunit.client.0.smithi142.stdout:2/677: truncate d3/d5/d19/d70/d3c/d64/f85 274325 0 2024-04-20T21:58:35.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:35.981+0000 7fd9e6a00700 1 -- 172.21.15.142:0/4055296083 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fd9dc05bb10 con 0x7fd9f0100cf0 2024-04-20T21:58:35.981 INFO:tasks.workunit.client.0.smithi142.stdout:6/536: dwrite d1/d5/f37 [0,4194304] 0 2024-04-20T21:58:35.986 INFO:tasks.workunit.client.0.smithi142.stdout:4/569: unlink d1/d12/da/d1c/c2a 0 2024-04-20T21:58:35.987 INFO:tasks.workunit.client.0.smithi142.stdout:2/678: truncate d3/d9/d89/fc7 469728 0 2024-04-20T21:58:35.994 INFO:tasks.workunit.client.0.smithi142.stdout:7/632: dwrite d4/fd2 [0,4194304] 0 2024-04-20T21:58:35.995 INFO:tasks.workunit.client.0.smithi142.stdout:4/570: mknod d1/cab 0 2024-04-20T21:58:35.995 INFO:tasks.workunit.client.0.smithi142.stdout:6/537: dread - d1/d2f/d35/d5b/d63/d34/fa2 zero size 2024-04-20T21:58:35.997 INFO:tasks.workunit.client.0.smithi142.stdout:2/679: creat d3/d9/d34/fdf x:0 0 0 2024-04-20T21:58:35.999 INFO:tasks.workunit.client.0.smithi142.stdout:0/556: write d5/d13/d1e/d23/d24/f79 [640019,113595] 0 2024-04-20T21:58:36.004 INFO:tasks.workunit.client.0.smithi142.stdout:0/557: chown d5/d6d/cad 4958 1 2024-04-20T21:58:36.004 INFO:tasks.workunit.client.0.smithi142.stdout:6/538: rmdir d1/d2f/d35/d5b/d63/d64 39 2024-04-20T21:58:36.011 INFO:tasks.workunit.client.0.smithi142.stdout:4/571: chown d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/l35 1527 1 2024-04-20T21:58:36.013 INFO:tasks.workunit.client.0.smithi142.stdout:0/558: creat d5/d1c/d3c/d8b/fba x:0 0 0 2024-04-20T21:58:36.015 INFO:tasks.workunit.client.0.smithi142.stdout:6/539: creat d1/d2f/d6c/d7e/fb8 x:0 0 0 2024-04-20T21:58:36.020 INFO:tasks.workunit.client.0.smithi142.stdout:7/633: write d4/d9/d11/f3e [1254127,15792] 0 2024-04-20T21:58:36.022 INFO:tasks.workunit.client.0.smithi142.stdout:4/572: chown d1/d12/da/d1c/d32/d3d/d2f/d7a/d90/ca8 234540 1 2024-04-20T21:58:36.024 INFO:tasks.workunit.client.0.smithi142.stdout:6/540: stat d1/d2f/d35/d5b/d63/d4b/f7b 0 2024-04-20T21:58:36.026 INFO:tasks.workunit.client.0.smithi142.stdout:0/559: symlink d5/d45/d6f/d70/da9/lbb 0 2024-04-20T21:58:36.028 INFO:tasks.workunit.client.0.smithi142.stdout:6/541: dread - d1/d5/d8b/f99 zero size 2024-04-20T21:58:36.029 INFO:tasks.workunit.client.0.smithi142.stdout:7/634: mkdir d4/d7f/d77/d78/d9b/dc1/de7 0 2024-04-20T21:58:36.033 INFO:tasks.workunit.client.0.smithi142.stdout:6/542: write d1/d11/f44 [751594,12940] 0 2024-04-20T21:58:36.033 INFO:tasks.workunit.client.0.smithi142.stdout:2/680: dwrite d3/d9/d89/d31/f92 [0,4194304] 0 2024-04-20T21:58:36.034 INFO:tasks.workunit.client.0.smithi142.stdout:2/681: chown d3 1454752 1 2024-04-20T21:58:36.035 INFO:tasks.workunit.client.0.smithi142.stdout:0/560: write d5/d1c/d3c/f5a [1421926,67747] 0 2024-04-20T21:58:36.037 INFO:tasks.workunit.client.0.smithi142.stdout:7/635: creat d4/d7f/d77/d78/fe8 x:0 0 0 2024-04-20T21:58:36.038 INFO:tasks.workunit.client.0.smithi142.stdout:2/682: write d3/d5/d74/fd5 [957681,46119] 0 2024-04-20T21:58:36.039 INFO:tasks.workunit.client.0.smithi142.stdout:6/543: creat d1/d2f/fb9 x:0 0 0 2024-04-20T21:58:36.044 INFO:tasks.workunit.client.0.smithi142.stdout:6/544: creat d1/d5/fba x:0 0 0 2024-04-20T21:58:36.046 INFO:tasks.workunit.client.0.smithi142.stdout:7/636: fdatasync d4/d7f/d77/d78/da8/d64/f65 0 2024-04-20T21:58:36.049 INFO:tasks.workunit.client.0.smithi142.stdout:0/561: dread d5/d1c/d3c/f61 [0,4194304] 0 2024-04-20T21:58:36.050 INFO:tasks.workunit.client.0.smithi142.stdout:2/683: rename d3/d9/da0 to d3/d9/d89/d31/da2/ddb/de0 0 2024-04-20T21:58:36.052 INFO:tasks.workunit.client.0.smithi142.stdout:4/573: dwrite d1/d12/da/f18 [4194304,4194304] 0 2024-04-20T21:58:36.056 INFO:tasks.workunit.client.0.smithi142.stdout:2/684: fsync d3/d5/f5e 0 2024-04-20T21:58:36.056 INFO:tasks.workunit.client.0.smithi142.stdout:6/545: chown d1/d2f/d35/d5b/d63/d4b/d83/c21 5 1 2024-04-20T21:58:36.061 INFO:tasks.workunit.client.0.smithi142.stdout:4/574: mkdir d1/d12/da/d72/dac 0 2024-04-20T21:58:36.062 INFO:tasks.workunit.client.0.smithi142.stdout:4/575: readlink d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/l35 0 2024-04-20T21:58:36.066 INFO:tasks.workunit.client.0.smithi142.stdout:7/637: rmdir d4/d7f/d77/d78/d9b/dc1/de7 0 2024-04-20T21:58:36.069 INFO:tasks.workunit.client.0.smithi142.stdout:6/546: mkdir d1/d11/dbb 0 2024-04-20T21:58:36.077 INFO:tasks.workunit.client.0.smithi142.stdout:6/547: mkdir d1/d5/d3a/dbc 0 2024-04-20T21:58:36.080 INFO:tasks.workunit.client.0.smithi142.stdout:2/685: mkdir d3/d9/d89/d31/de1 0 2024-04-20T21:58:36.081 INFO:tasks.workunit.client.0.smithi142.stdout:2/686: read d3/d9/d89/d31/f73 [2975888,73254] 0 2024-04-20T21:58:36.084 INFO:tasks.workunit.client.0.smithi142.stdout:6/548: symlink d1/d2f/d35/d5b/d63/d4b/d61/lbd 0 2024-04-20T21:58:36.095 INFO:tasks.workunit.client.0.smithi142.stdout:0/562: getdents d5/d1c/d3c/d4a 0 2024-04-20T21:58:36.096 INFO:tasks.workunit.client.0.smithi142.stdout:0/563: write d5/d1c/d3c/fa5 [539536,107799] 0 2024-04-20T21:58:36.096 INFO:tasks.workunit.client.0.smithi142.stdout:2/687: creat d3/d9/d89/d31/da2/ddb/de0/fe2 x:0 0 0 2024-04-20T21:58:36.096 INFO:tasks.workunit.client.0.smithi142.stdout:6/549: mknod d1/d1b/cbe 0 2024-04-20T21:58:36.096 INFO:tasks.workunit.client.0.smithi142.stdout:0/564: read d5/d1c/d3c/d85/f91 [3102711,4056] 0 2024-04-20T21:58:36.096 INFO:tasks.workunit.client.0.smithi142.stdout:2/688: write d3/d9/d89/d31/f6a [1989539,91003] 0 2024-04-20T21:58:36.097 INFO:tasks.workunit.client.0.smithi142.stdout:6/550: chown d1/d5/d3a/d43/d5c/d8f 128 1 2024-04-20T21:58:36.099 INFO:tasks.workunit.client.0.smithi142.stdout:7/638: getdents d4/d7d/da1 0 2024-04-20T21:58:36.100 INFO:tasks.workunit.client.0.smithi142.stdout:7/639: chown d4/d7f/c70 595 1 2024-04-20T21:58:36.101 INFO:tasks.workunit.client.0.smithi142.stdout:1/563: sync 2024-04-20T21:58:36.101 INFO:tasks.workunit.client.0.smithi142.stdout:3/614: sync 2024-04-20T21:58:36.102 INFO:tasks.workunit.client.0.smithi142.stdout:8/612: sync 2024-04-20T21:58:36.104 INFO:tasks.workunit.client.0.smithi142.stdout:7/640: stat d4/d7f/d77/d78/d9b/d5a/f63 0 2024-04-20T21:58:36.107 INFO:tasks.workunit.client.0.smithi142.stdout:2/689: mkdir d3/d9/db6/de3 0 2024-04-20T21:58:36.123 INFO:tasks.workunit.client.0.smithi142.stdout:1/564: dread - d2/dd/d17/d3b/d50/d62/f94 zero size 2024-04-20T21:58:36.123 INFO:tasks.workunit.client.0.smithi142.stdout:3/615: creat d6/d15/d30/d37/d6c/dcd/fe5 x:0 0 0 2024-04-20T21:58:36.124 INFO:tasks.workunit.client.0.smithi142.stdout:6/551: dwrite d1/d2f/d6c/d7e/fb8 [0,4194304] 0 2024-04-20T21:58:36.129 INFO:tasks.workunit.client.0.smithi142.stdout:3/616: dread - d6/d32/d39/f7b zero size 2024-04-20T21:58:36.130 INFO:tasks.workunit.client.0.smithi142.stdout:6/552: write d1/d5/fb4 [3802113,127624] 0 2024-04-20T21:58:36.134 INFO:tasks.workunit.client.0.smithi142.stdout:3/617: fdatasync d6/d15/d30/f46 0 2024-04-20T21:58:36.135 INFO:tasks.workunit.client.0.smithi142.stdout:0/565: dwrite d5/d1c/d3c/d85/d63/f64 [0,4194304] 0 2024-04-20T21:58:36.142 INFO:tasks.workunit.client.0.smithi142.stdout:8/613: creat d0/d17/d35/db5/fd7 x:0 0 0 2024-04-20T21:58:36.144 INFO:tasks.workunit.client.0.smithi142.stdout:7/641: creat d4/d9/d11/fe9 x:0 0 0 2024-04-20T21:58:36.145 INFO:tasks.workunit.client.0.smithi142.stdout:8/614: chown d0/d17/d35/d9d 637 1 2024-04-20T21:58:36.147 INFO:tasks.workunit.client.0.smithi142.stdout:3/618: mknod d6/d15/d47/ce6 0 2024-04-20T21:58:36.149 INFO:tasks.workunit.client.0.smithi142.stdout:0/566: unlink d5/f21 0 2024-04-20T21:58:36.150 INFO:tasks.workunit.client.0.smithi142.stdout:8/615: write d0/d29/f50 [217184,123931] 0 2024-04-20T21:58:36.155 INFO:tasks.workunit.client.0.smithi142.stdout:2/690: getdents d3/d9/d89/d31 0 2024-04-20T21:58:36.158 INFO:tasks.workunit.client.0.smithi142.stdout:3/619: dread d6/d15/d30/d37/d6c/dcd/f93 [8388608,4194304] 0 2024-04-20T21:58:36.158 INFO:tasks.workunit.client.0.smithi142.stdout:6/553: dwrite d1/d2f/d35/d5b/d39/f52 [0,4194304] 0 2024-04-20T21:58:36.162 INFO:tasks.workunit.client.0.smithi142.stdout:8/616: write d0/d1c/d44/dad/db3/d3f/d7f/d8f/fb8 [911591,95464] 0 2024-04-20T21:58:36.498 INFO:tasks.workunit.client.0.smithi142.stdout:1/565: creat d2/dd/d17/d3b/fc1 x:0 0 0 2024-04-20T21:58:36.498 INFO:tasks.workunit.client.0.smithi142.stdout:8/617: fdatasync d0/d1c/fa0 0 2024-04-20T21:58:36.499 INFO:tasks.workunit.client.0.smithi142.stdout:8/618: readlink d0/d1c/d44/d89/d45/d4c/d68/la1 0 2024-04-20T21:58:36.499 INFO:tasks.workunit.client.0.smithi142.stdout:7/642: dread d4/d9/d1c/d8e/f3a [0,4194304] 0 2024-04-20T21:58:36.499 INFO:tasks.workunit.client.0.smithi142.stdout:2/691: dread d3/d5/d19/d70/d3c/f9f [0,4194304] 0 2024-04-20T21:58:36.499 INFO:tasks.workunit.client.0.smithi142.stdout:7/643: fdatasync d4/d7f/f60 0 2024-04-20T21:58:36.499 INFO:tasks.workunit.client.0.smithi142.stdout:3/620: mkdir d6/d32/de7 0 2024-04-20T21:58:36.499 INFO:tasks.workunit.client.0.smithi142.stdout:6/554: dwrite d1/d2f/d35/d5b/d63/d34/f4c [0,4194304] 0 2024-04-20T21:58:36.499 INFO:tasks.workunit.client.0.smithi142.stdout:2/692: rename d3/d9/d89/d31/da7/dbe to d3/d9/db6/de4 0 2024-04-20T21:58:36.500 INFO:tasks.workunit.client.0.smithi142.stdout:3/621: mkdir d6/d15/d1e/d43/d4d/d59/de8 0 2024-04-20T21:58:36.500 INFO:tasks.workunit.client.0.smithi142.stdout:8/619: dwrite d0/d17/f34 [0,4194304] 0 2024-04-20T21:58:36.500 INFO:tasks.workunit.client.0.smithi142.stdout:8/620: truncate d0/d1c/fa0 612269 0 2024-04-20T21:58:36.500 INFO:tasks.workunit.client.0.smithi142.stdout:1/566: rmdir d2 39 2024-04-20T21:58:36.500 INFO:tasks.workunit.client.0.smithi142.stdout:1/567: readlink d2/d4e/l80 0 2024-04-20T21:58:36.500 INFO:tasks.workunit.client.0.smithi142.stdout:0/567: dwrite d5/f53 [0,4194304] 0 2024-04-20T21:58:36.500 INFO:tasks.workunit.client.0.smithi142.stdout:7/644: dwrite d4/d7f/d77/d7e/f94 [0,4194304] 0 2024-04-20T21:58:36.500 INFO:tasks.workunit.client.0.smithi142.stdout:3/622: truncate d6/d15/d30/f44 4491883 0 2024-04-20T21:58:36.500 INFO:tasks.workunit.client.0.smithi142.stdout:6/555: dread d1/d5/d3a/d43/d5c/f7c [0,4194304] 0 2024-04-20T21:58:36.500 INFO:tasks.workunit.client.0.smithi142.stdout:2/693: dwrite d3/d9/d89/d31/da2/ddb/de0/fe2 [0,4194304] 0 2024-04-20T21:58:36.500 INFO:tasks.workunit.client.0.smithi142.stdout:1/568: rename d2/dd/d17/d1b/d22/d55/fb9 to d2/dd/d1c/d60/fc2 0 2024-04-20T21:58:36.500 INFO:tasks.workunit.client.0.smithi142.stdout:0/568: getdents d5/d13/d1e/d23/d24/d48/d55 0 2024-04-20T21:58:36.501 INFO:tasks.workunit.client.0.smithi142.stdout:6/556: fsync d1/d11/f44 0 2024-04-20T21:58:36.501 INFO:tasks.workunit.client.0.smithi142.stdout:8/621: dwrite d0/d1c/d44/dad/db3/f52 [0,4194304] 0 2024-04-20T21:58:36.501 INFO:tasks.workunit.client.0.smithi142.stdout:3/623: mkdir d6/d32/de9 0 2024-04-20T21:58:36.501 INFO:tasks.workunit.client.0.smithi142.stdout:0/569: read d5/d1c/d3c/d85/d63/f64 [3331069,45478] 0 2024-04-20T21:58:36.501 INFO:tasks.workunit.client.0.smithi142.stdout:8/622: read d0/d1c/d44/d89/d45/d4c/fbd [2532943,118570] 0 2024-04-20T21:58:36.501 INFO:tasks.workunit.client.0.smithi142.stdout:7/645: dwrite d4/d7f/d77/d78/da8/dae/dd8/fc9 [0,4194304] 0 2024-04-20T21:58:36.501 INFO:tasks.workunit.client.0.smithi142.stdout:0/570: creat d5/d1c/d3c/fbc x:0 0 0 2024-04-20T21:58:36.501 INFO:tasks.workunit.client.0.smithi142.stdout:7/646: write d4/d7f/d77/d78/d9b/d5a/d90/dbc/fcd [567773,100322] 0 2024-04-20T21:58:36.501 INFO:tasks.workunit.client.0.smithi142.stdout:7/647: read d4/d7d/fc7 [1873183,91674] 0 2024-04-20T21:58:36.501 INFO:tasks.workunit.client.0.smithi142.stdout:3/624: creat d6/d15/d30/d37/d6c/dcd/d99/fea x:0 0 0 2024-04-20T21:58:36.501 INFO:tasks.workunit.client.0.smithi142.stdout:6/557: rename d1/d5/ce to d1/d75/cbf 0 2024-04-20T21:58:36.501 INFO:tasks.workunit.client.0.smithi142.stdout:4/576: sync 2024-04-20T21:58:36.501 INFO:tasks.workunit.client.0.smithi142.stdout:9/626: sync 2024-04-20T21:58:36.501 INFO:tasks.workunit.client.0.smithi142.stdout:5/512: sync 2024-04-20T21:58:36.502 INFO:tasks.workunit.client.0.smithi142.stdout:7/648: dread d4/d7f/d77/d78/da8/d64/fdc [0,4194304] 0 2024-04-20T21:58:36.502 INFO:tasks.workunit.client.0.smithi142.stdout:2/694: rename d3/d9/d69/l97 to d3/d9/d89/d9a/le5 0 2024-04-20T21:58:36.502 INFO:tasks.workunit.client.0.smithi142.stdout:4/577: fdatasync d1/d12/da/d1c/d32/d3d/d2f/d49/f75 0 2024-04-20T21:58:36.502 INFO:tasks.workunit.client.0.smithi142.stdout:7/649: mknod d4/d7f/d77/d78/da8/dae/cea 0 2024-04-20T21:58:36.502 INFO:tasks.workunit.client.0.smithi142.stdout:3/625: dwrite d6/d15/d1e/dab/faf [0,4194304] 0 2024-04-20T21:58:36.502 INFO:tasks.workunit.client.0.smithi142.stdout:8/623: rename d0/f2f to d0/d1c/d44/dad/db3/d3f/fd8 0 2024-04-20T21:58:36.502 INFO:tasks.workunit.client.0.smithi142.stdout:4/578: creat d1/d6/d4b/fad x:0 0 0 2024-04-20T21:58:36.502 INFO:tasks.workunit.client.0.smithi142.stdout:7/650: readlink d4/d9/d1c/d8e/l3f 0 2024-04-20T21:58:36.503 INFO:tasks.workunit.client.0.smithi142.stdout:6/558: mkdir d1/d2f/d6c/d7e/d9f/dc0 0 2024-04-20T21:58:36.503 INFO:tasks.workunit.client.0.smithi142.stdout:0/571: write d5/d1d/f22 [326609,7738] 0 2024-04-20T21:58:36.503 INFO:tasks.workunit.client.0.smithi142.stdout:1/569: dread d2/dd/d17/d1b/d22/d13/f14 [0,4194304] 0 2024-04-20T21:58:36.503 INFO:tasks.workunit.client.0.smithi142.stdout:5/513: dwrite dc/d71/f83 [0,4194304] 0 2024-04-20T21:58:36.503 INFO:tasks.workunit.client.0.smithi142.stdout:6/559: readlink d1/d5/d3a/d43/d5c/l6d 0 2024-04-20T21:58:36.503 INFO:tasks.workunit.client.0.smithi142.stdout:1/570: chown d2/dd/d17/d1b/d22/c2e 2029585 1 2024-04-20T21:58:36.503 INFO:tasks.workunit.client.0.smithi142.stdout:9/627: dwrite d0/d2a/f2d [4194304,4194304] 0 2024-04-20T21:58:36.504 INFO:tasks.workunit.client.0.smithi142.stdout:1/571: dread - d2/d4e/f64 zero size 2024-04-20T21:58:36.504 INFO:tasks.workunit.client.0.smithi142.stdout:6/560: fsync d1/d2f/d35/d5b/d63/d4b/f7b 0 2024-04-20T21:58:36.504 INFO:tasks.workunit.client.0.smithi142.stdout:4/579: rename d1/d12/da/d1c/d32/d3d/d2f/d7a/c8a to d1/d12/da/d1c/d32/d3d/d2f/d52/cae 0 2024-04-20T21:58:36.504 INFO:tasks.workunit.client.0.smithi142.stdout:1/572: write d2/dd/d17/d1b/f5b [315962,111569] 0 2024-04-20T21:58:36.504 INFO:tasks.workunit.client.0.smithi142.stdout:3/626: dread d6/f2e [0,4194304] 0 2024-04-20T21:58:36.504 INFO:tasks.workunit.client.0.smithi142.stdout:8/624: dwrite d0/d1c/d44/dad/db3/d3f/d7f/fc3 [0,4194304] 0 2024-04-20T21:58:36.504 INFO:tasks.workunit.client.0.smithi142.stdout:8/625: truncate d0/f1b 4953282 0 2024-04-20T21:58:36.504 INFO:tasks.workunit.client.0.smithi142.stdout:7/651: link d4/d7f/l66 d4/d7f/d77/d78/d97/d9a/dc4/leb 0 2024-04-20T21:58:36.504 INFO:tasks.workunit.client.0.smithi142.stdout:1/573: mkdir d2/dd/d17/d1b/d22/d20/dc3 0 2024-04-20T21:58:36.504 INFO:tasks.workunit.client.0.smithi142.stdout:1/574: chown d2/dd/d17/d1b/d22/d13/l2b 56 1 2024-04-20T21:58:36.505 INFO:tasks.workunit.client.0.smithi142.stdout:3/627: symlink d6/d15/d30/d37/d6c/dcd/d99/leb 0 2024-04-20T21:58:36.505 INFO:tasks.workunit.client.0.smithi142.stdout:8/626: symlink d0/d42/d90/ld9 0 2024-04-20T21:58:36.505 INFO:tasks.workunit.client.0.smithi142.stdout:5/514: truncate dc/d14/d21/d7f/f99 854261 0 2024-04-20T21:58:36.505 INFO:tasks.workunit.client.0.smithi142.stdout:9/628: symlink d0/d2a/dd4/ld9 0 2024-04-20T21:58:36.505 INFO:tasks.workunit.client.0.smithi142.stdout:1/575: unlink d2/d4e/f68 0 2024-04-20T21:58:36.505 INFO:tasks.workunit.client.0.smithi142.stdout:7/652: mkdir d4/d7f/d77/d78/da8/dae/db3/dec 0 2024-04-20T21:58:36.505 INFO:tasks.workunit.client.0.smithi142.stdout:5/515: write dc/d14/d26/faa [404347,124033] 0 2024-04-20T21:58:36.505 INFO:tasks.workunit.client.0.smithi142.stdout:3/628: getdents d6/d32/de7 0 2024-04-20T21:58:36.505 INFO:tasks.workunit.client.0.smithi142.stdout:8/627: creat d0/d1c/d44/d89/d45/d92/fda x:0 0 0 2024-04-20T21:58:36.505 INFO:tasks.workunit.client.0.smithi142.stdout:7/653: write d4/d7f/d77/d78/da8/dae/fa5 [88419,85493] 0 2024-04-20T21:58:36.505 INFO:tasks.workunit.client.0.smithi142.stdout:1/576: truncate d2/dd/d1c/d60/fa2 944824 0 2024-04-20T21:58:36.505 INFO:tasks.workunit.client.0.smithi142.stdout:0/572: dread d5/d45/f47 [0,4194304] 0 2024-04-20T21:58:36.506 INFO:tasks.workunit.client.0.smithi142.stdout:3/629: mknod d6/d15/d30/db4/cec 0 2024-04-20T21:58:36.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.438+0000 7fd9f4e00700 1 -- 172.21.15.142:0/4055296083 --> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9f01076f0 con 0x7fd9d406ead0 2024-04-20T21:58:36.506 INFO:tasks.workunit.client.0.smithi142.stdout:8/628: write d0/d1c/d44/d89/d45/f4d [4249499,40246] 0 2024-04-20T21:58:36.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.440+0000 7fd9e6a00700 1 -- 172.21.15.142:0/4055296083 <== mgr.24359 v2:172.21.15.164:6828/929524464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fd9f01076f0 con 0x7fd9d406ead0 2024-04-20T21:58:36.507 INFO:tasks.workunit.client.0.smithi142.stdout:0/573: chown d5/d1c/d3c/d4a/f7c 9 1 2024-04-20T21:58:36.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.444+0000 7fd9f4e00700 1 -- 172.21.15.142:0/4055296083 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fd9d406ead0 msgr2=0x7fd9d4070f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:36.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.444+0000 7fd9f4e00700 1 --2- 172.21.15.142:0/4055296083 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fd9d406ead0 0x7fd9d4070f90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000b800 tx=0x7fd9e0009f70 comp rx=0 tx=0).stop 2024-04-20T21:58:36.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.444+0000 7fd9f4e00700 1 -- 172.21.15.142:0/4055296083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9f0100cf0 msgr2=0x7fd9f006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:36.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.444+0000 7fd9f4e00700 1 --2- 172.21.15.142:0/4055296083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9f0100cf0 0x7fd9f006d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc00e920 tx=0x7fd9dc00ec30 comp rx=0 tx=0).stop 2024-04-20T21:58:36.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.444+0000 7fd9f4e00700 1 -- 172.21.15.142:0/4055296083 shutdown_connections 2024-04-20T21:58:36.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.444+0000 7fd9f4e00700 1 --2- 172.21.15.142:0/4055296083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9f00ffaf0 0x7fd9f006ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:36.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.444+0000 7fd9f4e00700 1 --2- 172.21.15.142:0/4055296083 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7fd9d406ead0 0x7fd9d4070f90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:36.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.444+0000 7fd9f4e00700 1 --2- 172.21.15.142:0/4055296083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9f0100cf0 0x7fd9f006d3f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:36.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.444+0000 7fd9f4e00700 1 -- 172.21.15.142:0/4055296083 >> 172.21.15.142:0/4055296083 conn(0x7fd9f00fb0d0 msgr2=0x7fd9f0104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:36.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.445+0000 7fd9f4e00700 1 -- 172.21.15.142:0/4055296083 shutdown_connections 2024-04-20T21:58:36.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.445+0000 7fd9f4e00700 1 -- 172.21.15.142:0/4055296083 wait complete. 2024-04-20T21:58:36.513 INFO:tasks.workunit.client.0.smithi142.stdout:0/574: read d5/d1c/d3c/d8b/f97 [2060043,36364] 0 2024-04-20T21:58:36.513 INFO:tasks.workunit.client.0.smithi142.stdout:3/630: symlink d6/d32/d9b/led 0 2024-04-20T21:58:36.513 INFO:tasks.workunit.client.0.smithi142.stdout:8/629: creat d0/d17/d35/fdb x:0 0 0 2024-04-20T21:58:36.513 INFO:tasks.workunit.client.0.smithi142.stdout:9/629: write d0/f8 [4204371,86309] 0 2024-04-20T21:58:36.513 INFO:tasks.workunit.client.0.smithi142.stdout:1/577: symlink d2/dd/d17/d8b/daf/lc4 0 2024-04-20T21:58:36.513 INFO:tasks.workunit.client.0.smithi142.stdout:7/654: dwrite d4/d9/d1c/f23 [4194304,4194304] 0 2024-04-20T21:58:36.513 INFO:tasks.workunit.client.0.smithi142.stdout:1/578: write d2/dd/d17/d3b/d50/d62/f94 [1004294,70760] 0 2024-04-20T21:58:36.513 INFO:tasks.workunit.client.0.smithi142.stdout:9/630: symlink d0/d3c/d4d/d63/d80/lda 0 2024-04-20T21:58:36.513 INFO:tasks.workunit.client.0.smithi142.stdout:7/655: fsync d4/d7f/d77/d78/da8/dae/fa5 0 2024-04-20T21:58:36.514 INFO:tasks.workunit.client.0.smithi142.stdout:5/516: getdents dc/d14/d26/d3f 0 2024-04-20T21:58:36.514 INFO:tasks.workunit.client.0.smithi142.stdout:5/517: chown dc/d71/d5c/d68 38347 1 2024-04-20T21:58:36.514 INFO:tasks.workunit.client.0.smithi142.stdout:0/575: write d5/d1c/d3c/d8b/fb5 [584554,1856] 0 2024-04-20T21:58:36.514 INFO:tasks.workunit.client.0.smithi142.stdout:0/576: chown d5/d1c/d3c/d85/d32/c9d 21 1 2024-04-20T21:58:36.514 INFO:tasks.workunit.client.0.smithi142.stdout:5/518: symlink dc/d14/d21/lb7 0 2024-04-20T21:58:36.514 INFO:tasks.workunit.client.0.smithi142.stdout:3/631: write d6/f9c [1124522,36302] 0 2024-04-20T21:58:36.514 INFO:tasks.workunit.client.0.smithi142.stdout:8/630: link d0/d1c/d44/d89/l3e d0/d29/ldc 0 2024-04-20T21:58:36.514 INFO:tasks.workunit.client.0.smithi142.stdout:1/579: creat d2/dd/d17/d1b/fc5 x:0 0 0 2024-04-20T21:58:36.514 INFO:tasks.workunit.client.0.smithi142.stdout:8/631: write d0/f26 [3417359,129798] 0 2024-04-20T21:58:36.514 INFO:tasks.workunit.client.0.smithi142.stdout:9/631: getdents d0/d2a/d39/d87/d9e/db3 0 2024-04-20T21:58:36.514 INFO:tasks.workunit.client.0.smithi142.stdout:5/519: read f9 [757923,99748] 0 2024-04-20T21:58:36.514 INFO:tasks.workunit.client.0.smithi142.stdout:0/577: rename d5/d1c/d3c/d4a/faa to d5/d1d/fbd 0 2024-04-20T21:58:36.514 INFO:tasks.workunit.client.0.smithi142.stdout:3/632: truncate d6/d32/f51 278429 0 2024-04-20T21:58:36.514 INFO:tasks.workunit.client.0.smithi142.stdout:3/633: stat d6/d32/d9b/fdf 0 2024-04-20T21:58:36.515 INFO:tasks.workunit.client.0.smithi142.stdout:7/656: dread d4/d9/d1c/d8e/d88/f9e [0,4194304] 0 2024-04-20T21:58:36.520 INFO:tasks.workunit.client.0.smithi142.stdout:5/520: creat dc/d71/d93/fb8 x:0 0 0 2024-04-20T21:58:36.525 INFO:tasks.workunit.client.0.smithi142.stdout:1/580: dwrite d2/dd/d17/d3b/fc1 [0,4194304] 0 2024-04-20T21:58:36.525 INFO:tasks.workunit.client.0.smithi142.stdout:0/578: dread d5/d13/d1e/d23/d46/f4c [0,4194304] 0 2024-04-20T21:58:36.567 INFO:tasks.workunit.client.0.smithi142.stdout:8/632: write d0/d1c/f61 [1013088,77173] 0 2024-04-20T21:58:36.567 INFO:tasks.workunit.client.0.smithi142.stdout:3/634: getdents d6/d15/d30/d37/d6c/dcd/d99 0 2024-04-20T21:58:36.569 INFO:tasks.workunit.client.0.smithi142.stdout:5/521: read dc/d14/f1a [5785570,42669] 0 2024-04-20T21:58:36.571 INFO:tasks.workunit.client.0.smithi142.stdout:8/633: rmdir d0/d42/d90 39 2024-04-20T21:58:36.571 INFO:tasks.workunit.client.0.smithi142.stdout:1/581: symlink d2/dd/d1c/lc6 0 2024-04-20T21:58:36.572 INFO:tasks.workunit.client.0.smithi142.stdout:9/632: dwrite d0/d2a/d39/f5e [0,4194304] 0 2024-04-20T21:58:36.574 INFO:tasks.workunit.client.0.smithi142.stdout:3/635: fdatasync d6/d32/d39/f7b 0 2024-04-20T21:58:36.576 INFO:tasks.workunit.client.0.smithi142.stdout:8/634: dread - d0/d1c/d44/d89/d45/d4c/f77 zero size 2024-04-20T21:58:36.576 INFO:tasks.workunit.client.0.smithi142.stdout:9/633: chown d0/ff 2551 1 2024-04-20T21:58:36.579 INFO:tasks.workunit.client.0.smithi142.stdout:0/579: creat d5/d13/fbe x:0 0 0 2024-04-20T21:58:36.579 INFO:tasks.workunit.client.0.smithi142.stdout:1/582: symlink d2/dd/lc7 0 2024-04-20T21:58:36.580 INFO:tasks.workunit.client.0.smithi142.stdout:8/635: truncate d0/d1c/f9e 350266 0 2024-04-20T21:58:36.580 INFO:tasks.workunit.client.0.smithi142.stdout:0/580: chown d5/d13/l60 28428 1 2024-04-20T21:58:36.581 INFO:tasks.workunit.client.0.smithi142.stdout:9/634: unlink d0/d2a/f4f 0 2024-04-20T21:58:36.583 INFO:tasks.workunit.client.0.smithi142.stdout:5/522: link dc/d71/d5c/d68/f8c dc/d71/fb9 0 2024-04-20T21:58:36.591 INFO:tasks.workunit.client.0.smithi142.stdout:0/581: rmdir d5/d1c/d3c/db2 0 2024-04-20T21:58:36.591 INFO:tasks.workunit.client.0.smithi142.stdout:5/523: fdatasync dc/d71/f6e 0 2024-04-20T21:58:36.591 INFO:tasks.workunit.client.0.smithi142.stdout:3/636: dread d6/d32/d9b/fa8 [0,4194304] 0 2024-04-20T21:58:36.595 INFO:tasks.workunit.client.0.smithi142.stdout:5/524: dread - dc/d14/d21/f6f zero size 2024-04-20T21:58:36.598 INFO:tasks.workunit.client.0.smithi142.stdout:5/525: dread - dc/d14/d25/faf zero size 2024-04-20T21:58:36.598 INFO:tasks.workunit.client.0.smithi142.stdout:3/637: symlink d6/d15/d47/d83/lee 0 2024-04-20T21:58:36.602 INFO:tasks.workunit.client.0.smithi142.stdout:8/636: dwrite d0/d1c/d44/dad/db3/f52 [0,4194304] 0 2024-04-20T21:58:36.606 INFO:tasks.workunit.client.0.smithi142.stdout:0/582: dread d5/f6c [0,4194304] 0 2024-04-20T21:58:36.606 INFO:tasks.workunit.client.0.smithi142.stdout:3/638: dread - d6/d15/d1e/d43/f70 zero size 2024-04-20T21:58:36.607 INFO:tasks.workunit.client.0.smithi142.stdout:8/637: symlink d0/da7/ldd 0 2024-04-20T21:58:36.611 INFO:tasks.workunit.client.0.smithi142.stdout:9/635: write d0/d2a/f4a [1880654,59976] 0 2024-04-20T21:58:36.622 INFO:tasks.workunit.client.0.smithi142.stdout:3/639: unlink d6/d15/d30/d37/d75/la0 0 2024-04-20T21:58:36.623 INFO:tasks.workunit.client.0.smithi142.stdout:3/640: chown d6/d32/d39/d69/de0 2 1 2024-04-20T21:58:36.624 INFO:tasks.workunit.client.0.smithi142.stdout:8/638: mknod d0/d1c/cde 0 2024-04-20T21:58:36.632 INFO:tasks.workunit.client.0.smithi142.stdout:8/639: symlink d0/d1c/d44/dad/db3/d3f/d7f/ldf 0 2024-04-20T21:58:36.641 INFO:tasks.workunit.client.0.smithi142.stdout:9/636: rmdir d0/d2a/d39/d87/dd1 0 2024-04-20T21:58:36.642 INFO:tasks.workunit.client.0.smithi142.stdout:0/583: dwrite d5/f17 [4194304,4194304] 0 2024-04-20T21:58:36.643 INFO:tasks.workunit.client.0.smithi142.stdout:5/526: dread f9 [0,4194304] 0 2024-04-20T21:58:36.644 INFO:tasks.workunit.client.0.smithi142.stdout:8/640: getdents d0/d1c/d44/d89/d45/d92 0 2024-04-20T21:58:36.648 INFO:tasks.workunit.client.0.smithi142.stdout:9/637: unlink d0/d2a/f4a 0 2024-04-20T21:58:36.652 INFO:tasks.workunit.client.0.smithi142.stdout:3/641: dwrite d6/d15/d30/d37/d75/fbe [0,4194304] 0 2024-04-20T21:58:36.653 INFO:tasks.workunit.client.0.smithi142.stdout:5/527: symlink dc/d14/d21/d46/d2a/d3c/lba 0 2024-04-20T21:58:36.662 INFO:tasks.workunit.client.0.smithi142.stdout:5/528: dread dc/d14/d21/d46/d2a/f8a [0,4194304] 0 2024-04-20T21:58:36.663 INFO:tasks.workunit.client.0.smithi142.stdout:3/642: mknod d6/d15/d47/d83/dc9/da7/cef 0 2024-04-20T21:58:36.669 INFO:tasks.workunit.client.0.smithi142.stdout:8/641: rename d0/d1c/d44/d89/d45/d4c/fbd to d0/d1c/d44/dad/db3/fe0 0 2024-04-20T21:58:36.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.681+0000 7f567b400700 1 -- 172.21.15.142:0/1019032150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5674073940 msgr2=0x7f5674073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:36.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.681+0000 7f567b400700 1 --2- 172.21.15.142:0/1019032150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5674073940 0x7f5674073dc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5660009910 tx=0x7f5660009c20 comp rx=0 tx=0).stop 2024-04-20T21:58:36.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.681+0000 7f567b400700 1 -- 172.21.15.142:0/1019032150 shutdown_connections 2024-04-20T21:58:36.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.681+0000 7f567b400700 1 --2- 172.21.15.142:0/1019032150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5674073940 0x7f5674073dc0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:36.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.681+0000 7f567b400700 1 --2- 172.21.15.142:0/1019032150 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5674074f10 0x7f5674073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:36.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.681+0000 7f567b400700 1 -- 172.21.15.142:0/1019032150 >> 172.21.15.142:0/1019032150 conn(0x7f56740fc1c0 msgr2=0x7f56740fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:36.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.682+0000 7f567b400700 1 -- 172.21.15.142:0/1019032150 shutdown_connections 2024-04-20T21:58:36.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.682+0000 7f567b400700 1 -- 172.21.15.142:0/1019032150 wait complete. 2024-04-20T21:58:36.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.683+0000 7f567b400700 1 Processor -- start 2024-04-20T21:58:36.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.683+0000 7f567b400700 1 -- start start 2024-04-20T21:58:36.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.684+0000 7f567b400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5674073940 0x7f567419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:36.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.684+0000 7f567b400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5674074f10 0x7f567419d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:36.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.684+0000 7f567b400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567419d7d0 con 0x7f5674074f10 2024-04-20T21:58:36.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.684+0000 7f567b400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56741a2190 con 0x7f5674073940 2024-04-20T21:58:36.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.684+0000 7f5673e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5674074f10 0x7f567419d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:36.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.684+0000 7f5673e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5674074f10 0x7f567419d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44110/0 (socket says 172.21.15.142:44110) 2024-04-20T21:58:36.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.684+0000 7f5673e00700 1 -- 172.21.15.142:0/696104180 learned_addr learned my addr 172.21.15.142:0/696104180 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:58:36.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.684+0000 7f5678a00700 1 --2- 172.21.15.142:0/696104180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5674073940 0x7f567419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:36.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.685+0000 7f5673e00700 1 -- 172.21.15.142:0/696104180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5674073940 msgr2=0x7f567419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:36.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.685+0000 7f5673e00700 1 --2- 172.21.15.142:0/696104180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5674073940 0x7f567419cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:36.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.685+0000 7f5673e00700 1 -- 172.21.15.142:0/696104180 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56600095f0 con 0x7f5674074f10 2024-04-20T21:58:36.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.685+0000 7f5678a00700 1 --2- 172.21.15.142:0/696104180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5674073940 0x7f567419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:58:36.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.685+0000 7f5673e00700 1 --2- 172.21.15.142:0/696104180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5674074f10 0x7f567419d1b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f566000b620 tx=0x7f5660005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:36.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.686+0000 7f5671600700 1 -- 172.21.15.142:0/696104180 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f566001d070 con 0x7f5674074f10 2024-04-20T21:58:36.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.686+0000 7f5671600700 1 -- 172.21.15.142:0/696104180 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f56600052a0 con 0x7f5674074f10 2024-04-20T21:58:36.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.686+0000 7f5671600700 1 -- 172.21.15.142:0/696104180 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5660017400 con 0x7f5674074f10 2024-04-20T21:58:36.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.686+0000 7f567b400700 1 -- 172.21.15.142:0/696104180 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56741a2330 con 0x7f5674074f10 2024-04-20T21:58:36.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.686+0000 7f567b400700 1 -- 172.21.15.142:0/696104180 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56741a2870 con 0x7f5674074f10 2024-04-20T21:58:36.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.687+0000 7f567b400700 1 -- 172.21.15.142:0/696104180 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5674062510 con 0x7f5674074f10 2024-04-20T21:58:36.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.689+0000 7f5671600700 1 -- 172.21.15.142:0/696104180 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 25) v1 ==== 92710+0+0 (secure 0 0 0) 0x7f5660003680 con 0x7f5674074f10 2024-04-20T21:58:36.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.690+0000 7f5671600700 1 --2- 172.21.15.142:0/696104180 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f565c06eac0 0x7f565c070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:36.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.690+0000 7f5671600700 1 -- 172.21.15.142:0/696104180 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f566008fe10 con 0x7f5674074f10 2024-04-20T21:58:36.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.690+0000 7f5678a00700 1 --2- 172.21.15.142:0/696104180 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f565c06eac0 0x7f565c070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:36.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.691+0000 7f5678a00700 1 --2- 172.21.15.142:0/696104180 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f565c06eac0 0x7f565c070f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f567419e100 tx=0x7f5668009260 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:36.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:36.695+0000 7f5671600700 1 -- 172.21.15.142:0/696104180 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f5660058f90 con 0x7f5674074f10 2024-04-20T21:58:36.723 INFO:tasks.workunit.client.0.smithi142.stdout:5/529: mkdir dc/d14/d25/db4/dbb 0 2024-04-20T21:58:36.724 INFO:tasks.workunit.client.0.smithi142.stdout:0/584: dwrite d5/d1d/f77 [0,4194304] 0 2024-04-20T21:58:36.726 INFO:tasks.workunit.client.0.smithi142.stdout:3/643: rename d6/fd8 to d6/d32/d39/d69/d91/ff0 0 2024-04-20T21:58:36.730 INFO:tasks.workunit.client.0.smithi142.stdout:0/585: fsync d5/d13/d1e/d23/d24/f2a 0 2024-04-20T21:58:36.732 INFO:tasks.workunit.client.0.smithi142.stdout:3/644: mknod d6/d32/d39/d69/de0/cf1 0 2024-04-20T21:58:36.733 INFO:tasks.workunit.client.0.smithi142.stdout:0/586: fdatasync d5/d1c/d3c/f5a 0 2024-04-20T21:58:36.738 INFO:tasks.workunit.client.0.smithi142.stdout:3/645: fdatasync d6/d32/f42 0 2024-04-20T21:58:36.739 INFO:tasks.workunit.client.0.smithi142.stdout:0/587: rmdir d5/d13/d1e/d23/d24/d48 39 2024-04-20T21:58:36.741 INFO:tasks.workunit.client.0.smithi142.stdout:8/642: dwrite d0/d29/f3c [0,4194304] 0 2024-04-20T21:58:36.747 INFO:tasks.workunit.client.0.smithi142.stdout:8/643: chown d0/d1c/d44/dad/db3/cbf 509 1 2024-04-20T21:58:36.748 INFO:tasks.workunit.client.0.smithi142.stdout:5/530: dwrite dc/d14/f1f [0,4194304] 0 2024-04-20T21:58:36.748 INFO:tasks.workunit.client.0.smithi142.stdout:0/588: read d5/d1c/d3c/d85/d38/f90 [139115,90545] 0 2024-04-20T21:58:36.751 INFO:tasks.workunit.client.0.smithi142.stdout:5/531: dread - dc/d14/d72/f85 zero size 2024-04-20T21:58:36.757 INFO:tasks.workunit.client.0.smithi142.stdout:8/644: mknod d0/d17/d35/db5/ce1 0 2024-04-20T21:58:36.759 INFO:tasks.workunit.client.0.smithi142.stdout:3/646: getdents d6/d15/da4 0 2024-04-20T21:58:36.759 INFO:tasks.workunit.client.0.smithi142.stdout:8/645: chown d0/d5e/f71 269470305 1 2024-04-20T21:58:36.765 INFO:tasks.workunit.client.0.smithi142.stdout:5/532: creat dc/d71/d93/fbc x:0 0 0 2024-04-20T21:58:36.770 INFO:tasks.workunit.client.0.smithi142.stdout:8/646: mkdir d0/d17/d35/db5/de2 0 2024-04-20T21:58:36.771 INFO:tasks.workunit.client.0.smithi142.stdout:0/589: dwrite d5/f53 [0,4194304] 0 2024-04-20T21:58:36.773 INFO:tasks.workunit.client.0.smithi142.stdout:3/647: symlink d6/d15/lf2 0 2024-04-20T21:58:36.775 INFO:tasks.workunit.client.0.smithi142.stdout:3/648: write d6/d32/d39/d69/f78 [1260750,14397] 0 2024-04-20T21:58:36.778 INFO:tasks.workunit.client.0.smithi142.stdout:0/590: symlink d5/d1c/d3c/d95/lbf 0 2024-04-20T21:58:36.780 INFO:tasks.workunit.client.0.smithi142.stdout:3/649: truncate d6/d15/d1e/d43/d4d/d59/fd3 1614722 0 2024-04-20T21:58:36.781 INFO:tasks.workunit.client.0.smithi142.stdout:5/533: truncate dc/d14/d26/d3f/f9b 795785 0 2024-04-20T21:58:36.791 INFO:tasks.workunit.client.0.smithi142.stdout:5/534: rename dc/f43 to dc/d14/d26/d3f/d53/d7c/d97/da6/fbd 0 2024-04-20T21:58:36.793 INFO:tasks.workunit.client.0.smithi142.stdout:0/591: link d5/d1c/d3c/fa5 d5/d1d/fc0 0 2024-04-20T21:58:36.795 INFO:tasks.workunit.client.0.smithi142.stdout:8/647: getdents d0/d17/d35/d9d 0 2024-04-20T21:58:36.795 INFO:tasks.workunit.client.0.smithi142.stdout:6/561: sync 2024-04-20T21:58:36.795 INFO:tasks.workunit.client.0.smithi142.stdout:2/695: sync 2024-04-20T21:58:36.798 INFO:tasks.workunit.client.0.smithi142.stdout:5/535: truncate dc/d14/d21/d46/fb2 128269 0 2024-04-20T21:58:36.799 INFO:tasks.workunit.client.0.smithi142.stdout:3/650: dwrite d6/d15/d1e/dab/faf [4194304,4194304] 0 2024-04-20T21:58:36.800 INFO:tasks.workunit.client.0.smithi142.stdout:2/696: chown d3/d9/d89/d31/f6a 8871885 1 2024-04-20T21:58:36.801 INFO:tasks.workunit.client.0.smithi142.stdout:6/562: symlink d1/d11/d71/lc1 0 2024-04-20T21:58:36.802 INFO:tasks.workunit.client.0.smithi142.stdout:5/536: write dc/d14/d21/f6f [803103,108122] 0 2024-04-20T21:58:36.803 INFO:tasks.workunit.client.0.smithi142.stdout:3/651: fdatasync d6/d15/d1e/d43/d4d/d59/f7d 0 2024-04-20T21:58:36.803 INFO:tasks.workunit.client.0.smithi142.stdout:8/648: mknod d0/d1c/d44/dad/db3/d3f/ce3 0 2024-04-20T21:58:36.804 INFO:tasks.workunit.client.0.smithi142.stdout:5/537: stat dc/d71/d93 0 2024-04-20T21:58:36.811 INFO:tasks.workunit.client.0.smithi142.stdout:8/649: read d0/d1c/f9e [103108,31922] 0 2024-04-20T21:58:36.811 INFO:tasks.workunit.client.0.smithi142.stdout:2/697: mkdir d3/d5/d19/d70/de6 0 2024-04-20T21:58:36.811 INFO:tasks.workunit.client.0.smithi142.stdout:8/650: readlink d0/d17/d35/d9d/lcc 0 2024-04-20T21:58:36.813 INFO:tasks.workunit.client.0.smithi142.stdout:8/651: write d0/d42/f98 [1045596,106632] 0 2024-04-20T21:58:36.817 INFO:tasks.workunit.client.0.smithi142.stdout:0/592: creat d5/d13/d1e/d23/d24/d48/db6/fc1 x:0 0 0 2024-04-20T21:58:36.818 INFO:tasks.workunit.client.0.smithi142.stdout:8/652: dread - d0/d1c/d44/d89/d45/d4c/f77 zero size 2024-04-20T21:58:36.818 INFO:tasks.workunit.client.0.smithi142.stdout:3/652: symlink d6/d32/d39/d69/de0/lf3 0 2024-04-20T21:58:36.820 INFO:tasks.workunit.client.0.smithi142.stdout:8/653: readlink d0/d1c/l2b 0 2024-04-20T21:58:36.820 INFO:tasks.workunit.client.0.smithi142.stdout:0/593: chown d5/d1c/d3c/d85/d63/f82 21374234 1 2024-04-20T21:58:36.825 INFO:tasks.workunit.client.0.smithi142.stdout:6/563: creat d1/d5/d3a/dbc/fc2 x:0 0 0 2024-04-20T21:58:36.828 INFO:tasks.workunit.client.0.smithi142.stdout:3/653: fsync d6/d15/d30/f40 0 2024-04-20T21:58:36.828 INFO:tasks.workunit.client.0.smithi142.stdout:6/564: write d1/d2f/d35/f47 [1802430,60054] 0 2024-04-20T21:58:36.831 INFO:tasks.workunit.client.0.smithi142.stdout:2/698: creat d3/d9/d89/d31/da7/dd7/fe7 x:0 0 0 2024-04-20T21:58:36.833 INFO:tasks.workunit.client.0.smithi142.stdout:0/594: truncate d5/d1c/d3c/f5a 1639399 0 2024-04-20T21:58:36.835 INFO:tasks.workunit.client.0.smithi142.stdout:3/654: creat d6/d32/d39/d69/d91/ff4 x:0 0 0 2024-04-20T21:58:36.837 INFO:tasks.workunit.client.0.smithi142.stdout:3/655: dread - d6/d32/d39/f7b zero size 2024-04-20T21:58:36.842 INFO:tasks.workunit.client.0.smithi142.stdout:8/654: creat d0/d1c/d44/dad/db3/fe4 x:0 0 0 2024-04-20T21:58:36.844 INFO:tasks.workunit.client.0.smithi142.stdout:0/595: creat d5/d13/d1e/d23/d46/fc2 x:0 0 0 2024-04-20T21:58:36.845 INFO:tasks.workunit.client.0.smithi142.stdout:6/565: creat d1/d2f/d35/d5b/d63/d4b/d61/db7/fc3 x:0 0 0 2024-04-20T21:58:36.849 INFO:tasks.workunit.client.0.smithi142.stdout:3/656: creat d6/d32/d39/d69/ff5 x:0 0 0 2024-04-20T21:58:36.853 INFO:tasks.workunit.client.0.smithi142.stdout:0/596: rename d5/d13/d1e/d23/l87 to d5/d45/d6f/d70/da9/lc3 0 2024-04-20T21:58:36.857 INFO:tasks.workunit.client.0.smithi142.stdout:2/699: creat d3/d9/fe8 x:0 0 0 2024-04-20T21:58:36.858 INFO:tasks.workunit.client.0.smithi142.stdout:3/657: truncate d6/d15/d47/d83/dc9/da7/fd1 952672 0 2024-04-20T21:58:36.861 INFO:tasks.workunit.client.0.smithi142.stdout:6/566: rename d1/d11/d71/lc1 to d1/d11/lc4 0 2024-04-20T21:58:36.866 INFO:tasks.workunit.client.0.smithi142.stdout:6/567: mkdir d1/d2f/d35/d5b/d3e/dc5 0 2024-04-20T21:58:36.868 INFO:tasks.workunit.client.0.smithi142.stdout:8/655: getdents d0/d42/d90 0 2024-04-20T21:58:36.870 INFO:tasks.workunit.client.0.smithi142.stdout:3/658: read d6/d15/f5b [1334264,128423] 0 2024-04-20T21:58:36.874 INFO:tasks.workunit.client.0.smithi142.stdout:8/656: read d0/d42/fa2 [397378,37421] 0 2024-04-20T21:58:36.878 INFO:tasks.workunit.client.0.smithi142.stdout:5/538: link dc/d71/f5e dc/d14/d26/d3f/db3/fbe 0 2024-04-20T21:58:36.883 INFO:tasks.workunit.client.0.smithi142.stdout:6/568: creat d1/fc6 x:0 0 0 2024-04-20T21:58:36.883 INFO:tasks.workunit.client.0.smithi142.stdout:8/657: mkdir d0/d5e/de5 0 2024-04-20T21:58:36.885 INFO:tasks.workunit.client.0.smithi142.stdout:8/658: fsync d0/d1c/fa0 0 2024-04-20T21:58:36.888 INFO:tasks.workunit.client.0.smithi142.stdout:5/539: creat dc/d14/d72/fbf x:0 0 0 2024-04-20T21:58:36.888 INFO:tasks.workunit.client.0.smithi142.stdout:3/659: dread d6/d15/d1e/dab/fdc [0,4194304] 0 2024-04-20T21:58:36.891 INFO:tasks.workunit.client.0.smithi142.stdout:8/659: fsync d0/d1c/f41 0 2024-04-20T21:58:36.891 INFO:tasks.workunit.client.0.smithi142.stdout:2/700: dread d3/d9/f49 [0,4194304] 0 2024-04-20T21:58:36.897 INFO:tasks.workunit.client.0.smithi142.stdout:0/597: dwrite d5/d13/d1e/d23/d24/f2a [0,4194304] 0 2024-04-20T21:58:36.905 INFO:tasks.workunit.client.0.smithi142.stdout:6/569: dwrite d1/d2f/d35/f47 [0,4194304] 0 2024-04-20T21:58:36.907 INFO:tasks.workunit.client.0.smithi142.stdout:4/580: sync 2024-04-20T21:58:36.911 INFO:tasks.workunit.client.0.smithi142.stdout:6/570: fsync d1/d5/d8b/fb5 0 2024-04-20T21:58:36.914 INFO:tasks.workunit.client.0.smithi142.stdout:5/540: write f4 [471453,64936] 0 2024-04-20T21:58:36.914 INFO:tasks.workunit.client.0.smithi142.stdout:3/660: write d6/f8 [3795840,84406] 0 2024-04-20T21:58:36.915 INFO:tasks.workunit.client.0.smithi142.stdout:4/581: rmdir d1/d12/da/d1c/d32/d3d 39 2024-04-20T21:58:36.918 INFO:tasks.workunit.client.0.smithi142.stdout:5/541: dread - dc/d14/d25/faf zero size 2024-04-20T21:58:36.920 INFO:tasks.workunit.client.0.smithi142.stdout:2/701: dwrite d3/d9/f49 [0,4194304] 0 2024-04-20T21:58:36.926 INFO:tasks.workunit.client.0.smithi142.stdout:5/542: read dc/d71/d5c/d68/f8c [3916258,95687] 0 2024-04-20T21:58:36.927 INFO:tasks.workunit.client.0.smithi142.stdout:2/702: readlink d3/d5/d19/d70/d3c/d64/lc8 0 2024-04-20T21:58:36.928 INFO:tasks.workunit.client.0.smithi142.stdout:2/703: stat d3/f42 0 2024-04-20T21:58:36.928 INFO:tasks.workunit.client.0.smithi142.stdout:3/661: unlink d6/d32/d39/d69/d91/c92 0 2024-04-20T21:58:36.928 INFO:tasks.workunit.client.0.smithi142.stdout:4/582: stat d1/d6/f1f 0 2024-04-20T21:58:36.930 INFO:tasks.workunit.client.0.smithi142.stdout:5/543: stat dc/f1d 0 2024-04-20T21:58:36.933 INFO:tasks.workunit.client.0.smithi142.stdout:0/598: dread d5/d1c/d3c/f73 [0,4194304] 0 2024-04-20T21:58:36.940 INFO:tasks.workunit.client.0.smithi142.stdout:0/599: creat d5/d13/d1e/d8f/fc4 x:0 0 0 2024-04-20T21:58:36.941 INFO:tasks.workunit.client.0.smithi142.stdout:4/583: getdents d1/d6/d30 0 2024-04-20T21:58:36.946 INFO:tasks.workunit.client.0.smithi142.stdout:0/600: write d5/d1c/d3c/d8b/fba [457844,67354] 0 2024-04-20T21:58:36.949 INFO:tasks.workunit.client.0.smithi142.stdout:5/544: link cb dc/d14/d21/d46/d7d/cc0 0 2024-04-20T21:58:36.951 INFO:tasks.workunit.client.0.smithi142.stdout:2/704: dwrite d3/f7e [4194304,4194304] 0 2024-04-20T21:58:36.952 INFO:tasks.workunit.client.0.smithi142.stdout:6/571: truncate d1/d5/f12 3410499 0 2024-04-20T21:58:36.955 INFO:tasks.workunit.client.0.smithi142.stdout:0/601: unlink d5/d1c/d3c/d95/c9f 0 2024-04-20T21:58:36.965 INFO:tasks.workunit.client.0.smithi142.stdout:5/545: chown cb 54437 1 2024-04-20T21:58:36.966 INFO:tasks.workunit.client.0.smithi142.stdout:6/572: creat d1/d2f/d6c/d7e/d9f/dc0/fc7 x:0 0 0 2024-04-20T21:58:36.973 INFO:tasks.workunit.client.0.smithi142.stdout:6/573: mkdir d1/d2f/d35/d5b/d63/d34/dc8 0 2024-04-20T21:58:36.976 INFO:tasks.workunit.client.0.smithi142.stdout:6/574: readlink d1/d5/d3a/d43/d5c/l6d 0 2024-04-20T21:58:36.978 INFO:tasks.workunit.client.0.smithi142.stdout:0/602: truncate d5/d13/d1e/d23/d24/f2a 1008785 0 2024-04-20T21:58:36.982 INFO:tasks.workunit.client.0.smithi142.stdout:6/575: creat d1/d2f/d6c/d7e/d9f/fc9 x:0 0 0 2024-04-20T21:58:36.983 INFO:tasks.workunit.client.0.smithi142.stdout:3/662: dread d6/d15/d30/d37/fc6 [4194304,4194304] 0 2024-04-20T21:58:36.986 INFO:tasks.workunit.client.0.smithi142.stdout:0/603: unlink d5/d1c/d3c/d85/f91 0 2024-04-20T21:58:36.987 INFO:tasks.workunit.client.0.smithi142.stdout:6/576: symlink d1/d5/d3a/dbc/lca 0 2024-04-20T21:58:36.992 INFO:tasks.workunit.client.0.smithi142.stdout:0/604: stat d5/d1c/d3c/d8b/f97 0 2024-04-20T21:58:36.994 INFO:tasks.workunit.client.0.smithi142.stdout:2/705: dread d3/d5/d19/d70/f95 [0,4194304] 0 2024-04-20T21:58:37.001 INFO:tasks.workunit.client.0.smithi142.stdout:2/706: creat d3/d9/d69/fe9 x:0 0 0 2024-04-20T21:58:37.002 INFO:tasks.workunit.client.0.smithi142.stdout:0/605: truncate d5/d1c/d3c/f5a 330791 0 2024-04-20T21:58:37.006 INFO:tasks.workunit.client.0.smithi142.stdout:5/546: dread dc/f1d [4194304,4194304] 0 2024-04-20T21:58:37.006 INFO:tasks.workunit.client.0.smithi142.stdout:3/663: dwrite d6/d15/d30/f46 [0,4194304] 0 2024-04-20T21:58:37.009 INFO:tasks.workunit.client.0.smithi142.stdout:2/707: truncate d3/d5/d74/fbd 466621 0 2024-04-20T21:58:37.014 INFO:tasks.workunit.client.0.smithi142.stdout:0/606: fdatasync d5/d13/d1e/d23/d2c/f84 0 2024-04-20T21:58:37.015 INFO:tasks.workunit.client.0.smithi142.stdout:6/577: write d1/d2f/d35/d5b/d63/d4b/f7b [1798899,119584] 0 2024-04-20T21:58:37.015 INFO:tasks.workunit.client.0.smithi142.stdout:5/547: mkdir dc/d14/d21/d46/dc1 0 2024-04-20T21:58:37.016 INFO:tasks.workunit.client.0.smithi142.stdout:3/664: truncate d6/d15/d1e/d43/d4d/fcc 337451 0 2024-04-20T21:58:37.019 INFO:tasks.workunit.client.0.smithi142.stdout:6/578: mknod d1/d2f/ccb 0 2024-04-20T21:58:37.023 INFO:tasks.workunit.client.0.smithi142.stdout:2/708: dread d3/d5/d19/d70/fc6 [0,4194304] 0 2024-04-20T21:58:37.026 INFO:tasks.workunit.client.0.smithi142.stdout:3/665: rename d6/d15/d1e/dab to d6/d15/d1e/d43/d4d/d59/df6 0 2024-04-20T21:58:37.027 INFO:tasks.workunit.client.0.smithi142.stdout:2/709: fdatasync d3/d5/d67/dc4/f90 0 2024-04-20T21:58:37.028 INFO:tasks.workunit.client.0.smithi142.stdout:5/548: creat dc/d14/d25/db4/fc2 x:0 0 0 2024-04-20T21:58:37.040 INFO:tasks.workunit.client.0.smithi142.stdout:3/666: fsync d6/fc 0 2024-04-20T21:58:37.046 INFO:tasks.workunit.client.0.smithi142.stdout:0/607: dread d5/d13/f2f [0,4194304] 0 2024-04-20T21:58:37.054 INFO:tasks.workunit.client.0.smithi142.stdout:3/667: dwrite d6/d15/d1e/d43/d4d/d59/db6/fc1 [0,4194304] 0 2024-04-20T21:58:37.080 INFO:tasks.workunit.client.0.smithi142.stdout:7/657: sync 2024-04-20T21:58:37.080 INFO:tasks.workunit.client.0.smithi142.stdout:9/638: sync 2024-04-20T21:58:37.080 INFO:tasks.workunit.client.0.smithi142.stdout:1/583: sync 2024-04-20T21:58:37.082 INFO:tasks.workunit.client.0.smithi142.stdout:5/549: rename dc/d14/d21/d46/d2a/d65/d79/d98 to dc/d14/d25/db4/dbb/dc3 0 2024-04-20T21:58:37.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.088+0000 7f567b400700 1 -- 172.21.15.142:0/696104180 --> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5674103bc0 con 0x7f565c06eac0 2024-04-20T21:58:37.095 INFO:tasks.workunit.client.0.smithi142.stdout:1/584: creat d2/d4e/fc8 x:0 0 0 2024-04-20T21:58:37.096 INFO:tasks.workunit.client.0.smithi142.stdout:1/585: write d2/f3e [2256465,6051] 0 2024-04-20T21:58:37.102 INFO:tasks.workunit.client.0.smithi142.stdout:0/608: dread d5/d1c/d3c/d85/d63/f64 [0,4194304] 0 2024-04-20T21:58:37.102 INFO:tasks.workunit.client.0.smithi142.stdout:7/658: mknod d4/d9/d1c/d8e/d88/ced 0 2024-04-20T21:58:37.103 INFO:tasks.workunit.client.0.smithi142.stdout:3/668: rename d6/d15/d47/f61 to d6/d15/d30/d37/ff7 0 2024-04-20T21:58:37.109 INFO:tasks.workunit.client.0.smithi142.stdout:9/639: dwrite d0/ff [0,4194304] 0 2024-04-20T21:58:37.111 INFO:tasks.workunit.client.0.smithi142.stdout:2/710: write d3/d5/d19/f79 [1080041,117751] 0 2024-04-20T21:58:37.115 INFO:tasks.workunit.client.0.smithi142.stdout:1/586: dwrite d2/f7 [0,4194304] 0 2024-04-20T21:58:37.118 INFO:tasks.workunit.client.0.smithi142.stdout:7/659: creat d4/d9/d1c/d8e/d88/fee x:0 0 0 2024-04-20T21:58:37.118 INFO:tasks.workunit.client.0.smithi142.stdout:1/587: chown d2/d4e/c70 126 1 2024-04-20T21:58:37.123 INFO:tasks.workunit.client.0.smithi142.stdout:1/588: read d2/dd/d17/d3b/d50/f5e [214818,76676] 0 2024-04-20T21:58:37.126 INFO:tasks.workunit.client.0.smithi142.stdout:1/589: read - d2/dd/d1c/d60/fc2 zero size 2024-04-20T21:58:37.129 INFO:tasks.workunit.client.0.smithi142.stdout:1/590: dread - d2/d4e/d7e/faa zero size 2024-04-20T21:58:37.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.132+0000 7f5671600700 1 -- 172.21.15.142:0/696104180 <== mgr.24359 v2:172.21.15.164:6828/929524464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f5674103bc0 con 0x7f565c06eac0 2024-04-20T21:58:37.133 INFO:tasks.workunit.client.0.smithi142.stdout:0/609: dwrite d5/d1c/d3c/d85/d38/d62/f96 [0,4194304] 0 2024-04-20T21:58:37.133 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T21:58:37.133 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (9m) 7s ago 11m 13.6M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T21:58:37.134 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (11m) 7s ago 11m 7868k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T21:58:37.134 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (10m) 62s ago 10m 7440k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T21:58:37.134 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (11m) 7s ago 11m 6665k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 56f2e41784f8 2024-04-20T21:58:37.134 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (10m) 62s ago 10m 6660k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 bce67525dd3e 2024-04-20T21:58:37.134 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (9m) 7s ago 10m 75.5M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T21:58:37.134 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (4m) 7s ago 4m 144M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 b68e279d7945 2024-04-20T21:58:37.134 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (3m) 7s ago 3m 13.7M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T21:58:37.134 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (3m) 62s ago 3m 13.5M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T21:58:37.134 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (3m) 62s ago 3m 13.6M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T21:58:37.134 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (27s) 7s ago 12m 69.1M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T21:58:37.134 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (96s) 62s ago 9m 492M - 19.0.0-3133-ga8c84f59 76bc6b91b726 b8f1c0f4899b 2024-04-20T21:58:37.134 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (13m) 7s ago 13m 50.8M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c076f7eb00ea 2024-04-20T21:58:37.134 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (9m) 62s ago 9m 39.5M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 2bacdeb02ee0 2024-04-20T21:58:37.134 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (11m) 7s ago 11m 7696k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T21:58:37.135 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (9m) 62s ago 9m 8006k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T21:58:37.135 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (8m) 7s ago 8m 108M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4361ae428e0d 2024-04-20T21:58:37.135 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (8m) 7s ago 8m 121M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 dd7e7cf8e8e1 2024-04-20T21:58:37.135 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (7m) 7s ago 7m 106M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 8e9165365127 2024-04-20T21:58:37.135 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (6m) 62s ago 6m 98.6M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c081911f56ab 2024-04-20T21:58:37.135 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (6m) 62s ago 6m 86.6M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 39e09d63d44f 2024-04-20T21:58:37.135 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (5m) 62s ago 5m 83.9M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4f36124aeb0d 2024-04-20T21:58:37.135 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (38s) 7s ago 10m 41.4M - 2.43.0 a07b618ecd1d c810d879d9e4 2024-04-20T21:58:37.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.137+0000 7f567b400700 1 -- 172.21.15.142:0/696104180 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f565c06eac0 msgr2=0x7f565c070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:37.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.137+0000 7f567b400700 1 --2- 172.21.15.142:0/696104180 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f565c06eac0 0x7f565c070f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f567419e100 tx=0x7f5668009260 comp rx=0 tx=0).stop 2024-04-20T21:58:37.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.137+0000 7f567b400700 1 -- 172.21.15.142:0/696104180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5674074f10 msgr2=0x7f567419d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:37.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.137+0000 7f567b400700 1 --2- 172.21.15.142:0/696104180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5674074f10 0x7f567419d1b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f566000b620 tx=0x7f5660005f00 comp rx=0 tx=0).stop 2024-04-20T21:58:37.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.137+0000 7f567b400700 1 -- 172.21.15.142:0/696104180 shutdown_connections 2024-04-20T21:58:37.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.137+0000 7f567b400700 1 --2- 172.21.15.142:0/696104180 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f565c06eac0 0x7f565c070f80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:37.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.137+0000 7f567b400700 1 --2- 172.21.15.142:0/696104180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5674073940 0x7f567419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:37.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.137+0000 7f567b400700 1 --2- 172.21.15.142:0/696104180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5674074f10 0x7f567419d1b0 secure :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f566000b620 tx=0x7f5660005f00 comp rx=0 tx=0).stop 2024-04-20T21:58:37.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.137+0000 7f567b400700 1 -- 172.21.15.142:0/696104180 >> 172.21.15.142:0/696104180 conn(0x7f56740fc1c0 msgr2=0x7f56741024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:37.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.137+0000 7f567b400700 1 -- 172.21.15.142:0/696104180 shutdown_connections 2024-04-20T21:58:37.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.137+0000 7f567b400700 1 -- 172.21.15.142:0/696104180 wait complete. 2024-04-20T21:58:37.145 INFO:tasks.workunit.client.0.smithi142.stdout:7/660: rename d4/d7f/d77/d78/da8/c85 to d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/cef 0 2024-04-20T21:58:37.152 INFO:tasks.workunit.client.0.smithi142.stdout:7/661: creat d4/d7f/d77/d78/da8/d64/ff0 x:0 0 0 2024-04-20T21:58:37.160 INFO:tasks.workunit.client.0.smithi142.stdout:1/591: rmdir d2/dd/d1c/d88/d89/db1 39 2024-04-20T21:58:37.161 INFO:tasks.workunit.client.0.smithi142.stdout:5/550: dwrite dc/d71/d5c/d68/f8c [0,4194304] 0 2024-04-20T21:58:37.172 INFO:tasks.workunit.client.0.smithi142.stdout:7/662: rename d4/d9 to d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1 0 2024-04-20T21:58:37.173 INFO:tasks.workunit.client.0.smithi142.stdout:9/640: dread d0/d3c/d4d/d63/f65 [0,4194304] 0 2024-04-20T21:58:37.174 INFO:tasks.workunit.client.0.smithi142.stdout:0/610: rmdir d5/d1c/d3c/d85/da0 0 2024-04-20T21:58:37.175 INFO:tasks.workunit.client.0.smithi142.stdout:2/711: dread d3/d9/d89/d31/da2/ddb/de0/fa6 [0,4194304] 0 2024-04-20T21:58:37.175 INFO:tasks.workunit.client.0.smithi142.stdout:3/669: dwrite d6/d15/d1e/d43/d4d/f97 [0,4194304] 0 2024-04-20T21:58:37.178 INFO:tasks.workunit.client.0.smithi142.stdout:3/670: chown d6/d15/d47/d83 36909033 1 2024-04-20T21:58:37.206 INFO:tasks.workunit.client.0.smithi142.stdout:2/712: read d3/d5/d67/dc4/f90 [2023006,3562] 0 2024-04-20T21:58:37.209 INFO:tasks.workunit.client.0.smithi142.stdout:5/551: dread dc/d71/f5e [0,4194304] 0 2024-04-20T21:58:37.210 INFO:tasks.workunit.client.0.smithi142.stdout:7/663: dwrite d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/f23 [0,4194304] 0 2024-04-20T21:58:37.212 INFO:tasks.workunit.client.0.smithi142.stdout:0/611: creat d5/d13/d1e/fc5 x:0 0 0 2024-04-20T21:58:37.218 INFO:tasks.workunit.client.0.smithi142.stdout:7/664: read d4/d7f/d77/d78/d9b/d5a/f76 [2513658,59570] 0 2024-04-20T21:58:37.220 INFO:tasks.workunit.client.0.smithi142.stdout:2/713: mkdir d3/d9/d89/d31/dc3/dce/dea 0 2024-04-20T21:58:37.221 INFO:tasks.workunit.client.0.smithi142.stdout:1/592: truncate d2/dd/d17/d1b/d22/f56 3742000 0 2024-04-20T21:58:37.223 INFO:tasks.workunit.client.0.smithi142.stdout:1/593: fsync d2/f7 0 2024-04-20T21:58:37.225 INFO:tasks.workunit.client.0.smithi142.stdout:5/552: rename dc/d14/d26/d3f/db3/fbe to dc/d14/d26/d3f/d53/d7c/d97/fc4 0 2024-04-20T21:58:37.226 INFO:tasks.workunit.client.0.smithi142.stdout:0/612: rmdir d5/d1c/d3c/d85/d38/d62 39 2024-04-20T21:58:37.229 INFO:tasks.workunit.client.0.smithi142.stdout:3/671: getdents d6/d15/d30/db4 0 2024-04-20T21:58:37.236 INFO:tasks.workunit.client.0.smithi142.stdout:1/594: write d2/d4e/d7e/fbd [725818,49916] 0 2024-04-20T21:58:37.237 INFO:tasks.workunit.client.0.smithi142.stdout:5/553: write dc/d14/d25/f2d [2387434,89902] 0 2024-04-20T21:58:37.238 INFO:tasks.workunit.client.0.smithi142.stdout:1/595: write d2/fb0 [434792,61561] 0 2024-04-20T21:58:37.239 INFO:tasks.workunit.client.0.smithi142.stdout:0/613: fsync d5/d45/d6f/f81 0 2024-04-20T21:58:37.259 INFO:tasks.workunit.client.0.smithi142.stdout:2/714: dread d3/d5/d19/d70/d3c/d64/f81 [0,4194304] 0 2024-04-20T21:58:37.281 INFO:tasks.workunit.client.0.smithi142.stdout:5/554: dread dc/d14/d21/d46/d2a/d3c/f61 [0,4194304] 0 2024-04-20T21:58:37.285 INFO:tasks.workunit.client.0.smithi142.stdout:5/555: fdatasync dc/d14/d21/d46/d7d/f84 0 2024-04-20T21:58:37.285 INFO:tasks.workunit.client.0.smithi142.stdout:2/715: dwrite d3/d9/d69/faf [0,4194304] 0 2024-04-20T21:58:37.288 INFO:tasks.workunit.client.0.smithi142.stdout:0/614: chown d5/d6d/l80 47388571 1 2024-04-20T21:58:37.291 INFO:tasks.workunit.client.0.smithi142.stdout:3/672: dread d6/d15/d1e/f87 [0,4194304] 0 2024-04-20T21:58:37.293 INFO:tasks.workunit.client.0.smithi142.stdout:5/556: symlink dc/d14/d26/d3f/d53/d7c/da9/lc5 0 2024-04-20T21:58:37.301 INFO:tasks.workunit.client.0.smithi142.stdout:5/557: creat dc/d14/d26/d3f/d53/fc6 x:0 0 0 2024-04-20T21:58:37.302 INFO:tasks.workunit.client.0.smithi142.stdout:2/716: rename d3/d9/d89/d31/d84/f88 to d3/d9/d89/feb 0 2024-04-20T21:58:37.304 INFO:tasks.workunit.client.0.smithi142.stdout:5/558: rmdir dc/d6b 39 2024-04-20T21:58:37.306 INFO:tasks.workunit.client.0.smithi142.stdout:2/717: chown d3/d9/f49 231 1 2024-04-20T21:58:37.308 INFO:tasks.workunit.client.0.smithi142.stdout:5/559: fdatasync f9 0 2024-04-20T21:58:37.309 INFO:tasks.workunit.client.0.smithi142.stdout:2/718: fsync d3/d5/d74/fbd 0 2024-04-20T21:58:37.314 INFO:tasks.workunit.client.0.smithi142.stdout:1/596: rmdir d2/dd/d17/d1b 39 2024-04-20T21:58:37.316 INFO:tasks.workunit.client.0.smithi142.stdout:0/615: dwrite d5/f6c [0,4194304] 0 2024-04-20T21:58:37.318 INFO:tasks.workunit.client.0.smithi142.stdout:3/673: dwrite d6/f4b [0,4194304] 0 2024-04-20T21:58:37.327 INFO:tasks.workunit.client.0.smithi142.stdout:1/597: readlink d2/dd/d17/d1b/d22/d55/l77 0 2024-04-20T21:58:37.329 INFO:tasks.workunit.client.0.smithi142.stdout:2/719: chown d3/d9/f83 1057442 1 2024-04-20T21:58:37.330 INFO:tasks.workunit.client.0.smithi142.stdout:0/616: write d5/d1c/d3c/d85/d38/d62/f75 [2118171,44674] 0 2024-04-20T21:58:37.335 INFO:tasks.workunit.client.0.smithi142.stdout:1/598: stat d2/dd/d17/d1b/d22/d13/l19 0 2024-04-20T21:58:37.337 INFO:tasks.workunit.client.0.smithi142.stdout:3/674: link d6/d15/f5e d6/d15/d30/dae/ff8 0 2024-04-20T21:58:37.341 INFO:tasks.workunit.client.0.smithi142.stdout:5/560: dwrite dc/d14/f8d [0,4194304] 0 2024-04-20T21:58:37.345 INFO:tasks.workunit.client.0.smithi142.stdout:2/720: rename d3/d9/f83 to d3/d9/d89/d31/dc3/dce/dea/fec 0 2024-04-20T21:58:37.345 INFO:tasks.workunit.client.0.smithi142.stdout:0/617: creat d5/d1d/d7e/fc6 x:0 0 0 2024-04-20T21:58:37.360 INFO:tasks.workunit.client.0.smithi142.stdout:3/675: rename d6/d32/d39/d69/d91/cb7 to d6/d15/d1e/d43/d4d/cf9 0 2024-04-20T21:58:37.365 INFO:tasks.workunit.client.0.smithi142.stdout:0/618: unlink d5/d13/l3d 0 2024-04-20T21:58:37.366 INFO:tasks.workunit.client.0.smithi142.stdout:0/619: chown d5/d1c/d3c/f73 1106038911 1 2024-04-20T21:58:37.367 INFO:tasks.workunit.client.0.smithi142.stdout:0/620: fsync d5/d1c/d3c/d85/f76 0 2024-04-20T21:58:37.368 INFO:tasks.workunit.client.0.smithi142.stdout:1/599: creat d2/d4e/d7e/dbf/fc9 x:0 0 0 2024-04-20T21:58:37.369 INFO:tasks.workunit.client.0.smithi142.stdout:1/600: readlink d2/l7a 0 2024-04-20T21:58:37.371 INFO:tasks.workunit.client.0.smithi142.stdout:5/561: mkdir dc/d14/d26/d3f/d53/d7c/d97/da6/dc7 0 2024-04-20T21:58:37.372 INFO:tasks.workunit.client.0.smithi142.stdout:2/721: rename d3/d9/d89/d31/f54 to d3/d9/d89/d31/da7/fed 0 2024-04-20T21:58:37.374 INFO:tasks.workunit.client.0.smithi142.stdout:3/676: fsync d6/d15/d1e/d43/d4d/d59/df6/fdc 0 2024-04-20T21:58:37.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.376+0000 7f9d2f600700 1 -- 172.21.15.142:0/2990662796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d28107260 msgr2=0x7f9d28107680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:37.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.376+0000 7f9d2f600700 1 --2- 172.21.15.142:0/2990662796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d28107260 0x7f9d28107680 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009910 tx=0x7f9d1c009c20 comp rx=0 tx=0).stop 2024-04-20T21:58:37.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.377+0000 7f9d2f600700 1 -- 172.21.15.142:0/2990662796 shutdown_connections 2024-04-20T21:58:37.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.377+0000 7f9d2f600700 1 --2- 172.21.15.142:0/2990662796 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d28108430 0x7f9d281088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:37.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.377+0000 7f9d2f600700 1 --2- 172.21.15.142:0/2990662796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d28107260 0x7f9d28107680 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:37.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.377+0000 7f9d2f600700 1 -- 172.21.15.142:0/2990662796 >> 172.21.15.142:0/2990662796 conn(0x7f9d28076400 msgr2=0x7f9d28078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:37.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.377+0000 7f9d2f600700 1 -- 172.21.15.142:0/2990662796 shutdown_connections 2024-04-20T21:58:37.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.377+0000 7f9d2f600700 1 -- 172.21.15.142:0/2990662796 wait complete. 2024-04-20T21:58:37.378 INFO:tasks.workunit.client.0.smithi142.stdout:3/677: chown d6/d32/d39/d69/de0 0 1 2024-04-20T21:58:37.378 INFO:tasks.workunit.client.0.smithi142.stdout:2/722: dread d3/d5/d67/dc4/fb0 [0,4194304] 0 2024-04-20T21:58:37.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.378+0000 7f9d2f600700 1 Processor -- start 2024-04-20T21:58:37.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.379+0000 7f9d2f600700 1 -- start start 2024-04-20T21:58:37.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.379+0000 7f9d2f600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d28107260 0x7f9d2819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:37.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.379+0000 7f9d2f600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d28108430 0x7f9d2819d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:37.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.379+0000 7f9d2f600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2819d730 con 0x7f9d28107260 2024-04-20T21:58:37.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.379+0000 7f9d2f600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2819d870 con 0x7f9d28108430 2024-04-20T21:58:37.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.380+0000 7f9d2cc00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d28107260 0x7f9d2819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:37.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.380+0000 7f9d27e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d28108430 0x7f9d2819d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:37.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.380+0000 7f9d27e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d28108430 0x7f9d2819d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:39470/0 (socket says 172.21.15.142:39470) 2024-04-20T21:58:37.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.380+0000 7f9d27e00700 1 -- 172.21.15.142:0/604437121 learned_addr learned my addr 172.21.15.142:0/604437121 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:58:37.380 INFO:tasks.workunit.client.0.smithi142.stdout:1/601: symlink d2/dd/d1c/d88/lca 0 2024-04-20T21:58:37.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.381+0000 7f9d27e00700 1 -- 172.21.15.142:0/604437121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d28107260 msgr2=0x7f9d2819cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:37.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.381+0000 7f9d27e00700 1 --2- 172.21.15.142:0/604437121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d28107260 0x7f9d2819cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:37.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.381+0000 7f9d27e00700 1 -- 172.21.15.142:0/604437121 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c0095f0 con 0x7f9d28108430 2024-04-20T21:58:37.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.382+0000 7f9d2cc00700 1 --2- 172.21.15.142:0/604437121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d28107260 0x7f9d2819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T21:58:37.382 INFO:tasks.workunit.client.0.smithi142.stdout:3/678: chown d6/f25 3837624 1 2024-04-20T21:58:37.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.383+0000 7f9d27e00700 1 --2- 172.21.15.142:0/604437121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d28108430 0x7f9d2819d110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400c8a0 tx=0x7f9d1400cbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:37.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.384+0000 7f9d25600700 1 -- 172.21.15.142:0/604437121 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d140078e0 con 0x7f9d28108430 2024-04-20T21:58:37.383 INFO:tasks.workunit.client.0.smithi142.stdout:0/621: mknod d5/d13/cc7 0 2024-04-20T21:58:37.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.384+0000 7f9d25600700 1 -- 172.21.15.142:0/604437121 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9d1400f450 con 0x7f9d28108430 2024-04-20T21:58:37.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.384+0000 7f9d25600700 1 -- 172.21.15.142:0/604437121 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d1400e5e0 con 0x7f9d28108430 2024-04-20T21:58:37.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.385+0000 7f9d2f600700 1 -- 172.21.15.142:0/604437121 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d281a22d0 con 0x7f9d28108430 2024-04-20T21:58:37.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.385+0000 7f9d2f600700 1 -- 172.21.15.142:0/604437121 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d281a2870 con 0x7f9d28108430 2024-04-20T21:58:37.385 INFO:tasks.workunit.client.0.smithi142.stdout:0/622: chown d5/d13/d1e/d8f/lb3 79 1 2024-04-20T21:58:37.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.386+0000 7f9d2f600700 1 -- 172.21.15.142:0/604437121 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d28196dd0 con 0x7f9d28108430 2024-04-20T21:58:37.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.390+0000 7f9d25600700 1 -- 172.21.15.142:0/604437121 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 25) v1 ==== 92710+0+0 (secure 0 0 0) 0x7f9d1400f5c0 con 0x7f9d28108430 2024-04-20T21:58:37.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.391+0000 7f9d25600700 1 --2- 172.21.15.142:0/604437121 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f9d1006eac0 0x7f9d10070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:37.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.391+0000 7f9d25600700 1 -- 172.21.15.142:0/604437121 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f9d1408e680 con 0x7f9d28108430 2024-04-20T21:58:37.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.392+0000 7f9d2cc00700 1 --2- 172.21.15.142:0/604437121 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f9d1006eac0 0x7f9d10070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:37.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.393+0000 7f9d2cc00700 1 --2- 172.21.15.142:0/604437121 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f9d1006eac0 0x7f9d10070f80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c005090 tx=0x7f9d1c005fb0 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:37.394 INFO:tasks.workunit.client.0.smithi142.stdout:1/602: getdents d2/d4e/d7e 0 2024-04-20T21:58:37.396 INFO:tasks.workunit.client.0.smithi142.stdout:1/603: dread - d2/d4e/f64 zero size 2024-04-20T21:58:37.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.402+0000 7f9d25600700 1 -- 172.21.15.142:0/604437121 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f9d1405b4f0 con 0x7f9d28108430 2024-04-20T21:58:37.402 INFO:tasks.workunit.client.0.smithi142.stdout:0/623: dwrite d5/d13/d1e/d23/d24/f33 [0,4194304] 0 2024-04-20T21:58:37.402 INFO:tasks.workunit.client.0.smithi142.stdout:1/604: read d2/dd/d17/d1b/d22/f91 [2634618,22818] 0 2024-04-20T21:58:37.409 INFO:tasks.workunit.client.0.smithi142.stdout:1/605: creat d2/dd/d17/d1b/d22/d55/fcb x:0 0 0 2024-04-20T21:58:37.411 INFO:tasks.workunit.client.0.smithi142.stdout:0/624: rename d5/d13/d1e/d23 to d5/d13/d1e/d23/d24/dc8 22 2024-04-20T21:58:37.412 INFO:tasks.workunit.client.0.smithi142.stdout:1/606: fsync d2/dd/d17/d1b/d22/d55/fb5 0 2024-04-20T21:58:37.414 INFO:tasks.workunit.client.0.smithi142.stdout:2/723: mknod d3/d9/d89/d31/dc3/cee 0 2024-04-20T21:58:37.415 INFO:tasks.workunit.client.0.smithi142.stdout:5/562: write dc/f10 [789248,104238] 0 2024-04-20T21:58:37.423 INFO:tasks.workunit.client.0.smithi142.stdout:2/724: mknod d3/d5/d19/d70/de6/cef 0 2024-04-20T21:58:37.429 INFO:tasks.workunit.client.0.smithi142.stdout:5/563: rename dc/d71/f5e to dc/d14/d25/db4/fc8 0 2024-04-20T21:58:37.429 INFO:tasks.workunit.client.0.smithi142.stdout:2/725: readlink d3/d9/d69/l8e 0 2024-04-20T21:58:37.431 INFO:tasks.workunit.client.0.smithi142.stdout:2/726: fsync d3/fad 0 2024-04-20T21:58:37.436 INFO:tasks.workunit.client.0.smithi142.stdout:5/564: unlink dc/d14/d21/d46/d2a/d65/d79/da2/l64 0 2024-04-20T21:58:37.437 INFO:tasks.workunit.client.0.smithi142.stdout:2/727: fdatasync d3/d9/d89/d31/da2/ddb/de0/fc0 0 2024-04-20T21:58:37.440 INFO:tasks.workunit.client.0.smithi142.stdout:2/728: chown d3/d9/d69/fe9 183015 1 2024-04-20T21:58:37.441 INFO:tasks.workunit.client.0.smithi142.stdout:5/565: stat dc/d71/d5c/l5d 0 2024-04-20T21:58:37.443 INFO:tasks.workunit.client.0.smithi142.stdout:2/729: symlink d3/d5/d67/db7/lf0 0 2024-04-20T21:58:37.446 INFO:tasks.workunit.client.0.smithi142.stdout:8/660: sync 2024-04-20T21:58:37.446 INFO:tasks.workunit.client.0.smithi142.stdout:4/584: sync 2024-04-20T21:58:37.447 INFO:tasks.workunit.client.0.smithi142.stdout:5/566: truncate f9 17876 0 2024-04-20T21:58:37.448 INFO:tasks.workunit.client.0.smithi142.stdout:2/730: truncate d3/d5/f4b 2465478 0 2024-04-20T21:58:37.449 INFO:tasks.workunit.client.0.smithi142.stdout:8/661: chown d0/d17/d35/d9d/lcc 24 1 2024-04-20T21:58:37.454 INFO:tasks.workunit.client.0.smithi142.stdout:1/607: dread d2/dd/d17/d1b/d22/d13/f63 [0,4194304] 0 2024-04-20T21:58:37.454 INFO:tasks.workunit.client.0.smithi142.stdout:2/731: fdatasync d3/d9/d89/d31/da2/ddb/de0/fc0 0 2024-04-20T21:58:37.457 INFO:tasks.workunit.client.0.smithi142.stdout:8/662: mknod d0/d1c/d44/d89/d45/d4c/d68/da5/ce6 0 2024-04-20T21:58:37.458 INFO:tasks.workunit.client.0.smithi142.stdout:1/608: mkdir d2/dd/d1c/d60/dcc 0 2024-04-20T21:58:37.465 INFO:tasks.workunit.client.0.smithi142.stdout:1/609: rmdir d2/dd/d17/d3b/d50 39 2024-04-20T21:58:37.468 INFO:tasks.workunit.client.0.smithi142.stdout:8/663: rename d0/l15 to d0/d1c/d44/d89/d45/d4c/d68/da5/le7 0 2024-04-20T21:58:37.471 INFO:tasks.workunit.client.0.smithi142.stdout:4/585: link d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/f44 d1/d12/da/d1c/d32/d3d/d2f/d52/d94/faf 0 2024-04-20T21:58:37.474 INFO:tasks.workunit.client.0.smithi142.stdout:8/664: mkdir d0/d1c/d44/d89/d45/d92/de8 0 2024-04-20T21:58:37.475 INFO:tasks.workunit.client.0.smithi142.stdout:5/567: dwrite f3 [0,4194304] 0 2024-04-20T21:58:37.476 INFO:tasks.workunit.client.0.smithi142.stdout:8/665: stat d0/d17/d35 0 2024-04-20T21:58:37.478 INFO:tasks.workunit.client.0.smithi142.stdout:2/732: truncate d3/d9/d34/f56 133299 0 2024-04-20T21:58:37.479 INFO:tasks.workunit.client.0.smithi142.stdout:4/586: mkdir d1/d6/d4a/db0 0 2024-04-20T21:58:37.481 INFO:tasks.workunit.client.0.smithi142.stdout:5/568: mknod dc/d14/d25/db4/dbb/cc9 0 2024-04-20T21:58:37.483 INFO:tasks.workunit.client.0.smithi142.stdout:2/733: write d3/d9/d34/db5/fbb [519484,54481] 0 2024-04-20T21:58:37.484 INFO:tasks.workunit.client.0.smithi142.stdout:4/587: write d1/d6/d4a/f9a [428138,34142] 0 2024-04-20T21:58:37.486 INFO:tasks.workunit.client.0.smithi142.stdout:1/610: link d2/dd/d17/d1b/d22/d13/l2b d2/dd/d17/d3b/d50/lcd 0 2024-04-20T21:58:37.487 INFO:tasks.workunit.client.0.smithi142.stdout:5/569: dread - dc/d14/d72/f85 zero size 2024-04-20T21:58:37.495 INFO:tasks.workunit.client.0.smithi142.stdout:5/570: chown dc/d14/d21/d46/d2a/l45 260979030 1 2024-04-20T21:58:37.497 INFO:tasks.workunit.client.0.smithi142.stdout:8/666: rename d0/d1c/d44/d89/d45/d4c/d68/da5/le7 to d0/d17/d35/le9 0 2024-04-20T21:58:37.503 INFO:tasks.workunit.client.0.smithi142.stdout:5/571: symlink dc/d71/d5c/lca 0 2024-04-20T21:58:37.505 INFO:tasks.workunit.client.0.smithi142.stdout:2/734: getdents d3/d5/d19/d70/d3c 0 2024-04-20T21:58:37.511 INFO:tasks.workunit.client.0.smithi142.stdout:5/572: chown dc/d14/d21/d46/d7d/c82 0 1 2024-04-20T21:58:37.514 INFO:tasks.workunit.client.0.smithi142.stdout:8/667: truncate d0/d1c/d44/dad/db3/d3f/fd8 5206184 0 2024-04-20T21:58:37.514 INFO:tasks.workunit.client.0.smithi142.stdout:5/573: stat dc/d14/d21/d46/d2a/l45 0 2024-04-20T21:58:37.517 INFO:tasks.workunit.client.0.smithi142.stdout:8/668: readlink d0/d1c/d44/dad/db3/d3f/d7f/lba 0 2024-04-20T21:58:37.518 INFO:tasks.workunit.client.0.smithi142.stdout:2/735: rename d3/d9/d89/d31/d84/fdc to d3/d5/d67/dc4/ff1 0 2024-04-20T21:58:37.519 INFO:tasks.workunit.client.0.smithi142.stdout:5/574: dread dc/d14/d21/d46/fb2 [0,4194304] 0 2024-04-20T21:58:37.524 INFO:tasks.workunit.client.0.smithi142.stdout:2/736: creat d3/d9/d89/d31/dc3/dce/ff2 x:0 0 0 2024-04-20T21:58:37.526 INFO:tasks.workunit.client.0.smithi142.stdout:4/588: dread d1/d12/da/d1c/d32/f60 [0,4194304] 0 2024-04-20T21:58:37.527 INFO:tasks.workunit.client.0.smithi142.stdout:2/737: mknod d3/d5/d19/d70/de6/cf3 0 2024-04-20T21:58:37.532 INFO:tasks.workunit.client.0.smithi142.stdout:2/738: mknod d3/d5/d67/dc4/d6c/cf4 0 2024-04-20T21:58:37.535 INFO:tasks.workunit.client.0.smithi142.stdout:8/669: dwrite d0/d1c/f2d [0,4194304] 0 2024-04-20T21:58:37.537 INFO:tasks.workunit.client.0.smithi142.stdout:2/739: mkdir d3/d9/df5 0 2024-04-20T21:58:37.539 INFO:tasks.workunit.client.0.smithi142.stdout:8/670: symlink d0/d17/d35/db5/lea 0 2024-04-20T21:58:37.545 INFO:tasks.workunit.client.0.smithi142.stdout:4/589: dread d1/d12/da/d1c/d32/f60 [0,4194304] 0 2024-04-20T21:58:37.545 INFO:tasks.workunit.client.0.smithi142.stdout:5/575: dwrite dc/d6b/f9d [0,4194304] 0 2024-04-20T21:58:37.552 INFO:tasks.workunit.client.0.smithi142.stdout:4/590: mknod d1/d12/da/d37/cb1 0 2024-04-20T21:58:37.566 INFO:tasks.workunit.client.0.smithi142.stdout:4/591: link d1/d12/da/d1c/d32/d3d/d2f/d49/f75 d1/d6/d4b/fb2 0 2024-04-20T21:58:37.568 INFO:tasks.workunit.client.0.smithi142.stdout:2/740: dwrite d3/d5/d19/d70/f3f [0,4194304] 0 2024-04-20T21:58:37.578 INFO:tasks.workunit.client.0.smithi142.stdout:8/671: dread d0/d1c/d44/f62 [0,4194304] 0 2024-04-20T21:58:37.590 INFO:tasks.workunit.client.0.smithi142.stdout:8/672: rename d0/d1c/l2b to d0/d1c/d44/d89/d45/d4c/d68/da5/leb 0 2024-04-20T21:58:37.590 INFO:tasks.workunit.client.0.smithi142.stdout:5/576: dread dc/d14/d21/d46/f24 [0,4194304] 0 2024-04-20T21:58:37.592 INFO:tasks.workunit.client.0.smithi142.stdout:4/592: write d1/d12/da/d1c/f61 [1639312,35263] 0 2024-04-20T21:58:37.593 INFO:tasks.workunit.client.0.smithi142.stdout:2/741: write d3/d9/d34/fc5 [607109,62661] 0 2024-04-20T21:58:37.593 INFO:tasks.workunit.client.0.smithi142.stdout:5/577: fdatasync dc/d71/f6e 0 2024-04-20T21:58:37.600 INFO:tasks.workunit.client.0.smithi142.stdout:8/673: mknod d0/d17/d35/db5/de2/cec 0 2024-04-20T21:58:37.600 INFO:tasks.workunit.client.0.smithi142.stdout:5/578: rmdir dc/d71/d93 39 2024-04-20T21:58:37.601 INFO:tasks.workunit.client.0.smithi142.stdout:8/674: fdatasync d0/f96 0 2024-04-20T21:58:37.606 INFO:tasks.workunit.client.0.smithi142.stdout:5/579: rmdir dc/d14 39 2024-04-20T21:58:37.609 INFO:tasks.workunit.client.0.smithi142.stdout:4/593: creat d1/d12/fb3 x:0 0 0 2024-04-20T21:58:37.612 INFO:tasks.workunit.client.0.smithi142.stdout:2/742: link d3/d5/d67/fbc d3/d9/d89/d31/ff6 0 2024-04-20T21:58:37.614 INFO:tasks.workunit.client.0.smithi142.stdout:5/580: fsync dc/d14/d21/d46/d7d/f84 0 2024-04-20T21:58:37.614 INFO:tasks.workunit.client.0.smithi142.stdout:8/675: mkdir d0/d1c/d44/d89/d45/ded 0 2024-04-20T21:58:37.616 INFO:tasks.workunit.client.0.smithi142.stdout:4/594: mknod d1/d6/d4b/cb4 0 2024-04-20T21:58:37.616 INFO:tasks.workunit.client.0.smithi142.stdout:2/743: creat d3/d9/d89/d9a/ff7 x:0 0 0 2024-04-20T21:58:37.617 INFO:tasks.workunit.client.0.smithi142.stdout:5/581: write dc/d14/d25/f2d [4150507,130771] 0 2024-04-20T21:58:37.619 INFO:tasks.workunit.client.0.smithi142.stdout:2/744: fsync d3/d5/f5e 0 2024-04-20T21:58:37.621 INFO:tasks.workunit.client.0.smithi142.stdout:4/595: symlink d1/d12/da/d1c/d32/d3d/lb5 0 2024-04-20T21:58:37.623 INFO:tasks.workunit.client.0.smithi142.stdout:2/745: fsync d3/d5/d19/d70/d3c/f9f 0 2024-04-20T21:58:37.625 INFO:tasks.workunit.client.0.smithi142.stdout:5/582: dread dc/d14/d26/d3f/f9b [0,4194304] 0 2024-04-20T21:58:37.625 INFO:tasks.workunit.client.0.smithi142.stdout:4/596: symlink d1/d6/d4b/lb6 0 2024-04-20T21:58:37.627 INFO:tasks.workunit.client.0.smithi142.stdout:5/583: readlink dc/d14/d25/l51 0 2024-04-20T21:58:37.634 INFO:tasks.workunit.client.0.smithi142.stdout:4/597: dread d1/d5b/f84 [0,4194304] 0 2024-04-20T21:58:37.638 INFO:tasks.workunit.client.0.smithi142.stdout:8/676: dwrite d0/d1c/f9e [0,4194304] 0 2024-04-20T21:58:37.654 INFO:tasks.workunit.client.0.smithi142.stdout:4/598: read d1/d12/da/d1c/d32/f43 [3742702,105405] 0 2024-04-20T21:58:37.661 INFO:tasks.workunit.client.0.smithi142.stdout:2/746: dwrite d3/d9/d89/feb [0,4194304] 0 2024-04-20T21:58:37.663 INFO:tasks.workunit.client.0.smithi142.stdout:4/599: symlink d1/d6/d4a/lb7 0 2024-04-20T21:58:37.666 INFO:tasks.workunit.client.0.smithi142.stdout:5/584: dwrite f9 [0,4194304] 0 2024-04-20T21:58:37.666 INFO:tasks.workunit.client.0.smithi142.stdout:9/641: sync 2024-04-20T21:58:37.666 INFO:tasks.workunit.client.0.smithi142.stdout:6/579: sync 2024-04-20T21:58:37.666 INFO:tasks.workunit.client.0.smithi142.stdout:7/665: sync 2024-04-20T21:58:37.669 INFO:tasks.workunit.client.0.smithi142.stdout:2/747: unlink d3/d5/d19/c39 0 2024-04-20T21:58:37.679 INFO:tasks.workunit.client.0.smithi142.stdout:9/642: write d0/d3c/f6f [1240486,78820] 0 2024-04-20T21:58:37.679 INFO:tasks.workunit.client.0.smithi142.stdout:2/748: creat d3/d9/da3/ff8 x:0 0 0 2024-04-20T21:58:37.683 INFO:tasks.workunit.client.0.smithi142.stdout:6/580: mkdir d1/d9e/dcc 0 2024-04-20T21:58:37.683 INFO:tasks.workunit.client.0.smithi142.stdout:5/585: mkdir dc/d14/d21/d46/d2a/d65/da3/dcb 0 2024-04-20T21:58:37.683 INFO:tasks.workunit.client.0.smithi142.stdout:7/666: creat d4/d7f/d77/d78/d9b/dc1/ff2 x:0 0 0 2024-04-20T21:58:37.690 INFO:tasks.workunit.client.0.smithi142.stdout:8/677: dread d0/ff [0,4194304] 0 2024-04-20T21:58:37.693 INFO:tasks.workunit.client.0.smithi142.stdout:9/643: creat d0/d36/d55/fdb x:0 0 0 2024-04-20T21:58:37.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:37 smithi164 ceph-mon[23506]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:58:37.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:37 smithi164 ceph-mon[23506]: pgmap v40: 65 pgs: 65 active+clean; 1.2 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 36 MiB/s rd, 113 MiB/s wr, 278 op/s 2024-04-20T21:58:37.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:37 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:58:37.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:37 smithi142 ceph-mon[15828]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:58:37.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:37 smithi142 ceph-mon[15828]: pgmap v40: 65 pgs: 65 active+clean; 1.2 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 36 MiB/s rd, 113 MiB/s wr, 278 op/s 2024-04-20T21:58:37.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:37 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:58:37.697 INFO:tasks.workunit.client.0.smithi142.stdout:5/586: symlink dc/d14/d21/d46/d2a/lcc 0 2024-04-20T21:58:37.697 INFO:tasks.workunit.client.0.smithi142.stdout:7/667: creat d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/dd5/ff3 x:0 0 0 2024-04-20T21:58:37.698 INFO:tasks.workunit.client.0.smithi142.stdout:8/678: write d0/d29/f6c [61027,97137] 0 2024-04-20T21:58:37.698 INFO:tasks.workunit.client.0.smithi142.stdout:2/749: fsync d3/d9/d89/d31/d84/fa5 0 2024-04-20T21:58:37.702 INFO:tasks.workunit.client.0.smithi142.stdout:7/668: dread - d4/d7f/d77/d78/d9b/dc1/ff2 zero size 2024-04-20T21:58:37.708 INFO:tasks.workunit.client.0.smithi142.stdout:4/600: dread f0 [0,4194304] 0 2024-04-20T21:58:37.712 INFO:tasks.workunit.client.0.smithi142.stdout:8/679: mkdir d0/d1c/d44/dee 0 2024-04-20T21:58:37.712 INFO:tasks.workunit.client.0.smithi142.stdout:2/750: mkdir d3/d5/d67/db7/df9 0 2024-04-20T21:58:37.715 INFO:tasks.workunit.client.0.smithi142.stdout:4/601: dread - d1/d12/da/d1c/d32/d3d/d9d/fa2 zero size 2024-04-20T21:58:37.723 INFO:tasks.workunit.client.0.smithi142.stdout:2/751: rename d3/d5/d67/dc4/c99 to d3/d9/db6/de3/cfa 0 2024-04-20T21:58:37.729 INFO:tasks.workunit.client.0.smithi142.stdout:8/680: dread d0/d1c/d44/f46 [0,4194304] 0 2024-04-20T21:58:37.735 INFO:tasks.workunit.client.0.smithi142.stdout:6/581: dread d1/d2f/d35/d5b/d39/f52 [0,4194304] 0 2024-04-20T21:58:37.736 INFO:tasks.workunit.client.0.smithi142.stdout:7/669: dwrite d4/d7f/d77/d78/da8/d64/ff0 [0,4194304] 0 2024-04-20T21:58:37.741 INFO:tasks.workunit.client.0.smithi142.stdout:4/602: dwrite d1/d12/da/d37/f96 [0,4194304] 0 2024-04-20T21:58:37.743 INFO:tasks.workunit.client.0.smithi142.stdout:7/670: mknod d4/d7f/cf4 0 2024-04-20T21:58:37.749 INFO:tasks.workunit.client.0.smithi142.stdout:4/603: fdatasync d1/d12/da/d1c/d32/d3d/d2f/d7a/d90/f9c 0 2024-04-20T21:58:37.754 INFO:tasks.workunit.client.0.smithi142.stdout:6/582: mkdir d1/d2f/d35/d5b/d39/dcd 0 2024-04-20T21:58:37.760 INFO:tasks.workunit.client.0.smithi142.stdout:7/671: dread d4/d7f/d77/d78/da8/d64/fdc [0,4194304] 0 2024-04-20T21:58:37.763 INFO:tasks.workunit.client.0.smithi142.stdout:6/583: dread d1/d11/f59 [0,4194304] 0 2024-04-20T21:58:37.764 INFO:tasks.workunit.client.0.smithi142.stdout:8/681: dwrite d0/d1c/d44/d89/d45/fb4 [0,4194304] 0 2024-04-20T21:58:37.765 INFO:tasks.workunit.client.0.smithi142.stdout:7/672: mknod d4/dd3/cf5 0 2024-04-20T21:58:37.769 INFO:tasks.workunit.client.0.smithi142.stdout:8/682: read - d0/d17/d35/fae zero size 2024-04-20T21:58:37.770 INFO:tasks.workunit.client.0.smithi142.stdout:8/683: chown d0/d17 25 1 2024-04-20T21:58:37.773 INFO:tasks.workunit.client.0.smithi142.stdout:6/584: creat d1/d2f/d6c/d7e/d9f/dc0/fce x:0 0 0 2024-04-20T21:58:37.775 INFO:tasks.workunit.client.0.smithi142.stdout:8/684: write d0/d17/d35/fd3 [3422543,45191] 0 2024-04-20T21:58:37.775 INFO:tasks.workunit.client.0.smithi142.stdout:4/604: truncate d1/f13 1222608 0 2024-04-20T21:58:37.776 INFO:tasks.workunit.client.0.smithi142.stdout:2/752: dread d3/d9/d34/fb9 [0,4194304] 0 2024-04-20T21:58:37.778 INFO:tasks.workunit.client.0.smithi142.stdout:7/673: readlink d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/l1e 0 2024-04-20T21:58:37.782 INFO:tasks.workunit.client.0.smithi142.stdout:6/585: fsync d1/d2f/d35/d5b/d63/d4b/f88 0 2024-04-20T21:58:37.784 INFO:tasks.workunit.client.0.smithi142.stdout:6/586: chown d1/d5/d3a/d43/c53 214830 1 2024-04-20T21:58:37.788 INFO:tasks.workunit.client.0.smithi142.stdout:4/605: creat d1/d12/da/d1c/d32/d3d/d2f/d52/fb8 x:0 0 0 2024-04-20T21:58:37.788 INFO:tasks.workunit.client.0.smithi142.stdout:7/674: creat d4/d7d/da1/ff6 x:0 0 0 2024-04-20T21:58:37.789 INFO:tasks.workunit.client.0.smithi142.stdout:6/587: creat d1/d2f/d6c/d7e/fcf x:0 0 0 2024-04-20T21:58:37.792 INFO:tasks.workunit.client.0.smithi142.stdout:2/753: getdents d3/d9/d89/d9a 0 2024-04-20T21:58:37.802 INFO:tasks.workunit.client.0.smithi142.stdout:8/685: dwrite d0/d17/f8d [0,4194304] 0 2024-04-20T21:58:37.807 INFO:tasks.workunit.client.0.smithi142.stdout:7/675: symlink d4/d7f/d77/d78/d9b/lf7 0 2024-04-20T21:58:37.808 INFO:tasks.workunit.client.0.smithi142.stdout:6/588: mknod d1/d2f/d35/d5b/d63/d34/cd0 0 2024-04-20T21:58:37.811 INFO:tasks.workunit.client.0.smithi142.stdout:8/686: dread - d0/d17/f95 zero size 2024-04-20T21:58:37.817 INFO:tasks.workunit.client.0.smithi142.stdout:4/606: dread d1/d12/da/d1c/d32/f4d [0,4194304] 0 2024-04-20T21:58:37.818 INFO:tasks.workunit.client.0.smithi142.stdout:6/589: rename d1/d5/d3a/d43/d5c to d1/dd1 0 2024-04-20T21:58:37.818 INFO:tasks.workunit.client.0.smithi142.stdout:2/754: dread d3/d5/d19/f8a [0,4194304] 0 2024-04-20T21:58:37.820 INFO:tasks.workunit.client.0.smithi142.stdout:8/687: truncate d0/d29/f37 1801827 0 2024-04-20T21:58:37.823 INFO:tasks.workunit.client.0.smithi142.stdout:8/688: chown d0/d42/f98 258124 1 2024-04-20T21:58:37.824 INFO:tasks.workunit.client.0.smithi142.stdout:7/676: rename d4/d7f/d77/d78/da8/d64 to d4/d7f/d77/d78/d9b/d5a/d90/df8 0 2024-04-20T21:58:37.824 INFO:tasks.workunit.client.0.smithi142.stdout:8/689: dread - d0/d29/fc5 zero size 2024-04-20T21:58:37.830 INFO:tasks.workunit.client.0.smithi142.stdout:4/607: write d1/d6/d30/f8f [5056051,76252] 0 2024-04-20T21:58:37.842 INFO:tasks.workunit.client.0.smithi142.stdout:4/608: readlink d1/d12/da/d1c/d32/d3d/d2f/d73/l93 0 2024-04-20T21:58:37.842 INFO:tasks.workunit.client.0.smithi142.stdout:7/677: write d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/f69 [50079,60584] 0 2024-04-20T21:58:37.851 INFO:tasks.workunit.client.0.smithi142.stdout:8/690: dwrite d0/d1c/d44/dad/db3/fe4 [0,4194304] 0 2024-04-20T21:58:37.856 INFO:tasks.workunit.client.0.smithi142.stdout:2/755: dread d3/d9/d89/d31/f6a [0,4194304] 0 2024-04-20T21:58:37.856 INFO:tasks.workunit.client.0.smithi142.stdout:6/590: dread d1/d5/fb [0,4194304] 0 2024-04-20T21:58:37.862 INFO:tasks.workunit.client.0.smithi142.stdout:8/691: creat d0/d1c/fef x:0 0 0 2024-04-20T21:58:37.865 INFO:tasks.workunit.client.0.smithi142.stdout:2/756: write d3/d9/d89/d31/da2/ddb/de0/fe2 [3774598,96143] 0 2024-04-20T21:58:37.867 INFO:tasks.workunit.client.0.smithi142.stdout:6/591: chown d1/d5/ca3 43 1 2024-04-20T21:58:37.871 INFO:tasks.workunit.client.0.smithi142.stdout:8/692: mkdir d0/d17/df0 0 2024-04-20T21:58:37.874 INFO:tasks.workunit.client.0.smithi142.stdout:6/592: creat d1/dd1/d8f/fd2 x:0 0 0 2024-04-20T21:58:37.876 INFO:tasks.workunit.client.0.smithi142.stdout:8/693: dread - d0/f7b zero size 2024-04-20T21:58:37.876 INFO:tasks.workunit.client.0.smithi142.stdout:4/609: dwrite d1/d12/faa [0,4194304] 0 2024-04-20T21:58:37.880 INFO:tasks.workunit.client.0.smithi142.stdout:2/757: creat d3/d9/d89/d31/dc3/dce/dea/ffb x:0 0 0 2024-04-20T21:58:37.883 INFO:tasks.workunit.client.0.smithi142.stdout:6/593: fsync d1/d5/d3a/f45 0 2024-04-20T21:58:37.895 INFO:tasks.workunit.client.0.smithi142.stdout:8/694: dread d0/d1c/f61 [0,4194304] 0 2024-04-20T21:58:37.899 INFO:tasks.workunit.client.0.smithi142.stdout:2/758: fdatasync d3/d5/d19/d70/d3c/f1b 0 2024-04-20T21:58:37.901 INFO:tasks.workunit.client.0.smithi142.stdout:4/610: creat d1/d6/d4a/d5a/fb9 x:0 0 0 2024-04-20T21:58:37.906 INFO:tasks.workunit.client.0.smithi142.stdout:8/695: creat d0/d1c/dd1/ff1 x:0 0 0 2024-04-20T21:58:37.910 INFO:tasks.workunit.client.0.smithi142.stdout:7/678: dread d4/d7d/f52 [0,4194304] 0 2024-04-20T21:58:37.915 INFO:tasks.workunit.client.0.smithi142.stdout:4/611: mkdir d1/d12/da/d1c/da9/dba 0 2024-04-20T21:58:37.917 INFO:tasks.workunit.client.0.smithi142.stdout:8/696: fdatasync d0/f4f 0 2024-04-20T21:58:37.922 INFO:tasks.workunit.client.0.smithi142.stdout:2/759: getdents d3/d5/d19/d70/de6 0 2024-04-20T21:58:37.923 INFO:tasks.workunit.client.0.smithi142.stdout:7/679: creat d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/ff9 x:0 0 0 2024-04-20T21:58:37.925 INFO:tasks.workunit.client.0.smithi142.stdout:6/594: dread d1/d5/f26 [0,4194304] 0 2024-04-20T21:58:37.926 INFO:tasks.workunit.client.0.smithi142.stdout:8/697: creat d0/d1c/d44/d89/d45/ded/ff2 x:0 0 0 2024-04-20T21:58:37.927 INFO:tasks.workunit.client.0.smithi142.stdout:2/760: unlink d3/d5/d19/d94/l9e 0 2024-04-20T21:58:37.928 INFO:tasks.workunit.client.0.smithi142.stdout:7/680: mknod d4/d7f/d77/d78/d9b/d5a/cfa 0 2024-04-20T21:58:37.933 INFO:tasks.workunit.client.0.smithi142.stdout:0/625: sync 2024-04-20T21:58:37.933 INFO:tasks.workunit.client.0.smithi142.stdout:3/679: sync 2024-04-20T21:58:37.934 INFO:tasks.workunit.client.0.smithi142.stdout:6/595: dread d1/d2f/d35/f36 [0,4194304] 0 2024-04-20T21:58:37.937 INFO:tasks.workunit.client.0.smithi142.stdout:0/626: write d5/d45/d6f/f81 [845586,117277] 0 2024-04-20T21:58:37.938 INFO:tasks.workunit.client.0.smithi142.stdout:8/698: mkdir d0/d29/df3 0 2024-04-20T21:58:37.939 INFO:tasks.workunit.client.0.smithi142.stdout:7/681: chown d4/l6 132230621 1 2024-04-20T21:58:37.941 INFO:tasks.workunit.client.0.smithi142.stdout:2/761: mknod d3/d9/d89/d31/de1/cfc 0 2024-04-20T21:58:37.943 INFO:tasks.workunit.client.0.smithi142.stdout:8/699: chown d0/d1c/d44/d89/d45/d4c/cd0 8856575 1 2024-04-20T21:58:37.945 INFO:tasks.workunit.client.0.smithi142.stdout:0/627: fsync d5/d1c/d3c/d85/d38/f90 0 2024-04-20T21:58:37.945 INFO:tasks.workunit.client.0.smithi142.stdout:8/700: stat d0/d1c/d44/d89/fa3 0 2024-04-20T21:58:37.946 INFO:tasks.workunit.client.0.smithi142.stdout:2/762: symlink d3/d9/d89/d31/d84/lfd 0 2024-04-20T21:58:37.947 INFO:tasks.workunit.client.0.smithi142.stdout:3/680: dread d6/d15/d30/f73 [0,4194304] 0 2024-04-20T21:58:37.948 INFO:tasks.workunit.client.0.smithi142.stdout:7/682: write d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/fd6 [637817,64582] 0 2024-04-20T21:58:37.948 INFO:tasks.workunit.client.0.smithi142.stdout:6/596: rename d1/d2f/d35/d5b/d63/d64/f80 to d1/d2f/d35/d5b/d63/fd3 0 2024-04-20T21:58:37.954 INFO:tasks.workunit.client.0.smithi142.stdout:8/701: unlink d0/d1c/f9e 0 2024-04-20T21:58:37.956 INFO:tasks.workunit.client.0.smithi142.stdout:8/702: write d0/f20 [712050,60206] 0 2024-04-20T21:58:37.956 INFO:tasks.workunit.client.0.smithi142.stdout:2/763: creat d3/d9/d89/d31/da2/ffe x:0 0 0 2024-04-20T21:58:37.959 INFO:tasks.workunit.client.0.smithi142.stdout:8/703: stat d0/d17/d35/fdb 0 2024-04-20T21:58:37.960 INFO:tasks.workunit.client.0.smithi142.stdout:3/681: creat d6/d32/d39/ffa x:0 0 0 2024-04-20T21:58:37.962 INFO:tasks.workunit.client.0.smithi142.stdout:6/597: dread - d1/d2f/d35/d5b/d63/d4b/d61/f67 zero size 2024-04-20T21:58:37.962 INFO:tasks.workunit.client.0.smithi142.stdout:8/704: truncate d0/d5e/f71 4768043 0 2024-04-20T21:58:37.963 INFO:tasks.workunit.client.0.smithi142.stdout:7/683: mknod d4/d7f/d77/d78/d9b/d5a/cfb 0 2024-04-20T21:58:37.964 INFO:tasks.workunit.client.0.smithi142.stdout:6/598: chown d1/d9e/dcc 1815963025 1 2024-04-20T21:58:37.968 INFO:tasks.workunit.client.0.smithi142.stdout:3/682: dread - d6/d32/f52 zero size 2024-04-20T21:58:37.968 INFO:tasks.workunit.client.0.smithi142.stdout:0/628: dwrite d5/d1c/d3c/d8b/fb5 [0,4194304] 0 2024-04-20T21:58:37.975 INFO:tasks.workunit.client.0.smithi142.stdout:6/599: creat d1/d11/d71/fd4 x:0 0 0 2024-04-20T21:58:37.976 INFO:tasks.workunit.client.0.smithi142.stdout:7/684: rmdir d4/d7f/d77/d78/da8/dae/db3 39 2024-04-20T21:58:37.980 INFO:tasks.workunit.client.0.smithi142.stdout:7/685: stat d4/d7f/d77/d78/da8/dae/dd8/ldb 0 2024-04-20T21:58:37.981 INFO:tasks.workunit.client.0.smithi142.stdout:3/683: rmdir d6/d15/d30/d37/d75/dbc 39 2024-04-20T21:58:37.981 INFO:tasks.workunit.client.0.smithi142.stdout:0/629: mkdir d5/dc9 0 2024-04-20T21:58:37.986 INFO:tasks.workunit.client.0.smithi142.stdout:6/600: creat d1/dd1/d8f/fd5 x:0 0 0 2024-04-20T21:58:37.986 INFO:tasks.workunit.client.0.smithi142.stdout:0/630: write d5/f17 [9434757,92408] 0 2024-04-20T21:58:37.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.987+0000 7f9d2f600700 1 -- 172.21.15.142:0/604437121 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9d2804ebb0 con 0x7f9d28108430 2024-04-20T21:58:37.987 INFO:tasks.workunit.client.0.smithi142.stdout:3/684: fsync d6/d15/d1e/d43/f70 0 2024-04-20T21:58:37.987 INFO:tasks.workunit.client.0.smithi142.stdout:6/601: readlink d1/d2f/d35/d5b/d63/l2c 0 2024-04-20T21:58:37.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.988+0000 7f9d25600700 1 -- 172.21.15.142:0/604437121 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f9d1405b080 con 0x7f9d28108430 2024-04-20T21:58:37.990 INFO:tasks.workunit.client.0.smithi142.stdout:0/631: unlink d5/l6 0 2024-04-20T21:58:37.990 INFO:tasks.workunit.client.0.smithi142.stdout:8/705: link d0/d29/f2e d0/d1c/d44/dad/db3/d3f/d7f/d8f/ff4 0 2024-04-20T21:58:37.993 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T21:58:37.994 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T21:58:37.994 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 2 2024-04-20T21:58:37.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:58:37.994 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T21:58:37.994 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T21:58:37.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:58:37.994 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T21:58:37.994 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 6 2024-04-20T21:58:37.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:58:37.994 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T21:58:37.994 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4 2024-04-20T21:58:37.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:58:37.994 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T21:58:37.994 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 12, 2024-04-20T21:58:37.995 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T21:58:37.995 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T21:58:37.995 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T21:58:37.995 INFO:tasks.workunit.client.0.smithi142.stdout:0/632: creat d5/d1c/fca x:0 0 0 2024-04-20T21:58:37.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.996+0000 7f9d2f600700 1 -- 172.21.15.142:0/604437121 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f9d1006eac0 msgr2=0x7f9d10070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:37.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.996+0000 7f9d2f600700 1 --2- 172.21.15.142:0/604437121 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f9d1006eac0 0x7f9d10070f80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c005090 tx=0x7f9d1c005fb0 comp rx=0 tx=0).stop 2024-04-20T21:58:37.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.996+0000 7f9d2f600700 1 -- 172.21.15.142:0/604437121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d28108430 msgr2=0x7f9d2819d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:37.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.996+0000 7f9d2f600700 1 --2- 172.21.15.142:0/604437121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d28108430 0x7f9d2819d110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400c8a0 tx=0x7f9d1400cbb0 comp rx=0 tx=0).stop 2024-04-20T21:58:37.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.996+0000 7f9d2f600700 1 -- 172.21.15.142:0/604437121 shutdown_connections 2024-04-20T21:58:37.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.996+0000 7f9d2f600700 1 --2- 172.21.15.142:0/604437121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d28107260 0x7f9d2819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:37.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.996+0000 7f9d2f600700 1 --2- 172.21.15.142:0/604437121 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f9d1006eac0 0x7f9d10070f80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:37.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.996+0000 7f9d2f600700 1 --2- 172.21.15.142:0/604437121 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9d28108430 0x7f9d2819d110 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:37.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.996+0000 7f9d2f600700 1 -- 172.21.15.142:0/604437121 >> 172.21.15.142:0/604437121 conn(0x7f9d28076400 msgr2=0x7f9d2810b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:37.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.997+0000 7f9d2f600700 1 -- 172.21.15.142:0/604437121 shutdown_connections 2024-04-20T21:58:37.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:37.997+0000 7f9d2f600700 1 -- 172.21.15.142:0/604437121 wait complete. 2024-04-20T21:58:37.997 INFO:tasks.workunit.client.0.smithi142.stdout:6/602: getdents d1 0 2024-04-20T21:58:38.002 INFO:tasks.workunit.client.0.smithi142.stdout:0/633: creat d5/d13/d1e/d23/fcb x:0 0 0 2024-04-20T21:58:38.006 INFO:tasks.workunit.client.0.smithi142.stdout:0/634: rmdir d5/d1c/d3c/d85/d63 39 2024-04-20T21:58:38.007 INFO:tasks.workunit.client.0.smithi142.stdout:2/764: dread d3/d9/d89/d31/f92 [0,4194304] 0 2024-04-20T21:58:38.012 INFO:tasks.workunit.client.0.smithi142.stdout:0/635: creat d5/d1d/d7e/fcc x:0 0 0 2024-04-20T21:58:38.012 INFO:tasks.workunit.client.0.smithi142.stdout:7/686: write d4/f48 [956400,110961] 0 2024-04-20T21:58:38.022 INFO:tasks.workunit.client.0.smithi142.stdout:6/603: truncate d1/dd1/f7c 256375 0 2024-04-20T21:58:38.030 INFO:tasks.workunit.client.0.smithi142.stdout:0/636: write d5/f18 [4265595,62080] 0 2024-04-20T21:58:38.031 INFO:tasks.workunit.client.0.smithi142.stdout:6/604: unlink d1/d5/f12 0 2024-04-20T21:58:38.032 INFO:tasks.workunit.client.0.smithi142.stdout:0/637: stat d5/d13/cc7 0 2024-04-20T21:58:38.034 INFO:tasks.workunit.client.0.smithi142.stdout:7/687: getdents d4/d7f/d77/d78/da8 0 2024-04-20T21:58:38.038 INFO:tasks.workunit.client.0.smithi142.stdout:2/765: dwrite d3/d5/f4b [0,4194304] 0 2024-04-20T21:58:38.040 INFO:tasks.workunit.client.0.smithi142.stdout:0/638: creat d5/d1c/d3c/fcd x:0 0 0 2024-04-20T21:58:38.040 INFO:tasks.workunit.client.0.smithi142.stdout:2/766: dread - d3/d9/d69/fd1 zero size 2024-04-20T21:58:38.040 INFO:tasks.workunit.client.0.smithi142.stdout:7/688: unlink d4/d7f/d77/d78/da8/l8f 0 2024-04-20T21:58:38.043 INFO:tasks.workunit.client.0.smithi142.stdout:0/639: stat d5/d13/d1e/d23/d24/c3e 0 2024-04-20T21:58:38.048 INFO:tasks.workunit.client.0.smithi142.stdout:2/767: creat d3/d5/d19/d70/de6/fff x:0 0 0 2024-04-20T21:58:38.053 INFO:tasks.workunit.client.0.smithi142.stdout:0/640: creat d5/d1c/d3c/d85/d38/d62/d9a/fce x:0 0 0 2024-04-20T21:58:38.057 INFO:tasks.workunit.client.0.smithi142.stdout:7/689: dread d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e/f7a [0,4194304] 0 2024-04-20T21:58:38.057 INFO:tasks.workunit.client.0.smithi142.stdout:2/768: chown d3/c48 398697 1 2024-04-20T21:58:38.059 INFO:tasks.workunit.client.0.smithi142.stdout:7/690: chown d4/d7f/d77/ldd 0 1 2024-04-20T21:58:38.061 INFO:tasks.workunit.client.0.smithi142.stdout:0/641: rename d5/d6d/cad to d5/d13/d1e/d8f/ccf 0 2024-04-20T21:58:38.067 INFO:tasks.workunit.client.0.smithi142.stdout:6/605: dwrite d1/d11/f76 [0,4194304] 0 2024-04-20T21:58:38.067 INFO:tasks.workunit.client.0.smithi142.stdout:7/691: creat d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/dd5/ffc x:0 0 0 2024-04-20T21:58:38.071 INFO:tasks.workunit.client.0.smithi142.stdout:0/642: read - d5/d1c/d3c/d85/d38/d62/f89 zero size 2024-04-20T21:58:38.074 INFO:tasks.workunit.client.0.smithi142.stdout:2/769: creat d3/d9/df5/f100 x:0 0 0 2024-04-20T21:58:38.084 INFO:tasks.workunit.client.0.smithi142.stdout:2/770: creat d3/d9/d89/d31/d84/f101 x:0 0 0 2024-04-20T21:58:38.086 INFO:tasks.workunit.client.0.smithi142.stdout:7/692: stat d4/d7f/d77/d78/da8/dae/db3/ce1 0 2024-04-20T21:58:38.088 INFO:tasks.workunit.client.0.smithi142.stdout:0/643: mkdir d5/d1d/d7e/db0/dd0 0 2024-04-20T21:58:38.092 INFO:tasks.workunit.client.0.smithi142.stdout:2/771: mknod d3/d9/d89/d31/dc3/dce/c102 0 2024-04-20T21:58:38.092 INFO:tasks.workunit.client.0.smithi142.stdout:0/644: dread - d5/d1c/d3c/d8b/fac zero size 2024-04-20T21:58:38.092 INFO:tasks.workunit.client.0.smithi142.stdout:7/693: readlink d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/dd5/le2 0 2024-04-20T21:58:38.098 INFO:tasks.workunit.client.0.smithi142.stdout:7/694: creat d4/d7f/d77/d78/d9b/dc1/ffd x:0 0 0 2024-04-20T21:58:38.101 INFO:tasks.workunit.client.0.smithi142.stdout:6/606: fsync d1/d2f/d35/d5b/d63/fd3 0 2024-04-20T21:58:38.103 INFO:tasks.workunit.client.0.smithi142.stdout:0/645: creat d5/d1c/d3c/d85/d38/fd1 x:0 0 0 2024-04-20T21:58:38.104 INFO:tasks.workunit.client.0.smithi142.stdout:7/695: fdatasync d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e/d88/fb8 0 2024-04-20T21:58:38.107 INFO:tasks.workunit.client.0.smithi142.stdout:6/607: symlink d1/ld6 0 2024-04-20T21:58:38.110 INFO:tasks.workunit.client.0.smithi142.stdout:2/772: dwrite d3/d9/d89/d31/da2/ddb/de0/fc0 [0,4194304] 0 2024-04-20T21:58:38.113 INFO:tasks.workunit.client.0.smithi142.stdout:7/696: truncate d4/d7f/d77/d78/d9b/d5a/f63 151830 0 2024-04-20T21:58:38.118 INFO:tasks.workunit.client.0.smithi142.stdout:7/697: stat d4/d7f/d77/d78/d97/d9a/dc4/fdf 0 2024-04-20T21:58:38.120 INFO:tasks.workunit.client.0.smithi142.stdout:6/608: truncate d1/d2f/d35/d5b/d63/d4b/f88 355899 0 2024-04-20T21:58:38.122 INFO:tasks.workunit.client.0.smithi142.stdout:7/698: write d4/d7f/d77/d7e/fcc [382164,78653] 0 2024-04-20T21:58:38.125 INFO:tasks.workunit.client.0.smithi142.stdout:0/646: dwrite d5/d13/d1e/d23/d24/d48/db6/fc1 [0,4194304] 0 2024-04-20T21:58:38.127 INFO:tasks.workunit.client.0.smithi142.stdout:7/699: stat d4/d7f/d77/d78/d9b/d5a/c61 0 2024-04-20T21:58:38.130 INFO:tasks.workunit.client.0.smithi142.stdout:6/609: creat d1/d2f/d35/d48/fd7 x:0 0 0 2024-04-20T21:58:38.132 INFO:tasks.workunit.client.0.smithi142.stdout:2/773: dwrite d3/d5/d19/f59 [0,4194304] 0 2024-04-20T21:58:38.133 INFO:tasks.workunit.client.0.smithi142.stdout:0/647: write d5/d1c/d3c/d85/d38/d62/f96 [1346686,27136] 0 2024-04-20T21:58:38.135 INFO:tasks.workunit.client.0.smithi142.stdout:2/774: stat d3/d5/d19/d70/d3c/d64 0 2024-04-20T21:58:38.139 INFO:tasks.workunit.client.0.smithi142.stdout:6/610: unlink d1/d1b/c1f 0 2024-04-20T21:58:38.142 INFO:tasks.workunit.client.0.smithi142.stdout:0/648: mknod d5/d13/d1e/d23/d2c/cd2 0 2024-04-20T21:58:38.144 INFO:tasks.workunit.client.0.smithi142.stdout:2/775: symlink d3/d5/d19/l103 0 2024-04-20T21:58:38.144 INFO:tasks.workunit.client.0.smithi142.stdout:0/649: dread - d5/d13/d1e/d8f/fc4 zero size 2024-04-20T21:58:38.146 INFO:tasks.workunit.client.0.smithi142.stdout:2/776: fsync d3/d9/d89/d31/dc3/dce/ff2 0 2024-04-20T21:58:38.153 INFO:tasks.workunit.client.0.smithi142.stdout:2/777: read d3/d9/d89/d31/da2/ddb/de0/fe2 [2916698,91028] 0 2024-04-20T21:58:38.158 INFO:tasks.workunit.client.0.smithi142.stdout:2/778: readlink d3/d9/d89/d31/lca 0 2024-04-20T21:58:38.160 INFO:tasks.workunit.client.0.smithi142.stdout:2/779: stat d3/d5/d19/c27 0 2024-04-20T21:58:38.162 INFO:tasks.workunit.client.0.smithi142.stdout:6/611: dwrite d1/d2f/d35/d5b/d63/d34/fa2 [0,4194304] 0 2024-04-20T21:58:38.165 INFO:tasks.workunit.client.0.smithi142.stdout:0/650: dwrite d5/d13/d1e/d23/d24/f79 [0,4194304] 0 2024-04-20T21:58:38.167 INFO:tasks.workunit.client.0.smithi142.stdout:6/612: mknod d1/dd1/cd8 0 2024-04-20T21:58:38.170 INFO:tasks.workunit.client.0.smithi142.stdout:2/780: write d3/d9/d89/d31/da2/fd8 [572894,14457] 0 2024-04-20T21:58:38.171 INFO:tasks.workunit.client.0.smithi142.stdout:6/613: readlink d1/d5/d3a/l78 0 2024-04-20T21:58:38.173 INFO:tasks.workunit.client.0.smithi142.stdout:0/651: read d5/d13/d1e/d23/d24/d48/db6/fc1 [2718100,85223] 0 2024-04-20T21:58:38.173 INFO:tasks.workunit.client.0.smithi142.stdout:7/700: read d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e/fa4 [861480,2647] 0 2024-04-20T21:58:38.177 INFO:tasks.workunit.client.0.smithi142.stdout:5/587: sync 2024-04-20T21:58:38.180 INFO:tasks.workunit.client.0.smithi142.stdout:1/611: sync 2024-04-20T21:58:38.181 INFO:tasks.workunit.client.0.smithi142.stdout:9/644: sync 2024-04-20T21:58:38.182 INFO:tasks.workunit.client.0.smithi142.stdout:5/588: fsync dc/d71/d5c/d68/f8c 0 2024-04-20T21:58:38.200 INFO:tasks.workunit.client.0.smithi142.stdout:9/645: dread - d0/fcd zero size 2024-04-20T21:58:38.205 INFO:tasks.workunit.client.0.smithi142.stdout:0/652: truncate d5/d13/d1e/fb1 340969 0 2024-04-20T21:58:38.207 INFO:tasks.workunit.client.0.smithi142.stdout:7/701: dwrite d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/f23 [0,4194304] 0 2024-04-20T21:58:38.212 INFO:tasks.workunit.client.0.smithi142.stdout:7/702: stat d4/d7f/d77/d78/d9b/d5a 0 2024-04-20T21:58:38.212 INFO:tasks.workunit.client.0.smithi142.stdout:9/646: write d0/d2a/d39/fc4 [1925437,99295] 0 2024-04-20T21:58:38.216 INFO:tasks.workunit.client.0.smithi142.stdout:9/647: readlink d0/l16 0 2024-04-20T21:58:38.219 INFO:tasks.workunit.client.0.smithi142.stdout:7/703: rmdir d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d11 39 2024-04-20T21:58:38.227 INFO:tasks.workunit.client.0.smithi142.stdout:2/781: rename d3/d5/d19 to d3/d9/d69/d104 0 2024-04-20T21:58:38.228 INFO:tasks.workunit.client.0.smithi142.stdout:5/589: rename dc/d14/d25 to dc/d14/d25/db4/dbb/dc3/dcd 22 2024-04-20T21:58:38.231 INFO:tasks.workunit.client.0.smithi142.stdout:9/648: dread d0/d89/fa2 [0,4194304] 0 2024-04-20T21:58:38.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.236+0000 7f38e8c00700 1 -- 172.21.15.142:0/359264574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38e4101e10 msgr2=0x7f38e4102270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:38.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.236+0000 7f38e8c00700 1 --2- 172.21.15.142:0/359264574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38e4101e10 0x7f38e4102270 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009910 tx=0x7f38cc009c20 comp rx=0 tx=0).stop 2024-04-20T21:58:38.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.236+0000 7f38e8c00700 1 -- 172.21.15.142:0/359264574 shutdown_connections 2024-04-20T21:58:38.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.236+0000 7f38e8c00700 1 --2- 172.21.15.142:0/359264574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38e4101e10 0x7f38e4102270 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:38.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.236+0000 7f38e8c00700 1 --2- 172.21.15.142:0/359264574 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38e4100c10 0x7f38e4101030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:38.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.236+0000 7f38e8c00700 1 -- 172.21.15.142:0/359264574 >> 172.21.15.142:0/359264574 conn(0x7f38e40fc1d0 msgr2=0x7f38e40fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:38.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.237+0000 7f38e8c00700 1 -- 172.21.15.142:0/359264574 shutdown_connections 2024-04-20T21:58:38.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.237+0000 7f38e8c00700 1 -- 172.21.15.142:0/359264574 wait complete. 2024-04-20T21:58:38.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.239+0000 7f38e8c00700 1 Processor -- start 2024-04-20T21:58:38.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.239+0000 7f38e8c00700 1 -- start start 2024-04-20T21:58:38.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.239+0000 7f38e8c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38e4100c10 0x7f38e4196630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:38.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.240+0000 7f38e8c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38e4101e10 0x7f38e4196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:38.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.240+0000 7f38e8c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e4197190 con 0x7f38e4100c10 2024-04-20T21:58:38.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.240+0000 7f38e8c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e41972d0 con 0x7f38e4101e10 2024-04-20T21:58:38.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.240+0000 7f38e1e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38e4100c10 0x7f38e4196630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:38.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.240+0000 7f38e1e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38e4100c10 0x7f38e4196630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46464/0 (socket says 172.21.15.142:46464) 2024-04-20T21:58:38.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.240+0000 7f38e1e00700 1 -- 172.21.15.142:0/885847200 learned_addr learned my addr 172.21.15.142:0/885847200 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:58:38.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.240+0000 7f38e1400700 1 --2- 172.21.15.142:0/885847200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38e4101e10 0x7f38e4196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:38.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.241+0000 7f38e1400700 1 -- 172.21.15.142:0/885847200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38e4100c10 msgr2=0x7f38e4196630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:38.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.241+0000 7f38e1400700 1 --2- 172.21.15.142:0/885847200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38e4100c10 0x7f38e4196630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:38.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.241+0000 7f38e1400700 1 -- 172.21.15.142:0/885847200 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d4009520 con 0x7f38e4101e10 2024-04-20T21:58:38.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.241+0000 7f38e1400700 1 --2- 172.21.15.142:0/885847200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38e4101e10 0x7f38e4196b70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f38cc000c00 tx=0x7f38cc00b600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:38.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.242+0000 7f38daa00700 1 -- 172.21.15.142:0/885847200 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38cc01d070 con 0x7f38e4101e10 2024-04-20T21:58:38.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.242+0000 7f38e8c00700 1 -- 172.21.15.142:0/885847200 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38cc0095f0 con 0x7f38e4101e10 2024-04-20T21:58:38.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.242+0000 7f38e8c00700 1 -- 172.21.15.142:0/885847200 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e419c060 con 0x7f38e4101e10 2024-04-20T21:58:38.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.242+0000 7f38daa00700 1 -- 172.21.15.142:0/885847200 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f38cc0052a0 con 0x7f38e4101e10 2024-04-20T21:58:38.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.242+0000 7f38daa00700 1 -- 172.21.15.142:0/885847200 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38cc003de0 con 0x7f38e4101e10 2024-04-20T21:58:38.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.244+0000 7f38e8c00700 1 -- 172.21.15.142:0/885847200 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c0005320 con 0x7f38e4101e10 2024-04-20T21:58:38.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.245+0000 7f38daa00700 1 -- 172.21.15.142:0/885847200 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 25) v1 ==== 92710+0+0 (secure 0 0 0) 0x7f38cc003680 con 0x7f38e4101e10 2024-04-20T21:58:38.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.245+0000 7f38daa00700 1 --2- 172.21.15.142:0/885847200 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f38c806ea80 0x7f38c8070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:38.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.246+0000 7f38daa00700 1 -- 172.21.15.142:0/885847200 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f38cc08fc20 con 0x7f38e4101e10 2024-04-20T21:58:38.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.246+0000 7f38e1e00700 1 --2- 172.21.15.142:0/885847200 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f38c806ea80 0x7f38c8070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:38.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.247+0000 7f38e1e00700 1 --2- 172.21.15.142:0/885847200 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f38c806ea80 0x7f38c8070f40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f38d4005950 tx=0x7f38d4009260 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:38.247 INFO:tasks.workunit.client.0.smithi142.stdout:7/704: creat d4/d7f/d77/d78/d9b/ffe x:0 0 0 2024-04-20T21:58:38.248 INFO:tasks.workunit.client.0.smithi142.stdout:2/782: symlink d3/d9/l105 0 2024-04-20T21:58:38.249 INFO:tasks.workunit.client.0.smithi142.stdout:9/649: mkdir d0/d2a/ddc 0 2024-04-20T21:58:38.256 INFO:tasks.workunit.client.0.smithi142.stdout:6/614: write d1/d2f/d35/d5b/d39/f3b [590445,60502] 0 2024-04-20T21:58:38.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.258+0000 7f38daa00700 1 -- 172.21.15.142:0/885847200 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f38cc05c950 con 0x7f38e4101e10 2024-04-20T21:58:38.262 INFO:tasks.workunit.client.0.smithi142.stdout:1/612: dread d2/dd/d17/d1b/d22/d13/f14 [0,4194304] 0 2024-04-20T21:58:38.283 INFO:tasks.workunit.client.0.smithi142.stdout:5/590: creat dc/fce x:0 0 0 2024-04-20T21:58:38.285 INFO:tasks.workunit.client.0.smithi142.stdout:2/783: creat d3/d5/d67/f106 x:0 0 0 2024-04-20T21:58:38.287 INFO:tasks.workunit.client.0.smithi142.stdout:7/705: unlink d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/ld1 0 2024-04-20T21:58:38.289 INFO:tasks.workunit.client.0.smithi142.stdout:9/650: creat d0/d3c/d4d/d63/d80/fdd x:0 0 0 2024-04-20T21:58:38.290 INFO:tasks.workunit.client.0.smithi142.stdout:6/615: symlink d1/dd1/d8f/ld9 0 2024-04-20T21:58:38.292 INFO:tasks.workunit.client.0.smithi142.stdout:1/613: rename d2/dd/d1c/d43 to d2/dd/d1c/d60/dce 0 2024-04-20T21:58:38.293 INFO:tasks.workunit.client.0.smithi142.stdout:5/591: mknod dc/d14/d26/d3f/d53/d7c/d97/ccf 0 2024-04-20T21:58:38.294 INFO:tasks.workunit.client.0.smithi142.stdout:7/706: fdatasync d4/d7f/d77/d78/f8a 0 2024-04-20T21:58:38.294 INFO:tasks.workunit.client.0.smithi142.stdout:1/614: write d2/dd/d1c/d60/fa4 [126554,69852] 0 2024-04-20T21:58:38.296 INFO:tasks.workunit.client.0.smithi142.stdout:5/592: dread - dc/d71/d5c/f8e zero size 2024-04-20T21:58:38.298 INFO:tasks.workunit.client.0.smithi142.stdout:7/707: chown d4/d7f/d77/d78/fe8 31916 1 2024-04-20T21:58:38.301 INFO:tasks.workunit.client.0.smithi142.stdout:6/616: creat d1/d2f/d35/d5b/d63/d64/fda x:0 0 0 2024-04-20T21:58:38.308 INFO:tasks.workunit.client.0.smithi142.stdout:6/617: truncate d1/d2f/d35/d5b/d39/f3b 1065175 0 2024-04-20T21:58:38.309 INFO:tasks.workunit.client.0.smithi142.stdout:7/708: mknod d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d11/cff 0 2024-04-20T21:58:38.312 INFO:tasks.workunit.client.0.smithi142.stdout:6/618: getdents d1/d9e/dcc 0 2024-04-20T21:58:38.312 INFO:tasks.workunit.client.0.smithi142.stdout:7/709: chown d4/d7f/d77/d78/d9b/d5a/cfa 2591 1 2024-04-20T21:58:38.315 INFO:tasks.workunit.client.0.smithi142.stdout:6/619: chown d1/d2f/d35/d5b/d3e/f87 1 1 2024-04-20T21:58:38.316 INFO:tasks.workunit.client.0.smithi142.stdout:7/710: truncate d4/d7d/da1/fda 423736 0 2024-04-20T21:58:38.324 INFO:tasks.workunit.client.0.smithi142.stdout:6/620: rename d1/d5/d3a/dbc to d1/d2f/d35/d5b/d3e/dc5/ddb 0 2024-04-20T21:58:38.325 INFO:tasks.workunit.client.0.smithi142.stdout:9/651: dread d0/f11 [0,4194304] 0 2024-04-20T21:58:38.325 INFO:tasks.workunit.client.0.smithi142.stdout:7/711: mkdir d4/d7f/d77/d78/d9b/d5a/d90/dbc/d100 0 2024-04-20T21:58:38.331 INFO:tasks.workunit.client.0.smithi142.stdout:5/593: write dc/f32 [707915,4257] 0 2024-04-20T21:58:38.334 INFO:tasks.workunit.client.0.smithi142.stdout:6/621: rename d1/d5/d3a/d43/f89 to d1/d2f/d6c/d7e/d9f/dc0/fdc 0 2024-04-20T21:58:38.339 INFO:tasks.workunit.client.0.smithi142.stdout:9/652: dread d0/d36/f4c [0,4194304] 0 2024-04-20T21:58:38.343 INFO:tasks.workunit.client.0.smithi142.stdout:7/712: rename d4/d7f/d77/d78/d9b/d5a/d90/fb1 to d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/f101 0 2024-04-20T21:58:38.344 INFO:tasks.workunit.client.0.smithi142.stdout:6/622: creat d1/d2f/d35/d5b/d39/dcd/fdd x:0 0 0 2024-04-20T21:58:38.346 INFO:tasks.workunit.client.0.smithi142.stdout:1/615: dwrite d2/f6 [0,4194304] 0 2024-04-20T21:58:38.352 INFO:tasks.workunit.client.0.smithi142.stdout:1/616: write d2/dd/d17/d3b/f9d [3581543,57740] 0 2024-04-20T21:58:38.352 INFO:tasks.workunit.client.0.smithi142.stdout:7/713: symlink d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e/d88/l102 0 2024-04-20T21:58:38.352 INFO:tasks.workunit.client.0.smithi142.stdout:5/594: dread dc/d14/d21/f27 [0,4194304] 0 2024-04-20T21:58:38.356 INFO:tasks.workunit.client.0.smithi142.stdout:5/595: write dc/d14/d21/f6f [1314111,123460] 0 2024-04-20T21:58:38.356 INFO:tasks.workunit.client.0.smithi142.stdout:7/714: chown d4/d7f/d77/d78/d9b/dc1/dd4 132463 1 2024-04-20T21:58:38.358 INFO:tasks.workunit.client.0.smithi142.stdout:7/715: stat d4/d7d/fa6 0 2024-04-20T21:58:38.360 INFO:tasks.workunit.client.0.smithi142.stdout:1/617: truncate d2/dd/d17/d1b/d22/f46 562261 0 2024-04-20T21:58:38.363 INFO:tasks.workunit.client.0.smithi142.stdout:7/716: read - d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/dd5/ff3 zero size 2024-04-20T21:58:38.364 INFO:tasks.workunit.client.0.smithi142.stdout:5/596: mkdir dc/d14/d25/d89/d9a/dd0 0 2024-04-20T21:58:38.365 INFO:tasks.workunit.client.0.smithi142.stdout:1/618: symlink d2/dd/d17/d3b/d50/d62/lcf 0 2024-04-20T21:58:38.380 INFO:tasks.workunit.client.0.smithi142.stdout:7/717: symlink d4/d7f/d77/d7e/db2/l103 0 2024-04-20T21:58:38.384 INFO:tasks.workunit.client.0.smithi142.stdout:9/653: dread d0/f14 [0,4194304] 0 2024-04-20T21:58:38.395 INFO:tasks.workunit.client.0.smithi142.stdout:1/619: link d2/dd/d1c/d88/cbc d2/dd/d17/d1b/d22/d20/cd0 0 2024-04-20T21:58:38.395 INFO:tasks.workunit.client.0.smithi142.stdout:7/718: write d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e/d88/f9e [1196397,59353] 0 2024-04-20T21:58:38.405 INFO:tasks.workunit.client.0.smithi142.stdout:9/654: getdents d0/d2a 0 2024-04-20T21:58:38.410 INFO:tasks.workunit.client.0.smithi142.stdout:5/597: dwrite dc/d14/d21/d46/d2a/f8a [0,4194304] 0 2024-04-20T21:58:38.411 INFO:tasks.workunit.client.0.smithi142.stdout:7/719: truncate d4/d7f/d77/d78/d97/d9a/dc4/fdf 28436 0 2024-04-20T21:58:38.412 INFO:tasks.workunit.client.0.smithi142.stdout:5/598: dread - dc/fce zero size 2024-04-20T21:58:38.413 INFO:tasks.workunit.client.0.smithi142.stdout:1/620: rmdir d2/dd/d1c/d60/dcc 0 2024-04-20T21:58:38.413 INFO:tasks.workunit.client.0.smithi142.stdout:6/623: dread d1/d2f/d35/d5b/d63/d34/f4c [0,4194304] 0 2024-04-20T21:58:38.416 INFO:tasks.workunit.client.0.smithi142.stdout:5/599: dread - dc/d14/d26/d3f/d53/d7c/fa7 zero size 2024-04-20T21:58:38.419 INFO:tasks.workunit.client.0.smithi142.stdout:4/612: sync 2024-04-20T21:58:38.420 INFO:tasks.workunit.client.0.smithi142.stdout:1/621: chown d2/dd/d1c/d60/fa4 2021147094 1 2024-04-20T21:58:38.420 INFO:tasks.workunit.client.0.smithi142.stdout:1/622: chown d2/dd/d1c/f4f 114569 1 2024-04-20T21:58:38.420 INFO:tasks.workunit.client.0.smithi142.stdout:9/655: link d0/d2a/f7c d0/d89/fde 0 2024-04-20T21:58:38.421 INFO:tasks.workunit.client.0.smithi142.stdout:6/624: creat d1/d9e/fde x:0 0 0 2024-04-20T21:58:38.422 INFO:tasks.workunit.client.0.smithi142.stdout:1/623: creat d2/dd/fd1 x:0 0 0 2024-04-20T21:58:38.430 INFO:tasks.workunit.client.0.smithi142.stdout:9/656: truncate d0/d36/d55/f76 283121 0 2024-04-20T21:58:38.433 INFO:tasks.workunit.client.0.smithi142.stdout:9/657: readlink d0/d36/l3e 0 2024-04-20T21:58:38.435 INFO:tasks.workunit.client.0.smithi142.stdout:5/600: dread dc/d14/d21/d46/f24 [0,4194304] 0 2024-04-20T21:58:38.438 INFO:tasks.workunit.client.0.smithi142.stdout:7/720: dwrite d4/d7f/d77/d7e/fcc [0,4194304] 0 2024-04-20T21:58:38.440 INFO:tasks.workunit.client.0.smithi142.stdout:5/601: fdatasync dc/d71/d5c/d68/f8c 0 2024-04-20T21:58:38.440 INFO:tasks.workunit.client.0.smithi142.stdout:1/624: symlink d2/dd/d17/d1b/d22/d55/ld2 0 2024-04-20T21:58:38.445 INFO:tasks.workunit.client.0.smithi142.stdout:9/658: dread - d0/fb0 zero size 2024-04-20T21:58:38.446 INFO:tasks.workunit.client.0.smithi142.stdout:6/625: write d1/d2f/d35/f47 [4192639,10487] 0 2024-04-20T21:58:38.450 INFO:tasks.workunit.client.0.smithi142.stdout:5/602: symlink dc/d14/d26/d3f/db3/ld1 0 2024-04-20T21:58:38.452 INFO:tasks.workunit.client.0.smithi142.stdout:1/625: stat d2/dd/d17/d3b/d50/c6c 0 2024-04-20T21:58:38.452 INFO:tasks.workunit.client.0.smithi142.stdout:6/626: symlink d1/d11/d71/ldf 0 2024-04-20T21:58:38.454 INFO:tasks.workunit.client.0.smithi142.stdout:5/603: chown dc/d71/d93 52321802 1 2024-04-20T21:58:38.454 INFO:tasks.workunit.client.0.smithi142.stdout:9/659: truncate d0/d91/fc7 329376 0 2024-04-20T21:58:38.457 INFO:tasks.workunit.client.0.smithi142.stdout:5/604: write dc/d14/d21/f27 [174721,19189] 0 2024-04-20T21:58:38.462 INFO:tasks.workunit.client.0.smithi142.stdout:6/627: rename d1/d2f/d6c to d1/d2f/d35/d5b/d3e/de0 0 2024-04-20T21:58:38.475 INFO:tasks.workunit.client.0.smithi142.stdout:5/605: creat dc/d14/d25/d78/fd2 x:0 0 0 2024-04-20T21:58:38.480 INFO:tasks.workunit.client.0.smithi142.stdout:7/721: dwrite d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e/d88/f9f [0,4194304] 0 2024-04-20T21:58:38.483 INFO:tasks.workunit.client.0.smithi142.stdout:5/606: creat dc/fd3 x:0 0 0 2024-04-20T21:58:38.487 INFO:tasks.workunit.client.0.smithi142.stdout:6/628: truncate d1/d2f/d35/d5b/d63/d64/fda 846559 0 2024-04-20T21:58:38.489 INFO:tasks.workunit.client.0.smithi142.stdout:7/722: mknod d4/d7f/d77/d78/da8/dae/dc5/c104 0 2024-04-20T21:58:38.491 INFO:tasks.workunit.client.0.smithi142.stdout:5/607: mkdir dc/d14/d21/d46/dc1/dd4 0 2024-04-20T21:58:38.494 INFO:tasks.workunit.client.0.smithi142.stdout:6/629: truncate d1/d2f/d35/d5b/d39/f52 8553710 0 2024-04-20T21:58:38.495 INFO:tasks.workunit.client.0.smithi142.stdout:9/660: dwrite d0/d2a/f47 [0,4194304] 0 2024-04-20T21:58:38.496 INFO:tasks.workunit.client.0.smithi142.stdout:5/608: truncate dc/d71/d5c/f8e 55871 0 2024-04-20T21:58:38.501 INFO:tasks.workunit.client.0.smithi142.stdout:7/723: truncate d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/f42 2849118 0 2024-04-20T21:58:38.502 INFO:tasks.workunit.client.0.smithi142.stdout:5/609: rename dc/d14/d21/d46/d2a/d65 to dc/d14/d21/d46/d2a/d65/da3/dcb/dd5 22 2024-04-20T21:58:38.503 INFO:tasks.workunit.client.0.smithi142.stdout:9/661: read d0/d2a/d39/d50/f5b [5652,34322] 0 2024-04-20T21:58:38.504 INFO:tasks.workunit.client.0.smithi142.stdout:6/630: mkdir d1/d2f/d35/d5b/d63/d64/de1 0 2024-04-20T21:58:38.506 INFO:tasks.workunit.client.0.smithi142.stdout:6/631: readlink d1/la7 0 2024-04-20T21:58:38.506 INFO:tasks.workunit.client.0.smithi142.stdout:7/724: mkdir d4/d7f/d77/d78/d9b/d105 0 2024-04-20T21:58:38.517 INFO:tasks.workunit.client.0.smithi142.stdout:9/662: dread d0/d2a/d39/f98 [0,4194304] 0 2024-04-20T21:58:38.518 INFO:tasks.workunit.client.0.smithi142.stdout:7/725: creat d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d11/f106 x:0 0 0 2024-04-20T21:58:38.523 INFO:tasks.workunit.client.0.smithi142.stdout:7/726: fdatasync d4/d7f/d77/d7e/f94 0 2024-04-20T21:58:38.527 INFO:tasks.workunit.client.0.smithi142.stdout:6/632: dread d1/d11/f5d [0,4194304] 0 2024-04-20T21:58:38.530 INFO:tasks.workunit.client.0.smithi142.stdout:7/727: write d4/d7f/d77/d78/da8/dae/fa5 [109006,100346] 0 2024-04-20T21:58:38.532 INFO:tasks.workunit.client.0.smithi142.stdout:6/633: chown d1/d2f/d35/d48/f73 80 1 2024-04-20T21:58:38.535 INFO:tasks.workunit.client.0.smithi142.stdout:5/610: dwrite dc/d71/d5c/d68/f8c [0,4194304] 0 2024-04-20T21:58:38.539 INFO:tasks.workunit.client.0.smithi142.stdout:6/634: dread d1/d75/fa0 [0,4194304] 0 2024-04-20T21:58:38.539 INFO:tasks.workunit.client.0.smithi142.stdout:5/611: chown dc/d14/d26/l4c 2984681 1 2024-04-20T21:58:38.541 INFO:tasks.workunit.client.0.smithi142.stdout:7/728: creat d4/d7f/d77/d78/d97/d9a/dc4/f107 x:0 0 0 2024-04-20T21:58:38.543 INFO:tasks.workunit.client.0.smithi142.stdout:5/612: dread - dc/d6b/f92 zero size 2024-04-20T21:58:38.547 INFO:tasks.workunit.client.0.smithi142.stdout:9/663: dwrite d0/d89/fa2 [0,4194304] 0 2024-04-20T21:58:38.552 INFO:tasks.workunit.client.0.smithi142.stdout:7/729: truncate d4/d7f/d77/d78/d9b/dc1/dd4/fd9 810532 0 2024-04-20T21:58:38.554 INFO:tasks.workunit.client.0.smithi142.stdout:5/613: rename dc/d14/f1e to dc/d14/d26/d3f/d53/d7c/fd6 0 2024-04-20T21:58:38.558 INFO:tasks.workunit.client.0.smithi142.stdout:5/614: readlink dc/d14/d26/d3f/db3/ld1 0 2024-04-20T21:58:38.561 INFO:tasks.workunit.client.0.smithi142.stdout:5/615: chown dc/d14/d26/d3f/f9b 478 1 2024-04-20T21:58:38.561 INFO:tasks.workunit.client.0.smithi142.stdout:6/635: getdents d1/d2f/d35/d5b/d63/d4b/d83 0 2024-04-20T21:58:38.564 INFO:tasks.workunit.client.0.smithi142.stdout:9/664: dread d0/d89/fde [0,4194304] 0 2024-04-20T21:58:38.568 INFO:tasks.workunit.client.0.smithi142.stdout:6/636: rename d1/d75/fa0 to d1/d5/fe2 0 2024-04-20T21:58:38.572 INFO:tasks.workunit.client.0.smithi142.stdout:9/665: mknod d0/d89/d95/cdf 0 2024-04-20T21:58:38.574 INFO:tasks.workunit.client.0.smithi142.stdout:9/666: write d0/d89/fc5 [489767,120420] 0 2024-04-20T21:58:38.585 INFO:tasks.workunit.client.0.smithi142.stdout:6/637: dread d1/d2f/d35/d5b/d39/f52 [4194304,4194304] 0 2024-04-20T21:58:38.595 INFO:tasks.workunit.client.0.smithi142.stdout:5/616: dread dc/f1d [4194304,4194304] 0 2024-04-20T21:58:38.595 INFO:tasks.workunit.client.0.smithi142.stdout:7/730: dread d4/d7f/d77/d7e/f87 [0,4194304] 0 2024-04-20T21:58:38.595 INFO:tasks.workunit.client.0.smithi142.stdout:9/667: dwrite d0/d2a/d39/f6d [0,4194304] 0 2024-04-20T21:58:38.597 INFO:tasks.workunit.client.0.smithi142.stdout:7/731: chown d4/d7f/d77/d78/fe8 14 1 2024-04-20T21:58:38.597 INFO:tasks.workunit.client.0.smithi142.stdout:9/668: read d0/f11 [3300754,43704] 0 2024-04-20T21:58:38.602 INFO:tasks.workunit.client.0.smithi142.stdout:9/669: symlink d0/d3c/d4d/le0 0 2024-04-20T21:58:38.604 INFO:tasks.workunit.client.0.smithi142.stdout:7/732: read d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e/f7a [20970,27235] 0 2024-04-20T21:58:38.604 INFO:tasks.workunit.client.0.smithi142.stdout:9/670: fdatasync d0/d2a/d39/fc4 0 2024-04-20T21:58:38.607 INFO:tasks.workunit.client.0.smithi142.stdout:6/638: dwrite d1/d1b/fb0 [0,4194304] 0 2024-04-20T21:58:38.607 INFO:tasks.workunit.client.0.smithi142.stdout:9/671: chown d0/d2a/l2f 2 1 2024-04-20T21:58:38.608 INFO:tasks.workunit.client.0.smithi142.stdout:7/733: write d4/d7f/d77/d78/d9b/dc1/ff2 [19817,54548] 0 2024-04-20T21:58:38.611 INFO:tasks.workunit.client.0.smithi142.stdout:7/734: fdatasync d4/d7f/d77/d78/da8/dae/dc5/fe5 0 2024-04-20T21:58:38.612 INFO:tasks.workunit.client.0.smithi142.stdout:9/672: truncate d0/d3c/d4d/d63/d80/fa4 654648 0 2024-04-20T21:58:38.617 INFO:tasks.workunit.client.0.smithi142.stdout:9/673: mknod d0/d2a/d39/ce1 0 2024-04-20T21:58:38.626 INFO:tasks.workunit.client.0.smithi142.stdout:5/617: write dc/d71/f42 [108065,49210] 0 2024-04-20T21:58:38.626 INFO:tasks.workunit.client.0.smithi142.stdout:7/735: link d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/lde d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/dd5/l108 0 2024-04-20T21:58:38.629 INFO:tasks.workunit.client.0.smithi142.stdout:7/736: symlink d4/d7f/l109 0 2024-04-20T21:58:38.632 INFO:tasks.workunit.client.0.smithi142.stdout:9/674: write d0/f11 [1301546,76328] 0 2024-04-20T21:58:38.637 INFO:tasks.workunit.client.0.smithi142.stdout:8/706: sync 2024-04-20T21:58:38.637 INFO:tasks.workunit.client.0.smithi142.stdout:3/685: sync 2024-04-20T21:58:38.638 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:38 smithi142 ceph-mon[15828]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:58:38.639 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:38 smithi142 ceph-mon[15828]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:58:38.639 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:38 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/604437121' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T21:58:38.641 INFO:tasks.workunit.client.0.smithi142.stdout:9/675: symlink d0/d2a/d39/d87/d9e/db3/le2 0 2024-04-20T21:58:38.646 INFO:tasks.workunit.client.0.smithi142.stdout:3/686: creat d6/d15/d47/d83/ffb x:0 0 0 2024-04-20T21:58:38.649 INFO:tasks.workunit.client.0.smithi142.stdout:9/676: symlink d0/d2a/d39/le3 0 2024-04-20T21:58:38.651 INFO:tasks.workunit.client.0.smithi142.stdout:7/737: dwrite d4/d7d/f52 [0,4194304] 0 2024-04-20T21:58:38.651 INFO:tasks.workunit.client.0.smithi142.stdout:8/707: mkdir d0/d29/df5 0 2024-04-20T21:58:38.667 INFO:tasks.workunit.client.0.smithi142.stdout:7/738: read d4/d7f/d77/d78/d9b/d5a/d90/dbc/fcd [560628,84607] 0 2024-04-20T21:58:38.670 INFO:tasks.workunit.client.0.smithi142.stdout:5/618: dwrite dc/d14/d26/d3f/d53/d7c/d97/fc4 [0,4194304] 0 2024-04-20T21:58:38.676 INFO:tasks.workunit.client.0.smithi142.stdout:7/739: creat d4/d7f/d77/d78/d9b/dc1/dd4/f10a x:0 0 0 2024-04-20T21:58:38.683 INFO:tasks.workunit.client.0.smithi142.stdout:5/619: fsync dc/d14/d21/d46/d7d/f84 0 2024-04-20T21:58:38.685 INFO:tasks.workunit.client.0.smithi142.stdout:8/708: dread d0/d1c/d44/f62 [0,4194304] 0 2024-04-20T21:58:38.687 INFO:tasks.workunit.client.0.smithi142.stdout:3/687: dwrite d6/d15/d1e/d43/d4d/d59/f9a [0,4194304] 0 2024-04-20T21:58:38.688 INFO:tasks.workunit.client.0.smithi142.stdout:7/740: read d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e/f7a [368231,121703] 0 2024-04-20T21:58:38.691 INFO:tasks.workunit.client.0.smithi142.stdout:9/677: dwrite d0/d91/fb7 [0,4194304] 0 2024-04-20T21:58:38.694 INFO:tasks.workunit.client.0.smithi142.stdout:9/678: fdatasync d0/d2a/fd3 0 2024-04-20T21:58:38.697 INFO:tasks.workunit.client.0.smithi142.stdout:5/620: mknod dc/d14/d21/d46/d7d/db0/cd7 0 2024-04-20T21:58:38.700 INFO:tasks.workunit.client.0.smithi142.stdout:3/688: rmdir d6/d15/d1e/d43 39 2024-04-20T21:58:38.700 INFO:tasks.workunit.client.0.smithi142.stdout:8/709: creat d0/d17/d35/d9d/ff6 x:0 0 0 2024-04-20T21:58:38.709 INFO:tasks.workunit.client.0.smithi142.stdout:3/689: write d6/d15/d1e/d43/d4d/fcc [1237593,57384] 0 2024-04-20T21:58:38.710 INFO:tasks.workunit.client.0.smithi142.stdout:7/741: link d4/d7f/d77/d78/da8/l40 d4/d7d/da1/l10b 0 2024-04-20T21:58:38.716 INFO:tasks.workunit.client.0.smithi142.stdout:7/742: dread d4/d7d/f5c [0,4194304] 0 2024-04-20T21:58:38.718 INFO:tasks.workunit.client.0.smithi142.stdout:5/621: dread dc/d71/fb9 [0,4194304] 0 2024-04-20T21:58:38.720 INFO:tasks.workunit.client.0.smithi142.stdout:7/743: truncate d4/d7f/d77/d78/d9b/ffe 826660 0 2024-04-20T21:58:38.721 INFO:tasks.workunit.client.0.smithi142.stdout:7/744: stat d4/l6 0 2024-04-20T21:58:38.727 INFO:tasks.workunit.client.0.smithi142.stdout:5/622: getdents dc/d14/d25/d78 0 2024-04-20T21:58:38.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.730+0000 7f38e8c00700 1 -- 172.21.15.142:0/885847200 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f38c00058a0 con 0x7f38e4101e10 2024-04-20T21:58:38.729 INFO:tasks.workunit.client.0.smithi142.stdout:5/623: chown dc/d14/d25/d78 78 1 2024-04-20T21:58:38.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.730+0000 7f38daa00700 1 -- 172.21.15.142:0/885847200 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1853 (secure 0 0 0) 0x7f38cc05c4e0 con 0x7f38e4101e10 2024-04-20T21:58:38.731 INFO:tasks.workunit.client.0.smithi142.stdout:8/710: truncate d0/d42/f70 2844825 0 2024-04-20T21:58:38.733 INFO:teuthology.orchestra.run.smithi142.stdout:e12 2024-04-20T21:58:38.733 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T21:58:38.733 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:58:38.733 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T21:58:38.733 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:58:38.733 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T21:58:38.733 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T21:58:38.734 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 12 2024-04-20T21:58:38.734 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T21:58:38.734 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T21:58:38.734 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:51.692699+0000 2024-04-20T21:58:38.734 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T21:58:38.734 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T21:58:38.734 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T21:58:38.734 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T21:58:38.734 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T21:58:38.734 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T21:58:38.734 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T21:58:38.735 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T21:58:38.735 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T21:58:38.735 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:58:38.735 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T21:58:38.735 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T21:58:38.735 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T21:58:38.735 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T21:58:38.735 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T21:58:38.735 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T21:58:38.735 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T21:58:38.735 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T21:58:38.736 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T21:58:38.736 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T21:58:38.736 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T21:58:38.736 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T21:58:38.736 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:58:38.736 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:58:38.736 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:58:38.736 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T21:58:38.736 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:58:38.736 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:58:38.737 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:58:38.737 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:58:38.737 INFO:tasks.workunit.client.0.smithi142.stdout:8/711: write d0/d29/f38 [12953,29477] 0 2024-04-20T21:58:38.737 INFO:tasks.workunit.client.0.smithi142.stdout:7/745: rename d4/d7f/d77/d7e/db2/l103 to d4/d7f/d77/d78/da8/dae/l10c 0 2024-04-20T21:58:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.734+0000 7f38e8c00700 1 -- 172.21.15.142:0/885847200 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f38c806ea80 msgr2=0x7f38c8070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.734+0000 7f38e8c00700 1 --2- 172.21.15.142:0/885847200 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f38c806ea80 0x7f38c8070f40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f38d4005950 tx=0x7f38d4009260 comp rx=0 tx=0).stop 2024-04-20T21:58:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.734+0000 7f38e8c00700 1 -- 172.21.15.142:0/885847200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38e4101e10 msgr2=0x7f38e4196b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.734+0000 7f38e8c00700 1 --2- 172.21.15.142:0/885847200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38e4101e10 0x7f38e4196b70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f38cc000c00 tx=0x7f38cc00b600 comp rx=0 tx=0).stop 2024-04-20T21:58:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.734+0000 7f38e8c00700 1 -- 172.21.15.142:0/885847200 shutdown_connections 2024-04-20T21:58:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.734+0000 7f38e8c00700 1 --2- 172.21.15.142:0/885847200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38e4100c10 0x7f38e4196630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.734+0000 7f38e8c00700 1 --2- 172.21.15.142:0/885847200 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f38c806ea80 0x7f38c8070f40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.734+0000 7f38e8c00700 1 --2- 172.21.15.142:0/885847200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38e4101e10 0x7f38e4196b70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.734+0000 7f38e8c00700 1 -- 172.21.15.142:0/885847200 >> 172.21.15.142:0/885847200 conn(0x7f38e40fc1d0 msgr2=0x7f38e4105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.735+0000 7f38e8c00700 1 -- 172.21.15.142:0/885847200 shutdown_connections 2024-04-20T21:58:38.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.735+0000 7f38e8c00700 1 -- 172.21.15.142:0/885847200 wait complete. 2024-04-20T21:58:38.739 INFO:tasks.workunit.client.0.smithi142.stdout:5/624: symlink dc/d71/d93/ld8 0 2024-04-20T21:58:38.740 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T21:58:38.740 INFO:tasks.workunit.client.0.smithi142.stdout:5/625: write dc/d71/d93/fbc [435596,123188] 0 2024-04-20T21:58:38.741 INFO:tasks.workunit.client.0.smithi142.stdout:7/746: chown d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d11 90996 1 2024-04-20T21:58:38.742 INFO:tasks.workunit.client.0.smithi142.stdout:8/712: symlink d0/lf7 0 2024-04-20T21:58:38.746 INFO:tasks.workunit.client.0.smithi142.stdout:3/690: dwrite d6/d15/d1e/fb2 [0,4194304] 0 2024-04-20T21:58:38.755 INFO:tasks.workunit.client.0.smithi142.stdout:5/626: link dc/d14/d26/fa0 dc/d14/fd9 0 2024-04-20T21:58:38.757 INFO:tasks.workunit.client.0.smithi142.stdout:3/691: dread - d6/d32/d39/d69/f85 zero size 2024-04-20T21:58:38.758 INFO:tasks.workunit.client.0.smithi142.stdout:7/747: symlink d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d11/l10d 0 2024-04-20T21:58:38.762 INFO:tasks.workunit.client.0.smithi142.stdout:7/748: readlink d4/d7f/l56 0 2024-04-20T21:58:38.766 INFO:tasks.workunit.client.0.smithi142.stdout:3/692: truncate d6/d15/d30/d37/d75/dbc/fd7 769264 0 2024-04-20T21:58:38.769 INFO:tasks.workunit.client.0.smithi142.stdout:7/749: unlink d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/f79 0 2024-04-20T21:58:38.770 INFO:tasks.workunit.client.0.smithi142.stdout:3/693: unlink d6/d15/d47/d83/dc9/da7/cef 0 2024-04-20T21:58:38.772 INFO:tasks.workunit.client.0.smithi142.stdout:3/694: fdatasync d6/d32/d9b/fa8 0 2024-04-20T21:58:38.777 INFO:tasks.workunit.client.0.smithi142.stdout:7/750: truncate d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e/d88/fb8 1000650 0 2024-04-20T21:58:38.778 INFO:tasks.workunit.client.0.smithi142.stdout:3/695: rename d6/d15/d1e/cd6 to d6/d15/d30/d37/d6c/dcd/cfc 0 2024-04-20T21:58:38.781 INFO:tasks.workunit.client.0.smithi142.stdout:3/696: truncate d6/d32/d9b/fdf 889816 0 2024-04-20T21:58:38.785 INFO:tasks.workunit.client.0.smithi142.stdout:7/751: rename d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/f101 to d4/d7d/f10e 0 2024-04-20T21:58:38.786 INFO:tasks.workunit.client.0.smithi142.stdout:3/697: truncate d6/d32/d39/d69/d91/ff0 313721 0 2024-04-20T21:58:38.789 INFO:tasks.workunit.client.0.smithi142.stdout:3/698: write d6/d15/d47/d83/dc9/da7/fc7 [3206196,58924] 0 2024-04-20T21:58:38.790 INFO:tasks.workunit.client.0.smithi142.stdout:7/752: creat d4/d7f/d77/d78/d9b/f10f x:0 0 0 2024-04-20T21:58:38.813 INFO:tasks.workunit.client.0.smithi142.stdout:3/699: dwrite d6/d15/d1e/d43/d4d/d59/f62 [0,4194304] 0 2024-04-20T21:58:38.814 INFO:tasks.workunit.client.0.smithi142.stdout:7/753: dwrite d4/d7f/d77/d78/da8/dae/f6a [0,4194304] 0 2024-04-20T21:58:38.815 INFO:tasks.workunit.client.0.smithi142.stdout:3/700: dread - d6/d15/f95 zero size 2024-04-20T21:58:38.817 INFO:tasks.workunit.client.0.smithi142.stdout:7/754: fdatasync d4/d7f/d77/d78/d9b/dc1/ffd 0 2024-04-20T21:58:38.825 INFO:tasks.workunit.client.0.smithi142.stdout:7/755: creat d4/d7f/d77/d78/da8/dae/db3/f110 x:0 0 0 2024-04-20T21:58:38.832 INFO:tasks.workunit.client.0.smithi142.stdout:7/756: link d4/d7d/da1/ff6 d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/dd5/f111 0 2024-04-20T21:58:38.834 INFO:tasks.workunit.client.0.smithi142.stdout:7/757: unlink d4/fd2 0 2024-04-20T21:58:38.837 INFO:tasks.workunit.client.0.smithi142.stdout:7/758: chown d4/cab 750 1 2024-04-20T21:58:38.842 INFO:tasks.workunit.client.0.smithi142.stdout:7/759: chown d4/d7f/d77/d78/da8/dae/cea 15 1 2024-04-20T21:58:38.844 INFO:tasks.workunit.client.0.smithi142.stdout:7/760: write d4/d7f/d77/d78/d9b/f95 [906307,7491] 0 2024-04-20T21:58:38.849 INFO:tasks.workunit.client.0.smithi142.stdout:7/761: dread - d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d11/fad zero size 2024-04-20T21:58:38.852 INFO:tasks.workunit.client.0.smithi142.stdout:3/701: dwrite d6/d15/da4/faa [0,4194304] 0 2024-04-20T21:58:38.857 INFO:tasks.workunit.client.0.smithi142.stdout:0/653: sync 2024-04-20T21:58:38.860 INFO:tasks.workunit.client.0.smithi142.stdout:7/762: rmdir d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e 39 2024-04-20T21:58:38.863 INFO:tasks.workunit.client.0.smithi142.stdout:3/702: unlink d6/d15/d1e/d43/d4d/d59/fd3 0 2024-04-20T21:58:38.868 INFO:tasks.workunit.client.0.smithi142.stdout:3/703: mkdir d6/d15/d47/dfd 0 2024-04-20T21:58:38.869 INFO:tasks.workunit.client.0.smithi142.stdout:0/654: chown d5/d13/d1e/fb1 14294 1 2024-04-20T21:58:38.871 INFO:tasks.workunit.client.0.smithi142.stdout:0/655: dread - d5/d1d/d7e/fc6 zero size 2024-04-20T21:58:38.876 INFO:tasks.workunit.client.0.smithi142.stdout:0/656: mknod d5/d13/d1e/d23/cd3 0 2024-04-20T21:58:38.879 INFO:tasks.workunit.client.0.smithi142.stdout:0/657: creat d5/d1d/fd4 x:0 0 0 2024-04-20T21:58:38.882 INFO:tasks.workunit.client.0.smithi142.stdout:0/658: write d5/d1c/fca [200355,24048] 0 2024-04-20T21:58:38.886 INFO:tasks.workunit.client.0.smithi142.stdout:3/704: dwrite d6/d15/d30/f46 [4194304,4194304] 0 2024-04-20T21:58:38.887 INFO:tasks.workunit.client.0.smithi142.stdout:3/705: readlink d6/d32/d9b/led 0 2024-04-20T21:58:38.914 INFO:tasks.workunit.client.0.smithi142.stdout:3/706: dread d6/d32/d39/d69/f78 [0,4194304] 0 2024-04-20T21:58:38.916 INFO:tasks.workunit.client.0.smithi142.stdout:3/707: chown d6/d15/d30/d37/d75/fb5 728889 1 2024-04-20T21:58:38.917 INFO:tasks.workunit.client.0.smithi142.stdout:3/708: fsync d6/d15/d30/d37/d6c/dcd/d99/fce 0 2024-04-20T21:58:38.923 INFO:tasks.workunit.client.0.smithi142.stdout:3/709: link d6/c27 d6/d15/d30/dae/cfe 0 2024-04-20T21:58:38.924 INFO:tasks.workunit.client.0.smithi142.stdout:3/710: fdatasync d6/d32/d9b/fda 0 2024-04-20T21:58:38.925 INFO:tasks.workunit.client.0.smithi142.stdout:3/711: chown d6/d15/d1e/d43/d4d 171 1 2024-04-20T21:58:38.928 INFO:tasks.workunit.client.0.smithi142.stdout:3/712: symlink d6/d32/de7/lff 0 2024-04-20T21:58:38.930 INFO:tasks.workunit.client.0.smithi142.stdout:3/713: chown d6/d32/f51 37543 1 2024-04-20T21:58:38.936 INFO:tasks.workunit.client.0.smithi142.stdout:3/714: link d6/d32/f51 d6/d32/d39/d69/de0/f100 0 2024-04-20T21:58:38.943 INFO:tasks.workunit.client.0.smithi142.stdout:3/715: getdents d6/d15/d1e 0 2024-04-20T21:58:38.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.945+0000 7ff353c00700 1 -- 172.21.15.142:0/2013950914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff34c074f10 msgr2=0x7ff34c073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:38.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.945+0000 7ff353c00700 1 --2- 172.21.15.142:0/2013950914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff34c074f10 0x7ff34c073370 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff340009910 tx=0x7ff340009c20 comp rx=0 tx=0).stop 2024-04-20T21:58:38.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.945+0000 7ff353c00700 1 -- 172.21.15.142:0/2013950914 shutdown_connections 2024-04-20T21:58:38.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.945+0000 7ff353c00700 1 --2- 172.21.15.142:0/2013950914 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff34c073940 0x7ff34c073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:38.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.945+0000 7ff353c00700 1 --2- 172.21.15.142:0/2013950914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff34c074f10 0x7ff34c073370 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:38.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.945+0000 7ff353c00700 1 -- 172.21.15.142:0/2013950914 >> 172.21.15.142:0/2013950914 conn(0x7ff34c0fc1c0 msgr2=0x7ff34c0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:38.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:38 smithi164 ceph-mon[23506]: from='client.24439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:58:38.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:38 smithi164 ceph-mon[23506]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:58:38.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:38 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/604437121' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T21:58:38.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.946+0000 7ff353c00700 1 -- 172.21.15.142:0/2013950914 shutdown_connections 2024-04-20T21:58:38.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.947+0000 7ff353c00700 1 -- 172.21.15.142:0/2013950914 wait complete. 2024-04-20T21:58:38.947 INFO:tasks.workunit.client.0.smithi142.stdout:7/763: dread d4/d7f/f91 [0,4194304] 0 2024-04-20T21:58:38.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.948+0000 7ff353c00700 1 Processor -- start 2024-04-20T21:58:38.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.948+0000 7ff353c00700 1 -- start start 2024-04-20T21:58:38.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.948+0000 7ff353c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff34c073940 0x7ff34c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:38.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.948+0000 7ff353c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff34c074f10 0x7ff34c19d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:38.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.948+0000 7ff353c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c19d800 con 0x7ff34c074f10 2024-04-20T21:58:38.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.948+0000 7ff353c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c1a21c0 con 0x7ff34c073940 2024-04-20T21:58:38.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.949+0000 7ff34be00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff34c074f10 0x7ff34c19d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:38.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.949+0000 7ff34be00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff34c074f10 0x7ff34c19d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46492/0 (socket says 172.21.15.142:46492) 2024-04-20T21:58:38.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.949+0000 7ff34be00700 1 -- 172.21.15.142:0/4179632641 learned_addr learned my addr 172.21.15.142:0/4179632641 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:58:38.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.949+0000 7ff34be00700 1 -- 172.21.15.142:0/4179632641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff34c073940 msgr2=0x7ff34c19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:38.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.949+0000 7ff34be00700 1 --2- 172.21.15.142:0/4179632641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff34c073940 0x7ff34c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:38.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.949+0000 7ff34be00700 1 -- 172.21.15.142:0/4179632641 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3400095f0 con 0x7ff34c074f10 2024-04-20T21:58:38.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.950+0000 7ff34be00700 1 --2- 172.21.15.142:0/4179632641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff34c074f10 0x7ff34c19d1e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff33800d900 tx=0x7ff33800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:38.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.950+0000 7ff349600700 1 -- 172.21.15.142:0/4179632641 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3380041f0 con 0x7ff34c074f10 2024-04-20T21:58:38.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.950+0000 7ff349600700 1 -- 172.21.15.142:0/4179632641 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff338004350 con 0x7ff34c074f10 2024-04-20T21:58:38.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.950+0000 7ff353c00700 1 -- 172.21.15.142:0/4179632641 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34c1a23c0 con 0x7ff34c074f10 2024-04-20T21:58:38.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.950+0000 7ff349600700 1 -- 172.21.15.142:0/4179632641 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff338003dc0 con 0x7ff34c074f10 2024-04-20T21:58:38.950 INFO:tasks.workunit.client.0.smithi142.stdout:7/764: chown d4/ca2 0 1 2024-04-20T21:58:38.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.950+0000 7ff353c00700 1 -- 172.21.15.142:0/4179632641 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34c1a2960 con 0x7ff34c074f10 2024-04-20T21:58:38.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.952+0000 7ff353c00700 1 -- 172.21.15.142:0/4179632641 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32c005320 con 0x7ff34c074f10 2024-04-20T21:58:38.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.953+0000 7ff349600700 1 -- 172.21.15.142:0/4179632641 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 25) v1 ==== 92710+0+0 (secure 0 0 0) 0x7ff338010670 con 0x7ff34c074f10 2024-04-20T21:58:38.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.954+0000 7ff349600700 1 --2- 172.21.15.142:0/4179632641 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7ff33406ea70 0x7ff334070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:38.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.954+0000 7ff349600700 1 -- 172.21.15.142:0/4179632641 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7ff33808eae0 con 0x7ff34c074f10 2024-04-20T21:58:38.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.954+0000 7ff351200700 1 --2- 172.21.15.142:0/4179632641 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7ff33406ea70 0x7ff334070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:38.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.956+0000 7ff351200700 1 --2- 172.21.15.142:0/4179632641 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7ff33406ea70 0x7ff334070f30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff34000b5c0 tx=0x7ff340005160 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:38.960 INFO:tasks.workunit.client.0.smithi142.stdout:7/765: link d4/d7f/d77/d78/d9b/lc8 d4/d7f/l112 0 2024-04-20T21:58:38.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:38.962+0000 7ff349600700 1 -- 172.21.15.142:0/4179632641 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7ff338057ce0 con 0x7ff34c074f10 2024-04-20T21:58:38.972 INFO:tasks.workunit.client.0.smithi142.stdout:3/716: dwrite d6/d15/d1e/d43/fa5 [4194304,4194304] 0 2024-04-20T21:58:38.977 INFO:tasks.workunit.client.0.smithi142.stdout:3/717: getdents d6/d15/d47/dfd 0 2024-04-20T21:58:38.979 INFO:tasks.workunit.client.0.smithi142.stdout:7/766: dwrite d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e/d88/fb8 [0,4194304] 0 2024-04-20T21:58:38.980 INFO:tasks.workunit.client.0.smithi142.stdout:7/767: chown d4/d7f/c70 135 1 2024-04-20T21:58:38.982 INFO:tasks.workunit.client.0.smithi142.stdout:3/718: truncate d6/d32/d39/d69/f85 74231 0 2024-04-20T21:58:38.984 INFO:tasks.workunit.client.0.smithi142.stdout:7/768: mknod d4/d7f/d77/d78/da8/dae/dc5/c113 0 2024-04-20T21:58:38.993 INFO:tasks.workunit.client.0.smithi142.stdout:7/769: creat d4/d7f/d77/d78/d9b/dc1/f114 x:0 0 0 2024-04-20T21:58:38.993 INFO:tasks.workunit.client.0.smithi142.stdout:3/719: getdents d6/d15/d1e/d43/d4d/d59/df6 0 2024-04-20T21:58:38.998 INFO:tasks.workunit.client.0.smithi142.stdout:7/770: dread - d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d11/fad zero size 2024-04-20T21:58:39.002 INFO:tasks.workunit.client.0.smithi142.stdout:3/720: fsync d6/d15/d30/dae/ff8 0 2024-04-20T21:58:39.004 INFO:tasks.workunit.client.0.smithi142.stdout:3/721: chown d6/d32/d9b 2857 1 2024-04-20T21:58:39.005 INFO:tasks.workunit.client.0.smithi142.stdout:3/722: chown d6/d15/d30/dae 137 1 2024-04-20T21:58:39.012 INFO:tasks.workunit.client.0.smithi142.stdout:7/771: truncate d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/f5f 2732024 0 2024-04-20T21:58:39.013 INFO:tasks.workunit.client.0.smithi142.stdout:3/723: rmdir d6 39 2024-04-20T21:58:39.024 INFO:tasks.workunit.client.0.smithi142.stdout:3/724: mknod d6/d15/d47/d83/dc9/c101 0 2024-04-20T21:58:39.026 INFO:tasks.workunit.client.0.smithi142.stdout:3/725: write d6/d15/d30/d37/d6c/dcd/d99/fce [390371,98164] 0 2024-04-20T21:58:39.028 INFO:tasks.workunit.client.0.smithi142.stdout:3/726: chown d6/d32/de9 18 1 2024-04-20T21:58:39.041 INFO:tasks.workunit.client.0.smithi142.stdout:3/727: dread d6/d15/d30/d37/fe3 [4194304,4194304] 0 2024-04-20T21:58:39.045 INFO:tasks.workunit.client.0.smithi142.stdout:7/772: truncate d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/f23 4186641 0 2024-04-20T21:58:39.049 INFO:tasks.workunit.client.0.smithi142.stdout:7/773: creat d4/d7f/d77/d78/da8/dae/dd8/f115 x:0 0 0 2024-04-20T21:58:39.054 INFO:tasks.workunit.client.0.smithi142.stdout:7/774: dread d4/d7f/d77/d78/da8/dae/fa5 [0,4194304] 0 2024-04-20T21:58:39.062 INFO:tasks.workunit.client.0.smithi142.stdout:7/775: rmdir d4/d7f/d77/d7e 39 2024-04-20T21:58:39.062 INFO:tasks.workunit.client.0.smithi142.stdout:3/728: dwrite d6/d15/d30/d37/d6c/dcd/d99/fea [0,4194304] 0 2024-04-20T21:58:39.067 INFO:tasks.workunit.client.0.smithi142.stdout:3/729: unlink d6/d15/d30/d37/d75/f8a 0 2024-04-20T21:58:39.071 INFO:tasks.workunit.client.0.smithi142.stdout:3/730: read d6/d15/d1e/d43/d4d/d59/db6/fc1 [1868327,31793] 0 2024-04-20T21:58:39.080 INFO:tasks.workunit.client.0.smithi142.stdout:3/731: mkdir d6/d102 0 2024-04-20T21:58:39.091 INFO:tasks.workunit.client.0.smithi142.stdout:3/732: dread d6/d15/d1e/d43/d4d/f6d [0,4194304] 0 2024-04-20T21:58:39.096 INFO:tasks.workunit.client.0.smithi142.stdout:3/733: creat d6/d15/d47/f103 x:0 0 0 2024-04-20T21:58:39.099 INFO:tasks.workunit.client.0.smithi142.stdout:3/734: creat d6/d15/d47/f104 x:0 0 0 2024-04-20T21:58:39.106 INFO:tasks.workunit.client.0.smithi142.stdout:7/776: truncate d4/d7f/d77/d7e/f87 446442 0 2024-04-20T21:58:39.132 INFO:tasks.workunit.client.0.smithi142.stdout:3/735: dwrite d6/f2e [0,4194304] 0 2024-04-20T21:58:39.134 INFO:tasks.workunit.client.0.smithi142.stdout:3/736: write d6/f25 [339013,100057] 0 2024-04-20T21:58:39.140 INFO:tasks.workunit.client.0.smithi142.stdout:3/737: symlink d6/d15/d1e/d43/d4d/d59/de8/l105 0 2024-04-20T21:58:39.142 INFO:tasks.workunit.client.0.smithi142.stdout:6/639: sync 2024-04-20T21:58:39.142 INFO:tasks.workunit.client.0.smithi142.stdout:4/613: sync 2024-04-20T21:58:39.142 INFO:tasks.workunit.client.0.smithi142.stdout:3/738: readlink d6/d15/d30/d37/d75/lb3 0 2024-04-20T21:58:39.143 INFO:tasks.workunit.client.0.smithi142.stdout:2/784: sync 2024-04-20T21:58:39.143 INFO:tasks.workunit.client.0.smithi142.stdout:9/679: sync 2024-04-20T21:58:39.143 INFO:tasks.workunit.client.0.smithi142.stdout:1/626: sync 2024-04-20T21:58:39.147 INFO:tasks.workunit.client.0.smithi142.stdout:1/627: chown d2/dd/d17/d3b/f95 5010 1 2024-04-20T21:58:39.149 INFO:tasks.workunit.client.0.smithi142.stdout:9/680: mkdir d0/d89/d95/de4 0 2024-04-20T21:58:39.150 INFO:tasks.workunit.client.0.smithi142.stdout:1/628: stat d2/dd/d17/d3b/d50/f5e 0 2024-04-20T21:58:39.152 INFO:tasks.workunit.client.0.smithi142.stdout:3/739: creat d6/d32/d39/d69/d91/f106 x:0 0 0 2024-04-20T21:58:39.154 INFO:tasks.workunit.client.0.smithi142.stdout:6/640: creat d1/d2f/d35/d5b/d3e/de0/d7e/fe3 x:0 0 0 2024-04-20T21:58:39.156 INFO:tasks.workunit.client.0.smithi142.stdout:6/641: write d1/d75/fb1 [354908,53198] 0 2024-04-20T21:58:39.158 INFO:tasks.workunit.client.0.smithi142.stdout:4/614: mkdir d1/d12/da/d1c/d32/d3d/dbb 0 2024-04-20T21:58:39.158 INFO:tasks.workunit.client.0.smithi142.stdout:2/785: symlink d3/d5/d67/db7/df9/l107 0 2024-04-20T21:58:39.161 INFO:tasks.workunit.client.0.smithi142.stdout:9/681: chown d0/d36/lc9 0 1 2024-04-20T21:58:39.163 INFO:tasks.workunit.client.0.smithi142.stdout:3/740: chown d6/cd2 398621 1 2024-04-20T21:58:39.165 INFO:tasks.workunit.client.0.smithi142.stdout:2/786: unlink d3/d9/fe8 0 2024-04-20T21:58:39.171 INFO:tasks.workunit.client.0.smithi142.stdout:3/741: rmdir d6/d15/d30/d37/d75/dbc 39 2024-04-20T21:58:39.172 INFO:tasks.workunit.client.0.smithi142.stdout:2/787: mkdir d3/d5/d74/d108 0 2024-04-20T21:58:39.178 INFO:tasks.workunit.client.0.smithi142.stdout:2/788: unlink d3/d9/d89/d31/f6a 0 2024-04-20T21:58:39.180 INFO:tasks.workunit.client.0.smithi142.stdout:4/615: write d1/d12/da/d1c/d32/d3d/d2f/d52/d94/faf [1401554,101686] 0 2024-04-20T21:58:39.182 INFO:tasks.workunit.client.0.smithi142.stdout:1/629: write d2/dd/d17/d1b/f71 [134054,112133] 0 2024-04-20T21:58:39.185 INFO:tasks.workunit.client.0.smithi142.stdout:4/616: readlink d1/d12/da/d1c/l45 0 2024-04-20T21:58:39.185 INFO:tasks.workunit.client.0.smithi142.stdout:2/789: rename d3/d9/d89/d9a/ff7 to d3/d5/d67/dc4/d6c/f109 0 2024-04-20T21:58:39.190 INFO:tasks.workunit.client.0.smithi142.stdout:4/617: write d1/d6/d4a/d5a/f56 [2777213,10668] 0 2024-04-20T21:58:39.197 INFO:tasks.workunit.client.0.smithi142.stdout:3/742: dwrite d6/d15/d30/d37/d6c/f7c [0,4194304] 0 2024-04-20T21:58:39.197 INFO:tasks.workunit.client.0.smithi142.stdout:2/790: dread d3/d9/d34/fa1 [0,4194304] 0 2024-04-20T21:58:39.202 INFO:tasks.workunit.client.0.smithi142.stdout:9/682: dread d0/f9 [0,4194304] 0 2024-04-20T21:58:39.204 INFO:tasks.workunit.client.0.smithi142.stdout:9/683: stat d0/d2a/d39/d50/f68 0 2024-04-20T21:58:39.207 INFO:tasks.workunit.client.0.smithi142.stdout:3/743: creat d6/d15/d1e/d43/d4d/d59/df6/f107 x:0 0 0 2024-04-20T21:58:39.209 INFO:tasks.workunit.client.0.smithi142.stdout:1/630: dwrite d2/dd/d17/d1b/d22/d20/f4c [0,4194304] 0 2024-04-20T21:58:39.209 INFO:tasks.workunit.client.0.smithi142.stdout:9/684: stat d0/c1f 0 2024-04-20T21:58:39.209 INFO:tasks.workunit.client.0.smithi142.stdout:3/744: readlink d6/d15/d47/l48 0 2024-04-20T21:58:39.213 INFO:tasks.workunit.client.0.smithi142.stdout:2/791: rename d3/d9/d69/d104/f30 to d3/d9/d89/f10a 0 2024-04-20T21:58:39.217 INFO:tasks.workunit.client.0.smithi142.stdout:2/792: stat d3/d9/d89/d31/da2/ffe 0 2024-04-20T21:58:39.219 INFO:tasks.workunit.client.0.smithi142.stdout:1/631: creat d2/d4e/fd3 x:0 0 0 2024-04-20T21:58:39.220 INFO:tasks.workunit.client.0.smithi142.stdout:9/685: mkdir d0/d2a/d39/d50/de5 0 2024-04-20T21:58:39.220 INFO:tasks.workunit.client.0.smithi142.stdout:2/793: rmdir d3/d9/d89/d31/de1 39 2024-04-20T21:58:39.221 INFO:tasks.workunit.client.0.smithi142.stdout:4/618: dwrite d1/d6/d4a/d5a/f99 [0,4194304] 0 2024-04-20T21:58:39.223 INFO:tasks.workunit.client.0.smithi142.stdout:1/632: write d2/dd/d1c/d60/fa2 [572541,14892] 0 2024-04-20T21:58:39.224 INFO:tasks.workunit.client.0.smithi142.stdout:2/794: dread - d3/d5/d67/dc4/d6c/f109 zero size 2024-04-20T21:58:39.225 INFO:tasks.workunit.client.0.smithi142.stdout:3/745: link d6/d15/d1e/d43/d4d/fcc d6/d15/d47/d83/dc9/da7/f108 0 2024-04-20T21:58:39.226 INFO:tasks.workunit.client.0.smithi142.stdout:1/633: chown d2/dd/d17/c23 836045 1 2024-04-20T21:58:39.228 INFO:tasks.workunit.client.0.smithi142.stdout:4/619: creat d1/d12/da/d1c/d32/d3d/d2f/d52/d94/fbc x:0 0 0 2024-04-20T21:58:39.233 INFO:tasks.workunit.client.0.smithi142.stdout:2/795: creat d3/d9/d89/d31/da2/ddb/de0/f10b x:0 0 0 2024-04-20T21:58:39.233 INFO:tasks.workunit.client.0.smithi142.stdout:4/620: creat d1/d12/da/d1c/da9/fbd x:0 0 0 2024-04-20T21:58:39.238 INFO:tasks.workunit.client.0.smithi142.stdout:1/634: rename d2/dd/d1c/f3f to d2/dd/d17/d3b/d74/fd4 0 2024-04-20T21:58:39.241 INFO:tasks.workunit.client.0.smithi142.stdout:9/686: dwrite d0/d89/fc5 [0,4194304] 0 2024-04-20T21:58:39.243 INFO:tasks.workunit.client.0.smithi142.stdout:1/635: dread - d2/dd/d17/d1b/d22/d55/f90 zero size 2024-04-20T21:58:39.284 INFO:tasks.workunit.client.0.smithi142.stdout:4/621: dread d1/d12/da/d1c/d32/d3d/d2f/d49/f62 [0,4194304] 0 2024-04-20T21:58:39.285 INFO:tasks.workunit.client.0.smithi142.stdout:3/746: truncate d6/d15/d30/d37/d75/fb5 2994257 0 2024-04-20T21:58:39.285 INFO:tasks.workunit.client.0.smithi142.stdout:3/747: chown d6/d15/da4 101538653 1 2024-04-20T21:58:39.296 INFO:tasks.workunit.client.0.smithi142.stdout:9/687: dwrite d0/d2a/d39/d50/f5b [0,4194304] 0 2024-04-20T21:58:39.312 INFO:tasks.workunit.client.0.smithi142.stdout:1/636: rename d2/dd/d17/d1b/fc5 to d2/dd/d17/d3b/d74/fd5 0 2024-04-20T21:58:39.312 INFO:tasks.workunit.client.0.smithi142.stdout:3/748: symlink d6/d15/d30/db4/l109 0 2024-04-20T21:58:39.314 INFO:tasks.workunit.client.0.smithi142.stdout:9/688: creat d0/d2a/d39/d50/fe6 x:0 0 0 2024-04-20T21:58:39.315 INFO:tasks.workunit.client.0.smithi142.stdout:1/637: fdatasync d2/dd/d17/d1b/f3c 0 2024-04-20T21:58:39.317 INFO:tasks.workunit.client.0.smithi142.stdout:1/638: fdatasync d2/dd/d17/d1b/f3c 0 2024-04-20T21:58:39.317 INFO:tasks.workunit.client.0.smithi142.stdout:3/749: unlink d6/d32/d39/cb8 0 2024-04-20T21:58:39.328 INFO:tasks.workunit.client.0.smithi142.stdout:1/639: dread d2/dd/d1c/d60/dce/f76 [0,4194304] 0 2024-04-20T21:58:39.330 INFO:tasks.workunit.client.0.smithi142.stdout:3/750: creat d6/d15/d1e/d43/f10a x:0 0 0 2024-04-20T21:58:39.335 INFO:tasks.workunit.client.0.smithi142.stdout:3/751: mkdir d6/d15/d30/d37/d6c/d7e/d10b 0 2024-04-20T21:58:39.336 INFO:tasks.workunit.client.0.smithi142.stdout:1/640: truncate d2/dd/d17/d1b/d22/d20/f7b 308115 0 2024-04-20T21:58:39.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.349+0000 7ff353c00700 1 -- 172.21.15.142:0/4179632641 --> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff32c000bf0 con 0x7ff33406ea70 2024-04-20T21:58:39.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.353+0000 7ff349600700 1 -- 172.21.15.142:0/4179632641 <== mgr.24359 v2:172.21.15.164:6828/929524464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7ff32c000bf0 con 0x7ff33406ea70 2024-04-20T21:58:39.352 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T21:58:39.352 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T21:58:39.353 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T21:58:39.353 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T21:58:39.353 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T21:58:39.353 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr" 2024-04-20T21:58:39.353 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T21:58:39.353 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "2/23 daemons upgraded", 2024-04-20T21:58:39.353 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading mgr daemons", 2024-04-20T21:58:39.353 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T21:58:39.353 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T21:58:39.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.356+0000 7ff353c00700 1 -- 172.21.15.142:0/4179632641 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7ff33406ea70 msgr2=0x7ff334070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:39.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.356+0000 7ff353c00700 1 --2- 172.21.15.142:0/4179632641 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7ff33406ea70 0x7ff334070f30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff34000b5c0 tx=0x7ff340005160 comp rx=0 tx=0).stop 2024-04-20T21:58:39.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.356+0000 7ff353c00700 1 -- 172.21.15.142:0/4179632641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff34c074f10 msgr2=0x7ff34c19d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:39.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.356+0000 7ff353c00700 1 --2- 172.21.15.142:0/4179632641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff34c074f10 0x7ff34c19d1e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff33800d900 tx=0x7ff33800dcc0 comp rx=0 tx=0).stop 2024-04-20T21:58:39.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.356+0000 7ff353c00700 1 -- 172.21.15.142:0/4179632641 shutdown_connections 2024-04-20T21:58:39.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.356+0000 7ff353c00700 1 --2- 172.21.15.142:0/4179632641 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7ff33406ea70 0x7ff334070f30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:39.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.356+0000 7ff353c00700 1 --2- 172.21.15.142:0/4179632641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff34c073940 0x7ff34c19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:39.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.356+0000 7ff353c00700 1 --2- 172.21.15.142:0/4179632641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff34c074f10 0x7ff34c19d1e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:39.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.356+0000 7ff353c00700 1 -- 172.21.15.142:0/4179632641 >> 172.21.15.142:0/4179632641 conn(0x7ff34c0fc1c0 msgr2=0x7ff34c1029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:39.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.357+0000 7ff353c00700 1 -- 172.21.15.142:0/4179632641 shutdown_connections 2024-04-20T21:58:39.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.357+0000 7ff353c00700 1 -- 172.21.15.142:0/4179632641 wait complete. 2024-04-20T21:58:39.360 INFO:tasks.workunit.client.0.smithi142.stdout:9/689: write d0/d3c/d4d/f9b [1367790,85228] 0 2024-04-20T21:58:39.365 INFO:tasks.workunit.client.0.smithi142.stdout:1/641: dread d2/f45 [0,4194304] 0 2024-04-20T21:58:39.370 INFO:tasks.workunit.client.0.smithi142.stdout:9/690: link d0/fe d0/d2a/d39/d87/d9e/fe7 0 2024-04-20T21:58:39.371 INFO:tasks.workunit.client.0.smithi142.stdout:9/691: fdatasync d0/fb0 0 2024-04-20T21:58:39.373 INFO:tasks.workunit.client.0.smithi142.stdout:3/752: dwrite d6/f3a [0,4194304] 0 2024-04-20T21:58:39.374 INFO:tasks.workunit.client.0.smithi142.stdout:8/713: sync 2024-04-20T21:58:39.374 INFO:tasks.workunit.client.0.smithi142.stdout:0/659: sync 2024-04-20T21:58:39.374 INFO:tasks.workunit.client.0.smithi142.stdout:5/627: sync 2024-04-20T21:58:39.374 INFO:tasks.workunit.client.0.smithi142.stdout:1/642: mknod d2/dd/d17/d1b/d22/d13/cd6 0 2024-04-20T21:58:39.377 INFO:tasks.workunit.client.0.smithi142.stdout:8/714: readlink d0/d1c/d44/d89/l7d 0 2024-04-20T21:58:39.382 INFO:tasks.workunit.client.0.smithi142.stdout:1/643: write d2/dd/d17/d3b/f78 [2694261,82512] 0 2024-04-20T21:58:39.383 INFO:tasks.workunit.client.0.smithi142.stdout:5/628: truncate dc/d14/d72/fbf 106639 0 2024-04-20T21:58:39.388 INFO:tasks.workunit.client.0.smithi142.stdout:9/692: truncate d0/f31 4280913 0 2024-04-20T21:58:39.389 INFO:tasks.workunit.client.0.smithi142.stdout:8/715: creat d0/d17/d35/db5/ff8 x:0 0 0 2024-04-20T21:58:39.396 INFO:tasks.workunit.client.0.smithi142.stdout:5/629: creat dc/d14/d26/d3f/db3/fda x:0 0 0 2024-04-20T21:58:39.396 INFO:tasks.workunit.client.0.smithi142.stdout:8/716: write d0/f26 [5073500,128108] 0 2024-04-20T21:58:39.400 INFO:tasks.workunit.client.0.smithi142.stdout:3/753: dwrite d6/d15/d30/f44 [0,4194304] 0 2024-04-20T21:58:39.409 INFO:tasks.workunit.client.0.smithi142.stdout:9/693: link d0/d36/f7a d0/d3c/d4d/d63/d80/fe8 0 2024-04-20T21:58:39.412 INFO:tasks.workunit.client.0.smithi142.stdout:5/630: symlink dc/d14/d21/d46/ldb 0 2024-04-20T21:58:39.413 INFO:tasks.workunit.client.0.smithi142.stdout:1/644: getdents d2/d4e/d7e/dbf 0 2024-04-20T21:58:39.415 INFO:tasks.workunit.client.0.smithi142.stdout:3/754: mknod d6/d15/d30/d37/d6c/dcd/c10c 0 2024-04-20T21:58:39.418 INFO:tasks.workunit.client.0.smithi142.stdout:8/717: mkdir d0/d1c/df9 0 2024-04-20T21:58:39.418 INFO:tasks.workunit.client.0.smithi142.stdout:9/694: rmdir d0/d3c 39 2024-04-20T21:58:39.422 INFO:tasks.workunit.client.0.smithi142.stdout:1/645: creat d2/d4e/d7e/fd7 x:0 0 0 2024-04-20T21:58:39.422 INFO:tasks.workunit.client.0.smithi142.stdout:5/631: creat dc/d14/d21/d46/fdc x:0 0 0 2024-04-20T21:58:39.428 INFO:tasks.workunit.client.0.smithi142.stdout:8/718: rmdir d0/d1c/d44/d89/d45/d92 39 2024-04-20T21:58:39.431 INFO:tasks.workunit.client.0.smithi142.stdout:3/755: dread d6/d15/d47/d83/dc9/da7/f108 [0,4194304] 0 2024-04-20T21:58:39.432 INFO:tasks.workunit.client.0.smithi142.stdout:5/632: creat dc/d14/d21/d46/d2a/d3c/fdd x:0 0 0 2024-04-20T21:58:39.433 INFO:tasks.workunit.client.0.smithi142.stdout:0/660: dwrite d5/d1c/d3c/d85/f4f [0,4194304] 0 2024-04-20T21:58:39.434 INFO:tasks.workunit.client.0.smithi142.stdout:5/633: dread - dc/fd3 zero size 2024-04-20T21:58:39.437 INFO:tasks.workunit.client.0.smithi142.stdout:8/719: truncate d0/d1c/fa0 615243 0 2024-04-20T21:58:39.439 INFO:tasks.workunit.client.0.smithi142.stdout:8/720: dread - d0/f7b zero size 2024-04-20T21:58:39.448 INFO:tasks.workunit.client.0.smithi142.stdout:3/756: mkdir d6/d32/de7/d10d 0 2024-04-20T21:58:39.449 INFO:tasks.workunit.client.0.smithi142.stdout:5/634: symlink dc/d14/d21/d46/d2a/d65/lde 0 2024-04-20T21:58:39.457 INFO:tasks.workunit.client.0.smithi142.stdout:0/661: creat d5/d13/d1e/d23/d24/fd5 x:0 0 0 2024-04-20T21:58:39.472 INFO:tasks.workunit.client.0.smithi142.stdout:5/635: dread dc/f10 [0,4194304] 0 2024-04-20T21:58:39.472 INFO:tasks.workunit.client.0.smithi142.stdout:3/757: getdents d6/d15/d30/d37/d6c 0 2024-04-20T21:58:39.473 INFO:tasks.workunit.client.0.smithi142.stdout:0/662: truncate d5/d1c/d3c/f73 1153958 0 2024-04-20T21:58:39.489 INFO:tasks.workunit.client.0.smithi142.stdout:8/721: dwrite d0/d1c/fa0 [0,4194304] 0 2024-04-20T21:58:39.489 INFO:tasks.workunit.client.0.smithi142.stdout:9/695: dwrite d0/f31 [4194304,4194304] 0 2024-04-20T21:58:39.490 INFO:tasks.workunit.client.0.smithi142.stdout:0/663: rmdir d5/d1c/d3c/d4a/d78 39 2024-04-20T21:58:39.492 INFO:tasks.workunit.client.0.smithi142.stdout:1/646: dwrite d2/dd/d1c/d88/d89/f97 [0,4194304] 0 2024-04-20T21:58:39.492 INFO:tasks.workunit.client.0.smithi142.stdout:3/758: mkdir d6/d15/d10e 0 2024-04-20T21:58:39.498 INFO:tasks.workunit.client.0.smithi142.stdout:1/647: write d2/dd/d17/d1b/d22/d55/f90 [425498,112358] 0 2024-04-20T21:58:39.500 INFO:tasks.workunit.client.0.smithi142.stdout:9/696: chown d0/f86 102657 1 2024-04-20T21:58:39.507 INFO:tasks.workunit.client.0.smithi142.stdout:7/777: sync 2024-04-20T21:58:39.507 INFO:tasks.workunit.client.0.smithi142.stdout:0/664: creat d5/d13/d1e/d23/d24/d48/d55/fd6 x:0 0 0 2024-04-20T21:58:39.513 INFO:tasks.workunit.client.0.smithi142.stdout:0/665: write d5/d1c/d3c/d85/d38/f42 [2378745,15713] 0 2024-04-20T21:58:39.517 INFO:tasks.workunit.client.0.smithi142.stdout:5/636: mkdir dc/d14/d21/d46/dc1/dd4/ddf 0 2024-04-20T21:58:39.518 INFO:tasks.workunit.client.0.smithi142.stdout:0/666: read - d5/d13/d1e/d23/d24/d48/d55/fd6 zero size 2024-04-20T21:58:39.525 INFO:tasks.workunit.client.0.smithi142.stdout:1/648: dwrite d2/d4e/f64 [0,4194304] 0 2024-04-20T21:58:39.529 INFO:tasks.workunit.client.0.smithi142.stdout:7/778: unlink d4/d7f/d77/d78/da8/dae/c7b 0 2024-04-20T21:58:39.535 INFO:tasks.workunit.client.0.smithi142.stdout:7/779: dread - d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d11/f9c zero size 2024-04-20T21:58:39.536 INFO:tasks.workunit.client.0.smithi142.stdout:3/759: mkdir d6/d15/d47/d83/dc9/d10f 0 2024-04-20T21:58:39.538 INFO:tasks.workunit.client.0.smithi142.stdout:9/697: truncate d0/d2a/d39/d87/f8d 150423 0 2024-04-20T21:58:39.546 INFO:tasks.workunit.client.0.smithi142.stdout:1/649: dread d2/f6 [0,4194304] 0 2024-04-20T21:58:39.553 INFO:tasks.workunit.client.0.smithi142.stdout:5/637: dread dc/d71/f6e [0,4194304] 0 2024-04-20T21:58:39.562 INFO:tasks.workunit.client.0.smithi142.stdout:3/760: symlink d6/d15/d1e/d43/d4d/d59/de8/l110 0 2024-04-20T21:58:39.564 INFO:tasks.workunit.client.0.smithi142.stdout:1/650: creat d2/dd/d17/d1b/d22/d55/fd8 x:0 0 0 2024-04-20T21:58:39.566 INFO:tasks.workunit.client.0.smithi142.stdout:8/722: truncate d0/d29/f4a 5446456 0 2024-04-20T21:58:39.567 INFO:tasks.workunit.client.0.smithi142.stdout:7/780: mkdir d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d11/d116 0 2024-04-20T21:58:39.570 INFO:tasks.workunit.client.0.smithi142.stdout:5/638: creat dc/d14/d25/db4/fe0 x:0 0 0 2024-04-20T21:58:39.573 INFO:tasks.workunit.client.0.smithi142.stdout:7/781: chown d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e/l5b 51 1 2024-04-20T21:58:39.574 INFO:tasks.workunit.client.0.smithi142.stdout:1/651: readlink d2/dd/d17/d3b/d50/lcd 0 2024-04-20T21:58:39.578 INFO:tasks.workunit.client.0.smithi142.stdout:6/642: sync 2024-04-20T21:58:39.579 INFO:tasks.workunit.client.0.smithi142.stdout:1/652: write d2/dd/d17/d3b/d50/f5e [950853,2673] 0 2024-04-20T21:58:39.579 INFO:tasks.workunit.client.0.smithi142.stdout:4/622: sync 2024-04-20T21:58:39.579 INFO:tasks.workunit.client.0.smithi142.stdout:2/796: sync 2024-04-20T21:58:39.581 INFO:tasks.workunit.client.0.smithi142.stdout:5/639: rename f9 to dc/d14/d21/d46/d7d/fe1 0 2024-04-20T21:58:39.583 INFO:tasks.workunit.client.0.smithi142.stdout:2/797: readlink d3/d9/d69/d104/d94/lb4 0 2024-04-20T21:58:39.584 INFO:tasks.workunit.client.0.smithi142.stdout:7/782: dread d4/d7f/d77/d78/d9b/ffe [0,4194304] 0 2024-04-20T21:58:39.600 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:39 smithi142 ceph-mon[15828]: pgmap v41: 65 pgs: 65 active+clean; 1.4 GiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 64 MiB/s rd, 168 MiB/s wr, 447 op/s 2024-04-20T21:58:39.600 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:39 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/885847200' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:58:39.600 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:39 smithi142 ceph-mon[15828]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:58:39.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.598+0000 7f49d3e00700 1 -- 172.21.15.142:0/1738892973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49cc100c20 msgr2=0x7f49cc101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:39.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.598+0000 7f49d3e00700 1 --2- 172.21.15.142:0/1738892973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49cc100c20 0x7f49cc101040 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f49c400b0a0 tx=0x7f49c400b3b0 comp rx=0 tx=0).stop 2024-04-20T21:58:39.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.599+0000 7f49d3e00700 1 -- 172.21.15.142:0/1738892973 shutdown_connections 2024-04-20T21:58:39.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.599+0000 7f49d3e00700 1 --2- 172.21.15.142:0/1738892973 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49cc101e20 0x7f49cc102280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:39.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.599+0000 7f49d3e00700 1 --2- 172.21.15.142:0/1738892973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49cc100c20 0x7f49cc101040 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:39.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.599+0000 7f49d3e00700 1 -- 172.21.15.142:0/1738892973 >> 172.21.15.142:0/1738892973 conn(0x7f49cc0fc1e0 msgr2=0x7f49cc0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:39.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.599+0000 7f49d3e00700 1 -- 172.21.15.142:0/1738892973 shutdown_connections 2024-04-20T21:58:39.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.599+0000 7f49d3e00700 1 -- 172.21.15.142:0/1738892973 wait complete. 2024-04-20T21:58:39.601 INFO:tasks.workunit.client.0.smithi142.stdout:0/667: dwrite d5/d1c/d3c/d85/d63/f82 [4194304,4194304] 0 2024-04-20T21:58:39.601 INFO:tasks.workunit.client.0.smithi142.stdout:9/698: dwrite d0/d36/f53 [0,4194304] 0 2024-04-20T21:58:39.601 INFO:tasks.workunit.client.0.smithi142.stdout:5/640: mkdir dc/d14/d26/de2 0 2024-04-20T21:58:39.601 INFO:tasks.workunit.client.0.smithi142.stdout:4/623: creat d1/d12/da/d1c/d32/d3d/d2f/d73/fbe x:0 0 0 2024-04-20T21:58:39.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.601+0000 7f49d3e00700 1 Processor -- start 2024-04-20T21:58:39.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.602+0000 7f49d3e00700 1 -- start start 2024-04-20T21:58:39.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.603+0000 7f49d3e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49cc100c20 0x7f49cc19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:39.608 INFO:tasks.workunit.client.0.smithi142.stdout:1/653: dread d2/dd/d1c/f69 [0,4194304] 0 2024-04-20T21:58:39.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.603+0000 7f49d3e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49cc101e20 0x7f49cc19d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:39.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.603+0000 7f49d3e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc19d820 con 0x7f49cc101e20 2024-04-20T21:58:39.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.603+0000 7f49d3e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc1a2190 con 0x7f49cc100c20 2024-04-20T21:58:39.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.603+0000 7f49d0a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49cc101e20 0x7f49cc19d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:39.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.603+0000 7f49d0a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49cc101e20 0x7f49cc19d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46500/0 (socket says 172.21.15.142:46500) 2024-04-20T21:58:39.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.603+0000 7f49d0a00700 1 -- 172.21.15.142:0/1797673520 learned_addr learned my addr 172.21.15.142:0/1797673520 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:58:39.609 INFO:tasks.workunit.client.0.smithi142.stdout:6/643: dwrite d1/d9e/fde [0,4194304] 0 2024-04-20T21:58:39.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.604+0000 7f49d1400700 1 --2- 172.21.15.142:0/1797673520 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49cc100c20 0x7f49cc19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:39.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.604+0000 7f49d0a00700 1 -- 172.21.15.142:0/1797673520 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49cc100c20 msgr2=0x7f49cc19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:39.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.604+0000 7f49d0a00700 1 --2- 172.21.15.142:0/1797673520 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49cc100c20 0x7f49cc19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:39.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.604+0000 7f49d0a00700 1 -- 172.21.15.142:0/1797673520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c4009d00 con 0x7f49cc101e20 2024-04-20T21:58:39.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.605+0000 7f49d0a00700 1 --2- 172.21.15.142:0/1797673520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49cc101e20 0x7f49cc19d200 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f49b800e920 tx=0x7f49b800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:39.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.606+0000 7f49ca000700 1 -- 172.21.15.142:0/1797673520 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b800c9d0 con 0x7f49cc101e20 2024-04-20T21:58:39.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.606+0000 7f49ca000700 1 -- 172.21.15.142:0/1797673520 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49b8021440 con 0x7f49cc101e20 2024-04-20T21:58:39.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.606+0000 7f49ca000700 1 -- 172.21.15.142:0/1797673520 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b8029630 con 0x7f49cc101e20 2024-04-20T21:58:39.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.606+0000 7f49d3e00700 1 -- 172.21.15.142:0/1797673520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49cc06a960 con 0x7f49cc101e20 2024-04-20T21:58:39.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.607+0000 7f49d3e00700 1 -- 172.21.15.142:0/1797673520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49cc06af00 con 0x7f49cc101e20 2024-04-20T21:58:39.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.611+0000 7f49d3e00700 1 -- 172.21.15.142:0/1797673520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49cc062510 con 0x7f49cc101e20 2024-04-20T21:58:39.612 INFO:tasks.workunit.client.0.smithi142.stdout:1/654: write d2/d4e/d7e/fbd [262614,36392] 0 2024-04-20T21:58:39.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.614+0000 7f49ca000700 1 -- 172.21.15.142:0/1797673520 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 25) v1 ==== 92710+0+0 (secure 0 0 0) 0x7f49b80215b0 con 0x7f49cc101e20 2024-04-20T21:58:39.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.616+0000 7f49ca000700 1 --2- 172.21.15.142:0/1797673520 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f49b406eab0 0x7f49b4070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:58:39.616 INFO:tasks.workunit.client.0.smithi142.stdout:1/655: chown d2/dd/d1c 2585610 1 2024-04-20T21:58:39.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.616+0000 7f49ca000700 1 -- 172.21.15.142:0/1797673520 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5726+0+0 (secure 0 0 0) 0x7f49b8025070 con 0x7f49cc101e20 2024-04-20T21:58:39.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.617+0000 7f49d1400700 1 --2- 172.21.15.142:0/1797673520 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f49b406eab0 0x7f49b4070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:58:39.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.618+0000 7f49d1400700 1 --2- 172.21.15.142:0/1797673520 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f49b406eab0 0x7f49b4070f70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f49c4006070 tx=0x7f49c4006000 comp rx=0 tx=0).ready entity=mgr.24359 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:58:39.618 INFO:tasks.workunit.client.0.smithi142.stdout:2/798: creat d3/d9/d89/d31/da2/ddb/f10c x:0 0 0 2024-04-20T21:58:39.625 INFO:tasks.workunit.client.0.smithi142.stdout:3/761: getdents d6/d15/d47/d83/dc9 0 2024-04-20T21:58:39.632 INFO:tasks.workunit.client.0.smithi142.stdout:0/668: creat d5/d6d/fd7 x:0 0 0 2024-04-20T21:58:39.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:39.636+0000 7f49ca000700 1 -- 172.21.15.142:0/1797673520 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f49b8069310 con 0x7f49cc101e20 2024-04-20T21:58:39.642 INFO:tasks.workunit.client.0.smithi142.stdout:8/723: dwrite d0/d29/f3d [0,4194304] 0 2024-04-20T21:58:39.647 INFO:tasks.workunit.client.0.smithi142.stdout:4/624: fdatasync d1/d12/da/d1c/d32/f60 0 2024-04-20T21:58:39.648 INFO:tasks.workunit.client.0.smithi142.stdout:4/625: write d1/d12/da/d1c/d32/f43 [7949535,58902] 0 2024-04-20T21:58:39.650 INFO:tasks.workunit.client.0.smithi142.stdout:5/641: creat dc/d14/d26/d3f/d53/d7c/d97/fe3 x:0 0 0 2024-04-20T21:58:39.653 INFO:tasks.workunit.client.0.smithi142.stdout:5/642: read - dc/d14/d21/d46/d2a/f74 zero size 2024-04-20T21:58:39.655 INFO:tasks.workunit.client.0.smithi142.stdout:6/644: creat d1/d2f/d35/d48/fe4 x:0 0 0 2024-04-20T21:58:39.657 INFO:tasks.workunit.client.0.smithi142.stdout:1/656: rename d2/l7a to d2/dd/d17/d1b/d22/d55/ld9 0 2024-04-20T21:58:39.660 INFO:tasks.workunit.client.0.smithi142.stdout:1/657: truncate d2/d4e/fc8 35222 0 2024-04-20T21:58:39.661 INFO:tasks.workunit.client.0.smithi142.stdout:0/669: rmdir d5/d1c/d3c/d85 39 2024-04-20T21:58:39.663 INFO:tasks.workunit.client.0.smithi142.stdout:0/670: dread - d5/d1d/fd4 zero size 2024-04-20T21:58:39.668 INFO:tasks.workunit.client.0.smithi142.stdout:9/699: creat d0/d91/db4/fe9 x:0 0 0 2024-04-20T21:58:39.669 INFO:tasks.workunit.client.0.smithi142.stdout:8/724: read d0/d5e/f81 [359670,96907] 0 2024-04-20T21:58:39.675 INFO:tasks.workunit.client.0.smithi142.stdout:3/762: rename d6/d15/d30/d37/d6c/dcd/d99/fea to d6/d32/d39/d69/de0/f111 0 2024-04-20T21:58:39.676 INFO:tasks.workunit.client.0.smithi142.stdout:8/725: truncate d0/d1c/d44/dad/db3/d3f/d7f/fc3 5190726 0 2024-04-20T21:58:39.686 INFO:tasks.workunit.client.0.smithi142.stdout:6/645: dread d1/f8c [0,4194304] 0 2024-04-20T21:58:39.687 INFO:tasks.workunit.client.0.smithi142.stdout:6/646: write d1/d11/f44 [1736142,6669] 0 2024-04-20T21:58:39.734 INFO:tasks.workunit.client.0.smithi142.stdout:5/643: mknod dc/d14/ce4 0 2024-04-20T21:58:39.740 INFO:tasks.workunit.client.0.smithi142.stdout:4/626: rename d1/d12/da/d1c/d32/d3d/l1b to d1/d12/da/d1c/da9/dba/lbf 0 2024-04-20T21:58:39.742 INFO:tasks.workunit.client.0.smithi142.stdout:7/783: getdents d4/d7f/d77/d78/d9b/d5a/d90/df8 0 2024-04-20T21:58:39.745 INFO:tasks.workunit.client.0.smithi142.stdout:2/799: truncate d3/d9/da3/fa9 284340 0 2024-04-20T21:58:39.746 INFO:tasks.workunit.client.0.smithi142.stdout:6/647: mknod d1/d2f/d35/d5b/d3e/dc5/ce5 0 2024-04-20T21:58:39.748 INFO:tasks.workunit.client.0.smithi142.stdout:6/648: stat d1/dd1 0 2024-04-20T21:58:39.750 INFO:tasks.workunit.client.0.smithi142.stdout:5/644: mkdir dc/d14/d21/d7f/de5 0 2024-04-20T21:58:39.755 INFO:tasks.workunit.client.0.smithi142.stdout:1/658: rename d2/dd/d17/d3b/d74/d86 to d2/dd/d1c/d60/dda 0 2024-04-20T21:58:39.756 INFO:tasks.workunit.client.0.smithi142.stdout:2/800: dread d3/d9/d69/d104/d70/fc6 [0,4194304] 0 2024-04-20T21:58:39.759 INFO:tasks.workunit.client.0.smithi142.stdout:9/700: dwrite d0/d36/f4c [0,4194304] 0 2024-04-20T21:58:39.759 INFO:tasks.workunit.client.0.smithi142.stdout:1/659: chown d2/dd/d17/d1b/d22/d13/c9c 0 1 2024-04-20T21:58:39.760 INFO:tasks.workunit.client.0.smithi142.stdout:8/726: link d0/d17/d35/d9d/ff6 d0/d1c/d44/d89/ffa 0 2024-04-20T21:58:39.762 INFO:tasks.workunit.client.0.smithi142.stdout:6/649: unlink d1/d5/f38 0 2024-04-20T21:58:39.764 INFO:tasks.workunit.client.0.smithi142.stdout:7/784: write d4/d7d/fc7 [3789360,126808] 0 2024-04-20T21:58:39.764 INFO:tasks.workunit.client.0.smithi142.stdout:9/701: mknod d0/d91/da0/cea 0 2024-04-20T21:58:39.772 INFO:tasks.workunit.client.0.smithi142.stdout:2/801: unlink d3/d5/cc9 0 2024-04-20T21:58:39.772 INFO:tasks.workunit.client.0.smithi142.stdout:3/763: link d6/d32/f52 d6/d15/d30/d37/d6c/dcd/d99/f112 0 2024-04-20T21:58:39.775 INFO:tasks.workunit.client.0.smithi142.stdout:7/785: stat d4/d7f/d77/d78/d9b/lf7 0 2024-04-20T21:58:39.779 INFO:tasks.workunit.client.0.smithi142.stdout:8/727: truncate d0/d17/d35/d9d/ff6 409104 0 2024-04-20T21:58:39.779 INFO:tasks.workunit.client.0.smithi142.stdout:5/645: dwrite dc/d14/d72/fbf [0,4194304] 0 2024-04-20T21:58:39.786 INFO:tasks.workunit.client.0.smithi142.stdout:1/660: dread d2/dd/d1c/d60/fa2 [0,4194304] 0 2024-04-20T21:58:39.787 INFO:tasks.workunit.client.0.smithi142.stdout:5/646: chown dc/d14/d21/d46/d2a/d65/d79/da2/f77 35 1 2024-04-20T21:58:39.788 INFO:tasks.workunit.client.0.smithi142.stdout:6/650: getdents d1/d11/dbb 0 2024-04-20T21:58:39.788 INFO:tasks.workunit.client.0.smithi142.stdout:3/764: mkdir d6/d15/d1e/d43/d4d/d59/de8/d113 0 2024-04-20T21:58:39.796 INFO:tasks.workunit.client.0.smithi142.stdout:2/802: mkdir d3/d5/d67/dc4/d10d 0 2024-04-20T21:58:39.801 INFO:tasks.workunit.client.0.smithi142.stdout:7/786: creat d4/d7f/d77/d78/d9b/dc1/f117 x:0 0 0 2024-04-20T21:58:39.802 INFO:tasks.workunit.client.0.smithi142.stdout:9/702: creat d0/d89/d95/de4/feb x:0 0 0 2024-04-20T21:58:39.803 INFO:tasks.workunit.client.0.smithi142.stdout:1/661: creat d2/dd/d1c/d60/fdb x:0 0 0 2024-04-20T21:58:39.805 INFO:tasks.workunit.client.0.smithi142.stdout:6/651: mknod d1/d2f/d35/d5b/d3e/dc5/ce6 0 2024-04-20T21:58:39.806 INFO:tasks.workunit.client.0.smithi142.stdout:3/765: dread d6/d15/d1e/d43/d4d/f6d [0,4194304] 0 2024-04-20T21:58:39.813 INFO:tasks.workunit.client.0.smithi142.stdout:9/703: creat d0/d36/d55/fec x:0 0 0 2024-04-20T21:58:39.814 INFO:tasks.workunit.client.0.smithi142.stdout:1/662: fdatasync d2/dd/d17/d1b/f5b 0 2024-04-20T21:58:39.815 INFO:tasks.workunit.client.0.smithi142.stdout:6/652: stat d1/d2f/d35/d5b/d63/d34/l62 0 2024-04-20T21:58:39.818 INFO:tasks.workunit.client.0.smithi142.stdout:2/803: creat d3/d9/d89/f10e x:0 0 0 2024-04-20T21:58:39.820 INFO:tasks.workunit.client.0.smithi142.stdout:3/766: mkdir d6/d15/d47/d83/d114 0 2024-04-20T21:58:39.823 INFO:tasks.workunit.client.0.smithi142.stdout:8/728: dwrite d0/d17/d35/db5/ff8 [0,4194304] 0 2024-04-20T21:58:39.823 INFO:tasks.workunit.client.0.smithi142.stdout:2/804: fsync d3/d9/d34/fb9 0 2024-04-20T21:58:39.825 INFO:tasks.workunit.client.0.smithi142.stdout:4/627: dread d1/d12/da/d1c/d32/d3d/d2f/d49/f78 [0,4194304] 0 2024-04-20T21:58:39.825 INFO:tasks.workunit.client.0.smithi142.stdout:9/704: write d0/d3c/d4d/d63/d80/fdd [355677,73] 0 2024-04-20T21:58:39.826 INFO:tasks.workunit.client.0.smithi142.stdout:7/787: mkdir d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/dd5/d118 0 2024-04-20T21:58:39.830 INFO:tasks.workunit.client.0.smithi142.stdout:5/647: dread dc/d71/d5c/d68/f8c [0,4194304] 0 2024-04-20T21:58:39.830 INFO:tasks.workunit.client.0.smithi142.stdout:1/663: rename d2/dd/c10 to d2/d4e/d7e/cdc 0 2024-04-20T21:58:39.833 INFO:tasks.workunit.client.0.smithi142.stdout:4/628: write d1/ff [2096790,50979] 0 2024-04-20T21:58:39.835 INFO:tasks.workunit.client.0.smithi142.stdout:7/788: write d4/d7f/d77/d78/fe8 [427195,97925] 0 2024-04-20T21:58:39.837 INFO:tasks.workunit.client.0.smithi142.stdout:2/805: readlink d3/d9/d69/d104/d70/l93 0 2024-04-20T21:58:39.837 INFO:tasks.workunit.client.0.smithi142.stdout:3/767: chown d6/d32/d39/d69/de0/f100 1156483 1 2024-04-20T21:58:39.841 INFO:tasks.workunit.client.0.smithi142.stdout:3/768: fsync d6/d15/d1e/d43/d4d/d59/f62 0 2024-04-20T21:58:39.844 INFO:tasks.workunit.client.0.smithi142.stdout:4/629: truncate d1/d6/d4b/fb2 383856 0 2024-04-20T21:58:39.847 INFO:tasks.workunit.client.0.smithi142.stdout:9/705: stat d0/f8 0 2024-04-20T21:58:39.854 INFO:tasks.workunit.client.0.smithi142.stdout:1/664: unlink d2/d4e/c70 0 2024-04-20T21:58:39.857 INFO:tasks.workunit.client.0.smithi142.stdout:7/789: truncate d4/d7f/f91 2015253 0 2024-04-20T21:58:39.859 INFO:tasks.workunit.client.0.smithi142.stdout:2/806: write d3/d9/d69/d104/d70/d3c/fd4 [1014730,129268] 0 2024-04-20T21:58:39.860 INFO:tasks.workunit.client.0.smithi142.stdout:8/729: truncate d0/d1c/d44/dad/db3/fe0 760306 0 2024-04-20T21:58:39.862 INFO:tasks.workunit.client.0.smithi142.stdout:5/648: dwrite dc/fce [0,4194304] 0 2024-04-20T21:58:39.864 INFO:tasks.workunit.client.0.smithi142.stdout:9/706: mknod d0/d89/d95/ced 0 2024-04-20T21:58:39.867 INFO:tasks.workunit.client.0.smithi142.stdout:5/649: chown dc/d71/d93/fb8 1 1 2024-04-20T21:58:39.871 INFO:tasks.workunit.client.0.smithi142.stdout:6/653: rename d1/d2f/d35/d5b/d63/d4b/d61/f67 to d1/d5/d8b/da6/fe7 0 2024-04-20T21:58:39.889 INFO:tasks.workunit.client.0.smithi142.stdout:7/790: dwrite d4/d7f/d77/d78/da8/dae/db3/f110 [0,4194304] 0 2024-04-20T21:58:39.897 INFO:tasks.workunit.client.0.smithi142.stdout:7/791: dread d4/d7f/d77/d78/d9b/d5a/d90/df8/fdc [0,4194304] 0 2024-04-20T21:58:39.916 INFO:tasks.workunit.client.0.smithi142.stdout:3/769: dread d6/d15/d1e/d43/d4d/f8b [0,4194304] 0 2024-04-20T21:58:39.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:39 smithi164 ceph-mon[23506]: pgmap v41: 65 pgs: 65 active+clean; 1.4 GiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 64 MiB/s rd, 168 MiB/s wr, 447 op/s 2024-04-20T21:58:39.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:39 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/885847200' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:58:39.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:39 smithi164 ceph-mon[23506]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:58:39.964 INFO:tasks.workunit.client.0.smithi142.stdout:0/671: sync 2024-04-20T21:58:39.995 INFO:tasks.workunit.client.0.smithi142.stdout:2/807: symlink d3/d9/d89/d31/d84/l10f 0 2024-04-20T21:58:39.996 INFO:tasks.workunit.client.0.smithi142.stdout:2/808: fsync d3/f7e 0 2024-04-20T21:58:40.000 INFO:tasks.workunit.client.0.smithi142.stdout:8/730: creat d0/d1c/d44/dad/db3/d3f/d7f/d8f/ffb x:0 0 0 2024-04-20T21:58:40.000 INFO:tasks.workunit.client.0.smithi142.stdout:8/731: chown d0 5353557 1 2024-04-20T21:58:40.002 INFO:tasks.workunit.client.0.smithi142.stdout:5/650: rename dc/d14/d21/d46/d2a/d65/d79/da2 to dc/d14/d21/d46/de6 0 2024-04-20T21:58:40.005 INFO:tasks.workunit.client.0.smithi142.stdout:5/651: readlink dc/d14/d25/la1 0 2024-04-20T21:58:40.038 INFO:tasks.workunit.client.0.smithi142.stdout:7/792: fdatasync d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/f23 0 2024-04-20T21:58:40.042 INFO:tasks.workunit.client.0.smithi142.stdout:5/652: symlink dc/d14/d25/db4/le7 0 2024-04-20T21:58:40.043 INFO:tasks.workunit.client.0.smithi142.stdout:7/793: stat d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e/d88 0 2024-04-20T21:58:40.045 INFO:tasks.workunit.client.0.smithi142.stdout:0/672: creat d5/d1c/d3c/d4a/d78/fd8 x:0 0 0 2024-04-20T21:58:40.047 INFO:tasks.workunit.client.0.smithi142.stdout:5/653: truncate dc/d14/d21/d46/d7d/fe1 4845695 0 2024-04-20T21:58:40.048 INFO:tasks.workunit.client.0.smithi142.stdout:5/654: chown dc 197 1 2024-04-20T21:58:40.050 INFO:tasks.workunit.client.0.smithi142.stdout:5/655: chown dc/d14/d21/d7f/cad 963111 1 2024-04-20T21:58:40.051 INFO:tasks.workunit.client.0.smithi142.stdout:4/630: link d1/d6/d4b/cb4 d1/d12/da/d1c/d32/cc0 0 2024-04-20T21:58:40.053 INFO:tasks.workunit.client.0.smithi142.stdout:5/656: stat dc/d14/d26/d3f/c87 0 2024-04-20T21:58:40.055 INFO:tasks.workunit.client.0.smithi142.stdout:4/631: dread - d1/d12/da/d1c/d32/d3d/d2f/d52/d94/fa3 zero size 2024-04-20T21:58:40.070 INFO:tasks.workunit.client.0.smithi142.stdout:1/665: getdents d2/dd/d17 0 2024-04-20T21:58:40.073 INFO:tasks.workunit.client.0.smithi142.stdout:5/657: mkdir dc/d14/d21/d46/d2a/d3c/de8 0 2024-04-20T21:58:40.078 INFO:tasks.workunit.client.0.smithi142.stdout:4/632: mknod d1/d6/d30/d4e/cc1 0 2024-04-20T21:58:40.081 INFO:tasks.workunit.client.0.smithi142.stdout:6/654: link d1/d2f/d35/d5b/d63/l55 d1/d2f/d35/d5b/d63/d64/le8 0 2024-04-20T21:58:40.084 INFO:tasks.workunit.client.0.smithi142.stdout:6/655: chown d1/d11/f76 703 1 2024-04-20T21:58:40.086 INFO:tasks.workunit.client.0.smithi142.stdout:6/656: read d1/d2f/d35/f47 [2524792,13099] 0 2024-04-20T21:58:40.090 INFO:tasks.workunit.client.0.smithi142.stdout:1/666: mkdir d2/dd/d1c/d60/dce/d7c/ddd 0 2024-04-20T21:58:40.096 INFO:tasks.workunit.client.0.smithi142.stdout:5/658: creat dc/d14/d26/d3f/db3/fe9 x:0 0 0 2024-04-20T21:58:40.097 INFO:tasks.workunit.client.0.smithi142.stdout:5/659: fsync dc/d71/d93/fbc 0 2024-04-20T21:58:40.104 INFO:tasks.workunit.client.0.smithi142.stdout:7/794: creat d4/d7d/f119 x:0 0 0 2024-04-20T21:58:40.105 INFO:tasks.workunit.client.0.smithi142.stdout:6/657: symlink d1/d75/le9 0 2024-04-20T21:58:40.110 INFO:tasks.workunit.client.0.smithi142.stdout:7/795: truncate d4/d7f/d77/d78/d9b/dc1/dd4/f10a 700858 0 2024-04-20T21:58:40.124 INFO:tasks.workunit.client.0.smithi142.stdout:6/658: readlink d1/d5/l10 0 2024-04-20T21:58:40.127 INFO:tasks.workunit.client.0.smithi142.stdout:4/633: link d1/d6/d30/d4e/cc1 d1/d12/da/d1c/d32/d3d/d2f/d52/d94/cc2 0 2024-04-20T21:58:40.132 INFO:tasks.workunit.client.0.smithi142.stdout:7/796: truncate d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/f81 171073 0 2024-04-20T21:58:40.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:40.133+0000 7f49d3e00700 1 -- 172.21.15.142:0/1797673520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f49cc107580 con 0x7f49cc101e20 2024-04-20T21:58:40.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:40.137+0000 7f49ca000700 1 -- 172.21.15.142:0/1797673520 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f49b8037090 con 0x7f49cc101e20 2024-04-20T21:58:40.137 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_OK 2024-04-20T21:58:40.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:40.141+0000 7f49d3e00700 1 -- 172.21.15.142:0/1797673520 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f49b406eab0 msgr2=0x7f49b4070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:40.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:40.141+0000 7f49d3e00700 1 --2- 172.21.15.142:0/1797673520 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f49b406eab0 0x7f49b4070f70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f49c4006070 tx=0x7f49c4006000 comp rx=0 tx=0).stop 2024-04-20T21:58:40.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:40.141+0000 7f49d3e00700 1 -- 172.21.15.142:0/1797673520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49cc101e20 msgr2=0x7f49cc19d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:58:40.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:40.141+0000 7f49d3e00700 1 --2- 172.21.15.142:0/1797673520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49cc101e20 0x7f49cc19d200 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f49b800e920 tx=0x7f49b800ec30 comp rx=0 tx=0).stop 2024-04-20T21:58:40.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:40.142+0000 7f49d3e00700 1 -- 172.21.15.142:0/1797673520 shutdown_connections 2024-04-20T21:58:40.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:40.142+0000 7f49d3e00700 1 --2- 172.21.15.142:0/1797673520 >> [v2:172.21.15.164:6828/929524464,v1:172.21.15.164:6829/929524464] conn(0x7f49b406eab0 0x7f49b4070f70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:40.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:40.142+0000 7f49d3e00700 1 --2- 172.21.15.142:0/1797673520 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49cc100c20 0x7f49cc19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:40.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:40.142+0000 7f49d3e00700 1 --2- 172.21.15.142:0/1797673520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49cc101e20 0x7f49cc19d200 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:58:40.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:40.142+0000 7f49d3e00700 1 -- 172.21.15.142:0/1797673520 >> 172.21.15.142:0/1797673520 conn(0x7f49cc0fc1e0 msgr2=0x7f49cc10a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:58:40.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:40.143+0000 7f49d3e00700 1 -- 172.21.15.142:0/1797673520 shutdown_connections 2024-04-20T21:58:40.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:58:40.143+0000 7f49d3e00700 1 -- 172.21.15.142:0/1797673520 wait complete. 2024-04-20T21:58:40.148 INFO:tasks.workunit.client.0.smithi142.stdout:4/634: dwrite d1/d12/da/d1c/d32/d3d/d2f/d73/fbe [0,4194304] 0 2024-04-20T21:58:40.148 INFO:tasks.workunit.client.0.smithi142.stdout:2/809: write d3/d9/f71 [101553,41523] 0 2024-04-20T21:58:40.151 INFO:tasks.workunit.client.0.smithi142.stdout:4/635: readlink d1/d6/l74 0 2024-04-20T21:58:40.159 INFO:tasks.workunit.client.0.smithi142.stdout:5/660: getdents dc/d14/d26/d3f/d53/d7c/da9/d75 0 2024-04-20T21:58:40.162 INFO:tasks.workunit.client.0.smithi142.stdout:8/732: write d0/f9a [802403,75318] 0 2024-04-20T21:58:40.164 INFO:tasks.workunit.client.0.smithi142.stdout:9/707: dwrite d0/d3c/d4d/d63/f7f [0,4194304] 0 2024-04-20T21:58:40.165 INFO:tasks.workunit.client.0.smithi142.stdout:7/797: mkdir d4/d7f/d77/d11a 0 2024-04-20T21:58:40.171 INFO:tasks.workunit.client.0.smithi142.stdout:2/810: chown d3/d9/d89/d31/da7/dd7/fe7 448 1 2024-04-20T21:58:40.172 INFO:tasks.workunit.client.0.smithi142.stdout:2/811: readlink d3/d5/l96 0 2024-04-20T21:58:40.175 INFO:tasks.workunit.client.0.smithi142.stdout:5/661: unlink dc/d71/f83 0 2024-04-20T21:58:40.177 INFO:tasks.workunit.client.0.smithi142.stdout:8/733: symlink d0/da7/lfc 0 2024-04-20T21:58:40.180 INFO:tasks.workunit.client.0.smithi142.stdout:9/708: creat d0/d89/fee x:0 0 0 2024-04-20T21:58:40.184 INFO:tasks.workunit.client.0.smithi142.stdout:6/659: getdents d1/d2f/d35/d5b/d63/d4b 0 2024-04-20T21:58:40.186 INFO:tasks.workunit.client.0.smithi142.stdout:4/636: symlink d1/d12/da/lc3 0 2024-04-20T21:58:40.186 INFO:tasks.workunit.client.0.smithi142.stdout:9/709: chown d0/d3c/d4d/d63/d80/fdd 1004655 1 2024-04-20T21:58:40.188 INFO:tasks.workunit.client.0.smithi142.stdout:4/637: chown d1/d12/da 0 1 2024-04-20T21:58:40.188 INFO:tasks.workunit.client.0.smithi142.stdout:7/798: dwrite d4/d7d/fcf [0,4194304] 0 2024-04-20T21:58:40.191 INFO:tasks.workunit.client.0.smithi142.stdout:7/799: chown d4/d7f/d77/d78/da8/dae/dd8 15820805 1 2024-04-20T21:58:40.193 INFO:tasks.workunit.client.0.smithi142.stdout:2/812: mkdir d3/d9/da3/dae/d110 0 2024-04-20T21:58:40.194 INFO:tasks.workunit.client.0.smithi142.stdout:5/662: creat dc/d14/d26/d3f/d53/d7c/d97/da6/fea x:0 0 0 2024-04-20T21:58:40.197 INFO:tasks.workunit.client.0.smithi142.stdout:5/663: stat dc/d14/d21/d46/dc1 0 2024-04-20T21:58:40.197 INFO:tasks.workunit.client.0.smithi142.stdout:7/800: read d4/d7f/d77/d78/d9b/d5a/f76 [2357036,79291] 0 2024-04-20T21:58:40.199 INFO:tasks.workunit.client.0.smithi142.stdout:2/813: dread d3/d9/f71 [0,4194304] 0 2024-04-20T21:58:40.202 INFO:tasks.workunit.client.0.smithi142.stdout:5/664: write dc/d14/d21/d46/d7d/f84 [881197,66466] 0 2024-04-20T21:58:40.205 INFO:tasks.workunit.client.0.smithi142.stdout:1/667: mknod d2/dd/cde 0 2024-04-20T21:58:40.208 INFO:tasks.workunit.client.0.smithi142.stdout:1/668: readlink d2/dd/d17/d8b/lb8 0 2024-04-20T21:58:40.209 INFO:tasks.workunit.client.0.smithi142.stdout:9/710: stat d0/fe 0 2024-04-20T21:58:40.211 INFO:tasks.workunit.client.0.smithi142.stdout:6/660: dread - d1/d2f/d35/d5b/d3e/f74 zero size 2024-04-20T21:58:40.214 INFO:tasks.workunit.client.0.smithi142.stdout:6/661: write d1/d11/f44 [4590513,77347] 0 2024-04-20T21:58:40.215 INFO:tasks.workunit.client.0.smithi142.stdout:8/734: rename d0/l6f to d0/d1c/d44/d89/lfd 0 2024-04-20T21:58:40.220 INFO:tasks.workunit.client.0.smithi142.stdout:2/814: creat d3/d9/d89/d31/da2/ddb/f111 x:0 0 0 2024-04-20T21:58:40.221 INFO:tasks.workunit.client.0.smithi142.stdout:5/665: creat dc/d14/d25/db4/dbb/feb x:0 0 0 2024-04-20T21:58:40.224 INFO:tasks.workunit.client.0.smithi142.stdout:5/666: chown dc/d14/d21/f6f 196326 1 2024-04-20T21:58:40.229 INFO:tasks.workunit.client.0.smithi142.stdout:5/667: write dc/d14/d25/db4/fc2 [132391,105633] 0 2024-04-20T21:58:40.238 INFO:tasks.workunit.client.0.smithi142.stdout:6/662: mknod d1/d2f/d35/d5b/d3e/dc5/cea 0 2024-04-20T21:58:40.241 INFO:tasks.workunit.client.0.smithi142.stdout:6/663: write d1/d2f/d35/d5b/d63/d64/fda [457736,39144] 0 2024-04-20T21:58:40.241 INFO:tasks.workunit.client.0.smithi142.stdout:8/735: creat d0/d1c/d44/d89/d45/d4c/d68/ffe x:0 0 0 2024-04-20T21:58:40.244 INFO:tasks.workunit.client.0.smithi142.stdout:6/664: truncate d1/dd1/d8f/fd5 1039407 0 2024-04-20T21:58:40.245 INFO:tasks.workunit.client.0.smithi142.stdout:2/815: mkdir d3/d9/d89/d31/dc3/dce/dea/d112 0 2024-04-20T21:58:40.249 INFO:tasks.workunit.client.0.smithi142.stdout:4/638: rmdir d1/d12/da/d72/dac 0 2024-04-20T21:58:40.251 INFO:tasks.workunit.client.0.smithi142.stdout:4/639: write d1/d6/d4a/d5a/f56 [3684425,91162] 0 2024-04-20T21:58:40.261 INFO:tasks.workunit.client.0.smithi142.stdout:2/816: mkdir d3/d9/d89/d31/dc3/dce/d113 0 2024-04-20T21:58:40.272 INFO:tasks.workunit.client.0.smithi142.stdout:7/801: rename d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/dd5/d118 to d4/d7d/d11b 0 2024-04-20T21:58:40.285 INFO:tasks.workunit.client.0.smithi142.stdout:3/770: sync 2024-04-20T21:58:40.286 INFO:tasks.workunit.client.0.smithi142.stdout:0/673: sync 2024-04-20T21:58:40.302 INFO:tasks.workunit.client.0.smithi142.stdout:1/669: dwrite d2/dd/d17/d1b/d22/d13/f39 [0,4194304] 0 2024-04-20T21:58:40.334 INFO:tasks.workunit.client.0.smithi142.stdout:5/668: truncate dc/d14/d25/db4/fc2 8947 0 2024-04-20T21:58:40.337 INFO:tasks.workunit.client.0.smithi142.stdout:6/665: getdents d1/d11/dbb 0 2024-04-20T21:58:40.338 INFO:tasks.workunit.client.0.smithi142.stdout:9/711: getdents d0/d3c/d4d/d63 0 2024-04-20T21:58:40.339 INFO:tasks.workunit.client.0.smithi142.stdout:6/666: chown d1/d11/c13 86727 1 2024-04-20T21:58:40.340 INFO:tasks.workunit.client.0.smithi142.stdout:2/817: write d3/d9/d69/d104/d70/d3c/d64/f7b [2910624,46444] 0 2024-04-20T21:58:40.341 INFO:tasks.workunit.client.0.smithi142.stdout:4/640: rename d1/d12/da/d37/l5f to d1/d12/da/d1c/d32/d3d/d2f/d52/d94/lc4 0 2024-04-20T21:58:40.342 INFO:tasks.workunit.client.0.smithi142.stdout:7/802: fdatasync d4/d7f/d77/d78/da8/dae/fa5 0 2024-04-20T21:58:40.346 INFO:tasks.workunit.client.0.smithi142.stdout:4/641: readlink d1/d12/da/d1c/d32/d3d/d2f/l53 0 2024-04-20T21:58:40.346 INFO:tasks.workunit.client.0.smithi142.stdout:1/670: rmdir d2/d4e 39 2024-04-20T21:58:40.350 INFO:tasks.workunit.client.0.smithi142.stdout:9/712: mknod d0/d2a/dd4/cef 0 2024-04-20T21:58:40.352 INFO:tasks.workunit.client.0.smithi142.stdout:5/669: dread dc/d14/d21/f6f [0,4194304] 0 2024-04-20T21:58:40.356 INFO:tasks.workunit.client.0.smithi142.stdout:8/736: link d0/d1c/d44/dad/db3/l43 d0/d1c/lff 0 2024-04-20T21:58:40.357 INFO:tasks.workunit.client.0.smithi142.stdout:4/642: mkdir d1/d12/da/d72/dc5 0 2024-04-20T21:58:40.364 INFO:tasks.workunit.client.0.smithi142.stdout:1/671: rename d2/dd/d17/d1b/d22/d55/f90 to d2/dd/d17/d8b/fdf 0 2024-04-20T21:58:40.366 INFO:tasks.workunit.client.0.smithi142.stdout:1/672: fsync d2/dd/d17/d1b/f71 0 2024-04-20T21:58:40.370 INFO:tasks.workunit.client.0.smithi142.stdout:9/713: dwrite d0/d3c/d4d/d63/d80/fa4 [0,4194304] 0 2024-04-20T21:58:40.371 INFO:tasks.workunit.client.0.smithi142.stdout:8/737: symlink d0/da7/l100 0 2024-04-20T21:58:40.372 INFO:tasks.workunit.client.0.smithi142.stdout:2/818: creat d3/d9/f114 x:0 0 0 2024-04-20T21:58:40.374 INFO:tasks.workunit.client.0.smithi142.stdout:6/667: creat d1/d5/feb x:0 0 0 2024-04-20T21:58:40.375 INFO:tasks.workunit.client.0.smithi142.stdout:3/771: link d6/d15/d30/d37/d75/fb5 d6/d15/d30/d37/f115 0 2024-04-20T21:58:40.383 INFO:tasks.workunit.client.0.smithi142.stdout:6/668: dread d1/d75/fb1 [0,4194304] 0 2024-04-20T21:58:40.385 INFO:tasks.workunit.client.0.smithi142.stdout:5/670: link dc/d6b/f9d dc/d14/d21/d46/d7d/fec 0 2024-04-20T21:58:40.390 INFO:tasks.workunit.client.0.smithi142.stdout:2/819: mknod d3/d9/d89/d9a/c115 0 2024-04-20T21:58:40.393 INFO:tasks.workunit.client.0.smithi142.stdout:0/674: rename d5/d13/d1e/d23/d46/f4c to d5/d1c/d3c/d85/d38/d62/fd9 0 2024-04-20T21:58:40.393 INFO:tasks.workunit.client.0.smithi142.stdout:2/820: readlink d3/d9/d89/d31/d84/l10f 0 2024-04-20T21:58:40.395 INFO:tasks.workunit.client.0.smithi142.stdout:3/772: creat d6/d15/d1e/d43/d4d/d59/db6/f116 x:0 0 0 2024-04-20T21:58:40.403 INFO:tasks.workunit.client.0.smithi142.stdout:5/671: rename dc/d14/d25/c69 to dc/d14/d21/d7f/de5/ced 0 2024-04-20T21:58:40.406 INFO:tasks.workunit.client.0.smithi142.stdout:2/821: symlink d3/d9/d34/db5/dc2/l116 0 2024-04-20T21:58:40.408 INFO:tasks.workunit.client.0.smithi142.stdout:6/669: creat d1/d5/d8b/fec x:0 0 0 2024-04-20T21:58:40.412 INFO:tasks.workunit.client.0.smithi142.stdout:4/643: getdents d1/d12/da/d1c/d32/d3d 0 2024-04-20T21:58:40.414 INFO:tasks.workunit.client.0.smithi142.stdout:6/670: dread - d1/d2f/d35/d48/f9c zero size 2024-04-20T21:58:40.419 INFO:tasks.workunit.client.0.smithi142.stdout:3/773: creat d6/d15/d47/d83/d114/f117 x:0 0 0 2024-04-20T21:58:40.421 INFO:tasks.workunit.client.0.smithi142.stdout:4/644: unlink d1/d6/f1a 0 2024-04-20T21:58:40.429 INFO:tasks.workunit.client.0.smithi142.stdout:2/822: dwrite d3/d5/f5e [0,4194304] 0 2024-04-20T21:58:40.430 INFO:tasks.workunit.client.0.smithi142.stdout:3/774: unlink d6/d15/da4/faa 0 2024-04-20T21:58:40.433 INFO:tasks.workunit.client.0.smithi142.stdout:6/671: mkdir d1/d2f/d35/d5b/d63/ded 0 2024-04-20T21:58:40.435 INFO:tasks.workunit.client.0.smithi142.stdout:4/645: symlink d1/d12/da/d1c/d32/d3d/d2f/d7a/lc6 0 2024-04-20T21:58:40.437 INFO:tasks.workunit.client.0.smithi142.stdout:7/803: write d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/f5f [1046625,19307] 0 2024-04-20T21:58:40.438 INFO:tasks.workunit.client.0.smithi142.stdout:4/646: chown d1/d6/ce 163248 1 2024-04-20T21:58:40.441 INFO:tasks.workunit.client.0.smithi142.stdout:3/775: truncate d6/f34 1753144 0 2024-04-20T21:58:40.443 INFO:tasks.workunit.client.0.smithi142.stdout:6/672: creat d1/d75/fee x:0 0 0 2024-04-20T21:58:40.445 INFO:tasks.workunit.client.0.smithi142.stdout:7/804: creat d4/d7f/d77/d78/da8/dae/db3/f11c x:0 0 0 2024-04-20T21:58:40.449 INFO:tasks.workunit.client.0.smithi142.stdout:3/776: unlink d6/d15/d30/d37/fc6 0 2024-04-20T21:58:40.453 INFO:tasks.workunit.client.0.smithi142.stdout:4/647: truncate d1/d12/da/d1c/d32/d3d/f85 3775995 0 2024-04-20T21:58:40.455 INFO:tasks.workunit.client.0.smithi142.stdout:9/714: write d0/d2a/d39/fbf [158696,15363] 0 2024-04-20T21:58:40.458 INFO:tasks.workunit.client.0.smithi142.stdout:7/805: unlink d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e/d88/f9e 0 2024-04-20T21:58:40.459 INFO:tasks.workunit.client.0.smithi142.stdout:1/673: dwrite d2/dd/d17/d1b/f5f [4194304,4194304] 0 2024-04-20T21:58:40.459 INFO:tasks.workunit.client.0.smithi142.stdout:8/738: write d0/d1c/d44/d89/d45/f56 [798070,89000] 0 2024-04-20T21:58:40.461 INFO:tasks.workunit.client.0.smithi142.stdout:7/806: stat d4/d7f/d77/d78/d9b/d5a/f76 0 2024-04-20T21:58:40.466 INFO:tasks.workunit.client.0.smithi142.stdout:8/739: truncate d0/d17/d35/db5/fd7 351408 0 2024-04-20T21:58:40.471 INFO:tasks.workunit.client.0.smithi142.stdout:7/807: write d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/f4a [687979,112459] 0 2024-04-20T21:58:40.479 INFO:tasks.workunit.client.0.smithi142.stdout:7/808: write d4/d7f/d77/d78/d9b/f95 [369440,38327] 0 2024-04-20T21:58:40.479 INFO:tasks.workunit.client.0.smithi142.stdout:3/777: dwrite d6/d32/d39/d69/ff5 [0,4194304] 0 2024-04-20T21:58:40.485 INFO:tasks.workunit.client.0.smithi142.stdout:8/740: mkdir d0/d17/d35/db5/d101 0 2024-04-20T21:58:40.485 INFO:tasks.workunit.client.0.smithi142.stdout:3/778: readlink d6/d32/d9b/led 0 2024-04-20T21:58:40.487 INFO:tasks.workunit.client.0.smithi142.stdout:4/648: truncate d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/f42 436839 0 2024-04-20T21:58:40.487 INFO:tasks.workunit.client.0.smithi142.stdout:7/809: chown d4/d7d/lb4 33 1 2024-04-20T21:58:40.490 INFO:tasks.workunit.client.0.smithi142.stdout:0/675: dwrite d5/d13/d1e/d23/fa6 [0,4194304] 0 2024-04-20T21:58:40.504 INFO:tasks.workunit.client.0.smithi142.stdout:1/674: dwrite d2/f6 [0,4194304] 0 2024-04-20T21:58:40.510 INFO:tasks.workunit.client.0.smithi142.stdout:9/715: getdents d0/d2a/d39/d87 0 2024-04-20T21:58:40.511 INFO:tasks.workunit.client.0.smithi142.stdout:3/779: rmdir d6/d32/d39/d69/de0 39 2024-04-20T21:58:40.514 INFO:tasks.workunit.client.0.smithi142.stdout:2/823: write d3/d9/d34/f41 [3722929,14067] 0 2024-04-20T21:58:40.528 INFO:tasks.workunit.client.0.smithi142.stdout:5/672: dwrite dc/d14/d21/d46/d2a/f52 [0,4194304] 0 2024-04-20T21:58:40.529 INFO:tasks.workunit.client.0.smithi142.stdout:3/780: write d6/d32/d39/d69/ff5 [931119,29124] 0 2024-04-20T21:58:40.531 INFO:tasks.workunit.client.0.smithi142.stdout:0/676: chown d5/d1d/f4e 3326443 1 2024-04-20T21:58:40.531 INFO:tasks.workunit.client.0.smithi142.stdout:1/675: rename d2/dd/d1c/l9b to d2/dd/d17/d1b/d22/d20/dc3/le0 0 2024-04-20T21:58:40.532 INFO:tasks.workunit.client.0.smithi142.stdout:3/781: chown d6/f8 19278 1 2024-04-20T21:58:40.539 INFO:tasks.workunit.client.0.smithi142.stdout:0/677: write d5/d1d/f77 [4567886,57634] 0 2024-04-20T21:58:40.558 INFO:tasks.workunit.client.0.smithi142.stdout:2/824: mkdir d3/d9/d69/d104/d70/d117 0 2024-04-20T21:58:40.561 INFO:tasks.workunit.client.0.smithi142.stdout:5/673: mknod dc/d14/d25/d89/cee 0 2024-04-20T21:58:40.562 INFO:tasks.workunit.client.0.smithi142.stdout:6/673: dwrite d1/d5/f66 [0,4194304] 0 2024-04-20T21:58:40.566 INFO:tasks.workunit.client.0.smithi142.stdout:2/825: chown d3/d9/d89/d31/da2/ddb/f111 0 1 2024-04-20T21:58:40.566 INFO:tasks.workunit.client.0.smithi142.stdout:6/674: chown d1/d2f/d35/d48/fd7 196100609 1 2024-04-20T21:58:40.567 INFO:tasks.workunit.client.0.smithi142.stdout:2/826: stat d3/d9/d69/d104/l4f 0 2024-04-20T21:58:40.571 INFO:tasks.workunit.client.0.smithi142.stdout:2/827: write d3/d9/d34/fc5 [753031,114758] 0 2024-04-20T21:58:40.579 INFO:tasks.workunit.client.0.smithi142.stdout:2/828: dread - d3/d9/d89/d31/dc3/dce/dea/ffb zero size 2024-04-20T21:58:40.586 INFO:tasks.workunit.client.0.smithi142.stdout:9/716: dread d0/d3c/d4d/d63/d80/fe8 [0,4194304] 0 2024-04-20T21:58:40.590 INFO:tasks.workunit.client.0.smithi142.stdout:9/717: write d0/d3c/f5a [2383287,128977] 0 2024-04-20T21:58:40.592 INFO:tasks.workunit.client.0.smithi142.stdout:6/675: read - d1/d2f/d35/d5b/d70/fad zero size 2024-04-20T21:58:40.593 INFO:tasks.workunit.client.0.smithi142.stdout:5/674: fdatasync dc/d14/fd9 0 2024-04-20T21:58:40.594 INFO:tasks.workunit.client.0.smithi142.stdout:4/649: dread d1/d12/da/f18 [0,4194304] 0 2024-04-20T21:58:40.598 INFO:tasks.workunit.client.0.smithi142.stdout:1/676: creat d2/dd/d17/d1b/fe1 x:0 0 0 2024-04-20T21:58:40.598 INFO:tasks.workunit.client.0.smithi142.stdout:7/810: dwrite d4/d7d/fa6 [0,4194304] 0 2024-04-20T21:58:40.605 INFO:tasks.workunit.client.0.smithi142.stdout:8/741: dwrite d0/d1c/d44/d89/d45/fc0 [0,4194304] 0 2024-04-20T21:58:40.612 INFO:tasks.workunit.client.0.smithi142.stdout:3/782: dread d6/d15/d1e/d43/d4d/d59/db6/fc1 [0,4194304] 0 2024-04-20T21:58:40.616 INFO:tasks.workunit.client.0.smithi142.stdout:6/676: symlink d1/d11/lef 0 2024-04-20T21:58:40.620 INFO:tasks.workunit.client.0.smithi142.stdout:2/829: dwrite d3/d5/f4b [0,4194304] 0 2024-04-20T21:58:40.622 INFO:tasks.workunit.client.0.smithi142.stdout:5/675: symlink dc/d14/d26/d3f/d53/d7c/lef 0 2024-04-20T21:58:40.626 INFO:tasks.workunit.client.0.smithi142.stdout:0/678: link d5/d1c/d3c/f8e d5/d13/d1e/d23/d46/fda 0 2024-04-20T21:58:40.626 INFO:tasks.workunit.client.0.smithi142.stdout:2/830: chown d3/d9/db6/de3 38 1 2024-04-20T21:58:40.628 INFO:tasks.workunit.client.0.smithi142.stdout:1/677: rename d2/dd/d17/d3b/d74/fd4 to d2/dd/d17/d1b/d22/d13/fe2 0 2024-04-20T21:58:40.637 INFO:tasks.workunit.client.0.smithi142.stdout:9/718: truncate d0/f24 1668479 0 2024-04-20T21:58:40.642 INFO:tasks.workunit.client.0.smithi142.stdout:6/677: dread d1/d75/fb1 [0,4194304] 0 2024-04-20T21:58:40.644 INFO:tasks.workunit.client.0.smithi142.stdout:8/742: dread d0/d1c/d44/f46 [0,4194304] 0 2024-04-20T21:58:40.644 INFO:tasks.workunit.client.0.smithi142.stdout:7/811: dwrite d4/d7f/f60 [0,4194304] 0 2024-04-20T21:58:40.647 INFO:tasks.workunit.client.0.smithi142.stdout:1/678: write d2/d4e/d7e/faa [891191,22214] 0 2024-04-20T21:58:40.647 INFO:tasks.workunit.client.0.smithi142.stdout:5/676: fdatasync dc/d14/d21/d46/d7d/fe1 0 2024-04-20T21:58:40.648 INFO:tasks.workunit.client.0.smithi142.stdout:3/783: dwrite d6/d15/d30/f46 [4194304,4194304] 0 2024-04-20T21:58:40.650 INFO:tasks.workunit.client.0.smithi142.stdout:2/831: symlink d3/d9/d89/d31/l118 0 2024-04-20T21:58:40.661 INFO:tasks.workunit.client.0.smithi142.stdout:8/743: truncate d0/f7b 617034 0 2024-04-20T21:58:40.666 INFO:tasks.workunit.client.0.smithi142.stdout:5/677: dread - dc/d71/f4e zero size 2024-04-20T21:58:40.670 INFO:tasks.workunit.client.0.smithi142.stdout:7/812: symlink d4/d7f/d77/d78/da8/dae/dc5/l11d 0 2024-04-20T21:58:40.671 INFO:tasks.workunit.client.0.smithi142.stdout:1/679: truncate d2/dd/d17/f24 3232355 0 2024-04-20T21:58:40.672 INFO:tasks.workunit.client.0.smithi142.stdout:0/679: dwrite d5/d1c/d3c/d85/d38/fd1 [0,4194304] 0 2024-04-20T21:58:40.674 INFO:tasks.workunit.client.0.smithi142.stdout:4/650: write d1/d12/da/d1c/d32/d3d/d2f/d49/f75 [646464,63139] 0 2024-04-20T21:58:40.675 INFO:tasks.workunit.client.0.smithi142.stdout:6/678: mknod d1/d2f/d35/d5b/d63/d64/cf0 0 2024-04-20T21:58:40.680 INFO:tasks.workunit.client.0.smithi142.stdout:5/678: dread - dc/d14/d26/d3f/db3/fe9 zero size 2024-04-20T21:58:40.685 INFO:tasks.workunit.client.0.smithi142.stdout:9/719: rename d0/d3c/d4d/f9b to d0/ff0 0 2024-04-20T21:58:40.687 INFO:tasks.workunit.client.0.smithi142.stdout:5/679: fsync dc/d14/d21/d46/d2a/d3c/f61 0 2024-04-20T21:58:40.690 INFO:tasks.workunit.client.0.smithi142.stdout:1/680: unlink d2/dd/d17/d8b/fdf 0 2024-04-20T21:58:40.692 INFO:tasks.workunit.client.0.smithi142.stdout:1/681: readlink d2/dd/d1c/d60/l85 0 2024-04-20T21:58:40.713 INFO:tasks.workunit.client.0.smithi142.stdout:2/832: rename d3/d9/d89/fc7 to d3/d5/d67/dc4/f119 0 2024-04-20T21:58:40.715 INFO:tasks.workunit.client.0.smithi142.stdout:5/680: creat dc/d71/d5c/d68/ff0 x:0 0 0 2024-04-20T21:58:40.717 INFO:tasks.workunit.client.0.smithi142.stdout:4/651: creat d1/d6/fc7 x:0 0 0 2024-04-20T21:58:40.720 INFO:tasks.workunit.client.0.smithi142.stdout:3/784: dwrite d6/d15/d30/d37/f67 [4194304,4194304] 0 2024-04-20T21:58:40.721 INFO:tasks.workunit.client.0.smithi142.stdout:1/682: dwrite d2/dd/d17/d1b/f3c [0,4194304] 0 2024-04-20T21:58:40.724 INFO:tasks.workunit.client.0.smithi142.stdout:1/683: write d2/dd/d1c/d60/fdb [144241,128563] 0 2024-04-20T21:58:40.725 INFO:tasks.workunit.client.0.smithi142.stdout:8/744: dread d0/d1c/d44/dad/db3/d3f/d7f/d8f/ff4 [0,4194304] 0 2024-04-20T21:58:40.728 INFO:tasks.workunit.client.0.smithi142.stdout:6/679: link d1/d2f/d35/d5b/d63/d4b/f90 d1/d75/ff1 0 2024-04-20T21:58:40.728 INFO:tasks.workunit.client.0.smithi142.stdout:1/684: dread - d2/dd/d1c/d60/fc2 zero size 2024-04-20T21:58:40.734 INFO:tasks.workunit.client.0.smithi142.stdout:9/720: write d0/d2a/f30 [2683771,68796] 0 2024-04-20T21:58:40.740 INFO:tasks.workunit.client.0.smithi142.stdout:6/680: creat d1/dd1/d8f/ff2 x:0 0 0 2024-04-20T21:58:40.742 INFO:tasks.workunit.client.0.smithi142.stdout:4/652: mkdir d1/d12/da/d37/d89/dc8 0 2024-04-20T21:58:40.742 INFO:tasks.workunit.client.0.smithi142.stdout:1/685: creat d2/d4e/d7e/fe3 x:0 0 0 2024-04-20T21:58:40.748 INFO:tasks.workunit.client.0.smithi142.stdout:7/813: dwrite d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/f8d [0,4194304] 0 2024-04-20T21:58:40.757 INFO:tasks.workunit.client.0.smithi142.stdout:6/681: mknod d1/dd1/d65/cf3 0 2024-04-20T21:58:40.759 INFO:tasks.workunit.client.0.smithi142.stdout:1/686: mknod d2/d4e/d7e/ce4 0 2024-04-20T21:58:40.771 INFO:tasks.workunit.client.0.smithi142.stdout:7/814: creat d4/d7f/d77/d78/d9b/d5a/f11e x:0 0 0 2024-04-20T21:58:40.771 INFO:tasks.workunit.client.0.smithi142.stdout:5/681: link dc/d14/d21/d46/de6/c81 dc/d14/cf1 0 2024-04-20T21:58:40.775 INFO:tasks.workunit.client.0.smithi142.stdout:3/785: dwrite d6/d15/d1e/d43/f96 [4194304,4194304] 0 2024-04-20T21:58:40.775 INFO:tasks.workunit.client.0.smithi142.stdout:6/682: mkdir d1/d2f/d35/d5b/d70/df4 0 2024-04-20T21:58:40.782 INFO:tasks.workunit.client.0.smithi142.stdout:2/833: dwrite d3/d5/d67/fcd [0,4194304] 0 2024-04-20T21:58:40.783 INFO:tasks.workunit.client.0.smithi142.stdout:6/683: creat d1/d75/ff5 x:0 0 0 2024-04-20T21:58:40.788 INFO:tasks.workunit.client.0.smithi142.stdout:9/721: dwrite d0/d2a/f34 [0,4194304] 0 2024-04-20T21:58:40.790 INFO:tasks.workunit.client.0.smithi142.stdout:5/682: rename dc/d14/d25/f7b to dc/d14/d21/d7f/ff2 0 2024-04-20T21:58:40.791 INFO:tasks.workunit.client.0.smithi142.stdout:3/786: unlink d6/d15/d1e/d43/d4d/d59/f7d 0 2024-04-20T21:58:40.793 INFO:tasks.workunit.client.0.smithi142.stdout:1/687: truncate d2/dd/d17/d1b/d22/d20/f7b 1223311 0 2024-04-20T21:58:40.795 INFO:tasks.workunit.client.0.smithi142.stdout:7/815: chown d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e/l31 5 1 2024-04-20T21:58:40.795 INFO:tasks.workunit.client.0.smithi142.stdout:2/834: mkdir d3/d9/da3/dae/d11a 0 2024-04-20T21:58:40.796 INFO:tasks.workunit.client.0.smithi142.stdout:6/684: creat d1/d2f/d35/d5b/d3e/ff6 x:0 0 0 2024-04-20T21:58:40.797 INFO:tasks.workunit.client.0.smithi142.stdout:9/722: mknod d0/d91/db4/cf1 0 2024-04-20T21:58:40.800 INFO:tasks.workunit.client.0.smithi142.stdout:6/685: dread - d1/d2f/d35/d5b/d3e/de0/d7e/d9f/dc0/fc7 zero size 2024-04-20T21:58:40.804 INFO:tasks.workunit.client.0.smithi142.stdout:5/683: chown dc/d14/d25/db4/fc2 106012840 1 2024-04-20T21:58:40.806 INFO:tasks.workunit.client.0.smithi142.stdout:9/723: write d0/f14 [2027683,51778] 0 2024-04-20T21:58:40.808 INFO:tasks.workunit.client.0.smithi142.stdout:2/835: rename d3/d9/d69/d104/d70/d3c/f1b to d3/d9/da3/dae/d110/f11b 0 2024-04-20T21:58:40.809 INFO:tasks.workunit.client.0.smithi142.stdout:3/787: symlink d6/d32/l118 0 2024-04-20T21:58:40.815 INFO:tasks.workunit.client.0.smithi142.stdout:3/788: truncate d6/d15/d1e/d43/f10a 973276 0 2024-04-20T21:58:40.817 INFO:tasks.workunit.client.0.smithi142.stdout:3/789: chown d6/d32/de9 3 1 2024-04-20T21:58:40.820 INFO:tasks.workunit.client.0.smithi142.stdout:1/688: mkdir d2/de5 0 2024-04-20T21:58:40.821 INFO:tasks.workunit.client.0.smithi142.stdout:7/816: symlink d4/d7f/d77/d7e/l11f 0 2024-04-20T21:58:40.825 INFO:tasks.workunit.client.0.smithi142.stdout:6/686: creat d1/d11/dbb/ff7 x:0 0 0 2024-04-20T21:58:40.826 INFO:tasks.workunit.client.0.smithi142.stdout:9/724: creat d0/d2a/d8b/dc1/ff2 x:0 0 0 2024-04-20T21:58:40.829 INFO:tasks.workunit.client.0.smithi142.stdout:1/689: stat d2/dd/d17/d1b/d22/d20/dc3 0 2024-04-20T21:58:40.831 INFO:tasks.workunit.client.0.smithi142.stdout:2/836: creat d3/d9/d89/f11c x:0 0 0 2024-04-20T21:58:40.834 INFO:tasks.workunit.client.0.smithi142.stdout:5/684: dwrite dc/d14/d21/d46/fdc [0,4194304] 0 2024-04-20T21:58:40.834 INFO:tasks.workunit.client.0.smithi142.stdout:7/817: symlink d4/d7f/d77/d78/d9b/d5a/d90/l120 0 2024-04-20T21:58:40.835 INFO:tasks.workunit.client.0.smithi142.stdout:9/725: readlink d0/d2a/d39/d87/lb5 0 2024-04-20T21:58:40.835 INFO:tasks.workunit.client.0.smithi142.stdout:3/790: link d6/d15/d47/ce6 d6/d32/d39/d69/d91/c119 0 2024-04-20T21:58:40.836 INFO:tasks.workunit.client.0.smithi142.stdout:1/690: dread - d2/dd/d17/d3b/d74/fd5 zero size 2024-04-20T21:58:40.837 INFO:tasks.workunit.client.0.smithi142.stdout:5/685: dread - dc/fd3 zero size 2024-04-20T21:58:40.839 INFO:tasks.workunit.client.0.smithi142.stdout:6/687: rename d1/d2f/d35/d5b/d63/d4b/f88 to d1/d9e/dcc/ff8 0 2024-04-20T21:58:40.842 INFO:tasks.workunit.client.0.smithi142.stdout:2/837: creat d3/d9/d89/d31/da2/ddb/f11d x:0 0 0 2024-04-20T21:58:40.844 INFO:tasks.workunit.client.0.smithi142.stdout:2/838: chown d3/d9/f77 14586 1 2024-04-20T21:58:40.847 INFO:tasks.workunit.client.0.smithi142.stdout:3/791: symlink d6/d15/d1e/l11a 0 2024-04-20T21:58:40.856 INFO:tasks.workunit.client.0.smithi142.stdout:5/686: creat dc/d71/d5c/d68/ff3 x:0 0 0 2024-04-20T21:58:40.860 INFO:tasks.workunit.client.0.smithi142.stdout:5/687: dread - dc/d14/d21/d46/d2a/f74 zero size 2024-04-20T21:58:40.861 INFO:tasks.workunit.client.0.smithi142.stdout:2/839: creat d3/d9/d89/d9a/f11e x:0 0 0 2024-04-20T21:58:40.864 INFO:tasks.workunit.client.0.smithi142.stdout:5/688: chown dc/d71/d5c/lca 130052670 1 2024-04-20T21:58:40.870 INFO:tasks.workunit.client.0.smithi142.stdout:2/840: read d3/d9/d89/feb [1026711,99581] 0 2024-04-20T21:58:40.874 INFO:tasks.workunit.client.0.smithi142.stdout:6/688: creat d1/d2f/d35/d5b/ff9 x:0 0 0 2024-04-20T21:58:40.874 INFO:tasks.workunit.client.0.smithi142.stdout:2/841: chown d3/d9/d89/c18 5 1 2024-04-20T21:58:40.875 INFO:tasks.workunit.client.0.smithi142.stdout:3/792: dwrite d6/d15/d47/d83/d114/f117 [0,4194304] 0 2024-04-20T21:58:40.878 INFO:tasks.workunit.client.0.smithi142.stdout:7/818: getdents d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7 0 2024-04-20T21:58:40.879 INFO:tasks.workunit.client.0.smithi142.stdout:2/842: symlink d3/d9/db6/l11f 0 2024-04-20T21:58:40.882 INFO:tasks.workunit.client.0.smithi142.stdout:2/843: write d3/d9/f49 [4679822,21193] 0 2024-04-20T21:58:40.886 INFO:tasks.workunit.client.0.smithi142.stdout:1/691: dread d2/dd/d17/f24 [0,4194304] 0 2024-04-20T21:58:40.894 INFO:tasks.workunit.client.0.smithi142.stdout:3/793: fdatasync d6/d15/d30/d37/d75/dbc/fd7 0 2024-04-20T21:58:40.894 INFO:tasks.workunit.client.0.smithi142.stdout:7/819: dread d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/f69 [0,4194304] 0 2024-04-20T21:58:40.895 INFO:tasks.workunit.client.0.smithi142.stdout:1/692: truncate d2/dd/d1c/d60/fc2 910965 0 2024-04-20T21:58:40.896 INFO:tasks.workunit.client.0.smithi142.stdout:2/844: dread d3/d9/d34/fc5 [0,4194304] 0 2024-04-20T21:58:40.909 INFO:tasks.workunit.client.0.smithi142.stdout:7/820: readlink d4/d7f/d77/d78/da8/dae/l10c 0 2024-04-20T21:58:40.909 INFO:tasks.workunit.client.0.smithi142.stdout:9/726: write d0/d3c/d4d/f75 [1181197,2534] 0 2024-04-20T21:58:40.912 INFO:tasks.workunit.client.0.smithi142.stdout:3/794: fsync d6/d32/d39/d69/f85 0 2024-04-20T21:58:40.916 INFO:tasks.workunit.client.0.smithi142.stdout:3/795: readlink d6/d15/d47/d83/dc9/da7/la9 0 2024-04-20T21:58:40.918 INFO:tasks.workunit.client.0.smithi142.stdout:3/796: chown d6/d32/d39/d69/f85 11 1 2024-04-20T21:58:40.920 INFO:tasks.workunit.client.0.smithi142.stdout:9/727: mknod d0/d89/d95/cf3 0 2024-04-20T21:58:40.922 INFO:tasks.workunit.client.0.smithi142.stdout:9/728: mknod d0/d91/da0/cf4 0 2024-04-20T21:58:40.924 INFO:tasks.workunit.client.0.smithi142.stdout:1/693: dread d2/dd/d17/d3b/fc1 [0,4194304] 0 2024-04-20T21:58:40.929 INFO:tasks.workunit.client.0.smithi142.stdout:7/821: link d4/d7f/d77/d78/d9b/d5a/d90/l120 d4/d7f/d77/d11a/l121 0 2024-04-20T21:58:40.931 INFO:tasks.workunit.client.0.smithi142.stdout:1/694: rmdir d2/dd/d1c/d60 39 2024-04-20T21:58:40.939 INFO:tasks.workunit.client.0.smithi142.stdout:3/797: getdents d6/d15/d30/d37 0 2024-04-20T21:58:40.939 INFO:tasks.workunit.client.0.smithi142.stdout:6/689: truncate d1/d5/fb4 4182273 0 2024-04-20T21:58:40.941 INFO:tasks.workunit.client.0.smithi142.stdout:2/845: write d3/d9/da3/fa9 [889342,71219] 0 2024-04-20T21:58:40.942 INFO:tasks.workunit.client.0.smithi142.stdout:3/798: readlink d6/d15/d30/d37/d75/lb3 0 2024-04-20T21:58:40.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:40 smithi142 ceph-mon[15828]: pgmap v42: 65 pgs: 65 active+clean; 1.4 GiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 48 MiB/s rd, 110 MiB/s wr, 306 op/s 2024-04-20T21:58:40.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:40 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1797673520' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T21:58:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:40 smithi164 ceph-mon[23506]: pgmap v42: 65 pgs: 65 active+clean; 1.4 GiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 48 MiB/s rd, 110 MiB/s wr, 306 op/s 2024-04-20T21:58:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:40 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/1797673520' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T21:58:40.946 INFO:tasks.workunit.client.0.smithi142.stdout:3/799: dread - d6/d15/d30/d37/d6c/f74 zero size 2024-04-20T21:58:40.948 INFO:tasks.workunit.client.0.smithi142.stdout:2/846: mkdir d3/d9/d89/d31/dc3/dce/dea/d120 0 2024-04-20T21:58:40.957 INFO:tasks.workunit.client.0.smithi142.stdout:3/800: symlink d6/d32/d9b/l11b 0 2024-04-20T21:58:40.958 INFO:tasks.workunit.client.0.smithi142.stdout:7/822: dwrite d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e/d88/fee [0,4194304] 0 2024-04-20T21:58:40.959 INFO:tasks.workunit.client.0.smithi142.stdout:1/695: dwrite d2/dd/d1c/d88/d89/f97 [0,4194304] 0 2024-04-20T21:58:40.965 INFO:tasks.workunit.client.0.smithi142.stdout:7/823: dread - d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/ff9 zero size 2024-04-20T21:58:40.965 INFO:tasks.workunit.client.0.smithi142.stdout:9/729: dwrite d0/d2a/d39/d87/d9e/fe7 [0,4194304] 0 2024-04-20T21:58:40.968 INFO:tasks.workunit.client.0.smithi142.stdout:7/824: chown d4/dd3/fe3 99360497 1 2024-04-20T21:58:40.972 INFO:tasks.workunit.client.0.smithi142.stdout:3/801: getdents d6/d32/de9 0 2024-04-20T21:58:40.976 INFO:tasks.workunit.client.0.smithi142.stdout:9/730: symlink d0/d2a/d39/d87/d9e/lf5 0 2024-04-20T21:58:40.980 INFO:tasks.workunit.client.0.smithi142.stdout:3/802: write d6/d32/d39/f7b [972642,43623] 0 2024-04-20T21:58:40.981 INFO:tasks.workunit.client.0.smithi142.stdout:2/847: dwrite d3/d9/d89/d31/da2/fd8 [0,4194304] 0 2024-04-20T21:58:40.985 INFO:tasks.workunit.client.0.smithi142.stdout:3/803: read d6/d15/d30/d37/f67 [5084959,125575] 0 2024-04-20T21:58:40.986 INFO:tasks.workunit.client.0.smithi142.stdout:1/696: getdents d2/dd/d1c/d88/d89 0 2024-04-20T21:58:40.988 INFO:tasks.workunit.client.0.smithi142.stdout:6/690: dwrite d1/d5/d3a/f45 [0,4194304] 0 2024-04-20T21:58:40.991 INFO:tasks.workunit.client.0.smithi142.stdout:6/691: fsync d1/d11/f44 0 2024-04-20T21:58:40.997 INFO:tasks.workunit.client.0.smithi142.stdout:7/825: mknod d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e/c122 0 2024-04-20T21:58:40.998 INFO:tasks.workunit.client.0.smithi142.stdout:6/692: truncate d1/d2f/d35/d5b/d39/dcd/fdd 942511 0 2024-04-20T21:58:41.001 INFO:tasks.workunit.client.0.smithi142.stdout:6/693: read - d1/d5/d8b/fec zero size 2024-04-20T21:58:41.001 INFO:tasks.workunit.client.0.smithi142.stdout:1/697: chown d2/dd/d17/d1b/d22/c67 48 1 2024-04-20T21:58:41.004 INFO:tasks.workunit.client.0.smithi142.stdout:3/804: read d6/d15/d30/fba [1632964,80942] 0 2024-04-20T21:58:41.008 INFO:tasks.workunit.client.0.smithi142.stdout:9/731: creat d0/d3c/ff6 x:0 0 0 2024-04-20T21:58:41.009 INFO:tasks.workunit.client.0.smithi142.stdout:7/826: truncate d4/d7f/d77/d78/d9b/d5a/d90/dbc/fcd 1297050 0 2024-04-20T21:58:41.010 INFO:tasks.workunit.client.0.smithi142.stdout:2/848: mkdir d3/d9/d121 0 2024-04-20T21:58:41.012 INFO:tasks.workunit.client.0.smithi142.stdout:1/698: stat d2/dd/d17/d1b/d22/d55/ld9 0 2024-04-20T21:58:41.020 INFO:tasks.workunit.client.0.smithi142.stdout:3/805: creat d6/d32/f11c x:0 0 0 2024-04-20T21:58:41.022 INFO:tasks.workunit.client.0.smithi142.stdout:2/849: mknod d3/d9/d34/db5/dc2/c122 0 2024-04-20T21:58:41.023 INFO:tasks.workunit.client.0.smithi142.stdout:3/806: fsync d6/d32/d39/ffa 0 2024-04-20T21:58:41.033 INFO:tasks.workunit.client.0.smithi142.stdout:1/699: getdents d2/dd 0 2024-04-20T21:58:41.036 INFO:tasks.workunit.client.0.smithi142.stdout:7/827: getdents d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/dd5 0 2024-04-20T21:58:41.044 INFO:tasks.workunit.client.0.smithi142.stdout:1/700: mknod d2/d4e/ce6 0 2024-04-20T21:58:41.046 INFO:tasks.workunit.client.0.smithi142.stdout:2/850: creat d3/d9/d89/d31/de1/f123 x:0 0 0 2024-04-20T21:58:41.050 INFO:tasks.workunit.client.0.smithi142.stdout:9/732: dread d0/fc [0,4194304] 0 2024-04-20T21:58:41.052 INFO:tasks.workunit.client.0.smithi142.stdout:9/733: stat d0/d2a/d39/d87/d9e/db3/le2 0 2024-04-20T21:58:41.052 INFO:tasks.workunit.client.0.smithi142.stdout:2/851: rmdir d3/d9/d69 39 2024-04-20T21:58:41.056 INFO:tasks.workunit.client.0.smithi142.stdout:3/807: write d6/d15/d30/d37/f60 [797407,115345] 0 2024-04-20T21:58:41.057 INFO:tasks.workunit.client.0.smithi142.stdout:2/852: dread - d3/d9/d89/d31/dc3/dce/ff2 zero size 2024-04-20T21:58:41.061 INFO:tasks.workunit.client.0.smithi142.stdout:1/701: mkdir d2/dd/d1c/d60/dce/d7c/de7 0 2024-04-20T21:58:41.063 INFO:tasks.workunit.client.0.smithi142.stdout:1/702: write d2/dd/d17/d1b/f3c [2302298,66330] 0 2024-04-20T21:58:41.070 INFO:tasks.workunit.client.0.smithi142.stdout:2/853: symlink d3/d5/d67/db7/df9/l124 0 2024-04-20T21:58:41.071 INFO:tasks.workunit.client.0.smithi142.stdout:7/828: link d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e/l5b d4/d7f/d77/d78/d9b/d5a/d90/l123 0 2024-04-20T21:58:41.071 INFO:tasks.workunit.client.0.smithi142.stdout:9/734: dwrite d0/d2a/f2d [4194304,4194304] 0 2024-04-20T21:58:41.072 INFO:tasks.workunit.client.0.smithi142.stdout:2/854: rename d3 to d3/d9/d34/db5/d125 22 2024-04-20T21:58:41.083 INFO:tasks.workunit.client.0.smithi142.stdout:2/855: unlink d3/d9/d89/d9a/le5 0 2024-04-20T21:58:41.085 INFO:tasks.workunit.client.0.smithi142.stdout:2/856: dread - d3/d9/d89/d31/dc3/dce/dea/ffb zero size 2024-04-20T21:58:41.091 INFO:tasks.workunit.client.0.smithi142.stdout:3/808: write d6/d15/d47/d83/dc9/da7/f108 [365715,107946] 0 2024-04-20T21:58:41.093 INFO:tasks.workunit.client.0.smithi142.stdout:2/857: rmdir d3/d5/d67/db7/df9 39 2024-04-20T21:58:41.096 INFO:tasks.workunit.client.0.smithi142.stdout:1/703: dwrite d2/dd/d17/d1b/d22/d20/f4c [0,4194304] 0 2024-04-20T21:58:41.098 INFO:tasks.workunit.client.0.smithi142.stdout:9/735: link d0/d2a/d39/d87/d9e/cc2 d0/d91/cf7 0 2024-04-20T21:58:41.100 INFO:tasks.workunit.client.0.smithi142.stdout:9/736: readlink d0/d36/d55/l58 0 2024-04-20T21:58:41.101 INFO:tasks.workunit.client.0.smithi142.stdout:2/858: mknod d3/d9/d89/d31/da2/ddb/c126 0 2024-04-20T21:58:41.107 INFO:tasks.workunit.client.0.smithi142.stdout:3/809: mkdir d6/d32/d39/d69/de0/d11d 0 2024-04-20T21:58:41.113 INFO:tasks.workunit.client.0.smithi142.stdout:2/859: creat d3/d9/d89/d31/dc3/dce/f127 x:0 0 0 2024-04-20T21:58:41.114 INFO:tasks.workunit.client.0.smithi142.stdout:7/829: truncate d4/d7f/d77/d78/da8/f55 617608 0 2024-04-20T21:58:41.114 INFO:tasks.workunit.client.0.smithi142.stdout:2/860: dread - d3/d5/d67/f106 zero size 2024-04-20T21:58:41.118 INFO:tasks.workunit.client.0.smithi142.stdout:9/737: creat d0/d2a/d39/d50/de5/ff8 x:0 0 0 2024-04-20T21:58:41.122 INFO:tasks.workunit.client.0.smithi142.stdout:3/810: dread d6/fc [0,4194304] 0 2024-04-20T21:58:41.126 INFO:tasks.workunit.client.0.smithi142.stdout:9/738: creat d0/d36/d55/ff9 x:0 0 0 2024-04-20T21:58:41.127 INFO:tasks.workunit.client.0.smithi142.stdout:1/704: write d2/dd/d1c/d88/f8d [6971120,117855] 0 2024-04-20T21:58:41.130 INFO:tasks.workunit.client.0.smithi142.stdout:1/705: write d2/d4e/d7e/dbf/fc9 [430498,31730] 0 2024-04-20T21:58:41.130 INFO:tasks.workunit.client.0.smithi142.stdout:2/861: truncate d3/d5/d67/dc4/f90 587862 0 2024-04-20T21:58:41.131 INFO:tasks.workunit.client.0.smithi142.stdout:7/830: getdents d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/dd5 0 2024-04-20T21:58:41.141 INFO:tasks.workunit.client.0.smithi142.stdout:3/811: mkdir d6/d15/d47/d83/dc9/d10f/d11e 0 2024-04-20T21:58:41.151 INFO:tasks.workunit.client.0.smithi142.stdout:9/739: creat d0/ffa x:0 0 0 2024-04-20T21:58:41.153 INFO:tasks.workunit.client.0.smithi142.stdout:1/706: rename d2/dd/d17/d1b/d22/d13/fe2 to d2/d4e/fe8 0 2024-04-20T21:58:41.162 INFO:tasks.workunit.client.0.smithi142.stdout:3/812: rename d6/d15/d47/d83/dc9/da7/f108 to d6/d102/f11f 0 2024-04-20T21:58:41.163 INFO:tasks.workunit.client.0.smithi142.stdout:1/707: creat d2/dd/d17/fe9 x:0 0 0 2024-04-20T21:58:41.164 INFO:tasks.workunit.client.0.smithi142.stdout:7/831: link d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/c3b d4/d7f/d77/d78/c124 0 2024-04-20T21:58:41.169 INFO:tasks.workunit.client.0.smithi142.stdout:2/862: dread d3/d9/d69/d104/d70/f4d [4194304,4194304] 0 2024-04-20T21:58:41.172 INFO:tasks.workunit.client.0.smithi142.stdout:9/740: creat d0/d36/ffb x:0 0 0 2024-04-20T21:58:41.173 INFO:tasks.workunit.client.0.smithi142.stdout:9/741: readlink d0/d91/lb2 0 2024-04-20T21:58:41.174 INFO:tasks.workunit.client.0.smithi142.stdout:7/832: mknod d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e/c125 0 2024-04-20T21:58:41.175 INFO:tasks.workunit.client.0.smithi142.stdout:1/708: mkdir d2/de5/dea 0 2024-04-20T21:58:41.176 INFO:tasks.workunit.client.0.smithi142.stdout:2/863: rmdir d3/d9/d89/d31/da7 39 2024-04-20T21:58:41.180 INFO:tasks.workunit.client.0.smithi142.stdout:9/742: dread d0/d36/d55/f76 [0,4194304] 0 2024-04-20T21:58:41.180 INFO:tasks.workunit.client.0.smithi142.stdout:7/833: creat d4/d7f/d77/d78/d9b/dc1/dd4/f126 x:0 0 0 2024-04-20T21:58:41.181 INFO:tasks.workunit.client.0.smithi142.stdout:1/709: mkdir d2/dd/d1c/d60/deb 0 2024-04-20T21:58:41.183 INFO:tasks.workunit.client.0.smithi142.stdout:9/743: chown d0/d3c/d4d/f75 29370 1 2024-04-20T21:58:41.186 INFO:tasks.workunit.client.0.smithi142.stdout:7/834: chown d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/f75 15914 1 2024-04-20T21:58:41.186 INFO:tasks.workunit.client.0.smithi142.stdout:2/864: creat d3/d9/d89/d31/da7/f128 x:0 0 0 2024-04-20T21:58:41.187 INFO:tasks.workunit.client.0.smithi142.stdout:3/813: dread d6/d15/f5e [4194304,4194304] 0 2024-04-20T21:58:41.189 INFO:tasks.workunit.client.0.smithi142.stdout:2/865: readlink d3/d9/d69/d104/l4f 0 2024-04-20T21:58:41.189 INFO:tasks.workunit.client.0.smithi142.stdout:7/835: fdatasync d4/d7f/d77/d78/d9b/dc1/dd4/fd9 0 2024-04-20T21:58:41.196 INFO:tasks.workunit.client.0.smithi142.stdout:3/814: symlink d6/d15/d47/d83/dc9/l120 0 2024-04-20T21:58:41.202 INFO:tasks.workunit.client.0.smithi142.stdout:7/836: creat d4/d7f/d77/d11a/f127 x:0 0 0 2024-04-20T21:58:41.208 INFO:tasks.workunit.client.0.smithi142.stdout:7/837: write d4/d7f/d77/d78/d9b/dc1/f117 [118816,115658] 0 2024-04-20T21:58:41.213 INFO:tasks.workunit.client.0.smithi142.stdout:1/710: dread d2/dd/d1c/d60/f72 [0,4194304] 0 2024-04-20T21:58:41.222 INFO:tasks.workunit.client.0.smithi142.stdout:7/838: symlink d4/d7f/d77/d78/da8/dae/db3/dec/l128 0 2024-04-20T21:58:41.226 INFO:tasks.workunit.client.0.smithi142.stdout:1/711: rename d2/dd/d17/d3b/lba to d2/dd/d1c/d60/dce/d7c/de7/lec 0 2024-04-20T21:58:41.229 INFO:tasks.workunit.client.0.smithi142.stdout:7/839: chown d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/f81 21 1 2024-04-20T21:58:41.239 INFO:tasks.workunit.client.0.smithi142.stdout:7/840: rename d4/d7f/d77/d78/d9b/d5a/f76 to d4/d7f/d77/d78/da8/dae/f129 0 2024-04-20T21:58:41.242 INFO:tasks.workunit.client.0.smithi142.stdout:1/712: dwrite d2/dd/d1c/d60/fdb [0,4194304] 0 2024-04-20T21:58:41.249 INFO:tasks.workunit.client.0.smithi142.stdout:9/744: write d0/fd8 [1989306,116538] 0 2024-04-20T21:58:41.254 INFO:tasks.workunit.client.0.smithi142.stdout:1/713: rename d2/f6 to d2/dd/d1c/d60/fed 0 2024-04-20T21:58:41.254 INFO:tasks.workunit.client.0.smithi142.stdout:9/745: readlink d0/d2a/d8b/lad 0 2024-04-20T21:58:41.257 INFO:tasks.workunit.client.0.smithi142.stdout:1/714: unlink d2/dd/d17/d1b/d22/d13/c9c 0 2024-04-20T21:58:41.265 INFO:tasks.workunit.client.0.smithi142.stdout:9/746: creat d0/d2a/ffc x:0 0 0 2024-04-20T21:58:41.268 INFO:tasks.workunit.client.0.smithi142.stdout:2/866: dwrite d3/d5/fdd [0,4194304] 0 2024-04-20T21:58:41.270 INFO:tasks.workunit.client.0.smithi142.stdout:3/815: truncate d6/d15/d1e/d43/f10a 232535 0 2024-04-20T21:58:41.287 INFO:tasks.workunit.client.0.smithi142.stdout:7/841: write d4/d7d/f5c [231173,68039] 0 2024-04-20T21:58:41.304 INFO:tasks.workunit.client.0.smithi142.stdout:1/715: unlink d2/dd/d17/fe9 0 2024-04-20T21:58:41.305 INFO:tasks.workunit.client.0.smithi142.stdout:2/867: mknod d3/d9/d89/d31/da2/c129 0 2024-04-20T21:58:41.306 INFO:tasks.workunit.client.0.smithi142.stdout:2/868: fsync d3/d9/df5/f100 0 2024-04-20T21:58:41.307 INFO:tasks.workunit.client.0.smithi142.stdout:3/816: creat d6/d15/d30/d37/d6c/d7e/f121 x:0 0 0 2024-04-20T21:58:41.309 INFO:tasks.workunit.client.0.smithi142.stdout:7/842: read d4/d7f/d77/d78/da8/f55 [187578,40987] 0 2024-04-20T21:58:41.312 INFO:tasks.workunit.client.0.smithi142.stdout:1/716: mkdir d2/d4e/d7e/dee 0 2024-04-20T21:58:41.314 INFO:tasks.workunit.client.0.smithi142.stdout:2/869: symlink d3/d9/d89/d31/dc3/dce/dea/d112/l12a 0 2024-04-20T21:58:41.314 INFO:tasks.workunit.client.0.smithi142.stdout:7/843: chown d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/d8e/l72 1089 1 2024-04-20T21:58:41.315 INFO:tasks.workunit.client.0.smithi142.stdout:3/817: mkdir d6/d15/d30/d37/d6c/d7e/d10b/d122 0 2024-04-20T21:58:41.316 INFO:tasks.workunit.client.0.smithi142.stdout:2/870: read d3/d5/f4b [2368756,36903] 0 2024-04-20T21:58:41.318 INFO:tasks.workunit.client.0.smithi142.stdout:3/818: chown d6/d32/d39/d69/f85 11501 1 2024-04-20T21:58:41.319 INFO:tasks.workunit.client.0.smithi142.stdout:2/871: chown d3/d9/d34/db5/dc2/cd2 12 1 2024-04-20T21:58:41.321 INFO:tasks.workunit.client.0.smithi142.stdout:7/844: dread d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/f69 [0,4194304] 0 2024-04-20T21:58:41.321 INFO:tasks.workunit.client.0.smithi142.stdout:2/872: read d3/d9/d89/d31/da2/fd8 [2775926,9123] 0 2024-04-20T21:58:41.324 INFO:tasks.workunit.client.0.smithi142.stdout:1/717: creat d2/dd/d17/d3b/fef x:0 0 0 2024-04-20T21:58:41.324 INFO:tasks.workunit.client.0.smithi142.stdout:7/845: chown d4/d7d/c4b 51 1 2024-04-20T21:58:41.326 INFO:tasks.workunit.client.0.smithi142.stdout:7/846: readlink d4/d7f/d77/d78/da8/dae/l10c 0 2024-04-20T21:58:41.330 INFO:tasks.workunit.client.0.smithi142.stdout:2/873: rmdir d3/d9/d89/d31/da2/ddb/de0 39 2024-04-20T21:58:41.332 INFO:tasks.workunit.client.0.smithi142.stdout:2/874: chown d3/d9/d89/f2d 105678 1 2024-04-20T21:58:41.334 INFO:tasks.workunit.client.0.smithi142.stdout:3/819: dread d6/d15/d47/d83/dc9/da7/fd1 [0,4194304] 0 2024-04-20T21:58:41.340 INFO:tasks.workunit.client.0.smithi142.stdout:1/718: symlink d2/dd/d17/d3b/d50/lf0 0 2024-04-20T21:58:41.358 INFO:tasks.workunit.client.0.smithi142.stdout:2/875: dwrite d3/d9/f49 [0,4194304] 0 2024-04-20T21:58:41.359 INFO:tasks.workunit.client.0.smithi142.stdout:3/820: dwrite d6/d15/d30/d37/f60 [0,4194304] 0 2024-04-20T21:58:41.362 INFO:tasks.workunit.client.0.smithi142.stdout:3/821: readlink d6/d15/d30/db4/ld9 0 2024-04-20T21:58:41.362 INFO:tasks.workunit.client.0.smithi142.stdout:9/747: truncate d0/f8 1632004 0 2024-04-20T21:58:41.365 INFO:tasks.workunit.client.0.smithi142.stdout:9/748: dread - d0/d36/d55/fec zero size 2024-04-20T21:58:41.373 INFO:tasks.workunit.client.0.smithi142.stdout:3/822: truncate d6/d15/d1e/f87 1278636 0 2024-04-20T21:58:41.376 INFO:tasks.workunit.client.0.smithi142.stdout:2/876: truncate d3/d9/d69/d104/d70/d3c/f36 5516498 0 2024-04-20T21:58:41.387 INFO:tasks.workunit.client.0.smithi142.stdout:2/877: dread - d3/d9/d89/d31/de1/f123 zero size 2024-04-20T21:58:41.390 INFO:tasks.workunit.client.0.smithi142.stdout:7/847: dwrite d4/d7f/d77/d78/d9b/d5a/d90/df8/fe4 [0,4194304] 0 2024-04-20T21:58:41.396 INFO:tasks.workunit.client.0.smithi142.stdout:9/749: dwrite d0/d2a/f34 [0,4194304] 0 2024-04-20T21:58:41.402 INFO:tasks.workunit.client.0.smithi142.stdout:1/719: dwrite d2/dd/d17/d1b/d22/f2f [4194304,4194304] 0 2024-04-20T21:58:41.403 INFO:tasks.workunit.client.0.smithi142.stdout:7/848: stat d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d11/l6b 0 2024-04-20T21:58:41.407 INFO:tasks.workunit.client.0.smithi142.stdout:1/720: chown d2/dd/d17/f24 5855613 1 2024-04-20T21:58:41.415 INFO:tasks.workunit.client.0.smithi142.stdout:9/750: mkdir d0/d89/d95/de4/dfd 0 2024-04-20T21:58:41.418 INFO:tasks.workunit.client.0.smithi142.stdout:7/849: creat d4/d7f/f12a x:0 0 0 2024-04-20T21:58:41.425 INFO:tasks.workunit.client.0.smithi142.stdout:3/823: dwrite d6/d32/f52 [0,4194304] 0 2024-04-20T21:58:41.434 INFO:tasks.workunit.client.0.smithi142.stdout:1/721: fdatasync d2/dd/d1c/d60/dce/f6d 0 2024-04-20T21:58:41.443 INFO:tasks.workunit.client.0.smithi142.stdout:9/751: rename d0/d89/fba to d0/d89/ffe 0 2024-04-20T21:58:41.444 INFO:tasks.workunit.client.0.smithi142.stdout:9/752: chown d0/d36/d55 124520824 1 2024-04-20T21:58:41.446 INFO:tasks.workunit.client.0.smithi142.stdout:2/878: write d3/d5/d67/fde [9311,73918] 0 2024-04-20T21:58:41.448 INFO:tasks.workunit.client.0.smithi142.stdout:3/824: mknod d6/d15/d1e/d43/d4d/d59/df6/c123 0 2024-04-20T21:58:41.450 INFO:tasks.workunit.client.0.smithi142.stdout:7/850: rmdir d4/d7f 39 2024-04-20T21:58:41.452 INFO:tasks.workunit.client.0.smithi142.stdout:1/722: mkdir d2/dd/d1c/d60/dce/d7c/df1 0 2024-04-20T21:58:41.456 INFO:tasks.workunit.client.0.smithi142.stdout:1/723: truncate d2/dd/d17/d1b/f71 365407 0 2024-04-20T21:58:41.458 INFO:tasks.workunit.client.0.smithi142.stdout:2/879: rmdir d3/d9/d89/d31 39 2024-04-20T21:58:41.472 INFO:tasks.workunit.client.0.smithi142.stdout:9/753: write d0/d2a/d39/d87/f8d [335996,66030] 0 2024-04-20T21:58:41.473 INFO:tasks.workunit.client.0.smithi142.stdout:1/724: rmdir d2/dd/d1c/d60/dce/d7c/df1 0 2024-04-20T21:58:41.475 INFO:tasks.workunit.client.0.smithi142.stdout:3/825: write d6/d15/d30/d37/f115 [1478745,25377] 0 2024-04-20T21:58:41.477 INFO:tasks.workunit.client.0.smithi142.stdout:9/754: chown d0/d2a/d39/d50/fe6 170147052 1 2024-04-20T21:58:41.480 INFO:tasks.workunit.client.0.smithi142.stdout:9/755: fsync d0/d2a/f30 0 2024-04-20T21:58:41.480 INFO:tasks.workunit.client.0.smithi142.stdout:3/826: write d6/d15/d30/f73 [3174714,29676] 0 2024-04-20T21:58:41.488 INFO:tasks.workunit.client.0.smithi142.stdout:2/880: dwrite d3/d9/d89/d31/dc3/dce/ff2 [0,4194304] 0 2024-04-20T21:58:41.488 INFO:tasks.workunit.client.0.smithi142.stdout:1/725: symlink d2/dd/d17/d3b/d50/d62/lf2 0 2024-04-20T21:58:41.489 INFO:tasks.workunit.client.0.smithi142.stdout:7/851: fsync d4/d7f/d77/d78/d9b/d5a/d90/dbc/fcd 0 2024-04-20T21:58:41.489 INFO:tasks.workunit.client.0.smithi142.stdout:1/726: fdatasync d2/d4e/fc8 0 2024-04-20T21:58:41.501 INFO:tasks.workunit.client.0.smithi142.stdout:2/881: creat d3/d9/db6/de3/f12b x:0 0 0 2024-04-20T21:58:41.501 INFO:tasks.workunit.client.0.smithi142.stdout:2/882: rename d3/d9 to d3/d9/d89/d9a/d12c 22 2024-04-20T21:58:41.510 INFO:tasks.workunit.client.0.smithi142.stdout:9/756: unlink d0/d91/da0/lcf 0 2024-04-20T21:58:41.514 INFO:tasks.workunit.client.0.smithi142.stdout:2/883: write d3/d9/d89/d31/f92 [4535575,27447] 0 2024-04-20T21:58:41.516 INFO:tasks.workunit.client.0.smithi142.stdout:9/757: dread - d0/d2a/fbd zero size 2024-04-20T21:58:41.519 INFO:tasks.workunit.client.0.smithi142.stdout:1/727: getdents d2/de5 0 2024-04-20T21:58:41.522 INFO:tasks.workunit.client.0.smithi142.stdout:1/728: chown d2/dd/d17/d1b/f5f 15728548 1 2024-04-20T21:58:41.527 INFO:tasks.workunit.client.0.smithi142.stdout:1/729: stat d2/dd/d17/d1b/d22/d55/ld2 0 2024-04-20T21:58:41.531 INFO:tasks.workunit.client.0.smithi142.stdout:3/827: dread d6/d15/d1e/d43/d4d/d59/f62 [0,4194304] 0 2024-04-20T21:58:41.533 INFO:tasks.workunit.client.0.smithi142.stdout:3/828: write d6/f9c [3420000,48842] 0 2024-04-20T21:58:41.541 INFO:tasks.workunit.client.0.smithi142.stdout:9/758: creat d0/d3c/fff x:0 0 0 2024-04-20T21:58:41.541 INFO:tasks.workunit.client.0.smithi142.stdout:7/852: dread d4/d7f/d77/d78/d9b/d5a/d90/df8/ff0 [0,4194304] 0 2024-04-20T21:58:41.541 INFO:tasks.workunit.client.0.smithi142.stdout:1/730: rename d2/la to d2/dd/d17/d8b/lf3 0 2024-04-20T21:58:41.542 INFO:tasks.workunit.client.0.smithi142.stdout:1/731: readlink d2/d4e/d7e/lc0 0 2024-04-20T21:58:41.542 INFO:tasks.workunit.client.0.smithi142.stdout:7/853: creat d4/dd3/f12b x:0 0 0 2024-04-20T21:58:41.542 INFO:tasks.workunit.client.0.smithi142.stdout:9/759: mknod d0/d89/c100 0 2024-04-20T21:58:41.542 INFO:tasks.workunit.client.0.smithi142.stdout:2/884: link d3/d9/d89/d31/f73 d3/d9/db6/de4/f12d 0 2024-04-20T21:58:41.543 INFO:tasks.workunit.client.0.smithi142.stdout:9/760: write d0/d2a/d39/f6d [1482450,56435] 0 2024-04-20T21:58:41.545 INFO:tasks.workunit.client.0.smithi142.stdout:7/854: creat d4/d7f/d77/d78/da8/dae/dd8/f12c x:0 0 0 2024-04-20T21:58:41.547 INFO:tasks.workunit.client.0.smithi142.stdout:2/885: chown d3/d9/d34/db5/dc2/l116 1 1 2024-04-20T21:58:41.547 INFO:tasks.workunit.client.0.smithi142.stdout:3/829: creat d6/f124 x:0 0 0 2024-04-20T21:58:41.547 INFO:tasks.workunit.client.0.smithi142.stdout:9/761: read d0/d3c/f6f [115269,116882] 0 2024-04-20T21:58:41.549 INFO:tasks.workunit.client.0.smithi142.stdout:1/732: creat d2/dd/d1c/d60/dce/d7c/ddd/ff4 x:0 0 0 2024-04-20T21:58:41.552 INFO:tasks.workunit.client.0.smithi142.stdout:9/762: chown d0/d36/l3e 134 1 2024-04-20T21:58:41.553 INFO:tasks.workunit.client.0.smithi142.stdout:2/886: creat d3/d9/db6/de4/f12e x:0 0 0 2024-04-20T21:58:41.555 INFO:tasks.workunit.client.0.smithi142.stdout:3/830: symlink d6/d32/d39/d69/de0/l125 0 2024-04-20T21:58:41.557 INFO:tasks.workunit.client.0.smithi142.stdout:2/887: write d3/d9/d89/f10e [286672,35690] 0 2024-04-20T21:58:41.558 INFO:tasks.workunit.client.0.smithi142.stdout:9/763: creat d0/d2a/d39/d87/f101 x:0 0 0 2024-04-20T21:58:41.560 INFO:tasks.workunit.client.0.smithi142.stdout:3/831: chown d6/d15/d47/d83/dc9/da7 12 1 2024-04-20T21:58:41.562 INFO:tasks.workunit.client.0.smithi142.stdout:1/733: rename d2/dd/d17/d1b/lae to d2/dd/d17/d1b/lf5 0 2024-04-20T21:58:41.565 INFO:tasks.workunit.client.0.smithi142.stdout:2/888: creat d3/d9/d34/db5/f12f x:0 0 0 2024-04-20T21:58:41.566 INFO:tasks.workunit.client.0.smithi142.stdout:3/832: mkdir d6/d32/de7/d126 0 2024-04-20T21:58:41.567 INFO:tasks.workunit.client.0.smithi142.stdout:9/764: symlink d0/d3c/d4d/d63/d80/dca/dcc/l102 0 2024-04-20T21:58:41.569 INFO:tasks.workunit.client.0.smithi142.stdout:1/734: unlink d2/dd/d17/d1b/d22/d20/f4c 0 2024-04-20T21:58:41.570 INFO:tasks.workunit.client.0.smithi142.stdout:9/765: write d0/d36/f4c [5214923,59380] 0 2024-04-20T21:58:41.573 INFO:tasks.workunit.client.0.smithi142.stdout:3/833: truncate d6/d32/d39/d69/d91/ff0 1323462 0 2024-04-20T21:58:41.574 INFO:tasks.workunit.client.0.smithi142.stdout:9/766: write d0/d89/d95/de4/feb [449674,92571] 0 2024-04-20T21:58:41.575 INFO:tasks.workunit.client.0.smithi142.stdout:1/735: chown d2/dd/d17/d1b/d22/d13/cd6 49754862 1 2024-04-20T21:58:41.584 INFO:tasks.workunit.client.0.smithi142.stdout:5/689: sync 2024-04-20T21:58:41.584 INFO:tasks.workunit.client.0.smithi142.stdout:6/694: sync 2024-04-20T21:58:41.585 INFO:tasks.workunit.client.0.smithi142.stdout:4/653: sync 2024-04-20T21:58:41.585 INFO:tasks.workunit.client.0.smithi142.stdout:0/680: sync 2024-04-20T21:58:41.585 INFO:tasks.workunit.client.0.smithi142.stdout:8/745: sync 2024-04-20T21:58:41.585 INFO:tasks.workunit.client.0.smithi142.stdout:1/736: readlink d2/dd/d17/d1b/d22/d55/ld2 0 2024-04-20T21:58:41.585 INFO:tasks.workunit.client.0.smithi142.stdout:3/834: mkdir d6/d32/d39/d69/d91/d127 0 2024-04-20T21:58:41.588 INFO:tasks.workunit.client.0.smithi142.stdout:0/681: readlink d5/d1d/d7e/l98 0 2024-04-20T21:58:41.589 INFO:tasks.workunit.client.0.smithi142.stdout:7/855: dread d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/f4a [0,4194304] 0 2024-04-20T21:58:41.589 INFO:tasks.workunit.client.0.smithi142.stdout:6/695: stat d1/d2f/d35/d5b/d63/d64/fda 0 2024-04-20T21:58:41.589 INFO:tasks.workunit.client.0.smithi142.stdout:4/654: creat d1/d6/d30/fc9 x:0 0 0 2024-04-20T21:58:41.589 INFO:tasks.workunit.client.0.smithi142.stdout:1/737: chown d2/dd/d17/c41 461865 1 2024-04-20T21:58:41.600 INFO:tasks.workunit.client.0.smithi142.stdout:6/696: readlink d1/ld6 0 2024-04-20T21:58:41.601 INFO:tasks.workunit.client.0.smithi142.stdout:8/746: mknod d0/d1c/d44/d89/d45/d4c/c102 0 2024-04-20T21:58:41.602 INFO:tasks.workunit.client.0.smithi142.stdout:0/682: write d5/d13/d1e/d23/fa6 [3247162,51798] 0 2024-04-20T21:58:41.605 INFO:tasks.workunit.client.0.smithi142.stdout:6/697: write d1/d2f/d35/d5b/d39/dcd/fdd [458189,30311] 0 2024-04-20T21:58:41.609 INFO:tasks.workunit.client.0.smithi142.stdout:1/738: symlink d2/dd/d1c/d88/d89/db1/lf6 0 2024-04-20T21:58:41.618 INFO:tasks.workunit.client.0.smithi142.stdout:4/655: dread d1/d12/da/f18 [4194304,4194304] 0 2024-04-20T21:58:41.619 INFO:tasks.workunit.client.0.smithi142.stdout:0/683: creat d5/d1d/d7e/db0/dd0/fdb x:0 0 0 2024-04-20T21:58:41.619 INFO:tasks.workunit.client.0.smithi142.stdout:3/835: rename d6/d15/d30/d37/c41 to d6/d15/d1e/d43/c128 0 2024-04-20T21:58:41.621 INFO:tasks.workunit.client.0.smithi142.stdout:4/656: chown d1/d6/d4a/f9a 2076645 1 2024-04-20T21:58:41.625 INFO:tasks.workunit.client.0.smithi142.stdout:0/684: rmdir d5/d45 39 2024-04-20T21:58:41.626 INFO:tasks.workunit.client.0.smithi142.stdout:6/698: dwrite d1/d2f/d35/d48/fe4 [0,4194304] 0 2024-04-20T21:58:41.630 INFO:tasks.workunit.client.0.smithi142.stdout:5/690: rename dc/d71/d93/fbc to dc/d14/d21/d46/d7d/db0/ff4 0 2024-04-20T21:58:41.632 INFO:tasks.workunit.client.0.smithi142.stdout:9/767: dread d0/d89/fa2 [0,4194304] 0 2024-04-20T21:58:41.634 INFO:tasks.workunit.client.0.smithi142.stdout:9/768: readlink d0/d3c/d4d/l88 0 2024-04-20T21:58:41.637 INFO:tasks.workunit.client.0.smithi142.stdout:8/747: getdents d0/d17 0 2024-04-20T21:58:41.639 INFO:tasks.workunit.client.0.smithi142.stdout:1/739: link d2/dd/d17/d1b/d22/d13/l2b d2/dd/d1c/d88/d89/lf7 0 2024-04-20T21:58:41.645 INFO:tasks.workunit.client.0.smithi142.stdout:5/691: unlink dc/d14/d21/f27 0 2024-04-20T21:58:41.645 INFO:tasks.workunit.client.0.smithi142.stdout:4/657: dwrite d1/d6/fc7 [0,4194304] 0 2024-04-20T21:58:41.654 INFO:tasks.workunit.client.0.smithi142.stdout:7/856: rename d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7/df1/d1c/c4c to d4/d7f/d77/d11a/c12d 0 2024-04-20T21:58:41.658 INFO:tasks.workunit.client.0.smithi142.stdout:0/685: creat d5/d13/d1e/d23/d24/fdc x:0 0 0 2024-04-20T21:58:41.667 INFO:tasks.workunit.client.0.smithi142.stdout:3/836: write d6/fc [1855448,80028] 0 2024-04-20T21:58:41.667 INFO:tasks.workunit.client.0.smithi142.stdout:9/769: dwrite d0/d89/d95/de4/feb [0,4194304] 0 2024-04-20T21:58:41.667 INFO:tasks.workunit.client.0.smithi142.stdout:3/837: fdatasync d6/d32/d39/d69/d91/f106 0 2024-04-20T21:58:41.668 INFO:tasks.workunit.client.0.smithi142.stdout:7/857: mknod d4/d7f/c12e 0 2024-04-20T21:58:41.670 INFO:tasks.workunit.client.0.smithi142.stdout:4/658: mknod d1/d12/da/d1c/d32/cca 0 2024-04-20T21:58:41.674 INFO:tasks.workunit.client.0.smithi142.stdout:0/686: chown d5/d45/d6f/f5b 0 1 2024-04-20T21:58:41.678 INFO:tasks.workunit.client.0.smithi142.stdout:1/740: creat d2/dd/d17/d1b/d22/ff8 x:0 0 0 2024-04-20T21:58:41.682 INFO:tasks.workunit.client.0.smithi142.stdout:6/699: rename d1/d5/d3a/d43/c7d to d1/d2f/d35/d5b/d63/d64/cfa 0 2024-04-20T21:58:41.683 INFO:tasks.workunit.client.0.smithi142.stdout:8/748: dwrite d0/d5e/f81 [0,4194304] 0 2024-04-20T21:58:41.685 INFO:tasks.workunit.client.0.smithi142.stdout:3/838: mknod d6/d15/d30/d37/d75/c129 0 2024-04-20T21:58:41.687 INFO:tasks.workunit.client.0.smithi142.stdout:4/659: mknod d1/d6/ccb 0 2024-04-20T21:58:41.687 INFO:tasks.workunit.client.0.smithi142.stdout:1/741: mkdir d2/dd/d17/d1b/d22/d55/df9 0 2024-04-20T21:58:41.690 INFO:tasks.workunit.client.0.smithi142.stdout:5/692: getdents dc/d14/d26/d3f/d53/d7c/d97/da6 0 2024-04-20T21:58:41.690 INFO:tasks.workunit.client.0.smithi142.stdout:6/700: readlink d1/d5/l10 0 2024-04-20T21:58:41.695 INFO:tasks.workunit.client.0.smithi142.stdout:7/858: rename d4/d7f/d77/d78/d9b/d5a/d90/dbc/dd7 to d4/d7f/d77/d7e/db2/d12f 0 2024-04-20T21:58:41.695 INFO:tasks.workunit.client.0.smithi142.stdout:9/770: read d0/d3c/d4d/d63/f65 [1751656,109770] 0 2024-04-20T21:58:41.695 INFO:tasks.workunit.client.0.smithi142.stdout:5/693: mknod dc/d14/d26/d3f/cf5 0 2024-04-20T21:58:41.695 INFO:tasks.workunit.client.0.smithi142.stdout:4/660: write d1/d12/da/d1c/d32/d3d/d2f/d49/f75 [733991,193] 0 2024-04-20T21:58:41.696 INFO:tasks.workunit.client.0.smithi142.stdout:5/694: readlink dc/d71/l70 0 2024-04-20T21:58:41.696 INFO:tasks.workunit.client.0.smithi142.stdout:5/695: readlink dc/d14/d26/l4c 0 2024-04-20T21:58:41.700 INFO:tasks.workunit.client.0.smithi142.stdout:4/661: read d1/d6/d30/f3a [11804,126326] 0 2024-04-20T21:58:41.700 INFO:tasks.workunit.client.0.smithi142.stdout:5/696: stat dc/d14/d25/d89/d9a/cab 0 2024-04-20T21:58:41.700 INFO:tasks.workunit.client.0.smithi142.stdout:8/749: rename d0/d1c/d44/dad/db3/d3f/d7f/d8f/ffb to d0/d5e/f103 0 2024-04-20T21:58:41.702 INFO:tasks.workunit.client.0.smithi142.stdout:4/662: chown d1/d12/da/d1c/d32/d3d/d2f/d52/d94/fbc 1769 1 2024-04-20T21:58:41.707 INFO:tasks.workunit.client.0.smithi142.stdout:1/742: unlink d2/dd/d17/d1b/d22/d13/l2b 0 2024-04-20T21:58:41.708 INFO:tasks.workunit.client.0.smithi142.stdout:9/771: mkdir d0/d3c/d4d/d103 0 2024-04-20T21:58:41.709 INFO:tasks.workunit.client.0.smithi142.stdout:6/701: creat d1/d2f/d35/d5b/d63/d64/de1/ffb x:0 0 0 2024-04-20T21:58:41.710 INFO:tasks.workunit.client.0.smithi142.stdout:7/859: mkdir d4/d7f/d77/d7e/db2/d12f/df1/d11/d116/d130 0 2024-04-20T21:58:41.710 INFO:tasks.workunit.client.0.smithi142.stdout:6/702: chown d1/d5/l10 232416 1 2024-04-20T21:58:41.711 INFO:tasks.workunit.client.0.smithi142.stdout:0/687: dwrite d5/f9 [4194304,4194304] 0 2024-04-20T21:58:41.712 INFO:tasks.workunit.client.0.smithi142.stdout:5/697: unlink f2 0 2024-04-20T21:58:41.712 INFO:tasks.workunit.client.0.smithi142.stdout:3/839: rename d6/f9c to d6/d15/d1e/d43/d4d/d59/df6/f12a 0 2024-04-20T21:58:41.713 INFO:tasks.workunit.client.0.smithi142.stdout:6/703: write d1/d2f/d35/d5b/d3e/de0/d7e/fe3 [65303,67533] 0 2024-04-20T21:58:41.720 INFO:tasks.workunit.client.0.smithi142.stdout:9/772: readlink d0/l2b 0 2024-04-20T21:58:41.720 INFO:tasks.workunit.client.0.smithi142.stdout:0/688: chown d5/d1c/d3c/d85/d38/d62 21 1 2024-04-20T21:58:41.722 INFO:tasks.workunit.client.0.smithi142.stdout:9/773: write d0/f14 [69557,114908] 0 2024-04-20T21:58:41.723 INFO:tasks.workunit.client.0.smithi142.stdout:8/750: link d0/f9a d0/d5e/de5/f104 0 2024-04-20T21:58:41.725 INFO:tasks.workunit.client.0.smithi142.stdout:3/840: mknod d6/d32/d39/d69/de0/c12b 0 2024-04-20T21:58:41.727 INFO:tasks.workunit.client.0.smithi142.stdout:8/751: fdatasync d0/d1c/d44/d89/d45/d4c/f77 0 2024-04-20T21:58:41.730 INFO:tasks.workunit.client.0.smithi142.stdout:7/860: dread d4/d7f/d77/d78/d9b/d5a/d90/dbc/fcd [0,4194304] 0 2024-04-20T21:58:41.730 INFO:tasks.workunit.client.0.smithi142.stdout:1/743: link d2/dd/cde d2/dd/d17/d1b/d22/d55/cfa 0 2024-04-20T21:58:41.734 INFO:tasks.workunit.client.0.smithi142.stdout:3/841: write d6/d15/d47/fca [865985,86968] 0 2024-04-20T21:58:41.734 INFO:tasks.workunit.client.0.smithi142.stdout:8/752: fsync d0/d1c/d44/f62 0 2024-04-20T21:58:41.739 INFO:tasks.workunit.client.0.smithi142.stdout:9/774: rename d0/l12 to d0/d2a/dd4/l104 0 2024-04-20T21:58:41.742 INFO:tasks.workunit.client.0.smithi142.stdout:1/744: read d2/dd/d17/d3b/d50/f52 [596802,7446] 0 2024-04-20T21:58:41.744 INFO:tasks.workunit.client.0.smithi142.stdout:3/842: write d6/d15/d1e/d43/d4d/d59/df6/f12a [3360476,57689] 0 2024-04-20T21:58:41.744 INFO:tasks.workunit.client.0.smithi142.stdout:8/753: truncate d0/d1c/d44/d89/d45/d4c/d68/fa6 489087 0 2024-04-20T21:58:41.746 INFO:tasks.workunit.client.0.smithi142.stdout:9/775: mkdir d0/d89/d95/d105 0 2024-04-20T21:58:41.750 INFO:tasks.workunit.client.0.smithi142.stdout:7/861: rename d4/d7f/d77/d78/d9b/d5a/d90/dbc to d4/d7f/d77/d78/da8/dae/dd8/d131 0 2024-04-20T21:58:41.750 INFO:tasks.workunit.client.0.smithi142.stdout:0/689: link d5/d1c/l37 d5/d1c/d3c/d85/d38/ldd 0 2024-04-20T21:58:41.758 INFO:tasks.workunit.client.0.smithi142.stdout:0/690: dread d5/d1c/d3c/d8b/fba [0,4194304] 0 2024-04-20T21:58:41.767 INFO:tasks.workunit.client.0.smithi142.stdout:9/776: dwrite d0/d2a/d39/d50/f5b [0,4194304] 0 2024-04-20T21:58:41.771 INFO:tasks.workunit.client.0.smithi142.stdout:9/777: read - d0/d3c/fff zero size 2024-04-20T21:58:41.777 INFO:tasks.workunit.client.0.smithi142.stdout:5/698: dwrite dc/f2f [0,4194304] 0 2024-04-20T21:58:41.777 INFO:tasks.workunit.client.0.smithi142.stdout:1/745: mknod d2/cfb 0 2024-04-20T21:58:41.780 INFO:tasks.workunit.client.0.smithi142.stdout:3/843: dwrite d6/d15/d1e/d43/fa5 [0,4194304] 0 2024-04-20T21:58:41.798 INFO:tasks.workunit.client.0.smithi142.stdout:1/746: creat d2/d4e/d7e/dbf/ffc x:0 0 0 2024-04-20T21:58:41.799 INFO:tasks.workunit.client.0.smithi142.stdout:8/754: rmdir d0/d1c/df9 0 2024-04-20T21:58:41.803 INFO:tasks.workunit.client.0.smithi142.stdout:0/691: symlink d5/lde 0 2024-04-20T21:58:41.806 INFO:tasks.workunit.client.0.smithi142.stdout:0/692: chown d5/d13/d1e/d23/d24/fdc 30 1 2024-04-20T21:58:41.807 INFO:tasks.workunit.client.0.smithi142.stdout:7/862: creat d4/d7f/d77/d7e/db2/d12f/df1/d1c/f132 x:0 0 0 2024-04-20T21:58:41.813 INFO:tasks.workunit.client.0.smithi142.stdout:5/699: rename dc/d14/f1a to dc/d14/d26/ff6 0 2024-04-20T21:58:41.814 INFO:tasks.workunit.client.0.smithi142.stdout:5/700: stat dc/d14/f59 0 2024-04-20T21:58:41.819 INFO:tasks.workunit.client.0.smithi142.stdout:0/693: fsync d5/d1c/d3c/d85/d63/f64 0 2024-04-20T21:58:41.819 INFO:tasks.workunit.client.0.smithi142.stdout:9/778: link d0/d3c/d4d/d63/d80/fae d0/d2a/d39/f106 0 2024-04-20T21:58:41.820 INFO:tasks.workunit.client.0.smithi142.stdout:5/701: mkdir dc/d14/d25/db4/df7 0 2024-04-20T21:58:41.821 INFO:tasks.workunit.client.0.smithi142.stdout:7/863: mknod d4/d7f/d77/d7e/db2/d12f/df1/d11/c133 0 2024-04-20T21:58:41.827 INFO:tasks.workunit.client.0.smithi142.stdout:9/779: unlink d0/d2a/d9c/lb8 0 2024-04-20T21:58:41.830 INFO:tasks.workunit.client.0.smithi142.stdout:1/747: creat d2/dd/d17/ffd x:0 0 0 2024-04-20T21:58:41.833 INFO:tasks.workunit.client.0.smithi142.stdout:0/694: dread d5/d13/d1e/d23/d24/f2a [0,4194304] 0 2024-04-20T21:58:41.834 INFO:tasks.workunit.client.0.smithi142.stdout:7/864: mkdir d4/d7f/d77/d78/da8/dae/dd8/d131/d134 0 2024-04-20T21:58:41.835 INFO:tasks.workunit.client.0.smithi142.stdout:3/844: dwrite d6/d15/d30/d37/d6c/dcd/f98 [0,4194304] 0 2024-04-20T21:58:41.839 INFO:tasks.workunit.client.0.smithi142.stdout:1/748: mknod d2/d4e/cfe 0 2024-04-20T21:58:41.840 INFO:tasks.workunit.client.0.smithi142.stdout:5/702: symlink dc/d14/d26/d3f/d53/d7c/d97/da6/dc7/lf8 0 2024-04-20T21:58:41.841 INFO:tasks.workunit.client.0.smithi142.stdout:0/695: creat d5/d45/d6f/fdf x:0 0 0 2024-04-20T21:58:41.842 INFO:tasks.workunit.client.0.smithi142.stdout:7/865: symlink d4/d7f/d77/d78/d9b/dc1/l135 0 2024-04-20T21:58:41.845 INFO:tasks.workunit.client.0.smithi142.stdout:8/755: dwrite d0/d29/f2e [0,4194304] 0 2024-04-20T21:58:41.848 INFO:tasks.workunit.client.0.smithi142.stdout:8/756: write d0/d1c/f2d [3461252,49855] 0 2024-04-20T21:58:41.848 INFO:tasks.workunit.client.0.smithi142.stdout:3/845: rename d6/d32/d39/d69/de0/c12b to d6/d15/d47/d83/d114/c12c 0 2024-04-20T21:58:41.852 INFO:tasks.workunit.client.0.smithi142.stdout:3/846: stat d6/d15/d30/d37/d6c/dcd/d99/fce 0 2024-04-20T21:58:41.853 INFO:tasks.workunit.client.0.smithi142.stdout:9/780: link d0/c18 d0/d89/d95/c107 0 2024-04-20T21:58:41.856 INFO:tasks.workunit.client.0.smithi142.stdout:9/781: chown d0/d3c/d4d/d63/d80/fa4 174 1 2024-04-20T21:58:41.859 INFO:tasks.workunit.client.0.smithi142.stdout:8/757: creat d0/d5e/f105 x:0 0 0 2024-04-20T21:58:41.860 INFO:tasks.workunit.client.0.smithi142.stdout:7/866: mknod d4/d7f/d77/d78/d9b/d105/c136 0 2024-04-20T21:58:41.862 INFO:tasks.workunit.client.0.smithi142.stdout:8/758: chown d0/d1c/l78 255 1 2024-04-20T21:58:41.865 INFO:tasks.workunit.client.0.smithi142.stdout:3/847: mkdir d6/d32/d39/d12d 0 2024-04-20T21:58:41.867 INFO:tasks.workunit.client.0.smithi142.stdout:8/759: dread - d0/d1c/d44/dad/db3/d3f/faf zero size 2024-04-20T21:58:41.868 INFO:tasks.workunit.client.0.smithi142.stdout:7/867: truncate d4/d7f/d77/d78/da8/dae/dd8/f12c 346829 0 2024-04-20T21:58:41.868 INFO:tasks.workunit.client.0.smithi142.stdout:9/782: chown d0/l35 0 1 2024-04-20T21:58:41.871 INFO:tasks.workunit.client.0.smithi142.stdout:0/696: rename d5/ld to d5/d13/d1e/d23/le0 0 2024-04-20T21:58:41.872 INFO:tasks.workunit.client.0.smithi142.stdout:9/783: mknod d0/d2a/c108 0 2024-04-20T21:58:41.881 INFO:tasks.workunit.client.0.smithi142.stdout:3/848: truncate d6/d15/d30/d37/fa1 829906 0 2024-04-20T21:58:41.881 INFO:tasks.workunit.client.0.smithi142.stdout:1/749: dwrite d2/dd/d17/ffd [0,4194304] 0 2024-04-20T21:58:41.882 INFO:tasks.workunit.client.0.smithi142.stdout:7/868: symlink d4/d7f/d77/d78/d9b/d5a/d90/df8/l137 0 2024-04-20T21:58:41.884 INFO:tasks.workunit.client.0.smithi142.stdout:0/697: rmdir d5/d13/d1e/d23/d2c 39 2024-04-20T21:58:41.885 INFO:tasks.workunit.client.0.smithi142.stdout:7/869: fdatasync d4/d7d/da1/fda 0 2024-04-20T21:58:41.890 INFO:tasks.workunit.client.0.smithi142.stdout:7/870: fdatasync d4/d7f/d77/d78/d9b/dc1/dd4/f126 0 2024-04-20T21:58:41.891 INFO:tasks.workunit.client.0.smithi142.stdout:0/698: write d5/d13/d1e/d23/d24/fd5 [514664,111287] 0 2024-04-20T21:58:41.891 INFO:tasks.workunit.client.0.smithi142.stdout:9/784: rename d0/d3c/d4d/d63/d80 to d0/d2a/d39/d50/de5/d109 0 2024-04-20T21:58:41.896 INFO:tasks.workunit.client.0.smithi142.stdout:1/750: chown d2/dd/d17/d1b/d22/d55/la8 30666 1 2024-04-20T21:58:41.898 INFO:tasks.workunit.client.0.smithi142.stdout:5/703: dread dc/d14/d21/d46/d2a/d65/d79/f90 [0,4194304] 0 2024-04-20T21:58:41.900 INFO:tasks.workunit.client.0.smithi142.stdout:9/785: symlink d0/d2a/d8b/l10a 0 2024-04-20T21:58:41.901 INFO:tasks.workunit.client.0.smithi142.stdout:5/704: read - dc/d14/d25/faf zero size 2024-04-20T21:58:41.902 INFO:tasks.workunit.client.0.smithi142.stdout:0/699: unlink d5/d1c/d3c/d85/d32/c9d 0 2024-04-20T21:58:41.905 INFO:tasks.workunit.client.0.smithi142.stdout:7/871: mkdir d4/d7d/d138 0 2024-04-20T21:58:41.907 INFO:tasks.workunit.client.0.smithi142.stdout:5/705: creat dc/d14/d25/db4/ff9 x:0 0 0 2024-04-20T21:58:41.909 INFO:tasks.workunit.client.0.smithi142.stdout:1/751: mkdir d2/dd/d17/d8b/daf/dff 0 2024-04-20T21:58:41.910 INFO:tasks.workunit.client.0.smithi142.stdout:8/760: write d0/d1c/d44/dad/fbc [258167,5579] 0 2024-04-20T21:58:41.913 INFO:tasks.workunit.client.0.smithi142.stdout:9/786: creat d0/d3c/d4d/d103/f10b x:0 0 0 2024-04-20T21:58:41.916 INFO:tasks.workunit.client.0.smithi142.stdout:7/872: rmdir d4/d7f/d77/d78/d9b/dc1/dd4 39 2024-04-20T21:58:41.918 INFO:tasks.workunit.client.0.smithi142.stdout:3/849: write d6/d15/d30/dae/ff8 [4191676,57136] 0 2024-04-20T21:58:41.919 INFO:tasks.workunit.client.0.smithi142.stdout:7/873: chown d4/d7f/d77/d78/d9b/d5a 1 1 2024-04-20T21:58:41.923 INFO:tasks.workunit.client.0.smithi142.stdout:1/752: creat d2/de5/dea/f100 x:0 0 0 2024-04-20T21:58:41.925 INFO:tasks.workunit.client.0.smithi142.stdout:9/787: creat d0/d2a/d39/d87/d9e/f10c x:0 0 0 2024-04-20T21:58:41.927 INFO:tasks.workunit.client.0.smithi142.stdout:0/700: truncate d5/d1c/d3c/d8b/fb5 2044598 0 2024-04-20T21:58:41.929 INFO:tasks.workunit.client.0.smithi142.stdout:3/850: write d6/d15/d30/d37/d6c/dcd/f93 [17010,99750] 0 2024-04-20T21:58:41.931 INFO:tasks.workunit.client.0.smithi142.stdout:5/706: dwrite dc/fd3 [0,4194304] 0 2024-04-20T21:58:41.935 INFO:tasks.workunit.client.0.smithi142.stdout:9/788: read d0/f8 [1324844,26196] 0 2024-04-20T21:58:41.939 INFO:tasks.workunit.client.0.smithi142.stdout:0/701: creat d5/d1c/d3c/d95/fe1 x:0 0 0 2024-04-20T21:58:41.940 INFO:tasks.workunit.client.0.smithi142.stdout:3/851: chown d6/d15/d30/dae/ff8 17268 1 2024-04-20T21:58:41.942 INFO:tasks.workunit.client.0.smithi142.stdout:1/753: chown d2/dd/d17/d1b/d22/d13/c3a 10 1 2024-04-20T21:58:41.943 INFO:tasks.workunit.client.0.smithi142.stdout:8/761: dwrite d0/d17/d35/fdb [0,4194304] 0 2024-04-20T21:58:41.945 INFO:tasks.workunit.client.0.smithi142.stdout:0/702: chown d5/d1c/d3c/d8b/fb4 58 1 2024-04-20T21:58:41.946 INFO:tasks.workunit.client.0.smithi142.stdout:9/789: truncate d0/faf 30074 0 2024-04-20T21:58:41.946 INFO:tasks.workunit.client.0.smithi142.stdout:3/852: fsync d6/d32/d39/d69/ff5 0 2024-04-20T21:58:41.947 INFO:tasks.workunit.client.0.smithi142.stdout:0/703: stat d5/d13/d1e/d23/d24/d48/d55/f74 0 2024-04-20T21:58:41.947 INFO:tasks.workunit.client.0.smithi142.stdout:7/874: rmdir d4/d7f/d77/d78/da8/dae/dd8/d131/d100 0 2024-04-20T21:58:41.951 INFO:tasks.workunit.client.0.smithi142.stdout:3/853: fdatasync d6/d32/f51 0 2024-04-20T21:58:41.954 INFO:tasks.workunit.client.0.smithi142.stdout:9/790: mkdir d0/d2a/d10d 0 2024-04-20T21:58:41.954 INFO:tasks.workunit.client.0.smithi142.stdout:7/875: chown d4/d7f/d77/d7e/db2/d12f/df1/d11 0 1 2024-04-20T21:58:41.957 INFO:tasks.workunit.client.0.smithi142.stdout:5/707: read f4 [185148,30057] 0 2024-04-20T21:58:41.958 INFO:tasks.workunit.client.0.smithi142.stdout:3/854: write d6/f2e [1378809,36662] 0 2024-04-20T21:58:41.962 INFO:tasks.workunit.client.0.smithi142.stdout:0/704: getdents d5/d1c/d3c/d85/d32 0 2024-04-20T21:58:41.966 INFO:tasks.workunit.client.0.smithi142.stdout:5/708: mknod dc/d14/d25/db4/dbb/cfa 0 2024-04-20T21:58:41.968 INFO:tasks.workunit.client.0.smithi142.stdout:1/754: dread d2/dd/d17/d3b/d50/f52 [0,4194304] 0 2024-04-20T21:58:41.972 INFO:tasks.workunit.client.0.smithi142.stdout:3/855: creat d6/d15/d30/d37/d6c/dcd/f12e x:0 0 0 2024-04-20T21:58:41.977 INFO:tasks.workunit.client.0.smithi142.stdout:7/876: rename d4/d7f/d77/d7e/db2/d12f/df1/d1c/f4f to d4/d7f/d77/d7e/db2/d12f/df1/d11/d116/f139 0 2024-04-20T21:58:41.979 INFO:tasks.workunit.client.0.smithi142.stdout:3/856: dread d6/d32/f51 [0,4194304] 0 2024-04-20T21:58:41.982 INFO:tasks.workunit.client.0.smithi142.stdout:5/709: dread dc/d14/d21/d46/d7d/db0/ff4 [0,4194304] 0 2024-04-20T21:58:41.984 INFO:tasks.workunit.client.0.smithi142.stdout:0/705: write d5/f8 [1278617,1989] 0 2024-04-20T21:58:41.989 INFO:tasks.workunit.client.0.smithi142.stdout:8/762: dwrite d0/d1c/d44/d89/d45/d92/fda [0,4194304] 0 2024-04-20T21:58:41.991 INFO:tasks.workunit.client.0.smithi142.stdout:9/791: dwrite d0/d2a/d39/d50/de5/ff8 [0,4194304] 0 2024-04-20T21:58:41.991 INFO:tasks.workunit.client.0.smithi142.stdout:1/755: dread d2/dd/d17/d1b/d22/d20/f2d [0,4194304] 0 2024-04-20T21:58:41.993 INFO:tasks.workunit.client.0.smithi142.stdout:0/706: chown d5/d13/l2d 24098 1 2024-04-20T21:58:41.995 INFO:tasks.workunit.client.0.smithi142.stdout:5/710: write dc/d14/f41 [3997330,100774] 0 2024-04-20T21:58:42.001 INFO:tasks.workunit.client.0.smithi142.stdout:7/877: dread d4/d7f/d77/d78/d9b/dc1/dd4/f10a [0,4194304] 0 2024-04-20T21:58:42.003 INFO:tasks.workunit.client.0.smithi142.stdout:8/763: creat d0/d1c/d44/dad/db3/f106 x:0 0 0 2024-04-20T21:58:42.003 INFO:tasks.workunit.client.0.smithi142.stdout:9/792: creat d0/d3c/f10e x:0 0 0 2024-04-20T21:58:42.006 INFO:tasks.workunit.client.0.smithi142.stdout:1/756: readlink d2/dd/d1c/d88/d89/lf7 0 2024-04-20T21:58:42.009 INFO:tasks.workunit.client.0.smithi142.stdout:3/857: dread d6/d32/f52 [0,4194304] 0 2024-04-20T21:58:42.009 INFO:tasks.workunit.client.0.smithi142.stdout:7/878: rmdir d4/d7f/d77/d11a 39 2024-04-20T21:58:42.013 INFO:tasks.workunit.client.0.smithi142.stdout:8/764: rename d0/d42/fa2 to d0/d17/d35/db5/f107 0 2024-04-20T21:58:42.014 INFO:tasks.workunit.client.0.smithi142.stdout:2/889: sync 2024-04-20T21:58:42.020 INFO:tasks.workunit.client.0.smithi142.stdout:3/858: chown d6/f6a 115859854 1 2024-04-20T21:58:42.022 INFO:tasks.workunit.client.0.smithi142.stdout:7/879: rename d4/d7f/d77/d7e/db2/d12f/df1/d1c/f5f to d4/dd3/f13a 0 2024-04-20T21:58:42.024 INFO:tasks.workunit.client.0.smithi142.stdout:1/757: write d2/dd/d17/d1b/d22/d13/f63 [4089154,84268] 0 2024-04-20T21:58:42.029 INFO:tasks.workunit.client.0.smithi142.stdout:7/880: chown d4/d7f/d77/d7e/db2/d12f/df1/d1c/d8e/d88/fb8 3297389 1 2024-04-20T21:58:42.030 INFO:tasks.workunit.client.0.smithi142.stdout:2/890: link d3/d5/f5e d3/d9/d34/f130 0 2024-04-20T21:58:42.033 INFO:tasks.workunit.client.0.smithi142.stdout:5/711: dread dc/d14/d26/d3f/f9b [0,4194304] 0 2024-04-20T21:58:42.035 INFO:tasks.workunit.client.0.smithi142.stdout:9/793: truncate d0/ff0 114484 0 2024-04-20T21:58:42.036 INFO:tasks.workunit.client.0.smithi142.stdout:2/891: read - d3/d9/d89/d31/d84/f101 zero size 2024-04-20T21:58:42.038 INFO:tasks.workunit.client.0.smithi142.stdout:5/712: stat dc/d14/d26/d3f/db3/lae 0 2024-04-20T21:58:42.039 INFO:tasks.workunit.client.0.smithi142.stdout:7/881: dread - d4/d7f/d77/d7e/db2/d12f/df1/d11/fe9 zero size 2024-04-20T21:58:42.044 INFO:tasks.workunit.client.0.smithi142.stdout:3/859: dwrite d6/d15/f95 [0,4194304] 0 2024-04-20T21:58:42.044 INFO:tasks.workunit.client.0.smithi142.stdout:2/892: write d3/d9/db6/de3/f12b [122368,90956] 0 2024-04-20T21:58:42.052 INFO:tasks.workunit.client.0.smithi142.stdout:3/860: read d6/d15/d1e/d43/d4d/f6d [802946,48765] 0 2024-04-20T21:58:42.052 INFO:tasks.workunit.client.0.smithi142.stdout:2/893: creat d3/d5/d74/d108/f131 x:0 0 0 2024-04-20T21:58:42.058 INFO:tasks.workunit.client.0.smithi142.stdout:8/765: dread d0/d1c/d44/dad/db3/d3f/d7f/d8f/fb8 [0,4194304] 0 2024-04-20T21:58:42.062 INFO:tasks.workunit.client.0.smithi142.stdout:2/894: write d3/d9/d89/d9a/f11e [882435,117509] 0 2024-04-20T21:58:42.066 INFO:tasks.workunit.client.0.smithi142.stdout:0/707: dread d5/d1c/d3c/d85/d63/f64 [0,4194304] 0 2024-04-20T21:58:42.067 INFO:tasks.workunit.client.0.smithi142.stdout:3/861: mkdir d6/d15/d47/d83/d12f 0 2024-04-20T21:58:42.067 INFO:tasks.workunit.client.0.smithi142.stdout:9/794: dwrite d0/d36/ffb [0,4194304] 0 2024-04-20T21:58:42.070 INFO:tasks.workunit.client.0.smithi142.stdout:5/713: dread dc/f10 [0,4194304] 0 2024-04-20T21:58:42.071 INFO:tasks.workunit.client.0.smithi142.stdout:1/758: dread d2/f3e [0,4194304] 0 2024-04-20T21:58:42.075 INFO:tasks.workunit.client.0.smithi142.stdout:8/766: mkdir d0/d1c/d44/d89/d45/d4c/d68/d108 0 2024-04-20T21:58:42.075 INFO:tasks.workunit.client.0.smithi142.stdout:5/714: write dc/d14/d72/fbf [3107445,51224] 0 2024-04-20T21:58:42.076 INFO:tasks.workunit.client.0.smithi142.stdout:2/895: read d3/f5a [2297075,64572] 0 2024-04-20T21:58:42.079 INFO:tasks.workunit.client.0.smithi142.stdout:9/795: creat d0/d2a/d39/d50/f10f x:0 0 0 2024-04-20T21:58:42.087 INFO:tasks.workunit.client.0.smithi142.stdout:8/767: chown d0/d42/f70 79868169 1 2024-04-20T21:58:42.088 INFO:tasks.workunit.client.0.smithi142.stdout:2/896: chown d3/d9/d89/d31/c4e 30 1 2024-04-20T21:58:42.092 INFO:tasks.workunit.client.0.smithi142.stdout:3/862: dwrite d6/d32/d9b/fda [0,4194304] 0 2024-04-20T21:58:42.095 INFO:tasks.workunit.client.0.smithi142.stdout:9/796: symlink d0/d2a/dd4/l110 0 2024-04-20T21:58:42.108 INFO:tasks.workunit.client.0.smithi142.stdout:8/768: unlink d0/d29/lc7 0 2024-04-20T21:58:42.110 INFO:tasks.workunit.client.0.smithi142.stdout:1/759: link d2/dd/d1c/d60/f72 d2/dd/d1c/d88/f101 0 2024-04-20T21:58:42.112 INFO:tasks.workunit.client.0.smithi142.stdout:5/715: link dc/d14/c35 dc/d14/d21/d46/d2a/d65/da3/cfb 0 2024-04-20T21:58:42.112 INFO:tasks.workunit.client.0.smithi142.stdout:1/760: readlink d2/dd/d17/d3b/d50/lf0 0 2024-04-20T21:58:42.112 INFO:tasks.workunit.client.0.smithi142.stdout:2/897: dwrite d3/d9/d89/f10a [0,4194304] 0 2024-04-20T21:58:42.114 INFO:tasks.workunit.client.0.smithi142.stdout:2/898: chown d3/d9/d69/fd1 3114519 1 2024-04-20T21:58:42.116 INFO:tasks.workunit.client.0.smithi142.stdout:3/863: link d6/d15/d1e/d43/f96 d6/d15/d47/d83/f130 0 2024-04-20T21:58:42.131 INFO:tasks.workunit.client.0.smithi142.stdout:3/864: stat d6/d15/d47/d83/dc9/cd5 0 2024-04-20T21:58:42.133 INFO:tasks.workunit.client.0.smithi142.stdout:0/708: truncate d5/f17 2790100 0 2024-04-20T21:58:42.137 INFO:tasks.workunit.client.0.smithi142.stdout:5/716: creat dc/d14/d21/d46/dc1/dd4/ddf/ffc x:0 0 0 2024-04-20T21:58:42.137 INFO:tasks.workunit.client.0.smithi142.stdout:8/769: dread d0/d1c/d44/d89/d45/d4c/f86 [0,4194304] 0 2024-04-20T21:58:42.139 INFO:tasks.workunit.client.0.smithi142.stdout:1/761: dwrite d2/dd/d1c/d60/fed [0,4194304] 0 2024-04-20T21:58:42.141 INFO:tasks.workunit.client.0.smithi142.stdout:8/770: chown d0/d1c/d44/dad/db3/d3f/d7f/lba 14076 1 2024-04-20T21:58:42.142 INFO:tasks.workunit.client.0.smithi142.stdout:8/771: fdatasync d0/d29/f6c 0 2024-04-20T21:58:42.154 INFO:tasks.workunit.client.0.smithi142.stdout:5/717: rename dc/d71/f4e to dc/d71/d93/ffd 0 2024-04-20T21:58:42.166 INFO:tasks.workunit.client.0.smithi142.stdout:9/797: write d0/f25 [1390608,40559] 0 2024-04-20T21:58:42.168 INFO:tasks.workunit.client.0.smithi142.stdout:1/762: dread d2/dd/d17/d3b/f78 [0,4194304] 0 2024-04-20T21:58:42.170 INFO:tasks.workunit.client.0.smithi142.stdout:9/798: write d0/d2a/fd3 [991486,111686] 0 2024-04-20T21:58:42.170 INFO:tasks.workunit.client.0.smithi142.stdout:8/772: rename d0/d1c/d44/d89/d45/l99 to d0/d1c/d44/d89/d45/d92/de8/l109 0 2024-04-20T21:58:42.170 INFO:tasks.workunit.client.0.smithi142.stdout:5/718: dread dc/d14/d25/db4/fc8 [0,4194304] 0 2024-04-20T21:58:42.172 INFO:tasks.workunit.client.0.smithi142.stdout:3/865: link d6/d15/d47/d83/cb9 d6/d15/d30/d37/d6c/d7e/d10b/c131 0 2024-04-20T21:58:42.174 INFO:tasks.workunit.client.0.smithi142.stdout:9/799: write d0/d2a/d39/d50/de5/ff8 [2225850,6198] 0 2024-04-20T21:58:42.189 INFO:tasks.workunit.client.0.smithi142.stdout:8/773: creat d0/d29/df5/f10a x:0 0 0 2024-04-20T21:58:42.193 INFO:tasks.workunit.client.0.smithi142.stdout:5/719: truncate dc/d14/d26/ff6 2238405 0 2024-04-20T21:58:42.193 INFO:tasks.workunit.client.0.smithi142.stdout:3/866: dwrite d6/d15/d30/d37/d75/fbe [0,4194304] 0 2024-04-20T21:58:42.195 INFO:tasks.workunit.client.0.smithi142.stdout:2/899: dwrite d3/d9/d89/d31/f73 [0,4194304] 0 2024-04-20T21:58:42.196 INFO:tasks.workunit.client.0.smithi142.stdout:5/720: dread - dc/d14/d26/d3f/d53/fc6 zero size 2024-04-20T21:58:42.202 INFO:tasks.workunit.client.0.smithi142.stdout:8/774: dread d0/d1c/f41 [0,4194304] 0 2024-04-20T21:58:42.203 INFO:tasks.workunit.client.0.smithi142.stdout:3/867: mknod d6/d15/da4/c132 0 2024-04-20T21:58:42.205 INFO:tasks.workunit.client.0.smithi142.stdout:0/709: dwrite d5/f6c [0,4194304] 0 2024-04-20T21:58:42.206 INFO:tasks.workunit.client.0.smithi142.stdout:5/721: fsync dc/d14/f91 0 2024-04-20T21:58:42.207 INFO:tasks.workunit.client.0.smithi142.stdout:3/868: readlink d6/d15/d30/d37/d6c/dcd/lc4 0 2024-04-20T21:58:42.210 INFO:tasks.workunit.client.0.smithi142.stdout:3/869: readlink d6/d15/d1e/d43/d4d/d59/de8/l105 0 2024-04-20T21:58:42.210 INFO:tasks.workunit.client.0.smithi142.stdout:2/900: symlink d3/d5/d67/dc4/l132 0 2024-04-20T21:58:42.211 INFO:tasks.workunit.client.0.smithi142.stdout:2/901: stat d3/d9/da3/dae 0 2024-04-20T21:58:42.213 INFO:tasks.workunit.client.0.smithi142.stdout:6/704: sync 2024-04-20T21:58:42.213 INFO:tasks.workunit.client.0.smithi142.stdout:4/663: sync 2024-04-20T21:58:42.224 INFO:tasks.workunit.client.0.smithi142.stdout:5/722: dread - dc/d71/d93/ffd zero size 2024-04-20T21:58:42.225 INFO:tasks.workunit.client.0.smithi142.stdout:8/775: dread d0/d1c/d44/f8b [0,4194304] 0 2024-04-20T21:58:42.227 INFO:tasks.workunit.client.0.smithi142.stdout:3/870: write d6/d32/d39/d69/de0/f111 [2218661,24751] 0 2024-04-20T21:58:42.230 INFO:tasks.workunit.client.0.smithi142.stdout:1/763: dwrite d2/dd/d1c/f69 [0,4194304] 0 2024-04-20T21:58:42.238 INFO:tasks.workunit.client.0.smithi142.stdout:4/664: creat d1/d6/d4b/fcc x:0 0 0 2024-04-20T21:58:42.243 INFO:tasks.workunit.client.0.smithi142.stdout:2/902: dwrite d3/d9/d89/d31/d84/f101 [0,4194304] 0 2024-04-20T21:58:42.249 INFO:tasks.workunit.client.0.smithi142.stdout:3/871: mknod d6/d102/c133 0 2024-04-20T21:58:42.256 INFO:tasks.workunit.client.0.smithi142.stdout:5/723: dread dc/d14/d26/fa0 [0,4194304] 0 2024-04-20T21:58:42.258 INFO:tasks.workunit.client.0.smithi142.stdout:5/724: dread - dc/d14/d25/db4/fe0 zero size 2024-04-20T21:58:42.260 INFO:tasks.workunit.client.0.smithi142.stdout:8/776: read d0/d1c/d44/dad/db3/fe4 [851725,34862] 0 2024-04-20T21:58:42.260 INFO:tasks.workunit.client.0.smithi142.stdout:6/705: write d1/d1b/f1e [1978266,98665] 0 2024-04-20T21:58:42.270 INFO:tasks.workunit.client.0.smithi142.stdout:2/903: creat d3/d9/d69/d104/d70/d3c/d64/f133 x:0 0 0 2024-04-20T21:58:42.271 INFO:tasks.workunit.client.0.smithi142.stdout:5/725: creat dc/d14/d21/d46/dc1/dd4/ddf/ffe x:0 0 0 2024-04-20T21:58:42.271 INFO:tasks.workunit.client.0.smithi142.stdout:0/710: getdents d5/d1d/d7e/db0 0 2024-04-20T21:58:42.271 INFO:tasks.workunit.client.0.smithi142.stdout:8/777: symlink d0/d1c/dd1/l10b 0 2024-04-20T21:58:42.273 INFO:tasks.workunit.client.0.smithi142.stdout:4/665: unlink d1/d12/f7d 0 2024-04-20T21:58:42.292 INFO:tasks.workunit.client.0.smithi142.stdout:4/666: dread d1/d12/da/d1c/d32/d3d/d2f/d49/f78 [0,4194304] 0 2024-04-20T21:58:42.294 INFO:tasks.workunit.client.0.smithi142.stdout:3/872: symlink d6/d32/de7/d126/l134 0 2024-04-20T21:58:42.296 INFO:tasks.workunit.client.0.smithi142.stdout:5/726: write dc/d14/d21/d46/d7d/db0/ff4 [169015,15151] 0 2024-04-20T21:58:42.298 INFO:tasks.workunit.client.0.smithi142.stdout:2/904: symlink d3/d9/da3/dae/d11a/l134 0 2024-04-20T21:58:42.299 INFO:tasks.workunit.client.0.smithi142.stdout:0/711: mknod d5/d1c/d3c/d4a/ce2 0 2024-04-20T21:58:42.304 INFO:tasks.workunit.client.0.smithi142.stdout:4/667: unlink d1/d12/da/d1c/d32/d3d/d2f/d52/d94/fbc 0 2024-04-20T21:58:42.304 INFO:tasks.workunit.client.0.smithi142.stdout:8/778: creat d0/d1c/d44/d89/d45/d4c/d68/d108/f10c x:0 0 0 2024-04-20T21:58:42.307 INFO:tasks.workunit.client.0.smithi142.stdout:6/706: getdents d1/d11/dbb 0 2024-04-20T21:58:42.308 INFO:tasks.workunit.client.0.smithi142.stdout:4/668: mknod d1/d6/d4b/ccd 0 2024-04-20T21:58:42.313 INFO:tasks.workunit.client.0.smithi142.stdout:6/707: dread - d1/d2f/d35/d5b/d3e/dc5/ddb/fc2 zero size 2024-04-20T21:58:42.313 INFO:tasks.workunit.client.0.smithi142.stdout:5/727: dwrite dc/d14/d21/d46/dc1/dd4/ddf/ffc [0,4194304] 0 2024-04-20T21:58:42.319 INFO:tasks.workunit.client.0.smithi142.stdout:2/905: read d3/d9/d89/d31/da2/ddb/de0/fa6 [2985402,77151] 0 2024-04-20T21:58:42.319 INFO:tasks.workunit.client.0.smithi142.stdout:2/906: rmdir d3/d9/d69/d104/d70 39 2024-04-20T21:58:42.325 INFO:tasks.workunit.client.0.smithi142.stdout:6/708: getdents d1/d5 0 2024-04-20T21:58:42.329 INFO:tasks.workunit.client.0.smithi142.stdout:2/907: fsync d3/d9/d69/d104/d70/f95 0 2024-04-20T21:58:42.331 INFO:tasks.workunit.client.0.smithi142.stdout:6/709: rmdir d1/d2f/d35/d5b/d63/d4b/d61/db7 39 2024-04-20T21:58:42.334 INFO:tasks.workunit.client.0.smithi142.stdout:2/908: symlink d3/d9/d89/d31/dc3/dce/dea/l135 0 2024-04-20T21:58:42.334 INFO:tasks.workunit.client.0.smithi142.stdout:6/710: chown d1/d2f/d35/d5b/d63/d64/de1/ffb 809 1 2024-04-20T21:58:42.346 INFO:tasks.workunit.client.0.smithi142.stdout:0/712: dread d5/f53 [0,4194304] 0 2024-04-20T21:58:42.347 INFO:tasks.workunit.client.0.smithi142.stdout:2/909: dread d3/d9/d89/d31/da2/fd8 [0,4194304] 0 2024-04-20T21:58:42.348 INFO:tasks.workunit.client.0.smithi142.stdout:2/910: stat d3/f42 0 2024-04-20T21:58:42.351 INFO:tasks.workunit.client.0.smithi142.stdout:2/911: creat d3/f136 x:0 0 0 2024-04-20T21:58:42.357 INFO:tasks.workunit.client.0.smithi142.stdout:2/912: dread d3/d9/d34/f56 [0,4194304] 0 2024-04-20T21:58:42.361 INFO:tasks.workunit.client.0.smithi142.stdout:0/713: dwrite d5/d1c/d3c/d4a/d78/fb9 [0,4194304] 0 2024-04-20T21:58:42.362 INFO:tasks.workunit.client.0.smithi142.stdout:0/714: chown d5/d45/d6f 0 1 2024-04-20T21:58:42.390 INFO:tasks.workunit.client.0.smithi142.stdout:0/715: dread d5/d1c/d3c/d85/d38/d62/f96 [0,4194304] 0 2024-04-20T21:58:42.393 INFO:tasks.workunit.client.0.smithi142.stdout:0/716: mkdir d5/d13/d1e/d23/de3 0 2024-04-20T21:58:42.424 INFO:tasks.workunit.client.0.smithi142.stdout:7/882: sync 2024-04-20T21:58:42.429 INFO:tasks.workunit.client.0.smithi142.stdout:7/883: creat d4/d7f/d77/d7e/db2/d12f/df1/d11/d116/f13b x:0 0 0 2024-04-20T21:58:42.437 INFO:tasks.workunit.client.0.smithi142.stdout:7/884: link d4/d7d/cc0 d4/d7f/d77/d7e/db2/d12f/df1/d11/d116/d130/c13c 0 2024-04-20T21:58:42.441 INFO:tasks.workunit.client.0.smithi142.stdout:7/885: creat d4/d7f/d77/f13d x:0 0 0 2024-04-20T21:58:42.444 INFO:tasks.workunit.client.0.smithi142.stdout:7/886: mknod d4/dd3/c13e 0 2024-04-20T21:58:42.446 INFO:tasks.workunit.client.0.smithi142.stdout:7/887: mknod d4/d7f/d77/d7e/db2/d12f/c13f 0 2024-04-20T21:58:42.494 INFO:tasks.workunit.client.0.smithi142.stdout:1/764: write d2/dd/d17/d1b/d22/d20/f2d [874075,77613] 0 2024-04-20T21:58:42.505 INFO:tasks.workunit.client.0.smithi142.stdout:1/765: rename d2/dd/d17/d1b/d22/c67 to d2/dd/d1c/c102 0 2024-04-20T21:58:42.517 INFO:tasks.workunit.client.0.smithi142.stdout:1/766: link d2/dd/d17/f24 d2/dd/d17/d1b/d22/d55/df9/f103 0 2024-04-20T21:58:42.524 INFO:tasks.workunit.client.0.smithi142.stdout:1/767: rename d2/d4e/d7e/fd7 to d2/dd/d17/d8b/f104 0 2024-04-20T21:58:42.528 INFO:tasks.workunit.client.0.smithi142.stdout:1/768: write d2/dd/d17/d8b/f104 [685293,5064] 0 2024-04-20T21:58:42.534 INFO:tasks.workunit.client.0.smithi142.stdout:3/873: write d6/d32/f51 [601556,14234] 0 2024-04-20T21:58:42.540 INFO:tasks.workunit.client.0.smithi142.stdout:1/769: dread d2/dd/d17/d1b/d22/d13/f35 [0,4194304] 0 2024-04-20T21:58:42.543 INFO:tasks.workunit.client.0.smithi142.stdout:3/874: creat d6/d15/d1e/d43/f135 x:0 0 0 2024-04-20T21:58:42.546 INFO:tasks.workunit.client.0.smithi142.stdout:3/875: fsync d6/d15/d30/f40 0 2024-04-20T21:58:42.546 INFO:tasks.workunit.client.0.smithi142.stdout:1/770: getdents d2/dd/d1c/d60/deb 0 2024-04-20T21:58:42.549 INFO:tasks.workunit.client.0.smithi142.stdout:2/913: write d3/d5/d74/fd5 [830312,48916] 0 2024-04-20T21:58:42.550 INFO:tasks.workunit.client.0.smithi142.stdout:5/728: dwrite dc/d14/d21/d46/d2a/d3c/f61 [0,4194304] 0 2024-04-20T21:58:42.555 INFO:tasks.workunit.client.0.smithi142.stdout:2/914: read - d3/d9/d34/db5/f12f zero size 2024-04-20T21:58:42.556 INFO:tasks.workunit.client.0.smithi142.stdout:6/711: dwrite d1/d11/fa [0,4194304] 0 2024-04-20T21:58:42.558 INFO:tasks.workunit.client.0.smithi142.stdout:3/876: mknod d6/d15/d30/d37/d6c/d7e/d10b/c136 0 2024-04-20T21:58:42.558 INFO:tasks.workunit.client.0.smithi142.stdout:2/915: dread - d3/d9/d69/d104/d70/de6/fff zero size 2024-04-20T21:58:42.567 INFO:tasks.workunit.client.0.smithi142.stdout:6/712: rename d1/d2f/d35/d5b/d70 to d1/d2f/d35/d5b/d63/d34/dc8/dfc 0 2024-04-20T21:58:42.572 INFO:tasks.workunit.client.0.smithi142.stdout:5/729: creat dc/fff x:0 0 0 2024-04-20T21:58:42.576 INFO:tasks.workunit.client.0.smithi142.stdout:0/717: dwrite d5/d13/d1e/d23/d24/d48/db6/fc1 [0,4194304] 0 2024-04-20T21:58:42.582 INFO:tasks.workunit.client.0.smithi142.stdout:6/713: creat d1/d2f/d35/d5b/d63/d34/dc8/dfc/df4/ffd x:0 0 0 2024-04-20T21:58:42.586 INFO:tasks.workunit.client.0.smithi142.stdout:3/877: link d6/d15/lf2 d6/d15/d47/l137 0 2024-04-20T21:58:42.587 INFO:tasks.workunit.client.0.smithi142.stdout:3/878: stat d6/d32/d39/ffa 0 2024-04-20T21:58:42.588 INFO:tasks.workunit.client.0.smithi142.stdout:0/718: creat d5/d1c/d3c/d85/d38/d62/d9a/fe4 x:0 0 0 2024-04-20T21:58:42.590 INFO:tasks.workunit.client.0.smithi142.stdout:3/879: dread - d6/d32/d39/ffa zero size 2024-04-20T21:58:42.594 INFO:tasks.workunit.client.0.smithi142.stdout:5/730: getdents dc/d14/d21/d7f/de5 0 2024-04-20T21:58:42.596 INFO:tasks.workunit.client.0.smithi142.stdout:5/731: chown dc/d14/d21/d46/ldb 71 1 2024-04-20T21:58:42.599 INFO:tasks.workunit.client.0.smithi142.stdout:5/732: chown dc/d14/l4f 3 1 2024-04-20T21:58:42.603 INFO:tasks.workunit.client.0.smithi142.stdout:5/733: truncate dc/d14/d21/d46/d2a/f74 484557 0 2024-04-20T21:58:42.603 INFO:tasks.workunit.client.0.smithi142.stdout:0/719: dread d5/d13/d1e/fb1 [0,4194304] 0 2024-04-20T21:58:42.606 INFO:tasks.workunit.client.0.smithi142.stdout:9/800: sync 2024-04-20T21:58:42.606 INFO:tasks.workunit.client.0.smithi142.stdout:4/669: sync 2024-04-20T21:58:42.606 INFO:tasks.workunit.client.0.smithi142.stdout:8/779: sync 2024-04-20T21:58:42.611 INFO:tasks.workunit.client.0.smithi142.stdout:0/720: rmdir d5/d1c/d3c/d85/d63 39 2024-04-20T21:58:42.611 INFO:tasks.workunit.client.0.smithi142.stdout:9/801: chown d0/d3c/d4d/d103 918 1 2024-04-20T21:58:42.616 INFO:tasks.workunit.client.0.smithi142.stdout:0/721: readlink d5/d1c/d3c/d85/d38/l67 0 2024-04-20T21:58:42.618 INFO:tasks.workunit.client.0.smithi142.stdout:0/722: stat d5/d1d/l6e 0 2024-04-20T21:58:42.621 INFO:tasks.workunit.client.0.smithi142.stdout:1/771: dwrite d2/dd/d1c/d88/f101 [0,4194304] 0 2024-04-20T21:58:42.625 INFO:tasks.workunit.client.0.smithi142.stdout:0/723: chown d5/d45/d6f 0 1 2024-04-20T21:58:42.628 INFO:tasks.workunit.client.0.smithi142.stdout:2/916: dwrite d3/d9/f77 [4194304,4194304] 0 2024-04-20T21:58:42.629 INFO:tasks.workunit.client.0.smithi142.stdout:8/780: getdents d0/d17/d35/db5 0 2024-04-20T21:58:42.632 INFO:tasks.workunit.client.0.smithi142.stdout:6/714: dread d1/d5/d8b/fb6 [0,4194304] 0 2024-04-20T21:58:42.634 INFO:tasks.workunit.client.0.smithi142.stdout:4/670: truncate d1/d12/da/d1c/d32/d3d/f6b 732091 0 2024-04-20T21:58:42.635 INFO:tasks.workunit.client.0.smithi142.stdout:7/888: sync 2024-04-20T21:58:42.635 INFO:tasks.workunit.client.0.smithi142.stdout:1/772: mknod d2/dd/d1c/d60/dda/c105 0 2024-04-20T21:58:42.636 INFO:tasks.workunit.client.0.smithi142.stdout:3/880: dread d6/d15/d30/fba [0,4194304] 0 2024-04-20T21:58:42.638 INFO:tasks.workunit.client.0.smithi142.stdout:9/802: getdents d0/d36/d55 0 2024-04-20T21:58:42.639 INFO:tasks.workunit.client.0.smithi142.stdout:4/671: readlink d1/d12/da/lc3 0 2024-04-20T21:58:42.639 INFO:tasks.workunit.client.0.smithi142.stdout:0/724: rmdir d5/d1c/d3c/d85/d38/d62 39 2024-04-20T21:58:42.641 INFO:tasks.workunit.client.0.smithi142.stdout:5/734: dwrite dc/d71/f6e [0,4194304] 0 2024-04-20T21:58:42.647 INFO:tasks.workunit.client.0.smithi142.stdout:6/715: creat d1/dd1/d65/ffe x:0 0 0 2024-04-20T21:58:42.649 INFO:tasks.workunit.client.0.smithi142.stdout:1/773: creat d2/dd/d1c/d88/f106 x:0 0 0 2024-04-20T21:58:42.649 INFO:tasks.workunit.client.0.smithi142.stdout:3/881: write d6/d15/d30/d37/d6c/dcd/f12e [804387,79923] 0 2024-04-20T21:58:42.650 INFO:tasks.workunit.client.0.smithi142.stdout:6/716: fsync d1/d11/f44 0 2024-04-20T21:58:42.653 INFO:tasks.workunit.client.0.smithi142.stdout:7/889: truncate d4/d7f/d77/d78/d9b/d5a/d90/df8/fdc 491541 0 2024-04-20T21:58:42.654 INFO:tasks.workunit.client.0.smithi142.stdout:8/781: truncate d0/d1c/d44/dad/fc8 603014 0 2024-04-20T21:58:42.655 INFO:tasks.workunit.client.0.smithi142.stdout:5/735: symlink dc/d14/d25/d89/l100 0 2024-04-20T21:58:42.662 INFO:tasks.workunit.client.0.smithi142.stdout:4/672: mknod d1/d12/da/d37/d89/dc8/cce 0 2024-04-20T21:58:42.668 INFO:tasks.workunit.client.0.smithi142.stdout:3/882: fdatasync d6/d15/d1e/d43/d4d/d59/df6/faf 0 2024-04-20T21:58:42.668 INFO:tasks.workunit.client.0.smithi142.stdout:8/782: creat d0/d1c/d44/d89/d45/d4c/d68/da5/f10d x:0 0 0 2024-04-20T21:58:42.672 INFO:tasks.workunit.client.0.smithi142.stdout:4/673: chown d1/d12/da/d1c/d32/d3d/d2f/d52 3 1 2024-04-20T21:58:42.677 INFO:tasks.workunit.client.0.smithi142.stdout:8/783: readlink d0/d1c/d44/dad/db3/lbb 0 2024-04-20T21:58:42.685 INFO:tasks.workunit.client.0.smithi142.stdout:3/883: dread d6/d32/f51 [0,4194304] 0 2024-04-20T21:58:42.687 INFO:tasks.workunit.client.0.smithi142.stdout:4/674: creat d1/d12/da/d37/d89/fcf x:0 0 0 2024-04-20T21:58:42.688 INFO:tasks.workunit.client.0.smithi142.stdout:1/774: dwrite d2/d4e/fd3 [0,4194304] 0 2024-04-20T21:58:42.688 INFO:tasks.workunit.client.0.smithi142.stdout:8/784: chown d0/d1c/d44/d89/fa3 527824 1 2024-04-20T21:58:42.690 INFO:tasks.workunit.client.0.smithi142.stdout:5/736: dread dc/f2b [0,4194304] 0 2024-04-20T21:58:42.699 INFO:tasks.workunit.client.0.smithi142.stdout:1/775: dread - d2/d4e/d7e/fe3 zero size 2024-04-20T21:58:42.699 INFO:tasks.workunit.client.0.smithi142.stdout:4/675: stat d1/d12/da/d37/cb1 0 2024-04-20T21:58:42.699 INFO:tasks.workunit.client.0.smithi142.stdout:6/717: dwrite d1/d2f/d35/d5b/d3e/ff6 [0,4194304] 0 2024-04-20T21:58:42.707 INFO:tasks.workunit.client.0.smithi142.stdout:7/890: dwrite d4/d7f/d77/d78/da8/dae/db3/f11c [0,4194304] 0 2024-04-20T21:58:42.709 INFO:tasks.workunit.client.0.smithi142.stdout:9/803: dread d0/d2a/d39/d50/de5/d109/fa4 [0,4194304] 0 2024-04-20T21:58:42.712 INFO:tasks.workunit.client.0.smithi142.stdout:3/884: truncate d6/d15/d47/d83/dc9/da7/fd1 1689942 0 2024-04-20T21:58:42.716 INFO:tasks.workunit.client.0.smithi142.stdout:8/785: truncate d0/d29/f3c 4332745 0 2024-04-20T21:58:42.717 INFO:tasks.workunit.client.0.smithi142.stdout:7/891: dread - d4/d7f/d77/d78/d9b/f10f zero size 2024-04-20T21:58:42.723 INFO:tasks.workunit.client.0.smithi142.stdout:7/892: dread - d4/d7f/d77/d7e/db2/d12f/df1/d1c/dd5/ffc zero size 2024-04-20T21:58:42.727 INFO:tasks.workunit.client.0.smithi142.stdout:1/776: dwrite d2/dd/d17/ffd [0,4194304] 0 2024-04-20T21:58:42.731 INFO:tasks.workunit.client.0.smithi142.stdout:1/777: chown d2/dd/d17/d1b/d22/d55/ld2 336 1 2024-04-20T21:58:42.731 INFO:tasks.workunit.client.0.smithi142.stdout:7/893: truncate d4/d7f/d77/d78/d9b/d5a/f11e 889577 0 2024-04-20T21:58:42.738 INFO:tasks.workunit.client.0.smithi142.stdout:5/737: link dc/d14/d21/f96 dc/d14/d25/d78/f101 0 2024-04-20T21:58:42.741 INFO:tasks.workunit.client.0.smithi142.stdout:9/804: rename d0/d3c/d4d/d63 to d0/d36/d55/d111 0 2024-04-20T21:58:42.742 INFO:tasks.workunit.client.0.smithi142.stdout:3/885: mknod d6/d32/d39/d69/de0/d11d/c138 0 2024-04-20T21:58:42.746 INFO:tasks.workunit.client.0.smithi142.stdout:5/738: mkdir dc/d14/d26/d102 0 2024-04-20T21:58:42.748 INFO:tasks.workunit.client.0.smithi142.stdout:9/805: mknod d0/d2a/c112 0 2024-04-20T21:58:42.749 INFO:tasks.workunit.client.0.smithi142.stdout:5/739: readlink dc/d14/d21/d46/d2a/lcc 0 2024-04-20T21:58:42.749 INFO:tasks.workunit.client.0.smithi142.stdout:3/886: symlink d6/d15/da4/l139 0 2024-04-20T21:58:42.750 INFO:tasks.workunit.client.0.smithi142.stdout:7/894: mknod d4/d7f/d77/d78/d9b/dc1/c140 0 2024-04-20T21:58:42.752 INFO:tasks.workunit.client.0.smithi142.stdout:6/718: getdents d1/d2f/d35/d5b/d63/d34/dc8 0 2024-04-20T21:58:42.755 INFO:tasks.workunit.client.0.smithi142.stdout:4/676: truncate d1/d6/fc7 4092511 0 2024-04-20T21:58:42.759 INFO:tasks.workunit.client.0.smithi142.stdout:3/887: mkdir d6/d32/d39/d69/d91/d13a 0 2024-04-20T21:58:42.765 INFO:tasks.workunit.client.0.smithi142.stdout:5/740: unlink dc/d14/d25/d89/l100 0 2024-04-20T21:58:42.766 INFO:tasks.workunit.client.0.smithi142.stdout:6/719: dread d1/d2f/d35/f36 [0,4194304] 0 2024-04-20T21:58:42.768 INFO:tasks.workunit.client.0.smithi142.stdout:8/786: write d0/d29/f37 [2754969,75086] 0 2024-04-20T21:58:42.775 INFO:tasks.workunit.client.0.smithi142.stdout:6/720: write d1/d11/fa [3704300,62939] 0 2024-04-20T21:58:42.775 INFO:tasks.workunit.client.0.smithi142.stdout:3/888: dread d6/d15/d30/d37/d75/dbc/fd7 [0,4194304] 0 2024-04-20T21:58:42.776 INFO:tasks.workunit.client.0.smithi142.stdout:5/741: write dc/f10 [20928,94906] 0 2024-04-20T21:58:42.782 INFO:tasks.workunit.client.0.smithi142.stdout:1/778: dread d2/dd/d1c/d60/fdb [0,4194304] 0 2024-04-20T21:58:42.782 INFO:tasks.workunit.client.0.smithi142.stdout:8/787: creat d0/d1c/d44/d89/d45/d4c/d68/f10e x:0 0 0 2024-04-20T21:58:42.784 INFO:tasks.workunit.client.0.smithi142.stdout:7/895: dread d4/d7f/d77/d7e/f94 [0,4194304] 0 2024-04-20T21:58:42.788 INFO:tasks.workunit.client.0.smithi142.stdout:3/889: creat d6/d15/d30/db4/f13b x:0 0 0 2024-04-20T21:58:42.789 INFO:tasks.workunit.client.0.smithi142.stdout:6/721: mknod d1/d2f/d35/d5b/d63/d4b/cff 0 2024-04-20T21:58:42.790 INFO:tasks.workunit.client.0.smithi142.stdout:4/677: dread d1/d12/da/d1c/f26 [4194304,4194304] 0 2024-04-20T21:58:42.790 INFO:tasks.workunit.client.0.smithi142.stdout:9/806: truncate d0/d2a/f47 1565737 0 2024-04-20T21:58:42.796 INFO:tasks.workunit.client.0.smithi142.stdout:3/890: mknod d6/d32/d39/c13c 0 2024-04-20T21:58:42.799 INFO:tasks.workunit.client.0.smithi142.stdout:6/722: creat d1/f100 x:0 0 0 2024-04-20T21:58:42.799 INFO:tasks.workunit.client.0.smithi142.stdout:5/742: creat dc/d14/d21/f103 x:0 0 0 2024-04-20T21:58:42.804 INFO:tasks.workunit.client.0.smithi142.stdout:9/807: rename d0/d36/d55/f76 to d0/d2a/d39/f113 0 2024-04-20T21:58:42.808 INFO:tasks.workunit.client.0.smithi142.stdout:1/779: dwrite d2/dd/fd1 [0,4194304] 0 2024-04-20T21:58:42.808 INFO:tasks.workunit.client.0.smithi142.stdout:6/723: mknod d1/d2f/d35/d5b/d3e/dc5/c101 0 2024-04-20T21:58:42.812 INFO:tasks.workunit.client.0.smithi142.stdout:8/788: getdents d0/d1c/d44/d89/d45/d92/de8 0 2024-04-20T21:58:42.822 INFO:tasks.workunit.client.0.smithi142.stdout:1/780: symlink d2/d4e/l107 0 2024-04-20T21:58:42.826 INFO:tasks.workunit.client.0.smithi142.stdout:6/724: mkdir d1/d2f/d35/d48/d102 0 2024-04-20T21:58:42.826 INFO:tasks.workunit.client.0.smithi142.stdout:1/781: read d2/dd/d17/ffd [1151297,4790] 0 2024-04-20T21:58:42.830 INFO:tasks.workunit.client.0.smithi142.stdout:5/743: dwrite dc/d14/d21/d46/fdc [0,4194304] 0 2024-04-20T21:58:42.833 INFO:tasks.workunit.client.0.smithi142.stdout:4/678: dread d1/d6/d30/f8f [0,4194304] 0 2024-04-20T21:58:42.835 INFO:tasks.workunit.client.0.smithi142.stdout:5/744: stat dc/d14/d21/d46/l2c 0 2024-04-20T21:58:42.837 INFO:tasks.workunit.client.0.smithi142.stdout:3/891: write d6/d15/d1e/d43/d4d/d59/db6/fc1 [1636553,46478] 0 2024-04-20T21:58:42.842 INFO:tasks.workunit.client.0.smithi142.stdout:3/892: write d6/d15/d47/d83/d114/f117 [1298605,69244] 0 2024-04-20T21:58:42.843 INFO:tasks.workunit.client.0.smithi142.stdout:8/789: dwrite d0/d17/d35/fdb [0,4194304] 0 2024-04-20T21:58:42.847 INFO:tasks.workunit.client.0.smithi142.stdout:7/896: dread d4/d7f/d77/d78/da8/dae/dd8/fc9 [0,4194304] 0 2024-04-20T21:58:42.851 INFO:tasks.workunit.client.0.smithi142.stdout:9/808: truncate d0/d2a/d39/d50/de5/d109/fe8 2065964 0 2024-04-20T21:58:42.856 INFO:tasks.workunit.client.0.smithi142.stdout:3/893: truncate d6/d15/d30/d37/d6c/dcd/f12e 1356303 0 2024-04-20T21:58:42.859 INFO:tasks.workunit.client.0.smithi142.stdout:7/897: creat d4/d7f/d77/d7e/db2/d12f/f141 x:0 0 0 2024-04-20T21:58:42.859 INFO:tasks.workunit.client.0.smithi142.stdout:3/894: write d6/d15/d30/f46 [8253422,116684] 0 2024-04-20T21:58:42.860 INFO:tasks.workunit.client.0.smithi142.stdout:6/725: write d1/d2f/d35/d5b/d63/f92 [557775,52700] 0 2024-04-20T21:58:42.866 INFO:tasks.workunit.client.0.smithi142.stdout:5/745: dwrite dc/d14/f41 [0,4194304] 0 2024-04-20T21:58:42.867 INFO:tasks.workunit.client.0.smithi142.stdout:9/809: readlink d0/l16 0 2024-04-20T21:58:42.870 INFO:tasks.workunit.client.0.smithi142.stdout:1/782: link d2/dd/d17/d1b/d22/d20/f8c d2/dd/d17/d1b/d22/d55/df9/f108 0 2024-04-20T21:58:42.873 INFO:tasks.workunit.client.0.smithi142.stdout:8/790: link d0/d17/d35/c64 d0/d1c/d44/dad/c10f 0 2024-04-20T21:58:42.873 INFO:tasks.workunit.client.0.smithi142.stdout:7/898: readlink d4/d7f/d77/d7e/db2/d12f/df1/d1c/l74 0 2024-04-20T21:58:42.876 INFO:tasks.workunit.client.0.smithi142.stdout:9/810: chown d0/d36/f41 224713 1 2024-04-20T21:58:42.877 INFO:tasks.workunit.client.0.smithi142.stdout:3/895: rename d6/d15/d30/d37/d6c/d7e/d10b to d6/d15/d47/d83/d13d 0 2024-04-20T21:58:42.884 INFO:tasks.workunit.client.0.smithi142.stdout:4/679: dwrite d1/d12/da/d1c/d32/f40 [0,4194304] 0 2024-04-20T21:58:42.888 INFO:tasks.workunit.client.0.smithi142.stdout:3/896: write d6/d15/d30/d37/d6c/f7c [3956,111220] 0 2024-04-20T21:58:42.890 INFO:tasks.workunit.client.0.smithi142.stdout:3/897: write d6/d15/d30/f40 [1882752,109685] 0 2024-04-20T21:58:42.897 INFO:tasks.workunit.client.0.smithi142.stdout:7/899: mknod d4/d7f/d77/d78/da8/dae/dd8/d131/c142 0 2024-04-20T21:58:42.902 INFO:tasks.workunit.client.0.smithi142.stdout:5/746: dwrite dc/d14/d21/d46/d7d/fe1 [0,4194304] 0 2024-04-20T21:58:42.908 INFO:tasks.workunit.client.0.smithi142.stdout:0/725: sync 2024-04-20T21:58:42.908 INFO:tasks.workunit.client.0.smithi142.stdout:2/917: sync 2024-04-20T21:58:42.911 INFO:tasks.workunit.client.0.smithi142.stdout:8/791: rename d0/d1c/d44/d89/d45/d92 to d0/d17/d6e/d110 0 2024-04-20T21:58:42.914 INFO:tasks.workunit.client.0.smithi142.stdout:1/783: symlink d2/dd/d17/d3b/l109 0 2024-04-20T21:58:42.924 INFO:tasks.workunit.client.0.smithi142.stdout:2/918: symlink d3/d9/db6/de3/l137 0 2024-04-20T21:58:42.926 INFO:tasks.workunit.client.0.smithi142.stdout:2/919: stat d3/d9/d89/d31/da7 0 2024-04-20T21:58:42.928 INFO:tasks.workunit.client.0.smithi142.stdout:1/784: dread d2/dd/d17/d3b/f78 [0,4194304] 0 2024-04-20T21:58:42.930 INFO:tasks.workunit.client.0.smithi142.stdout:6/726: link d1/d2f/d35/d5b/d3e/de0/d7e/fb3 d1/d2f/d35/d5b/d63/d4b/d61/f103 0 2024-04-20T21:58:42.930 INFO:tasks.workunit.client.0.smithi142.stdout:2/920: chown d3/d9/d89/d31/d84/fa5 4 1 2024-04-20T21:58:42.933 INFO:tasks.workunit.client.0.smithi142.stdout:1/785: chown d2/dd/d17/d3b/f9d 1 1 2024-04-20T21:58:42.933 INFO:tasks.workunit.client.0.smithi142.stdout:2/921: fdatasync d3/d9/d89/d31/f73 0 2024-04-20T21:58:42.935 INFO:tasks.workunit.client.0.smithi142.stdout:5/747: rename dc/d14/f59 to dc/d14/d26/d3f/db3/f104 0 2024-04-20T21:58:42.936 INFO:tasks.workunit.client.0.smithi142.stdout:2/922: readlink d3/d9/d69/d104/l4f 0 2024-04-20T21:58:42.947 INFO:tasks.workunit.client.0.smithi142.stdout:6/727: mkdir d1/d2f/d35/d5b/d39/dcd/d104 0 2024-04-20T21:58:42.954 INFO:tasks.workunit.client.0.smithi142.stdout:5/748: dwrite dc/d14/d26/d3f/d53/d7c/d97/fe3 [0,4194304] 0 2024-04-20T21:58:42.956 INFO:tasks.workunit.client.0.smithi142.stdout:2/923: mkdir d3/d9/d69/d104/d70/d138 0 2024-04-20T21:58:42.957 INFO:tasks.workunit.client.0.smithi142.stdout:5/749: chown dc/d14/d25/db4/ff9 11 1 2024-04-20T21:58:42.963 INFO:tasks.workunit.client.0.smithi142.stdout:1/786: mknod d2/d4e/d7e/dee/c10a 0 2024-04-20T21:58:42.965 INFO:tasks.workunit.client.0.smithi142.stdout:4/680: link d1/d12/da/d1c/f88 d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/fd0 0 2024-04-20T21:58:42.969 INFO:tasks.workunit.client.0.smithi142.stdout:9/811: dwrite d0/f24 [0,4194304] 0 2024-04-20T21:58:42.970 INFO:tasks.workunit.client.0.smithi142.stdout:5/750: symlink dc/d71/d5c/l105 0 2024-04-20T21:58:42.986 INFO:tasks.workunit.client.0.smithi142.stdout:0/726: dwrite d5/d1c/d3c/d85/d38/f90 [0,4194304] 0 2024-04-20T21:58:42.986 INFO:tasks.workunit.client.0.smithi142.stdout:5/751: mknod dc/d14/d21/d46/d2a/d3c/c106 0 2024-04-20T21:58:42.986 INFO:tasks.workunit.client.0.smithi142.stdout:3/898: truncate d6/d15/d47/d83/dc9/da7/fc7 1061704 0 2024-04-20T21:58:42.986 INFO:tasks.workunit.client.0.smithi142.stdout:5/752: chown dc/d14/d26/l4c 409297 1 2024-04-20T21:58:42.991 INFO:tasks.workunit.client.0.smithi142.stdout:5/753: fsync dc/d14/d21/d46/d7d/fe1 0 2024-04-20T21:58:42.993 INFO:tasks.workunit.client.0.smithi142.stdout:1/787: readlink d2/dd/d1c/d88/d89/db1/lb3 0 2024-04-20T21:58:42.993 INFO:tasks.workunit.client.0.smithi142.stdout:7/900: dwrite d4/d7f/d77/d78/d9b/d5a/f63 [0,4194304] 0 2024-04-20T21:58:42.994 INFO:tasks.workunit.client.0.smithi142.stdout:8/792: write d0/f6 [302350,28632] 0 2024-04-20T21:58:42.998 INFO:tasks.workunit.client.0.smithi142.stdout:1/788: stat d2/dd/d17/d1b/d22/ff8 0 2024-04-20T21:58:42.998 INFO:tasks.workunit.client.0.smithi142.stdout:2/924: creat d3/d9/d69/d104/f139 x:0 0 0 2024-04-20T21:58:43.001 INFO:tasks.workunit.client.0.smithi142.stdout:0/727: mkdir d5/d1c/d3c/d4a/d78/de5 0 2024-04-20T21:58:43.001 INFO:tasks.workunit.client.0.smithi142.stdout:2/925: fsync d3/d9/d69/d104/d70/f3f 0 2024-04-20T21:58:43.008 INFO:tasks.workunit.client.0.smithi142.stdout:6/728: truncate d1/dd1/d8f/fd5 706569 0 2024-04-20T21:58:43.010 INFO:tasks.workunit.client.0.smithi142.stdout:5/754: rename dc/d14/d21/c40 to dc/d14/d25/c107 0 2024-04-20T21:58:43.024 INFO:tasks.workunit.client.0.smithi142.stdout:2/926: dwrite d3/d9/d89/d31/f73 [0,4194304] 0 2024-04-20T21:58:43.027 INFO:tasks.workunit.client.0.smithi142.stdout:3/899: symlink d6/d32/l13e 0 2024-04-20T21:58:43.028 INFO:tasks.workunit.client.0.smithi142.stdout:6/729: mknod d1/d9e/c105 0 2024-04-20T21:58:43.033 INFO:tasks.workunit.client.0.smithi142.stdout:5/755: rmdir dc/d14/d21/d46 39 2024-04-20T21:58:43.035 INFO:tasks.workunit.client.0.smithi142.stdout:5/756: dread - dc/d71/d5c/d68/ff3 zero size 2024-04-20T21:58:43.036 INFO:tasks.workunit.client.0.smithi142.stdout:5/757: chown dc/d71 236642 1 2024-04-20T21:58:43.039 INFO:tasks.workunit.client.0.smithi142.stdout:8/793: mknod d0/c111 0 2024-04-20T21:58:43.044 INFO:tasks.workunit.client.0.smithi142.stdout:1/789: unlink d2/d4e/d7e/la1 0 2024-04-20T21:58:43.044 INFO:tasks.workunit.client.0.smithi142.stdout:8/794: read d0/d1c/d44/d89/d45/fb4 [596563,6766] 0 2024-04-20T21:58:43.045 INFO:tasks.workunit.client.0.smithi142.stdout:0/728: mkdir d5/d13/d1e/d23/d46/de6 0 2024-04-20T21:58:43.051 INFO:tasks.workunit.client.0.smithi142.stdout:3/900: creat d6/d15/d47/d83/d13d/f13f x:0 0 0 2024-04-20T21:58:43.053 INFO:tasks.workunit.client.0.smithi142.stdout:9/812: dread d0/d2a/d39/d50/de5/d109/f93 [0,4194304] 0 2024-04-20T21:58:43.054 INFO:tasks.workunit.client.0.smithi142.stdout:2/927: rename d3/d9/d89/d31/da7/dd7 to d3/d9/d89/d31/da7/d13a 0 2024-04-20T21:58:43.057 INFO:tasks.workunit.client.0.smithi142.stdout:7/901: creat d4/d7f/d77/d78/da8/dae/f143 x:0 0 0 2024-04-20T21:58:43.062 INFO:tasks.workunit.client.0.smithi142.stdout:1/790: mknod d2/dd/d1c/d60/c10b 0 2024-04-20T21:58:43.069 INFO:tasks.workunit.client.0.smithi142.stdout:0/729: mknod d5/d13/d1e/d23/d24/d48/d55/ce7 0 2024-04-20T21:58:43.072 INFO:tasks.workunit.client.0.smithi142.stdout:9/813: dwrite d0/d2a/f2d [8388608,4194304] 0 2024-04-20T21:58:43.072 INFO:tasks.workunit.client.0.smithi142.stdout:6/730: mkdir d1/d2f/d35/d106 0 2024-04-20T21:58:43.079 INFO:tasks.workunit.client.0.smithi142.stdout:2/928: creat d3/d9/d69/d104/d70/f13b x:0 0 0 2024-04-20T21:58:43.084 INFO:tasks.workunit.client.0.smithi142.stdout:7/902: creat d4/d7f/d77/d78/d97/d9a/f144 x:0 0 0 2024-04-20T21:58:43.086 INFO:tasks.workunit.client.0.smithi142.stdout:7/903: chown d4/d7d/lb4 289541552 1 2024-04-20T21:58:43.093 INFO:tasks.workunit.client.0.smithi142.stdout:6/731: mkdir d1/d2f/d35/d5b/d3e/de0/d107 0 2024-04-20T21:58:43.094 INFO:tasks.workunit.client.0.smithi142.stdout:3/901: mknod d6/d15/d30/dae/c140 0 2024-04-20T21:58:43.097 INFO:tasks.workunit.client.0.smithi142.stdout:9/814: chown d0/d91/da0/cb6 15141408 1 2024-04-20T21:58:43.098 INFO:tasks.workunit.client.0.smithi142.stdout:8/795: creat d0/d1c/d44/dad/db3/f112 x:0 0 0 2024-04-20T21:58:43.099 INFO:tasks.workunit.client.0.smithi142.stdout:5/758: dread dc/d14/d21/d46/d2a/f52 [0,4194304] 0 2024-04-20T21:58:43.101 INFO:tasks.workunit.client.0.smithi142.stdout:8/796: stat d0/d1c/d44/d89/d45/cc1 0 2024-04-20T21:58:43.103 INFO:tasks.workunit.client.0.smithi142.stdout:2/929: getdents d3/d5/d67/dc4/d10d 0 2024-04-20T21:58:43.108 INFO:tasks.workunit.client.0.smithi142.stdout:7/904: dwrite d4/d7f/d77/d7e/db2/d12f/df1/d11/f3c [0,4194304] 0 2024-04-20T21:58:43.117 INFO:tasks.workunit.client.0.smithi142.stdout:2/930: creat d3/d9/d34/f13c x:0 0 0 2024-04-20T21:58:43.118 INFO:tasks.workunit.client.0.smithi142.stdout:7/905: dread d4/d7d/f5c [0,4194304] 0 2024-04-20T21:58:43.119 INFO:tasks.workunit.client.0.smithi142.stdout:3/902: truncate d6/d15/d47/d83/dc9/da7/fc7 1173732 0 2024-04-20T21:58:43.121 INFO:tasks.workunit.client.0.smithi142.stdout:3/903: fsync d6/d15/d30/f44 0 2024-04-20T21:58:43.125 INFO:tasks.workunit.client.0.smithi142.stdout:1/791: write d2/dd/d17/ffd [167564,90188] 0 2024-04-20T21:58:43.125 INFO:tasks.workunit.client.0.smithi142.stdout:3/904: write d6/d15/d30/f73 [988592,109465] 0 2024-04-20T21:58:43.126 INFO:tasks.workunit.client.0.smithi142.stdout:5/759: fdatasync dc/d14/d26/ff6 0 2024-04-20T21:58:43.132 INFO:tasks.workunit.client.0.smithi142.stdout:1/792: chown d2/dd/d17/d8b/daf/lc4 108 1 2024-04-20T21:58:43.133 INFO:tasks.workunit.client.0.smithi142.stdout:5/760: write dc/d14/d21/d46/d2a/f74 [348029,57310] 0 2024-04-20T21:58:43.136 INFO:tasks.workunit.client.0.smithi142.stdout:9/815: dread d0/d36/f41 [0,4194304] 0 2024-04-20T21:58:43.146 INFO:tasks.workunit.client.0.smithi142.stdout:7/906: truncate d4/d7f/d77/d7e/db2/d12f/df1/d1c/f81 5011 0 2024-04-20T21:58:43.158 INFO:tasks.workunit.client.0.smithi142.stdout:5/761: rename dc/d14/d21/d46/d2a/d65/da3/dcb to dc/d71/d5c/d68/d108 0 2024-04-20T21:58:43.160 INFO:tasks.workunit.client.0.smithi142.stdout:8/797: getdents d0/d1c/d44/d89/d45/d4c 0 2024-04-20T21:58:43.164 INFO:tasks.workunit.client.0.smithi142.stdout:7/907: creat d4/d7f/d77/d78/da8/dae/dd8/f145 x:0 0 0 2024-04-20T21:58:43.168 INFO:tasks.workunit.client.0.smithi142.stdout:7/908: chown d4/d7f/d77/d78/d9b/d5a/c67 81978704 1 2024-04-20T21:58:43.171 INFO:tasks.workunit.client.0.smithi142.stdout:3/905: dread d6/f4b [0,4194304] 0 2024-04-20T21:58:43.171 INFO:tasks.workunit.client.0.smithi142.stdout:7/909: chown d4/ca2 244123 1 2024-04-20T21:58:43.172 INFO:tasks.workunit.client.0.smithi142.stdout:5/762: mkdir dc/d71/d5c/d68/d109 0 2024-04-20T21:58:43.173 INFO:tasks.workunit.client.0.smithi142.stdout:8/798: unlink d0/d1c/d44/dad/db3/f112 0 2024-04-20T21:58:43.185 INFO:tasks.workunit.client.0.smithi142.stdout:9/816: dread d0/d2a/d39/d50/f6b [0,4194304] 0 2024-04-20T21:58:43.186 INFO:tasks.workunit.client.0.smithi142.stdout:3/906: rename d6/d15/d1e/d43/f96 to d6/d32/d9b/f141 0 2024-04-20T21:58:43.188 INFO:tasks.workunit.client.0.smithi142.stdout:3/907: chown d6/d15/d47/d83/d12f 224482891 1 2024-04-20T21:58:43.193 INFO:tasks.workunit.client.0.smithi142.stdout:2/931: write d3/d9/d89/d31/dc3/dce/dea/fec [1158438,64863] 0 2024-04-20T21:58:43.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:43 smithi142 ceph-mon[15828]: pgmap v43: 65 pgs: 65 active+clean; 1.4 GiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 48 MiB/s rd, 110 MiB/s wr, 306 op/s 2024-04-20T21:58:43.197 INFO:tasks.workunit.client.0.smithi142.stdout:2/932: write d3/d9/d89/d31/dc3/dce/dea/fec [944068,11989] 0 2024-04-20T21:58:43.198 INFO:tasks.workunit.client.0.smithi142.stdout:8/799: rename d0/d1c/d44/d89/d45/d4c/d68/f10e to d0/d1c/d44/d89/f113 0 2024-04-20T21:58:43.207 INFO:tasks.workunit.client.0.smithi142.stdout:9/817: truncate d0/d2a/d39/f5c 550374 0 2024-04-20T21:58:43.209 INFO:tasks.workunit.client.0.smithi142.stdout:8/800: fsync d0/d42/f70 0 2024-04-20T21:58:43.212 INFO:tasks.workunit.client.0.smithi142.stdout:1/793: dwrite d2/dd/d17/d1b/d22/f46 [0,4194304] 0 2024-04-20T21:58:43.213 INFO:tasks.workunit.client.0.smithi142.stdout:2/933: mknod d3/d5/d67/c13d 0 2024-04-20T21:58:43.215 INFO:tasks.workunit.client.0.smithi142.stdout:3/908: mkdir d6/d15/d30/d37/d75/d142 0 2024-04-20T21:58:43.218 INFO:tasks.workunit.client.0.smithi142.stdout:5/763: write dc/d14/f1f [3529476,123827] 0 2024-04-20T21:58:43.227 INFO:tasks.workunit.client.0.smithi142.stdout:8/801: chown d0/d1c/lff 29 1 2024-04-20T21:58:43.231 INFO:tasks.workunit.client.0.smithi142.stdout:5/764: rmdir dc/d14/d21/d46/dc1 39 2024-04-20T21:58:43.235 INFO:tasks.workunit.client.0.smithi142.stdout:4/681: sync 2024-04-20T21:58:43.239 INFO:tasks.workunit.client.0.smithi142.stdout:7/910: dwrite d4/d7f/d77/d7e/db2/d12f/df1/d1c/f81 [0,4194304] 0 2024-04-20T21:58:43.245 INFO:tasks.workunit.client.0.smithi142.stdout:2/934: rename d3/d9/d69 to d3/d13e 0 2024-04-20T21:58:43.248 INFO:tasks.workunit.client.0.smithi142.stdout:8/802: mkdir d0/d29/df3/d114 0 2024-04-20T21:58:43.251 INFO:tasks.workunit.client.0.smithi142.stdout:9/818: dread d0/d89/d95/de4/feb [0,4194304] 0 2024-04-20T21:58:43.255 INFO:tasks.workunit.client.0.smithi142.stdout:8/803: rmdir d0 39 2024-04-20T21:58:43.257 INFO:tasks.workunit.client.0.smithi142.stdout:4/682: dwrite d1/d6/d30/fc9 [0,4194304] 0 2024-04-20T21:58:43.259 INFO:tasks.workunit.client.0.smithi142.stdout:4/683: chown d1/d12/da/d1c/d32 624310 1 2024-04-20T21:58:43.260 INFO:tasks.workunit.client.0.smithi142.stdout:2/935: creat d3/d5/d67/dc4/d6c/f13f x:0 0 0 2024-04-20T21:58:43.265 INFO:tasks.workunit.client.0.smithi142.stdout:7/911: fsync d4/d7f/d77/d7e/db2/d12f/df1/d1c/f33 0 2024-04-20T21:58:43.269 INFO:tasks.workunit.client.0.smithi142.stdout:5/765: rename dc/d14/d21/d46/de6/c81 to dc/d71/d5c/d68/d109/c10a 0 2024-04-20T21:58:43.275 INFO:tasks.workunit.client.0.smithi142.stdout:4/684: creat d1/d12/da/d1c/d32/d3d/d2f/d73/fd1 x:0 0 0 2024-04-20T21:58:43.276 INFO:tasks.workunit.client.0.smithi142.stdout:2/936: mknod d3/d9/d89/d31/dc3/dce/c140 0 2024-04-20T21:58:43.278 INFO:tasks.workunit.client.0.smithi142.stdout:2/937: read - d3/d13e/d104/d70/f13b zero size 2024-04-20T21:58:43.313 INFO:tasks.workunit.client.0.smithi142.stdout:8/804: creat d0/d1c/d44/d89/d45/d4c/f115 x:0 0 0 2024-04-20T21:58:43.316 INFO:tasks.workunit.client.0.smithi142.stdout:5/766: rename dc/d14/d26/d3f/db3/c8b to dc/d14/d25/db4/c10b 0 2024-04-20T21:58:43.318 INFO:tasks.workunit.client.0.smithi142.stdout:7/912: link d4/d7f/cbb d4/d7f/d77/d7e/db2/c146 0 2024-04-20T21:58:43.320 INFO:tasks.workunit.client.0.smithi142.stdout:7/913: dread - d4/d7f/d77/f13d zero size 2024-04-20T21:58:43.321 INFO:tasks.workunit.client.0.smithi142.stdout:9/819: link d0/l2 d0/d89/l114 0 2024-04-20T21:58:43.322 INFO:tasks.workunit.client.0.smithi142.stdout:7/914: stat d4/d7f/d77/d78/d9b/l57 0 2024-04-20T21:58:43.322 INFO:tasks.workunit.client.0.smithi142.stdout:8/805: rmdir d0/d42/d90 39 2024-04-20T21:58:43.325 INFO:tasks.workunit.client.0.smithi142.stdout:8/806: dread - d0/d1c/d44/d89/d45/d4c/d68/ffe zero size 2024-04-20T21:58:43.326 INFO:tasks.workunit.client.0.smithi142.stdout:8/807: chown d0/da7/l100 1760257 1 2024-04-20T21:58:43.327 INFO:tasks.workunit.client.0.smithi142.stdout:9/820: mknod d0/d2a/d39/d50/de5/c115 0 2024-04-20T21:58:43.328 INFO:tasks.workunit.client.0.smithi142.stdout:9/821: fsync d0/fe 0 2024-04-20T21:58:43.329 INFO:tasks.workunit.client.0.smithi142.stdout:5/767: mknod dc/c10c 0 2024-04-20T21:58:43.330 INFO:tasks.workunit.client.0.smithi142.stdout:2/938: rmdir d3/d13e/d104/d70/d138 0 2024-04-20T21:58:43.331 INFO:tasks.workunit.client.0.smithi142.stdout:7/915: mkdir d4/d7f/d77/d78/da8/dae/d147 0 2024-04-20T21:58:43.333 INFO:tasks.workunit.client.0.smithi142.stdout:5/768: truncate dc/d14/d21/d46/d2a/f52 4977832 0 2024-04-20T21:58:43.336 INFO:tasks.workunit.client.0.smithi142.stdout:2/939: chown d3/d5/d67/db7/df9/l107 68584 1 2024-04-20T21:58:43.337 INFO:tasks.workunit.client.0.smithi142.stdout:9/822: mknod d0/d91/da0/dcb/c116 0 2024-04-20T21:58:43.343 INFO:tasks.workunit.client.0.smithi142.stdout:9/823: fsync d0/d2a/d39/d87/fbe 0 2024-04-20T21:58:43.344 INFO:tasks.workunit.client.0.smithi142.stdout:9/824: readlink d0/d89/d95/la3 0 2024-04-20T21:58:43.347 INFO:tasks.workunit.client.0.smithi142.stdout:9/825: mknod d0/d91/c117 0 2024-04-20T21:58:43.351 INFO:tasks.workunit.client.0.smithi142.stdout:7/916: dwrite d4/d7f/d77/d7e/db2/d12f/df1/d1c/d8e/d88/f9f [4194304,4194304] 0 2024-04-20T21:58:43.356 INFO:tasks.workunit.client.0.smithi142.stdout:7/917: unlink d4/d7f/d77/f13d 0 2024-04-20T21:58:43.362 INFO:tasks.workunit.client.0.smithi142.stdout:7/918: mknod d4/d7f/d77/d78/d97/d9a/dc4/c148 0 2024-04-20T21:58:43.367 INFO:tasks.workunit.client.0.smithi142.stdout:4/685: write d1/d12/da/d1c/f34 [8398334,68155] 0 2024-04-20T21:58:43.373 INFO:tasks.workunit.client.0.smithi142.stdout:2/940: dread d3/d5/f5e [0,4194304] 0 2024-04-20T21:58:43.376 INFO:tasks.workunit.client.0.smithi142.stdout:7/919: getdents d4/d7f/d77/d7e/db2/d12f/df1/d1c/d8e 0 2024-04-20T21:58:43.377 INFO:tasks.workunit.client.0.smithi142.stdout:2/941: creat d3/d13e/d104/d70/de6/f141 x:0 0 0 2024-04-20T21:58:43.380 INFO:tasks.workunit.client.0.smithi142.stdout:7/920: rmdir d4/d7f/d77/d78/d9b 39 2024-04-20T21:58:43.381 INFO:tasks.workunit.client.0.smithi142.stdout:5/769: write dc/d14/d21/d46/d7d/fec [4892001,117371] 0 2024-04-20T21:58:43.381 INFO:tasks.workunit.client.0.smithi142.stdout:2/942: rmdir d3/d5/d67/dc4 39 2024-04-20T21:58:43.382 INFO:tasks.workunit.client.0.smithi142.stdout:5/770: dread - dc/fff zero size 2024-04-20T21:58:43.385 INFO:tasks.workunit.client.0.smithi142.stdout:7/921: fsync d4/d7f/d77/d78/d9b/d5a/d90/df8/fe4 0 2024-04-20T21:58:43.386 INFO:tasks.workunit.client.0.smithi142.stdout:9/826: write d0/d91/f97 [1195445,94951] 0 2024-04-20T21:58:43.389 INFO:tasks.workunit.client.0.smithi142.stdout:9/827: dread - d0/d2a/d39/d87/f101 zero size 2024-04-20T21:58:43.390 INFO:tasks.workunit.client.0.smithi142.stdout:4/686: write d1/d6/d4b/fa5 [611680,61136] 0 2024-04-20T21:58:43.391 INFO:tasks.workunit.client.0.smithi142.stdout:7/922: fdatasync d4/d7f/d77/d78/da8/f55 0 2024-04-20T21:58:43.395 INFO:tasks.workunit.client.0.smithi142.stdout:7/923: read d4/d7d/da1/fda [139027,42169] 0 2024-04-20T21:58:43.398 INFO:tasks.workunit.client.0.smithi142.stdout:4/687: readlink d1/d12/da/d1c/da9/dba/lbf 0 2024-04-20T21:58:43.406 INFO:tasks.workunit.client.0.smithi142.stdout:2/943: dwrite d3/d9/d89/d31/da2/ddb/f111 [0,4194304] 0 2024-04-20T21:58:43.408 INFO:tasks.workunit.client.0.smithi142.stdout:5/771: dwrite dc/d14/d21/d46/d7d/fe1 [0,4194304] 0 2024-04-20T21:58:43.409 INFO:tasks.workunit.client.0.smithi142.stdout:7/924: creat d4/d7f/d77/d78/da8/dae/dd8/d131/d134/f149 x:0 0 0 2024-04-20T21:58:43.418 INFO:tasks.workunit.client.0.smithi142.stdout:2/944: symlink d3/d9/d89/d31/da2/ddb/de0/l142 0 2024-04-20T21:58:43.421 INFO:tasks.workunit.client.0.smithi142.stdout:7/925: read d4/d7f/d77/d78/d9b/d5a/f11e [348561,112785] 0 2024-04-20T21:58:43.424 INFO:tasks.workunit.client.0.smithi142.stdout:5/772: creat dc/d14/d21/d46/dc1/dd4/f10d x:0 0 0 2024-04-20T21:58:43.428 INFO:tasks.workunit.client.0.smithi142.stdout:7/926: creat d4/d7f/d77/d7e/db2/f14a x:0 0 0 2024-04-20T21:58:43.429 INFO:tasks.workunit.client.0.smithi142.stdout:9/828: dwrite d0/ff0 [0,4194304] 0 2024-04-20T21:58:43.432 INFO:tasks.workunit.client.0.smithi142.stdout:2/945: creat d3/d5/d67/dc4/f143 x:0 0 0 2024-04-20T21:58:43.435 INFO:tasks.workunit.client.0.smithi142.stdout:4/688: dwrite d1/d6/d4b/f82 [0,4194304] 0 2024-04-20T21:58:43.436 INFO:tasks.workunit.client.0.smithi142.stdout:7/927: truncate d4/d7f/d77/d78/da8/dae/dc5/fe5 759187 0 2024-04-20T21:58:43.438 INFO:tasks.workunit.client.0.smithi142.stdout:5/773: rename dc/d14/d21/d46/dc1/dd4/f10d to dc/d14/d25/d89/f10e 0 2024-04-20T21:58:43.441 INFO:tasks.workunit.client.0.smithi142.stdout:2/946: creat d3/d9/d89/d31/dc3/dce/dea/f144 x:0 0 0 2024-04-20T21:58:43.441 INFO:tasks.workunit.client.0.smithi142.stdout:9/829: creat d0/d89/d95/d105/f118 x:0 0 0 2024-04-20T21:58:43.443 INFO:tasks.workunit.client.0.smithi142.stdout:9/830: read - d0/d89/d95/d105/f118 zero size 2024-04-20T21:58:43.444 INFO:tasks.workunit.client.0.smithi142.stdout:7/928: stat d4/d7f/cbb 0 2024-04-20T21:58:43.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:43 smithi164 ceph-mon[23506]: pgmap v43: 65 pgs: 65 active+clean; 1.4 GiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 48 MiB/s rd, 110 MiB/s wr, 306 op/s 2024-04-20T21:58:43.450 INFO:tasks.workunit.client.0.smithi142.stdout:2/947: rmdir d3/d13e/d104 39 2024-04-20T21:58:43.452 INFO:tasks.workunit.client.0.smithi142.stdout:9/831: write d0/d89/d95/de4/feb [871492,73701] 0 2024-04-20T21:58:43.453 INFO:tasks.workunit.client.0.smithi142.stdout:7/929: symlink d4/d7f/d77/d7e/db2/l14b 0 2024-04-20T21:58:43.455 INFO:tasks.workunit.client.0.smithi142.stdout:7/930: write d4/d7f/d77/d78/fe8 [578678,14110] 0 2024-04-20T21:58:43.465 INFO:tasks.workunit.client.0.smithi142.stdout:2/948: rmdir d3/d5/d67/dc4/d10d 0 2024-04-20T21:58:43.466 INFO:tasks.workunit.client.0.smithi142.stdout:5/774: dwrite dc/d71/fb9 [0,4194304] 0 2024-04-20T21:58:43.467 INFO:tasks.workunit.client.0.smithi142.stdout:0/730: sync 2024-04-20T21:58:43.473 INFO:tasks.workunit.client.0.smithi142.stdout:7/931: truncate d4/d7f/d77/d7e/f94 2538505 0 2024-04-20T21:58:43.473 INFO:tasks.workunit.client.0.smithi142.stdout:9/832: link d0/d2a/d39/d50/de5/d109/fe8 d0/d2a/d9c/f119 0 2024-04-20T21:58:43.475 INFO:tasks.workunit.client.0.smithi142.stdout:5/775: write dc/fff [391781,76645] 0 2024-04-20T21:58:43.481 INFO:tasks.workunit.client.0.smithi142.stdout:9/833: rename d0/d36/d55 to d0/d89/d11a 0 2024-04-20T21:58:43.484 INFO:tasks.workunit.client.0.smithi142.stdout:9/834: chown d0/d89/d95/ced 7124 1 2024-04-20T21:58:43.487 INFO:tasks.workunit.client.0.smithi142.stdout:9/835: dread - d0/d91/fc0 zero size 2024-04-20T21:58:43.498 INFO:tasks.workunit.client.0.smithi142.stdout:5/776: dwrite dc/d14/d25/db4/dbb/feb [0,4194304] 0 2024-04-20T21:58:43.500 INFO:tasks.workunit.client.0.smithi142.stdout:7/932: truncate d4/d7f/d77/d78/d9b/d5a/d90/df8/ff0 518259 0 2024-04-20T21:58:43.500 INFO:tasks.workunit.client.0.smithi142.stdout:0/731: write d5/d13/d1e/d23/d46/fc2 [302307,46199] 0 2024-04-20T21:58:43.514 INFO:tasks.workunit.client.0.smithi142.stdout:7/933: unlink d4/d7f/d77/d7e/db2/d12f/ff9 0 2024-04-20T21:58:43.517 INFO:tasks.workunit.client.0.smithi142.stdout:2/949: dwrite d3/d9/d34/fdf [0,4194304] 0 2024-04-20T21:58:43.518 INFO:tasks.workunit.client.0.smithi142.stdout:0/732: mknod d5/d1c/d3c/d4a/d78/de5/ce8 0 2024-04-20T21:58:43.524 INFO:tasks.workunit.client.0.smithi142.stdout:9/836: dwrite d0/d36/f78 [0,4194304] 0 2024-04-20T21:58:43.529 INFO:tasks.workunit.client.0.smithi142.stdout:5/777: dwrite dc/d14/d72/fbf [4194304,4194304] 0 2024-04-20T21:58:43.532 INFO:tasks.workunit.client.0.smithi142.stdout:7/934: mknod d4/d7f/d77/d7e/db2/d12f/df1/d1c/d8e/c14c 0 2024-04-20T21:58:43.532 INFO:tasks.workunit.client.0.smithi142.stdout:7/935: chown d4/ca2 14801407 1 2024-04-20T21:58:43.536 INFO:tasks.workunit.client.0.smithi142.stdout:2/950: symlink d3/d13e/d104/l145 0 2024-04-20T21:58:43.540 INFO:tasks.workunit.client.0.smithi142.stdout:5/778: unlink dc/d14/d21/f6f 0 2024-04-20T21:58:43.541 INFO:tasks.workunit.client.0.smithi142.stdout:0/733: truncate d5/d1c/d3c/d8b/fba 192533 0 2024-04-20T21:58:43.542 INFO:tasks.workunit.client.0.smithi142.stdout:5/779: fdatasync dc/d71/d5c/f8e 0 2024-04-20T21:58:43.542 INFO:tasks.workunit.client.0.smithi142.stdout:7/936: creat d4/d7f/d77/d78/da8/f14d x:0 0 0 2024-04-20T21:58:43.545 INFO:tasks.workunit.client.0.smithi142.stdout:2/951: chown d3/d5/l9d 40509109 1 2024-04-20T21:58:43.545 INFO:tasks.workunit.client.0.smithi142.stdout:5/780: dread - dc/d14/d25/d78/fd2 zero size 2024-04-20T21:58:43.546 INFO:tasks.workunit.client.0.smithi142.stdout:7/937: chown d4/d7f/d77/d78/d9b/d5a 19797 1 2024-04-20T21:58:43.546 INFO:tasks.workunit.client.0.smithi142.stdout:9/837: creat d0/f11b x:0 0 0 2024-04-20T21:58:43.552 INFO:tasks.workunit.client.0.smithi142.stdout:0/734: chown d5/d13/d1e/d23/d2c/cd2 57835 1 2024-04-20T21:58:43.555 INFO:tasks.workunit.client.0.smithi142.stdout:5/781: creat dc/f10f x:0 0 0 2024-04-20T21:58:43.559 INFO:tasks.workunit.client.0.smithi142.stdout:0/735: creat d5/d1c/d3c/d4a/fe9 x:0 0 0 2024-04-20T21:58:43.562 INFO:tasks.workunit.client.0.smithi142.stdout:5/782: rename dc/d14/d21/d46/d2a/d3c/de8 to dc/d14/d21/d46/de6/d110 0 2024-04-20T21:58:43.564 INFO:tasks.workunit.client.0.smithi142.stdout:5/783: chown dc/d14/d72/f85 115 1 2024-04-20T21:58:43.568 INFO:tasks.workunit.client.0.smithi142.stdout:0/736: read d5/d13/d1e/d23/d24/d48/f65 [3725431,33006] 0 2024-04-20T21:58:43.569 INFO:tasks.workunit.client.0.smithi142.stdout:5/784: unlink dc/d14/d25/c63 0 2024-04-20T21:58:43.571 INFO:tasks.workunit.client.0.smithi142.stdout:7/938: write d4/d7f/d77/d7e/db2/d12f/df1/d1c/f6e [312090,67159] 0 2024-04-20T21:58:43.572 INFO:tasks.workunit.client.0.smithi142.stdout:9/838: write d0/d36/f7a [1698750,118338] 0 2024-04-20T21:58:43.574 INFO:tasks.workunit.client.0.smithi142.stdout:5/785: write f3 [4743179,123034] 0 2024-04-20T21:58:43.578 INFO:tasks.workunit.client.0.smithi142.stdout:9/839: mkdir d0/d91/db4/d11c 0 2024-04-20T21:58:43.579 INFO:tasks.workunit.client.0.smithi142.stdout:7/939: rmdir d4/d7f/d77/d78/d9b 39 2024-04-20T21:58:43.590 INFO:tasks.workunit.client.0.smithi142.stdout:7/940: rename d4/d7f/d77/d7e/db2/d12f/df1/d1c/c38 to d4/d7f/d77/d7e/db2/d12f/df1/d11/d116/d130/c14e 0 2024-04-20T21:58:43.596 INFO:tasks.workunit.client.0.smithi142.stdout:7/941: write d4/d7f/d77/d78/d9b/d5a/d90/df8/fdc [375595,62756] 0 2024-04-20T21:58:43.598 INFO:tasks.workunit.client.0.smithi142.stdout:9/840: dread d0/d2a/f47 [0,4194304] 0 2024-04-20T21:58:43.599 INFO:tasks.workunit.client.0.smithi142.stdout:5/786: dwrite dc/d14/d21/d46/de6/f77 [0,4194304] 0 2024-04-20T21:58:43.601 INFO:tasks.workunit.client.0.smithi142.stdout:5/787: readlink dc/d14/d21/d46/d2a/lcc 0 2024-04-20T21:58:43.606 INFO:tasks.workunit.client.0.smithi142.stdout:5/788: chown dc/d14/d21/d46/dc1 3353 1 2024-04-20T21:58:43.609 INFO:tasks.workunit.client.0.smithi142.stdout:9/841: rename d0/d91/da0/dcb to d0/dd5/d11d 0 2024-04-20T21:58:43.611 INFO:tasks.workunit.client.0.smithi142.stdout:9/842: chown d0/d89/d11a/cce 0 1 2024-04-20T21:58:43.611 INFO:tasks.workunit.client.0.smithi142.stdout:5/789: creat dc/d14/d26/d3f/d53/d7c/da9/f111 x:0 0 0 2024-04-20T21:58:43.613 INFO:tasks.workunit.client.0.smithi142.stdout:9/843: dread - d0/d3c/d4d/d103/f10b zero size 2024-04-20T21:58:43.616 INFO:tasks.workunit.client.0.smithi142.stdout:5/790: read dc/d14/d26/faa [419206,66875] 0 2024-04-20T21:58:43.620 INFO:tasks.workunit.client.0.smithi142.stdout:7/942: dwrite d4/d7f/d77/d7e/db2/d12f/df1/d11/d116/f13b [0,4194304] 0 2024-04-20T21:58:43.620 INFO:tasks.workunit.client.0.smithi142.stdout:5/791: write dc/d14/d26/d3f/d53/d7c/da9/f111 [125482,116117] 0 2024-04-20T21:58:43.621 INFO:tasks.workunit.client.0.smithi142.stdout:9/844: creat d0/d2a/d39/d87/d9e/db3/f11e x:0 0 0 2024-04-20T21:58:43.623 INFO:tasks.workunit.client.0.smithi142.stdout:9/845: write d0/d2a/fd3 [1493770,89871] 0 2024-04-20T21:58:43.626 INFO:tasks.workunit.client.0.smithi142.stdout:9/846: dread - d0/d2a/ffc zero size 2024-04-20T21:58:43.629 INFO:tasks.workunit.client.0.smithi142.stdout:7/943: mknod d4/d7f/d77/d7e/db2/d12f/df1/c14f 0 2024-04-20T21:58:43.630 INFO:tasks.workunit.client.0.smithi142.stdout:9/847: mknod d0/d89/d95/c11f 0 2024-04-20T21:58:43.634 INFO:tasks.workunit.client.0.smithi142.stdout:9/848: fsync d0/d3c/f10e 0 2024-04-20T21:58:43.634 INFO:tasks.workunit.client.0.smithi142.stdout:5/792: read dc/d71/d5c/f8e [3032,14231] 0 2024-04-20T21:58:43.634 INFO:tasks.workunit.client.0.smithi142.stdout:9/849: read - d0/f11b zero size 2024-04-20T21:58:43.638 INFO:tasks.workunit.client.0.smithi142.stdout:9/850: write d0/d89/d95/de4/feb [2734913,56034] 0 2024-04-20T21:58:43.641 INFO:tasks.workunit.client.0.smithi142.stdout:5/793: link dc/d71/f42 dc/f112 0 2024-04-20T21:58:43.646 INFO:tasks.workunit.client.0.smithi142.stdout:5/794: mknod dc/d14/d21/d46/dc1/dd4/ddf/c113 0 2024-04-20T21:58:43.650 INFO:tasks.workunit.client.0.smithi142.stdout:7/944: dwrite d4/d7f/d77/d7e/db2/d12f/df1/d11/fad [0,4194304] 0 2024-04-20T21:58:43.652 INFO:tasks.workunit.client.0.smithi142.stdout:5/795: unlink dc/d14/d26/d3f/d53/d7c/fa7 0 2024-04-20T21:58:43.658 INFO:tasks.workunit.client.0.smithi142.stdout:7/945: mknod d4/d7f/d77/d78/da8/dae/dd8/d131/d134/c150 0 2024-04-20T21:58:43.663 INFO:tasks.workunit.client.0.smithi142.stdout:7/946: mknod d4/d7d/d138/c151 0 2024-04-20T21:58:43.669 INFO:tasks.workunit.client.0.smithi142.stdout:9/851: dwrite d0/d2a/f44 [0,4194304] 0 2024-04-20T21:58:43.672 INFO:tasks.workunit.client.0.smithi142.stdout:7/947: write d4/d7f/d77/d7e/db2/d12f/df1/d1c/dd5/f111 [192029,102785] 0 2024-04-20T21:58:43.683 INFO:tasks.workunit.client.0.smithi142.stdout:7/948: link d4/d7f/d77/d78/da8/dae/dd8/f115 d4/d7f/d77/d78/da8/dae/dd8/d131/f152 0 2024-04-20T21:58:43.691 INFO:tasks.workunit.client.0.smithi142.stdout:9/852: dwrite d0/d89/d11a/d111/f7f [0,4194304] 0 2024-04-20T21:58:43.692 INFO:tasks.workunit.client.0.smithi142.stdout:9/853: dread - d0/f11b zero size 2024-04-20T21:58:43.695 INFO:tasks.workunit.client.0.smithi142.stdout:9/854: unlink d0/d2a/f42 0 2024-04-20T21:58:43.704 INFO:tasks.workunit.client.0.smithi142.stdout:7/949: dread d4/d7f/d77/d7e/db2/d12f/df1/d1c/f21 [0,4194304] 0 2024-04-20T21:58:43.717 INFO:tasks.workunit.client.0.smithi142.stdout:9/855: dwrite d0/d2a/d39/f113 [0,4194304] 0 2024-04-20T21:58:43.717 INFO:tasks.workunit.client.0.smithi142.stdout:7/950: dread d4/d7f/d77/d7e/db2/d12f/df1/d1c/f81 [0,4194304] 0 2024-04-20T21:58:43.719 INFO:tasks.workunit.client.0.smithi142.stdout:9/856: chown d0/c27 32 1 2024-04-20T21:58:43.721 INFO:tasks.workunit.client.0.smithi142.stdout:7/951: mkdir d4/d7f/d77/d7e/db2/d12f/d153 0 2024-04-20T21:58:43.722 INFO:tasks.workunit.client.0.smithi142.stdout:9/857: creat d0/d2a/ddc/f120 x:0 0 0 2024-04-20T21:58:43.724 INFO:tasks.workunit.client.0.smithi142.stdout:9/858: mknod d0/d2a/d39/d50/c121 0 2024-04-20T21:58:43.732 INFO:tasks.workunit.client.0.smithi142.stdout:7/952: truncate d4/d7f/d77/d7e/db2/d12f/df1/d1c/d8e/fa4 4578 0 2024-04-20T21:58:43.736 INFO:tasks.workunit.client.0.smithi142.stdout:7/953: dread - d4/d7f/d77/d7e/db2/d12f/df1/d11/f9c zero size 2024-04-20T21:58:43.737 INFO:tasks.workunit.client.0.smithi142.stdout:9/859: dread d0/d2a/d39/f98 [0,4194304] 0 2024-04-20T21:58:43.738 INFO:tasks.workunit.client.0.smithi142.stdout:6/732: sync 2024-04-20T21:58:43.741 INFO:tasks.workunit.client.0.smithi142.stdout:6/733: fdatasync d1/d2f/d35/d48/fe4 0 2024-04-20T21:58:43.744 INFO:tasks.workunit.client.0.smithi142.stdout:7/954: rmdir d4/d7f/d77/d78/d9b/dc1/dd4 39 2024-04-20T21:58:43.749 INFO:tasks.workunit.client.0.smithi142.stdout:7/955: fsync d4/d7f/d77/d78/d9b/dc1/ff2 0 2024-04-20T21:58:43.749 INFO:tasks.workunit.client.0.smithi142.stdout:6/734: rename d1/d2f/d35/d5b/d63/d34/dc8/dfc to d1/d2f/d35/d5b/d63/ded/d108 0 2024-04-20T21:58:43.754 INFO:tasks.workunit.client.0.smithi142.stdout:7/956: mkdir d4/d7f/d77/d7e/db2/d12f/df1/d1c/d154 0 2024-04-20T21:58:43.762 INFO:tasks.workunit.client.0.smithi142.stdout:7/957: truncate d4/d7f/d77/d7e/db2/d12f/df1/d1c/f33 3664906 0 2024-04-20T21:58:43.765 INFO:tasks.workunit.client.0.smithi142.stdout:7/958: dread - d4/d7f/d77/d7e/db2/d12f/f141 zero size 2024-04-20T21:58:43.767 INFO:tasks.workunit.client.0.smithi142.stdout:7/959: dread - d4/d7f/d77/d7e/db2/d12f/f141 zero size 2024-04-20T21:58:43.770 INFO:tasks.workunit.client.0.smithi142.stdout:7/960: mknod d4/d7f/d77/d78/d9b/d5a/d90/df8/c155 0 2024-04-20T21:58:43.771 INFO:tasks.workunit.client.0.smithi142.stdout:6/735: dread d1/d2f/d35/d5b/d3e/de0/d7e/fb3 [0,4194304] 0 2024-04-20T21:58:43.775 INFO:tasks.workunit.client.0.smithi142.stdout:7/961: rmdir d4/d7f/d77/d78/d9b 39 2024-04-20T21:58:43.777 INFO:tasks.workunit.client.0.smithi142.stdout:6/736: rename d1/d2f/d35/d5b/d63/f2a to d1/d2f/d35/f109 0 2024-04-20T21:58:43.779 INFO:tasks.workunit.client.0.smithi142.stdout:7/962: creat d4/d7f/d77/d7e/db2/d12f/d153/f156 x:0 0 0 2024-04-20T21:58:43.781 INFO:tasks.workunit.client.0.smithi142.stdout:6/737: creat d1/d2f/d35/f10a x:0 0 0 2024-04-20T21:58:43.783 INFO:tasks.workunit.client.0.smithi142.stdout:6/738: chown d1/d1b/f1e 0 1 2024-04-20T21:58:43.784 INFO:tasks.workunit.client.0.smithi142.stdout:7/963: dread d4/d7f/d77/d78/da8/dae/dc5/fe5 [0,4194304] 0 2024-04-20T21:58:43.786 INFO:tasks.workunit.client.0.smithi142.stdout:6/739: dread - d1/d2f/d35/d5b/d3e/de0/d7e/d9f/dc0/fc7 zero size 2024-04-20T21:58:43.786 INFO:tasks.workunit.client.0.smithi142.stdout:7/964: chown d4/d7f/d77/d78/da8/dae/f129 11 1 2024-04-20T21:58:43.787 INFO:tasks.workunit.client.0.smithi142.stdout:6/740: write d1/d2f/d35/f10a [133128,82373] 0 2024-04-20T21:58:43.791 INFO:tasks.workunit.client.0.smithi142.stdout:7/965: rename d4/d7d/d138/c151 to d4/d7f/d77/d78/da8/dae/dd8/c157 0 2024-04-20T21:58:43.792 INFO:tasks.workunit.client.0.smithi142.stdout:6/741: creat d1/d11/d71/f10b x:0 0 0 2024-04-20T21:58:43.794 INFO:tasks.workunit.client.0.smithi142.stdout:6/742: mknod d1/d2f/d35/d48/d102/c10c 0 2024-04-20T21:58:43.796 INFO:tasks.workunit.client.0.smithi142.stdout:7/966: creat d4/d7f/d77/d78/d9b/f158 x:0 0 0 2024-04-20T21:58:43.800 INFO:tasks.workunit.client.0.smithi142.stdout:7/967: creat d4/d7f/d77/d78/da8/dae/dd8/f159 x:0 0 0 2024-04-20T21:58:43.801 INFO:tasks.workunit.client.0.smithi142.stdout:7/968: write d4/d7f/f60 [3648998,105007] 0 2024-04-20T21:58:43.804 INFO:tasks.workunit.client.0.smithi142.stdout:7/969: readlink d4/d7f/d77/d7e/db2/d12f/df1/d1c/d8e/l4e 0 2024-04-20T21:58:43.814 INFO:tasks.workunit.client.0.smithi142.stdout:6/743: write d1/d11/ff [3118352,16771] 0 2024-04-20T21:58:43.820 INFO:tasks.workunit.client.0.smithi142.stdout:7/970: truncate d4/d7f/d77/d7e/db2/d12f/df1/d1c/d8e/d88/fee 3964476 0 2024-04-20T21:58:43.822 INFO:tasks.workunit.client.0.smithi142.stdout:6/744: write d1/d2f/d35/f47 [813105,65152] 0 2024-04-20T21:58:43.824 INFO:tasks.workunit.client.0.smithi142.stdout:6/745: chown d1/d2f/d35/d5b/d63/ded/d108/fad 31152 1 2024-04-20T21:58:43.835 INFO:tasks.workunit.client.0.smithi142.stdout:6/746: truncate d1/d2f/d35/d5b/d39/dcd/fdd 369553 0 2024-04-20T21:58:43.838 INFO:tasks.workunit.client.0.smithi142.stdout:6/747: creat d1/d2f/d35/d5b/d3e/f10d x:0 0 0 2024-04-20T21:58:43.842 INFO:tasks.workunit.client.0.smithi142.stdout:6/748: creat d1/d2f/d35/d5b/d63/d4b/d61/db7/f10e x:0 0 0 2024-04-20T21:58:43.844 INFO:tasks.workunit.client.0.smithi142.stdout:6/749: fsync d1/d5/f26 0 2024-04-20T21:58:43.846 INFO:tasks.workunit.client.0.smithi142.stdout:6/750: chown d1/d5/d8b/f97 6 1 2024-04-20T21:58:43.856 INFO:tasks.workunit.client.0.smithi142.stdout:6/751: truncate d1/f8c 3594499 0 2024-04-20T21:58:43.859 INFO:tasks.workunit.client.0.smithi142.stdout:6/752: creat d1/dd1/d65/f10f x:0 0 0 2024-04-20T21:58:43.863 INFO:tasks.workunit.client.0.smithi142.stdout:6/753: write d1/d11/dbb/ff7 [919494,68645] 0 2024-04-20T21:58:43.881 INFO:tasks.workunit.client.0.smithi142.stdout:6/754: dwrite d1/dd1/d8f/fd2 [0,4194304] 0 2024-04-20T21:58:44.023 INFO:tasks.workunit.client.0.smithi142.stdout:1/794: sync 2024-04-20T21:58:44.030 INFO:tasks.workunit.client.0.smithi142.stdout:1/795: symlink d2/dd/d1c/d60/dda/l10c 0 2024-04-20T21:58:44.038 INFO:tasks.workunit.client.0.smithi142.stdout:1/796: creat d2/dd/d1c/d60/dce/d7c/de7/f10d x:0 0 0 2024-04-20T21:58:44.132 INFO:tasks.workunit.client.0.smithi142.stdout:1/797: dwrite d2/dd/d17/d1b/d22/d20/f7b [0,4194304] 0 2024-04-20T21:58:44.155 INFO:tasks.workunit.client.0.smithi142.stdout:3/909: sync 2024-04-20T21:58:44.224 INFO:tasks.workunit.client.0.smithi142.stdout:1/798: dread d2/dd/d17/d1b/d22/f56 [0,4194304] 0 2024-04-20T21:58:44.239 INFO:tasks.workunit.client.0.smithi142.stdout:1/799: rename d2/dd/d17/d3b/d50/lcd to d2/dd/d17/d8b/l10e 0 2024-04-20T21:58:44.246 INFO:tasks.workunit.client.0.smithi142.stdout:8/808: sync 2024-04-20T21:58:44.246 INFO:tasks.workunit.client.0.smithi142.stdout:4/689: sync 2024-04-20T21:58:44.249 INFO:tasks.workunit.client.0.smithi142.stdout:1/800: symlink d2/de5/l10f 0 2024-04-20T21:58:44.298 INFO:tasks.workunit.client.0.smithi142.stdout:3/910: dwrite d6/d15/d30/d37/d6c/dcd/fe5 [0,4194304] 0 2024-04-20T21:58:44.346 INFO:tasks.workunit.client.0.smithi142.stdout:5/796: sync 2024-04-20T21:58:44.346 INFO:tasks.workunit.client.0.smithi142.stdout:2/952: sync 2024-04-20T21:58:44.346 INFO:tasks.workunit.client.0.smithi142.stdout:7/971: sync 2024-04-20T21:58:44.346 INFO:tasks.workunit.client.0.smithi142.stdout:9/860: sync 2024-04-20T21:58:44.346 INFO:tasks.workunit.client.0.smithi142.stdout:6/755: sync 2024-04-20T21:58:44.346 INFO:tasks.workunit.client.0.smithi142.stdout:0/737: sync 2024-04-20T21:58:44.354 INFO:tasks.workunit.client.0.smithi142.stdout:4/690: dwrite d1/d12/da/d1c/d32/d3d/f85 [0,4194304] 0 2024-04-20T21:58:44.372 INFO:tasks.workunit.client.0.smithi142.stdout:5/797: dwrite dc/d71/d5c/f8e [0,4194304] 0 2024-04-20T21:58:44.380 INFO:tasks.workunit.client.0.smithi142.stdout:8/809: sync 2024-04-20T21:58:44.381 INFO:tasks.workunit.client.0.smithi142.stdout:8/810: chown d0/d1c 14246192 1 2024-04-20T21:58:44.391 INFO:tasks.workunit.client.0.smithi142.stdout:1/801: rename d2/d4e/cfe to d2/dd/d1c/c110 0 2024-04-20T21:58:44.395 INFO:tasks.workunit.client.0.smithi142.stdout:1/802: write d2/dd/d17/d1b/d22/d13/f63 [2089408,64842] 0 2024-04-20T21:58:44.397 INFO:tasks.workunit.client.0.smithi142.stdout:4/691: mkdir d1/d5b/dd2 0 2024-04-20T21:58:44.400 INFO:tasks.workunit.client.0.smithi142.stdout:8/811: creat d0/d1c/d44/dad/db3/d3f/f116 x:0 0 0 2024-04-20T21:58:44.404 INFO:tasks.workunit.client.0.smithi142.stdout:2/953: rename d3/d13e/d104/d70/d117 to d3/d9/db6/de4/d146 0 2024-04-20T21:58:44.404 INFO:tasks.workunit.client.0.smithi142.stdout:8/812: truncate d0/d1c/d44/dad/fbc 383568 0 2024-04-20T21:58:44.406 INFO:tasks.workunit.client.0.smithi142.stdout:0/738: read - d5/d1c/d3c/d85/d38/d62/d9a/fce zero size 2024-04-20T21:58:44.408 INFO:tasks.workunit.client.0.smithi142.stdout:7/972: unlink d4/d7f/d77/d7e/db2/d12f/df1/d1c/dd5/l108 0 2024-04-20T21:58:44.410 INFO:tasks.workunit.client.0.smithi142.stdout:7/973: write d4/d7d/da1/fda [1320564,77359] 0 2024-04-20T21:58:44.411 INFO:tasks.workunit.client.0.smithi142.stdout:4/692: creat d1/d6/d30/fd3 x:0 0 0 2024-04-20T21:58:44.416 INFO:tasks.workunit.client.0.smithi142.stdout:2/954: mknod d3/d9/da3/dae/c147 0 2024-04-20T21:58:44.422 INFO:tasks.workunit.client.0.smithi142.stdout:3/911: getdents d6/d15/d30/d37/d6c/dcd/d99 0 2024-04-20T21:58:44.424 INFO:tasks.workunit.client.0.smithi142.stdout:7/974: creat d4/d7f/d77/d78/d9b/d5a/d90/f15a x:0 0 0 2024-04-20T21:58:44.425 INFO:tasks.workunit.client.0.smithi142.stdout:3/912: write d6/d15/d30/d37/d6c/dcd/f12e [1159748,1959] 0 2024-04-20T21:58:44.426 INFO:tasks.workunit.client.0.smithi142.stdout:6/756: link d1/d2f/d35/d5b/c1c d1/d2f/d35/d5b/d63/d64/c110 0 2024-04-20T21:58:44.428 INFO:tasks.workunit.client.0.smithi142.stdout:2/955: fdatasync d3/d9/d34/fa1 0 2024-04-20T21:58:44.431 INFO:tasks.workunit.client.0.smithi142.stdout:1/803: creat d2/dd/d1c/d88/d89/f111 x:0 0 0 2024-04-20T21:58:44.432 INFO:tasks.workunit.client.0.smithi142.stdout:5/798: getdents dc/d14/d21/d46/d2a/d65/da3 0 2024-04-20T21:58:44.434 INFO:tasks.workunit.client.0.smithi142.stdout:4/693: symlink d1/d5b/dd2/ld4 0 2024-04-20T21:58:44.436 INFO:tasks.workunit.client.0.smithi142.stdout:4/694: rename d1/d12/da to d1/d12/da/d72/dd5 22 2024-04-20T21:58:44.440 INFO:tasks.workunit.client.0.smithi142.stdout:7/975: write d4/d7f/d77/d7e/db2/d12f/df1/f69 [1317712,95635] 0 2024-04-20T21:58:44.441 INFO:tasks.workunit.client.0.smithi142.stdout:4/695: write d1/d12/da/d1c/d32/d3d/d2f/d73/fd1 [179498,103162] 0 2024-04-20T21:58:44.442 INFO:tasks.workunit.client.0.smithi142.stdout:0/739: creat d5/d1c/d3c/d85/fea x:0 0 0 2024-04-20T21:58:44.443 INFO:tasks.workunit.client.0.smithi142.stdout:2/956: creat d3/d9/d89/d9a/f148 x:0 0 0 2024-04-20T21:58:44.445 INFO:tasks.workunit.client.0.smithi142.stdout:5/799: dread f4 [0,4194304] 0 2024-04-20T21:58:44.447 INFO:tasks.workunit.client.0.smithi142.stdout:6/757: mknod d1/d2f/d35/d5b/d63/d64/c111 0 2024-04-20T21:58:44.448 INFO:tasks.workunit.client.0.smithi142.stdout:5/800: fsync dc/d14/d21/f103 0 2024-04-20T21:58:44.452 INFO:tasks.workunit.client.0.smithi142.stdout:7/976: creat d4/d7f/d77/d78/d9b/d5a/d90/f15b x:0 0 0 2024-04-20T21:58:44.454 INFO:tasks.workunit.client.0.smithi142.stdout:1/804: dread d2/dd/d17/d3b/d50/d62/f94 [0,4194304] 0 2024-04-20T21:58:44.455 INFO:tasks.workunit.client.0.smithi142.stdout:7/977: fdatasync d4/d7d/fa6 0 2024-04-20T21:58:44.455 INFO:tasks.workunit.client.0.smithi142.stdout:2/957: creat d3/d9/d89/d31/da7/f149 x:0 0 0 2024-04-20T21:58:44.457 INFO:tasks.workunit.client.0.smithi142.stdout:5/801: mkdir dc/d71/d5c/d68/d114 0 2024-04-20T21:58:44.459 INFO:tasks.workunit.client.0.smithi142.stdout:6/758: creat d1/d2f/d35/d5b/d3e/dc5/ddb/f112 x:0 0 0 2024-04-20T21:58:44.459 INFO:tasks.workunit.client.0.smithi142.stdout:5/802: chown dc/d14/d72/f85 300 1 2024-04-20T21:58:44.459 INFO:tasks.workunit.client.0.smithi142.stdout:7/978: truncate d4/d7f/d77/d78/da8/f14d 144714 0 2024-04-20T21:58:44.461 INFO:tasks.workunit.client.0.smithi142.stdout:5/803: chown dc/d14/d26/d3f/cf5 964118419 1 2024-04-20T21:58:44.462 INFO:tasks.workunit.client.0.smithi142.stdout:4/696: mknod d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/cd6 0 2024-04-20T21:58:44.466 INFO:tasks.workunit.client.0.smithi142.stdout:6/759: symlink d1/d2f/d35/d5b/d63/d4b/d61/db7/l113 0 2024-04-20T21:58:44.467 INFO:tasks.workunit.client.0.smithi142.stdout:7/979: mkdir d4/d7f/d77/d78/da8/dae/dd8/d131/d15c 0 2024-04-20T21:58:44.467 INFO:tasks.workunit.client.0.smithi142.stdout:6/760: readlink d1/d11/lef 0 2024-04-20T21:58:44.470 INFO:tasks.workunit.client.0.smithi142.stdout:1/805: symlink d2/dd/d17/d1b/d22/d55/df9/l112 0 2024-04-20T21:58:44.471 INFO:tasks.workunit.client.0.smithi142.stdout:2/958: getdents d3/d9/db6/de4/d146 0 2024-04-20T21:58:44.473 INFO:tasks.workunit.client.0.smithi142.stdout:4/697: mkdir d1/d6/d4a/d5a/d80/dd7 0 2024-04-20T21:58:44.474 INFO:tasks.workunit.client.0.smithi142.stdout:5/804: symlink dc/d14/d21/d46/d2a/l115 0 2024-04-20T21:58:44.475 INFO:tasks.workunit.client.0.smithi142.stdout:4/698: fdatasync d1/d6/d30/fd3 0 2024-04-20T21:58:44.476 INFO:tasks.workunit.client.0.smithi142.stdout:6/761: dread - d1/d2f/fb9 zero size 2024-04-20T21:58:44.476 INFO:tasks.workunit.client.0.smithi142.stdout:7/980: symlink d4/d7f/l15d 0 2024-04-20T21:58:44.480 INFO:tasks.workunit.client.0.smithi142.stdout:4/699: dread - d1/d12/da/d1c/d32/d3d/d2f/d52/d94/fa3 zero size 2024-04-20T21:58:44.480 INFO:tasks.workunit.client.0.smithi142.stdout:6/762: readlink d1/d2f/d35/d5b/d63/d4b/d61/lbd 0 2024-04-20T21:58:44.487 INFO:tasks.workunit.client.0.smithi142.stdout:7/981: mkdir d4/d7f/d77/d78/da8/dae/dd8/d15e 0 2024-04-20T21:58:44.487 INFO:tasks.workunit.client.0.smithi142.stdout:5/805: rename dc/d14/d26/d3f/d53/d7c/d97/da6 to dc/d14/d26/d3f/d53/d116 0 2024-04-20T21:58:44.487 INFO:tasks.workunit.client.0.smithi142.stdout:6/763: rename d1/d2f/d35/d5b/d3e to d1/d2f/d35/d5b/d3e/de0/d7e/d114 22 2024-04-20T21:58:44.490 INFO:tasks.workunit.client.0.smithi142.stdout:4/700: creat d1/fd8 x:0 0 0 2024-04-20T21:58:44.491 INFO:tasks.workunit.client.0.smithi142.stdout:4/701: stat d1/cab 0 2024-04-20T21:58:44.492 INFO:tasks.workunit.client.0.smithi142.stdout:5/806: creat dc/d14/d26/d3f/d53/d7c/da9/f117 x:0 0 0 2024-04-20T21:58:44.493 INFO:tasks.workunit.client.0.smithi142.stdout:6/764: mknod d1/d2f/d35/d5b/d3e/dc5/ddb/c115 0 2024-04-20T21:58:44.496 INFO:tasks.workunit.client.0.smithi142.stdout:5/807: truncate dc/d71/d5c/d68/ff0 492030 0 2024-04-20T21:58:44.498 INFO:tasks.workunit.client.0.smithi142.stdout:6/765: unlink d1/d75/fb1 0 2024-04-20T21:58:44.499 INFO:tasks.workunit.client.0.smithi142.stdout:6/766: dread - d1/d5/fba zero size 2024-04-20T21:58:44.501 INFO:tasks.workunit.client.0.smithi142.stdout:4/702: rename d1/d12/da/d1c/d32/d3d/d2f/d52/d94/fa3 to d1/d12/da/d1c/fd9 0 2024-04-20T21:58:44.502 INFO:tasks.workunit.client.0.smithi142.stdout:7/982: link d4/d7f/d77/d7e/db2/d12f/df1/d11/c133 d4/d7f/d77/d11a/c15f 0 2024-04-20T21:58:44.506 INFO:tasks.workunit.client.0.smithi142.stdout:6/767: symlink d1/l116 0 2024-04-20T21:58:44.508 INFO:tasks.workunit.client.0.smithi142.stdout:7/983: readlink d4/d7f/d77/d78/d9b/d5a/lc3 0 2024-04-20T21:58:44.509 INFO:tasks.workunit.client.0.smithi142.stdout:4/703: mkdir d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/dda 0 2024-04-20T21:58:44.513 INFO:tasks.workunit.client.0.smithi142.stdout:6/768: link d1/d2f/d35/d5b/d3e/ff6 d1/d5/d8b/f117 0 2024-04-20T21:58:44.515 INFO:tasks.workunit.client.0.smithi142.stdout:7/984: creat d4/d7f/d77/d78/d9b/d105/f160 x:0 0 0 2024-04-20T21:58:44.516 INFO:tasks.workunit.client.0.smithi142.stdout:4/704: mknod d1/d5b/cdb 0 2024-04-20T21:58:44.520 INFO:tasks.workunit.client.0.smithi142.stdout:5/808: dwrite dc/d14/d26/d3f/d53/d7c/d97/fc4 [4194304,4194304] 0 2024-04-20T21:58:44.522 INFO:tasks.workunit.client.0.smithi142.stdout:6/769: rename d1/c9 to d1/d5/d3a/d43/c118 0 2024-04-20T21:58:44.532 INFO:tasks.workunit.client.0.smithi142.stdout:4/705: symlink d1/d12/da/ldc 0 2024-04-20T21:58:44.536 INFO:tasks.workunit.client.0.smithi142.stdout:9/861: dwrite d0/d3c/f6f [0,4194304] 0 2024-04-20T21:58:44.537 INFO:tasks.workunit.client.0.smithi142.stdout:2/959: rename d3/d9/db6/de4 to d3/d9/db6/d14a 0 2024-04-20T21:58:44.540 INFO:tasks.workunit.client.0.smithi142.stdout:2/960: write d3/d5/d74/d108/f131 [834040,110747] 0 2024-04-20T21:58:44.549 INFO:tasks.workunit.client.0.smithi142.stdout:5/809: getdents dc/d14/d25/db4/dbb 0 2024-04-20T21:58:44.549 INFO:tasks.workunit.client.0.smithi142.stdout:8/813: write d0/d1c/d44/dad/db3/d3f/d7f/d8f/fb8 [357565,120253] 0 2024-04-20T21:58:44.553 INFO:tasks.workunit.client.0.smithi142.stdout:9/862: mkdir d0/d89/d11a/d111/d122 0 2024-04-20T21:58:44.554 INFO:tasks.workunit.client.0.smithi142.stdout:3/913: write d6/d15/d30/d37/f67 [1418061,1049] 0 2024-04-20T21:58:44.557 INFO:tasks.workunit.client.0.smithi142.stdout:8/814: chown d0/d1c/d44/dad/db3/f52 181888386 1 2024-04-20T21:58:44.563 INFO:tasks.workunit.client.0.smithi142.stdout:5/810: truncate dc/d14/f8d 392312 0 2024-04-20T21:58:44.567 INFO:tasks.workunit.client.0.smithi142.stdout:8/815: mknod d0/d1c/d44/dad/db3/d3f/d7f/c117 0 2024-04-20T21:58:44.569 INFO:tasks.workunit.client.0.smithi142.stdout:2/961: dwrite d3/d13e/d104/d70/d3c/f36 [0,4194304] 0 2024-04-20T21:58:44.572 INFO:tasks.workunit.client.0.smithi142.stdout:4/706: dwrite d1/d6/d4a/d5a/f6a [4194304,4194304] 0 2024-04-20T21:58:44.580 INFO:tasks.workunit.client.0.smithi142.stdout:0/740: dwrite d5/d45/d6f/f86 [0,4194304] 0 2024-04-20T21:58:44.592 INFO:tasks.workunit.client.0.smithi142.stdout:8/816: creat d0/d42/f118 x:0 0 0 2024-04-20T21:58:44.594 INFO:tasks.workunit.client.0.smithi142.stdout:1/806: dwrite d2/d4e/f7f [0,4194304] 0 2024-04-20T21:58:44.600 INFO:tasks.workunit.client.0.smithi142.stdout:4/707: read d1/f13 [820927,81913] 0 2024-04-20T21:58:44.610 INFO:tasks.workunit.client.0.smithi142.stdout:8/817: creat d0/d17/d35/db5/f119 x:0 0 0 2024-04-20T21:58:44.620 INFO:tasks.workunit.client.0.smithi142.stdout:4/708: unlink d1/cab 0 2024-04-20T21:58:44.625 INFO:tasks.workunit.client.0.smithi142.stdout:1/807: symlink d2/dd/d17/d3b/d50/d62/l113 0 2024-04-20T21:58:44.629 INFO:tasks.workunit.client.0.smithi142.stdout:6/770: write d1/d5/fb [1854108,105691] 0 2024-04-20T21:58:44.629 INFO:tasks.workunit.client.0.smithi142.stdout:8/818: symlink d0/d17/d35/db5/l11a 0 2024-04-20T21:58:44.633 INFO:tasks.workunit.client.0.smithi142.stdout:6/771: chown d1/d2f/d35/d5b/d63/d34 7919645 1 2024-04-20T21:58:44.634 INFO:tasks.workunit.client.0.smithi142.stdout:5/811: link dc/d14/d21/d46/d2a/d65/da3/cfb dc/c118 0 2024-04-20T21:58:44.634 INFO:tasks.workunit.client.0.smithi142.stdout:6/772: chown d1/d5/d8b 1 1 2024-04-20T21:58:44.636 INFO:tasks.workunit.client.0.smithi142.stdout:4/709: mkdir d1/d5b/ddd 0 2024-04-20T21:58:44.638 INFO:tasks.workunit.client.0.smithi142.stdout:3/914: dread d6/d15/d30/fba [0,4194304] 0 2024-04-20T21:58:44.639 INFO:tasks.workunit.client.0.smithi142.stdout:5/812: fdatasync dc/d14/d21/d46/d7d/fec 0 2024-04-20T21:58:44.644 INFO:tasks.workunit.client.0.smithi142.stdout:7/985: dwrite d4/f48 [0,4194304] 0 2024-04-20T21:58:44.647 INFO:tasks.workunit.client.0.smithi142.stdout:9/863: write d0/d89/fde [1248323,105681] 0 2024-04-20T21:58:44.651 INFO:tasks.workunit.client.0.smithi142.stdout:4/710: mknod d1/d12/da/d1c/d32/d3d/d2f/d7a/cde 0 2024-04-20T21:58:44.659 INFO:tasks.workunit.client.0.smithi142.stdout:2/962: dread d3/d9/d89/d31/da2/fd8 [0,4194304] 0 2024-04-20T21:58:44.661 INFO:tasks.workunit.client.0.smithi142.stdout:0/741: write d5/d1c/d3c/d85/fae [994535,78182] 0 2024-04-20T21:58:44.664 INFO:tasks.workunit.client.0.smithi142.stdout:5/813: symlink dc/d71/d93/l119 0 2024-04-20T21:58:44.675 INFO:tasks.workunit.client.0.smithi142.stdout:9/864: rename d0/d2a/d39/fbf to d0/dd5/d11d/f123 0 2024-04-20T21:58:44.682 INFO:tasks.workunit.client.0.smithi142.stdout:2/963: symlink d3/d9/d89/d31/dc3/dce/dea/d112/l14b 0 2024-04-20T21:58:44.685 INFO:tasks.workunit.client.0.smithi142.stdout:5/814: mkdir dc/d14/d26/d3f/db3/d11a 0 2024-04-20T21:58:44.685 INFO:tasks.workunit.client.0.smithi142.stdout:0/742: dwrite d5/d13/d1e/d23/d46/fc2 [0,4194304] 0 2024-04-20T21:58:44.692 INFO:tasks.workunit.client.0.smithi142.stdout:3/915: truncate d6/d15/d30/d37/d75/dbc/fd7 225081 0 2024-04-20T21:58:44.700 INFO:tasks.workunit.client.0.smithi142.stdout:8/819: dwrite d0/d1c/dd1/ff1 [0,4194304] 0 2024-04-20T21:58:44.705 INFO:tasks.workunit.client.0.smithi142.stdout:9/865: symlink d0/d89/d11a/d111/l124 0 2024-04-20T21:58:44.706 INFO:tasks.workunit.client.0.smithi142.stdout:6/773: write d1/d2f/d35/d5b/d3e/de0/d7e/d9f/dc0/fce [617228,1882] 0 2024-04-20T21:58:44.707 INFO:tasks.workunit.client.0.smithi142.stdout:1/808: dread d2/d4e/fd3 [0,4194304] 0 2024-04-20T21:58:44.712 INFO:tasks.workunit.client.0.smithi142.stdout:7/986: dwrite d4/f96 [0,4194304] 0 2024-04-20T21:58:44.714 INFO:tasks.workunit.client.0.smithi142.stdout:4/711: write d1/d12/da/d1c/f3b [3800264,93728] 0 2024-04-20T21:58:44.717 INFO:tasks.workunit.client.0.smithi142.stdout:0/743: fdatasync d5/d1c/d3c/f5a 0 2024-04-20T21:58:44.720 INFO:tasks.workunit.client.0.smithi142.stdout:0/744: chown d5/d13/d1e/d23/cd3 62565453 1 2024-04-20T21:58:44.721 INFO:tasks.workunit.client.0.smithi142.stdout:6/774: creat d1/d5/d3a/f119 x:0 0 0 2024-04-20T21:58:44.723 INFO:tasks.workunit.client.0.smithi142.stdout:9/866: rename d0/d91/fc7 to d0/d2a/f125 0 2024-04-20T21:58:44.725 INFO:tasks.workunit.client.0.smithi142.stdout:6/775: chown d1/d9e/c105 0 1 2024-04-20T21:58:44.727 INFO:tasks.workunit.client.0.smithi142.stdout:6/776: dread - d1/dd1/d65/ffe zero size 2024-04-20T21:58:44.727 INFO:tasks.workunit.client.0.smithi142.stdout:6/777: stat d1/la7 0 2024-04-20T21:58:44.731 INFO:tasks.workunit.client.0.smithi142.stdout:5/815: creat dc/f11b x:0 0 0 2024-04-20T21:58:44.735 INFO:tasks.workunit.client.0.smithi142.stdout:8/820: rmdir d0/d42/d90 39 2024-04-20T21:58:44.737 INFO:tasks.workunit.client.0.smithi142.stdout:0/745: fdatasync d5/d1c/d3c/d85/d38/d62/fd9 0 2024-04-20T21:58:44.738 INFO:tasks.workunit.client.0.smithi142.stdout:8/821: chown d0/d29/df5 44397 1 2024-04-20T21:58:44.740 INFO:tasks.workunit.client.0.smithi142.stdout:9/867: unlink d0/dd5/d11d/c116 0 2024-04-20T21:58:44.741 INFO:tasks.workunit.client.0.smithi142.stdout:0/746: chown d5/d1c/d3c/d95/fe1 41 1 2024-04-20T21:58:44.744 INFO:tasks.workunit.client.0.smithi142.stdout:3/916: creat d6/d15/f143 x:0 0 0 2024-04-20T21:58:44.746 INFO:tasks.workunit.client.0.smithi142.stdout:2/964: dwrite d3/d9/d89/d31/da2/fd8 [4194304,4194304] 0 2024-04-20T21:58:44.746 INFO:tasks.workunit.client.0.smithi142.stdout:8/822: write d0/d1c/d44/dad/db3/d3f/d7f/fc3 [3132119,38203] 0 2024-04-20T21:58:44.747 INFO:tasks.workunit.client.0.smithi142.stdout:1/809: write d2/dd/f8e [286251,40055] 0 2024-04-20T21:58:44.750 INFO:tasks.workunit.client.0.smithi142.stdout:7/987: mknod d4/d7f/d77/d7e/db2/d12f/df1/d11/c161 0 2024-04-20T21:58:44.754 INFO:tasks.workunit.client.0.smithi142.stdout:6/778: fsync d1/dd1/d8f/fd5 0 2024-04-20T21:58:44.755 INFO:tasks.workunit.client.0.smithi142.stdout:9/868: chown d0/d89/d11a/d111/cab 457529 1 2024-04-20T21:58:44.758 INFO:tasks.workunit.client.0.smithi142.stdout:3/917: creat d6/d32/de7/d126/f144 x:0 0 0 2024-04-20T21:58:44.762 INFO:tasks.workunit.client.0.smithi142.stdout:5/816: dwrite dc/d14/d26/d3f/d53/fc6 [0,4194304] 0 2024-04-20T21:58:44.762 INFO:tasks.workunit.client.0.smithi142.stdout:0/747: link d5/d1d/fbd d5/d6d/feb 0 2024-04-20T21:58:44.765 INFO:tasks.workunit.client.0.smithi142.stdout:1/810: fsync d2/dd/d1c/d60/dce/d7c/fa5 0 2024-04-20T21:58:44.770 INFO:tasks.workunit.client.0.smithi142.stdout:6/779: mknod d1/d11/c11a 0 2024-04-20T21:58:44.777 INFO:tasks.workunit.client.0.smithi142.stdout:6/780: dread - d1/d5/d3a/f119 zero size 2024-04-20T21:58:44.777 INFO:tasks.workunit.client.0.smithi142.stdout:4/712: write d1/d6/fc7 [3211753,69740] 0 2024-04-20T21:58:44.778 INFO:tasks.workunit.client.0.smithi142.stdout:2/965: mknod d3/d9/d89/c14c 0 2024-04-20T21:58:44.781 INFO:tasks.workunit.client.0.smithi142.stdout:4/713: fdatasync d1/d6/d4b/f82 0 2024-04-20T21:58:44.790 INFO:tasks.workunit.client.0.smithi142.stdout:7/988: dread d4/d7f/f91 [0,4194304] 0 2024-04-20T21:58:44.793 INFO:tasks.workunit.client.0.smithi142.stdout:1/811: mknod d2/dd/d17/d1b/d22/d13/c114 0 2024-04-20T21:58:44.810 INFO:tasks.workunit.client.0.smithi142.stdout:5/817: write dc/f32 [574161,28151] 0 2024-04-20T21:58:44.810 INFO:tasks.workunit.client.0.smithi142.stdout:7/989: chown d4/d7f/d77/d78/d9b/d5a/l92 1969877 1 2024-04-20T21:58:44.810 INFO:tasks.workunit.client.0.smithi142.stdout:3/918: dread d6/d15/d47/d83/dc9/da7/fd1 [0,4194304] 0 2024-04-20T21:58:44.810 INFO:tasks.workunit.client.0.smithi142.stdout:6/781: creat d1/d2f/d35/d5b/f11b x:0 0 0 2024-04-20T21:58:44.822 INFO:tasks.workunit.client.0.smithi142.stdout:8/823: dread d0/f1b [0,4194304] 0 2024-04-20T21:58:44.824 INFO:tasks.workunit.client.0.smithi142.stdout:7/990: creat d4/f162 x:0 0 0 2024-04-20T21:58:44.835 INFO:tasks.workunit.client.0.smithi142.stdout:6/782: fdatasync d1/d2f/d35/d48/f73 0 2024-04-20T21:58:44.838 INFO:tasks.workunit.client.0.smithi142.stdout:4/714: dwrite f0 [0,4194304] 0 2024-04-20T21:58:44.838 INFO:tasks.workunit.client.0.smithi142.stdout:0/748: dwrite d5/d1c/d3c/d85/d38/d62/f75 [0,4194304] 0 2024-04-20T21:58:44.849 INFO:tasks.workunit.client.0.smithi142.stdout:1/812: dwrite d2/dd/d17/d1b/d22/d55/f6e [0,4194304] 0 2024-04-20T21:58:44.849 INFO:tasks.workunit.client.0.smithi142.stdout:2/966: dwrite d3/d9/d89/d31/da2/ddb/de0/fc0 [0,4194304] 0 2024-04-20T21:58:44.851 INFO:tasks.workunit.client.0.smithi142.stdout:9/869: dwrite d0/d2a/d39/f98 [0,4194304] 0 2024-04-20T21:58:44.859 INFO:tasks.workunit.client.0.smithi142.stdout:5/818: dwrite dc/d6b/f9d [0,4194304] 0 2024-04-20T21:58:44.861 INFO:tasks.workunit.client.0.smithi142.stdout:3/919: dread d6/d15/d30/d37/d75/dbc/fd7 [0,4194304] 0 2024-04-20T21:58:44.862 INFO:tasks.workunit.client.0.smithi142.stdout:8/824: rmdir d0/d1c/d44/d89 39 2024-04-20T21:58:44.871 INFO:tasks.workunit.client.0.smithi142.stdout:1/813: symlink d2/dd/l115 0 2024-04-20T21:58:44.871 INFO:tasks.workunit.client.0.smithi142.stdout:2/967: symlink d3/d13e/d104/d70/l14d 0 2024-04-20T21:58:44.878 INFO:tasks.workunit.client.0.smithi142.stdout:0/749: mkdir d5/d1c/d3c/d95/dec 0 2024-04-20T21:58:44.889 INFO:tasks.workunit.client.0.smithi142.stdout:5/819: dread dc/d14/d21/d46/d2a/f74 [0,4194304] 0 2024-04-20T21:58:44.906 INFO:tasks.workunit.client.0.smithi142.stdout:9/870: dread d0/d2a/f34 [0,4194304] 0 2024-04-20T21:58:44.967 INFO:tasks.workunit.client.0.smithi142.stdout:8/825: mknod d0/d1c/d44/dad/db3/d3f/d7f/c11b 0 2024-04-20T21:58:44.973 INFO:tasks.workunit.client.0.smithi142.stdout:6/783: write d1/d5/d8b/f99 [76553,42833] 0 2024-04-20T21:58:44.976 INFO:tasks.workunit.client.0.smithi142.stdout:1/814: stat d2/dd/d17/d1b/l84 0 2024-04-20T21:58:44.977 INFO:tasks.workunit.client.0.smithi142.stdout:2/968: fsync d3/d13e/d104/f79 0 2024-04-20T21:58:44.978 INFO:tasks.workunit.client.0.smithi142.stdout:1/815: dread - d2/dd/d17/d1b/fe1 zero size 2024-04-20T21:58:44.983 INFO:tasks.workunit.client.0.smithi142.stdout:1/816: write d2/dd/d1c/d88/f106 [793634,106171] 0 2024-04-20T21:58:44.987 INFO:tasks.workunit.client.0.smithi142.stdout:5/820: creat dc/d14/d21/d46/de6/f11c x:0 0 0 2024-04-20T21:58:44.990 INFO:tasks.workunit.client.0.smithi142.stdout:5/821: chown dc/d14/d26/d3f/db3/fda 5 1 2024-04-20T21:58:44.990 INFO:tasks.workunit.client.0.smithi142.stdout:1/817: fdatasync d2/dd/d1c/d88/f106 0 2024-04-20T21:58:44.997 INFO:tasks.workunit.client.0.smithi142.stdout:8/826: unlink d0/d1c/d44/dad/db3/d3f/c55 0 2024-04-20T21:58:44.997 INFO:tasks.workunit.client.0.smithi142.stdout:7/991: link d4/d7f/d77/d7e/db2/d12f/df1/d11/l1a d4/d7f/d77/d78/da8/dae/dd8/l163 0 2024-04-20T21:58:45.005 INFO:tasks.workunit.client.0.smithi142.stdout:0/750: fdatasync d5/d1c/d3c/d85/d63/f64 0 2024-04-20T21:58:45.014 INFO:tasks.workunit.client.0.smithi142.stdout:1/818: mkdir d2/dd/d116 0 2024-04-20T21:58:45.017 INFO:tasks.workunit.client.0.smithi142.stdout:5/822: creat dc/d14/d21/d7f/f11d x:0 0 0 2024-04-20T21:58:45.022 INFO:tasks.workunit.client.0.smithi142.stdout:5/823: truncate dc/d14/d21/d46/dc1/dd4/ddf/ffe 239622 0 2024-04-20T21:58:45.024 INFO:tasks.workunit.client.0.smithi142.stdout:0/751: truncate d5/d1c/f5c 442534 0 2024-04-20T21:58:45.027 INFO:tasks.workunit.client.0.smithi142.stdout:9/871: creat d0/d89/d11a/d111/f126 x:0 0 0 2024-04-20T21:58:45.027 INFO:tasks.workunit.client.0.smithi142.stdout:4/715: getdents d1/d12/da/d1c/d32/d3d/d2f/d7a/d90 0 2024-04-20T21:58:45.031 INFO:tasks.workunit.client.0.smithi142.stdout:1/819: rmdir d2/dd/d17/d1b 39 2024-04-20T21:58:45.036 INFO:tasks.workunit.client.0.smithi142.stdout:5/824: chown dc/d6b/c9e 24 1 2024-04-20T21:58:45.037 INFO:tasks.workunit.client.0.smithi142.stdout:9/872: mkdir d0/d91/db4/d127 0 2024-04-20T21:58:45.038 INFO:tasks.workunit.client.0.smithi142.stdout:5/825: write dc/d14/d21/d7f/f11d [714259,6444] 0 2024-04-20T21:58:45.042 INFO:tasks.workunit.client.0.smithi142.stdout:8/827: rename d0/d42/f98 to d0/d42/f11c 0 2024-04-20T21:58:45.043 INFO:tasks.workunit.client.0.smithi142.stdout:1/820: symlink d2/dd/d1c/d60/dce/d7c/ddd/l117 0 2024-04-20T21:58:45.047 INFO:tasks.workunit.client.0.smithi142.stdout:7/992: creat d4/d7f/d77/d7e/f164 x:0 0 0 2024-04-20T21:58:45.049 INFO:tasks.workunit.client.0.smithi142.stdout:9/873: mknod d0/d89/c128 0 2024-04-20T21:58:45.052 INFO:tasks.workunit.client.0.smithi142.stdout:4/716: mknod d1/d12/da/d1c/d32/d3d/d2f/d52/d6d/cdf 0 2024-04-20T21:58:45.053 INFO:tasks.workunit.client.0.smithi142.stdout:5/826: symlink dc/d6b/l11e 0 2024-04-20T21:58:45.055 INFO:tasks.workunit.client.0.smithi142.stdout:4/717: readlink d1/d12/da/d1c/d32/d3d/d2f/d73/l93 0 2024-04-20T21:58:45.057 INFO:tasks.workunit.client.0.smithi142.stdout:1/821: mknod d2/dd/d1c/d88/c118 0 2024-04-20T21:58:45.057 INFO:tasks.workunit.client.0.smithi142.stdout:8/828: dread d0/f7b [0,4194304] 0 2024-04-20T21:58:45.059 INFO:tasks.workunit.client.0.smithi142.stdout:7/993: chown d4/d7d/cc0 949 1 2024-04-20T21:58:45.063 INFO:tasks.workunit.client.0.smithi142.stdout:9/874: fdatasync d0/d89/fa7 0 2024-04-20T21:58:45.065 INFO:tasks.workunit.client.0.smithi142.stdout:6/784: mknod d1/dd1/c11c 0 2024-04-20T21:58:45.067 INFO:tasks.workunit.client.0.smithi142.stdout:6/785: chown d1/d5/d3a/d43 109 1 2024-04-20T21:58:45.068 INFO:tasks.workunit.client.0.smithi142.stdout:8/829: unlink d0/f7b 0 2024-04-20T21:58:45.071 INFO:tasks.workunit.client.0.smithi142.stdout:1/822: symlink d2/dd/d1c/d60/dce/d7c/l119 0 2024-04-20T21:58:45.074 INFO:tasks.workunit.client.0.smithi142.stdout:5/827: dread dc/d71/d5c/d68/f8c [0,4194304] 0 2024-04-20T21:58:45.075 INFO:tasks.workunit.client.0.smithi142.stdout:5/828: chown dc/d14/d25/db4 392 1 2024-04-20T21:58:45.078 INFO:tasks.workunit.client.0.smithi142.stdout:4/718: dread d1/d6/d4a/d5a/f56 [0,4194304] 0 2024-04-20T21:58:45.080 INFO:tasks.workunit.client.0.smithi142.stdout:9/875: mknod d0/d89/d95/de4/c129 0 2024-04-20T21:58:45.085 INFO:tasks.workunit.client.0.smithi142.stdout:8/830: chown d0/d29/ldc 223 1 2024-04-20T21:58:45.095 INFO:tasks.workunit.client.0.smithi142.stdout:4/719: dwrite d1/d12/da/d1c/f25 [0,4194304] 0 2024-04-20T21:58:45.107 INFO:tasks.workunit.client.0.smithi142.stdout:6/786: truncate d1/d2f/d35/d5b/d39/dcd/fdd 1145851 0 2024-04-20T21:58:45.118 INFO:tasks.workunit.client.0.smithi142.stdout:4/720: creat d1/fe0 x:0 0 0 2024-04-20T21:58:45.120 INFO:tasks.workunit.client.0.smithi142.stdout:7/994: link d4/d7f/c54 d4/d7f/d77/d78/d97/d9a/dc4/c165 0 2024-04-20T21:58:45.122 INFO:tasks.workunit.client.0.smithi142.stdout:3/920: rename d6/d32/d39/d12d to d6/d15/d30/d37/d6c/d145 0 2024-04-20T21:58:45.125 INFO:tasks.workunit.client.0.smithi142.stdout:1/823: creat d2/f11a x:0 0 0 2024-04-20T21:58:45.136 INFO:tasks.workunit.client.0.smithi142.stdout:8/831: dread d0/d29/f3c [0,4194304] 0 2024-04-20T21:58:45.139 INFO:tasks.workunit.client.0.smithi142.stdout:3/921: dwrite d6/f2e [4194304,4194304] 0 2024-04-20T21:58:45.162 INFO:tasks.workunit.client.0.smithi142.stdout:3/922: mknod d6/d32/d39/d69/de0/c146 0 2024-04-20T21:58:45.167 INFO:tasks.workunit.client.0.smithi142.stdout:9/876: getdents d0 0 2024-04-20T21:58:45.169 INFO:tasks.workunit.client.0.smithi142.stdout:8/832: mkdir d0/d17/d35/db5/d101/d11d 0 2024-04-20T21:58:45.173 INFO:tasks.workunit.client.0.smithi142.stdout:9/877: mkdir d0/d2a/d8b/d12a 0 2024-04-20T21:58:45.178 INFO:tasks.workunit.client.0.smithi142.stdout:9/878: unlink d0/d36/c49 0 2024-04-20T21:58:45.182 INFO:tasks.workunit.client.0.smithi142.stdout:9/879: symlink d0/d2a/d39/d50/l12b 0 2024-04-20T21:58:45.185 INFO:tasks.workunit.client.0.smithi142.stdout:1/824: link d2/dd/d17/d1b/d22/d13/f63 d2/dd/d17/d1b/d22/f11b 0 2024-04-20T21:58:45.198 INFO:tasks.workunit.client.0.smithi142.stdout:9/880: dwrite d0/ff0 [0,4194304] 0 2024-04-20T21:58:45.201 INFO:tasks.workunit.client.0.smithi142.stdout:1/825: dread d2/dd/d17/d1b/d22/d55/f6e [0,4194304] 0 2024-04-20T21:58:45.204 INFO:tasks.workunit.client.0.smithi142.stdout:9/881: chown d0/d2a/d39/f106 692131 1 2024-04-20T21:58:45.207 INFO:tasks.workunit.client.0.smithi142.stdout:1/826: truncate d2/dd/d1c/d88/d89/f111 422138 0 2024-04-20T21:58:45.216 INFO:tasks.workunit.client.0.smithi142.stdout:9/882: write d0/d3c/d4d/d103/f10b [535381,87500] 0 2024-04-20T21:58:45.221 INFO:tasks.workunit.client.0.smithi142.stdout:1/827: truncate d2/dd/d17/d3b/f95 455123 0 2024-04-20T21:58:45.226 INFO:tasks.workunit.client.0.smithi142.stdout:1/828: read d2/fb0 [154538,123337] 0 2024-04-20T21:58:45.227 INFO:tasks.workunit.client.0.smithi142.stdout:0/752: write d5/d1c/d3c/f73 [1653351,55909] 0 2024-04-20T21:58:45.230 INFO:tasks.workunit.client.0.smithi142.stdout:1/829: creat d2/dd/d1c/d88/d89/db1/f11c x:0 0 0 2024-04-20T21:58:45.232 INFO:tasks.workunit.client.0.smithi142.stdout:0/753: creat d5/d45/d6f/d70/fed x:0 0 0 2024-04-20T21:58:45.245 INFO:tasks.workunit.client.0.smithi142.stdout:5/829: write dc/d14/d26/ff6 [2826686,71105] 0 2024-04-20T21:58:45.250 INFO:tasks.workunit.client.0.smithi142.stdout:5/830: getdents dc/d71/d5c/d68/d108 0 2024-04-20T21:58:45.253 INFO:tasks.workunit.client.0.smithi142.stdout:1/830: dwrite d2/dd/d1c/d88/f8d [4194304,4194304] 0 2024-04-20T21:58:45.254 INFO:tasks.workunit.client.0.smithi142.stdout:5/831: read dc/d14/d26/d3f/f9b [1254314,18477] 0 2024-04-20T21:58:45.260 INFO:tasks.workunit.client.0.smithi142.stdout:5/832: chown dc/d14/d21/d46/d7d/db0/fb1 225400622 1 2024-04-20T21:58:45.263 INFO:tasks.workunit.client.0.smithi142.stdout:5/833: dread - dc/d14/d21/d46/de6/f11c zero size 2024-04-20T21:58:45.266 INFO:tasks.workunit.client.0.smithi142.stdout:1/831: dread d2/d4e/d7e/fbd [0,4194304] 0 2024-04-20T21:58:45.269 INFO:tasks.workunit.client.0.smithi142.stdout:6/787: truncate d1/d1b/f1e 2543918 0 2024-04-20T21:58:45.272 INFO:tasks.workunit.client.0.smithi142.stdout:6/788: write d1/d5/d8b/f99 [445539,77431] 0 2024-04-20T21:58:45.273 INFO:tasks.workunit.client.0.smithi142.stdout:1/832: symlink d2/l11d 0 2024-04-20T21:58:45.273 INFO:tasks.workunit.client.0.smithi142.stdout:5/834: dread f4 [0,4194304] 0 2024-04-20T21:58:45.275 INFO:tasks.workunit.client.0.smithi142.stdout:4/721: dwrite d1/d12/da/d1c/d32/f60 [0,4194304] 0 2024-04-20T21:58:45.281 INFO:tasks.workunit.client.0.smithi142.stdout:2/969: rename d3/d5 to d3/d13e/d104/d14e 0 2024-04-20T21:58:45.284 INFO:tasks.workunit.client.0.smithi142.stdout:5/835: mknod dc/d14/d21/d7f/de5/c11f 0 2024-04-20T21:58:45.294 INFO:tasks.workunit.client.0.smithi142.stdout:8/833: rename d0/d1c/d44/dee to d0/d29/df5/d11e 0 2024-04-20T21:58:45.294 INFO:tasks.workunit.client.0.smithi142.stdout:2/970: fsync d3/d9/d34/f35 0 2024-04-20T21:58:45.294 INFO:tasks.workunit.client.0.smithi142.stdout:2/971: chown d3/d13e 884 1 2024-04-20T21:58:45.297 INFO:tasks.workunit.client.0.smithi142.stdout:1/833: dwrite d2/dd/f8e [0,4194304] 0 2024-04-20T21:58:45.343 INFO:tasks.workunit.client.0.smithi142.stdout:5/836: fsync dc/d14/d25/db4/fc2 0 2024-04-20T21:58:45.346 INFO:tasks.workunit.client.0.smithi142.stdout:5/837: write dc/f11b [664326,31988] 0 2024-04-20T21:58:45.348 INFO:tasks.workunit.client.0.smithi142.stdout:9/883: rename d0/f14 to d0/d91/da0/f12c 0 2024-04-20T21:58:45.350 INFO:tasks.workunit.client.0.smithi142.stdout:2/972: creat d3/d13e/d104/d94/f14f x:0 0 0 2024-04-20T21:58:45.351 INFO:tasks.workunit.client.0.smithi142.stdout:1/834: mknod d2/dd/d1c/d60/dce/d7c/ddd/c11e 0 2024-04-20T21:58:45.354 INFO:tasks.workunit.client.0.smithi142.stdout:2/973: write d3/d13e/d104/d70/de6/fff [122406,112622] 0 2024-04-20T21:58:45.355 INFO:tasks.workunit.client.0.smithi142.stdout:1/835: write d2/dd/d17/d1b/d22/f46 [2107286,121519] 0 2024-04-20T21:58:45.358 INFO:tasks.workunit.client.0.smithi142.stdout:8/834: mknod d0/d29/c11f 0 2024-04-20T21:58:45.361 INFO:tasks.workunit.client.0.smithi142.stdout:5/838: write dc/d14/d25/db4/fc8 [6144973,63829] 0 2024-04-20T21:58:45.366 INFO:tasks.workunit.client.0.smithi142.stdout:5/839: readlink dc/d14/d26/d3f/d53/d7c/da9/d75/dac/lb6 0 2024-04-20T21:58:45.369 INFO:tasks.workunit.client.0.smithi142.stdout:5/840: stat dc/d14/d25/db4/fc8 0 2024-04-20T21:58:45.370 INFO:tasks.workunit.client.0.smithi142.stdout:4/722: dwrite d1/d6/d4a/f71 [0,4194304] 0 2024-04-20T21:58:45.375 INFO:tasks.workunit.client.0.smithi142.stdout:0/754: rename d5/d45/d6f/d70/c83 to d5/d1c/d3c/d85/d38/cee 0 2024-04-20T21:58:45.378 INFO:tasks.workunit.client.0.smithi142.stdout:1/836: link d2/dd/d1c/d60/dce/f76 d2/dd/d1c/d60/dda/f11f 0 2024-04-20T21:58:45.380 INFO:tasks.workunit.client.0.smithi142.stdout:2/974: dwrite d3/d13e/d104/d70/de6/f141 [0,4194304] 0 2024-04-20T21:58:45.381 INFO:tasks.workunit.client.0.smithi142.stdout:1/837: fdatasync d2/dd/d17/d1b/f3c 0 2024-04-20T21:58:45.383 INFO:tasks.workunit.client.0.smithi142.stdout:4/723: mknod d1/d12/da/d1c/d32/d3d/d2f/d73/ce1 0 2024-04-20T21:58:45.383 INFO:tasks.workunit.client.0.smithi142.stdout:5/841: mknod dc/d71/c120 0 2024-04-20T21:58:45.391 INFO:tasks.workunit.client.0.smithi142.stdout:1/838: symlink d2/dd/d17/d1b/d22/l120 0 2024-04-20T21:58:45.397 INFO:tasks.workunit.client.0.smithi142.stdout:4/724: creat d1/d12/da/d1c/d32/d3d/d9d/fe2 x:0 0 0 2024-04-20T21:58:45.407 INFO:tasks.workunit.client.0.smithi142.stdout:1/839: mkdir d2/dd/d1c/d60/d121 0 2024-04-20T21:58:45.410 INFO:tasks.workunit.client.0.smithi142.stdout:2/975: dwrite d3/d13e/d104/d94/f14f [0,4194304] 0 2024-04-20T21:58:45.411 INFO:tasks.workunit.client.0.smithi142.stdout:4/725: rename d1/d12/da/d1c/d32/d3d/d2f/d52/c5e to d1/d12/da/d37/ce3 0 2024-04-20T21:58:45.416 INFO:tasks.workunit.client.0.smithi142.stdout:6/789: truncate d1/d5/fb 2419433 0 2024-04-20T21:58:45.417 INFO:tasks.workunit.client.0.smithi142.stdout:4/726: chown d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/cd6 13508540 1 2024-04-20T21:58:45.418 INFO:tasks.workunit.client.0.smithi142.stdout:1/840: symlink d2/dd/d17/d1b/d22/l122 0 2024-04-20T21:58:45.427 INFO:tasks.workunit.client.0.smithi142.stdout:6/790: creat d1/d11/f11d x:0 0 0 2024-04-20T21:58:45.440 INFO:tasks.workunit.client.0.smithi142.stdout:2/976: dwrite d3/d9/d89/d31/f73 [4194304,4194304] 0 2024-04-20T21:58:45.442 INFO:tasks.workunit.client.0.smithi142.stdout:0/755: dread d5/d1c/d3c/d85/d63/f82 [4194304,4194304] 0 2024-04-20T21:58:45.443 INFO:tasks.workunit.client.0.smithi142.stdout:1/841: creat d2/dd/d17/d3b/d50/d62/f123 x:0 0 0 2024-04-20T21:58:45.444 INFO:tasks.workunit.client.0.smithi142.stdout:6/791: creat d1/d2f/d35/d5b/d63/d4b/d83/f11e x:0 0 0 2024-04-20T21:58:45.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:45 smithi164 ceph-mon[23506]: pgmap v44: 65 pgs: 65 active+clean; 1.7 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 66 MiB/s rd, 156 MiB/s wr, 441 op/s 2024-04-20T21:58:45.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:45 smithi142 ceph-mon[15828]: pgmap v44: 65 pgs: 65 active+clean; 1.7 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 66 MiB/s rd, 156 MiB/s wr, 441 op/s 2024-04-20T21:58:45.447 INFO:tasks.workunit.client.0.smithi142.stdout:2/977: write d3/d9/d34/db5/f12f [224612,72743] 0 2024-04-20T21:58:45.447 INFO:tasks.workunit.client.0.smithi142.stdout:9/884: mkdir d0/d89/d95/d12d 0 2024-04-20T21:58:45.451 INFO:tasks.workunit.client.0.smithi142.stdout:1/842: chown d2/c8 10990 1 2024-04-20T21:58:45.452 INFO:tasks.workunit.client.0.smithi142.stdout:6/792: rmdir d1/d2f/d35/d48 39 2024-04-20T21:58:45.455 INFO:tasks.workunit.client.0.smithi142.stdout:5/842: write dc/d14/d21/d46/d2a/f74 [755357,118796] 0 2024-04-20T21:58:45.458 INFO:tasks.workunit.client.0.smithi142.stdout:2/978: symlink d3/d9/d89/d9a/l150 0 2024-04-20T21:58:45.461 INFO:tasks.workunit.client.0.smithi142.stdout:0/756: dread d5/d13/d1e/d23/d24/d48/d55/f74 [0,4194304] 0 2024-04-20T21:58:45.463 INFO:tasks.workunit.client.0.smithi142.stdout:1/843: rename d2/dd/d17/d1b/d22/d13/c114 to d2/de5/c124 0 2024-04-20T21:58:45.465 INFO:tasks.workunit.client.0.smithi142.stdout:6/793: dread - d1/d2f/d35/d5b/d63/d4b/f90 zero size 2024-04-20T21:58:45.469 INFO:tasks.workunit.client.0.smithi142.stdout:9/885: mknod d0/d2a/d39/d87/d9e/db3/c12e 0 2024-04-20T21:58:45.474 INFO:tasks.workunit.client.0.smithi142.stdout:2/979: unlink d3/d13e/d104/d14e/d67/dc4/f143 0 2024-04-20T21:58:45.475 INFO:tasks.workunit.client.0.smithi142.stdout:9/886: chown d0/d2a/d8b/cb9 742247 1 2024-04-20T21:58:45.477 INFO:tasks.workunit.client.0.smithi142.stdout:1/844: truncate d2/dd/d17/d3b/f9d 2264299 0 2024-04-20T21:58:45.481 INFO:tasks.workunit.client.0.smithi142.stdout:4/727: truncate d1/d12/da/d1c/f26 6421316 0 2024-04-20T21:58:45.484 INFO:tasks.workunit.client.0.smithi142.stdout:1/845: rmdir d2/dd/d17/d1b/d22/d20 39 2024-04-20T21:58:45.484 INFO:tasks.workunit.client.0.smithi142.stdout:9/887: chown d0/l35 425612 1 2024-04-20T21:58:45.489 INFO:tasks.workunit.client.0.smithi142.stdout:5/843: getdents dc/d14/d25/d78 0 2024-04-20T21:58:45.491 INFO:tasks.workunit.client.0.smithi142.stdout:4/728: chown d1/d12/da/d1c/d32/d3d/d2f/d49/f76 105850 1 2024-04-20T21:58:45.493 INFO:tasks.workunit.client.0.smithi142.stdout:9/888: mkdir d0/d2a/dd4/d12f 0 2024-04-20T21:58:45.495 INFO:tasks.workunit.client.0.smithi142.stdout:6/794: dwrite d1/d2f/d35/d5b/d63/d4b/d61/db7/f10e [0,4194304] 0 2024-04-20T21:58:45.497 INFO:tasks.workunit.client.0.smithi142.stdout:0/757: dread d5/f17 [0,4194304] 0 2024-04-20T21:58:45.503 INFO:tasks.workunit.client.0.smithi142.stdout:2/980: dread d3/d13e/d104/d70/d3c/f36 [0,4194304] 0 2024-04-20T21:58:45.503 INFO:tasks.workunit.client.0.smithi142.stdout:1/846: link d2/dd/d1c/d60/dce/l51 d2/d4e/d7e/l125 0 2024-04-20T21:58:45.508 INFO:tasks.workunit.client.0.smithi142.stdout:6/795: stat d1/d2f/d35/f109 0 2024-04-20T21:58:45.509 INFO:tasks.workunit.client.0.smithi142.stdout:2/981: chown d3/d13e/d104/d14e/d67/l7a 58975 1 2024-04-20T21:58:45.510 INFO:tasks.workunit.client.0.smithi142.stdout:1/847: write d2/dd/d17/d1b/d22/d13/f39 [2156679,91416] 0 2024-04-20T21:58:45.512 INFO:tasks.workunit.client.0.smithi142.stdout:0/758: stat d5/d13/d1e/d8f/ccf 0 2024-04-20T21:58:45.513 INFO:tasks.workunit.client.0.smithi142.stdout:6/796: write d1/dd1/d8f/ff2 [31851,4103] 0 2024-04-20T21:58:45.514 INFO:tasks.workunit.client.0.smithi142.stdout:4/729: rename d1/d6/f1f to d1/d12/da/d1c/d32/d3d/d2f/d52/d94/fe4 0 2024-04-20T21:58:45.515 INFO:tasks.workunit.client.0.smithi142.stdout:5/844: dwrite dc/d14/d25/db4/fc8 [4194304,4194304] 0 2024-04-20T21:58:45.517 INFO:tasks.workunit.client.0.smithi142.stdout:2/982: dread - d3/d9/d89/d31/de1/f123 zero size 2024-04-20T21:58:45.519 INFO:tasks.workunit.client.0.smithi142.stdout:9/889: mkdir d0/d89/d95/d12d/d130 0 2024-04-20T21:58:45.522 INFO:tasks.workunit.client.0.smithi142.stdout:0/759: chown d5/d45/d6f/d70/da9 5239851 1 2024-04-20T21:58:45.527 INFO:tasks.workunit.client.0.smithi142.stdout:1/848: rename d2 to d2/dd/d1c/d88/d89/d126 22 2024-04-20T21:58:45.530 INFO:tasks.workunit.client.0.smithi142.stdout:4/730: symlink d1/d12/le5 0 2024-04-20T21:58:45.536 INFO:tasks.workunit.client.0.smithi142.stdout:0/760: read - d5/d1c/d3c/fbc zero size 2024-04-20T21:58:45.536 INFO:tasks.workunit.client.0.smithi142.stdout:6/797: truncate d1/d2f/d35/d5b/d63/d4b/d61/db7/fc3 1020936 0 2024-04-20T21:58:45.538 INFO:tasks.workunit.client.0.smithi142.stdout:1/849: creat d2/dd/f127 x:0 0 0 2024-04-20T21:58:45.540 INFO:tasks.workunit.client.0.smithi142.stdout:4/731: chown d1/d12/da/d1c/d32/d3d/f6b 39101387 1 2024-04-20T21:58:45.542 INFO:tasks.workunit.client.0.smithi142.stdout:5/845: creat dc/d14/d21/d46/f121 x:0 0 0 2024-04-20T21:58:45.543 INFO:tasks.workunit.client.0.smithi142.stdout:5/846: readlink dc/l31 0 2024-04-20T21:58:45.544 INFO:tasks.workunit.client.0.smithi142.stdout:6/798: mknod d1/d5/d3a/d43/c11f 0 2024-04-20T21:58:45.546 INFO:tasks.workunit.client.0.smithi142.stdout:9/890: creat d0/d89/d11a/d111/f131 x:0 0 0 2024-04-20T21:58:45.549 INFO:tasks.workunit.client.0.smithi142.stdout:0/761: mknod d5/d1c/d3c/d4a/cef 0 2024-04-20T21:58:45.553 INFO:tasks.workunit.client.0.smithi142.stdout:2/983: getdents d3/d9/d89 0 2024-04-20T21:58:45.557 INFO:tasks.workunit.client.0.smithi142.stdout:6/799: rename d1/dd1/c11c to d1/d75/c120 0 2024-04-20T21:58:45.563 INFO:tasks.workunit.client.0.smithi142.stdout:1/850: dread d2/dd/d17/d1b/d22/d20/f8c [0,4194304] 0 2024-04-20T21:58:45.564 INFO:tasks.workunit.client.0.smithi142.stdout:2/984: mknod d3/d9/d89/d31/da7/c151 0 2024-04-20T21:58:45.567 INFO:tasks.workunit.client.0.smithi142.stdout:5/847: dwrite dc/d71/fb9 [4194304,4194304] 0 2024-04-20T21:58:45.570 INFO:tasks.workunit.client.0.smithi142.stdout:6/800: rmdir d1/d5 39 2024-04-20T21:58:45.572 INFO:tasks.workunit.client.0.smithi142.stdout:0/762: rename d5/d45/d6f/d70/fb7 to d5/dc9/ff0 0 2024-04-20T21:58:45.575 INFO:tasks.workunit.client.0.smithi142.stdout:0/763: chown d5/d1c/d3c/fbc 4225112 1 2024-04-20T21:58:45.577 INFO:tasks.workunit.client.0.smithi142.stdout:0/764: chown d5/d13/f7d 2055558948 1 2024-04-20T21:58:45.588 INFO:tasks.workunit.client.0.smithi142.stdout:9/891: dread d0/d2a/f2d [4194304,4194304] 0 2024-04-20T21:58:45.588 INFO:tasks.workunit.client.0.smithi142.stdout:4/732: dread d1/d6/d30/fa0 [0,4194304] 0 2024-04-20T21:58:45.592 INFO:tasks.workunit.client.0.smithi142.stdout:0/765: symlink d5/d6d/lf1 0 2024-04-20T21:58:45.595 INFO:tasks.workunit.client.0.smithi142.stdout:1/851: fdatasync d2/d4e/f64 0 2024-04-20T21:58:45.598 INFO:tasks.workunit.client.0.smithi142.stdout:5/848: fdatasync dc/d14/d21/f96 0 2024-04-20T21:58:45.600 INFO:tasks.workunit.client.0.smithi142.stdout:1/852: chown d2/dd/d17/d1b/d22/d55 540311 1 2024-04-20T21:58:45.601 INFO:tasks.workunit.client.0.smithi142.stdout:5/849: write f3 [1986188,9702] 0 2024-04-20T21:58:45.607 INFO:tasks.workunit.client.0.smithi142.stdout:9/892: write d0/d89/d11a/d111/f65 [4615936,20945] 0 2024-04-20T21:58:45.607 INFO:tasks.workunit.client.0.smithi142.stdout:5/850: write dc/fff [1218995,21213] 0 2024-04-20T21:58:45.607 INFO:tasks.workunit.client.0.smithi142.stdout:4/733: creat d1/d12/da/d72/dc5/fe6 x:0 0 0 2024-04-20T21:58:45.610 INFO:tasks.workunit.client.0.smithi142.stdout:2/985: write d3/d9/d89/d31/da2/ddb/de0/f10b [309953,42019] 0 2024-04-20T21:58:45.619 INFO:tasks.workunit.client.0.smithi142.stdout:2/986: fdatasync d3/f1f 0 2024-04-20T21:58:45.620 INFO:tasks.workunit.client.0.smithi142.stdout:1/853: write d2/dd/d17/d3b/d50/f52 [644222,42493] 0 2024-04-20T21:58:45.622 INFO:tasks.workunit.client.0.smithi142.stdout:4/734: read d1/d6/f47 [1136334,18221] 0 2024-04-20T21:58:45.623 INFO:tasks.workunit.client.0.smithi142.stdout:5/851: link dc/d14/d21/d46/f24 dc/d14/d21/d46/dc1/dd4/f122 0 2024-04-20T21:58:45.624 INFO:tasks.workunit.client.0.smithi142.stdout:0/766: dwrite d5/d1c/d3c/d85/d38/d62/f75 [0,4194304] 0 2024-04-20T21:58:45.625 INFO:tasks.workunit.client.0.smithi142.stdout:9/893: truncate d0/d36/f41 1220976 0 2024-04-20T21:58:45.628 INFO:tasks.workunit.client.0.smithi142.stdout:6/801: dwrite d1/d5/d8b/f117 [0,4194304] 0 2024-04-20T21:58:45.632 INFO:tasks.workunit.client.0.smithi142.stdout:4/735: unlink d1/d12/da/d37/d89/dc8/cce 0 2024-04-20T21:58:45.636 INFO:tasks.workunit.client.0.smithi142.stdout:1/854: creat d2/dd/d1c/d60/dce/d7c/de7/f128 x:0 0 0 2024-04-20T21:58:45.638 INFO:tasks.workunit.client.0.smithi142.stdout:4/736: chown d1/d12/da/d1c/d32/d3d/d9d/fa2 137382359 1 2024-04-20T21:58:45.643 INFO:tasks.workunit.client.0.smithi142.stdout:6/802: unlink d1/d11/cd 0 2024-04-20T21:58:45.644 INFO:tasks.workunit.client.0.smithi142.stdout:2/987: dread d3/d13e/d104/d70/d3c/d64/f81 [0,4194304] 0 2024-04-20T21:58:45.648 INFO:tasks.workunit.client.0.smithi142.stdout:1/855: truncate d2/dd/d17/d3b/d74/fd5 73717 0 2024-04-20T21:58:45.650 INFO:tasks.workunit.client.0.smithi142.stdout:6/803: rmdir d1/dd1/d65 39 2024-04-20T21:58:45.650 INFO:tasks.workunit.client.0.smithi142.stdout:9/894: stat d0/dd5/cd7 0 2024-04-20T21:58:45.652 INFO:tasks.workunit.client.0.smithi142.stdout:5/852: write dc/d14/d25/f2d [3712323,49587] 0 2024-04-20T21:58:45.655 INFO:tasks.workunit.client.0.smithi142.stdout:2/988: symlink d3/d9/d89/d31/da2/l152 0 2024-04-20T21:58:45.656 INFO:tasks.workunit.client.0.smithi142.stdout:5/853: chown dc/d14/d21/d46/dc1/dd4/ddf/ffc 2398808 1 2024-04-20T21:58:45.657 INFO:tasks.workunit.client.0.smithi142.stdout:0/767: write d5/d45/d6f/f81 [1202667,13807] 0 2024-04-20T21:58:45.658 INFO:tasks.workunit.client.0.smithi142.stdout:5/854: stat dc/d14/d21 0 2024-04-20T21:58:45.662 INFO:tasks.workunit.client.0.smithi142.stdout:9/895: creat d0/d2a/dd4/f132 x:0 0 0 2024-04-20T21:58:45.667 INFO:tasks.workunit.client.0.smithi142.stdout:0/768: rmdir d5/d13/d1e/d8f 39 2024-04-20T21:58:45.671 INFO:tasks.workunit.client.0.smithi142.stdout:0/769: read - d5/d1c/d3c/fcd zero size 2024-04-20T21:58:45.672 INFO:tasks.workunit.client.0.smithi142.stdout:1/856: write d2/dd/d1c/d60/fa4 [605144,84629] 0 2024-04-20T21:58:45.675 INFO:tasks.workunit.client.0.smithi142.stdout:5/855: creat dc/d14/d21/d46/d2a/f123 x:0 0 0 2024-04-20T21:58:45.676 INFO:tasks.workunit.client.0.smithi142.stdout:1/857: chown d2/d4e/d7e/fbd 977693885 1 2024-04-20T21:58:45.677 INFO:tasks.workunit.client.0.smithi142.stdout:6/804: getdents d1/d2f/d35/d5b/d3e/dc5/ddb 0 2024-04-20T21:58:45.680 INFO:tasks.workunit.client.0.smithi142.stdout:6/805: readlink d1/l20 0 2024-04-20T21:58:45.686 INFO:tasks.workunit.client.0.smithi142.stdout:9/896: dread d0/d2a/d39/f5c [0,4194304] 0 2024-04-20T21:58:45.687 INFO:tasks.workunit.client.0.smithi142.stdout:1/858: mknod d2/dd/d17/d8b/daf/c129 0 2024-04-20T21:58:45.691 INFO:tasks.workunit.client.0.smithi142.stdout:2/989: dwrite d3/d9/d89/d31/dc3/dce/dea/ffb [0,4194304] 0 2024-04-20T21:58:45.697 INFO:tasks.workunit.client.0.smithi142.stdout:1/859: truncate d2/dd/d1c/d60/fdb 4550995 0 2024-04-20T21:58:45.704 INFO:tasks.workunit.client.0.smithi142.stdout:2/990: creat d3/d13e/d104/d14e/f153 x:0 0 0 2024-04-20T21:58:45.706 INFO:tasks.workunit.client.0.smithi142.stdout:1/860: mkdir d2/dd/d17/d1b/d22/d20/d12a 0 2024-04-20T21:58:45.711 INFO:tasks.workunit.client.0.smithi142.stdout:1/861: read d2/dd/d1c/d60/dce/f6d [881186,75259] 0 2024-04-20T21:58:45.713 INFO:tasks.workunit.client.0.smithi142.stdout:0/770: dread d5/d13/d1e/d23/d2c/f84 [0,4194304] 0 2024-04-20T21:58:45.716 INFO:tasks.workunit.client.0.smithi142.stdout:5/856: dread dc/d14/d21/d46/fdc [0,4194304] 0 2024-04-20T21:58:45.719 INFO:tasks.workunit.client.0.smithi142.stdout:6/806: dwrite d1/d11/f59 [0,4194304] 0 2024-04-20T21:58:45.720 INFO:tasks.workunit.client.0.smithi142.stdout:1/862: mknod d2/dd/d17/d3b/c12b 0 2024-04-20T21:58:45.721 INFO:tasks.workunit.client.0.smithi142.stdout:6/807: chown d1/c3f 49395771 1 2024-04-20T21:58:45.723 INFO:tasks.workunit.client.0.smithi142.stdout:2/991: write d3/d9/d34/db5/fbb [1452115,4573] 0 2024-04-20T21:58:45.735 INFO:tasks.workunit.client.0.smithi142.stdout:0/771: getdents d5/d13/d1e/d23/d24/d48/d55 0 2024-04-20T21:58:45.741 INFO:tasks.workunit.client.0.smithi142.stdout:5/857: dwrite dc/d14/d25/db4/ff9 [0,4194304] 0 2024-04-20T21:58:45.744 INFO:tasks.workunit.client.0.smithi142.stdout:6/808: write d1/d2f/d35/d5b/d63/d4b/d83/f28 [2784325,3779] 0 2024-04-20T21:58:45.747 INFO:tasks.workunit.client.0.smithi142.stdout:0/772: truncate d5/f6c 2447321 0 2024-04-20T21:58:45.753 INFO:tasks.workunit.client.0.smithi142.stdout:1/863: dwrite d2/d4e/fd3 [0,4194304] 0 2024-04-20T21:58:45.756 INFO:tasks.workunit.client.0.smithi142.stdout:2/992: dwrite d3/d13e/d104/d70/de6/fff [0,4194304] 0 2024-04-20T21:58:45.766 INFO:tasks.workunit.client.0.smithi142.stdout:2/993: write d3/d13e/d104/d70/de6/f141 [3761320,59265] 0 2024-04-20T21:58:45.865 INFO:tasks.workunit.client.0.smithi142.stdout:7/995: sync 2024-04-20T21:58:45.866 INFO:tasks.workunit.client.0.smithi142.stdout:6/809: mknod d1/d2f/d35/d5b/d63/d4b/d83/c121 0 2024-04-20T21:58:45.871 INFO:tasks.workunit.client.0.smithi142.stdout:7/996: dread - d4/d7f/d77/d7e/db2/d12f/df1/d1c/dd5/ffc zero size 2024-04-20T21:58:45.871 INFO:tasks.workunit.client.0.smithi142.stdout:0/773: read d5/f18 [550033,93260] 0 2024-04-20T21:58:45.873 INFO:tasks.workunit.client.0.smithi142.stdout:2/994: mkdir d3/d9/d89/d31/d84/d154 0 2024-04-20T21:58:45.876 INFO:tasks.workunit.client.0.smithi142.stdout:6/810: mknod d1/d2f/d35/d5b/d63/d64/de1/c122 0 2024-04-20T21:58:45.879 INFO:tasks.workunit.client.0.smithi142.stdout:7/997: chown d4/d7f/d77/d78/d9b/d5a/d90/df8/ff0 860 1 2024-04-20T21:58:45.879 INFO:tasks.workunit.client.0.smithi142.stdout:6/811: fsync d1/d5/d3a/f119 0 2024-04-20T21:58:45.883 INFO:tasks.workunit.client.0.smithi142.stdout:2/995: creat d3/d13e/d104/d70/d3c/d64/f155 x:0 0 0 2024-04-20T21:58:45.885 INFO:tasks.workunit.client.0.smithi142.stdout:0/774: rmdir d5/d13/d1e/d8f 39 2024-04-20T21:58:45.886 INFO:tasks.workunit.client.0.smithi142.stdout:5/858: dwrite dc/d14/d26/d3f/d53/d116/fbd [4194304,4194304] 0 2024-04-20T21:58:45.888 INFO:tasks.workunit.client.0.smithi142.stdout:2/996: chown d3/d9/d89/d31/da7 1591520 1 2024-04-20T21:58:45.889 INFO:tasks.workunit.client.0.smithi142.stdout:7/998: mkdir d4/d7f/d77/d78/d166 0 2024-04-20T21:58:45.891 INFO:tasks.workunit.client.0.smithi142.stdout:2/997: write d3/d9/d89/d31/dc3/dce/f127 [89844,19745] 0 2024-04-20T21:58:45.892 INFO:tasks.workunit.client.0.smithi142.stdout:0/775: creat d5/d45/d6f/ff2 x:0 0 0 2024-04-20T21:58:45.895 INFO:tasks.workunit.client.0.smithi142.stdout:5/859: write dc/d14/d25/d89/f10e [797391,127571] 0 2024-04-20T21:58:45.895 INFO:tasks.workunit.client.0.smithi142.stdout:1/864: truncate d2/dd/d17/d1b/d22/d55/f6e 3040140 0 2024-04-20T21:58:45.898 INFO:tasks.workunit.client.0.smithi142.stdout:6/812: getdents d1/d11 0 2024-04-20T21:58:45.901 INFO:tasks.workunit.client.0.smithi142.stdout:6/813: write d1/d2f/d35/d5b/d63/d4b/d83/f11e [718244,45819] 0 2024-04-20T21:58:45.911 INFO:tasks.workunit.client.0.smithi142.stdout:5/860: mknod dc/d14/d21/c124 0 2024-04-20T21:58:45.913 INFO:tasks.workunit.client.0.smithi142.stdout:6/814: creat d1/d2f/d35/d5b/d63/d4b/f123 x:0 0 0 2024-04-20T21:58:45.914 INFO:tasks.workunit.client.0.smithi142.stdout:5/861: fsync dc/d14/d72/fbf 0 2024-04-20T21:58:45.926 INFO:tasks.workunit.client.0.smithi142.stdout:5/862: mkdir dc/d14/d26/d3f/d53/d7c/da9/d125 0 2024-04-20T21:58:45.934 INFO:tasks.workunit.client.0.smithi142.stdout:2/998: dwrite d3/d13e/d104/d70/f4d [8388608,4194304] 0 2024-04-20T21:58:45.936 INFO:tasks.workunit.client.0.smithi142.stdout:7/999: dwrite d4/d7f/d77/d7e/db2/d12f/df1/d1c/d8e/d88/fee [0,4194304] 0 2024-04-20T21:58:45.938 INFO:tasks.workunit.client.0.smithi142.stdout:2/999: fsync d3/d9/d34/f41 0 2024-04-20T21:58:45.940 INFO:tasks.workunit.client.0.smithi142.stdout:0/776: dwrite d5/d1c/d3c/d8b/fba [0,4194304] 0 2024-04-20T21:58:45.943 INFO:tasks.workunit.client.0.smithi142.stdout:5/863: creat dc/d14/d21/d46/d2a/d3c/f126 x:0 0 0 2024-04-20T21:58:45.946 INFO:tasks.workunit.client.0.smithi142.stdout:6/815: dwrite d1/d5/fb4 [0,4194304] 0 2024-04-20T21:58:45.949 INFO:tasks.workunit.client.0.smithi142.stdout:0/777: fsync d5/d1c/d3c/d8b/fac 0 2024-04-20T21:58:45.954 INFO:tasks.workunit.client.0.smithi142.stdout:5/864: fdatasync dc/d14/d26/d3f/d53/d7c/da9/f95 0 2024-04-20T21:58:45.957 INFO:tasks.workunit.client.0.smithi142.stdout:1/865: dread d2/f7 [0,4194304] 0 2024-04-20T21:58:45.963 INFO:tasks.workunit.client.0.smithi142.stdout:0/778: fdatasync d5/d13/d1e/d23/d24/d48/d55/fd6 0 2024-04-20T21:58:45.976 INFO:tasks.workunit.client.0.smithi142.stdout:1/866: dread d2/dd/f8e [0,4194304] 0 2024-04-20T21:58:45.976 INFO:tasks.workunit.client.0.smithi142.stdout:6/816: link d1/c3f d1/d2f/d35/d5b/c124 0 2024-04-20T21:58:45.983 INFO:tasks.workunit.client.0.smithi142.stdout:1/867: chown d2/d4e/lb6 29767845 1 2024-04-20T21:58:45.989 INFO:tasks.workunit.client.0.smithi142.stdout:0/779: getdents d5/d1c/d3c/d95 0 2024-04-20T21:58:45.991 INFO:tasks.workunit.client.0.smithi142.stdout:6/817: dread d1/d2f/d35/d5b/d63/f92 [0,4194304] 0 2024-04-20T21:58:45.993 INFO:tasks.workunit.client.0.smithi142.stdout:5/865: dwrite dc/d14/d25/f3a [0,4194304] 0 2024-04-20T21:58:45.997 INFO:tasks.workunit.client.0.smithi142.stdout:5/866: rename dc/d71/d93/ffd to dc/d14/d26/d3f/db3/f127 0 2024-04-20T21:58:45.998 INFO:tasks.workunit.client.0.smithi142.stdout:6/818: creat d1/dd1/d65/f125 x:0 0 0 2024-04-20T21:58:46.013 INFO:tasks.workunit.client.0.smithi142.stdout:6/819: dwrite d1/d11/d71/f10b [0,4194304] 0 2024-04-20T21:58:46.016 INFO:tasks.workunit.client.0.smithi142.stdout:6/820: truncate d1/d2f/d35/d5b/ff9 269690 0 2024-04-20T21:58:46.017 INFO:tasks.workunit.client.0.smithi142.stdout:6/821: chown d1/d75/fee 13 1 2024-04-20T21:58:46.021 INFO:tasks.workunit.client.0.smithi142.stdout:0/780: dread d5/d1c/d3c/d85/d38/f1b [0,4194304] 0 2024-04-20T21:58:46.032 INFO:tasks.workunit.client.0.smithi142.stdout:3/923: sync 2024-04-20T21:58:46.074 INFO:tasks.workunit.client.0.smithi142.stdout:5/867: dread - dc/d14/d21/d46/d2a/d3c/fdd zero size 2024-04-20T21:58:46.077 INFO:tasks.workunit.client.0.smithi142.stdout:6/822: creat d1/d2f/d35/d5b/d63/ded/d108/f126 x:0 0 0 2024-04-20T21:58:46.083 INFO:tasks.workunit.client.0.smithi142.stdout:6/823: creat d1/d2f/d35/d5b/d63/d34/f127 x:0 0 0 2024-04-20T21:58:46.085 INFO:tasks.workunit.client.0.smithi142.stdout:6/824: readlink d1/d5/l24 0 2024-04-20T21:58:46.090 INFO:tasks.workunit.client.0.smithi142.stdout:3/924: rmdir d6/d32/de9 0 2024-04-20T21:58:46.093 INFO:tasks.workunit.client.0.smithi142.stdout:5/868: dwrite dc/d14/d26/d3f/d53/d7c/da9/f117 [0,4194304] 0 2024-04-20T21:58:46.102 INFO:tasks.workunit.client.0.smithi142.stdout:5/869: mknod dc/d14/d21/d46/de6/d110/c128 0 2024-04-20T21:58:46.104 INFO:tasks.workunit.client.0.smithi142.stdout:0/781: dwrite d5/d1c/d3c/d85/d38/d62/f89 [0,4194304] 0 2024-04-20T21:58:46.110 INFO:tasks.workunit.client.0.smithi142.stdout:0/782: fdatasync d5/d1c/d3c/fa5 0 2024-04-20T21:58:46.115 INFO:tasks.workunit.client.0.smithi142.stdout:0/783: rmdir d5/d13/d1e/d23 39 2024-04-20T21:58:46.119 INFO:tasks.workunit.client.0.smithi142.stdout:5/870: dwrite dc/d14/d72/fbf [4194304,4194304] 0 2024-04-20T21:58:46.124 INFO:tasks.workunit.client.0.smithi142.stdout:0/784: chown d5/d13/d1e/d23/d24/f33 172683 1 2024-04-20T21:58:46.126 INFO:tasks.workunit.client.0.smithi142.stdout:6/825: dwrite d1/d5/f37 [0,4194304] 0 2024-04-20T21:58:46.134 INFO:tasks.workunit.client.0.smithi142.stdout:0/785: truncate d5/d13/f7d 1199144 0 2024-04-20T21:58:46.135 INFO:tasks.workunit.client.0.smithi142.stdout:5/871: truncate dc/d14/d21/d46/d2a/d3c/fdd 935459 0 2024-04-20T21:58:46.144 INFO:tasks.workunit.client.0.smithi142.stdout:5/872: creat dc/d14/d25/d89/f129 x:0 0 0 2024-04-20T21:58:46.147 INFO:tasks.workunit.client.0.smithi142.stdout:0/786: dread d5/d13/d1e/fb1 [0,4194304] 0 2024-04-20T21:58:46.147 INFO:tasks.workunit.client.0.smithi142.stdout:6/826: unlink d1/d1b/c31 0 2024-04-20T21:58:46.152 INFO:tasks.workunit.client.0.smithi142.stdout:5/873: mknod dc/d14/d21/d7f/c12a 0 2024-04-20T21:58:46.154 INFO:tasks.workunit.client.0.smithi142.stdout:5/874: chown dc/d14/d21/d46/d2a 1698 1 2024-04-20T21:58:46.155 INFO:tasks.workunit.client.0.smithi142.stdout:0/787: creat d5/d1c/ff3 x:0 0 0 2024-04-20T21:58:46.157 INFO:tasks.workunit.client.0.smithi142.stdout:5/875: chown dc/d14/d21/f103 2928051 1 2024-04-20T21:58:46.165 INFO:tasks.workunit.client.0.smithi142.stdout:6/827: dwrite d1/d5/fb4 [0,4194304] 0 2024-04-20T21:58:46.172 INFO:tasks.workunit.client.0.smithi142.stdout:5/876: rename dc/d14/d25/db4/le7 to dc/d14/d21/d46/d2a/l12b 0 2024-04-20T21:58:46.177 INFO:tasks.workunit.client.0.smithi142.stdout:5/877: write dc/d14/d21/d46/f121 [668201,71722] 0 2024-04-20T21:58:46.178 INFO:tasks.workunit.client.0.smithi142.stdout:6/828: rename d1/d2f/d35/d5b/d3e/de0/d7e/d9f/fc9 to d1/d1b/f128 0 2024-04-20T21:58:46.182 INFO:tasks.workunit.client.0.smithi142.stdout:4/737: sync 2024-04-20T21:58:46.182 INFO:tasks.workunit.client.0.smithi142.stdout:8/835: sync 2024-04-20T21:58:46.182 INFO:tasks.workunit.client.0.smithi142.stdout:9/897: sync 2024-04-20T21:58:46.185 INFO:tasks.workunit.client.0.smithi142.stdout:6/829: mknod d1/d75/c129 0 2024-04-20T21:58:46.189 INFO:tasks.workunit.client.0.smithi142.stdout:9/898: symlink d0/d2a/d39/d87/l133 0 2024-04-20T21:58:46.189 INFO:tasks.workunit.client.0.smithi142.stdout:4/738: mkdir d1/d12/da/d1c/d32/d3d/de7 0 2024-04-20T21:58:46.192 INFO:tasks.workunit.client.0.smithi142.stdout:5/878: unlink dc/d14/d26/d3f/db3/f127 0 2024-04-20T21:58:46.195 INFO:tasks.workunit.client.0.smithi142.stdout:5/879: fdatasync dc/d14/d21/d46/de6/f77 0 2024-04-20T21:58:46.195 INFO:tasks.workunit.client.0.smithi142.stdout:6/830: symlink d1/d2f/d35/d5b/d3e/dc5/l12a 0 2024-04-20T21:58:46.204 INFO:tasks.workunit.client.0.smithi142.stdout:9/899: stat d0/d89/l114 0 2024-04-20T21:58:46.207 INFO:tasks.workunit.client.0.smithi142.stdout:5/880: creat dc/d71/d5c/d68/f12c x:0 0 0 2024-04-20T21:58:46.209 INFO:tasks.workunit.client.0.smithi142.stdout:6/831: symlink d1/d2f/d35/d5b/d63/d64/de1/l12b 0 2024-04-20T21:58:46.211 INFO:tasks.workunit.client.0.smithi142.stdout:9/900: creat d0/d2a/d39/d50/de5/d109/f134 x:0 0 0 2024-04-20T21:58:46.212 INFO:tasks.workunit.client.0.smithi142.stdout:4/739: dread d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/f63 [0,4194304] 0 2024-04-20T21:58:46.216 INFO:tasks.workunit.client.0.smithi142.stdout:4/740: write d1/d6/d4b/f82 [4823478,90720] 0 2024-04-20T21:58:46.222 INFO:tasks.workunit.client.0.smithi142.stdout:4/741: creat d1/d5b/dd2/fe8 x:0 0 0 2024-04-20T21:58:46.228 INFO:tasks.workunit.client.0.smithi142.stdout:4/742: fdatasync d1/d12/fb3 0 2024-04-20T21:58:46.231 INFO:tasks.workunit.client.0.smithi142.stdout:0/788: dwrite d5/d45/f47 [0,4194304] 0 2024-04-20T21:58:46.234 INFO:tasks.workunit.client.0.smithi142.stdout:0/789: chown d5/d45/d6f/c69 791 1 2024-04-20T21:58:46.236 INFO:tasks.workunit.client.0.smithi142.stdout:1/868: sync 2024-04-20T21:58:46.236 INFO:tasks.workunit.client.0.smithi142.stdout:5/881: dwrite dc/d14/d26/d3f/d53/d7c/d97/fc4 [0,4194304] 0 2024-04-20T21:58:46.237 INFO:tasks.workunit.client.0.smithi142.stdout:4/743: creat d1/d12/da/d1c/da9/fe9 x:0 0 0 2024-04-20T21:58:46.243 INFO:tasks.workunit.client.0.smithi142.stdout:9/901: dread d0/d36/f4c [0,4194304] 0 2024-04-20T21:58:46.251 INFO:tasks.workunit.client.0.smithi142.stdout:0/790: read - d5/d13/d1e/d8f/fc4 zero size 2024-04-20T21:58:46.254 INFO:tasks.workunit.client.0.smithi142.stdout:1/869: unlink d2/d4e/d7e/l125 0 2024-04-20T21:58:46.255 INFO:tasks.workunit.client.0.smithi142.stdout:8/836: dwrite d0/d1c/d44/d89/d45/f4d [0,4194304] 0 2024-04-20T21:58:46.258 INFO:tasks.workunit.client.0.smithi142.stdout:6/832: mkdir d1/d5/d8b/d12c 0 2024-04-20T21:58:46.263 INFO:tasks.workunit.client.0.smithi142.stdout:0/791: symlink d5/d1d/d7e/db0/lf4 0 2024-04-20T21:58:46.266 INFO:tasks.workunit.client.0.smithi142.stdout:1/870: creat d2/dd/d17/d1b/d22/d20/dc3/f12c x:0 0 0 2024-04-20T21:58:46.269 INFO:tasks.workunit.client.0.smithi142.stdout:5/882: dwrite dc/d14/d26/ff6 [0,4194304] 0 2024-04-20T21:58:46.269 INFO:tasks.workunit.client.0.smithi142.stdout:6/833: fsync d1/d5/f3d 0 2024-04-20T21:58:46.274 INFO:tasks.workunit.client.0.smithi142.stdout:8/837: mknod d0/c120 0 2024-04-20T21:58:46.274 INFO:tasks.workunit.client.0.smithi142.stdout:5/883: write f3 [1270598,46633] 0 2024-04-20T21:58:46.278 INFO:tasks.workunit.client.0.smithi142.stdout:8/838: dread - d0/d1c/d44/d89/d45/d4c/d68/da5/f10d zero size 2024-04-20T21:58:46.278 INFO:tasks.workunit.client.0.smithi142.stdout:4/744: dwrite d1/d6/fa7 [0,4194304] 0 2024-04-20T21:58:46.284 INFO:tasks.workunit.client.0.smithi142.stdout:9/902: write d0/d3c/f46 [1713127,7879] 0 2024-04-20T21:58:46.286 INFO:tasks.workunit.client.0.smithi142.stdout:6/834: dread - d1/f100 zero size 2024-04-20T21:58:46.290 INFO:tasks.workunit.client.0.smithi142.stdout:9/903: chown d0/d89/d95/d105/f118 52488666 1 2024-04-20T21:58:46.296 INFO:tasks.workunit.client.0.smithi142.stdout:8/839: symlink d0/d5e/de5/l121 0 2024-04-20T21:58:46.297 INFO:tasks.workunit.client.0.smithi142.stdout:9/904: chown d0/d3c/laa 0 1 2024-04-20T21:58:46.299 INFO:tasks.workunit.client.0.smithi142.stdout:6/835: chown d1/d2f/d35/f109 639 1 2024-04-20T21:58:46.301 INFO:tasks.workunit.client.0.smithi142.stdout:9/905: chown d0/d89/d11a/d111/f65 23 1 2024-04-20T21:58:46.304 INFO:tasks.workunit.client.0.smithi142.stdout:9/906: write d0/d2a/d39/d87/d9e/db3/f11e [515673,65965] 0 2024-04-20T21:58:46.318 INFO:tasks.workunit.client.0.smithi142.stdout:1/871: write d2/dd/d1c/d60/fa2 [467569,13527] 0 2024-04-20T21:58:46.340 INFO:tasks.workunit.client.0.smithi142.stdout:8/840: write d0/d5e/f103 [227481,52722] 0 2024-04-20T21:58:46.340 INFO:tasks.workunit.client.0.smithi142.stdout:4/745: rmdir d1/d12/da/d37/d89/dc8 0 2024-04-20T21:58:46.342 INFO:tasks.workunit.client.0.smithi142.stdout:6/836: stat d1/dd1/d65/cf3 0 2024-04-20T21:58:46.344 INFO:tasks.workunit.client.0.smithi142.stdout:9/907: mkdir d0/d89/d95/de4/d135 0 2024-04-20T21:58:46.344 INFO:tasks.workunit.client.0.smithi142.stdout:4/746: chown d1/d6/l9 59 1 2024-04-20T21:58:46.345 INFO:tasks.workunit.client.0.smithi142.stdout:0/792: link d5/d13/d1e/d23/d46/fda d5/d1c/d3c/d85/ff5 0 2024-04-20T21:58:46.347 INFO:tasks.workunit.client.0.smithi142.stdout:0/793: dread - d5/d1c/d3c/fcd zero size 2024-04-20T21:58:46.347 INFO:tasks.workunit.client.0.smithi142.stdout:4/747: chown d1/la4 12503 1 2024-04-20T21:58:46.348 INFO:tasks.workunit.client.0.smithi142.stdout:6/837: creat d1/d5/d8b/da6/f12d x:0 0 0 2024-04-20T21:58:46.350 INFO:tasks.workunit.client.0.smithi142.stdout:4/748: chown d1/d6/d4a/d5a/f6a 754415187 1 2024-04-20T21:58:46.354 INFO:tasks.workunit.client.0.smithi142.stdout:9/908: write d0/ff0 [1854120,75479] 0 2024-04-20T21:58:46.354 INFO:tasks.workunit.client.0.smithi142.stdout:8/841: write d0/d1c/d44/d89/d45/fc0 [3207661,64762] 0 2024-04-20T21:58:46.358 INFO:tasks.workunit.client.0.smithi142.stdout:4/749: write d1/d12/da/d1c/d32/d3d/d2f/d49/f75 [383940,49734] 0 2024-04-20T21:58:46.358 INFO:tasks.workunit.client.0.smithi142.stdout:0/794: unlink d5/d1c/d3c/f5a 0 2024-04-20T21:58:46.360 INFO:tasks.workunit.client.0.smithi142.stdout:6/838: mkdir d1/d1b/d12e 0 2024-04-20T21:58:46.367 INFO:tasks.workunit.client.0.smithi142.stdout:4/750: dread - d1/d6/d4b/f79 zero size 2024-04-20T21:58:46.369 INFO:tasks.workunit.client.0.smithi142.stdout:0/795: symlink d5/d1d/d7e/db0/dd0/lf6 0 2024-04-20T21:58:46.374 INFO:tasks.workunit.client.0.smithi142.stdout:6/839: creat d1/f12f x:0 0 0 2024-04-20T21:58:46.383 INFO:tasks.workunit.client.0.smithi142.stdout:9/909: link d0/d2a/d39/d50/de5/d109/dca/dcc/l102 d0/d91/db4/l136 0 2024-04-20T21:58:46.384 INFO:tasks.workunit.client.0.smithi142.stdout:6/840: read - d1/d75/ff5 zero size 2024-04-20T21:58:46.386 INFO:tasks.workunit.client.0.smithi142.stdout:9/910: truncate d0/d3c/f10e 564589 0 2024-04-20T21:58:46.387 INFO:tasks.workunit.client.0.smithi142.stdout:0/796: rmdir d5/d13/d1e/d23/de3 0 2024-04-20T21:58:46.389 INFO:tasks.workunit.client.0.smithi142.stdout:9/911: dread - d0/d2a/ffc zero size 2024-04-20T21:58:46.390 INFO:tasks.workunit.client.0.smithi142.stdout:6/841: creat d1/dd1/d8f/f130 x:0 0 0 2024-04-20T21:58:46.390 INFO:tasks.workunit.client.0.smithi142.stdout:9/912: chown d0/d2a/c32 38 1 2024-04-20T21:58:46.392 INFO:tasks.workunit.client.0.smithi142.stdout:0/797: creat d5/d1c/d3c/d8b/ff7 x:0 0 0 2024-04-20T21:58:46.395 INFO:tasks.workunit.client.0.smithi142.stdout:6/842: symlink d1/d5/l131 0 2024-04-20T21:58:46.397 INFO:tasks.workunit.client.0.smithi142.stdout:0/798: chown d5/d45/c68 3411 1 2024-04-20T21:58:46.399 INFO:tasks.workunit.client.0.smithi142.stdout:6/843: mkdir d1/d5/d3a/d43/d132 0 2024-04-20T21:58:46.400 INFO:tasks.workunit.client.0.smithi142.stdout:3/925: sync 2024-04-20T21:58:46.408 INFO:tasks.workunit.client.0.smithi142.stdout:1/872: truncate d2/dd/d17/d1b/d22/d13/f14 769971 0 2024-04-20T21:58:46.411 INFO:tasks.workunit.client.0.smithi142.stdout:9/913: dwrite d0/d2a/d39/d87/f101 [0,4194304] 0 2024-04-20T21:58:46.414 INFO:tasks.workunit.client.0.smithi142.stdout:0/799: creat d5/d13/d1e/ff8 x:0 0 0 2024-04-20T21:58:46.419 INFO:tasks.workunit.client.0.smithi142.stdout:3/926: dread d6/d15/d1e/f89 [0,4194304] 0 2024-04-20T21:58:46.419 INFO:tasks.workunit.client.0.smithi142.stdout:5/884: sync 2024-04-20T21:58:46.423 INFO:tasks.workunit.client.0.smithi142.stdout:4/751: write d1/d12/da/d1c/f9f [1922148,7603] 0 2024-04-20T21:58:46.426 INFO:tasks.workunit.client.0.smithi142.stdout:9/914: mknod d0/d2a/dd4/d12f/c137 0 2024-04-20T21:58:46.430 INFO:tasks.workunit.client.0.smithi142.stdout:1/873: mkdir d2/dd/d17/d3b/d50/d12d 0 2024-04-20T21:58:46.433 INFO:tasks.workunit.client.0.smithi142.stdout:0/800: mknod d5/d13/d1e/d23/cf9 0 2024-04-20T21:58:46.441 INFO:tasks.workunit.client.0.smithi142.stdout:3/927: symlink d6/d32/l147 0 2024-04-20T21:58:46.446 INFO:tasks.workunit.client.0.smithi142.stdout:9/915: creat d0/d2a/d39/d87/d9e/db3/f138 x:0 0 0 2024-04-20T21:58:46.447 INFO:tasks.workunit.client.0.smithi142.stdout:1/874: mknod d2/dd/d1c/d60/dce/c12e 0 2024-04-20T21:58:46.448 INFO:tasks.workunit.client.0.smithi142.stdout:8/842: dwrite d0/d1c/f31 [4194304,4194304] 0 2024-04-20T21:58:46.458 INFO:tasks.workunit.client.0.smithi142.stdout:9/916: chown d0/d2a/d39/f5e 6423768 1 2024-04-20T21:58:46.458 INFO:tasks.workunit.client.0.smithi142.stdout:5/885: dwrite dc/d14/d25/d78/fd2 [0,4194304] 0 2024-04-20T21:58:46.460 INFO:tasks.workunit.client.0.smithi142.stdout:1/875: mknod d2/dd/d17/d1b/d22/d20/dc3/c12f 0 2024-04-20T21:58:46.461 INFO:tasks.workunit.client.0.smithi142.stdout:6/844: dread d1/d2f/d35/d5b/d3e/de0/d7e/fb3 [0,4194304] 0 2024-04-20T21:58:46.467 INFO:tasks.workunit.client.0.smithi142.stdout:4/752: write d1/d6/d4a/d5a/f99 [1072462,54027] 0 2024-04-20T21:58:46.469 INFO:tasks.workunit.client.0.smithi142.stdout:9/917: mkdir d0/d2a/d9c/d139 0 2024-04-20T21:58:46.473 INFO:tasks.workunit.client.0.smithi142.stdout:6/845: creat d1/d2f/d35/d5b/d39/dcd/f133 x:0 0 0 2024-04-20T21:58:46.474 INFO:tasks.workunit.client.0.smithi142.stdout:4/753: dread - d1/d12/da/d1c/da9/fe9 zero size 2024-04-20T21:58:46.475 INFO:tasks.workunit.client.0.smithi142.stdout:1/876: mkdir d2/d4e/d130 0 2024-04-20T21:58:46.478 INFO:tasks.workunit.client.0.smithi142.stdout:9/918: symlink d0/d89/d95/d12d/l13a 0 2024-04-20T21:58:46.480 INFO:tasks.workunit.client.0.smithi142.stdout:3/928: dread d6/d15/d1e/d43/d4d/fcc [0,4194304] 0 2024-04-20T21:58:46.480 INFO:tasks.workunit.client.0.smithi142.stdout:6/846: write d1/d2f/d35/d5b/d3e/f10d [989530,98422] 0 2024-04-20T21:58:46.480 INFO:tasks.workunit.client.0.smithi142.stdout:1/877: rmdir d2/dd/d1c 39 2024-04-20T21:58:46.482 INFO:tasks.workunit.client.0.smithi142.stdout:5/886: creat dc/d71/f12d x:0 0 0 2024-04-20T21:58:46.482 INFO:tasks.workunit.client.0.smithi142.stdout:9/919: write d0/d3c/f46 [5032460,119053] 0 2024-04-20T21:58:46.498 INFO:tasks.workunit.client.0.smithi142.stdout:4/754: dwrite d1/d12/da/d1c/f3b [0,4194304] 0 2024-04-20T21:58:46.506 INFO:tasks.workunit.client.0.smithi142.stdout:6/847: truncate d1/d2f/d35/d48/f9c 1005622 0 2024-04-20T21:58:46.508 INFO:tasks.workunit.client.0.smithi142.stdout:8/843: dread d0/d17/f34 [0,4194304] 0 2024-04-20T21:58:46.510 INFO:tasks.workunit.client.0.smithi142.stdout:3/929: getdents d6/d15/d47/dfd 0 2024-04-20T21:58:46.518 INFO:tasks.workunit.client.0.smithi142.stdout:1/878: rename d2/dd/d1c/d60/fdb to d2/dd/d17/d3b/f131 0 2024-04-20T21:58:46.522 INFO:tasks.workunit.client.0.smithi142.stdout:3/930: dread - d6/d15/d1e/d43/d4d/d59/df6/f107 zero size 2024-04-20T21:58:46.526 INFO:tasks.workunit.client.0.smithi142.stdout:8/844: dread d0/d1c/d44/d89/d45/d4c/f86 [0,4194304] 0 2024-04-20T21:58:46.535 INFO:tasks.workunit.client.0.smithi142.stdout:3/931: rename d6/d32/d9b/led to d6/d15/d30/d37/d75/d142/l148 0 2024-04-20T21:58:46.541 INFO:tasks.workunit.client.0.smithi142.stdout:8/845: rename d0/d29/f3c to d0/d17/d35/db5/de2/f122 0 2024-04-20T21:58:46.542 INFO:tasks.workunit.client.0.smithi142.stdout:5/887: truncate dc/fff 619278 0 2024-04-20T21:58:46.543 INFO:tasks.workunit.client.0.smithi142.stdout:4/755: write d1/d12/da/d1c/d32/d3d/f6b [370567,56322] 0 2024-04-20T21:58:46.548 INFO:tasks.workunit.client.0.smithi142.stdout:4/756: fdatasync d1/d12/da/d1c/d32/d3d/f6b 0 2024-04-20T21:58:46.551 INFO:tasks.workunit.client.0.smithi142.stdout:3/932: symlink d6/d15/d1e/d43/d4d/d59/de8/d113/l149 0 2024-04-20T21:58:46.553 INFO:tasks.workunit.client.0.smithi142.stdout:9/920: dwrite d0/d2a/d39/d87/fbe [0,4194304] 0 2024-04-20T21:58:46.556 INFO:tasks.workunit.client.0.smithi142.stdout:8/846: creat d0/d1c/d44/f123 x:0 0 0 2024-04-20T21:58:46.559 INFO:tasks.workunit.client.0.smithi142.stdout:4/757: symlink d1/d12/da/d37/lea 0 2024-04-20T21:58:46.561 INFO:tasks.workunit.client.0.smithi142.stdout:9/921: chown d0/d2a/d39/d87/d9e/lf5 233 1 2024-04-20T21:58:46.565 INFO:tasks.workunit.client.0.smithi142.stdout:8/847: stat d0/d1c/d44/dad/db3/d3f/d7f/ldf 0 2024-04-20T21:58:46.566 INFO:tasks.workunit.client.0.smithi142.stdout:1/879: dwrite d2/dd/d17/d1b/d22/d55/fcb [0,4194304] 0 2024-04-20T21:58:46.570 INFO:tasks.workunit.client.0.smithi142.stdout:6/848: dwrite d1/d2f/d35/d5b/d39/f3b [0,4194304] 0 2024-04-20T21:58:46.578 INFO:tasks.workunit.client.0.smithi142.stdout:4/758: rmdir d1/d12/da/d1c/d32/d3d/d2f/d73 39 2024-04-20T21:58:46.588 INFO:tasks.workunit.client.0.smithi142.stdout:6/849: unlink d1/d2f/d35/d5b/d3e/dc5/ddb/fc2 0 2024-04-20T21:58:46.589 INFO:tasks.workunit.client.0.smithi142.stdout:8/848: creat d0/d29/df3/f124 x:0 0 0 2024-04-20T21:58:46.590 INFO:tasks.workunit.client.0.smithi142.stdout:4/759: mknod d1/d5b/ceb 0 2024-04-20T21:58:46.591 INFO:tasks.workunit.client.0.smithi142.stdout:9/922: getdents d0/d2a/d8b/dc1 0 2024-04-20T21:58:46.595 INFO:tasks.workunit.client.0.smithi142.stdout:8/849: fsync d0/d1c/f41 0 2024-04-20T21:58:46.595 INFO:tasks.workunit.client.0.smithi142.stdout:3/933: dwrite d6/f8 [0,4194304] 0 2024-04-20T21:58:46.606 INFO:tasks.workunit.client.0.smithi142.stdout:9/923: symlink d0/d91/da0/l13b 0 2024-04-20T21:58:46.606 INFO:tasks.workunit.client.0.smithi142.stdout:5/888: dwrite dc/d71/d5c/d68/f12c [0,4194304] 0 2024-04-20T21:58:46.607 INFO:tasks.workunit.client.0.smithi142.stdout:4/760: write d1/d12/da/d72/dc5/fe6 [51291,79418] 0 2024-04-20T21:58:46.613 INFO:tasks.workunit.client.0.smithi142.stdout:1/880: dwrite d2/dd/d1c/d88/f101 [0,4194304] 0 2024-04-20T21:58:46.620 INFO:tasks.workunit.client.0.smithi142.stdout:9/924: creat d0/dd5/f13c x:0 0 0 2024-04-20T21:58:46.620 INFO:tasks.workunit.client.0.smithi142.stdout:5/889: readlink dc/d14/d26/d3f/d53/d116/dc7/lf8 0 2024-04-20T21:58:46.623 INFO:tasks.workunit.client.0.smithi142.stdout:8/850: dread d0/d1c/d44/dad/db3/f39 [0,4194304] 0 2024-04-20T21:58:46.623 INFO:tasks.workunit.client.0.smithi142.stdout:6/850: getdents d1/d5/d3a/d43 0 2024-04-20T21:58:46.626 INFO:tasks.workunit.client.0.smithi142.stdout:1/881: chown d2/dd/d1c/d88/d89/f111 13 1 2024-04-20T21:58:46.630 INFO:tasks.workunit.client.0.smithi142.stdout:5/890: creat dc/d14/d26/d3f/f12e x:0 0 0 2024-04-20T21:58:46.633 INFO:tasks.workunit.client.0.smithi142.stdout:6/851: write d1/d11/f11d [473534,9508] 0 2024-04-20T21:58:46.637 INFO:tasks.workunit.client.0.smithi142.stdout:0/801: sync 2024-04-20T21:58:46.645 INFO:tasks.workunit.client.0.smithi142.stdout:8/851: rename d0/d42/f9f to d0/d5e/f125 0 2024-04-20T21:58:46.647 INFO:tasks.workunit.client.0.smithi142.stdout:4/761: creat d1/d12/da/d1c/d32/d3d/d2f/fec x:0 0 0 2024-04-20T21:58:46.655 INFO:tasks.workunit.client.0.smithi142.stdout:0/802: read d5/d13/d1e/d23/fa6 [632101,75257] 0 2024-04-20T21:58:46.657 INFO:tasks.workunit.client.0.smithi142.stdout:4/762: write d1/fd8 [204427,103275] 0 2024-04-20T21:58:46.662 INFO:tasks.workunit.client.0.smithi142.stdout:4/763: fdatasync d1/d12/da/d1c/d32/d3d/d9d/fe2 0 2024-04-20T21:58:46.663 INFO:tasks.workunit.client.0.smithi142.stdout:8/852: mkdir d0/d5e/d126 0 2024-04-20T21:58:46.663 INFO:tasks.workunit.client.0.smithi142.stdout:0/803: chown d5/d1d/l9b 596 1 2024-04-20T21:58:46.666 INFO:tasks.workunit.client.0.smithi142.stdout:1/882: getdents d2/dd/d17/d1b/d22/d20/dc3 0 2024-04-20T21:58:46.669 INFO:tasks.workunit.client.1.smithi164.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-20T21:58:46.669 INFO:tasks.workunit.client.0.smithi142.stdout:9/925: dread d0/d2a/d39/d50/f6b [0,4194304] 0 2024-04-20T21:58:46.671 INFO:tasks.workunit.client.0.smithi142.stdout:6/852: dread d1/d5/d8b/f117 [0,4194304] 0 2024-04-20T21:58:46.672 INFO:tasks.workunit.client.0.smithi142.stdout:0/804: symlink d5/d1c/d3c/d95/lfa 0 2024-04-20T21:58:46.673 INFO:tasks.workunit.client.0.smithi142.stdout:4/764: chown d1/d12/da/d1c/d32/d3d/f7e 652202 1 2024-04-20T21:58:46.675 INFO:tasks.workunit.client.0.smithi142.stdout:3/934: dread d6/d32/d9b/f141 [4194304,4194304] 0 2024-04-20T21:58:46.677 INFO:tasks.workunit.client.0.smithi142.stdout:3/935: readlink d6/d15/d30/l94 0 2024-04-20T21:58:46.681 INFO:tasks.workunit.client.0.smithi142.stdout:0/805: fdatasync d5/d1c/d3c/fbc 0 2024-04-20T21:58:46.683 INFO:tasks.workunit.client.0.smithi142.stdout:9/926: creat d0/d89/d95/de4/dfd/f13d x:0 0 0 2024-04-20T21:58:46.687 INFO:tasks.workunit.client.1.smithi164.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-20T21:58:46.687 INFO:tasks.workunit.client.1.smithi164.stderr:+ make 2024-04-20T21:58:46.687 INFO:tasks.workunit.client.0.smithi142.stdout:6/853: write d1/d5/feb [68087,78271] 0 2024-04-20T21:58:46.689 INFO:tasks.workunit.client.0.smithi142.stdout:3/936: unlink d6/d15/d1e/d43/d4d/fcc 0 2024-04-20T21:58:46.689 INFO:tasks.workunit.client.0.smithi142.stdout:4/765: creat d1/d12/da/d1c/d32/d3d/de7/fed x:0 0 0 2024-04-20T21:58:46.693 INFO:tasks.workunit.client.0.smithi142.stdout:0/806: symlink d5/d45/d6f/d70/da9/lfb 0 2024-04-20T21:58:46.694 INFO:tasks.workunit.client.0.smithi142.stdout:8/853: dwrite d0/d29/df3/f124 [0,4194304] 0 2024-04-20T21:58:46.698 INFO:tasks.workunit.client.0.smithi142.stdout:1/883: getdents d2 0 2024-04-20T21:58:46.704 INFO:tasks.workunit.client.0.smithi142.stdout:8/854: chown d0/d1c/d44/dad/db3/l43 5250 1 2024-04-20T21:58:46.704 INFO:tasks.workunit.client.0.smithi142.stdout:1/884: write d2/dd/d1c/d60/fed [1055981,30902] 0 2024-04-20T21:58:46.708 INFO:tasks.workunit.client.0.smithi142.stdout:5/891: dwrite dc/d14/d21/d7f/ff2 [0,4194304] 0 2024-04-20T21:58:46.725 INFO:tasks.workunit.client.0.smithi142.stdout:3/937: creat d6/d15/d47/d83/dc9/da7/f14a x:0 0 0 2024-04-20T21:58:46.725 INFO:tasks.workunit.client.0.smithi142.stdout:1/885: truncate d2/f11a 543540 0 2024-04-20T21:58:46.730 INFO:tasks.workunit.client.0.smithi142.stdout:0/807: mkdir d5/d13/d1e/d23/d46/dfc 0 2024-04-20T21:58:46.732 INFO:tasks.workunit.client.0.smithi142.stdout:1/886: write d2/dd/d1c/d88/f106 [638053,47853] 0 2024-04-20T21:58:46.733 INFO:tasks.workunit.client.0.smithi142.stdout:9/927: dwrite d0/d2a/ddc/f120 [0,4194304] 0 2024-04-20T21:58:46.734 INFO:tasks.workunit.client.0.smithi142.stdout:5/892: write dc/d14/d21/d46/d2a/d3c/f126 [560318,109505] 0 2024-04-20T21:58:46.738 INFO:tasks.workunit.client.0.smithi142.stdout:3/938: rename d6/d15/d1e/d43 to d6/d32/d39/d69/d91/d14b 0 2024-04-20T21:58:46.739 INFO:tasks.workunit.client.0.smithi142.stdout:8/855: link d0/d1c/cde d0/d17/d6e/d110/c127 0 2024-04-20T21:58:46.742 INFO:tasks.workunit.client.0.smithi142.stdout:1/887: creat d2/dd/d1c/d60/dda/f132 x:0 0 0 2024-04-20T21:58:46.745 INFO:tasks.workunit.client.0.smithi142.stdout:9/928: mkdir d0/d89/d95/de4/dfd/d13e 0 2024-04-20T21:58:46.746 INFO:tasks.workunit.client.0.smithi142.stdout:5/893: creat dc/d14/d26/d3f/d53/d7c/da9/f12f x:0 0 0 2024-04-20T21:58:46.750 INFO:tasks.workunit.client.0.smithi142.stdout:8/856: creat d0/d1c/d44/dad/db3/d3f/d7f/f128 x:0 0 0 2024-04-20T21:58:46.753 INFO:tasks.workunit.client.0.smithi142.stdout:3/939: mkdir d6/d15/d47/dfd/d14c 0 2024-04-20T21:58:46.754 INFO:tasks.workunit.client.0.smithi142.stdout:1/888: mknod d2/dd/d17/d1b/d22/d13/c133 0 2024-04-20T21:58:46.761 INFO:tasks.workunit.client.0.smithi142.stdout:6/854: dread d1/d9e/fde [0,4194304] 0 2024-04-20T21:58:46.769 INFO:tasks.workunit.client.0.smithi142.stdout:1/889: symlink d2/dd/d17/d1b/d22/d20/l134 0 2024-04-20T21:58:46.772 INFO:tasks.workunit.client.0.smithi142.stdout:0/808: write d5/d6d/fd7 [643030,507] 0 2024-04-20T21:58:46.772 INFO:tasks.workunit.client.0.smithi142.stdout:9/929: link d0/d2a/dd4/d12f/c137 d0/d89/d95/d12d/c13f 0 2024-04-20T21:58:46.781 INFO:tasks.workunit.client.0.smithi142.stdout:0/809: dread - d5/d1d/d7e/fcc zero size 2024-04-20T21:58:46.782 INFO:tasks.workunit.client.0.smithi142.stdout:9/930: truncate d0/d89/d11a/f5d 295210 0 2024-04-20T21:58:46.785 INFO:tasks.workunit.client.0.smithi142.stdout:6/855: dread d1/dd1/f7c [0,4194304] 0 2024-04-20T21:58:46.789 INFO:tasks.workunit.client.0.smithi142.stdout:1/890: rename d2/dd/d17/d1b/d22/d55/df9/l112 to d2/dd/d17/d1b/d22/d20/d12a/l135 0 2024-04-20T21:58:46.791 INFO:tasks.workunit.client.0.smithi142.stdout:8/857: dread d0/f13 [0,4194304] 0 2024-04-20T21:58:46.792 INFO:tasks.workunit.client.0.smithi142.stdout:0/810: unlink d5/d45/d6f/f81 0 2024-04-20T21:58:46.797 INFO:tasks.workunit.client.0.smithi142.stdout:5/894: dread dc/d14/d26/d3f/d53/d7c/da9/f95 [0,4194304] 0 2024-04-20T21:58:46.799 INFO:tasks.workunit.client.0.smithi142.stdout:8/858: creat d0/d29/df3/f129 x:0 0 0 2024-04-20T21:58:46.801 INFO:tasks.workunit.client.1.smithi164.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-20T21:58:46.802 INFO:tasks.workunit.client.0.smithi142.stdout:9/931: dwrite d0/d2a/f7c [0,4194304] 0 2024-04-20T21:58:46.803 INFO:tasks.workunit.client.0.smithi142.stdout:3/940: dread d6/f2e [0,4194304] 0 2024-04-20T21:58:46.803 INFO:tasks.workunit.client.0.smithi142.stdout:1/891: dread d2/d4e/d7e/dbf/fc9 [0,4194304] 0 2024-04-20T21:58:46.805 INFO:tasks.workunit.client.0.smithi142.stdout:9/932: fdatasync d0/d2a/d39/f6d 0 2024-04-20T21:58:46.812 INFO:tasks.workunit.client.0.smithi142.stdout:0/811: write d5/d1d/fbd [1058405,16595] 0 2024-04-20T21:58:46.813 INFO:tasks.workunit.client.0.smithi142.stdout:6/856: truncate d1/dd1/d8f/fd2 4080131 0 2024-04-20T21:58:46.816 INFO:tasks.workunit.client.0.smithi142.stdout:1/892: mknod d2/dd/d1c/d60/dce/d7c/c136 0 2024-04-20T21:58:46.817 INFO:tasks.workunit.client.0.smithi142.stdout:5/895: creat dc/d14/d26/d102/f130 x:0 0 0 2024-04-20T21:58:46.822 INFO:tasks.workunit.client.0.smithi142.stdout:5/896: write dc/d14/f41 [915125,12728] 0 2024-04-20T21:58:46.824 INFO:tasks.workunit.client.0.smithi142.stdout:1/893: mkdir d2/dd/d17/d3b/d50/d62/d137 0 2024-04-20T21:58:46.825 INFO:tasks.workunit.client.0.smithi142.stdout:3/941: creat d6/d15/d47/d83/dc9/f14d x:0 0 0 2024-04-20T21:58:46.826 INFO:tasks.workunit.client.0.smithi142.stdout:9/933: link d0/d2a/d39/c3b d0/d2a/d9c/d139/c140 0 2024-04-20T21:58:46.829 INFO:tasks.workunit.client.0.smithi142.stdout:9/934: fsync d0/d89/d95/d105/f118 0 2024-04-20T21:58:46.830 INFO:tasks.workunit.client.0.smithi142.stdout:6/857: creat d1/d2f/f134 x:0 0 0 2024-04-20T21:58:46.830 INFO:tasks.workunit.client.0.smithi142.stdout:1/894: rmdir d2/dd/d17/d1b/d22/d55/df9 39 2024-04-20T21:58:46.835 INFO:tasks.workunit.client.0.smithi142.stdout:0/812: creat d5/d1c/d3c/d8b/ffd x:0 0 0 2024-04-20T21:58:46.843 INFO:tasks.workunit.client.0.smithi142.stdout:9/935: unlink d0/d2a/d39/c45 0 2024-04-20T21:58:46.849 INFO:tasks.workunit.client.0.smithi142.stdout:9/936: write d0/d2a/d39/d50/de5/ff8 [4333469,29006] 0 2024-04-20T21:58:46.851 INFO:tasks.workunit.client.0.smithi142.stdout:8/859: dread d0/d1c/f1e [0,4194304] 0 2024-04-20T21:58:46.852 INFO:tasks.workunit.client.0.smithi142.stdout:3/942: write d6/d15/d30/d37/fa1 [219971,124289] 0 2024-04-20T21:58:46.856 INFO:tasks.workunit.client.0.smithi142.stdout:0/813: truncate d5/d1c/f5c 960063 0 2024-04-20T21:58:46.857 INFO:tasks.workunit.client.0.smithi142.stdout:9/937: fdatasync d0/d2a/d39/d87/f101 0 2024-04-20T21:58:46.858 INFO:tasks.workunit.client.0.smithi142.stdout:5/897: dwrite dc/d71/d93/fb8 [0,4194304] 0 2024-04-20T21:58:46.858 INFO:tasks.workunit.client.0.smithi142.stdout:8/860: mkdir d0/d5e/de5/d12a 0 2024-04-20T21:58:46.860 INFO:tasks.workunit.client.0.smithi142.stdout:3/943: chown d6/d15/d30/l94 245372316 1 2024-04-20T21:58:46.861 INFO:tasks.workunit.client.0.smithi142.stdout:1/895: link d2/dd/d1c/d88/d89/f97 d2/dd/d17/d3b/d50/d62/d137/f138 0 2024-04-20T21:58:46.871 INFO:tasks.workunit.client.0.smithi142.stdout:3/944: mknod d6/d15/d30/d37/d6c/d145/c14e 0 2024-04-20T21:58:46.872 INFO:tasks.workunit.client.0.smithi142.stdout:5/898: symlink dc/d14/d26/d3f/db3/d11a/l131 0 2024-04-20T21:58:46.880 INFO:tasks.workunit.client.0.smithi142.stdout:8/861: write d0/d1c/f61 [713651,129707] 0 2024-04-20T21:58:46.880 INFO:tasks.workunit.client.0.smithi142.stdout:5/899: unlink dc/d14/d21/d46/dc1/dd4/ddf/ffc 0 2024-04-20T21:58:46.882 INFO:tasks.workunit.client.0.smithi142.stdout:3/945: getdents d6/d15/d47/dfd 0 2024-04-20T21:58:46.894 INFO:tasks.workunit.client.0.smithi142.stdout:1/896: dwrite d2/de5/dea/f100 [0,4194304] 0 2024-04-20T21:58:46.899 INFO:tasks.workunit.client.0.smithi142.stdout:8/862: dread - d0/d42/d90/fb9 zero size 2024-04-20T21:58:46.899 INFO:tasks.workunit.client.0.smithi142.stdout:5/900: write dc/d14/d21/d46/d2a/f52 [5047726,79303] 0 2024-04-20T21:58:46.900 INFO:tasks.workunit.client.0.smithi142.stdout:9/938: dwrite d0/d91/fb7 [0,4194304] 0 2024-04-20T21:58:46.904 INFO:tasks.workunit.client.0.smithi142.stdout:3/946: truncate d6/d15/d30/dae/ff8 8732290 0 2024-04-20T21:58:46.906 INFO:tasks.workunit.client.0.smithi142.stdout:1/897: rmdir d2/dd/d1c 39 2024-04-20T21:58:46.907 INFO:tasks.workunit.client.0.smithi142.stdout:6/858: dwrite d1/d2f/d35/d5b/d3e/de0/d7e/fb8 [0,4194304] 0 2024-04-20T21:58:46.912 INFO:tasks.workunit.client.0.smithi142.stdout:3/947: creat d6/d15/d10e/f14f x:0 0 0 2024-04-20T21:58:46.915 INFO:tasks.workunit.client.0.smithi142.stdout:9/939: rmdir d0/d36 39 2024-04-20T21:58:46.923 INFO:tasks.workunit.client.0.smithi142.stdout:5/901: dread dc/f11b [0,4194304] 0 2024-04-20T21:58:46.925 INFO:tasks.workunit.client.0.smithi142.stdout:3/948: read d6/d32/d39/d69/de0/f111 [2944908,94991] 0 2024-04-20T21:58:46.926 INFO:tasks.workunit.client.0.smithi142.stdout:5/902: read dc/d14/d21/d7f/f11d [503372,86488] 0 2024-04-20T21:58:46.928 INFO:tasks.workunit.client.0.smithi142.stdout:9/940: fdatasync d0/d91/fc0 0 2024-04-20T21:58:46.933 INFO:tasks.workunit.client.0.smithi142.stdout:9/941: chown d0/d2a/d39/d50 541 1 2024-04-20T21:58:46.933 INFO:tasks.workunit.client.0.smithi142.stdout:5/903: rmdir dc/d14/d21/d46/de6/d110 39 2024-04-20T21:58:46.936 INFO:tasks.workunit.client.0.smithi142.stdout:5/904: truncate dc/f10f 901302 0 2024-04-20T21:58:46.937 INFO:tasks.workunit.client.0.smithi142.stdout:5/905: readlink dc/d14/d21/d46/d2a/d3c/lba 0 2024-04-20T21:58:46.939 INFO:tasks.workunit.client.0.smithi142.stdout:5/906: fsync dc/d71/d5c/d68/ff0 0 2024-04-20T21:58:46.941 INFO:tasks.workunit.client.0.smithi142.stdout:9/942: getdents d0/d89/d95/de4/dfd 0 2024-04-20T21:58:46.941 INFO:tasks.workunit.client.0.smithi142.stdout:3/949: write d6/d15/d30/dae/ff8 [1452633,5246] 0 2024-04-20T21:58:46.945 INFO:tasks.workunit.client.0.smithi142.stdout:1/898: write d2/dd/d17/d3b/d50/d62/f94 [69246,52597] 0 2024-04-20T21:58:46.947 INFO:tasks.workunit.client.0.smithi142.stdout:8/863: truncate d0/d1c/d44/dad/db3/d3f/d7f/fc3 1270637 0 2024-04-20T21:58:46.950 INFO:tasks.workunit.client.0.smithi142.stdout:3/950: read d6/f34 [1607076,2137] 0 2024-04-20T21:58:46.950 INFO:tasks.workunit.client.0.smithi142.stdout:9/943: chown d0/l17 109146821 1 2024-04-20T21:58:46.957 INFO:tasks.workunit.client.0.smithi142.stdout:3/951: mknod d6/d15/d10e/c150 0 2024-04-20T21:58:46.960 INFO:tasks.workunit.client.0.smithi142.stdout:6/859: dwrite d1/d2f/d35/d48/f73 [0,4194304] 0 2024-04-20T21:58:46.961 INFO:tasks.workunit.client.0.smithi142.stdout:9/944: creat d0/d2a/d8b/dc1/f141 x:0 0 0 2024-04-20T21:58:46.964 INFO:tasks.workunit.client.0.smithi142.stdout:3/952: mkdir d6/d15/d30/db4/d151 0 2024-04-20T21:58:46.964 INFO:tasks.workunit.client.0.smithi142.stdout:5/907: dwrite dc/d14/d21/d46/d2a/f74 [0,4194304] 0 2024-04-20T21:58:46.970 INFO:tasks.workunit.client.0.smithi142.stdout:6/860: dread - d1/d2f/d35/d5b/d39/dcd/f133 zero size 2024-04-20T21:58:46.972 INFO:tasks.workunit.client.0.smithi142.stdout:9/945: unlink d0/d2a/d9c/d139/c140 0 2024-04-20T21:58:46.975 INFO:tasks.workunit.client.0.smithi142.stdout:3/953: truncate d6/f3a 4518435 0 2024-04-20T21:58:46.981 INFO:tasks.workunit.client.0.smithi142.stdout:5/908: rename dc/d71/d5c/d68/ff3 to dc/d71/d93/f132 0 2024-04-20T21:58:46.986 INFO:tasks.workunit.client.0.smithi142.stdout:1/899: dwrite d2/dd/d17/d1b/d22/d55/fb5 [0,4194304] 0 2024-04-20T21:58:46.992 INFO:tasks.workunit.client.0.smithi142.stdout:6/861: creat d1/d2f/d35/d5b/d63/d4b/d61/f135 x:0 0 0 2024-04-20T21:58:46.992 INFO:tasks.workunit.client.0.smithi142.stdout:3/954: rename d6/d32/d39/d69/d91/d14b/d4d/d59/cd0 to d6/d15/d30/d37/c152 0 2024-04-20T21:58:46.995 INFO:tasks.workunit.client.0.smithi142.stdout:4/766: sync 2024-04-20T21:58:46.995 INFO:tasks.workunit.client.0.smithi142.stdout:3/955: stat d6/d15/d47/d83 0 2024-04-20T21:58:47.004 INFO:tasks.workunit.client.0.smithi142.stdout:5/909: write dc/d14/d25/db4/fc2 [932208,21115] 0 2024-04-20T21:58:47.005 INFO:tasks.workunit.client.0.smithi142.stdout:3/956: read d6/d15/d30/d37/f3d [389029,130975] 0 2024-04-20T21:58:47.006 INFO:tasks.workunit.client.0.smithi142.stdout:8/864: dread d0/f26 [0,4194304] 0 2024-04-20T21:58:47.006 INFO:tasks.workunit.client.0.smithi142.stdout:1/900: link d2/dd/d17/d3b/d50/c6c d2/dd/d1c/d60/dce/d7c/de7/c139 0 2024-04-20T21:58:47.007 INFO:tasks.workunit.client.0.smithi142.stdout:9/946: dwrite d0/ff [0,4194304] 0 2024-04-20T21:58:47.015 INFO:tasks.workunit.client.0.smithi142.stdout:8/865: fsync d0/d5e/f87 0 2024-04-20T21:58:47.018 INFO:tasks.workunit.client.0.smithi142.stdout:1/901: unlink d2/d4e/d7e/fe3 0 2024-04-20T21:58:47.018 INFO:tasks.workunit.client.0.smithi142.stdout:0/814: sync 2024-04-20T21:58:47.022 INFO:tasks.workunit.client.0.smithi142.stdout:6/862: dwrite d1/d5/f37 [4194304,4194304] 0 2024-04-20T21:58:47.023 INFO:tasks.workunit.client.0.smithi142.stdout:1/902: write d2/dd/d17/ffd [1481600,90678] 0 2024-04-20T21:58:47.024 INFO:tasks.workunit.client.0.smithi142.stdout:5/910: creat dc/d14/d21/d46/f133 x:0 0 0 2024-04-20T21:58:47.031 INFO:tasks.workunit.client.0.smithi142.stdout:8/866: unlink d0/d1c/d44/dad/db3/d3f/l6b 0 2024-04-20T21:58:47.035 INFO:tasks.workunit.client.0.smithi142.stdout:6/863: symlink d1/d2f/d35/d5b/d3e/de0/d7e/l136 0 2024-04-20T21:58:47.036 INFO:tasks.workunit.client.0.smithi142.stdout:9/947: dread d0/d3c/d4d/d103/f10b [0,4194304] 0 2024-04-20T21:58:47.038 INFO:tasks.workunit.client.0.smithi142.stdout:8/867: fdatasync d0/d17/f3b 0 2024-04-20T21:58:47.039 INFO:tasks.workunit.client.0.smithi142.stdout:6/864: truncate d1/f12f 24200 0 2024-04-20T21:58:47.042 INFO:tasks.workunit.client.0.smithi142.stdout:4/767: dread d1/d6/d4b/f82 [0,4194304] 0 2024-04-20T21:58:47.044 INFO:tasks.workunit.client.0.smithi142.stdout:9/948: write d0/d2a/f44 [748693,64428] 0 2024-04-20T21:58:47.049 INFO:tasks.workunit.client.0.smithi142.stdout:3/957: dread d6/d32/d39/d69/de0/f100 [0,4194304] 0 2024-04-20T21:58:47.050 INFO:tasks.workunit.client.0.smithi142.stdout:8/868: mknod d0/d29/df5/d11e/c12b 0 2024-04-20T21:58:47.051 INFO:tasks.workunit.client.0.smithi142.stdout:6/865: mknod d1/c137 0 2024-04-20T21:58:47.055 INFO:tasks.workunit.client.0.smithi142.stdout:5/911: write dc/d14/d21/d46/d2a/d3c/fdd [827229,16680] 0 2024-04-20T21:58:47.056 INFO:tasks.workunit.client.0.smithi142.stdout:9/949: creat d0/d3c/d4d/f142 x:0 0 0 2024-04-20T21:58:47.058 INFO:tasks.workunit.client.0.smithi142.stdout:6/866: chown d1/d2f/d35/d5b/d63/d34/f127 128039975 1 2024-04-20T21:58:47.063 INFO:tasks.workunit.client.0.smithi142.stdout:4/768: dread d1/d6/d4a/d5a/f6a [0,4194304] 0 2024-04-20T21:58:47.065 INFO:tasks.workunit.client.0.smithi142.stdout:1/903: dwrite d2/d4e/f64 [0,4194304] 0 2024-04-20T21:58:47.069 INFO:tasks.workunit.client.0.smithi142.stdout:6/867: link d1/d11/c13 d1/d2f/d35/d5b/d63/d34/c138 0 2024-04-20T21:58:47.072 INFO:tasks.workunit.client.0.smithi142.stdout:1/904: creat d2/dd/d17/d8b/f13a x:0 0 0 2024-04-20T21:58:47.077 INFO:tasks.workunit.client.0.smithi142.stdout:5/912: write dc/d14/d25/d78/f101 [315951,115620] 0 2024-04-20T21:58:47.078 INFO:tasks.workunit.client.0.smithi142.stdout:6/868: write d1/d5/f37 [2528560,76692] 0 2024-04-20T21:58:47.085 INFO:tasks.workunit.client.0.smithi142.stdout:1/905: rename d2/dd/f127 to d2/dd/d116/f13b 0 2024-04-20T21:58:47.088 INFO:tasks.workunit.client.0.smithi142.stdout:9/950: dwrite d0/d2a/d39/d87/fbe [0,4194304] 0 2024-04-20T21:58:47.088 INFO:tasks.workunit.client.0.smithi142.stdout:5/913: write dc/d14/d21/d46/d2a/d3c/fdd [1467923,125644] 0 2024-04-20T21:58:47.091 INFO:tasks.workunit.client.0.smithi142.stdout:5/914: chown dc/d14/d21/d46/dc1/dd4/ddf/ffe 3 1 2024-04-20T21:58:47.094 INFO:tasks.workunit.client.0.smithi142.stdout:3/958: dread d6/f25 [0,4194304] 0 2024-04-20T21:58:47.095 INFO:tasks.workunit.client.0.smithi142.stdout:9/951: fsync d0/ff 0 2024-04-20T21:58:47.099 INFO:tasks.workunit.client.0.smithi142.stdout:5/915: write dc/d14/d26/ff6 [392164,366] 0 2024-04-20T21:58:47.102 INFO:tasks.workunit.client.0.smithi142.stdout:5/916: stat f4 0 2024-04-20T21:58:47.103 INFO:tasks.workunit.client.0.smithi142.stdout:6/869: dread d1/d2f/d35/d5b/d3e/f57 [0,4194304] 0 2024-04-20T21:58:47.103 INFO:tasks.workunit.client.0.smithi142.stdout:3/959: dread d6/d32/d39/d69/f85 [0,4194304] 0 2024-04-20T21:58:47.106 INFO:tasks.workunit.client.0.smithi142.stdout:9/952: truncate d0/d89/d95/d105/f118 592879 0 2024-04-20T21:58:47.113 INFO:tasks.workunit.client.0.smithi142.stdout:4/769: dread d1/d12/da/f18 [0,4194304] 0 2024-04-20T21:58:47.115 INFO:tasks.workunit.client.0.smithi142.stdout:3/960: mknod d6/d15/d10e/c153 0 2024-04-20T21:58:47.117 INFO:tasks.workunit.client.0.smithi142.stdout:5/917: symlink dc/d14/d21/d46/dc1/dd4/l134 0 2024-04-20T21:58:47.120 INFO:tasks.workunit.client.0.smithi142.stdout:9/953: truncate d0/d2a/d39/fc4 5115333 0 2024-04-20T21:58:47.122 INFO:tasks.workunit.client.0.smithi142.stdout:6/870: unlink d1/d2f/d35/d5b/d63/d4b/cff 0 2024-04-20T21:58:47.124 INFO:tasks.workunit.client.0.smithi142.stdout:1/906: dwrite d2/d4e/fe8 [0,4194304] 0 2024-04-20T21:58:47.125 INFO:tasks.workunit.client.0.smithi142.stdout:3/961: creat d6/d15/d47/d83/d13d/f154 x:0 0 0 2024-04-20T21:58:47.140 INFO:tasks.workunit.client.0.smithi142.stdout:3/962: fsync d6/f25 0 2024-04-20T21:58:47.151 INFO:tasks.workunit.client.0.smithi142.stdout:5/918: write dc/d14/d21/d46/d2a/f8a [1421302,3989] 0 2024-04-20T21:58:47.156 INFO:tasks.workunit.client.0.smithi142.stdout:1/907: write d2/dd/d1c/d60/dda/fbe [67734,8472] 0 2024-04-20T21:58:47.158 INFO:tasks.workunit.client.0.smithi142.stdout:4/770: truncate d1/d6/d4a/d5a/f56 2777140 0 2024-04-20T21:58:47.162 INFO:tasks.workunit.client.0.smithi142.stdout:4/771: chown d1/d12/da/d1c/d32/d3d/d2f/fec 2 1 2024-04-20T21:58:47.162 INFO:tasks.workunit.client.0.smithi142.stdout:9/954: write d0/d3c/d4d/f75 [1145955,103821] 0 2024-04-20T21:58:47.167 INFO:tasks.workunit.client.0.smithi142.stdout:9/955: chown d0/d2a/c57 45 1 2024-04-20T21:58:47.169 INFO:tasks.workunit.client.0.smithi142.stdout:6/871: getdents d1/d2f/d35/d5b/d3e/dc5/ddb 0 2024-04-20T21:58:47.170 INFO:tasks.workunit.client.0.smithi142.stdout:3/963: getdents d6/d15/d47/d83/dc9/d10f/d11e 0 2024-04-20T21:58:47.174 INFO:tasks.workunit.client.0.smithi142.stdout:4/772: fsync d1/d6/d4b/f82 0 2024-04-20T21:58:47.178 INFO:tasks.workunit.client.0.smithi142.stdout:3/964: mknod d6/d15/d47/c155 0 2024-04-20T21:58:47.179 INFO:tasks.workunit.client.0.smithi142.stdout:1/908: dread d2/dd/d17/d3b/f78 [0,4194304] 0 2024-04-20T21:58:47.180 INFO:tasks.workunit.client.0.smithi142.stdout:6/872: symlink d1/d5/d8b/da6/l139 0 2024-04-20T21:58:47.182 INFO:tasks.workunit.client.0.smithi142.stdout:5/919: dread dc/d14/d25/db4/dbb/feb [0,4194304] 0 2024-04-20T21:58:47.182 INFO:tasks.workunit.client.0.smithi142.stdout:3/965: dread - d6/d32/d39/d69/d91/f106 zero size 2024-04-20T21:58:47.187 INFO:tasks.workunit.client.0.smithi142.stdout:3/966: stat d6/d32/d39/d69/d91/d14b/d4d/d59/df6 0 2024-04-20T21:58:47.187 INFO:tasks.workunit.client.0.smithi142.stdout:6/873: read d1/d11/fa [2784170,109915] 0 2024-04-20T21:58:47.187 INFO:tasks.workunit.client.0.smithi142.stdout:4/773: symlink d1/d6/d4a/db0/lee 0 2024-04-20T21:58:47.187 INFO:tasks.workunit.client.0.smithi142.stdout:1/909: truncate d2/dd/d17/d3b/d50/d62/f123 226873 0 2024-04-20T21:58:47.188 INFO:tasks.workunit.client.0.smithi142.stdout:4/774: readlink d1/la4 0 2024-04-20T21:58:47.192 INFO:tasks.workunit.client.0.smithi142.stdout:6/874: write d1/d2f/d35/d5b/d63/d4b/d61/db7/f10e [409696,70387] 0 2024-04-20T21:58:47.193 INFO:tasks.workunit.client.0.smithi142.stdout:9/956: getdents d0 0 2024-04-20T21:58:47.193 INFO:tasks.workunit.client.0.smithi142.stdout:5/920: mknod dc/c135 0 2024-04-20T21:58:47.195 INFO:tasks.workunit.client.0.smithi142.stdout:5/921: fdatasync dc/d14/d25/db4/fe0 0 2024-04-20T21:58:47.196 INFO:tasks.workunit.client.0.smithi142.stdout:3/967: creat d6/d15/d47/dfd/f156 x:0 0 0 2024-04-20T21:58:47.198 INFO:tasks.workunit.client.0.smithi142.stdout:5/922: write dc/d14/d25/f2d [3998299,70282] 0 2024-04-20T21:58:47.202 INFO:tasks.workunit.client.0.smithi142.stdout:4/775: truncate d1/f13 2131187 0 2024-04-20T21:58:47.204 INFO:tasks.workunit.client.0.smithi142.stdout:6/875: creat d1/d5/d8b/da6/f13a x:0 0 0 2024-04-20T21:58:47.205 INFO:tasks.workunit.client.0.smithi142.stdout:4/776: chown d1/d12/da/d1c/l45 349 1 2024-04-20T21:58:47.211 INFO:tasks.workunit.client.0.smithi142.stdout:1/910: creat d2/dd/d1c/d60/d121/f13c x:0 0 0 2024-04-20T21:58:47.213 INFO:tasks.workunit.client.0.smithi142.stdout:9/957: dwrite d0/d2a/d39/d87/d9e/db3/f11e [0,4194304] 0 2024-04-20T21:58:47.217 INFO:tasks.workunit.client.0.smithi142.stdout:4/777: rename d1/d6/d4a/f71 to d1/d12/da/d72/fef 0 2024-04-20T21:58:47.218 INFO:tasks.workunit.client.0.smithi142.stdout:4/778: readlink d1/d5b/l70 0 2024-04-20T21:58:47.218 INFO:tasks.workunit.client.0.smithi142.stdout:9/958: write d0/d2a/dd4/f132 [390949,30839] 0 2024-04-20T21:58:47.222 INFO:tasks.workunit.client.0.smithi142.stdout:0/815: sync 2024-04-20T21:58:47.227 INFO:tasks.workunit.client.0.smithi142.stdout:0/816: write d5/d1c/d3c/f73 [640326,35513] 0 2024-04-20T21:58:47.227 INFO:tasks.workunit.client.0.smithi142.stdout:5/923: dread dc/fd3 [0,4194304] 0 2024-04-20T21:58:47.228 INFO:tasks.workunit.client.0.smithi142.stdout:6/876: rename d1/d2f/d35/d5b/d3e/de0/d7e/fb8 to d1/d11/d71/f13b 0 2024-04-20T21:58:47.234 INFO:tasks.workunit.client.0.smithi142.stdout:9/959: unlink d0/d89/lc8 0 2024-04-20T21:58:47.237 INFO:tasks.workunit.client.0.smithi142.stdout:9/960: fsync d0/d2a/d39/d50/de5/d109/f134 0 2024-04-20T21:58:47.238 INFO:tasks.workunit.client.0.smithi142.stdout:4/779: symlink d1/d12/da/d1c/d32/d3d/d2f/d7a/d90/lf0 0 2024-04-20T21:58:47.246 INFO:tasks.workunit.client.0.smithi142.stdout:3/968: dread d6/d15/d1e/fb2 [0,4194304] 0 2024-04-20T21:58:47.248 INFO:tasks.workunit.client.0.smithi142.stdout:3/969: write d6/d15/d30/d37/fa1 [108278,49324] 0 2024-04-20T21:58:47.249 INFO:tasks.workunit.client.0.smithi142.stdout:9/961: mkdir d0/d2a/d39/d87/d9e/d143 0 2024-04-20T21:58:47.254 INFO:tasks.workunit.client.0.smithi142.stdout:5/924: rmdir dc/d14/d21/d46/de6/d110 39 2024-04-20T21:58:47.255 INFO:tasks.workunit.client.0.smithi142.stdout:5/925: readlink dc/d71/d5c/lca 0 2024-04-20T21:58:47.258 INFO:tasks.workunit.client.0.smithi142.stdout:9/962: symlink d0/d2a/dd4/l144 0 2024-04-20T21:58:47.260 INFO:tasks.workunit.client.0.smithi142.stdout:3/970: rename d6/d15/d30/d37/d6c/dcd/lc4 to d6/d32/d39/l157 0 2024-04-20T21:58:47.261 INFO:tasks.workunit.client.0.smithi142.stdout:9/963: read d0/f31 [2683144,98596] 0 2024-04-20T21:58:47.262 INFO:tasks.workunit.client.0.smithi142.stdout:0/817: creat d5/d1c/d3c/ffe x:0 0 0 2024-04-20T21:58:47.263 INFO:tasks.workunit.client.0.smithi142.stdout:9/964: stat d0/d2a/d39/d50/f5b 0 2024-04-20T21:58:47.263 INFO:tasks.workunit.client.0.smithi142.stdout:5/926: mkdir dc/d14/d25/db4/d136 0 2024-04-20T21:58:47.265 INFO:tasks.workunit.client.0.smithi142.stdout:3/971: creat d6/d32/d39/d69/de0/d11d/f158 x:0 0 0 2024-04-20T21:58:47.266 INFO:tasks.workunit.client.0.smithi142.stdout:4/780: dwrite d1/d12/da/d1c/f26 [0,4194304] 0 2024-04-20T21:58:47.268 INFO:tasks.workunit.client.0.smithi142.stdout:4/781: truncate d1/fd8 375487 0 2024-04-20T21:58:47.269 INFO:tasks.workunit.client.0.smithi142.stdout:9/965: creat d0/d91/da0/f145 x:0 0 0 2024-04-20T21:58:47.271 INFO:tasks.workunit.client.0.smithi142.stdout:9/966: chown d0/d2a/d8b 3 1 2024-04-20T21:58:47.272 INFO:tasks.workunit.client.0.smithi142.stdout:9/967: chown d0/d89/d95/d105 20830 1 2024-04-20T21:58:47.273 INFO:tasks.workunit.client.0.smithi142.stdout:5/927: rename dc/d14/d21/d7f/ff2 to dc/d14/d21/d46/d2a/d65/da3/f137 0 2024-04-20T21:58:47.275 INFO:tasks.workunit.client.0.smithi142.stdout:3/972: mkdir d6/d15/d47/d83/d13d/d122/d159 0 2024-04-20T21:58:47.276 INFO:tasks.workunit.client.0.smithi142.stdout:5/928: write dc/f10 [1261591,110569] 0 2024-04-20T21:58:47.281 INFO:tasks.workunit.client.0.smithi142.stdout:1/911: dwrite d2/dd/d17/d3b/d50/f5e [0,4194304] 0 2024-04-20T21:58:47.284 INFO:tasks.workunit.client.0.smithi142.stdout:9/968: mknod d0/d89/c146 0 2024-04-20T21:58:47.284 INFO:tasks.workunit.client.0.smithi142.stdout:5/929: unlink dc/d14/d25/db4/dbb/feb 0 2024-04-20T21:58:47.288 INFO:tasks.workunit.client.0.smithi142.stdout:3/973: rename d6/d15/d30/d37/d6c/dcd/c10c to d6/d15/d30/c15a 0 2024-04-20T21:58:47.290 INFO:tasks.workunit.client.0.smithi142.stdout:9/969: mknod d0/d2a/d9c/c147 0 2024-04-20T21:58:47.292 INFO:tasks.workunit.client.0.smithi142.stdout:1/912: symlink d2/dd/d1c/d60/dda/l13d 0 2024-04-20T21:58:47.295 INFO:tasks.workunit.client.0.smithi142.stdout:5/930: symlink dc/d14/d26/d3f/d53/d7c/da9/d75/dac/l138 0 2024-04-20T21:58:47.303 INFO:tasks.workunit.client.0.smithi142.stdout:9/970: rename d0/f21 to d0/d89/d95/d105/f148 0 2024-04-20T21:58:47.303 INFO:tasks.workunit.client.0.smithi142.stdout:6/877: truncate d1/d5/d8b/f117 3637897 0 2024-04-20T21:58:47.305 INFO:tasks.workunit.client.0.smithi142.stdout:5/931: write dc/d14/d21/d46/f121 [795724,9472] 0 2024-04-20T21:58:47.306 INFO:tasks.workunit.client.0.smithi142.stdout:8/869: sync 2024-04-20T21:58:47.309 INFO:tasks.workunit.client.0.smithi142.stdout:8/870: chown d0/d29/df5/d11e/c12b 437569 1 2024-04-20T21:58:47.312 INFO:tasks.workunit.client.0.smithi142.stdout:4/782: write d1/d12/da/f7f [2630310,97753] 0 2024-04-20T21:58:47.313 INFO:tasks.workunit.client.0.smithi142.stdout:3/974: dwrite d6/d15/f143 [0,4194304] 0 2024-04-20T21:58:47.322 INFO:tasks.workunit.client.0.smithi142.stdout:0/818: dwrite d5/f18 [0,4194304] 0 2024-04-20T21:58:47.330 INFO:tasks.workunit.client.0.smithi142.stdout:4/783: dwrite d1/d6/d4b/fa5 [0,4194304] 0 2024-04-20T21:58:47.355 INFO:tasks.workunit.client.0.smithi142.stdout:1/913: truncate d2/dd/d17/d1b/d22/d13/f63 4184615 0 2024-04-20T21:58:47.357 INFO:tasks.workunit.client.0.smithi142.stdout:1/914: chown d2/dd/d1c/d88/d89/f111 2026 1 2024-04-20T21:58:47.358 INFO:tasks.workunit.client.0.smithi142.stdout:6/878: unlink d1/d2f/d35/d5b/d39/c81 0 2024-04-20T21:58:47.358 INFO:tasks.workunit.client.0.smithi142.stdout:1/915: chown d2/d4e/d130 216967 1 2024-04-20T21:58:47.360 INFO:tasks.workunit.client.0.smithi142.stdout:5/932: mkdir dc/d14/d25/d89/d139 0 2024-04-20T21:58:47.360 INFO:tasks.workunit.client.0.smithi142.stdout:1/916: fdatasync d2/dd/d17/d8b/f104 0 2024-04-20T21:58:47.362 INFO:tasks.workunit.client.0.smithi142.stdout:3/975: mknod d6/d32/d39/d69/d91/d14b/d4d/d59/c15b 0 2024-04-20T21:58:47.365 INFO:tasks.workunit.client.0.smithi142.stdout:4/784: dread - d1/d12/da/d1c/f88 zero size 2024-04-20T21:58:47.367 INFO:tasks.workunit.client.0.smithi142.stdout:6/879: dread - d1/d2f/d35/d5b/d3e/f87 zero size 2024-04-20T21:58:47.367 INFO:tasks.workunit.client.0.smithi142.stdout:4/785: dread - d1/d12/fb3 zero size 2024-04-20T21:58:47.371 INFO:tasks.workunit.client.0.smithi142.stdout:5/933: unlink dc/d14/d26/d3f/d53/fc6 0 2024-04-20T21:58:47.373 INFO:tasks.workunit.client.0.smithi142.stdout:1/917: fsync d2/dd/d17/d1b/f71 0 2024-04-20T21:58:47.377 INFO:tasks.workunit.client.0.smithi142.stdout:6/880: creat d1/d5/d8b/da6/f13c x:0 0 0 2024-04-20T21:58:47.380 INFO:tasks.workunit.client.0.smithi142.stdout:3/976: dwrite d6/d15/d30/f46 [4194304,4194304] 0 2024-04-20T21:58:47.384 INFO:tasks.workunit.client.0.smithi142.stdout:1/918: rename d2/dd/d17/d3b/d50/d62/lf2 to d2/dd/d116/l13e 0 2024-04-20T21:58:47.387 INFO:tasks.workunit.client.0.smithi142.stdout:4/786: link d1/d6/d4a/d5a/f99 d1/d6/d4a/db0/ff1 0 2024-04-20T21:58:47.388 INFO:tasks.workunit.client.0.smithi142.stdout:6/881: truncate d1/d75/ff1 49645 0 2024-04-20T21:58:47.391 INFO:tasks.workunit.client.0.smithi142.stdout:9/971: creat d0/d2a/d39/d87/d9e/db3/f149 x:0 0 0 2024-04-20T21:58:47.393 INFO:tasks.workunit.client.0.smithi142.stdout:6/882: creat d1/d2f/d35/d5b/d63/d4b/f13d x:0 0 0 2024-04-20T21:58:47.395 INFO:tasks.workunit.client.0.smithi142.stdout:3/977: truncate d6/f3a 1235523 0 2024-04-20T21:58:47.399 INFO:tasks.workunit.client.0.smithi142.stdout:9/972: write d0/d3c/d4d/d103/f10b [314338,79228] 0 2024-04-20T21:58:47.404 INFO:tasks.workunit.client.0.smithi142.stdout:9/973: unlink d0/d2a/d9c/c147 0 2024-04-20T21:58:47.408 INFO:tasks.workunit.client.0.smithi142.stdout:9/974: creat d0/d89/d11a/d111/d122/f14a x:0 0 0 2024-04-20T21:58:47.412 INFO:tasks.workunit.client.0.smithi142.stdout:9/975: creat d0/dd5/d11d/f14b x:0 0 0 2024-04-20T21:58:47.413 INFO:tasks.workunit.client.0.smithi142.stdout:9/976: chown d0/d2a/d8b/d12a 1854 1 2024-04-20T21:58:47.418 INFO:tasks.workunit.client.0.smithi142.stdout:9/977: link d0/d2a/d39/f5e d0/d2a/d39/d87/d9e/db3/f14c 0 2024-04-20T21:58:47.423 INFO:tasks.workunit.client.0.smithi142.stdout:9/978: mkdir d0/d91/db4/d127/d14d 0 2024-04-20T21:58:47.426 INFO:tasks.workunit.client.0.smithi142.stdout:9/979: creat d0/d89/d95/de4/f14e x:0 0 0 2024-04-20T21:58:47.427 INFO:tasks.workunit.client.0.smithi142.stdout:8/871: write d0/d5e/f125 [571916,53803] 0 2024-04-20T21:58:47.427 INFO:tasks.workunit.client.0.smithi142.stdout:9/980: readlink d0/d2a/dd4/l144 0 2024-04-20T21:58:47.430 INFO:tasks.workunit.client.0.smithi142.stdout:0/819: write d5/d1c/d3c/d8b/fac [705524,37321] 0 2024-04-20T21:58:47.431 INFO:tasks.workunit.client.0.smithi142.stdout:8/872: dread - d0/d17/d6e/d110/fbe zero size 2024-04-20T21:58:47.432 INFO:tasks.workunit.client.0.smithi142.stdout:9/981: read d0/d2a/d39/d50/de5/d109/fe8 [334617,19765] 0 2024-04-20T21:58:47.441 INFO:tasks.workunit.client.0.smithi142.stdout:1/919: truncate d2/dd/d1c/d88/f8d 7162408 0 2024-04-20T21:58:47.444 INFO:tasks.workunit.client.0.smithi142.stdout:6/883: write d1/d75/ff5 [578242,21157] 0 2024-04-20T21:58:47.444 INFO:tasks.workunit.client.0.smithi142.stdout:8/873: creat d0/f12c x:0 0 0 2024-04-20T21:58:47.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:47 smithi164 ceph-mon[23506]: pgmap v45: 65 pgs: 65 active+clean; 1.7 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 47 MiB/s rd, 101 MiB/s wr, 304 op/s 2024-04-20T21:58:47.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:47 smithi142 ceph-mon[15828]: pgmap v45: 65 pgs: 65 active+clean; 1.7 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 47 MiB/s rd, 101 MiB/s wr, 304 op/s 2024-04-20T21:58:47.449 INFO:tasks.workunit.client.0.smithi142.stdout:9/982: rename d0/d2a/d39 to d0/d89/d95/d14f 0 2024-04-20T21:58:47.449 INFO:tasks.workunit.client.0.smithi142.stdout:1/920: rmdir d2/dd/d17/d3b/d50/d62/d137 39 2024-04-20T21:58:47.454 INFO:tasks.workunit.client.0.smithi142.stdout:0/820: dread d5/f6c [0,4194304] 0 2024-04-20T21:58:47.455 INFO:tasks.workunit.client.0.smithi142.stdout:3/978: dwrite d6/d32/d39/d69/d91/d14b/d4d/f6d [0,4194304] 0 2024-04-20T21:58:47.457 INFO:tasks.workunit.client.0.smithi142.stdout:9/983: mknod d0/d91/da0/c150 0 2024-04-20T21:58:47.457 INFO:tasks.workunit.client.0.smithi142.stdout:0/821: chown d5/d1c/d3c/d4a/ce2 10 1 2024-04-20T21:58:47.461 INFO:tasks.workunit.client.0.smithi142.stdout:9/984: write d0/d89/d11a/d111/d122/f14a [52807,100418] 0 2024-04-20T21:58:47.462 INFO:tasks.workunit.client.0.smithi142.stdout:0/822: chown d5/d13/d1e/d23/d24/d48/c4b 62 1 2024-04-20T21:58:47.470 INFO:tasks.workunit.client.0.smithi142.stdout:0/823: creat d5/d13/d1e/d23/d46/fff x:0 0 0 2024-04-20T21:58:47.475 INFO:tasks.workunit.client.0.smithi142.stdout:0/824: rmdir d5/d1c 39 2024-04-20T21:58:47.476 INFO:tasks.workunit.client.0.smithi142.stdout:0/825: readlink d5/lde 0 2024-04-20T21:58:47.480 INFO:tasks.workunit.client.0.smithi142.stdout:9/985: write d0/d89/d95/d14f/f106 [844713,124436] 0 2024-04-20T21:58:47.484 INFO:tasks.workunit.client.0.smithi142.stdout:9/986: mkdir d0/dd5/d11d/d151 0 2024-04-20T21:58:47.487 INFO:tasks.workunit.client.0.smithi142.stdout:1/921: dwrite d2/dd/d17/d1b/d22/d13/f35 [0,4194304] 0 2024-04-20T21:58:47.487 INFO:tasks.workunit.client.0.smithi142.stdout:9/987: chown d0/cb1 2 1 2024-04-20T21:58:47.489 INFO:tasks.workunit.client.0.smithi142.stdout:6/884: dread d1/d2f/d35/d5b/d63/d4b/f7b [0,4194304] 0 2024-04-20T21:58:47.494 INFO:tasks.workunit.client.0.smithi142.stdout:3/979: dread d6/d32/d39/d69/d91/d14b/d4d/f8b [0,4194304] 0 2024-04-20T21:58:47.494 INFO:tasks.workunit.client.0.smithi142.stdout:9/988: mknod d0/d2a/d9c/c152 0 2024-04-20T21:58:47.497 INFO:tasks.workunit.client.0.smithi142.stdout:9/989: mknod d0/d2a/dd4/c153 0 2024-04-20T21:58:47.498 INFO:tasks.workunit.client.0.smithi142.stdout:1/922: creat d2/dd/d17/d3b/d50/d62/d137/f13f x:0 0 0 2024-04-20T21:58:47.499 INFO:tasks.workunit.client.0.smithi142.stdout:6/885: symlink d1/d1b/d12e/l13e 0 2024-04-20T21:58:47.501 INFO:tasks.workunit.client.0.smithi142.stdout:1/923: fsync d2/dd/d1c/d60/fed 0 2024-04-20T21:58:47.503 INFO:tasks.workunit.client.0.smithi142.stdout:8/874: dread d0/d1c/d44/dad/db3/fe4 [0,4194304] 0 2024-04-20T21:58:47.504 INFO:tasks.workunit.client.0.smithi142.stdout:1/924: write d2/dd/d1c/d88/d89/f111 [25414,68136] 0 2024-04-20T21:58:47.506 INFO:tasks.workunit.client.0.smithi142.stdout:3/980: getdents d6/d15/d30/d37/d75 0 2024-04-20T21:58:47.508 INFO:tasks.workunit.client.0.smithi142.stdout:8/875: mknod d0/d17/d35/db5/d101/c12d 0 2024-04-20T21:58:47.511 INFO:tasks.workunit.client.0.smithi142.stdout:3/981: mknod d6/d15/d30/d37/c15c 0 2024-04-20T21:58:47.514 INFO:tasks.workunit.client.0.smithi142.stdout:8/876: unlink d0/d29/c82 0 2024-04-20T21:58:47.517 INFO:tasks.workunit.client.0.smithi142.stdout:3/982: mknod d6/d32/d39/d69/d91/d14b/d4d/d59/df6/c15d 0 2024-04-20T21:58:47.520 INFO:tasks.workunit.client.0.smithi142.stdout:6/886: dwrite d1/d2f/d35/d5b/d63/ded/d108/f126 [0,4194304] 0 2024-04-20T21:58:47.523 INFO:tasks.workunit.client.0.smithi142.stdout:3/983: creat d6/d15/d47/f15e x:0 0 0 2024-04-20T21:58:47.524 INFO:tasks.workunit.client.0.smithi142.stdout:1/925: write d2/dd/d17/d3b/fc1 [4787771,110849] 0 2024-04-20T21:58:47.528 INFO:tasks.workunit.client.0.smithi142.stdout:8/877: rename d0/d1c/d44/dad/db3/fe0 to d0/f12e 0 2024-04-20T21:58:47.529 INFO:tasks.workunit.client.0.smithi142.stdout:3/984: mkdir d6/d15/d30/d15f 0 2024-04-20T21:58:47.530 INFO:tasks.workunit.client.0.smithi142.stdout:6/887: getdents d1/d2f/d35/d48/d102 0 2024-04-20T21:58:47.531 INFO:tasks.workunit.client.0.smithi142.stdout:1/926: symlink d2/dd/d1c/d60/dce/d7c/de7/l140 0 2024-04-20T21:58:47.533 INFO:tasks.workunit.client.0.smithi142.stdout:8/878: symlink d0/d1c/l12f 0 2024-04-20T21:58:47.533 INFO:tasks.workunit.client.0.smithi142.stdout:3/985: creat d6/d32/d39/d69/de0/d11d/f160 x:0 0 0 2024-04-20T21:58:47.533 INFO:tasks.workunit.client.0.smithi142.stdout:6/888: mkdir d1/dd1/d65/d13f 0 2024-04-20T21:58:47.536 INFO:tasks.workunit.client.0.smithi142.stdout:1/927: fdatasync d2/dd/d1c/d88/d89/f97 0 2024-04-20T21:58:47.537 INFO:tasks.workunit.client.0.smithi142.stdout:8/879: rmdir d0/d17/d6e/d110/de8 39 2024-04-20T21:58:47.539 INFO:tasks.workunit.client.0.smithi142.stdout:6/889: write d1/d2f/d35/d5b/d3e/de0/d7e/fb3 [6697226,35258] 0 2024-04-20T21:58:47.540 INFO:tasks.workunit.client.0.smithi142.stdout:1/928: write d2/dd/d1c/d60/f72 [3387864,85356] 0 2024-04-20T21:58:47.541 INFO:tasks.workunit.client.0.smithi142.stdout:3/986: fdatasync d6/d32/d39/d69/d91/d14b/d4d/d59/f62 0 2024-04-20T21:58:47.544 INFO:tasks.workunit.client.0.smithi142.stdout:3/987: chown d6/d15/da4 796 1 2024-04-20T21:58:47.544 INFO:tasks.workunit.client.0.smithi142.stdout:8/880: symlink d0/d42/l130 0 2024-04-20T21:58:47.550 INFO:tasks.workunit.client.0.smithi142.stdout:3/988: creat d6/d15/d30/d37/f161 x:0 0 0 2024-04-20T21:58:47.551 INFO:tasks.workunit.client.0.smithi142.stdout:8/881: symlink d0/d1c/d44/d89/d45/d4c/d68/da5/l131 0 2024-04-20T21:58:47.551 INFO:tasks.workunit.client.0.smithi142.stdout:1/929: symlink d2/dd/d17/d1b/d22/l141 0 2024-04-20T21:58:47.553 INFO:tasks.workunit.client.0.smithi142.stdout:3/989: fsync d6/d15/d30/d37/d6c/dcd/f93 0 2024-04-20T21:58:47.556 INFO:tasks.workunit.client.0.smithi142.stdout:3/990: dread - d6/d32/d39/d69/d91/d14b/f135 zero size 2024-04-20T21:58:47.557 INFO:tasks.workunit.client.0.smithi142.stdout:8/882: rename d0/d17/d35 to d0/d132 0 2024-04-20T21:58:47.561 INFO:tasks.workunit.client.0.smithi142.stdout:8/883: stat d0/d1c/d44/f123 0 2024-04-20T21:58:47.563 INFO:tasks.workunit.client.0.smithi142.stdout:1/930: rename d2/dd/d17/d1b/d22/c8a to d2/dd/d1c/d60/dda/c142 0 2024-04-20T21:58:47.564 INFO:tasks.workunit.client.0.smithi142.stdout:6/890: dwrite d1/d2f/d35/d5b/d3e/dc5/ddb/f112 [0,4194304] 0 2024-04-20T21:58:47.564 INFO:tasks.workunit.client.0.smithi142.stdout:3/991: symlink d6/d32/d39/d69/d91/d14b/d4d/d59/l162 0 2024-04-20T21:58:47.570 INFO:tasks.workunit.client.0.smithi142.stdout:1/931: creat d2/dd/d1c/d60/dce/f143 x:0 0 0 2024-04-20T21:58:47.572 INFO:tasks.workunit.client.0.smithi142.stdout:6/891: fdatasync d1/f8c 0 2024-04-20T21:58:47.573 INFO:tasks.workunit.client.0.smithi142.stdout:1/932: readlink d2/dd/d1c/d60/dce/d7c/de7/l140 0 2024-04-20T21:58:47.576 INFO:tasks.workunit.client.0.smithi142.stdout:8/884: dread d0/d29/df3/f124 [0,4194304] 0 2024-04-20T21:58:47.578 INFO:tasks.workunit.client.0.smithi142.stdout:3/992: link d6/d15/da4/c132 d6/d32/d39/d69/de0/d11d/c163 0 2024-04-20T21:58:47.579 INFO:tasks.workunit.client.0.smithi142.stdout:1/933: dread d2/dd/d17/d3b/d50/d62/f123 [0,4194304] 0 2024-04-20T21:58:47.579 INFO:tasks.workunit.client.0.smithi142.stdout:8/885: creat d0/da7/f133 x:0 0 0 2024-04-20T21:58:47.586 INFO:tasks.workunit.client.0.smithi142.stdout:6/892: write d1/dd1/d8f/fd5 [1527430,96425] 0 2024-04-20T21:58:47.590 INFO:tasks.workunit.client.0.smithi142.stdout:3/993: rename d6/d32/d39/d69/d91/d14b/d4d/d59/df6/faf to d6/d15/d47/d83/dc9/f164 0 2024-04-20T21:58:47.591 INFO:tasks.workunit.client.0.smithi142.stdout:6/893: write d1/d5/d3a/f119 [211655,27351] 0 2024-04-20T21:58:47.599 INFO:tasks.workunit.client.0.smithi142.stdout:6/894: rename d1/d5/d8b/da6/f12d to d1/d2f/d35/d5b/d39/dcd/d104/f140 0 2024-04-20T21:58:47.599 INFO:tasks.workunit.client.1.smithi164.stderr:++ readlink -f fsstress 2024-04-20T21:58:47.604 INFO:tasks.workunit.client.1.smithi164.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-20T21:58:47.604 INFO:tasks.workunit.client.1.smithi164.stderr:+ popd 2024-04-20T21:58:47.606 INFO:tasks.workunit.client.1.smithi164.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-20T21:58:47.606 INFO:tasks.workunit.client.1.smithi164.stderr:+ popd 2024-04-20T21:58:47.607 INFO:tasks.workunit.client.0.smithi142.stdout:8/886: dread d0/d1c/d44/d89/d45/fc0 [0,4194304] 0 2024-04-20T21:58:47.607 INFO:tasks.workunit.client.0.smithi142.stdout:1/934: dread d2/dd/d17/d1b/d22/d13/f39 [0,4194304] 0 2024-04-20T21:58:47.607 INFO:tasks.workunit.client.1.smithi164.stdout:~/cephtest/mnt.1/client.1/tmp 2024-04-20T21:58:47.608 INFO:tasks.workunit.client.1.smithi164.stderr:++ mktemp -d -p . 2024-04-20T21:58:47.610 INFO:tasks.workunit.client.0.smithi142.stdout:1/935: dread - d2/dd/d1c/d60/dce/d7c/de7/f10d zero size 2024-04-20T21:58:47.610 INFO:tasks.workunit.client.0.smithi142.stdout:3/994: write d6/d32/d39/d69/d91/d14b/d4d/d59/df6/fc2 [715137,40812] 0 2024-04-20T21:58:47.611 INFO:tasks.workunit.client.0.smithi142.stdout:6/895: rmdir d1 39 2024-04-20T21:58:47.613 INFO:tasks.workunit.client.0.smithi142.stdout:8/887: chown d0/d17/f6d 39047223 1 2024-04-20T21:58:47.613 INFO:tasks.workunit.client.1.smithi164.stderr:+ T=./tmp.lgAE8GKzHj 2024-04-20T21:58:47.613 INFO:tasks.workunit.client.1.smithi164.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.lgAE8GKzHj -l 1 -n 1000 -p 10 -v 2024-04-20T21:58:47.616 INFO:tasks.workunit.client.0.smithi142.stdout:3/995: creat d6/d15/d47/d83/dc9/f165 x:0 0 0 2024-04-20T21:58:47.618 INFO:tasks.workunit.client.0.smithi142.stdout:6/896: symlink d1/d2f/d35/d5b/d63/d4b/d61/l141 0 2024-04-20T21:58:47.619 INFO:tasks.workunit.client.0.smithi142.stdout:3/996: read - d6/d15/d47/f103 zero size 2024-04-20T21:58:47.621 INFO:tasks.workunit.client.0.smithi142.stdout:1/936: truncate d2/dd/d17/d1b/f3c 2997437 0 2024-04-20T21:58:47.623 INFO:tasks.workunit.client.1.smithi164.stdout:seed = 1714270513 2024-04-20T21:58:47.624 INFO:tasks.workunit.client.0.smithi142.stdout:3/997: fsync d6/d15/d30/d37/ff7 0 2024-04-20T21:58:47.625 INFO:tasks.workunit.client.0.smithi142.stdout:1/937: stat d2/d4e/fc8 0 2024-04-20T21:58:47.629 INFO:tasks.workunit.client.0.smithi142.stdout:8/888: dwrite d0/d42/f118 [0,4194304] 0 2024-04-20T21:58:47.633 INFO:tasks.workunit.client.1.smithi164.stdout:0/0: write - no filename 2024-04-20T21:58:47.633 INFO:tasks.workunit.client.1.smithi164.stdout:0/1: dread - no filename 2024-04-20T21:58:47.633 INFO:tasks.workunit.client.1.smithi164.stdout:0/2: truncate - no filename 2024-04-20T21:58:47.633 INFO:tasks.workunit.client.1.smithi164.stdout:0/3: dread - no filename 2024-04-20T21:58:47.634 INFO:tasks.workunit.client.0.smithi142.stdout:6/897: write d1/d2f/d35/d5b/d63/fd3 [806507,15333] 0 2024-04-20T21:58:47.640 INFO:tasks.workunit.client.1.smithi164.stdout:2/0: chown . 6 1 2024-04-20T21:58:47.640 INFO:tasks.workunit.client.1.smithi164.stdout:2/1: chown . 22009 1 2024-04-20T21:58:47.640 INFO:tasks.workunit.client.0.smithi142.stdout:8/889: rename d0/d1c/d44/l5c to d0/d1c/dd1/l134 0 2024-04-20T21:58:47.641 INFO:tasks.workunit.client.1.smithi164.stdout:0/4: mknod c0 0 2024-04-20T21:58:47.642 INFO:tasks.workunit.client.0.smithi142.stdout:1/938: creat d2/dd/d17/d3b/d50/f144 x:0 0 0 2024-04-20T21:58:47.644 INFO:tasks.workunit.client.1.smithi164.stdout:1/0: write - no filename 2024-04-20T21:58:47.645 INFO:tasks.workunit.client.1.smithi164.stdout:1/1: rmdir - no directory 2024-04-20T21:58:47.645 INFO:tasks.workunit.client.1.smithi164.stdout:1/2: stat - no entries 2024-04-20T21:58:47.645 INFO:tasks.workunit.client.1.smithi164.stdout:0/5: mkdir d1 0 2024-04-20T21:58:47.645 INFO:tasks.workunit.client.0.smithi142.stdout:3/998: getdents d6/d15/d30 0 2024-04-20T21:58:47.646 INFO:tasks.workunit.client.1.smithi164.stdout:2/2: mknod c0 0 2024-04-20T21:58:47.646 INFO:tasks.workunit.client.1.smithi164.stdout:2/3: readlink - no filename 2024-04-20T21:58:47.646 INFO:tasks.workunit.client.1.smithi164.stdout:0/6: chown c0 439529107 1 2024-04-20T21:58:47.648 INFO:tasks.workunit.client.1.smithi164.stdout:3/0: write - no filename 2024-04-20T21:58:47.648 INFO:tasks.workunit.client.1.smithi164.stdout:3/1: rename - no filename 2024-04-20T21:58:47.651 INFO:tasks.workunit.client.1.smithi164.stdout:1/3: creat f0 x:0 0 0 2024-04-20T21:58:47.653 INFO:tasks.workunit.client.1.smithi164.stdout:4/0: read - no filename 2024-04-20T21:58:47.653 INFO:tasks.workunit.client.1.smithi164.stdout:4/1: fsync - no filename 2024-04-20T21:58:47.653 INFO:tasks.workunit.client.0.smithi142.stdout:6/898: link d1/d2f/d35/d5b/d63/d4b/d61/lbd d1/dd1/l142 0 2024-04-20T21:58:47.654 INFO:tasks.workunit.client.1.smithi164.stdout:0/7: symlink d1/l2 0 2024-04-20T21:58:47.655 INFO:tasks.workunit.client.0.smithi142.stdout:8/890: getdents d0/d1c/d44/d89/d45/d59 0 2024-04-20T21:58:47.656 INFO:tasks.workunit.client.1.smithi164.stdout:1/4: creat f1 x:0 0 0 2024-04-20T21:58:47.657 INFO:tasks.workunit.client.0.smithi142.stdout:3/999: link d6/d15/d10e/c150 d6/d15/d47/d83/d13d/d122/d159/c166 0 2024-04-20T21:58:47.657 INFO:tasks.workunit.client.0.smithi142.stdout:6/899: write d1/d2f/d35/d5b/d63/d4b/f13d [451019,12063] 0 2024-04-20T21:58:47.658 INFO:tasks.workunit.client.0.smithi142.stdout:1/939: dwrite d2/dd/d1c/d60/fa2 [0,4194304] 0 2024-04-20T21:58:47.658 INFO:tasks.workunit.client.1.smithi164.stdout:2/4: link c0 c1 0 2024-04-20T21:58:47.660 INFO:tasks.workunit.client.1.smithi164.stdout:5/0: truncate - no filename 2024-04-20T21:58:47.660 INFO:tasks.workunit.client.1.smithi164.stdout:5/1: write - no filename 2024-04-20T21:58:47.660 INFO:tasks.workunit.client.1.smithi164.stdout:5/2: chown . 529 1 2024-04-20T21:58:47.661 INFO:tasks.workunit.client.1.smithi164.stdout:5/3: read - no filename 2024-04-20T21:58:47.661 INFO:tasks.workunit.client.1.smithi164.stdout:5/4: write - no filename 2024-04-20T21:58:47.661 INFO:tasks.workunit.client.1.smithi164.stdout:5/5: dwrite - no filename 2024-04-20T21:58:47.661 INFO:tasks.workunit.client.1.smithi164.stdout:0/8: mkdir d1/d3 0 2024-04-20T21:58:47.661 INFO:tasks.workunit.client.1.smithi164.stdout:0/9: fdatasync - no filename 2024-04-20T21:58:47.661 INFO:tasks.workunit.client.1.smithi164.stdout:0/10: write - no filename 2024-04-20T21:58:47.661 INFO:tasks.workunit.client.0.smithi142.stdout:6/900: mknod d1/d1b/c143 0 2024-04-20T21:58:47.662 INFO:tasks.workunit.client.1.smithi164.stdout:3/2: creat f0 x:0 0 0 2024-04-20T21:58:47.662 INFO:tasks.workunit.client.0.smithi142.stdout:1/940: fdatasync d2/f7 0 2024-04-20T21:58:47.663 INFO:tasks.workunit.client.1.smithi164.stdout:1/5: symlink l2 0 2024-04-20T21:58:47.663 INFO:tasks.workunit.client.1.smithi164.stdout:4/2: symlink l0 0 2024-04-20T21:58:47.666 INFO:tasks.workunit.client.0.smithi142.stdout:1/941: creat d2/dd/d1c/d60/deb/f145 x:0 0 0 2024-04-20T21:58:47.668 INFO:tasks.workunit.client.1.smithi164.stdout:6/0: link - no file 2024-04-20T21:58:47.668 INFO:tasks.workunit.client.1.smithi164.stdout:6/1: dwrite - no filename 2024-04-20T21:58:47.668 INFO:tasks.workunit.client.1.smithi164.stdout:6/2: dread - no filename 2024-04-20T21:58:47.668 INFO:tasks.workunit.client.1.smithi164.stdout:5/6: mknod c0 0 2024-04-20T21:58:47.668 INFO:tasks.workunit.client.0.smithi142.stdout:6/901: creat d1/d2f/d35/d48/f144 x:0 0 0 2024-04-20T21:58:47.669 INFO:tasks.workunit.client.0.smithi142.stdout:6/902: rmdir d1/d5/d8b 39 2024-04-20T21:58:47.672 INFO:tasks.workunit.client.0.smithi142.stdout:1/942: rename d2/dd/d17/d1b/f71 to d2/dd/d1c/d60/dce/d7c/ddd/f146 0 2024-04-20T21:58:47.674 INFO:tasks.workunit.client.1.smithi164.stdout:7/0: write - no filename 2024-04-20T21:58:47.674 INFO:tasks.workunit.client.1.smithi164.stdout:7/1: dwrite - no filename 2024-04-20T21:58:47.674 INFO:tasks.workunit.client.1.smithi164.stdout:7/2: truncate - no filename 2024-04-20T21:58:47.674 INFO:tasks.workunit.client.1.smithi164.stdout:7/3: dread - no filename 2024-04-20T21:58:47.674 INFO:tasks.workunit.client.1.smithi164.stdout:7/4: dwrite - no filename 2024-04-20T21:58:47.674 INFO:tasks.workunit.client.1.smithi164.stdout:7/5: rename - no filename 2024-04-20T21:58:47.674 INFO:tasks.workunit.client.1.smithi164.stdout:7/6: dread - no filename 2024-04-20T21:58:47.675 INFO:tasks.workunit.client.1.smithi164.stdout:5/7: symlink l1 0 2024-04-20T21:58:47.675 INFO:tasks.workunit.client.1.smithi164.stdout:5/8: read - no filename 2024-04-20T21:58:47.676 INFO:tasks.workunit.client.1.smithi164.stdout:1/6: truncate f0 750106 0 2024-04-20T21:58:47.676 INFO:tasks.workunit.client.1.smithi164.stdout:4/3: rename l0 to l1 0 2024-04-20T21:58:47.678 INFO:tasks.workunit.client.0.smithi142.stdout:1/943: write d2/d4e/d7e/fbd [230208,24471] 0 2024-04-20T21:58:47.679 INFO:tasks.workunit.client.1.smithi164.stdout:0/11: getdents d1/d3 0 2024-04-20T21:58:47.680 INFO:tasks.workunit.client.1.smithi164.stdout:0/12: dwrite - no filename 2024-04-20T21:58:47.680 INFO:tasks.workunit.client.1.smithi164.stdout:0/13: dread - no filename 2024-04-20T21:58:47.680 INFO:tasks.workunit.client.1.smithi164.stdout:0/14: dread - no filename 2024-04-20T21:58:47.680 INFO:tasks.workunit.client.1.smithi164.stdout:0/15: write - no filename 2024-04-20T21:58:47.680 INFO:tasks.workunit.client.1.smithi164.stdout:0/16: dwrite - no filename 2024-04-20T21:58:47.680 INFO:tasks.workunit.client.0.smithi142.stdout:6/903: creat d1/d2f/d35/d106/f145 x:0 0 0 2024-04-20T21:58:47.680 INFO:tasks.workunit.client.1.smithi164.stdout:6/3: getdents . 0 2024-04-20T21:58:47.682 INFO:tasks.workunit.client.0.smithi142.stdout:6/904: chown d1/d2f/d35/d48/fd7 0 1 2024-04-20T21:58:47.682 INFO:tasks.workunit.client.0.smithi142.stdout:1/944: truncate d2/dd/d17/d1b/d22/d55/fb5 4388254 0 2024-04-20T21:58:47.683 INFO:tasks.workunit.client.1.smithi164.stdout:5/9: creat f2 x:0 0 0 2024-04-20T21:58:47.684 INFO:tasks.workunit.client.0.smithi142.stdout:1/945: chown d2/d4e/f64 18202872 1 2024-04-20T21:58:47.690 INFO:tasks.workunit.client.1.smithi164.stdout:0/17: rename d1/d3 to d1/d4 0 2024-04-20T21:58:47.690 INFO:tasks.workunit.client.1.smithi164.stdout:0/18: fsync - no filename 2024-04-20T21:58:47.690 INFO:tasks.workunit.client.1.smithi164.stdout:0/19: dwrite - no filename 2024-04-20T21:58:47.690 INFO:tasks.workunit.client.1.smithi164.stdout:0/20: write - no filename 2024-04-20T21:58:47.690 INFO:tasks.workunit.client.1.smithi164.stdout:0/21: dwrite - no filename 2024-04-20T21:58:47.690 INFO:tasks.workunit.client.1.smithi164.stdout:0/22: write - no filename 2024-04-20T21:58:47.690 INFO:tasks.workunit.client.1.smithi164.stdout:0/23: write - no filename 2024-04-20T21:58:47.691 INFO:tasks.workunit.client.1.smithi164.stdout:6/4: mkdir d0 0 2024-04-20T21:58:47.691 INFO:tasks.workunit.client.1.smithi164.stdout:6/5: dread - no filename 2024-04-20T21:58:47.692 INFO:tasks.workunit.client.1.smithi164.stdout:6/6: fsync - no filename 2024-04-20T21:58:47.692 INFO:tasks.workunit.client.1.smithi164.stdout:6/7: link - no file 2024-04-20T21:58:47.692 INFO:tasks.workunit.client.1.smithi164.stdout:6/8: readlink - no filename 2024-04-20T21:58:47.692 INFO:tasks.workunit.client.1.smithi164.stdout:6/9: read - no filename 2024-04-20T21:58:47.693 INFO:tasks.workunit.client.0.smithi142.stdout:1/946: getdents d2/dd/d17/d3b/d50/d12d 0 2024-04-20T21:58:47.694 INFO:tasks.workunit.client.1.smithi164.stdout:8/0: mkdir d0 0 2024-04-20T21:58:47.695 INFO:tasks.workunit.client.0.smithi142.stdout:1/947: dread - d2/dd/d17/d1b/d22/d20/dc3/f12c zero size 2024-04-20T21:58:47.697 INFO:tasks.workunit.client.1.smithi164.stdout:0/24: unlink d1/l2 0 2024-04-20T21:58:47.699 INFO:tasks.workunit.client.1.smithi164.stdout:9/0: mknod c0 0 2024-04-20T21:58:47.700 INFO:tasks.workunit.client.1.smithi164.stdout:3/3: dwrite f0 [0,4194304] 0 2024-04-20T21:58:47.700 INFO:tasks.workunit.client.1.smithi164.stdout:9/1: stat c0 0 2024-04-20T21:58:47.701 INFO:tasks.workunit.client.0.smithi142.stdout:1/948: link d2/dd/d17/ffd d2/de5/f147 0 2024-04-20T21:58:47.703 INFO:tasks.workunit.client.1.smithi164.stdout:6/10: symlink d0/l1 0 2024-04-20T21:58:47.705 INFO:tasks.workunit.client.1.smithi164.stdout:8/1: mknod d0/c1 0 2024-04-20T21:58:47.705 INFO:tasks.workunit.client.1.smithi164.stdout:6/11: stat d0/l1 0 2024-04-20T21:58:47.705 INFO:tasks.workunit.client.1.smithi164.stdout:0/25: symlink d1/l5 0 2024-04-20T21:58:47.706 INFO:tasks.workunit.client.1.smithi164.stdout:8/2: chown d0 49 1 2024-04-20T21:58:47.708 INFO:tasks.workunit.client.0.smithi142.stdout:1/949: creat d2/dd/d17/f148 x:0 0 0 2024-04-20T21:58:47.709 INFO:tasks.workunit.client.1.smithi164.stdout:1/7: dwrite f1 [0,4194304] 0 2024-04-20T21:58:47.710 INFO:tasks.workunit.client.1.smithi164.stdout:0/26: symlink d1/l6 0 2024-04-20T21:58:47.713 INFO:tasks.workunit.client.1.smithi164.stdout:8/3: mkdir d0/d2 0 2024-04-20T21:58:47.714 INFO:tasks.workunit.client.1.smithi164.stdout:3/4: write f0 [4943175,112951] 0 2024-04-20T21:58:47.715 INFO:tasks.workunit.client.1.smithi164.stdout:0/27: rename d1 to d1/d4/d7 22 2024-04-20T21:58:47.715 INFO:tasks.workunit.client.1.smithi164.stdout:0/28: dread - no filename 2024-04-20T21:58:47.716 INFO:tasks.workunit.client.1.smithi164.stdout:0/29: dread - no filename 2024-04-20T21:58:47.716 INFO:tasks.workunit.client.0.smithi142.stdout:6/905: dwrite d1/d2f/d35/d5b/d3e/f74 [0,4194304] 0 2024-04-20T21:58:47.717 INFO:tasks.workunit.client.1.smithi164.stdout:0/30: chown d1 412255 1 2024-04-20T21:58:47.718 INFO:tasks.workunit.client.1.smithi164.stdout:0/31: stat d1/d4 0 2024-04-20T21:58:47.722 INFO:tasks.workunit.client.1.smithi164.stdout:8/4: creat d0/f3 x:0 0 0 2024-04-20T21:58:47.725 INFO:tasks.workunit.client.1.smithi164.stdout:8/5: dread - d0/f3 zero size 2024-04-20T21:58:47.725 INFO:tasks.workunit.client.1.smithi164.stdout:6/12: link d0/l1 d0/l2 0 2024-04-20T21:58:47.732 INFO:tasks.workunit.client.1.smithi164.stdout:0/32: creat d1/f8 x:0 0 0 2024-04-20T21:58:47.733 INFO:tasks.workunit.client.1.smithi164.stdout:9/2: getdents . 0 2024-04-20T21:58:47.736 INFO:tasks.workunit.client.1.smithi164.stdout:6/13: mkdir d0/d3 0 2024-04-20T21:58:47.736 INFO:tasks.workunit.client.1.smithi164.stdout:6/14: dread - no filename 2024-04-20T21:58:47.736 INFO:tasks.workunit.client.1.smithi164.stdout:6/15: dread - no filename 2024-04-20T21:58:47.737 INFO:tasks.workunit.client.1.smithi164.stdout:6/16: dwrite - no filename 2024-04-20T21:58:47.737 INFO:tasks.workunit.client.1.smithi164.stdout:9/3: chown c0 1 1 2024-04-20T21:58:47.737 INFO:tasks.workunit.client.1.smithi164.stdout:9/4: write - no filename 2024-04-20T21:58:47.737 INFO:tasks.workunit.client.1.smithi164.stdout:9/5: write - no filename 2024-04-20T21:58:47.737 INFO:tasks.workunit.client.1.smithi164.stdout:8/6: creat d0/d2/f4 x:0 0 0 2024-04-20T21:58:47.737 INFO:tasks.workunit.client.1.smithi164.stdout:0/33: creat d1/f9 x:0 0 0 2024-04-20T21:58:47.738 INFO:tasks.workunit.client.1.smithi164.stdout:1/8: dwrite f0 [0,4194304] 0 2024-04-20T21:58:47.740 INFO:tasks.workunit.client.1.smithi164.stdout:0/34: write d1/f9 [316585,41612] 0 2024-04-20T21:58:47.741 INFO:tasks.workunit.client.1.smithi164.stdout:6/17: chown d0/l2 2071414 1 2024-04-20T21:58:47.741 INFO:tasks.workunit.client.1.smithi164.stdout:6/18: fdatasync - no filename 2024-04-20T21:58:47.741 INFO:tasks.workunit.client.1.smithi164.stdout:8/7: creat d0/d2/f5 x:0 0 0 2024-04-20T21:58:47.741 INFO:tasks.workunit.client.1.smithi164.stdout:0/35: dread - d1/f8 zero size 2024-04-20T21:58:47.743 INFO:tasks.workunit.client.1.smithi164.stdout:1/9: mknod c3 0 2024-04-20T21:58:47.744 INFO:tasks.workunit.client.1.smithi164.stdout:1/10: readlink l2 0 2024-04-20T21:58:47.745 INFO:tasks.workunit.client.1.smithi164.stdout:9/6: link c0 c1 0 2024-04-20T21:58:47.745 INFO:tasks.workunit.client.1.smithi164.stdout:9/7: fdatasync - no filename 2024-04-20T21:58:47.745 INFO:tasks.workunit.client.1.smithi164.stdout:9/8: readlink - no filename 2024-04-20T21:58:47.745 INFO:tasks.workunit.client.1.smithi164.stdout:3/5: fsync f0 0 2024-04-20T21:58:47.746 INFO:tasks.workunit.client.1.smithi164.stdout:1/11: stat l2 0 2024-04-20T21:58:47.746 INFO:tasks.workunit.client.1.smithi164.stdout:8/8: creat d0/d2/f6 x:0 0 0 2024-04-20T21:58:47.747 INFO:tasks.workunit.client.0.smithi142.stdout:6/906: dwrite d1/d2f/d35/d5b/d63/d4b/d61/db7/fc3 [0,4194304] 0 2024-04-20T21:58:47.748 INFO:tasks.workunit.client.1.smithi164.stdout:9/9: mknod c2 0 2024-04-20T21:58:47.748 INFO:tasks.workunit.client.1.smithi164.stdout:9/10: dread - no filename 2024-04-20T21:58:47.748 INFO:tasks.workunit.client.1.smithi164.stdout:0/36: dread - d1/f8 zero size 2024-04-20T21:58:47.749 INFO:tasks.workunit.client.1.smithi164.stdout:3/6: mknod c1 0 2024-04-20T21:58:47.750 INFO:tasks.workunit.client.1.smithi164.stdout:0/37: stat c0 0 2024-04-20T21:58:47.751 INFO:tasks.workunit.client.1.smithi164.stdout:9/11: mkdir d3 0 2024-04-20T21:58:47.751 INFO:tasks.workunit.client.1.smithi164.stdout:9/12: dwrite - no filename 2024-04-20T21:58:47.751 INFO:tasks.workunit.client.1.smithi164.stdout:9/13: write - no filename 2024-04-20T21:58:47.752 INFO:tasks.workunit.client.1.smithi164.stdout:8/9: creat d0/d2/f7 x:0 0 0 2024-04-20T21:58:47.753 INFO:tasks.workunit.client.1.smithi164.stdout:3/7: unlink c1 0 2024-04-20T21:58:47.754 INFO:tasks.workunit.client.1.smithi164.stdout:0/38: mkdir d1/d4/da 0 2024-04-20T21:58:47.755 INFO:tasks.workunit.client.1.smithi164.stdout:8/10: mkdir d0/d8 0 2024-04-20T21:58:47.756 INFO:tasks.workunit.client.1.smithi164.stdout:0/39: dread - d1/f8 zero size 2024-04-20T21:58:47.756 INFO:tasks.workunit.client.1.smithi164.stdout:6/19: getdents d0 0 2024-04-20T21:58:47.756 INFO:tasks.workunit.client.1.smithi164.stdout:6/20: read - no filename 2024-04-20T21:58:47.756 INFO:tasks.workunit.client.1.smithi164.stdout:6/21: write - no filename 2024-04-20T21:58:47.756 INFO:tasks.workunit.client.1.smithi164.stdout:6/22: write - no filename 2024-04-20T21:58:47.756 INFO:tasks.workunit.client.1.smithi164.stdout:6/23: dread - no filename 2024-04-20T21:58:47.756 INFO:tasks.workunit.client.1.smithi164.stdout:6/24: truncate - no filename 2024-04-20T21:58:47.756 INFO:tasks.workunit.client.1.smithi164.stdout:6/25: dread - no filename 2024-04-20T21:58:47.756 INFO:tasks.workunit.client.1.smithi164.stdout:6/26: dread - no filename 2024-04-20T21:58:47.757 INFO:tasks.workunit.client.1.smithi164.stdout:6/27: dread - no filename 2024-04-20T21:58:47.761 INFO:tasks.workunit.client.1.smithi164.stdout:9/14: stat c1 0 2024-04-20T21:58:47.761 INFO:tasks.workunit.client.1.smithi164.stdout:6/28: readlink d0/l2 0 2024-04-20T21:58:47.761 INFO:tasks.workunit.client.1.smithi164.stdout:6/29: dread - no filename 2024-04-20T21:58:47.761 INFO:tasks.workunit.client.1.smithi164.stdout:6/30: truncate - no filename 2024-04-20T21:58:47.763 INFO:tasks.workunit.client.1.smithi164.stdout:3/8: link f0 f2 0 2024-04-20T21:58:47.764 INFO:tasks.workunit.client.1.smithi164.stdout:0/40: unlink c0 0 2024-04-20T21:58:47.766 INFO:tasks.workunit.client.1.smithi164.stdout:6/31: rmdir d0 39 2024-04-20T21:58:47.766 INFO:tasks.workunit.client.1.smithi164.stdout:6/32: truncate - no filename 2024-04-20T21:58:47.766 INFO:tasks.workunit.client.1.smithi164.stdout:6/33: write - no filename 2024-04-20T21:58:47.770 INFO:tasks.workunit.client.1.smithi164.stdout:8/11: rename d0/d2/f7 to d0/d8/f9 0 2024-04-20T21:58:47.770 INFO:tasks.workunit.client.1.smithi164.stdout:0/41: creat d1/fb x:0 0 0 2024-04-20T21:58:47.770 INFO:tasks.workunit.client.1.smithi164.stdout:1/12: dwrite f0 [0,4194304] 0 2024-04-20T21:58:47.772 INFO:tasks.workunit.client.0.smithi142.stdout:6/907: dread d1/d2f/d35/f47 [0,4194304] 0 2024-04-20T21:58:47.773 INFO:tasks.workunit.client.1.smithi164.stdout:3/9: write f0 [3531464,66506] 0 2024-04-20T21:58:47.774 INFO:tasks.workunit.client.1.smithi164.stdout:6/34: chown d0/l1 176930 1 2024-04-20T21:58:47.774 INFO:tasks.workunit.client.1.smithi164.stdout:6/35: write - no filename 2024-04-20T21:58:47.774 INFO:tasks.workunit.client.1.smithi164.stdout:6/36: dread - no filename 2024-04-20T21:58:47.775 INFO:tasks.workunit.client.1.smithi164.stdout:0/42: write d1/f9 [1048550,92525] 0 2024-04-20T21:58:47.776 INFO:tasks.workunit.client.0.smithi142.stdout:6/908: creat d1/d2f/d35/d5b/d39/f146 x:0 0 0 2024-04-20T21:58:47.778 INFO:tasks.workunit.client.1.smithi164.stdout:6/37: readlink d0/l1 0 2024-04-20T21:58:47.779 INFO:tasks.workunit.client.1.smithi164.stdout:9/15: link c0 d3/c4 0 2024-04-20T21:58:47.779 INFO:tasks.workunit.client.1.smithi164.stdout:9/16: write - no filename 2024-04-20T21:58:47.779 INFO:tasks.workunit.client.1.smithi164.stdout:9/17: write - no filename 2024-04-20T21:58:47.779 INFO:tasks.workunit.client.1.smithi164.stdout:9/18: fsync - no filename 2024-04-20T21:58:47.782 INFO:tasks.workunit.client.0.smithi142.stdout:6/909: rename d1/d1b/f1e to d1/d2f/d35/d5b/d63/d34/f147 0 2024-04-20T21:58:47.784 INFO:tasks.workunit.client.0.smithi142.stdout:6/910: mknod d1/d9e/c148 0 2024-04-20T21:58:47.784 INFO:tasks.workunit.client.1.smithi164.stdout:6/38: creat d0/f4 x:0 0 0 2024-04-20T21:58:47.786 INFO:tasks.workunit.client.1.smithi164.stdout:9/19: unlink c0 0 2024-04-20T21:58:47.786 INFO:tasks.workunit.client.1.smithi164.stdout:9/20: dread - no filename 2024-04-20T21:58:47.787 INFO:tasks.workunit.client.0.smithi142.stdout:6/911: symlink d1/d2f/d35/d5b/d39/dcd/d104/l149 0 2024-04-20T21:58:47.788 INFO:tasks.workunit.client.1.smithi164.stdout:6/39: dread - d0/f4 zero size 2024-04-20T21:58:47.789 INFO:tasks.workunit.client.0.smithi142.stdout:6/912: mknod d1/d2f/d35/d48/d102/c14a 0 2024-04-20T21:58:47.791 INFO:tasks.workunit.client.0.smithi142.stdout:6/913: creat d1/d5/d3a/f14b x:0 0 0 2024-04-20T21:58:47.792 INFO:tasks.workunit.client.1.smithi164.stdout:6/40: chown d0/l1 116674801 1 2024-04-20T21:58:47.794 INFO:tasks.workunit.client.0.smithi142.stdout:6/914: unlink d1/d1b/d12e/l13e 0 2024-04-20T21:58:47.795 INFO:tasks.workunit.client.1.smithi164.stdout:1/13: dwrite f0 [0,4194304] 0 2024-04-20T21:58:47.797 INFO:tasks.workunit.client.0.smithi142.stdout:6/915: mkdir d1/d5/d8b/d14c 0 2024-04-20T21:58:47.799 INFO:tasks.workunit.client.1.smithi164.stdout:6/41: symlink d0/d3/l5 0 2024-04-20T21:58:47.802 INFO:tasks.workunit.client.1.smithi164.stdout:8/12: dwrite d0/d8/f9 [0,4194304] 0 2024-04-20T21:58:47.802 INFO:tasks.workunit.client.0.smithi142.stdout:6/916: mkdir d1/d2f/d35/d48/d102/d14d 0 2024-04-20T21:58:47.802 INFO:tasks.workunit.client.1.smithi164.stdout:3/10: dwrite f0 [0,4194304] 0 2024-04-20T21:58:47.803 INFO:tasks.workunit.client.1.smithi164.stdout:6/42: write d0/f4 [754446,114605] 0 2024-04-20T21:58:47.806 INFO:tasks.workunit.client.1.smithi164.stdout:6/43: stat d0/l2 0 2024-04-20T21:58:47.806 INFO:tasks.workunit.client.0.smithi142.stdout:6/917: creat d1/d2f/d35/d5b/d39/dcd/f14e x:0 0 0 2024-04-20T21:58:47.807 INFO:tasks.workunit.client.0.smithi142.stdout:6/918: fsync d1/dd1/d65/f125 0 2024-04-20T21:58:47.808 INFO:tasks.workunit.client.1.smithi164.stdout:6/44: readlink d0/l2 0 2024-04-20T21:58:47.809 INFO:tasks.workunit.client.1.smithi164.stdout:6/45: stat d0/d3 0 2024-04-20T21:58:47.811 INFO:tasks.workunit.client.1.smithi164.stdout:3/11: unlink f2 0 2024-04-20T21:58:47.811 INFO:tasks.workunit.client.0.smithi142.stdout:6/919: rmdir d1/d9e 39 2024-04-20T21:58:47.813 INFO:tasks.workunit.client.1.smithi164.stdout:8/13: creat d0/d2/fa x:0 0 0 2024-04-20T21:58:47.817 INFO:tasks.workunit.client.1.smithi164.stdout:6/46: rmdir d0/d3 39 2024-04-20T21:58:47.818 INFO:tasks.workunit.client.1.smithi164.stdout:3/12: creat f3 x:0 0 0 2024-04-20T21:58:47.819 INFO:tasks.workunit.client.1.smithi164.stdout:8/14: creat d0/fb x:0 0 0 2024-04-20T21:58:47.819 INFO:tasks.workunit.client.1.smithi164.stdout:1/14: dread f1 [0,4194304] 0 2024-04-20T21:58:47.821 INFO:tasks.workunit.client.0.smithi142.stdout:6/920: dread d1/d2f/d35/d5b/d63/d64/f8e [0,4194304] 0 2024-04-20T21:58:47.822 INFO:tasks.workunit.client.1.smithi164.stdout:8/15: write d0/d2/f4 [889913,129181] 0 2024-04-20T21:58:47.824 INFO:tasks.workunit.client.0.smithi142.stdout:6/921: write d1/dd1/d65/f10f [313602,104677] 0 2024-04-20T21:58:47.824 INFO:tasks.workunit.client.1.smithi164.stdout:3/13: chown f0 190433068 1 2024-04-20T21:58:47.825 INFO:tasks.workunit.client.1.smithi164.stdout:1/15: symlink l4 0 2024-04-20T21:58:47.825 INFO:tasks.workunit.client.1.smithi164.stdout:6/47: rmdir d0/d3 39 2024-04-20T21:58:47.839 INFO:tasks.workunit.client.0.smithi142.stdout:6/922: dwrite d1/d11/d71/f13b [0,4194304] 0 2024-04-20T21:58:47.841 INFO:tasks.workunit.client.0.smithi142.stdout:6/923: mknod d1/d11/c14f 0 2024-04-20T21:58:47.842 INFO:tasks.workunit.client.1.smithi164.stdout:1/16: dread f0 [0,4194304] 0 2024-04-20T21:58:47.850 INFO:tasks.workunit.client.0.smithi142.stdout:6/924: rename d1/d2f/d35/d5b/c1c to d1/c150 0 2024-04-20T21:58:47.850 INFO:tasks.workunit.client.1.smithi164.stdout:1/17: creat f5 x:0 0 0 2024-04-20T21:58:47.854 INFO:tasks.workunit.client.0.smithi142.stdout:6/925: creat d1/d2f/d35/d5b/d63/d4b/d61/db7/f151 x:0 0 0 2024-04-20T21:58:47.858 INFO:tasks.workunit.client.1.smithi164.stdout:3/14: dwrite f3 [0,4194304] 0 2024-04-20T21:58:47.859 INFO:tasks.workunit.client.1.smithi164.stdout:3/15: readlink - no filename 2024-04-20T21:58:47.861 INFO:tasks.workunit.client.0.smithi142.stdout:6/926: rename d1/d2f/d35/d5b/d3e/de0/d7e/fb3 to d1/d2f/d35/d5b/d3e/dc5/f152 0 2024-04-20T21:58:47.862 INFO:tasks.workunit.client.1.smithi164.stdout:8/16: dwrite d0/d2/fa [0,4194304] 0 2024-04-20T21:58:47.862 INFO:tasks.workunit.client.1.smithi164.stdout:6/48: dwrite d0/f4 [0,4194304] 0 2024-04-20T21:58:47.863 INFO:tasks.workunit.client.1.smithi164.stdout:1/18: write f0 [4668179,70831] 0 2024-04-20T21:58:47.866 INFO:tasks.workunit.client.1.smithi164.stdout:8/17: dread - d0/fb zero size 2024-04-20T21:58:47.871 INFO:tasks.workunit.client.0.smithi142.stdout:6/927: link d1/d11/c13 d1/d2f/d35/d5b/d3e/de0/c153 0 2024-04-20T21:58:47.874 INFO:tasks.workunit.client.1.smithi164.stdout:1/19: symlink l6 0 2024-04-20T21:58:47.875 INFO:tasks.workunit.client.0.smithi142.stdout:6/928: mkdir d1/dd1/d8f/d154 0 2024-04-20T21:58:47.876 INFO:tasks.workunit.client.1.smithi164.stdout:3/16: write f0 [1217437,98287] 0 2024-04-20T21:58:47.878 INFO:tasks.workunit.client.1.smithi164.stdout:1/20: read f0 [3628329,45152] 0 2024-04-20T21:58:47.878 INFO:tasks.workunit.client.0.smithi142.stdout:6/929: unlink d1/d2f/d35/d5b/d39/f146 0 2024-04-20T21:58:47.884 INFO:tasks.workunit.client.1.smithi164.stdout:8/18: dread d0/d2/f4 [0,4194304] 0 2024-04-20T21:58:47.887 INFO:tasks.workunit.client.0.smithi142.stdout:6/930: rename d1/d2f/d35/d5b/d63/d34/f147 to d1/d2f/d35/d5b/d3e/dc5/f155 0 2024-04-20T21:58:47.888 INFO:tasks.workunit.client.1.smithi164.stdout:6/49: dread d0/f4 [0,4194304] 0 2024-04-20T21:58:47.889 INFO:tasks.workunit.client.0.smithi142.stdout:6/931: chown d1/d2f/d35/d5b/d63/d4b/f13d 0 1 2024-04-20T21:58:47.890 INFO:tasks.workunit.client.1.smithi164.stdout:8/19: unlink d0/d8/f9 0 2024-04-20T21:58:47.891 INFO:tasks.workunit.client.0.smithi142.stdout:6/932: fdatasync d1/dd1/f7c 0 2024-04-20T21:58:47.891 INFO:tasks.workunit.client.1.smithi164.stdout:6/50: fsync d0/f4 0 2024-04-20T21:58:47.895 INFO:tasks.workunit.client.0.smithi142.stdout:6/933: creat d1/d2f/d35/d5b/d3e/de0/d7e/d9f/dc0/f156 x:0 0 0 2024-04-20T21:58:47.896 INFO:tasks.workunit.client.1.smithi164.stdout:8/20: truncate d0/d2/f6 489867 0 2024-04-20T21:58:47.898 INFO:tasks.workunit.client.1.smithi164.stdout:6/51: creat d0/f6 x:0 0 0 2024-04-20T21:58:47.902 INFO:tasks.workunit.client.1.smithi164.stdout:3/17: dwrite f0 [0,4194304] 0 2024-04-20T21:58:47.903 INFO:tasks.workunit.client.1.smithi164.stdout:8/21: dread d0/d2/f6 [0,4194304] 0 2024-04-20T21:58:47.905 INFO:tasks.workunit.client.1.smithi164.stdout:3/18: chown f0 17658724 1 2024-04-20T21:58:47.906 INFO:tasks.workunit.client.1.smithi164.stdout:6/52: symlink d0/l7 0 2024-04-20T21:58:47.908 INFO:tasks.workunit.client.1.smithi164.stdout:6/53: dread - d0/f6 zero size 2024-04-20T21:58:47.908 INFO:tasks.workunit.client.1.smithi164.stdout:1/21: dwrite f0 [0,4194304] 0 2024-04-20T21:58:47.908 INFO:tasks.workunit.client.1.smithi164.stdout:8/22: unlink d0/d2/f5 0 2024-04-20T21:58:47.910 INFO:tasks.workunit.client.1.smithi164.stdout:8/23: chown d0/d2/f6 303252 1 2024-04-20T21:58:47.919 INFO:tasks.workunit.client.0.smithi142.stdout:6/934: dwrite d1/dd1/d8f/fd2 [0,4194304] 0 2024-04-20T21:58:47.926 INFO:tasks.workunit.client.1.smithi164.stdout:3/19: dwrite f3 [0,4194304] 0 2024-04-20T21:58:47.928 INFO:tasks.workunit.client.1.smithi164.stdout:1/22: truncate f0 2962241 0 2024-04-20T21:58:47.929 INFO:tasks.workunit.client.1.smithi164.stdout:3/20: creat f4 x:0 0 0 2024-04-20T21:58:47.933 INFO:tasks.workunit.client.1.smithi164.stdout:1/23: creat f7 x:0 0 0 2024-04-20T21:58:47.935 INFO:tasks.workunit.client.1.smithi164.stdout:1/24: mknod c8 0 2024-04-20T21:58:47.949 INFO:tasks.workunit.client.1.smithi164.stdout:1/25: dread f1 [0,4194304] 0 2024-04-20T21:58:47.950 INFO:tasks.workunit.client.1.smithi164.stdout:3/21: dwrite f0 [0,4194304] 0 2024-04-20T21:58:47.965 INFO:tasks.workunit.client.1.smithi164.stdout:3/22: truncate f3 3235955 0 2024-04-20T21:58:47.965 INFO:tasks.workunit.client.1.smithi164.stdout:3/23: readlink - no filename 2024-04-20T21:58:47.971 INFO:tasks.workunit.client.1.smithi164.stdout:3/24: rename f3 to f5 0 2024-04-20T21:58:47.979 INFO:tasks.workunit.client.1.smithi164.stdout:3/25: unlink f5 0 2024-04-20T21:58:47.982 INFO:tasks.workunit.client.1.smithi164.stdout:3/26: rename f0 to f6 0 2024-04-20T21:58:47.983 INFO:tasks.workunit.client.1.smithi164.stdout:3/27: write f4 [274607,26670] 0 2024-04-20T21:58:47.992 INFO:tasks.workunit.client.1.smithi164.stdout:3/28: truncate f6 3327204 0 2024-04-20T21:58:47.992 INFO:tasks.workunit.client.1.smithi164.stdout:3/29: stat f4 0 2024-04-20T21:58:47.995 INFO:tasks.workunit.client.1.smithi164.stdout:3/30: fdatasync f6 0 2024-04-20T21:58:47.996 INFO:tasks.workunit.client.1.smithi164.stdout:3/31: chown f4 38 1 2024-04-20T21:58:48.048 INFO:tasks.workunit.client.0.smithi142.stdout:4/787: sync 2024-04-20T21:58:48.048 INFO:tasks.workunit.client.0.smithi142.stdout:5/934: sync 2024-04-20T21:58:48.062 INFO:tasks.workunit.client.0.smithi142.stdout:4/788: creat d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/ff2 x:0 0 0 2024-04-20T21:58:48.068 INFO:tasks.workunit.client.0.smithi142.stdout:4/789: fdatasync d1/d12/faa 0 2024-04-20T21:58:48.075 INFO:tasks.workunit.client.0.smithi142.stdout:4/790: stat d1/d12/da/d1c/d32/d3d/f85 0 2024-04-20T21:58:48.084 INFO:tasks.workunit.client.0.smithi142.stdout:4/791: creat d1/d6/d4a/db0/ff3 x:0 0 0 2024-04-20T21:58:48.094 INFO:tasks.workunit.client.0.smithi142.stdout:5/935: dread dc/d14/d26/ff6 [0,4194304] 0 2024-04-20T21:58:48.096 INFO:tasks.workunit.client.0.smithi142.stdout:4/792: link d1/d12/da/d37/f96 d1/d5b/ff4 0 2024-04-20T21:58:48.106 INFO:tasks.workunit.client.0.smithi142.stdout:5/936: mknod dc/d71/d5c/c13a 0 2024-04-20T21:58:48.119 INFO:tasks.workunit.client.0.smithi142.stdout:0/826: sync 2024-04-20T21:58:48.119 INFO:tasks.workunit.client.0.smithi142.stdout:8/891: sync 2024-04-20T21:58:48.120 INFO:tasks.workunit.client.0.smithi142.stdout:1/950: sync 2024-04-20T21:58:48.120 INFO:tasks.workunit.client.0.smithi142.stdout:6/935: sync 2024-04-20T21:58:48.120 INFO:tasks.workunit.client.0.smithi142.stdout:9/990: sync 2024-04-20T21:58:48.126 INFO:tasks.workunit.client.0.smithi142.stdout:9/991: stat d0/d2a/d8b/dc1/ld2 0 2024-04-20T21:58:48.130 INFO:tasks.workunit.client.0.smithi142.stdout:4/793: getdents d1/d12/da/d37/d89 0 2024-04-20T21:58:48.146 INFO:tasks.workunit.client.0.smithi142.stdout:1/951: dread - d2/dd/d17/d1b/d22/d55/fd8 zero size 2024-04-20T21:58:48.155 INFO:tasks.workunit.client.0.smithi142.stdout:5/937: write dc/d14/d21/d46/dc1/dd4/f122 [107923,95010] 0 2024-04-20T21:58:48.161 INFO:tasks.workunit.client.0.smithi142.stdout:0/827: rmdir d5/d1c/d3c/d85/d38/d62/d9a 39 2024-04-20T21:58:48.168 INFO:tasks.workunit.client.0.smithi142.stdout:8/892: symlink d0/d1c/d44/dad/db3/l135 0 2024-04-20T21:58:48.168 INFO:tasks.workunit.client.0.smithi142.stdout:6/936: mkdir d1/dd1/d8f/d154/d157 0 2024-04-20T21:58:48.172 INFO:tasks.workunit.client.0.smithi142.stdout:6/937: chown d1/d2f/d35/d5b/d39 49250083 1 2024-04-20T21:58:48.174 INFO:tasks.workunit.client.0.smithi142.stdout:5/938: rename dc/d14/d26/d102 to dc/d14/d25/db4/d136/d13b 0 2024-04-20T21:58:48.176 INFO:tasks.workunit.client.0.smithi142.stdout:6/938: chown d1/d2f/d35/d48/d102 1497749 1 2024-04-20T21:58:48.182 INFO:tasks.workunit.client.0.smithi142.stdout:1/952: dwrite d2/dd/d17/d3b/d50/f144 [0,4194304] 0 2024-04-20T21:58:48.192 INFO:tasks.workunit.client.0.smithi142.stdout:5/939: mknod dc/d14/d21/d7f/c13c 0 2024-04-20T21:58:48.194 INFO:tasks.workunit.client.0.smithi142.stdout:9/992: dwrite d0/d89/d95/d14f/f56 [0,4194304] 0 2024-04-20T21:58:48.196 INFO:tasks.workunit.client.0.smithi142.stdout:5/940: chown dc/d14/d25/d78 25 1 2024-04-20T21:58:48.200 INFO:tasks.workunit.client.0.smithi142.stdout:9/993: fdatasync d0/d3c/d4d/f75 0 2024-04-20T21:58:48.200 INFO:tasks.workunit.client.0.smithi142.stdout:4/794: dwrite d1/d12/faa [0,4194304] 0 2024-04-20T21:58:48.201 INFO:tasks.workunit.client.0.smithi142.stdout:8/893: rename d0/d1c/d44/c8e to d0/d1c/d44/d89/d45/ded/c136 0 2024-04-20T21:58:48.203 INFO:tasks.workunit.client.0.smithi142.stdout:5/941: write dc/d14/d21/d46/d2a/d3c/f126 [532465,81795] 0 2024-04-20T21:58:48.211 INFO:tasks.workunit.client.0.smithi142.stdout:9/994: symlink d0/d91/l154 0 2024-04-20T21:58:48.212 INFO:tasks.workunit.client.0.smithi142.stdout:6/939: dwrite d1/dd1/d8f/f130 [0,4194304] 0 2024-04-20T21:58:48.220 INFO:tasks.workunit.client.0.smithi142.stdout:0/828: getdents d5/d6d 0 2024-04-20T21:58:48.222 INFO:tasks.workunit.client.0.smithi142.stdout:6/940: truncate d1/d2f/d35/d5b/d63/d4b/f123 330527 0 2024-04-20T21:58:48.225 INFO:tasks.workunit.client.0.smithi142.stdout:5/942: mkdir dc/d14/d21/d46/d7d/d13d 0 2024-04-20T21:58:48.230 INFO:tasks.workunit.client.0.smithi142.stdout:8/894: mknod d0/d1c/d44/dad/db3/c137 0 2024-04-20T21:58:48.232 INFO:tasks.workunit.client.0.smithi142.stdout:5/943: truncate dc/d14/d21/d46/d2a/d3c/f61 5603008 0 2024-04-20T21:58:48.236 INFO:tasks.workunit.client.0.smithi142.stdout:4/795: mkdir d1/d6/d4a/d5a/d80/dd7/df5 0 2024-04-20T21:58:48.242 INFO:tasks.workunit.client.0.smithi142.stdout:1/953: dread d2/dd/d1c/d88/f101 [0,4194304] 0 2024-04-20T21:58:48.242 INFO:tasks.workunit.client.0.smithi142.stdout:6/941: mkdir d1/d5/d8b/d14c/d158 0 2024-04-20T21:58:48.245 INFO:tasks.workunit.client.0.smithi142.stdout:5/944: mkdir dc/d14/d25/d89/d139/d13e 0 2024-04-20T21:58:48.249 INFO:tasks.workunit.client.0.smithi142.stdout:4/796: rename d1/d5b/dd2 to d1/d12/da/d1c/d32/d3d/d2f/d52/d94/df6 0 2024-04-20T21:58:48.252 INFO:tasks.workunit.client.0.smithi142.stdout:6/942: chown d1/d2f/d35/d5b/d3e/ff6 4861068 1 2024-04-20T21:58:48.254 INFO:tasks.workunit.client.0.smithi142.stdout:1/954: mkdir d2/dd/d1c/d88/d89/db1/d149 0 2024-04-20T21:58:48.257 INFO:tasks.workunit.client.0.smithi142.stdout:5/945: rename dc/d14/d25/d78/f101 to dc/d6b/f13f 0 2024-04-20T21:58:48.260 INFO:tasks.workunit.client.0.smithi142.stdout:1/955: symlink d2/d4e/d7e/dbf/l14a 0 2024-04-20T21:58:48.267 INFO:tasks.workunit.client.0.smithi142.stdout:1/956: mknod d2/dd/d1c/d60/dda/c14b 0 2024-04-20T21:58:48.267 INFO:tasks.workunit.client.0.smithi142.stdout:9/995: write d0/fcd [795920,104863] 0 2024-04-20T21:58:48.274 INFO:tasks.workunit.client.0.smithi142.stdout:8/895: write d0/d29/f4a [5778672,109839] 0 2024-04-20T21:58:48.274 INFO:tasks.workunit.client.0.smithi142.stdout:4/797: link d1/d6/c24 d1/d12/da/cf7 0 2024-04-20T21:58:48.277 INFO:tasks.workunit.client.0.smithi142.stdout:1/957: rename d2/d4e/d7e/ce4 to d2/dd/d17/d8b/c14c 0 2024-04-20T21:58:48.278 INFO:tasks.workunit.client.0.smithi142.stdout:9/996: truncate d0/d89/fee 587524 0 2024-04-20T21:58:48.280 INFO:tasks.workunit.client.0.smithi142.stdout:5/946: rmdir dc/d14/d25/db4/df7 0 2024-04-20T21:58:48.282 INFO:tasks.workunit.client.0.smithi142.stdout:8/896: creat d0/d1c/d44/d89/f138 x:0 0 0 2024-04-20T21:58:48.284 INFO:tasks.workunit.client.0.smithi142.stdout:4/798: rename d1/d6/d4a/db0/ff3 to d1/d12/da/d37/d89/ff8 0 2024-04-20T21:58:48.286 INFO:tasks.workunit.client.0.smithi142.stdout:1/958: unlink d2/dd/d17/d1b/d22/d13/c133 0 2024-04-20T21:58:48.288 INFO:tasks.workunit.client.0.smithi142.stdout:5/947: mkdir dc/d71/d93/d140 0 2024-04-20T21:58:48.292 INFO:tasks.workunit.client.0.smithi142.stdout:4/799: creat d1/d6/d4a/d5a/d80/ff9 x:0 0 0 2024-04-20T21:58:48.292 INFO:tasks.workunit.client.0.smithi142.stdout:9/997: dread d0/d89/d95/d14f/d87/d9e/db3/f11e [0,4194304] 0 2024-04-20T21:58:48.294 INFO:tasks.workunit.client.0.smithi142.stdout:9/998: chown d0/d2a/l2f 12412 1 2024-04-20T21:58:48.295 INFO:tasks.workunit.client.0.smithi142.stdout:9/999: read - d0/d2a/ffc zero size 2024-04-20T21:58:48.298 INFO:tasks.workunit.client.0.smithi142.stdout:5/948: rename dc/d14/d72 to dc/d14/d26/d3f/d53/d7c/d97/d141 0 2024-04-20T21:58:48.301 INFO:tasks.workunit.client.0.smithi142.stdout:1/959: mkdir d2/dd/d17/d14d 0 2024-04-20T21:58:48.302 INFO:tasks.workunit.client.0.smithi142.stdout:4/800: mknod d1/d12/da/d1c/d32/d3d/d2f/d52/d94/df6/cfa 0 2024-04-20T21:58:48.310 INFO:tasks.workunit.client.0.smithi142.stdout:5/949: creat dc/d14/d26/d3f/d53/d7c/da9/d75/f142 x:0 0 0 2024-04-20T21:58:48.310 INFO:tasks.workunit.client.0.smithi142.stdout:8/897: creat d0/f139 x:0 0 0 2024-04-20T21:58:48.347 INFO:tasks.workunit.client.0.smithi142.stdout:5/950: creat dc/d14/d25/f143 x:0 0 0 2024-04-20T21:58:48.350 INFO:tasks.workunit.client.0.smithi142.stdout:4/801: unlink d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/f42 0 2024-04-20T21:58:48.350 INFO:tasks.workunit.client.0.smithi142.stdout:5/951: fsync dc/d14/d21/d46/d7d/fe1 0 2024-04-20T21:58:48.351 INFO:tasks.workunit.client.0.smithi142.stdout:1/960: getdents d2/dd/d1c 0 2024-04-20T21:58:48.352 INFO:tasks.workunit.client.0.smithi142.stdout:4/802: chown d1/d12/le5 1715 1 2024-04-20T21:58:48.354 INFO:tasks.workunit.client.0.smithi142.stdout:5/952: creat dc/d14/d26/d3f/d53/d7c/da9/f144 x:0 0 0 2024-04-20T21:58:48.355 INFO:tasks.workunit.client.0.smithi142.stdout:1/961: creat d2/dd/d1c/d60/deb/f14e x:0 0 0 2024-04-20T21:58:48.358 INFO:tasks.workunit.client.0.smithi142.stdout:1/962: fsync d2/dd/d1c/f69 0 2024-04-20T21:58:48.362 INFO:tasks.workunit.client.0.smithi142.stdout:1/963: creat d2/dd/d17/d1b/d22/d20/dc3/f14f x:0 0 0 2024-04-20T21:58:48.369 INFO:tasks.workunit.client.0.smithi142.stdout:1/964: rename d2/dd/d17/d1b/d22/f56 to d2/dd/d17/d3b/d50/d62/d137/f150 0 2024-04-20T21:58:48.376 INFO:tasks.workunit.client.0.smithi142.stdout:5/953: dread dc/d14/d21/d7f/f99 [0,4194304] 0 2024-04-20T21:58:48.380 INFO:tasks.workunit.client.0.smithi142.stdout:5/954: symlink dc/d14/d21/d46/d7d/db0/l145 0 2024-04-20T21:58:48.383 INFO:tasks.workunit.client.0.smithi142.stdout:5/955: creat dc/d14/d26/f146 x:0 0 0 2024-04-20T21:58:48.388 INFO:tasks.workunit.client.0.smithi142.stdout:5/956: rename dc/d14/d25/db4/d136 to dc/d71/d93/d147 0 2024-04-20T21:58:48.395 INFO:tasks.workunit.client.0.smithi142.stdout:4/803: write d1/d5b/ff4 [4529399,90251] 0 2024-04-20T21:58:48.397 INFO:tasks.workunit.client.0.smithi142.stdout:1/965: write d2/dd/d17/d1b/f3c [3527053,40838] 0 2024-04-20T21:58:48.397 INFO:tasks.workunit.client.0.smithi142.stdout:4/804: read d1/d6/d30/fa0 [3536677,72988] 0 2024-04-20T21:58:48.400 INFO:tasks.workunit.client.0.smithi142.stdout:1/966: write d2/dd/d17/d3b/fc1 [3485480,43575] 0 2024-04-20T21:58:48.401 INFO:tasks.workunit.client.0.smithi142.stdout:4/805: dread - d1/d12/da/d1c/d32/d3d/de7/fed zero size 2024-04-20T21:58:48.404 INFO:tasks.workunit.client.0.smithi142.stdout:4/806: chown d1/d12/da/d1c/da9 215 1 2024-04-20T21:58:48.407 INFO:tasks.workunit.client.0.smithi142.stdout:5/957: dwrite dc/d14/d21/d46/d2a/f123 [0,4194304] 0 2024-04-20T21:58:48.408 INFO:tasks.workunit.client.0.smithi142.stdout:4/807: fsync d1/d12/da/d1c/f88 0 2024-04-20T21:58:48.443 INFO:tasks.workunit.client.0.smithi142.stdout:4/808: write d1/d12/da/d1c/d32/d3d/d2f/d7a/d90/f9c [7333227,124670] 0 2024-04-20T21:58:48.450 INFO:tasks.workunit.client.0.smithi142.stdout:1/967: dwrite d2/dd/d17/d1b/d22/f11b [0,4194304] 0 2024-04-20T21:58:48.451 INFO:tasks.workunit.client.0.smithi142.stdout:4/809: mkdir d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/dda/dfb 0 2024-04-20T21:58:48.458 INFO:tasks.workunit.client.0.smithi142.stdout:4/810: mknod d1/d12/da/d1c/d32/d3d/d2f/cfc 0 2024-04-20T21:58:48.462 INFO:tasks.workunit.client.0.smithi142.stdout:4/811: creat d1/d6/d4a/db0/ffd x:0 0 0 2024-04-20T21:58:48.465 INFO:tasks.workunit.client.0.smithi142.stdout:4/812: symlink d1/d12/da/d72/lfe 0 2024-04-20T21:58:48.469 INFO:tasks.workunit.client.0.smithi142.stdout:4/813: fdatasync d1/d12/da/d1c/da9/fbd 0 2024-04-20T21:58:48.476 INFO:tasks.workunit.client.0.smithi142.stdout:1/968: dwrite d2/dd/d17/d1b/f3c [0,4194304] 0 2024-04-20T21:58:48.480 INFO:tasks.workunit.client.0.smithi142.stdout:1/969: mknod d2/dd/d1c/d60/dce/d7c/de7/c151 0 2024-04-20T21:58:48.484 INFO:tasks.workunit.client.0.smithi142.stdout:1/970: write d2/dd/d1c/d60/dce/d7c/ddd/f146 [1171761,13386] 0 2024-04-20T21:58:48.495 INFO:tasks.workunit.client.0.smithi142.stdout:5/958: dread dc/d6b/f9d [0,4194304] 0 2024-04-20T21:58:48.497 INFO:tasks.workunit.client.0.smithi142.stdout:1/971: rename d2/dd/d17/d3b/d50/d62/d137/f13f to d2/dd/d1c/d88/d89/f152 0 2024-04-20T21:58:48.499 INFO:tasks.workunit.client.0.smithi142.stdout:5/959: symlink dc/d71/d93/d140/l148 0 2024-04-20T21:58:48.501 INFO:tasks.workunit.client.0.smithi142.stdout:1/972: mkdir d2/dd/d17/d1b/d22/d20/dc3/d153 0 2024-04-20T21:58:48.510 INFO:tasks.workunit.client.0.smithi142.stdout:1/973: dread d2/dd/d17/f1a [0,4194304] 0 2024-04-20T21:58:48.518 INFO:tasks.workunit.client.0.smithi142.stdout:1/974: rename d2/dd/d17/f24 to d2/dd/d1c/d88/d89/db1/f154 0 2024-04-20T21:58:48.522 INFO:tasks.workunit.client.0.smithi142.stdout:5/960: dwrite dc/f2b [0,4194304] 0 2024-04-20T21:58:48.525 INFO:tasks.workunit.client.0.smithi142.stdout:5/961: chown dc/d14/d26/d3f/db3/lae 793069 1 2024-04-20T21:58:48.525 INFO:tasks.workunit.client.0.smithi142.stdout:1/975: rename d2/f31 to d2/dd/d1c/d60/dce/d7c/ddd/f155 0 2024-04-20T21:58:48.541 INFO:tasks.workunit.client.0.smithi142.stdout:5/962: dwrite dc/fd3 [0,4194304] 0 2024-04-20T21:58:48.542 INFO:tasks.workunit.client.0.smithi142.stdout:1/976: rename d2/fb0 to d2/dd/d1c/d88/d89/f156 0 2024-04-20T21:58:48.551 INFO:tasks.workunit.client.0.smithi142.stdout:5/963: link dc/d14/d26/d3f/d53/d7c/d97/d141/cb5 dc/d14/d21/d7f/de5/c149 0 2024-04-20T21:58:48.552 INFO:tasks.workunit.client.0.smithi142.stdout:5/964: fdatasync f3 0 2024-04-20T21:58:48.554 INFO:tasks.workunit.client.0.smithi142.stdout:1/977: write d2/dd/d17/d1b/d22/f46 [2862000,73971] 0 2024-04-20T21:58:48.561 INFO:tasks.workunit.client.0.smithi142.stdout:1/978: link d2/d4e/d7e/faa d2/d4e/d7e/f157 0 2024-04-20T21:58:48.564 INFO:tasks.workunit.client.0.smithi142.stdout:1/979: chown d2/dd/d17/la9 8127 1 2024-04-20T21:58:48.567 INFO:tasks.workunit.client.0.smithi142.stdout:5/965: write dc/d14/d21/d46/fb2 [650316,17785] 0 2024-04-20T21:58:48.581 INFO:tasks.workunit.client.0.smithi142.stdout:1/980: dwrite d2/dd/d17/d3b/d50/d62/f94 [0,4194304] 0 2024-04-20T21:58:48.581 INFO:tasks.workunit.client.0.smithi142.stdout:5/966: dwrite dc/d71/f12d [0,4194304] 0 2024-04-20T21:58:48.586 INFO:tasks.workunit.client.0.smithi142.stdout:1/981: creat d2/dd/d17/d1b/d22/d20/f158 x:0 0 0 2024-04-20T21:58:48.586 INFO:tasks.workunit.client.0.smithi142.stdout:5/967: rmdir dc/d14/d21/d46/d2a/d65/d79 39 2024-04-20T21:58:48.588 INFO:tasks.workunit.client.0.smithi142.stdout:1/982: chown d2/dd/d17/d3b/d50/d12d 29082423 1 2024-04-20T21:58:48.590 INFO:tasks.workunit.client.0.smithi142.stdout:5/968: rmdir dc/d14/d21/d46/d2a/d65 39 2024-04-20T21:58:48.592 INFO:tasks.workunit.client.0.smithi142.stdout:1/983: symlink d2/dd/l159 0 2024-04-20T21:58:48.596 INFO:tasks.workunit.client.0.smithi142.stdout:1/984: creat d2/de5/f15a x:0 0 0 2024-04-20T21:58:48.600 INFO:tasks.workunit.client.0.smithi142.stdout:1/985: fsync d2/dd/d1c/d88/f101 0 2024-04-20T21:58:48.600 INFO:tasks.workunit.client.0.smithi142.stdout:5/969: rename dc/d71/d93/fb8 to dc/d14/d21/f14a 0 2024-04-20T21:58:48.602 INFO:tasks.workunit.client.0.smithi142.stdout:5/970: fdatasync dc/d14/d26/ff6 0 2024-04-20T21:58:48.603 INFO:tasks.workunit.client.0.smithi142.stdout:1/986: truncate d2/dd/fd1 5071819 0 2024-04-20T21:58:48.605 INFO:tasks.workunit.client.0.smithi142.stdout:5/971: mknod dc/d14/d21/d46/c14b 0 2024-04-20T21:58:48.607 INFO:tasks.workunit.client.0.smithi142.stdout:1/987: mknod d2/dd/d17/d1b/c15b 0 2024-04-20T21:58:48.611 INFO:tasks.workunit.client.0.smithi142.stdout:5/972: creat dc/d14/d21/d46/d2a/f14c x:0 0 0 2024-04-20T21:58:48.614 INFO:tasks.workunit.client.0.smithi142.stdout:1/988: dread d2/d4e/d7e/f157 [0,4194304] 0 2024-04-20T21:58:48.616 INFO:tasks.workunit.client.0.smithi142.stdout:5/973: rename dc/d14/d26/c38 to dc/d14/d26/d3f/db3/d11a/c14d 0 2024-04-20T21:58:48.619 INFO:tasks.workunit.client.0.smithi142.stdout:5/974: creat dc/d71/d5c/d68/d108/f14e x:0 0 0 2024-04-20T21:58:48.620 INFO:tasks.workunit.client.0.smithi142.stdout:5/975: readlink dc/d71/l5b 0 2024-04-20T21:58:48.620 INFO:tasks.workunit.client.0.smithi142.stdout:5/976: readlink dc/d71/l70 0 2024-04-20T21:58:48.623 INFO:tasks.workunit.client.0.smithi142.stdout:5/977: creat dc/d14/d21/d46/d7d/db0/f14f x:0 0 0 2024-04-20T21:58:48.624 INFO:tasks.workunit.client.0.smithi142.stdout:0/829: sync 2024-04-20T21:58:48.626 INFO:tasks.workunit.client.0.smithi142.stdout:0/830: chown d5/d45/d6f/d70/da9 192126830 1 2024-04-20T21:58:48.629 INFO:tasks.workunit.client.0.smithi142.stdout:0/831: symlink d5/d1c/d3c/d4a/d78/l100 0 2024-04-20T21:58:48.630 INFO:tasks.workunit.client.0.smithi142.stdout:5/978: dread dc/fff [0,4194304] 0 2024-04-20T21:58:48.632 INFO:tasks.workunit.client.0.smithi142.stdout:0/832: chown d5/d13/d1e/d23/d24/l27 75 1 2024-04-20T21:58:48.633 INFO:tasks.workunit.client.0.smithi142.stdout:5/979: chown dc/d14/d26/d3f/d53/d7c/da9/f117 2 1 2024-04-20T21:58:48.634 INFO:tasks.workunit.client.0.smithi142.stdout:1/989: dwrite d2/dd/d1c/d88/f8d [0,4194304] 0 2024-04-20T21:58:48.636 INFO:tasks.workunit.client.0.smithi142.stdout:5/980: write dc/d14/d26/d3f/d53/d7c/da9/d75/f142 [177014,13459] 0 2024-04-20T21:58:48.638 INFO:tasks.workunit.client.0.smithi142.stdout:5/981: stat dc/d14/d21 0 2024-04-20T21:58:48.642 INFO:tasks.workunit.client.0.smithi142.stdout:0/833: link d5/d13/c36 d5/d13/d1e/d23/d2c/c101 0 2024-04-20T21:58:48.645 INFO:tasks.workunit.client.0.smithi142.stdout:0/834: creat d5/d1d/f102 x:0 0 0 2024-04-20T21:58:48.648 INFO:tasks.workunit.client.0.smithi142.stdout:0/835: symlink d5/d13/l103 0 2024-04-20T21:58:48.652 INFO:tasks.workunit.client.0.smithi142.stdout:1/990: dwrite d2/dd/d17/f148 [0,4194304] 0 2024-04-20T21:58:48.655 INFO:tasks.workunit.client.0.smithi142.stdout:0/836: link d5/d1c/d3c/d85/fea d5/d1d/d7e/f104 0 2024-04-20T21:58:48.658 INFO:tasks.workunit.client.0.smithi142.stdout:1/991: creat d2/dd/d17/d8b/f15c x:0 0 0 2024-04-20T21:58:48.659 INFO:tasks.workunit.client.0.smithi142.stdout:0/837: mknod d5/d45/d6f/c105 0 2024-04-20T21:58:48.660 INFO:tasks.workunit.client.0.smithi142.stdout:1/992: dread - d2/dd/d1c/d60/dce/d7c/fa5 zero size 2024-04-20T21:58:48.663 INFO:tasks.workunit.client.0.smithi142.stdout:0/838: mkdir d5/d1c/d3c/d85/d106 0 2024-04-20T21:58:48.669 INFO:tasks.workunit.client.0.smithi142.stdout:1/993: getdents d2/dd/d1c/d60/dda 0 2024-04-20T21:58:48.670 INFO:tasks.workunit.client.0.smithi142.stdout:1/994: stat d2/dd/d17/d1b/d22/d55/df9 0 2024-04-20T21:58:48.673 INFO:tasks.workunit.client.0.smithi142.stdout:1/995: fdatasync d2/dd/d1c/d60/dda/f132 0 2024-04-20T21:58:48.676 INFO:tasks.workunit.client.0.smithi142.stdout:1/996: chown d2/dd/d17/d3b/d50/la7 3562961 1 2024-04-20T21:58:48.678 INFO:tasks.workunit.client.0.smithi142.stdout:1/997: chown d2/dd/d17/d3b/d50/d62/ca6 6284 1 2024-04-20T21:58:48.681 INFO:tasks.workunit.client.0.smithi142.stdout:0/839: dwrite d5/d45/d6f/d70/fa2 [0,4194304] 0 2024-04-20T21:58:48.683 INFO:tasks.workunit.client.0.smithi142.stdout:0/840: readlink l3 0 2024-04-20T21:58:48.692 INFO:tasks.workunit.client.0.smithi142.stdout:0/841: link d5/d13/d1e/d23/f39 d5/d1c/d3c/d85/d106/f107 0 2024-04-20T21:58:48.694 INFO:tasks.workunit.client.0.smithi142.stdout:0/842: symlink d5/dc9/l108 0 2024-04-20T21:58:48.696 INFO:tasks.workunit.client.0.smithi142.stdout:0/843: chown d5/d45/d6f/f86 53 1 2024-04-20T21:58:48.699 INFO:tasks.workunit.client.0.smithi142.stdout:0/844: unlink d5/d1c/d3c/d85/d32/l44 0 2024-04-20T21:58:48.701 INFO:tasks.workunit.client.0.smithi142.stdout:0/845: fsync d5/d13/f14 0 2024-04-20T21:58:48.703 INFO:tasks.workunit.client.0.smithi142.stdout:0/846: chown d5/d1c/d3c/d85/d38/d62/f75 59 1 2024-04-20T21:58:48.706 INFO:tasks.workunit.client.0.smithi142.stdout:1/998: dread d2/d4e/f7f [0,4194304] 0 2024-04-20T21:58:48.708 INFO:tasks.workunit.client.0.smithi142.stdout:1/999: chown d2/dd/fd1 736450 1 2024-04-20T21:58:48.718 INFO:tasks.workunit.client.0.smithi142.stdout:0/847: dwrite d5/d1c/f52 [0,4194304] 0 2024-04-20T21:58:48.724 INFO:tasks.workunit.client.0.smithi142.stdout:8/898: sync 2024-04-20T21:58:48.724 INFO:tasks.workunit.client.0.smithi142.stdout:6/943: sync 2024-04-20T21:58:48.727 INFO:tasks.workunit.client.0.smithi142.stdout:0/848: write d5/d1c/d3c/d85/d38/d62/d9a/fe4 [466750,78976] 0 2024-04-20T21:58:48.729 INFO:tasks.workunit.client.0.smithi142.stdout:6/944: rename d1/d2f/d35/d5b/d63/d34/fa2 to d1/dd1/d8f/d154/d157/f159 0 2024-04-20T21:58:48.730 INFO:tasks.workunit.client.0.smithi142.stdout:0/849: readlink d5/d13/d1e/d23/le0 0 2024-04-20T21:58:48.733 INFO:tasks.workunit.client.0.smithi142.stdout:8/899: rename d0/d1c/d44/d89/d45/d4c/d68/da5/f10d to d0/d29/df5/f13a 0 2024-04-20T21:58:48.736 INFO:tasks.workunit.client.0.smithi142.stdout:0/850: mknod d5/d1c/d3c/d4a/c109 0 2024-04-20T21:58:48.737 INFO:tasks.workunit.client.0.smithi142.stdout:8/900: mkdir d0/d1c/d44/dad/db3/d13b 0 2024-04-20T21:58:48.740 INFO:tasks.workunit.client.0.smithi142.stdout:8/901: mkdir d0/d1c/d13c 0 2024-04-20T21:58:48.750 INFO:tasks.workunit.client.0.smithi142.stdout:6/945: write d1/d2f/d35/f36 [1573262,81738] 0 2024-04-20T21:58:48.752 INFO:tasks.workunit.client.0.smithi142.stdout:0/851: dwrite d5/d1c/d3c/d8b/fba [4194304,4194304] 0 2024-04-20T21:58:48.755 INFO:tasks.workunit.client.0.smithi142.stdout:6/946: creat d1/d2f/d35/d5b/d63/d4b/d83/f15a x:0 0 0 2024-04-20T21:58:48.758 INFO:tasks.workunit.client.0.smithi142.stdout:0/852: read d5/d1c/d3c/d4a/d78/fb9 [3471289,119347] 0 2024-04-20T21:58:48.760 INFO:tasks.workunit.client.0.smithi142.stdout:4/814: sync 2024-04-20T21:58:48.760 INFO:tasks.workunit.client.0.smithi142.stdout:5/982: sync 2024-04-20T21:58:48.762 INFO:tasks.workunit.client.0.smithi142.stdout:4/815: chown d1/d6/ccb 4146062 1 2024-04-20T21:58:48.763 INFO:tasks.workunit.client.0.smithi142.stdout:6/947: getdents d1/d2f/d35/d106 0 2024-04-20T21:58:48.764 INFO:tasks.workunit.client.0.smithi142.stdout:5/983: fsync dc/d14/f1f 0 2024-04-20T21:58:48.766 INFO:tasks.workunit.client.0.smithi142.stdout:6/948: write d1/d2f/d35/d48/fe4 [4057017,56322] 0 2024-04-20T21:58:48.766 INFO:tasks.workunit.client.0.smithi142.stdout:5/984: stat dc/d71/d5c/d68/ff0 0 2024-04-20T21:58:48.769 INFO:tasks.workunit.client.0.smithi142.stdout:5/985: mknod dc/c150 0 2024-04-20T21:58:48.771 INFO:tasks.workunit.client.0.smithi142.stdout:6/949: symlink d1/d2f/l15b 0 2024-04-20T21:58:48.777 INFO:tasks.workunit.client.0.smithi142.stdout:4/816: truncate d1/d6/fc7 3188516 0 2024-04-20T21:58:48.781 INFO:tasks.workunit.client.0.smithi142.stdout:6/950: link d1/d2f/d35/d5b/d39/c41 d1/d2f/d35/d5b/d3e/de0/d7e/d9f/c15c 0 2024-04-20T21:58:48.784 INFO:tasks.workunit.client.0.smithi142.stdout:4/817: creat d1/d12/da/fff x:0 0 0 2024-04-20T21:58:48.787 INFO:tasks.workunit.client.0.smithi142.stdout:0/853: dwrite d5/d13/d1e/d23/d24/fdc [0,4194304] 0 2024-04-20T21:58:48.789 INFO:tasks.workunit.client.0.smithi142.stdout:8/902: dread d0/d17/d6e/d110/fda [0,4194304] 0 2024-04-20T21:58:48.791 INFO:tasks.workunit.client.0.smithi142.stdout:4/818: creat d1/d12/da/d37/d89/f100 x:0 0 0 2024-04-20T21:58:48.793 INFO:tasks.workunit.client.0.smithi142.stdout:4/819: chown d1/d6/c2b 0 1 2024-04-20T21:58:48.793 INFO:tasks.workunit.client.0.smithi142.stdout:0/854: symlink d5/d1c/d3c/d4a/d78/de5/l10a 0 2024-04-20T21:58:48.795 INFO:tasks.workunit.client.0.smithi142.stdout:6/951: rename d1/d5/d8b/d14c to d1/dd1/d15d 0 2024-04-20T21:58:48.796 INFO:tasks.workunit.client.0.smithi142.stdout:0/855: chown d5/d1c/d3c/f61 8 1 2024-04-20T21:58:48.798 INFO:tasks.workunit.client.0.smithi142.stdout:8/903: mknod d0/d132/db5/d101/d11d/c13d 0 2024-04-20T21:58:48.798 INFO:tasks.workunit.client.0.smithi142.stdout:6/952: stat d1/d2f/d35/d5b/d3e/de0/d7e 0 2024-04-20T21:58:48.798 INFO:tasks.workunit.client.0.smithi142.stdout:5/986: dread dc/d14/d26/d3f/db3/f104 [0,4194304] 0 2024-04-20T21:58:48.800 INFO:tasks.workunit.client.0.smithi142.stdout:0/856: stat d5/d13/d1e/d23/d46/l51 0 2024-04-20T21:58:48.801 INFO:tasks.workunit.client.0.smithi142.stdout:0/857: readlink d5/d13/d1e/d23/d24/l8d 0 2024-04-20T21:58:48.803 INFO:tasks.workunit.client.0.smithi142.stdout:8/904: fsync d0/d1c/d44/f8b 0 2024-04-20T21:58:48.807 INFO:tasks.workunit.client.0.smithi142.stdout:0/858: write d5/d1c/d3c/d85/fae [999828,65891] 0 2024-04-20T21:58:48.807 INFO:tasks.workunit.client.0.smithi142.stdout:8/905: chown d0/d1c/d44/d89/d45/d59/l79 10656153 1 2024-04-20T21:58:48.814 INFO:tasks.workunit.client.0.smithi142.stdout:5/987: rename dc/d14/d26/d3f/d53/d7c/d97/ccf to dc/d14/d21/d46/d2a/d65/d79/c151 0 2024-04-20T21:58:48.817 INFO:tasks.workunit.client.0.smithi142.stdout:4/820: truncate d1/d12/da/f7f 2569630 0 2024-04-20T21:58:48.818 INFO:tasks.workunit.client.0.smithi142.stdout:0/859: write d5/d13/fbe [599440,22230] 0 2024-04-20T21:58:48.822 INFO:tasks.workunit.client.0.smithi142.stdout:5/988: mknod dc/d71/d5c/d68/d108/c152 0 2024-04-20T21:58:48.825 INFO:tasks.workunit.client.0.smithi142.stdout:0/860: unlink d5/d1c/d3c/d4a/d78/fb9 0 2024-04-20T21:58:48.830 INFO:tasks.workunit.client.0.smithi142.stdout:0/861: chown d5/d1c/d3c/l8c 108157 1 2024-04-20T21:58:48.830 INFO:tasks.workunit.client.0.smithi142.stdout:6/953: dwrite d1/d2f/f4e [0,4194304] 0 2024-04-20T21:58:48.830 INFO:tasks.workunit.client.0.smithi142.stdout:5/989: mkdir dc/d14/d21/d46/d7d/d153 0 2024-04-20T21:58:48.830 INFO:tasks.workunit.client.0.smithi142.stdout:8/906: dread d0/d42/f118 [0,4194304] 0 2024-04-20T21:58:48.835 INFO:tasks.workunit.client.0.smithi142.stdout:6/954: rmdir d1/d2f/d35/d5b/d63/d4b/d61 39 2024-04-20T21:58:48.835 INFO:tasks.workunit.client.0.smithi142.stdout:0/862: stat d5/d13/d1e/d23/d24/d48/d55/fd6 0 2024-04-20T21:58:48.837 INFO:tasks.workunit.client.0.smithi142.stdout:8/907: mknod d0/d42/c13e 0 2024-04-20T21:58:48.843 INFO:tasks.workunit.client.0.smithi142.stdout:0/863: mkdir d5/d13/d1e/d23/d24/d10b 0 2024-04-20T21:58:48.846 INFO:tasks.workunit.client.0.smithi142.stdout:0/864: write d5/d1c/d3c/d4a/fe9 [618356,126470] 0 2024-04-20T21:58:48.846 INFO:tasks.workunit.client.0.smithi142.stdout:8/908: rename d0/d1c/d44/d89/d45/d4c/d68/lcf to d0/d29/df5/l13f 0 2024-04-20T21:58:48.847 INFO:tasks.workunit.client.0.smithi142.stdout:5/990: dread dc/d14/d26/d3f/d53/d116/fbd [4194304,4194304] 0 2024-04-20T21:58:48.848 INFO:tasks.workunit.client.0.smithi142.stdout:0/865: symlink d5/dc9/l10c 0 2024-04-20T21:58:48.851 INFO:tasks.workunit.client.0.smithi142.stdout:5/991: write dc/d71/d5c/d68/d108/f14e [586541,116305] 0 2024-04-20T21:58:48.854 INFO:tasks.workunit.client.0.smithi142.stdout:5/992: chown dc/d14/d21/d46/d2a/d65 30259599 1 2024-04-20T21:58:48.854 INFO:tasks.workunit.client.0.smithi142.stdout:0/866: read d5/d1d/f77 [925874,91935] 0 2024-04-20T21:58:48.854 INFO:tasks.workunit.client.0.smithi142.stdout:4/821: dread d1/d12/da/d1c/d32/d3d/d2f/d49/f76 [0,4194304] 0 2024-04-20T21:58:48.857 INFO:tasks.workunit.client.0.smithi142.stdout:5/993: rmdir dc/d71/d5c/d68/d109 39 2024-04-20T21:58:48.859 INFO:tasks.workunit.client.0.smithi142.stdout:0/867: creat d5/d1d/d7e/db0/dd0/f10d x:0 0 0 2024-04-20T21:58:48.859 INFO:tasks.workunit.client.0.smithi142.stdout:5/994: rmdir dc/d71/d93/d140 39 2024-04-20T21:58:48.861 INFO:tasks.workunit.client.0.smithi142.stdout:5/995: symlink dc/d14/d25/d89/l154 0 2024-04-20T21:58:48.864 INFO:tasks.workunit.client.0.smithi142.stdout:0/868: creat d5/d1c/d3c/d95/dec/f10e x:0 0 0 2024-04-20T21:58:48.869 INFO:tasks.workunit.client.0.smithi142.stdout:6/955: read d1/d2f/d35/d5b/d63/d4b/d61/db7/f10e [3388659,73874] 0 2024-04-20T21:58:48.872 INFO:tasks.workunit.client.0.smithi142.stdout:6/956: chown d1/dd1/d8f/d154/d157 1295 1 2024-04-20T21:58:48.874 INFO:tasks.workunit.client.0.smithi142.stdout:0/869: read d5/d13/d1e/d23/d46/fc2 [2187380,56930] 0 2024-04-20T21:58:48.878 INFO:tasks.workunit.client.0.smithi142.stdout:0/870: chown d5/dc9/l108 4 1 2024-04-20T21:58:48.881 INFO:tasks.workunit.client.0.smithi142.stdout:6/957: creat d1/d2f/d35/f15e x:0 0 0 2024-04-20T21:58:48.884 INFO:tasks.workunit.client.0.smithi142.stdout:5/996: dwrite dc/d14/d26/d3f/d53/d7c/da9/d75/f142 [0,4194304] 0 2024-04-20T21:58:48.884 INFO:tasks.workunit.client.0.smithi142.stdout:0/871: symlink d5/d13/d1e/d23/d24/l10f 0 2024-04-20T21:58:48.896 INFO:tasks.workunit.client.0.smithi142.stdout:0/872: dread d5/d1c/d3c/d4a/f7c [0,4194304] 0 2024-04-20T21:58:48.896 INFO:tasks.workunit.client.0.smithi142.stdout:8/909: dwrite d0/d5e/de5/f104 [0,4194304] 0 2024-04-20T21:58:48.898 INFO:tasks.workunit.client.0.smithi142.stdout:5/997: getdents dc/d14/d25/d78 0 2024-04-20T21:58:48.900 INFO:tasks.workunit.client.0.smithi142.stdout:4/822: dwrite d1/d6/d4a/d5a/f99 [4194304,4194304] 0 2024-04-20T21:58:48.902 INFO:tasks.workunit.client.0.smithi142.stdout:5/998: dread - dc/d14/d26/d3f/d53/d7c/da9/f12f zero size 2024-04-20T21:58:48.904 INFO:tasks.workunit.client.0.smithi142.stdout:0/873: creat d5/d13/d1e/d23/d46/de6/f110 x:0 0 0 2024-04-20T21:58:48.905 INFO:tasks.workunit.client.0.smithi142.stdout:5/999: read dc/fff [552429,75134] 0 2024-04-20T21:58:48.909 INFO:tasks.workunit.client.0.smithi142.stdout:8/910: dread d0/f26 [4194304,4194304] 0 2024-04-20T21:58:48.918 INFO:tasks.workunit.client.0.smithi142.stdout:6/958: truncate d1/d2f/d35/d5b/ff9 44835 0 2024-04-20T21:58:48.919 INFO:tasks.workunit.client.0.smithi142.stdout:8/911: truncate d0/d17/f3b 2046430 0 2024-04-20T21:58:48.919 INFO:tasks.workunit.client.0.smithi142.stdout:6/959: read - d1/d5/d3a/f14b zero size 2024-04-20T21:58:48.921 INFO:tasks.workunit.client.0.smithi142.stdout:4/823: dread f0 [4194304,4194304] 0 2024-04-20T21:58:48.925 INFO:tasks.workunit.client.0.smithi142.stdout:6/960: truncate d1/d2f/d35/d5b/d3e/de0/d7e/d9f/dc0/f156 1027206 0 2024-04-20T21:58:48.926 INFO:tasks.workunit.client.0.smithi142.stdout:8/912: rmdir d0/d17/df0 0 2024-04-20T21:58:48.928 INFO:tasks.workunit.client.0.smithi142.stdout:8/913: chown d0/d1c/d44/d89/fb2 212 1 2024-04-20T21:58:48.929 INFO:tasks.workunit.client.0.smithi142.stdout:4/824: rename d1/d12/da/d1c/d32/d3d/d2f/d52/d94/df6/ld4 to d1/d12/da/d1c/d32/d3d/d2f/d52/d6d/l101 0 2024-04-20T21:58:48.931 INFO:tasks.workunit.client.0.smithi142.stdout:8/914: truncate d0/d1c/d44/d89/f113 821988 0 2024-04-20T21:58:48.932 INFO:tasks.workunit.client.0.smithi142.stdout:6/961: creat d1/d2f/d35/d5b/d63/f15f x:0 0 0 2024-04-20T21:58:48.933 INFO:tasks.workunit.client.0.smithi142.stdout:4/825: mknod d1/d6/d4a/d5a/c102 0 2024-04-20T21:58:48.939 INFO:tasks.workunit.client.0.smithi142.stdout:4/826: mkdir d1/d12/da/d1c/d32/d3d/d2f/d52/d103 0 2024-04-20T21:58:48.951 INFO:tasks.workunit.client.0.smithi142.stdout:6/962: dwrite d1/d11/f59 [0,4194304] 0 2024-04-20T21:58:48.951 INFO:tasks.workunit.client.0.smithi142.stdout:4/827: link d1/d5b/ff4 d1/d12/da/d1c/d32/d3d/d2f/d49/f104 0 2024-04-20T21:58:48.954 INFO:tasks.workunit.client.0.smithi142.stdout:0/874: dread d5/d13/d1e/d23/d24/d48/db6/fc1 [0,4194304] 0 2024-04-20T21:58:48.954 INFO:tasks.workunit.client.0.smithi142.stdout:4/828: fsync d1/d12/da/d1c/f26 0 2024-04-20T21:58:48.956 INFO:tasks.workunit.client.0.smithi142.stdout:8/915: dwrite d0/d132/db5/ff8 [0,4194304] 0 2024-04-20T21:58:48.956 INFO:tasks.workunit.client.0.smithi142.stdout:4/829: chown d1/d6/l9 47 1 2024-04-20T21:58:48.956 INFO:tasks.workunit.client.0.smithi142.stdout:6/963: rename d1/d5/fe2 to d1/dd1/d8f/f160 0 2024-04-20T21:58:48.958 INFO:tasks.workunit.client.0.smithi142.stdout:8/916: stat d0/d42/d90/lb0 0 2024-04-20T21:58:48.958 INFO:tasks.workunit.client.0.smithi142.stdout:4/830: dread - d1/d6/d4b/f79 zero size 2024-04-20T21:58:48.958 INFO:tasks.workunit.client.0.smithi142.stdout:6/964: write d1/f12f [995286,19131] 0 2024-04-20T21:58:48.959 INFO:tasks.workunit.client.0.smithi142.stdout:0/875: symlink d5/d13/l111 0 2024-04-20T21:58:48.962 INFO:tasks.workunit.client.0.smithi142.stdout:0/876: write d5/d1c/d3c/d85/d38/d62/f89 [3447144,104347] 0 2024-04-20T21:58:48.963 INFO:tasks.workunit.client.0.smithi142.stdout:4/831: symlink d1/d12/da/d72/l105 0 2024-04-20T21:58:48.963 INFO:tasks.workunit.client.0.smithi142.stdout:0/877: readlink d5/lde 0 2024-04-20T21:58:48.964 INFO:tasks.workunit.client.0.smithi142.stdout:6/965: stat d1/d9e/dcc/ff8 0 2024-04-20T21:58:48.967 INFO:tasks.workunit.client.0.smithi142.stdout:4/832: truncate d1/d12/da/d1c/fd9 144370 0 2024-04-20T21:58:48.968 INFO:tasks.workunit.client.0.smithi142.stdout:6/966: mknod d1/d5/d8b/d12c/c161 0 2024-04-20T21:58:48.969 INFO:tasks.workunit.client.0.smithi142.stdout:0/878: symlink d5/d1c/d3c/d8b/l112 0 2024-04-20T21:58:48.972 INFO:tasks.workunit.client.0.smithi142.stdout:4/833: rename d1/d6/fc to d1/d12/da/d1c/d32/d3d/de7/f106 0 2024-04-20T21:58:48.973 INFO:tasks.workunit.client.0.smithi142.stdout:0/879: creat d5/d1c/f113 x:0 0 0 2024-04-20T21:58:48.975 INFO:tasks.workunit.client.0.smithi142.stdout:4/834: stat d1/d12/da/d1c/d32/d3d/d2f/d52/d94/df6 0 2024-04-20T21:58:48.979 INFO:tasks.workunit.client.0.smithi142.stdout:4/835: chown d1/d12/da/d1c/d32/c9e 276 1 2024-04-20T21:58:48.981 INFO:tasks.workunit.client.0.smithi142.stdout:4/836: rmdir d1/d6/d30 39 2024-04-20T21:58:48.984 INFO:tasks.workunit.client.0.smithi142.stdout:4/837: rename d1/d6/l74 to d1/l107 0 2024-04-20T21:58:48.987 INFO:tasks.workunit.client.0.smithi142.stdout:4/838: write d1/d12/da/d1c/d32/d3d/d2f/d7a/d90/f9c [8631953,106195] 0 2024-04-20T21:58:48.992 INFO:tasks.workunit.client.0.smithi142.stdout:4/839: rename d1/d12/da/d1c/d32/d3d/d2f/d49/f76 to d1/d12/da/d1c/d32/d3d/d2f/d7a/d90/f108 0 2024-04-20T21:58:48.997 INFO:tasks.workunit.client.0.smithi142.stdout:4/840: rename d1/d12/da/d1c/d32/d3d/d2f/d73/ce1 to d1/d12/da/d37/c109 0 2024-04-20T21:58:48.998 INFO:tasks.workunit.client.0.smithi142.stdout:4/841: read - d1/d6/d4b/fcc zero size 2024-04-20T21:58:49.000 INFO:tasks.workunit.client.0.smithi142.stdout:4/842: unlink d1/d6/d4b/ccd 0 2024-04-20T21:58:49.003 INFO:tasks.workunit.client.0.smithi142.stdout:4/843: symlink d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/dda/dfb/l10a 0 2024-04-20T21:58:49.020 INFO:tasks.workunit.client.0.smithi142.stdout:4/844: dread d1/d12/da/d1c/d32/d3d/d2f/d49/f78 [0,4194304] 0 2024-04-20T21:58:49.023 INFO:tasks.workunit.client.0.smithi142.stdout:4/845: truncate d1/d6/d4b/fad 797087 0 2024-04-20T21:58:49.057 INFO:tasks.workunit.client.0.smithi142.stdout:8/917: write d0/d29/f2e [1340888,9557] 0 2024-04-20T21:58:49.060 INFO:tasks.workunit.client.0.smithi142.stdout:6/967: write d1/d1b/fb0 [1352067,35669] 0 2024-04-20T21:58:49.062 INFO:tasks.workunit.client.0.smithi142.stdout:8/918: symlink d0/d1c/d44/d89/l140 0 2024-04-20T21:58:49.070 INFO:tasks.workunit.client.0.smithi142.stdout:0/880: dwrite d5/d13/d1e/d23/d46/fda [0,4194304] 0 2024-04-20T21:58:49.073 INFO:tasks.workunit.client.0.smithi142.stdout:4/846: write d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/f44 [1052197,67501] 0 2024-04-20T21:58:49.075 INFO:tasks.workunit.client.0.smithi142.stdout:8/919: write d0/d29/f3d [4233863,43324] 0 2024-04-20T21:58:49.080 INFO:tasks.workunit.client.0.smithi142.stdout:8/920: mkdir d0/d141 0 2024-04-20T21:58:49.085 INFO:tasks.workunit.client.0.smithi142.stdout:8/921: mknod d0/d1c/d44/d89/d45/d4c/c142 0 2024-04-20T21:58:49.086 INFO:tasks.workunit.client.0.smithi142.stdout:6/968: dwrite d1/d5/d8b/fb6 [4194304,4194304] 0 2024-04-20T21:58:49.090 INFO:tasks.workunit.client.0.smithi142.stdout:8/922: symlink d0/d132/db5/de2/l143 0 2024-04-20T21:58:49.092 INFO:tasks.workunit.client.0.smithi142.stdout:8/923: readlink d0/d17/d6e/d110/lc6 0 2024-04-20T21:58:49.094 INFO:tasks.workunit.client.0.smithi142.stdout:6/969: link d1/d75/c129 d1/d2f/d35/d5b/d39/c162 0 2024-04-20T21:58:49.096 INFO:tasks.workunit.client.0.smithi142.stdout:8/924: mkdir d0/d29/df5/d11e/d144 0 2024-04-20T21:58:49.097 INFO:tasks.workunit.client.0.smithi142.stdout:6/970: fdatasync d1/d2f/d35/d5b/d3e/dc5/ddb/f112 0 2024-04-20T21:58:49.099 INFO:tasks.workunit.client.0.smithi142.stdout:6/971: fsync d1/d5/d8b/f99 0 2024-04-20T21:58:49.103 INFO:tasks.workunit.client.0.smithi142.stdout:8/925: getdents d0/d132/d9d 0 2024-04-20T21:58:49.104 INFO:tasks.workunit.client.0.smithi142.stdout:6/972: dread - d1/d2f/d35/d5b/d63/d34/f127 zero size 2024-04-20T21:58:49.105 INFO:tasks.workunit.client.0.smithi142.stdout:6/973: readlink d1/d11/l33 0 2024-04-20T21:58:49.105 INFO:tasks.workunit.client.0.smithi142.stdout:0/881: dread d5/d13/d1e/d23/d2c/f84 [0,4194304] 0 2024-04-20T21:58:49.108 INFO:tasks.workunit.client.0.smithi142.stdout:4/847: dread d1/d12/da/d37/f96 [0,4194304] 0 2024-04-20T21:58:49.108 INFO:tasks.workunit.client.0.smithi142.stdout:8/926: mkdir d0/d1c/d44/dad/db3/d3f/d7f/d8f/d145 0 2024-04-20T21:58:49.111 INFO:tasks.workunit.client.0.smithi142.stdout:6/974: mknod d1/dd1/d15d/d158/c163 0 2024-04-20T21:58:49.120 INFO:tasks.workunit.client.0.smithi142.stdout:8/927: dread d0/d1c/d44/f8b [0,4194304] 0 2024-04-20T21:58:49.123 INFO:tasks.workunit.client.0.smithi142.stdout:4/848: rename d1/d6/d30/fc9 to d1/d12/da/d1c/d32/d3d/d2f/d52/d94/f10b 0 2024-04-20T21:58:49.124 INFO:tasks.workunit.client.0.smithi142.stdout:0/882: dwrite d5/d13/f2f [4194304,4194304] 0 2024-04-20T21:58:49.125 INFO:tasks.workunit.client.0.smithi142.stdout:0/883: chown d5/d1c/d3c/d95 100152 1 2024-04-20T21:58:49.126 INFO:tasks.workunit.client.0.smithi142.stdout:6/975: write d1/d2f/d35/d5b/d63/ded/d108/df4/ffd [577886,72969] 0 2024-04-20T21:58:49.129 INFO:tasks.workunit.client.0.smithi142.stdout:0/884: truncate d5/d1c/d3c/d85/fea 769614 0 2024-04-20T21:58:49.151 INFO:tasks.workunit.client.0.smithi142.stdout:0/885: dread d5/d13/d1e/d23/d24/fd5 [0,4194304] 0 2024-04-20T21:58:49.152 INFO:tasks.workunit.client.0.smithi142.stdout:8/928: dwrite d0/d17/d6e/d110/fa8 [0,4194304] 0 2024-04-20T21:58:49.158 INFO:tasks.workunit.client.0.smithi142.stdout:6/976: dwrite d1/d2f/d35/d48/f9c [0,4194304] 0 2024-04-20T21:58:49.159 INFO:tasks.workunit.client.0.smithi142.stdout:4/849: dwrite d1/f13 [0,4194304] 0 2024-04-20T21:58:49.162 INFO:tasks.workunit.client.0.smithi142.stdout:8/929: readlink d0/d1c/d44/d89/d45/d4c/lc4 0 2024-04-20T21:58:49.163 INFO:tasks.workunit.client.0.smithi142.stdout:0/886: mkdir d5/d1c/d3c/d95/dec/d114 0 2024-04-20T21:58:49.163 INFO:tasks.workunit.client.0.smithi142.stdout:6/977: chown d1/dd1/f7c 295531613 1 2024-04-20T21:58:49.167 INFO:tasks.workunit.client.0.smithi142.stdout:4/850: symlink d1/d12/da/d1c/d32/d3d/l10c 0 2024-04-20T21:58:49.170 INFO:tasks.workunit.client.0.smithi142.stdout:6/978: chown d1/d11/c13 47 1 2024-04-20T21:58:49.171 INFO:tasks.workunit.client.0.smithi142.stdout:6/979: fsync d1/d2f/f4e 0 2024-04-20T21:58:49.174 INFO:tasks.workunit.client.0.smithi142.stdout:8/930: unlink d0/d1c/d44/d89/d45/d4c/f115 0 2024-04-20T21:58:49.177 INFO:tasks.workunit.client.0.smithi142.stdout:4/851: symlink d1/d6/d30/l10d 0 2024-04-20T21:58:49.180 INFO:tasks.workunit.client.0.smithi142.stdout:4/852: dread d1/d12/da/d1c/fd9 [0,4194304] 0 2024-04-20T21:58:49.185 INFO:tasks.workunit.client.0.smithi142.stdout:6/980: mknod d1/d5/d3a/c164 0 2024-04-20T21:58:49.187 INFO:tasks.workunit.client.0.smithi142.stdout:6/981: fsync d1/dd1/d65/f125 0 2024-04-20T21:58:49.188 INFO:tasks.workunit.client.0.smithi142.stdout:8/931: creat d0/d29/df5/d11e/f146 x:0 0 0 2024-04-20T21:58:49.191 INFO:tasks.workunit.client.0.smithi142.stdout:4/853: rmdir d1/d5b 39 2024-04-20T21:58:49.193 INFO:tasks.workunit.client.0.smithi142.stdout:6/982: mkdir d1/d9e/dcc/d165 0 2024-04-20T21:58:49.194 INFO:tasks.workunit.client.0.smithi142.stdout:8/932: mkdir d0/d132/db5/d101/d11d/d147 0 2024-04-20T21:58:49.198 INFO:tasks.workunit.client.0.smithi142.stdout:8/933: creat d0/d1c/d44/d89/d45/d4c/f148 x:0 0 0 2024-04-20T21:58:49.200 INFO:tasks.workunit.client.0.smithi142.stdout:8/934: write d0/d29/df3/f129 [126205,113403] 0 2024-04-20T21:58:49.205 INFO:tasks.workunit.client.0.smithi142.stdout:8/935: symlink d0/d1c/d44/d89/d45/ded/l149 0 2024-04-20T21:58:49.214 INFO:tasks.workunit.client.0.smithi142.stdout:6/983: dwrite d1/d2f/d35/d5b/d63/d4b/d83/f15a [0,4194304] 0 2024-04-20T21:58:49.216 INFO:tasks.workunit.client.0.smithi142.stdout:0/887: write d5/d1c/d3c/d85/d106/f107 [1347973,54807] 0 2024-04-20T21:58:49.221 INFO:tasks.workunit.client.0.smithi142.stdout:6/984: symlink d1/d2f/d35/d5b/d63/d34/l166 0 2024-04-20T21:58:49.226 INFO:tasks.workunit.client.0.smithi142.stdout:8/936: dwrite d0/f9a [4194304,4194304] 0 2024-04-20T21:58:49.229 INFO:tasks.workunit.client.1.smithi164.stdout:7/7: sync 2024-04-20T21:58:49.229 INFO:tasks.workunit.client.1.smithi164.stdout:7/8: stat - no entries 2024-04-20T21:58:49.229 INFO:tasks.workunit.client.1.smithi164.stdout:9/21: sync 2024-04-20T21:58:49.229 INFO:tasks.workunit.client.1.smithi164.stdout:6/54: sync 2024-04-20T21:58:49.229 INFO:tasks.workunit.client.1.smithi164.stdout:7/9: chown . 483248449 1 2024-04-20T21:58:49.229 INFO:tasks.workunit.client.1.smithi164.stdout:7/10: dread - no filename 2024-04-20T21:58:49.230 INFO:tasks.workunit.client.1.smithi164.stdout:0/43: sync 2024-04-20T21:58:49.230 INFO:tasks.workunit.client.1.smithi164.stdout:2/5: sync 2024-04-20T21:58:49.230 INFO:tasks.workunit.client.1.smithi164.stdout:2/6: read - no filename 2024-04-20T21:58:49.231 INFO:tasks.workunit.client.1.smithi164.stdout:0/44: read - d1/fb zero size 2024-04-20T21:58:49.233 INFO:tasks.workunit.client.1.smithi164.stdout:0/45: write d1/fb [922480,111281] 0 2024-04-20T21:58:49.234 INFO:tasks.workunit.client.1.smithi164.stdout:0/46: readlink d1/l5 0 2024-04-20T21:58:49.235 INFO:tasks.workunit.client.0.smithi142.stdout:6/985: dread d1/d2f/d35/f36 [0,4194304] 0 2024-04-20T21:58:49.236 INFO:tasks.workunit.client.1.smithi164.stdout:0/47: chown d1/l5 688 1 2024-04-20T21:58:49.239 INFO:tasks.workunit.client.0.smithi142.stdout:6/986: write d1/d2f/d35/d48/f73 [3755236,50812] 0 2024-04-20T21:58:49.243 INFO:tasks.workunit.client.0.smithi142.stdout:6/987: fdatasync d1/d2f/d35/f109 0 2024-04-20T21:58:49.249 INFO:tasks.workunit.client.0.smithi142.stdout:6/988: mknod d1/d9e/dcc/c167 0 2024-04-20T21:58:49.260 INFO:tasks.workunit.client.1.smithi164.stdout:0/48: dwrite d1/f8 [0,4194304] 0 2024-04-20T21:58:49.278 INFO:tasks.workunit.client.1.smithi164.stdout:2/7: chown c0 991 1 2024-04-20T21:58:49.279 INFO:tasks.workunit.client.1.smithi164.stdout:2/8: stat c0 0 2024-04-20T21:58:49.280 INFO:tasks.workunit.client.1.smithi164.stdout:6/55: mkdir d0/d3/d8 0 2024-04-20T21:58:49.281 INFO:tasks.workunit.client.1.smithi164.stdout:9/22: symlink d3/l5 0 2024-04-20T21:58:49.282 INFO:tasks.workunit.client.1.smithi164.stdout:9/23: truncate - no filename 2024-04-20T21:58:49.282 INFO:tasks.workunit.client.1.smithi164.stdout:2/9: mkdir d2 0 2024-04-20T21:58:49.283 INFO:tasks.workunit.client.1.smithi164.stdout:2/10: write - no filename 2024-04-20T21:58:49.283 INFO:tasks.workunit.client.1.smithi164.stdout:2/11: dread - no filename 2024-04-20T21:58:49.283 INFO:tasks.workunit.client.1.smithi164.stdout:2/12: write - no filename 2024-04-20T21:58:49.283 INFO:tasks.workunit.client.1.smithi164.stdout:2/13: read - no filename 2024-04-20T21:58:49.284 INFO:tasks.workunit.client.1.smithi164.stdout:6/56: symlink d0/d3/l9 0 2024-04-20T21:58:49.285 INFO:tasks.workunit.client.1.smithi164.stdout:2/14: creat d2/f3 x:0 0 0 2024-04-20T21:58:49.287 INFO:tasks.workunit.client.1.smithi164.stdout:2/15: dread - d2/f3 zero size 2024-04-20T21:58:49.288 INFO:tasks.workunit.client.1.smithi164.stdout:6/57: creat d0/d3/d8/fa x:0 0 0 2024-04-20T21:58:49.291 INFO:tasks.workunit.client.1.smithi164.stdout:6/58: write d0/f4 [3845747,70961] 0 2024-04-20T21:58:49.296 INFO:tasks.workunit.client.1.smithi164.stdout:6/59: link d0/f4 d0/d3/fb 0 2024-04-20T21:58:49.298 INFO:tasks.workunit.client.1.smithi164.stdout:6/60: fdatasync d0/d3/d8/fa 0 2024-04-20T21:58:49.301 INFO:tasks.workunit.client.1.smithi164.stdout:6/61: write d0/d3/d8/fa [769891,101330] 0 2024-04-20T21:58:49.306 INFO:tasks.workunit.client.1.smithi164.stdout:6/62: mknod d0/d3/cc 0 2024-04-20T21:58:49.309 INFO:tasks.workunit.client.1.smithi164.stdout:6/63: chown d0/d3/l9 220801446 1 2024-04-20T21:58:49.313 INFO:tasks.workunit.client.1.smithi164.stdout:2/16: dwrite d2/f3 [0,4194304] 0 2024-04-20T21:58:49.322 INFO:tasks.workunit.client.1.smithi164.stdout:6/64: symlink d0/ld 0 2024-04-20T21:58:49.325 INFO:tasks.workunit.client.1.smithi164.stdout:6/65: write d0/f6 [309699,27484] 0 2024-04-20T21:58:49.328 INFO:tasks.workunit.client.1.smithi164.stdout:5/10: sync 2024-04-20T21:58:49.328 INFO:tasks.workunit.client.1.smithi164.stdout:3/32: sync 2024-04-20T21:58:49.328 INFO:tasks.workunit.client.1.smithi164.stdout:4/4: sync 2024-04-20T21:58:49.328 INFO:tasks.workunit.client.1.smithi164.stdout:8/24: sync 2024-04-20T21:58:49.328 INFO:tasks.workunit.client.1.smithi164.stdout:1/26: sync 2024-04-20T21:58:49.329 INFO:tasks.workunit.client.0.smithi142.stdout:0/888: dwrite d5/d13/d1e/d23/d24/f2a [0,4194304] 0 2024-04-20T21:58:49.331 INFO:tasks.workunit.client.1.smithi164.stdout:1/27: write f7 [410301,127209] 0 2024-04-20T21:58:49.332 INFO:tasks.workunit.client.1.smithi164.stdout:3/33: truncate f4 1250245 0 2024-04-20T21:58:49.333 INFO:tasks.workunit.client.1.smithi164.stdout:3/34: fdatasync f6 0 2024-04-20T21:58:49.334 INFO:tasks.workunit.client.1.smithi164.stdout:4/5: creat f2 x:0 0 0 2024-04-20T21:58:49.334 INFO:tasks.workunit.client.1.smithi164.stdout:2/17: dread d2/f3 [0,4194304] 0 2024-04-20T21:58:49.338 INFO:tasks.workunit.client.1.smithi164.stdout:6/66: symlink d0/le 0 2024-04-20T21:58:49.340 INFO:tasks.workunit.client.0.smithi142.stdout:8/937: dwrite d0/d1c/fca [0,4194304] 0 2024-04-20T21:58:49.341 INFO:tasks.workunit.client.1.smithi164.stdout:5/11: rename f2 to f3 0 2024-04-20T21:58:49.342 INFO:tasks.workunit.client.0.smithi142.stdout:8/938: fdatasync d0/d1c/d44/d89/d45/f4d 0 2024-04-20T21:58:49.345 INFO:tasks.workunit.client.1.smithi164.stdout:1/28: dread f0 [0,4194304] 0 2024-04-20T21:58:49.349 INFO:tasks.workunit.client.1.smithi164.stdout:4/6: creat f3 x:0 0 0 2024-04-20T21:58:49.351 INFO:tasks.workunit.client.0.smithi142.stdout:6/989: write d1/d2f/d35/d5b/d3e/f9b [619814,49976] 0 2024-04-20T21:58:49.352 INFO:tasks.workunit.client.0.smithi142.stdout:6/990: stat d1/d11/ff 0 2024-04-20T21:58:49.354 INFO:tasks.workunit.client.0.smithi142.stdout:6/991: stat d1/d2f/d35/d5b/d3e/dc5/cea 0 2024-04-20T21:58:49.354 INFO:tasks.workunit.client.1.smithi164.stdout:3/35: dwrite f4 [0,4194304] 0 2024-04-20T21:58:49.355 INFO:tasks.workunit.client.1.smithi164.stdout:3/36: chown f6 1 1 2024-04-20T21:58:49.357 INFO:tasks.workunit.client.0.smithi142.stdout:6/992: write d1/d2f/d35/d5b/d3e/f10d [838399,63525] 0 2024-04-20T21:58:49.358 INFO:tasks.workunit.client.0.smithi142.stdout:6/993: chown d1/d2f/d35/d48/fe4 0 1 2024-04-20T21:58:49.360 INFO:tasks.workunit.client.1.smithi164.stdout:5/12: write f3 [607155,51474] 0 2024-04-20T21:58:49.360 INFO:tasks.workunit.client.1.smithi164.stdout:1/29: symlink l9 0 2024-04-20T21:58:49.362 INFO:tasks.workunit.client.1.smithi164.stdout:5/13: stat l1 0 2024-04-20T21:58:49.364 INFO:tasks.workunit.client.1.smithi164.stdout:1/30: truncate f7 1229048 0 2024-04-20T21:58:49.368 INFO:tasks.workunit.client.1.smithi164.stdout:3/37: creat f7 x:0 0 0 2024-04-20T21:58:49.370 INFO:tasks.workunit.client.1.smithi164.stdout:3/38: chown f7 364637 1 2024-04-20T21:58:49.372 INFO:tasks.workunit.client.1.smithi164.stdout:3/39: chown f4 90444669 1 2024-04-20T21:58:49.375 INFO:tasks.workunit.client.0.smithi142.stdout:6/994: dwrite d1/d2f/d35/d48/f73 [0,4194304] 0 2024-04-20T21:58:49.376 INFO:tasks.workunit.client.1.smithi164.stdout:4/7: unlink l1 0 2024-04-20T21:58:49.378 INFO:tasks.workunit.client.1.smithi164.stdout:6/67: rename d0/l1 to d0/lf 0 2024-04-20T21:58:49.381 INFO:tasks.workunit.client.1.smithi164.stdout:8/25: getdents d0 0 2024-04-20T21:58:49.383 INFO:tasks.workunit.client.1.smithi164.stdout:0/49: truncate d1/fb 406169 0 2024-04-20T21:58:49.383 INFO:tasks.workunit.client.1.smithi164.stdout:5/14: dwrite f3 [0,4194304] 0 2024-04-20T21:58:49.386 INFO:tasks.workunit.client.1.smithi164.stdout:3/40: mknod c8 0 2024-04-20T21:58:49.386 INFO:tasks.workunit.client.1.smithi164.stdout:5/15: read f3 [1642122,101839] 0 2024-04-20T21:58:49.387 INFO:tasks.workunit.client.1.smithi164.stdout:3/41: write f6 [1116802,20615] 0 2024-04-20T21:58:49.390 INFO:tasks.workunit.client.1.smithi164.stdout:4/8: mkdir d4 0 2024-04-20T21:58:49.391 INFO:tasks.workunit.client.0.smithi142.stdout:6/995: dwrite d1/d2f/d35/d5b/d63/ded/d108/f126 [0,4194304] 0 2024-04-20T21:58:49.393 INFO:tasks.workunit.client.1.smithi164.stdout:4/9: chown f2 6128 1 2024-04-20T21:58:49.393 INFO:tasks.workunit.client.1.smithi164.stdout:3/42: write f6 [2745069,117571] 0 2024-04-20T21:58:49.399 INFO:tasks.workunit.client.1.smithi164.stdout:7/11: sync 2024-04-20T21:58:49.399 INFO:tasks.workunit.client.1.smithi164.stdout:7/12: dwrite - no filename 2024-04-20T21:58:49.399 INFO:tasks.workunit.client.1.smithi164.stdout:7/13: dwrite - no filename 2024-04-20T21:58:49.399 INFO:tasks.workunit.client.1.smithi164.stdout:7/14: rename - no filename 2024-04-20T21:58:49.399 INFO:tasks.workunit.client.1.smithi164.stdout:7/15: write - no filename 2024-04-20T21:58:49.399 INFO:tasks.workunit.client.1.smithi164.stdout:7/16: dread - no filename 2024-04-20T21:58:49.399 INFO:tasks.workunit.client.1.smithi164.stdout:7/17: fsync - no filename 2024-04-20T21:58:49.399 INFO:tasks.workunit.client.1.smithi164.stdout:7/18: write - no filename 2024-04-20T21:58:49.401 INFO:tasks.workunit.client.1.smithi164.stdout:0/50: dread d1/f8 [0,4194304] 0 2024-04-20T21:58:49.402 INFO:tasks.workunit.client.1.smithi164.stdout:8/26: creat d0/fc x:0 0 0 2024-04-20T21:58:49.404 INFO:tasks.workunit.client.0.smithi142.stdout:0/889: truncate d5/d1c/d3c/d8b/fac 1346048 0 2024-04-20T21:58:49.407 INFO:tasks.workunit.client.0.smithi142.stdout:8/939: creat d0/d29/df5/d11e/f14a x:0 0 0 2024-04-20T21:58:49.407 INFO:tasks.workunit.client.1.smithi164.stdout:9/24: chown d3/c4 292332 1 2024-04-20T21:58:49.407 INFO:tasks.workunit.client.1.smithi164.stdout:9/25: dwrite - no filename 2024-04-20T21:58:49.407 INFO:tasks.workunit.client.1.smithi164.stdout:9/26: fsync - no filename 2024-04-20T21:58:49.407 INFO:tasks.workunit.client.1.smithi164.stdout:9/27: dwrite - no filename 2024-04-20T21:58:49.408 INFO:tasks.workunit.client.1.smithi164.stdout:6/68: dread d0/d3/fb [0,4194304] 0 2024-04-20T21:58:49.408 INFO:tasks.workunit.client.1.smithi164.stdout:9/28: chown c2 0 1 2024-04-20T21:58:49.409 INFO:tasks.workunit.client.1.smithi164.stdout:5/16: creat f4 x:0 0 0 2024-04-20T21:58:49.411 INFO:tasks.workunit.client.1.smithi164.stdout:5/17: truncate f4 436286 0 2024-04-20T21:58:49.412 INFO:tasks.workunit.client.1.smithi164.stdout:5/18: chown c0 19247 1 2024-04-20T21:58:49.416 INFO:tasks.workunit.client.1.smithi164.stdout:3/43: creat f9 x:0 0 0 2024-04-20T21:58:49.420 INFO:tasks.workunit.client.0.smithi142.stdout:6/996: mkdir d1/d5/d3a/d43/d132/d168 0 2024-04-20T21:58:49.425 INFO:tasks.workunit.client.1.smithi164.stdout:8/27: mknod d0/d2/cd 0 2024-04-20T21:58:49.426 INFO:tasks.workunit.client.1.smithi164.stdout:3/44: dread f4 [0,4194304] 0 2024-04-20T21:58:49.426 INFO:tasks.workunit.client.1.smithi164.stdout:3/45: stat f4 0 2024-04-20T21:58:49.429 INFO:tasks.workunit.client.1.smithi164.stdout:6/69: creat d0/d3/f10 x:0 0 0 2024-04-20T21:58:49.430 INFO:tasks.workunit.client.0.smithi142.stdout:8/940: getdents d0/d5e/de5 0 2024-04-20T21:58:49.431 INFO:tasks.workunit.client.1.smithi164.stdout:1/31: getdents . 0 2024-04-20T21:58:49.432 INFO:tasks.workunit.client.0.smithi142.stdout:0/890: dread d5/d45/d6f/f86 [0,4194304] 0 2024-04-20T21:58:49.432 INFO:tasks.workunit.client.1.smithi164.stdout:5/19: creat f5 x:0 0 0 2024-04-20T21:58:49.433 INFO:tasks.workunit.client.1.smithi164.stdout:4/10: creat d4/f5 x:0 0 0 2024-04-20T21:58:49.434 INFO:tasks.workunit.client.1.smithi164.stdout:2/18: truncate d2/f3 122047 0 2024-04-20T21:58:49.434 INFO:tasks.workunit.client.1.smithi164.stdout:5/20: chown l1 569 1 2024-04-20T21:58:49.435 INFO:tasks.workunit.client.1.smithi164.stdout:5/21: stat f5 0 2024-04-20T21:58:49.436 INFO:tasks.workunit.client.1.smithi164.stdout:7/19: symlink l0 0 2024-04-20T21:58:49.436 INFO:tasks.workunit.client.1.smithi164.stdout:7/20: write - no filename 2024-04-20T21:58:49.436 INFO:tasks.workunit.client.1.smithi164.stdout:7/21: rmdir - no directory 2024-04-20T21:58:49.436 INFO:tasks.workunit.client.1.smithi164.stdout:7/22: truncate - no filename 2024-04-20T21:58:49.436 INFO:tasks.workunit.client.1.smithi164.stdout:7/23: truncate - no filename 2024-04-20T21:58:49.436 INFO:tasks.workunit.client.1.smithi164.stdout:7/24: truncate - no filename 2024-04-20T21:58:49.436 INFO:tasks.workunit.client.1.smithi164.stdout:4/11: read - f3 zero size 2024-04-20T21:58:49.437 INFO:tasks.workunit.client.1.smithi164.stdout:2/19: chown c0 2103231 1 2024-04-20T21:58:49.437 INFO:tasks.workunit.client.0.smithi142.stdout:6/997: dwrite d1/d2f/d35/d5b/d63/d34/f127 [0,4194304] 0 2024-04-20T21:58:49.438 INFO:tasks.workunit.client.1.smithi164.stdout:3/46: dread f4 [0,4194304] 0 2024-04-20T21:58:49.439 INFO:tasks.workunit.client.0.smithi142.stdout:6/998: fdatasync d1/d5/d8b/fb6 0 2024-04-20T21:58:49.440 INFO:tasks.workunit.client.1.smithi164.stdout:7/25: chown l0 15050814 1 2024-04-20T21:58:49.440 INFO:tasks.workunit.client.0.smithi142.stdout:6/999: fsync d1/d5/d3a/f14b 0 2024-04-20T21:58:49.441 INFO:tasks.workunit.client.1.smithi164.stdout:6/70: mkdir d0/d3/d11 0 2024-04-20T21:58:49.443 INFO:tasks.workunit.client.1.smithi164.stdout:3/47: truncate f9 711084 0 2024-04-20T21:58:49.444 INFO:tasks.workunit.client.0.smithi142.stdout:8/941: symlink d0/d132/db5/d101/d11d/d147/l14b 0 2024-04-20T21:58:49.445 INFO:tasks.workunit.client.1.smithi164.stdout:1/32: write f1 [4173802,11733] 0 2024-04-20T21:58:49.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:49 smithi164 ceph-mon[23506]: pgmap v46: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 66 MiB/s rd, 150 MiB/s wr, 444 op/s 2024-04-20T21:58:49.445 INFO:tasks.workunit.client.1.smithi164.stdout:8/28: dwrite d0/f3 [0,4194304] 0 2024-04-20T21:58:49.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:49 smithi142 ceph-mon[15828]: pgmap v46: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 66 MiB/s rd, 150 MiB/s wr, 444 op/s 2024-04-20T21:58:49.448 INFO:tasks.workunit.client.0.smithi142.stdout:0/891: mknod d5/d13/d1e/d23/d24/c115 0 2024-04-20T21:58:49.449 INFO:tasks.workunit.client.1.smithi164.stdout:8/29: fdatasync d0/fb 0 2024-04-20T21:58:49.449 INFO:tasks.workunit.client.1.smithi164.stdout:1/33: read f7 [212323,51061] 0 2024-04-20T21:58:49.451 INFO:tasks.workunit.client.0.smithi142.stdout:0/892: chown d5/d1c/d3c/d4a/d78/de5/l10a 101 1 2024-04-20T21:58:49.455 INFO:tasks.workunit.client.1.smithi164.stdout:9/29: getdents d3 0 2024-04-20T21:58:49.456 INFO:tasks.workunit.client.1.smithi164.stdout:4/12: creat d4/f6 x:0 0 0 2024-04-20T21:58:49.459 INFO:tasks.workunit.client.1.smithi164.stdout:7/26: creat f1 x:0 0 0 2024-04-20T21:58:49.460 INFO:tasks.workunit.client.1.smithi164.stdout:3/48: creat fa x:0 0 0 2024-04-20T21:58:49.462 INFO:tasks.workunit.client.0.smithi142.stdout:8/942: dwrite d0/d5e/f103 [0,4194304] 0 2024-04-20T21:58:49.463 INFO:tasks.workunit.client.1.smithi164.stdout:1/34: mkdir da 0 2024-04-20T21:58:49.465 INFO:tasks.workunit.client.1.smithi164.stdout:4/13: creat d4/f7 x:0 0 0 2024-04-20T21:58:49.466 INFO:tasks.workunit.client.1.smithi164.stdout:9/30: creat d3/f6 x:0 0 0 2024-04-20T21:58:49.467 INFO:tasks.workunit.client.1.smithi164.stdout:7/27: mkdir d2 0 2024-04-20T21:58:49.469 INFO:tasks.workunit.client.1.smithi164.stdout:3/49: rename c8 to cb 0 2024-04-20T21:58:49.471 INFO:tasks.workunit.client.0.smithi142.stdout:8/943: mkdir d0/d132/db5/de2/d14c 0 2024-04-20T21:58:49.472 INFO:tasks.workunit.client.1.smithi164.stdout:3/50: read f6 [753794,110980] 0 2024-04-20T21:58:49.473 INFO:tasks.workunit.client.1.smithi164.stdout:6/71: dwrite d0/d3/f10 [0,4194304] 0 2024-04-20T21:58:49.473 INFO:tasks.workunit.client.0.smithi142.stdout:0/893: dwrite d5/f9 [0,4194304] 0 2024-04-20T21:58:49.475 INFO:tasks.workunit.client.1.smithi164.stdout:3/51: truncate f6 3793779 0 2024-04-20T21:58:49.478 INFO:tasks.workunit.client.1.smithi164.stdout:4/14: mknod d4/c8 0 2024-04-20T21:58:49.481 INFO:tasks.workunit.client.1.smithi164.stdout:3/52: mknod cc 0 2024-04-20T21:58:49.484 INFO:tasks.workunit.client.1.smithi164.stdout:4/15: write f3 [1011984,126340] 0 2024-04-20T21:58:49.484 INFO:tasks.workunit.client.0.smithi142.stdout:8/944: mkdir d0/d1c/d44/dad/db3/d3f/d7f/d14d 0 2024-04-20T21:58:49.485 INFO:tasks.workunit.client.1.smithi164.stdout:2/20: rmdir d2 39 2024-04-20T21:58:49.488 INFO:tasks.workunit.client.1.smithi164.stdout:1/35: rmdir da 0 2024-04-20T21:58:49.489 INFO:tasks.workunit.client.0.smithi142.stdout:8/945: fdatasync d0/d1c/d44/d89/fa3 0 2024-04-20T21:58:49.493 INFO:tasks.workunit.client.1.smithi164.stdout:1/36: read f0 [377092,126337] 0 2024-04-20T21:58:49.494 INFO:tasks.workunit.client.0.smithi142.stdout:8/946: mkdir d0/d17/d6e/d14e 0 2024-04-20T21:58:49.495 INFO:tasks.workunit.client.1.smithi164.stdout:1/37: rmdir - no directory 2024-04-20T21:58:49.496 INFO:tasks.workunit.client.1.smithi164.stdout:4/16: write d4/f7 [857032,49939] 0 2024-04-20T21:58:49.497 INFO:tasks.workunit.client.0.smithi142.stdout:8/947: dread - d0/d1c/d44/dad/db3/d3f/d7f/f128 zero size 2024-04-20T21:58:49.499 INFO:tasks.workunit.client.0.smithi142.stdout:8/948: read - d0/d29/df5/d11e/f14a zero size 2024-04-20T21:58:49.503 INFO:tasks.workunit.client.1.smithi164.stdout:1/38: creat fb x:0 0 0 2024-04-20T21:58:49.505 INFO:tasks.workunit.client.1.smithi164.stdout:4/17: write d4/f6 [595116,95920] 0 2024-04-20T21:58:49.505 INFO:tasks.workunit.client.1.smithi164.stdout:1/39: stat f7 0 2024-04-20T21:58:49.505 INFO:tasks.workunit.client.1.smithi164.stdout:7/28: dwrite f1 [0,4194304] 0 2024-04-20T21:58:49.506 INFO:tasks.workunit.client.0.smithi142.stdout:8/949: link d0/d1c/d44/d89/d45/d59/la9 d0/d1c/d44/d89/d45/d4c/l14f 0 2024-04-20T21:58:49.506 INFO:tasks.workunit.client.1.smithi164.stdout:9/31: dread - d3/f6 zero size 2024-04-20T21:58:49.507 INFO:tasks.workunit.client.1.smithi164.stdout:7/29: readlink l0 0 2024-04-20T21:58:49.508 INFO:tasks.workunit.client.1.smithi164.stdout:1/40: chown l9 387621 1 2024-04-20T21:58:49.510 INFO:tasks.workunit.client.1.smithi164.stdout:6/72: dwrite d0/d3/f10 [0,4194304] 0 2024-04-20T21:58:49.511 INFO:tasks.workunit.client.0.smithi142.stdout:8/950: creat d0/d17/d6e/d110/f150 x:0 0 0 2024-04-20T21:58:49.516 INFO:tasks.workunit.client.0.smithi142.stdout:8/951: symlink d0/d1c/d44/dad/db3/d13b/l151 0 2024-04-20T21:58:49.518 INFO:tasks.workunit.client.1.smithi164.stdout:0/51: truncate d1/fb 293481 0 2024-04-20T21:58:49.518 INFO:tasks.workunit.client.1.smithi164.stdout:3/53: truncate f9 271478 0 2024-04-20T21:58:49.519 INFO:tasks.workunit.client.1.smithi164.stdout:3/54: rmdir - no directory 2024-04-20T21:58:49.520 INFO:tasks.workunit.client.1.smithi164.stdout:6/73: creat d0/d3/f12 x:0 0 0 2024-04-20T21:58:49.520 INFO:tasks.workunit.client.0.smithi142.stdout:8/952: mkdir d0/d1c/d44/dad/db3/d3f/d7f/d8f/d152 0 2024-04-20T21:58:49.520 INFO:tasks.workunit.client.1.smithi164.stdout:9/32: mknod d3/c7 0 2024-04-20T21:58:49.523 INFO:tasks.workunit.client.1.smithi164.stdout:1/41: dread f0 [0,4194304] 0 2024-04-20T21:58:49.523 INFO:tasks.workunit.client.0.smithi142.stdout:8/953: write d0/d17/d6e/d110/fa8 [3318916,113458] 0 2024-04-20T21:58:49.527 INFO:tasks.workunit.client.1.smithi164.stdout:7/30: dread f1 [0,4194304] 0 2024-04-20T21:58:49.529 INFO:tasks.workunit.client.1.smithi164.stdout:2/21: dread d2/f3 [0,4194304] 0 2024-04-20T21:58:49.529 INFO:tasks.workunit.client.1.smithi164.stdout:9/33: chown d3/c4 718207597 1 2024-04-20T21:58:49.532 INFO:tasks.workunit.client.1.smithi164.stdout:9/34: fdatasync d3/f6 0 2024-04-20T21:58:49.534 INFO:tasks.workunit.client.1.smithi164.stdout:7/31: unlink l0 0 2024-04-20T21:58:49.536 INFO:tasks.workunit.client.1.smithi164.stdout:1/42: read f7 [104198,71307] 0 2024-04-20T21:58:49.538 INFO:tasks.workunit.client.1.smithi164.stdout:2/22: mknod d2/c4 0 2024-04-20T21:58:49.540 INFO:tasks.workunit.client.1.smithi164.stdout:7/32: fsync f1 0 2024-04-20T21:58:49.541 INFO:tasks.workunit.client.1.smithi164.stdout:9/35: write d3/f6 [293649,105370] 0 2024-04-20T21:58:49.542 INFO:tasks.workunit.client.1.smithi164.stdout:2/23: rmdir d2 39 2024-04-20T21:58:49.543 INFO:tasks.workunit.client.0.smithi142.stdout:8/954: write d0/d29/f6c [82543,5831] 0 2024-04-20T21:58:49.543 INFO:tasks.workunit.client.1.smithi164.stdout:1/43: chown fb 362650231 1 2024-04-20T21:58:49.545 INFO:tasks.workunit.client.1.smithi164.stdout:9/36: chown c1 203030222 1 2024-04-20T21:58:49.550 INFO:tasks.workunit.client.1.smithi164.stdout:3/55: dwrite fa [0,4194304] 0 2024-04-20T21:58:49.553 INFO:tasks.workunit.client.1.smithi164.stdout:5/22: sync 2024-04-20T21:58:49.553 INFO:tasks.workunit.client.1.smithi164.stdout:8/30: sync 2024-04-20T21:58:49.553 INFO:tasks.workunit.client.1.smithi164.stdout:7/33: link f1 d2/f3 0 2024-04-20T21:58:49.555 INFO:tasks.workunit.client.1.smithi164.stdout:9/37: creat d3/f8 x:0 0 0 2024-04-20T21:58:49.558 INFO:tasks.workunit.client.1.smithi164.stdout:0/52: dwrite d1/f8 [0,4194304] 0 2024-04-20T21:58:49.560 INFO:tasks.workunit.client.0.smithi142.stdout:8/955: dwrite d0/d29/f2e [0,4194304] 0 2024-04-20T21:58:49.563 INFO:tasks.workunit.client.1.smithi164.stdout:0/53: fsync d1/f9 0 2024-04-20T21:58:49.564 INFO:tasks.workunit.client.1.smithi164.stdout:9/38: write d3/f6 [1376693,90275] 0 2024-04-20T21:58:49.564 INFO:tasks.workunit.client.1.smithi164.stdout:8/31: creat d0/fe x:0 0 0 2024-04-20T21:58:49.566 INFO:tasks.workunit.client.0.smithi142.stdout:8/956: symlink d0/d132/db5/de2/d14c/l153 0 2024-04-20T21:58:49.569 INFO:tasks.workunit.client.1.smithi164.stdout:8/32: read - d0/fe zero size 2024-04-20T21:58:49.572 INFO:tasks.workunit.client.0.smithi142.stdout:8/957: truncate d0/d1c/d44/d89/d45/f56 1675940 0 2024-04-20T21:58:49.574 INFO:tasks.workunit.client.0.smithi142.stdout:8/958: mkdir d0/d1c/d154 0 2024-04-20T21:58:49.577 INFO:tasks.workunit.client.1.smithi164.stdout:6/74: dwrite d0/f4 [0,4194304] 0 2024-04-20T21:58:49.580 INFO:tasks.workunit.client.1.smithi164.stdout:6/75: readlink d0/l7 0 2024-04-20T21:58:49.586 INFO:tasks.workunit.client.1.smithi164.stdout:5/23: truncate f3 2739124 0 2024-04-20T21:58:49.596 INFO:tasks.workunit.client.1.smithi164.stdout:1/44: dread f0 [0,4194304] 0 2024-04-20T21:58:49.598 INFO:tasks.workunit.client.0.smithi142.stdout:8/959: dread d0/d1c/d44/dad/db3/f52 [0,4194304] 0 2024-04-20T21:58:49.599 INFO:tasks.workunit.client.1.smithi164.stdout:5/24: creat f6 x:0 0 0 2024-04-20T21:58:49.599 INFO:tasks.workunit.client.1.smithi164.stdout:7/34: dwrite f1 [0,4194304] 0 2024-04-20T21:58:49.599 INFO:tasks.workunit.client.1.smithi164.stdout:1/45: readlink l4 0 2024-04-20T21:58:49.600 INFO:tasks.workunit.client.1.smithi164.stdout:4/18: sync 2024-04-20T21:58:49.601 INFO:tasks.workunit.client.0.smithi142.stdout:8/960: mkdir d0/d17/d6e/d110/de8/d155 0 2024-04-20T21:58:49.602 INFO:tasks.workunit.client.1.smithi164.stdout:8/33: link d0/c1 d0/cf 0 2024-04-20T21:58:49.603 INFO:tasks.workunit.client.0.smithi142.stdout:8/961: rmdir d0/d42/d90 39 2024-04-20T21:58:49.605 INFO:tasks.workunit.client.1.smithi164.stdout:2/24: dwrite d2/f3 [0,4194304] 0 2024-04-20T21:58:49.605 INFO:tasks.workunit.client.0.smithi142.stdout:8/962: creat d0/d29/df5/f156 x:0 0 0 2024-04-20T21:58:49.610 INFO:tasks.workunit.client.1.smithi164.stdout:1/46: write f5 [904728,29221] 0 2024-04-20T21:58:49.610 INFO:tasks.workunit.client.0.smithi142.stdout:8/963: symlink d0/d1c/d44/d89/d45/d4c/d68/d108/l157 0 2024-04-20T21:58:49.613 INFO:tasks.workunit.client.1.smithi164.stdout:4/19: mkdir d4/d9 0 2024-04-20T21:58:49.613 INFO:tasks.workunit.client.0.smithi142.stdout:8/964: mkdir d0/d1c/d158 0 2024-04-20T21:58:49.617 INFO:tasks.workunit.client.0.smithi142.stdout:8/965: unlink d0/d1c/d44/d89/d45/f4d 0 2024-04-20T21:58:49.619 INFO:tasks.workunit.client.1.smithi164.stdout:9/39: dwrite d3/f8 [0,4194304] 0 2024-04-20T21:58:49.625 INFO:tasks.workunit.client.1.smithi164.stdout:2/25: mkdir d2/d5 0 2024-04-20T21:58:49.626 INFO:tasks.workunit.client.1.smithi164.stdout:4/20: read - d4/f5 zero size 2024-04-20T21:58:49.627 INFO:tasks.workunit.client.1.smithi164.stdout:5/25: dread f4 [0,4194304] 0 2024-04-20T21:58:49.628 INFO:tasks.workunit.client.1.smithi164.stdout:0/54: dwrite d1/f8 [0,4194304] 0 2024-04-20T21:58:49.629 INFO:tasks.workunit.client.1.smithi164.stdout:4/21: fsync f2 0 2024-04-20T21:58:49.634 INFO:tasks.workunit.client.1.smithi164.stdout:7/35: rename d2/f3 to d2/f4 0 2024-04-20T21:58:49.638 INFO:tasks.workunit.client.1.smithi164.stdout:3/56: dwrite f6 [0,4194304] 0 2024-04-20T21:58:49.640 INFO:tasks.workunit.client.1.smithi164.stdout:2/26: mknod d2/c6 0 2024-04-20T21:58:49.642 INFO:tasks.workunit.client.1.smithi164.stdout:1/47: write f7 [1188532,35061] 0 2024-04-20T21:58:49.645 INFO:tasks.workunit.client.1.smithi164.stdout:4/22: creat d4/fa x:0 0 0 2024-04-20T21:58:49.646 INFO:tasks.workunit.client.1.smithi164.stdout:0/55: write d1/f8 [555732,15243] 0 2024-04-20T21:58:49.648 INFO:tasks.workunit.client.0.smithi142.stdout:8/966: dread d0/d1c/f2d [0,4194304] 0 2024-04-20T21:58:49.649 INFO:tasks.workunit.client.1.smithi164.stdout:6/76: dread d0/f4 [0,4194304] 0 2024-04-20T21:58:49.653 INFO:tasks.workunit.client.1.smithi164.stdout:3/57: creat fd x:0 0 0 2024-04-20T21:58:49.654 INFO:tasks.workunit.client.1.smithi164.stdout:9/40: creat d3/f9 x:0 0 0 2024-04-20T21:58:49.655 INFO:tasks.workunit.client.0.smithi142.stdout:8/967: rename d0/d1c/d44/d89/d45/d59/la9 to d0/d1c/d44/d89/l159 0 2024-04-20T21:58:49.655 INFO:tasks.workunit.client.1.smithi164.stdout:1/48: symlink lc 0 2024-04-20T21:58:49.656 INFO:tasks.workunit.client.1.smithi164.stdout:9/41: readlink d3/l5 0 2024-04-20T21:58:49.657 INFO:tasks.workunit.client.1.smithi164.stdout:0/56: creat d1/d4/fc x:0 0 0 2024-04-20T21:58:49.659 INFO:tasks.workunit.client.1.smithi164.stdout:2/27: getdents d2/d5 0 2024-04-20T21:58:49.659 INFO:tasks.workunit.client.1.smithi164.stdout:8/34: dwrite d0/fe [0,4194304] 0 2024-04-20T21:58:49.660 INFO:tasks.workunit.client.0.smithi142.stdout:8/968: mkdir d0/d1c/d44/dad/db3/d3f/d15a 0 2024-04-20T21:58:49.661 INFO:tasks.workunit.client.1.smithi164.stdout:3/58: symlink le 0 2024-04-20T21:58:49.664 INFO:tasks.workunit.client.1.smithi164.stdout:4/23: link d4/fa d4/fb 0 2024-04-20T21:58:49.665 INFO:tasks.workunit.client.1.smithi164.stdout:9/42: write d3/f8 [2431014,76692] 0 2024-04-20T21:58:49.665 INFO:tasks.workunit.client.1.smithi164.stdout:5/26: getdents . 0 2024-04-20T21:58:49.666 INFO:tasks.workunit.client.1.smithi164.stdout:2/28: write d2/f3 [3443034,126790] 0 2024-04-20T21:58:49.668 INFO:tasks.workunit.client.0.smithi142.stdout:8/969: getdents d0/d17/d6e/d14e 0 2024-04-20T21:58:49.668 INFO:tasks.workunit.client.1.smithi164.stdout:3/59: truncate fd 975573 0 2024-04-20T21:58:49.668 INFO:tasks.workunit.client.1.smithi164.stdout:5/27: read - f6 zero size 2024-04-20T21:58:49.670 INFO:tasks.workunit.client.1.smithi164.stdout:4/24: write d4/f7 [758993,54685] 0 2024-04-20T21:58:49.670 INFO:tasks.workunit.client.1.smithi164.stdout:6/77: creat d0/d3/d11/f13 x:0 0 0 2024-04-20T21:58:49.670 INFO:tasks.workunit.client.1.smithi164.stdout:8/35: creat d0/d8/f10 x:0 0 0 2024-04-20T21:58:49.674 INFO:tasks.workunit.client.1.smithi164.stdout:3/60: write fa [319084,114725] 0 2024-04-20T21:58:49.675 INFO:tasks.workunit.client.1.smithi164.stdout:8/36: write d0/fe [3741650,29818] 0 2024-04-20T21:58:49.680 INFO:tasks.workunit.client.1.smithi164.stdout:5/28: creat f7 x:0 0 0 2024-04-20T21:58:49.680 INFO:tasks.workunit.client.1.smithi164.stdout:1/49: dread f7 [0,4194304] 0 2024-04-20T21:58:49.680 INFO:tasks.workunit.client.1.smithi164.stdout:4/25: unlink d4/f5 0 2024-04-20T21:58:49.681 INFO:tasks.workunit.client.1.smithi164.stdout:9/43: creat d3/fa x:0 0 0 2024-04-20T21:58:49.682 INFO:tasks.workunit.client.1.smithi164.stdout:3/61: creat ff x:0 0 0 2024-04-20T21:58:49.682 INFO:tasks.workunit.client.1.smithi164.stdout:6/78: dread d0/f6 [0,4194304] 0 2024-04-20T21:58:49.683 INFO:tasks.workunit.client.1.smithi164.stdout:4/26: write f2 [523173,45775] 0 2024-04-20T21:58:49.684 INFO:tasks.workunit.client.1.smithi164.stdout:8/37: creat d0/f11 x:0 0 0 2024-04-20T21:58:49.685 INFO:tasks.workunit.client.1.smithi164.stdout:1/50: rename fb to fd 0 2024-04-20T21:58:49.686 INFO:tasks.workunit.client.1.smithi164.stdout:6/79: stat d0/d3/f12 0 2024-04-20T21:58:49.688 INFO:tasks.workunit.client.0.smithi142.stdout:8/970: dwrite d0/d1c/d44/d89/f138 [0,4194304] 0 2024-04-20T21:58:49.689 INFO:tasks.workunit.client.1.smithi164.stdout:1/51: fsync f1 0 2024-04-20T21:58:49.693 INFO:tasks.workunit.client.1.smithi164.stdout:6/80: write d0/d3/f12 [46621,68933] 0 2024-04-20T21:58:49.693 INFO:tasks.workunit.client.1.smithi164.stdout:4/27: creat d4/d9/fc x:0 0 0 2024-04-20T21:58:49.697 INFO:tasks.workunit.client.1.smithi164.stdout:6/81: write d0/d3/f12 [471030,92930] 0 2024-04-20T21:58:49.699 INFO:tasks.workunit.client.0.smithi142.stdout:8/971: getdents d0/d132/db5 0 2024-04-20T21:58:49.700 INFO:tasks.workunit.client.1.smithi164.stdout:6/82: chown d0/d3/l9 21 1 2024-04-20T21:58:49.703 INFO:tasks.workunit.client.0.smithi142.stdout:8/972: chown d0/d1c/d44/dad/db3/d3f/fd8 1 1 2024-04-20T21:58:49.704 INFO:tasks.workunit.client.1.smithi164.stdout:4/28: creat d4/d9/fd x:0 0 0 2024-04-20T21:58:49.705 INFO:tasks.workunit.client.1.smithi164.stdout:0/57: rmdir d1 39 2024-04-20T21:58:49.706 INFO:tasks.workunit.client.1.smithi164.stdout:1/52: dread f5 [0,4194304] 0 2024-04-20T21:58:49.707 INFO:tasks.workunit.client.1.smithi164.stdout:6/83: unlink d0/d3/d11/f13 0 2024-04-20T21:58:49.707 INFO:tasks.workunit.client.0.smithi142.stdout:0/894: sync 2024-04-20T21:58:49.707 INFO:tasks.workunit.client.0.smithi142.stdout:4/854: sync 2024-04-20T21:58:49.710 INFO:tasks.workunit.client.1.smithi164.stdout:7/36: truncate d2/f4 2481371 0 2024-04-20T21:58:49.711 INFO:tasks.workunit.client.1.smithi164.stdout:5/29: dread f3 [0,4194304] 0 2024-04-20T21:58:49.713 INFO:tasks.workunit.client.1.smithi164.stdout:3/62: dread fa [0,4194304] 0 2024-04-20T21:58:49.713 INFO:tasks.workunit.client.1.smithi164.stdout:1/53: symlink le 0 2024-04-20T21:58:49.713 INFO:tasks.workunit.client.0.smithi142.stdout:4/855: truncate d1/d12/da/d1c/d32/d3d/d2f/d73/fd1 315282 0 2024-04-20T21:58:49.715 INFO:tasks.workunit.client.1.smithi164.stdout:6/84: dread d0/f6 [0,4194304] 0 2024-04-20T21:58:49.715 INFO:tasks.workunit.client.1.smithi164.stdout:0/58: rename d1 to d1/d4/da/dd 22 2024-04-20T21:58:49.717 INFO:tasks.workunit.client.0.smithi142.stdout:8/973: rmdir d0/d1c/d44/dad/db3/d3f/d7f/d8f/d145 0 2024-04-20T21:58:49.719 INFO:tasks.workunit.client.1.smithi164.stdout:5/30: write f5 [36240,129697] 0 2024-04-20T21:58:49.720 INFO:tasks.workunit.client.0.smithi142.stdout:4/856: rmdir d1/d6/d4a/d5a/d80/dd7 39 2024-04-20T21:58:49.722 INFO:tasks.workunit.client.1.smithi164.stdout:8/38: dwrite d0/d8/f10 [0,4194304] 0 2024-04-20T21:58:49.722 INFO:tasks.workunit.client.1.smithi164.stdout:0/59: write d1/f8 [5018105,100647] 0 2024-04-20T21:58:49.724 INFO:tasks.workunit.client.1.smithi164.stdout:7/37: creat d2/f5 x:0 0 0 2024-04-20T21:58:49.724 INFO:tasks.workunit.client.0.smithi142.stdout:0/895: dwrite d5/d1c/d3c/d85/d38/d62/f89 [0,4194304] 0 2024-04-20T21:58:49.727 INFO:tasks.workunit.client.1.smithi164.stdout:1/54: rename le to lf 0 2024-04-20T21:58:49.728 INFO:tasks.workunit.client.1.smithi164.stdout:8/39: dread - d0/fc zero size 2024-04-20T21:58:49.728 INFO:tasks.workunit.client.1.smithi164.stdout:2/29: truncate d2/f3 519444 0 2024-04-20T21:58:49.728 INFO:tasks.workunit.client.0.smithi142.stdout:8/974: fdatasync d0/d1c/d44/d89/d45/d4c/d68/fa6 0 2024-04-20T21:58:49.731 INFO:tasks.workunit.client.0.smithi142.stdout:0/896: mknod d5/d13/d1e/d8f/c116 0 2024-04-20T21:58:49.734 INFO:tasks.workunit.client.0.smithi142.stdout:4/857: creat d1/d5b/f10e x:0 0 0 2024-04-20T21:58:49.734 INFO:tasks.workunit.client.1.smithi164.stdout:2/30: rename d2/d5 to d2/d5/d7 22 2024-04-20T21:58:49.735 INFO:tasks.workunit.client.1.smithi164.stdout:1/55: mkdir d10 0 2024-04-20T21:58:49.735 INFO:tasks.workunit.client.1.smithi164.stdout:9/44: truncate d3/f8 1309056 0 2024-04-20T21:58:49.737 INFO:tasks.workunit.client.1.smithi164.stdout:1/56: chown f5 6 1 2024-04-20T21:58:49.737 INFO:tasks.workunit.client.0.smithi142.stdout:8/975: fdatasync d0/d132/f80 0 2024-04-20T21:58:49.740 INFO:tasks.workunit.client.1.smithi164.stdout:3/63: dread fa [0,4194304] 0 2024-04-20T21:58:49.741 INFO:tasks.workunit.client.0.smithi142.stdout:4/858: creat d1/d12/da/d72/dc5/f10f x:0 0 0 2024-04-20T21:58:49.743 INFO:tasks.workunit.client.1.smithi164.stdout:4/29: rmdir d4/d9 39 2024-04-20T21:58:49.744 INFO:tasks.workunit.client.1.smithi164.stdout:9/45: write d3/fa [227552,82090] 0 2024-04-20T21:58:49.745 INFO:tasks.workunit.client.1.smithi164.stdout:0/60: symlink d1/d4/da/le 0 2024-04-20T21:58:49.746 INFO:tasks.workunit.client.1.smithi164.stdout:7/38: fsync f1 0 2024-04-20T21:58:49.746 INFO:tasks.workunit.client.0.smithi142.stdout:0/897: truncate d5/d13/d1e/d23/d24/f33 3754840 0 2024-04-20T21:58:49.750 INFO:tasks.workunit.client.1.smithi164.stdout:5/31: dwrite f7 [0,4194304] 0 2024-04-20T21:58:49.751 INFO:tasks.workunit.client.0.smithi142.stdout:8/976: symlink d0/d1c/dd1/l15b 0 2024-04-20T21:58:49.754 INFO:tasks.workunit.client.1.smithi164.stdout:8/40: rename d0/d2/f4 to d0/d2/f12 0 2024-04-20T21:58:49.759 INFO:tasks.workunit.client.0.smithi142.stdout:8/977: truncate d0/d1c/f1e 1861050 0 2024-04-20T21:58:49.761 INFO:tasks.workunit.client.0.smithi142.stdout:8/978: fsync d0/d29/f3d 0 2024-04-20T21:58:49.762 INFO:tasks.workunit.client.1.smithi164.stdout:3/64: creat f10 x:0 0 0 2024-04-20T21:58:49.766 INFO:tasks.workunit.client.1.smithi164.stdout:7/39: symlink d2/l6 0 2024-04-20T21:58:49.767 INFO:tasks.workunit.client.0.smithi142.stdout:0/898: dwrite d5/d13/d1e/d23/d24/f2a [4194304,4194304] 0 2024-04-20T21:58:49.770 INFO:tasks.workunit.client.1.smithi164.stdout:6/85: link d0/d3/cc d0/c14 0 2024-04-20T21:58:49.770 INFO:tasks.workunit.client.1.smithi164.stdout:7/40: stat d2/l6 0 2024-04-20T21:58:49.771 INFO:tasks.workunit.client.1.smithi164.stdout:5/32: creat f8 x:0 0 0 2024-04-20T21:58:49.772 INFO:tasks.workunit.client.0.smithi142.stdout:4/859: dread d1/d12/da/f7f [0,4194304] 0 2024-04-20T21:58:49.772 INFO:tasks.workunit.client.0.smithi142.stdout:8/979: mknod d0/d1c/d44/d89/d45/c15c 0 2024-04-20T21:58:49.776 INFO:tasks.workunit.client.0.smithi142.stdout:0/899: creat d5/dc9/f117 x:0 0 0 2024-04-20T21:58:49.782 INFO:tasks.workunit.client.0.smithi142.stdout:4/860: rmdir d1/d6/d4a/db0 39 2024-04-20T21:58:49.783 INFO:tasks.workunit.client.0.smithi142.stdout:4/861: write d1/d12/faa [3832497,28480] 0 2024-04-20T21:58:49.790 INFO:tasks.workunit.client.0.smithi142.stdout:8/980: rmdir d0/d141 0 2024-04-20T21:58:49.791 INFO:tasks.workunit.client.0.smithi142.stdout:4/862: chown d1/d12/da/d37/ce3 1 1 2024-04-20T21:58:49.793 INFO:tasks.workunit.client.0.smithi142.stdout:4/863: chown d1/d12/da/d72/dc5 17724 1 2024-04-20T21:58:49.794 INFO:tasks.workunit.client.0.smithi142.stdout:8/981: rmdir d0/d1c/d44/d89/d45/d4c 39 2024-04-20T21:58:49.795 INFO:tasks.workunit.client.0.smithi142.stdout:4/864: stat d1/d12/da/d1c/d32/f60 0 2024-04-20T21:58:49.800 INFO:tasks.workunit.client.0.smithi142.stdout:0/900: write d5/f8 [1467935,15686] 0 2024-04-20T21:58:49.800 INFO:tasks.workunit.client.1.smithi164.stdout:9/46: mkdir d3/db 0 2024-04-20T21:58:49.806 INFO:tasks.workunit.client.0.smithi142.stdout:0/901: unlink d5/d45/la1 0 2024-04-20T21:58:49.809 INFO:tasks.workunit.client.1.smithi164.stdout:1/57: dwrite f1 [0,4194304] 0 2024-04-20T21:58:49.811 INFO:tasks.workunit.client.1.smithi164.stdout:6/86: rmdir d0/d3/d8 39 2024-04-20T21:58:49.812 INFO:tasks.workunit.client.1.smithi164.stdout:0/61: dwrite d1/f9 [0,4194304] 0 2024-04-20T21:58:49.812 INFO:tasks.workunit.client.1.smithi164.stdout:4/30: creat d4/fe x:0 0 0 2024-04-20T21:58:49.813 INFO:tasks.workunit.client.0.smithi142.stdout:4/865: link d1/d12/da/d1c/l6f d1/d6/d4a/d5a/d80/dd7/l110 0 2024-04-20T21:58:49.813 INFO:tasks.workunit.client.1.smithi164.stdout:7/41: creat d2/f7 x:0 0 0 2024-04-20T21:58:49.815 INFO:tasks.workunit.client.0.smithi142.stdout:8/982: dwrite d0/d17/f6d [0,4194304] 0 2024-04-20T21:58:49.818 INFO:tasks.workunit.client.0.smithi142.stdout:8/983: chown d0/d29/df5/d11e/f14a 32309 1 2024-04-20T21:58:49.818 INFO:tasks.workunit.client.1.smithi164.stdout:5/33: link f6 f9 0 2024-04-20T21:58:49.818 INFO:tasks.workunit.client.1.smithi164.stdout:1/58: write f5 [1142131,72904] 0 2024-04-20T21:58:49.821 INFO:tasks.workunit.client.0.smithi142.stdout:4/866: creat d1/d12/da/d1c/d32/d3d/f111 x:0 0 0 2024-04-20T21:58:49.823 INFO:tasks.workunit.client.1.smithi164.stdout:2/31: dwrite d2/f3 [0,4194304] 0 2024-04-20T21:58:49.823 INFO:tasks.workunit.client.1.smithi164.stdout:6/87: mkdir d0/d3/d15 0 2024-04-20T21:58:49.824 INFO:tasks.workunit.client.1.smithi164.stdout:0/62: mkdir d1/d4/df 0 2024-04-20T21:58:49.829 INFO:tasks.workunit.client.0.smithi142.stdout:0/902: write d5/d45/f50 [4914067,90792] 0 2024-04-20T21:58:49.829 INFO:tasks.workunit.client.1.smithi164.stdout:5/34: symlink la 0 2024-04-20T21:58:49.831 INFO:tasks.workunit.client.0.smithi142.stdout:0/903: chown d5/f18 15945 1 2024-04-20T21:58:49.833 INFO:tasks.workunit.client.0.smithi142.stdout:0/904: write d5/d13/fbe [381252,11267] 0 2024-04-20T21:58:49.834 INFO:tasks.workunit.client.1.smithi164.stdout:6/88: dread d0/f6 [0,4194304] 0 2024-04-20T21:58:49.836 INFO:tasks.workunit.client.0.smithi142.stdout:4/867: write d1/d12/da/f7f [3539656,44546] 0 2024-04-20T21:58:49.836 INFO:tasks.workunit.client.0.smithi142.stdout:0/905: truncate d5/d13/d1e/ff8 698479 0 2024-04-20T21:58:49.839 INFO:tasks.workunit.client.1.smithi164.stdout:0/63: rmdir d1/d4 39 2024-04-20T21:58:49.842 INFO:tasks.workunit.client.1.smithi164.stdout:4/31: creat d4/ff x:0 0 0 2024-04-20T21:58:49.842 INFO:tasks.workunit.client.0.smithi142.stdout:0/906: creat d5/d6d/f118 x:0 0 0 2024-04-20T21:58:49.846 INFO:tasks.workunit.client.1.smithi164.stdout:4/32: chown d4 55479146 1 2024-04-20T21:58:49.848 INFO:tasks.workunit.client.0.smithi142.stdout:0/907: fdatasync d5/d13/d1e/fc5 0 2024-04-20T21:58:49.853 INFO:tasks.workunit.client.0.smithi142.stdout:0/908: truncate d5/d13/f7d 1739410 0 2024-04-20T21:58:49.854 INFO:tasks.workunit.client.0.smithi142.stdout:4/868: dwrite d1/d12/da/fff [0,4194304] 0 2024-04-20T21:58:49.856 INFO:tasks.workunit.client.0.smithi142.stdout:4/869: dread - d1/d12/da/d1c/f88 zero size 2024-04-20T21:58:49.858 INFO:tasks.workunit.client.0.smithi142.stdout:0/909: read d5/dc9/ff0 [6571361,63609] 0 2024-04-20T21:58:49.860 INFO:tasks.workunit.client.0.smithi142.stdout:0/910: chown l3 126 1 2024-04-20T21:58:49.860 INFO:tasks.workunit.client.1.smithi164.stdout:9/47: dwrite d3/f9 [0,4194304] 0 2024-04-20T21:58:49.862 INFO:tasks.workunit.client.1.smithi164.stdout:3/65: dwrite f4 [0,4194304] 0 2024-04-20T21:58:49.865 INFO:tasks.workunit.client.0.smithi142.stdout:4/870: truncate d1/d6/fc7 261032 0 2024-04-20T21:58:49.869 INFO:tasks.workunit.client.0.smithi142.stdout:4/871: symlink d1/d5b/ddd/l112 0 2024-04-20T21:58:49.872 INFO:tasks.workunit.client.1.smithi164.stdout:0/64: creat d1/f10 x:0 0 0 2024-04-20T21:58:49.874 INFO:tasks.workunit.client.1.smithi164.stdout:4/33: mknod d4/c10 0 2024-04-20T21:58:49.874 INFO:tasks.workunit.client.0.smithi142.stdout:4/872: chown d1/d12/da/d37/c109 14 1 2024-04-20T21:58:49.875 INFO:tasks.workunit.client.1.smithi164.stdout:3/66: fdatasync f10 0 2024-04-20T21:58:49.878 INFO:tasks.workunit.client.0.smithi142.stdout:0/911: dwrite d5/d1c/f113 [0,4194304] 0 2024-04-20T21:58:49.888 INFO:tasks.workunit.client.1.smithi164.stdout:7/42: dwrite f1 [0,4194304] 0 2024-04-20T21:58:49.891 INFO:tasks.workunit.client.1.smithi164.stdout:2/32: dread d2/f3 [0,4194304] 0 2024-04-20T21:58:49.891 INFO:tasks.workunit.client.0.smithi142.stdout:4/873: dwrite d1/d12/da/d1c/f9f [0,4194304] 0 2024-04-20T21:58:49.892 INFO:tasks.workunit.client.1.smithi164.stdout:8/41: sync 2024-04-20T21:58:49.896 INFO:tasks.workunit.client.1.smithi164.stdout:5/35: dwrite f8 [0,4194304] 0 2024-04-20T21:58:49.904 INFO:tasks.workunit.client.1.smithi164.stdout:6/89: dwrite d0/f4 [4194304,4194304] 0 2024-04-20T21:58:49.917 INFO:tasks.workunit.client.1.smithi164.stdout:6/90: chown d0/d3/l9 706585281 1 2024-04-20T21:58:49.934 INFO:tasks.workunit.client.1.smithi164.stdout:1/59: sync 2024-04-20T21:58:49.938 INFO:tasks.workunit.client.1.smithi164.stdout:4/34: dwrite f3 [0,4194304] 0 2024-04-20T21:58:49.942 INFO:tasks.workunit.client.1.smithi164.stdout:0/65: dwrite d1/f10 [0,4194304] 0 2024-04-20T21:58:49.950 INFO:tasks.workunit.client.1.smithi164.stdout:1/60: dread f5 [0,4194304] 0 2024-04-20T21:58:49.958 INFO:tasks.workunit.client.0.smithi142.stdout:0/912: creat d5/d13/d1e/d23/d24/d48/db6/f119 x:0 0 0 2024-04-20T21:58:49.963 INFO:tasks.workunit.client.1.smithi164.stdout:7/43: mknod d2/c8 0 2024-04-20T21:58:49.964 INFO:tasks.workunit.client.1.smithi164.stdout:5/36: mknod cb 0 2024-04-20T21:58:49.964 INFO:tasks.workunit.client.1.smithi164.stdout:5/37: rmdir - no directory 2024-04-20T21:58:49.967 INFO:tasks.workunit.client.1.smithi164.stdout:2/33: mknod d2/c8 0 2024-04-20T21:58:49.971 INFO:tasks.workunit.client.1.smithi164.stdout:8/42: unlink d0/d8/f10 0 2024-04-20T21:58:49.972 INFO:tasks.workunit.client.1.smithi164.stdout:4/35: dwrite d4/f6 [0,4194304] 0 2024-04-20T21:58:49.972 INFO:tasks.workunit.client.1.smithi164.stdout:8/43: chown d0/d2 2935 1 2024-04-20T21:58:49.977 INFO:tasks.workunit.client.1.smithi164.stdout:4/36: dread - d4/fb zero size 2024-04-20T21:58:49.977 INFO:tasks.workunit.client.1.smithi164.stdout:8/44: write d0/f11 [641285,38735] 0 2024-04-20T21:58:49.979 INFO:tasks.workunit.client.1.smithi164.stdout:8/45: stat d0/d2/f6 0 2024-04-20T21:58:49.983 INFO:tasks.workunit.client.1.smithi164.stdout:8/46: write d0/d2/fa [1030958,87161] 0 2024-04-20T21:58:49.990 INFO:tasks.workunit.client.1.smithi164.stdout:6/91: dread d0/d3/d8/fa [0,4194304] 0 2024-04-20T21:58:49.996 INFO:tasks.workunit.client.1.smithi164.stdout:7/44: mknod d2/c9 0 2024-04-20T21:58:50.005 INFO:tasks.workunit.client.1.smithi164.stdout:9/48: link c2 d3/cc 0 2024-04-20T21:58:50.006 INFO:tasks.workunit.client.1.smithi164.stdout:6/92: readlink d0/l2 0 2024-04-20T21:58:50.009 INFO:tasks.workunit.client.1.smithi164.stdout:4/37: rmdir d4/d9 39 2024-04-20T21:58:50.010 INFO:tasks.workunit.client.1.smithi164.stdout:6/93: write d0/d3/f12 [300608,76123] 0 2024-04-20T21:58:50.010 INFO:tasks.workunit.client.1.smithi164.stdout:0/66: mknod d1/d4/df/c11 0 2024-04-20T21:58:50.013 INFO:tasks.workunit.client.1.smithi164.stdout:7/45: link d2/f4 d2/fa 0 2024-04-20T21:58:50.014 INFO:tasks.workunit.client.1.smithi164.stdout:0/67: chown d1/f9 1116 1 2024-04-20T21:58:50.020 INFO:tasks.workunit.client.1.smithi164.stdout:9/49: mkdir d3/db/dd 0 2024-04-20T21:58:50.022 INFO:tasks.workunit.client.1.smithi164.stdout:2/34: dwrite d2/f3 [0,4194304] 0 2024-04-20T21:58:50.026 INFO:tasks.workunit.client.1.smithi164.stdout:1/61: sync 2024-04-20T21:58:50.028 INFO:tasks.workunit.client.1.smithi164.stdout:0/68: link d1/d4/fc d1/f12 0 2024-04-20T21:58:50.028 INFO:tasks.workunit.client.1.smithi164.stdout:2/35: write d2/f3 [541738,49477] 0 2024-04-20T21:58:50.033 INFO:tasks.workunit.client.1.smithi164.stdout:0/69: chown d1/f9 11436102 1 2024-04-20T21:58:50.036 INFO:tasks.workunit.client.1.smithi164.stdout:1/62: write f0 [2152926,101434] 0 2024-04-20T21:58:50.040 INFO:tasks.workunit.client.1.smithi164.stdout:1/63: write fd [848007,117302] 0 2024-04-20T21:58:50.040 INFO:tasks.workunit.client.1.smithi164.stdout:0/70: symlink d1/d4/l13 0 2024-04-20T21:58:50.042 INFO:tasks.workunit.client.1.smithi164.stdout:1/64: readlink l4 0 2024-04-20T21:58:50.045 INFO:tasks.workunit.client.1.smithi164.stdout:0/71: dread - d1/d4/fc zero size 2024-04-20T21:58:50.048 INFO:tasks.workunit.client.1.smithi164.stdout:7/46: dread f1 [0,4194304] 0 2024-04-20T21:58:50.051 INFO:tasks.workunit.client.1.smithi164.stdout:6/94: dwrite d0/d3/fb [0,4194304] 0 2024-04-20T21:58:50.051 INFO:tasks.workunit.client.1.smithi164.stdout:1/65: unlink lf 0 2024-04-20T21:58:50.054 INFO:tasks.workunit.client.1.smithi164.stdout:1/66: readlink l2 0 2024-04-20T21:58:50.055 INFO:tasks.workunit.client.1.smithi164.stdout:0/72: read d1/f10 [3807033,3742] 0 2024-04-20T21:58:50.059 INFO:tasks.workunit.client.1.smithi164.stdout:7/47: write d2/fa [815290,14522] 0 2024-04-20T21:58:50.063 INFO:tasks.workunit.client.1.smithi164.stdout:2/36: dwrite d2/f3 [0,4194304] 0 2024-04-20T21:58:50.065 INFO:tasks.workunit.client.0.smithi142.stdout:4/874: dwrite d1/d12/da/d1c/d32/f4d [0,4194304] 0 2024-04-20T21:58:50.068 INFO:tasks.workunit.client.0.smithi142.stdout:0/913: dwrite d5/d1d/d7e/f104 [0,4194304] 0 2024-04-20T21:58:50.071 INFO:tasks.workunit.client.1.smithi164.stdout:0/73: symlink d1/d4/df/l14 0 2024-04-20T21:58:50.071 INFO:tasks.workunit.client.1.smithi164.stdout:8/47: rmdir d0 39 2024-04-20T21:58:50.071 INFO:tasks.workunit.client.1.smithi164.stdout:2/37: write d2/f3 [3386743,123093] 0 2024-04-20T21:58:50.073 INFO:tasks.workunit.client.1.smithi164.stdout:1/67: creat d10/f11 x:0 0 0 2024-04-20T21:58:50.073 INFO:tasks.workunit.client.1.smithi164.stdout:6/95: creat d0/f16 x:0 0 0 2024-04-20T21:58:50.075 INFO:tasks.workunit.client.0.smithi142.stdout:4/875: rename d1/d12/da/d1c/d32/d3d/d2f/d7a/d90/f108 to d1/d12/da/d72/dc5/f113 0 2024-04-20T21:58:50.079 INFO:tasks.workunit.client.0.smithi142.stdout:0/914: unlink d5/d1c/d3c/d4a/d78/de5/l10a 0 2024-04-20T21:58:50.081 INFO:tasks.workunit.client.0.smithi142.stdout:0/915: fdatasync d5/d13/d1e/d23/d24/d48/db6/f119 0 2024-04-20T21:58:50.085 INFO:tasks.workunit.client.0.smithi142.stdout:4/876: rename d1/d12/da/d1c/d32/cca to d1/d12/da/d1c/d32/d3d/d2f/d7a/c114 0 2024-04-20T21:58:50.087 INFO:tasks.workunit.client.1.smithi164.stdout:1/68: creat d10/f12 x:0 0 0 2024-04-20T21:58:50.088 INFO:tasks.workunit.client.1.smithi164.stdout:9/50: getdents d3 0 2024-04-20T21:58:50.089 INFO:tasks.workunit.client.0.smithi142.stdout:0/916: creat d5/d13/d1e/d23/d46/de6/f11a x:0 0 0 2024-04-20T21:58:50.091 INFO:tasks.workunit.client.1.smithi164.stdout:0/74: symlink d1/l15 0 2024-04-20T21:58:50.092 INFO:tasks.workunit.client.1.smithi164.stdout:1/69: write d10/f11 [356104,26479] 0 2024-04-20T21:58:50.094 INFO:tasks.workunit.client.0.smithi142.stdout:0/917: fsync d5/d1c/d3c/d4a/fe9 0 2024-04-20T21:58:50.094 INFO:tasks.workunit.client.1.smithi164.stdout:3/67: truncate f6 1682343 0 2024-04-20T21:58:50.095 INFO:tasks.workunit.client.0.smithi142.stdout:0/918: chown d5/d13/d1e/d23/d46/dfc 7904516 1 2024-04-20T21:58:50.095 INFO:tasks.workunit.client.1.smithi164.stdout:3/68: dread - ff zero size 2024-04-20T21:58:50.097 INFO:tasks.workunit.client.1.smithi164.stdout:8/48: creat d0/d2/f13 x:0 0 0 2024-04-20T21:58:50.099 INFO:tasks.workunit.client.0.smithi142.stdout:4/877: dread d1/d12/da/d1c/d32/d3d/d2f/d52/d94/faf [0,4194304] 0 2024-04-20T21:58:50.102 INFO:tasks.workunit.client.1.smithi164.stdout:6/96: symlink d0/l17 0 2024-04-20T21:58:50.102 INFO:tasks.workunit.client.0.smithi142.stdout:4/878: chown d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/c31 285432 1 2024-04-20T21:58:50.103 INFO:tasks.workunit.client.0.smithi142.stdout:0/919: truncate d5/d1c/d3c/d85/f76 3797863 0 2024-04-20T21:58:50.107 INFO:tasks.workunit.client.1.smithi164.stdout:3/69: creat f11 x:0 0 0 2024-04-20T21:58:50.108 INFO:tasks.workunit.client.0.smithi142.stdout:8/984: sync 2024-04-20T21:58:50.110 INFO:tasks.workunit.client.0.smithi142.stdout:8/985: dread - d0/d132/db5/f119 zero size 2024-04-20T21:58:50.112 INFO:tasks.workunit.client.0.smithi142.stdout:0/920: mknod d5/d13/d1e/d23/d46/c11b 0 2024-04-20T21:58:50.112 INFO:tasks.workunit.client.1.smithi164.stdout:4/38: truncate d4/fa 50830 0 2024-04-20T21:58:50.113 INFO:tasks.workunit.client.1.smithi164.stdout:9/51: creat d3/db/dd/fe x:0 0 0 2024-04-20T21:58:50.113 INFO:tasks.workunit.client.1.smithi164.stdout:9/52: fsync d3/fa 0 2024-04-20T21:58:50.114 INFO:tasks.workunit.client.1.smithi164.stdout:5/38: dwrite f9 [0,4194304] 0 2024-04-20T21:58:50.117 INFO:tasks.workunit.client.1.smithi164.stdout:5/39: dread f4 [0,4194304] 0 2024-04-20T21:58:50.117 INFO:tasks.workunit.client.1.smithi164.stdout:5/40: rmdir - no directory 2024-04-20T21:58:50.117 INFO:tasks.workunit.client.0.smithi142.stdout:8/986: mkdir d0/d5e/d15d 0 2024-04-20T21:58:50.123 INFO:tasks.workunit.client.0.smithi142.stdout:0/921: truncate d5/d13/d1e/d23/d24/d48/f65 1493132 0 2024-04-20T21:58:50.125 INFO:tasks.workunit.client.0.smithi142.stdout:8/987: chown d0/d1c/d44/dad/c10f 8 1 2024-04-20T21:58:50.131 INFO:tasks.workunit.client.1.smithi164.stdout:1/70: link l9 d10/l13 0 2024-04-20T21:58:50.132 INFO:tasks.workunit.client.1.smithi164.stdout:1/71: read - d10/f12 zero size 2024-04-20T21:58:50.134 INFO:tasks.workunit.client.1.smithi164.stdout:9/53: creat d3/ff x:0 0 0 2024-04-20T21:58:50.136 INFO:tasks.workunit.client.1.smithi164.stdout:5/41: mkdir dc 0 2024-04-20T21:58:50.136 INFO:tasks.workunit.client.1.smithi164.stdout:9/54: chown c1 378215753 1 2024-04-20T21:58:50.136 INFO:tasks.workunit.client.0.smithi142.stdout:8/988: truncate d0/d1c/d44/d89/d45/f56 328475 0 2024-04-20T21:58:50.138 INFO:tasks.workunit.client.1.smithi164.stdout:0/75: rename d1/l15 to d1/l16 0 2024-04-20T21:58:50.139 INFO:tasks.workunit.client.0.smithi142.stdout:8/989: mkdir d0/d5e/d15e 0 2024-04-20T21:58:50.142 INFO:tasks.workunit.client.0.smithi142.stdout:8/990: dread - d0/d17/f95 zero size 2024-04-20T21:58:50.146 INFO:tasks.workunit.client.0.smithi142.stdout:8/991: fsync d0/d132/fae 0 2024-04-20T21:58:50.150 INFO:tasks.workunit.client.0.smithi142.stdout:8/992: creat d0/d5e/de5/f15f x:0 0 0 2024-04-20T21:58:50.152 INFO:tasks.workunit.client.0.smithi142.stdout:8/993: chown d0/d1c/dd1/l15b 1846586960 1 2024-04-20T21:58:50.153 INFO:tasks.workunit.client.0.smithi142.stdout:8/994: chown d0/d42/f118 21 1 2024-04-20T21:58:50.159 INFO:tasks.workunit.client.0.smithi142.stdout:8/995: fdatasync d0/d132/db5/de2/f122 0 2024-04-20T21:58:50.159 INFO:tasks.workunit.client.0.smithi142.stdout:8/996: chown d0/d1c 1 1 2024-04-20T21:58:50.167 INFO:tasks.workunit.client.1.smithi164.stdout:7/48: sync 2024-04-20T21:58:50.171 INFO:tasks.workunit.client.0.smithi142.stdout:4/879: rename d1/d12/da/d1c/d32/d3d/d2f/d7a/d90 to d1/d12/d115 0 2024-04-20T21:58:50.179 INFO:tasks.workunit.client.0.smithi142.stdout:8/997: rename d0/d1c/d44/d89/d45/d4c to d0/d1c/d13c/d160 0 2024-04-20T21:58:50.183 INFO:tasks.workunit.client.1.smithi164.stdout:8/49: rename d0/d2 to d0/d14 0 2024-04-20T21:58:50.185 INFO:tasks.workunit.client.1.smithi164.stdout:2/38: truncate d2/f3 2523196 0 2024-04-20T21:58:50.186 INFO:tasks.workunit.client.0.smithi142.stdout:8/998: chown d0/d1c/d44/dad/db3/d3f/cb1 328361156 1 2024-04-20T21:58:50.187 INFO:tasks.workunit.client.1.smithi164.stdout:8/50: dread d0/d14/f12 [0,4194304] 0 2024-04-20T21:58:50.199 INFO:tasks.workunit.client.0.smithi142.stdout:0/922: write d5/d1c/d3c/d95/fe1 [228563,104603] 0 2024-04-20T21:58:50.209 INFO:tasks.workunit.client.1.smithi164.stdout:3/70: sync 2024-04-20T21:58:50.209 INFO:tasks.workunit.client.1.smithi164.stdout:6/97: creat d0/d3/f18 x:0 0 0 2024-04-20T21:58:50.210 INFO:tasks.workunit.client.1.smithi164.stdout:4/39: creat d4/d9/f11 x:0 0 0 2024-04-20T21:58:50.211 INFO:tasks.workunit.client.1.smithi164.stdout:1/72: creat d10/f14 x:0 0 0 2024-04-20T21:58:50.212 INFO:tasks.workunit.client.0.smithi142.stdout:0/923: dread d5/d13/d1e/d23/d2c/f84 [0,4194304] 0 2024-04-20T21:58:50.213 INFO:tasks.workunit.client.1.smithi164.stdout:1/73: write fd [1092293,8198] 0 2024-04-20T21:58:50.213 INFO:tasks.workunit.client.1.smithi164.stdout:9/55: dread - d3/db/dd/fe zero size 2024-04-20T21:58:50.215 INFO:tasks.workunit.client.1.smithi164.stdout:1/74: chown fd 442830988 1 2024-04-20T21:58:50.215 INFO:tasks.workunit.client.1.smithi164.stdout:9/56: readlink d3/l5 0 2024-04-20T21:58:50.215 INFO:tasks.workunit.client.1.smithi164.stdout:7/49: mknod d2/cb 0 2024-04-20T21:58:50.216 INFO:tasks.workunit.client.1.smithi164.stdout:2/39: creat d2/f9 x:0 0 0 2024-04-20T21:58:50.217 INFO:tasks.workunit.client.1.smithi164.stdout:1/75: dread - d10/f14 zero size 2024-04-20T21:58:50.217 INFO:tasks.workunit.client.1.smithi164.stdout:8/51: mknod d0/d8/c15 0 2024-04-20T21:58:50.218 INFO:tasks.workunit.client.0.smithi142.stdout:0/924: truncate d5/d1c/d3c/d85/d63/f64 4545111 0 2024-04-20T21:58:50.219 INFO:tasks.workunit.client.1.smithi164.stdout:3/71: mkdir d12 0 2024-04-20T21:58:50.221 INFO:tasks.workunit.client.1.smithi164.stdout:5/42: creat dc/fd x:0 0 0 2024-04-20T21:58:50.222 INFO:tasks.workunit.client.1.smithi164.stdout:5/43: fsync f7 0 2024-04-20T21:58:50.224 INFO:tasks.workunit.client.1.smithi164.stdout:5/44: write f9 [1557169,84364] 0 2024-04-20T21:58:50.226 INFO:tasks.workunit.client.1.smithi164.stdout:5/45: chown f5 414090621 1 2024-04-20T21:58:50.228 INFO:tasks.workunit.client.0.smithi142.stdout:0/925: getdents d5/d45/d6f 0 2024-04-20T21:58:50.230 INFO:tasks.workunit.client.1.smithi164.stdout:6/98: creat d0/d3/d15/f19 x:0 0 0 2024-04-20T21:58:50.230 INFO:tasks.workunit.client.1.smithi164.stdout:8/52: dread d0/d14/f6 [0,4194304] 0 2024-04-20T21:58:50.231 INFO:tasks.workunit.client.1.smithi164.stdout:4/40: mknod d4/c12 0 2024-04-20T21:58:50.231 INFO:tasks.workunit.client.1.smithi164.stdout:1/76: dread f5 [0,4194304] 0 2024-04-20T21:58:50.234 INFO:tasks.workunit.client.0.smithi142.stdout:0/926: mknod d5/d1c/d3c/d85/d106/c11c 0 2024-04-20T21:58:50.236 INFO:tasks.workunit.client.1.smithi164.stdout:9/57: dwrite d3/ff [0,4194304] 0 2024-04-20T21:58:50.238 INFO:tasks.workunit.client.0.smithi142.stdout:4/880: getdents d1/d12 0 2024-04-20T21:58:50.240 INFO:tasks.workunit.client.0.smithi142.stdout:0/927: unlink d5/d1c/d3c/ffe 0 2024-04-20T21:58:50.243 INFO:tasks.workunit.client.1.smithi164.stdout:9/58: write d3/db/dd/fe [934359,48593] 0 2024-04-20T21:58:50.246 INFO:tasks.workunit.client.0.smithi142.stdout:4/881: mkdir d1/d12/da/d72/dc5/d116 0 2024-04-20T21:58:50.250 INFO:tasks.workunit.client.0.smithi142.stdout:0/928: creat d5/d1d/f11d x:0 0 0 2024-04-20T21:58:50.251 INFO:tasks.workunit.client.1.smithi164.stdout:1/77: fsync f7 0 2024-04-20T21:58:50.253 INFO:tasks.workunit.client.1.smithi164.stdout:6/99: symlink d0/d3/d11/l1a 0 2024-04-20T21:58:50.255 INFO:tasks.workunit.client.1.smithi164.stdout:2/40: fsync d2/f3 0 2024-04-20T21:58:50.260 INFO:tasks.workunit.client.1.smithi164.stdout:5/46: dwrite dc/fd [0,4194304] 0 2024-04-20T21:58:50.264 INFO:tasks.workunit.client.1.smithi164.stdout:6/100: chown d0/d3/l9 13184088 1 2024-04-20T21:58:50.267 INFO:tasks.workunit.client.1.smithi164.stdout:8/53: dwrite d0/d14/f13 [0,4194304] 0 2024-04-20T21:58:50.270 INFO:tasks.workunit.client.1.smithi164.stdout:4/41: dwrite d4/f7 [0,4194304] 0 2024-04-20T21:58:50.271 INFO:tasks.workunit.client.0.smithi142.stdout:4/882: rename d1/d12/da/fff to d1/f117 0 2024-04-20T21:58:50.275 INFO:tasks.workunit.client.0.smithi142.stdout:8/999: write d0/f96 [823567,57787] 0 2024-04-20T21:58:50.276 INFO:tasks.workunit.client.1.smithi164.stdout:9/59: unlink d3/c7 0 2024-04-20T21:58:50.284 INFO:tasks.workunit.client.1.smithi164.stdout:1/78: rename fd to d10/f15 0 2024-04-20T21:58:50.285 INFO:tasks.workunit.client.1.smithi164.stdout:2/41: creat d2/fa x:0 0 0 2024-04-20T21:58:50.287 INFO:tasks.workunit.client.1.smithi164.stdout:4/42: stat d4/fa 0 2024-04-20T21:58:50.288 INFO:tasks.workunit.client.1.smithi164.stdout:9/60: creat d3/db/f10 x:0 0 0 2024-04-20T21:58:50.288 INFO:tasks.workunit.client.1.smithi164.stdout:1/79: read f7 [160648,109410] 0 2024-04-20T21:58:50.291 INFO:tasks.workunit.client.1.smithi164.stdout:9/61: write d3/db/f10 [1012104,78085] 0 2024-04-20T21:58:50.295 INFO:tasks.workunit.client.1.smithi164.stdout:2/42: symlink d2/d5/lb 0 2024-04-20T21:58:50.295 INFO:tasks.workunit.client.1.smithi164.stdout:6/101: creat d0/d3/f1b x:0 0 0 2024-04-20T21:58:50.298 INFO:tasks.workunit.client.1.smithi164.stdout:2/43: mknod d2/cc 0 2024-04-20T21:58:50.300 INFO:tasks.workunit.client.1.smithi164.stdout:8/54: rename d0/d8 to d0/d14/d16 0 2024-04-20T21:58:50.303 INFO:tasks.workunit.client.1.smithi164.stdout:2/44: read - d2/fa zero size 2024-04-20T21:58:50.310 INFO:tasks.workunit.client.1.smithi164.stdout:7/50: truncate d2/fa 2851134 0 2024-04-20T21:58:50.311 INFO:tasks.workunit.client.1.smithi164.stdout:6/102: creat d0/d3/f1c x:0 0 0 2024-04-20T21:58:50.317 INFO:tasks.workunit.client.1.smithi164.stdout:8/55: symlink d0/d14/d16/l17 0 2024-04-20T21:58:50.319 INFO:tasks.workunit.client.1.smithi164.stdout:2/45: creat d2/d5/fd x:0 0 0 2024-04-20T21:58:50.321 INFO:tasks.workunit.client.0.smithi142.stdout:4/883: dwrite d1/d6/d4b/f79 [0,4194304] 0 2024-04-20T21:58:50.322 INFO:tasks.workunit.client.1.smithi164.stdout:9/62: rmdir d3 39 2024-04-20T21:58:50.324 INFO:tasks.workunit.client.0.smithi142.stdout:4/884: write d1/d5b/f10e [594483,113855] 0 2024-04-20T21:58:50.326 INFO:tasks.workunit.client.1.smithi164.stdout:7/51: rmdir d2 39 2024-04-20T21:58:50.329 INFO:tasks.workunit.client.1.smithi164.stdout:8/56: chown d0/f3 5 1 2024-04-20T21:58:50.329 INFO:tasks.workunit.client.1.smithi164.stdout:6/103: write d0/d3/d15/f19 [824794,92273] 0 2024-04-20T21:58:50.331 INFO:tasks.workunit.client.1.smithi164.stdout:5/47: truncate dc/fd 3725685 0 2024-04-20T21:58:50.331 INFO:tasks.workunit.client.1.smithi164.stdout:4/43: dwrite d4/ff [0,4194304] 0 2024-04-20T21:58:50.333 INFO:tasks.workunit.client.1.smithi164.stdout:1/80: dwrite d10/f11 [0,4194304] 0 2024-04-20T21:58:50.333 INFO:tasks.workunit.client.1.smithi164.stdout:9/63: chown c1 390 1 2024-04-20T21:58:50.336 INFO:tasks.workunit.client.1.smithi164.stdout:0/76: dwrite d1/d4/fc [0,4194304] 0 2024-04-20T21:58:50.337 INFO:tasks.workunit.client.1.smithi164.stdout:8/57: write d0/fc [194614,29649] 0 2024-04-20T21:58:50.346 INFO:tasks.workunit.client.1.smithi164.stdout:8/58: readlink d0/d14/d16/l17 0 2024-04-20T21:58:50.346 INFO:tasks.workunit.client.1.smithi164.stdout:6/104: truncate d0/d3/f12 655082 0 2024-04-20T21:58:50.346 INFO:tasks.workunit.client.1.smithi164.stdout:1/81: write f0 [3300486,26606] 0 2024-04-20T21:58:50.346 INFO:tasks.workunit.client.1.smithi164.stdout:3/72: write f6 [897366,11088] 0 2024-04-20T21:58:50.346 INFO:tasks.workunit.client.1.smithi164.stdout:5/48: mknod dc/ce 0 2024-04-20T21:58:50.353 INFO:tasks.workunit.client.1.smithi164.stdout:8/59: creat d0/d14/f18 x:0 0 0 2024-04-20T21:58:50.359 INFO:tasks.workunit.client.1.smithi164.stdout:1/82: dread d10/f11 [0,4194304] 0 2024-04-20T21:58:50.360 INFO:tasks.workunit.client.1.smithi164.stdout:2/46: truncate d2/f3 301526 0 2024-04-20T21:58:50.365 INFO:tasks.workunit.client.1.smithi164.stdout:4/44: dwrite f3 [0,4194304] 0 2024-04-20T21:58:50.365 INFO:tasks.workunit.client.1.smithi164.stdout:1/83: dread f7 [0,4194304] 0 2024-04-20T21:58:50.369 INFO:tasks.workunit.client.1.smithi164.stdout:6/105: symlink d0/d3/d8/l1d 0 2024-04-20T21:58:50.372 INFO:tasks.workunit.client.1.smithi164.stdout:9/64: creat d3/db/dd/f11 x:0 0 0 2024-04-20T21:58:50.377 INFO:tasks.workunit.client.1.smithi164.stdout:6/106: dread d0/d3/f12 [0,4194304] 0 2024-04-20T21:58:50.378 INFO:tasks.workunit.client.1.smithi164.stdout:5/49: mknod dc/cf 0 2024-04-20T21:58:50.379 INFO:tasks.workunit.client.1.smithi164.stdout:2/47: dwrite d2/f9 [0,4194304] 0 2024-04-20T21:58:50.381 INFO:tasks.workunit.client.1.smithi164.stdout:2/48: write d2/d5/fd [125771,114355] 0 2024-04-20T21:58:50.386 INFO:tasks.workunit.client.1.smithi164.stdout:8/60: creat d0/f19 x:0 0 0 2024-04-20T21:58:50.387 INFO:tasks.workunit.client.1.smithi164.stdout:8/61: chown d0/d14/d16 88171410 1 2024-04-20T21:58:50.392 INFO:tasks.workunit.client.1.smithi164.stdout:4/45: unlink d4/f6 0 2024-04-20T21:58:50.392 INFO:tasks.workunit.client.1.smithi164.stdout:1/84: mkdir d10/d16 0 2024-04-20T21:58:50.393 INFO:tasks.workunit.client.1.smithi164.stdout:5/50: dread f9 [0,4194304] 0 2024-04-20T21:58:50.396 INFO:tasks.workunit.client.1.smithi164.stdout:0/77: truncate d1/f9 2558711 0 2024-04-20T21:58:50.399 INFO:tasks.workunit.client.1.smithi164.stdout:8/62: dread d0/d14/fa [0,4194304] 0 2024-04-20T21:58:50.403 INFO:tasks.workunit.client.0.smithi142.stdout:4/885: symlink d1/d12/da/d1c/da9/dba/l118 0 2024-04-20T21:58:50.404 INFO:tasks.workunit.client.1.smithi164.stdout:3/73: link cc d12/c13 0 2024-04-20T21:58:50.404 INFO:tasks.workunit.client.1.smithi164.stdout:3/74: dread - f10 zero size 2024-04-20T21:58:50.408 INFO:tasks.workunit.client.1.smithi164.stdout:4/46: mknod d4/d9/c13 0 2024-04-20T21:58:50.412 INFO:tasks.workunit.client.1.smithi164.stdout:5/51: symlink dc/l10 0 2024-04-20T21:58:50.413 INFO:tasks.workunit.client.1.smithi164.stdout:0/78: unlink d1/d4/fc 0 2024-04-20T21:58:50.416 INFO:tasks.workunit.client.0.smithi142.stdout:4/886: dwrite d1/d12/da/d37/d89/f100 [0,4194304] 0 2024-04-20T21:58:50.419 INFO:tasks.workunit.client.1.smithi164.stdout:8/63: creat d0/f1a x:0 0 0 2024-04-20T21:58:50.419 INFO:tasks.workunit.client.1.smithi164.stdout:7/52: link d2/fa d2/fc 0 2024-04-20T21:58:50.421 INFO:tasks.workunit.client.1.smithi164.stdout:3/75: dwrite f10 [0,4194304] 0 2024-04-20T21:58:50.421 INFO:tasks.workunit.client.1.smithi164.stdout:8/64: chown d0/fc 22571 1 2024-04-20T21:58:50.422 INFO:tasks.workunit.client.1.smithi164.stdout:3/76: write f4 [3780486,33049] 0 2024-04-20T21:58:50.424 INFO:tasks.workunit.client.1.smithi164.stdout:3/77: chown le 2120625344 1 2024-04-20T21:58:50.424 INFO:tasks.workunit.client.1.smithi164.stdout:2/49: dread d2/f3 [0,4194304] 0 2024-04-20T21:58:50.429 INFO:tasks.workunit.client.1.smithi164.stdout:1/85: mknod d10/d16/c17 0 2024-04-20T21:58:50.440 INFO:tasks.workunit.client.1.smithi164.stdout:7/53: mkdir d2/dd 0 2024-04-20T21:58:50.440 INFO:tasks.workunit.client.1.smithi164.stdout:1/86: dread d10/f11 [0,4194304] 0 2024-04-20T21:58:50.441 INFO:tasks.workunit.client.1.smithi164.stdout:7/54: truncate d2/f5 1008468 0 2024-04-20T21:58:50.442 INFO:tasks.workunit.client.1.smithi164.stdout:8/65: creat d0/f1b x:0 0 0 2024-04-20T21:58:50.442 INFO:tasks.workunit.client.1.smithi164.stdout:7/55: dread - d2/f7 zero size 2024-04-20T21:58:50.444 INFO:tasks.workunit.client.1.smithi164.stdout:6/107: truncate d0/d3/fb 4351528 0 2024-04-20T21:58:50.445 INFO:tasks.workunit.client.1.smithi164.stdout:2/50: mknod d2/d5/ce 0 2024-04-20T21:58:50.446 INFO:tasks.workunit.client.1.smithi164.stdout:5/52: truncate dc/fd 2478726 0 2024-04-20T21:58:50.446 INFO:tasks.workunit.client.1.smithi164.stdout:2/51: readlink d2/d5/lb 0 2024-04-20T21:58:50.447 INFO:tasks.workunit.client.1.smithi164.stdout:6/108: truncate d0/d3/f1b 538272 0 2024-04-20T21:58:50.451 INFO:tasks.workunit.client.1.smithi164.stdout:4/47: write d4/f7 [4132832,81732] 0 2024-04-20T21:58:50.455 INFO:tasks.workunit.client.0.smithi142.stdout:4/887: dwrite d1/d6/d4b/f95 [0,4194304] 0 2024-04-20T21:58:50.462 INFO:tasks.workunit.client.0.smithi142.stdout:4/888: rename d1/d12/da/d72/c8b to d1/d6/d30/c119 0 2024-04-20T21:58:50.465 INFO:tasks.workunit.client.0.smithi142.stdout:4/889: write d1/d6/d4a/d5a/f99 [433491,126500] 0 2024-04-20T21:58:50.477 INFO:tasks.workunit.client.0.smithi142.stdout:4/890: truncate d1/d6/d4a/d5a/f99 2823133 0 2024-04-20T21:58:50.493 INFO:tasks.workunit.client.1.smithi164.stdout:2/52: dread d2/f3 [0,4194304] 0 2024-04-20T21:58:50.493 INFO:tasks.workunit.client.1.smithi164.stdout:3/78: truncate f4 3237497 0 2024-04-20T21:58:50.494 INFO:tasks.workunit.client.0.smithi142.stdout:4/891: dwrite d1/d6/d4b/fcc [0,4194304] 0 2024-04-20T21:58:50.495 INFO:tasks.workunit.client.1.smithi164.stdout:3/79: fdatasync ff 0 2024-04-20T21:58:50.495 INFO:tasks.workunit.client.1.smithi164.stdout:6/109: symlink d0/d3/d8/l1e 0 2024-04-20T21:58:50.496 INFO:tasks.workunit.client.0.smithi142.stdout:4/892: fdatasync d1/d6/d4b/f79 0 2024-04-20T21:58:50.497 INFO:tasks.workunit.client.1.smithi164.stdout:5/53: link l1 dc/l11 0 2024-04-20T21:58:50.498 INFO:tasks.workunit.client.1.smithi164.stdout:4/48: creat d4/d9/f14 x:0 0 0 2024-04-20T21:58:50.500 INFO:tasks.workunit.client.1.smithi164.stdout:0/79: dwrite d1/f10 [0,4194304] 0 2024-04-20T21:58:50.500 INFO:tasks.workunit.client.1.smithi164.stdout:3/80: fdatasync fa 0 2024-04-20T21:58:50.504 INFO:tasks.workunit.client.0.smithi142.stdout:4/893: creat d1/d12/da/d1c/d32/d3d/d2f/d7a/f11a x:0 0 0 2024-04-20T21:58:50.504 INFO:tasks.workunit.client.1.smithi164.stdout:3/81: write f10 [2953198,122128] 0 2024-04-20T21:58:50.507 INFO:tasks.workunit.client.1.smithi164.stdout:3/82: write fa [1455885,108418] 0 2024-04-20T21:58:50.507 INFO:tasks.workunit.client.1.smithi164.stdout:7/56: dread f1 [0,4194304] 0 2024-04-20T21:58:50.508 INFO:tasks.workunit.client.0.smithi142.stdout:4/894: chown d1/d12/da/d1c/d32/d3d/d2f/c8d 241520122 1 2024-04-20T21:58:50.510 INFO:tasks.workunit.client.1.smithi164.stdout:8/66: dread d0/d14/fa [0,4194304] 0 2024-04-20T21:58:50.512 INFO:tasks.workunit.client.1.smithi164.stdout:6/110: chown d0/d3/fb 1818 1 2024-04-20T21:58:50.515 INFO:tasks.workunit.client.0.smithi142.stdout:4/895: rename d1/ff to d1/d12/d115/f11b 0 2024-04-20T21:58:50.515 INFO:tasks.workunit.client.1.smithi164.stdout:4/49: creat d4/f15 x:0 0 0 2024-04-20T21:58:50.517 INFO:tasks.workunit.client.1.smithi164.stdout:5/54: dread f8 [0,4194304] 0 2024-04-20T21:58:50.520 INFO:tasks.workunit.client.1.smithi164.stdout:7/57: creat d2/fe x:0 0 0 2024-04-20T21:58:50.522 INFO:tasks.workunit.client.1.smithi164.stdout:8/67: symlink d0/l1c 0 2024-04-20T21:58:50.523 INFO:tasks.workunit.client.1.smithi164.stdout:7/58: read d2/f5 [324877,103634] 0 2024-04-20T21:58:50.523 INFO:tasks.workunit.client.1.smithi164.stdout:6/111: truncate d0/d3/f12 91176 0 2024-04-20T21:58:50.524 INFO:tasks.workunit.client.1.smithi164.stdout:5/55: mkdir dc/d12 0 2024-04-20T21:58:50.526 INFO:tasks.workunit.client.1.smithi164.stdout:3/83: link f11 d12/f14 0 2024-04-20T21:58:50.530 INFO:tasks.workunit.client.1.smithi164.stdout:7/59: creat d2/ff x:0 0 0 2024-04-20T21:58:50.533 INFO:tasks.workunit.client.1.smithi164.stdout:3/84: mkdir d12/d15 0 2024-04-20T21:58:50.534 INFO:tasks.workunit.client.1.smithi164.stdout:7/60: fsync d2/fc 0 2024-04-20T21:58:50.536 INFO:tasks.workunit.client.1.smithi164.stdout:3/85: dread - d12/f14 zero size 2024-04-20T21:58:50.541 INFO:tasks.workunit.client.1.smithi164.stdout:0/80: write d1/f12 [681150,63485] 0 2024-04-20T21:58:50.542 INFO:tasks.workunit.client.1.smithi164.stdout:6/112: dwrite d0/d3/f1b [0,4194304] 0 2024-04-20T21:58:50.542 INFO:tasks.workunit.client.1.smithi164.stdout:3/86: rmdir d12 39 2024-04-20T21:58:50.544 INFO:tasks.workunit.client.1.smithi164.stdout:9/65: sync 2024-04-20T21:58:50.545 INFO:tasks.workunit.client.1.smithi164.stdout:0/81: fsync d1/f10 0 2024-04-20T21:58:50.547 INFO:tasks.workunit.client.1.smithi164.stdout:5/56: write f6 [4262668,91353] 0 2024-04-20T21:58:50.547 INFO:tasks.workunit.client.1.smithi164.stdout:6/113: creat d0/d3/d8/f1f x:0 0 0 2024-04-20T21:58:50.548 INFO:tasks.workunit.client.1.smithi164.stdout:5/57: chown c0 12560 1 2024-04-20T21:58:50.550 INFO:tasks.workunit.client.1.smithi164.stdout:7/61: rmdir d2/dd 0 2024-04-20T21:58:50.550 INFO:tasks.workunit.client.1.smithi164.stdout:6/114: dread - d0/f16 zero size 2024-04-20T21:58:50.551 INFO:tasks.workunit.client.1.smithi164.stdout:5/58: chown f3 1 1 2024-04-20T21:58:50.552 INFO:tasks.workunit.client.1.smithi164.stdout:3/87: fdatasync f9 0 2024-04-20T21:58:50.554 INFO:tasks.workunit.client.1.smithi164.stdout:9/66: symlink d3/l12 0 2024-04-20T21:58:50.555 INFO:tasks.workunit.client.1.smithi164.stdout:3/88: read - f11 zero size 2024-04-20T21:58:50.555 INFO:tasks.workunit.client.1.smithi164.stdout:8/68: dwrite d0/d14/fa [0,4194304] 0 2024-04-20T21:58:50.558 INFO:tasks.workunit.client.1.smithi164.stdout:7/62: unlink d2/fe 0 2024-04-20T21:58:50.561 INFO:tasks.workunit.client.1.smithi164.stdout:9/67: fsync d3/fa 0 2024-04-20T21:58:50.565 INFO:tasks.workunit.client.1.smithi164.stdout:3/89: write d12/f14 [1032567,15850] 0 2024-04-20T21:58:50.565 INFO:tasks.workunit.client.1.smithi164.stdout:6/115: rename d0/d3/d15/f19 to d0/f20 0 2024-04-20T21:58:50.568 INFO:tasks.workunit.client.1.smithi164.stdout:5/59: dread f7 [0,4194304] 0 2024-04-20T21:58:50.568 INFO:tasks.workunit.client.1.smithi164.stdout:9/68: mknod d3/c13 0 2024-04-20T21:58:50.569 INFO:tasks.workunit.client.1.smithi164.stdout:6/116: dread - d0/f16 zero size 2024-04-20T21:58:50.570 INFO:tasks.workunit.client.1.smithi164.stdout:5/60: truncate f5 1057212 0 2024-04-20T21:58:50.570 INFO:tasks.workunit.client.1.smithi164.stdout:0/82: rename d1/l6 to d1/d4/df/l17 0 2024-04-20T21:58:50.574 INFO:tasks.workunit.client.1.smithi164.stdout:5/61: readlink dc/l10 0 2024-04-20T21:58:50.574 INFO:tasks.workunit.client.1.smithi164.stdout:9/69: creat d3/db/dd/f14 x:0 0 0 2024-04-20T21:58:50.574 INFO:tasks.workunit.client.1.smithi164.stdout:0/83: write d1/f10 [391523,52767] 0 2024-04-20T21:58:50.575 INFO:tasks.workunit.client.1.smithi164.stdout:8/69: rename d0/fb to d0/d14/f1d 0 2024-04-20T21:58:50.575 INFO:tasks.workunit.client.1.smithi164.stdout:8/70: chown d0 5482467 1 2024-04-20T21:58:50.578 INFO:tasks.workunit.client.1.smithi164.stdout:0/84: chown d1/d4/l13 918865 1 2024-04-20T21:58:50.580 INFO:tasks.workunit.client.1.smithi164.stdout:9/70: symlink d3/l15 0 2024-04-20T21:58:50.584 INFO:tasks.workunit.client.1.smithi164.stdout:8/71: unlink d0/d14/d16/l17 0 2024-04-20T21:58:50.592 INFO:tasks.workunit.client.1.smithi164.stdout:7/63: dwrite d2/f5 [0,4194304] 0 2024-04-20T21:58:50.597 INFO:tasks.workunit.client.1.smithi164.stdout:8/72: write d0/f3 [2000904,121183] 0 2024-04-20T21:58:50.601 INFO:tasks.workunit.client.1.smithi164.stdout:3/90: dwrite fa [0,4194304] 0 2024-04-20T21:58:50.602 INFO:tasks.workunit.client.1.smithi164.stdout:0/85: link d1/d4/df/c11 d1/d4/da/c18 0 2024-04-20T21:58:50.610 INFO:tasks.workunit.client.1.smithi164.stdout:8/73: mkdir d0/d1e 0 2024-04-20T21:58:50.611 INFO:tasks.workunit.client.1.smithi164.stdout:6/117: dwrite d0/d3/f1c [0,4194304] 0 2024-04-20T21:58:50.613 INFO:tasks.workunit.client.1.smithi164.stdout:0/86: write d1/f10 [3472406,77925] 0 2024-04-20T21:58:50.616 INFO:tasks.workunit.client.1.smithi164.stdout:3/91: unlink f7 0 2024-04-20T21:58:50.619 INFO:tasks.workunit.client.1.smithi164.stdout:8/74: mknod d0/d14/c1f 0 2024-04-20T21:58:50.620 INFO:tasks.workunit.client.1.smithi164.stdout:5/62: dwrite dc/fd [0,4194304] 0 2024-04-20T21:58:50.623 INFO:tasks.workunit.client.1.smithi164.stdout:6/118: stat d0/d3/f1b 0 2024-04-20T21:58:50.624 INFO:tasks.workunit.client.1.smithi164.stdout:8/75: dread - d0/d14/f1d zero size 2024-04-20T21:58:50.626 INFO:tasks.workunit.client.1.smithi164.stdout:3/92: rename fd to d12/f16 0 2024-04-20T21:58:50.627 INFO:tasks.workunit.client.1.smithi164.stdout:9/71: dwrite d3/ff [4194304,4194304] 0 2024-04-20T21:58:50.629 INFO:tasks.workunit.client.1.smithi164.stdout:6/119: write d0/d3/f10 [1603848,37224] 0 2024-04-20T21:58:50.630 INFO:tasks.workunit.client.1.smithi164.stdout:8/76: write d0/fc [94546,59695] 0 2024-04-20T21:58:50.634 INFO:tasks.workunit.client.1.smithi164.stdout:8/77: write d0/fc [901703,41976] 0 2024-04-20T21:58:50.637 INFO:tasks.workunit.client.1.smithi164.stdout:5/63: creat dc/d12/f13 x:0 0 0 2024-04-20T21:58:50.637 INFO:tasks.workunit.client.1.smithi164.stdout:3/93: mkdir d12/d17 0 2024-04-20T21:58:50.639 INFO:tasks.workunit.client.1.smithi164.stdout:6/120: mkdir d0/d3/d15/d21 0 2024-04-20T21:58:50.640 INFO:tasks.workunit.client.1.smithi164.stdout:9/72: symlink d3/db/l16 0 2024-04-20T21:58:50.644 INFO:tasks.workunit.client.1.smithi164.stdout:0/87: dread d1/f9 [0,4194304] 0 2024-04-20T21:58:50.648 INFO:tasks.workunit.client.1.smithi164.stdout:6/121: rmdir d0/d3/d11 39 2024-04-20T21:58:50.648 INFO:tasks.workunit.client.1.smithi164.stdout:9/73: write d3/f6 [518420,21013] 0 2024-04-20T21:58:50.654 INFO:tasks.workunit.client.1.smithi164.stdout:6/122: read d0/f20 [307199,72180] 0 2024-04-20T21:58:50.654 INFO:tasks.workunit.client.1.smithi164.stdout:3/94: rmdir d12/d17 0 2024-04-20T21:58:50.662 INFO:tasks.workunit.client.1.smithi164.stdout:6/123: mkdir d0/d3/d15/d22 0 2024-04-20T21:58:50.662 INFO:tasks.workunit.client.1.smithi164.stdout:9/74: write d3/f8 [1056613,13871] 0 2024-04-20T21:58:50.662 INFO:tasks.workunit.client.1.smithi164.stdout:8/78: dwrite d0/f1a [0,4194304] 0 2024-04-20T21:58:50.666 INFO:tasks.workunit.client.1.smithi164.stdout:5/64: truncate dc/fd 3966224 0 2024-04-20T21:58:50.667 INFO:tasks.workunit.client.1.smithi164.stdout:0/88: dread d1/f10 [0,4194304] 0 2024-04-20T21:58:50.676 INFO:tasks.workunit.client.1.smithi164.stdout:5/65: rename cb to dc/c14 0 2024-04-20T21:58:50.676 INFO:tasks.workunit.client.1.smithi164.stdout:9/75: link d3/db/f10 d3/db/f17 0 2024-04-20T21:58:50.677 INFO:tasks.workunit.client.1.smithi164.stdout:1/87: sync 2024-04-20T21:58:50.679 INFO:tasks.workunit.client.1.smithi164.stdout:5/66: creat dc/d12/f15 x:0 0 0 2024-04-20T21:58:50.680 INFO:tasks.workunit.client.1.smithi164.stdout:8/79: getdents d0/d14/d16 0 2024-04-20T21:58:50.680 INFO:tasks.workunit.client.1.smithi164.stdout:3/95: dread fa [0,4194304] 0 2024-04-20T21:58:50.681 INFO:tasks.workunit.client.1.smithi164.stdout:1/88: read - d10/f14 zero size 2024-04-20T21:58:50.682 INFO:tasks.workunit.client.1.smithi164.stdout:9/76: write d3/f6 [1285305,113551] 0 2024-04-20T21:58:50.682 INFO:tasks.workunit.client.1.smithi164.stdout:6/124: write d0/d3/d8/fa [344979,98732] 0 2024-04-20T21:58:50.682 INFO:tasks.workunit.client.1.smithi164.stdout:0/89: dread d1/f9 [0,4194304] 0 2024-04-20T21:58:50.685 INFO:tasks.workunit.client.1.smithi164.stdout:1/89: fdatasync f0 0 2024-04-20T21:58:50.688 INFO:tasks.workunit.client.1.smithi164.stdout:5/67: link dc/fd dc/f16 0 2024-04-20T21:58:50.689 INFO:tasks.workunit.client.1.smithi164.stdout:8/80: read d0/f11 [537909,45853] 0 2024-04-20T21:58:50.695 INFO:tasks.workunit.client.1.smithi164.stdout:8/81: write d0/d14/f13 [2444814,37782] 0 2024-04-20T21:58:50.695 INFO:tasks.workunit.client.1.smithi164.stdout:9/77: dread d3/f8 [0,4194304] 0 2024-04-20T21:58:50.697 INFO:tasks.workunit.client.1.smithi164.stdout:5/68: rmdir dc/d12 39 2024-04-20T21:58:50.701 INFO:tasks.workunit.client.1.smithi164.stdout:8/82: creat d0/d1e/f20 x:0 0 0 2024-04-20T21:58:50.705 INFO:tasks.workunit.client.1.smithi164.stdout:7/64: sync 2024-04-20T21:58:50.705 INFO:tasks.workunit.client.1.smithi164.stdout:2/53: sync 2024-04-20T21:58:50.705 INFO:tasks.workunit.client.1.smithi164.stdout:4/50: sync 2024-04-20T21:58:50.709 INFO:tasks.workunit.client.0.smithi142.stdout:0/929: sync 2024-04-20T21:58:50.709 INFO:tasks.workunit.client.1.smithi164.stdout:3/96: dread f4 [0,4194304] 0 2024-04-20T21:58:50.710 INFO:tasks.workunit.client.1.smithi164.stdout:9/78: creat d3/f18 x:0 0 0 2024-04-20T21:58:50.711 INFO:tasks.workunit.client.1.smithi164.stdout:5/69: creat dc/d12/f17 x:0 0 0 2024-04-20T21:58:50.712 INFO:tasks.workunit.client.1.smithi164.stdout:8/83: creat d0/f21 x:0 0 0 2024-04-20T21:58:50.713 INFO:tasks.workunit.client.0.smithi142.stdout:0/930: symlink d5/d1c/d3c/l11e 0 2024-04-20T21:58:50.713 INFO:tasks.workunit.client.1.smithi164.stdout:2/54: symlink d2/lf 0 2024-04-20T21:58:50.714 INFO:tasks.workunit.client.1.smithi164.stdout:7/65: creat d2/f10 x:0 0 0 2024-04-20T21:58:50.715 INFO:tasks.workunit.client.0.smithi142.stdout:0/931: read - d5/d1c/d3c/d85/d63/f99 zero size 2024-04-20T21:58:50.715 INFO:tasks.workunit.client.1.smithi164.stdout:5/70: chown dc/cf 2652643 1 2024-04-20T21:58:50.718 INFO:tasks.workunit.client.1.smithi164.stdout:2/55: unlink d2/f3 0 2024-04-20T21:58:50.718 INFO:tasks.workunit.client.1.smithi164.stdout:8/84: chown d0/d14/f1d 0 1 2024-04-20T21:58:50.720 INFO:tasks.workunit.client.1.smithi164.stdout:0/90: dwrite d1/f10 [0,4194304] 0 2024-04-20T21:58:50.720 INFO:tasks.workunit.client.1.smithi164.stdout:4/51: creat d4/f16 x:0 0 0 2024-04-20T21:58:50.724 INFO:tasks.workunit.client.1.smithi164.stdout:6/125: dwrite d0/d3/f1c [4194304,4194304] 0 2024-04-20T21:58:50.724 INFO:tasks.workunit.client.1.smithi164.stdout:3/97: truncate f9 577084 0 2024-04-20T21:58:50.724 INFO:tasks.workunit.client.1.smithi164.stdout:2/56: write d2/d5/fd [141090,107208] 0 2024-04-20T21:58:50.730 INFO:tasks.workunit.client.1.smithi164.stdout:5/71: dread f4 [0,4194304] 0 2024-04-20T21:58:50.732 INFO:tasks.workunit.client.1.smithi164.stdout:5/72: write f5 [457751,70522] 0 2024-04-20T21:58:50.735 INFO:tasks.workunit.client.1.smithi164.stdout:2/57: symlink d2/d5/l10 0 2024-04-20T21:58:50.738 INFO:tasks.workunit.client.1.smithi164.stdout:8/85: rename d0/f1a to d0/d1e/f22 0 2024-04-20T21:58:50.739 INFO:tasks.workunit.client.0.smithi142.stdout:0/932: dwrite d5/d1c/d3c/d85/d38/d62/f96 [0,4194304] 0 2024-04-20T21:58:50.739 INFO:tasks.workunit.client.1.smithi164.stdout:4/52: creat d4/d9/f17 x:0 0 0 2024-04-20T21:58:50.741 INFO:tasks.workunit.client.1.smithi164.stdout:0/91: dread d1/f10 [0,4194304] 0 2024-04-20T21:58:50.749 INFO:tasks.workunit.client.1.smithi164.stdout:4/53: write d4/d9/f11 [5591,125016] 0 2024-04-20T21:58:50.749 INFO:tasks.workunit.client.1.smithi164.stdout:9/79: dread d3/f9 [0,4194304] 0 2024-04-20T21:58:50.749 INFO:tasks.workunit.client.1.smithi164.stdout:3/98: creat d12/f18 x:0 0 0 2024-04-20T21:58:50.753 INFO:tasks.workunit.client.1.smithi164.stdout:8/86: symlink d0/l23 0 2024-04-20T21:58:50.753 INFO:tasks.workunit.client.1.smithi164.stdout:5/73: creat dc/d12/f18 x:0 0 0 2024-04-20T21:58:50.760 INFO:tasks.workunit.client.1.smithi164.stdout:4/54: mknod d4/d9/c18 0 2024-04-20T21:58:50.762 INFO:tasks.workunit.client.1.smithi164.stdout:5/74: dread - dc/d12/f15 zero size 2024-04-20T21:58:50.762 INFO:tasks.workunit.client.1.smithi164.stdout:8/87: creat d0/f24 x:0 0 0 2024-04-20T21:58:50.764 INFO:tasks.workunit.client.1.smithi164.stdout:9/80: write d3/db/dd/f11 [725661,52144] 0 2024-04-20T21:58:50.764 INFO:tasks.workunit.client.1.smithi164.stdout:3/99: creat d12/d15/f19 x:0 0 0 2024-04-20T21:58:50.770 INFO:tasks.workunit.client.1.smithi164.stdout:7/66: dwrite d2/fc [0,4194304] 0 2024-04-20T21:58:50.770 INFO:tasks.workunit.client.0.smithi142.stdout:0/933: dwrite d5/d1c/d3c/fa5 [0,4194304] 0 2024-04-20T21:58:50.770 INFO:tasks.workunit.client.1.smithi164.stdout:2/58: dread d2/f9 [0,4194304] 0 2024-04-20T21:58:50.772 INFO:tasks.workunit.client.1.smithi164.stdout:6/126: dwrite d0/f6 [0,4194304] 0 2024-04-20T21:58:50.773 INFO:tasks.workunit.client.1.smithi164.stdout:8/88: creat d0/d14/f25 x:0 0 0 2024-04-20T21:58:50.775 INFO:tasks.workunit.client.1.smithi164.stdout:3/100: mknod d12/c1a 0 2024-04-20T21:58:50.780 INFO:tasks.workunit.client.1.smithi164.stdout:5/75: symlink dc/l19 0 2024-04-20T21:58:50.780 INFO:tasks.workunit.client.1.smithi164.stdout:7/67: chown d2/fa 31275153 1 2024-04-20T21:58:50.780 INFO:tasks.workunit.client.1.smithi164.stdout:1/90: sync 2024-04-20T21:58:50.786 INFO:tasks.workunit.client.1.smithi164.stdout:4/55: creat d4/f19 x:0 0 0 2024-04-20T21:58:50.790 INFO:tasks.workunit.client.0.smithi142.stdout:0/934: write d5/d1c/d3c/d85/d38/f42 [2051708,60593] 0 2024-04-20T21:58:50.791 INFO:tasks.workunit.client.1.smithi164.stdout:3/101: creat d12/d15/f1b x:0 0 0 2024-04-20T21:58:50.794 INFO:tasks.workunit.client.1.smithi164.stdout:6/127: unlink d0/d3/l9 0 2024-04-20T21:58:50.798 INFO:tasks.workunit.client.1.smithi164.stdout:9/81: symlink d3/l19 0 2024-04-20T21:58:50.798 INFO:tasks.workunit.client.1.smithi164.stdout:0/92: dwrite d1/f9 [0,4194304] 0 2024-04-20T21:58:50.799 INFO:tasks.workunit.client.1.smithi164.stdout:7/68: symlink d2/l11 0 2024-04-20T21:58:50.805 INFO:tasks.workunit.client.1.smithi164.stdout:9/82: read d3/ff [7652830,17423] 0 2024-04-20T21:58:50.806 INFO:tasks.workunit.client.1.smithi164.stdout:3/102: creat d12/d15/f1c x:0 0 0 2024-04-20T21:58:50.808 INFO:tasks.workunit.client.1.smithi164.stdout:6/128: mkdir d0/d3/d15/d23 0 2024-04-20T21:58:50.812 INFO:tasks.workunit.client.1.smithi164.stdout:1/91: write f5 [1215217,974] 0 2024-04-20T21:58:50.812 INFO:tasks.workunit.client.1.smithi164.stdout:6/129: readlink d0/l17 0 2024-04-20T21:58:50.813 INFO:tasks.workunit.client.0.smithi142.stdout:0/935: dwrite d5/d1c/d3c/d85/d38/d62/f96 [0,4194304] 0 2024-04-20T21:58:50.815 INFO:tasks.workunit.client.1.smithi164.stdout:2/59: getdents d2/d5 0 2024-04-20T21:58:50.815 INFO:tasks.workunit.client.0.smithi142.stdout:4/896: sync 2024-04-20T21:58:50.817 INFO:tasks.workunit.client.1.smithi164.stdout:6/130: chown d0/d3/d8 1168598 1 2024-04-20T21:58:50.818 INFO:tasks.workunit.client.1.smithi164.stdout:7/69: unlink d2/fa 0 2024-04-20T21:58:50.820 INFO:tasks.workunit.client.1.smithi164.stdout:8/89: dwrite d0/f24 [0,4194304] 0 2024-04-20T21:58:50.822 INFO:tasks.workunit.client.1.smithi164.stdout:6/131: stat d0/f4 0 2024-04-20T21:58:50.824 INFO:tasks.workunit.client.0.smithi142.stdout:0/936: dread d5/d13/d1e/d23/d24/fd5 [0,4194304] 0 2024-04-20T21:58:50.826 INFO:tasks.workunit.client.1.smithi164.stdout:4/56: creat d4/f1a x:0 0 0 2024-04-20T21:58:50.826 INFO:tasks.workunit.client.1.smithi164.stdout:5/76: dread f6 [0,4194304] 0 2024-04-20T21:58:50.827 INFO:tasks.workunit.client.0.smithi142.stdout:4/897: mknod d1/d12/da/d1c/d32/c11c 0 2024-04-20T21:58:50.828 INFO:tasks.workunit.client.1.smithi164.stdout:3/103: symlink d12/l1d 0 2024-04-20T21:58:50.828 INFO:tasks.workunit.client.0.smithi142.stdout:0/937: read d5/d13/d1e/d23/d24/d48/db6/fc1 [1133121,31988] 0 2024-04-20T21:58:50.830 INFO:tasks.workunit.client.1.smithi164.stdout:2/60: creat d2/d5/f11 x:0 0 0 2024-04-20T21:58:50.832 INFO:tasks.workunit.client.0.smithi142.stdout:4/898: symlink d1/d12/da/d72/dc5/d116/l11d 0 2024-04-20T21:58:50.835 INFO:tasks.workunit.client.1.smithi164.stdout:5/77: rmdir dc 39 2024-04-20T21:58:50.837 INFO:tasks.workunit.client.0.smithi142.stdout:4/899: chown d1/d6/d4a/db0/ff1 1460 1 2024-04-20T21:58:50.837 INFO:tasks.workunit.client.0.smithi142.stdout:4/900: readlink d1/la4 0 2024-04-20T21:58:50.838 INFO:tasks.workunit.client.1.smithi164.stdout:3/104: write d12/d15/f1c [601112,64389] 0 2024-04-20T21:58:50.839 INFO:tasks.workunit.client.1.smithi164.stdout:8/90: link d0/d14/f13 d0/d14/d16/f26 0 2024-04-20T21:58:50.841 INFO:tasks.workunit.client.0.smithi142.stdout:4/901: fsync d1/d12/da/d1c/f3b 0 2024-04-20T21:58:50.842 INFO:tasks.workunit.client.1.smithi164.stdout:8/91: fdatasync d0/f21 0 2024-04-20T21:58:50.842 INFO:tasks.workunit.client.1.smithi164.stdout:3/105: write d12/f18 [962975,39999] 0 2024-04-20T21:58:50.843 INFO:tasks.workunit.client.1.smithi164.stdout:4/57: link d4/f15 d4/d9/f1b 0 2024-04-20T21:58:50.844 INFO:tasks.workunit.client.1.smithi164.stdout:2/61: creat d2/f12 x:0 0 0 2024-04-20T21:58:50.845 INFO:tasks.workunit.client.1.smithi164.stdout:4/58: chown d4/f1a 9 1 2024-04-20T21:58:50.845 INFO:tasks.workunit.client.0.smithi142.stdout:4/902: fsync d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/f44 0 2024-04-20T21:58:50.846 INFO:tasks.workunit.client.1.smithi164.stdout:8/92: read d0/d14/f13 [81487,65536] 0 2024-04-20T21:58:50.848 INFO:tasks.workunit.client.1.smithi164.stdout:9/83: getdents d3/db/dd 0 2024-04-20T21:58:50.848 INFO:tasks.workunit.client.1.smithi164.stdout:3/106: creat d12/f1e x:0 0 0 2024-04-20T21:58:50.851 INFO:tasks.workunit.client.0.smithi142.stdout:4/903: symlink d1/d5b/l11e 0 2024-04-20T21:58:50.853 INFO:tasks.workunit.client.1.smithi164.stdout:9/84: creat d3/db/f1a x:0 0 0 2024-04-20T21:58:50.855 INFO:tasks.workunit.client.1.smithi164.stdout:3/107: creat d12/f1f x:0 0 0 2024-04-20T21:58:50.855 INFO:tasks.workunit.client.1.smithi164.stdout:6/132: dread d0/f6 [0,4194304] 0 2024-04-20T21:58:50.857 INFO:tasks.workunit.client.0.smithi142.stdout:4/904: creat d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/dda/f11f x:0 0 0 2024-04-20T21:58:50.857 INFO:tasks.workunit.client.1.smithi164.stdout:0/93: truncate d1/f9 3294016 0 2024-04-20T21:58:50.860 INFO:tasks.workunit.client.0.smithi142.stdout:4/905: write d1/d6/d4a/d5a/d80/ff9 [242134,93897] 0 2024-04-20T21:58:50.864 INFO:tasks.workunit.client.1.smithi164.stdout:3/108: mkdir d12/d20 0 2024-04-20T21:58:50.866 INFO:tasks.workunit.client.0.smithi142.stdout:4/906: truncate d1/d6/d4a/d5a/d80/ff9 423797 0 2024-04-20T21:58:50.866 INFO:tasks.workunit.client.1.smithi164.stdout:5/78: creat dc/f1a x:0 0 0 2024-04-20T21:58:50.867 INFO:tasks.workunit.client.1.smithi164.stdout:8/93: dread d0/d14/fa [0,4194304] 0 2024-04-20T21:58:50.869 INFO:tasks.workunit.client.1.smithi164.stdout:6/133: creat d0/d3/d15/f24 x:0 0 0 2024-04-20T21:58:50.869 INFO:tasks.workunit.client.0.smithi142.stdout:0/938: dwrite d5/d1c/d3c/d85/f76 [4194304,4194304] 0 2024-04-20T21:58:50.871 INFO:tasks.workunit.client.1.smithi164.stdout:3/109: fdatasync d12/f18 0 2024-04-20T21:58:50.874 INFO:tasks.workunit.client.1.smithi164.stdout:4/59: write d4/fa [756118,62129] 0 2024-04-20T21:58:50.874 INFO:tasks.workunit.client.1.smithi164.stdout:6/134: stat d0/f20 0 2024-04-20T21:58:50.877 INFO:tasks.workunit.client.1.smithi164.stdout:4/60: write f2 [1025048,48522] 0 2024-04-20T21:58:50.878 INFO:tasks.workunit.client.1.smithi164.stdout:8/94: creat d0/f27 x:0 0 0 2024-04-20T21:58:50.881 INFO:tasks.workunit.client.1.smithi164.stdout:5/79: mknod dc/d12/c1b 0 2024-04-20T21:58:50.883 INFO:tasks.workunit.client.1.smithi164.stdout:5/80: readlink la 0 2024-04-20T21:58:50.884 INFO:tasks.workunit.client.1.smithi164.stdout:2/62: dwrite d2/d5/fd [0,4194304] 0 2024-04-20T21:58:50.884 INFO:tasks.workunit.client.1.smithi164.stdout:4/61: fsync d4/d9/fd 0 2024-04-20T21:58:50.888 INFO:tasks.workunit.client.1.smithi164.stdout:1/92: sync 2024-04-20T21:58:50.889 INFO:tasks.workunit.client.0.smithi142.stdout:0/939: creat d5/d13/f11f x:0 0 0 2024-04-20T21:58:50.890 INFO:tasks.workunit.client.0.smithi142.stdout:4/907: truncate f0 2753076 0 2024-04-20T21:58:50.893 INFO:tasks.workunit.client.1.smithi164.stdout:9/85: truncate d3/ff 4062505 0 2024-04-20T21:58:50.897 INFO:tasks.workunit.client.1.smithi164.stdout:8/95: unlink d0/f27 0 2024-04-20T21:58:50.899 INFO:tasks.workunit.client.0.smithi142.stdout:4/908: mknod d1/d6/d4b/c120 0 2024-04-20T21:58:50.899 INFO:tasks.workunit.client.0.smithi142.stdout:0/940: mknod d5/d13/d1e/d23/d24/d48/d55/c120 0 2024-04-20T21:58:50.903 INFO:tasks.workunit.client.1.smithi164.stdout:2/63: mknod d2/d5/c13 0 2024-04-20T21:58:50.905 INFO:tasks.workunit.client.0.smithi142.stdout:0/941: unlink d5/d1c/d3c/d85/d38/d62/d9a/fe4 0 2024-04-20T21:58:50.906 INFO:tasks.workunit.client.1.smithi164.stdout:1/93: symlink d10/d16/l18 0 2024-04-20T21:58:50.906 INFO:tasks.workunit.client.0.smithi142.stdout:4/909: creat d1/d12/da/d37/d89/f121 x:0 0 0 2024-04-20T21:58:50.907 INFO:tasks.workunit.client.0.smithi142.stdout:0/942: readlink d5/d45/d6f/d70/da9/lbb 0 2024-04-20T21:58:50.912 INFO:tasks.workunit.client.0.smithi142.stdout:4/910: creat d1/d6/d4a/d5a/d80/dd7/f122 x:0 0 0 2024-04-20T21:58:50.912 INFO:tasks.workunit.client.1.smithi164.stdout:0/94: dwrite d1/f8 [0,4194304] 0 2024-04-20T21:58:50.913 INFO:tasks.workunit.client.0.smithi142.stdout:0/943: creat d5/d1c/d3c/d85/d38/d62/d9a/f121 x:0 0 0 2024-04-20T21:58:50.916 INFO:tasks.workunit.client.0.smithi142.stdout:0/944: chown d5/d1c/d3c/d4a/c109 1077 1 2024-04-20T21:58:50.918 INFO:tasks.workunit.client.1.smithi164.stdout:1/94: read - d10/f12 zero size 2024-04-20T21:58:50.919 INFO:tasks.workunit.client.1.smithi164.stdout:7/70: dwrite f1 [0,4194304] 0 2024-04-20T21:58:50.921 INFO:tasks.workunit.client.1.smithi164.stdout:9/86: unlink d3/f8 0 2024-04-20T21:58:50.922 INFO:tasks.workunit.client.1.smithi164.stdout:8/96: symlink d0/d1e/l28 0 2024-04-20T21:58:50.926 INFO:tasks.workunit.client.1.smithi164.stdout:4/62: creat d4/f1c x:0 0 0 2024-04-20T21:58:50.930 INFO:tasks.workunit.client.0.smithi142.stdout:4/911: dread d1/d6/d4b/fcc [0,4194304] 0 2024-04-20T21:58:50.932 INFO:tasks.workunit.client.0.smithi142.stdout:0/945: dwrite d5/d13/d1e/d23/d46/fda [0,4194304] 0 2024-04-20T21:58:50.933 INFO:tasks.workunit.client.1.smithi164.stdout:6/135: dwrite d0/d3/f1c [0,4194304] 0 2024-04-20T21:58:50.942 INFO:tasks.workunit.client.1.smithi164.stdout:4/63: unlink d4/d9/fd 0 2024-04-20T21:58:50.944 INFO:tasks.workunit.client.0.smithi142.stdout:0/946: mknod d5/d45/d6f/d70/da9/c122 0 2024-04-20T21:58:50.947 INFO:tasks.workunit.client.1.smithi164.stdout:6/136: fdatasync d0/d3/d15/f24 0 2024-04-20T21:58:50.948 INFO:tasks.workunit.client.1.smithi164.stdout:8/97: mknod d0/d1e/c29 0 2024-04-20T21:58:50.949 INFO:tasks.workunit.client.1.smithi164.stdout:5/81: dwrite f9 [4194304,4194304] 0 2024-04-20T21:58:50.953 INFO:tasks.workunit.client.0.smithi142.stdout:4/912: dwrite d1/d12/da/d1c/da9/fe9 [0,4194304] 0 2024-04-20T21:58:50.955 INFO:tasks.workunit.client.1.smithi164.stdout:3/110: dwrite f4 [0,4194304] 0 2024-04-20T21:58:50.956 INFO:tasks.workunit.client.1.smithi164.stdout:7/71: symlink d2/l12 0 2024-04-20T21:58:50.962 INFO:tasks.workunit.client.0.smithi142.stdout:4/913: creat d1/d6/d4b/f123 x:0 0 0 2024-04-20T21:58:50.962 INFO:tasks.workunit.client.1.smithi164.stdout:9/87: getdents d3/db/dd 0 2024-04-20T21:58:50.965 INFO:tasks.workunit.client.1.smithi164.stdout:8/98: read d0/d14/f6 [280293,82676] 0 2024-04-20T21:58:50.971 INFO:tasks.workunit.client.1.smithi164.stdout:5/82: mknod dc/d12/c1c 0 2024-04-20T21:58:50.971 INFO:tasks.workunit.client.1.smithi164.stdout:4/64: chown d4/d9/f17 1279528183 1 2024-04-20T21:58:50.972 INFO:tasks.workunit.client.0.smithi142.stdout:0/947: dread d5/d1d/f4e [0,4194304] 0 2024-04-20T21:58:50.973 INFO:tasks.workunit.client.1.smithi164.stdout:9/88: mkdir d3/db/d1b 0 2024-04-20T21:58:50.974 INFO:tasks.workunit.client.1.smithi164.stdout:2/64: dwrite d2/f12 [0,4194304] 0 2024-04-20T21:58:50.978 INFO:tasks.workunit.client.0.smithi142.stdout:0/948: chown d5/d13/d1e/d23/d24/d48/f65 437055337 1 2024-04-20T21:58:50.980 INFO:tasks.workunit.client.1.smithi164.stdout:3/111: creat d12/d15/f21 x:0 0 0 2024-04-20T21:58:50.985 INFO:tasks.workunit.client.0.smithi142.stdout:4/914: dwrite d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/f44 [0,4194304] 0 2024-04-20T21:58:50.985 INFO:tasks.workunit.client.0.smithi142.stdout:0/949: read d5/d45/d6f/d70/fa2 [1969698,126285] 0 2024-04-20T21:58:50.985 INFO:tasks.workunit.client.1.smithi164.stdout:5/83: symlink dc/l1d 0 2024-04-20T21:58:50.985 INFO:tasks.workunit.client.1.smithi164.stdout:1/95: dwrite f7 [0,4194304] 0 2024-04-20T21:58:50.986 INFO:tasks.workunit.client.1.smithi164.stdout:0/95: getdents d1/d4/da 0 2024-04-20T21:58:50.987 INFO:tasks.workunit.client.1.smithi164.stdout:2/65: readlink d2/lf 0 2024-04-20T21:58:50.989 INFO:tasks.workunit.client.0.smithi142.stdout:0/950: fsync d5/d13/d1e/d23/f39 0 2024-04-20T21:58:50.997 INFO:tasks.workunit.client.0.smithi142.stdout:4/915: creat d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/dda/dfb/f124 x:0 0 0 2024-04-20T21:58:50.999 INFO:tasks.workunit.client.1.smithi164.stdout:5/84: write f9 [8491296,26708] 0 2024-04-20T21:58:50.999 INFO:tasks.workunit.client.0.smithi142.stdout:4/916: chown d1/d6/d4b/fa5 0 1 2024-04-20T21:58:51.002 INFO:tasks.workunit.client.0.smithi142.stdout:4/917: truncate d1/fd8 426463 0 2024-04-20T21:58:51.005 INFO:tasks.workunit.client.0.smithi142.stdout:4/918: readlink d1/d12/da/ldc 0 2024-04-20T21:58:51.008 INFO:tasks.workunit.client.1.smithi164.stdout:6/137: dwrite d0/f16 [0,4194304] 0 2024-04-20T21:58:51.009 INFO:tasks.workunit.client.0.smithi142.stdout:4/919: rmdir d1/d12/da/d72/dc5/d116 39 2024-04-20T21:58:51.010 INFO:tasks.workunit.client.1.smithi164.stdout:1/96: mkdir d10/d16/d19 0 2024-04-20T21:58:51.011 INFO:tasks.workunit.client.1.smithi164.stdout:4/65: truncate d4/d9/f17 875860 0 2024-04-20T21:58:51.015 INFO:tasks.workunit.client.0.smithi142.stdout:0/951: read d5/d1c/d3c/d4a/fe9 [207065,127618] 0 2024-04-20T21:58:51.021 INFO:tasks.workunit.client.1.smithi164.stdout:4/66: chown d4/d9/f17 25604183 1 2024-04-20T21:58:51.026 INFO:tasks.workunit.client.1.smithi164.stdout:3/112: creat d12/d20/f22 x:0 0 0 2024-04-20T21:58:51.028 INFO:tasks.workunit.client.0.smithi142.stdout:0/952: symlink d5/d13/d1e/d23/d24/d48/db6/l123 0 2024-04-20T21:58:51.039 INFO:tasks.workunit.client.1.smithi164.stdout:6/138: unlink d0/c14 0 2024-04-20T21:58:51.041 INFO:tasks.workunit.client.0.smithi142.stdout:0/953: creat d5/d1c/d3c/d85/d38/f124 x:0 0 0 2024-04-20T21:58:51.043 INFO:tasks.workunit.client.1.smithi164.stdout:1/97: write d10/f11 [5025776,75189] 0 2024-04-20T21:58:51.044 INFO:tasks.workunit.client.1.smithi164.stdout:8/99: dwrite d0/f21 [0,4194304] 0 2024-04-20T21:58:51.044 INFO:tasks.workunit.client.1.smithi164.stdout:3/113: creat d12/d15/f23 x:0 0 0 2024-04-20T21:58:51.053 INFO:tasks.workunit.client.0.smithi142.stdout:4/920: write d1/d12/da/d1c/d32/d3d/d9d/fa2 [660620,34630] 0 2024-04-20T21:58:51.058 INFO:tasks.workunit.client.1.smithi164.stdout:0/96: dread d1/f12 [0,4194304] 0 2024-04-20T21:58:51.061 INFO:tasks.workunit.client.0.smithi142.stdout:4/921: creat d1/d12/da/d72/dc5/f125 x:0 0 0 2024-04-20T21:58:51.061 INFO:tasks.workunit.client.1.smithi164.stdout:7/72: truncate d2/f4 4015785 0 2024-04-20T21:58:51.063 INFO:tasks.workunit.client.1.smithi164.stdout:9/89: dwrite d3/db/dd/fe [0,4194304] 0 2024-04-20T21:58:51.065 INFO:tasks.workunit.client.0.smithi142.stdout:4/922: mknod d1/d12/da/d37/c126 0 2024-04-20T21:58:51.065 INFO:tasks.workunit.client.1.smithi164.stdout:7/73: stat d2/cb 0 2024-04-20T21:58:51.067 INFO:tasks.workunit.client.0.smithi142.stdout:4/923: rmdir d1/d5b/ddd 39 2024-04-20T21:58:51.069 INFO:tasks.workunit.client.1.smithi164.stdout:2/66: dwrite d2/d5/f11 [0,4194304] 0 2024-04-20T21:58:51.070 INFO:tasks.workunit.client.1.smithi164.stdout:8/100: creat d0/d14/f2a x:0 0 0 2024-04-20T21:58:51.071 INFO:tasks.workunit.client.1.smithi164.stdout:5/85: dread dc/f16 [0,4194304] 0 2024-04-20T21:58:51.074 INFO:tasks.workunit.client.0.smithi142.stdout:4/924: creat d1/d12/da/d1c/d32/d3d/f127 x:0 0 0 2024-04-20T21:58:51.082 INFO:tasks.workunit.client.0.smithi142.stdout:4/925: getdents d1/d12/da/d72/dc5/d116 0 2024-04-20T21:58:51.084 INFO:tasks.workunit.client.1.smithi164.stdout:6/139: creat d0/f25 x:0 0 0 2024-04-20T21:58:51.084 INFO:tasks.workunit.client.1.smithi164.stdout:5/86: write f9 [72414,5617] 0 2024-04-20T21:58:51.086 INFO:tasks.workunit.client.0.smithi142.stdout:4/926: write d1/d12/da/d1c/d32/d3d/d2f/d52/d94/faf [5079895,86064] 0 2024-04-20T21:58:51.087 INFO:tasks.workunit.client.1.smithi164.stdout:2/67: creat d2/d5/f14 x:0 0 0 2024-04-20T21:58:51.090 INFO:tasks.workunit.client.0.smithi142.stdout:4/927: mkdir d1/d128 0 2024-04-20T21:58:51.090 INFO:tasks.workunit.client.1.smithi164.stdout:8/101: unlink d0/c1 0 2024-04-20T21:58:51.092 INFO:tasks.workunit.client.1.smithi164.stdout:2/68: stat d2/d5/f11 0 2024-04-20T21:58:51.093 INFO:tasks.workunit.client.0.smithi142.stdout:4/928: unlink d1/d12/c87 0 2024-04-20T21:58:51.093 INFO:tasks.workunit.client.1.smithi164.stdout:5/87: mkdir dc/d12/d1e 0 2024-04-20T21:58:51.093 INFO:tasks.workunit.client.1.smithi164.stdout:8/102: fdatasync d0/f24 0 2024-04-20T21:58:51.095 INFO:tasks.workunit.client.0.smithi142.stdout:0/954: dread d5/d1c/d3c/d85/d38/f42 [0,4194304] 0 2024-04-20T21:58:51.096 INFO:tasks.workunit.client.1.smithi164.stdout:2/69: read - d2/d5/f14 zero size 2024-04-20T21:58:51.098 INFO:tasks.workunit.client.1.smithi164.stdout:8/103: read d0/d14/f6 [102796,84327] 0 2024-04-20T21:58:51.099 INFO:tasks.workunit.client.0.smithi142.stdout:4/929: mknod d1/d6/d4a/db0/c129 0 2024-04-20T21:58:51.099 INFO:tasks.workunit.client.1.smithi164.stdout:6/140: mknod d0/d3/d11/c26 0 2024-04-20T21:58:51.099 INFO:tasks.workunit.client.1.smithi164.stdout:1/98: dwrite d10/f14 [0,4194304] 0 2024-04-20T21:58:51.101 INFO:tasks.workunit.client.1.smithi164.stdout:1/99: fsync d10/f11 0 2024-04-20T21:58:51.103 INFO:tasks.workunit.client.1.smithi164.stdout:5/88: creat dc/d12/d1e/f1f x:0 0 0 2024-04-20T21:58:51.103 INFO:tasks.workunit.client.1.smithi164.stdout:2/70: write d2/d5/f14 [875527,105059] 0 2024-04-20T21:58:51.104 INFO:tasks.workunit.client.1.smithi164.stdout:9/90: dread d3/db/dd/fe [0,4194304] 0 2024-04-20T21:58:51.109 INFO:tasks.workunit.client.0.smithi142.stdout:4/930: rmdir d1/d12/da/d72 39 2024-04-20T21:58:51.110 INFO:tasks.workunit.client.1.smithi164.stdout:9/91: write d3/f6 [1743871,92185] 0 2024-04-20T21:58:51.116 INFO:tasks.workunit.client.1.smithi164.stdout:5/89: symlink dc/d12/l20 0 2024-04-20T21:58:51.122 INFO:tasks.workunit.client.1.smithi164.stdout:6/141: mkdir d0/d3/d27 0 2024-04-20T21:58:51.137 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: pgmap v47: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 37 MiB/s rd, 96 MiB/s wr, 275 op/s 2024-04-20T21:58:51.137 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:51.137 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:51.138 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:58:51.138 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:58:51.138 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:51.138 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:58:51.138 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mgr fail", "who": "smithi164.oejajr"}]: dispatch 2024-04-20T21:58:51.138 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mgr fail", "who": "smithi164.oejajr"}]: dispatch 2024-04-20T21:58:51.138 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: Activating manager daemon smithi142.zzmcfz 2024-04-20T21:58:51.138 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: osdmap e49: 6 total, 6 up, 6 in 2024-04-20T21:58:51.138 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd='[{"prefix": "mgr fail", "who": "smithi164.oejajr"}]': finished 2024-04-20T21:58:51.138 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: mgrmap e26: smithi142.zzmcfz(active, starting, since 0.016506s) 2024-04-20T21:58:51.138 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T21:58:51.138 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:58:51.138 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lirkws"}]: dispatch 2024-04-20T21:58:51.139 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lrvfgg"}]: dispatch 2024-04-20T21:58:51.139 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.ybvzha"}]: dispatch 2024-04-20T21:58:51.139 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.gmmrfu"}]: dispatch 2024-04-20T21:58:51.139 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr metadata", "who": "smithi142.zzmcfz", "id": "smithi142.zzmcfz"}]: dispatch 2024-04-20T21:58:51.139 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T21:58:51.139 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T21:58:51.139 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T21:58:51.139 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:58:51.139 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T21:58:51.139 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T21:58:51.139 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-20T21:58:51.139 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-20T21:58:51.139 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-20T21:58:51.140 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: Manager daemon smithi142.zzmcfz is now available 2024-04-20T21:58:51.140 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:58:51.140 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:58:51.140 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.zzmcfz/mirror_snapshot_schedule"}]: dispatch 2024-04-20T21:58:51.140 INFO:tasks.workunit.client.0.smithi142.stdout:0/955: dread d5/d13/d1e/d23/d46/fc2 [0,4194304] 0 2024-04-20T21:58:51.140 INFO:tasks.workunit.client.0.smithi142.stdout:0/956: chown d5/d1c/d3c/d85/d38/d62/f75 22210 1 2024-04-20T21:58:51.141 INFO:tasks.workunit.client.1.smithi164.stdout:1/100: mkdir d10/d16/d19/d1a 0 2024-04-20T21:58:51.144 INFO:tasks.workunit.client.0.smithi142.stdout:4/931: write d1/d6/d4a/d5a/d80/f97 [376905,87142] 0 2024-04-20T21:58:51.144 INFO:tasks.workunit.client.1.smithi164.stdout:9/92: write d3/db/dd/fe [1174114,63853] 0 2024-04-20T21:58:51.144 INFO:tasks.workunit.client.1.smithi164.stdout:6/142: unlink d0/f20 0 2024-04-20T21:58:51.145 INFO:tasks.workunit.client.0.smithi142.stdout:0/957: symlink d5/d1c/l125 0 2024-04-20T21:58:51.153 INFO:tasks.workunit.client.1.smithi164.stdout:2/71: dwrite d2/f9 [0,4194304] 0 2024-04-20T21:58:51.153 INFO:tasks.workunit.client.1.smithi164.stdout:3/114: dwrite f9 [0,4194304] 0 2024-04-20T21:58:51.161 INFO:tasks.workunit.client.1.smithi164.stdout:5/90: dwrite f6 [0,4194304] 0 2024-04-20T21:58:51.161 INFO:tasks.workunit.client.1.smithi164.stdout:2/72: write d2/d5/f14 [1536859,65088] 0 2024-04-20T21:58:51.163 INFO:tasks.workunit.client.1.smithi164.stdout:2/73: stat c1 0 2024-04-20T21:58:51.163 INFO:tasks.workunit.client.0.smithi142.stdout:4/932: getdents d1/d6/d4a/db0 0 2024-04-20T21:58:51.165 INFO:tasks.workunit.client.1.smithi164.stdout:8/104: dwrite d0/d14/d16/f26 [0,4194304] 0 2024-04-20T21:58:51.175 INFO:tasks.workunit.client.0.smithi142.stdout:4/933: mkdir d1/d12/da/d1c/d32/d3d/dbb/d12a 0 2024-04-20T21:58:51.178 INFO:tasks.workunit.client.0.smithi142.stdout:0/958: dwrite d5/f6c [0,4194304] 0 2024-04-20T21:58:51.201 INFO:tasks.workunit.client.0.smithi142.stdout:0/959: dwrite d5/d1d/f102 [0,4194304] 0 2024-04-20T21:58:51.206 INFO:tasks.workunit.client.0.smithi142.stdout:4/934: dwrite d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/dda/dfb/f124 [0,4194304] 0 2024-04-20T21:58:51.228 INFO:tasks.workunit.client.0.smithi142.stdout:0/960: rename d5/d45/d6f/d70/da9/lc3 to d5/d45/l126 0 2024-04-20T21:58:51.229 INFO:tasks.workunit.client.0.smithi142.stdout:4/935: dwrite d1/f13 [0,4194304] 0 2024-04-20T21:58:51.231 INFO:tasks.workunit.client.0.smithi142.stdout:4/936: chown d1/d6/d4b/fa5 1020 1 2024-04-20T21:58:51.240 INFO:tasks.workunit.client.0.smithi142.stdout:0/961: rename d5/d6d to d5/d13/d1e/d23/d127 0 2024-04-20T21:58:51.243 INFO:tasks.workunit.client.0.smithi142.stdout:0/962: read - d5/d1c/d3c/d85/d63/f99 zero size 2024-04-20T21:58:51.246 INFO:tasks.workunit.client.1.smithi164.stdout:4/67: sync 2024-04-20T21:58:51.249 INFO:tasks.workunit.client.0.smithi142.stdout:0/963: chown d5/d45/d6f/d70/da9/lfb 3 1 2024-04-20T21:58:51.249 INFO:tasks.workunit.client.0.smithi142.stdout:4/937: getdents d1/d12/da/d1c/da9/dba 0 2024-04-20T21:58:51.254 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: pgmap v47: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 37 MiB/s rd, 96 MiB/s wr, 275 op/s 2024-04-20T21:58:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:58:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:58:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' 2024-04-20T21:58:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:58:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.24359 172.21.15.164:0/4158786383' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mgr fail", "who": "smithi164.oejajr"}]: dispatch 2024-04-20T21:58:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "mgr fail", "who": "smithi164.oejajr"}]: dispatch 2024-04-20T21:58:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: Activating manager daemon smithi142.zzmcfz 2024-04-20T21:58:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: osdmap e49: 6 total, 6 up, 6 in 2024-04-20T21:58:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.24359 ' entity='mgr.smithi164.oejajr' cmd='[{"prefix": "mgr fail", "who": "smithi164.oejajr"}]': finished 2024-04-20T21:58:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: mgrmap e26: smithi142.zzmcfz(active, starting, since 0.016506s) 2024-04-20T21:58:51.255 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T21:58:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T21:58:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lirkws"}]: dispatch 2024-04-20T21:58:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lrvfgg"}]: dispatch 2024-04-20T21:58:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.ybvzha"}]: dispatch 2024-04-20T21:58:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.gmmrfu"}]: dispatch 2024-04-20T21:58:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr metadata", "who": "smithi142.zzmcfz", "id": "smithi142.zzmcfz"}]: dispatch 2024-04-20T21:58:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T21:58:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T21:58:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T21:58:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T21:58:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T21:58:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T21:58:51.256 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-20T21:58:51.257 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-20T21:58:51.257 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-20T21:58:51.257 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: Manager daemon smithi142.zzmcfz is now available 2024-04-20T21:58:51.257 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:58:51.257 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:58:51.257 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.zzmcfz/mirror_snapshot_schedule"}]: dispatch 2024-04-20T21:58:51.257 INFO:tasks.workunit.client.0.smithi142.stdout:4/938: fsync d1/d12/da/d1c/f88 0 2024-04-20T21:58:51.271 INFO:tasks.workunit.client.1.smithi164.stdout:1/101: rmdir d10/d16/d19 39 2024-04-20T21:58:51.271 INFO:tasks.workunit.client.1.smithi164.stdout:6/143: write d0/f6 [1225559,113486] 0 2024-04-20T21:58:51.273 INFO:tasks.workunit.client.1.smithi164.stdout:9/93: fdatasync d3/db/f10 0 2024-04-20T21:58:51.276 INFO:tasks.workunit.client.1.smithi164.stdout:1/102: dread f5 [0,4194304] 0 2024-04-20T21:58:51.276 INFO:tasks.workunit.client.0.smithi142.stdout:4/939: creat d1/d12/da/f12b x:0 0 0 2024-04-20T21:58:51.278 INFO:tasks.workunit.client.1.smithi164.stdout:2/74: symlink d2/l15 0 2024-04-20T21:58:51.279 INFO:tasks.workunit.client.1.smithi164.stdout:2/75: truncate d2/fa 734716 0 2024-04-20T21:58:51.280 INFO:tasks.workunit.client.0.smithi142.stdout:4/940: write d1/f117 [1543043,76821] 0 2024-04-20T21:58:51.281 INFO:tasks.workunit.client.1.smithi164.stdout:2/76: fsync d2/d5/f11 0 2024-04-20T21:58:51.283 INFO:tasks.workunit.client.1.smithi164.stdout:2/77: write d2/d5/fd [2900987,122217] 0 2024-04-20T21:58:51.286 INFO:tasks.workunit.client.1.smithi164.stdout:3/115: unlink d12/c13 0 2024-04-20T21:58:51.287 INFO:tasks.workunit.client.1.smithi164.stdout:5/91: mknod dc/c21 0 2024-04-20T21:58:51.288 INFO:tasks.workunit.client.1.smithi164.stdout:3/116: write d12/f1f [705144,71719] 0 2024-04-20T21:58:51.289 INFO:tasks.workunit.client.0.smithi142.stdout:4/941: creat d1/d12/d115/f12c x:0 0 0 2024-04-20T21:58:51.294 INFO:tasks.workunit.client.0.smithi142.stdout:0/964: rename d5/d45/d6f/d70/da9 to d5/d13/d1e/d23/d24/d128 0 2024-04-20T21:58:51.296 INFO:tasks.workunit.client.0.smithi142.stdout:4/942: readlink d1/d12/le5 0 2024-04-20T21:58:51.307 INFO:tasks.workunit.client.0.smithi142.stdout:0/965: symlink d5/d13/d1e/d23/l129 0 2024-04-20T21:58:51.308 INFO:tasks.workunit.client.0.smithi142.stdout:0/966: dread - d5/d1c/d3c/fcd zero size 2024-04-20T21:58:51.311 INFO:tasks.workunit.client.0.smithi142.stdout:0/967: chown d5/d13/c36 27447185 1 2024-04-20T21:58:51.316 INFO:tasks.workunit.client.0.smithi142.stdout:0/968: chown d5/d1c/d3c/d8b/fb5 460562 1 2024-04-20T21:58:51.329 INFO:tasks.workunit.client.0.smithi142.stdout:0/969: dread d5/d1c/f5c [0,4194304] 0 2024-04-20T21:58:51.340 INFO:tasks.workunit.client.1.smithi164.stdout:9/94: symlink d3/l1c 0 2024-04-20T21:58:51.340 INFO:tasks.workunit.client.1.smithi164.stdout:5/92: mkdir dc/d12/d22 0 2024-04-20T21:58:51.342 INFO:tasks.workunit.client.1.smithi164.stdout:4/68: creat d4/f1d x:0 0 0 2024-04-20T21:58:51.343 INFO:tasks.workunit.client.1.smithi164.stdout:5/93: fdatasync f7 0 2024-04-20T21:58:51.343 INFO:tasks.workunit.client.1.smithi164.stdout:9/95: readlink d3/l12 0 2024-04-20T21:58:51.343 INFO:tasks.workunit.client.1.smithi164.stdout:3/117: dread f6 [0,4194304] 0 2024-04-20T21:58:51.343 INFO:tasks.workunit.client.1.smithi164.stdout:9/96: chown d3 266850 1 2024-04-20T21:58:51.345 INFO:tasks.workunit.client.1.smithi164.stdout:2/78: dread d2/f9 [0,4194304] 0 2024-04-20T21:58:51.346 INFO:tasks.workunit.client.1.smithi164.stdout:9/97: readlink d3/l15 0 2024-04-20T21:58:51.347 INFO:tasks.workunit.client.1.smithi164.stdout:2/79: chown d2/cc 413514267 1 2024-04-20T21:58:51.349 INFO:tasks.workunit.client.1.smithi164.stdout:8/105: chown d0/d1e/f20 1572 1 2024-04-20T21:58:51.352 INFO:tasks.workunit.client.1.smithi164.stdout:3/118: unlink d12/c1a 0 2024-04-20T21:58:51.354 INFO:tasks.workunit.client.1.smithi164.stdout:4/69: creat d4/d9/f1e x:0 0 0 2024-04-20T21:58:51.356 INFO:tasks.workunit.client.1.smithi164.stdout:6/144: getdents d0/d3/d11 0 2024-04-20T21:58:51.358 INFO:tasks.workunit.client.1.smithi164.stdout:6/145: write d0/d3/f1b [357099,100169] 0 2024-04-20T21:58:51.367 INFO:tasks.workunit.client.1.smithi164.stdout:4/70: mknod d4/d9/c1f 0 2024-04-20T21:58:51.369 INFO:tasks.workunit.client.1.smithi164.stdout:6/146: unlink d0/d3/d11/l1a 0 2024-04-20T21:58:51.371 INFO:tasks.workunit.client.1.smithi164.stdout:3/119: dread f4 [0,4194304] 0 2024-04-20T21:58:51.376 INFO:tasks.workunit.client.1.smithi164.stdout:9/98: dwrite d3/f18 [0,4194304] 0 2024-04-20T21:58:51.381 INFO:tasks.workunit.client.1.smithi164.stdout:3/120: write d12/f16 [13379,41074] 0 2024-04-20T21:58:51.381 INFO:tasks.workunit.client.1.smithi164.stdout:8/106: dwrite d0/f24 [0,4194304] 0 2024-04-20T21:58:51.396 INFO:tasks.workunit.client.1.smithi164.stdout:6/147: getdents d0/d3/d15/d22 0 2024-04-20T21:58:51.401 INFO:tasks.workunit.client.1.smithi164.stdout:3/121: creat d12/d15/f24 x:0 0 0 2024-04-20T21:58:51.402 INFO:tasks.workunit.client.1.smithi164.stdout:3/122: dread - d12/d15/f1b zero size 2024-04-20T21:58:51.402 INFO:tasks.workunit.client.1.smithi164.stdout:9/99: mknod d3/db/d1b/c1d 0 2024-04-20T21:58:51.403 INFO:tasks.workunit.client.1.smithi164.stdout:3/123: read - d12/d15/f21 zero size 2024-04-20T21:58:51.404 INFO:tasks.workunit.client.1.smithi164.stdout:3/124: dread - ff zero size 2024-04-20T21:58:51.405 INFO:tasks.workunit.client.1.smithi164.stdout:6/148: mkdir d0/d3/d8/d28 0 2024-04-20T21:58:51.405 INFO:tasks.workunit.client.1.smithi164.stdout:0/97: sync 2024-04-20T21:58:51.406 INFO:tasks.workunit.client.0.smithi142.stdout:0/970: creat d5/d13/d1e/d23/d46/de6/f12a x:0 0 0 2024-04-20T21:58:51.408 INFO:tasks.workunit.client.1.smithi164.stdout:9/100: fdatasync d3/db/f10 0 2024-04-20T21:58:51.409 INFO:tasks.workunit.client.1.smithi164.stdout:3/125: symlink d12/l25 0 2024-04-20T21:58:51.411 INFO:tasks.workunit.client.1.smithi164.stdout:6/149: mkdir d0/d3/d11/d29 0 2024-04-20T21:58:51.411 INFO:tasks.workunit.client.1.smithi164.stdout:3/126: write d12/f1f [1108880,24683] 0 2024-04-20T21:58:51.412 INFO:tasks.workunit.client.1.smithi164.stdout:8/107: link d0/d14/f25 d0/d14/f2b 0 2024-04-20T21:58:51.413 INFO:tasks.workunit.client.1.smithi164.stdout:3/127: chown d12/d20/f22 520203 1 2024-04-20T21:58:51.415 INFO:tasks.workunit.client.1.smithi164.stdout:9/101: mkdir d3/db/d1b/d1e 0 2024-04-20T21:58:51.416 INFO:tasks.workunit.client.1.smithi164.stdout:6/150: creat d0/d3/d15/f2a x:0 0 0 2024-04-20T21:58:51.417 INFO:tasks.workunit.client.1.smithi164.stdout:5/94: truncate f9 27783 0 2024-04-20T21:58:51.430 INFO:tasks.workunit.client.0.smithi142.stdout:0/971: write d5/d13/f7d [1154496,39211] 0 2024-04-20T21:58:51.451 INFO:tasks.workunit.client.0.smithi142.stdout:0/972: dwrite d5/d1c/d3c/d85/fea [4194304,4194304] 0 2024-04-20T21:58:51.453 INFO:tasks.workunit.client.0.smithi142.stdout:0/973: dread - d5/d1c/ff3 zero size 2024-04-20T21:58:51.454 INFO:tasks.workunit.client.0.smithi142.stdout:0/974: readlink d5/d13/d1e/l40 0 2024-04-20T21:58:51.456 INFO:tasks.workunit.client.0.smithi142.stdout:0/975: stat d5/d1c/d3c/d85/d32/l35 0 2024-04-20T21:58:51.485 INFO:tasks.workunit.client.0.smithi142.stdout:0/976: dread d5/d1c/d3c/d85/d63/f64 [0,4194304] 0 2024-04-20T21:58:51.495 INFO:tasks.workunit.client.0.smithi142.stdout:0/977: truncate d5/d13/d1e/d23/d24/d48/d55/f88 541668 0 2024-04-20T21:58:51.498 INFO:tasks.workunit.client.0.smithi142.stdout:0/978: mkdir d5/d45/d6f/d12b 0 2024-04-20T21:58:51.503 INFO:tasks.workunit.client.1.smithi164.stdout:3/128: creat d12/d15/f26 x:0 0 0 2024-04-20T21:58:51.505 INFO:tasks.workunit.client.1.smithi164.stdout:2/80: truncate d2/d5/f14 467734 0 2024-04-20T21:58:51.507 INFO:tasks.workunit.client.0.smithi142.stdout:0/979: write d5/d1c/d3c/d4a/d78/fd8 [457190,53311] 0 2024-04-20T21:58:51.507 INFO:tasks.workunit.client.1.smithi164.stdout:4/71: truncate d4/fb 522702 0 2024-04-20T21:58:51.511 INFO:tasks.workunit.client.1.smithi164.stdout:3/129: mknod d12/d20/c27 0 2024-04-20T21:58:51.512 INFO:tasks.workunit.client.1.smithi164.stdout:5/95: mknod dc/d12/d1e/c23 0 2024-04-20T21:58:51.512 INFO:tasks.workunit.client.1.smithi164.stdout:2/81: mknod d2/d5/c16 0 2024-04-20T21:58:51.512 INFO:tasks.workunit.client.0.smithi142.stdout:0/980: creat d5/d1c/d3c/d4a/d78/f12c x:0 0 0 2024-04-20T21:58:51.514 INFO:tasks.workunit.client.1.smithi164.stdout:3/130: write f11 [323954,107246] 0 2024-04-20T21:58:51.515 INFO:tasks.workunit.client.1.smithi164.stdout:8/108: dread d0/f24 [0,4194304] 0 2024-04-20T21:58:51.516 INFO:tasks.workunit.client.1.smithi164.stdout:8/109: stat d0 0 2024-04-20T21:58:51.516 INFO:tasks.workunit.client.0.smithi142.stdout:0/981: stat d5/d1c/d3c/d85/d38/ldd 0 2024-04-20T21:58:51.517 INFO:tasks.workunit.client.0.smithi142.stdout:0/982: stat d5/dc9 0 2024-04-20T21:58:51.517 INFO:tasks.workunit.client.1.smithi164.stdout:9/102: creat d3/f1f x:0 0 0 2024-04-20T21:58:51.518 INFO:tasks.workunit.client.1.smithi164.stdout:9/103: chown d3 1098811 1 2024-04-20T21:58:51.519 INFO:tasks.workunit.client.1.smithi164.stdout:4/72: rename d4/f1a to d4/d9/f20 0 2024-04-20T21:58:51.521 INFO:tasks.workunit.client.1.smithi164.stdout:8/110: truncate d0/d14/f12 1669974 0 2024-04-20T21:58:51.521 INFO:tasks.workunit.client.1.smithi164.stdout:6/151: dread d0/d3/f10 [0,4194304] 0 2024-04-20T21:58:51.522 INFO:tasks.workunit.client.0.smithi142.stdout:0/983: creat d5/d45/d6f/d12b/f12d x:0 0 0 2024-04-20T21:58:51.523 INFO:tasks.workunit.client.1.smithi164.stdout:3/131: mknod d12/d20/c28 0 2024-04-20T21:58:51.523 INFO:tasks.workunit.client.0.smithi142.stdout:0/984: fdatasync d5/d1c/d3c/d85/f76 0 2024-04-20T21:58:51.524 INFO:tasks.workunit.client.1.smithi164.stdout:9/104: mkdir d3/db/d1b/d20 0 2024-04-20T21:58:51.526 INFO:tasks.workunit.client.1.smithi164.stdout:4/73: symlink d4/d9/l21 0 2024-04-20T21:58:51.526 INFO:tasks.workunit.client.0.smithi142.stdout:0/985: write d5/d13/d1e/d23/d46/de6/f12a [398397,99165] 0 2024-04-20T21:58:51.530 INFO:tasks.workunit.client.1.smithi164.stdout:8/111: fdatasync d0/d14/f25 0 2024-04-20T21:58:51.530 INFO:tasks.workunit.client.1.smithi164.stdout:4/74: truncate d4/d9/fc 399065 0 2024-04-20T21:58:51.535 INFO:tasks.workunit.client.1.smithi164.stdout:2/82: dwrite d2/d5/f11 [4194304,4194304] 0 2024-04-20T21:58:51.538 INFO:tasks.workunit.client.1.smithi164.stdout:8/112: symlink d0/d1e/l2c 0 2024-04-20T21:58:51.538 INFO:tasks.workunit.client.0.smithi142.stdout:0/986: link d5/d1d/l7a d5/dc9/l12e 0 2024-04-20T21:58:51.541 INFO:tasks.workunit.client.0.smithi142.stdout:0/987: stat d5/d1c/d3c/d85/d32/l35 0 2024-04-20T21:58:51.542 INFO:tasks.workunit.client.1.smithi164.stdout:4/75: mkdir d4/d9/d22 0 2024-04-20T21:58:51.543 INFO:tasks.workunit.client.1.smithi164.stdout:6/152: rename d0/d3/d15/d22 to d0/d3/d2b 0 2024-04-20T21:58:51.543 INFO:tasks.workunit.client.0.smithi142.stdout:0/988: write d5/d1c/d3c/d8b/fb5 [224516,130358] 0 2024-04-20T21:58:51.545 INFO:tasks.workunit.client.1.smithi164.stdout:2/83: dread d2/fa [0,4194304] 0 2024-04-20T21:58:51.552 INFO:tasks.workunit.client.1.smithi164.stdout:8/113: symlink d0/d14/d16/l2d 0 2024-04-20T21:58:51.553 INFO:tasks.workunit.client.1.smithi164.stdout:7/74: sync 2024-04-20T21:58:51.559 INFO:tasks.workunit.client.1.smithi164.stdout:8/114: symlink d0/d14/l2e 0 2024-04-20T21:58:51.560 INFO:tasks.workunit.client.1.smithi164.stdout:7/75: creat d2/f13 x:0 0 0 2024-04-20T21:58:51.562 INFO:tasks.workunit.client.1.smithi164.stdout:2/84: read d2/d5/f14 [445903,120291] 0 2024-04-20T21:58:51.564 INFO:tasks.workunit.client.0.smithi142.stdout:0/989: write d5/d1c/d3c/d85/d63/f99 [999059,78295] 0 2024-04-20T21:58:51.567 INFO:tasks.workunit.client.0.smithi142.stdout:0/990: dread - d5/d1d/d7e/db0/dd0/f10d zero size 2024-04-20T21:58:51.570 INFO:tasks.workunit.client.1.smithi164.stdout:7/76: mknod d2/c14 0 2024-04-20T21:58:51.571 INFO:tasks.workunit.client.0.smithi142.stdout:0/991: symlink d5/d13/d1e/d23/l12f 0 2024-04-20T21:58:51.575 INFO:tasks.workunit.client.1.smithi164.stdout:2/85: symlink d2/l17 0 2024-04-20T21:58:51.577 INFO:tasks.workunit.client.0.smithi142.stdout:0/992: mkdir d5/d13/d1e/d23/d24/d48/db6/d130 0 2024-04-20T21:58:51.583 INFO:tasks.workunit.client.1.smithi164.stdout:4/76: dwrite d4/fe [0,4194304] 0 2024-04-20T21:58:51.587 INFO:tasks.workunit.client.0.smithi142.stdout:0/993: creat d5/d1c/d3c/d8b/f131 x:0 0 0 2024-04-20T21:58:51.588 INFO:tasks.workunit.client.1.smithi164.stdout:6/153: dwrite d0/f6 [0,4194304] 0 2024-04-20T21:58:51.588 INFO:tasks.workunit.client.1.smithi164.stdout:9/105: dwrite d3/db/f10 [0,4194304] 0 2024-04-20T21:58:51.589 INFO:tasks.workunit.client.1.smithi164.stdout:4/77: readlink d4/d9/l21 0 2024-04-20T21:58:51.590 INFO:tasks.workunit.client.1.smithi164.stdout:7/77: chown d2/fc 1828445020 1 2024-04-20T21:58:51.591 INFO:tasks.workunit.client.1.smithi164.stdout:2/86: symlink d2/d5/l18 0 2024-04-20T21:58:51.592 INFO:tasks.workunit.client.1.smithi164.stdout:4/78: read - d4/f16 zero size 2024-04-20T21:58:51.593 INFO:tasks.workunit.client.1.smithi164.stdout:6/154: read d0/f16 [1775129,103445] 0 2024-04-20T21:58:51.595 INFO:tasks.workunit.client.1.smithi164.stdout:5/96: dwrite f9 [0,4194304] 0 2024-04-20T21:58:51.595 INFO:tasks.workunit.client.1.smithi164.stdout:7/78: chown d2/fc 0 1 2024-04-20T21:58:51.600 INFO:tasks.workunit.client.1.smithi164.stdout:9/106: write d3/db/dd/f11 [1231096,110392] 0 2024-04-20T21:58:51.600 INFO:tasks.workunit.client.1.smithi164.stdout:2/87: mkdir d2/d19 0 2024-04-20T21:58:51.606 INFO:tasks.workunit.client.1.smithi164.stdout:7/79: creat d2/f15 x:0 0 0 2024-04-20T21:58:51.610 INFO:tasks.workunit.client.0.smithi142.stdout:0/994: rename d5/d13/d1e/d23/d24/d48/db6/l123 to d5/d13/l132 0 2024-04-20T21:58:51.611 INFO:tasks.workunit.client.1.smithi164.stdout:7/80: stat d2 0 2024-04-20T21:58:51.611 INFO:tasks.workunit.client.1.smithi164.stdout:4/79: dread d4/d9/fc [0,4194304] 0 2024-04-20T21:58:51.611 INFO:tasks.workunit.client.1.smithi164.stdout:6/155: creat d0/d3/d15/f2c x:0 0 0 2024-04-20T21:58:51.612 INFO:tasks.workunit.client.1.smithi164.stdout:4/80: chown d4/d9/f1b 3085504 1 2024-04-20T21:58:51.613 INFO:tasks.workunit.client.0.smithi142.stdout:0/995: fdatasync d5/d1d/d7e/f104 0 2024-04-20T21:58:51.615 INFO:tasks.workunit.client.1.smithi164.stdout:4/81: chown d4/d9/f17 64990 1 2024-04-20T21:58:51.620 INFO:tasks.workunit.client.1.smithi164.stdout:7/81: truncate d2/f4 3178220 0 2024-04-20T21:58:51.620 INFO:tasks.workunit.client.1.smithi164.stdout:2/88: dread d2/d5/f11 [4194304,4194304] 0 2024-04-20T21:58:51.622 INFO:tasks.workunit.client.1.smithi164.stdout:5/97: creat dc/f24 x:0 0 0 2024-04-20T21:58:51.622 INFO:tasks.workunit.client.1.smithi164.stdout:9/107: dread d3/db/dd/f11 [0,4194304] 0 2024-04-20T21:58:51.625 INFO:tasks.workunit.client.1.smithi164.stdout:4/82: symlink d4/d9/l23 0 2024-04-20T21:58:51.625 INFO:tasks.workunit.client.1.smithi164.stdout:2/89: fsync d2/f9 0 2024-04-20T21:58:51.626 INFO:tasks.workunit.client.1.smithi164.stdout:4/83: readlink d4/d9/l23 0 2024-04-20T21:58:51.628 INFO:tasks.workunit.client.0.smithi142.stdout:4/943: sync 2024-04-20T21:58:51.628 INFO:tasks.workunit.client.1.smithi164.stdout:7/82: creat d2/f16 x:0 0 0 2024-04-20T21:58:51.629 INFO:tasks.workunit.client.1.smithi164.stdout:2/90: write d2/f12 [1502533,10699] 0 2024-04-20T21:58:51.633 INFO:tasks.workunit.client.1.smithi164.stdout:9/108: mknod d3/c21 0 2024-04-20T21:58:51.641 INFO:tasks.workunit.client.0.smithi142.stdout:4/944: dread d1/d6/d30/f3a [0,4194304] 0 2024-04-20T21:58:51.643 INFO:tasks.workunit.client.1.smithi164.stdout:9/109: rename c1 to d3/db/c22 0 2024-04-20T21:58:51.643 INFO:tasks.workunit.client.1.smithi164.stdout:7/83: link d2/c14 d2/c17 0 2024-04-20T21:58:51.645 INFO:tasks.workunit.client.1.smithi164.stdout:7/84: dread - d2/f10 zero size 2024-04-20T21:58:51.645 INFO:tasks.workunit.client.1.smithi164.stdout:5/98: dread f3 [0,4194304] 0 2024-04-20T21:58:51.647 INFO:tasks.workunit.client.1.smithi164.stdout:9/110: truncate d3/f6 2000095 0 2024-04-20T21:58:51.652 INFO:tasks.workunit.client.0.smithi142.stdout:4/945: unlink d1/d12/da/d1c/d32/d3d/d2f/d7a/c114 0 2024-04-20T21:58:51.653 INFO:tasks.workunit.client.1.smithi164.stdout:2/91: link c1 d2/c1a 0 2024-04-20T21:58:51.655 INFO:tasks.workunit.client.0.smithi142.stdout:0/996: write d5/d13/d1e/d23/d24/f79 [96535,87139] 0 2024-04-20T21:58:51.661 INFO:tasks.workunit.client.0.smithi142.stdout:4/946: creat d1/d128/f12d x:0 0 0 2024-04-20T21:58:51.663 INFO:tasks.workunit.client.1.smithi164.stdout:9/111: creat d3/db/dd/f23 x:0 0 0 2024-04-20T21:58:51.669 INFO:tasks.workunit.client.0.smithi142.stdout:0/997: mknod d5/d1c/d3c/d4a/c133 0 2024-04-20T21:58:51.673 INFO:tasks.workunit.client.1.smithi164.stdout:5/99: creat dc/f25 x:0 0 0 2024-04-20T21:58:51.674 INFO:tasks.workunit.client.0.smithi142.stdout:0/998: mknod d5/d13/d1e/d23/d24/d48/d55/c134 0 2024-04-20T21:58:51.675 INFO:tasks.workunit.client.1.smithi164.stdout:6/156: dwrite d0/d3/f12 [0,4194304] 0 2024-04-20T21:58:51.675 INFO:tasks.workunit.client.0.smithi142.stdout:0/999: chown d5/d1c/d3c/d95 122 1 2024-04-20T21:58:51.676 INFO:tasks.workunit.client.1.smithi164.stdout:7/85: write d2/f4 [1160568,37406] 0 2024-04-20T21:58:51.678 INFO:tasks.workunit.client.1.smithi164.stdout:7/86: rename d2 to d2/d18 22 2024-04-20T21:58:51.678 INFO:tasks.workunit.client.1.smithi164.stdout:2/92: chown c0 38 1 2024-04-20T21:58:51.680 INFO:tasks.workunit.client.0.smithi142.stdout:4/947: write d1/d12/da/d1c/d32/d3d/d2f/d49/f62 [3530553,31683] 0 2024-04-20T21:58:51.681 INFO:tasks.workunit.client.1.smithi164.stdout:4/84: dwrite d4/fa [0,4194304] 0 2024-04-20T21:58:51.681 INFO:tasks.workunit.client.1.smithi164.stdout:9/112: symlink d3/l24 0 2024-04-20T21:58:51.684 INFO:tasks.workunit.client.0.smithi142.stdout:4/948: write d1/d12/da/f12b [845909,31610] 0 2024-04-20T21:58:51.685 INFO:tasks.workunit.client.1.smithi164.stdout:7/87: symlink d2/l19 0 2024-04-20T21:58:51.686 INFO:tasks.workunit.client.1.smithi164.stdout:9/113: write d3/f1f [909411,50399] 0 2024-04-20T21:58:51.689 INFO:tasks.workunit.client.1.smithi164.stdout:7/88: write d2/f13 [953994,105019] 0 2024-04-20T21:58:51.690 INFO:tasks.workunit.client.1.smithi164.stdout:6/157: mknod d0/d3/c2d 0 2024-04-20T21:58:51.692 INFO:tasks.workunit.client.1.smithi164.stdout:4/85: unlink d4/d9/f20 0 2024-04-20T21:58:51.695 INFO:tasks.workunit.client.1.smithi164.stdout:9/114: rmdir d3/db/dd 39 2024-04-20T21:58:51.699 INFO:tasks.workunit.client.1.smithi164.stdout:9/115: write d3/db/f1a [119385,83221] 0 2024-04-20T21:58:51.699 INFO:tasks.workunit.client.0.smithi142.stdout:4/949: mknod d1/d12/da/c12e 0 2024-04-20T21:58:51.700 INFO:tasks.workunit.client.1.smithi164.stdout:2/93: dread d2/f9 [0,4194304] 0 2024-04-20T21:58:51.701 INFO:tasks.workunit.client.1.smithi164.stdout:2/94: fdatasync d2/f9 0 2024-04-20T21:58:51.704 INFO:tasks.workunit.client.1.smithi164.stdout:6/158: symlink d0/d3/l2e 0 2024-04-20T21:58:51.706 INFO:tasks.workunit.client.1.smithi164.stdout:1/103: sync 2024-04-20T21:58:51.706 INFO:tasks.workunit.client.1.smithi164.stdout:2/95: write d2/f12 [1293122,121005] 0 2024-04-20T21:58:51.706 INFO:tasks.workunit.client.1.smithi164.stdout:0/98: sync 2024-04-20T21:58:51.706 INFO:tasks.workunit.client.0.smithi142.stdout:4/950: truncate d1/d6/d4a/d5a/f5d 5106503 0 2024-04-20T21:58:51.708 INFO:tasks.workunit.client.1.smithi164.stdout:9/116: fdatasync d3/db/dd/f23 0 2024-04-20T21:58:51.711 INFO:tasks.workunit.client.1.smithi164.stdout:2/96: chown d2/f9 8 1 2024-04-20T21:58:51.711 INFO:tasks.workunit.client.1.smithi164.stdout:7/89: dwrite d2/f5 [0,4194304] 0 2024-04-20T21:58:51.712 INFO:tasks.workunit.client.1.smithi164.stdout:1/104: write f7 [3133119,77479] 0 2024-04-20T21:58:51.713 INFO:tasks.workunit.client.0.smithi142.stdout:4/951: symlink d1/d12/da/d1c/d32/l12f 0 2024-04-20T21:58:51.714 INFO:tasks.workunit.client.1.smithi164.stdout:6/159: write d0/d3/d15/f2a [633366,84591] 0 2024-04-20T21:58:51.716 INFO:tasks.workunit.client.1.smithi164.stdout:2/97: chown d2/d5/f11 261879 1 2024-04-20T21:58:51.717 INFO:tasks.workunit.client.1.smithi164.stdout:0/99: mknod d1/c19 0 2024-04-20T21:58:51.718 INFO:tasks.workunit.client.1.smithi164.stdout:9/117: stat c2 0 2024-04-20T21:58:51.721 INFO:tasks.workunit.client.0.smithi142.stdout:4/952: rename d1/d12/da/d1c/d32/d3d/d2f/d7a to d1/d12/da/d1c/d32/d3d/d2f/d7a/d130 22 2024-04-20T21:58:51.724 INFO:tasks.workunit.client.1.smithi164.stdout:6/160: mknod d0/d3/d11/c2f 0 2024-04-20T21:58:51.727 INFO:tasks.workunit.client.1.smithi164.stdout:4/86: dwrite f3 [0,4194304] 0 2024-04-20T21:58:51.727 INFO:tasks.workunit.client.1.smithi164.stdout:4/87: chown d4/d9 392026 1 2024-04-20T21:58:51.729 INFO:tasks.workunit.client.1.smithi164.stdout:1/105: creat d10/d16/d19/f1b x:0 0 0 2024-04-20T21:58:51.729 INFO:tasks.workunit.client.1.smithi164.stdout:1/106: readlink l2 0 2024-04-20T21:58:51.730 INFO:tasks.workunit.client.1.smithi164.stdout:7/90: rename d2/l12 to d2/l1a 0 2024-04-20T21:58:51.733 INFO:tasks.workunit.client.0.smithi142.stdout:4/953: unlink d1/d12/da/d1c/l51 0 2024-04-20T21:58:51.734 INFO:tasks.workunit.client.1.smithi164.stdout:2/98: creat d2/f1b x:0 0 0 2024-04-20T21:58:51.734 INFO:tasks.workunit.client.1.smithi164.stdout:2/99: stat d2/f1b 0 2024-04-20T21:58:51.736 INFO:tasks.workunit.client.1.smithi164.stdout:2/100: rename d2 to d2/d5/d1c 22 2024-04-20T21:58:51.741 INFO:tasks.workunit.client.1.smithi164.stdout:0/100: creat d1/d4/df/f1a x:0 0 0 2024-04-20T21:58:51.742 INFO:tasks.workunit.client.1.smithi164.stdout:2/101: fsync d2/d5/f14 0 2024-04-20T21:58:51.746 INFO:tasks.workunit.client.1.smithi164.stdout:9/118: creat d3/db/d1b/d1e/f25 x:0 0 0 2024-04-20T21:58:51.746 INFO:tasks.workunit.client.1.smithi164.stdout:4/88: creat d4/d9/d22/f24 x:0 0 0 2024-04-20T21:58:51.749 INFO:tasks.workunit.client.1.smithi164.stdout:9/119: chown d3/db/dd/f11 37098 1 2024-04-20T21:58:51.755 INFO:tasks.workunit.client.1.smithi164.stdout:6/161: creat d0/f30 x:0 0 0 2024-04-20T21:58:51.756 INFO:tasks.workunit.client.1.smithi164.stdout:1/107: link l6 d10/l1c 0 2024-04-20T21:58:51.761 INFO:tasks.workunit.client.1.smithi164.stdout:0/101: creat d1/f1b x:0 0 0 2024-04-20T21:58:51.761 INFO:tasks.workunit.client.1.smithi164.stdout:1/108: write d10/f14 [5194169,44153] 0 2024-04-20T21:58:51.763 INFO:tasks.workunit.client.1.smithi164.stdout:6/162: symlink d0/d3/d15/l31 0 2024-04-20T21:58:51.765 INFO:tasks.workunit.client.1.smithi164.stdout:9/120: mknod d3/db/c26 0 2024-04-20T21:58:51.766 INFO:tasks.workunit.client.1.smithi164.stdout:6/163: fsync d0/d3/f18 0 2024-04-20T21:58:51.766 INFO:tasks.workunit.client.1.smithi164.stdout:0/102: readlink d1/d4/df/l17 0 2024-04-20T21:58:51.768 INFO:tasks.workunit.client.1.smithi164.stdout:6/164: readlink d0/le 0 2024-04-20T21:58:51.769 INFO:tasks.workunit.client.1.smithi164.stdout:2/102: getdents d2/d5 0 2024-04-20T21:58:51.769 INFO:tasks.workunit.client.1.smithi164.stdout:1/109: symlink d10/d16/l1d 0 2024-04-20T21:58:51.772 INFO:tasks.workunit.client.1.smithi164.stdout:4/89: truncate d4/fa 3308572 0 2024-04-20T21:58:51.772 INFO:tasks.workunit.client.1.smithi164.stdout:0/103: dread - d1/f1b zero size 2024-04-20T21:58:51.773 INFO:tasks.workunit.client.1.smithi164.stdout:1/110: chown f7 122 1 2024-04-20T21:58:51.775 INFO:tasks.workunit.client.1.smithi164.stdout:1/111: chown f1 158345 1 2024-04-20T21:58:51.776 INFO:tasks.workunit.client.1.smithi164.stdout:2/103: fsync d2/fa 0 2024-04-20T21:58:51.778 INFO:tasks.workunit.client.1.smithi164.stdout:1/112: write f1 [1374346,71225] 0 2024-04-20T21:58:51.780 INFO:tasks.workunit.client.1.smithi164.stdout:6/165: link d0/d3/f1b d0/d3/d15/f32 0 2024-04-20T21:58:51.782 INFO:tasks.workunit.client.1.smithi164.stdout:4/90: mknod d4/c25 0 2024-04-20T21:58:51.785 INFO:tasks.workunit.client.1.smithi164.stdout:6/166: dread d0/d3/d8/fa [0,4194304] 0 2024-04-20T21:58:51.785 INFO:tasks.workunit.client.1.smithi164.stdout:0/104: rename d1/d4/da/c18 to d1/d4/c1c 0 2024-04-20T21:58:51.787 INFO:tasks.workunit.client.1.smithi164.stdout:9/121: dread d3/db/f17 [0,4194304] 0 2024-04-20T21:58:51.787 INFO:tasks.workunit.client.1.smithi164.stdout:0/105: write d1/f1b [367543,89585] 0 2024-04-20T21:58:51.789 INFO:tasks.workunit.client.1.smithi164.stdout:2/104: creat d2/d5/f1d x:0 0 0 2024-04-20T21:58:51.791 INFO:tasks.workunit.client.1.smithi164.stdout:0/106: chown d1/d4/da 0 1 2024-04-20T21:58:51.791 INFO:tasks.workunit.client.1.smithi164.stdout:1/113: symlink d10/d16/l1e 0 2024-04-20T21:58:51.792 INFO:tasks.workunit.client.1.smithi164.stdout:9/122: write d3/db/f10 [5056337,59433] 0 2024-04-20T21:58:51.793 INFO:tasks.workunit.client.1.smithi164.stdout:6/167: creat d0/d3/d8/d28/f33 x:0 0 0 2024-04-20T21:58:51.795 INFO:tasks.workunit.client.1.smithi164.stdout:9/123: readlink d3/l19 0 2024-04-20T21:58:51.798 INFO:tasks.workunit.client.1.smithi164.stdout:8/115: sync 2024-04-20T21:58:51.798 INFO:tasks.workunit.client.1.smithi164.stdout:3/132: sync 2024-04-20T21:58:51.802 INFO:tasks.workunit.client.1.smithi164.stdout:1/114: unlink d10/d16/d19/f1b 0 2024-04-20T21:58:51.804 INFO:tasks.workunit.client.1.smithi164.stdout:4/91: creat d4/f26 x:0 0 0 2024-04-20T21:58:51.806 INFO:tasks.workunit.client.1.smithi164.stdout:3/133: rmdir d12/d15 39 2024-04-20T21:58:51.808 INFO:tasks.workunit.client.1.smithi164.stdout:8/116: rename d0/d1e/l28 to d0/d1e/l2f 0 2024-04-20T21:58:51.810 INFO:tasks.workunit.client.1.smithi164.stdout:1/115: mkdir d10/d16/d19/d1f 0 2024-04-20T21:58:51.812 INFO:tasks.workunit.client.1.smithi164.stdout:2/105: dread d2/d5/f11 [4194304,4194304] 0 2024-04-20T21:58:51.813 INFO:tasks.workunit.client.1.smithi164.stdout:9/124: mkdir d3/d27 0 2024-04-20T21:58:51.814 INFO:tasks.workunit.client.1.smithi164.stdout:8/117: chown d0/d1e/f20 216208303 1 2024-04-20T21:58:51.821 INFO:tasks.workunit.client.1.smithi164.stdout:9/125: mknod d3/db/d1b/d1e/c28 0 2024-04-20T21:58:51.822 INFO:tasks.workunit.client.1.smithi164.stdout:8/118: fsync d0/d1e/f22 0 2024-04-20T21:58:51.824 INFO:tasks.workunit.client.1.smithi164.stdout:2/106: mknod d2/d19/c1e 0 2024-04-20T21:58:51.826 INFO:tasks.workunit.client.1.smithi164.stdout:9/126: chown d3 15636 1 2024-04-20T21:58:51.827 INFO:tasks.workunit.client.1.smithi164.stdout:6/168: dwrite d0/d3/f1c [8388608,4194304] 0 2024-04-20T21:58:51.836 INFO:tasks.workunit.client.1.smithi164.stdout:2/107: symlink d2/d19/l1f 0 2024-04-20T21:58:51.838 INFO:tasks.workunit.client.1.smithi164.stdout:9/127: chown d3/db/dd/f23 213017 1 2024-04-20T21:58:51.839 INFO:tasks.workunit.client.1.smithi164.stdout:0/107: dwrite d1/d4/df/f1a [0,4194304] 0 2024-04-20T21:58:51.839 INFO:tasks.workunit.client.1.smithi164.stdout:3/134: dread d12/f1f [0,4194304] 0 2024-04-20T21:58:51.841 INFO:tasks.workunit.client.1.smithi164.stdout:1/116: rename d10/d16/d19/d1f to d10/d16/d20 0 2024-04-20T21:58:51.843 INFO:tasks.workunit.client.1.smithi164.stdout:6/169: write d0/d3/d15/f2c [801967,42444] 0 2024-04-20T21:58:51.844 INFO:tasks.workunit.client.1.smithi164.stdout:9/128: chown d3/l19 1111471 1 2024-04-20T21:58:51.847 INFO:tasks.workunit.client.1.smithi164.stdout:2/108: chown d2/d5/l10 250773 1 2024-04-20T21:58:51.849 INFO:tasks.workunit.client.1.smithi164.stdout:1/117: mknod d10/d16/d20/c21 0 2024-04-20T21:58:51.849 INFO:tasks.workunit.client.1.smithi164.stdout:3/135: fsync d12/f18 0 2024-04-20T21:58:51.851 INFO:tasks.workunit.client.1.smithi164.stdout:8/119: getdents d0/d14/d16 0 2024-04-20T21:58:51.851 INFO:tasks.workunit.client.1.smithi164.stdout:9/129: symlink d3/db/dd/l29 0 2024-04-20T21:58:51.851 INFO:tasks.workunit.client.1.smithi164.stdout:4/92: dwrite f3 [4194304,4194304] 0 2024-04-20T21:58:51.852 INFO:tasks.workunit.client.1.smithi164.stdout:3/136: readlink d12/l1d 0 2024-04-20T21:58:51.853 INFO:tasks.workunit.client.1.smithi164.stdout:0/108: dread d1/f1b [0,4194304] 0 2024-04-20T21:58:51.854 INFO:tasks.workunit.client.1.smithi164.stdout:6/170: mknod d0/d3/d15/c34 0 2024-04-20T21:58:51.855 INFO:tasks.workunit.client.1.smithi164.stdout:9/130: stat d3/fa 0 2024-04-20T21:58:51.856 INFO:tasks.workunit.client.1.smithi164.stdout:4/93: stat d4/fe 0 2024-04-20T21:58:51.862 INFO:tasks.workunit.client.1.smithi164.stdout:8/120: truncate d0/f1b 256002 0 2024-04-20T21:58:51.862 INFO:tasks.workunit.client.1.smithi164.stdout:4/94: mkdir d4/d9/d27 0 2024-04-20T21:58:51.865 INFO:tasks.workunit.client.1.smithi164.stdout:6/171: symlink d0/d3/d11/d29/l35 0 2024-04-20T21:58:51.865 INFO:tasks.workunit.client.1.smithi164.stdout:0/109: stat d1/d4/c1c 0 2024-04-20T21:58:51.867 INFO:tasks.workunit.client.1.smithi164.stdout:9/131: mkdir d3/d27/d2a 0 2024-04-20T21:58:51.868 INFO:tasks.workunit.client.1.smithi164.stdout:3/137: symlink d12/d15/l29 0 2024-04-20T21:58:51.869 INFO:tasks.workunit.client.1.smithi164.stdout:6/172: chown d0/d3/c2d 0 1 2024-04-20T21:58:51.871 INFO:tasks.workunit.client.1.smithi164.stdout:7/91: sync 2024-04-20T21:58:51.872 INFO:tasks.workunit.client.1.smithi164.stdout:0/110: rmdir d1 39 2024-04-20T21:58:51.874 INFO:tasks.workunit.client.1.smithi164.stdout:5/100: sync 2024-04-20T21:58:51.881 INFO:tasks.workunit.client.1.smithi164.stdout:7/92: write f1 [2190132,22515] 0 2024-04-20T21:58:51.881 INFO:tasks.workunit.client.1.smithi164.stdout:3/138: mkdir d12/d2a 0 2024-04-20T21:58:51.885 INFO:tasks.workunit.client.1.smithi164.stdout:9/132: symlink d3/d27/l2b 0 2024-04-20T21:58:51.885 INFO:tasks.workunit.client.1.smithi164.stdout:2/109: dread d2/d5/fd [0,4194304] 0 2024-04-20T21:58:51.885 INFO:tasks.workunit.client.1.smithi164.stdout:1/118: dread d10/f11 [0,4194304] 0 2024-04-20T21:58:51.886 INFO:tasks.workunit.client.1.smithi164.stdout:4/95: truncate d4/fa 2453707 0 2024-04-20T21:58:51.887 INFO:tasks.workunit.client.1.smithi164.stdout:3/139: read - d12/d15/f26 zero size 2024-04-20T21:58:51.891 INFO:tasks.workunit.client.1.smithi164.stdout:8/121: truncate d0/d14/f12 1198402 0 2024-04-20T21:58:51.892 INFO:tasks.workunit.client.1.smithi164.stdout:7/93: creat d2/f1b x:0 0 0 2024-04-20T21:58:51.893 INFO:tasks.workunit.client.1.smithi164.stdout:5/101: symlink dc/d12/d22/l26 0 2024-04-20T21:58:51.894 INFO:tasks.workunit.client.1.smithi164.stdout:0/111: mknod d1/d4/df/c1d 0 2024-04-20T21:58:51.899 INFO:tasks.workunit.client.1.smithi164.stdout:3/140: dread d12/d15/f1c [0,4194304] 0 2024-04-20T21:58:51.900 INFO:tasks.workunit.client.1.smithi164.stdout:7/94: creat d2/f1c x:0 0 0 2024-04-20T21:58:51.903 INFO:tasks.workunit.client.1.smithi164.stdout:8/122: mknod d0/d14/c30 0 2024-04-20T21:58:51.903 INFO:tasks.workunit.client.1.smithi164.stdout:4/96: mkdir d4/d28 0 2024-04-20T21:58:51.904 INFO:tasks.workunit.client.1.smithi164.stdout:6/173: link d0/d3/d11/c26 d0/d3/d15/d21/c36 0 2024-04-20T21:58:51.904 INFO:tasks.workunit.client.1.smithi164.stdout:3/141: fdatasync f10 0 2024-04-20T21:58:51.907 INFO:tasks.workunit.client.1.smithi164.stdout:0/112: truncate d1/fb 1234584 0 2024-04-20T21:58:51.913 INFO:tasks.workunit.client.1.smithi164.stdout:3/142: creat d12/d20/f2b x:0 0 0 2024-04-20T21:58:51.916 INFO:tasks.workunit.client.1.smithi164.stdout:8/123: rename d0/d14/l2e to d0/d14/d16/l31 0 2024-04-20T21:58:51.918 INFO:tasks.workunit.client.1.smithi164.stdout:3/143: dread - d12/f1e zero size 2024-04-20T21:58:51.918 INFO:tasks.workunit.client.1.smithi164.stdout:4/97: creat d4/d9/d27/f29 x:0 0 0 2024-04-20T21:58:51.918 INFO:tasks.workunit.client.0.smithi142.stdout:4/954: sync 2024-04-20T21:58:51.919 INFO:tasks.workunit.client.1.smithi164.stdout:9/133: dread d3/f18 [0,4194304] 0 2024-04-20T21:58:51.920 INFO:tasks.workunit.client.1.smithi164.stdout:6/174: creat d0/f37 x:0 0 0 2024-04-20T21:58:51.921 INFO:tasks.workunit.client.0.smithi142.stdout:4/955: read d1/d12/da/d1c/da9/fe9 [3934013,129519] 0 2024-04-20T21:58:51.922 INFO:tasks.workunit.client.1.smithi164.stdout:4/98: readlink d4/d9/l21 0 2024-04-20T21:58:51.922 INFO:tasks.workunit.client.1.smithi164.stdout:3/144: write f9 [4353843,49047] 0 2024-04-20T21:58:51.924 INFO:tasks.workunit.client.0.smithi142.stdout:4/956: symlink d1/d12/da/l131 0 2024-04-20T21:58:51.926 INFO:tasks.workunit.client.1.smithi164.stdout:8/124: write d0/fc [1789115,13224] 0 2024-04-20T21:58:51.929 INFO:tasks.workunit.client.1.smithi164.stdout:1/119: dread d10/f15 [0,4194304] 0 2024-04-20T21:58:51.929 INFO:tasks.workunit.client.0.smithi142.stdout:4/957: mkdir d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/dda/d132 0 2024-04-20T21:58:51.930 INFO:tasks.workunit.client.1.smithi164.stdout:9/134: fsync d3/db/dd/f11 0 2024-04-20T21:58:51.933 INFO:tasks.workunit.client.1.smithi164.stdout:4/99: symlink d4/d9/d27/l2a 0 2024-04-20T21:58:51.937 INFO:tasks.workunit.client.1.smithi164.stdout:8/125: creat d0/d14/f32 x:0 0 0 2024-04-20T21:58:51.939 INFO:tasks.workunit.client.1.smithi164.stdout:2/110: dwrite d2/d5/f11 [4194304,4194304] 0 2024-04-20T21:58:51.941 INFO:tasks.workunit.client.1.smithi164.stdout:6/175: rmdir d0/d3/d2b 0 2024-04-20T21:58:51.942 INFO:tasks.workunit.client.1.smithi164.stdout:9/135: chown d3/c13 4 1 2024-04-20T21:58:51.944 INFO:tasks.workunit.client.1.smithi164.stdout:5/102: dwrite dc/d12/d1e/f1f [0,4194304] 0 2024-04-20T21:58:51.947 INFO:tasks.workunit.client.0.smithi142.stdout:4/958: dwrite d1/d12/da/d37/d89/f121 [0,4194304] 0 2024-04-20T21:58:51.951 INFO:tasks.workunit.client.1.smithi164.stdout:7/95: getdents d2 0 2024-04-20T21:58:51.953 INFO:tasks.workunit.client.0.smithi142.stdout:4/959: write d1/d12/da/f7f [2961116,107644] 0 2024-04-20T21:58:51.956 INFO:tasks.workunit.client.0.smithi142.stdout:4/960: mknod d1/d6/d4a/d5a/d80/dd7/c133 0 2024-04-20T21:58:51.960 INFO:tasks.workunit.client.1.smithi164.stdout:2/111: creat d2/f20 x:0 0 0 2024-04-20T21:58:51.962 INFO:tasks.workunit.client.0.smithi142.stdout:4/961: mknod d1/d12/da/d1c/d32/d3d/d2f/d52/c134 0 2024-04-20T21:58:51.964 INFO:tasks.workunit.client.1.smithi164.stdout:7/96: mkdir d2/d1d 0 2024-04-20T21:58:51.965 INFO:tasks.workunit.client.1.smithi164.stdout:3/145: dread fa [0,4194304] 0 2024-04-20T21:58:51.967 INFO:tasks.workunit.client.1.smithi164.stdout:2/112: stat d2/d5/c13 0 2024-04-20T21:58:51.968 INFO:tasks.workunit.client.0.smithi142.stdout:4/962: symlink d1/d12/da/d1c/d32/d3d/d2f/d7a/l135 0 2024-04-20T21:58:51.970 INFO:tasks.workunit.client.1.smithi164.stdout:5/103: creat dc/d12/d22/f27 x:0 0 0 2024-04-20T21:58:51.971 INFO:tasks.workunit.client.1.smithi164.stdout:4/100: rename d4/f1c to d4/f2b 0 2024-04-20T21:58:51.972 INFO:tasks.workunit.client.1.smithi164.stdout:8/126: creat d0/f33 x:0 0 0 2024-04-20T21:58:51.975 INFO:tasks.workunit.client.1.smithi164.stdout:7/97: dread - d2/f7 zero size 2024-04-20T21:58:51.982 INFO:tasks.workunit.client.1.smithi164.stdout:5/104: creat dc/d12/d1e/f28 x:0 0 0 2024-04-20T21:58:51.982 INFO:tasks.workunit.client.1.smithi164.stdout:0/113: dread d1/fb [0,4194304] 0 2024-04-20T21:58:51.983 INFO:tasks.workunit.client.1.smithi164.stdout:2/113: mkdir d2/d5/d21 0 2024-04-20T21:58:51.985 INFO:tasks.workunit.client.1.smithi164.stdout:4/101: dread - d4/d9/d27/f29 zero size 2024-04-20T21:58:51.985 INFO:tasks.workunit.client.1.smithi164.stdout:1/120: dwrite d10/f11 [4194304,4194304] 0 2024-04-20T21:58:51.985 INFO:tasks.workunit.client.1.smithi164.stdout:0/114: chown d1/d4 1551217853 1 2024-04-20T21:58:51.986 INFO:tasks.workunit.client.0.smithi142.stdout:4/963: dwrite d1/d12/da/d1c/d32/d3d/d2f/d73/fd1 [0,4194304] 0 2024-04-20T21:58:51.988 INFO:tasks.workunit.client.1.smithi164.stdout:3/146: chown cb 57477 1 2024-04-20T21:58:51.989 INFO:tasks.workunit.client.1.smithi164.stdout:2/114: fsync d2/d5/f1d 0 2024-04-20T21:58:51.989 INFO:tasks.workunit.client.1.smithi164.stdout:6/176: dwrite d0/d3/f18 [0,4194304] 0 2024-04-20T21:58:51.990 INFO:tasks.workunit.client.1.smithi164.stdout:5/105: fsync dc/f1a 0 2024-04-20T21:58:51.991 INFO:tasks.workunit.client.1.smithi164.stdout:4/102: chown d4 30598 1 2024-04-20T21:58:51.994 INFO:tasks.workunit.client.1.smithi164.stdout:5/106: truncate dc/f24 634910 0 2024-04-20T21:58:51.994 INFO:tasks.workunit.client.1.smithi164.stdout:7/98: mknod d2/c1e 0 2024-04-20T21:58:51.995 INFO:tasks.workunit.client.1.smithi164.stdout:6/177: write d0/d3/f18 [607052,105025] 0 2024-04-20T21:58:51.998 INFO:tasks.workunit.client.1.smithi164.stdout:3/147: chown d12/d15/f1b 361807588 1 2024-04-20T21:58:52.002 INFO:tasks.workunit.client.1.smithi164.stdout:8/127: write d0/f24 [2943104,71810] 0 2024-04-20T21:58:52.009 INFO:tasks.workunit.client.1.smithi164.stdout:2/115: creat d2/d5/f22 x:0 0 0 2024-04-20T21:58:52.009 INFO:tasks.workunit.client.1.smithi164.stdout:4/103: creat d4/d9/d27/f2c x:0 0 0 2024-04-20T21:58:52.012 INFO:tasks.workunit.client.0.smithi142.stdout:4/964: dwrite d1/d6/d4b/f95 [4194304,4194304] 0 2024-04-20T21:58:52.012 INFO:tasks.workunit.client.1.smithi164.stdout:9/136: dwrite d3/ff [0,4194304] 0 2024-04-20T21:58:52.019 INFO:tasks.workunit.client.1.smithi164.stdout:6/178: link d0/f25 d0/d3/d8/f38 0 2024-04-20T21:58:52.024 INFO:tasks.workunit.client.1.smithi164.stdout:3/148: mkdir d12/d2a/d2c 0 2024-04-20T21:58:52.028 INFO:tasks.workunit.client.1.smithi164.stdout:7/99: rmdir d2/d1d 0 2024-04-20T21:58:52.029 INFO:tasks.workunit.client.1.smithi164.stdout:8/128: creat d0/d14/d16/f34 x:0 0 0 2024-04-20T21:58:52.031 INFO:tasks.workunit.client.1.smithi164.stdout:5/107: dread f5 [0,4194304] 0 2024-04-20T21:58:52.031 INFO:tasks.workunit.client.1.smithi164.stdout:3/149: chown f4 67 1 2024-04-20T21:58:52.032 INFO:tasks.workunit.client.1.smithi164.stdout:7/100: dread - d2/f1c zero size 2024-04-20T21:58:52.038 INFO:tasks.workunit.client.0.smithi142.stdout:4/965: link d1/d12/d115/f11b d1/d12/da/d1c/d32/d3d/d2f/d73/f136 0 2024-04-20T21:58:52.039 INFO:tasks.workunit.client.1.smithi164.stdout:0/115: dwrite d1/f9 [0,4194304] 0 2024-04-20T21:58:52.040 INFO:tasks.workunit.client.1.smithi164.stdout:1/121: getdents d10 0 2024-04-20T21:58:52.040 INFO:tasks.workunit.client.1.smithi164.stdout:6/179: fsync d0/d3/fb 0 2024-04-20T21:58:52.040 INFO:tasks.workunit.client.1.smithi164.stdout:0/116: fdatasync d1/fb 0 2024-04-20T21:58:52.044 INFO:tasks.workunit.client.1.smithi164.stdout:5/108: symlink dc/l29 0 2024-04-20T21:58:52.044 INFO:tasks.workunit.client.1.smithi164.stdout:8/129: readlink d0/d14/d16/l2d 0 2024-04-20T21:58:52.046 INFO:tasks.workunit.client.0.smithi142.stdout:4/966: dread - d1/d12/da/d1c/d32/d3d/d2f/d52/d94/df6/fe8 zero size 2024-04-20T21:58:52.047 INFO:tasks.workunit.client.1.smithi164.stdout:5/109: dread - dc/d12/d1e/f28 zero size 2024-04-20T21:58:52.049 INFO:tasks.workunit.client.1.smithi164.stdout:4/104: dread d4/d9/f11 [0,4194304] 0 2024-04-20T21:58:52.052 INFO:tasks.workunit.client.1.smithi164.stdout:3/150: dread d12/f18 [0,4194304] 0 2024-04-20T21:58:52.052 INFO:tasks.workunit.client.1.smithi164.stdout:8/130: dread - d0/d14/f2a zero size 2024-04-20T21:58:52.053 INFO:tasks.workunit.client.0.smithi142.stdout:4/967: readlink d1/d12/da/d1c/d32/d3d/d2f/d52/d6d/la6 0 2024-04-20T21:58:52.053 INFO:tasks.workunit.client.1.smithi164.stdout:4/105: creat d4/d9/f2d x:0 0 0 2024-04-20T21:58:52.056 INFO:tasks.workunit.client.0.smithi142.stdout:4/968: read d1/d6/d4b/f95 [979866,91188] 0 2024-04-20T21:58:52.056 INFO:tasks.workunit.client.1.smithi164.stdout:5/110: symlink dc/l2a 0 2024-04-20T21:58:52.059 INFO:tasks.workunit.client.1.smithi164.stdout:3/151: write d12/d15/f23 [625355,90874] 0 2024-04-20T21:58:52.061 INFO:tasks.workunit.client.1.smithi164.stdout:5/111: dread - dc/d12/f17 zero size 2024-04-20T21:58:52.062 INFO:tasks.workunit.client.0.smithi142.stdout:4/969: creat d1/d6/d4a/d5a/d80/dd7/df5/f137 x:0 0 0 2024-04-20T21:58:52.064 INFO:tasks.workunit.client.1.smithi164.stdout:4/106: write d4/f2b [788028,97555] 0 2024-04-20T21:58:52.070 INFO:tasks.workunit.client.1.smithi164.stdout:4/107: read - d4/d9/d22/f24 zero size 2024-04-20T21:58:52.070 INFO:tasks.workunit.client.1.smithi164.stdout:5/112: chown dc/d12/d22 86 1 2024-04-20T21:58:52.073 INFO:tasks.workunit.client.1.smithi164.stdout:4/108: chown d4/d9/fc 12146000 1 2024-04-20T21:58:52.074 INFO:tasks.workunit.client.1.smithi164.stdout:5/113: chown f4 137220 1 2024-04-20T21:58:52.077 INFO:tasks.workunit.client.1.smithi164.stdout:9/137: truncate d3/f6 577062 0 2024-04-20T21:58:52.079 INFO:tasks.workunit.client.0.smithi142.stdout:4/970: dwrite d1/d12/da/d1c/fd9 [0,4194304] 0 2024-04-20T21:58:52.080 INFO:tasks.workunit.client.1.smithi164.stdout:5/114: read f3 [324812,4659] 0 2024-04-20T21:58:52.081 INFO:tasks.workunit.client.1.smithi164.stdout:1/122: truncate d10/f11 1709781 0 2024-04-20T21:58:52.084 INFO:tasks.workunit.client.1.smithi164.stdout:5/115: fsync dc/d12/f15 0 2024-04-20T21:58:52.085 INFO:tasks.workunit.client.0.smithi142.stdout:4/971: read - d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/dda/f11f zero size 2024-04-20T21:58:52.087 INFO:tasks.workunit.client.0.smithi142.stdout:4/972: chown d1/d12/da/d1c/d32/f43 1 1 2024-04-20T21:58:52.089 INFO:tasks.workunit.client.1.smithi164.stdout:9/138: mknod d3/db/dd/c2c 0 2024-04-20T21:58:52.091 INFO:tasks.workunit.client.1.smithi164.stdout:6/180: dwrite d0/d3/fb [0,4194304] 0 2024-04-20T21:58:52.091 INFO:tasks.workunit.client.1.smithi164.stdout:2/116: dwrite d2/d5/f14 [0,4194304] 0 2024-04-20T21:58:52.098 INFO:tasks.workunit.client.1.smithi164.stdout:6/181: chown d0/d3/f10 415785685 1 2024-04-20T21:58:52.098 INFO:tasks.workunit.client.1.smithi164.stdout:0/117: dread d1/f8 [0,4194304] 0 2024-04-20T21:58:52.105 INFO:tasks.workunit.client.1.smithi164.stdout:6/182: readlink d0/ld 0 2024-04-20T21:58:52.113 INFO:tasks.workunit.client.1.smithi164.stdout:3/152: dwrite d12/d15/f1c [0,4194304] 0 2024-04-20T21:58:52.117 INFO:tasks.workunit.client.0.smithi142.stdout:4/973: dread d1/d12/d115/f9c [0,4194304] 0 2024-04-20T21:58:52.120 INFO:tasks.workunit.client.1.smithi164.stdout:6/183: creat d0/d3/d11/f39 x:0 0 0 2024-04-20T21:58:52.121 INFO:tasks.workunit.client.1.smithi164.stdout:8/131: dwrite d0/d14/f2a [0,4194304] 0 2024-04-20T21:58:52.122 INFO:tasks.workunit.client.0.smithi142.stdout:4/974: creat d1/d6/d4a/f138 x:0 0 0 2024-04-20T21:58:52.126 INFO:tasks.workunit.client.1.smithi164.stdout:5/116: rename dc/d12/d22 to dc/d2b 0 2024-04-20T21:58:52.127 INFO:tasks.workunit.client.0.smithi142.stdout:4/975: chown d1/d12/faa 106856542 1 2024-04-20T21:58:52.130 INFO:tasks.workunit.client.1.smithi164.stdout:3/153: rmdir d12/d2a/d2c 0 2024-04-20T21:58:52.135 INFO:tasks.workunit.client.1.smithi164.stdout:5/117: stat dc/d12/d1e/c23 0 2024-04-20T21:58:52.141 INFO:tasks.workunit.client.1.smithi164.stdout:6/184: rename d0/f4 to d0/d3/f3a 0 2024-04-20T21:58:52.150 INFO:tasks.workunit.client.1.smithi164.stdout:4/109: dwrite d4/f15 [0,4194304] 0 2024-04-20T21:58:52.157 INFO:tasks.workunit.client.0.smithi142.stdout:4/976: write f0 [2858143,59290] 0 2024-04-20T21:58:52.158 INFO:tasks.workunit.client.1.smithi164.stdout:4/110: fdatasync d4/f7 0 2024-04-20T21:58:52.158 INFO:tasks.workunit.client.1.smithi164.stdout:6/185: chown d0/d3/d15/c34 107616 1 2024-04-20T21:58:52.159 INFO:tasks.workunit.client.1.smithi164.stdout:2/117: write d2/fa [575231,38990] 0 2024-04-20T21:58:52.161 INFO:tasks.workunit.client.1.smithi164.stdout:7/101: sync 2024-04-20T21:58:52.161 INFO:tasks.workunit.client.1.smithi164.stdout:0/118: dread d1/f12 [0,4194304] 0 2024-04-20T21:58:52.161 INFO:tasks.workunit.client.0.smithi142.stdout:4/977: creat d1/d6/d4a/d5a/d80/dd7/f139 x:0 0 0 2024-04-20T21:58:52.162 INFO:tasks.workunit.client.1.smithi164.stdout:1/123: dwrite f1 [0,4194304] 0 2024-04-20T21:58:52.163 INFO:tasks.workunit.client.1.smithi164.stdout:9/139: dwrite d3/ff [0,4194304] 0 2024-04-20T21:58:52.165 INFO:tasks.workunit.client.1.smithi164.stdout:4/111: chown d4/d9/f1e 3752 1 2024-04-20T21:58:52.167 INFO:tasks.workunit.client.1.smithi164.stdout:7/102: read f1 [686622,33990] 0 2024-04-20T21:58:52.167 INFO:tasks.workunit.client.1.smithi164.stdout:9/140: readlink d3/l12 0 2024-04-20T21:58:52.171 INFO:tasks.workunit.client.1.smithi164.stdout:4/112: chown d4/f2b 103365 1 2024-04-20T21:58:52.179 INFO:tasks.workunit.client.1.smithi164.stdout:8/132: dwrite d0/d1e/f22 [0,4194304] 0 2024-04-20T21:58:52.185 INFO:tasks.workunit.client.1.smithi164.stdout:3/154: dread d12/f14 [0,4194304] 0 2024-04-20T21:58:52.185 INFO:tasks.workunit.client.1.smithi164.stdout:5/118: mkdir dc/d2c 0 2024-04-20T21:58:52.186 INFO:tasks.workunit.client.1.smithi164.stdout:3/155: dread - d12/d15/f24 zero size 2024-04-20T21:58:52.188 INFO:tasks.workunit.client.1.smithi164.stdout:3/156: truncate f6 1806231 0 2024-04-20T21:58:52.188 INFO:tasks.workunit.client.1.smithi164.stdout:3/157: dread - d12/f1e zero size 2024-04-20T21:58:52.189 INFO:tasks.workunit.client.1.smithi164.stdout:0/119: rmdir d1/d4 39 2024-04-20T21:58:52.197 INFO:tasks.workunit.client.1.smithi164.stdout:7/103: creat d2/f1f x:0 0 0 2024-04-20T21:58:52.198 INFO:tasks.workunit.client.1.smithi164.stdout:9/141: creat d3/db/d1b/d1e/f2d x:0 0 0 2024-04-20T21:58:52.199 INFO:tasks.workunit.client.1.smithi164.stdout:4/113: rename d4/d9/l23 to d4/d9/d27/l2e 0 2024-04-20T21:58:52.201 INFO:tasks.workunit.client.1.smithi164.stdout:3/158: mknod d12/d2a/c2d 0 2024-04-20T21:58:52.203 INFO:tasks.workunit.client.1.smithi164.stdout:6/186: mkdir d0/d3/d15/d23/d3b 0 2024-04-20T21:58:52.203 INFO:tasks.workunit.client.1.smithi164.stdout:2/118: mknod d2/d5/d21/c23 0 2024-04-20T21:58:52.206 INFO:tasks.workunit.client.1.smithi164.stdout:7/104: creat d2/f20 x:0 0 0 2024-04-20T21:58:52.207 INFO:tasks.workunit.client.1.smithi164.stdout:9/142: symlink d3/db/d1b/l2e 0 2024-04-20T21:58:52.208 INFO:tasks.workunit.client.1.smithi164.stdout:3/159: rename d12/d20/c28 to d12/d15/c2e 0 2024-04-20T21:58:52.209 INFO:tasks.workunit.client.1.smithi164.stdout:7/105: write d2/f10 [2745,64973] 0 2024-04-20T21:58:52.212 INFO:tasks.workunit.client.1.smithi164.stdout:5/119: link dc/ce dc/d2b/c2d 0 2024-04-20T21:58:52.213 INFO:tasks.workunit.client.1.smithi164.stdout:6/187: fsync d0/d3/d8/fa 0 2024-04-20T21:58:52.213 INFO:tasks.workunit.client.1.smithi164.stdout:4/114: link d4/d9/d27/f2c d4/d9/d22/f2f 0 2024-04-20T21:58:52.216 INFO:tasks.workunit.client.1.smithi164.stdout:3/160: creat d12/d15/f2f x:0 0 0 2024-04-20T21:58:52.217 INFO:tasks.workunit.client.1.smithi164.stdout:7/106: mkdir d2/d21 0 2024-04-20T21:58:52.218 INFO:tasks.workunit.client.1.smithi164.stdout:5/120: write dc/d2b/f27 [223233,109258] 0 2024-04-20T21:58:52.218 INFO:tasks.workunit.client.0.smithi142.stdout:4/978: dread f0 [0,4194304] 0 2024-04-20T21:58:52.220 INFO:tasks.workunit.client.1.smithi164.stdout:2/119: getdents d2/d19 0 2024-04-20T21:58:52.222 INFO:tasks.workunit.client.1.smithi164.stdout:6/188: creat d0/d3/d8/f3c x:0 0 0 2024-04-20T21:58:52.223 INFO:tasks.workunit.client.0.smithi142.stdout:4/979: mknod d1/d12/da/d1c/d32/d3d/d2f/d52/d103/c13a 0 2024-04-20T21:58:52.223 INFO:tasks.workunit.client.1.smithi164.stdout:2/120: write d2/d5/f22 [488085,109247] 0 2024-04-20T21:58:52.224 INFO:tasks.workunit.client.1.smithi164.stdout:5/121: mkdir dc/d2c/d2e 0 2024-04-20T21:58:52.225 INFO:tasks.workunit.client.1.smithi164.stdout:7/107: write d2/fc [2470879,51131] 0 2024-04-20T21:58:52.226 INFO:tasks.workunit.client.0.smithi142.stdout:4/980: dread - d1/d12/da/d1c/d32/d3d/de7/fed zero size 2024-04-20T21:58:52.230 INFO:tasks.workunit.client.1.smithi164.stdout:6/189: mkdir d0/d3/d8/d28/d3d 0 2024-04-20T21:58:52.232 INFO:tasks.workunit.client.1.smithi164.stdout:0/120: dread d1/d4/df/f1a [0,4194304] 0 2024-04-20T21:58:52.232 INFO:tasks.workunit.client.1.smithi164.stdout:5/122: mkdir dc/d2b/d2f 0 2024-04-20T21:58:52.234 INFO:tasks.workunit.client.1.smithi164.stdout:6/190: dread - d0/d3/d8/f38 zero size 2024-04-20T21:58:52.234 INFO:tasks.workunit.client.1.smithi164.stdout:7/108: symlink d2/l22 0 2024-04-20T21:58:52.238 INFO:tasks.workunit.client.1.smithi164.stdout:7/109: write d2/f1c [378671,69327] 0 2024-04-20T21:58:52.243 INFO:tasks.workunit.client.1.smithi164.stdout:9/143: dwrite d3/db/dd/f23 [0,4194304] 0 2024-04-20T21:58:52.245 INFO:tasks.workunit.client.1.smithi164.stdout:2/121: dread d2/f12 [0,4194304] 0 2024-04-20T21:58:52.245 INFO:tasks.workunit.client.1.smithi164.stdout:0/121: symlink d1/l1e 0 2024-04-20T21:58:52.245 INFO:tasks.workunit.client.1.smithi164.stdout:5/123: mkdir dc/d2c/d2e/d30 0 2024-04-20T21:58:52.246 INFO:tasks.workunit.client.1.smithi164.stdout:9/144: chown d3/db 9 1 2024-04-20T21:58:52.255 INFO:tasks.workunit.client.1.smithi164.stdout:2/122: rmdir d2/d19 39 2024-04-20T21:58:52.255 INFO:tasks.workunit.client.1.smithi164.stdout:0/122: mkdir d1/d4/da/d1f 0 2024-04-20T21:58:52.255 INFO:tasks.workunit.client.1.smithi164.stdout:8/133: write d0/d14/f25 [648184,38303] 0 2024-04-20T21:58:52.259 INFO:tasks.workunit.client.1.smithi164.stdout:9/145: symlink d3/db/dd/l2f 0 2024-04-20T21:58:52.259 INFO:tasks.workunit.client.1.smithi164.stdout:1/124: fdatasync d10/f11 0 2024-04-20T21:58:52.260 INFO:tasks.workunit.client.1.smithi164.stdout:0/123: unlink d1/f9 0 2024-04-20T21:58:52.261 INFO:tasks.workunit.client.1.smithi164.stdout:9/146: write d3/ff [3722772,30177] 0 2024-04-20T21:58:52.262 INFO:tasks.workunit.client.1.smithi164.stdout:4/115: rmdir d4/d9/d27 39 2024-04-20T21:58:52.262 INFO:tasks.workunit.client.1.smithi164.stdout:2/123: write d2/d5/f1d [731348,83279] 0 2024-04-20T21:58:52.269 INFO:tasks.workunit.client.1.smithi164.stdout:0/124: mkdir d1/d4/d20 0 2024-04-20T21:58:52.274 INFO:tasks.workunit.client.1.smithi164.stdout:5/124: dwrite f8 [4194304,4194304] 0 2024-04-20T21:58:52.274 INFO:tasks.workunit.client.1.smithi164.stdout:0/125: rename d1/d4/df to d1/d4/df/d21 22 2024-04-20T21:58:52.274 INFO:tasks.workunit.client.1.smithi164.stdout:3/161: truncate d12/f14 372937 0 2024-04-20T21:58:52.281 INFO:tasks.workunit.client.1.smithi164.stdout:5/125: read f8 [5171828,128442] 0 2024-04-20T21:58:52.282 INFO:tasks.workunit.client.1.smithi164.stdout:3/162: fsync d12/d15/f23 0 2024-04-20T21:58:52.283 INFO:tasks.workunit.client.1.smithi164.stdout:0/126: chown d1/d4 6680 1 2024-04-20T21:58:52.284 INFO:tasks.workunit.client.1.smithi164.stdout:9/147: getdents d3/d27 0 2024-04-20T21:58:52.290 INFO:tasks.workunit.client.1.smithi164.stdout:1/125: write d10/f11 [1543313,50500] 0 2024-04-20T21:58:52.297 INFO:tasks.workunit.client.1.smithi164.stdout:5/126: creat dc/d2c/d2e/f31 x:0 0 0 2024-04-20T21:58:52.298 INFO:tasks.workunit.client.1.smithi164.stdout:7/110: dwrite f1 [0,4194304] 0 2024-04-20T21:58:52.302 INFO:tasks.workunit.client.1.smithi164.stdout:6/191: dwrite d0/d3/d8/fa [0,4194304] 0 2024-04-20T21:58:52.308 INFO:tasks.workunit.client.1.smithi164.stdout:2/124: truncate d2/d5/f11 519324 0 2024-04-20T21:58:52.311 INFO:tasks.workunit.client.1.smithi164.stdout:4/116: dwrite d4/d9/f11 [0,4194304] 0 2024-04-20T21:58:52.313 INFO:tasks.workunit.client.1.smithi164.stdout:9/148: mknod d3/c30 0 2024-04-20T21:58:52.314 INFO:tasks.workunit.client.1.smithi164.stdout:0/127: creat d1/f22 x:0 0 0 2024-04-20T21:58:52.316 INFO:tasks.workunit.client.1.smithi164.stdout:2/125: unlink c1 0 2024-04-20T21:58:52.317 INFO:tasks.workunit.client.1.smithi164.stdout:3/163: link d12/d15/f24 d12/d20/f30 0 2024-04-20T21:58:52.319 INFO:tasks.workunit.client.1.smithi164.stdout:2/126: read - d2/f1b zero size 2024-04-20T21:58:52.323 INFO:tasks.workunit.client.1.smithi164.stdout:3/164: creat d12/d2a/f31 x:0 0 0 2024-04-20T21:58:52.325 INFO:tasks.workunit.client.1.smithi164.stdout:1/126: rename d10/d16/c17 to d10/d16/c22 0 2024-04-20T21:58:52.325 INFO:tasks.workunit.client.1.smithi164.stdout:9/149: write d3/db/dd/fe [3246556,121875] 0 2024-04-20T21:58:52.328 INFO:tasks.workunit.client.1.smithi164.stdout:4/117: symlink d4/d9/l30 0 2024-04-20T21:58:52.329 INFO:tasks.workunit.client.1.smithi164.stdout:7/111: dread d2/f10 [0,4194304] 0 2024-04-20T21:58:52.337 INFO:tasks.workunit.client.1.smithi164.stdout:1/127: readlink l6 0 2024-04-20T21:58:52.338 INFO:tasks.workunit.client.1.smithi164.stdout:7/112: unlink d2/f13 0 2024-04-20T21:58:52.342 INFO:tasks.workunit.client.1.smithi164.stdout:3/165: creat d12/f32 x:0 0 0 2024-04-20T21:58:52.344 INFO:tasks.workunit.client.1.smithi164.stdout:9/150: symlink d3/l31 0 2024-04-20T21:58:52.345 INFO:tasks.workunit.client.1.smithi164.stdout:8/134: dread d0/f3 [0,4194304] 0 2024-04-20T21:58:52.351 INFO:tasks.workunit.client.1.smithi164.stdout:3/166: dread - d12/d20/f22 zero size 2024-04-20T21:58:52.351 INFO:tasks.workunit.client.1.smithi164.stdout:6/192: dwrite d0/f6 [0,4194304] 0 2024-04-20T21:58:52.352 INFO:tasks.workunit.client.1.smithi164.stdout:5/127: dwrite dc/d12/f18 [0,4194304] 0 2024-04-20T21:58:52.352 INFO:tasks.workunit.client.1.smithi164.stdout:0/128: dread d1/f12 [0,4194304] 0 2024-04-20T21:58:52.365 INFO:tasks.workunit.client.1.smithi164.stdout:5/128: readlink dc/l1d 0 2024-04-20T21:58:52.368 INFO:tasks.workunit.client.1.smithi164.stdout:3/167: symlink d12/d20/l33 0 2024-04-20T21:58:52.369 INFO:tasks.workunit.client.1.smithi164.stdout:6/193: write d0/d3/d15/f2a [664494,102185] 0 2024-04-20T21:58:52.374 INFO:tasks.workunit.client.1.smithi164.stdout:0/129: dread d1/fb [0,4194304] 0 2024-04-20T21:58:52.384 INFO:tasks.workunit.client.1.smithi164.stdout:3/168: read - d12/d15/f19 zero size 2024-04-20T21:58:52.385 INFO:tasks.workunit.client.1.smithi164.stdout:6/194: rmdir d0 39 2024-04-20T21:58:52.388 INFO:tasks.workunit.client.1.smithi164.stdout:0/130: stat d1/d4/da/le 0 2024-04-20T21:58:52.395 INFO:tasks.workunit.client.1.smithi164.stdout:7/113: dwrite d2/fc [0,4194304] 0 2024-04-20T21:58:52.397 INFO:tasks.workunit.client.1.smithi164.stdout:2/127: dwrite d2/fa [0,4194304] 0 2024-04-20T21:58:52.403 INFO:tasks.workunit.client.1.smithi164.stdout:1/128: dwrite f1 [0,4194304] 0 2024-04-20T21:58:52.403 INFO:tasks.workunit.client.1.smithi164.stdout:3/169: chown d12/f14 6897 1 2024-04-20T21:58:52.403 INFO:tasks.workunit.client.1.smithi164.stdout:7/114: write d2/f20 [227786,60831] 0 2024-04-20T21:58:52.404 INFO:tasks.workunit.client.1.smithi164.stdout:0/131: readlink d1/l16 0 2024-04-20T21:58:52.407 INFO:tasks.workunit.client.1.smithi164.stdout:8/135: dwrite d0/f24 [0,4194304] 0 2024-04-20T21:58:52.409 INFO:tasks.workunit.client.1.smithi164.stdout:5/129: dread dc/d12/f18 [0,4194304] 0 2024-04-20T21:58:52.410 INFO:tasks.workunit.client.1.smithi164.stdout:0/132: chown d1/l16 4537 1 2024-04-20T21:58:52.413 INFO:tasks.workunit.client.1.smithi164.stdout:0/133: readlink d1/d4/df/l17 0 2024-04-20T21:58:52.417 INFO:tasks.workunit.client.1.smithi164.stdout:6/195: creat d0/d3/d15/d23/d3b/f3e x:0 0 0 2024-04-20T21:58:52.419 INFO:tasks.workunit.client.1.smithi164.stdout:8/136: mknod d0/d1e/c35 0 2024-04-20T21:58:52.428 INFO:tasks.workunit.client.1.smithi164.stdout:5/130: rename dc/l10 to dc/d2b/l32 0 2024-04-20T21:58:52.428 INFO:tasks.workunit.client.1.smithi164.stdout:7/115: creat d2/d21/f23 x:0 0 0 2024-04-20T21:58:52.433 INFO:tasks.workunit.client.1.smithi164.stdout:0/134: fsync d1/fb 0 2024-04-20T21:58:52.433 INFO:tasks.workunit.client.1.smithi164.stdout:7/116: write d2/f4 [4479571,71375] 0 2024-04-20T21:58:52.433 INFO:tasks.workunit.client.1.smithi164.stdout:5/131: write dc/d2b/f27 [1277403,64432] 0 2024-04-20T21:58:52.433 INFO:tasks.workunit.client.1.smithi164.stdout:8/137: symlink d0/d1e/l36 0 2024-04-20T21:58:52.435 INFO:tasks.workunit.client.1.smithi164.stdout:2/128: link d2/d5/c13 d2/d5/c24 0 2024-04-20T21:58:52.436 INFO:tasks.workunit.client.1.smithi164.stdout:1/129: dwrite d10/f12 [0,4194304] 0 2024-04-20T21:58:52.441 INFO:tasks.workunit.client.0.smithi142.stdout:4/981: sync 2024-04-20T21:58:52.443 INFO:tasks.workunit.client.0.smithi142.stdout:4/982: fsync d1/d12/da/f7f 0 2024-04-20T21:58:52.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:52 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.zzmcfz/trash_purge_schedule"}]: dispatch 2024-04-20T21:58:52.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:52 smithi142 ceph-mon[15828]: mgrmap e27: smithi142.zzmcfz(active, since 1.01806s) 2024-04-20T21:58:52.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:52 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.zzmcfz/trash_purge_schedule"}]: dispatch 2024-04-20T21:58:52.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:52 smithi164 ceph-mon[23506]: mgrmap e27: smithi142.zzmcfz(active, since 1.01806s) 2024-04-20T21:58:52.446 INFO:tasks.workunit.client.0.smithi142.stdout:4/983: fdatasync d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/f44 0 2024-04-20T21:58:52.448 INFO:tasks.workunit.client.1.smithi164.stdout:3/170: getdents d12 0 2024-04-20T21:58:52.454 INFO:tasks.workunit.client.1.smithi164.stdout:7/117: mkdir d2/d21/d24 0 2024-04-20T21:58:52.457 INFO:tasks.workunit.client.1.smithi164.stdout:6/196: creat d0/d3/d27/f3f x:0 0 0 2024-04-20T21:58:52.457 INFO:tasks.workunit.client.1.smithi164.stdout:5/132: dwrite dc/d2c/d2e/f31 [0,4194304] 0 2024-04-20T21:58:52.458 INFO:tasks.workunit.client.1.smithi164.stdout:8/138: dread d0/d14/f2b [0,4194304] 0 2024-04-20T21:58:52.459 INFO:tasks.workunit.client.1.smithi164.stdout:2/129: rename d2/lf to d2/d5/d21/l25 0 2024-04-20T21:58:52.461 INFO:tasks.workunit.client.0.smithi142.stdout:4/984: creat d1/d12/da/d37/f13b x:0 0 0 2024-04-20T21:58:52.463 INFO:tasks.workunit.client.1.smithi164.stdout:1/130: creat d10/d16/d19/d1a/f23 x:0 0 0 2024-04-20T21:58:52.466 INFO:tasks.workunit.client.0.smithi142.stdout:4/985: creat d1/d12/da/d37/d89/f13c x:0 0 0 2024-04-20T21:58:52.471 INFO:tasks.workunit.client.1.smithi164.stdout:8/139: write d0/fe [801611,20216] 0 2024-04-20T21:58:52.471 INFO:tasks.workunit.client.1.smithi164.stdout:6/197: mknod d0/d3/d8/d28/c40 0 2024-04-20T21:58:52.473 INFO:tasks.workunit.client.1.smithi164.stdout:6/198: dread - d0/d3/d15/f24 zero size 2024-04-20T21:58:52.475 INFO:tasks.workunit.client.1.smithi164.stdout:9/151: sync 2024-04-20T21:58:52.475 INFO:tasks.workunit.client.1.smithi164.stdout:4/118: sync 2024-04-20T21:58:52.476 INFO:tasks.workunit.client.1.smithi164.stdout:9/152: chown d3/l24 342041287 1 2024-04-20T21:58:52.478 INFO:tasks.workunit.client.1.smithi164.stdout:0/135: creat d1/f23 x:0 0 0 2024-04-20T21:58:52.480 INFO:tasks.workunit.client.0.smithi142.stdout:4/986: dread d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/f1e [0,4194304] 0 2024-04-20T21:58:52.481 INFO:tasks.workunit.client.1.smithi164.stdout:1/131: symlink d10/d16/d19/l24 0 2024-04-20T21:58:52.482 INFO:tasks.workunit.client.1.smithi164.stdout:1/132: stat c3 0 2024-04-20T21:58:52.486 INFO:tasks.workunit.client.1.smithi164.stdout:8/140: creat d0/d14/f37 x:0 0 0 2024-04-20T21:58:52.487 INFO:tasks.workunit.client.0.smithi142.stdout:4/987: dread - d1/d6/d4a/d5a/fb9 zero size 2024-04-20T21:58:52.488 INFO:tasks.workunit.client.1.smithi164.stdout:8/141: chown d0/d1e/c35 3517597 1 2024-04-20T21:58:52.492 INFO:tasks.workunit.client.1.smithi164.stdout:2/130: mknod d2/d19/c26 0 2024-04-20T21:58:52.494 INFO:tasks.workunit.client.1.smithi164.stdout:9/153: symlink d3/db/d1b/d1e/l32 0 2024-04-20T21:58:52.494 INFO:tasks.workunit.client.1.smithi164.stdout:3/171: link d12/l25 d12/d20/l34 0 2024-04-20T21:58:52.495 INFO:tasks.workunit.client.1.smithi164.stdout:0/136: fsync d1/f1b 0 2024-04-20T21:58:52.495 INFO:tasks.workunit.client.1.smithi164.stdout:9/154: chown d3/db/dd/c2c 42 1 2024-04-20T21:58:52.496 INFO:tasks.workunit.client.0.smithi142.stdout:4/988: creat d1/d6/f13d x:0 0 0 2024-04-20T21:58:52.496 INFO:tasks.workunit.client.1.smithi164.stdout:1/133: mkdir d10/d16/d20/d25 0 2024-04-20T21:58:52.497 INFO:tasks.workunit.client.1.smithi164.stdout:6/199: mkdir d0/d3/d8/d28/d3d/d41 0 2024-04-20T21:58:52.499 INFO:tasks.workunit.client.1.smithi164.stdout:4/119: mknod d4/d9/d27/c31 0 2024-04-20T21:58:52.499 INFO:tasks.workunit.client.1.smithi164.stdout:8/142: chown d0/f19 42 1 2024-04-20T21:58:52.500 INFO:tasks.workunit.client.1.smithi164.stdout:5/133: link f3 dc/d2c/d2e/d30/f33 0 2024-04-20T21:58:52.500 INFO:tasks.workunit.client.1.smithi164.stdout:4/120: read - d4/f19 zero size 2024-04-20T21:58:52.501 INFO:tasks.workunit.client.1.smithi164.stdout:2/131: mknod d2/d19/c27 0 2024-04-20T21:58:52.503 INFO:tasks.workunit.client.1.smithi164.stdout:3/172: mknod d12/d15/c35 0 2024-04-20T21:58:52.504 INFO:tasks.workunit.client.1.smithi164.stdout:2/132: read d2/d5/f1d [293443,78555] 0 2024-04-20T21:58:52.504 INFO:tasks.workunit.client.1.smithi164.stdout:3/173: read f11 [93619,102878] 0 2024-04-20T21:58:52.505 INFO:tasks.workunit.client.0.smithi142.stdout:4/989: creat d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/f13e x:0 0 0 2024-04-20T21:58:52.506 INFO:tasks.workunit.client.1.smithi164.stdout:1/134: mkdir d10/d16/d20/d26 0 2024-04-20T21:58:52.507 INFO:tasks.workunit.client.1.smithi164.stdout:6/200: creat d0/d3/d15/d23/d3b/f42 x:0 0 0 2024-04-20T21:58:52.508 INFO:tasks.workunit.client.1.smithi164.stdout:6/201: readlink d0/ld 0 2024-04-20T21:58:52.509 INFO:tasks.workunit.client.0.smithi142.stdout:4/990: symlink d1/d6/d4a/d5a/d80/dd7/df5/l13f 0 2024-04-20T21:58:52.510 INFO:tasks.workunit.client.1.smithi164.stdout:6/202: write d0/d3/f12 [2773567,74898] 0 2024-04-20T21:58:52.513 INFO:tasks.workunit.client.1.smithi164.stdout:4/121: creat d4/d9/d27/f32 x:0 0 0 2024-04-20T21:58:52.516 INFO:tasks.workunit.client.1.smithi164.stdout:0/137: mknod d1/c24 0 2024-04-20T21:58:52.520 INFO:tasks.workunit.client.1.smithi164.stdout:9/155: symlink d3/d27/d2a/l33 0 2024-04-20T21:58:52.520 INFO:tasks.workunit.client.0.smithi142.stdout:4/991: truncate d1/d6/d4b/f79 3923551 0 2024-04-20T21:58:52.521 INFO:tasks.workunit.client.1.smithi164.stdout:9/156: readlink d3/l15 0 2024-04-20T21:58:52.522 INFO:tasks.workunit.client.1.smithi164.stdout:2/133: mkdir d2/d19/d28 0 2024-04-20T21:58:52.523 INFO:tasks.workunit.client.1.smithi164.stdout:3/174: creat d12/d2a/f36 x:0 0 0 2024-04-20T21:58:52.525 INFO:tasks.workunit.client.1.smithi164.stdout:7/118: truncate f1 2531234 0 2024-04-20T21:58:52.526 INFO:tasks.workunit.client.1.smithi164.stdout:7/119: dread - d2/d21/f23 zero size 2024-04-20T21:58:52.529 INFO:tasks.workunit.client.1.smithi164.stdout:8/143: unlink d0/d14/f12 0 2024-04-20T21:58:52.532 INFO:tasks.workunit.client.1.smithi164.stdout:4/122: mknod d4/d9/d27/c33 0 2024-04-20T21:58:52.535 INFO:tasks.workunit.client.1.smithi164.stdout:1/135: dread d10/f14 [0,4194304] 0 2024-04-20T21:58:52.536 INFO:tasks.workunit.client.1.smithi164.stdout:9/157: creat d3/db/d1b/f34 x:0 0 0 2024-04-20T21:58:52.537 INFO:tasks.workunit.client.1.smithi164.stdout:4/123: write d4/f7 [4308161,38799] 0 2024-04-20T21:58:52.538 INFO:tasks.workunit.client.1.smithi164.stdout:7/120: creat d2/d21/f25 x:0 0 0 2024-04-20T21:58:52.539 INFO:tasks.workunit.client.1.smithi164.stdout:3/175: chown d12/l25 879154 1 2024-04-20T21:58:52.540 INFO:tasks.workunit.client.1.smithi164.stdout:7/121: chown d2/ff 9 1 2024-04-20T21:58:52.540 INFO:tasks.workunit.client.1.smithi164.stdout:8/144: write d0/fc [2724266,36944] 0 2024-04-20T21:58:52.542 INFO:tasks.workunit.client.1.smithi164.stdout:2/134: creat d2/d19/d28/f29 x:0 0 0 2024-04-20T21:58:52.543 INFO:tasks.workunit.client.1.smithi164.stdout:1/136: truncate f5 1073059 0 2024-04-20T21:58:52.545 INFO:tasks.workunit.client.1.smithi164.stdout:9/158: read d3/f6 [44117,92506] 0 2024-04-20T21:58:52.548 INFO:tasks.workunit.client.1.smithi164.stdout:7/122: creat d2/f26 x:0 0 0 2024-04-20T21:58:52.552 INFO:tasks.workunit.client.0.smithi142.stdout:4/992: write d1/d6/f47 [3074667,84037] 0 2024-04-20T21:58:52.555 INFO:tasks.workunit.client.0.smithi142.stdout:4/993: dread - d1/d6/d4a/d5a/d80/dd7/f122 zero size 2024-04-20T21:58:52.557 INFO:tasks.workunit.client.1.smithi164.stdout:0/138: getdents d1/d4 0 2024-04-20T21:58:52.557 INFO:tasks.workunit.client.1.smithi164.stdout:9/159: mknod d3/d27/d2a/c35 0 2024-04-20T21:58:52.558 INFO:tasks.workunit.client.1.smithi164.stdout:5/134: write dc/d2c/d2e/d30/f33 [3373893,74652] 0 2024-04-20T21:58:52.560 INFO:tasks.workunit.client.0.smithi142.stdout:4/994: creat d1/d12/da/d1c/d32/d3d/d9d/f140 x:0 0 0 2024-04-20T21:58:52.564 INFO:tasks.workunit.client.1.smithi164.stdout:8/145: link d0/d1e/l2c d0/d14/d16/l38 0 2024-04-20T21:58:52.565 INFO:tasks.workunit.client.1.smithi164.stdout:3/176: dwrite f10 [0,4194304] 0 2024-04-20T21:58:52.569 INFO:tasks.workunit.client.1.smithi164.stdout:4/124: getdents d4/d9 0 2024-04-20T21:58:52.571 INFO:tasks.workunit.client.1.smithi164.stdout:9/160: dread d3/db/f1a [0,4194304] 0 2024-04-20T21:58:52.573 INFO:tasks.workunit.client.1.smithi164.stdout:1/137: creat d10/d16/f27 x:0 0 0 2024-04-20T21:58:52.575 INFO:tasks.workunit.client.1.smithi164.stdout:4/125: dread - d4/d9/d27/f29 zero size 2024-04-20T21:58:52.577 INFO:tasks.workunit.client.1.smithi164.stdout:2/135: write d2/d5/f1d [210436,28508] 0 2024-04-20T21:58:52.577 INFO:tasks.workunit.client.1.smithi164.stdout:5/135: rename dc/d12/d1e/c23 to dc/d2c/d2e/d30/c34 0 2024-04-20T21:58:52.577 INFO:tasks.workunit.client.1.smithi164.stdout:1/138: write f7 [708560,4533] 0 2024-04-20T21:58:52.581 INFO:tasks.workunit.client.1.smithi164.stdout:8/146: rmdir d0/d14 39 2024-04-20T21:58:52.583 INFO:tasks.workunit.client.1.smithi164.stdout:9/161: chown d3/db/dd/l29 1980 1 2024-04-20T21:58:52.585 INFO:tasks.workunit.client.1.smithi164.stdout:5/136: chown dc/d12 4 1 2024-04-20T21:58:52.585 INFO:tasks.workunit.client.1.smithi164.stdout:4/126: rename d4/f26 to d4/d9/d22/f34 0 2024-04-20T21:58:52.587 INFO:tasks.workunit.client.1.smithi164.stdout:8/147: readlink d0/d1e/l36 0 2024-04-20T21:58:52.588 INFO:tasks.workunit.client.1.smithi164.stdout:2/136: write d2/d5/f22 [773614,77519] 0 2024-04-20T21:58:52.590 INFO:tasks.workunit.client.1.smithi164.stdout:7/123: dwrite d2/f1b [0,4194304] 0 2024-04-20T21:58:52.591 INFO:tasks.workunit.client.1.smithi164.stdout:3/177: getdents d12/d20 0 2024-04-20T21:58:52.600 INFO:tasks.workunit.client.1.smithi164.stdout:8/148: creat d0/d1e/f39 x:0 0 0 2024-04-20T21:58:52.601 INFO:tasks.workunit.client.1.smithi164.stdout:7/124: write d2/f5 [1036429,59538] 0 2024-04-20T21:58:52.603 INFO:tasks.workunit.client.1.smithi164.stdout:9/162: mkdir d3/d27/d2a/d36 0 2024-04-20T21:58:52.603 INFO:tasks.workunit.client.1.smithi164.stdout:5/137: chown dc/ce 206741 1 2024-04-20T21:58:52.607 INFO:tasks.workunit.client.1.smithi164.stdout:3/178: write f11 [466167,100344] 0 2024-04-20T21:58:52.608 INFO:tasks.workunit.client.1.smithi164.stdout:0/139: dwrite d1/f1b [0,4194304] 0 2024-04-20T21:58:52.616 INFO:tasks.workunit.client.1.smithi164.stdout:5/138: rename f3 to dc/d12/d1e/f35 0 2024-04-20T21:58:52.616 INFO:tasks.workunit.client.1.smithi164.stdout:1/139: dread f5 [0,4194304] 0 2024-04-20T21:58:52.617 INFO:tasks.workunit.client.1.smithi164.stdout:3/179: fsync d12/d15/f19 0 2024-04-20T21:58:52.620 INFO:tasks.workunit.client.1.smithi164.stdout:0/140: dread - d1/f22 zero size 2024-04-20T21:58:52.624 INFO:tasks.workunit.client.1.smithi164.stdout:9/163: truncate d3/db/dd/f11 325288 0 2024-04-20T21:58:52.624 INFO:tasks.workunit.client.1.smithi164.stdout:8/149: link d0/d14/f2a d0/f3a 0 2024-04-20T21:58:52.625 INFO:tasks.workunit.client.1.smithi164.stdout:0/141: stat d1/d4/da/le 0 2024-04-20T21:58:52.626 INFO:tasks.workunit.client.1.smithi164.stdout:5/139: symlink dc/d2c/l36 0 2024-04-20T21:58:52.627 INFO:tasks.workunit.client.1.smithi164.stdout:1/140: truncate f5 280265 0 2024-04-20T21:58:52.633 INFO:tasks.workunit.client.1.smithi164.stdout:2/137: dread d2/f12 [0,4194304] 0 2024-04-20T21:58:52.633 INFO:tasks.workunit.client.1.smithi164.stdout:1/141: creat d10/d16/d20/f28 x:0 0 0 2024-04-20T21:58:52.634 INFO:tasks.workunit.client.1.smithi164.stdout:4/127: dread f3 [0,4194304] 0 2024-04-20T21:58:52.636 INFO:tasks.workunit.client.1.smithi164.stdout:0/142: creat d1/d4/da/d1f/f25 x:0 0 0 2024-04-20T21:58:52.640 INFO:tasks.workunit.client.1.smithi164.stdout:2/138: write d2/f1b [1047382,50657] 0 2024-04-20T21:58:52.645 INFO:tasks.workunit.client.1.smithi164.stdout:6/203: sync 2024-04-20T21:58:52.647 INFO:tasks.workunit.client.1.smithi164.stdout:2/139: chown d2/c1a 158002 1 2024-04-20T21:58:52.647 INFO:tasks.workunit.client.1.smithi164.stdout:1/142: symlink d10/d16/d19/l29 0 2024-04-20T21:58:52.657 INFO:tasks.workunit.client.1.smithi164.stdout:0/143: mkdir d1/d4/d26 0 2024-04-20T21:58:52.668 INFO:tasks.workunit.client.1.smithi164.stdout:7/125: dwrite d2/fc [0,4194304] 0 2024-04-20T21:58:52.669 INFO:tasks.workunit.client.1.smithi164.stdout:6/204: unlink d0/d3/d15/d21/c36 0 2024-04-20T21:58:52.675 INFO:tasks.workunit.client.1.smithi164.stdout:3/180: dwrite d12/f18 [0,4194304] 0 2024-04-20T21:58:52.680 INFO:tasks.workunit.client.1.smithi164.stdout:8/150: dwrite d0/d14/f25 [0,4194304] 0 2024-04-20T21:58:52.681 INFO:tasks.workunit.client.1.smithi164.stdout:7/126: write d2/f4 [3643033,85892] 0 2024-04-20T21:58:52.685 INFO:tasks.workunit.client.1.smithi164.stdout:1/143: mknod d10/d16/d20/d26/c2a 0 2024-04-20T21:58:52.685 INFO:tasks.workunit.client.1.smithi164.stdout:3/181: chown d12/d2a/c2d 4 1 2024-04-20T21:58:52.695 INFO:tasks.workunit.client.1.smithi164.stdout:1/144: chown d10 1027 1 2024-04-20T21:58:52.695 INFO:tasks.workunit.client.1.smithi164.stdout:4/128: dwrite d4/d9/f1e [0,4194304] 0 2024-04-20T21:58:52.697 INFO:tasks.workunit.client.1.smithi164.stdout:3/182: fsync d12/d15/f1b 0 2024-04-20T21:58:52.698 INFO:tasks.workunit.client.1.smithi164.stdout:7/127: mknod d2/c27 0 2024-04-20T21:58:52.701 INFO:tasks.workunit.client.1.smithi164.stdout:5/140: dread dc/d2c/d2e/f31 [0,4194304] 0 2024-04-20T21:58:52.712 INFO:tasks.workunit.client.1.smithi164.stdout:1/145: mknod d10/d16/d19/d1a/c2b 0 2024-04-20T21:58:52.715 INFO:tasks.workunit.client.1.smithi164.stdout:5/141: rmdir dc/d2c/d2e/d30 39 2024-04-20T21:58:52.718 INFO:tasks.workunit.client.1.smithi164.stdout:2/140: dwrite d2/d5/f14 [4194304,4194304] 0 2024-04-20T21:58:52.719 INFO:tasks.workunit.client.1.smithi164.stdout:9/164: dread d3/db/dd/fe [0,4194304] 0 2024-04-20T21:58:52.732 INFO:tasks.workunit.client.1.smithi164.stdout:6/205: dwrite d0/f25 [0,4194304] 0 2024-04-20T21:58:52.732 INFO:tasks.workunit.client.1.smithi164.stdout:2/141: write d2/f9 [206031,69416] 0 2024-04-20T21:58:52.734 INFO:tasks.workunit.client.1.smithi164.stdout:4/129: dread f3 [0,4194304] 0 2024-04-20T21:58:52.734 INFO:tasks.workunit.client.1.smithi164.stdout:1/146: creat d10/f2c x:0 0 0 2024-04-20T21:58:52.736 INFO:tasks.workunit.client.0.smithi142.stdout:4/995: sync 2024-04-20T21:58:52.737 INFO:tasks.workunit.client.1.smithi164.stdout:5/142: creat dc/d2b/f37 x:0 0 0 2024-04-20T21:58:52.738 INFO:tasks.workunit.client.1.smithi164.stdout:7/128: getdents d2/d21 0 2024-04-20T21:58:52.740 INFO:tasks.workunit.client.1.smithi164.stdout:4/130: read - d4/d9/f2d zero size 2024-04-20T21:58:52.742 INFO:tasks.workunit.client.1.smithi164.stdout:9/165: link d3/l12 d3/db/dd/l37 0 2024-04-20T21:58:52.743 INFO:tasks.workunit.client.1.smithi164.stdout:7/129: write d2/d21/f25 [266840,4084] 0 2024-04-20T21:58:52.744 INFO:tasks.workunit.client.0.smithi142.stdout:4/996: link d1/d12/da/d1c/d32/d3d/d2f/d7a/lc6 d1/d6/d30/d4e/l141 0 2024-04-20T21:58:52.747 INFO:tasks.workunit.client.1.smithi164.stdout:3/183: dwrite d12/d20/f30 [0,4194304] 0 2024-04-20T21:58:52.749 INFO:tasks.workunit.client.0.smithi142.stdout:4/997: read d1/d12/da/d1c/f25 [3289927,9227] 0 2024-04-20T21:58:52.754 INFO:tasks.workunit.client.1.smithi164.stdout:9/166: dread - d3/db/dd/f14 zero size 2024-04-20T21:58:52.754 INFO:tasks.workunit.client.1.smithi164.stdout:6/206: rename d0/d3/d15/f2a to d0/d3/d27/f43 0 2024-04-20T21:58:52.754 INFO:tasks.workunit.client.1.smithi164.stdout:1/147: mknod d10/d16/c2d 0 2024-04-20T21:58:52.754 INFO:tasks.workunit.client.1.smithi164.stdout:7/130: write d2/f4 [3938683,105301] 0 2024-04-20T21:58:52.754 INFO:tasks.workunit.client.1.smithi164.stdout:1/148: readlink lc 0 2024-04-20T21:58:52.754 INFO:tasks.workunit.client.1.smithi164.stdout:3/184: read d12/f1f [32493,93996] 0 2024-04-20T21:58:52.754 INFO:tasks.workunit.client.1.smithi164.stdout:7/131: chown d2/fc 3 1 2024-04-20T21:58:52.754 INFO:tasks.workunit.client.1.smithi164.stdout:4/131: dread - d4/d9/d27/f32 zero size 2024-04-20T21:58:52.755 INFO:tasks.workunit.client.0.smithi142.stdout:4/998: unlink d1/d12/da/d1c/d32/d3d/d2f/d7a/d8e/l35 0 2024-04-20T21:58:52.757 INFO:tasks.workunit.client.0.smithi142.stdout:4/999: mkdir d1/d12/da/d1c/da9/dba/d142 0 2024-04-20T21:58:52.763 INFO:tasks.workunit.client.1.smithi164.stdout:0/144: dread d1/f10 [0,4194304] 0 2024-04-20T21:58:52.764 INFO:tasks.workunit.client.1.smithi164.stdout:0/145: read - d1/f23 zero size 2024-04-20T21:58:52.765 INFO:tasks.workunit.client.1.smithi164.stdout:1/149: rmdir d10/d16/d19/d1a 39 2024-04-20T21:58:52.769 INFO:tasks.workunit.client.0.smithi142.stderr:+ rm -rf -- ./tmp.2FRQRDUOi6 2024-04-20T21:58:52.772 INFO:tasks.workunit.client.1.smithi164.stdout:7/132: rename d2/f4 to d2/d21/f28 0 2024-04-20T21:58:52.772 INFO:tasks.workunit.client.1.smithi164.stdout:4/132: readlink d4/d9/d27/l2e 0 2024-04-20T21:58:52.774 INFO:tasks.workunit.client.1.smithi164.stdout:7/133: stat d2/c8 0 2024-04-20T21:58:52.775 INFO:tasks.workunit.client.1.smithi164.stdout:5/143: link dc/l1d dc/l38 0 2024-04-20T21:58:52.777 INFO:tasks.workunit.client.1.smithi164.stdout:1/150: rename d10/f2c to d10/d16/d20/d25/f2e 0 2024-04-20T21:58:52.781 INFO:tasks.workunit.client.1.smithi164.stdout:1/151: read - d10/d16/d20/d25/f2e zero size 2024-04-20T21:58:52.782 INFO:tasks.workunit.client.1.smithi164.stdout:7/134: creat d2/f29 x:0 0 0 2024-04-20T21:58:52.783 INFO:tasks.workunit.client.1.smithi164.stdout:4/133: creat d4/d9/d27/f35 x:0 0 0 2024-04-20T21:58:52.784 INFO:tasks.workunit.client.1.smithi164.stdout:6/207: link d0/d3/d8/l1d d0/d3/l44 0 2024-04-20T21:58:52.784 INFO:tasks.workunit.client.1.smithi164.stdout:9/167: write d3/f6 [559808,9042] 0 2024-04-20T21:58:52.786 INFO:tasks.workunit.client.1.smithi164.stdout:2/142: truncate d2/d5/f1d 783019 0 2024-04-20T21:58:52.787 INFO:tasks.workunit.client.1.smithi164.stdout:4/134: readlink d4/d9/d27/l2a 0 2024-04-20T21:58:52.789 INFO:tasks.workunit.client.1.smithi164.stdout:5/144: getdents dc/d2b/d2f 0 2024-04-20T21:58:52.789 INFO:tasks.workunit.client.1.smithi164.stdout:0/146: dwrite d1/f23 [0,4194304] 0 2024-04-20T21:58:52.792 INFO:tasks.workunit.client.1.smithi164.stdout:7/135: chown d2/c17 0 1 2024-04-20T21:58:52.792 INFO:tasks.workunit.client.1.smithi164.stdout:4/135: write d4/fe [920562,74957] 0 2024-04-20T21:58:52.795 INFO:tasks.workunit.client.1.smithi164.stdout:6/208: mkdir d0/d3/d15/d23/d45 0 2024-04-20T21:58:52.800 INFO:tasks.workunit.client.1.smithi164.stdout:0/147: mkdir d1/d4/da/d27 0 2024-04-20T21:58:52.801 INFO:tasks.workunit.client.1.smithi164.stdout:6/209: chown d0/d3/d15/f32 90 1 2024-04-20T21:58:52.803 INFO:tasks.workunit.client.1.smithi164.stdout:0/148: dread - d1/d4/da/d1f/f25 zero size 2024-04-20T21:58:52.803 INFO:tasks.workunit.client.1.smithi164.stdout:7/136: getdents d2/d21/d24 0 2024-04-20T21:58:52.805 INFO:tasks.workunit.client.1.smithi164.stdout:7/137: dread - d2/f29 zero size 2024-04-20T21:58:52.807 INFO:tasks.workunit.client.1.smithi164.stdout:9/168: rename d3/db/d1b/d1e/f2d to d3/db/f38 0 2024-04-20T21:58:52.811 INFO:tasks.workunit.client.1.smithi164.stdout:8/151: sync 2024-04-20T21:58:52.814 INFO:tasks.workunit.client.1.smithi164.stdout:0/149: creat d1/d4/f28 x:0 0 0 2024-04-20T21:58:52.814 INFO:tasks.workunit.client.1.smithi164.stdout:7/138: write d2/d21/f25 [1103836,11538] 0 2024-04-20T21:58:52.819 INFO:tasks.workunit.client.1.smithi164.stdout:2/143: dread d2/fa [0,4194304] 0 2024-04-20T21:58:52.820 INFO:tasks.workunit.client.1.smithi164.stdout:8/152: chown d0/fe 3113 1 2024-04-20T21:58:52.821 INFO:tasks.workunit.client.1.smithi164.stdout:0/150: chown d1/d4/da/le 865 1 2024-04-20T21:58:52.822 INFO:tasks.workunit.client.1.smithi164.stdout:5/145: dwrite f8 [0,4194304] 0 2024-04-20T21:58:52.822 INFO:tasks.workunit.client.1.smithi164.stdout:2/144: stat d2/d5/l10 0 2024-04-20T21:58:52.825 INFO:tasks.workunit.client.1.smithi164.stdout:5/146: stat dc/d12/f13 0 2024-04-20T21:58:52.829 INFO:tasks.workunit.client.1.smithi164.stdout:1/152: dread f0 [0,4194304] 0 2024-04-20T21:58:52.830 INFO:tasks.workunit.client.1.smithi164.stdout:1/153: fsync f0 0 2024-04-20T21:58:52.831 INFO:tasks.workunit.client.1.smithi164.stdout:8/153: truncate d0/f1b 265715 0 2024-04-20T21:58:52.832 INFO:tasks.workunit.client.1.smithi164.stdout:2/145: rmdir d2 39 2024-04-20T21:58:52.833 INFO:tasks.workunit.client.1.smithi164.stdout:8/154: write d0/f19 [995257,18022] 0 2024-04-20T21:58:52.836 INFO:tasks.workunit.client.1.smithi164.stdout:0/151: unlink d1/d4/c1c 0 2024-04-20T21:58:52.837 INFO:tasks.workunit.client.1.smithi164.stdout:7/139: rename d2/f10 to d2/d21/f2a 0 2024-04-20T21:58:52.837 INFO:tasks.workunit.client.1.smithi164.stdout:9/169: dread d3/db/dd/f23 [0,4194304] 0 2024-04-20T21:58:52.837 INFO:tasks.workunit.client.1.smithi164.stdout:5/147: mknod dc/d2b/c39 0 2024-04-20T21:58:52.840 INFO:tasks.workunit.client.1.smithi164.stdout:9/170: chown d3/db/f10 9568664 1 2024-04-20T21:58:52.840 INFO:tasks.workunit.client.1.smithi164.stdout:1/154: creat d10/d16/d20/f2f x:0 0 0 2024-04-20T21:58:52.843 INFO:tasks.workunit.client.1.smithi164.stdout:2/146: chown d2/d19/d28/f29 13 1 2024-04-20T21:58:52.845 INFO:tasks.workunit.client.1.smithi164.stdout:7/140: rename d2/f1f to d2/d21/d24/f2b 0 2024-04-20T21:58:52.845 INFO:tasks.workunit.client.1.smithi164.stdout:2/147: write d2/d19/d28/f29 [524051,100] 0 2024-04-20T21:58:52.855 INFO:tasks.workunit.client.1.smithi164.stdout:7/141: mkdir d2/d21/d24/d2c 0 2024-04-20T21:58:52.855 INFO:tasks.workunit.client.1.smithi164.stdout:9/171: dread d3/f6 [0,4194304] 0 2024-04-20T21:58:52.857 INFO:tasks.workunit.client.1.smithi164.stdout:2/148: creat d2/d19/d28/f2a x:0 0 0 2024-04-20T21:58:52.857 INFO:tasks.workunit.client.1.smithi164.stdout:5/148: dread dc/d2c/d2e/f31 [0,4194304] 0 2024-04-20T21:58:52.859 INFO:tasks.workunit.client.1.smithi164.stdout:0/152: getdents d1/d4/da/d1f 0 2024-04-20T21:58:52.860 INFO:tasks.workunit.client.1.smithi164.stdout:8/155: link d0/d1e/l2f d0/d14/d16/l3b 0 2024-04-20T21:58:52.861 INFO:tasks.workunit.client.1.smithi164.stdout:2/149: creat d2/d5/d21/f2b x:0 0 0 2024-04-20T21:58:52.862 INFO:tasks.workunit.client.1.smithi164.stdout:5/149: symlink dc/d12/d1e/l3a 0 2024-04-20T21:58:52.863 INFO:tasks.workunit.client.1.smithi164.stdout:4/136: dread d4/fe [0,4194304] 0 2024-04-20T21:58:52.865 INFO:tasks.workunit.client.1.smithi164.stdout:1/155: dwrite f1 [4194304,4194304] 0 2024-04-20T21:58:52.869 INFO:tasks.workunit.client.1.smithi164.stdout:9/172: creat d3/f39 x:0 0 0 2024-04-20T21:58:52.870 INFO:tasks.workunit.client.1.smithi164.stdout:4/137: write d4/d9/f17 [891402,38672] 0 2024-04-20T21:58:52.876 INFO:tasks.workunit.client.1.smithi164.stdout:2/150: symlink d2/d5/d21/l2c 0 2024-04-20T21:58:52.878 INFO:tasks.workunit.client.1.smithi164.stdout:1/156: creat d10/d16/d20/f30 x:0 0 0 2024-04-20T21:58:52.879 INFO:tasks.workunit.client.1.smithi164.stdout:8/156: write d0/f3 [1049435,25826] 0 2024-04-20T21:58:52.883 INFO:tasks.workunit.client.1.smithi164.stdout:9/173: creat d3/d27/d2a/f3a x:0 0 0 2024-04-20T21:58:52.886 INFO:tasks.workunit.client.1.smithi164.stdout:5/150: rename dc/d2c/d2e/d30/f33 to dc/d2b/f3b 0 2024-04-20T21:58:52.888 INFO:tasks.workunit.client.1.smithi164.stdout:7/142: dwrite d2/f29 [0,4194304] 0 2024-04-20T21:58:52.891 INFO:tasks.workunit.client.1.smithi164.stdout:2/151: creat d2/d5/d21/f2d x:0 0 0 2024-04-20T21:58:52.896 INFO:tasks.workunit.client.1.smithi164.stdout:8/157: symlink d0/l3c 0 2024-04-20T21:58:52.898 INFO:tasks.workunit.client.1.smithi164.stdout:4/138: creat d4/f36 x:0 0 0 2024-04-20T21:58:52.899 INFO:tasks.workunit.client.1.smithi164.stdout:3/185: sync 2024-04-20T21:58:52.902 INFO:tasks.workunit.client.1.smithi164.stdout:1/157: rmdir d10 39 2024-04-20T21:58:52.902 INFO:tasks.workunit.client.1.smithi164.stdout:0/153: dwrite d1/f8 [0,4194304] 0 2024-04-20T21:58:52.905 INFO:tasks.workunit.client.1.smithi164.stdout:0/154: write d1/d4/da/d1f/f25 [766758,98565] 0 2024-04-20T21:58:52.905 INFO:tasks.workunit.client.1.smithi164.stdout:5/151: rmdir dc 39 2024-04-20T21:58:52.909 INFO:tasks.workunit.client.1.smithi164.stdout:8/158: creat d0/d14/f3d x:0 0 0 2024-04-20T21:58:52.914 INFO:tasks.workunit.client.1.smithi164.stdout:7/143: rmdir d2/d21/d24/d2c 0 2024-04-20T21:58:52.917 INFO:tasks.workunit.client.1.smithi164.stdout:5/152: read dc/d12/d1e/f35 [1250054,84901] 0 2024-04-20T21:58:52.918 INFO:tasks.workunit.client.1.smithi164.stdout:0/155: mkdir d1/d4/d26/d29 0 2024-04-20T21:58:52.919 INFO:tasks.workunit.client.1.smithi164.stdout:9/174: write d3/db/f1a [813453,45946] 0 2024-04-20T21:58:52.923 INFO:tasks.workunit.client.1.smithi164.stdout:2/152: rename d2/d5/d21/l25 to d2/l2e 0 2024-04-20T21:58:52.924 INFO:tasks.workunit.client.1.smithi164.stdout:9/175: write d3/db/f10 [3728360,94260] 0 2024-04-20T21:58:52.928 INFO:tasks.workunit.client.1.smithi164.stdout:7/144: mknod d2/d21/c2d 0 2024-04-20T21:58:52.929 INFO:tasks.workunit.client.1.smithi164.stdout:4/139: getdents d4/d9/d27 0 2024-04-20T21:58:52.929 INFO:tasks.workunit.client.1.smithi164.stdout:2/153: symlink d2/d5/l2f 0 2024-04-20T21:58:52.932 INFO:tasks.workunit.client.1.smithi164.stdout:5/153: creat dc/d2b/f3c x:0 0 0 2024-04-20T21:58:52.935 INFO:tasks.workunit.client.1.smithi164.stdout:4/140: fdatasync d4/d9/f1b 0 2024-04-20T21:58:52.941 INFO:tasks.workunit.client.1.smithi164.stdout:4/141: mkdir d4/d9/d27/d37 0 2024-04-20T21:58:52.944 INFO:tasks.workunit.client.1.smithi164.stdout:8/159: dwrite d0/d14/f13 [0,4194304] 0 2024-04-20T21:58:52.948 INFO:tasks.workunit.client.1.smithi164.stdout:1/158: dwrite d10/d16/d20/f30 [0,4194304] 0 2024-04-20T21:58:52.951 INFO:tasks.workunit.client.1.smithi164.stdout:4/142: symlink d4/d9/l38 0 2024-04-20T21:58:52.952 INFO:tasks.workunit.client.1.smithi164.stdout:4/143: dread - d4/f16 zero size 2024-04-20T21:58:52.956 INFO:tasks.workunit.client.1.smithi164.stdout:8/160: creat d0/d14/f3e x:0 0 0 2024-04-20T21:58:52.957 INFO:tasks.workunit.client.1.smithi164.stdout:7/145: dwrite d2/f1c [0,4194304] 0 2024-04-20T21:58:52.959 INFO:tasks.workunit.client.1.smithi164.stdout:1/159: symlink d10/l31 0 2024-04-20T21:58:52.959 INFO:tasks.workunit.client.1.smithi164.stdout:2/154: dread d2/d5/f14 [4194304,4194304] 0 2024-04-20T21:58:52.964 INFO:tasks.workunit.client.1.smithi164.stdout:8/161: mknod d0/d14/d16/c3f 0 2024-04-20T21:58:52.967 INFO:tasks.workunit.client.1.smithi164.stdout:7/146: symlink d2/d21/l2e 0 2024-04-20T21:58:52.970 INFO:tasks.workunit.client.1.smithi164.stdout:0/156: truncate d1/f1b 1487957 0 2024-04-20T21:58:52.974 INFO:tasks.workunit.client.1.smithi164.stdout:7/147: mknod d2/c2f 0 2024-04-20T21:58:52.976 INFO:tasks.workunit.client.1.smithi164.stdout:1/160: creat d10/d16/d19/d1a/f32 x:0 0 0 2024-04-20T21:58:52.978 INFO:tasks.workunit.client.1.smithi164.stdout:5/154: truncate dc/f24 389344 0 2024-04-20T21:58:52.979 INFO:tasks.workunit.client.1.smithi164.stdout:0/157: unlink d1/d4/da/le 0 2024-04-20T21:58:52.980 INFO:tasks.workunit.client.1.smithi164.stdout:6/210: sync 2024-04-20T21:58:52.982 INFO:tasks.workunit.client.1.smithi164.stdout:0/158: readlink d1/d4/df/l17 0 2024-04-20T21:58:52.983 INFO:tasks.workunit.client.1.smithi164.stdout:1/161: mkdir d10/d33 0 2024-04-20T21:58:52.985 INFO:tasks.workunit.client.1.smithi164.stdout:5/155: write dc/d12/d1e/f1f [251333,83481] 0 2024-04-20T21:58:52.986 INFO:tasks.workunit.client.1.smithi164.stdout:7/148: link f1 d2/d21/d24/f30 0 2024-04-20T21:58:52.987 INFO:tasks.workunit.client.1.smithi164.stdout:2/155: dread d2/d5/f11 [0,4194304] 0 2024-04-20T21:58:52.990 INFO:tasks.workunit.client.1.smithi164.stdout:6/211: creat d0/d3/d11/d29/f46 x:0 0 0 2024-04-20T21:58:52.990 INFO:tasks.workunit.client.1.smithi164.stdout:4/144: getdents d4/d9 0 2024-04-20T21:58:52.994 INFO:tasks.workunit.client.1.smithi164.stdout:5/156: dread - dc/d2b/f3c zero size 2024-04-20T21:58:52.995 INFO:tasks.workunit.client.1.smithi164.stdout:4/145: truncate d4/f36 475863 0 2024-04-20T21:58:52.995 INFO:tasks.workunit.client.1.smithi164.stdout:8/162: dread d0/d14/d16/f26 [0,4194304] 0 2024-04-20T21:58:52.996 INFO:tasks.workunit.client.1.smithi164.stdout:7/149: mkdir d2/d21/d24/d31 0 2024-04-20T21:58:52.996 INFO:tasks.workunit.client.1.smithi164.stdout:5/157: write dc/d2b/f3c [509435,71752] 0 2024-04-20T21:58:52.997 INFO:tasks.workunit.client.1.smithi164.stdout:1/162: mkdir d10/d16/d20/d26/d34 0 2024-04-20T21:58:52.998 INFO:tasks.workunit.client.1.smithi164.stdout:2/156: mkdir d2/d30 0 2024-04-20T21:58:53.000 INFO:tasks.workunit.client.1.smithi164.stdout:5/158: write f8 [1897211,37791] 0 2024-04-20T21:58:53.003 INFO:tasks.workunit.client.1.smithi164.stdout:1/163: rename d10/d16 to d10/d16/d20/d25/d35 22 2024-04-20T21:58:53.013 INFO:tasks.workunit.client.1.smithi164.stdout:7/150: mknod d2/d21/d24/c32 0 2024-04-20T21:58:53.014 INFO:tasks.workunit.client.1.smithi164.stdout:0/159: dwrite d1/f10 [4194304,4194304] 0 2024-04-20T21:58:53.015 INFO:tasks.workunit.client.1.smithi164.stdout:7/151: chown d2/d21/f25 4192980 1 2024-04-20T21:58:53.017 INFO:tasks.workunit.client.1.smithi164.stdout:7/152: chown d2/d21/d24/f2b 6078 1 2024-04-20T21:58:53.018 INFO:tasks.workunit.client.1.smithi164.stdout:6/212: mknod d0/c47 0 2024-04-20T21:58:53.019 INFO:tasks.workunit.client.1.smithi164.stdout:6/213: chown d0/d3/f1c 41 1 2024-04-20T21:58:53.028 INFO:tasks.workunit.client.1.smithi164.stdout:7/153: mkdir d2/d21/d33 0 2024-04-20T21:58:53.029 INFO:tasks.workunit.client.1.smithi164.stdout:1/164: symlink d10/d33/l36 0 2024-04-20T21:58:53.030 INFO:tasks.workunit.client.1.smithi164.stdout:2/157: dread d2/d5/f1d [0,4194304] 0 2024-04-20T21:58:53.030 INFO:tasks.workunit.client.1.smithi164.stdout:1/165: write f0 [2267688,121400] 0 2024-04-20T21:58:53.033 INFO:tasks.workunit.client.1.smithi164.stdout:4/146: creat d4/f39 x:0 0 0 2024-04-20T21:58:53.035 INFO:tasks.workunit.client.1.smithi164.stdout:8/163: rename d0/f33 to d0/f40 0 2024-04-20T21:58:53.038 INFO:tasks.workunit.client.1.smithi164.stdout:5/159: rmdir dc/d2b/d2f 0 2024-04-20T21:58:53.039 INFO:tasks.workunit.client.1.smithi164.stdout:2/158: mknod d2/d5/d21/c31 0 2024-04-20T21:58:53.042 INFO:tasks.workunit.client.1.smithi164.stdout:2/159: dread - d2/d5/d21/f2b zero size 2024-04-20T21:58:53.043 INFO:tasks.workunit.client.1.smithi164.stdout:2/160: fdatasync d2/f1b 0 2024-04-20T21:58:53.044 INFO:tasks.workunit.client.1.smithi164.stdout:4/147: write d4/d9/d22/f34 [98312,20755] 0 2024-04-20T21:58:53.045 INFO:tasks.workunit.client.1.smithi164.stdout:8/164: symlink d0/l41 0 2024-04-20T21:58:53.047 INFO:tasks.workunit.client.1.smithi164.stdout:4/148: write d4/f39 [205544,31284] 0 2024-04-20T21:58:53.049 INFO:tasks.workunit.client.1.smithi164.stdout:2/161: creat d2/d19/d28/f32 x:0 0 0 2024-04-20T21:58:53.053 INFO:tasks.workunit.client.1.smithi164.stdout:4/149: dread d4/d9/fc [0,4194304] 0 2024-04-20T21:58:53.059 INFO:tasks.workunit.client.1.smithi164.stdout:1/166: truncate f1 8221506 0 2024-04-20T21:58:53.060 INFO:tasks.workunit.client.1.smithi164.stdout:4/150: getdents d4/d28 0 2024-04-20T21:58:53.062 INFO:tasks.workunit.client.1.smithi164.stdout:5/160: dwrite dc/d2b/f37 [0,4194304] 0 2024-04-20T21:58:53.064 INFO:tasks.workunit.client.1.smithi164.stdout:2/162: getdents d2/d19 0 2024-04-20T21:58:53.066 INFO:tasks.workunit.client.1.smithi164.stdout:1/167: write d10/f15 [507652,20804] 0 2024-04-20T21:58:53.068 INFO:tasks.workunit.client.1.smithi164.stdout:4/151: mknod d4/d28/c3a 0 2024-04-20T21:58:53.072 INFO:tasks.workunit.client.1.smithi164.stdout:1/168: fdatasync d10/f14 0 2024-04-20T21:58:53.076 INFO:tasks.workunit.client.1.smithi164.stdout:4/152: unlink d4/d9/c1f 0 2024-04-20T21:58:53.077 INFO:tasks.workunit.client.1.smithi164.stdout:2/163: getdents d2/d5 0 2024-04-20T21:58:53.078 INFO:tasks.workunit.client.1.smithi164.stdout:1/169: mknod d10/d16/d19/d1a/c37 0 2024-04-20T21:58:53.083 INFO:tasks.workunit.client.1.smithi164.stdout:1/170: write d10/d16/f27 [926697,113699] 0 2024-04-20T21:58:53.085 INFO:tasks.workunit.client.1.smithi164.stdout:4/153: creat d4/d9/d27/d37/f3b x:0 0 0 2024-04-20T21:58:53.090 INFO:tasks.workunit.client.1.smithi164.stdout:4/154: creat d4/d9/d22/f3c x:0 0 0 2024-04-20T21:58:53.090 INFO:tasks.workunit.client.1.smithi164.stdout:5/161: dwrite dc/d2b/f3b [0,4194304] 0 2024-04-20T21:58:53.093 INFO:tasks.workunit.client.1.smithi164.stdout:5/162: read - dc/d12/f13 zero size 2024-04-20T21:58:53.096 INFO:tasks.workunit.client.1.smithi164.stdout:4/155: symlink d4/l3d 0 2024-04-20T21:58:53.103 INFO:tasks.workunit.client.1.smithi164.stdout:2/164: dwrite d2/d5/d21/f2b [0,4194304] 0 2024-04-20T21:58:53.112 INFO:tasks.workunit.client.1.smithi164.stdout:1/171: dwrite f0 [0,4194304] 0 2024-04-20T21:58:53.113 INFO:tasks.workunit.client.1.smithi164.stdout:2/165: symlink d2/d19/d28/l33 0 2024-04-20T21:58:53.116 INFO:tasks.workunit.client.1.smithi164.stdout:5/163: truncate dc/d2c/d2e/f31 2675709 0 2024-04-20T21:58:53.117 INFO:tasks.workunit.client.1.smithi164.stdout:1/172: creat d10/d16/d20/f38 x:0 0 0 2024-04-20T21:58:53.121 INFO:tasks.workunit.client.1.smithi164.stdout:5/164: dread f4 [0,4194304] 0 2024-04-20T21:58:53.122 INFO:tasks.workunit.client.1.smithi164.stdout:1/173: creat d10/d16/d20/d25/f39 x:0 0 0 2024-04-20T21:58:53.123 INFO:tasks.workunit.client.1.smithi164.stdout:4/156: dread d4/fe [0,4194304] 0 2024-04-20T21:58:53.127 INFO:tasks.workunit.client.1.smithi164.stdout:5/165: symlink dc/d12/d1e/l3d 0 2024-04-20T21:58:53.127 INFO:tasks.workunit.client.1.smithi164.stdout:4/157: mkdir d4/d28/d3e 0 2024-04-20T21:58:53.129 INFO:tasks.workunit.client.1.smithi164.stdout:4/158: chown f3 16645767 1 2024-04-20T21:58:53.129 INFO:tasks.workunit.client.1.smithi164.stdout:5/166: fsync dc/d12/f18 0 2024-04-20T21:58:53.130 INFO:tasks.workunit.client.1.smithi164.stdout:5/167: stat dc/c21 0 2024-04-20T21:58:53.133 INFO:tasks.workunit.client.1.smithi164.stdout:5/168: write dc/f25 [298995,84814] 0 2024-04-20T21:58:53.133 INFO:tasks.workunit.client.1.smithi164.stdout:4/159: mkdir d4/d9/d27/d3f 0 2024-04-20T21:58:53.136 INFO:tasks.workunit.client.1.smithi164.stdout:5/169: symlink dc/d12/l3e 0 2024-04-20T21:58:53.137 INFO:tasks.workunit.client.1.smithi164.stdout:4/160: symlink d4/d28/d3e/l40 0 2024-04-20T21:58:53.138 INFO:tasks.workunit.client.1.smithi164.stdout:4/161: readlink d4/l3d 0 2024-04-20T21:58:53.138 INFO:tasks.workunit.client.1.smithi164.stdout:5/170: creat dc/d2b/f3f x:0 0 0 2024-04-20T21:58:53.140 INFO:tasks.workunit.client.1.smithi164.stdout:5/171: fdatasync dc/d12/d1e/f35 0 2024-04-20T21:58:53.141 INFO:tasks.workunit.client.1.smithi164.stdout:4/162: mkdir d4/d28/d3e/d41 0 2024-04-20T21:58:53.142 INFO:tasks.workunit.client.1.smithi164.stdout:5/172: fsync dc/d12/f13 0 2024-04-20T21:58:53.142 INFO:tasks.workunit.client.1.smithi164.stdout:1/174: dwrite d10/d16/d20/d25/f39 [0,4194304] 0 2024-04-20T21:58:53.144 INFO:tasks.workunit.client.1.smithi164.stdout:4/163: mkdir d4/d9/d42 0 2024-04-20T21:58:53.147 INFO:tasks.workunit.client.1.smithi164.stdout:5/173: symlink dc/d2c/l40 0 2024-04-20T21:58:53.152 INFO:tasks.workunit.client.1.smithi164.stdout:4/164: dread d4/f36 [0,4194304] 0 2024-04-20T21:58:53.161 INFO:tasks.workunit.client.1.smithi164.stdout:1/175: dwrite d10/d16/d20/d25/f2e [0,4194304] 0 2024-04-20T21:58:53.163 INFO:tasks.workunit.client.1.smithi164.stdout:1/176: fdatasync d10/d16/d20/f28 0 2024-04-20T21:58:53.165 INFO:tasks.workunit.client.1.smithi164.stdout:1/177: rmdir d10/d33 39 2024-04-20T21:58:53.167 INFO:tasks.workunit.client.1.smithi164.stdout:4/165: dwrite f3 [0,4194304] 0 2024-04-20T21:58:53.169 INFO:tasks.workunit.client.1.smithi164.stdout:4/166: dread - d4/d9/d22/f2f zero size 2024-04-20T21:58:53.171 INFO:tasks.workunit.client.1.smithi164.stdout:4/167: creat d4/d9/d22/f43 x:0 0 0 2024-04-20T21:58:53.172 INFO:tasks.workunit.client.1.smithi164.stdout:4/168: chown d4/f16 11543604 1 2024-04-20T21:58:53.177 INFO:tasks.workunit.client.1.smithi164.stdout:4/169: link f2 d4/d28/f44 0 2024-04-20T21:58:53.179 INFO:tasks.workunit.client.1.smithi164.stdout:4/170: write d4/f15 [1180825,74004] 0 2024-04-20T21:58:53.194 INFO:tasks.workunit.client.1.smithi164.stdout:4/171: dwrite d4/fe [0,4194304] 0 2024-04-20T21:58:53.213 INFO:tasks.workunit.client.1.smithi164.stdout:4/172: dwrite d4/d28/f44 [0,4194304] 0 2024-04-20T21:58:53.215 INFO:tasks.workunit.client.1.smithi164.stdout:9/176: sync 2024-04-20T21:58:53.215 INFO:tasks.workunit.client.1.smithi164.stdout:3/186: sync 2024-04-20T21:58:53.217 INFO:tasks.workunit.client.1.smithi164.stdout:4/173: mknod d4/d9/d22/c45 0 2024-04-20T21:58:53.221 INFO:tasks.workunit.client.1.smithi164.stdout:3/187: creat d12/d15/f37 x:0 0 0 2024-04-20T21:58:53.222 INFO:tasks.workunit.client.1.smithi164.stdout:9/177: creat d3/db/d1b/d1e/f3b x:0 0 0 2024-04-20T21:58:53.227 INFO:tasks.workunit.client.1.smithi164.stdout:9/178: creat d3/db/d1b/f3c x:0 0 0 2024-04-20T21:58:53.230 INFO:tasks.workunit.client.1.smithi164.stdout:9/179: symlink d3/d27/d2a/l3d 0 2024-04-20T21:58:53.233 INFO:tasks.workunit.client.1.smithi164.stdout:3/188: read f4 [2928608,49080] 0 2024-04-20T21:58:53.236 INFO:tasks.workunit.client.1.smithi164.stdout:4/174: dread d4/fe [0,4194304] 0 2024-04-20T21:58:53.237 INFO:tasks.workunit.client.1.smithi164.stdout:3/189: creat d12/d15/f38 x:0 0 0 2024-04-20T21:58:53.238 INFO:tasks.workunit.client.1.smithi164.stdout:4/175: stat d4/d9 0 2024-04-20T21:58:53.241 INFO:tasks.workunit.client.1.smithi164.stdout:4/176: truncate d4/f19 469237 0 2024-04-20T21:58:53.246 INFO:tasks.workunit.client.1.smithi164.stdout:9/180: dread d3/db/dd/f23 [0,4194304] 0 2024-04-20T21:58:53.263 INFO:tasks.workunit.client.1.smithi164.stdout:9/181: dwrite d3/db/dd/fe [0,4194304] 0 2024-04-20T21:58:53.266 INFO:tasks.workunit.client.1.smithi164.stdout:4/177: dread d4/fb [0,4194304] 0 2024-04-20T21:58:53.269 INFO:tasks.workunit.client.1.smithi164.stdout:5/174: write f4 [756097,77416] 0 2024-04-20T21:58:53.273 INFO:tasks.workunit.client.1.smithi164.stdout:9/182: symlink d3/db/l3e 0 2024-04-20T21:58:53.274 INFO:tasks.workunit.client.1.smithi164.stdout:9/183: fsync d3/ff 0 2024-04-20T21:58:53.274 INFO:tasks.workunit.client.1.smithi164.stdout:5/175: rmdir dc 39 2024-04-20T21:58:53.278 INFO:tasks.workunit.client.1.smithi164.stdout:4/178: link d4/d9/l38 d4/d28/d3e/d41/l46 0 2024-04-20T21:58:53.283 INFO:tasks.workunit.client.1.smithi164.stdout:4/179: mknod d4/d9/d22/c47 0 2024-04-20T21:58:53.285 INFO:tasks.workunit.client.1.smithi164.stdout:9/184: mkdir d3/db/d1b/d20/d3f 0 2024-04-20T21:58:53.290 INFO:tasks.workunit.client.1.smithi164.stdout:9/185: rename d3/d27 to d3/db/dd/d40 0 2024-04-20T21:58:53.292 INFO:tasks.workunit.client.1.smithi164.stdout:9/186: write d3/f9 [2528854,37760] 0 2024-04-20T21:58:53.295 INFO:tasks.workunit.client.1.smithi164.stdout:4/180: dread f3 [0,4194304] 0 2024-04-20T21:58:53.300 INFO:tasks.workunit.client.1.smithi164.stdout:5/176: truncate f8 1019800 0 2024-04-20T21:58:53.306 INFO:tasks.workunit.client.1.smithi164.stdout:5/177: rmdir dc/d2c 39 2024-04-20T21:58:53.307 INFO:tasks.workunit.client.1.smithi164.stdout:5/178: stat f9 0 2024-04-20T21:58:53.310 INFO:tasks.workunit.client.1.smithi164.stdout:9/187: dwrite d3/db/d1b/f3c [0,4194304] 0 2024-04-20T21:58:53.312 INFO:tasks.workunit.client.1.smithi164.stdout:4/181: dwrite d4/d9/d27/f32 [0,4194304] 0 2024-04-20T21:58:53.312 INFO:tasks.workunit.client.1.smithi164.stdout:5/179: mkdir dc/d41 0 2024-04-20T21:58:53.312 INFO:tasks.workunit.client.1.smithi164.stdout:4/182: dread - d4/f1d zero size 2024-04-20T21:58:53.317 INFO:tasks.workunit.client.1.smithi164.stdout:4/183: fdatasync d4/d9/f2d 0 2024-04-20T21:58:53.317 INFO:tasks.workunit.client.1.smithi164.stdout:9/188: creat d3/f41 x:0 0 0 2024-04-20T21:58:53.323 INFO:tasks.workunit.client.1.smithi164.stdout:4/184: rmdir d4 39 2024-04-20T21:58:53.325 INFO:tasks.workunit.client.1.smithi164.stdout:9/189: symlink d3/db/d1b/d1e/l42 0 2024-04-20T21:58:53.327 INFO:tasks.workunit.client.1.smithi164.stdout:4/185: chown d4/d28/d3e 1509 1 2024-04-20T21:58:53.333 INFO:tasks.workunit.client.1.smithi164.stdout:4/186: creat d4/d9/d27/f48 x:0 0 0 2024-04-20T21:58:53.336 INFO:tasks.workunit.client.1.smithi164.stdout:9/190: symlink d3/db/d1b/d20/d3f/l43 0 2024-04-20T21:58:53.337 INFO:tasks.workunit.client.1.smithi164.stdout:4/187: mknod d4/d9/d27/d37/c49 0 2024-04-20T21:58:53.338 INFO:tasks.workunit.client.1.smithi164.stdout:9/191: fsync d3/f9 0 2024-04-20T21:58:53.339 INFO:tasks.workunit.client.1.smithi164.stdout:5/180: dwrite dc/d12/d1e/f1f [0,4194304] 0 2024-04-20T21:58:53.340 INFO:tasks.workunit.client.1.smithi164.stdout:4/188: mkdir d4/d28/d3e/d4a 0 2024-04-20T21:58:53.347 INFO:tasks.workunit.client.1.smithi164.stdout:0/160: sync 2024-04-20T21:58:53.347 INFO:tasks.workunit.client.1.smithi164.stdout:6/214: sync 2024-04-20T21:58:53.348 INFO:tasks.workunit.client.1.smithi164.stdout:4/189: write d4/d9/f2d [740627,92423] 0 2024-04-20T21:58:53.348 INFO:tasks.workunit.client.1.smithi164.stdout:9/192: truncate d3/fa 32051 0 2024-04-20T21:58:53.348 INFO:tasks.workunit.client.1.smithi164.stdout:5/181: fdatasync dc/fd 0 2024-04-20T21:58:53.351 INFO:tasks.workunit.client.1.smithi164.stdout:0/161: mknod d1/c2a 0 2024-04-20T21:58:53.355 INFO:tasks.workunit.client.1.smithi164.stdout:9/193: mknod d3/db/dd/d40/c44 0 2024-04-20T21:58:53.356 INFO:tasks.workunit.client.1.smithi164.stdout:9/194: readlink d3/db/l16 0 2024-04-20T21:58:53.360 INFO:tasks.workunit.client.1.smithi164.stdout:0/162: write d1/f12 [4448233,4950] 0 2024-04-20T21:58:53.365 INFO:tasks.workunit.client.1.smithi164.stdout:9/195: creat d3/db/dd/f45 x:0 0 0 2024-04-20T21:58:53.367 INFO:tasks.workunit.client.1.smithi164.stdout:6/215: link d0/d3/d15/f2c d0/d3/d15/d23/f48 0 2024-04-20T21:58:53.368 INFO:tasks.workunit.client.1.smithi164.stdout:6/216: chown d0/d3/d15/d23/d3b/f42 20320 1 2024-04-20T21:58:53.371 INFO:tasks.workunit.client.1.smithi164.stdout:0/163: fdatasync d1/fb 0 2024-04-20T21:58:53.375 INFO:tasks.workunit.client.1.smithi164.stdout:9/196: creat d3/db/d1b/f46 x:0 0 0 2024-04-20T21:58:53.377 INFO:tasks.workunit.client.1.smithi164.stdout:6/217: creat d0/d3/d11/f49 x:0 0 0 2024-04-20T21:58:53.386 INFO:tasks.workunit.client.1.smithi164.stdout:9/197: rename d3/l19 to d3/db/d1b/d20/d3f/l47 0 2024-04-20T21:58:53.388 INFO:tasks.workunit.client.1.smithi164.stdout:9/198: write d3/db/d1b/f34 [725275,109634] 0 2024-04-20T21:58:53.391 INFO:tasks.workunit.client.1.smithi164.stdout:9/199: truncate d3/db/dd/f14 1017277 0 2024-04-20T21:58:53.391 INFO:tasks.workunit.client.1.smithi164.stdout:0/164: mkdir d1/d2b 0 2024-04-20T21:58:53.392 INFO:tasks.workunit.client.1.smithi164.stdout:0/165: chown d1/c24 16850147 1 2024-04-20T21:58:53.394 INFO:tasks.workunit.client.1.smithi164.stdout:6/218: mkdir d0/d3/d4a 0 2024-04-20T21:58:53.399 INFO:tasks.workunit.client.1.smithi164.stdout:0/166: unlink d1/f10 0 2024-04-20T21:58:53.403 INFO:tasks.workunit.client.1.smithi164.stdout:6/219: mkdir d0/d3/d15/d21/d4b 0 2024-04-20T21:58:53.410 INFO:tasks.workunit.client.1.smithi164.stdout:7/154: sync 2024-04-20T21:58:53.413 INFO:tasks.workunit.client.1.smithi164.stdout:4/190: write d4/d9/d27/f2c [832437,72950] 0 2024-04-20T21:58:53.421 INFO:tasks.workunit.client.1.smithi164.stdout:7/155: rename d2/f20 to d2/d21/f34 0 2024-04-20T21:58:53.424 INFO:tasks.workunit.client.1.smithi164.stdout:0/167: link d1/d4/df/f1a d1/d4/f2c 0 2024-04-20T21:58:53.425 INFO:tasks.workunit.client.1.smithi164.stdout:5/182: write dc/f24 [1369653,88362] 0 2024-04-20T21:58:53.426 INFO:tasks.workunit.client.1.smithi164.stdout:0/168: chown d1/d4/df 124442292 1 2024-04-20T21:58:53.427 INFO:tasks.workunit.client.1.smithi164.stdout:5/183: dread - dc/f1a zero size 2024-04-20T21:58:53.428 INFO:tasks.workunit.client.1.smithi164.stdout:6/220: symlink d0/d3/d4a/l4c 0 2024-04-20T21:58:53.431 INFO:tasks.workunit.client.1.smithi164.stdout:6/221: dread - d0/d3/d15/f24 zero size 2024-04-20T21:58:53.431 INFO:tasks.workunit.client.1.smithi164.stdout:5/184: truncate dc/d12/f13 742789 0 2024-04-20T21:58:53.433 INFO:tasks.workunit.client.1.smithi164.stdout:5/185: write f4 [1022647,118799] 0 2024-04-20T21:58:53.435 INFO:tasks.workunit.client.1.smithi164.stdout:4/191: rename d4/d9/d22/f3c to d4/d28/d3e/d41/f4b 0 2024-04-20T21:58:53.435 INFO:tasks.workunit.client.1.smithi164.stdout:5/186: chown f9 14577 1 2024-04-20T21:58:53.435 INFO:tasks.workunit.client.1.smithi164.stdout:7/156: dread d2/d21/f28 [0,4194304] 0 2024-04-20T21:58:53.436 INFO:tasks.workunit.client.1.smithi164.stdout:6/222: truncate d0/d3/d15/d23/d3b/f3e 953721 0 2024-04-20T21:58:53.436 INFO:tasks.workunit.client.1.smithi164.stdout:4/192: chown d4/f39 110 1 2024-04-20T21:58:53.437 INFO:tasks.workunit.client.1.smithi164.stdout:7/157: fsync d2/f5 0 2024-04-20T21:58:53.439 INFO:tasks.workunit.client.1.smithi164.stdout:7/158: readlink d2/l22 0 2024-04-20T21:58:53.442 INFO:tasks.workunit.client.1.smithi164.stdout:9/200: getdents d3/db/d1b 0 2024-04-20T21:58:53.443 INFO:tasks.workunit.client.1.smithi164.stdout:8/165: sync 2024-04-20T21:58:53.443 INFO:tasks.workunit.client.1.smithi164.stdout:3/190: sync 2024-04-20T21:58:53.443 INFO:tasks.workunit.client.1.smithi164.stdout:1/178: sync 2024-04-20T21:58:53.443 INFO:tasks.workunit.client.1.smithi164.stdout:2/166: sync 2024-04-20T21:58:53.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:53 smithi142 ceph-mon[15828]: [20/Apr/2024:21:58:52] ENGINE Bus STARTING 2024-04-20T21:58:53.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:53 smithi142 ceph-mon[15828]: [20/Apr/2024:21:58:52] ENGINE Serving on https://172.21.15.142:7150 2024-04-20T21:58:53.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:53 smithi142 ceph-mon[15828]: [20/Apr/2024:21:58:52] ENGINE Serving on http://172.21.15.142:8765 2024-04-20T21:58:53.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:53 smithi142 ceph-mon[15828]: [20/Apr/2024:21:58:52] ENGINE Bus STARTED 2024-04-20T21:58:53.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:53 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:58:53.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:53 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:58:53.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:53 smithi164 ceph-mon[23506]: [20/Apr/2024:21:58:52] ENGINE Bus STARTING 2024-04-20T21:58:53.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:53 smithi164 ceph-mon[23506]: [20/Apr/2024:21:58:52] ENGINE Serving on https://172.21.15.142:7150 2024-04-20T21:58:53.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:53 smithi164 ceph-mon[23506]: [20/Apr/2024:21:58:52] ENGINE Serving on http://172.21.15.142:8765 2024-04-20T21:58:53.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:53 smithi164 ceph-mon[23506]: [20/Apr/2024:21:58:52] ENGINE Bus STARTED 2024-04-20T21:58:53.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:53 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:58:53.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:53 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:58:53.447 INFO:tasks.workunit.client.1.smithi164.stdout:8/166: dread - d0/d1e/f20 zero size 2024-04-20T21:58:53.448 INFO:tasks.workunit.client.1.smithi164.stdout:8/167: fsync d0/f19 0 2024-04-20T21:58:53.450 INFO:tasks.workunit.client.1.smithi164.stdout:1/179: read d10/f15 [337522,89046] 0 2024-04-20T21:58:53.451 INFO:tasks.workunit.client.1.smithi164.stdout:8/168: read d0/f24 [2513949,115133] 0 2024-04-20T21:58:53.452 INFO:tasks.workunit.client.1.smithi164.stdout:1/180: fsync d10/d16/f27 0 2024-04-20T21:58:53.454 INFO:tasks.workunit.client.1.smithi164.stdout:4/193: symlink d4/d9/d27/d37/l4c 0 2024-04-20T21:58:53.456 INFO:tasks.workunit.client.1.smithi164.stdout:6/223: creat d0/d3/d11/d29/f4d x:0 0 0 2024-04-20T21:58:53.464 INFO:tasks.workunit.client.1.smithi164.stdout:7/159: dread d2/d21/f28 [0,4194304] 0 2024-04-20T21:58:53.464 INFO:tasks.workunit.client.1.smithi164.stdout:8/169: dread d0/f1b [0,4194304] 0 2024-04-20T21:58:53.465 INFO:tasks.workunit.client.1.smithi164.stdout:0/169: dwrite d1/d4/f2c [0,4194304] 0 2024-04-20T21:58:53.466 INFO:tasks.workunit.client.1.smithi164.stdout:0/170: write d1/d4/df/f1a [4238670,6363] 0 2024-04-20T21:58:53.469 INFO:tasks.workunit.client.1.smithi164.stdout:8/170: fdatasync d0/d14/d16/f34 0 2024-04-20T21:58:53.472 INFO:tasks.workunit.client.1.smithi164.stdout:8/171: dread - d0/d14/f1d zero size 2024-04-20T21:58:53.473 INFO:tasks.workunit.client.1.smithi164.stdout:3/191: dwrite d12/d15/f1c [0,4194304] 0 2024-04-20T21:58:53.479 INFO:tasks.workunit.client.1.smithi164.stdout:9/201: creat d3/db/dd/d40/d2a/d36/f48 x:0 0 0 2024-04-20T21:58:53.480 INFO:tasks.workunit.client.1.smithi164.stdout:5/187: dread dc/f16 [0,4194304] 0 2024-04-20T21:58:53.481 INFO:tasks.workunit.client.1.smithi164.stdout:7/160: creat d2/d21/f35 x:0 0 0 2024-04-20T21:58:53.490 INFO:tasks.workunit.client.1.smithi164.stdout:0/171: unlink d1/d4/da/d1f/f25 0 2024-04-20T21:58:53.491 INFO:tasks.workunit.client.1.smithi164.stdout:8/172: unlink d0/d14/f25 0 2024-04-20T21:58:53.493 INFO:tasks.workunit.client.1.smithi164.stdout:3/192: mkdir d12/d20/d39 0 2024-04-20T21:58:53.494 INFO:tasks.workunit.client.1.smithi164.stdout:4/194: mknod d4/d28/d3e/d4a/c4d 0 2024-04-20T21:58:53.496 INFO:tasks.workunit.client.1.smithi164.stdout:8/173: truncate d0/d14/f3d 685500 0 2024-04-20T21:58:53.498 INFO:tasks.workunit.client.1.smithi164.stdout:3/193: write d12/d20/f2b [968810,29774] 0 2024-04-20T21:58:53.500 INFO:tasks.workunit.client.1.smithi164.stdout:8/174: chown d0/d14/d16/c15 365662842 1 2024-04-20T21:58:53.502 INFO:tasks.workunit.client.1.smithi164.stdout:6/224: link d0/d3/f3a d0/d3/d15/d21/d4b/f4e 0 2024-04-20T21:58:53.504 INFO:tasks.workunit.client.1.smithi164.stdout:7/161: dwrite d2/f29 [0,4194304] 0 2024-04-20T21:58:53.505 INFO:tasks.workunit.client.1.smithi164.stdout:6/225: write d0/f6 [2934726,2301] 0 2024-04-20T21:58:53.505 INFO:tasks.workunit.client.1.smithi164.stdout:2/167: getdents d2/d19/d28 0 2024-04-20T21:58:53.509 INFO:tasks.workunit.client.1.smithi164.stdout:5/188: dwrite dc/d12/d1e/f35 [4194304,4194304] 0 2024-04-20T21:58:53.509 INFO:tasks.workunit.client.1.smithi164.stdout:1/181: link l2 d10/d16/d20/d26/d34/l3a 0 2024-04-20T21:58:53.510 INFO:tasks.workunit.client.1.smithi164.stdout:2/168: readlink d2/l15 0 2024-04-20T21:58:53.514 INFO:tasks.workunit.client.1.smithi164.stdout:3/194: mknod d12/c3a 0 2024-04-20T21:58:53.517 INFO:tasks.workunit.client.1.smithi164.stdout:3/195: stat f6 0 2024-04-20T21:58:53.522 INFO:tasks.workunit.client.1.smithi164.stdout:6/226: dread d0/d3/d15/f2c [0,4194304] 0 2024-04-20T21:58:53.525 INFO:tasks.workunit.client.1.smithi164.stdout:8/175: truncate d0/d14/f2a 251784 0 2024-04-20T21:58:53.525 INFO:tasks.workunit.client.1.smithi164.stdout:2/169: write d2/fa [790443,73513] 0 2024-04-20T21:58:53.531 INFO:tasks.workunit.client.1.smithi164.stdout:4/195: creat d4/f4e x:0 0 0 2024-04-20T21:58:53.531 INFO:tasks.workunit.client.1.smithi164.stdout:1/182: mknod d10/c3b 0 2024-04-20T21:58:53.533 INFO:tasks.workunit.client.1.smithi164.stdout:2/170: truncate d2/d19/d28/f2a 605395 0 2024-04-20T21:58:53.543 INFO:tasks.workunit.client.1.smithi164.stdout:9/202: getdents d3/db/d1b/d1e 0 2024-04-20T21:58:53.543 INFO:tasks.workunit.client.1.smithi164.stdout:0/172: dwrite d1/f8 [4194304,4194304] 0 2024-04-20T21:58:53.552 INFO:tasks.workunit.client.1.smithi164.stdout:0/173: chown d1 1 1 2024-04-20T21:58:53.557 INFO:tasks.workunit.client.1.smithi164.stdout:3/196: mknod d12/d20/d39/c3b 0 2024-04-20T21:58:53.557 INFO:tasks.workunit.client.1.smithi164.stdout:5/189: dwrite dc/d2b/f3c [0,4194304] 0 2024-04-20T21:58:53.569 INFO:tasks.workunit.client.1.smithi164.stdout:1/183: dwrite f0 [0,4194304] 0 2024-04-20T21:58:53.571 INFO:tasks.workunit.client.1.smithi164.stdout:4/196: creat d4/d9/d27/d3f/f4f x:0 0 0 2024-04-20T21:58:53.580 INFO:tasks.workunit.client.1.smithi164.stdout:6/227: dwrite d0/d3/d27/f43 [0,4194304] 0 2024-04-20T21:58:53.586 INFO:tasks.workunit.client.1.smithi164.stdout:2/171: creat d2/f34 x:0 0 0 2024-04-20T21:58:53.587 INFO:tasks.workunit.client.1.smithi164.stdout:1/184: truncate d10/f15 527020 0 2024-04-20T21:58:53.596 INFO:tasks.workunit.client.1.smithi164.stdout:2/172: chown d2/c8 570425 1 2024-04-20T21:58:53.598 INFO:tasks.workunit.client.1.smithi164.stdout:4/197: truncate d4/d9/fc 214392 0 2024-04-20T21:58:53.603 INFO:tasks.workunit.client.1.smithi164.stdout:8/176: dwrite d0/f24 [0,4194304] 0 2024-04-20T21:58:53.605 INFO:tasks.workunit.client.1.smithi164.stdout:5/190: rename dc/d2b/l32 to dc/l42 0 2024-04-20T21:58:53.605 INFO:tasks.workunit.client.1.smithi164.stdout:1/185: mkdir d10/d16/d3c 0 2024-04-20T21:58:53.605 INFO:tasks.workunit.client.1.smithi164.stdout:2/173: fdatasync d2/d19/d28/f29 0 2024-04-20T21:58:53.612 INFO:tasks.workunit.client.1.smithi164.stdout:5/191: dread - dc/d12/f15 zero size 2024-04-20T21:58:53.612 INFO:tasks.workunit.client.1.smithi164.stdout:7/162: dread d2/f5 [0,4194304] 0 2024-04-20T21:58:53.614 INFO:tasks.workunit.client.1.smithi164.stdout:6/228: mkdir d0/d3/d15/d23/d45/d4f 0 2024-04-20T21:58:53.618 INFO:tasks.workunit.client.1.smithi164.stdout:1/186: unlink d10/d16/d19/d1a/f23 0 2024-04-20T21:58:53.619 INFO:tasks.workunit.client.1.smithi164.stdout:3/197: dwrite f6 [0,4194304] 0 2024-04-20T21:58:53.621 INFO:tasks.workunit.client.1.smithi164.stdout:6/229: fsync d0/d3/f12 0 2024-04-20T21:58:53.622 INFO:tasks.workunit.client.1.smithi164.stdout:4/198: dread d4/f19 [0,4194304] 0 2024-04-20T21:58:53.622 INFO:tasks.workunit.client.1.smithi164.stdout:2/174: mknod d2/d5/c35 0 2024-04-20T21:58:53.629 INFO:tasks.workunit.client.1.smithi164.stdout:6/230: chown d0/d3/d15/d23/f48 184 1 2024-04-20T21:58:53.630 INFO:tasks.workunit.client.1.smithi164.stdout:8/177: symlink d0/l42 0 2024-04-20T21:58:53.634 INFO:tasks.workunit.client.1.smithi164.stdout:7/163: write d2/d21/d24/f2b [444029,53769] 0 2024-04-20T21:58:53.638 INFO:tasks.workunit.client.1.smithi164.stdout:9/203: dread d3/ff [0,4194304] 0 2024-04-20T21:58:53.639 INFO:tasks.workunit.client.1.smithi164.stdout:3/198: unlink d12/f16 0 2024-04-20T21:58:53.641 INFO:tasks.workunit.client.1.smithi164.stdout:1/187: dread d10/d16/f27 [0,4194304] 0 2024-04-20T21:58:53.644 INFO:tasks.workunit.client.1.smithi164.stdout:0/174: sync 2024-04-20T21:58:53.648 INFO:tasks.workunit.client.1.smithi164.stdout:7/164: symlink d2/l36 0 2024-04-20T21:58:53.648 INFO:tasks.workunit.client.1.smithi164.stdout:9/204: write d3/db/dd/d40/d2a/d36/f48 [55211,41515] 0 2024-04-20T21:58:53.650 INFO:tasks.workunit.client.1.smithi164.stdout:5/192: dread dc/d2b/f37 [0,4194304] 0 2024-04-20T21:58:53.652 INFO:tasks.workunit.client.1.smithi164.stdout:9/205: stat d3/db/d1b/f3c 0 2024-04-20T21:58:53.656 INFO:tasks.workunit.client.1.smithi164.stdout:8/178: rename d0/f21 to d0/d1e/f43 0 2024-04-20T21:58:53.656 INFO:tasks.workunit.client.1.smithi164.stdout:5/193: dread - dc/d12/f17 zero size 2024-04-20T21:58:53.659 INFO:tasks.workunit.client.1.smithi164.stdout:1/188: mkdir d10/d16/d20/d25/d3d 0 2024-04-20T21:58:53.667 INFO:tasks.workunit.client.1.smithi164.stdout:6/231: dwrite d0/d3/d8/f3c [0,4194304] 0 2024-04-20T21:58:53.669 INFO:tasks.workunit.client.1.smithi164.stdout:7/165: rename d2/c17 to d2/d21/d33/c37 0 2024-04-20T21:58:53.670 INFO:tasks.workunit.client.1.smithi164.stdout:3/199: dread f6 [0,4194304] 0 2024-04-20T21:58:53.673 INFO:tasks.workunit.client.1.smithi164.stdout:4/199: truncate d4/f2b 43313 0 2024-04-20T21:58:53.679 INFO:tasks.workunit.client.1.smithi164.stdout:0/175: mkdir d1/d4/d26/d29/d2d 0 2024-04-20T21:58:53.682 INFO:tasks.workunit.client.1.smithi164.stdout:2/175: dwrite d2/d5/f11 [0,4194304] 0 2024-04-20T21:58:53.687 INFO:tasks.workunit.client.1.smithi164.stdout:2/176: stat d2/d5/f14 0 2024-04-20T21:58:53.688 INFO:tasks.workunit.client.1.smithi164.stdout:5/194: dwrite dc/d2b/f3b [0,4194304] 0 2024-04-20T21:58:53.691 INFO:tasks.workunit.client.1.smithi164.stdout:1/189: creat d10/d16/d3c/f3e x:0 0 0 2024-04-20T21:58:53.698 INFO:tasks.workunit.client.1.smithi164.stdout:2/177: rename c0 to d2/d19/c36 0 2024-04-20T21:58:53.702 INFO:tasks.workunit.client.1.smithi164.stdout:9/206: getdents d3/db 0 2024-04-20T21:58:53.703 INFO:tasks.workunit.client.1.smithi164.stdout:0/176: getdents d1/d4/da/d27 0 2024-04-20T21:58:53.705 INFO:tasks.workunit.client.1.smithi164.stdout:5/195: dwrite f7 [0,4194304] 0 2024-04-20T21:58:53.705 INFO:tasks.workunit.client.1.smithi164.stdout:0/177: chown d1/f8 898 1 2024-04-20T21:58:53.706 INFO:tasks.workunit.client.1.smithi164.stdout:4/200: link d4/d9/d22/c47 d4/d9/d22/c50 0 2024-04-20T21:58:53.708 INFO:tasks.workunit.client.1.smithi164.stdout:0/178: stat d1/d4/d20 0 2024-04-20T21:58:53.713 INFO:tasks.workunit.client.1.smithi164.stdout:3/200: dread d12/d15/f23 [0,4194304] 0 2024-04-20T21:58:53.719 INFO:tasks.workunit.client.1.smithi164.stdout:6/232: getdents d0/d3/d15 0 2024-04-20T21:58:53.719 INFO:tasks.workunit.client.1.smithi164.stdout:7/166: getdents d2/d21/d24 0 2024-04-20T21:58:53.720 INFO:tasks.workunit.client.1.smithi164.stdout:2/178: chown d2/c1a 3173 1 2024-04-20T21:58:53.721 INFO:tasks.workunit.client.1.smithi164.stdout:1/190: link f7 d10/d33/f3f 0 2024-04-20T21:58:53.722 INFO:tasks.workunit.client.1.smithi164.stdout:5/196: unlink dc/ce 0 2024-04-20T21:58:53.723 INFO:tasks.workunit.client.1.smithi164.stdout:0/179: truncate d1/fb 1579191 0 2024-04-20T21:58:53.725 INFO:tasks.workunit.client.1.smithi164.stdout:4/201: rename d4/d9/d27/d37/f3b to d4/d9/d27/d37/f51 0 2024-04-20T21:58:53.726 INFO:tasks.workunit.client.1.smithi164.stdout:4/202: chown d4/d28/d3e 4736 1 2024-04-20T21:58:53.727 INFO:tasks.workunit.client.1.smithi164.stdout:3/201: rmdir d12/d2a 39 2024-04-20T21:58:53.729 INFO:tasks.workunit.client.1.smithi164.stdout:2/179: creat d2/d5/d21/f37 x:0 0 0 2024-04-20T21:58:53.731 INFO:tasks.workunit.client.1.smithi164.stdout:9/207: dread d3/db/d1b/f3c [0,4194304] 0 2024-04-20T21:58:53.731 INFO:tasks.workunit.client.1.smithi164.stdout:6/233: truncate d0/d3/d15/f2c 308152 0 2024-04-20T21:58:53.733 INFO:tasks.workunit.client.1.smithi164.stdout:1/191: unlink d10/d16/d3c/f3e 0 2024-04-20T21:58:53.735 INFO:tasks.workunit.client.1.smithi164.stdout:0/180: creat d1/d4/da/f2e x:0 0 0 2024-04-20T21:58:53.736 INFO:tasks.workunit.client.1.smithi164.stdout:9/208: read d3/f1f [376499,71302] 0 2024-04-20T21:58:53.736 INFO:tasks.workunit.client.1.smithi164.stdout:8/179: write d0/d14/f2b [1444650,27362] 0 2024-04-20T21:58:53.736 INFO:tasks.workunit.client.1.smithi164.stdout:6/234: chown d0/d3/d11/d29/f4d 3038806 1 2024-04-20T21:58:53.737 INFO:tasks.workunit.client.1.smithi164.stdout:5/197: creat dc/d2c/f43 x:0 0 0 2024-04-20T21:58:53.741 INFO:tasks.workunit.client.1.smithi164.stdout:4/203: rename d4/fa to d4/d9/d22/f52 0 2024-04-20T21:58:53.746 INFO:tasks.workunit.client.1.smithi164.stdout:6/235: rmdir d0/d3/d15 39 2024-04-20T21:58:53.751 INFO:tasks.workunit.client.1.smithi164.stdout:9/209: write d3/db/dd/d40/d2a/d36/f48 [993983,120382] 0 2024-04-20T21:58:53.755 INFO:tasks.workunit.client.1.smithi164.stdout:9/210: dread - d3/db/f38 zero size 2024-04-20T21:58:53.755 INFO:tasks.workunit.client.1.smithi164.stdout:3/202: dread d12/d15/f24 [0,4194304] 0 2024-04-20T21:58:53.755 INFO:tasks.workunit.client.1.smithi164.stdout:8/180: creat d0/d1e/f44 x:0 0 0 2024-04-20T21:58:53.756 INFO:tasks.workunit.client.1.smithi164.stdout:1/192: mknod d10/c40 0 2024-04-20T21:58:53.756 INFO:tasks.workunit.client.1.smithi164.stdout:4/204: creat d4/d28/d3e/f53 x:0 0 0 2024-04-20T21:58:53.756 INFO:tasks.workunit.client.1.smithi164.stdout:2/180: dread d2/f12 [0,4194304] 0 2024-04-20T21:58:53.764 INFO:tasks.workunit.client.1.smithi164.stdout:3/203: creat d12/d20/d39/f3c x:0 0 0 2024-04-20T21:58:53.769 INFO:tasks.workunit.client.1.smithi164.stdout:9/211: read d3/db/d1b/f34 [159497,30821] 0 2024-04-20T21:58:53.769 INFO:tasks.workunit.client.1.smithi164.stdout:2/181: write d2/d19/d28/f2a [465267,112505] 0 2024-04-20T21:58:53.769 INFO:tasks.workunit.client.1.smithi164.stdout:1/193: mkdir d10/d33/d41 0 2024-04-20T21:58:53.774 INFO:tasks.workunit.client.1.smithi164.stdout:2/182: write d2/d5/d21/f2d [911058,12172] 0 2024-04-20T21:58:53.776 INFO:tasks.workunit.client.1.smithi164.stdout:1/194: fsync d10/d16/d20/f2f 0 2024-04-20T21:58:53.779 INFO:tasks.workunit.client.1.smithi164.stdout:5/198: rename dc/l38 to dc/d2b/l44 0 2024-04-20T21:58:53.785 INFO:tasks.workunit.client.1.smithi164.stdout:4/205: getdents d4/d9 0 2024-04-20T21:58:53.795 INFO:tasks.workunit.client.1.smithi164.stdout:0/181: dread d1/f12 [0,4194304] 0 2024-04-20T21:58:53.797 INFO:tasks.workunit.client.1.smithi164.stdout:3/204: dwrite f11 [0,4194304] 0 2024-04-20T21:58:53.803 INFO:tasks.workunit.client.1.smithi164.stdout:7/167: sync 2024-04-20T21:58:53.806 INFO:tasks.workunit.client.1.smithi164.stdout:1/195: truncate f0 2698417 0 2024-04-20T21:58:53.806 INFO:tasks.workunit.client.1.smithi164.stdout:9/212: dwrite d3/db/f17 [4194304,4194304] 0 2024-04-20T21:58:53.807 INFO:tasks.workunit.client.1.smithi164.stdout:7/168: readlink d2/d21/l2e 0 2024-04-20T21:58:53.807 INFO:tasks.workunit.client.1.smithi164.stdout:8/181: dwrite d0/d1e/f44 [0,4194304] 0 2024-04-20T21:58:53.810 INFO:tasks.workunit.client.1.smithi164.stdout:2/183: getdents d2/d5/d21 0 2024-04-20T21:58:53.810 INFO:tasks.workunit.client.1.smithi164.stdout:6/236: dread d0/d3/f10 [0,4194304] 0 2024-04-20T21:58:53.811 INFO:tasks.workunit.client.1.smithi164.stdout:0/182: creat d1/d4/df/f2f x:0 0 0 2024-04-20T21:58:53.815 INFO:tasks.workunit.client.1.smithi164.stdout:4/206: truncate d4/ff 276471 0 2024-04-20T21:58:53.817 INFO:tasks.workunit.client.1.smithi164.stdout:5/199: dread dc/d2b/f3b [4194304,4194304] 0 2024-04-20T21:58:53.820 INFO:tasks.workunit.client.1.smithi164.stdout:1/196: rename d10/d16/d19/d1a/c2b to d10/d33/c42 0 2024-04-20T21:58:53.825 INFO:tasks.workunit.client.1.smithi164.stdout:0/183: symlink d1/d4/da/d1f/l30 0 2024-04-20T21:58:53.825 INFO:tasks.workunit.client.1.smithi164.stdout:1/197: truncate d10/d16/d20/f38 731029 0 2024-04-20T21:58:53.825 INFO:tasks.workunit.client.1.smithi164.stdout:9/213: symlink d3/db/dd/d40/l49 0 2024-04-20T21:58:53.829 INFO:tasks.workunit.client.1.smithi164.stdout:7/169: link d2/f5 d2/d21/d33/f38 0 2024-04-20T21:58:53.833 INFO:tasks.workunit.client.1.smithi164.stdout:9/214: unlink d3/l24 0 2024-04-20T21:58:53.834 INFO:tasks.workunit.client.1.smithi164.stdout:3/205: dread d12/d20/f2b [0,4194304] 0 2024-04-20T21:58:53.841 INFO:tasks.workunit.client.1.smithi164.stdout:6/237: link d0/d3/cc d0/d3/d15/d21/c50 0 2024-04-20T21:58:53.843 INFO:tasks.workunit.client.1.smithi164.stdout:3/206: stat d12/d2a/f36 0 2024-04-20T21:58:53.845 INFO:tasks.workunit.client.1.smithi164.stdout:1/198: creat d10/d16/f43 x:0 0 0 2024-04-20T21:58:53.849 INFO:tasks.workunit.client.1.smithi164.stdout:7/170: getdents d2 0 2024-04-20T21:58:53.849 INFO:tasks.workunit.client.1.smithi164.stdout:9/215: creat d3/db/dd/d40/d2a/f4a x:0 0 0 2024-04-20T21:58:53.852 INFO:tasks.workunit.client.1.smithi164.stdout:1/199: dread - d10/d16/d20/f2f zero size 2024-04-20T21:58:53.852 INFO:tasks.workunit.client.1.smithi164.stdout:6/238: read d0/d3/f18 [1087621,97984] 0 2024-04-20T21:58:53.855 INFO:tasks.workunit.client.1.smithi164.stdout:3/207: creat d12/d2a/f3d x:0 0 0 2024-04-20T21:58:53.856 INFO:tasks.workunit.client.1.smithi164.stdout:0/184: dwrite d1/f23 [0,4194304] 0 2024-04-20T21:58:53.859 INFO:tasks.workunit.client.1.smithi164.stdout:9/216: write d3/f9 [2283419,127858] 0 2024-04-20T21:58:53.859 INFO:tasks.workunit.client.1.smithi164.stdout:4/207: dwrite d4/f39 [0,4194304] 0 2024-04-20T21:58:53.866 INFO:tasks.workunit.client.1.smithi164.stdout:0/185: write d1/f23 [2888351,61465] 0 2024-04-20T21:58:53.866 INFO:tasks.workunit.client.1.smithi164.stdout:3/208: creat d12/d2a/f3e x:0 0 0 2024-04-20T21:58:53.868 INFO:tasks.workunit.client.1.smithi164.stdout:4/208: chown d4/d28/c3a 79432 1 2024-04-20T21:58:53.870 INFO:tasks.workunit.client.1.smithi164.stdout:9/217: dread - d3/db/d1b/f46 zero size 2024-04-20T21:58:53.870 INFO:tasks.workunit.client.1.smithi164.stdout:3/209: fdatasync f11 0 2024-04-20T21:58:53.872 INFO:tasks.workunit.client.1.smithi164.stdout:0/186: unlink d1/c19 0 2024-04-20T21:58:53.872 INFO:tasks.workunit.client.1.smithi164.stdout:1/200: link d10/d16/d19/l29 d10/d16/d20/d25/d3d/l44 0 2024-04-20T21:58:53.880 INFO:tasks.workunit.client.1.smithi164.stdout:9/218: creat d3/db/d1b/d1e/f4b x:0 0 0 2024-04-20T21:58:53.880 INFO:tasks.workunit.client.1.smithi164.stdout:3/210: rmdir d12/d20/d39 39 2024-04-20T21:58:53.881 INFO:tasks.workunit.client.1.smithi164.stdout:4/209: rmdir d4/d28/d3e/d41 39 2024-04-20T21:58:53.882 INFO:tasks.workunit.client.1.smithi164.stdout:9/219: dread - d3/f41 zero size 2024-04-20T21:58:53.884 INFO:tasks.workunit.client.1.smithi164.stdout:0/187: mknod d1/d4/d26/d29/d2d/c31 0 2024-04-20T21:58:53.890 INFO:tasks.workunit.client.1.smithi164.stdout:6/239: dwrite d0/d3/d11/f49 [0,4194304] 0 2024-04-20T21:58:53.893 INFO:tasks.workunit.client.1.smithi164.stdout:8/182: write d0/d14/f6 [1322049,52348] 0 2024-04-20T21:58:53.895 INFO:tasks.workunit.client.1.smithi164.stdout:9/220: creat d3/db/dd/f4c x:0 0 0 2024-04-20T21:58:53.899 INFO:tasks.workunit.client.1.smithi164.stdout:2/184: truncate d2/d5/f14 5079912 0 2024-04-20T21:58:53.901 INFO:tasks.workunit.client.1.smithi164.stdout:1/201: dwrite d10/d16/d20/f2f [0,4194304] 0 2024-04-20T21:58:53.909 INFO:tasks.workunit.client.1.smithi164.stdout:9/221: truncate d3/db/d1b/d1e/f3b 615574 0 2024-04-20T21:58:53.910 INFO:tasks.workunit.client.1.smithi164.stdout:5/200: sync 2024-04-20T21:58:53.910 INFO:tasks.workunit.client.1.smithi164.stdout:3/211: dread f6 [0,4194304] 0 2024-04-20T21:58:53.917 INFO:tasks.workunit.client.1.smithi164.stdout:2/185: creat d2/d19/d28/f38 x:0 0 0 2024-04-20T21:58:53.920 INFO:tasks.workunit.client.1.smithi164.stdout:8/183: symlink d0/l45 0 2024-04-20T21:58:53.924 INFO:tasks.workunit.client.1.smithi164.stdout:8/184: chown d0/d1e/f20 95876442 1 2024-04-20T21:58:53.925 INFO:tasks.workunit.client.1.smithi164.stdout:1/202: symlink d10/d16/d19/l45 0 2024-04-20T21:58:53.926 INFO:tasks.workunit.client.1.smithi164.stdout:3/212: symlink d12/d15/l3f 0 2024-04-20T21:58:53.931 INFO:tasks.workunit.client.1.smithi164.stdout:3/213: fdatasync d12/d15/f19 0 2024-04-20T21:58:53.932 INFO:tasks.workunit.client.1.smithi164.stdout:2/186: creat d2/d19/f39 x:0 0 0 2024-04-20T21:58:53.939 INFO:tasks.workunit.client.1.smithi164.stdout:5/201: dwrite dc/f24 [0,4194304] 0 2024-04-20T21:58:53.940 INFO:tasks.workunit.client.1.smithi164.stdout:1/203: creat d10/d33/f46 x:0 0 0 2024-04-20T21:58:53.940 INFO:tasks.workunit.client.1.smithi164.stdout:7/171: dwrite d2/d21/d24/f30 [0,4194304] 0 2024-04-20T21:58:53.942 INFO:tasks.workunit.client.1.smithi164.stdout:9/222: dread d3/db/f17 [4194304,4194304] 0 2024-04-20T21:58:53.947 INFO:tasks.workunit.client.1.smithi164.stdout:0/188: write d1/fb [2429392,925] 0 2024-04-20T21:58:53.947 INFO:tasks.workunit.client.1.smithi164.stdout:1/204: write d10/d16/d20/f30 [643963,58435] 0 2024-04-20T21:58:53.953 INFO:tasks.workunit.client.1.smithi164.stdout:5/202: creat dc/d12/d1e/f45 x:0 0 0 2024-04-20T21:58:53.953 INFO:tasks.workunit.client.1.smithi164.stdout:6/240: dread d0/d3/d8/f38 [0,4194304] 0 2024-04-20T21:58:53.958 INFO:tasks.workunit.client.1.smithi164.stdout:1/205: dread d10/d16/f27 [0,4194304] 0 2024-04-20T21:58:53.958 INFO:tasks.workunit.client.1.smithi164.stdout:4/210: dwrite d4/d9/d22/f52 [0,4194304] 0 2024-04-20T21:58:53.964 INFO:tasks.workunit.client.1.smithi164.stdout:2/187: read d2/f1b [44282,85299] 0 2024-04-20T21:58:53.967 INFO:tasks.workunit.client.1.smithi164.stdout:6/241: chown d0/d3/d15/d23/d45/d4f 3245818 1 2024-04-20T21:58:53.970 INFO:tasks.workunit.client.1.smithi164.stdout:2/188: readlink d2/l15 0 2024-04-20T21:58:53.973 INFO:tasks.workunit.client.1.smithi164.stdout:8/185: dread d0/d14/f2a [0,4194304] 0 2024-04-20T21:58:53.976 INFO:tasks.workunit.client.1.smithi164.stdout:2/189: unlink d2/c6 0 2024-04-20T21:58:53.981 INFO:tasks.workunit.client.1.smithi164.stdout:0/189: dread d1/f12 [0,4194304] 0 2024-04-20T21:58:53.982 INFO:tasks.workunit.client.1.smithi164.stdout:2/190: dread - d2/d19/f39 zero size 2024-04-20T21:58:53.987 INFO:tasks.workunit.client.1.smithi164.stdout:3/214: dwrite fa [0,4194304] 0 2024-04-20T21:58:53.990 INFO:tasks.workunit.client.1.smithi164.stdout:8/186: creat d0/d14/f46 x:0 0 0 2024-04-20T21:58:53.991 INFO:tasks.workunit.client.1.smithi164.stdout:5/203: dread dc/fd [0,4194304] 0 2024-04-20T21:58:53.993 INFO:tasks.workunit.client.1.smithi164.stdout:9/223: dwrite d3/db/d1b/f3c [0,4194304] 0 2024-04-20T21:58:53.993 INFO:tasks.workunit.client.1.smithi164.stdout:3/215: truncate d12/d20/f22 919834 0 2024-04-20T21:58:53.994 INFO:tasks.workunit.client.1.smithi164.stdout:8/187: chown d0/d14/cd 47 1 2024-04-20T21:58:53.996 INFO:tasks.workunit.client.1.smithi164.stdout:0/190: creat d1/d4/da/d27/f32 x:0 0 0 2024-04-20T21:58:53.999 INFO:tasks.workunit.client.1.smithi164.stdout:5/204: rmdir dc/d12 39 2024-04-20T21:58:53.999 INFO:tasks.workunit.client.1.smithi164.stdout:9/224: truncate d3/db/dd/f45 168132 0 2024-04-20T21:58:54.003 INFO:tasks.workunit.client.1.smithi164.stdout:5/205: chown dc/f25 77475 1 2024-04-20T21:58:54.008 INFO:tasks.workunit.client.1.smithi164.stdout:8/188: write d0/d1e/f43 [567845,53463] 0 2024-04-20T21:58:54.008 INFO:tasks.workunit.client.1.smithi164.stdout:9/225: chown d3/db/d1b/l2e 424349183 1 2024-04-20T21:58:54.008 INFO:tasks.workunit.client.1.smithi164.stdout:2/191: getdents d2/d5 0 2024-04-20T21:58:54.012 INFO:tasks.workunit.client.1.smithi164.stdout:5/206: chown dc/d2b/c39 621 1 2024-04-20T21:58:54.019 INFO:tasks.workunit.client.1.smithi164.stdout:9/226: mknod d3/db/d1b/d20/d3f/c4d 0 2024-04-20T21:58:54.022 INFO:tasks.workunit.client.1.smithi164.stdout:0/191: getdents d1/d4 0 2024-04-20T21:58:54.024 INFO:tasks.workunit.client.1.smithi164.stdout:7/172: dwrite d2/f5 [0,4194304] 0 2024-04-20T21:58:54.025 INFO:tasks.workunit.client.1.smithi164.stdout:8/189: mknod d0/d14/d16/c47 0 2024-04-20T21:58:54.025 INFO:tasks.workunit.client.1.smithi164.stdout:5/207: dread - dc/d12/d1e/f45 zero size 2024-04-20T21:58:54.026 INFO:tasks.workunit.client.1.smithi164.stdout:1/206: dwrite f5 [0,4194304] 0 2024-04-20T21:58:54.036 INFO:tasks.workunit.client.1.smithi164.stdout:3/216: dread d12/f14 [0,4194304] 0 2024-04-20T21:58:54.038 INFO:tasks.workunit.client.1.smithi164.stdout:3/217: fdatasync d12/d2a/f3d 0 2024-04-20T21:58:54.047 INFO:tasks.workunit.client.1.smithi164.stdout:7/173: symlink d2/l39 0 2024-04-20T21:58:54.048 INFO:tasks.workunit.client.1.smithi164.stdout:4/211: dread d4/f15 [0,4194304] 0 2024-04-20T21:58:54.049 INFO:tasks.workunit.client.1.smithi164.stdout:5/208: write f5 [321999,115748] 0 2024-04-20T21:58:54.050 INFO:tasks.workunit.client.1.smithi164.stdout:9/227: unlink d3/db/dd/d40/l2b 0 2024-04-20T21:58:54.050 INFO:tasks.workunit.client.1.smithi164.stdout:8/190: dread d0/d14/d16/f26 [0,4194304] 0 2024-04-20T21:58:54.050 INFO:tasks.workunit.client.1.smithi164.stdout:7/174: fsync d2/f15 0 2024-04-20T21:58:54.058 INFO:tasks.workunit.client.1.smithi164.stdout:1/207: symlink d10/d16/d19/d1a/l47 0 2024-04-20T21:58:54.060 INFO:tasks.workunit.client.1.smithi164.stdout:3/218: rmdir d12/d20 39 2024-04-20T21:58:54.061 INFO:tasks.workunit.client.1.smithi164.stdout:4/212: symlink d4/d9/d27/l54 0 2024-04-20T21:58:54.067 INFO:tasks.workunit.client.1.smithi164.stdout:1/208: write d10/d16/d19/d1a/f32 [145545,93341] 0 2024-04-20T21:58:54.067 INFO:tasks.workunit.client.1.smithi164.stdout:4/213: fdatasync d4/d9/d27/f32 0 2024-04-20T21:58:54.067 INFO:tasks.workunit.client.1.smithi164.stdout:1/209: dread - d10/d16/d20/f28 zero size 2024-04-20T21:58:54.072 INFO:tasks.workunit.client.1.smithi164.stdout:7/175: getdents d2/d21/d24 0 2024-04-20T21:58:54.073 INFO:tasks.workunit.client.1.smithi164.stdout:9/228: dwrite d3/db/d1b/f3c [4194304,4194304] 0 2024-04-20T21:58:54.074 INFO:tasks.workunit.client.1.smithi164.stdout:2/192: dread d2/f1b [0,4194304] 0 2024-04-20T21:58:54.077 INFO:tasks.workunit.client.1.smithi164.stdout:4/214: symlink d4/d9/d22/l55 0 2024-04-20T21:58:54.081 INFO:tasks.workunit.client.1.smithi164.stdout:1/210: truncate f0 3041859 0 2024-04-20T21:58:54.081 INFO:tasks.workunit.client.1.smithi164.stdout:6/242: dread d0/d3/f3a [0,4194304] 0 2024-04-20T21:58:54.083 INFO:tasks.workunit.client.1.smithi164.stdout:2/193: mkdir d2/d5/d3a 0 2024-04-20T21:58:54.087 INFO:tasks.workunit.client.1.smithi164.stdout:7/176: unlink d2/d21/c2d 0 2024-04-20T21:58:54.088 INFO:tasks.workunit.client.1.smithi164.stdout:3/219: rename d12/f14 to d12/d20/f40 0 2024-04-20T21:58:54.094 INFO:tasks.workunit.client.1.smithi164.stdout:4/215: creat d4/d9/d22/f56 x:0 0 0 2024-04-20T21:58:54.094 INFO:tasks.workunit.client.1.smithi164.stdout:6/243: symlink d0/l51 0 2024-04-20T21:58:54.097 INFO:tasks.workunit.client.1.smithi164.stdout:3/220: truncate d12/d15/f19 441192 0 2024-04-20T21:58:54.098 INFO:tasks.workunit.client.1.smithi164.stdout:0/192: dread d1/fb [0,4194304] 0 2024-04-20T21:58:54.101 INFO:tasks.workunit.client.1.smithi164.stdout:2/194: dread d2/d19/d28/f29 [0,4194304] 0 2024-04-20T21:58:54.101 INFO:tasks.workunit.client.1.smithi164.stdout:1/211: truncate d10/d16/f27 95544 0 2024-04-20T21:58:54.106 INFO:tasks.workunit.client.1.smithi164.stdout:8/191: dwrite d0/d14/d16/f26 [4194304,4194304] 0 2024-04-20T21:58:54.121 INFO:tasks.workunit.client.1.smithi164.stdout:5/209: dwrite dc/f1a [0,4194304] 0 2024-04-20T21:58:54.126 INFO:tasks.workunit.client.1.smithi164.stdout:2/195: read d2/d5/f22 [724427,1701] 0 2024-04-20T21:58:54.134 INFO:tasks.workunit.client.1.smithi164.stdout:9/229: dwrite d3/db/f38 [0,4194304] 0 2024-04-20T21:58:54.134 INFO:tasks.workunit.client.1.smithi164.stdout:7/177: mkdir d2/d21/d24/d31/d3a 0 2024-04-20T21:58:54.138 INFO:tasks.workunit.client.1.smithi164.stdout:6/244: creat d0/f52 x:0 0 0 2024-04-20T21:58:54.141 INFO:tasks.workunit.client.1.smithi164.stdout:2/196: readlink d2/d19/l1f 0 2024-04-20T21:58:54.146 INFO:tasks.workunit.client.1.smithi164.stdout:9/230: fdatasync d3/f9 0 2024-04-20T21:58:54.158 INFO:tasks.workunit.client.1.smithi164.stdout:6/245: dread - d0/d3/d15/d23/d3b/f42 zero size 2024-04-20T21:58:54.158 INFO:tasks.workunit.client.1.smithi164.stdout:7/178: creat d2/d21/f3b x:0 0 0 2024-04-20T21:58:54.159 INFO:tasks.workunit.client.1.smithi164.stdout:0/193: dread d1/f12 [0,4194304] 0 2024-04-20T21:58:54.168 INFO:tasks.workunit.client.1.smithi164.stdout:4/216: dwrite d4/d9/f14 [0,4194304] 0 2024-04-20T21:58:54.170 INFO:tasks.workunit.client.1.smithi164.stdout:5/210: rename dc/d2b/f3c to dc/d2c/d2e/f46 0 2024-04-20T21:58:54.173 INFO:tasks.workunit.client.1.smithi164.stdout:1/212: dwrite d10/d16/d20/d25/f39 [0,4194304] 0 2024-04-20T21:58:54.174 INFO:tasks.workunit.client.1.smithi164.stdout:9/231: dread - d3/db/dd/d40/d2a/f4a zero size 2024-04-20T21:58:54.175 INFO:tasks.workunit.client.1.smithi164.stdout:6/246: stat d0/d3/d11/d29/f46 0 2024-04-20T21:58:54.177 INFO:tasks.workunit.client.1.smithi164.stdout:3/221: dwrite f6 [0,4194304] 0 2024-04-20T21:58:54.232 INFO:tasks.workunit.client.1.smithi164.stdout:9/232: creat d3/db/d1b/d20/d3f/f4e x:0 0 0 2024-04-20T21:58:54.233 INFO:tasks.workunit.client.1.smithi164.stdout:5/211: write dc/d12/f17 [721062,31761] 0 2024-04-20T21:58:54.234 INFO:tasks.workunit.client.1.smithi164.stdout:6/247: dread - d0/d3/d15/d23/d3b/f42 zero size 2024-04-20T21:58:54.235 INFO:tasks.workunit.client.1.smithi164.stdout:7/179: getdents d2 0 2024-04-20T21:58:54.236 INFO:tasks.workunit.client.1.smithi164.stdout:4/217: truncate d4/d9/d27/f48 162397 0 2024-04-20T21:58:54.237 INFO:tasks.workunit.client.1.smithi164.stdout:3/222: symlink d12/d15/l41 0 2024-04-20T21:58:54.239 INFO:tasks.workunit.client.1.smithi164.stdout:9/233: mkdir d3/db/d4f 0 2024-04-20T21:58:54.239 INFO:tasks.workunit.client.1.smithi164.stdout:4/218: readlink d4/d9/l30 0 2024-04-20T21:58:54.241 INFO:tasks.workunit.client.1.smithi164.stdout:1/213: write d10/f15 [816003,93159] 0 2024-04-20T21:58:54.241 INFO:tasks.workunit.client.1.smithi164.stdout:4/219: fdatasync d4/d9/d27/f32 0 2024-04-20T21:58:54.243 INFO:tasks.workunit.client.1.smithi164.stdout:6/248: fdatasync d0/f25 0 2024-04-20T21:58:54.244 INFO:tasks.workunit.client.1.smithi164.stdout:3/223: write f11 [78636,89102] 0 2024-04-20T21:58:54.244 INFO:tasks.workunit.client.1.smithi164.stdout:1/214: stat d10/f15 0 2024-04-20T21:58:54.248 INFO:tasks.workunit.client.1.smithi164.stdout:4/220: chown d4/d9/d27/c31 113524718 1 2024-04-20T21:58:54.248 INFO:tasks.workunit.client.1.smithi164.stdout:5/212: dread f5 [0,4194304] 0 2024-04-20T21:58:54.248 INFO:tasks.workunit.client.1.smithi164.stdout:4/221: dread - d4/d9/d27/f29 zero size 2024-04-20T21:58:54.250 INFO:tasks.workunit.client.1.smithi164.stdout:3/224: fsync d12/f1e 0 2024-04-20T21:58:54.251 INFO:tasks.workunit.client.1.smithi164.stdout:6/249: mknod d0/d3/d15/d23/d45/c53 0 2024-04-20T21:58:54.252 INFO:tasks.workunit.client.1.smithi164.stdout:4/222: stat d4/d28/d3e/f53 0 2024-04-20T21:58:54.254 INFO:tasks.workunit.client.1.smithi164.stdout:5/213: write dc/d12/f15 [339372,120925] 0 2024-04-20T21:58:54.257 INFO:tasks.workunit.client.1.smithi164.stdout:3/225: creat d12/d2a/f42 x:0 0 0 2024-04-20T21:58:54.259 INFO:tasks.workunit.client.1.smithi164.stdout:6/250: mknod d0/c54 0 2024-04-20T21:58:54.264 INFO:tasks.workunit.client.1.smithi164.stdout:9/234: stat d3/db/dd/d40/d2a/l33 0 2024-04-20T21:58:54.269 INFO:tasks.workunit.client.1.smithi164.stdout:7/180: dwrite d2/ff [0,4194304] 0 2024-04-20T21:58:54.274 INFO:tasks.workunit.client.1.smithi164.stdout:7/181: chown d2/d21/d33 4 1 2024-04-20T21:58:54.275 INFO:tasks.workunit.client.1.smithi164.stdout:9/235: fsync d3/db/d1b/d20/d3f/f4e 0 2024-04-20T21:58:54.276 INFO:tasks.workunit.client.1.smithi164.stdout:2/197: dread d2/fa [0,4194304] 0 2024-04-20T21:58:54.277 INFO:tasks.workunit.client.1.smithi164.stdout:3/226: dread d12/d20/f2b [0,4194304] 0 2024-04-20T21:58:54.278 INFO:tasks.workunit.client.1.smithi164.stdout:7/182: write d2/d21/d24/f30 [263919,40530] 0 2024-04-20T21:58:54.280 INFO:tasks.workunit.client.1.smithi164.stdout:5/214: creat dc/d2c/d2e/f47 x:0 0 0 2024-04-20T21:58:54.280 INFO:tasks.workunit.client.1.smithi164.stdout:3/227: read f11 [279104,117313] 0 2024-04-20T21:58:54.282 INFO:tasks.workunit.client.1.smithi164.stdout:8/192: sync 2024-04-20T21:58:54.283 INFO:tasks.workunit.client.1.smithi164.stdout:2/198: stat d2/f12 0 2024-04-20T21:58:54.291 INFO:tasks.workunit.client.1.smithi164.stdout:9/236: creat d3/db/dd/d40/d2a/d36/f50 x:0 0 0 2024-04-20T21:58:54.291 INFO:tasks.workunit.client.1.smithi164.stdout:5/215: rename dc/d2c to dc/d2c/d48 22 2024-04-20T21:58:54.292 INFO:tasks.workunit.client.1.smithi164.stdout:8/193: write d0/d14/f18 [578319,20413] 0 2024-04-20T21:58:54.294 INFO:tasks.workunit.client.1.smithi164.stdout:3/228: symlink d12/d2a/l43 0 2024-04-20T21:58:54.295 INFO:tasks.workunit.client.1.smithi164.stdout:8/194: readlink d0/l3c 0 2024-04-20T21:58:54.296 INFO:tasks.workunit.client.1.smithi164.stdout:4/223: dread d4/d9/f1b [0,4194304] 0 2024-04-20T21:58:54.298 INFO:tasks.workunit.client.1.smithi164.stdout:1/215: dwrite d10/d16/f27 [0,4194304] 0 2024-04-20T21:58:54.300 INFO:tasks.workunit.client.1.smithi164.stdout:8/195: fsync d0/d1e/f43 0 2024-04-20T21:58:54.300 INFO:tasks.workunit.client.1.smithi164.stdout:5/216: dread dc/d12/f13 [0,4194304] 0 2024-04-20T21:58:54.301 INFO:tasks.workunit.client.1.smithi164.stdout:9/237: mkdir d3/db/dd/d40/d2a/d36/d51 0 2024-04-20T21:58:54.306 INFO:tasks.workunit.client.1.smithi164.stdout:9/238: readlink d3/l5 0 2024-04-20T21:58:54.306 INFO:tasks.workunit.client.1.smithi164.stdout:1/216: chown d10 25 1 2024-04-20T21:58:54.309 INFO:tasks.workunit.client.1.smithi164.stdout:4/224: creat d4/d9/d42/f57 x:0 0 0 2024-04-20T21:58:54.312 INFO:tasks.workunit.client.1.smithi164.stdout:7/183: dwrite d2/f15 [0,4194304] 0 2024-04-20T21:58:54.314 INFO:tasks.workunit.client.1.smithi164.stdout:9/239: write d3/db/dd/d40/d2a/d36/f50 [421589,48630] 0 2024-04-20T21:58:54.314 INFO:tasks.workunit.client.1.smithi164.stdout:5/217: fsync dc/d2b/f3b 0 2024-04-20T21:58:54.316 INFO:tasks.workunit.client.1.smithi164.stdout:3/229: rename d12/f18 to d12/d20/d39/f44 0 2024-04-20T21:58:54.316 INFO:tasks.workunit.client.1.smithi164.stdout:3/230: chown d12 41637432 1 2024-04-20T21:58:54.317 INFO:tasks.workunit.client.1.smithi164.stdout:2/199: dread d2/d5/f1d [0,4194304] 0 2024-04-20T21:58:54.319 INFO:tasks.workunit.client.1.smithi164.stdout:4/225: creat d4/d28/f58 x:0 0 0 2024-04-20T21:58:54.319 INFO:tasks.workunit.client.1.smithi164.stdout:3/231: stat d12/d20/d39 0 2024-04-20T21:58:54.321 INFO:tasks.workunit.client.1.smithi164.stdout:8/196: creat d0/f48 x:0 0 0 2024-04-20T21:58:54.322 INFO:tasks.workunit.client.1.smithi164.stdout:7/184: creat d2/f3c x:0 0 0 2024-04-20T21:58:54.323 INFO:tasks.workunit.client.1.smithi164.stdout:0/194: sync 2024-04-20T21:58:54.324 INFO:tasks.workunit.client.1.smithi164.stdout:9/240: write d3/db/dd/f45 [15246,123616] 0 2024-04-20T21:58:54.325 INFO:tasks.workunit.client.1.smithi164.stdout:2/200: stat d2/f9 0 2024-04-20T21:58:54.327 INFO:tasks.workunit.client.1.smithi164.stdout:6/251: dread d0/d3/d15/f32 [0,4194304] 0 2024-04-20T21:58:54.327 INFO:tasks.workunit.client.1.smithi164.stdout:2/201: readlink d2/d5/lb 0 2024-04-20T21:58:54.331 INFO:tasks.workunit.client.1.smithi164.stdout:9/241: fdatasync d3/db/d1b/d20/d3f/f4e 0 2024-04-20T21:58:54.333 INFO:tasks.workunit.client.1.smithi164.stdout:5/218: rename dc/d12/c1c to dc/c49 0 2024-04-20T21:58:54.334 INFO:tasks.workunit.client.1.smithi164.stdout:7/185: dread - d2/d21/f23 zero size 2024-04-20T21:58:54.341 INFO:tasks.workunit.client.1.smithi164.stdout:8/197: chown d0/d14/d16/l38 9349 1 2024-04-20T21:58:54.343 INFO:tasks.workunit.client.1.smithi164.stdout:8/198: readlink d0/d1e/l2c 0 2024-04-20T21:58:54.347 INFO:tasks.workunit.client.1.smithi164.stdout:1/217: dwrite d10/d16/d20/f28 [0,4194304] 0 2024-04-20T21:58:54.349 INFO:tasks.workunit.client.1.smithi164.stdout:2/202: dread - d2/d19/d28/f38 zero size 2024-04-20T21:58:54.350 INFO:tasks.workunit.client.1.smithi164.stdout:4/226: getdents d4/d9/d27 0 2024-04-20T21:58:54.354 INFO:tasks.workunit.client.1.smithi164.stdout:4/227: readlink d4/d9/d27/l2e 0 2024-04-20T21:58:54.354 INFO:tasks.workunit.client.1.smithi164.stdout:3/232: link d12/d15/c35 d12/d20/c45 0 2024-04-20T21:58:54.354 INFO:tasks.workunit.client.1.smithi164.stdout:7/186: write d2/f5 [1498788,15359] 0 2024-04-20T21:58:54.355 INFO:tasks.workunit.client.1.smithi164.stdout:8/199: unlink d0/d14/c30 0 2024-04-20T21:58:54.357 INFO:tasks.workunit.client.1.smithi164.stdout:3/233: dread - d12/d15/f2f zero size 2024-04-20T21:58:54.361 INFO:tasks.workunit.client.1.smithi164.stdout:8/200: chown d0/l41 50 1 2024-04-20T21:58:54.361 INFO:tasks.workunit.client.1.smithi164.stdout:9/242: creat d3/db/f52 x:0 0 0 2024-04-20T21:58:54.365 INFO:tasks.workunit.client.1.smithi164.stdout:5/219: symlink dc/d41/l4a 0 2024-04-20T21:58:54.366 INFO:tasks.workunit.client.1.smithi164.stdout:1/218: mkdir d10/d33/d48 0 2024-04-20T21:58:54.367 INFO:tasks.workunit.client.1.smithi164.stdout:3/234: unlink d12/l1d 0 2024-04-20T21:58:54.372 INFO:tasks.workunit.client.1.smithi164.stdout:2/203: write d2/fa [2522602,16944] 0 2024-04-20T21:58:54.377 INFO:tasks.workunit.client.1.smithi164.stdout:8/201: fsync d0/d14/f37 0 2024-04-20T21:58:54.377 INFO:tasks.workunit.client.1.smithi164.stdout:2/204: stat d2/d19/c1e 0 2024-04-20T21:58:54.378 INFO:tasks.workunit.client.1.smithi164.stdout:3/235: write f10 [422732,121595] 0 2024-04-20T21:58:54.378 INFO:tasks.workunit.client.1.smithi164.stdout:0/195: dwrite d1/d4/da/f2e [0,4194304] 0 2024-04-20T21:58:54.380 INFO:tasks.workunit.client.1.smithi164.stdout:7/187: creat d2/d21/d24/d31/d3a/f3d x:0 0 0 2024-04-20T21:58:54.388 INFO:tasks.workunit.client.1.smithi164.stdout:6/252: dread d0/d3/d15/f32 [0,4194304] 0 2024-04-20T21:58:54.388 INFO:tasks.workunit.client.1.smithi164.stdout:0/196: readlink d1/d4/da/d1f/l30 0 2024-04-20T21:58:54.388 INFO:tasks.workunit.client.1.smithi164.stdout:2/205: read d2/d19/d28/f2a [25790,129796] 0 2024-04-20T21:58:54.392 INFO:tasks.workunit.client.1.smithi164.stdout:9/243: symlink d3/db/dd/d40/d2a/d36/l53 0 2024-04-20T21:58:54.396 INFO:tasks.workunit.client.1.smithi164.stdout:5/220: creat dc/d2c/d2e/f4b x:0 0 0 2024-04-20T21:58:54.398 INFO:tasks.workunit.client.1.smithi164.stdout:3/236: dread d12/d20/f22 [0,4194304] 0 2024-04-20T21:58:54.401 INFO:tasks.workunit.client.1.smithi164.stdout:5/221: write dc/d12/f17 [953239,8930] 0 2024-04-20T21:58:54.402 INFO:tasks.workunit.client.1.smithi164.stdout:7/188: mknod d2/d21/d24/d31/d3a/c3e 0 2024-04-20T21:58:54.404 INFO:tasks.workunit.client.1.smithi164.stdout:1/219: dwrite d10/f14 [0,4194304] 0 2024-04-20T21:58:54.404 INFO:tasks.workunit.client.1.smithi164.stdout:9/244: unlink d3/db/dd/f4c 0 2024-04-20T21:58:54.416 INFO:tasks.workunit.client.1.smithi164.stdout:9/245: mknod d3/db/dd/d40/c54 0 2024-04-20T21:58:54.419 INFO:tasks.workunit.client.1.smithi164.stdout:7/189: symlink d2/d21/d24/d31/d3a/l3f 0 2024-04-20T21:58:54.423 INFO:tasks.workunit.client.1.smithi164.stdout:2/206: dwrite d2/f20 [0,4194304] 0 2024-04-20T21:58:54.426 INFO:tasks.workunit.client.1.smithi164.stdout:4/228: truncate d4/d9/f1b 3052666 0 2024-04-20T21:58:54.427 INFO:tasks.workunit.client.1.smithi164.stdout:2/207: stat d2/c4 0 2024-04-20T21:58:54.435 INFO:tasks.workunit.client.1.smithi164.stdout:5/222: dwrite dc/d2b/f3b [4194304,4194304] 0 2024-04-20T21:58:54.440 INFO:tasks.workunit.client.1.smithi164.stdout:2/208: creat d2/d5/d3a/f3b x:0 0 0 2024-04-20T21:58:54.442 INFO:tasks.workunit.client.1.smithi164.stdout:5/223: write dc/f1a [2037074,65002] 0 2024-04-20T21:58:54.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:54 smithi164 ceph-mon[23506]: pgmap v4: 65 pgs: 65 active+clean; 2.4 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail 2024-04-20T21:58:54.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:54 smithi164 ceph-mon[23506]: mgrmap e28: smithi142.zzmcfz(active, since 3s) 2024-04-20T21:58:54.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:54 smithi142 ceph-mon[15828]: pgmap v4: 65 pgs: 65 active+clean; 2.4 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail 2024-04-20T21:58:54.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:54 smithi142 ceph-mon[15828]: mgrmap e28: smithi142.zzmcfz(active, since 3s) 2024-04-20T21:58:54.450 INFO:tasks.workunit.client.1.smithi164.stdout:9/246: dread d3/db/d1b/f3c [4194304,4194304] 0 2024-04-20T21:58:54.450 INFO:tasks.workunit.client.1.smithi164.stdout:5/224: mknod dc/d2c/c4c 0 2024-04-20T21:58:54.457 INFO:tasks.workunit.client.1.smithi164.stdout:9/247: dread d3/fa [0,4194304] 0 2024-04-20T21:58:54.458 INFO:tasks.workunit.client.1.smithi164.stdout:5/225: unlink dc/d12/d1e/f28 0 2024-04-20T21:58:54.460 INFO:tasks.workunit.client.1.smithi164.stdout:4/229: dwrite d4/d28/f44 [0,4194304] 0 2024-04-20T21:58:54.462 INFO:tasks.workunit.client.1.smithi164.stdout:4/230: dread - d4/f4e zero size 2024-04-20T21:58:54.463 INFO:tasks.workunit.client.1.smithi164.stdout:3/237: sync 2024-04-20T21:58:54.463 INFO:tasks.workunit.client.1.smithi164.stdout:0/197: sync 2024-04-20T21:58:54.463 INFO:tasks.workunit.client.1.smithi164.stdout:8/202: sync 2024-04-20T21:58:54.464 INFO:tasks.workunit.client.1.smithi164.stdout:2/209: rename d2/d19/f39 to d2/f3c 0 2024-04-20T21:58:54.465 INFO:tasks.workunit.client.1.smithi164.stdout:4/231: stat d4/d9/d27/f32 0 2024-04-20T21:58:54.466 INFO:tasks.workunit.client.1.smithi164.stdout:2/210: read d2/f1b [361620,68877] 0 2024-04-20T21:58:54.468 INFO:tasks.workunit.client.1.smithi164.stdout:4/232: truncate d4/d28/d3e/f53 18566 0 2024-04-20T21:58:54.469 INFO:tasks.workunit.client.1.smithi164.stdout:6/253: truncate d0/d3/f1b 3262800 0 2024-04-20T21:58:54.470 INFO:tasks.workunit.client.1.smithi164.stdout:5/226: creat dc/d12/f4d x:0 0 0 2024-04-20T21:58:54.472 INFO:tasks.workunit.client.1.smithi164.stdout:5/227: chown dc/d12/d1e/f45 5 1 2024-04-20T21:58:54.473 INFO:tasks.workunit.client.1.smithi164.stdout:0/198: mkdir d1/d4/da/d27/d33 0 2024-04-20T21:58:54.473 INFO:tasks.workunit.client.1.smithi164.stdout:5/228: fdatasync dc/d12/f17 0 2024-04-20T21:58:54.478 INFO:tasks.workunit.client.1.smithi164.stdout:8/203: unlink d0/d1e/c35 0 2024-04-20T21:58:54.480 INFO:tasks.workunit.client.1.smithi164.stdout:1/220: write f0 [3268178,28929] 0 2024-04-20T21:58:54.481 INFO:tasks.workunit.client.1.smithi164.stdout:6/254: creat d0/d3/d4a/f55 x:0 0 0 2024-04-20T21:58:54.490 INFO:tasks.workunit.client.1.smithi164.stdout:5/229: unlink dc/l2a 0 2024-04-20T21:58:54.490 INFO:tasks.workunit.client.1.smithi164.stdout:7/190: truncate d2/d21/f25 532205 0 2024-04-20T21:58:54.491 INFO:tasks.workunit.client.1.smithi164.stdout:7/191: readlink d2/l19 0 2024-04-20T21:58:54.498 INFO:tasks.workunit.client.1.smithi164.stdout:6/255: dwrite d0/d3/d11/d29/f4d [0,4194304] 0 2024-04-20T21:58:54.499 INFO:tasks.workunit.client.1.smithi164.stdout:0/199: symlink d1/d4/d20/l34 0 2024-04-20T21:58:54.500 INFO:tasks.workunit.client.1.smithi164.stdout:5/230: mkdir dc/d41/d4e 0 2024-04-20T21:58:54.506 INFO:tasks.workunit.client.1.smithi164.stdout:8/204: mknod d0/c49 0 2024-04-20T21:58:54.512 INFO:tasks.workunit.client.1.smithi164.stdout:7/192: dwrite d2/f7 [0,4194304] 0 2024-04-20T21:58:54.513 INFO:tasks.workunit.client.1.smithi164.stdout:9/248: truncate d3/db/dd/f23 348988 0 2024-04-20T21:58:54.519 INFO:tasks.workunit.client.1.smithi164.stdout:3/238: getdents d12/d15 0 2024-04-20T21:58:54.523 INFO:tasks.workunit.client.1.smithi164.stdout:2/211: getdents d2/d5/d3a 0 2024-04-20T21:58:54.525 INFO:tasks.workunit.client.1.smithi164.stdout:1/221: write f7 [2051780,32756] 0 2024-04-20T21:58:54.526 INFO:tasks.workunit.client.1.smithi164.stdout:7/193: creat d2/d21/d33/f40 x:0 0 0 2024-04-20T21:58:54.529 INFO:tasks.workunit.client.1.smithi164.stdout:9/249: symlink d3/db/dd/d40/d2a/l55 0 2024-04-20T21:58:54.530 INFO:tasks.workunit.client.1.smithi164.stdout:0/200: creat d1/d4/da/d27/d33/f35 x:0 0 0 2024-04-20T21:58:54.533 INFO:tasks.workunit.client.1.smithi164.stdout:3/239: creat d12/d20/d39/f46 x:0 0 0 2024-04-20T21:58:54.538 INFO:tasks.workunit.client.1.smithi164.stdout:8/205: symlink d0/d14/l4a 0 2024-04-20T21:58:54.538 INFO:tasks.workunit.client.1.smithi164.stdout:6/256: creat d0/d3/f56 x:0 0 0 2024-04-20T21:58:54.540 INFO:tasks.workunit.client.1.smithi164.stdout:2/212: rename d2/d5/d21/c31 to d2/d19/c3d 0 2024-04-20T21:58:54.542 INFO:tasks.workunit.client.1.smithi164.stdout:6/257: write d0/d3/d4a/f55 [185815,128395] 0 2024-04-20T21:58:54.544 INFO:tasks.workunit.client.1.smithi164.stdout:7/194: creat d2/d21/d24/d31/f41 x:0 0 0 2024-04-20T21:58:54.547 INFO:tasks.workunit.client.1.smithi164.stdout:9/250: creat d3/db/dd/d40/f56 x:0 0 0 2024-04-20T21:58:54.549 INFO:tasks.workunit.client.1.smithi164.stdout:7/195: chown d2/ff 8021900 1 2024-04-20T21:58:54.549 INFO:tasks.workunit.client.1.smithi164.stdout:2/213: chown d2/d5/d21/f37 24982 1 2024-04-20T21:58:54.549 INFO:tasks.workunit.client.1.smithi164.stdout:9/251: stat d3/db/dd/f45 0 2024-04-20T21:58:54.553 INFO:tasks.workunit.client.1.smithi164.stdout:5/231: getdents dc 0 2024-04-20T21:58:54.554 INFO:tasks.workunit.client.1.smithi164.stdout:4/233: sync 2024-04-20T21:58:54.554 INFO:tasks.workunit.client.1.smithi164.stdout:9/252: dread - d3/db/d1b/d1e/f4b zero size 2024-04-20T21:58:54.558 INFO:tasks.workunit.client.1.smithi164.stdout:0/201: link d1/d4/da/f2e d1/d4/d26/f36 0 2024-04-20T21:58:54.559 INFO:tasks.workunit.client.1.smithi164.stdout:2/214: mkdir d2/d19/d28/d3e 0 2024-04-20T21:58:54.562 INFO:tasks.workunit.client.1.smithi164.stdout:3/240: dwrite d12/f32 [0,4194304] 0 2024-04-20T21:58:54.562 INFO:tasks.workunit.client.1.smithi164.stdout:8/206: write d0/d14/fa [5081910,31371] 0 2024-04-20T21:58:54.563 INFO:tasks.workunit.client.1.smithi164.stdout:3/241: chown d12/d2a/f42 1 1 2024-04-20T21:58:54.566 INFO:tasks.workunit.client.1.smithi164.stdout:8/207: write d0/d14/f37 [794584,123430] 0 2024-04-20T21:58:54.566 INFO:tasks.workunit.client.1.smithi164.stdout:3/242: stat d12/d20/d39/c3b 0 2024-04-20T21:58:54.570 INFO:tasks.workunit.client.1.smithi164.stdout:1/222: rmdir d10/d16/d3c 0 2024-04-20T21:58:54.573 INFO:tasks.workunit.client.1.smithi164.stdout:1/223: write d10/d16/f27 [588454,99154] 0 2024-04-20T21:58:54.574 INFO:tasks.workunit.client.1.smithi164.stdout:9/253: symlink d3/db/d1b/d1e/l57 0 2024-04-20T21:58:54.577 INFO:tasks.workunit.client.1.smithi164.stdout:5/232: rename dc/d2c/d2e/f4b to dc/d2c/f4f 0 2024-04-20T21:58:54.578 INFO:tasks.workunit.client.1.smithi164.stdout:5/233: stat f7 0 2024-04-20T21:58:54.579 INFO:tasks.workunit.client.1.smithi164.stdout:5/234: chown dc/d2c/l40 32822818 1 2024-04-20T21:58:54.581 INFO:tasks.workunit.client.1.smithi164.stdout:0/202: rmdir d1/d4/da/d27 39 2024-04-20T21:58:54.582 INFO:tasks.workunit.client.1.smithi164.stdout:2/215: mknod d2/d5/c3f 0 2024-04-20T21:58:54.584 INFO:tasks.workunit.client.1.smithi164.stdout:2/216: write d2/fa [3124697,90012] 0 2024-04-20T21:58:54.590 INFO:tasks.workunit.client.1.smithi164.stdout:7/196: truncate d2/f1b 1565818 0 2024-04-20T21:58:54.592 INFO:tasks.workunit.client.1.smithi164.stdout:1/224: unlink d10/d16/d20/f30 0 2024-04-20T21:58:54.593 INFO:tasks.workunit.client.1.smithi164.stdout:5/235: creat dc/d41/f50 x:0 0 0 2024-04-20T21:58:54.598 INFO:tasks.workunit.client.1.smithi164.stdout:6/258: write d0/d3/d15/f32 [478661,18310] 0 2024-04-20T21:58:54.598 INFO:tasks.workunit.client.1.smithi164.stdout:2/217: readlink d2/l2e 0 2024-04-20T21:58:54.600 INFO:tasks.workunit.client.1.smithi164.stdout:3/243: link d12/d20/d39/f44 d12/d15/f47 0 2024-04-20T21:58:54.601 INFO:tasks.workunit.client.1.smithi164.stdout:6/259: readlink d0/d3/d8/l1e 0 2024-04-20T21:58:54.602 INFO:tasks.workunit.client.1.smithi164.stdout:3/244: readlink d12/l25 0 2024-04-20T21:58:54.605 INFO:tasks.workunit.client.1.smithi164.stdout:9/254: symlink d3/l58 0 2024-04-20T21:58:54.609 INFO:tasks.workunit.client.1.smithi164.stdout:1/225: symlink d10/d16/d20/d25/l49 0 2024-04-20T21:58:54.615 INFO:tasks.workunit.client.1.smithi164.stdout:8/208: creat d0/f4b x:0 0 0 2024-04-20T21:58:54.615 INFO:tasks.workunit.client.1.smithi164.stdout:2/218: creat d2/d19/d28/f40 x:0 0 0 2024-04-20T21:58:54.617 INFO:tasks.workunit.client.1.smithi164.stdout:9/255: chown d3/db/dd/d40/d2a/f4a 3 1 2024-04-20T21:58:54.620 INFO:tasks.workunit.client.1.smithi164.stdout:1/226: symlink d10/d16/d19/d1a/l4a 0 2024-04-20T21:58:54.627 INFO:tasks.workunit.client.1.smithi164.stdout:3/245: creat d12/d20/f48 x:0 0 0 2024-04-20T21:58:54.631 INFO:tasks.workunit.client.1.smithi164.stdout:0/203: dwrite d1/fb [0,4194304] 0 2024-04-20T21:58:54.635 INFO:tasks.workunit.client.1.smithi164.stdout:6/260: dread d0/d3/d11/d29/f4d [0,4194304] 0 2024-04-20T21:58:54.638 INFO:tasks.workunit.client.1.smithi164.stdout:6/261: fsync d0/d3/d8/d28/f33 0 2024-04-20T21:58:54.639 INFO:tasks.workunit.client.1.smithi164.stdout:4/234: sync 2024-04-20T21:58:54.640 INFO:tasks.workunit.client.1.smithi164.stdout:9/256: creat d3/db/dd/d40/d2a/f59 x:0 0 0 2024-04-20T21:58:54.641 INFO:tasks.workunit.client.1.smithi164.stdout:7/197: dread d2/f1c [0,4194304] 0 2024-04-20T21:58:54.642 INFO:tasks.workunit.client.1.smithi164.stdout:3/246: rmdir d12 39 2024-04-20T21:58:54.643 INFO:tasks.workunit.client.1.smithi164.stdout:6/262: dread - d0/d3/d15/f24 zero size 2024-04-20T21:58:54.649 INFO:tasks.workunit.client.1.smithi164.stdout:5/236: dwrite f9 [0,4194304] 0 2024-04-20T21:58:54.649 INFO:tasks.workunit.client.1.smithi164.stdout:7/198: fsync d2/d21/d33/f38 0 2024-04-20T21:58:54.658 INFO:tasks.workunit.client.1.smithi164.stdout:3/247: symlink d12/d15/l49 0 2024-04-20T21:58:54.661 INFO:tasks.workunit.client.1.smithi164.stdout:9/257: symlink d3/db/l5a 0 2024-04-20T21:58:54.663 INFO:tasks.workunit.client.1.smithi164.stdout:6/263: creat d0/d3/d15/d23/d3b/f57 x:0 0 0 2024-04-20T21:58:54.669 INFO:tasks.workunit.client.1.smithi164.stdout:7/199: creat d2/d21/d24/d31/d3a/f42 x:0 0 0 2024-04-20T21:58:54.672 INFO:tasks.workunit.client.1.smithi164.stdout:8/209: dread d0/f3 [0,4194304] 0 2024-04-20T21:58:54.673 INFO:tasks.workunit.client.1.smithi164.stdout:2/219: dwrite d2/d5/d3a/f3b [0,4194304] 0 2024-04-20T21:58:54.674 INFO:tasks.workunit.client.1.smithi164.stdout:0/204: truncate d1/d4/f2c 409087 0 2024-04-20T21:58:54.677 INFO:tasks.workunit.client.1.smithi164.stdout:4/235: dread d4/d9/f14 [0,4194304] 0 2024-04-20T21:58:54.679 INFO:tasks.workunit.client.1.smithi164.stdout:8/210: rmdir d0 39 2024-04-20T21:58:54.680 INFO:tasks.workunit.client.1.smithi164.stdout:7/200: rmdir d2/d21/d24 39 2024-04-20T21:58:54.681 INFO:tasks.workunit.client.1.smithi164.stdout:6/264: write d0/d3/d8/d28/f33 [356068,19398] 0 2024-04-20T21:58:54.687 INFO:tasks.workunit.client.1.smithi164.stdout:1/227: dwrite d10/d16/d20/d25/f2e [0,4194304] 0 2024-04-20T21:58:54.688 INFO:tasks.workunit.client.1.smithi164.stdout:2/220: write d2/d5/fd [5230080,8325] 0 2024-04-20T21:58:54.690 INFO:tasks.workunit.client.1.smithi164.stdout:0/205: mknod d1/d4/d26/c37 0 2024-04-20T21:58:54.693 INFO:tasks.workunit.client.1.smithi164.stdout:9/258: rename d3/db/d1b/f3c to d3/db/f5b 0 2024-04-20T21:58:54.698 INFO:tasks.workunit.client.1.smithi164.stdout:1/228: unlink l6 0 2024-04-20T21:58:54.699 INFO:tasks.workunit.client.1.smithi164.stdout:6/265: write d0/d3/d11/d29/f46 [893926,30188] 0 2024-04-20T21:58:54.701 INFO:tasks.workunit.client.1.smithi164.stdout:8/211: read d0/d1e/f44 [253729,8731] 0 2024-04-20T21:58:54.703 INFO:tasks.workunit.client.1.smithi164.stdout:2/221: mknod d2/d5/d3a/c41 0 2024-04-20T21:58:54.704 INFO:tasks.workunit.client.1.smithi164.stdout:7/201: chown d2/f1b 265521 1 2024-04-20T21:58:54.707 INFO:tasks.workunit.client.1.smithi164.stdout:5/237: dwrite dc/d12/f17 [0,4194304] 0 2024-04-20T21:58:54.711 INFO:tasks.workunit.client.1.smithi164.stdout:0/206: symlink d1/d4/d20/l38 0 2024-04-20T21:58:54.712 INFO:tasks.workunit.client.1.smithi164.stdout:3/248: dwrite f10 [0,4194304] 0 2024-04-20T21:58:54.713 INFO:tasks.workunit.client.1.smithi164.stdout:2/222: chown d2/l17 59959 1 2024-04-20T21:58:54.714 INFO:tasks.workunit.client.1.smithi164.stdout:6/266: symlink d0/d3/d27/l58 0 2024-04-20T21:58:54.715 INFO:tasks.workunit.client.1.smithi164.stdout:9/259: dread d3/db/dd/d40/d2a/d36/f50 [0,4194304] 0 2024-04-20T21:58:54.716 INFO:tasks.workunit.client.1.smithi164.stdout:4/236: creat d4/d28/d3e/f59 x:0 0 0 2024-04-20T21:58:54.716 INFO:tasks.workunit.client.1.smithi164.stdout:1/229: write d10/d16/f43 [286398,104602] 0 2024-04-20T21:58:54.717 INFO:tasks.workunit.client.1.smithi164.stdout:7/202: symlink d2/l43 0 2024-04-20T21:58:54.722 INFO:tasks.workunit.client.1.smithi164.stdout:6/267: fdatasync d0/d3/f1c 0 2024-04-20T21:58:54.723 INFO:tasks.workunit.client.1.smithi164.stdout:5/238: unlink dc/d2b/f37 0 2024-04-20T21:58:54.728 INFO:tasks.workunit.client.1.smithi164.stdout:3/249: mknod d12/d20/d39/c4a 0 2024-04-20T21:58:54.730 INFO:tasks.workunit.client.1.smithi164.stdout:0/207: getdents d1/d2b 0 2024-04-20T21:58:54.739 INFO:tasks.workunit.client.1.smithi164.stdout:4/237: mknod d4/d9/d27/d37/c5a 0 2024-04-20T21:58:54.739 INFO:tasks.workunit.client.1.smithi164.stdout:5/239: creat dc/d12/d1e/f51 x:0 0 0 2024-04-20T21:58:54.741 INFO:tasks.workunit.client.1.smithi164.stdout:0/208: mknod d1/d2b/c39 0 2024-04-20T21:58:54.748 INFO:tasks.workunit.client.1.smithi164.stdout:4/238: read - d4/d28/f58 zero size 2024-04-20T21:58:54.751 INFO:tasks.workunit.client.1.smithi164.stdout:1/230: dwrite d10/f11 [0,4194304] 0 2024-04-20T21:58:54.751 INFO:tasks.workunit.client.1.smithi164.stdout:0/209: fdatasync d1/d4/f28 0 2024-04-20T21:58:54.757 INFO:tasks.workunit.client.1.smithi164.stdout:5/240: mkdir dc/d2b/d52 0 2024-04-20T21:58:54.761 INFO:tasks.workunit.client.1.smithi164.stdout:7/203: truncate d2/ff 2913360 0 2024-04-20T21:58:54.772 INFO:tasks.workunit.client.1.smithi164.stdout:9/260: dwrite d3/db/f38 [0,4194304] 0 2024-04-20T21:58:54.772 INFO:tasks.workunit.client.1.smithi164.stdout:1/231: fsync d10/f14 0 2024-04-20T21:58:54.773 INFO:tasks.workunit.client.1.smithi164.stdout:2/223: dwrite d2/d19/d28/f40 [0,4194304] 0 2024-04-20T21:58:54.773 INFO:tasks.workunit.client.1.smithi164.stdout:0/210: chown d1/d4/d26/f36 791 1 2024-04-20T21:58:54.777 INFO:tasks.workunit.client.1.smithi164.stdout:7/204: mkdir d2/d21/d44 0 2024-04-20T21:58:54.779 INFO:tasks.workunit.client.1.smithi164.stdout:0/211: chown d1/f12 6474 1 2024-04-20T21:58:54.779 INFO:tasks.workunit.client.1.smithi164.stdout:6/268: dwrite d0/d3/d11/f49 [4194304,4194304] 0 2024-04-20T21:58:54.779 INFO:tasks.workunit.client.1.smithi164.stdout:9/261: dread - d3/db/d1b/d20/d3f/f4e zero size 2024-04-20T21:58:54.781 INFO:tasks.workunit.client.1.smithi164.stdout:7/205: readlink d2/l1a 0 2024-04-20T21:58:54.785 INFO:tasks.workunit.client.1.smithi164.stdout:5/241: mkdir dc/d2b/d53 0 2024-04-20T21:58:54.789 INFO:tasks.workunit.client.1.smithi164.stdout:5/242: write dc/d12/f17 [219070,60959] 0 2024-04-20T21:58:54.794 INFO:tasks.workunit.client.1.smithi164.stdout:8/212: dread d0/f24 [0,4194304] 0 2024-04-20T21:58:54.795 INFO:tasks.workunit.client.1.smithi164.stdout:4/239: truncate d4/d9/f14 306574 0 2024-04-20T21:58:54.797 INFO:tasks.workunit.client.1.smithi164.stdout:9/262: creat d3/db/d1b/d20/f5c x:0 0 0 2024-04-20T21:58:54.799 INFO:tasks.workunit.client.1.smithi164.stdout:5/243: rename dc/d12/f17 to dc/d2c/f54 0 2024-04-20T21:58:54.800 INFO:tasks.workunit.client.1.smithi164.stdout:1/232: creat d10/d33/d48/f4b x:0 0 0 2024-04-20T21:58:54.801 INFO:tasks.workunit.client.1.smithi164.stdout:5/244: chown dc/f1a 2020 1 2024-04-20T21:58:54.803 INFO:tasks.workunit.client.1.smithi164.stdout:2/224: dread d2/f20 [0,4194304] 0 2024-04-20T21:58:54.803 INFO:tasks.workunit.client.1.smithi164.stdout:4/240: unlink d4/d9/d42/f57 0 2024-04-20T21:58:54.804 INFO:tasks.workunit.client.1.smithi164.stdout:5/245: truncate f7 4448077 0 2024-04-20T21:58:54.805 INFO:tasks.workunit.client.1.smithi164.stdout:9/263: creat d3/db/dd/f5d x:0 0 0 2024-04-20T21:58:54.807 INFO:tasks.workunit.client.1.smithi164.stdout:7/206: creat d2/d21/f45 x:0 0 0 2024-04-20T21:58:54.809 INFO:tasks.workunit.client.1.smithi164.stdout:5/246: readlink dc/d12/l20 0 2024-04-20T21:58:54.810 INFO:tasks.workunit.client.1.smithi164.stdout:4/241: chown d4/d9/c18 22 1 2024-04-20T21:58:54.814 INFO:tasks.workunit.client.1.smithi164.stdout:7/207: unlink d2/l6 0 2024-04-20T21:58:54.818 INFO:tasks.workunit.client.1.smithi164.stdout:2/225: creat d2/d19/d28/d3e/f42 x:0 0 0 2024-04-20T21:58:54.820 INFO:tasks.workunit.client.1.smithi164.stdout:4/242: write d4/d9/d27/f29 [312373,117183] 0 2024-04-20T21:58:54.823 INFO:tasks.workunit.client.1.smithi164.stdout:5/247: truncate dc/d2b/f3f 1046333 0 2024-04-20T21:58:54.824 INFO:tasks.workunit.client.1.smithi164.stdout:6/269: write d0/f16 [1199853,108746] 0 2024-04-20T21:58:54.827 INFO:tasks.workunit.client.1.smithi164.stdout:2/226: stat d2/d19/d28/d3e 0 2024-04-20T21:58:54.831 INFO:tasks.workunit.client.1.smithi164.stdout:6/270: readlink d0/l17 0 2024-04-20T21:58:54.835 INFO:tasks.workunit.client.1.smithi164.stdout:5/248: write dc/d12/f18 [648165,11476] 0 2024-04-20T21:58:54.835 INFO:tasks.workunit.client.1.smithi164.stdout:8/213: dread d0/d1e/f44 [0,4194304] 0 2024-04-20T21:58:54.835 INFO:tasks.workunit.client.1.smithi164.stdout:4/243: write d4/f7 [3718239,29045] 0 2024-04-20T21:58:54.836 INFO:tasks.workunit.client.1.smithi164.stdout:1/233: dwrite d10/d33/d48/f4b [0,4194304] 0 2024-04-20T21:58:54.840 INFO:tasks.workunit.client.1.smithi164.stdout:0/212: dwrite d1/d4/f28 [0,4194304] 0 2024-04-20T21:58:54.841 INFO:tasks.workunit.client.1.smithi164.stdout:7/208: rename d2/d21/d24/d31/d3a/f42 to d2/d21/d24/d31/f46 0 2024-04-20T21:58:54.844 INFO:tasks.workunit.client.1.smithi164.stdout:7/209: chown d2/c9 6338932 1 2024-04-20T21:58:54.845 INFO:tasks.workunit.client.1.smithi164.stdout:7/210: fsync d2/d21/d24/f30 0 2024-04-20T21:58:54.849 INFO:tasks.workunit.client.1.smithi164.stdout:5/249: creat dc/d2c/d2e/d30/f55 x:0 0 0 2024-04-20T21:58:54.851 INFO:tasks.workunit.client.1.smithi164.stdout:0/213: chown d1/d4/d26/d29 11078 1 2024-04-20T21:58:54.853 INFO:tasks.workunit.client.1.smithi164.stdout:4/244: readlink d4/d28/d3e/d41/l46 0 2024-04-20T21:58:54.855 INFO:tasks.workunit.client.1.smithi164.stdout:7/211: unlink d2/d21/f2a 0 2024-04-20T21:58:54.863 INFO:tasks.workunit.client.1.smithi164.stdout:8/214: dread d0/f19 [0,4194304] 0 2024-04-20T21:58:54.864 INFO:tasks.workunit.client.1.smithi164.stdout:7/212: write d2/f15 [4462411,25986] 0 2024-04-20T21:58:54.867 INFO:tasks.workunit.client.1.smithi164.stdout:0/214: rename d1/d4/d20/l38 to d1/d4/d26/l3a 0 2024-04-20T21:58:54.867 INFO:tasks.workunit.client.1.smithi164.stdout:3/250: sync 2024-04-20T21:58:54.871 INFO:tasks.workunit.client.1.smithi164.stdout:3/251: chown d12/d15/f37 62775271 1 2024-04-20T21:58:54.875 INFO:tasks.workunit.client.1.smithi164.stdout:8/215: mknod d0/c4c 0 2024-04-20T21:58:54.879 INFO:tasks.workunit.client.1.smithi164.stdout:6/271: dwrite d0/f16 [4194304,4194304] 0 2024-04-20T21:58:54.885 INFO:tasks.workunit.client.1.smithi164.stdout:3/252: creat d12/d20/d39/f4b x:0 0 0 2024-04-20T21:58:54.886 INFO:tasks.workunit.client.1.smithi164.stdout:0/215: dread d1/d4/f2c [0,4194304] 0 2024-04-20T21:58:54.891 INFO:tasks.workunit.client.1.smithi164.stdout:9/264: dread d3/ff [0,4194304] 0 2024-04-20T21:58:54.894 INFO:tasks.workunit.client.1.smithi164.stdout:6/272: chown d0/d3/d15/d23/d45/c53 1064 1 2024-04-20T21:58:54.895 INFO:tasks.workunit.client.1.smithi164.stdout:9/265: chown d3 4269 1 2024-04-20T21:58:54.899 INFO:tasks.workunit.client.1.smithi164.stdout:5/250: dwrite f4 [0,4194304] 0 2024-04-20T21:58:54.904 INFO:tasks.workunit.client.1.smithi164.stdout:7/213: dwrite d2/d21/f45 [0,4194304] 0 2024-04-20T21:58:54.918 INFO:tasks.workunit.client.1.smithi164.stdout:4/245: link d4/d28/f44 d4/d9/d27/d37/f5b 0 2024-04-20T21:58:54.927 INFO:tasks.workunit.client.1.smithi164.stdout:9/266: dwrite d3/db/dd/d40/d2a/f4a [0,4194304] 0 2024-04-20T21:58:54.944 INFO:tasks.workunit.client.1.smithi164.stdout:4/246: dwrite d4/f1d [0,4194304] 0 2024-04-20T21:58:54.973 INFO:tasks.workunit.client.1.smithi164.stdout:3/253: mknod d12/d15/c4c 0 2024-04-20T21:58:54.978 INFO:tasks.workunit.client.1.smithi164.stdout:0/216: creat d1/d4/df/f3b x:0 0 0 2024-04-20T21:58:54.979 INFO:tasks.workunit.client.1.smithi164.stdout:6/273: chown d0/d3/cc 412 1 2024-04-20T21:58:54.982 INFO:tasks.workunit.client.1.smithi164.stdout:6/274: fsync d0/d3/f56 0 2024-04-20T21:58:54.984 INFO:tasks.workunit.client.1.smithi164.stdout:9/267: rename d3/db/dd/d40/c54 to d3/db/d1b/d1e/c5e 0 2024-04-20T21:58:54.987 INFO:tasks.workunit.client.1.smithi164.stdout:4/247: mkdir d4/d9/d5c 0 2024-04-20T21:58:54.990 INFO:tasks.workunit.client.1.smithi164.stdout:1/234: dwrite f1 [4194304,4194304] 0 2024-04-20T21:58:54.990 INFO:tasks.workunit.client.1.smithi164.stdout:0/217: mkdir d1/d4/da/d1f/d3c 0 2024-04-20T21:58:54.993 INFO:tasks.workunit.client.1.smithi164.stdout:7/214: symlink d2/d21/d44/l47 0 2024-04-20T21:58:54.996 INFO:tasks.workunit.client.1.smithi164.stdout:9/268: symlink d3/db/dd/d40/d2a/l5f 0 2024-04-20T21:58:55.001 INFO:tasks.workunit.client.1.smithi164.stdout:7/215: write d2/d21/d24/d31/f41 [1042440,103013] 0 2024-04-20T21:58:55.001 INFO:tasks.workunit.client.1.smithi164.stdout:6/275: dread d0/d3/d15/f2c [0,4194304] 0 2024-04-20T21:58:55.007 INFO:tasks.workunit.client.1.smithi164.stdout:0/218: creat d1/d4/da/d1f/d3c/f3d x:0 0 0 2024-04-20T21:58:55.007 INFO:tasks.workunit.client.1.smithi164.stdout:3/254: dwrite d12/d20/d39/f46 [0,4194304] 0 2024-04-20T21:58:55.011 INFO:tasks.workunit.client.1.smithi164.stdout:6/276: mkdir d0/d3/d8/d28/d59 0 2024-04-20T21:58:55.013 INFO:tasks.workunit.client.1.smithi164.stdout:9/269: symlink d3/db/l60 0 2024-04-20T21:58:55.014 INFO:tasks.workunit.client.1.smithi164.stdout:9/270: chown d3/f41 291069 1 2024-04-20T21:58:55.021 INFO:tasks.workunit.client.1.smithi164.stdout:9/271: creat d3/db/dd/f61 x:0 0 0 2024-04-20T21:58:55.025 INFO:tasks.workunit.client.1.smithi164.stdout:7/216: link d2/ff d2/f48 0 2024-04-20T21:58:55.026 INFO:tasks.workunit.client.1.smithi164.stdout:9/272: write d3/db/dd/fe [2089555,79382] 0 2024-04-20T21:58:55.034 INFO:tasks.workunit.client.1.smithi164.stdout:9/273: stat d3/db/d1b/d20/d3f/l47 0 2024-04-20T21:58:55.050 INFO:tasks.workunit.client.1.smithi164.stdout:3/255: dwrite d12/d2a/f3d [0,4194304] 0 2024-04-20T21:58:55.050 INFO:tasks.workunit.client.1.smithi164.stdout:6/277: dwrite d0/d3/d11/f49 [4194304,4194304] 0 2024-04-20T21:58:55.058 INFO:tasks.workunit.client.1.smithi164.stdout:6/278: mkdir d0/d3/d11/d5a 0 2024-04-20T21:58:55.062 INFO:tasks.workunit.client.1.smithi164.stdout:3/256: rename d12/d2a/f3e to d12/d2a/f4d 0 2024-04-20T21:58:55.072 INFO:tasks.workunit.client.1.smithi164.stdout:7/217: dwrite d2/d21/d24/d31/f46 [0,4194304] 0 2024-04-20T21:58:55.072 INFO:tasks.workunit.client.1.smithi164.stdout:2/227: dread d2/d5/f11 [0,4194304] 0 2024-04-20T21:58:55.074 INFO:tasks.workunit.client.1.smithi164.stdout:6/279: link d0/d3/d4a/f55 d0/d3/d15/f5b 0 2024-04-20T21:58:55.075 INFO:tasks.workunit.client.1.smithi164.stdout:9/274: dwrite d3/db/f52 [0,4194304] 0 2024-04-20T21:58:55.081 INFO:tasks.workunit.client.1.smithi164.stdout:2/228: rename d2/f9 to d2/d5/d3a/f43 0 2024-04-20T21:58:55.082 INFO:tasks.workunit.client.1.smithi164.stdout:6/280: mkdir d0/d3/d15/d21/d5c 0 2024-04-20T21:58:55.088 INFO:tasks.workunit.client.1.smithi164.stdout:9/275: creat d3/db/d4f/f62 x:0 0 0 2024-04-20T21:58:55.090 INFO:tasks.workunit.client.1.smithi164.stdout:7/218: getdents d2/d21/d24 0 2024-04-20T21:58:55.096 INFO:tasks.workunit.client.1.smithi164.stdout:6/281: mkdir d0/d3/d8/d28/d3d/d5d 0 2024-04-20T21:58:55.096 INFO:tasks.workunit.client.1.smithi164.stdout:2/229: getdents d2/d30 0 2024-04-20T21:58:55.096 INFO:tasks.workunit.client.1.smithi164.stdout:9/276: chown d3/db/dd/d40/d2a/l3d 615 1 2024-04-20T21:58:55.096 INFO:tasks.workunit.client.1.smithi164.stdout:3/257: dwrite d12/d20/f2b [0,4194304] 0 2024-04-20T21:58:55.099 INFO:tasks.workunit.client.1.smithi164.stdout:7/219: unlink d2/c9 0 2024-04-20T21:58:55.099 INFO:tasks.workunit.client.1.smithi164.stdout:6/282: creat d0/d3/d15/f5e x:0 0 0 2024-04-20T21:58:55.103 INFO:tasks.workunit.client.1.smithi164.stdout:2/230: symlink d2/d19/d28/d3e/l44 0 2024-04-20T21:58:55.112 INFO:tasks.workunit.client.1.smithi164.stdout:2/231: symlink d2/l45 0 2024-04-20T21:58:55.112 INFO:tasks.workunit.client.1.smithi164.stdout:7/220: unlink d2/d21/d44/l47 0 2024-04-20T21:58:55.123 INFO:tasks.workunit.client.1.smithi164.stdout:7/221: write d2/d21/f28 [5163196,120258] 0 2024-04-20T21:58:55.124 INFO:tasks.workunit.client.1.smithi164.stdout:2/232: link d2/d5/d21/f37 d2/f46 0 2024-04-20T21:58:55.137 INFO:tasks.workunit.client.1.smithi164.stdout:3/258: dwrite fa [4194304,4194304] 0 2024-04-20T21:58:55.138 INFO:tasks.workunit.client.1.smithi164.stdout:6/283: dwrite d0/d3/d15/d23/d3b/f42 [0,4194304] 0 2024-04-20T21:58:55.139 INFO:tasks.workunit.client.1.smithi164.stdout:7/222: creat d2/d21/d24/d31/d3a/f49 x:0 0 0 2024-04-20T21:58:55.141 INFO:tasks.workunit.client.1.smithi164.stdout:6/284: chown d0/d3/d15 36940061 1 2024-04-20T21:58:55.145 INFO:tasks.workunit.client.1.smithi164.stdout:9/277: dwrite d3/f41 [0,4194304] 0 2024-04-20T21:58:55.145 INFO:tasks.workunit.client.1.smithi164.stdout:2/233: rename d2/d5/f22 to d2/d19/d28/f47 0 2024-04-20T21:58:55.152 INFO:tasks.workunit.client.1.smithi164.stdout:9/278: chown d3/db/dd/d40/f56 30576 1 2024-04-20T21:58:55.160 INFO:tasks.workunit.client.1.smithi164.stdout:7/223: symlink d2/d21/d24/d31/l4a 0 2024-04-20T21:58:55.162 INFO:tasks.workunit.client.1.smithi164.stdout:2/234: unlink d2/d5/fd 0 2024-04-20T21:58:55.164 INFO:tasks.workunit.client.1.smithi164.stdout:6/285: mknod d0/d3/d8/d28/d3d/c5f 0 2024-04-20T21:58:55.165 INFO:tasks.workunit.client.1.smithi164.stdout:3/259: link d12/d20/d39/c4a d12/d15/c4e 0 2024-04-20T21:58:55.167 INFO:tasks.workunit.client.1.smithi164.stdout:9/279: write d3/f18 [232642,100135] 0 2024-04-20T21:58:55.169 INFO:tasks.workunit.client.1.smithi164.stdout:3/260: readlink d12/d15/l29 0 2024-04-20T21:58:55.170 INFO:tasks.workunit.client.1.smithi164.stdout:7/224: creat d2/d21/d44/f4b x:0 0 0 2024-04-20T21:58:55.175 INFO:tasks.workunit.client.1.smithi164.stdout:3/261: unlink d12/d20/l34 0 2024-04-20T21:58:55.177 INFO:tasks.workunit.client.1.smithi164.stdout:6/286: mknod d0/d3/d8/d28/d3d/c60 0 2024-04-20T21:58:55.179 INFO:tasks.workunit.client.1.smithi164.stdout:9/280: symlink d3/db/l63 0 2024-04-20T21:58:55.181 INFO:tasks.workunit.client.1.smithi164.stdout:3/262: write f11 [276271,69742] 0 2024-04-20T21:58:55.184 INFO:tasks.workunit.client.1.smithi164.stdout:6/287: mkdir d0/d3/d15/d23/d45/d4f/d61 0 2024-04-20T21:58:55.186 INFO:tasks.workunit.client.1.smithi164.stdout:2/235: link d2/d19/c36 d2/c48 0 2024-04-20T21:58:55.187 INFO:tasks.workunit.client.1.smithi164.stdout:6/288: read d0/f16 [6802986,37937] 0 2024-04-20T21:58:55.187 INFO:tasks.workunit.client.1.smithi164.stdout:9/281: creat d3/db/dd/d40/d2a/d36/f64 x:0 0 0 2024-04-20T21:58:55.189 INFO:tasks.workunit.client.1.smithi164.stdout:3/263: symlink d12/d15/l4f 0 2024-04-20T21:58:55.189 INFO:tasks.workunit.client.1.smithi164.stdout:9/282: dread - d3/f39 zero size 2024-04-20T21:58:55.192 INFO:tasks.workunit.client.1.smithi164.stdout:6/289: fsync d0/d3/d8/f38 0 2024-04-20T21:58:55.192 INFO:tasks.workunit.client.1.smithi164.stdout:3/264: mknod d12/d2a/c50 0 2024-04-20T21:58:55.194 INFO:tasks.workunit.client.1.smithi164.stdout:2/236: read d2/d5/d21/f2b [3243529,368] 0 2024-04-20T21:58:55.194 INFO:tasks.workunit.client.1.smithi164.stdout:9/283: symlink d3/db/dd/d40/d2a/l65 0 2024-04-20T21:58:55.197 INFO:tasks.workunit.client.1.smithi164.stdout:2/237: readlink d2/d5/lb 0 2024-04-20T21:58:55.197 INFO:tasks.workunit.client.1.smithi164.stdout:6/290: write d0/f25 [191552,40548] 0 2024-04-20T21:58:55.203 INFO:tasks.workunit.client.1.smithi164.stdout:2/238: stat d2 0 2024-04-20T21:58:55.206 INFO:tasks.workunit.client.1.smithi164.stdout:3/265: creat d12/f51 x:0 0 0 2024-04-20T21:58:55.207 INFO:tasks.workunit.client.1.smithi164.stdout:2/239: stat d2/d5/l10 0 2024-04-20T21:58:55.208 INFO:tasks.workunit.client.1.smithi164.stdout:3/266: fdatasync fa 0 2024-04-20T21:58:55.208 INFO:tasks.workunit.client.1.smithi164.stdout:9/284: chown d3/db/dd/d40/d2a/d36/f48 485 1 2024-04-20T21:58:55.211 INFO:tasks.workunit.client.1.smithi164.stdout:3/267: dread - d12/d15/f1b zero size 2024-04-20T21:58:55.213 INFO:tasks.workunit.client.1.smithi164.stdout:2/240: mknod d2/c49 0 2024-04-20T21:58:55.215 INFO:tasks.workunit.client.1.smithi164.stdout:3/268: unlink d12/d15/f23 0 2024-04-20T21:58:55.217 INFO:tasks.workunit.client.1.smithi164.stdout:3/269: read f10 [2500585,78885] 0 2024-04-20T21:58:55.217 INFO:tasks.workunit.client.1.smithi164.stdout:9/285: rename d3/db/dd/l2f to d3/db/dd/d40/l66 0 2024-04-20T21:58:55.222 INFO:tasks.workunit.client.1.smithi164.stdout:9/286: write d3/db/d1b/d1e/f3b [452531,28668] 0 2024-04-20T21:58:55.222 INFO:tasks.workunit.client.1.smithi164.stdout:3/270: write d12/d20/d39/f4b [804640,64264] 0 2024-04-20T21:58:55.230 INFO:tasks.workunit.client.1.smithi164.stdout:3/271: symlink d12/l52 0 2024-04-20T21:58:55.230 INFO:tasks.workunit.client.1.smithi164.stdout:3/272: stat d12/d15/f21 0 2024-04-20T21:58:55.238 INFO:tasks.workunit.client.1.smithi164.stdout:7/225: dread d2/fc [0,4194304] 0 2024-04-20T21:58:55.242 INFO:tasks.workunit.client.1.smithi164.stdout:2/241: dwrite d2/f20 [0,4194304] 0 2024-04-20T21:58:55.250 INFO:tasks.workunit.client.1.smithi164.stdout:3/273: dread f11 [0,4194304] 0 2024-04-20T21:58:55.253 INFO:tasks.workunit.client.1.smithi164.stdout:3/274: chown d12/d15/l41 709 1 2024-04-20T21:58:55.255 INFO:tasks.workunit.client.1.smithi164.stdout:3/275: dread - d12/d2a/f42 zero size 2024-04-20T21:58:55.256 INFO:tasks.workunit.client.1.smithi164.stdout:5/251: dwrite dc/d12/f13 [0,4194304] 0 2024-04-20T21:58:55.258 INFO:tasks.workunit.client.1.smithi164.stdout:3/276: creat d12/d2a/f53 x:0 0 0 2024-04-20T21:58:55.262 INFO:tasks.workunit.client.1.smithi164.stdout:3/277: chown f4 354856040 1 2024-04-20T21:58:55.262 INFO:tasks.workunit.client.1.smithi164.stdout:8/216: truncate d0/fe 146202 0 2024-04-20T21:58:55.262 INFO:tasks.workunit.client.1.smithi164.stdout:5/252: chown dc/l11 348279273 1 2024-04-20T21:58:55.262 INFO:tasks.workunit.client.1.smithi164.stdout:3/278: readlink le 0 2024-04-20T21:58:55.269 INFO:tasks.workunit.client.1.smithi164.stdout:5/253: dread dc/f25 [0,4194304] 0 2024-04-20T21:58:55.273 INFO:tasks.workunit.client.1.smithi164.stdout:7/226: dwrite d2/d21/f34 [0,4194304] 0 2024-04-20T21:58:55.273 INFO:tasks.workunit.client.1.smithi164.stdout:3/279: rename d12/d2a/f31 to d12/d20/d39/f54 0 2024-04-20T21:58:55.280 INFO:tasks.workunit.client.1.smithi164.stdout:5/254: chown dc/d2b/c2d 0 1 2024-04-20T21:58:55.286 INFO:tasks.workunit.client.1.smithi164.stdout:5/255: write dc/d12/f4d [400133,58029] 0 2024-04-20T21:58:55.295 INFO:tasks.workunit.client.1.smithi164.stdout:5/256: read f8 [863035,92717] 0 2024-04-20T21:58:55.303 INFO:tasks.workunit.client.1.smithi164.stdout:7/227: dwrite d2/d21/d24/d31/d3a/f49 [0,4194304] 0 2024-04-20T21:58:55.303 INFO:tasks.workunit.client.1.smithi164.stdout:4/248: write d4/f36 [662858,45377] 0 2024-04-20T21:58:55.309 INFO:tasks.workunit.client.1.smithi164.stdout:4/249: symlink d4/d9/d27/d37/l5d 0 2024-04-20T21:58:55.332 INFO:tasks.workunit.client.1.smithi164.stdout:1/235: truncate d10/d16/d20/d25/f2e 469309 0 2024-04-20T21:58:55.333 INFO:tasks.workunit.client.1.smithi164.stdout:4/250: dwrite d4/d9/d27/d37/f51 [0,4194304] 0 2024-04-20T21:58:55.336 INFO:tasks.workunit.client.1.smithi164.stdout:4/251: chown d4/d9/d22/f56 625 1 2024-04-20T21:58:55.351 INFO:tasks.workunit.client.1.smithi164.stdout:4/252: dread d4/d9/f17 [0,4194304] 0 2024-04-20T21:58:55.352 INFO:tasks.workunit.client.1.smithi164.stdout:7/228: dread d2/d21/d33/f38 [0,4194304] 0 2024-04-20T21:58:55.356 INFO:tasks.workunit.client.1.smithi164.stdout:4/253: write d4/d9/d27/d37/f51 [464908,457] 0 2024-04-20T21:58:55.363 INFO:tasks.workunit.client.1.smithi164.stdout:4/254: write d4/d9/f2d [998880,11348] 0 2024-04-20T21:58:55.371 INFO:tasks.workunit.client.1.smithi164.stdout:1/236: dwrite d10/f15 [0,4194304] 0 2024-04-20T21:58:55.371 INFO:tasks.workunit.client.1.smithi164.stdout:4/255: rmdir d4/d9/d27/d3f 39 2024-04-20T21:58:55.376 INFO:tasks.workunit.client.1.smithi164.stdout:1/237: write d10/d16/f43 [1089724,16535] 0 2024-04-20T21:58:55.379 INFO:tasks.workunit.client.1.smithi164.stdout:7/229: dwrite d2/d21/f3b [0,4194304] 0 2024-04-20T21:58:55.379 INFO:tasks.workunit.client.1.smithi164.stdout:1/238: write f0 [1635749,46401] 0 2024-04-20T21:58:55.383 INFO:tasks.workunit.client.1.smithi164.stdout:7/230: dread - d2/d21/d44/f4b zero size 2024-04-20T21:58:55.385 INFO:tasks.workunit.client.1.smithi164.stdout:4/256: mkdir d4/d28/d3e/d41/d5e 0 2024-04-20T21:58:55.388 INFO:tasks.workunit.client.1.smithi164.stdout:4/257: truncate d4/d28/d3e/d41/f4b 785626 0 2024-04-20T21:58:55.409 INFO:tasks.workunit.client.1.smithi164.stdout:4/258: dread d4/d9/d27/f29 [0,4194304] 0 2024-04-20T21:58:55.412 INFO:tasks.workunit.client.1.smithi164.stdout:4/259: chown d4/d9/d27/c33 4155852 1 2024-04-20T21:58:55.419 INFO:tasks.workunit.client.1.smithi164.stdout:4/260: mkdir d4/d9/d27/d3f/d5f 0 2024-04-20T21:58:55.422 INFO:tasks.workunit.client.1.smithi164.stdout:4/261: symlink d4/d9/d22/l60 0 2024-04-20T21:58:55.430 INFO:tasks.workunit.client.1.smithi164.stdout:2/242: rmdir d2/d19/d28/d3e 39 2024-04-20T21:58:55.456 INFO:tasks.workunit.client.1.smithi164.stdout:0/219: creat d1/f3e x:0 0 0 2024-04-20T21:58:55.457 INFO:tasks.workunit.client.1.smithi164.stdout:0/220: read - d1/f22 zero size 2024-04-20T21:58:55.458 INFO:tasks.workunit.client.1.smithi164.stdout:0/221: stat d1/d4/l13 0 2024-04-20T21:58:55.459 INFO:tasks.workunit.client.1.smithi164.stdout:0/222: chown d1/l16 208 1 2024-04-20T21:58:55.463 INFO:tasks.workunit.client.1.smithi164.stdout:4/262: rmdir d4 39 2024-04-20T21:58:55.464 INFO:tasks.workunit.client.1.smithi164.stdout:4/263: chown f3 3 1 2024-04-20T21:58:55.465 INFO:tasks.workunit.client.1.smithi164.stdout:9/287: truncate d3/db/f5b 2840322 0 2024-04-20T21:58:55.468 INFO:tasks.workunit.client.1.smithi164.stdout:9/288: write d3/db/d1b/d20/d3f/f4e [965907,112791] 0 2024-04-20T21:58:55.471 INFO:tasks.workunit.client.1.smithi164.stdout:9/289: write d3/db/dd/f61 [578794,108118] 0 2024-04-20T21:58:55.471 INFO:tasks.workunit.client.1.smithi164.stdout:0/223: rmdir d1/d4/da 39 2024-04-20T21:58:55.473 INFO:tasks.workunit.client.1.smithi164.stdout:9/290: read d3/f9 [62613,9318] 0 2024-04-20T21:58:55.477 INFO:tasks.workunit.client.1.smithi164.stdout:8/217: creat d0/f4d x:0 0 0 2024-04-20T21:58:55.484 INFO:tasks.workunit.client.1.smithi164.stdout:0/224: dread d1/d4/f28 [0,4194304] 0 2024-04-20T21:58:55.485 INFO:tasks.workunit.client.1.smithi164.stdout:8/218: mkdir d0/d14/d4e 0 2024-04-20T21:58:55.488 INFO:tasks.workunit.client.1.smithi164.stdout:3/280: truncate d12/f32 3298505 0 2024-04-20T21:58:55.490 INFO:tasks.workunit.client.1.smithi164.stdout:5/257: write dc/d2c/d2e/f31 [2916980,7563] 0 2024-04-20T21:58:55.492 INFO:tasks.workunit.client.1.smithi164.stdout:8/219: creat d0/d14/f4f x:0 0 0 2024-04-20T21:58:55.494 INFO:tasks.workunit.client.1.smithi164.stdout:0/225: creat d1/d4/da/d27/d33/f3f x:0 0 0 2024-04-20T21:58:55.507 INFO:tasks.workunit.client.1.smithi164.stdout:8/220: creat d0/f50 x:0 0 0 2024-04-20T21:58:55.509 INFO:tasks.workunit.client.1.smithi164.stdout:9/291: dread d3/db/dd/fe [0,4194304] 0 2024-04-20T21:58:55.511 INFO:tasks.workunit.client.1.smithi164.stdout:3/281: dwrite d12/d15/f19 [0,4194304] 0 2024-04-20T21:58:55.515 INFO:tasks.workunit.client.1.smithi164.stdout:9/292: mkdir d3/db/d4f/d67 0 2024-04-20T21:58:55.517 INFO:tasks.workunit.client.1.smithi164.stdout:5/258: dread dc/d2c/d2e/f31 [0,4194304] 0 2024-04-20T21:58:55.518 INFO:tasks.workunit.client.1.smithi164.stdout:3/282: mkdir d12/d20/d39/d55 0 2024-04-20T21:58:55.523 INFO:tasks.workunit.client.1.smithi164.stdout:2/243: write d2/d5/d21/f37 [874402,93768] 0 2024-04-20T21:58:55.526 INFO:tasks.workunit.client.1.smithi164.stdout:8/221: dread d0/d14/f6 [0,4194304] 0 2024-04-20T21:58:55.539 INFO:tasks.workunit.client.1.smithi164.stdout:0/226: dread d1/f12 [0,4194304] 0 2024-04-20T21:58:55.540 INFO:tasks.workunit.client.1.smithi164.stdout:7/231: dwrite d2/f48 [0,4194304] 0 2024-04-20T21:58:55.544 INFO:tasks.workunit.client.1.smithi164.stdout:9/293: dwrite d3/db/dd/f45 [0,4194304] 0 2024-04-20T21:58:55.549 INFO:tasks.workunit.client.1.smithi164.stdout:5/259: dwrite f7 [4194304,4194304] 0 2024-04-20T21:58:55.550 INFO:tasks.workunit.client.1.smithi164.stdout:0/227: creat d1/d4/d20/f40 x:0 0 0 2024-04-20T21:58:55.550 INFO:tasks.workunit.client.1.smithi164.stdout:7/232: creat d2/d21/d24/f4c x:0 0 0 2024-04-20T21:58:55.551 INFO:tasks.workunit.client.1.smithi164.stdout:3/283: dread d12/d20/f40 [0,4194304] 0 2024-04-20T21:58:55.555 INFO:tasks.workunit.client.1.smithi164.stdout:7/233: fdatasync d2/f5 0 2024-04-20T21:58:55.559 INFO:tasks.workunit.client.1.smithi164.stdout:8/222: dread d0/f24 [0,4194304] 0 2024-04-20T21:58:55.559 INFO:tasks.workunit.client.1.smithi164.stdout:9/294: creat d3/db/dd/d40/d2a/d36/d51/f68 x:0 0 0 2024-04-20T21:58:55.562 INFO:tasks.workunit.client.1.smithi164.stdout:5/260: mknod dc/d12/c56 0 2024-04-20T21:58:55.566 INFO:tasks.workunit.client.1.smithi164.stdout:7/234: write f1 [322712,16206] 0 2024-04-20T21:58:55.573 INFO:tasks.workunit.client.1.smithi164.stdout:7/235: write d2/fc [3295856,4691] 0 2024-04-20T21:58:55.576 INFO:tasks.workunit.client.1.smithi164.stdout:7/236: stat d2/d21/l2e 0 2024-04-20T21:58:55.581 INFO:tasks.workunit.client.1.smithi164.stdout:0/228: dread d1/d4/f28 [0,4194304] 0 2024-04-20T21:58:55.582 INFO:tasks.workunit.client.1.smithi164.stdout:9/295: link d3/db/d1b/l2e d3/db/dd/d40/d2a/d36/d51/l69 0 2024-04-20T21:58:55.584 INFO:tasks.workunit.client.1.smithi164.stdout:9/296: readlink d3/l31 0 2024-04-20T21:58:55.586 INFO:tasks.workunit.client.1.smithi164.stdout:7/237: write d2/d21/d24/f2b [1303190,52837] 0 2024-04-20T21:58:55.587 INFO:tasks.workunit.client.1.smithi164.stdout:3/284: dwrite d12/f1e [0,4194304] 0 2024-04-20T21:58:55.592 INFO:tasks.workunit.client.1.smithi164.stdout:0/229: symlink d1/d4/da/d1f/l41 0 2024-04-20T21:58:55.593 INFO:tasks.workunit.client.1.smithi164.stdout:3/285: fdatasync d12/d15/f1c 0 2024-04-20T21:58:55.593 INFO:tasks.workunit.client.1.smithi164.stdout:7/238: write d2/d21/d33/f38 [1538347,2582] 0 2024-04-20T21:58:55.593 INFO:tasks.workunit.client.1.smithi164.stdout:2/244: dread d2/d5/d21/f2b [0,4194304] 0 2024-04-20T21:58:55.595 INFO:tasks.workunit.client.1.smithi164.stdout:9/297: creat d3/db/dd/f6a x:0 0 0 2024-04-20T21:58:55.596 INFO:tasks.workunit.client.1.smithi164.stdout:5/261: dwrite dc/d12/d1e/f51 [0,4194304] 0 2024-04-20T21:58:55.598 INFO:tasks.workunit.client.1.smithi164.stdout:3/286: stat d12/d20/c27 0 2024-04-20T21:58:55.598 INFO:tasks.workunit.client.1.smithi164.stdout:9/298: write d3/f41 [4046781,124969] 0 2024-04-20T21:58:55.599 INFO:tasks.workunit.client.1.smithi164.stdout:2/245: stat d2/d19/d28/d3e/f42 0 2024-04-20T21:58:55.599 INFO:tasks.workunit.client.1.smithi164.stdout:7/239: write d2/f3c [790894,50766] 0 2024-04-20T21:58:55.602 INFO:tasks.workunit.client.1.smithi164.stdout:5/262: mknod dc/d41/c57 0 2024-04-20T21:58:55.606 INFO:tasks.workunit.client.1.smithi164.stdout:7/240: fdatasync d2/d21/f45 0 2024-04-20T21:58:55.608 INFO:tasks.workunit.client.1.smithi164.stdout:2/246: creat d2/d30/f4a x:0 0 0 2024-04-20T21:58:55.609 INFO:tasks.workunit.client.1.smithi164.stdout:9/299: fsync d3/fa 0 2024-04-20T21:58:55.617 INFO:tasks.workunit.client.1.smithi164.stdout:9/300: write d3/db/dd/f5d [918690,33789] 0 2024-04-20T21:58:55.617 INFO:tasks.workunit.client.1.smithi164.stdout:6/291: sync 2024-04-20T21:58:55.621 INFO:tasks.workunit.client.1.smithi164.stdout:9/301: creat d3/db/dd/f6b x:0 0 0 2024-04-20T21:58:55.624 INFO:tasks.workunit.client.1.smithi164.stdout:6/292: mkdir d0/d3/d62 0 2024-04-20T21:58:55.624 INFO:tasks.workunit.client.1.smithi164.stdout:8/223: dread d0/d1e/f43 [0,4194304] 0 2024-04-20T21:58:55.631 INFO:tasks.workunit.client.1.smithi164.stdout:0/230: dwrite d1/f12 [0,4194304] 0 2024-04-20T21:58:55.632 INFO:tasks.workunit.client.1.smithi164.stdout:9/302: symlink d3/db/d4f/d67/l6c 0 2024-04-20T21:58:55.632 INFO:tasks.workunit.client.1.smithi164.stdout:7/241: dread d2/d21/f28 [0,4194304] 0 2024-04-20T21:58:55.637 INFO:tasks.workunit.client.1.smithi164.stdout:5/263: truncate f9 3242787 0 2024-04-20T21:58:55.639 INFO:tasks.workunit.client.1.smithi164.stdout:6/293: symlink d0/d3/d8/d28/d3d/d5d/l63 0 2024-04-20T21:58:55.640 INFO:tasks.workunit.client.1.smithi164.stdout:8/224: creat d0/d14/f51 x:0 0 0 2024-04-20T21:58:55.640 INFO:tasks.workunit.client.1.smithi164.stdout:3/287: dwrite d12/d15/f38 [0,4194304] 0 2024-04-20T21:58:55.642 INFO:tasks.workunit.client.1.smithi164.stdout:0/231: creat d1/f42 x:0 0 0 2024-04-20T21:58:55.643 INFO:tasks.workunit.client.1.smithi164.stdout:5/264: write dc/fd [904593,20533] 0 2024-04-20T21:58:55.644 INFO:tasks.workunit.client.1.smithi164.stdout:7/242: write d2/d21/d24/f30 [602800,68810] 0 2024-04-20T21:58:55.645 INFO:tasks.workunit.client.1.smithi164.stdout:3/288: write d12/f1e [4643614,16679] 0 2024-04-20T21:58:55.647 INFO:tasks.workunit.client.1.smithi164.stdout:6/294: truncate d0/f30 496391 0 2024-04-20T21:58:55.651 INFO:tasks.workunit.client.1.smithi164.stdout:8/225: write d0/d14/f4f [720177,84625] 0 2024-04-20T21:58:55.655 INFO:tasks.workunit.client.1.smithi164.stdout:5/265: mknod dc/d12/d1e/c58 0 2024-04-20T21:58:55.660 INFO:tasks.workunit.client.1.smithi164.stdout:6/295: unlink d0/d3/l5 0 2024-04-20T21:58:55.662 INFO:tasks.workunit.client.1.smithi164.stdout:2/247: dwrite d2/d19/d28/f47 [0,4194304] 0 2024-04-20T21:58:55.664 INFO:tasks.workunit.client.1.smithi164.stdout:6/296: read d0/f30 [423491,50380] 0 2024-04-20T21:58:55.667 INFO:tasks.workunit.client.1.smithi164.stdout:5/266: creat dc/d2c/d2e/d30/f59 x:0 0 0 2024-04-20T21:58:55.670 INFO:tasks.workunit.client.1.smithi164.stdout:2/248: creat d2/d30/f4b x:0 0 0 2024-04-20T21:58:55.676 INFO:tasks.workunit.client.1.smithi164.stdout:5/267: rmdir dc 39 2024-04-20T21:58:55.677 INFO:tasks.workunit.client.1.smithi164.stdout:0/232: dwrite d1/d4/df/f2f [0,4194304] 0 2024-04-20T21:58:55.679 INFO:tasks.workunit.client.1.smithi164.stdout:0/233: read d1/d4/f28 [1860897,39446] 0 2024-04-20T21:58:55.679 INFO:tasks.workunit.client.1.smithi164.stdout:7/243: link d2/l43 d2/d21/d33/l4d 0 2024-04-20T21:58:55.681 INFO:tasks.workunit.client.1.smithi164.stdout:0/234: chown d1/d4/d26/d29/d2d 29 1 2024-04-20T21:58:55.684 INFO:tasks.workunit.client.1.smithi164.stdout:7/244: truncate d2/f15 5512178 0 2024-04-20T21:58:55.684 INFO:tasks.workunit.client.1.smithi164.stdout:2/249: creat d2/d5/d3a/f4c x:0 0 0 2024-04-20T21:58:55.685 INFO:tasks.workunit.client.1.smithi164.stdout:3/289: getdents d12/d2a 0 2024-04-20T21:58:55.690 INFO:tasks.workunit.client.1.smithi164.stdout:6/297: mkdir d0/d3/d15/d23/d45/d4f/d61/d64 0 2024-04-20T21:58:55.691 INFO:tasks.workunit.client.1.smithi164.stdout:3/290: write d12/d20/d39/f4b [188571,84839] 0 2024-04-20T21:58:55.693 INFO:tasks.workunit.client.1.smithi164.stdout:0/235: chown d1/l5 76 1 2024-04-20T21:58:55.693 INFO:tasks.workunit.client.1.smithi164.stdout:7/245: creat d2/d21/d44/f4e x:0 0 0 2024-04-20T21:58:55.693 INFO:tasks.workunit.client.1.smithi164.stdout:2/250: rmdir d2/d5/d21 39 2024-04-20T21:58:55.697 INFO:tasks.workunit.client.1.smithi164.stdout:8/226: link d0/d1e/l2f d0/d14/d16/l52 0 2024-04-20T21:58:55.697 INFO:tasks.workunit.client.1.smithi164.stdout:5/268: write dc/d2b/f27 [737113,115739] 0 2024-04-20T21:58:55.700 INFO:tasks.workunit.client.1.smithi164.stdout:3/291: creat d12/d20/d39/f56 x:0 0 0 2024-04-20T21:58:55.701 INFO:tasks.workunit.client.1.smithi164.stdout:0/236: unlink d1/d4/df/l14 0 2024-04-20T21:58:55.701 INFO:tasks.workunit.client.1.smithi164.stdout:8/227: chown d0/c49 0 1 2024-04-20T21:58:55.704 INFO:tasks.workunit.client.1.smithi164.stdout:5/269: dread dc/d12/f4d [0,4194304] 0 2024-04-20T21:58:55.704 INFO:tasks.workunit.client.1.smithi164.stdout:7/246: creat d2/d21/d24/f4f x:0 0 0 2024-04-20T21:58:55.708 INFO:tasks.workunit.client.1.smithi164.stdout:6/298: symlink d0/l65 0 2024-04-20T21:58:55.710 INFO:tasks.workunit.client.1.smithi164.stdout:6/299: chown d0/d3/f56 4080573 1 2024-04-20T21:58:55.715 INFO:tasks.workunit.client.1.smithi164.stdout:2/251: dwrite d2/d19/d28/f40 [0,4194304] 0 2024-04-20T21:58:55.719 INFO:tasks.workunit.client.1.smithi164.stdout:7/247: mkdir d2/d21/d24/d50 0 2024-04-20T21:58:55.721 INFO:tasks.workunit.client.1.smithi164.stdout:7/248: truncate d2/f26 459160 0 2024-04-20T21:58:55.722 INFO:tasks.workunit.client.1.smithi164.stdout:0/237: truncate d1/d4/da/f2e 3699326 0 2024-04-20T21:58:55.722 INFO:tasks.workunit.client.1.smithi164.stdout:3/292: dwrite f10 [0,4194304] 0 2024-04-20T21:58:55.723 INFO:tasks.workunit.client.1.smithi164.stdout:7/249: write d2/f29 [2055950,99627] 0 2024-04-20T21:58:55.725 INFO:tasks.workunit.client.1.smithi164.stdout:3/293: chown d12/d20/f22 9262051 1 2024-04-20T21:58:55.725 INFO:tasks.workunit.client.1.smithi164.stdout:6/300: creat d0/d3/d15/d23/d45/d4f/f66 x:0 0 0 2024-04-20T21:58:55.726 INFO:tasks.workunit.client.1.smithi164.stdout:2/252: rename d2/d5/lb to d2/d19/l4d 0 2024-04-20T21:58:55.727 INFO:tasks.workunit.client.1.smithi164.stdout:3/294: write d12/d20/f48 [659037,58012] 0 2024-04-20T21:58:55.728 INFO:tasks.workunit.client.1.smithi164.stdout:6/301: write d0/d3/d27/f3f [747594,124037] 0 2024-04-20T21:58:55.730 INFO:tasks.workunit.client.1.smithi164.stdout:3/295: read - d12/d15/f21 zero size 2024-04-20T21:58:55.733 INFO:tasks.workunit.client.1.smithi164.stdout:3/296: stat d12/d20/d39/d55 0 2024-04-20T21:58:55.734 INFO:tasks.workunit.client.1.smithi164.stdout:3/297: rename d12 to d12/d20/d39/d57 22 2024-04-20T21:58:55.736 INFO:tasks.workunit.client.1.smithi164.stdout:7/250: symlink d2/d21/d33/l51 0 2024-04-20T21:58:55.737 INFO:tasks.workunit.client.1.smithi164.stdout:2/253: fdatasync d2/d19/d28/f2a 0 2024-04-20T21:58:55.738 INFO:tasks.workunit.client.1.smithi164.stdout:5/270: link dc/d2c/l40 dc/d2b/d52/l5a 0 2024-04-20T21:58:55.738 INFO:tasks.workunit.client.1.smithi164.stdout:7/251: dread - d2/d21/d33/f40 zero size 2024-04-20T21:58:55.742 INFO:tasks.workunit.client.1.smithi164.stdout:8/228: getdents d0/d14 0 2024-04-20T21:58:55.747 INFO:tasks.workunit.client.1.smithi164.stdout:5/271: symlink dc/l5b 0 2024-04-20T21:58:55.749 INFO:tasks.workunit.client.1.smithi164.stdout:7/252: creat d2/d21/d24/f52 x:0 0 0 2024-04-20T21:58:55.750 INFO:tasks.workunit.client.1.smithi164.stdout:5/272: read dc/d12/d1e/f51 [2042659,121179] 0 2024-04-20T21:58:55.750 INFO:tasks.workunit.client.1.smithi164.stdout:8/229: symlink d0/d14/l53 0 2024-04-20T21:58:55.753 INFO:tasks.workunit.client.1.smithi164.stdout:5/273: read dc/f16 [3782524,114936] 0 2024-04-20T21:58:55.754 INFO:tasks.workunit.client.1.smithi164.stdout:3/298: dwrite d12/d15/f26 [0,4194304] 0 2024-04-20T21:58:55.756 INFO:tasks.workunit.client.1.smithi164.stdout:6/302: rmdir d0/d3 39 2024-04-20T21:58:55.762 INFO:tasks.workunit.client.1.smithi164.stdout:2/254: creat d2/d19/d28/f4e x:0 0 0 2024-04-20T21:58:55.763 INFO:tasks.workunit.client.1.smithi164.stdout:2/255: readlink d2/d5/l18 0 2024-04-20T21:58:55.764 INFO:tasks.workunit.client.1.smithi164.stdout:0/238: write d1/d4/f2c [1230358,127822] 0 2024-04-20T21:58:55.764 INFO:tasks.workunit.client.1.smithi164.stdout:2/256: stat d2/d19/d28/l33 0 2024-04-20T21:58:55.767 INFO:tasks.workunit.client.1.smithi164.stdout:5/274: dread dc/d2b/f27 [0,4194304] 0 2024-04-20T21:58:55.767 INFO:tasks.workunit.client.1.smithi164.stdout:0/239: write d1/fb [2276588,102240] 0 2024-04-20T21:58:55.770 INFO:tasks.workunit.client.1.smithi164.stdout:0/240: write d1/d4/da/d27/f32 [611134,54894] 0 2024-04-20T21:58:55.773 INFO:tasks.workunit.client.1.smithi164.stdout:3/299: creat d12/d20/d39/d55/f58 x:0 0 0 2024-04-20T21:58:55.774 INFO:tasks.workunit.client.1.smithi164.stdout:3/300: fsync d12/d20/f48 0 2024-04-20T21:58:55.775 INFO:tasks.workunit.client.1.smithi164.stdout:6/303: mknod d0/d3/d8/c67 0 2024-04-20T21:58:55.776 INFO:tasks.workunit.client.1.smithi164.stdout:7/253: link d2/c27 d2/d21/d44/c53 0 2024-04-20T21:58:55.778 INFO:tasks.workunit.client.1.smithi164.stdout:6/304: write d0/d3/f56 [849213,3466] 0 2024-04-20T21:58:55.778 INFO:tasks.workunit.client.1.smithi164.stdout:5/275: rename dc/d41/l4a to dc/d2b/d52/l5c 0 2024-04-20T21:58:55.779 INFO:tasks.workunit.client.1.smithi164.stdout:4/264: sync 2024-04-20T21:58:55.779 INFO:tasks.workunit.client.1.smithi164.stdout:1/239: sync 2024-04-20T21:58:55.780 INFO:tasks.workunit.client.1.smithi164.stdout:8/230: readlink d0/d14/l4a 0 2024-04-20T21:58:55.782 INFO:tasks.workunit.client.1.smithi164.stdout:0/241: symlink d1/d4/d26/d29/d2d/l43 0 2024-04-20T21:58:55.783 INFO:tasks.workunit.client.1.smithi164.stdout:1/240: write f5 [1897496,38244] 0 2024-04-20T21:58:55.785 INFO:tasks.workunit.client.1.smithi164.stdout:1/241: chown d10/d33/d41 154 1 2024-04-20T21:58:55.786 INFO:tasks.workunit.client.1.smithi164.stdout:6/305: creat d0/d3/d15/d23/d45/d4f/f68 x:0 0 0 2024-04-20T21:58:55.787 INFO:tasks.workunit.client.1.smithi164.stdout:0/242: read d1/f8 [7476913,88797] 0 2024-04-20T21:58:55.793 INFO:tasks.workunit.client.1.smithi164.stdout:1/242: fdatasync d10/d16/d20/f28 0 2024-04-20T21:58:55.794 INFO:tasks.workunit.client.1.smithi164.stdout:4/265: write d4/d9/f2d [217011,63339] 0 2024-04-20T21:58:55.794 INFO:tasks.workunit.client.1.smithi164.stdout:6/306: fsync d0/f30 0 2024-04-20T21:58:55.799 INFO:tasks.workunit.client.1.smithi164.stdout:6/307: unlink d0/f30 0 2024-04-20T21:58:55.800 INFO:tasks.workunit.client.1.smithi164.stdout:5/276: link dc/d2c/d2e/d30/c34 dc/d2c/d2e/d30/c5d 0 2024-04-20T21:58:55.807 INFO:tasks.workunit.client.1.smithi164.stdout:1/243: mknod d10/d33/d41/c4c 0 2024-04-20T21:58:55.807 INFO:tasks.workunit.client.1.smithi164.stdout:7/254: dwrite d2/d21/d44/f4b [0,4194304] 0 2024-04-20T21:58:55.811 INFO:tasks.workunit.client.1.smithi164.stdout:5/277: mkdir dc/d2c/d2e/d30/d5e 0 2024-04-20T21:58:55.812 INFO:tasks.workunit.client.1.smithi164.stdout:8/231: dwrite d0/d14/d16/f26 [0,4194304] 0 2024-04-20T21:58:55.813 INFO:tasks.workunit.client.1.smithi164.stdout:0/243: link d1/d4/da/d27/f32 d1/d4/d26/d29/f44 0 2024-04-20T21:58:55.814 INFO:tasks.workunit.client.1.smithi164.stdout:3/301: write d12/d20/f22 [1530965,97403] 0 2024-04-20T21:58:55.817 INFO:tasks.workunit.client.1.smithi164.stdout:6/308: mkdir d0/d3/d15/d23/d45/d69 0 2024-04-20T21:58:55.818 INFO:tasks.workunit.client.1.smithi164.stdout:2/257: dread d2/f12 [0,4194304] 0 2024-04-20T21:58:55.819 INFO:tasks.workunit.client.1.smithi164.stdout:5/278: symlink dc/d2c/l5f 0 2024-04-20T21:58:55.821 INFO:tasks.workunit.client.1.smithi164.stdout:6/309: chown d0/d3/d15/d23/d45/d4f/d61 172847 1 2024-04-20T21:58:55.827 INFO:tasks.workunit.client.1.smithi164.stdout:3/302: symlink d12/d20/d39/l59 0 2024-04-20T21:58:55.828 INFO:tasks.workunit.client.1.smithi164.stdout:0/244: rmdir d1/d4/da/d27/d33 39 2024-04-20T21:58:55.829 INFO:tasks.workunit.client.1.smithi164.stdout:6/310: chown d0/d3/d15/f5e 18441 1 2024-04-20T21:58:55.831 INFO:tasks.workunit.client.1.smithi164.stdout:4/266: dwrite d4/d9/d22/f2f [0,4194304] 0 2024-04-20T21:58:55.832 INFO:tasks.workunit.client.1.smithi164.stdout:1/244: dread d10/d16/f43 [0,4194304] 0 2024-04-20T21:58:55.832 INFO:tasks.workunit.client.1.smithi164.stdout:7/255: rename d2/fc to d2/d21/d33/f54 0 2024-04-20T21:58:55.837 INFO:tasks.workunit.client.1.smithi164.stdout:9/303: sync 2024-04-20T21:58:55.838 INFO:tasks.workunit.client.1.smithi164.stdout:6/311: write d0/d3/d27/f3f [895840,113514] 0 2024-04-20T21:58:55.838 INFO:tasks.workunit.client.1.smithi164.stdout:4/267: unlink d4/c10 0 2024-04-20T21:58:55.838 INFO:tasks.workunit.client.1.smithi164.stdout:2/258: fsync d2/d5/f14 0 2024-04-20T21:58:55.839 INFO:tasks.workunit.client.1.smithi164.stdout:5/279: write dc/f25 [1171779,75263] 0 2024-04-20T21:58:55.841 INFO:tasks.workunit.client.1.smithi164.stdout:7/256: mkdir d2/d55 0 2024-04-20T21:58:55.842 INFO:tasks.workunit.client.1.smithi164.stdout:4/268: chown d4/f4e 1268619 1 2024-04-20T21:58:55.845 INFO:tasks.workunit.client.1.smithi164.stdout:0/245: mknod d1/c45 0 2024-04-20T21:58:55.847 INFO:tasks.workunit.client.1.smithi164.stdout:9/304: fdatasync d3/db/d1b/d20/f5c 0 2024-04-20T21:58:55.847 INFO:tasks.workunit.client.1.smithi164.stdout:3/303: creat d12/f5a x:0 0 0 2024-04-20T21:58:55.851 INFO:tasks.workunit.client.1.smithi164.stdout:7/257: mknod d2/d21/d24/d31/d3a/c56 0 2024-04-20T21:58:55.851 INFO:tasks.workunit.client.1.smithi164.stdout:4/269: rmdir d4/d9/d27 39 2024-04-20T21:58:55.854 INFO:tasks.workunit.client.1.smithi164.stdout:3/304: write d12/d15/f1b [727024,70790] 0 2024-04-20T21:58:55.854 INFO:tasks.workunit.client.1.smithi164.stdout:7/258: dread - d2/f16 zero size 2024-04-20T21:58:55.855 INFO:tasks.workunit.client.1.smithi164.stdout:4/270: chown d4/d28 157 1 2024-04-20T21:58:55.855 INFO:tasks.workunit.client.1.smithi164.stdout:0/246: creat d1/d4/d26/f46 x:0 0 0 2024-04-20T21:58:55.857 INFO:tasks.workunit.client.1.smithi164.stdout:0/247: read d1/f12 [2846012,42886] 0 2024-04-20T21:58:55.857 INFO:tasks.workunit.client.1.smithi164.stdout:9/305: write d3/db/dd/f14 [1313238,81436] 0 2024-04-20T21:58:55.858 INFO:tasks.workunit.client.1.smithi164.stdout:7/259: chown d2/c8 156476436 1 2024-04-20T21:58:55.860 INFO:tasks.workunit.client.1.smithi164.stdout:5/280: rename dc/d2b/f3b to dc/d2c/d2e/f60 0 2024-04-20T21:58:55.863 INFO:tasks.workunit.client.1.smithi164.stdout:8/232: dread d0/f3 [0,4194304] 0 2024-04-20T21:58:55.865 INFO:tasks.workunit.client.1.smithi164.stdout:3/305: write f11 [4764665,17985] 0 2024-04-20T21:58:55.872 INFO:tasks.workunit.client.1.smithi164.stdout:3/306: dread d12/d20/f40 [4194304,4194304] 0 2024-04-20T21:58:55.872 INFO:tasks.workunit.client.1.smithi164.stdout:9/306: symlink d3/db/d1b/l6d 0 2024-04-20T21:58:55.874 INFO:tasks.workunit.client.1.smithi164.stdout:9/307: write d3/db/d4f/f62 [13317,119989] 0 2024-04-20T21:58:55.878 INFO:tasks.workunit.client.1.smithi164.stdout:7/260: rename d2/d21/d33/f38 to d2/d21/d24/f57 0 2024-04-20T21:58:55.879 INFO:tasks.workunit.client.1.smithi164.stdout:7/261: fsync d2/f15 0 2024-04-20T21:58:55.882 INFO:tasks.workunit.client.1.smithi164.stdout:6/312: dread d0/d3/d11/d29/f4d [0,4194304] 0 2024-04-20T21:58:55.883 INFO:tasks.workunit.client.1.smithi164.stdout:7/262: chown d2/d21/d24/d31/d3a/f49 3934 1 2024-04-20T21:58:55.885 INFO:tasks.workunit.client.1.smithi164.stdout:3/307: symlink d12/d20/d39/d55/l5b 0 2024-04-20T21:58:55.886 INFO:tasks.workunit.client.1.smithi164.stdout:1/245: dread d10/d16/d20/f2f [0,4194304] 0 2024-04-20T21:58:55.886 INFO:tasks.workunit.client.1.smithi164.stdout:1/246: readlink l4 0 2024-04-20T21:58:55.889 INFO:tasks.workunit.client.1.smithi164.stdout:0/248: link d1/d2b/c39 d1/d2b/c47 0 2024-04-20T21:58:55.892 INFO:tasks.workunit.client.1.smithi164.stdout:9/308: rename d3/db/d1b/l2e to d3/db/d1b/d20/d3f/l6e 0 2024-04-20T21:58:55.893 INFO:tasks.workunit.client.1.smithi164.stdout:8/233: creat d0/d14/d4e/f54 x:0 0 0 2024-04-20T21:58:55.894 INFO:tasks.workunit.client.1.smithi164.stdout:3/308: mknod d12/d20/d39/d55/c5c 0 2024-04-20T21:58:55.895 INFO:tasks.workunit.client.1.smithi164.stdout:6/313: mknod d0/d3/d8/d28/d3d/d41/c6a 0 2024-04-20T21:58:55.897 INFO:tasks.workunit.client.1.smithi164.stdout:0/249: rename d1/d4/d26/d29/d2d/l43 to d1/d4/da/d1f/d3c/l48 0 2024-04-20T21:58:55.900 INFO:tasks.workunit.client.1.smithi164.stdout:1/247: unlink l9 0 2024-04-20T21:58:55.903 INFO:tasks.workunit.client.1.smithi164.stdout:5/281: write f6 [504706,26104] 0 2024-04-20T21:58:55.903 INFO:tasks.workunit.client.1.smithi164.stdout:8/234: mkdir d0/d14/d55 0 2024-04-20T21:58:55.904 INFO:tasks.workunit.client.1.smithi164.stdout:5/282: fsync dc/d2c/d2e/f47 0 2024-04-20T21:58:55.907 INFO:tasks.workunit.client.1.smithi164.stdout:6/314: symlink d0/d3/d15/d21/d4b/l6b 0 2024-04-20T21:58:55.907 INFO:tasks.workunit.client.1.smithi164.stdout:0/250: mkdir d1/d4/d49 0 2024-04-20T21:58:55.908 INFO:tasks.workunit.client.1.smithi164.stdout:0/251: chown d1/d4 12510462 1 2024-04-20T21:58:55.909 INFO:tasks.workunit.client.1.smithi164.stdout:9/309: link d3/db/dd/d40/d2a/f3a d3/db/f6f 0 2024-04-20T21:58:55.910 INFO:tasks.workunit.client.1.smithi164.stdout:9/310: dread - d3/f39 zero size 2024-04-20T21:58:55.913 INFO:tasks.workunit.client.1.smithi164.stdout:5/283: symlink dc/d2c/d2e/d30/d5e/l61 0 2024-04-20T21:58:55.914 INFO:tasks.workunit.client.1.smithi164.stdout:5/284: fsync dc/d12/f18 0 2024-04-20T21:58:55.915 INFO:tasks.workunit.client.1.smithi164.stdout:6/315: mknod d0/d3/d15/d21/d5c/c6c 0 2024-04-20T21:58:55.916 INFO:tasks.workunit.client.1.smithi164.stdout:5/285: fdatasync dc/f1a 0 2024-04-20T21:58:55.916 INFO:tasks.workunit.client.1.smithi164.stdout:0/252: mknod d1/d4/c4a 0 2024-04-20T21:58:55.918 INFO:tasks.workunit.client.1.smithi164.stdout:9/311: creat d3/db/dd/d40/d2a/d36/d51/f70 x:0 0 0 2024-04-20T21:58:55.918 INFO:tasks.workunit.client.1.smithi164.stdout:6/316: readlink d0/d3/d11/d29/l35 0 2024-04-20T21:58:55.919 INFO:tasks.workunit.client.1.smithi164.stdout:6/317: dread - d0/f37 zero size 2024-04-20T21:58:55.921 INFO:tasks.workunit.client.1.smithi164.stdout:5/286: chown dc/d2b/l26 24343 1 2024-04-20T21:58:55.922 INFO:tasks.workunit.client.1.smithi164.stdout:3/309: dread d12/d15/f24 [0,4194304] 0 2024-04-20T21:58:55.926 INFO:tasks.workunit.client.1.smithi164.stdout:9/312: dread d3/db/dd/f23 [0,4194304] 0 2024-04-20T21:58:55.928 INFO:tasks.workunit.client.1.smithi164.stdout:9/313: chown d3/db/dd/d40/d2a/d36/f48 78784 1 2024-04-20T21:58:55.933 INFO:tasks.workunit.client.1.smithi164.stdout:6/318: creat d0/d3/d11/d5a/f6d x:0 0 0 2024-04-20T21:58:55.935 INFO:tasks.workunit.client.1.smithi164.stdout:9/314: fdatasync d3/f1f 0 2024-04-20T21:58:55.937 INFO:tasks.workunit.client.1.smithi164.stdout:5/287: dwrite dc/d2b/f3f [0,4194304] 0 2024-04-20T21:58:55.939 INFO:tasks.workunit.client.1.smithi164.stdout:9/315: truncate d3/db/dd/f14 2371430 0 2024-04-20T21:58:55.942 INFO:tasks.workunit.client.1.smithi164.stdout:1/248: truncate d10/f12 4183300 0 2024-04-20T21:58:55.942 INFO:tasks.workunit.client.1.smithi164.stdout:9/316: write d3/db/d1b/d1e/f25 [938934,29448] 0 2024-04-20T21:58:55.948 INFO:tasks.workunit.client.1.smithi164.stdout:6/319: unlink d0/d3/f56 0 2024-04-20T21:58:55.949 INFO:tasks.workunit.client.1.smithi164.stdout:6/320: readlink d0/l17 0 2024-04-20T21:58:55.955 INFO:tasks.workunit.client.1.smithi164.stdout:0/253: truncate d1/d4/df/f2f 4123054 0 2024-04-20T21:58:55.956 INFO:tasks.workunit.client.1.smithi164.stdout:0/254: chown d1/f42 2 1 2024-04-20T21:58:55.961 INFO:tasks.workunit.client.1.smithi164.stdout:9/317: write d3/f1f [981037,110691] 0 2024-04-20T21:58:55.963 INFO:tasks.workunit.client.1.smithi164.stdout:9/318: chown d3/db/dd/d40/d2a/d36/l53 124965 1 2024-04-20T21:58:56.001 INFO:tasks.workunit.client.1.smithi164.stdout:3/310: getdents d12/d20/d39 0 2024-04-20T21:58:56.001 INFO:tasks.workunit.client.1.smithi164.stdout:0/255: write d1/d4/da/d27/f32 [126103,34253] 0 2024-04-20T21:58:56.002 INFO:tasks.workunit.client.1.smithi164.stdout:3/311: fdatasync f10 0 2024-04-20T21:58:56.006 INFO:tasks.workunit.client.1.smithi164.stdout:1/249: mkdir d10/d33/d4d 0 2024-04-20T21:58:56.008 INFO:tasks.workunit.client.1.smithi164.stdout:9/319: rename d3/db/c22 to d3/db/dd/d40/d2a/c71 0 2024-04-20T21:58:56.012 INFO:tasks.workunit.client.1.smithi164.stdout:1/250: write d10/f11 [969403,7946] 0 2024-04-20T21:58:56.016 INFO:tasks.workunit.client.1.smithi164.stdout:5/288: dwrite dc/d12/d1e/f51 [0,4194304] 0 2024-04-20T21:58:56.016 INFO:tasks.workunit.client.1.smithi164.stdout:9/320: chown d3/db/dd/l29 270153987 1 2024-04-20T21:58:56.016 INFO:tasks.workunit.client.1.smithi164.stdout:3/312: rename d12/d20/d39/d55/f58 to d12/d20/d39/f5d 0 2024-04-20T21:58:56.022 INFO:tasks.workunit.client.1.smithi164.stdout:5/289: truncate dc/d2c/f4f 3369 0 2024-04-20T21:58:56.024 INFO:tasks.workunit.client.1.smithi164.stdout:3/313: rename d12/l52 to d12/l5e 0 2024-04-20T21:58:56.026 INFO:tasks.workunit.client.1.smithi164.stdout:3/314: read - d12/f5a zero size 2024-04-20T21:58:56.030 INFO:tasks.workunit.client.1.smithi164.stdout:5/290: creat dc/d2b/d52/f62 x:0 0 0 2024-04-20T21:58:56.032 INFO:tasks.workunit.client.1.smithi164.stdout:0/256: dwrite d1/d4/df/f3b [0,4194304] 0 2024-04-20T21:58:56.034 INFO:tasks.workunit.client.1.smithi164.stdout:5/291: chown dc/d2c/c4c 1801721 1 2024-04-20T21:58:56.034 INFO:tasks.workunit.client.1.smithi164.stdout:1/251: creat d10/d16/d19/f4e x:0 0 0 2024-04-20T21:58:56.035 INFO:tasks.workunit.client.1.smithi164.stdout:0/257: stat d1/d4/da/d27 0 2024-04-20T21:58:56.035 INFO:tasks.workunit.client.1.smithi164.stdout:5/292: rename dc to dc/d2c/d63 22 2024-04-20T21:58:56.036 INFO:tasks.workunit.client.1.smithi164.stdout:5/293: chown dc/d2c 13 1 2024-04-20T21:58:56.043 INFO:tasks.workunit.client.1.smithi164.stdout:5/294: unlink dc/d12/d1e/f51 0 2024-04-20T21:58:56.044 INFO:tasks.workunit.client.1.smithi164.stdout:5/295: chown dc/d2c/f43 2230 1 2024-04-20T21:58:56.045 INFO:tasks.workunit.client.1.smithi164.stdout:0/258: creat d1/d4/d49/f4b x:0 0 0 2024-04-20T21:58:56.050 INFO:tasks.workunit.client.1.smithi164.stdout:9/321: dwrite d3/db/d4f/f62 [0,4194304] 0 2024-04-20T21:58:56.052 INFO:tasks.workunit.client.1.smithi164.stdout:0/259: write d1/d4/da/d1f/d3c/f3d [741238,114784] 0 2024-04-20T21:58:56.054 INFO:tasks.workunit.client.1.smithi164.stdout:5/296: mkdir dc/d2b/d52/d64 0 2024-04-20T21:58:56.058 INFO:tasks.workunit.client.1.smithi164.stdout:0/260: chown d1/d4/da/d1f/d3c 4578101 1 2024-04-20T21:58:56.059 INFO:tasks.workunit.client.1.smithi164.stdout:5/297: truncate dc/d2c/d2e/f31 3872392 0 2024-04-20T21:58:56.065 INFO:tasks.workunit.client.1.smithi164.stdout:6/321: truncate d0/f6 3658175 0 2024-04-20T21:58:56.067 INFO:tasks.workunit.client.1.smithi164.stdout:9/322: dread d3/db/dd/f5d [0,4194304] 0 2024-04-20T21:58:56.068 INFO:tasks.workunit.client.1.smithi164.stdout:6/322: chown d0/d3/d15/d21/d5c/c6c 22574 1 2024-04-20T21:58:56.068 INFO:tasks.workunit.client.1.smithi164.stdout:5/298: rename dc/d2b/f27 to dc/d41/f65 0 2024-04-20T21:58:56.073 INFO:tasks.workunit.client.1.smithi164.stdout:9/323: read - d3/db/dd/d40/d2a/f3a zero size 2024-04-20T21:58:56.075 INFO:tasks.workunit.client.1.smithi164.stdout:6/323: rename d0/d3/d8/d28/d3d to d0/d3/d11/d29/d6e 0 2024-04-20T21:58:56.087 INFO:tasks.workunit.client.1.smithi164.stdout:0/261: dwrite d1/f42 [0,4194304] 0 2024-04-20T21:58:56.089 INFO:tasks.workunit.client.1.smithi164.stdout:1/252: rmdir d10/d16 39 2024-04-20T21:58:56.090 INFO:tasks.workunit.client.1.smithi164.stdout:0/262: readlink d1/l1e 0 2024-04-20T21:58:56.091 INFO:tasks.workunit.client.1.smithi164.stdout:9/324: link d3/db/dd/d40/d2a/c35 d3/db/dd/d40/c72 0 2024-04-20T21:58:56.094 INFO:tasks.workunit.client.1.smithi164.stdout:5/299: dwrite dc/d12/f18 [0,4194304] 0 2024-04-20T21:58:56.099 INFO:tasks.workunit.client.1.smithi164.stdout:9/325: creat d3/db/d1b/d1e/f73 x:0 0 0 2024-04-20T21:58:56.102 INFO:tasks.workunit.client.1.smithi164.stdout:0/263: mknod d1/d4/c4c 0 2024-04-20T21:58:56.103 INFO:tasks.workunit.client.1.smithi164.stdout:5/300: creat dc/f66 x:0 0 0 2024-04-20T21:58:56.104 INFO:tasks.workunit.client.1.smithi164.stdout:5/301: stat dc/d2c 0 2024-04-20T21:58:56.106 INFO:tasks.workunit.client.1.smithi164.stdout:0/264: write d1/d4/d26/f46 [497169,101097] 0 2024-04-20T21:58:56.108 INFO:tasks.workunit.client.1.smithi164.stdout:1/253: rename f0 to d10/d33/d48/f4f 0 2024-04-20T21:58:56.111 INFO:tasks.workunit.client.1.smithi164.stdout:9/326: symlink d3/db/d4f/l74 0 2024-04-20T21:58:56.117 INFO:tasks.workunit.client.1.smithi164.stdout:6/324: dread d0/d3/f1b [0,4194304] 0 2024-04-20T21:58:56.119 INFO:tasks.workunit.client.1.smithi164.stdout:9/327: mkdir d3/db/dd/d75 0 2024-04-20T21:58:56.122 INFO:tasks.workunit.client.1.smithi164.stdout:0/265: dwrite d1/f23 [0,4194304] 0 2024-04-20T21:58:56.123 INFO:tasks.workunit.client.1.smithi164.stdout:0/266: stat d1/f12 0 2024-04-20T21:58:56.123 INFO:tasks.workunit.client.1.smithi164.stdout:6/325: dread d0/d3/d15/d23/f48 [0,4194304] 0 2024-04-20T21:58:56.127 INFO:tasks.workunit.client.1.smithi164.stdout:5/302: rename dc/l29 to dc/d2c/d2e/l67 0 2024-04-20T21:58:56.129 INFO:tasks.workunit.client.1.smithi164.stdout:5/303: fsync f4 0 2024-04-20T21:58:56.132 INFO:tasks.workunit.client.1.smithi164.stdout:9/328: creat d3/f76 x:0 0 0 2024-04-20T21:58:56.134 INFO:tasks.workunit.client.1.smithi164.stdout:0/267: rename d1/d4/df/l17 to d1/d4/da/l4d 0 2024-04-20T21:58:56.136 INFO:tasks.workunit.client.1.smithi164.stdout:5/304: creat dc/d41/d4e/f68 x:0 0 0 2024-04-20T21:58:56.137 INFO:tasks.workunit.client.1.smithi164.stdout:5/305: fsync dc/d12/f13 0 2024-04-20T21:58:56.137 INFO:tasks.workunit.client.1.smithi164.stdout:1/254: dwrite d10/d16/d20/f2f [0,4194304] 0 2024-04-20T21:58:56.139 INFO:tasks.workunit.client.1.smithi164.stdout:9/329: creat d3/db/dd/d40/d2a/f77 x:0 0 0 2024-04-20T21:58:56.144 INFO:tasks.workunit.client.1.smithi164.stdout:5/306: mknod dc/d2b/d52/c69 0 2024-04-20T21:58:56.146 INFO:tasks.workunit.client.1.smithi164.stdout:1/255: symlink d10/d16/d20/l50 0 2024-04-20T21:58:56.149 INFO:tasks.workunit.client.1.smithi164.stdout:1/256: write d10/d16/d19/d1a/f32 [1075958,53179] 0 2024-04-20T21:58:56.151 INFO:tasks.workunit.client.1.smithi164.stdout:5/307: mknod dc/d12/c6a 0 2024-04-20T21:58:56.155 INFO:tasks.workunit.client.1.smithi164.stdout:5/308: symlink dc/d41/d4e/l6b 0 2024-04-20T21:58:56.155 INFO:tasks.workunit.client.1.smithi164.stdout:0/268: dwrite d1/d4/d26/f46 [0,4194304] 0 2024-04-20T21:58:56.157 INFO:tasks.workunit.client.1.smithi164.stdout:5/309: fdatasync dc/d12/f13 0 2024-04-20T21:58:56.160 INFO:tasks.workunit.client.1.smithi164.stdout:9/330: dwrite d3/db/dd/d40/f56 [0,4194304] 0 2024-04-20T21:58:56.164 INFO:tasks.workunit.client.1.smithi164.stdout:1/257: mkdir d10/d16/d19/d1a/d51 0 2024-04-20T21:58:56.170 INFO:tasks.workunit.client.1.smithi164.stdout:9/331: write d3/db/dd/d40/d2a/f77 [469741,13763] 0 2024-04-20T21:58:56.172 INFO:tasks.workunit.client.1.smithi164.stdout:5/310: unlink dc/d2c/f54 0 2024-04-20T21:58:56.172 INFO:tasks.workunit.client.1.smithi164.stdout:2/259: sync 2024-04-20T21:58:56.178 INFO:tasks.workunit.client.1.smithi164.stdout:9/332: write d3/db/dd/f45 [3944883,4399] 0 2024-04-20T21:58:56.178 INFO:tasks.workunit.client.1.smithi164.stdout:0/269: dwrite d1/d4/d49/f4b [0,4194304] 0 2024-04-20T21:58:56.180 INFO:tasks.workunit.client.1.smithi164.stdout:2/260: read - d2/d5/d3a/f4c zero size 2024-04-20T21:58:56.184 INFO:tasks.workunit.client.1.smithi164.stdout:0/270: read d1/f23 [825113,87876] 0 2024-04-20T21:58:56.186 INFO:tasks.workunit.client.1.smithi164.stdout:9/333: dread - d3/db/d1b/d1e/f73 zero size 2024-04-20T21:58:56.190 INFO:tasks.workunit.client.1.smithi164.stdout:1/258: dwrite d10/d16/f27 [0,4194304] 0 2024-04-20T21:58:56.191 INFO:tasks.workunit.client.1.smithi164.stdout:2/261: creat d2/d5/d21/f4f x:0 0 0 2024-04-20T21:58:56.193 INFO:tasks.workunit.client.1.smithi164.stdout:1/259: readlink d10/d16/d19/l24 0 2024-04-20T21:58:56.194 INFO:tasks.workunit.client.1.smithi164.stdout:2/262: chown d2/d5/d3a/f43 9363233 1 2024-04-20T21:58:56.195 INFO:tasks.workunit.client.1.smithi164.stdout:1/260: write d10/d33/f46 [956042,70162] 0 2024-04-20T21:58:56.196 INFO:tasks.workunit.client.1.smithi164.stdout:0/271: creat d1/d4/da/d1f/d3c/f4e x:0 0 0 2024-04-20T21:58:56.197 INFO:tasks.workunit.client.1.smithi164.stdout:2/263: chown d2/d19/d28/d3e 322962309 1 2024-04-20T21:58:56.202 INFO:tasks.workunit.client.1.smithi164.stdout:9/334: getdents d3/db 0 2024-04-20T21:58:56.203 INFO:tasks.workunit.client.1.smithi164.stdout:2/264: readlink d2/d19/l4d 0 2024-04-20T21:58:56.203 INFO:tasks.workunit.client.1.smithi164.stdout:0/272: fdatasync d1/d4/df/f2f 0 2024-04-20T21:58:56.204 INFO:tasks.workunit.client.1.smithi164.stdout:5/311: dwrite dc/d2c/d2e/f60 [4194304,4194304] 0 2024-04-20T21:58:56.210 INFO:tasks.workunit.client.1.smithi164.stdout:9/335: chown d3/db/dd/d40/d2a/d36/f64 48 1 2024-04-20T21:58:56.210 INFO:tasks.workunit.client.1.smithi164.stdout:2/265: mknod d2/d5/c50 0 2024-04-20T21:58:56.213 INFO:tasks.workunit.client.1.smithi164.stdout:1/261: dread d10/d16/d20/f2f [0,4194304] 0 2024-04-20T21:58:56.215 INFO:tasks.workunit.client.1.smithi164.stdout:9/336: mkdir d3/db/dd/d40/d78 0 2024-04-20T21:58:56.226 INFO:tasks.workunit.client.1.smithi164.stdout:0/273: getdents d1/d4/d26/d29/d2d 0 2024-04-20T21:58:56.228 INFO:tasks.workunit.client.1.smithi164.stdout:0/274: truncate d1/d4/df/f3b 4866983 0 2024-04-20T21:58:56.230 INFO:tasks.workunit.client.1.smithi164.stdout:1/262: truncate d10/d33/f3f 3522855 0 2024-04-20T21:58:56.270 INFO:tasks.workunit.client.1.smithi164.stdout:1/263: write d10/d16/d19/f4e [965332,23111] 0 2024-04-20T21:58:56.275 INFO:tasks.workunit.client.1.smithi164.stdout:9/337: dwrite d3/db/d1b/f34 [0,4194304] 0 2024-04-20T21:58:56.276 INFO:tasks.workunit.client.1.smithi164.stdout:5/312: dread dc/f1a [0,4194304] 0 2024-04-20T21:58:56.281 INFO:tasks.workunit.client.1.smithi164.stdout:9/338: write d3/db/dd/d40/f56 [84746,77829] 0 2024-04-20T21:58:56.281 INFO:tasks.workunit.client.1.smithi164.stdout:0/275: dwrite d1/d4/d26/f46 [0,4194304] 0 2024-04-20T21:58:56.289 INFO:tasks.workunit.client.1.smithi164.stdout:9/339: creat d3/db/d1b/d1e/f79 x:0 0 0 2024-04-20T21:58:56.290 INFO:tasks.workunit.client.1.smithi164.stdout:5/313: getdents dc/d41/d4e 0 2024-04-20T21:58:56.292 INFO:tasks.workunit.client.1.smithi164.stdout:0/276: symlink d1/d4/da/d27/d33/l4f 0 2024-04-20T21:58:56.295 INFO:tasks.workunit.client.1.smithi164.stdout:5/314: mknod dc/d2c/d2e/d30/d5e/c6c 0 2024-04-20T21:58:56.296 INFO:tasks.workunit.client.1.smithi164.stdout:0/277: readlink d1/d4/d26/l3a 0 2024-04-20T21:58:56.299 INFO:tasks.workunit.client.1.smithi164.stdout:5/315: write dc/d2c/d2e/f46 [2766139,23427] 0 2024-04-20T21:58:56.300 INFO:tasks.workunit.client.1.smithi164.stdout:0/278: rmdir d1/d4/d26/d29/d2d 39 2024-04-20T21:58:56.302 INFO:tasks.workunit.client.1.smithi164.stdout:0/279: chown d1/d4/d20/l34 940138802 1 2024-04-20T21:58:56.305 INFO:tasks.workunit.client.1.smithi164.stdout:9/340: dwrite d3/f41 [0,4194304] 0 2024-04-20T21:58:56.309 INFO:tasks.workunit.client.1.smithi164.stdout:0/280: mknod d1/d4/d26/c50 0 2024-04-20T21:58:56.311 INFO:tasks.workunit.client.1.smithi164.stdout:9/341: mknod d3/db/d4f/d67/c7a 0 2024-04-20T21:58:56.312 INFO:tasks.workunit.client.1.smithi164.stdout:0/281: write d1/d4/da/d1f/d3c/f4e [100601,14910] 0 2024-04-20T21:58:56.313 INFO:tasks.workunit.client.1.smithi164.stdout:5/316: getdents dc/d2c/d2e 0 2024-04-20T21:58:56.314 INFO:tasks.workunit.client.1.smithi164.stdout:9/342: stat d3/db/dd/d40/d2a/f3a 0 2024-04-20T21:58:56.317 INFO:tasks.workunit.client.1.smithi164.stdout:5/317: mkdir dc/d2b/d6d 0 2024-04-20T21:58:56.317 INFO:tasks.workunit.client.1.smithi164.stdout:0/282: dread d1/f12 [4194304,4194304] 0 2024-04-20T21:58:56.319 INFO:tasks.workunit.client.1.smithi164.stdout:9/343: rename d3/db/f10 to d3/db/dd/d40/d2a/d36/f7b 0 2024-04-20T21:58:56.320 INFO:tasks.workunit.client.1.smithi164.stdout:5/318: truncate dc/d41/d4e/f68 1019055 0 2024-04-20T21:58:56.322 INFO:tasks.workunit.client.1.smithi164.stdout:4/271: sync 2024-04-20T21:58:56.326 INFO:tasks.workunit.client.1.smithi164.stdout:4/272: creat d4/d28/f61 x:0 0 0 2024-04-20T21:58:56.329 INFO:tasks.workunit.client.1.smithi164.stdout:0/283: dread d1/f42 [0,4194304] 0 2024-04-20T21:58:56.329 INFO:tasks.workunit.client.1.smithi164.stdout:4/273: rmdir d4/d28/d3e 39 2024-04-20T21:58:56.335 INFO:tasks.workunit.client.1.smithi164.stdout:0/284: symlink d1/d4/da/d1f/l51 0 2024-04-20T21:58:56.336 INFO:tasks.workunit.client.1.smithi164.stdout:4/274: mknod d4/d9/d27/d37/c62 0 2024-04-20T21:58:56.338 INFO:tasks.workunit.client.1.smithi164.stdout:5/319: dwrite dc/d2c/d2e/f60 [4194304,4194304] 0 2024-04-20T21:58:56.338 INFO:tasks.workunit.client.1.smithi164.stdout:9/344: creat d3/db/d1b/d20/d3f/f7c x:0 0 0 2024-04-20T21:58:56.340 INFO:tasks.workunit.client.1.smithi164.stdout:0/285: mknod d1/d4/d49/c52 0 2024-04-20T21:58:56.341 INFO:tasks.workunit.client.1.smithi164.stdout:4/275: creat d4/d9/d27/d3f/f63 x:0 0 0 2024-04-20T21:58:56.342 INFO:tasks.workunit.client.1.smithi164.stdout:0/286: truncate d1/d4/f28 4842903 0 2024-04-20T21:58:56.343 INFO:tasks.workunit.client.1.smithi164.stdout:9/345: write d3/db/dd/d40/f56 [2420528,45969] 0 2024-04-20T21:58:56.346 INFO:tasks.workunit.client.1.smithi164.stdout:5/320: link l1 dc/d41/l6e 0 2024-04-20T21:58:56.347 INFO:tasks.workunit.client.1.smithi164.stdout:5/321: write dc/d2b/f3f [2068685,49416] 0 2024-04-20T21:58:56.347 INFO:tasks.workunit.client.1.smithi164.stdout:9/346: creat d3/db/d1b/d20/f7d x:0 0 0 2024-04-20T21:58:56.349 INFO:tasks.workunit.client.1.smithi164.stdout:0/287: mknod d1/d4/d26/d29/c53 0 2024-04-20T21:58:56.350 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:56 smithi142 ceph-mon[15828]: pgmap v5: 65 pgs: 65 active+clean; 2.4 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail 2024-04-20T21:58:56.350 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:56 smithi142 ceph-mon[15828]: mgrmap e29: smithi142.zzmcfz(active, since 4s) 2024-04-20T21:58:56.355 INFO:tasks.workunit.client.1.smithi164.stdout:5/322: rename dc/f1a to dc/d2b/d6d/f6f 0 2024-04-20T21:58:56.356 INFO:tasks.workunit.client.1.smithi164.stdout:5/323: dread - dc/f66 zero size 2024-04-20T21:58:56.357 INFO:tasks.workunit.client.1.smithi164.stdout:9/347: symlink d3/db/d1b/d20/l7e 0 2024-04-20T21:58:56.369 INFO:tasks.workunit.client.1.smithi164.stdout:4/276: getdents d4/d28/d3e 0 2024-04-20T21:58:56.370 INFO:tasks.workunit.client.1.smithi164.stdout:5/324: mknod dc/d2b/d52/d64/c70 0 2024-04-20T21:58:56.371 INFO:tasks.workunit.client.1.smithi164.stdout:5/325: chown f8 166313210 1 2024-04-20T21:58:56.373 INFO:tasks.workunit.client.1.smithi164.stdout:6/326: sync 2024-04-20T21:58:56.373 INFO:tasks.workunit.client.1.smithi164.stdout:7/263: sync 2024-04-20T21:58:56.373 INFO:tasks.workunit.client.1.smithi164.stdout:3/315: sync 2024-04-20T21:58:56.373 INFO:tasks.workunit.client.1.smithi164.stdout:8/235: sync 2024-04-20T21:58:56.373 INFO:tasks.workunit.client.1.smithi164.stdout:9/348: rename d3/db/d4f/d67/c7a to d3/c7f 0 2024-04-20T21:58:56.378 INFO:tasks.workunit.client.1.smithi164.stdout:6/327: mkdir d0/d3/d8/d28/d6f 0 2024-04-20T21:58:56.380 INFO:tasks.workunit.client.1.smithi164.stdout:7/264: rename d2/f1b to d2/d55/f58 0 2024-04-20T21:58:56.381 INFO:tasks.workunit.client.1.smithi164.stdout:0/288: dread d1/d4/da/f2e [0,4194304] 0 2024-04-20T21:58:56.382 INFO:tasks.workunit.client.1.smithi164.stdout:7/265: write d2/f29 [4420890,85945] 0 2024-04-20T21:58:56.386 INFO:tasks.workunit.client.1.smithi164.stdout:9/349: unlink d3/c4 0 2024-04-20T21:58:56.389 INFO:tasks.workunit.client.1.smithi164.stdout:9/350: write d3/db/dd/d40/d2a/d36/f48 [1863184,74548] 0 2024-04-20T21:58:56.389 INFO:tasks.workunit.client.1.smithi164.stdout:3/316: creat d12/f5f x:0 0 0 2024-04-20T21:58:56.391 INFO:tasks.workunit.client.1.smithi164.stdout:5/326: dwrite dc/d2c/f4f [0,4194304] 0 2024-04-20T21:58:56.397 INFO:tasks.workunit.client.1.smithi164.stdout:4/277: getdents d4/d9/d22 0 2024-04-20T21:58:56.397 INFO:tasks.workunit.client.1.smithi164.stdout:8/236: truncate d0/d1e/f43 139806 0 2024-04-20T21:58:56.403 INFO:tasks.workunit.client.1.smithi164.stdout:7/266: rename d2/c2f to d2/d21/d44/c59 0 2024-04-20T21:58:56.404 INFO:tasks.workunit.client.1.smithi164.stdout:7/267: chown d2/d21/d24/d50 0 1 2024-04-20T21:58:56.410 INFO:tasks.workunit.client.1.smithi164.stdout:9/351: creat d3/db/d1b/d20/d3f/f80 x:0 0 0 2024-04-20T21:58:56.411 INFO:tasks.workunit.client.1.smithi164.stdout:5/327: write f5 [1752715,510] 0 2024-04-20T21:58:56.413 INFO:tasks.workunit.client.1.smithi164.stdout:8/237: chown d0/d14/f4f 3 1 2024-04-20T21:58:56.414 INFO:tasks.workunit.client.1.smithi164.stdout:0/289: mkdir d1/d4/d26/d29/d2d/d54 0 2024-04-20T21:58:56.417 INFO:tasks.workunit.client.1.smithi164.stdout:7/268: unlink d2/d21/d24/d31/d3a/f3d 0 2024-04-20T21:58:56.417 INFO:tasks.workunit.client.1.smithi164.stdout:7/269: stat d2/l19 0 2024-04-20T21:58:56.417 INFO:tasks.workunit.client.1.smithi164.stdout:6/328: dread d0/d3/d11/f49 [0,4194304] 0 2024-04-20T21:58:56.417 INFO:tasks.workunit.client.1.smithi164.stdout:9/352: dread d3/db/dd/f5d [0,4194304] 0 2024-04-20T21:58:56.418 INFO:tasks.workunit.client.1.smithi164.stdout:6/329: readlink d0/l51 0 2024-04-20T21:58:56.419 INFO:tasks.workunit.client.1.smithi164.stdout:4/278: mknod d4/d9/d5c/c64 0 2024-04-20T21:58:56.423 INFO:tasks.workunit.client.1.smithi164.stdout:0/290: symlink d1/d4/d26/d29/d2d/l55 0 2024-04-20T21:58:56.425 INFO:tasks.workunit.client.1.smithi164.stdout:7/270: mknod d2/c5a 0 2024-04-20T21:58:56.427 INFO:tasks.workunit.client.1.smithi164.stdout:0/291: write d1/d4/d49/f4b [3376554,48122] 0 2024-04-20T21:58:56.427 INFO:tasks.workunit.client.1.smithi164.stdout:6/330: read d0/d3/fb [2695173,126410] 0 2024-04-20T21:58:56.427 INFO:tasks.workunit.client.1.smithi164.stdout:3/317: creat d12/f60 x:0 0 0 2024-04-20T21:58:56.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:56 smithi164 ceph-mon[23506]: pgmap v5: 65 pgs: 65 active+clean; 2.4 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail 2024-04-20T21:58:56.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:56 smithi164 ceph-mon[23506]: mgrmap e29: smithi142.zzmcfz(active, since 4s) 2024-04-20T21:58:56.448 INFO:tasks.workunit.client.1.smithi164.stdout:5/328: symlink dc/d2b/d53/l71 0 2024-04-20T21:58:56.451 INFO:tasks.workunit.client.1.smithi164.stdout:5/329: fsync dc/d2c/f4f 0 2024-04-20T21:58:56.452 INFO:tasks.workunit.client.1.smithi164.stdout:0/292: fsync d1/d4/df/f3b 0 2024-04-20T21:58:56.455 INFO:tasks.workunit.client.1.smithi164.stdout:9/353: dwrite d3/f9 [0,4194304] 0 2024-04-20T21:58:56.460 INFO:tasks.workunit.client.1.smithi164.stdout:9/354: read d3/fa [11427,95938] 0 2024-04-20T21:58:56.461 INFO:tasks.workunit.client.1.smithi164.stdout:5/330: mkdir dc/d2c/d2e/d30/d72 0 2024-04-20T21:58:56.462 INFO:tasks.workunit.client.1.smithi164.stdout:7/271: dread d2/d21/f25 [0,4194304] 0 2024-04-20T21:58:56.464 INFO:tasks.workunit.client.1.smithi164.stdout:4/279: dread d4/f1d [0,4194304] 0 2024-04-20T21:58:56.465 INFO:tasks.workunit.client.1.smithi164.stdout:4/280: read - d4/d28/d3e/f59 zero size 2024-04-20T21:58:56.466 INFO:tasks.workunit.client.1.smithi164.stdout:3/318: creat d12/d20/f61 x:0 0 0 2024-04-20T21:58:56.468 INFO:tasks.workunit.client.1.smithi164.stdout:3/319: stat d12/f5f 0 2024-04-20T21:58:56.468 INFO:tasks.workunit.client.1.smithi164.stdout:4/281: dread - d4/d9/d27/d3f/f63 zero size 2024-04-20T21:58:56.468 INFO:tasks.workunit.client.1.smithi164.stdout:6/331: dread d0/d3/d11/d29/f46 [0,4194304] 0 2024-04-20T21:58:56.469 INFO:tasks.workunit.client.1.smithi164.stdout:5/331: readlink dc/l1d 0 2024-04-20T21:58:56.470 INFO:tasks.workunit.client.1.smithi164.stdout:3/320: write d12/d15/f1c [769126,74611] 0 2024-04-20T21:58:56.472 INFO:tasks.workunit.client.1.smithi164.stdout:5/332: read f5 [1143524,22978] 0 2024-04-20T21:58:56.472 INFO:tasks.workunit.client.1.smithi164.stdout:9/355: chown d3/db/dd/d40/d2a/f77 14951 1 2024-04-20T21:58:56.472 INFO:tasks.workunit.client.1.smithi164.stdout:3/321: fsync d12/d15/f21 0 2024-04-20T21:58:56.473 INFO:tasks.workunit.client.1.smithi164.stdout:0/293: getdents d1/d4/da 0 2024-04-20T21:58:56.474 INFO:tasks.workunit.client.1.smithi164.stdout:4/282: getdents d4/d9/d27/d3f/d5f 0 2024-04-20T21:58:56.475 INFO:tasks.workunit.client.1.smithi164.stdout:3/322: chown d12/d15/l3f 199623 1 2024-04-20T21:58:56.476 INFO:tasks.workunit.client.1.smithi164.stdout:4/283: chown d4/f1d 169432 1 2024-04-20T21:58:56.477 INFO:tasks.workunit.client.1.smithi164.stdout:6/332: rename d0/d3/d11/d29/f4d to d0/d3/d15/d23/d45/d4f/f70 0 2024-04-20T21:58:56.479 INFO:tasks.workunit.client.1.smithi164.stdout:0/294: rmdir d1/d4/d26/d29 39 2024-04-20T21:58:56.481 INFO:tasks.workunit.client.1.smithi164.stdout:4/284: write d4/d28/d3e/d41/f4b [542957,122734] 0 2024-04-20T21:58:56.483 INFO:tasks.workunit.client.1.smithi164.stdout:6/333: link d0/lf d0/d3/d15/d23/d45/d69/l71 0 2024-04-20T21:58:56.484 INFO:tasks.workunit.client.1.smithi164.stdout:3/323: getdents d12/d20/d39/d55 0 2024-04-20T21:58:56.487 INFO:tasks.workunit.client.1.smithi164.stdout:3/324: unlink d12/d20/f30 0 2024-04-20T21:58:56.488 INFO:tasks.workunit.client.1.smithi164.stdout:4/285: link d4/c8 d4/d9/d27/d3f/d5f/c65 0 2024-04-20T21:58:56.494 INFO:tasks.workunit.client.1.smithi164.stdout:3/325: dread d12/d20/d39/f4b [0,4194304] 0 2024-04-20T21:58:56.497 INFO:tasks.workunit.client.1.smithi164.stdout:3/326: dread - d12/d15/f21 zero size 2024-04-20T21:58:56.500 INFO:tasks.workunit.client.1.smithi164.stdout:5/333: dread dc/f16 [0,4194304] 0 2024-04-20T21:58:56.500 INFO:tasks.workunit.client.1.smithi164.stdout:6/334: dwrite d0/d3/d11/f39 [0,4194304] 0 2024-04-20T21:58:56.501 INFO:tasks.workunit.client.1.smithi164.stdout:3/327: creat d12/d20/d39/f62 x:0 0 0 2024-04-20T21:58:56.503 INFO:tasks.workunit.client.1.smithi164.stdout:3/328: chown d12/d20/c27 32026 1 2024-04-20T21:58:56.503 INFO:tasks.workunit.client.1.smithi164.stdout:5/334: mkdir dc/d2b/d6d/d73 0 2024-04-20T21:58:56.503 INFO:tasks.workunit.client.1.smithi164.stdout:6/335: dread - d0/d3/d8/f1f zero size 2024-04-20T21:58:56.505 INFO:tasks.workunit.client.1.smithi164.stdout:5/335: fdatasync dc/f24 0 2024-04-20T21:58:56.505 INFO:tasks.workunit.client.1.smithi164.stdout:6/336: chown d0/f16 196 1 2024-04-20T21:58:56.508 INFO:tasks.workunit.client.1.smithi164.stdout:6/337: fdatasync d0/d3/d15/d21/d4b/f4e 0 2024-04-20T21:58:56.509 INFO:tasks.workunit.client.1.smithi164.stdout:5/336: creat dc/d2c/d2e/d30/f74 x:0 0 0 2024-04-20T21:58:56.509 INFO:tasks.workunit.client.1.smithi164.stdout:4/286: dread d4/f15 [0,4194304] 0 2024-04-20T21:58:56.510 INFO:tasks.workunit.client.1.smithi164.stdout:2/266: sync 2024-04-20T21:58:56.510 INFO:tasks.workunit.client.1.smithi164.stdout:1/264: sync 2024-04-20T21:58:56.513 INFO:tasks.workunit.client.1.smithi164.stdout:4/287: mknod d4/c66 0 2024-04-20T21:58:56.515 INFO:tasks.workunit.client.1.smithi164.stdout:5/337: mknod dc/d2b/d52/c75 0 2024-04-20T21:58:56.517 INFO:tasks.workunit.client.1.smithi164.stdout:2/267: creat d2/d19/f51 x:0 0 0 2024-04-20T21:58:56.518 INFO:tasks.workunit.client.1.smithi164.stdout:4/288: read - d4/d9/d27/f35 zero size 2024-04-20T21:58:56.520 INFO:tasks.workunit.client.1.smithi164.stdout:6/338: rename d0/f37 to d0/d3/d15/d23/d45/d4f/d61/f72 0 2024-04-20T21:58:56.521 INFO:tasks.workunit.client.1.smithi164.stdout:5/338: creat dc/d2b/d52/f76 x:0 0 0 2024-04-20T21:58:56.526 INFO:tasks.workunit.client.1.smithi164.stdout:1/265: creat d10/d16/d19/f52 x:0 0 0 2024-04-20T21:58:56.529 INFO:tasks.workunit.client.1.smithi164.stdout:3/329: dwrite d12/d15/f21 [0,4194304] 0 2024-04-20T21:58:56.531 INFO:tasks.workunit.client.1.smithi164.stdout:3/330: dread - d12/d20/d39/f56 zero size 2024-04-20T21:58:56.531 INFO:tasks.workunit.client.1.smithi164.stdout:4/289: unlink d4/d9/d27/f29 0 2024-04-20T21:58:56.533 INFO:tasks.workunit.client.1.smithi164.stdout:5/339: creat dc/d2c/d2e/d30/f77 x:0 0 0 2024-04-20T21:58:56.544 INFO:tasks.workunit.client.1.smithi164.stdout:2/268: dwrite d2/f20 [0,4194304] 0 2024-04-20T21:58:56.548 INFO:tasks.workunit.client.1.smithi164.stdout:5/340: unlink c0 0 2024-04-20T21:58:56.552 INFO:tasks.workunit.client.1.smithi164.stdout:9/356: dwrite d3/fa [0,4194304] 0 2024-04-20T21:58:56.553 INFO:tasks.workunit.client.1.smithi164.stdout:5/341: chown dc/d2c/f4f 31 1 2024-04-20T21:58:56.557 INFO:tasks.workunit.client.1.smithi164.stdout:3/331: creat d12/d20/f63 x:0 0 0 2024-04-20T21:58:56.561 INFO:tasks.workunit.client.1.smithi164.stdout:5/342: mknod dc/d2b/d53/c78 0 2024-04-20T21:58:56.561 INFO:tasks.workunit.client.1.smithi164.stdout:3/332: truncate d12/d20/d39/f5d 633774 0 2024-04-20T21:58:56.568 INFO:tasks.workunit.client.1.smithi164.stdout:2/269: dwrite d2/d19/d28/f40 [0,4194304] 0 2024-04-20T21:58:56.569 INFO:tasks.workunit.client.1.smithi164.stdout:6/339: truncate d0/d3/d8/f3c 3164411 0 2024-04-20T21:58:56.573 INFO:tasks.workunit.client.1.smithi164.stdout:2/270: chown d2/f34 11 1 2024-04-20T21:58:56.581 INFO:tasks.workunit.client.1.smithi164.stdout:9/357: dwrite d3/db/d1b/d1e/f73 [0,4194304] 0 2024-04-20T21:58:56.583 INFO:tasks.workunit.client.1.smithi164.stdout:2/271: truncate d2/d19/d28/f47 4677304 0 2024-04-20T21:58:56.587 INFO:tasks.workunit.client.1.smithi164.stdout:6/340: link d0/d3/c2d d0/d3/d8/d28/d6f/c73 0 2024-04-20T21:58:56.587 INFO:tasks.workunit.client.1.smithi164.stdout:4/290: dwrite d4/d9/fc [0,4194304] 0 2024-04-20T21:58:56.588 INFO:tasks.workunit.client.1.smithi164.stdout:3/333: dwrite d12/d15/f37 [0,4194304] 0 2024-04-20T21:58:56.589 INFO:tasks.workunit.client.1.smithi164.stdout:1/266: dread d10/f15 [0,4194304] 0 2024-04-20T21:58:56.598 INFO:tasks.workunit.client.1.smithi164.stdout:3/334: creat d12/d2a/f64 x:0 0 0 2024-04-20T21:58:56.600 INFO:tasks.workunit.client.1.smithi164.stdout:6/341: rename d0/d3/d8/d28/d59 to d0/d3/d8/d28/d6f/d74 0 2024-04-20T21:58:56.601 INFO:tasks.workunit.client.1.smithi164.stdout:1/267: creat d10/d16/d20/d26/d34/f53 x:0 0 0 2024-04-20T21:58:56.604 INFO:tasks.workunit.client.1.smithi164.stdout:6/342: read - d0/d3/d15/d23/d3b/f57 zero size 2024-04-20T21:58:56.607 INFO:tasks.workunit.client.1.smithi164.stdout:2/272: dread d2/f1b [0,4194304] 0 2024-04-20T21:58:56.608 INFO:tasks.workunit.client.1.smithi164.stdout:3/335: rename d12/d2a/f36 to d12/d20/d39/f65 0 2024-04-20T21:58:56.614 INFO:tasks.workunit.client.1.smithi164.stdout:3/336: mknod d12/d20/d39/d55/c66 0 2024-04-20T21:58:56.615 INFO:tasks.workunit.client.1.smithi164.stdout:2/273: mknod d2/d19/d28/d3e/c52 0 2024-04-20T21:58:56.616 INFO:tasks.workunit.client.1.smithi164.stdout:6/343: mkdir d0/d3/d62/d75 0 2024-04-20T21:58:56.616 INFO:tasks.workunit.client.1.smithi164.stdout:2/274: readlink d2/l17 0 2024-04-20T21:58:56.620 INFO:tasks.workunit.client.1.smithi164.stdout:6/344: fdatasync d0/d3/d15/f5e 0 2024-04-20T21:58:56.621 INFO:tasks.workunit.client.1.smithi164.stdout:3/337: creat d12/f67 x:0 0 0 2024-04-20T21:58:56.622 INFO:tasks.workunit.client.1.smithi164.stdout:3/338: fdatasync d12/f1e 0 2024-04-20T21:58:56.626 INFO:tasks.workunit.client.1.smithi164.stdout:6/345: getdents d0/d3/d8/d28/d6f/d74 0 2024-04-20T21:58:56.627 INFO:tasks.workunit.client.1.smithi164.stdout:1/268: dread d10/d16/d19/d1a/f32 [0,4194304] 0 2024-04-20T21:58:56.629 INFO:tasks.workunit.client.1.smithi164.stdout:6/346: fsync d0/d3/f1c 0 2024-04-20T21:58:56.629 INFO:tasks.workunit.client.1.smithi164.stdout:5/343: dread dc/d2c/d2e/f46 [0,4194304] 0 2024-04-20T21:58:56.630 INFO:tasks.workunit.client.1.smithi164.stdout:3/339: dread d12/d20/d39/f4b [0,4194304] 0 2024-04-20T21:58:56.633 INFO:tasks.workunit.client.1.smithi164.stdout:5/344: rmdir dc/d2b 39 2024-04-20T21:58:56.634 INFO:tasks.workunit.client.1.smithi164.stdout:1/269: fdatasync d10/d16/d19/d1a/f32 0 2024-04-20T21:58:56.640 INFO:tasks.workunit.client.1.smithi164.stdout:1/270: write d10/d33/d48/f4f [2496726,104924] 0 2024-04-20T21:58:56.642 INFO:tasks.workunit.client.1.smithi164.stdout:5/345: chown dc/d2b/l44 6456 1 2024-04-20T21:58:56.644 INFO:tasks.workunit.client.1.smithi164.stdout:1/271: chown d10/d16/d19/d1a/l4a 40590082 1 2024-04-20T21:58:56.644 INFO:tasks.workunit.client.1.smithi164.stdout:3/340: getdents d12/d15 0 2024-04-20T21:58:56.646 INFO:tasks.workunit.client.1.smithi164.stdout:1/272: stat d10/d16/d19/d1a/c37 0 2024-04-20T21:58:56.652 INFO:tasks.workunit.client.1.smithi164.stdout:4/291: dread d4/f7 [0,4194304] 0 2024-04-20T21:58:56.652 INFO:tasks.workunit.client.1.smithi164.stdout:3/341: mkdir d12/d68 0 2024-04-20T21:58:56.653 INFO:tasks.workunit.client.1.smithi164.stdout:1/273: chown d10/d33/d41/c4c 381661813 1 2024-04-20T21:58:56.656 INFO:tasks.workunit.client.1.smithi164.stdout:5/346: link dc/d2b/d52/c69 dc/d12/c79 0 2024-04-20T21:58:56.658 INFO:tasks.workunit.client.1.smithi164.stdout:6/347: dwrite d0/d3/f10 [0,4194304] 0 2024-04-20T21:58:56.660 INFO:tasks.workunit.client.1.smithi164.stdout:1/274: mknod d10/d16/d19/c54 0 2024-04-20T21:58:56.660 INFO:tasks.workunit.client.1.smithi164.stdout:2/275: dread d2/d5/d3a/f43 [0,4194304] 0 2024-04-20T21:58:56.662 INFO:tasks.workunit.client.1.smithi164.stdout:6/348: write d0/d3/d8/f38 [5018852,21328] 0 2024-04-20T21:58:56.663 INFO:tasks.workunit.client.1.smithi164.stdout:2/276: chown d2/d19/c1e 1639 1 2024-04-20T21:58:56.663 INFO:tasks.workunit.client.1.smithi164.stdout:5/347: mkdir dc/d12/d1e/d7a 0 2024-04-20T21:58:56.664 INFO:tasks.workunit.client.1.smithi164.stdout:6/349: fdatasync d0/d3/fb 0 2024-04-20T21:58:56.666 INFO:tasks.workunit.client.1.smithi164.stdout:1/275: creat d10/d33/d41/f55 x:0 0 0 2024-04-20T21:58:56.666 INFO:tasks.workunit.client.1.smithi164.stdout:4/292: rmdir d4/d28/d3e/d41/d5e 0 2024-04-20T21:58:56.669 INFO:tasks.workunit.client.1.smithi164.stdout:5/348: unlink f4 0 2024-04-20T21:58:56.673 INFO:tasks.workunit.client.1.smithi164.stdout:2/277: mkdir d2/d19/d28/d3e/d53 0 2024-04-20T21:58:56.673 INFO:tasks.workunit.client.1.smithi164.stdout:4/293: mkdir d4/d9/d27/d3f/d67 0 2024-04-20T21:58:56.674 INFO:tasks.workunit.client.1.smithi164.stdout:3/342: dwrite d12/d15/f26 [0,4194304] 0 2024-04-20T21:58:56.675 INFO:tasks.workunit.client.1.smithi164.stdout:2/278: read d2/f1b [103596,2774] 0 2024-04-20T21:58:56.678 INFO:tasks.workunit.client.1.smithi164.stdout:5/349: mknod dc/d2b/d52/c7b 0 2024-04-20T21:58:56.678 INFO:tasks.workunit.client.1.smithi164.stdout:4/294: truncate d4/d9/fc 4223464 0 2024-04-20T21:58:56.680 INFO:tasks.workunit.client.1.smithi164.stdout:7/272: sync 2024-04-20T21:58:56.680 INFO:tasks.workunit.client.1.smithi164.stdout:0/295: sync 2024-04-20T21:58:56.680 INFO:tasks.workunit.client.1.smithi164.stdout:8/238: sync 2024-04-20T21:58:56.680 INFO:tasks.workunit.client.1.smithi164.stdout:4/295: stat d4/d28 0 2024-04-20T21:58:56.683 INFO:tasks.workunit.client.1.smithi164.stdout:5/350: creat dc/d2b/d52/f7c x:0 0 0 2024-04-20T21:58:56.687 INFO:tasks.workunit.client.1.smithi164.stdout:8/239: chown d0/l42 85689379 1 2024-04-20T21:58:56.687 INFO:tasks.workunit.client.1.smithi164.stdout:0/296: mkdir d1/d4/df/d56 0 2024-04-20T21:58:56.693 INFO:tasks.workunit.client.1.smithi164.stdout:5/351: creat dc/f7d x:0 0 0 2024-04-20T21:58:56.696 INFO:tasks.workunit.client.1.smithi164.stdout:8/240: truncate d0/f19 1103008 0 2024-04-20T21:58:56.697 INFO:tasks.workunit.client.1.smithi164.stdout:2/279: dread d2/d5/f1d [0,4194304] 0 2024-04-20T21:58:56.700 INFO:tasks.workunit.client.1.smithi164.stdout:8/241: readlink d0/d1e/l2c 0 2024-04-20T21:58:56.701 INFO:tasks.workunit.client.1.smithi164.stdout:6/350: dwrite d0/d3/d15/f5e [0,4194304] 0 2024-04-20T21:58:56.701 INFO:tasks.workunit.client.1.smithi164.stdout:2/280: chown d2/f3c 30013336 1 2024-04-20T21:58:56.704 INFO:tasks.workunit.client.1.smithi164.stdout:0/297: unlink d1/d4/d26/d29/d2d/l55 0 2024-04-20T21:58:56.704 INFO:tasks.workunit.client.1.smithi164.stdout:5/352: getdents dc/d41/d4e 0 2024-04-20T21:58:56.707 INFO:tasks.workunit.client.1.smithi164.stdout:2/281: chown d2/d5/l18 63148 1 2024-04-20T21:58:56.712 INFO:tasks.workunit.client.1.smithi164.stdout:3/343: dwrite d12/d20/f2b [0,4194304] 0 2024-04-20T21:58:56.716 INFO:tasks.workunit.client.1.smithi164.stdout:4/296: dread d4/d9/fc [0,4194304] 0 2024-04-20T21:58:56.717 INFO:tasks.workunit.client.1.smithi164.stdout:3/344: chown d12/d15/f21 7110 1 2024-04-20T21:58:56.721 INFO:tasks.workunit.client.1.smithi164.stdout:9/358: sync 2024-04-20T21:58:56.722 INFO:tasks.workunit.client.1.smithi164.stdout:7/273: dwrite d2/d21/d33/f54 [4194304,4194304] 0 2024-04-20T21:58:56.723 INFO:tasks.workunit.client.1.smithi164.stdout:2/282: creat d2/d19/f54 x:0 0 0 2024-04-20T21:58:56.723 INFO:tasks.workunit.client.1.smithi164.stdout:5/353: symlink dc/d12/d1e/l7e 0 2024-04-20T21:58:56.725 INFO:tasks.workunit.client.1.smithi164.stdout:5/354: chown dc/f66 11315 1 2024-04-20T21:58:56.730 INFO:tasks.workunit.client.1.smithi164.stdout:7/274: readlink d2/d21/d24/d31/l4a 0 2024-04-20T21:58:56.731 INFO:tasks.workunit.client.1.smithi164.stdout:3/345: mkdir d12/d20/d39/d69 0 2024-04-20T21:58:56.732 INFO:tasks.workunit.client.1.smithi164.stdout:8/242: unlink d0/l23 0 2024-04-20T21:58:56.734 INFO:tasks.workunit.client.1.smithi164.stdout:6/351: symlink d0/l76 0 2024-04-20T21:58:56.735 INFO:tasks.workunit.client.1.smithi164.stdout:0/298: dread d1/f23 [0,4194304] 0 2024-04-20T21:58:56.738 INFO:tasks.workunit.client.1.smithi164.stdout:4/297: rename d4/d9/d27/d37/c49 to d4/d9/d27/d3f/d67/c68 0 2024-04-20T21:58:56.739 INFO:tasks.workunit.client.1.smithi164.stdout:3/346: write d12/f1e [2108473,73357] 0 2024-04-20T21:58:56.741 INFO:tasks.workunit.client.1.smithi164.stdout:9/359: creat d3/db/d1b/d1e/f81 x:0 0 0 2024-04-20T21:58:56.741 INFO:tasks.workunit.client.1.smithi164.stdout:1/276: dread d10/f14 [0,4194304] 0 2024-04-20T21:58:56.742 INFO:tasks.workunit.client.1.smithi164.stdout:2/283: mkdir d2/d5/d3a/d55 0 2024-04-20T21:58:56.742 INFO:tasks.workunit.client.1.smithi164.stdout:7/275: mknod d2/d21/d24/d31/d3a/c5b 0 2024-04-20T21:58:56.746 INFO:tasks.workunit.client.1.smithi164.stdout:6/352: symlink d0/d3/d8/d28/l77 0 2024-04-20T21:58:56.747 INFO:tasks.workunit.client.1.smithi164.stdout:3/347: unlink d12/d20/d39/c3b 0 2024-04-20T21:58:56.750 INFO:tasks.workunit.client.1.smithi164.stdout:4/298: creat d4/d28/d3e/d4a/f69 x:0 0 0 2024-04-20T21:58:56.754 INFO:tasks.workunit.client.1.smithi164.stdout:7/276: mkdir d2/d21/d33/d5c 0 2024-04-20T21:58:56.754 INFO:tasks.workunit.client.1.smithi164.stdout:4/299: write d4/f16 [529214,97954] 0 2024-04-20T21:58:56.755 INFO:tasks.workunit.client.1.smithi164.stdout:0/299: creat d1/d4/d26/d29/d2d/d54/f57 x:0 0 0 2024-04-20T21:58:56.756 INFO:tasks.workunit.client.1.smithi164.stdout:1/277: mknod d10/d16/d20/d25/c56 0 2024-04-20T21:58:56.756 INFO:tasks.workunit.client.1.smithi164.stdout:2/284: creat d2/d5/d3a/d55/f56 x:0 0 0 2024-04-20T21:58:56.759 INFO:tasks.workunit.client.1.smithi164.stdout:4/300: unlink d4/d9/f2d 0 2024-04-20T21:58:56.761 INFO:tasks.workunit.client.1.smithi164.stdout:1/278: chown d10/f15 41569412 1 2024-04-20T21:58:56.761 INFO:tasks.workunit.client.1.smithi164.stdout:0/300: creat d1/d4/da/d1f/d3c/f58 x:0 0 0 2024-04-20T21:58:56.762 INFO:tasks.workunit.client.1.smithi164.stdout:2/285: write d2/d5/d3a/f4c [149881,94445] 0 2024-04-20T21:58:56.764 INFO:tasks.workunit.client.1.smithi164.stdout:7/277: rename d2/d21/d33/d5c to d2/d21/d44/d5d 0 2024-04-20T21:58:56.767 INFO:tasks.workunit.client.1.smithi164.stdout:0/301: write d1/d4/da/d1f/d3c/f58 [183274,119650] 0 2024-04-20T21:58:56.767 INFO:tasks.workunit.client.1.smithi164.stdout:4/301: write d4/d9/f1e [2309757,55472] 0 2024-04-20T21:58:56.773 INFO:tasks.workunit.client.1.smithi164.stdout:7/278: fsync d2/d21/f28 0 2024-04-20T21:58:56.774 INFO:tasks.workunit.client.1.smithi164.stdout:2/286: creat d2/d5/d21/f57 x:0 0 0 2024-04-20T21:58:56.778 INFO:tasks.workunit.client.1.smithi164.stdout:8/243: truncate d0/f3 3200486 0 2024-04-20T21:58:56.779 INFO:tasks.workunit.client.1.smithi164.stdout:9/360: dwrite d3/f76 [0,4194304] 0 2024-04-20T21:58:56.781 INFO:tasks.workunit.client.1.smithi164.stdout:5/355: dwrite dc/d2c/d2e/f46 [0,4194304] 0 2024-04-20T21:58:56.781 INFO:tasks.workunit.client.1.smithi164.stdout:2/287: chown d2/d5/d21/f2d 1126523 1 2024-04-20T21:58:56.783 INFO:tasks.workunit.client.1.smithi164.stdout:4/302: creat d4/d9/d27/d3f/f6a x:0 0 0 2024-04-20T21:58:56.787 INFO:tasks.workunit.client.1.smithi164.stdout:3/348: dwrite f4 [0,4194304] 0 2024-04-20T21:58:56.787 INFO:tasks.workunit.client.1.smithi164.stdout:5/356: fsync dc/d41/d4e/f68 0 2024-04-20T21:58:56.792 INFO:tasks.workunit.client.1.smithi164.stdout:9/361: write d3/db/d1b/d1e/f25 [853275,21162] 0 2024-04-20T21:58:56.795 INFO:tasks.workunit.client.1.smithi164.stdout:2/288: dread d2/f1b [0,4194304] 0 2024-04-20T21:58:56.799 INFO:tasks.workunit.client.1.smithi164.stdout:6/353: dwrite d0/d3/d15/f2c [0,4194304] 0 2024-04-20T21:58:56.799 INFO:tasks.workunit.client.1.smithi164.stdout:2/289: dread - d2/f34 zero size 2024-04-20T21:58:56.799 INFO:tasks.workunit.client.1.smithi164.stdout:7/279: creat d2/d21/f5e x:0 0 0 2024-04-20T21:58:56.799 INFO:tasks.workunit.client.1.smithi164.stdout:0/302: getdents d1/d2b 0 2024-04-20T21:58:56.803 INFO:tasks.workunit.client.1.smithi164.stdout:8/244: creat d0/f56 x:0 0 0 2024-04-20T21:58:56.806 INFO:tasks.workunit.client.1.smithi164.stdout:5/357: creat dc/d2b/d52/d64/f7f x:0 0 0 2024-04-20T21:58:56.807 INFO:tasks.workunit.client.1.smithi164.stdout:4/303: creat d4/d28/f6b x:0 0 0 2024-04-20T21:58:56.809 INFO:tasks.workunit.client.1.smithi164.stdout:2/290: mkdir d2/d5/d3a/d55/d58 0 2024-04-20T21:58:56.809 INFO:tasks.workunit.client.1.smithi164.stdout:8/245: dread - d0/d1e/f39 zero size 2024-04-20T21:58:56.811 INFO:tasks.workunit.client.1.smithi164.stdout:6/354: creat d0/d3/d15/d21/d5c/f78 x:0 0 0 2024-04-20T21:58:56.814 INFO:tasks.workunit.client.1.smithi164.stdout:4/304: truncate d4/d9/d27/d3f/f4f 838574 0 2024-04-20T21:58:56.817 INFO:tasks.workunit.client.1.smithi164.stdout:7/280: write d2/d21/d24/f57 [4420721,28319] 0 2024-04-20T21:58:56.821 INFO:tasks.workunit.client.1.smithi164.stdout:9/362: mkdir d3/db/d82 0 2024-04-20T21:58:56.829 INFO:tasks.workunit.client.1.smithi164.stdout:5/358: dread dc/d12/f15 [0,4194304] 0 2024-04-20T21:58:56.830 INFO:tasks.workunit.client.1.smithi164.stdout:8/246: dwrite d0/fc [0,4194304] 0 2024-04-20T21:58:56.830 INFO:tasks.workunit.client.1.smithi164.stdout:0/303: rmdir d1/d4/da/d27/d33 39 2024-04-20T21:58:56.837 INFO:tasks.workunit.client.1.smithi164.stdout:4/305: unlink d4/d9/d27/f2c 0 2024-04-20T21:58:56.840 INFO:tasks.workunit.client.1.smithi164.stdout:6/355: mknod d0/d3/d11/d29/d6e/d41/c79 0 2024-04-20T21:58:56.845 INFO:tasks.workunit.client.1.smithi164.stdout:7/281: rename d2/ff to d2/f5f 0 2024-04-20T21:58:56.847 INFO:tasks.workunit.client.1.smithi164.stdout:5/359: dread dc/d12/f18 [0,4194304] 0 2024-04-20T21:58:56.848 INFO:tasks.workunit.client.1.smithi164.stdout:7/282: truncate d2/d21/f34 4566947 0 2024-04-20T21:58:56.851 INFO:tasks.workunit.client.1.smithi164.stdout:3/349: creat d12/d20/f6a x:0 0 0 2024-04-20T21:58:56.853 INFO:tasks.workunit.client.1.smithi164.stdout:7/283: readlink d2/d21/l2e 0 2024-04-20T21:58:56.855 INFO:tasks.workunit.client.1.smithi164.stdout:7/284: write d2/d21/f34 [232645,94260] 0 2024-04-20T21:58:56.858 INFO:tasks.workunit.client.1.smithi164.stdout:4/306: dwrite d4/d9/d22/f43 [0,4194304] 0 2024-04-20T21:58:56.863 INFO:tasks.workunit.client.1.smithi164.stdout:8/247: fdatasync d0/d14/f3d 0 2024-04-20T21:58:56.865 INFO:tasks.workunit.client.1.smithi164.stdout:0/304: rmdir d1/d4/d26/d29/d2d/d54 39 2024-04-20T21:58:56.866 INFO:tasks.workunit.client.1.smithi164.stdout:8/248: truncate d0/f50 798373 0 2024-04-20T21:58:56.868 INFO:tasks.workunit.client.1.smithi164.stdout:5/360: dwrite dc/d12/d1e/f1f [0,4194304] 0 2024-04-20T21:58:56.868 INFO:tasks.workunit.client.1.smithi164.stdout:0/305: chown d1/d4/f28 18229 1 2024-04-20T21:58:56.872 INFO:tasks.workunit.client.1.smithi164.stdout:2/291: link d2/f20 d2/d19/d28/d3e/f59 0 2024-04-20T21:58:56.873 INFO:tasks.workunit.client.1.smithi164.stdout:9/363: fsync d3/db/f6f 0 2024-04-20T21:58:56.874 INFO:tasks.workunit.client.1.smithi164.stdout:3/350: mkdir d12/d20/d39/d55/d6b 0 2024-04-20T21:58:56.876 INFO:tasks.workunit.client.1.smithi164.stdout:9/364: fsync d3/ff 0 2024-04-20T21:58:56.879 INFO:tasks.workunit.client.1.smithi164.stdout:2/292: fsync d2/d5/d3a/f4c 0 2024-04-20T21:58:56.881 INFO:tasks.workunit.client.1.smithi164.stdout:0/306: creat d1/d4/df/f59 x:0 0 0 2024-04-20T21:58:56.886 INFO:tasks.workunit.client.1.smithi164.stdout:7/285: dwrite d2/d21/f5e [0,4194304] 0 2024-04-20T21:58:56.891 INFO:tasks.workunit.client.1.smithi164.stdout:3/351: stat d12/d15/c4e 0 2024-04-20T21:58:56.894 INFO:tasks.workunit.client.1.smithi164.stdout:4/307: unlink d4/d9/f14 0 2024-04-20T21:58:56.894 INFO:tasks.workunit.client.1.smithi164.stdout:3/352: dread - d12/f60 zero size 2024-04-20T21:58:56.896 INFO:tasks.workunit.client.1.smithi164.stdout:5/361: dwrite dc/d12/d1e/f35 [0,4194304] 0 2024-04-20T21:58:56.900 INFO:tasks.workunit.client.1.smithi164.stdout:9/365: write d3/db/d1b/f46 [553832,24668] 0 2024-04-20T21:58:56.900 INFO:tasks.workunit.client.1.smithi164.stdout:3/353: fsync d12/d20/d39/f62 0 2024-04-20T21:58:56.902 INFO:tasks.workunit.client.1.smithi164.stdout:3/354: write d12/f5f [876503,65590] 0 2024-04-20T21:58:56.902 INFO:tasks.workunit.client.1.smithi164.stdout:9/366: write d3/f1f [1630489,69512] 0 2024-04-20T21:58:56.904 INFO:tasks.workunit.client.1.smithi164.stdout:8/249: rmdir d0/d14/d16 39 2024-04-20T21:58:56.909 INFO:tasks.workunit.client.1.smithi164.stdout:2/293: creat d2/d5/d3a/f5a x:0 0 0 2024-04-20T21:58:56.915 INFO:tasks.workunit.client.1.smithi164.stdout:7/286: mkdir d2/d21/d24/d60 0 2024-04-20T21:58:56.918 INFO:tasks.workunit.client.1.smithi164.stdout:4/308: mknod d4/d9/d27/d37/c6c 0 2024-04-20T21:58:56.919 INFO:tasks.workunit.client.1.smithi164.stdout:4/309: fsync d4/d28/f61 0 2024-04-20T21:58:56.923 INFO:tasks.workunit.client.1.smithi164.stdout:3/355: rename d12/d20/f40 to d12/d15/f6c 0 2024-04-20T21:58:56.925 INFO:tasks.workunit.client.1.smithi164.stdout:8/250: fsync d0/d14/f18 0 2024-04-20T21:58:56.925 INFO:tasks.workunit.client.1.smithi164.stdout:0/307: symlink d1/d4/d26/d29/l5a 0 2024-04-20T21:58:56.925 INFO:tasks.workunit.client.1.smithi164.stdout:3/356: write d12/d15/f38 [5125763,15611] 0 2024-04-20T21:58:56.927 INFO:tasks.workunit.client.1.smithi164.stdout:5/362: getdents dc/d41/d4e 0 2024-04-20T21:58:56.928 INFO:tasks.workunit.client.1.smithi164.stdout:3/357: dread - d12/f51 zero size 2024-04-20T21:58:56.931 INFO:tasks.workunit.client.1.smithi164.stdout:7/287: dwrite d2/d21/f35 [0,4194304] 0 2024-04-20T21:58:56.933 INFO:tasks.workunit.client.1.smithi164.stdout:7/288: write d2/d21/d24/f30 [9244048,8803] 0 2024-04-20T21:58:56.938 INFO:tasks.workunit.client.1.smithi164.stdout:7/289: write d2/d21/d24/d31/f41 [117826,51047] 0 2024-04-20T21:58:56.942 INFO:tasks.workunit.client.1.smithi164.stdout:9/367: mkdir d3/db/dd/d40/d2a/d36/d51/d83 0 2024-04-20T21:58:56.943 INFO:tasks.workunit.client.1.smithi164.stdout:3/358: mkdir d12/d6d 0 2024-04-20T21:58:56.946 INFO:tasks.workunit.client.1.smithi164.stdout:3/359: fdatasync d12/d20/d39/f56 0 2024-04-20T21:58:56.948 INFO:tasks.workunit.client.1.smithi164.stdout:8/251: dwrite d0/d14/f3d [0,4194304] 0 2024-04-20T21:58:56.953 INFO:tasks.workunit.client.1.smithi164.stdout:9/368: creat d3/db/dd/d40/f84 x:0 0 0 2024-04-20T21:58:56.955 INFO:tasks.workunit.client.1.smithi164.stdout:0/308: rename d1/d4/da/d1f/d3c/f3d to d1/d4/d26/d29/f5b 0 2024-04-20T21:58:56.958 INFO:tasks.workunit.client.1.smithi164.stdout:9/369: write d3/db/dd/f45 [581885,24307] 0 2024-04-20T21:58:56.965 INFO:tasks.workunit.client.1.smithi164.stdout:9/370: chown d3/f39 25663800 1 2024-04-20T21:58:56.969 INFO:tasks.workunit.client.1.smithi164.stdout:5/363: dwrite dc/d12/f15 [0,4194304] 0 2024-04-20T21:58:56.969 INFO:tasks.workunit.client.1.smithi164.stdout:0/309: mkdir d1/d4/da/d5c 0 2024-04-20T21:58:56.973 INFO:tasks.workunit.client.1.smithi164.stdout:8/252: read d0/d14/f2a [133419,100579] 0 2024-04-20T21:58:56.982 INFO:tasks.workunit.client.1.smithi164.stdout:3/360: truncate d12/d20/d39/f46 1673113 0 2024-04-20T21:58:56.985 INFO:tasks.workunit.client.1.smithi164.stdout:8/253: symlink d0/d1e/l57 0 2024-04-20T21:58:56.986 INFO:tasks.workunit.client.1.smithi164.stdout:7/290: dread d2/d21/d24/f57 [0,4194304] 0 2024-04-20T21:58:56.990 INFO:tasks.workunit.client.1.smithi164.stdout:4/310: dread d4/d9/d22/f52 [0,4194304] 0 2024-04-20T21:58:56.990 INFO:tasks.workunit.client.1.smithi164.stdout:3/361: creat d12/d15/f6e x:0 0 0 2024-04-20T21:58:56.993 INFO:tasks.workunit.client.1.smithi164.stdout:8/254: read d0/f3 [2388826,100734] 0 2024-04-20T21:58:56.994 INFO:tasks.workunit.client.1.smithi164.stdout:0/310: truncate d1/d4/df/f3b 1134006 0 2024-04-20T21:58:56.994 INFO:tasks.workunit.client.1.smithi164.stdout:9/371: dwrite d3/db/d1b/d1e/f79 [0,4194304] 0 2024-04-20T21:58:56.998 INFO:tasks.workunit.client.1.smithi164.stdout:7/291: creat d2/d21/d24/f61 x:0 0 0 2024-04-20T21:58:56.998 INFO:tasks.workunit.client.1.smithi164.stdout:5/364: link dc/d2b/d52/c7b dc/d2c/d2e/d30/d5e/c80 0 2024-04-20T21:58:57.008 INFO:tasks.workunit.client.1.smithi164.stdout:5/365: fdatasync dc/f16 0 2024-04-20T21:58:57.010 INFO:tasks.workunit.client.1.smithi164.stdout:7/292: rename d2/l36 to d2/d55/l62 0 2024-04-20T21:58:57.012 INFO:tasks.workunit.client.1.smithi164.stdout:4/311: dread d4/d9/f17 [0,4194304] 0 2024-04-20T21:58:57.013 INFO:tasks.workunit.client.1.smithi164.stdout:3/362: dwrite d12/d2a/f42 [0,4194304] 0 2024-04-20T21:58:57.014 INFO:tasks.workunit.client.1.smithi164.stdout:4/312: readlink d4/d9/l21 0 2024-04-20T21:58:57.015 INFO:tasks.workunit.client.1.smithi164.stdout:4/313: read d4/f7 [2123048,100698] 0 2024-04-20T21:58:57.016 INFO:tasks.workunit.client.1.smithi164.stdout:3/363: write d12/d15/f37 [3672946,68246] 0 2024-04-20T21:58:57.021 INFO:tasks.workunit.client.1.smithi164.stdout:8/255: rename d0/d14/d55 to d0/d14/d16/d58 0 2024-04-20T21:58:57.022 INFO:tasks.workunit.client.1.smithi164.stdout:8/256: chown d0/d14/l53 1148575 1 2024-04-20T21:58:57.025 INFO:tasks.workunit.client.1.smithi164.stdout:0/311: creat d1/d4/da/d1f/f5d x:0 0 0 2024-04-20T21:58:57.036 INFO:tasks.workunit.client.1.smithi164.stdout:7/293: rename d2/d21/d44/d5d to d2/d55/d63 0 2024-04-20T21:58:57.037 INFO:tasks.workunit.client.1.smithi164.stdout:7/294: fdatasync d2/f16 0 2024-04-20T21:58:57.038 INFO:tasks.workunit.client.1.smithi164.stdout:9/372: getdents d3/db/d4f/d67 0 2024-04-20T21:58:57.040 INFO:tasks.workunit.client.1.smithi164.stdout:6/356: sync 2024-04-20T21:58:57.041 INFO:tasks.workunit.client.1.smithi164.stdout:1/279: sync 2024-04-20T21:58:57.041 INFO:tasks.workunit.client.1.smithi164.stdout:0/312: unlink d1/d4/d26/d29/l5a 0 2024-04-20T21:58:57.042 INFO:tasks.workunit.client.1.smithi164.stdout:0/313: stat d1/d4/c4a 0 2024-04-20T21:58:57.042 INFO:tasks.workunit.client.1.smithi164.stdout:4/314: symlink d4/l6d 0 2024-04-20T21:58:57.044 INFO:tasks.workunit.client.1.smithi164.stdout:3/364: mkdir d12/d68/d6f 0 2024-04-20T21:58:57.050 INFO:tasks.workunit.client.1.smithi164.stdout:7/295: write d2/d21/d24/f57 [3359939,113135] 0 2024-04-20T21:58:57.050 INFO:tasks.workunit.client.1.smithi164.stdout:8/257: symlink d0/l59 0 2024-04-20T21:58:57.053 INFO:tasks.workunit.client.1.smithi164.stdout:8/258: dread - d0/f4b zero size 2024-04-20T21:58:57.054 INFO:tasks.workunit.client.1.smithi164.stdout:7/296: fsync d2/d21/f3b 0 2024-04-20T21:58:57.054 INFO:tasks.workunit.client.1.smithi164.stdout:1/280: stat d10/f12 0 2024-04-20T21:58:57.061 INFO:tasks.workunit.client.1.smithi164.stdout:4/315: chown d4/d9/d22/f24 601601 1 2024-04-20T21:58:57.065 INFO:tasks.workunit.client.1.smithi164.stdout:0/314: dwrite d1/d4/d49/f4b [0,4194304] 0 2024-04-20T21:58:57.065 INFO:tasks.workunit.client.1.smithi164.stdout:3/365: creat d12/d15/f70 x:0 0 0 2024-04-20T21:58:57.066 INFO:tasks.workunit.client.1.smithi164.stdout:3/366: fdatasync d12/d15/f70 0 2024-04-20T21:58:57.068 INFO:tasks.workunit.client.1.smithi164.stdout:9/373: link d3/f41 d3/db/dd/d40/d2a/d36/d51/d83/f85 0 2024-04-20T21:58:57.076 INFO:tasks.workunit.client.1.smithi164.stdout:5/366: truncate f6 821373 0 2024-04-20T21:58:57.077 INFO:tasks.workunit.client.1.smithi164.stdout:9/374: read d3/db/dd/f45 [1730347,26098] 0 2024-04-20T21:58:57.081 INFO:tasks.workunit.client.1.smithi164.stdout:9/375: chown d3/c13 13688 1 2024-04-20T21:58:57.082 INFO:tasks.workunit.client.1.smithi164.stdout:2/294: sync 2024-04-20T21:58:57.094 INFO:tasks.workunit.client.1.smithi164.stdout:1/281: dread d10/d33/f46 [0,4194304] 0 2024-04-20T21:58:57.094 INFO:tasks.workunit.client.1.smithi164.stdout:5/367: rename dc/d41/d4e to dc/d12/d81 0 2024-04-20T21:58:57.097 INFO:tasks.workunit.client.1.smithi164.stdout:5/368: read dc/d12/f15 [1002836,116195] 0 2024-04-20T21:58:57.098 INFO:tasks.workunit.client.1.smithi164.stdout:3/367: mkdir d12/d68/d6f/d71 0 2024-04-20T21:58:57.098 INFO:tasks.workunit.client.1.smithi164.stdout:1/282: write d10/d16/d20/f38 [602893,93939] 0 2024-04-20T21:58:57.100 INFO:tasks.workunit.client.1.smithi164.stdout:3/368: dread - d12/f60 zero size 2024-04-20T21:58:57.104 INFO:tasks.workunit.client.1.smithi164.stdout:7/297: rmdir d2/d21/d24/d50 0 2024-04-20T21:58:57.106 INFO:tasks.workunit.client.1.smithi164.stdout:9/376: dwrite d3/db/dd/d40/d2a/d36/d51/f70 [0,4194304] 0 2024-04-20T21:58:57.111 INFO:tasks.workunit.client.1.smithi164.stdout:0/315: creat d1/d4/da/d27/d33/f5e x:0 0 0 2024-04-20T21:58:57.113 INFO:tasks.workunit.client.1.smithi164.stdout:4/316: dread f3 [0,4194304] 0 2024-04-20T21:58:57.115 INFO:tasks.workunit.client.1.smithi164.stdout:6/357: write d0/d3/f18 [321985,26510] 0 2024-04-20T21:58:57.118 INFO:tasks.workunit.client.1.smithi164.stdout:1/283: mkdir d10/d33/d57 0 2024-04-20T21:58:57.119 INFO:tasks.workunit.client.1.smithi164.stdout:7/298: mknod d2/d55/d63/c64 0 2024-04-20T21:58:57.132 INFO:tasks.workunit.client.1.smithi164.stdout:8/259: dread d0/d14/f13 [4194304,4194304] 0 2024-04-20T21:58:57.134 INFO:tasks.workunit.client.1.smithi164.stdout:3/369: creat d12/d20/d39/d55/d6b/f72 x:0 0 0 2024-04-20T21:58:57.138 INFO:tasks.workunit.client.1.smithi164.stdout:2/295: dread d2/d5/f14 [0,4194304] 0 2024-04-20T21:58:57.139 INFO:tasks.workunit.client.1.smithi164.stdout:2/296: readlink d2/d5/l10 0 2024-04-20T21:58:57.139 INFO:tasks.workunit.client.1.smithi164.stdout:8/260: dread d0/f50 [0,4194304] 0 2024-04-20T21:58:57.140 INFO:tasks.workunit.client.1.smithi164.stdout:2/297: stat d2/d30 0 2024-04-20T21:58:57.141 INFO:tasks.workunit.client.1.smithi164.stdout:8/261: chown d0/d1e/f39 772139192 1 2024-04-20T21:58:57.144 INFO:tasks.workunit.client.1.smithi164.stdout:5/369: creat dc/f82 x:0 0 0 2024-04-20T21:58:57.153 INFO:tasks.workunit.client.1.smithi164.stdout:4/317: rename d4/d9/d22/f34 to d4/d28/d3e/d41/f6e 0 2024-04-20T21:58:57.155 INFO:tasks.workunit.client.1.smithi164.stdout:2/298: rmdir d2/d19 39 2024-04-20T21:58:57.157 INFO:tasks.workunit.client.1.smithi164.stdout:4/318: write d4/d28/f58 [782566,106581] 0 2024-04-20T21:58:57.158 INFO:tasks.workunit.client.1.smithi164.stdout:2/299: chown d2/d5/d3a/d55/f56 669 1 2024-04-20T21:58:57.159 INFO:tasks.workunit.client.1.smithi164.stdout:8/262: mkdir d0/d14/d16/d5a 0 2024-04-20T21:58:57.161 INFO:tasks.workunit.client.1.smithi164.stdout:2/300: chown d2/d30/f4b 19 1 2024-04-20T21:58:57.162 INFO:tasks.workunit.client.1.smithi164.stdout:5/370: dwrite dc/d2b/f3f [0,4194304] 0 2024-04-20T21:58:57.162 INFO:tasks.workunit.client.1.smithi164.stdout:9/377: truncate d3/db/d1b/d1e/f73 3206655 0 2024-04-20T21:58:57.168 INFO:tasks.workunit.client.1.smithi164.stdout:7/299: link d2/d21/d24/d31/l4a d2/d21/d44/l65 0 2024-04-20T21:58:57.168 INFO:tasks.workunit.client.1.smithi164.stdout:0/316: dread d1/d4/f28 [0,4194304] 0 2024-04-20T21:58:57.169 INFO:tasks.workunit.client.1.smithi164.stdout:5/371: readlink dc/d2c/l36 0 2024-04-20T21:58:57.169 INFO:tasks.workunit.client.1.smithi164.stdout:8/263: mkdir d0/d14/d16/d5b 0 2024-04-20T21:58:57.172 INFO:tasks.workunit.client.1.smithi164.stdout:9/378: fsync d3/db/dd/d40/d2a/f77 0 2024-04-20T21:58:57.172 INFO:tasks.workunit.client.1.smithi164.stdout:0/317: chown d1/d4/f2c 0 1 2024-04-20T21:58:57.173 INFO:tasks.workunit.client.1.smithi164.stdout:7/300: chown d2/d21/d24/f61 55 1 2024-04-20T21:58:57.174 INFO:tasks.workunit.client.1.smithi164.stdout:1/284: dread f7 [0,4194304] 0 2024-04-20T21:58:57.177 INFO:tasks.workunit.client.1.smithi164.stdout:6/358: getdents d0/d3/d8/d28 0 2024-04-20T21:58:57.178 INFO:tasks.workunit.client.1.smithi164.stdout:2/301: creat d2/d5/d3a/d55/d58/f5b x:0 0 0 2024-04-20T21:58:57.180 INFO:tasks.workunit.client.1.smithi164.stdout:8/264: readlink d0/d14/d16/l31 0 2024-04-20T21:58:57.181 INFO:tasks.workunit.client.1.smithi164.stdout:0/318: creat d1/d4/d49/f5f x:0 0 0 2024-04-20T21:58:57.184 INFO:tasks.workunit.client.1.smithi164.stdout:3/370: rename d12/d20/d39/f44 to d12/f73 0 2024-04-20T21:58:57.186 INFO:tasks.workunit.client.1.smithi164.stdout:9/379: mkdir d3/db/dd/d40/d78/d86 0 2024-04-20T21:58:57.187 INFO:tasks.workunit.client.1.smithi164.stdout:2/302: readlink d2/d19/d28/l33 0 2024-04-20T21:58:57.188 INFO:tasks.workunit.client.1.smithi164.stdout:0/319: write d1/d4/d26/d29/f44 [1608088,12824] 0 2024-04-20T21:58:57.189 INFO:tasks.workunit.client.1.smithi164.stdout:7/301: creat d2/d21/d24/d60/f66 x:0 0 0 2024-04-20T21:58:57.197 INFO:tasks.workunit.client.1.smithi164.stdout:8/265: creat d0/d14/d16/d5a/f5c x:0 0 0 2024-04-20T21:58:57.198 INFO:tasks.workunit.client.1.smithi164.stdout:7/302: creat d2/f67 x:0 0 0 2024-04-20T21:58:57.199 INFO:tasks.workunit.client.1.smithi164.stdout:5/372: dwrite dc/d2b/d52/f7c [0,4194304] 0 2024-04-20T21:58:57.200 INFO:tasks.workunit.client.1.smithi164.stdout:6/359: rmdir d0/d3/d15/d23/d45/d4f/d61/d64 0 2024-04-20T21:58:57.202 INFO:tasks.workunit.client.1.smithi164.stdout:2/303: symlink d2/d19/d28/l5c 0 2024-04-20T21:58:57.204 INFO:tasks.workunit.client.1.smithi164.stdout:8/266: write d0/d14/f4f [845423,109260] 0 2024-04-20T21:58:57.216 INFO:tasks.workunit.client.1.smithi164.stdout:1/285: dwrite d10/d16/d19/f52 [0,4194304] 0 2024-04-20T21:58:57.222 INFO:tasks.workunit.client.1.smithi164.stdout:9/380: dwrite d3/db/d1b/f34 [0,4194304] 0 2024-04-20T21:58:57.223 INFO:tasks.workunit.client.1.smithi164.stdout:4/319: rename d4/f4e to d4/d28/f6f 0 2024-04-20T21:58:57.229 INFO:tasks.workunit.client.1.smithi164.stdout:4/320: chown d4/d9/d27/l2a 63773532 1 2024-04-20T21:58:57.232 INFO:tasks.workunit.client.1.smithi164.stdout:4/321: chown d4/d28/d3e/f59 739 1 2024-04-20T21:58:57.234 INFO:tasks.workunit.client.1.smithi164.stdout:0/320: truncate d1/f42 2027501 0 2024-04-20T21:58:57.235 INFO:tasks.workunit.client.1.smithi164.stdout:9/381: mknod d3/db/d4f/d67/c87 0 2024-04-20T21:58:57.236 INFO:tasks.workunit.client.1.smithi164.stdout:2/304: dwrite d2/d30/f4b [0,4194304] 0 2024-04-20T21:58:57.238 INFO:tasks.workunit.client.1.smithi164.stdout:5/373: dwrite dc/d12/f13 [0,4194304] 0 2024-04-20T21:58:57.248 INFO:tasks.workunit.client.1.smithi164.stdout:5/374: write dc/d12/d1e/f45 [73935,105716] 0 2024-04-20T21:58:57.259 INFO:tasks.workunit.client.1.smithi164.stdout:7/303: getdents d2/d21/d24 0 2024-04-20T21:58:57.259 INFO:tasks.workunit.client.1.smithi164.stdout:5/375: chown dc/d2c/d2e 65091795 1 2024-04-20T21:58:57.259 INFO:tasks.workunit.client.1.smithi164.stdout:6/360: truncate d0/d3/d15/f2c 1090304 0 2024-04-20T21:58:57.266 INFO:tasks.workunit.client.1.smithi164.stdout:9/382: write d3/db/f17 [4559260,101528] 0 2024-04-20T21:58:57.274 INFO:tasks.workunit.client.1.smithi164.stdout:4/322: getdents d4/d9 0 2024-04-20T21:58:57.276 INFO:tasks.workunit.client.1.smithi164.stdout:5/376: rmdir dc/d12/d1e/d7a 0 2024-04-20T21:58:57.280 INFO:tasks.workunit.client.1.smithi164.stdout:1/286: dwrite d10/d16/d20/f38 [0,4194304] 0 2024-04-20T21:58:57.284 INFO:tasks.workunit.client.1.smithi164.stdout:6/361: symlink d0/d3/d15/d23/d45/d69/l7a 0 2024-04-20T21:58:57.286 INFO:tasks.workunit.client.1.smithi164.stdout:0/321: dwrite d1/d4/da/d27/d33/f3f [0,4194304] 0 2024-04-20T21:58:57.289 INFO:tasks.workunit.client.1.smithi164.stdout:4/323: write d4/d9/f11 [3874802,9423] 0 2024-04-20T21:58:57.289 INFO:tasks.workunit.client.1.smithi164.stdout:3/371: dread d12/f32 [0,4194304] 0 2024-04-20T21:58:57.291 INFO:tasks.workunit.client.1.smithi164.stdout:2/305: dwrite d2/f46 [0,4194304] 0 2024-04-20T21:58:57.291 INFO:tasks.workunit.client.1.smithi164.stdout:1/287: creat d10/d33/d41/f58 x:0 0 0 2024-04-20T21:58:57.295 INFO:tasks.workunit.client.1.smithi164.stdout:4/324: chown d4/d28/f61 7 1 2024-04-20T21:58:57.307 INFO:tasks.workunit.client.1.smithi164.stdout:2/306: mknod d2/d30/c5d 0 2024-04-20T21:58:57.307 INFO:tasks.workunit.client.1.smithi164.stdout:4/325: write d4/d28/d3e/d41/f6e [38091,34326] 0 2024-04-20T21:58:57.307 INFO:tasks.workunit.client.1.smithi164.stdout:7/304: dwrite d2/d21/d33/f54 [4194304,4194304] 0 2024-04-20T21:58:57.307 INFO:tasks.workunit.client.1.smithi164.stdout:9/383: rename d3/db/l60 to d3/db/d4f/l88 0 2024-04-20T21:58:57.309 INFO:tasks.workunit.client.1.smithi164.stdout:2/307: dread - d2/d5/d3a/d55/d58/f5b zero size 2024-04-20T21:58:57.315 INFO:tasks.workunit.client.1.smithi164.stdout:0/322: link d1/d4/d49/c52 d1/d4/da/d27/d33/c60 0 2024-04-20T21:58:57.316 INFO:tasks.workunit.client.1.smithi164.stdout:9/384: write d3/f76 [1595565,58489] 0 2024-04-20T21:58:57.318 INFO:tasks.workunit.client.1.smithi164.stdout:7/305: mkdir d2/d55/d68 0 2024-04-20T21:58:57.321 INFO:tasks.workunit.client.1.smithi164.stdout:4/326: mkdir d4/d28/d70 0 2024-04-20T21:58:57.322 INFO:tasks.workunit.client.1.smithi164.stdout:2/308: fdatasync d2/d5/d3a/f43 0 2024-04-20T21:58:57.324 INFO:tasks.workunit.client.1.smithi164.stdout:6/362: link d0/d3/d15/c34 d0/d3/d8/d28/d6f/c7b 0 2024-04-20T21:58:57.326 INFO:tasks.workunit.client.1.smithi164.stdout:8/267: sync 2024-04-20T21:58:57.331 INFO:tasks.workunit.client.1.smithi164.stdout:4/327: readlink d4/d28/d3e/l40 0 2024-04-20T21:58:57.332 INFO:tasks.workunit.client.1.smithi164.stdout:2/309: chown d2/d5/d21 4066384 1 2024-04-20T21:58:57.338 INFO:tasks.workunit.client.1.smithi164.stdout:2/310: truncate d2/f12 5146948 0 2024-04-20T21:58:57.339 INFO:tasks.workunit.client.1.smithi164.stdout:9/385: creat d3/db/d82/f89 x:0 0 0 2024-04-20T21:58:57.340 INFO:tasks.workunit.client.1.smithi164.stdout:1/288: dwrite d10/f11 [0,4194304] 0 2024-04-20T21:58:57.346 INFO:tasks.workunit.client.1.smithi164.stdout:5/377: dwrite f9 [0,4194304] 0 2024-04-20T21:58:57.346 INFO:tasks.workunit.client.1.smithi164.stdout:9/386: read - d3/db/f6f zero size 2024-04-20T21:58:57.352 INFO:tasks.workunit.client.1.smithi164.stdout:8/268: creat d0/d14/d16/d5b/f5d x:0 0 0 2024-04-20T21:58:57.353 INFO:tasks.workunit.client.1.smithi164.stdout:0/323: dwrite d1/d4/da/d27/f32 [0,4194304] 0 2024-04-20T21:58:57.354 INFO:tasks.workunit.client.1.smithi164.stdout:8/269: fsync d0/d14/f3d 0 2024-04-20T21:58:57.361 INFO:tasks.workunit.client.1.smithi164.stdout:9/387: chown d3/db/dd/f45 6342382 1 2024-04-20T21:58:57.369 INFO:tasks.workunit.client.1.smithi164.stdout:1/289: symlink d10/d33/d48/l59 0 2024-04-20T21:58:57.369 INFO:tasks.workunit.client.1.smithi164.stdout:9/388: chown d3/db/dd/f23 3075 1 2024-04-20T21:58:57.377 INFO:tasks.workunit.client.1.smithi164.stdout:6/363: write d0/d3/d15/d23/f48 [994337,89396] 0 2024-04-20T21:58:57.378 INFO:tasks.workunit.client.1.smithi164.stdout:4/328: write d4/d9/d27/d37/f5b [4534232,51500] 0 2024-04-20T21:58:57.378 INFO:tasks.workunit.client.1.smithi164.stdout:8/270: dread - d0/d14/d4e/f54 zero size 2024-04-20T21:58:57.386 INFO:tasks.workunit.client.1.smithi164.stdout:5/378: mknod dc/d2c/d2e/d30/d72/c83 0 2024-04-20T21:58:57.388 INFO:tasks.workunit.client.1.smithi164.stdout:5/379: stat f8 0 2024-04-20T21:58:57.390 INFO:tasks.workunit.client.1.smithi164.stdout:6/364: mkdir d0/d3/d8/d7c 0 2024-04-20T21:58:57.391 INFO:tasks.workunit.client.1.smithi164.stdout:2/311: dwrite d2/f34 [0,4194304] 0 2024-04-20T21:58:57.392 INFO:tasks.workunit.client.1.smithi164.stdout:8/271: truncate d0/d14/d16/d5a/f5c 328659 0 2024-04-20T21:58:57.392 INFO:tasks.workunit.client.1.smithi164.stdout:7/306: dread d2/f5f [0,4194304] 0 2024-04-20T21:58:57.397 INFO:tasks.workunit.client.1.smithi164.stdout:2/312: dread - d2/d19/d28/f38 zero size 2024-04-20T21:58:57.397 INFO:tasks.workunit.client.1.smithi164.stdout:0/324: creat d1/d4/da/f61 x:0 0 0 2024-04-20T21:58:57.397 INFO:tasks.workunit.client.1.smithi164.stdout:3/372: dread f6 [0,4194304] 0 2024-04-20T21:58:57.400 INFO:tasks.workunit.client.1.smithi164.stdout:1/290: write f7 [2191911,98541] 0 2024-04-20T21:58:57.453 INFO:tasks.workunit.client.1.smithi164.stdout:6/365: mknod d0/d3/d11/d29/d6e/d5d/c7d 0 2024-04-20T21:58:57.454 INFO:tasks.workunit.client.1.smithi164.stdout:8/272: read - d0/d14/d16/d5b/f5d zero size 2024-04-20T21:58:57.456 INFO:tasks.workunit.client.1.smithi164.stdout:0/325: rmdir d1/d4/d49 39 2024-04-20T21:58:57.461 INFO:tasks.workunit.client.1.smithi164.stdout:3/373: creat d12/d68/d6f/d71/f74 x:0 0 0 2024-04-20T21:58:57.463 INFO:tasks.workunit.client.1.smithi164.stdout:4/329: dwrite f2 [0,4194304] 0 2024-04-20T21:58:57.463 INFO:tasks.workunit.client.1.smithi164.stdout:6/366: mknod d0/d3/d15/d23/c7e 0 2024-04-20T21:58:57.466 INFO:tasks.workunit.client.1.smithi164.stdout:6/367: dread - d0/d3/d15/f24 zero size 2024-04-20T21:58:57.467 INFO:tasks.workunit.client.1.smithi164.stdout:2/313: rename d2/d19/d28/d3e/c52 to d2/d19/d28/d3e/d53/c5e 0 2024-04-20T21:58:57.470 INFO:tasks.workunit.client.1.smithi164.stdout:0/326: mknod d1/d4/d49/c62 0 2024-04-20T21:58:57.471 INFO:tasks.workunit.client.1.smithi164.stdout:6/368: stat d0/d3/d8/f38 0 2024-04-20T21:58:57.480 INFO:tasks.workunit.client.1.smithi164.stdout:1/291: dwrite d10/d33/f3f [4194304,4194304] 0 2024-04-20T21:58:57.484 INFO:tasks.workunit.client.1.smithi164.stdout:2/314: mkdir d2/d5f 0 2024-04-20T21:58:57.484 INFO:tasks.workunit.client.1.smithi164.stdout:4/330: rename d4/d9/d22/l55 to d4/d9/d5c/l71 0 2024-04-20T21:58:57.484 INFO:tasks.workunit.client.1.smithi164.stdout:3/374: dread d12/d2a/f42 [0,4194304] 0 2024-04-20T21:58:57.487 INFO:tasks.workunit.client.1.smithi164.stdout:8/273: getdents d0/d14/d16/d5b 0 2024-04-20T21:58:57.487 INFO:tasks.workunit.client.1.smithi164.stdout:7/307: truncate d2/d21/d24/f57 1415365 0 2024-04-20T21:58:57.487 INFO:tasks.workunit.client.1.smithi164.stdout:9/389: sync 2024-04-20T21:58:57.491 INFO:tasks.workunit.client.1.smithi164.stdout:8/274: write d0/d14/d16/d5a/f5c [411304,71261] 0 2024-04-20T21:58:57.491 INFO:tasks.workunit.client.1.smithi164.stdout:2/315: unlink d2/d30/c5d 0 2024-04-20T21:58:57.494 INFO:tasks.workunit.client.1.smithi164.stdout:6/369: rename d0/l17 to d0/d3/d11/d29/d6e/l7f 0 2024-04-20T21:58:57.498 INFO:tasks.workunit.client.1.smithi164.stdout:0/327: write d1/d4/d26/f36 [4311728,28481] 0 2024-04-20T21:58:57.500 INFO:tasks.workunit.client.1.smithi164.stdout:4/331: mknod d4/d28/c72 0 2024-04-20T21:58:57.505 INFO:tasks.workunit.client.1.smithi164.stdout:0/328: write d1/d4/da/d1f/d3c/f4e [707741,104410] 0 2024-04-20T21:58:57.506 INFO:tasks.workunit.client.1.smithi164.stdout:8/275: truncate d0/d14/f51 86416 0 2024-04-20T21:58:57.506 INFO:tasks.workunit.client.1.smithi164.stdout:9/390: dwrite d3/db/d1b/f34 [4194304,4194304] 0 2024-04-20T21:58:57.514 INFO:tasks.workunit.client.1.smithi164.stdout:0/329: read d1/f42 [1249880,113128] 0 2024-04-20T21:58:57.514 INFO:tasks.workunit.client.1.smithi164.stdout:9/391: rmdir d3/db/dd/d40/d78 39 2024-04-20T21:58:57.516 INFO:tasks.workunit.client.1.smithi164.stdout:9/392: stat d3/f76 0 2024-04-20T21:58:57.516 INFO:tasks.workunit.client.1.smithi164.stdout:8/276: getdents d0/d14/d16/d5b 0 2024-04-20T21:58:57.518 INFO:tasks.workunit.client.1.smithi164.stdout:7/308: write d2/d21/f25 [1038558,30635] 0 2024-04-20T21:58:57.521 INFO:tasks.workunit.client.1.smithi164.stdout:0/330: creat d1/d4/da/d27/d33/f63 x:0 0 0 2024-04-20T21:58:57.523 INFO:tasks.workunit.client.1.smithi164.stdout:9/393: mkdir d3/db/d1b/d20/d3f/d8a 0 2024-04-20T21:58:57.526 INFO:tasks.workunit.client.1.smithi164.stdout:8/277: creat d0/d14/d16/d5b/f5e x:0 0 0 2024-04-20T21:58:57.527 INFO:tasks.workunit.client.1.smithi164.stdout:7/309: mknod d2/d21/d24/c69 0 2024-04-20T21:58:57.530 INFO:tasks.workunit.client.1.smithi164.stdout:7/310: mkdir d2/d55/d6a 0 2024-04-20T21:58:57.531 INFO:tasks.workunit.client.1.smithi164.stdout:6/370: dread d0/d3/d15/d23/d45/d4f/f70 [0,4194304] 0 2024-04-20T21:58:57.531 INFO:tasks.workunit.client.1.smithi164.stdout:9/394: creat d3/db/dd/d40/d2a/d36/d51/d83/f8b x:0 0 0 2024-04-20T21:58:57.533 INFO:tasks.workunit.client.1.smithi164.stdout:8/278: truncate d0/d14/d16/d5b/f5e 392182 0 2024-04-20T21:58:57.534 INFO:tasks.workunit.client.1.smithi164.stdout:9/395: chown d3/f39 177842 1 2024-04-20T21:58:57.534 INFO:tasks.workunit.client.1.smithi164.stdout:7/311: chown d2/d21/d33/c37 51864 1 2024-04-20T21:58:57.534 INFO:tasks.workunit.client.1.smithi164.stdout:4/332: dwrite d4/d9/fc [0,4194304] 0 2024-04-20T21:58:57.535 INFO:tasks.workunit.client.1.smithi164.stdout:0/331: creat d1/d4/da/f64 x:0 0 0 2024-04-20T21:58:57.536 INFO:tasks.workunit.client.1.smithi164.stdout:6/371: chown d0/d3/d15/d23/d45/d4f/f66 3 1 2024-04-20T21:58:57.538 INFO:tasks.workunit.client.1.smithi164.stdout:9/396: write d3/db/d1b/d1e/f79 [786468,118015] 0 2024-04-20T21:58:57.539 INFO:tasks.workunit.client.1.smithi164.stdout:9/397: chown d3/db/dd/d40 8 1 2024-04-20T21:58:57.546 INFO:tasks.workunit.client.1.smithi164.stdout:4/333: fdatasync d4/f2b 0 2024-04-20T21:58:57.548 INFO:tasks.workunit.client.1.smithi164.stdout:5/380: sync 2024-04-20T21:58:57.553 INFO:tasks.workunit.client.1.smithi164.stdout:4/334: chown d4/d28/d3e/d4a 756 1 2024-04-20T21:58:57.557 INFO:tasks.workunit.client.1.smithi164.stdout:9/398: creat d3/db/f8c x:0 0 0 2024-04-20T21:58:57.560 INFO:tasks.workunit.client.1.smithi164.stdout:9/399: dread - d3/db/d1b/d1e/f4b zero size 2024-04-20T21:58:57.563 INFO:tasks.workunit.client.1.smithi164.stdout:7/312: dwrite d2/d21/d24/d31/f41 [0,4194304] 0 2024-04-20T21:58:57.563 INFO:tasks.workunit.client.1.smithi164.stdout:5/381: getdents dc/d12/d81 0 2024-04-20T21:58:57.564 INFO:tasks.workunit.client.1.smithi164.stdout:9/400: read - d3/db/d1b/d1e/f4b zero size 2024-04-20T21:58:57.569 INFO:tasks.workunit.client.1.smithi164.stdout:0/332: dwrite d1/f12 [0,4194304] 0 2024-04-20T21:58:57.573 INFO:tasks.workunit.client.1.smithi164.stdout:7/313: symlink d2/d21/d44/l6b 0 2024-04-20T21:58:57.583 INFO:tasks.workunit.client.1.smithi164.stdout:9/401: chown d3/db/d4f/d67/c87 95177108 1 2024-04-20T21:58:57.585 INFO:tasks.workunit.client.1.smithi164.stdout:7/314: mknod d2/d55/d6a/c6c 0 2024-04-20T21:58:57.591 INFO:tasks.workunit.client.1.smithi164.stdout:6/372: dread d0/d3/f12 [0,4194304] 0 2024-04-20T21:58:57.594 INFO:tasks.workunit.client.1.smithi164.stdout:0/333: dwrite d1/d4/da/d27/d33/f5e [0,4194304] 0 2024-04-20T21:58:57.598 INFO:tasks.workunit.client.1.smithi164.stdout:5/382: truncate dc/d2c/d2e/f46 1603605 0 2024-04-20T21:58:57.602 INFO:tasks.workunit.client.1.smithi164.stdout:5/383: rmdir dc/d2c/d2e/d30/d72 39 2024-04-20T21:58:57.603 INFO:tasks.workunit.client.1.smithi164.stdout:7/315: dwrite d2/f5f [0,4194304] 0 2024-04-20T21:58:57.605 INFO:tasks.workunit.client.1.smithi164.stdout:6/373: read d0/d3/d8/f3c [168906,58254] 0 2024-04-20T21:58:57.606 INFO:tasks.workunit.client.1.smithi164.stdout:9/402: truncate d3/db/dd/f14 2074243 0 2024-04-20T21:58:57.609 INFO:tasks.workunit.client.1.smithi164.stdout:0/334: dread d1/d4/f28 [0,4194304] 0 2024-04-20T21:58:57.610 INFO:tasks.workunit.client.1.smithi164.stdout:7/316: rename d2/l19 to d2/d21/d24/d60/l6d 0 2024-04-20T21:58:57.611 INFO:tasks.workunit.client.1.smithi164.stdout:7/317: fdatasync d2/d21/d44/f4b 0 2024-04-20T21:58:57.612 INFO:tasks.workunit.client.1.smithi164.stdout:5/384: dread dc/d41/f65 [0,4194304] 0 2024-04-20T21:58:57.619 INFO:tasks.workunit.client.1.smithi164.stdout:6/374: creat d0/d3/f80 x:0 0 0 2024-04-20T21:58:57.621 INFO:tasks.workunit.client.1.smithi164.stdout:7/318: symlink d2/d21/d24/d31/d3a/l6e 0 2024-04-20T21:58:57.621 INFO:tasks.workunit.client.1.smithi164.stdout:0/335: fsync d1/d4/f28 0 2024-04-20T21:58:57.626 INFO:tasks.workunit.client.1.smithi164.stdout:1/292: sync 2024-04-20T21:58:57.628 INFO:tasks.workunit.client.1.smithi164.stdout:1/293: chown d10/d33/d41/f55 6296 1 2024-04-20T21:58:57.630 INFO:tasks.workunit.client.1.smithi164.stdout:5/385: dwrite dc/d2b/f3f [4194304,4194304] 0 2024-04-20T21:58:57.645 INFO:tasks.workunit.client.1.smithi164.stdout:5/386: dread dc/d41/f65 [0,4194304] 0 2024-04-20T21:58:57.647 INFO:tasks.workunit.client.1.smithi164.stdout:0/336: truncate d1/fb 3573178 0 2024-04-20T21:58:57.653 INFO:tasks.workunit.client.1.smithi164.stdout:9/403: dwrite d3/db/f6f [0,4194304] 0 2024-04-20T21:58:57.654 INFO:tasks.workunit.client.1.smithi164.stdout:6/375: dwrite d0/d3/d11/f49 [4194304,4194304] 0 2024-04-20T21:58:57.658 INFO:tasks.workunit.client.1.smithi164.stdout:7/319: dwrite d2/d21/f25 [0,4194304] 0 2024-04-20T21:58:57.664 INFO:tasks.workunit.client.1.smithi164.stdout:3/375: sync 2024-04-20T21:58:57.664 INFO:tasks.workunit.client.1.smithi164.stdout:2/316: sync 2024-04-20T21:58:57.664 INFO:tasks.workunit.client.1.smithi164.stdout:7/320: write d2/d21/f5e [1278205,108791] 0 2024-04-20T21:58:57.671 INFO:tasks.workunit.client.1.smithi164.stdout:1/294: dwrite d10/d16/d19/f52 [4194304,4194304] 0 2024-04-20T21:58:57.671 INFO:tasks.workunit.client.1.smithi164.stdout:9/404: truncate d3/db/d1b/f46 1510804 0 2024-04-20T21:58:57.672 INFO:tasks.workunit.client.1.smithi164.stdout:6/376: dread d0/d3/d27/f3f [0,4194304] 0 2024-04-20T21:58:57.673 INFO:tasks.workunit.client.1.smithi164.stdout:1/295: rmdir d10 39 2024-04-20T21:58:57.675 INFO:tasks.workunit.client.1.smithi164.stdout:3/376: mknod d12/d20/d39/d55/d6b/c75 0 2024-04-20T21:58:57.676 INFO:tasks.workunit.client.1.smithi164.stdout:0/337: write d1/f1b [370859,104445] 0 2024-04-20T21:58:57.678 INFO:tasks.workunit.client.1.smithi164.stdout:2/317: creat d2/d5f/f60 x:0 0 0 2024-04-20T21:58:57.679 INFO:tasks.workunit.client.1.smithi164.stdout:5/387: truncate dc/d2b/f3f 3880993 0 2024-04-20T21:58:57.681 INFO:tasks.workunit.client.1.smithi164.stdout:0/338: chown d1/d4/c4a 1710 1 2024-04-20T21:58:57.684 INFO:tasks.workunit.client.1.smithi164.stdout:0/339: truncate d1/d4/df/f1a 1648485 0 2024-04-20T21:58:57.685 INFO:tasks.workunit.client.1.smithi164.stdout:6/377: mkdir d0/d3/d8/d81 0 2024-04-20T21:58:57.685 INFO:tasks.workunit.client.1.smithi164.stdout:9/405: getdents d3/db/dd/d75 0 2024-04-20T21:58:57.686 INFO:tasks.workunit.client.1.smithi164.stdout:0/340: dread - d1/d4/da/d27/d33/f63 zero size 2024-04-20T21:58:57.686 INFO:tasks.workunit.client.1.smithi164.stdout:3/377: creat d12/d20/d39/d55/d6b/f76 x:0 0 0 2024-04-20T21:58:57.687 INFO:tasks.workunit.client.1.smithi164.stdout:3/378: chown d12/d68 31913 1 2024-04-20T21:58:57.690 INFO:tasks.workunit.client.1.smithi164.stdout:9/406: write d3/f6 [615197,26913] 0 2024-04-20T21:58:57.691 INFO:tasks.workunit.client.1.smithi164.stdout:7/321: getdents d2/d21 0 2024-04-20T21:58:57.693 INFO:tasks.workunit.client.1.smithi164.stdout:5/388: symlink dc/d2b/l84 0 2024-04-20T21:58:57.700 INFO:tasks.workunit.client.1.smithi164.stdout:0/341: dread d1/d4/da/d27/d33/f3f [0,4194304] 0 2024-04-20T21:58:57.701 INFO:tasks.workunit.client.1.smithi164.stdout:6/378: dwrite d0/d3/f1c [0,4194304] 0 2024-04-20T21:58:57.702 INFO:tasks.workunit.client.1.smithi164.stdout:3/379: mkdir d12/d20/d39/d69/d77 0 2024-04-20T21:58:57.704 INFO:tasks.workunit.client.1.smithi164.stdout:3/380: truncate d12/d20/f6a 56744 0 2024-04-20T21:58:57.707 INFO:tasks.workunit.client.1.smithi164.stdout:7/322: rename d2/c27 to d2/d55/d63/c6f 0 2024-04-20T21:58:57.710 INFO:tasks.workunit.client.1.smithi164.stdout:1/296: truncate d10/d16/f43 49960 0 2024-04-20T21:58:57.712 INFO:tasks.workunit.client.1.smithi164.stdout:1/297: readlink lc 0 2024-04-20T21:58:57.713 INFO:tasks.workunit.client.1.smithi164.stdout:5/389: link dc/d12/d1e/f45 dc/d12/f85 0 2024-04-20T21:58:57.713 INFO:tasks.workunit.client.1.smithi164.stdout:2/318: truncate d2/d5/d21/f2b 1365683 0 2024-04-20T21:58:57.716 INFO:tasks.workunit.client.1.smithi164.stdout:6/379: dwrite d0/f52 [0,4194304] 0 2024-04-20T21:58:57.716 INFO:tasks.workunit.client.1.smithi164.stdout:7/323: symlink d2/d55/d63/l70 0 2024-04-20T21:58:57.723 INFO:tasks.workunit.client.1.smithi164.stdout:3/381: mknod d12/c78 0 2024-04-20T21:58:57.723 INFO:tasks.workunit.client.1.smithi164.stdout:2/319: mknod d2/d30/c61 0 2024-04-20T21:58:57.724 INFO:tasks.workunit.client.1.smithi164.stdout:6/380: dread - d0/d3/d15/d21/d5c/f78 zero size 2024-04-20T21:58:57.726 INFO:tasks.workunit.client.1.smithi164.stdout:9/407: rename d3/db/dd/d40/d2a/l55 to d3/db/d1b/d20/d3f/l8d 0 2024-04-20T21:58:57.726 INFO:tasks.workunit.client.1.smithi164.stdout:2/320: truncate d2/d5f/f60 1013765 0 2024-04-20T21:58:57.728 INFO:tasks.workunit.client.1.smithi164.stdout:2/321: readlink d2/d19/d28/l33 0 2024-04-20T21:58:57.731 INFO:tasks.workunit.client.1.smithi164.stdout:2/322: write d2/d5/d3a/f43 [3811590,69040] 0 2024-04-20T21:58:57.737 INFO:tasks.workunit.client.1.smithi164.stdout:5/390: dwrite dc/d12/d81/f68 [0,4194304] 0 2024-04-20T21:58:57.737 INFO:tasks.workunit.client.1.smithi164.stdout:9/408: truncate d3/db/dd/d40/d2a/d36/f64 19095 0 2024-04-20T21:58:57.737 INFO:tasks.workunit.client.1.smithi164.stdout:1/298: dread d10/d16/f43 [0,4194304] 0 2024-04-20T21:58:57.738 INFO:tasks.workunit.client.1.smithi164.stdout:2/323: mkdir d2/d19/d28/d3e/d53/d62 0 2024-04-20T21:58:57.741 INFO:tasks.workunit.client.1.smithi164.stdout:0/342: dread d1/d4/d26/f46 [0,4194304] 0 2024-04-20T21:58:57.741 INFO:tasks.workunit.client.1.smithi164.stdout:2/324: truncate d2/f34 4957054 0 2024-04-20T21:58:57.743 INFO:tasks.workunit.client.1.smithi164.stdout:2/325: fdatasync d2/d5/d3a/f3b 0 2024-04-20T21:58:57.748 INFO:tasks.workunit.client.1.smithi164.stdout:9/409: symlink d3/db/dd/d75/l8e 0 2024-04-20T21:58:57.753 INFO:tasks.workunit.client.1.smithi164.stdout:5/391: rename dc/d2c/d2e/d30/c34 to dc/d2c/c86 0 2024-04-20T21:58:57.756 INFO:tasks.workunit.client.1.smithi164.stdout:2/326: dread d2/d5/d21/f2d [0,4194304] 0 2024-04-20T21:58:57.758 INFO:tasks.workunit.client.1.smithi164.stdout:1/299: rename d10/d16/d19/c54 to d10/d16/d19/c5a 0 2024-04-20T21:58:57.760 INFO:tasks.workunit.client.1.smithi164.stdout:9/410: creat d3/db/d1b/f8f x:0 0 0 2024-04-20T21:58:57.760 INFO:tasks.workunit.client.1.smithi164.stdout:5/392: symlink dc/d12/l87 0 2024-04-20T21:58:57.762 INFO:tasks.workunit.client.1.smithi164.stdout:2/327: write d2/f12 [1866445,89169] 0 2024-04-20T21:58:57.762 INFO:tasks.workunit.client.1.smithi164.stdout:9/411: readlink d3/l12 0 2024-04-20T21:58:57.763 INFO:tasks.workunit.client.1.smithi164.stdout:6/381: dread d0/f6 [0,4194304] 0 2024-04-20T21:58:57.764 INFO:tasks.workunit.client.1.smithi164.stdout:9/412: chown d3/l31 5 1 2024-04-20T21:58:57.769 INFO:tasks.workunit.client.1.smithi164.stdout:1/300: unlink d10/d16/c22 0 2024-04-20T21:58:57.769 INFO:tasks.workunit.client.1.smithi164.stdout:2/328: truncate d2/d19/d28/f29 1104184 0 2024-04-20T21:58:57.769 INFO:tasks.workunit.client.1.smithi164.stdout:9/413: dread - d3/db/d1b/d1e/f4b zero size 2024-04-20T21:58:57.769 INFO:tasks.workunit.client.1.smithi164.stdout:5/393: creat dc/f88 x:0 0 0 2024-04-20T21:58:57.772 INFO:tasks.workunit.client.1.smithi164.stdout:2/329: mknod d2/d19/d28/d3e/c63 0 2024-04-20T21:58:57.776 INFO:tasks.workunit.client.1.smithi164.stdout:2/330: unlink d2/d5/l10 0 2024-04-20T21:58:57.779 INFO:tasks.workunit.client.1.smithi164.stdout:0/343: dread d1/f23 [0,4194304] 0 2024-04-20T21:58:57.781 INFO:tasks.workunit.client.1.smithi164.stdout:0/344: chown d1/d4/d20 32018549 1 2024-04-20T21:58:57.781 INFO:tasks.workunit.client.1.smithi164.stdout:6/382: dwrite d0/d3/f3a [0,4194304] 0 2024-04-20T21:58:57.783 INFO:tasks.workunit.client.1.smithi164.stdout:2/331: unlink d2/d19/l4d 0 2024-04-20T21:58:57.786 INFO:tasks.workunit.client.1.smithi164.stdout:9/414: dwrite d3/db/dd/d40/d2a/d36/f48 [0,4194304] 0 2024-04-20T21:58:57.786 INFO:tasks.workunit.client.1.smithi164.stdout:0/345: truncate d1/d4/da/d1f/d3c/f58 317144 0 2024-04-20T21:58:57.789 INFO:tasks.workunit.client.1.smithi164.stdout:0/346: fsync d1/d4/da/d1f/f5d 0 2024-04-20T21:58:57.793 INFO:tasks.workunit.client.1.smithi164.stdout:1/301: truncate d10/f15 56523 0 2024-04-20T21:58:57.794 INFO:tasks.workunit.client.1.smithi164.stdout:2/332: symlink d2/d5/l64 0 2024-04-20T21:58:57.798 INFO:tasks.workunit.client.1.smithi164.stdout:5/394: write dc/d2b/f3f [3983242,15540] 0 2024-04-20T21:58:57.807 INFO:tasks.workunit.client.1.smithi164.stdout:4/335: sync 2024-04-20T21:58:57.807 INFO:tasks.workunit.client.1.smithi164.stdout:8/279: sync 2024-04-20T21:58:57.808 INFO:tasks.workunit.client.1.smithi164.stdout:6/383: dwrite d0/d3/d15/d23/d3b/f42 [4194304,4194304] 0 2024-04-20T21:58:57.809 INFO:tasks.workunit.client.1.smithi164.stdout:5/395: write dc/d2c/d2e/f31 [400438,57531] 0 2024-04-20T21:58:57.812 INFO:tasks.workunit.client.1.smithi164.stdout:8/280: stat d0/d14/d16/c3f 0 2024-04-20T21:58:57.818 INFO:tasks.workunit.client.1.smithi164.stdout:4/336: chown d4/d28/d3e/d41/f4b 128104 1 2024-04-20T21:58:57.818 INFO:tasks.workunit.client.1.smithi164.stdout:1/302: symlink d10/d33/d4d/l5b 0 2024-04-20T21:58:57.820 INFO:tasks.workunit.client.1.smithi164.stdout:9/415: dread d3/db/dd/f14 [0,4194304] 0 2024-04-20T21:58:57.821 INFO:tasks.workunit.client.1.smithi164.stdout:8/281: unlink d0/d1e/l36 0 2024-04-20T21:58:57.823 INFO:tasks.workunit.client.1.smithi164.stdout:8/282: fdatasync d0/f4d 0 2024-04-20T21:58:57.825 INFO:tasks.workunit.client.1.smithi164.stdout:5/396: write dc/d2b/d6d/f6f [3044892,31009] 0 2024-04-20T21:58:57.826 INFO:tasks.workunit.client.1.smithi164.stdout:4/337: mkdir d4/d28/d70/d73 0 2024-04-20T21:58:57.831 INFO:tasks.workunit.client.1.smithi164.stdout:2/333: dwrite d2/d5/f1d [0,4194304] 0 2024-04-20T21:58:57.831 INFO:tasks.workunit.client.1.smithi164.stdout:4/338: fdatasync d4/d28/d3e/d41/f6e 0 2024-04-20T21:58:57.831 INFO:tasks.workunit.client.1.smithi164.stdout:8/283: mkdir d0/d14/d5f 0 2024-04-20T21:58:57.834 INFO:tasks.workunit.client.1.smithi164.stdout:9/416: creat d3/db/dd/d40/d2a/f90 x:0 0 0 2024-04-20T21:58:57.834 INFO:tasks.workunit.client.1.smithi164.stdout:5/397: chown dc/d12/l20 1438066 1 2024-04-20T21:58:57.836 INFO:tasks.workunit.client.1.smithi164.stdout:6/384: dwrite d0/d3/f12 [4194304,4194304] 0 2024-04-20T21:58:57.840 INFO:tasks.workunit.client.1.smithi164.stdout:2/334: write d2/d5/d21/f37 [4454994,58734] 0 2024-04-20T21:58:57.840 INFO:tasks.workunit.client.1.smithi164.stdout:6/385: chown d0/d3/f80 799101183 1 2024-04-20T21:58:57.840 INFO:tasks.workunit.client.1.smithi164.stdout:1/303: dwrite d10/d16/d20/f38 [0,4194304] 0 2024-04-20T21:58:57.845 INFO:tasks.workunit.client.1.smithi164.stdout:0/347: dread d1/d4/d26/f36 [0,4194304] 0 2024-04-20T21:58:57.849 INFO:tasks.workunit.client.1.smithi164.stdout:4/339: rename d4/d9/d27/d37/c5a to d4/d28/d3e/c74 0 2024-04-20T21:58:57.850 INFO:tasks.workunit.client.1.smithi164.stdout:6/386: fsync d0/d3/d8/fa 0 2024-04-20T21:58:57.851 INFO:tasks.workunit.client.1.smithi164.stdout:2/335: dread d2/d5/d3a/f4c [0,4194304] 0 2024-04-20T21:58:57.854 INFO:tasks.workunit.client.1.smithi164.stdout:0/348: fsync d1/d4/da/d1f/d3c/f58 0 2024-04-20T21:58:57.859 INFO:tasks.workunit.client.1.smithi164.stdout:5/398: creat dc/d2c/d2e/d30/f89 x:0 0 0 2024-04-20T21:58:57.861 INFO:tasks.workunit.client.1.smithi164.stdout:8/284: dwrite d0/d14/d16/f34 [0,4194304] 0 2024-04-20T21:58:57.863 INFO:tasks.workunit.client.1.smithi164.stdout:8/285: fsync d0/d14/d16/d5b/f5d 0 2024-04-20T21:58:57.865 INFO:tasks.workunit.client.1.smithi164.stdout:4/340: rename d4/l3d to d4/d28/d70/l75 0 2024-04-20T21:58:57.867 INFO:tasks.workunit.client.1.smithi164.stdout:7/324: sync 2024-04-20T21:58:57.868 INFO:tasks.workunit.client.1.smithi164.stdout:9/417: truncate d3/f18 3870640 0 2024-04-20T21:58:57.871 INFO:tasks.workunit.client.1.smithi164.stdout:2/336: mkdir d2/d5/d3a/d65 0 2024-04-20T21:58:57.876 INFO:tasks.workunit.client.1.smithi164.stdout:1/304: link f1 d10/f5c 0 2024-04-20T21:58:57.879 INFO:tasks.workunit.client.1.smithi164.stdout:5/399: mkdir dc/d12/d81/d8a 0 2024-04-20T21:58:57.882 INFO:tasks.workunit.client.1.smithi164.stdout:6/387: symlink d0/d3/d8/d7c/l82 0 2024-04-20T21:58:57.885 INFO:tasks.workunit.client.1.smithi164.stdout:7/325: creat d2/d21/d24/f71 x:0 0 0 2024-04-20T21:58:57.886 INFO:tasks.workunit.client.1.smithi164.stdout:2/337: symlink d2/d30/l66 0 2024-04-20T21:58:57.896 INFO:tasks.workunit.client.1.smithi164.stdout:6/388: rmdir d0/d3/d11/d5a 39 2024-04-20T21:58:57.898 INFO:tasks.workunit.client.1.smithi164.stdout:7/326: creat d2/f72 x:0 0 0 2024-04-20T21:58:57.899 INFO:tasks.workunit.client.1.smithi164.stdout:6/389: write d0/d3/d15/d23/d45/d4f/f66 [520660,63561] 0 2024-04-20T21:58:57.903 INFO:tasks.workunit.client.1.smithi164.stdout:8/286: write d0/f1b [519158,127164] 0 2024-04-20T21:58:57.906 INFO:tasks.workunit.client.1.smithi164.stdout:9/418: creat d3/f91 x:0 0 0 2024-04-20T21:58:57.912 INFO:tasks.workunit.client.1.smithi164.stdout:0/349: getdents d1/d4/d26/d29/d2d 0 2024-04-20T21:58:57.918 INFO:tasks.workunit.client.1.smithi164.stdout:2/338: dwrite d2/f3c [0,4194304] 0 2024-04-20T21:58:57.926 INFO:tasks.workunit.client.1.smithi164.stdout:8/287: link d0/d14/d16/f34 d0/d14/d16/d58/f60 0 2024-04-20T21:58:57.931 INFO:tasks.workunit.client.1.smithi164.stdout:1/305: dwrite d10/d16/f43 [0,4194304] 0 2024-04-20T21:58:57.934 INFO:tasks.workunit.client.1.smithi164.stdout:2/339: unlink d2/d19/d28/l5c 0 2024-04-20T21:58:57.934 INFO:tasks.workunit.client.1.smithi164.stdout:5/400: dwrite f8 [0,4194304] 0 2024-04-20T21:58:57.936 INFO:tasks.workunit.client.1.smithi164.stdout:8/288: dread - d0/f4b zero size 2024-04-20T21:58:57.939 INFO:tasks.workunit.client.1.smithi164.stdout:7/327: dread d2/f7 [0,4194304] 0 2024-04-20T21:58:57.940 INFO:tasks.workunit.client.1.smithi164.stdout:2/340: dread - d2/d19/d28/f32 zero size 2024-04-20T21:58:57.942 INFO:tasks.workunit.client.1.smithi164.stdout:9/419: dwrite d3/db/f8c [0,4194304] 0 2024-04-20T21:58:57.942 INFO:tasks.workunit.client.1.smithi164.stdout:1/306: creat d10/d16/d20/d26/d34/f5d x:0 0 0 2024-04-20T21:58:57.945 INFO:tasks.workunit.client.1.smithi164.stdout:6/390: dwrite d0/d3/d8/f3c [0,4194304] 0 2024-04-20T21:58:57.947 INFO:tasks.workunit.client.1.smithi164.stdout:2/341: truncate d2/d19/d28/f38 817494 0 2024-04-20T21:58:57.950 INFO:tasks.workunit.client.1.smithi164.stdout:9/420: truncate d3/db/d1b/d1e/f25 1298083 0 2024-04-20T21:58:57.955 INFO:tasks.workunit.client.1.smithi164.stdout:8/289: dread d0/f50 [0,4194304] 0 2024-04-20T21:58:57.958 INFO:tasks.workunit.client.1.smithi164.stdout:1/307: creat d10/f5e x:0 0 0 2024-04-20T21:58:57.958 INFO:tasks.workunit.client.1.smithi164.stdout:3/382: sync 2024-04-20T21:58:57.960 INFO:tasks.workunit.client.1.smithi164.stdout:9/421: readlink d3/db/d1b/d20/d3f/l6e 0 2024-04-20T21:58:57.962 INFO:tasks.workunit.client.1.smithi164.stdout:9/422: fsync d3/db/f6f 0 2024-04-20T21:58:57.963 INFO:tasks.workunit.client.1.smithi164.stdout:3/383: dread - d12/d20/d39/d55/d6b/f72 zero size 2024-04-20T21:58:57.968 INFO:tasks.workunit.client.1.smithi164.stdout:0/350: dwrite d1/fb [0,4194304] 0 2024-04-20T21:58:57.973 INFO:tasks.workunit.client.1.smithi164.stdout:1/308: rmdir d10/d33/d57 0 2024-04-20T21:58:57.976 INFO:tasks.workunit.client.1.smithi164.stdout:0/351: creat d1/d2b/f65 x:0 0 0 2024-04-20T21:58:57.980 INFO:tasks.workunit.client.1.smithi164.stdout:9/423: creat d3/f92 x:0 0 0 2024-04-20T21:58:57.980 INFO:tasks.workunit.client.1.smithi164.stdout:2/342: dread d2/d5/d21/f2b [0,4194304] 0 2024-04-20T21:58:57.985 INFO:tasks.workunit.client.1.smithi164.stdout:2/343: write d2/d19/d28/f38 [950405,23797] 0 2024-04-20T21:58:57.986 INFO:tasks.workunit.client.1.smithi164.stdout:2/344: fsync d2/f46 0 2024-04-20T21:58:57.990 INFO:tasks.workunit.client.1.smithi164.stdout:1/309: mknod d10/d16/d20/d26/c5f 0 2024-04-20T21:58:57.991 INFO:tasks.workunit.client.1.smithi164.stdout:0/352: creat d1/d2b/f66 x:0 0 0 2024-04-20T21:58:57.995 INFO:tasks.workunit.client.1.smithi164.stdout:9/424: write d3/db/dd/d40/d2a/f3a [1117197,56223] 0 2024-04-20T21:58:57.998 INFO:tasks.workunit.client.1.smithi164.stdout:9/425: chown d3/f6 0 1 2024-04-20T21:58:58.001 INFO:tasks.workunit.client.1.smithi164.stdout:8/290: write d0/f11 [1557455,115977] 0 2024-04-20T21:58:58.001 INFO:tasks.workunit.client.1.smithi164.stdout:9/426: fdatasync d3/db/dd/f6a 0 2024-04-20T21:58:58.003 INFO:tasks.workunit.client.1.smithi164.stdout:1/310: creat d10/d16/d20/d26/d34/f60 x:0 0 0 2024-04-20T21:58:58.005 INFO:tasks.workunit.client.1.smithi164.stdout:3/384: dread d12/d15/f19 [0,4194304] 0 2024-04-20T21:58:58.006 INFO:tasks.workunit.client.1.smithi164.stdout:8/291: stat d0/d1e/l57 0 2024-04-20T21:58:58.008 INFO:tasks.workunit.client.1.smithi164.stdout:2/345: dwrite d2/f1b [0,4194304] 0 2024-04-20T21:58:58.010 INFO:tasks.workunit.client.1.smithi164.stdout:7/328: dread d2/d21/f34 [0,4194304] 0 2024-04-20T21:58:58.011 INFO:tasks.workunit.client.1.smithi164.stdout:0/353: link d1/d4/df/c11 d1/d2b/c67 0 2024-04-20T21:58:58.014 INFO:tasks.workunit.client.1.smithi164.stdout:7/329: stat d2/d55/d68 0 2024-04-20T21:58:58.014 INFO:tasks.workunit.client.1.smithi164.stdout:2/346: dread - d2/d19/d28/d3e/f42 zero size 2024-04-20T21:58:58.016 INFO:tasks.workunit.client.1.smithi164.stdout:3/385: mkdir d12/d20/d39/d55/d6b/d79 0 2024-04-20T21:58:58.017 INFO:tasks.workunit.client.1.smithi164.stdout:2/347: chown d2/d19/d28/d3e/c63 13515728 1 2024-04-20T21:58:58.022 INFO:tasks.workunit.client.1.smithi164.stdout:0/354: mknod d1/d4/da/d5c/c68 0 2024-04-20T21:58:58.026 INFO:tasks.workunit.client.1.smithi164.stdout:8/292: dwrite d0/f19 [0,4194304] 0 2024-04-20T21:58:58.028 INFO:tasks.workunit.client.1.smithi164.stdout:8/293: chown d0/fc 551 1 2024-04-20T21:58:58.033 INFO:tasks.workunit.client.1.smithi164.stdout:8/294: chown d0/d14/d16/l2d 353388 1 2024-04-20T21:58:58.033 INFO:tasks.workunit.client.1.smithi164.stdout:3/386: link d12/d20/f22 d12/d68/d6f/d71/f7a 0 2024-04-20T21:58:58.034 INFO:tasks.workunit.client.1.smithi164.stdout:1/311: dwrite d10/d16/d20/f2f [0,4194304] 0 2024-04-20T21:58:58.034 INFO:tasks.workunit.client.1.smithi164.stdout:8/295: dread - d0/f4d zero size 2024-04-20T21:58:58.034 INFO:tasks.workunit.client.1.smithi164.stdout:4/341: sync 2024-04-20T21:58:58.034 INFO:tasks.workunit.client.1.smithi164.stdout:2/348: creat d2/f67 x:0 0 0 2024-04-20T21:58:58.034 INFO:tasks.workunit.client.1.smithi164.stdout:7/330: link d2/f5 d2/f73 0 2024-04-20T21:58:58.036 INFO:tasks.workunit.client.1.smithi164.stdout:2/349: write d2/d19/f54 [99165,48287] 0 2024-04-20T21:58:58.038 INFO:tasks.workunit.client.1.smithi164.stdout:2/350: readlink d2/d5/l18 0 2024-04-20T21:58:58.042 INFO:tasks.workunit.client.1.smithi164.stdout:3/387: creat d12/d68/d6f/f7b x:0 0 0 2024-04-20T21:58:58.053 INFO:tasks.workunit.client.1.smithi164.stdout:0/355: creat d1/d4/da/d27/f69 x:0 0 0 2024-04-20T21:58:58.055 INFO:tasks.workunit.client.1.smithi164.stdout:3/388: read - ff zero size 2024-04-20T21:58:58.056 INFO:tasks.workunit.client.1.smithi164.stdout:3/389: readlink d12/d20/d39/d55/l5b 0 2024-04-20T21:58:58.057 INFO:tasks.workunit.client.1.smithi164.stdout:3/390: chown d12/f5a 1183724342 1 2024-04-20T21:58:58.059 INFO:tasks.workunit.client.1.smithi164.stdout:9/427: truncate d3/db/f6f 3399237 0 2024-04-20T21:58:58.059 INFO:tasks.workunit.client.1.smithi164.stdout:6/391: sync 2024-04-20T21:58:58.059 INFO:tasks.workunit.client.1.smithi164.stdout:5/401: sync 2024-04-20T21:58:58.064 INFO:tasks.workunit.client.1.smithi164.stdout:8/296: creat d0/f61 x:0 0 0 2024-04-20T21:58:58.065 INFO:tasks.workunit.client.1.smithi164.stdout:4/342: creat d4/d28/f76 x:0 0 0 2024-04-20T21:58:58.065 INFO:tasks.workunit.client.1.smithi164.stdout:3/391: fsync d12/d20/d39/f4b 0 2024-04-20T21:58:58.066 INFO:tasks.workunit.client.1.smithi164.stdout:4/343: write d4/d9/f1e [112525,9419] 0 2024-04-20T21:58:58.068 INFO:tasks.workunit.client.1.smithi164.stdout:7/331: link d2/c14 d2/d55/c74 0 2024-04-20T21:58:58.070 INFO:tasks.workunit.client.1.smithi164.stdout:9/428: creat d3/db/d4f/f93 x:0 0 0 2024-04-20T21:58:58.070 INFO:tasks.workunit.client.1.smithi164.stdout:9/429: chown d3/f92 190984 1 2024-04-20T21:58:58.072 INFO:tasks.workunit.client.1.smithi164.stdout:9/430: dread - d3/db/dd/f6a zero size 2024-04-20T21:58:58.073 INFO:tasks.workunit.client.1.smithi164.stdout:2/351: dread d2/d19/d28/f40 [0,4194304] 0 2024-04-20T21:58:58.073 INFO:tasks.workunit.client.1.smithi164.stdout:0/356: symlink d1/d4/da/d27/l6a 0 2024-04-20T21:58:58.076 INFO:tasks.workunit.client.1.smithi164.stdout:4/344: rmdir d4/d28/d70 39 2024-04-20T21:58:58.078 INFO:tasks.workunit.client.1.smithi164.stdout:7/332: creat d2/d21/f75 x:0 0 0 2024-04-20T21:58:58.081 INFO:tasks.workunit.client.1.smithi164.stdout:5/402: mknod dc/d2b/d6d/d73/c8b 0 2024-04-20T21:58:58.082 INFO:tasks.workunit.client.1.smithi164.stdout:5/403: read - dc/d2c/d2e/d30/f59 zero size 2024-04-20T21:58:58.089 INFO:tasks.workunit.client.1.smithi164.stdout:0/357: creat d1/d2b/f6b x:0 0 0 2024-04-20T21:58:58.099 INFO:tasks.workunit.client.1.smithi164.stdout:9/431: unlink d3/db/dd/d40/d2a/l3d 0 2024-04-20T21:58:58.099 INFO:tasks.workunit.client.1.smithi164.stdout:1/312: write d10/f5c [8891770,28917] 0 2024-04-20T21:58:58.109 INFO:tasks.workunit.client.1.smithi164.stdout:2/352: dwrite d2/d5/d21/f2d [0,4194304] 0 2024-04-20T21:58:58.110 INFO:tasks.workunit.client.1.smithi164.stdout:6/392: rename d0/d3/d11/c26 to d0/c83 0 2024-04-20T21:58:58.110 INFO:tasks.workunit.client.1.smithi164.stdout:9/432: unlink d3/db/d1b/d20/f5c 0 2024-04-20T21:58:58.113 INFO:tasks.workunit.client.1.smithi164.stdout:2/353: truncate d2/f67 112082 0 2024-04-20T21:58:58.116 INFO:tasks.workunit.client.1.smithi164.stdout:5/404: mkdir dc/d2c/d2e/d30/d8c 0 2024-04-20T21:58:58.119 INFO:tasks.workunit.client.1.smithi164.stdout:3/392: getdents d12/d20/d39 0 2024-04-20T21:58:58.120 INFO:tasks.workunit.client.1.smithi164.stdout:5/405: fsync dc/d2b/d52/f7c 0 2024-04-20T21:58:58.129 INFO:tasks.workunit.client.1.smithi164.stdout:5/406: read dc/d2c/d2e/f31 [3546270,34241] 0 2024-04-20T21:58:58.130 INFO:tasks.workunit.client.1.smithi164.stdout:5/407: readlink dc/l19 0 2024-04-20T21:58:58.134 INFO:tasks.workunit.client.1.smithi164.stdout:5/408: write dc/d2b/d52/d64/f7f [192595,103861] 0 2024-04-20T21:58:58.136 INFO:tasks.workunit.client.1.smithi164.stdout:5/409: write f7 [4764441,127571] 0 2024-04-20T21:58:58.139 INFO:tasks.workunit.client.1.smithi164.stdout:8/297: rename d0/d14/d16/d5b to d0/d14/d4e/d62 0 2024-04-20T21:58:58.139 INFO:tasks.workunit.client.1.smithi164.stdout:6/393: symlink d0/d3/d11/d29/d6e/l84 0 2024-04-20T21:58:58.142 INFO:tasks.workunit.client.1.smithi164.stdout:5/410: read dc/f24 [2523796,109345] 0 2024-04-20T21:58:58.142 INFO:tasks.workunit.client.1.smithi164.stdout:6/394: fsync d0/d3/d8/d28/f33 0 2024-04-20T21:58:58.145 INFO:tasks.workunit.client.1.smithi164.stdout:6/395: readlink d0/d3/d15/d23/d45/d69/l7a 0 2024-04-20T21:58:58.145 INFO:tasks.workunit.client.1.smithi164.stdout:2/354: creat d2/d5/d3a/d55/f68 x:0 0 0 2024-04-20T21:58:58.145 INFO:tasks.workunit.client.1.smithi164.stdout:3/393: creat d12/d68/f7c x:0 0 0 2024-04-20T21:58:58.149 INFO:tasks.workunit.client.1.smithi164.stdout:2/355: stat d2/d19/d28/f2a 0 2024-04-20T21:58:58.149 INFO:tasks.workunit.client.1.smithi164.stdout:6/396: stat d0/d3/d15/d21/d4b/l6b 0 2024-04-20T21:58:58.149 INFO:tasks.workunit.client.1.smithi164.stdout:1/313: creat d10/d16/d19/d1a/d51/f61 x:0 0 0 2024-04-20T21:58:58.151 INFO:tasks.workunit.client.1.smithi164.stdout:4/345: link d4/d28/f6b d4/d9/d22/f77 0 2024-04-20T21:58:58.153 INFO:tasks.workunit.client.1.smithi164.stdout:8/298: readlink d0/d14/l4a 0 2024-04-20T21:58:58.154 INFO:tasks.workunit.client.1.smithi164.stdout:6/397: readlink d0/d3/d11/d29/d6e/l84 0 2024-04-20T21:58:58.155 INFO:tasks.workunit.client.1.smithi164.stdout:2/356: chown d2/l17 51509 1 2024-04-20T21:58:58.156 INFO:tasks.workunit.client.1.smithi164.stdout:3/394: mkdir d12/d68/d6f/d71/d7d 0 2024-04-20T21:58:58.156 INFO:tasks.workunit.client.1.smithi164.stdout:2/357: stat d2/f12 0 2024-04-20T21:58:58.157 INFO:tasks.workunit.client.1.smithi164.stdout:1/314: mknod d10/d33/c62 0 2024-04-20T21:58:58.158 INFO:tasks.workunit.client.1.smithi164.stdout:9/433: creat d3/f94 x:0 0 0 2024-04-20T21:58:58.159 INFO:tasks.workunit.client.1.smithi164.stdout:5/411: unlink dc/d2c/d2e/d30/d5e/c80 0 2024-04-20T21:58:58.163 INFO:tasks.workunit.client.1.smithi164.stdout:4/346: write d4/fb [171325,49049] 0 2024-04-20T21:58:58.163 INFO:tasks.workunit.client.1.smithi164.stdout:8/299: dread d0/f50 [0,4194304] 0 2024-04-20T21:58:58.163 INFO:tasks.workunit.client.1.smithi164.stdout:1/315: write d10/d33/d48/f4b [1493085,107765] 0 2024-04-20T21:58:58.164 INFO:tasks.workunit.client.1.smithi164.stdout:9/434: fsync d3/db/d1b/d1e/f79 0 2024-04-20T21:58:58.165 INFO:tasks.workunit.client.1.smithi164.stdout:4/347: fdatasync d4/d9/d27/d37/f5b 0 2024-04-20T21:58:58.169 INFO:tasks.workunit.client.1.smithi164.stdout:8/300: rmdir d0/d1e 39 2024-04-20T21:58:58.170 INFO:tasks.workunit.client.1.smithi164.stdout:1/316: stat d10/d16/d19/d1a/l4a 0 2024-04-20T21:58:58.171 INFO:tasks.workunit.client.1.smithi164.stdout:6/398: rename d0/d3/l44 to d0/d3/d11/l85 0 2024-04-20T21:58:58.173 INFO:tasks.workunit.client.1.smithi164.stdout:1/317: truncate d10/f5e 299857 0 2024-04-20T21:58:58.174 INFO:tasks.workunit.client.1.smithi164.stdout:0/358: write d1/f42 [1826160,73507] 0 2024-04-20T21:58:58.175 INFO:tasks.workunit.client.1.smithi164.stdout:7/333: write d2/d21/d33/f54 [9456525,20027] 0 2024-04-20T21:58:58.176 INFO:tasks.workunit.client.1.smithi164.stdout:3/395: link d12/f32 d12/d20/f7e 0 2024-04-20T21:58:58.184 INFO:tasks.workunit.client.1.smithi164.stdout:9/435: read - d3/db/dd/d40/d2a/f59 zero size 2024-04-20T21:58:58.187 INFO:tasks.workunit.client.1.smithi164.stdout:2/358: dwrite d2/d5/d3a/f43 [4194304,4194304] 0 2024-04-20T21:58:58.192 INFO:tasks.workunit.client.1.smithi164.stdout:2/359: dread - d2/d5/d3a/d55/f56 zero size 2024-04-20T21:58:58.198 INFO:tasks.workunit.client.1.smithi164.stdout:7/334: chown d2/d21/d24/d31/d3a/l3f 3096 1 2024-04-20T21:58:58.199 INFO:tasks.workunit.client.1.smithi164.stdout:1/318: dread d10/d16/f43 [0,4194304] 0 2024-04-20T21:58:58.203 INFO:tasks.workunit.client.1.smithi164.stdout:1/319: fsync d10/d16/d19/f4e 0 2024-04-20T21:58:58.203 INFO:tasks.workunit.client.1.smithi164.stdout:0/359: dread d1/d4/d26/d29/f44 [0,4194304] 0 2024-04-20T21:58:58.205 INFO:tasks.workunit.client.1.smithi164.stdout:3/396: dwrite d12/d15/f37 [0,4194304] 0 2024-04-20T21:58:58.205 INFO:tasks.workunit.client.1.smithi164.stdout:1/320: fsync d10/d33/d48/f4b 0 2024-04-20T21:58:58.208 INFO:tasks.workunit.client.1.smithi164.stdout:5/412: rename dc/l1d to dc/d2b/l8d 0 2024-04-20T21:58:58.223 INFO:tasks.workunit.client.1.smithi164.stdout:8/301: link d0/l3c d0/d1e/l63 0 2024-04-20T21:58:58.225 INFO:tasks.workunit.client.1.smithi164.stdout:5/413: creat dc/d12/f8e x:0 0 0 2024-04-20T21:58:58.231 INFO:tasks.workunit.client.1.smithi164.stdout:9/436: write d3/db/f5b [2480312,123960] 0 2024-04-20T21:58:58.231 INFO:tasks.workunit.client.1.smithi164.stdout:0/360: dread d1/d4/f2c [0,4194304] 0 2024-04-20T21:58:58.233 INFO:tasks.workunit.client.1.smithi164.stdout:2/360: link d2/f20 d2/d5/d3a/d55/f69 0 2024-04-20T21:58:58.234 INFO:tasks.workunit.client.1.smithi164.stdout:4/348: dwrite d4/d28/f6b [0,4194304] 0 2024-04-20T21:58:58.235 INFO:tasks.workunit.client.1.smithi164.stdout:3/397: link d12/d15/f1c d12/d20/d39/d69/d77/f7f 0 2024-04-20T21:58:58.240 INFO:tasks.workunit.client.1.smithi164.stdout:4/349: chown d4/fe 66 1 2024-04-20T21:58:58.240 INFO:tasks.workunit.client.1.smithi164.stdout:3/398: chown d12/d20/d39/d55/c5c 352590 1 2024-04-20T21:58:58.243 INFO:tasks.workunit.client.1.smithi164.stdout:6/399: dwrite d0/d3/d8/f1f [0,4194304] 0 2024-04-20T21:58:58.243 INFO:tasks.workunit.client.1.smithi164.stdout:4/350: chown d4/d9/d27/d37/l4c 784 1 2024-04-20T21:58:58.248 INFO:tasks.workunit.client.1.smithi164.stdout:6/400: write d0/d3/d8/f3c [4672337,88929] 0 2024-04-20T21:58:58.253 INFO:tasks.workunit.client.1.smithi164.stdout:1/321: dread d10/f5c [4194304,4194304] 0 2024-04-20T21:58:58.254 INFO:tasks.workunit.client.1.smithi164.stdout:5/414: dread dc/d12/d81/f68 [0,4194304] 0 2024-04-20T21:58:58.254 INFO:tasks.workunit.client.1.smithi164.stdout:1/322: write f7 [667136,75] 0 2024-04-20T21:58:58.257 INFO:tasks.workunit.client.1.smithi164.stdout:8/302: symlink d0/d14/d16/d58/l64 0 2024-04-20T21:58:58.262 INFO:tasks.workunit.client.1.smithi164.stdout:7/335: truncate d2/d21/d24/d31/f41 1813586 0 2024-04-20T21:58:58.267 INFO:tasks.workunit.client.1.smithi164.stdout:2/361: creat d2/d5/d3a/f6a x:0 0 0 2024-04-20T21:58:58.271 INFO:tasks.workunit.client.1.smithi164.stdout:0/361: dwrite d1/d4/da/d1f/d3c/f4e [0,4194304] 0 2024-04-20T21:58:58.273 INFO:tasks.workunit.client.1.smithi164.stdout:1/323: rmdir d10/d16/d20/d26 39 2024-04-20T21:58:58.273 INFO:tasks.workunit.client.1.smithi164.stdout:5/415: rmdir dc/d2c/d2e/d30 39 2024-04-20T21:58:58.274 INFO:tasks.workunit.client.1.smithi164.stdout:8/303: symlink d0/d14/d4e/l65 0 2024-04-20T21:58:58.279 INFO:tasks.workunit.client.1.smithi164.stdout:2/362: dread d2/d5/d3a/f4c [0,4194304] 0 2024-04-20T21:58:58.285 INFO:tasks.workunit.client.1.smithi164.stdout:9/437: creat d3/f95 x:0 0 0 2024-04-20T21:58:58.292 INFO:tasks.workunit.client.1.smithi164.stdout:3/399: getdents d12/d20/d39/d55/d6b 0 2024-04-20T21:58:58.295 INFO:tasks.workunit.client.1.smithi164.stdout:3/400: dread - d12/d2a/f4d zero size 2024-04-20T21:58:58.296 INFO:tasks.workunit.client.1.smithi164.stdout:7/336: dwrite d2/f72 [0,4194304] 0 2024-04-20T21:58:58.296 INFO:tasks.workunit.client.1.smithi164.stdout:6/401: dread d0/d3/d15/f32 [0,4194304] 0 2024-04-20T21:58:58.298 INFO:tasks.workunit.client.1.smithi164.stdout:8/304: unlink d0/d14/f32 0 2024-04-20T21:58:58.298 INFO:tasks.workunit.client.1.smithi164.stdout:9/438: symlink d3/db/l96 0 2024-04-20T21:58:58.300 INFO:tasks.workunit.client.1.smithi164.stdout:3/401: dread - d12/d20/f63 zero size 2024-04-20T21:58:58.301 INFO:tasks.workunit.client.1.smithi164.stdout:2/363: creat d2/f6b x:0 0 0 2024-04-20T21:58:58.303 INFO:tasks.workunit.client.1.smithi164.stdout:8/305: write d0/d14/f3d [2169370,109610] 0 2024-04-20T21:58:58.303 INFO:tasks.workunit.client.1.smithi164.stdout:4/351: write d4/d9/d22/f24 [317678,106689] 0 2024-04-20T21:58:58.306 INFO:tasks.workunit.client.1.smithi164.stdout:6/402: fsync d0/d3/d15/f2c 0 2024-04-20T21:58:58.307 INFO:tasks.workunit.client.1.smithi164.stdout:5/416: truncate dc/d12/f13 3026414 0 2024-04-20T21:58:58.309 INFO:tasks.workunit.client.1.smithi164.stdout:0/362: dwrite d1/f42 [0,4194304] 0 2024-04-20T21:58:58.309 INFO:tasks.workunit.client.1.smithi164.stdout:9/439: creat d3/db/d4f/d67/f97 x:0 0 0 2024-04-20T21:58:58.309 INFO:tasks.workunit.client.1.smithi164.stdout:3/402: stat d12/d20/d39 0 2024-04-20T21:58:58.309 INFO:tasks.workunit.client.1.smithi164.stdout:7/337: chown d2/d21/l2e 1 1 2024-04-20T21:58:58.311 INFO:tasks.workunit.client.1.smithi164.stdout:1/324: truncate d10/d33/f46 500676 0 2024-04-20T21:58:58.314 INFO:tasks.workunit.client.1.smithi164.stdout:3/403: dread - d12/d15/f6e zero size 2024-04-20T21:58:58.314 INFO:tasks.workunit.client.1.smithi164.stdout:5/417: stat dc/d2b/d6d/d73 0 2024-04-20T21:58:58.316 INFO:tasks.workunit.client.1.smithi164.stdout:2/364: mknod d2/d5/d3a/d55/c6c 0 2024-04-20T21:58:58.316 INFO:tasks.workunit.client.1.smithi164.stdout:1/325: stat d10/d16/l1d 0 2024-04-20T21:58:58.319 INFO:tasks.workunit.client.1.smithi164.stdout:3/404: stat d12/d20/f6a 0 2024-04-20T21:58:58.321 INFO:tasks.workunit.client.1.smithi164.stdout:9/440: rmdir d3/db/d82 39 2024-04-20T21:58:58.321 INFO:tasks.workunit.client.1.smithi164.stdout:3/405: readlink d12/d20/d39/d55/l5b 0 2024-04-20T21:58:58.323 INFO:tasks.workunit.client.1.smithi164.stdout:0/363: mkdir d1/d4/da/d5c/d6c 0 2024-04-20T21:58:58.325 INFO:tasks.workunit.client.1.smithi164.stdout:6/403: mknod d0/d3/d15/d21/d5c/c86 0 2024-04-20T21:58:58.326 INFO:tasks.workunit.client.1.smithi164.stdout:5/418: unlink f6 0 2024-04-20T21:58:58.329 INFO:tasks.workunit.client.1.smithi164.stdout:3/406: read d12/d15/f21 [2103185,62106] 0 2024-04-20T21:58:58.330 INFO:tasks.workunit.client.1.smithi164.stdout:6/404: write d0/d3/f80 [839487,20265] 0 2024-04-20T21:58:58.331 INFO:tasks.workunit.client.1.smithi164.stdout:1/326: creat d10/d33/d41/f63 x:0 0 0 2024-04-20T21:58:58.332 INFO:tasks.workunit.client.1.smithi164.stdout:3/407: dread - d12/d20/f63 zero size 2024-04-20T21:58:58.348 INFO:tasks.workunit.client.1.smithi164.stdout:1/327: dwrite d10/d16/d20/f28 [0,4194304] 0 2024-04-20T21:58:58.349 INFO:tasks.workunit.client.1.smithi164.stdout:9/441: mkdir d3/db/d82/d98 0 2024-04-20T21:58:58.356 INFO:tasks.workunit.client.1.smithi164.stdout:8/306: truncate d0/d14/f6 1255959 0 2024-04-20T21:58:58.358 INFO:tasks.workunit.client.1.smithi164.stdout:4/352: dread d4/f7 [0,4194304] 0 2024-04-20T21:58:58.359 INFO:tasks.workunit.client.1.smithi164.stdout:7/338: truncate d2/d21/f35 1910724 0 2024-04-20T21:58:58.362 INFO:tasks.workunit.client.1.smithi164.stdout:5/419: dread - dc/d2c/d2e/d30/f59 zero size 2024-04-20T21:58:58.367 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:58:58 smithi164 ceph-mon[23506]: pgmap v6: 65 pgs: 65 active+clean; 2.5 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 8.6 MiB/s rd, 33 MiB/s wr, 43 op/s 2024-04-20T21:58:58.367 INFO:tasks.workunit.client.1.smithi164.stdout:2/365: creat d2/d5/f6d x:0 0 0 2024-04-20T21:58:58.369 INFO:tasks.workunit.client.1.smithi164.stdout:6/405: dwrite d0/f16 [0,4194304] 0 2024-04-20T21:58:58.370 INFO:tasks.workunit.client.1.smithi164.stdout:2/366: fdatasync d2/d5/f1d 0 2024-04-20T21:58:58.372 INFO:tasks.workunit.client.1.smithi164.stdout:2/367: dread - d2/f6b zero size 2024-04-20T21:58:58.373 INFO:tasks.workunit.client.1.smithi164.stdout:3/408: link d12/d20/d39/f4b d12/d20/d39/d55/d6b/f80 0 2024-04-20T21:58:58.373 INFO:tasks.workunit.client.1.smithi164.stdout:9/442: dwrite d3/db/d1b/d20/d3f/f4e [0,4194304] 0 2024-04-20T21:58:58.373 INFO:tasks.workunit.client.1.smithi164.stdout:0/364: creat d1/d4/da/f6d x:0 0 0 2024-04-20T21:58:58.377 INFO:tasks.workunit.client.1.smithi164.stdout:3/409: write d12/d20/d39/d55/d6b/f76 [204121,879] 0 2024-04-20T21:58:58.377 INFO:tasks.workunit.client.1.smithi164.stdout:9/443: write d3/db/dd/d40/d2a/d36/f64 [253399,89352] 0 2024-04-20T21:58:58.385 INFO:tasks.workunit.client.1.smithi164.stdout:7/339: rename d2/f15 to d2/d21/d24/d60/f76 0 2024-04-20T21:58:58.393 INFO:tasks.workunit.client.1.smithi164.stdout:1/328: truncate d10/f15 352274 0 2024-04-20T21:58:58.396 INFO:tasks.workunit.client.1.smithi164.stdout:3/410: dwrite d12/f1e [4194304,4194304] 0 2024-04-20T21:58:58.399 INFO:tasks.workunit.client.1.smithi164.stdout:0/365: mkdir d1/d4/da/d5c/d6e 0 2024-04-20T21:58:58.404 INFO:tasks.workunit.client.1.smithi164.stdout:7/340: mkdir d2/d55/d77 0 2024-04-20T21:58:58.406 INFO:tasks.workunit.client.1.smithi164.stdout:7/341: stat d2/d21/d24/f71 0 2024-04-20T21:58:58.406 INFO:tasks.workunit.client.1.smithi164.stdout:5/420: dwrite dc/f66 [0,4194304] 0 2024-04-20T21:58:58.412 INFO:tasks.workunit.client.1.smithi164.stdout:6/406: creat d0/d3/d62/d75/f87 x:0 0 0 2024-04-20T21:58:58.412 INFO:tasks.workunit.client.1.smithi164.stdout:2/368: mknod d2/c6e 0 2024-04-20T21:58:58.412 INFO:tasks.workunit.client.1.smithi164.stdout:5/421: write dc/d12/d1e/f35 [3057897,123167] 0 2024-04-20T21:58:58.413 INFO:tasks.workunit.client.1.smithi164.stdout:8/307: dwrite d0/d14/d16/d58/f60 [0,4194304] 0 2024-04-20T21:58:58.422 INFO:tasks.workunit.client.1.smithi164.stdout:5/422: dread - dc/d2c/d2e/d30/f59 zero size 2024-04-20T21:58:58.422 INFO:tasks.workunit.client.1.smithi164.stdout:4/353: creat d4/f78 x:0 0 0 2024-04-20T21:58:58.424 INFO:tasks.workunit.client.1.smithi164.stdout:7/342: rename d2 to d2/d21/d78 22 2024-04-20T21:58:58.424 INFO:tasks.workunit.client.1.smithi164.stdout:1/329: symlink d10/d16/d20/l64 0 2024-04-20T21:58:58.426 INFO:tasks.workunit.client.1.smithi164.stdout:3/411: mkdir d12/d20/d39/d69/d77/d81 0 2024-04-20T21:58:58.428 INFO:tasks.workunit.client.1.smithi164.stdout:2/369: symlink d2/d19/d28/d3e/l6f 0 2024-04-20T21:58:58.430 INFO:tasks.workunit.client.1.smithi164.stdout:2/370: write d2/f67 [42853,45160] 0 2024-04-20T21:58:58.433 INFO:tasks.workunit.client.1.smithi164.stdout:2/371: fdatasync d2/d5/d3a/f4c 0 2024-04-20T21:58:58.433 INFO:tasks.workunit.client.1.smithi164.stdout:0/366: symlink d1/d4/d26/l6f 0 2024-04-20T21:58:58.436 INFO:tasks.workunit.client.1.smithi164.stdout:9/444: creat d3/f99 x:0 0 0 2024-04-20T21:58:58.437 INFO:tasks.workunit.client.1.smithi164.stdout:1/330: symlink d10/d16/d19/d1a/l65 0 2024-04-20T21:58:58.439 INFO:tasks.workunit.client.1.smithi164.stdout:6/407: truncate d0/d3/d8/fa 451941 0 2024-04-20T21:58:58.440 INFO:tasks.workunit.client.1.smithi164.stdout:5/423: dwrite dc/d12/f8e [0,4194304] 0 2024-04-20T21:58:58.441 INFO:tasks.workunit.client.1.smithi164.stdout:6/408: chown d0/l65 5302 1 2024-04-20T21:58:58.441 INFO:tasks.workunit.client.1.smithi164.stdout:8/308: mknod d0/d14/d5f/c66 0 2024-04-20T21:58:58.442 INFO:tasks.workunit.client.1.smithi164.stdout:6/409: fsync d0/f52 0 2024-04-20T21:58:58.443 INFO:tasks.workunit.client.1.smithi164.stdout:5/424: write dc/d2b/d52/f62 [936835,41289] 0 2024-04-20T21:58:58.444 INFO:tasks.workunit.client.1.smithi164.stdout:6/410: chown d0/l76 0 1 2024-04-20T21:58:58.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:58:58 smithi142 ceph-mon[15828]: pgmap v6: 65 pgs: 65 active+clean; 2.5 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 8.6 MiB/s rd, 33 MiB/s wr, 43 op/s 2024-04-20T21:58:58.454 INFO:tasks.workunit.client.1.smithi164.stdout:5/425: readlink dc/d2b/d52/l5a 0 2024-04-20T21:58:58.454 INFO:tasks.workunit.client.1.smithi164.stdout:1/331: mkdir d10/d16/d20/d66 0 2024-04-20T21:58:58.458 INFO:tasks.workunit.client.1.smithi164.stdout:7/343: dwrite d2/d21/f28 [4194304,4194304] 0 2024-04-20T21:58:58.459 INFO:tasks.workunit.client.1.smithi164.stdout:0/367: dwrite d1/d4/da/d27/d33/f35 [0,4194304] 0 2024-04-20T21:58:58.464 INFO:tasks.workunit.client.1.smithi164.stdout:4/354: creat d4/d28/d3e/f79 x:0 0 0 2024-04-20T21:58:58.472 INFO:tasks.workunit.client.1.smithi164.stdout:3/412: dread d12/f73 [0,4194304] 0 2024-04-20T21:58:58.475 INFO:tasks.workunit.client.1.smithi164.stdout:6/411: dwrite d0/d3/f18 [0,4194304] 0 2024-04-20T21:58:58.475 INFO:tasks.workunit.client.1.smithi164.stdout:2/372: getdents d2/d19/d28/d3e/d53 0 2024-04-20T21:58:58.478 INFO:tasks.workunit.client.1.smithi164.stdout:9/445: getdents d3/db 0 2024-04-20T21:58:58.479 INFO:tasks.workunit.client.1.smithi164.stdout:5/426: symlink dc/d2c/d2e/d30/d72/l8f 0 2024-04-20T21:58:58.484 INFO:tasks.workunit.client.1.smithi164.stdout:3/413: symlink d12/d20/d39/d69/d77/l82 0 2024-04-20T21:58:58.484 INFO:tasks.workunit.client.1.smithi164.stdout:9/446: mkdir d3/db/d4f/d9a 0 2024-04-20T21:58:58.484 INFO:tasks.workunit.client.1.smithi164.stdout:7/344: symlink d2/d55/d68/l79 0 2024-04-20T21:58:58.490 INFO:tasks.workunit.client.1.smithi164.stdout:0/368: dread d1/f23 [0,4194304] 0 2024-04-20T21:58:58.490 INFO:tasks.workunit.client.1.smithi164.stdout:7/345: chown d2/c1e 110169 1 2024-04-20T21:58:58.493 INFO:tasks.workunit.client.1.smithi164.stdout:7/346: readlink d2/l11 0 2024-04-20T21:58:58.498 INFO:tasks.workunit.client.1.smithi164.stdout:9/447: write d3/db/d1b/f34 [8269841,111770] 0 2024-04-20T21:58:58.498 INFO:tasks.workunit.client.1.smithi164.stdout:4/355: creat d4/d9/d27/f7a x:0 0 0 2024-04-20T21:58:58.499 INFO:tasks.workunit.client.1.smithi164.stdout:8/309: dwrite d0/d14/f6 [0,4194304] 0 2024-04-20T21:58:58.507 INFO:tasks.workunit.client.1.smithi164.stdout:2/373: getdents d2/d5/d3a/d55 0 2024-04-20T21:58:58.507 INFO:tasks.workunit.client.1.smithi164.stdout:1/332: dwrite d10/d16/d20/d25/f2e [0,4194304] 0 2024-04-20T21:58:58.513 INFO:tasks.workunit.client.1.smithi164.stdout:9/448: chown d3/db/d1b/d1e/l42 224843743 1 2024-04-20T21:58:58.513 INFO:tasks.workunit.client.1.smithi164.stdout:0/369: write d1/d4/da/d1f/d3c/f4e [3512372,112813] 0 2024-04-20T21:58:58.520 INFO:tasks.workunit.client.1.smithi164.stdout:8/310: symlink d0/d14/l67 0 2024-04-20T21:58:58.521 INFO:tasks.workunit.client.1.smithi164.stdout:4/356: chown d4/d9/d27/d3f/d5f/c65 25 1 2024-04-20T21:58:58.522 INFO:tasks.workunit.client.1.smithi164.stdout:0/370: chown d1/d4/d26/c50 22119938 1 2024-04-20T21:58:58.522 INFO:tasks.workunit.client.1.smithi164.stdout:3/414: dread d12/d15/f19 [0,4194304] 0 2024-04-20T21:58:58.522 INFO:tasks.workunit.client.1.smithi164.stdout:2/374: mknod d2/d5/d3a/d55/c70 0 2024-04-20T21:58:58.524 INFO:tasks.workunit.client.1.smithi164.stdout:7/347: rename d2/d21/d24/d31/d3a/c3e to d2/d21/d44/c7a 0 2024-04-20T21:58:58.526 INFO:tasks.workunit.client.1.smithi164.stdout:5/427: dwrite dc/d2c/f4f [4194304,4194304] 0 2024-04-20T21:58:58.528 INFO:tasks.workunit.client.1.smithi164.stdout:0/371: read - d1/d4/df/f59 zero size 2024-04-20T21:58:58.528 INFO:tasks.workunit.client.1.smithi164.stdout:6/412: dwrite d0/d3/d15/d21/d5c/f78 [0,4194304] 0 2024-04-20T21:58:58.529 INFO:tasks.workunit.client.1.smithi164.stdout:1/333: creat d10/d16/d19/f67 x:0 0 0 2024-04-20T21:58:58.531 INFO:tasks.workunit.client.1.smithi164.stdout:3/415: chown d12/d20/d39/f46 5 1 2024-04-20T21:58:58.538 INFO:tasks.workunit.client.1.smithi164.stdout:2/375: creat d2/d5/d3a/d55/f71 x:0 0 0 2024-04-20T21:58:58.543 INFO:tasks.workunit.client.1.smithi164.stdout:9/449: rename d3/db/f6f to d3/db/dd/d40/d2a/d36/d51/f9b 0 2024-04-20T21:58:58.544 INFO:tasks.workunit.client.1.smithi164.stdout:3/416: read d12/d20/d39/d55/d6b/f80 [12928,63131] 0 2024-04-20T21:58:58.550 INFO:tasks.workunit.client.1.smithi164.stdout:2/376: chown d2/c1a 762075833 1 2024-04-20T21:58:58.550 INFO:tasks.workunit.client.1.smithi164.stdout:9/450: rmdir d3/db/d82 39 2024-04-20T21:58:58.552 INFO:tasks.workunit.client.1.smithi164.stdout:8/311: write d0/f3a [581001,54186] 0 2024-04-20T21:58:58.554 INFO:tasks.workunit.client.1.smithi164.stdout:5/428: dwrite dc/d2b/d52/f62 [0,4194304] 0 2024-04-20T21:58:58.554 INFO:tasks.workunit.client.1.smithi164.stdout:0/372: getdents d1/d4/df 0 2024-04-20T21:58:58.557 INFO:tasks.workunit.client.1.smithi164.stdout:2/377: chown d2/c1a 93375 1 2024-04-20T21:58:58.558 INFO:tasks.workunit.client.1.smithi164.stdout:5/429: stat dc/f7d 0 2024-04-20T21:58:58.563 INFO:tasks.workunit.client.1.smithi164.stdout:2/378: mknod d2/d19/c72 0 2024-04-20T21:58:58.567 INFO:tasks.workunit.client.1.smithi164.stdout:4/357: dwrite d4/d28/f44 [0,4194304] 0 2024-04-20T21:58:58.570 INFO:tasks.workunit.client.1.smithi164.stdout:0/373: rmdir d1/d4/d49 39 2024-04-20T21:58:58.572 INFO:tasks.workunit.client.1.smithi164.stdout:9/451: rename d3/l15 to d3/db/dd/d40/d78/l9c 0 2024-04-20T21:58:58.572 INFO:tasks.workunit.client.1.smithi164.stdout:5/430: creat dc/d2c/f90 x:0 0 0 2024-04-20T21:58:58.572 INFO:tasks.workunit.client.1.smithi164.stdout:6/413: dwrite d0/d3/d8/f38 [4194304,4194304] 0 2024-04-20T21:58:58.575 INFO:tasks.workunit.client.1.smithi164.stdout:6/414: dread - d0/d3/d15/d23/d3b/f57 zero size 2024-04-20T21:58:58.577 INFO:tasks.workunit.client.1.smithi164.stdout:0/374: write d1/d4/f28 [3533698,27877] 0 2024-04-20T21:58:58.580 INFO:tasks.workunit.client.1.smithi164.stdout:6/415: readlink d0/d3/d8/d7c/l82 0 2024-04-20T21:58:58.581 INFO:tasks.workunit.client.1.smithi164.stdout:3/417: truncate d12/d20/f2b 1868269 0 2024-04-20T21:58:58.582 INFO:tasks.workunit.client.1.smithi164.stdout:1/334: dwrite d10/d16/f43 [0,4194304] 0 2024-04-20T21:58:58.588 INFO:tasks.workunit.client.1.smithi164.stdout:4/358: dread d4/d9/d27/d3f/f4f [0,4194304] 0 2024-04-20T21:58:58.594 INFO:tasks.workunit.client.1.smithi164.stdout:5/431: chown la 80692 1 2024-04-20T21:58:58.598 INFO:tasks.workunit.client.1.smithi164.stdout:9/452: chown d3/db/dd/f11 313 1 2024-04-20T21:58:58.600 INFO:tasks.workunit.client.1.smithi164.stdout:9/453: fdatasync d3/db/f52 0 2024-04-20T21:58:58.601 INFO:tasks.workunit.client.1.smithi164.stdout:8/312: truncate d0/d14/f6 2916592 0 2024-04-20T21:58:58.601 INFO:tasks.workunit.client.1.smithi164.stdout:6/416: creat d0/d3/d62/f88 x:0 0 0 2024-04-20T21:58:58.602 INFO:tasks.workunit.client.1.smithi164.stdout:8/313: fsync d0/f56 0 2024-04-20T21:58:58.603 INFO:tasks.workunit.client.1.smithi164.stdout:7/348: dread d2/d21/d24/d31/f46 [0,4194304] 0 2024-04-20T21:58:58.606 INFO:tasks.workunit.client.1.smithi164.stdout:5/432: dread - dc/d2c/d2e/f47 zero size 2024-04-20T21:58:58.606 INFO:tasks.workunit.client.1.smithi164.stdout:8/314: dread - d0/f4b zero size 2024-04-20T21:58:58.610 INFO:tasks.workunit.client.1.smithi164.stdout:8/315: readlink d0/l41 0 2024-04-20T21:58:58.612 INFO:tasks.workunit.client.1.smithi164.stdout:2/379: getdents d2/d5/d3a 0 2024-04-20T21:58:58.613 INFO:tasks.workunit.client.1.smithi164.stdout:4/359: link f2 d4/d9/d27/f7b 0 2024-04-20T21:58:58.616 INFO:tasks.workunit.client.1.smithi164.stdout:2/380: stat d2/c48 0 2024-04-20T21:58:58.617 INFO:tasks.workunit.client.1.smithi164.stdout:7/349: creat d2/d21/d24/d31/f7b x:0 0 0 2024-04-20T21:58:58.621 INFO:tasks.workunit.client.1.smithi164.stdout:3/418: truncate d12/d15/f37 4153959 0 2024-04-20T21:58:58.622 INFO:tasks.workunit.client.1.smithi164.stdout:1/335: dwrite d10/d16/f27 [4194304,4194304] 0 2024-04-20T21:58:58.626 INFO:tasks.workunit.client.1.smithi164.stdout:9/454: write d3/db/dd/f14 [59803,31861] 0 2024-04-20T21:58:58.627 INFO:tasks.workunit.client.1.smithi164.stdout:5/433: mknod dc/d2c/d2e/d30/c91 0 2024-04-20T21:58:58.628 INFO:tasks.workunit.client.1.smithi164.stdout:5/434: chown dc/d2b/d52 8665 1 2024-04-20T21:58:58.629 INFO:tasks.workunit.client.1.smithi164.stdout:7/350: symlink d2/d55/d6a/l7c 0 2024-04-20T21:58:58.630 INFO:tasks.workunit.client.1.smithi164.stdout:5/435: write dc/f24 [2542773,42623] 0 2024-04-20T21:58:58.634 INFO:tasks.workunit.client.1.smithi164.stdout:6/417: rmdir d0/d3/d8/d28/d6f/d74 0 2024-04-20T21:58:58.639 INFO:tasks.workunit.client.1.smithi164.stdout:6/418: read d0/f6 [1123210,104819] 0 2024-04-20T21:58:58.640 INFO:tasks.workunit.client.1.smithi164.stdout:3/419: mkdir d12/d20/d39/d69/d83 0 2024-04-20T21:58:58.644 INFO:tasks.workunit.client.1.smithi164.stdout:6/419: chown d0/d3/f12 5 1 2024-04-20T21:58:58.644 INFO:tasks.workunit.client.1.smithi164.stdout:1/336: write f1 [1412647,36913] 0 2024-04-20T21:58:58.646 INFO:tasks.workunit.client.1.smithi164.stdout:9/455: rmdir d3 39 2024-04-20T21:58:58.648 INFO:tasks.workunit.client.1.smithi164.stdout:2/381: dread d2/d30/f4b [0,4194304] 0 2024-04-20T21:58:58.650 INFO:tasks.workunit.client.1.smithi164.stdout:8/316: link d0/d14/d4e/l65 d0/d14/d4e/l68 0 2024-04-20T21:58:58.652 INFO:tasks.workunit.client.1.smithi164.stdout:6/420: chown d0/d3/d15/d21/d4b/f4e 449912 1 2024-04-20T21:58:58.657 INFO:tasks.workunit.client.1.smithi164.stdout:7/351: write d2/d21/d24/f57 [2186018,99272] 0 2024-04-20T21:58:58.657 INFO:tasks.workunit.client.1.smithi164.stdout:4/360: dwrite d4/f15 [0,4194304] 0 2024-04-20T21:58:58.659 INFO:tasks.workunit.client.1.smithi164.stdout:2/382: write d2/d5/d3a/d55/f56 [840701,54215] 0 2024-04-20T21:58:58.661 INFO:tasks.workunit.client.1.smithi164.stdout:9/456: dread - d3/db/d1b/d20/f7d zero size 2024-04-20T21:58:58.665 INFO:tasks.workunit.client.1.smithi164.stdout:5/436: dwrite dc/d2b/d52/d64/f7f [0,4194304] 0 2024-04-20T21:58:58.673 INFO:tasks.workunit.client.1.smithi164.stdout:3/420: dwrite d12/f5f [0,4194304] 0 2024-04-20T21:58:58.677 INFO:tasks.workunit.client.1.smithi164.stdout:5/437: write dc/d2c/d2e/d30/f55 [435937,58442] 0 2024-04-20T21:58:58.677 INFO:tasks.workunit.client.1.smithi164.stdout:2/383: creat d2/d5/d3a/d55/f73 x:0 0 0 2024-04-20T21:58:58.677 INFO:tasks.workunit.client.1.smithi164.stdout:1/337: truncate d10/d16/d20/f2f 2138336 0 2024-04-20T21:58:58.677 INFO:tasks.workunit.client.1.smithi164.stdout:9/457: creat d3/db/d1b/d1e/f9d x:0 0 0 2024-04-20T21:58:58.679 INFO:tasks.workunit.client.1.smithi164.stdout:7/352: creat d2/d21/f7d x:0 0 0 2024-04-20T21:58:58.679 INFO:tasks.workunit.client.1.smithi164.stdout:4/361: write d4/d28/f44 [1200445,957] 0 2024-04-20T21:58:58.681 INFO:tasks.workunit.client.1.smithi164.stdout:3/421: dread - d12/f5a zero size 2024-04-20T21:58:58.681 INFO:tasks.workunit.client.1.smithi164.stdout:9/458: readlink d3/db/l3e 0 2024-04-20T21:58:58.685 INFO:tasks.workunit.client.1.smithi164.stdout:8/317: dwrite d0/f3 [0,4194304] 0 2024-04-20T21:58:58.686 INFO:tasks.workunit.client.1.smithi164.stdout:5/438: fdatasync dc/d2c/f43 0 2024-04-20T21:58:58.686 INFO:tasks.workunit.client.1.smithi164.stdout:2/384: readlink d2/d30/l66 0 2024-04-20T21:58:58.689 INFO:tasks.workunit.client.1.smithi164.stdout:7/353: symlink d2/l7e 0 2024-04-20T21:58:58.690 INFO:tasks.workunit.client.1.smithi164.stdout:1/338: write d10/d33/d48/f4f [850059,93816] 0 2024-04-20T21:58:58.696 INFO:tasks.workunit.client.1.smithi164.stdout:5/439: write dc/d2b/f3f [1574195,89878] 0 2024-04-20T21:58:58.701 INFO:tasks.workunit.client.1.smithi164.stdout:7/354: fdatasync d2/d21/f25 0 2024-04-20T21:58:58.701 INFO:tasks.workunit.client.1.smithi164.stdout:6/421: dwrite d0/d3/d15/d23/d45/d4f/f68 [0,4194304] 0 2024-04-20T21:58:58.701 INFO:tasks.workunit.client.1.smithi164.stdout:8/318: chown d0/d14/f46 1996486889 1 2024-04-20T21:58:58.704 INFO:tasks.workunit.client.1.smithi164.stdout:6/422: chown d0/d3/d8/d81 2897135 1 2024-04-20T21:58:58.707 INFO:tasks.workunit.client.1.smithi164.stdout:1/339: truncate d10/d16/d20/d26/d34/f53 566812 0 2024-04-20T21:58:58.711 INFO:tasks.workunit.client.1.smithi164.stdout:5/440: creat dc/d2b/d52/f92 x:0 0 0 2024-04-20T21:58:58.720 INFO:tasks.workunit.client.1.smithi164.stdout:4/362: rename d4/d28/c3a to d4/d28/d3e/d4a/c7c 0 2024-04-20T21:58:58.727 INFO:tasks.workunit.client.1.smithi164.stdout:5/441: dread dc/d41/f65 [0,4194304] 0 2024-04-20T21:58:58.728 INFO:tasks.workunit.client.1.smithi164.stdout:9/459: link d3/db/d1b/d1e/l32 d3/db/d82/l9e 0 2024-04-20T21:58:58.733 INFO:tasks.workunit.client.1.smithi164.stdout:5/442: rename dc/d12/d81 to dc/d12/d81/d8a/d93 22 2024-04-20T21:58:58.737 INFO:tasks.workunit.client.1.smithi164.stdout:6/423: getdents d0/d3/d8/d7c 0 2024-04-20T21:58:58.737 INFO:tasks.workunit.client.1.smithi164.stdout:5/443: mknod dc/d41/c94 0 2024-04-20T21:58:58.745 INFO:tasks.workunit.client.1.smithi164.stdout:4/363: dread d4/d28/d3e/d41/f6e [0,4194304] 0 2024-04-20T21:58:58.746 INFO:tasks.workunit.client.1.smithi164.stdout:5/444: creat dc/d2b/d52/d64/f95 x:0 0 0 2024-04-20T21:58:58.747 INFO:tasks.workunit.client.1.smithi164.stdout:3/422: dread d12/d15/f26 [0,4194304] 0 2024-04-20T21:58:58.747 INFO:tasks.workunit.client.1.smithi164.stdout:1/340: dread d10/d16/f27 [0,4194304] 0 2024-04-20T21:58:58.748 INFO:tasks.workunit.client.1.smithi164.stdout:8/319: dwrite d0/d14/f1d [0,4194304] 0 2024-04-20T21:58:58.748 INFO:tasks.workunit.client.1.smithi164.stdout:5/445: fsync dc/d2c/d2e/f47 0 2024-04-20T21:58:58.749 INFO:tasks.workunit.client.1.smithi164.stdout:6/424: creat d0/d3/d11/d5a/f89 x:0 0 0 2024-04-20T21:58:58.751 INFO:tasks.workunit.client.1.smithi164.stdout:7/355: dread d2/d21/f35 [0,4194304] 0 2024-04-20T21:58:58.752 INFO:tasks.workunit.client.1.smithi164.stdout:8/320: dread - d0/f40 zero size 2024-04-20T21:58:58.754 INFO:tasks.workunit.client.1.smithi164.stdout:6/425: dread - d0/d3/d11/d5a/f89 zero size 2024-04-20T21:58:58.755 INFO:tasks.workunit.client.1.smithi164.stdout:2/385: dread d2/f46 [0,4194304] 0 2024-04-20T21:58:58.757 INFO:tasks.workunit.client.1.smithi164.stdout:8/321: write d0/d14/d16/d58/f60 [1824537,33664] 0 2024-04-20T21:58:58.758 INFO:tasks.workunit.client.1.smithi164.stdout:7/356: dread d2/f26 [0,4194304] 0 2024-04-20T21:58:58.758 INFO:tasks.workunit.client.1.smithi164.stdout:3/423: fdatasync f11 0 2024-04-20T21:58:58.763 INFO:tasks.workunit.client.1.smithi164.stdout:5/446: rename dc/f82 to dc/d2b/d53/f96 0 2024-04-20T21:58:58.764 INFO:tasks.workunit.client.1.smithi164.stdout:4/364: getdents d4/d28/d70/d73 0 2024-04-20T21:58:58.764 INFO:tasks.workunit.client.1.smithi164.stdout:1/341: rename d10/d16/d20/d25/d3d to d10/d16/d20/d25/d3d/d68 22 2024-04-20T21:58:58.765 INFO:tasks.workunit.client.1.smithi164.stdout:6/426: symlink d0/d3/d4a/l8a 0 2024-04-20T21:58:58.767 INFO:tasks.workunit.client.1.smithi164.stdout:2/386: creat d2/d5/d3a/f74 x:0 0 0 2024-04-20T21:58:58.767 INFO:tasks.workunit.client.1.smithi164.stdout:1/342: write d10/f5e [1123773,39963] 0 2024-04-20T21:58:58.770 INFO:tasks.workunit.client.1.smithi164.stdout:8/322: symlink d0/d14/d16/d5a/l69 0 2024-04-20T21:58:58.773 INFO:tasks.workunit.client.1.smithi164.stdout:5/447: mknod dc/d12/c97 0 2024-04-20T21:58:58.775 INFO:tasks.workunit.client.1.smithi164.stdout:8/323: chown d0/d14/d4e/d62/f5e 13433 1 2024-04-20T21:58:58.777 INFO:tasks.workunit.client.1.smithi164.stdout:4/365: truncate d4/f19 577944 0 2024-04-20T21:58:58.778 INFO:tasks.workunit.client.1.smithi164.stdout:3/424: dwrite d12/d20/d39/f62 [0,4194304] 0 2024-04-20T21:58:58.779 INFO:tasks.workunit.client.1.smithi164.stdout:3/425: stat fa 0 2024-04-20T21:58:58.781 INFO:tasks.workunit.client.1.smithi164.stdout:9/460: dread d3/db/dd/d40/d2a/f4a [0,4194304] 0 2024-04-20T21:58:58.781 INFO:tasks.workunit.client.1.smithi164.stdout:3/426: dread - d12/d2a/f64 zero size 2024-04-20T21:58:58.783 INFO:tasks.workunit.client.1.smithi164.stdout:5/448: creat dc/d2c/f98 x:0 0 0 2024-04-20T21:58:58.785 INFO:tasks.workunit.client.1.smithi164.stdout:4/366: dread d4/d28/f44 [4194304,4194304] 0 2024-04-20T21:58:58.785 INFO:tasks.workunit.client.1.smithi164.stdout:6/427: creat d0/d3/d8/d81/f8b x:0 0 0 2024-04-20T21:58:58.786 INFO:tasks.workunit.client.1.smithi164.stdout:3/427: chown d12/d20/d39/f56 112727 1 2024-04-20T21:58:58.788 INFO:tasks.workunit.client.1.smithi164.stdout:1/343: fdatasync d10/f15 0 2024-04-20T21:58:58.790 INFO:tasks.workunit.client.1.smithi164.stdout:1/344: stat d10/f11 0 2024-04-20T21:58:58.790 INFO:tasks.workunit.client.1.smithi164.stdout:7/357: dwrite d2/d21/d33/f54 [4194304,4194304] 0 2024-04-20T21:58:58.794 INFO:tasks.workunit.client.1.smithi164.stdout:2/387: mknod d2/d19/d28/d3e/d53/d62/c75 0 2024-04-20T21:58:58.796 INFO:tasks.workunit.client.1.smithi164.stdout:8/324: dread d0/f11 [0,4194304] 0 2024-04-20T21:58:58.800 INFO:tasks.workunit.client.1.smithi164.stdout:6/428: mknod d0/d3/d11/d5a/c8c 0 2024-04-20T21:58:58.802 INFO:tasks.workunit.client.1.smithi164.stdout:9/461: dread d3/db/f5b [0,4194304] 0 2024-04-20T21:58:58.805 INFO:tasks.workunit.client.1.smithi164.stdout:9/462: write d3/ff [1237157,116367] 0 2024-04-20T21:58:58.809 INFO:tasks.workunit.client.1.smithi164.stdout:8/325: rename d0/d14/f1d to d0/d14/d16/f6a 0 2024-04-20T21:58:58.811 INFO:tasks.workunit.client.1.smithi164.stdout:5/449: rmdir dc/d12/d81/d8a 0 2024-04-20T21:58:58.812 INFO:tasks.workunit.client.1.smithi164.stdout:5/450: fsync dc/d12/d1e/f1f 0 2024-04-20T21:58:58.814 INFO:tasks.workunit.client.1.smithi164.stdout:1/345: creat d10/d16/d20/f69 x:0 0 0 2024-04-20T21:58:58.814 INFO:tasks.workunit.client.1.smithi164.stdout:8/326: rmdir d0/d14/d5f 39 2024-04-20T21:58:58.815 INFO:tasks.workunit.client.1.smithi164.stdout:4/367: getdents d4/d9/d27/d3f 0 2024-04-20T21:58:58.817 INFO:tasks.workunit.client.1.smithi164.stdout:7/358: fsync d2/d21/d33/f54 0 2024-04-20T21:58:58.817 INFO:tasks.workunit.client.1.smithi164.stdout:4/368: write d4/d28/f61 [530230,102824] 0 2024-04-20T21:58:58.822 INFO:tasks.workunit.client.1.smithi164.stdout:1/346: read d10/d16/d20/f2f [644971,58882] 0 2024-04-20T21:58:58.822 INFO:tasks.workunit.client.1.smithi164.stdout:6/429: getdents d0/d3/d11 0 2024-04-20T21:58:58.822 INFO:tasks.workunit.client.1.smithi164.stdout:4/369: dread d4/d9/d27/f48 [0,4194304] 0 2024-04-20T21:58:58.825 INFO:tasks.workunit.client.1.smithi164.stdout:7/359: symlink d2/d55/d6a/l7f 0 2024-04-20T21:58:58.826 INFO:tasks.workunit.client.1.smithi164.stdout:7/360: stat d2/d21/f7d 0 2024-04-20T21:58:58.829 INFO:tasks.workunit.client.1.smithi164.stdout:6/430: rmdir d0/d3/d62/d75 39 2024-04-20T21:58:58.831 INFO:tasks.workunit.client.1.smithi164.stdout:6/431: chown d0/d3/d11/d29/d6e/c5f 299898 1 2024-04-20T21:58:58.833 INFO:tasks.workunit.client.1.smithi164.stdout:5/451: write dc/fd [3789302,39739] 0 2024-04-20T21:58:58.834 INFO:tasks.workunit.client.1.smithi164.stdout:5/452: fsync dc/f66 0 2024-04-20T21:58:58.835 INFO:tasks.workunit.client.1.smithi164.stdout:1/347: creat d10/d16/d19/d1a/d51/f6a x:0 0 0 2024-04-20T21:58:58.841 INFO:tasks.workunit.client.1.smithi164.stdout:9/463: dread d3/ff [0,4194304] 0 2024-04-20T21:58:58.844 INFO:tasks.workunit.client.1.smithi164.stdout:6/432: creat d0/d3/d15/d23/d45/d69/f8d x:0 0 0 2024-04-20T21:58:58.848 INFO:tasks.workunit.client.1.smithi164.stdout:6/433: truncate d0/d3/d15/d23/d3b/f57 906299 0 2024-04-20T21:58:58.848 INFO:tasks.workunit.client.1.smithi164.stdout:1/348: creat d10/d33/d48/f6b x:0 0 0 2024-04-20T21:58:58.850 INFO:tasks.workunit.client.1.smithi164.stdout:8/327: getdents d0/d14/d16/d5a 0 2024-04-20T21:58:58.851 INFO:tasks.workunit.client.1.smithi164.stdout:7/361: dwrite d2/d21/f23 [0,4194304] 0 2024-04-20T21:58:58.852 INFO:tasks.workunit.client.1.smithi164.stdout:4/370: creat d4/d9/d27/f7d x:0 0 0 2024-04-20T21:58:58.860 INFO:tasks.workunit.client.1.smithi164.stdout:8/328: rmdir d0/d14/d4e/d62 39 2024-04-20T21:58:58.861 INFO:tasks.workunit.client.1.smithi164.stdout:8/329: chown d0/d1e/c29 110176 1 2024-04-20T21:58:58.863 INFO:tasks.workunit.client.1.smithi164.stdout:9/464: mkdir d3/d9f 0 2024-04-20T21:58:58.867 INFO:tasks.workunit.client.1.smithi164.stdout:1/349: mknod d10/d16/c6c 0 2024-04-20T21:58:58.871 INFO:tasks.workunit.client.1.smithi164.stdout:9/465: creat d3/db/dd/d40/d2a/d36/fa0 x:0 0 0 2024-04-20T21:58:58.873 INFO:tasks.workunit.client.1.smithi164.stdout:6/434: rename d0/d3/d8/d7c to d0/d3/d62/d8e 0 2024-04-20T21:58:58.878 INFO:tasks.workunit.client.1.smithi164.stdout:1/350: rename d10/d16/d19/d1a/l4a to d10/d16/d20/d26/d34/l6d 0 2024-04-20T21:58:58.879 INFO:tasks.workunit.client.1.smithi164.stdout:8/330: dread d0/d14/f37 [0,4194304] 0 2024-04-20T21:58:58.880 INFO:tasks.workunit.client.1.smithi164.stdout:1/351: chown d10/d16/d20/f28 1625 1 2024-04-20T21:58:58.881 INFO:tasks.workunit.client.1.smithi164.stdout:6/435: write d0/d3/d62/d75/f87 [391704,34220] 0 2024-04-20T21:58:58.885 INFO:tasks.workunit.client.1.smithi164.stdout:7/362: dread d2/d21/d24/f30 [0,4194304] 0 2024-04-20T21:58:58.885 INFO:tasks.workunit.client.1.smithi164.stdout:6/436: creat d0/d3/d11/f8f x:0 0 0 2024-04-20T21:58:58.888 INFO:tasks.workunit.client.1.smithi164.stdout:6/437: write d0/d3/d15/d23/d45/d69/f8d [710607,128932] 0 2024-04-20T21:58:58.896 INFO:tasks.workunit.client.1.smithi164.stdout:8/331: dwrite d0/d1e/f20 [0,4194304] 0 2024-04-20T21:58:58.897 INFO:tasks.workunit.client.1.smithi164.stdout:7/363: creat d2/d21/f80 x:0 0 0 2024-04-20T21:58:58.898 INFO:tasks.workunit.client.1.smithi164.stdout:8/332: chown d0/l42 14515787 1 2024-04-20T21:58:58.902 INFO:tasks.workunit.client.1.smithi164.stdout:1/352: dwrite d10/d16/d19/d1a/d51/f6a [0,4194304] 0 2024-04-20T21:58:58.905 INFO:tasks.workunit.client.1.smithi164.stdout:9/466: dwrite d3/f18 [0,4194304] 0 2024-04-20T21:58:58.906 INFO:tasks.workunit.client.1.smithi164.stdout:8/333: chown d0/d1e/f43 92 1 2024-04-20T21:58:58.907 INFO:tasks.workunit.client.1.smithi164.stdout:1/353: write d10/d16/d19/d1a/f32 [1493178,13168] 0 2024-04-20T21:58:58.916 INFO:tasks.workunit.client.1.smithi164.stdout:9/467: truncate d3/db/dd/d40/d2a/f90 210204 0 2024-04-20T21:58:58.917 INFO:tasks.workunit.client.1.smithi164.stdout:8/334: rename d0/d14/f2b to d0/d1e/f6b 0 2024-04-20T21:58:58.923 INFO:tasks.workunit.client.1.smithi164.stdout:7/364: dwrite d2/d21/f3b [0,4194304] 0 2024-04-20T21:58:58.926 INFO:tasks.workunit.client.1.smithi164.stdout:6/438: creat d0/d3/d11/d5a/f90 x:0 0 0 2024-04-20T21:58:58.926 INFO:tasks.workunit.client.1.smithi164.stdout:8/335: creat d0/d14/d16/d5a/f6c x:0 0 0 2024-04-20T21:58:58.927 INFO:tasks.workunit.client.1.smithi164.stdout:7/365: creat d2/d21/d24/d31/d3a/f81 x:0 0 0 2024-04-20T21:58:58.930 INFO:tasks.workunit.client.1.smithi164.stdout:9/468: mkdir d3/d9f/da1 0 2024-04-20T21:58:58.932 INFO:tasks.workunit.client.1.smithi164.stdout:6/439: creat d0/d3/d15/d21/f91 x:0 0 0 2024-04-20T21:58:58.936 INFO:tasks.workunit.client.1.smithi164.stdout:9/469: creat d3/db/d4f/fa2 x:0 0 0 2024-04-20T21:58:58.937 INFO:tasks.workunit.client.1.smithi164.stdout:8/336: symlink d0/d14/d4e/l6d 0 2024-04-20T21:58:58.940 INFO:tasks.workunit.client.1.smithi164.stdout:1/354: truncate f7 7059393 0 2024-04-20T21:58:58.943 INFO:tasks.workunit.client.1.smithi164.stdout:6/440: dread d0/d3/d15/d23/d45/d4f/f68 [0,4194304] 0 2024-04-20T21:58:58.944 INFO:tasks.workunit.client.1.smithi164.stdout:6/441: readlink d0/d3/d15/d21/d4b/l6b 0 2024-04-20T21:58:58.947 INFO:tasks.workunit.client.1.smithi164.stdout:8/337: write d0/f24 [340696,69075] 0 2024-04-20T21:58:58.950 INFO:tasks.workunit.client.1.smithi164.stdout:1/355: mkdir d10/d33/d48/d6e 0 2024-04-20T21:58:58.959 INFO:tasks.workunit.client.1.smithi164.stdout:6/442: mknod d0/d3/d11/d29/d6e/c92 0 2024-04-20T21:58:58.960 INFO:tasks.workunit.client.1.smithi164.stdout:6/443: fdatasync d0/d3/d8/f3c 0 2024-04-20T21:58:58.962 INFO:tasks.workunit.client.1.smithi164.stdout:9/470: getdents d3/db/dd/d75 0 2024-04-20T21:58:58.962 INFO:tasks.workunit.client.1.smithi164.stdout:6/444: write d0/d3/d15/d21/f91 [421900,27464] 0 2024-04-20T21:58:58.967 INFO:tasks.workunit.client.1.smithi164.stdout:0/375: sync 2024-04-20T21:58:58.969 INFO:tasks.workunit.client.1.smithi164.stdout:1/356: rmdir d10/d33/d48/d6e 0 2024-04-20T21:58:58.970 INFO:tasks.workunit.client.1.smithi164.stdout:7/366: truncate d2/f29 484885 0 2024-04-20T21:58:58.970 INFO:tasks.workunit.client.1.smithi164.stdout:0/376: write d1/d4/d26/d29/d2d/d54/f57 [91031,103944] 0 2024-04-20T21:58:58.971 INFO:tasks.workunit.client.1.smithi164.stdout:9/471: mkdir d3/db/dd/d40/d2a/d36/d51/da3 0 2024-04-20T21:58:58.972 INFO:tasks.workunit.client.1.smithi164.stdout:0/377: stat d1/f23 0 2024-04-20T21:58:58.974 INFO:tasks.workunit.client.1.smithi164.stdout:0/378: chown d1/d4/c4a 98239034 1 2024-04-20T21:58:58.976 INFO:tasks.workunit.client.1.smithi164.stdout:6/445: rename d0/d3/d62/f88 to d0/d3/d15/d23/d45/d69/f93 0 2024-04-20T21:58:58.979 INFO:tasks.workunit.client.1.smithi164.stdout:6/446: truncate d0/d3/d8/d28/f33 870709 0 2024-04-20T21:58:58.980 INFO:tasks.workunit.client.1.smithi164.stdout:6/447: stat d0/ld 0 2024-04-20T21:58:58.980 INFO:tasks.workunit.client.1.smithi164.stdout:1/357: mknod d10/d16/d20/d25/c6f 0 2024-04-20T21:58:58.985 INFO:tasks.workunit.client.1.smithi164.stdout:7/367: mkdir d2/d21/d24/d60/d82 0 2024-04-20T21:58:58.986 INFO:tasks.workunit.client.1.smithi164.stdout:1/358: write d10/d33/d41/f63 [850217,25816] 0 2024-04-20T21:58:58.989 INFO:tasks.workunit.client.1.smithi164.stdout:7/368: dread - d2/f16 zero size 2024-04-20T21:58:58.990 INFO:tasks.workunit.client.1.smithi164.stdout:8/338: dwrite d0/d1e/f44 [0,4194304] 0 2024-04-20T21:58:58.991 INFO:tasks.workunit.client.1.smithi164.stdout:6/448: symlink d0/d3/d15/d21/d4b/l94 0 2024-04-20T21:58:58.995 INFO:tasks.workunit.client.1.smithi164.stdout:0/379: dwrite d1/fb [0,4194304] 0 2024-04-20T21:58:58.996 INFO:tasks.workunit.client.1.smithi164.stdout:9/472: dwrite d3/db/dd/d40/d2a/d36/d51/f68 [0,4194304] 0 2024-04-20T21:58:59.005 INFO:tasks.workunit.client.1.smithi164.stdout:8/339: read d0/d14/d16/d5a/f5c [186590,61300] 0 2024-04-20T21:58:59.009 INFO:tasks.workunit.client.1.smithi164.stdout:6/449: dread d0/d3/d15/d21/f91 [0,4194304] 0 2024-04-20T21:58:59.013 INFO:tasks.workunit.client.1.smithi164.stdout:9/473: symlink d3/db/dd/d40/d78/d86/la4 0 2024-04-20T21:58:59.014 INFO:tasks.workunit.client.1.smithi164.stdout:6/450: stat d0/d3/l2e 0 2024-04-20T21:58:59.017 INFO:tasks.workunit.client.1.smithi164.stdout:6/451: fdatasync d0/d3/f1b 0 2024-04-20T21:58:59.021 INFO:tasks.workunit.client.1.smithi164.stdout:8/340: creat d0/d14/d5f/f6e x:0 0 0 2024-04-20T21:58:59.024 INFO:tasks.workunit.client.1.smithi164.stdout:9/474: creat d3/db/dd/d40/d2a/d36/d51/fa5 x:0 0 0 2024-04-20T21:58:59.024 INFO:tasks.workunit.client.1.smithi164.stdout:3/428: sync 2024-04-20T21:58:59.025 INFO:tasks.workunit.client.1.smithi164.stdout:2/388: sync 2024-04-20T21:58:59.025 INFO:tasks.workunit.client.1.smithi164.stdout:6/452: mknod d0/d3/c95 0 2024-04-20T21:58:59.026 INFO:tasks.workunit.client.1.smithi164.stdout:8/341: chown d0/l42 1949 1 2024-04-20T21:58:59.033 INFO:tasks.workunit.client.1.smithi164.stdout:6/453: dread - d0/d3/d8/d81/f8b zero size 2024-04-20T21:58:59.034 INFO:tasks.workunit.client.1.smithi164.stdout:2/389: creat d2/d5/d3a/f76 x:0 0 0 2024-04-20T21:58:59.035 INFO:tasks.workunit.client.1.smithi164.stdout:0/380: dwrite d1/d4/d26/d29/f5b [0,4194304] 0 2024-04-20T21:58:59.039 INFO:tasks.workunit.client.1.smithi164.stdout:9/475: creat d3/db/d1b/d20/fa6 x:0 0 0 2024-04-20T21:58:59.043 INFO:tasks.workunit.client.1.smithi164.stdout:9/476: write d3/f76 [4934433,21375] 0 2024-04-20T21:58:59.043 INFO:tasks.workunit.client.1.smithi164.stdout:7/369: dread d2/f48 [0,4194304] 0 2024-04-20T21:58:59.045 INFO:tasks.workunit.client.1.smithi164.stdout:2/390: creat d2/d19/f77 x:0 0 0 2024-04-20T21:58:59.052 INFO:tasks.workunit.client.1.smithi164.stdout:1/359: dread d10/d33/d48/f4b [0,4194304] 0 2024-04-20T21:58:59.052 INFO:tasks.workunit.client.1.smithi164.stdout:7/370: write d2/d21/d24/d60/f76 [3241507,129605] 0 2024-04-20T21:58:59.055 INFO:tasks.workunit.client.1.smithi164.stdout:0/381: creat d1/d4/da/d27/f70 x:0 0 0 2024-04-20T21:58:59.056 INFO:tasks.workunit.client.1.smithi164.stdout:1/360: read - d10/d16/d20/d26/d34/f5d zero size 2024-04-20T21:58:59.056 INFO:tasks.workunit.client.1.smithi164.stdout:6/454: getdents d0/d3/d11/d29/d6e/d41 0 2024-04-20T21:58:59.058 INFO:tasks.workunit.client.1.smithi164.stdout:9/477: dread d3/f6 [0,4194304] 0 2024-04-20T21:58:59.062 INFO:tasks.workunit.client.1.smithi164.stdout:7/371: truncate d2/d21/d24/d60/f66 992240 0 2024-04-20T21:58:59.065 INFO:tasks.workunit.client.1.smithi164.stdout:5/453: sync 2024-04-20T21:58:59.065 INFO:tasks.workunit.client.1.smithi164.stdout:4/371: sync 2024-04-20T21:58:59.068 INFO:tasks.workunit.client.1.smithi164.stdout:6/455: creat d0/d3/d8/f96 x:0 0 0 2024-04-20T21:58:59.069 INFO:tasks.workunit.client.1.smithi164.stdout:1/361: write d10/d16/d19/f52 [8475628,101577] 0 2024-04-20T21:58:59.076 INFO:tasks.workunit.client.1.smithi164.stdout:7/372: rename d2/d55 to d2/d21/d24/d31/d3a/d83 0 2024-04-20T21:58:59.076 INFO:tasks.workunit.client.1.smithi164.stdout:5/454: mkdir dc/d2b/d52/d99 0 2024-04-20T21:58:59.082 INFO:tasks.workunit.client.1.smithi164.stdout:0/382: dwrite d1/fb [0,4194304] 0 2024-04-20T21:58:59.089 INFO:tasks.workunit.client.1.smithi164.stdout:7/373: readlink d2/d21/d24/d60/l6d 0 2024-04-20T21:58:59.094 INFO:tasks.workunit.client.1.smithi164.stdout:5/455: mknod dc/d2c/d2e/d30/d8c/c9a 0 2024-04-20T21:58:59.095 INFO:tasks.workunit.client.1.smithi164.stdout:1/362: rename d10/f15 to d10/d16/f70 0 2024-04-20T21:58:59.098 INFO:tasks.workunit.client.1.smithi164.stdout:7/374: creat d2/d21/d24/d31/f84 x:0 0 0 2024-04-20T21:58:59.106 INFO:tasks.workunit.client.1.smithi164.stdout:0/383: write d1/d4/df/f3b [761403,90937] 0 2024-04-20T21:58:59.106 INFO:tasks.workunit.client.1.smithi164.stdout:4/372: write d4/d9/d27/f7b [1530588,67818] 0 2024-04-20T21:58:59.108 INFO:tasks.workunit.client.1.smithi164.stdout:1/363: dread - d10/d16/d19/f67 zero size 2024-04-20T21:58:59.112 INFO:tasks.workunit.client.1.smithi164.stdout:0/384: stat d1/d4/da/f2e 0 2024-04-20T21:58:59.112 INFO:tasks.workunit.client.1.smithi164.stdout:4/373: write d4/d28/f61 [1286085,43561] 0 2024-04-20T21:58:59.113 INFO:tasks.workunit.client.1.smithi164.stdout:0/385: readlink d1/l16 0 2024-04-20T21:58:59.114 INFO:tasks.workunit.client.1.smithi164.stdout:3/429: dread d12/d15/f24 [0,4194304] 0 2024-04-20T21:58:59.118 INFO:tasks.workunit.client.1.smithi164.stdout:7/375: mkdir d2/d21/d24/d31/d3a/d83/d63/d85 0 2024-04-20T21:58:59.119 INFO:tasks.workunit.client.1.smithi164.stdout:2/391: dwrite d2/f20 [0,4194304] 0 2024-04-20T21:58:59.122 INFO:tasks.workunit.client.1.smithi164.stdout:3/430: chown d12/d20/d39/f65 4527865 1 2024-04-20T21:58:59.124 INFO:tasks.workunit.client.1.smithi164.stdout:1/364: rename f1 to d10/d33/d48/f71 0 2024-04-20T21:58:59.131 INFO:tasks.workunit.client.1.smithi164.stdout:1/365: truncate d10/d16/d20/d26/d34/f5d 251042 0 2024-04-20T21:58:59.132 INFO:tasks.workunit.client.1.smithi164.stdout:8/342: dread d0/d14/d16/f26 [4194304,4194304] 0 2024-04-20T21:58:59.133 INFO:tasks.workunit.client.1.smithi164.stdout:5/456: truncate dc/d12/d81/f68 3282839 0 2024-04-20T21:58:59.135 INFO:tasks.workunit.client.1.smithi164.stdout:0/386: dread d1/d4/da/d1f/d3c/f58 [0,4194304] 0 2024-04-20T21:58:59.137 INFO:tasks.workunit.client.1.smithi164.stdout:3/431: mknod d12/d20/d39/d69/d83/c84 0 2024-04-20T21:58:59.137 INFO:tasks.workunit.client.1.smithi164.stdout:5/457: write dc/f25 [54591,21565] 0 2024-04-20T21:58:59.145 INFO:tasks.workunit.client.1.smithi164.stdout:2/392: creat d2/f78 x:0 0 0 2024-04-20T21:58:59.148 INFO:tasks.workunit.client.1.smithi164.stdout:2/393: read - d2/d5/d3a/d55/f71 zero size 2024-04-20T21:58:59.152 INFO:tasks.workunit.client.1.smithi164.stdout:1/366: unlink d10/l31 0 2024-04-20T21:58:59.153 INFO:tasks.workunit.client.1.smithi164.stdout:2/394: write d2/d5/d3a/d55/f68 [240256,104856] 0 2024-04-20T21:58:59.156 INFO:tasks.workunit.client.1.smithi164.stdout:4/374: truncate d4/d9/d27/f7b 772013 0 2024-04-20T21:58:59.157 INFO:tasks.workunit.client.1.smithi164.stdout:2/395: truncate d2/d5/d3a/f4c 1189489 0 2024-04-20T21:58:59.161 INFO:tasks.workunit.client.1.smithi164.stdout:3/432: rename d12/d15/f2f to d12/d6d/f85 0 2024-04-20T21:58:59.161 INFO:tasks.workunit.client.1.smithi164.stdout:8/343: mkdir d0/d14/d4e/d6f 0 2024-04-20T21:58:59.163 INFO:tasks.workunit.client.1.smithi164.stdout:8/344: readlink d0/d14/d16/d5a/l69 0 2024-04-20T21:58:59.164 INFO:tasks.workunit.client.1.smithi164.stdout:0/387: symlink d1/d4/df/d56/l71 0 2024-04-20T21:58:59.169 INFO:tasks.workunit.client.1.smithi164.stdout:7/376: dread d2/d21/d44/f4b [0,4194304] 0 2024-04-20T21:58:59.173 INFO:tasks.workunit.client.1.smithi164.stdout:4/375: symlink d4/d9/d27/d3f/d67/l7e 0 2024-04-20T21:58:59.173 INFO:tasks.workunit.client.1.smithi164.stdout:2/396: symlink d2/d19/d28/d3e/d53/d62/l79 0 2024-04-20T21:58:59.174 INFO:tasks.workunit.client.1.smithi164.stdout:1/367: dwrite d10/f5e [0,4194304] 0 2024-04-20T21:58:59.174 INFO:tasks.workunit.client.1.smithi164.stdout:8/345: creat d0/d14/d16/f70 x:0 0 0 2024-04-20T21:58:59.176 INFO:tasks.workunit.client.1.smithi164.stdout:0/388: unlink d1/d4/da/d27/d33/l4f 0 2024-04-20T21:58:59.178 INFO:tasks.workunit.client.1.smithi164.stdout:8/346: read d0/f3 [1655734,7770] 0 2024-04-20T21:58:59.178 INFO:tasks.workunit.client.1.smithi164.stdout:2/397: write d2/d5/d3a/d55/d58/f5b [737701,26866] 0 2024-04-20T21:58:59.179 INFO:tasks.workunit.client.1.smithi164.stdout:0/389: read - d1/d4/d20/f40 zero size 2024-04-20T21:58:59.181 INFO:tasks.workunit.client.1.smithi164.stdout:5/458: dread f7 [4194304,4194304] 0 2024-04-20T21:58:59.181 INFO:tasks.workunit.client.1.smithi164.stdout:0/390: dread - d1/d4/d20/f40 zero size 2024-04-20T21:58:59.183 INFO:tasks.workunit.client.1.smithi164.stdout:8/347: truncate d0/d14/d16/d5a/f6c 835552 0 2024-04-20T21:58:59.183 INFO:tasks.workunit.client.1.smithi164.stdout:3/433: symlink d12/d68/d6f/d71/d7d/l86 0 2024-04-20T21:58:59.185 INFO:tasks.workunit.client.1.smithi164.stdout:8/348: dread - d0/f4d zero size 2024-04-20T21:58:59.186 INFO:tasks.workunit.client.1.smithi164.stdout:3/434: chown d12/d15/f19 3187 1 2024-04-20T21:58:59.194 INFO:tasks.workunit.client.1.smithi164.stdout:7/377: rename d2/d21/f5e to d2/d21/d24/d60/f86 0 2024-04-20T21:58:59.198 INFO:tasks.workunit.client.1.smithi164.stdout:7/378: truncate d2/d21/f80 71352 0 2024-04-20T21:58:59.202 INFO:tasks.workunit.client.1.smithi164.stdout:0/391: dread d1/d4/df/f3b [0,4194304] 0 2024-04-20T21:58:59.202 INFO:tasks.workunit.client.1.smithi164.stdout:3/435: getdents d12/d20/d39/d55/d6b/d79 0 2024-04-20T21:58:59.205 INFO:tasks.workunit.client.1.smithi164.stdout:2/398: getdents d2/d30 0 2024-04-20T21:58:59.206 INFO:tasks.workunit.client.1.smithi164.stdout:1/368: dread d10/d16/d20/f2f [0,4194304] 0 2024-04-20T21:58:59.206 INFO:tasks.workunit.client.1.smithi164.stdout:4/376: rename d4/d9/d22/f43 to d4/d9/d27/d3f/f7f 0 2024-04-20T21:58:59.209 INFO:tasks.workunit.client.1.smithi164.stdout:2/399: write d2/d5/d3a/f43 [5977319,58955] 0 2024-04-20T21:58:59.209 INFO:tasks.workunit.client.1.smithi164.stdout:3/436: mkdir d12/d20/d39/d55/d87 0 2024-04-20T21:58:59.211 INFO:tasks.workunit.client.1.smithi164.stdout:3/437: dread - d12/f67 zero size 2024-04-20T21:58:59.213 INFO:tasks.workunit.client.1.smithi164.stdout:2/400: truncate d2/d19/d28/d3e/f42 1036821 0 2024-04-20T21:58:59.215 INFO:tasks.workunit.client.1.smithi164.stdout:5/459: dread dc/d2c/f4f [0,4194304] 0 2024-04-20T21:58:59.216 INFO:tasks.workunit.client.1.smithi164.stdout:7/379: dread d2/d21/d44/f4b [0,4194304] 0 2024-04-20T21:58:59.216 INFO:tasks.workunit.client.1.smithi164.stdout:0/392: dread d1/fb [0,4194304] 0 2024-04-20T21:58:59.217 INFO:tasks.workunit.client.1.smithi164.stdout:4/377: unlink d4/d28/d3e/d4a/c4d 0 2024-04-20T21:58:59.218 INFO:tasks.workunit.client.1.smithi164.stdout:7/380: write d2/d21/f3b [4483292,83813] 0 2024-04-20T21:58:59.223 INFO:tasks.workunit.client.1.smithi164.stdout:2/401: creat d2/d30/f7a x:0 0 0 2024-04-20T21:58:59.225 INFO:tasks.workunit.client.1.smithi164.stdout:2/402: dread - d2/d19/f51 zero size 2024-04-20T21:58:59.231 INFO:tasks.workunit.client.1.smithi164.stdout:5/460: dwrite dc/d2b/d52/f92 [0,4194304] 0 2024-04-20T21:58:59.231 INFO:tasks.workunit.client.1.smithi164.stdout:7/381: unlink d2/d21/d24/c32 0 2024-04-20T21:58:59.233 INFO:tasks.workunit.client.1.smithi164.stdout:7/382: stat d2/d21/d44/f4b 0 2024-04-20T21:58:59.234 INFO:tasks.workunit.client.1.smithi164.stdout:0/393: dwrite d1/d2b/f66 [0,4194304] 0 2024-04-20T21:58:59.240 INFO:tasks.workunit.client.1.smithi164.stdout:7/383: truncate d2/d21/d24/f52 687229 0 2024-04-20T21:58:59.240 INFO:tasks.workunit.client.1.smithi164.stdout:3/438: creat d12/d20/f88 x:0 0 0 2024-04-20T21:58:59.240 INFO:tasks.workunit.client.1.smithi164.stdout:1/369: creat d10/d16/f72 x:0 0 0 2024-04-20T21:58:59.242 INFO:tasks.workunit.client.1.smithi164.stdout:4/378: creat d4/d9/d27/d3f/d5f/f80 x:0 0 0 2024-04-20T21:58:59.243 INFO:tasks.workunit.client.1.smithi164.stdout:2/403: symlink d2/d5/l7b 0 2024-04-20T21:58:59.246 INFO:tasks.workunit.client.1.smithi164.stdout:5/461: stat f8 0 2024-04-20T21:58:59.249 INFO:tasks.workunit.client.1.smithi164.stdout:3/439: creat d12/d68/d6f/f89 x:0 0 0 2024-04-20T21:58:59.249 INFO:tasks.workunit.client.1.smithi164.stdout:7/384: mknod d2/d21/d44/c87 0 2024-04-20T21:58:59.249 INFO:tasks.workunit.client.1.smithi164.stdout:5/462: dread - dc/d2c/d2e/f47 zero size 2024-04-20T21:58:59.251 INFO:tasks.workunit.client.1.smithi164.stdout:2/404: dread - d2/d5/d21/f57 zero size 2024-04-20T21:58:59.262 INFO:tasks.workunit.client.1.smithi164.stdout:4/379: symlink d4/d28/d70/d73/l81 0 2024-04-20T21:58:59.265 INFO:tasks.workunit.client.1.smithi164.stdout:5/463: creat dc/d2b/d52/d99/f9b x:0 0 0 2024-04-20T21:58:59.266 INFO:tasks.workunit.client.1.smithi164.stdout:2/405: mknod d2/d5/c7c 0 2024-04-20T21:58:59.268 INFO:tasks.workunit.client.1.smithi164.stdout:3/440: write ff [877070,114247] 0 2024-04-20T21:58:59.270 INFO:tasks.workunit.client.1.smithi164.stdout:1/370: dwrite d10/f5c [4194304,4194304] 0 2024-04-20T21:58:59.270 INFO:tasks.workunit.client.1.smithi164.stdout:5/464: chown dc/d2b/d53 80677 1 2024-04-20T21:58:59.271 INFO:tasks.workunit.client.1.smithi164.stdout:3/441: read - d12/d20/f63 zero size 2024-04-20T21:58:59.274 INFO:tasks.workunit.client.1.smithi164.stdout:2/406: unlink d2/d19/d28/d3e/c63 0 2024-04-20T21:58:59.278 INFO:tasks.workunit.client.1.smithi164.stdout:5/465: write dc/d2c/d2e/d30/f59 [249055,71086] 0 2024-04-20T21:58:59.278 INFO:tasks.workunit.client.1.smithi164.stdout:1/371: rmdir d10/d16 39 2024-04-20T21:58:59.281 INFO:tasks.workunit.client.1.smithi164.stdout:4/380: truncate d4/d28/d3e/d41/f6e 67242 0 2024-04-20T21:58:59.282 INFO:tasks.workunit.client.1.smithi164.stdout:2/407: creat d2/d5f/f7d x:0 0 0 2024-04-20T21:58:59.283 INFO:tasks.workunit.client.1.smithi164.stdout:7/385: dwrite d2/f73 [0,4194304] 0 2024-04-20T21:58:59.283 INFO:tasks.workunit.client.1.smithi164.stdout:3/442: rename d12/d68/f7c to d12/d2a/f8a 0 2024-04-20T21:58:59.287 INFO:tasks.workunit.client.1.smithi164.stdout:4/381: chown d4/d9/d5c 20971 1 2024-04-20T21:58:59.287 INFO:tasks.workunit.client.1.smithi164.stdout:0/394: dread d1/d4/d26/d29/f44 [0,4194304] 0 2024-04-20T21:58:59.290 INFO:tasks.workunit.client.1.smithi164.stdout:5/466: symlink dc/d2c/l9c 0 2024-04-20T21:58:59.298 INFO:tasks.workunit.client.1.smithi164.stdout:7/386: write d2/f7 [2418305,131035] 0 2024-04-20T21:58:59.302 INFO:tasks.workunit.client.1.smithi164.stdout:0/395: symlink d1/d4/d20/l72 0 2024-04-20T21:58:59.303 INFO:tasks.workunit.client.1.smithi164.stdout:7/387: symlink d2/d21/d24/d31/d3a/l88 0 2024-04-20T21:58:59.306 INFO:tasks.workunit.client.1.smithi164.stdout:0/396: chown d1/f8 14 1 2024-04-20T21:58:59.306 INFO:tasks.workunit.client.1.smithi164.stdout:2/408: dread d2/d5/d3a/d55/f69 [0,4194304] 0 2024-04-20T21:58:59.306 INFO:tasks.workunit.client.1.smithi164.stdout:7/388: dread - d2/d21/f75 zero size 2024-04-20T21:58:59.306 INFO:tasks.workunit.client.1.smithi164.stdout:3/443: getdents d12/d6d 0 2024-04-20T21:58:59.309 INFO:tasks.workunit.client.1.smithi164.stdout:3/444: chown f4 3558928 1 2024-04-20T21:58:59.310 INFO:tasks.workunit.client.1.smithi164.stdout:1/372: getdents d10/d16/d19/d1a/d51 0 2024-04-20T21:58:59.314 INFO:tasks.workunit.client.1.smithi164.stdout:2/409: write d2/d5/f6d [793366,3679] 0 2024-04-20T21:58:59.316 INFO:tasks.workunit.client.1.smithi164.stdout:5/467: dwrite dc/f7d [0,4194304] 0 2024-04-20T21:58:59.320 INFO:tasks.workunit.client.1.smithi164.stdout:1/373: unlink d10/d16/l1e 0 2024-04-20T21:58:59.320 INFO:tasks.workunit.client.1.smithi164.stdout:2/410: dread - d2/d5/d3a/d55/f71 zero size 2024-04-20T21:58:59.327 INFO:tasks.workunit.client.1.smithi164.stdout:0/397: symlink d1/d4/da/d27/l73 0 2024-04-20T21:58:59.328 INFO:tasks.workunit.client.1.smithi164.stdout:7/389: dread d2/d21/f35 [0,4194304] 0 2024-04-20T21:58:59.329 INFO:tasks.workunit.client.1.smithi164.stdout:5/468: creat dc/d2c/d2e/d30/d5e/f9d x:0 0 0 2024-04-20T21:58:59.335 INFO:tasks.workunit.client.1.smithi164.stdout:0/398: write d1/f3e [878588,60218] 0 2024-04-20T21:58:59.342 INFO:tasks.workunit.client.1.smithi164.stdout:0/399: dread - d1/d4/da/d1f/f5d zero size 2024-04-20T21:58:59.347 INFO:tasks.workunit.client.1.smithi164.stdout:5/469: write dc/d2b/d52/f62 [4702526,82214] 0 2024-04-20T21:58:59.348 INFO:tasks.workunit.client.1.smithi164.stdout:3/445: dwrite d12/d20/d39/f54 [0,4194304] 0 2024-04-20T21:58:59.349 INFO:tasks.workunit.client.1.smithi164.stdout:2/411: dwrite d2/f46 [0,4194304] 0 2024-04-20T21:58:59.350 INFO:tasks.workunit.client.1.smithi164.stdout:0/400: rmdir d1/d4/da/d5c 39 2024-04-20T21:58:59.355 INFO:tasks.workunit.client.1.smithi164.stdout:5/470: rmdir dc/d2b 39 2024-04-20T21:58:59.360 INFO:tasks.workunit.client.1.smithi164.stdout:7/390: dwrite d2/f72 [0,4194304] 0 2024-04-20T21:58:59.367 INFO:tasks.workunit.client.1.smithi164.stdout:3/446: creat d12/d6d/f8b x:0 0 0 2024-04-20T21:58:59.370 INFO:tasks.workunit.client.1.smithi164.stdout:6/456: sync 2024-04-20T21:58:59.370 INFO:tasks.workunit.client.1.smithi164.stdout:9/478: sync 2024-04-20T21:58:59.377 INFO:tasks.workunit.client.1.smithi164.stdout:0/401: rename d1/d4/da/d27/d33 to d1/d4/d20/d74 0 2024-04-20T21:58:59.380 INFO:tasks.workunit.client.1.smithi164.stdout:9/479: write d3/f76 [4671556,46986] 0 2024-04-20T21:58:59.381 INFO:tasks.workunit.client.1.smithi164.stdout:5/471: mknod dc/d2b/d52/c9e 0 2024-04-20T21:58:59.382 INFO:tasks.workunit.client.1.smithi164.stdout:3/447: truncate d12/d15/f26 5125428 0 2024-04-20T21:58:59.383 INFO:tasks.workunit.client.1.smithi164.stdout:6/457: truncate d0/d3/d27/f3f 1066759 0 2024-04-20T21:58:59.391 INFO:tasks.workunit.client.1.smithi164.stdout:0/402: mknod d1/d4/d26/d29/d2d/c75 0 2024-04-20T21:58:59.393 INFO:tasks.workunit.client.1.smithi164.stdout:9/480: readlink d3/db/d4f/l88 0 2024-04-20T21:58:59.394 INFO:tasks.workunit.client.1.smithi164.stdout:2/412: dwrite d2/d19/d28/f38 [0,4194304] 0 2024-04-20T21:58:59.395 INFO:tasks.workunit.client.1.smithi164.stdout:5/472: symlink dc/d41/l9f 0 2024-04-20T21:58:59.395 INFO:tasks.workunit.client.1.smithi164.stdout:0/403: chown d1/d4/d20/l72 1 1 2024-04-20T21:58:59.395 INFO:tasks.workunit.client.1.smithi164.stdout:6/458: mkdir d0/d3/d11/d29/d6e/d5d/d97 0 2024-04-20T21:58:59.397 INFO:tasks.workunit.client.1.smithi164.stdout:2/413: fsync d2/d5/d21/f4f 0 2024-04-20T21:58:59.398 INFO:tasks.workunit.client.1.smithi164.stdout:9/481: rmdir d3/db/d4f/d67 39 2024-04-20T21:58:59.399 INFO:tasks.workunit.client.1.smithi164.stdout:9/482: fsync d3/f99 0 2024-04-20T21:58:59.399 INFO:tasks.workunit.client.1.smithi164.stdout:2/414: truncate d2/d5f/f7d 664430 0 2024-04-20T21:58:59.401 INFO:tasks.workunit.client.1.smithi164.stdout:9/483: chown d3/db/d4f/d9a 4120694 1 2024-04-20T21:58:59.401 INFO:tasks.workunit.client.1.smithi164.stdout:9/484: chown d3/db/l3e 787 1 2024-04-20T21:58:59.405 INFO:tasks.workunit.client.1.smithi164.stdout:6/459: creat d0/d3/d8/d28/f98 x:0 0 0 2024-04-20T21:58:59.406 INFO:tasks.workunit.client.1.smithi164.stdout:9/485: stat d3/f91 0 2024-04-20T21:58:59.406 INFO:tasks.workunit.client.1.smithi164.stdout:5/473: mkdir dc/d2b/da0 0 2024-04-20T21:58:59.413 INFO:tasks.workunit.client.1.smithi164.stdout:3/448: write d12/d20/d39/d69/d77/f7f [3018374,17430] 0 2024-04-20T21:58:59.414 INFO:tasks.workunit.client.1.smithi164.stdout:0/404: creat d1/d4/d26/f76 x:0 0 0 2024-04-20T21:58:59.418 INFO:tasks.workunit.client.1.smithi164.stdout:9/486: mkdir d3/db/d1b/d20/d3f/d8a/da7 0 2024-04-20T21:58:59.418 INFO:tasks.workunit.client.1.smithi164.stdout:8/349: sync 2024-04-20T21:58:59.419 INFO:tasks.workunit.client.1.smithi164.stdout:4/382: sync 2024-04-20T21:58:59.420 INFO:tasks.workunit.client.1.smithi164.stdout:0/405: dread - d1/d4/da/f6d zero size 2024-04-20T21:58:59.422 INFO:tasks.workunit.client.1.smithi164.stdout:7/391: dread d2/f7 [0,4194304] 0 2024-04-20T21:58:59.423 INFO:tasks.workunit.client.1.smithi164.stdout:2/415: dwrite d2/d5/d3a/f6a [0,4194304] 0 2024-04-20T21:58:59.429 INFO:tasks.workunit.client.1.smithi164.stdout:3/449: creat d12/d20/d39/d69/d77/d81/f8c x:0 0 0 2024-04-20T21:58:59.430 INFO:tasks.workunit.client.1.smithi164.stdout:7/392: readlink d2/d21/d24/d31/d3a/d83/d68/l79 0 2024-04-20T21:58:59.430 INFO:tasks.workunit.client.1.smithi164.stdout:0/406: rmdir d1/d4/d26/d29 39 2024-04-20T21:58:59.443 INFO:tasks.workunit.client.1.smithi164.stdout:0/407: fsync d1/f8 0 2024-04-20T21:58:59.446 INFO:tasks.workunit.client.1.smithi164.stdout:5/474: dwrite dc/d2c/d2e/d30/f89 [0,4194304] 0 2024-04-20T21:58:59.452 INFO:tasks.workunit.client.1.smithi164.stdout:6/460: dwrite d0/d3/d15/d23/d45/d69/f93 [0,4194304] 0 2024-04-20T21:58:59.452 INFO:tasks.workunit.client.1.smithi164.stdout:0/408: chown d1/d4/da/f6d 130791 1 2024-04-20T21:58:59.464 INFO:tasks.workunit.client.1.smithi164.stdout:8/350: dwrite d0/d14/f3d [4194304,4194304] 0 2024-04-20T21:58:59.464 INFO:tasks.workunit.client.1.smithi164.stdout:2/416: link d2/d19/d28/f47 d2/d5f/f7e 0 2024-04-20T21:58:59.464 INFO:tasks.workunit.client.1.smithi164.stdout:9/487: dwrite d3/f99 [0,4194304] 0 2024-04-20T21:58:59.469 INFO:tasks.workunit.client.1.smithi164.stdout:1/374: sync 2024-04-20T21:58:59.472 INFO:tasks.workunit.client.1.smithi164.stdout:6/461: creat d0/d3/d8/d28/f99 x:0 0 0 2024-04-20T21:58:59.478 INFO:tasks.workunit.client.1.smithi164.stdout:7/393: creat d2/d21/f89 x:0 0 0 2024-04-20T21:58:59.479 INFO:tasks.workunit.client.1.smithi164.stdout:8/351: creat d0/d14/d16/d5a/f71 x:0 0 0 2024-04-20T21:58:59.481 INFO:tasks.workunit.client.1.smithi164.stdout:8/352: readlink d0/d14/d4e/l6d 0 2024-04-20T21:58:59.481 INFO:tasks.workunit.client.1.smithi164.stdout:6/462: chown d0/d3/d15/d21/d5c/c86 145393 1 2024-04-20T21:58:59.487 INFO:tasks.workunit.client.1.smithi164.stdout:3/450: link cb d12/d20/c8d 0 2024-04-20T21:58:59.489 INFO:tasks.workunit.client.1.smithi164.stdout:2/417: creat d2/d5/d3a/d65/f7f x:0 0 0 2024-04-20T21:58:59.490 INFO:tasks.workunit.client.1.smithi164.stdout:5/475: dwrite dc/f88 [0,4194304] 0 2024-04-20T21:58:59.491 INFO:tasks.workunit.client.1.smithi164.stdout:7/394: read d2/d21/f28 [8253283,3491] 0 2024-04-20T21:58:59.492 INFO:tasks.workunit.client.1.smithi164.stdout:5/476: fsync dc/f7d 0 2024-04-20T21:58:59.493 INFO:tasks.workunit.client.1.smithi164.stdout:3/451: write d12/d20/d39/f54 [3584896,78663] 0 2024-04-20T21:58:59.500 INFO:tasks.workunit.client.1.smithi164.stdout:1/375: rename d10/d16/d20/d25/f2e to d10/f73 0 2024-04-20T21:58:59.500 INFO:tasks.workunit.client.1.smithi164.stdout:4/383: dread d4/d9/d22/f52 [0,4194304] 0 2024-04-20T21:58:59.501 INFO:tasks.workunit.client.1.smithi164.stdout:1/376: chown d10/d33/d48 259312365 1 2024-04-20T21:58:59.503 INFO:tasks.workunit.client.1.smithi164.stdout:1/377: chown d10/d33/d48/f4f 461137152 1 2024-04-20T21:58:59.505 INFO:tasks.workunit.client.1.smithi164.stdout:4/384: truncate d4/d28/f6f 239380 0 2024-04-20T21:58:59.506 INFO:tasks.workunit.client.1.smithi164.stdout:2/418: rmdir d2/d19/d28/d3e/d53 39 2024-04-20T21:58:59.506 INFO:tasks.workunit.client.1.smithi164.stdout:4/385: chown d4/f16 40 1 2024-04-20T21:58:59.507 INFO:tasks.workunit.client.1.smithi164.stdout:7/395: mkdir d2/d21/d24/d8a 0 2024-04-20T21:58:59.510 INFO:tasks.workunit.client.1.smithi164.stdout:2/419: fdatasync d2/f67 0 2024-04-20T21:58:59.511 INFO:tasks.workunit.client.1.smithi164.stdout:5/477: symlink dc/d2b/d52/d64/la1 0 2024-04-20T21:58:59.511 INFO:tasks.workunit.client.1.smithi164.stdout:3/452: creat d12/d6d/f8e x:0 0 0 2024-04-20T21:58:59.511 INFO:tasks.workunit.client.1.smithi164.stdout:8/353: dread d0/d14/d16/d5a/f5c [0,4194304] 0 2024-04-20T21:58:59.514 INFO:tasks.workunit.client.1.smithi164.stdout:7/396: write d2/f3c [1736726,91449] 0 2024-04-20T21:58:59.514 INFO:tasks.workunit.client.1.smithi164.stdout:0/409: getdents d1/d4/d49 0 2024-04-20T21:58:59.520 INFO:tasks.workunit.client.1.smithi164.stdout:4/386: rmdir d4/d9/d27 39 2024-04-20T21:58:59.520 INFO:tasks.workunit.client.1.smithi164.stdout:6/463: link d0/d3/d11/d29/d6e/d41/c79 d0/d3/c9a 0 2024-04-20T21:58:59.521 INFO:tasks.workunit.client.1.smithi164.stdout:0/410: fdatasync d1/f8 0 2024-04-20T21:58:59.525 INFO:tasks.workunit.client.1.smithi164.stdout:3/453: symlink d12/d20/d39/d55/l8f 0 2024-04-20T21:58:59.525 INFO:tasks.workunit.client.1.smithi164.stdout:1/378: link d10/d33/d41/f58 d10/d16/d20/d26/f74 0 2024-04-20T21:58:59.533 INFO:tasks.workunit.client.1.smithi164.stdout:5/478: mknod dc/d2b/da0/ca2 0 2024-04-20T21:58:59.533 INFO:tasks.workunit.client.1.smithi164.stdout:2/420: dwrite d2/d19/d28/d3e/f42 [0,4194304] 0 2024-04-20T21:58:59.534 INFO:tasks.workunit.client.1.smithi164.stdout:9/488: dread d3/db/dd/d40/d2a/d36/f48 [0,4194304] 0 2024-04-20T21:58:59.535 INFO:tasks.workunit.client.1.smithi164.stdout:0/411: chown d1/d4/da/d1f/d3c/l48 1090768 1 2024-04-20T21:58:59.538 INFO:tasks.workunit.client.1.smithi164.stdout:8/354: truncate d0/f19 4190873 0 2024-04-20T21:58:59.540 INFO:tasks.workunit.client.1.smithi164.stdout:5/479: write dc/d2b/d52/d99/f9b [1035404,57192] 0 2024-04-20T21:58:59.540 INFO:tasks.workunit.client.1.smithi164.stdout:6/464: truncate d0/d3/d8/fa 102659 0 2024-04-20T21:58:59.542 INFO:tasks.workunit.client.1.smithi164.stdout:9/489: write d3/db/dd/d40/f84 [76085,78374] 0 2024-04-20T21:58:59.542 INFO:tasks.workunit.client.1.smithi164.stdout:2/421: rmdir d2/d5/d3a/d65 39 2024-04-20T21:58:59.550 INFO:tasks.workunit.client.1.smithi164.stdout:6/465: dread - d0/d3/d15/f24 zero size 2024-04-20T21:58:59.550 INFO:tasks.workunit.client.1.smithi164.stdout:2/422: chown d2/f12 5621055 1 2024-04-20T21:58:59.550 INFO:tasks.workunit.client.1.smithi164.stdout:3/454: creat d12/f90 x:0 0 0 2024-04-20T21:58:59.552 INFO:tasks.workunit.client.1.smithi164.stdout:7/397: dwrite d2/d21/f3b [0,4194304] 0 2024-04-20T21:58:59.553 INFO:tasks.workunit.client.1.smithi164.stdout:2/423: read - d2/d5/d21/f57 zero size 2024-04-20T21:58:59.553 INFO:tasks.workunit.client.1.smithi164.stdout:5/480: mknod dc/d2b/d6d/d73/ca3 0 2024-04-20T21:58:59.557 INFO:tasks.workunit.client.1.smithi164.stdout:8/355: dread d0/d14/f51 [0,4194304] 0 2024-04-20T21:58:59.563 INFO:tasks.workunit.client.1.smithi164.stdout:7/398: stat d2/d21/d33/c37 0 2024-04-20T21:58:59.567 INFO:tasks.workunit.client.1.smithi164.stdout:5/481: write dc/d2b/d52/f7c [650608,84248] 0 2024-04-20T21:58:59.567 INFO:tasks.workunit.client.1.smithi164.stdout:0/412: rmdir d1/d4/da/d5c/d6c 0 2024-04-20T21:58:59.568 INFO:tasks.workunit.client.1.smithi164.stdout:1/379: dwrite d10/d33/d48/f71 [0,4194304] 0 2024-04-20T21:58:59.575 INFO:tasks.workunit.client.1.smithi164.stdout:3/455: rename fa to d12/d20/d39/d55/d6b/d79/f91 0 2024-04-20T21:58:59.575 INFO:tasks.workunit.client.1.smithi164.stdout:0/413: fdatasync d1/d4/da/f6d 0 2024-04-20T21:58:59.576 INFO:tasks.workunit.client.1.smithi164.stdout:2/424: dread d2/d19/d28/f2a [0,4194304] 0 2024-04-20T21:58:59.579 INFO:tasks.workunit.client.1.smithi164.stdout:7/399: rmdir d2/d21 39 2024-04-20T21:58:59.581 INFO:tasks.workunit.client.1.smithi164.stdout:9/490: dread d3/db/dd/d40/d2a/d36/d51/f68 [0,4194304] 0 2024-04-20T21:58:59.582 INFO:tasks.workunit.client.1.smithi164.stdout:0/414: write d1/f8 [651414,91243] 0 2024-04-20T21:58:59.582 INFO:tasks.workunit.client.1.smithi164.stdout:8/356: read d0/d14/fa [1059703,67219] 0 2024-04-20T21:58:59.587 INFO:tasks.workunit.client.1.smithi164.stdout:1/380: creat d10/d33/f75 x:0 0 0 2024-04-20T21:58:59.589 INFO:tasks.workunit.client.1.smithi164.stdout:2/425: unlink d2/d5/d3a/c41 0 2024-04-20T21:58:59.590 INFO:tasks.workunit.client.1.smithi164.stdout:1/381: stat d10/d33/d48/f4f 0 2024-04-20T21:58:59.591 INFO:tasks.workunit.client.1.smithi164.stdout:5/482: dwrite f8 [0,4194304] 0 2024-04-20T21:58:59.593 INFO:tasks.workunit.client.1.smithi164.stdout:6/466: link d0/d3/d15/d23/d45/d4f/f66 d0/d3/d11/f9b 0 2024-04-20T21:58:59.593 INFO:tasks.workunit.client.1.smithi164.stdout:1/382: write d10/d16/d20/f38 [4615577,112981] 0 2024-04-20T21:58:59.594 INFO:tasks.workunit.client.1.smithi164.stdout:2/426: dread - d2/d19/f51 zero size 2024-04-20T21:58:59.598 INFO:tasks.workunit.client.1.smithi164.stdout:2/427: chown d2/d5f/f7d 0 1 2024-04-20T21:58:59.600 INFO:tasks.workunit.client.1.smithi164.stdout:2/428: write d2/f34 [5669076,115021] 0 2024-04-20T21:58:59.605 INFO:tasks.workunit.client.1.smithi164.stdout:7/400: creat d2/d21/d24/d31/d3a/d83/d68/f8b x:0 0 0 2024-04-20T21:58:59.610 INFO:tasks.workunit.client.1.smithi164.stdout:7/401: fdatasync d2/d21/d33/f54 0 2024-04-20T21:58:59.610 INFO:tasks.workunit.client.1.smithi164.stdout:4/387: dread d4/d9/d27/d37/f51 [0,4194304] 0 2024-04-20T21:58:59.610 INFO:tasks.workunit.client.1.smithi164.stdout:7/402: chown d2/d21/d24/f52 236363 1 2024-04-20T21:58:59.610 INFO:tasks.workunit.client.1.smithi164.stdout:5/483: dread dc/d2c/d2e/d30/f89 [0,4194304] 0 2024-04-20T21:58:59.611 INFO:tasks.workunit.client.1.smithi164.stdout:4/388: chown d4/d9/d42 20378741 1 2024-04-20T21:58:59.612 INFO:tasks.workunit.client.1.smithi164.stdout:1/383: mknod d10/d33/d48/c76 0 2024-04-20T21:58:59.616 INFO:tasks.workunit.client.1.smithi164.stdout:8/357: rename d0/d14/d16/l52 to d0/d1e/l72 0 2024-04-20T21:58:59.616 INFO:tasks.workunit.client.1.smithi164.stdout:3/456: link d12/d15/l49 d12/l92 0 2024-04-20T21:58:59.620 INFO:tasks.workunit.client.1.smithi164.stdout:4/389: creat d4/d9/d27/d3f/f82 x:0 0 0 2024-04-20T21:58:59.622 INFO:tasks.workunit.client.1.smithi164.stdout:1/384: mknod d10/d16/d20/d25/c77 0 2024-04-20T21:58:59.624 INFO:tasks.workunit.client.1.smithi164.stdout:1/385: read - d10/d16/d20/f69 zero size 2024-04-20T21:58:59.626 INFO:tasks.workunit.client.1.smithi164.stdout:2/429: rename d2/f67 to d2/d19/f80 0 2024-04-20T21:58:59.629 INFO:tasks.workunit.client.1.smithi164.stdout:8/358: stat d0/d14/c1f 0 2024-04-20T21:58:59.631 INFO:tasks.workunit.client.1.smithi164.stdout:3/457: dwrite ff [0,4194304] 0 2024-04-20T21:58:59.631 INFO:tasks.workunit.client.1.smithi164.stdout:2/430: truncate d2/d19/f54 657912 0 2024-04-20T21:58:59.631 INFO:tasks.workunit.client.1.smithi164.stdout:5/484: fsync dc/d12/d81/f68 0 2024-04-20T21:58:59.633 INFO:tasks.workunit.client.1.smithi164.stdout:4/390: rmdir d4/d28/d70/d73 39 2024-04-20T21:58:59.635 INFO:tasks.workunit.client.1.smithi164.stdout:6/467: dwrite d0/d3/d11/d29/f46 [0,4194304] 0 2024-04-20T21:58:59.635 INFO:tasks.workunit.client.1.smithi164.stdout:9/491: getdents d3/db/dd/d40/d78/d86 0 2024-04-20T21:58:59.638 INFO:tasks.workunit.client.1.smithi164.stdout:4/391: write d4/d9/f1b [3269794,90422] 0 2024-04-20T21:58:59.639 INFO:tasks.workunit.client.1.smithi164.stdout:2/431: read d2/d5/f14 [849925,129077] 0 2024-04-20T21:58:59.643 INFO:tasks.workunit.client.1.smithi164.stdout:4/392: read - d4/d28/d3e/d4a/f69 zero size 2024-04-20T21:58:59.643 INFO:tasks.workunit.client.1.smithi164.stdout:0/415: rename d1/d4/da/d1f to d1/d4/d26/d29/d2d/d54/d77 0 2024-04-20T21:58:59.646 INFO:tasks.workunit.client.1.smithi164.stdout:1/386: write d10/d16/d20/d26/f74 [601679,99113] 0 2024-04-20T21:58:59.648 INFO:tasks.workunit.client.1.smithi164.stdout:1/387: chown d10/d33/d4d/l5b 9264007 1 2024-04-20T21:58:59.648 INFO:tasks.workunit.client.1.smithi164.stdout:8/359: dread d0/d1e/f44 [0,4194304] 0 2024-04-20T21:58:59.650 INFO:tasks.workunit.client.1.smithi164.stdout:1/388: fsync d10/d16/d20/d26/d34/f5d 0 2024-04-20T21:58:59.651 INFO:tasks.workunit.client.1.smithi164.stdout:7/403: creat d2/f8c x:0 0 0 2024-04-20T21:58:59.652 INFO:tasks.workunit.client.1.smithi164.stdout:5/485: mknod dc/d12/ca4 0 2024-04-20T21:58:59.653 INFO:tasks.workunit.client.1.smithi164.stdout:3/458: creat d12/d20/d39/d55/f93 x:0 0 0 2024-04-20T21:58:59.656 INFO:tasks.workunit.client.1.smithi164.stdout:6/468: mkdir d0/d3/d15/d23/d45/d4f/d9c 0 2024-04-20T21:58:59.666 INFO:tasks.workunit.client.1.smithi164.stdout:1/389: mknod d10/d33/d41/c78 0 2024-04-20T21:58:59.667 INFO:tasks.workunit.client.1.smithi164.stdout:6/469: mkdir d0/d3/d27/d9d 0 2024-04-20T21:58:59.669 INFO:tasks.workunit.client.1.smithi164.stdout:2/432: mkdir d2/d5/d3a/d65/d81 0 2024-04-20T21:58:59.669 INFO:tasks.workunit.client.1.smithi164.stdout:7/404: symlink d2/d21/l8d 0 2024-04-20T21:58:59.671 INFO:tasks.workunit.client.1.smithi164.stdout:5/486: dwrite dc/d2b/d6d/f6f [0,4194304] 0 2024-04-20T21:58:59.673 INFO:tasks.workunit.client.1.smithi164.stdout:9/492: dwrite d3/db/dd/f5d [0,4194304] 0 2024-04-20T21:58:59.674 INFO:tasks.workunit.client.1.smithi164.stdout:4/393: dread d4/d9/d22/f77 [0,4194304] 0 2024-04-20T21:58:59.678 INFO:tasks.workunit.client.1.smithi164.stdout:7/405: write d2/d21/d33/f54 [7821034,15590] 0 2024-04-20T21:58:59.678 INFO:tasks.workunit.client.1.smithi164.stdout:5/487: chown dc/d12/f13 387282 1 2024-04-20T21:58:59.689 INFO:tasks.workunit.client.1.smithi164.stdout:9/493: mknod d3/db/d82/ca8 0 2024-04-20T21:58:59.694 INFO:tasks.workunit.client.1.smithi164.stdout:5/488: rmdir dc/d41 39 2024-04-20T21:58:59.694 INFO:tasks.workunit.client.1.smithi164.stdout:2/433: unlink d2/d19/d28/d3e/d53/d62/l79 0 2024-04-20T21:58:59.700 INFO:tasks.workunit.client.1.smithi164.stdout:7/406: unlink d2/d21/l2e 0 2024-04-20T21:58:59.701 INFO:tasks.workunit.client.1.smithi164.stdout:3/459: truncate d12/f5f 1774859 0 2024-04-20T21:58:59.702 INFO:tasks.workunit.client.1.smithi164.stdout:5/489: creat dc/d2c/d2e/d30/d5e/fa5 x:0 0 0 2024-04-20T21:58:59.703 INFO:tasks.workunit.client.1.smithi164.stdout:3/460: chown d12/d20/f61 509679740 1 2024-04-20T21:58:59.703 INFO:tasks.workunit.client.1.smithi164.stdout:8/360: dread d0/d1e/f22 [0,4194304] 0 2024-04-20T21:58:59.707 INFO:tasks.workunit.client.1.smithi164.stdout:3/461: fdatasync d12/d20/d39/d69/d77/d81/f8c 0 2024-04-20T21:58:59.707 INFO:tasks.workunit.client.1.smithi164.stdout:9/494: creat d3/db/d4f/d67/fa9 x:0 0 0 2024-04-20T21:58:59.709 INFO:tasks.workunit.client.1.smithi164.stdout:4/394: truncate d4/d28/f6b 3668340 0 2024-04-20T21:58:59.710 INFO:tasks.workunit.client.1.smithi164.stdout:5/490: creat dc/d2b/d6d/fa6 x:0 0 0 2024-04-20T21:58:59.710 INFO:tasks.workunit.client.1.smithi164.stdout:8/361: mkdir d0/d14/d16/d58/d73 0 2024-04-20T21:58:59.711 INFO:tasks.workunit.client.1.smithi164.stdout:3/462: fsync f11 0 2024-04-20T21:58:59.712 INFO:tasks.workunit.client.1.smithi164.stdout:2/434: creat d2/d5/f82 x:0 0 0 2024-04-20T21:58:59.712 INFO:tasks.workunit.client.1.smithi164.stdout:5/491: chown dc/c49 455716 1 2024-04-20T21:58:59.714 INFO:tasks.workunit.client.1.smithi164.stdout:9/495: mknod d3/d9f/caa 0 2024-04-20T21:58:59.716 INFO:tasks.workunit.client.1.smithi164.stdout:6/470: dwrite d0/d3/d4a/f55 [0,4194304] 0 2024-04-20T21:58:59.716 INFO:tasks.workunit.client.1.smithi164.stdout:1/390: dread f5 [0,4194304] 0 2024-04-20T21:58:59.717 INFO:tasks.workunit.client.1.smithi164.stdout:4/395: chown d4/d28/d70/d73/l81 2 1 2024-04-20T21:58:59.718 INFO:tasks.workunit.client.1.smithi164.stdout:5/492: fdatasync dc/d2c/d2e/d30/d5e/f9d 0 2024-04-20T21:58:59.719 INFO:tasks.workunit.client.1.smithi164.stdout:6/471: read - d0/d3/d11/f8f zero size 2024-04-20T21:58:59.721 INFO:tasks.workunit.client.1.smithi164.stdout:8/362: creat d0/d14/d16/d58/f74 x:0 0 0 2024-04-20T21:58:59.722 INFO:tasks.workunit.client.1.smithi164.stdout:7/407: creat d2/f8e x:0 0 0 2024-04-20T21:58:59.724 INFO:tasks.workunit.client.1.smithi164.stdout:3/463: rmdir d12/d20/d39/d55/d6b 39 2024-04-20T21:58:59.726 INFO:tasks.workunit.client.1.smithi164.stdout:8/363: write d0/d14/d16/d5a/f6c [1137136,25846] 0 2024-04-20T21:58:59.727 INFO:tasks.workunit.client.1.smithi164.stdout:6/472: read d0/d3/d15/f2c [367534,39268] 0 2024-04-20T21:58:59.727 INFO:tasks.workunit.client.1.smithi164.stdout:4/396: write d4/d28/d3e/f79 [911281,74300] 0 2024-04-20T21:58:59.728 INFO:tasks.workunit.client.1.smithi164.stdout:7/408: fsync d2/d21/d24/d31/d3a/f81 0 2024-04-20T21:58:59.732 INFO:tasks.workunit.client.1.smithi164.stdout:5/493: rmdir dc/d12/d1e 39 2024-04-20T21:58:59.732 INFO:tasks.workunit.client.1.smithi164.stdout:4/397: read - d4/d28/d3e/d4a/f69 zero size 2024-04-20T21:58:59.738 INFO:tasks.workunit.client.1.smithi164.stdout:9/496: creat d3/db/d4f/d9a/fab x:0 0 0 2024-04-20T21:58:59.739 INFO:tasks.workunit.client.1.smithi164.stdout:6/473: dread d0/d3/d8/d28/f33 [0,4194304] 0 2024-04-20T21:58:59.741 INFO:tasks.workunit.client.1.smithi164.stdout:7/409: fsync d2/f48 0 2024-04-20T21:58:59.741 INFO:tasks.workunit.client.1.smithi164.stdout:1/391: dwrite d10/d33/d48/f4b [0,4194304] 0 2024-04-20T21:58:59.742 INFO:tasks.workunit.client.1.smithi164.stdout:2/435: dwrite d2/d5/d21/f37 [0,4194304] 0 2024-04-20T21:58:59.744 INFO:tasks.workunit.client.1.smithi164.stdout:9/497: stat d3/db/dd/d40/c44 0 2024-04-20T21:58:59.749 INFO:tasks.workunit.client.1.smithi164.stdout:7/410: write d2/f5f [3348859,94071] 0 2024-04-20T21:58:59.751 INFO:tasks.workunit.client.1.smithi164.stdout:4/398: mknod d4/d9/c83 0 2024-04-20T21:58:59.752 INFO:tasks.workunit.client.1.smithi164.stdout:2/436: fsync d2/d5/d3a/d55/f73 0 2024-04-20T21:58:59.754 INFO:tasks.workunit.client.1.smithi164.stdout:6/474: mknod d0/c9e 0 2024-04-20T21:58:59.756 INFO:tasks.workunit.client.1.smithi164.stdout:2/437: stat d2/d5/c50 0 2024-04-20T21:58:59.756 INFO:tasks.workunit.client.1.smithi164.stdout:3/464: dwrite f4 [0,4194304] 0 2024-04-20T21:58:59.757 INFO:tasks.workunit.client.1.smithi164.stdout:7/411: mknod d2/d21/d44/c8f 0 2024-04-20T21:58:59.757 INFO:tasks.workunit.client.1.smithi164.stdout:8/364: creat d0/f75 x:0 0 0 2024-04-20T21:58:59.762 INFO:tasks.workunit.client.1.smithi164.stdout:4/399: creat d4/d28/d70/d73/f84 x:0 0 0 2024-04-20T21:58:59.762 INFO:tasks.workunit.client.1.smithi164.stdout:7/412: fsync d2/d21/d33/f40 0 2024-04-20T21:58:59.762 INFO:tasks.workunit.client.1.smithi164.stdout:3/465: chown d12/d6d 579924317 1 2024-04-20T21:58:59.763 INFO:tasks.workunit.client.1.smithi164.stdout:2/438: creat d2/d30/f83 x:0 0 0 2024-04-20T21:58:59.765 INFO:tasks.workunit.client.1.smithi164.stdout:6/475: creat d0/d3/d4a/f9f x:0 0 0 2024-04-20T21:58:59.768 INFO:tasks.workunit.client.1.smithi164.stdout:3/466: read - d12/d2a/f53 zero size 2024-04-20T21:58:59.777 INFO:tasks.workunit.client.1.smithi164.stdout:8/365: mknod d0/d14/d4e/d6f/c76 0 2024-04-20T21:58:59.787 INFO:tasks.workunit.client.1.smithi164.stdout:5/494: dwrite dc/d2c/d2e/f60 [0,4194304] 0 2024-04-20T21:58:59.788 INFO:tasks.workunit.client.1.smithi164.stdout:8/366: unlink d0/d14/f46 0 2024-04-20T21:58:59.790 INFO:tasks.workunit.client.1.smithi164.stdout:3/467: rmdir d12/d20/d39/d55/d6b 39 2024-04-20T21:58:59.795 INFO:tasks.workunit.client.1.smithi164.stdout:9/498: dwrite d3/db/d4f/f93 [0,4194304] 0 2024-04-20T21:58:59.795 INFO:tasks.workunit.client.1.smithi164.stdout:6/476: creat d0/d3/d62/fa0 x:0 0 0 2024-04-20T21:58:59.795 INFO:tasks.workunit.client.1.smithi164.stdout:5/495: write dc/f25 [294929,12293] 0 2024-04-20T21:58:59.799 INFO:tasks.workunit.client.1.smithi164.stdout:8/367: mknod d0/d14/d5f/c77 0 2024-04-20T21:58:59.802 INFO:tasks.workunit.client.1.smithi164.stdout:5/496: readlink dc/d12/l87 0 2024-04-20T21:58:59.802 INFO:tasks.workunit.client.1.smithi164.stdout:6/477: chown d0/f16 371495458 1 2024-04-20T21:58:59.803 INFO:tasks.workunit.client.1.smithi164.stdout:3/468: mknod d12/d68/c94 0 2024-04-20T21:58:59.805 INFO:tasks.workunit.client.1.smithi164.stdout:2/439: dwrite d2/d19/f54 [0,4194304] 0 2024-04-20T21:58:59.805 INFO:tasks.workunit.client.1.smithi164.stdout:4/400: dwrite d4/d9/d22/f24 [0,4194304] 0 2024-04-20T21:58:59.806 INFO:tasks.workunit.client.1.smithi164.stdout:5/497: fdatasync dc/fd 0 2024-04-20T21:58:59.808 INFO:tasks.workunit.client.1.smithi164.stdout:7/413: dwrite d2/d21/d24/d31/f7b [0,4194304] 0 2024-04-20T21:58:59.811 INFO:tasks.workunit.client.1.smithi164.stdout:5/498: readlink dc/d2b/d52/l5a 0 2024-04-20T21:58:59.816 INFO:tasks.workunit.client.1.smithi164.stdout:2/440: mkdir d2/d30/d84 0 2024-04-20T21:58:59.819 INFO:tasks.workunit.client.1.smithi164.stdout:6/478: write d0/d3/d11/d5a/f90 [641194,41008] 0 2024-04-20T21:58:59.820 INFO:tasks.workunit.client.1.smithi164.stdout:8/368: mknod d0/d14/d16/d5a/c78 0 2024-04-20T21:58:59.823 INFO:tasks.workunit.client.1.smithi164.stdout:6/479: truncate d0/d3/d11/f9b 1359217 0 2024-04-20T21:58:59.834 INFO:tasks.workunit.client.1.smithi164.stdout:2/441: rename d2/f34 to d2/d5/d3a/d55/d58/f85 0 2024-04-20T21:58:59.835 INFO:tasks.workunit.client.1.smithi164.stdout:3/469: dwrite d12/d20/d39/f65 [0,4194304] 0 2024-04-20T21:58:59.838 INFO:tasks.workunit.client.1.smithi164.stdout:3/470: fdatasync d12/d20/d39/d55/f93 0 2024-04-20T21:58:59.839 INFO:tasks.workunit.client.1.smithi164.stdout:8/369: write d0/d14/d4e/d62/f5e [834394,102384] 0 2024-04-20T21:58:59.839 INFO:tasks.workunit.client.1.smithi164.stdout:3/471: stat d12/d20/f61 0 2024-04-20T21:58:59.845 INFO:tasks.workunit.client.1.smithi164.stdout:9/499: write d3/db/dd/f11 [406736,131042] 0 2024-04-20T21:58:59.845 INFO:tasks.workunit.client.1.smithi164.stdout:6/480: dwrite d0/d3/d8/f96 [0,4194304] 0 2024-04-20T21:58:59.848 INFO:tasks.workunit.client.1.smithi164.stdout:3/472: read f10 [908031,115533] 0 2024-04-20T21:58:59.851 INFO:tasks.workunit.client.1.smithi164.stdout:4/401: write d4/f19 [1612022,91322] 0 2024-04-20T21:58:59.855 INFO:tasks.workunit.client.1.smithi164.stdout:7/414: getdents d2/d21/d44 0 2024-04-20T21:58:59.855 INFO:tasks.workunit.client.1.smithi164.stdout:5/499: link dc/cf dc/d2b/ca7 0 2024-04-20T21:58:59.858 INFO:tasks.workunit.client.1.smithi164.stdout:6/481: creat d0/d3/d62/d75/fa1 x:0 0 0 2024-04-20T21:58:59.858 INFO:tasks.workunit.client.1.smithi164.stdout:9/500: creat d3/db/d82/d98/fac x:0 0 0 2024-04-20T21:58:59.860 INFO:tasks.workunit.client.1.smithi164.stdout:3/473: symlink d12/d20/d39/d69/d83/l95 0 2024-04-20T21:58:59.868 INFO:tasks.workunit.client.1.smithi164.stdout:3/474: write d12/f51 [155676,32524] 0 2024-04-20T21:58:59.869 INFO:tasks.workunit.client.1.smithi164.stdout:2/442: dwrite d2/d5/d3a/f76 [0,4194304] 0 2024-04-20T21:58:59.871 INFO:tasks.workunit.client.1.smithi164.stdout:8/370: dwrite d0/f3a [0,4194304] 0 2024-04-20T21:58:59.873 INFO:tasks.workunit.client.1.smithi164.stdout:9/501: creat d3/db/d4f/d9a/fad x:0 0 0 2024-04-20T21:58:59.880 INFO:tasks.workunit.client.1.smithi164.stdout:6/482: creat d0/d3/d27/d9d/fa2 x:0 0 0 2024-04-20T21:58:59.882 INFO:tasks.workunit.client.1.smithi164.stdout:3/475: creat d12/d6d/f96 x:0 0 0 2024-04-20T21:58:59.887 INFO:tasks.workunit.client.1.smithi164.stdout:7/415: dwrite d2/f7 [0,4194304] 0 2024-04-20T21:58:59.890 INFO:tasks.workunit.client.1.smithi164.stdout:8/371: dread d0/f11 [0,4194304] 0 2024-04-20T21:58:59.893 INFO:tasks.workunit.client.1.smithi164.stdout:8/372: dread - d0/d14/d16/f70 zero size 2024-04-20T21:58:59.896 INFO:tasks.workunit.client.1.smithi164.stdout:5/500: dwrite dc/d12/f18 [0,4194304] 0 2024-04-20T21:58:59.912 INFO:tasks.workunit.client.1.smithi164.stdout:0/416: sync 2024-04-20T21:58:59.936 INFO:tasks.workunit.client.1.smithi164.stdout:0/417: dread d1/d4/d26/d29/d2d/d54/d77/d3c/f4e [0,4194304] 0 2024-04-20T21:58:59.948 INFO:tasks.workunit.client.1.smithi164.stdout:0/418: dwrite d1/f3e [0,4194304] 0 2024-04-20T21:58:59.951 INFO:tasks.workunit.client.1.smithi164.stdout:0/419: chown d1/d4/d26/d29/d2d/d54/d77/d3c/f58 6343 1 2024-04-20T21:58:59.956 INFO:tasks.workunit.client.1.smithi164.stdout:0/420: fdatasync d1/d4/d26/d29/d2d/d54/f57 0 2024-04-20T21:58:59.963 INFO:tasks.workunit.client.1.smithi164.stdout:1/392: sync 2024-04-20T21:59:00.033 INFO:tasks.workunit.client.1.smithi164.stdout:8/373: write d0/d14/d16/f26 [4004222,76518] 0 2024-04-20T21:59:00.045 INFO:tasks.workunit.client.1.smithi164.stdout:2/443: mknod d2/d5/d3a/d65/d81/c86 0 2024-04-20T21:59:00.050 INFO:tasks.workunit.client.1.smithi164.stdout:5/501: mkdir dc/d12/d1e/da8 0 2024-04-20T21:59:00.054 INFO:tasks.workunit.client.1.smithi164.stdout:8/374: creat d0/d14/d4e/d6f/f79 x:0 0 0 2024-04-20T21:59:00.057 INFO:tasks.workunit.client.1.smithi164.stdout:1/393: mknod d10/d16/d20/d66/c79 0 2024-04-20T21:59:00.059 INFO:tasks.workunit.client.1.smithi164.stdout:2/444: symlink d2/d19/d28/d3e/d53/l87 0 2024-04-20T21:59:00.063 INFO:tasks.workunit.client.1.smithi164.stdout:5/502: mkdir dc/d2c/d2e/d30/d72/da9 0 2024-04-20T21:59:00.063 INFO:tasks.workunit.client.1.smithi164.stdout:0/421: link d1/c2a d1/d4/df/c78 0 2024-04-20T21:59:00.067 INFO:tasks.workunit.client.1.smithi164.stdout:0/422: read d1/fb [2645520,7769] 0 2024-04-20T21:59:00.068 INFO:tasks.workunit.client.1.smithi164.stdout:2/445: creat d2/d19/d28/d3e/d53/d62/f88 x:0 0 0 2024-04-20T21:59:00.072 INFO:tasks.workunit.client.1.smithi164.stdout:2/446: read d2/d19/d28/d3e/f59 [3032788,87178] 0 2024-04-20T21:59:00.073 INFO:tasks.workunit.client.1.smithi164.stdout:0/423: write d1/d4/d26/d29/d2d/d54/d77/f5d [283379,41008] 0 2024-04-20T21:59:00.073 INFO:tasks.workunit.client.1.smithi164.stdout:2/447: fsync d2/d5/d3a/f6a 0 2024-04-20T21:59:00.079 INFO:tasks.workunit.client.1.smithi164.stdout:2/448: symlink d2/d5/d3a/l89 0 2024-04-20T21:59:00.088 INFO:tasks.workunit.client.1.smithi164.stdout:9/502: symlink d3/db/dd/d40/d2a/lae 0 2024-04-20T21:59:00.093 INFO:tasks.workunit.client.1.smithi164.stdout:1/394: dwrite d10/f5c [0,4194304] 0 2024-04-20T21:59:00.099 INFO:tasks.workunit.client.1.smithi164.stdout:1/395: read d10/d16/d20/f2f [1160431,69604] 0 2024-04-20T21:59:00.100 INFO:tasks.workunit.client.1.smithi164.stdout:5/503: dwrite dc/d2c/f90 [0,4194304] 0 2024-04-20T21:59:00.103 INFO:tasks.workunit.client.1.smithi164.stdout:1/396: readlink d10/d16/d20/d25/l49 0 2024-04-20T21:59:00.104 INFO:tasks.workunit.client.1.smithi164.stdout:1/397: dread - d10/d33/f75 zero size 2024-04-20T21:59:00.106 INFO:tasks.workunit.client.1.smithi164.stdout:5/504: write dc/d12/d1e/f35 [4597900,119460] 0 2024-04-20T21:59:00.108 INFO:tasks.workunit.client.1.smithi164.stdout:5/505: read - dc/d2c/f43 zero size 2024-04-20T21:59:00.109 INFO:tasks.workunit.client.1.smithi164.stdout:9/503: dread d3/db/d4f/f93 [0,4194304] 0 2024-04-20T21:59:00.110 INFO:tasks.workunit.client.1.smithi164.stdout:1/398: creat d10/d16/d20/d26/d34/f7a x:0 0 0 2024-04-20T21:59:00.116 INFO:tasks.workunit.client.1.smithi164.stdout:9/504: fsync d3/db/d4f/f93 0 2024-04-20T21:59:00.120 INFO:tasks.workunit.client.1.smithi164.stdout:9/505: write d3/db/d1b/d1e/f4b [756574,31633] 0 2024-04-20T21:59:00.122 INFO:tasks.workunit.client.1.smithi164.stdout:5/506: truncate dc/d12/d1e/f1f 1028776 0 2024-04-20T21:59:00.127 INFO:tasks.workunit.client.1.smithi164.stdout:9/506: write d3/db/dd/f6b [704280,114774] 0 2024-04-20T21:59:00.128 INFO:tasks.workunit.client.1.smithi164.stdout:2/449: dread d2/d5/d3a/d55/d58/f85 [0,4194304] 0 2024-04-20T21:59:00.132 INFO:tasks.workunit.client.1.smithi164.stdout:5/507: read dc/f66 [2847655,271] 0 2024-04-20T21:59:00.135 INFO:tasks.workunit.client.1.smithi164.stdout:9/507: write d3/db/f5b [284803,130477] 0 2024-04-20T21:59:00.141 INFO:tasks.workunit.client.1.smithi164.stdout:1/399: dread d10/d16/d19/f4e [0,4194304] 0 2024-04-20T21:59:00.156 INFO:tasks.workunit.client.1.smithi164.stdout:1/400: unlink d10/d33/d41/c4c 0 2024-04-20T21:59:00.157 INFO:tasks.workunit.client.1.smithi164.stdout:5/508: dwrite dc/fd [0,4194304] 0 2024-04-20T21:59:00.158 INFO:tasks.workunit.client.1.smithi164.stdout:5/509: fsync dc/d2b/d6d/f6f 0 2024-04-20T21:59:00.166 INFO:tasks.workunit.client.1.smithi164.stdout:1/401: write d10/d16/d20/d26/f74 [280391,28602] 0 2024-04-20T21:59:00.184 INFO:tasks.workunit.client.1.smithi164.stdout:8/375: rmdir d0/d14/d4e 39 2024-04-20T21:59:00.184 INFO:tasks.workunit.client.1.smithi164.stdout:3/476: dwrite d12/d15/f6c [0,4194304] 0 2024-04-20T21:59:00.188 INFO:tasks.workunit.client.1.smithi164.stdout:9/508: dread d3/db/f8c [0,4194304] 0 2024-04-20T21:59:00.191 INFO:tasks.workunit.client.1.smithi164.stdout:9/509: write d3/f39 [352758,57825] 0 2024-04-20T21:59:00.196 INFO:tasks.workunit.client.1.smithi164.stdout:8/376: creat d0/d14/d5f/f7a x:0 0 0 2024-04-20T21:59:00.197 INFO:tasks.workunit.client.1.smithi164.stdout:8/377: chown d0/d14/d5f 0 1 2024-04-20T21:59:00.201 INFO:tasks.workunit.client.1.smithi164.stdout:3/477: creat d12/d20/d39/d55/d6b/f97 x:0 0 0 2024-04-20T21:59:00.205 INFO:tasks.workunit.client.1.smithi164.stdout:9/510: creat d3/db/d1b/faf x:0 0 0 2024-04-20T21:59:00.207 INFO:tasks.workunit.client.1.smithi164.stdout:9/511: write d3/f1f [2178071,31086] 0 2024-04-20T21:59:00.211 INFO:tasks.workunit.client.1.smithi164.stdout:9/512: mkdir d3/db0 0 2024-04-20T21:59:00.215 INFO:tasks.workunit.client.1.smithi164.stdout:9/513: read d3/f41 [232263,124985] 0 2024-04-20T21:59:00.219 INFO:tasks.workunit.client.1.smithi164.stdout:7/416: symlink d2/d21/d24/l90 0 2024-04-20T21:59:00.220 INFO:tasks.workunit.client.1.smithi164.stdout:3/478: dwrite f11 [0,4194304] 0 2024-04-20T21:59:00.223 INFO:tasks.workunit.client.1.smithi164.stdout:7/417: write d2/d21/d24/d31/f84 [54313,75535] 0 2024-04-20T21:59:00.223 INFO:tasks.workunit.client.1.smithi164.stdout:8/378: dwrite d0/d1e/f6b [0,4194304] 0 2024-04-20T21:59:00.224 INFO:tasks.workunit.client.1.smithi164.stdout:2/450: creat d2/f8a x:0 0 0 2024-04-20T21:59:00.224 INFO:tasks.workunit.client.1.smithi164.stdout:3/479: chown d12/d20/d39/d55/d6b/d79/f91 58512 1 2024-04-20T21:59:00.227 INFO:tasks.workunit.client.1.smithi164.stdout:2/451: readlink d2/d5/l2f 0 2024-04-20T21:59:00.228 INFO:tasks.workunit.client.1.smithi164.stdout:5/510: symlink dc/laa 0 2024-04-20T21:59:00.231 INFO:tasks.workunit.client.1.smithi164.stdout:7/418: unlink d2/d21/d24/f2b 0 2024-04-20T21:59:00.232 INFO:tasks.workunit.client.1.smithi164.stdout:2/452: fsync d2/d5/d21/f2d 0 2024-04-20T21:59:00.236 INFO:tasks.workunit.client.1.smithi164.stdout:7/419: fsync d2/f8e 0 2024-04-20T21:59:00.236 INFO:tasks.workunit.client.1.smithi164.stdout:7/420: fsync f1 0 2024-04-20T21:59:00.241 INFO:tasks.workunit.client.1.smithi164.stdout:5/511: truncate f9 2485071 0 2024-04-20T21:59:00.243 INFO:tasks.workunit.client.1.smithi164.stdout:7/421: symlink d2/d21/d24/d31/d3a/d83/d63/d85/l91 0 2024-04-20T21:59:00.245 INFO:tasks.workunit.client.1.smithi164.stdout:5/512: mkdir dc/d2b/d6d/d73/dab 0 2024-04-20T21:59:00.246 INFO:tasks.workunit.client.1.smithi164.stdout:7/422: dread - d2/f67 zero size 2024-04-20T21:59:00.247 INFO:tasks.workunit.client.1.smithi164.stdout:3/480: dwrite d12/d20/d39/f54 [0,4194304] 0 2024-04-20T21:59:00.248 INFO:tasks.workunit.client.1.smithi164.stdout:3/481: readlink d12/d20/l33 0 2024-04-20T21:59:00.250 INFO:tasks.workunit.client.1.smithi164.stdout:4/402: rename d4/d9/d27/d3f/d67/c68 to d4/d28/c85 0 2024-04-20T21:59:00.253 INFO:tasks.workunit.client.1.smithi164.stdout:4/403: chown d4/d9/fc 37833784 1 2024-04-20T21:59:00.257 INFO:tasks.workunit.client.1.smithi164.stdout:5/513: symlink dc/d2b/d6d/d73/lac 0 2024-04-20T21:59:00.257 INFO:tasks.workunit.client.1.smithi164.stdout:3/482: read d12/d20/d39/f5d [300775,27067] 0 2024-04-20T21:59:00.258 INFO:tasks.workunit.client.1.smithi164.stdout:6/483: rename d0/d3/d8/d28/f33 to d0/d3/d27/d9d/fa3 0 2024-04-20T21:59:00.262 INFO:tasks.workunit.client.1.smithi164.stdout:5/514: chown dc/d2c/l36 18166 1 2024-04-20T21:59:00.262 INFO:tasks.workunit.client.1.smithi164.stdout:6/484: write d0/d3/f3a [245292,67477] 0 2024-04-20T21:59:00.264 INFO:tasks.workunit.client.1.smithi164.stdout:0/424: rename d1/d4/d26/d29/d2d/d54/d77/d3c/f4e to d1/d4/d20/f79 0 2024-04-20T21:59:00.267 INFO:tasks.workunit.client.1.smithi164.stdout:1/402: truncate d10/d33/d41/f63 95406 0 2024-04-20T21:59:00.269 INFO:tasks.workunit.client.1.smithi164.stdout:1/403: fsync d10/d16/d20/f69 0 2024-04-20T21:59:00.270 INFO:tasks.workunit.client.1.smithi164.stdout:0/425: write d1/d4/d20/d74/f35 [2806597,10941] 0 2024-04-20T21:59:00.274 INFO:tasks.workunit.client.1.smithi164.stdout:6/485: creat d0/d3/d11/d29/d6e/d5d/fa4 x:0 0 0 2024-04-20T21:59:00.276 INFO:tasks.workunit.client.1.smithi164.stdout:6/486: chown d0/d3/d4a/f55 100070507 1 2024-04-20T21:59:00.278 INFO:tasks.workunit.client.1.smithi164.stdout:5/515: creat dc/d41/fad x:0 0 0 2024-04-20T21:59:00.279 INFO:tasks.workunit.client.1.smithi164.stdout:6/487: fdatasync d0/d3/d8/f1f 0 2024-04-20T21:59:00.280 INFO:tasks.workunit.client.1.smithi164.stdout:1/404: rmdir d10/d33/d4d 39 2024-04-20T21:59:00.283 INFO:tasks.workunit.client.1.smithi164.stdout:2/453: dread d2/d5/d3a/f43 [4194304,4194304] 0 2024-04-20T21:59:00.286 INFO:tasks.workunit.client.1.smithi164.stdout:5/516: mknod dc/d2b/d52/cae 0 2024-04-20T21:59:00.286 INFO:tasks.workunit.client.1.smithi164.stdout:2/454: write d2/d19/d28/d3e/f42 [2952329,58833] 0 2024-04-20T21:59:00.288 INFO:tasks.workunit.client.1.smithi164.stdout:0/426: link d1/f42 d1/d4/da/d5c/d6e/f7a 0 2024-04-20T21:59:00.289 INFO:tasks.workunit.client.1.smithi164.stdout:7/423: truncate f1 7735031 0 2024-04-20T21:59:00.290 INFO:tasks.workunit.client.1.smithi164.stdout:6/488: creat d0/d3/d15/d21/d5c/fa5 x:0 0 0 2024-04-20T21:59:00.294 INFO:tasks.workunit.client.1.smithi164.stdout:9/514: rename d3/db/d82/d98/fac to d3/fb1 0 2024-04-20T21:59:00.297 INFO:tasks.workunit.client.1.smithi164.stdout:5/517: stat dc/d2b/d52/c69 0 2024-04-20T21:59:00.304 INFO:tasks.workunit.client.1.smithi164.stdout:7/424: dread d2/d21/f3b [0,4194304] 0 2024-04-20T21:59:00.306 INFO:tasks.workunit.client.1.smithi164.stdout:6/489: creat d0/d3/d15/d23/d45/d69/fa6 x:0 0 0 2024-04-20T21:59:00.306 INFO:tasks.workunit.client.1.smithi164.stdout:7/425: chown d2/d21/d44/f4b 9068 1 2024-04-20T21:59:00.310 INFO:tasks.workunit.client.1.smithi164.stdout:4/404: rename d4/d28/d70/d73 to d4/d9/d27/d3f/d67/d86 0 2024-04-20T21:59:00.311 INFO:tasks.workunit.client.1.smithi164.stdout:9/515: truncate d3/db/dd/f45 1211507 0 2024-04-20T21:59:00.311 INFO:tasks.workunit.client.1.smithi164.stdout:7/426: truncate d2/d21/d24/f4f 639188 0 2024-04-20T21:59:00.312 INFO:tasks.workunit.client.1.smithi164.stdout:3/483: write d12/d15/f37 [2957298,108563] 0 2024-04-20T21:59:00.313 INFO:tasks.workunit.client.1.smithi164.stdout:2/455: dread d2/d5/d3a/f6a [0,4194304] 0 2024-04-20T21:59:00.313 INFO:tasks.workunit.client.1.smithi164.stdout:9/516: stat d3/db/l5a 0 2024-04-20T21:59:00.316 INFO:tasks.workunit.client.1.smithi164.stdout:1/405: creat d10/d16/f7b x:0 0 0 2024-04-20T21:59:00.316 INFO:tasks.workunit.client.1.smithi164.stdout:0/427: fsync d1/d4/d20/f79 0 2024-04-20T21:59:00.319 INFO:tasks.workunit.client.1.smithi164.stdout:1/406: rename d10/d16/d20 to d10/d16/d20/d26/d7c 22 2024-04-20T21:59:00.319 INFO:tasks.workunit.client.1.smithi164.stdout:0/428: stat d1/d4/d26/l6f 0 2024-04-20T21:59:00.323 INFO:tasks.workunit.client.1.smithi164.stdout:0/429: write d1/d4/da/f6d [608215,119156] 0 2024-04-20T21:59:00.325 INFO:tasks.workunit.client.1.smithi164.stdout:3/484: mknod d12/d68/d6f/c98 0 2024-04-20T21:59:00.328 INFO:tasks.workunit.client.1.smithi164.stdout:9/517: creat d3/db/d82/fb2 x:0 0 0 2024-04-20T21:59:00.330 INFO:tasks.workunit.client.1.smithi164.stdout:2/456: symlink d2/d5/d3a/d65/d81/l8b 0 2024-04-20T21:59:00.331 INFO:tasks.workunit.client.1.smithi164.stdout:4/405: dwrite d4/f19 [0,4194304] 0 2024-04-20T21:59:00.336 INFO:tasks.workunit.client.1.smithi164.stdout:7/427: symlink d2/l92 0 2024-04-20T21:59:00.336 INFO:tasks.workunit.client.1.smithi164.stdout:2/457: write d2/d5/f6d [889823,123599] 0 2024-04-20T21:59:00.338 INFO:tasks.workunit.client.1.smithi164.stdout:5/518: write dc/d12/f4d [1284447,12288] 0 2024-04-20T21:59:00.342 INFO:tasks.workunit.client.1.smithi164.stdout:6/490: creat d0/d3/d62/fa7 x:0 0 0 2024-04-20T21:59:00.342 INFO:tasks.workunit.client.1.smithi164.stdout:4/406: write d4/d9/d27/d3f/d67/d86/f84 [724222,40700] 0 2024-04-20T21:59:00.347 INFO:tasks.workunit.client.1.smithi164.stdout:0/430: symlink d1/d4/da/d27/l7b 0 2024-04-20T21:59:00.347 INFO:tasks.workunit.client.1.smithi164.stdout:1/407: dwrite d10/d16/d19/d1a/f32 [0,4194304] 0 2024-04-20T21:59:00.348 INFO:tasks.workunit.client.1.smithi164.stdout:9/518: creat d3/db/dd/d40/d78/d86/fb3 x:0 0 0 2024-04-20T21:59:00.351 INFO:tasks.workunit.client.1.smithi164.stdout:7/428: readlink d2/d21/d24/d31/l4a 0 2024-04-20T21:59:00.351 INFO:tasks.workunit.client.1.smithi164.stdout:6/491: dread - d0/d3/d62/fa7 zero size 2024-04-20T21:59:00.356 INFO:tasks.workunit.client.1.smithi164.stdout:2/458: rename d2/f6b to d2/d19/d28/d3e/d53/d62/f8c 0 2024-04-20T21:59:00.356 INFO:tasks.workunit.client.1.smithi164.stdout:0/431: stat d1/d4/d26/l6f 0 2024-04-20T21:59:00.357 INFO:tasks.workunit.client.1.smithi164.stdout:1/408: chown d10/l13 4736 1 2024-04-20T21:59:00.362 INFO:tasks.workunit.client.1.smithi164.stdout:3/485: dwrite d12/f67 [0,4194304] 0 2024-04-20T21:59:00.362 INFO:tasks.workunit.client.1.smithi164.stdout:9/519: creat d3/db/d1b/d20/fb4 x:0 0 0 2024-04-20T21:59:00.363 INFO:tasks.workunit.client.1.smithi164.stdout:2/459: fsync d2/d19/d28/f29 0 2024-04-20T21:59:00.366 INFO:tasks.workunit.client.1.smithi164.stdout:9/520: truncate d3/f91 61778 0 2024-04-20T21:59:00.369 INFO:tasks.workunit.client.1.smithi164.stdout:6/492: mknod d0/d3/d8/d28/d6f/ca8 0 2024-04-20T21:59:00.370 INFO:tasks.workunit.client.1.smithi164.stdout:1/409: chown d10/d16/d20/d66/c79 54855392 1 2024-04-20T21:59:00.370 INFO:tasks.workunit.client.1.smithi164.stdout:5/519: dread dc/d2b/d52/d99/f9b [0,4194304] 0 2024-04-20T21:59:00.373 INFO:tasks.workunit.client.1.smithi164.stdout:5/520: readlink dc/laa 0 2024-04-20T21:59:00.379 INFO:tasks.workunit.client.1.smithi164.stdout:9/521: creat d3/db/dd/d40/d78/d86/fb5 x:0 0 0 2024-04-20T21:59:00.379 INFO:tasks.workunit.client.1.smithi164.stdout:6/493: creat d0/d3/d8/d81/fa9 x:0 0 0 2024-04-20T21:59:00.379 INFO:tasks.workunit.client.1.smithi164.stdout:5/521: stat dc/d2b/d52/l5a 0 2024-04-20T21:59:00.380 INFO:tasks.workunit.client.1.smithi164.stdout:2/460: mknod d2/d19/d28/d3e/c8d 0 2024-04-20T21:59:00.382 INFO:tasks.workunit.client.1.smithi164.stdout:2/461: fsync d2/d5/d3a/d55/f68 0 2024-04-20T21:59:00.382 INFO:tasks.workunit.client.1.smithi164.stdout:1/410: mkdir d10/d7d 0 2024-04-20T21:59:00.383 INFO:tasks.workunit.client.1.smithi164.stdout:6/494: write d0/d3/f80 [74720,39539] 0 2024-04-20T21:59:00.385 INFO:tasks.workunit.client.1.smithi164.stdout:4/407: getdents d4/d28/d3e/d41 0 2024-04-20T21:59:00.390 INFO:tasks.workunit.client.1.smithi164.stdout:2/462: chown d2/f20 1313 1 2024-04-20T21:59:00.391 INFO:tasks.workunit.client.1.smithi164.stdout:7/429: getdents d2/d21/d24/d31/d3a/d83 0 2024-04-20T21:59:00.398 INFO:tasks.workunit.client.1.smithi164.stdout:8/379: sync 2024-04-20T21:59:00.400 INFO:tasks.workunit.client.1.smithi164.stdout:2/463: read d2/d5/d21/f2d [3191532,77767] 0 2024-04-20T21:59:00.400 INFO:tasks.workunit.client.1.smithi164.stdout:6/495: creat d0/d3/d15/d23/d3b/faa x:0 0 0 2024-04-20T21:59:00.401 INFO:tasks.workunit.client.1.smithi164.stdout:1/411: rename d10/d16/d20/d26/c5f to d10/d16/d19/d1a/c7e 0 2024-04-20T21:59:00.403 INFO:tasks.workunit.client.1.smithi164.stdout:7/430: mkdir d2/d21/d24/d60/d82/d93 0 2024-04-20T21:59:00.403 INFO:tasks.workunit.client.1.smithi164.stdout:3/486: dwrite d12/d6d/f96 [0,4194304] 0 2024-04-20T21:59:00.408 INFO:tasks.workunit.client.1.smithi164.stdout:5/522: link dc/d2b/d52/l5c dc/d12/d1e/da8/laf 0 2024-04-20T21:59:00.412 INFO:tasks.workunit.client.1.smithi164.stdout:0/432: dread d1/d4/d20/d74/f5e [0,4194304] 0 2024-04-20T21:59:00.413 INFO:tasks.workunit.client.1.smithi164.stdout:2/464: mknod d2/c8e 0 2024-04-20T21:59:00.413 INFO:tasks.workunit.client.1.smithi164.stdout:4/408: dwrite d4/d9/d27/d3f/f63 [0,4194304] 0 2024-04-20T21:59:00.414 INFO:tasks.workunit.client.1.smithi164.stdout:1/412: mkdir d10/d33/d7f 0 2024-04-20T21:59:00.414 INFO:tasks.workunit.client.1.smithi164.stdout:9/522: dwrite d3/db/dd/d40/d78/d86/fb3 [0,4194304] 0 2024-04-20T21:59:00.418 INFO:tasks.workunit.client.1.smithi164.stdout:1/413: chown d10/d16/d20/d66 715 1 2024-04-20T21:59:00.422 INFO:tasks.workunit.client.1.smithi164.stdout:2/465: truncate d2/d19/d28/f4e 133627 0 2024-04-20T21:59:00.422 INFO:tasks.workunit.client.1.smithi164.stdout:6/496: rmdir d0/d3/d15/d23/d45/d4f 39 2024-04-20T21:59:00.428 INFO:tasks.workunit.client.1.smithi164.stdout:8/380: mknod d0/d14/d16/d58/d73/c7b 0 2024-04-20T21:59:00.432 INFO:tasks.workunit.client.1.smithi164.stdout:7/431: truncate d2/d21/f35 983934 0 2024-04-20T21:59:00.432 INFO:tasks.workunit.client.1.smithi164.stdout:3/487: dwrite f4 [0,4194304] 0 2024-04-20T21:59:00.436 INFO:tasks.workunit.client.1.smithi164.stdout:1/414: symlink d10/d16/d20/d25/l80 0 2024-04-20T21:59:00.436 INFO:tasks.workunit.client.1.smithi164.stdout:6/497: symlink d0/d3/d15/d23/d45/d69/lab 0 2024-04-20T21:59:00.440 INFO:tasks.workunit.client.1.smithi164.stdout:9/523: write d3/db/dd/d40/d78/d86/fb3 [4303855,19270] 0 2024-04-20T21:59:00.442 INFO:tasks.workunit.client.1.smithi164.stdout:5/523: dread dc/f16 [0,4194304] 0 2024-04-20T21:59:00.442 INFO:tasks.workunit.client.1.smithi164.stdout:8/381: mkdir d0/d14/d16/d58/d73/d7c 0 2024-04-20T21:59:00.448 INFO:tasks.workunit.client.1.smithi164.stdout:7/432: creat d2/d21/d24/d31/d3a/d83/d63/d85/f94 x:0 0 0 2024-04-20T21:59:00.449 INFO:tasks.workunit.client.1.smithi164.stdout:8/382: write d0/d1e/f39 [659048,43852] 0 2024-04-20T21:59:00.452 INFO:tasks.workunit.client.1.smithi164.stdout:4/409: dwrite d4/d9/d27/d3f/f82 [0,4194304] 0 2024-04-20T21:59:00.461 INFO:tasks.workunit.client.1.smithi164.stdout:1/415: mkdir d10/d16/d20/d81 0 2024-04-20T21:59:00.461 INFO:tasks.workunit.client.1.smithi164.stdout:3/488: creat d12/d20/d39/d55/d6b/f99 x:0 0 0 2024-04-20T21:59:00.461 INFO:tasks.workunit.client.1.smithi164.stdout:9/524: mkdir d3/db/d82/d98/db6 0 2024-04-20T21:59:00.461 INFO:tasks.workunit.client.1.smithi164.stdout:0/433: link d1/d4/d26/d29/d2d/d54/d77/f5d d1/d4/da/d27/f7c 0 2024-04-20T21:59:00.462 INFO:tasks.workunit.client.1.smithi164.stdout:6/498: dwrite d0/d3/d15/f32 [0,4194304] 0 2024-04-20T21:59:00.467 INFO:tasks.workunit.client.1.smithi164.stdout:5/524: creat dc/d2c/d2e/d30/d5e/fb0 x:0 0 0 2024-04-20T21:59:00.468 INFO:tasks.workunit.client.1.smithi164.stdout:3/489: fsync d12/d6d/f96 0 2024-04-20T21:59:00.475 INFO:tasks.workunit.client.1.smithi164.stdout:0/434: symlink d1/d4/d20/l7d 0 2024-04-20T21:59:00.476 INFO:tasks.workunit.client.1.smithi164.stdout:8/383: mknod d0/d14/d4e/d62/c7d 0 2024-04-20T21:59:00.478 INFO:tasks.workunit.client.1.smithi164.stdout:1/416: mknod d10/d16/d19/c82 0 2024-04-20T21:59:00.478 INFO:tasks.workunit.client.1.smithi164.stdout:3/490: mkdir d12/d20/d39/d69/d9a 0 2024-04-20T21:59:00.480 INFO:tasks.workunit.client.1.smithi164.stdout:2/466: truncate d2/d19/f54 362690 0 2024-04-20T21:59:00.480 INFO:tasks.workunit.client.1.smithi164.stdout:0/435: fsync d1/d4/d20/f40 0 2024-04-20T21:59:00.481 INFO:tasks.workunit.client.1.smithi164.stdout:8/384: readlink d0/d14/l4a 0 2024-04-20T21:59:00.483 INFO:tasks.workunit.client.1.smithi164.stdout:9/525: rename d3/db/dd/d40/d2a/d36/d51/d83/f85 to d3/db/dd/d40/d2a/d36/d51/da3/fb7 0 2024-04-20T21:59:00.483 INFO:tasks.workunit.client.1.smithi164.stdout:7/433: dwrite d2/d21/d24/d31/f84 [0,4194304] 0 2024-04-20T21:59:00.485 INFO:tasks.workunit.client.1.smithi164.stdout:9/526: dread - d3/db/d4f/fa2 zero size 2024-04-20T21:59:00.486 INFO:tasks.workunit.client.1.smithi164.stdout:2/467: write d2/d19/d28/f29 [1511586,70141] 0 2024-04-20T21:59:00.488 INFO:tasks.workunit.client.1.smithi164.stdout:4/410: truncate d4/f19 341579 0 2024-04-20T21:59:00.489 INFO:tasks.workunit.client.1.smithi164.stdout:3/491: fdatasync d12/d15/f26 0 2024-04-20T21:59:00.491 INFO:tasks.workunit.client.1.smithi164.stdout:3/492: read - d12/d20/f88 zero size 2024-04-20T21:59:00.492 INFO:tasks.workunit.client.1.smithi164.stdout:8/385: rename d0/d14/d4e/d62/f5d to d0/d14/d16/d58/d73/f7e 0 2024-04-20T21:59:00.495 INFO:tasks.workunit.client.1.smithi164.stdout:6/499: getdents d0/d3/d27/d9d 0 2024-04-20T21:59:00.496 INFO:tasks.workunit.client.1.smithi164.stdout:9/527: symlink d3/db/d4f/d67/lb8 0 2024-04-20T21:59:00.497 INFO:tasks.workunit.client.1.smithi164.stdout:1/417: symlink d10/d33/d7f/l83 0 2024-04-20T21:59:00.498 INFO:tasks.workunit.client.1.smithi164.stdout:4/411: symlink d4/d9/d27/d3f/d67/l87 0 2024-04-20T21:59:00.501 INFO:tasks.workunit.client.1.smithi164.stdout:6/500: rmdir d0/d3/d27/d9d 39 2024-04-20T21:59:00.501 INFO:tasks.workunit.client.1.smithi164.stdout:4/412: readlink d4/d9/d27/l2a 0 2024-04-20T21:59:00.502 INFO:tasks.workunit.client.1.smithi164.stdout:4/413: readlink d4/d9/l21 0 2024-04-20T21:59:00.503 INFO:tasks.workunit.client.1.smithi164.stdout:1/418: mknod d10/d16/d20/d26/c84 0 2024-04-20T21:59:00.505 INFO:tasks.workunit.client.1.smithi164.stdout:7/434: rename d2/d21/d44/c87 to d2/d21/c95 0 2024-04-20T21:59:00.570 INFO:tasks.workunit.client.1.smithi164.stdout:1/419: mkdir d10/d16/d19/d1a/d51/d85 0 2024-04-20T21:59:00.572 INFO:tasks.workunit.client.1.smithi164.stdout:0/436: write d1/d4/da/d27/f7c [1271917,76959] 0 2024-04-20T21:59:00.573 INFO:tasks.workunit.client.1.smithi164.stdout:2/468: write d2/d5/f11 [2741298,90985] 0 2024-04-20T21:59:00.574 INFO:tasks.workunit.client.1.smithi164.stdout:1/420: fsync d10/d33/f75 0 2024-04-20T21:59:00.576 INFO:tasks.workunit.client.1.smithi164.stdout:3/493: dwrite d12/f1e [0,4194304] 0 2024-04-20T21:59:00.577 INFO:tasks.workunit.client.1.smithi164.stdout:6/501: rename d0/d3/d11/f9b to d0/d3/d8/d28/d6f/fac 0 2024-04-20T21:59:00.580 INFO:tasks.workunit.client.1.smithi164.stdout:3/494: fsync d12/f67 0 2024-04-20T21:59:00.583 INFO:tasks.workunit.client.1.smithi164.stdout:3/495: chown d12/d20/d39/d55/d6b 3781299 1 2024-04-20T21:59:00.584 INFO:tasks.workunit.client.1.smithi164.stdout:8/386: dwrite d0/d14/d16/d5a/f5c [0,4194304] 0 2024-04-20T21:59:00.584 INFO:tasks.workunit.client.1.smithi164.stdout:1/421: mknod d10/d33/d7f/c86 0 2024-04-20T21:59:00.586 INFO:tasks.workunit.client.1.smithi164.stdout:8/387: chown d0/l42 3 1 2024-04-20T21:59:00.589 INFO:tasks.workunit.client.1.smithi164.stdout:4/414: dwrite d4/fe [0,4194304] 0 2024-04-20T21:59:00.593 INFO:tasks.workunit.client.1.smithi164.stdout:3/496: creat d12/d68/f9b x:0 0 0 2024-04-20T21:59:00.598 INFO:tasks.workunit.client.1.smithi164.stdout:4/415: rmdir d4/d9/d27/d3f 39 2024-04-20T21:59:00.601 INFO:tasks.workunit.client.1.smithi164.stdout:0/437: rename d1/d4/d26/f36 to d1/d4/f7e 0 2024-04-20T21:59:00.606 INFO:tasks.workunit.client.1.smithi164.stdout:3/497: unlink d12/d20/d39/d55/l8f 0 2024-04-20T21:59:00.609 INFO:tasks.workunit.client.1.smithi164.stdout:3/498: write d12/f67 [993290,66891] 0 2024-04-20T21:59:00.609 INFO:tasks.workunit.client.1.smithi164.stdout:6/502: mknod d0/d3/d15/d23/d45/d4f/d9c/cad 0 2024-04-20T21:59:00.611 INFO:tasks.workunit.client.1.smithi164.stdout:6/503: stat d0/d3/c95 0 2024-04-20T21:59:00.613 INFO:tasks.workunit.client.1.smithi164.stdout:6/504: dread - d0/d3/d11/d5a/f89 zero size 2024-04-20T21:59:00.615 INFO:tasks.workunit.client.1.smithi164.stdout:4/416: rmdir d4/d9 39 2024-04-20T21:59:00.617 INFO:tasks.workunit.client.1.smithi164.stdout:8/388: link d0/d1e/f43 d0/d14/d16/f7f 0 2024-04-20T21:59:00.619 INFO:tasks.workunit.client.1.smithi164.stdout:3/499: fsync d12/d20/d39/f46 0 2024-04-20T21:59:00.619 INFO:tasks.workunit.client.1.smithi164.stdout:8/389: stat d0/d14/f4f 0 2024-04-20T21:59:00.620 INFO:tasks.workunit.client.1.smithi164.stdout:0/438: dwrite d1/f12 [0,4194304] 0 2024-04-20T21:59:00.623 INFO:tasks.workunit.client.1.smithi164.stdout:6/505: unlink d0/d3/d11/d29/d6e/d5d/fa4 0 2024-04-20T21:59:00.624 INFO:tasks.workunit.client.1.smithi164.stdout:7/435: rename d2/d21/f34 to d2/d21/d24/d31/d3a/d83/f96 0 2024-04-20T21:59:00.625 INFO:tasks.workunit.client.1.smithi164.stdout:6/506: dread - d0/d3/d8/d81/f8b zero size 2024-04-20T21:59:00.631 INFO:tasks.workunit.client.1.smithi164.stdout:1/422: dread f7 [0,4194304] 0 2024-04-20T21:59:00.633 INFO:tasks.workunit.client.1.smithi164.stdout:4/417: chown d4/d9/d22/c45 24649 1 2024-04-20T21:59:00.633 INFO:tasks.workunit.client.1.smithi164.stdout:8/390: creat d0/d14/d16/d58/f80 x:0 0 0 2024-04-20T21:59:00.637 INFO:tasks.workunit.client.1.smithi164.stdout:3/500: link d12/d15/f38 d12/d68/f9c 0 2024-04-20T21:59:00.642 INFO:tasks.workunit.client.1.smithi164.stdout:7/436: link d2/d21/d24/d31/d3a/d83/f96 d2/d21/d24/d31/d3a/d83/d77/f97 0 2024-04-20T21:59:00.643 INFO:tasks.workunit.client.1.smithi164.stdout:4/418: symlink d4/d28/d70/l88 0 2024-04-20T21:59:00.645 INFO:tasks.workunit.client.1.smithi164.stdout:8/391: mknod d0/d14/c81 0 2024-04-20T21:59:00.645 INFO:tasks.workunit.client.1.smithi164.stdout:0/439: fdatasync d1/f12 0 2024-04-20T21:59:00.646 INFO:tasks.workunit.client.1.smithi164.stdout:4/419: write d4/d9/d27/f7a [46698,50267] 0 2024-04-20T21:59:00.646 INFO:tasks.workunit.client.1.smithi164.stdout:6/507: creat d0/d3/d15/d23/d45/fae x:0 0 0 2024-04-20T21:59:00.650 INFO:tasks.workunit.client.1.smithi164.stdout:1/423: creat d10/d33/f87 x:0 0 0 2024-04-20T21:59:00.652 INFO:tasks.workunit.client.1.smithi164.stdout:7/437: unlink d2/f3c 0 2024-04-20T21:59:00.652 INFO:tasks.workunit.client.1.smithi164.stdout:1/424: write d10/d33/f87 [117395,21571] 0 2024-04-20T21:59:00.654 INFO:tasks.workunit.client.1.smithi164.stdout:8/392: mkdir d0/d14/d4e/d62/d82 0 2024-04-20T21:59:00.656 INFO:tasks.workunit.client.1.smithi164.stdout:8/393: fsync d0/d14/f13 0 2024-04-20T21:59:00.657 INFO:tasks.workunit.client.1.smithi164.stdout:6/508: stat d0/d3/d27/d9d 0 2024-04-20T21:59:00.657 INFO:tasks.workunit.client.1.smithi164.stdout:3/501: rmdir d12/d15 39 2024-04-20T21:59:00.659 INFO:tasks.workunit.client.1.smithi164.stdout:4/420: fsync d4/d9/d27/d3f/f82 0 2024-04-20T21:59:00.659 INFO:tasks.workunit.client.1.smithi164.stdout:6/509: dread - d0/d3/d8/d28/f98 zero size 2024-04-20T21:59:00.661 INFO:tasks.workunit.client.1.smithi164.stdout:4/421: write d4/d9/d27/d3f/f63 [3638404,24237] 0 2024-04-20T21:59:00.662 INFO:tasks.workunit.client.1.smithi164.stdout:7/438: creat d2/d21/d44/f98 x:0 0 0 2024-04-20T21:59:00.662 INFO:tasks.workunit.client.1.smithi164.stdout:0/440: symlink d1/d4/d26/d29/l7f 0 2024-04-20T21:59:00.663 INFO:tasks.workunit.client.1.smithi164.stdout:4/422: chown d4/d28/c72 56845 1 2024-04-20T21:59:00.664 INFO:tasks.workunit.client.1.smithi164.stdout:7/439: write d2/d21/d44/f4b [2820575,92790] 0 2024-04-20T21:59:00.664 INFO:tasks.workunit.client.1.smithi164.stdout:0/441: write d1/d2b/f65 [821481,11904] 0 2024-04-20T21:59:00.666 INFO:tasks.workunit.client.1.smithi164.stdout:3/502: creat d12/d68/d6f/d71/f9d x:0 0 0 2024-04-20T21:59:00.669 INFO:tasks.workunit.client.1.smithi164.stdout:8/394: symlink d0/l83 0 2024-04-20T21:59:00.676 INFO:tasks.workunit.client.1.smithi164.stdout:7/440: rename d2/d21/d24/d31/d3a/d83/d68/l79 to d2/d21/d44/l99 0 2024-04-20T21:59:00.679 INFO:tasks.workunit.client.1.smithi164.stdout:7/441: readlink d2/d21/d24/d31/d3a/d83/d63/d85/l91 0 2024-04-20T21:59:00.680 INFO:tasks.workunit.client.1.smithi164.stdout:1/425: link d10/d33/d4d/l5b d10/d33/d7f/l88 0 2024-04-20T21:59:00.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:00 smithi164 ceph-mon[23506]: pgmap v7: 65 pgs: 65 active+clean; 2.8 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 33 MiB/s rd, 115 MiB/s wr, 264 op/s 2024-04-20T21:59:00.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:00 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:00.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:00 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:00.726 INFO:tasks.workunit.client.1.smithi164.stdout:5/525: sync 2024-04-20T21:59:00.728 INFO:tasks.workunit.client.1.smithi164.stdout:6/510: creat d0/d3/d11/faf x:0 0 0 2024-04-20T21:59:00.729 INFO:tasks.workunit.client.1.smithi164.stdout:4/423: write d4/d28/f6b [658046,59522] 0 2024-04-20T21:59:00.732 INFO:tasks.workunit.client.1.smithi164.stdout:8/395: creat d0/f84 x:0 0 0 2024-04-20T21:59:00.733 INFO:tasks.workunit.client.1.smithi164.stdout:0/442: dwrite d1/d4/d20/d74/f5e [0,4194304] 0 2024-04-20T21:59:00.733 INFO:tasks.workunit.client.1.smithi164.stdout:5/526: readlink dc/d2b/l8d 0 2024-04-20T21:59:00.737 INFO:tasks.workunit.client.1.smithi164.stdout:6/511: chown d0/d3/d15/d23/d45/d69/fa6 1701231209 1 2024-04-20T21:59:00.737 INFO:tasks.workunit.client.1.smithi164.stdout:8/396: read - d0/f84 zero size 2024-04-20T21:59:00.739 INFO:tasks.workunit.client.1.smithi164.stdout:7/442: getdents d2/d21/d24/d31/d3a/d83/d6a 0 2024-04-20T21:59:00.740 INFO:tasks.workunit.client.1.smithi164.stdout:7/443: stat d2/d21/d33/l51 0 2024-04-20T21:59:00.741 INFO:tasks.workunit.client.1.smithi164.stdout:1/426: truncate d10/d16/f70 1066398 0 2024-04-20T21:59:00.743 INFO:tasks.workunit.client.1.smithi164.stdout:7/444: dread - d2/d21/d24/f71 zero size 2024-04-20T21:59:00.747 INFO:tasks.workunit.client.1.smithi164.stdout:5/527: rename dc/d2b/c39 to dc/d2b/da0/cb1 0 2024-04-20T21:59:00.750 INFO:tasks.workunit.client.1.smithi164.stdout:4/424: dread d4/d28/f6b [0,4194304] 0 2024-04-20T21:59:00.751 INFO:tasks.workunit.client.1.smithi164.stdout:5/528: read dc/d12/f85 [160798,18491] 0 2024-04-20T21:59:00.752 INFO:tasks.workunit.client.1.smithi164.stdout:4/425: chown d4 928 1 2024-04-20T21:59:00.755 INFO:tasks.workunit.client.1.smithi164.stdout:7/445: creat d2/d21/d24/f9a x:0 0 0 2024-04-20T21:59:00.758 INFO:tasks.workunit.client.1.smithi164.stdout:7/446: fdatasync d2/d21/d24/f4c 0 2024-04-20T21:59:00.760 INFO:tasks.workunit.client.1.smithi164.stdout:0/443: dwrite d1/d2b/f65 [0,4194304] 0 2024-04-20T21:59:00.760 INFO:tasks.workunit.client.1.smithi164.stdout:7/447: fsync d2/d21/f25 0 2024-04-20T21:59:00.761 INFO:tasks.workunit.client.1.smithi164.stdout:6/512: dwrite d0/d3/d8/f38 [0,4194304] 0 2024-04-20T21:59:00.761 INFO:tasks.workunit.client.1.smithi164.stdout:5/529: dread dc/d2c/d2e/d30/f59 [0,4194304] 0 2024-04-20T21:59:00.761 INFO:tasks.workunit.client.1.smithi164.stdout:4/426: link d4/fb d4/d28/f89 0 2024-04-20T21:59:00.766 INFO:tasks.workunit.client.1.smithi164.stdout:6/513: write d0/d3/d15/d23/d45/fae [369197,67193] 0 2024-04-20T21:59:00.766 INFO:tasks.workunit.client.1.smithi164.stdout:0/444: mknod d1/d4/da/d27/c80 0 2024-04-20T21:59:00.768 INFO:tasks.workunit.client.1.smithi164.stdout:4/427: creat d4/d9/d27/d3f/d5f/f8a x:0 0 0 2024-04-20T21:59:00.769 INFO:tasks.workunit.client.1.smithi164.stdout:6/514: write d0/d3/f10 [1574469,115791] 0 2024-04-20T21:59:00.772 INFO:tasks.workunit.client.1.smithi164.stdout:5/530: rename dc/d2b/d52/f7c to dc/d2c/d2e/d30/d72/da9/fb2 0 2024-04-20T21:59:00.783 INFO:tasks.workunit.client.1.smithi164.stdout:7/448: rename d2/d21/d24/d31/d3a/d83/c74 to d2/d21/d24/c9b 0 2024-04-20T21:59:00.784 INFO:tasks.workunit.client.1.smithi164.stdout:8/397: truncate d0/d14/d16/d58/f60 3395618 0 2024-04-20T21:59:00.784 INFO:tasks.workunit.client.1.smithi164.stdout:0/445: dread d1/d4/d20/d74/f5e [0,4194304] 0 2024-04-20T21:59:00.784 INFO:tasks.workunit.client.1.smithi164.stdout:1/427: write d10/d33/f46 [871814,12360] 0 2024-04-20T21:59:00.786 INFO:tasks.workunit.client.1.smithi164.stdout:5/531: mknod dc/d2c/d2e/d30/d5e/cb3 0 2024-04-20T21:59:00.786 INFO:tasks.workunit.client.1.smithi164.stdout:8/398: write d0/d14/f2a [1995940,71645] 0 2024-04-20T21:59:00.794 INFO:tasks.workunit.client.1.smithi164.stdout:5/532: creat dc/d2c/d2e/d30/d72/fb4 x:0 0 0 2024-04-20T21:59:00.796 INFO:tasks.workunit.client.1.smithi164.stdout:8/399: dread d0/d14/f4f [0,4194304] 0 2024-04-20T21:59:00.796 INFO:tasks.workunit.client.1.smithi164.stdout:5/533: write dc/d2c/d2e/d30/d72/fb4 [821941,22760] 0 2024-04-20T21:59:00.799 INFO:tasks.workunit.client.1.smithi164.stdout:4/428: getdents d4/d28 0 2024-04-20T21:59:00.800 INFO:tasks.workunit.client.1.smithi164.stdout:4/429: chown d4/d28/d70 3 1 2024-04-20T21:59:00.801 INFO:tasks.workunit.client.1.smithi164.stdout:8/400: rmdir d0/d14 39 2024-04-20T21:59:00.805 INFO:tasks.workunit.client.1.smithi164.stdout:5/534: creat dc/d2c/d2e/d30/d72/da9/fb5 x:0 0 0 2024-04-20T21:59:00.811 INFO:tasks.workunit.client.1.smithi164.stdout:7/449: write d2/f1c [3310605,77898] 0 2024-04-20T21:59:00.811 INFO:tasks.workunit.client.1.smithi164.stdout:2/469: sync 2024-04-20T21:59:00.811 INFO:tasks.workunit.client.1.smithi164.stdout:9/528: sync 2024-04-20T21:59:00.812 INFO:tasks.workunit.client.1.smithi164.stdout:0/446: rename d1/d4/d20/d74/c60 to d1/d4/d26/d29/d2d/c81 0 2024-04-20T21:59:00.816 INFO:tasks.workunit.client.1.smithi164.stdout:0/447: fsync d1/d2b/f6b 0 2024-04-20T21:59:00.817 INFO:tasks.workunit.client.1.smithi164.stdout:9/529: write d3/f6 [1222340,80794] 0 2024-04-20T21:59:00.819 INFO:tasks.workunit.client.1.smithi164.stdout:1/428: rename d10/d16/d20/d25/f39 to d10/d16/d20/d26/d34/f89 0 2024-04-20T21:59:00.821 INFO:tasks.workunit.client.1.smithi164.stdout:6/515: dwrite d0/d3/d27/f43 [0,4194304] 0 2024-04-20T21:59:00.825 INFO:tasks.workunit.client.1.smithi164.stdout:7/450: creat d2/d21/d33/f9c x:0 0 0 2024-04-20T21:59:00.855 INFO:tasks.workunit.client.1.smithi164.stdout:8/401: rename d0/d1e/f39 to d0/d14/d16/d58/d73/f85 0 2024-04-20T21:59:00.855 INFO:tasks.workunit.client.1.smithi164.stdout:6/516: write d0/d3/d27/f43 [4303159,78750] 0 2024-04-20T21:59:00.857 INFO:tasks.workunit.client.1.smithi164.stdout:5/535: dwrite dc/d41/fad [0,4194304] 0 2024-04-20T21:59:00.863 INFO:tasks.workunit.client.1.smithi164.stdout:0/448: creat d1/d4/d26/d29/d2d/d54/d77/d3c/f82 x:0 0 0 2024-04-20T21:59:00.865 INFO:tasks.workunit.client.1.smithi164.stdout:7/451: symlink d2/d21/d24/d60/d82/d93/l9d 0 2024-04-20T21:59:00.866 INFO:tasks.workunit.client.1.smithi164.stdout:8/402: write d0/d14/d4e/d6f/f79 [758781,97384] 0 2024-04-20T21:59:00.866 INFO:tasks.workunit.client.1.smithi164.stdout:6/517: write d0/d3/d15/f24 [950378,128181] 0 2024-04-20T21:59:00.867 INFO:tasks.workunit.client.1.smithi164.stdout:5/536: symlink dc/d41/lb6 0 2024-04-20T21:59:00.867 INFO:tasks.workunit.client.1.smithi164.stdout:2/470: dwrite d2/d5/f82 [0,4194304] 0 2024-04-20T21:59:00.873 INFO:tasks.workunit.client.1.smithi164.stdout:6/518: chown d0/d3/d11/d29/d6e/d5d 14814735 1 2024-04-20T21:59:00.874 INFO:tasks.workunit.client.1.smithi164.stdout:2/471: write d2/d19/f77 [536901,39964] 0 2024-04-20T21:59:00.877 INFO:tasks.workunit.client.1.smithi164.stdout:9/530: dwrite d3/db/d1b/f8f [0,4194304] 0 2024-04-20T21:59:00.879 INFO:tasks.workunit.client.1.smithi164.stdout:4/430: dwrite d4/d9/d27/f7b [0,4194304] 0 2024-04-20T21:59:00.888 INFO:tasks.workunit.client.1.smithi164.stdout:6/519: symlink d0/d3/d11/lb0 0 2024-04-20T21:59:00.890 INFO:tasks.workunit.client.1.smithi164.stdout:9/531: dread - d3/db/d4f/d67/fa9 zero size 2024-04-20T21:59:00.891 INFO:tasks.workunit.client.1.smithi164.stdout:4/431: unlink d4/d28/f44 0 2024-04-20T21:59:00.891 INFO:tasks.workunit.client.1.smithi164.stdout:8/403: rename d0/d14/d16/d58/d73/d7c to d0/d14/d4e/d86 0 2024-04-20T21:59:00.892 INFO:tasks.workunit.client.1.smithi164.stdout:6/520: stat d0/d3/d15/d23/d3b/f3e 0 2024-04-20T21:59:00.894 INFO:tasks.workunit.client.1.smithi164.stdout:2/472: creat d2/f8f x:0 0 0 2024-04-20T21:59:00.895 INFO:tasks.workunit.client.1.smithi164.stdout:0/449: dwrite d1/d4/f7e [0,4194304] 0 2024-04-20T21:59:00.901 INFO:tasks.workunit.client.1.smithi164.stdout:3/503: sync 2024-04-20T21:59:00.907 INFO:tasks.workunit.client.1.smithi164.stdout:8/404: symlink d0/d1e/l87 0 2024-04-20T21:59:00.908 INFO:tasks.workunit.client.1.smithi164.stdout:6/521: truncate d0/d3/d8/fa 305046 0 2024-04-20T21:59:00.911 INFO:tasks.workunit.client.1.smithi164.stdout:9/532: dread d3/db/f1a [0,4194304] 0 2024-04-20T21:59:00.911 INFO:tasks.workunit.client.1.smithi164.stdout:5/537: truncate f8 3775746 0 2024-04-20T21:59:00.916 INFO:tasks.workunit.client.1.smithi164.stdout:5/538: write dc/d2c/d2e/f60 [3971530,11354] 0 2024-04-20T21:59:00.920 INFO:tasks.workunit.client.1.smithi164.stdout:9/533: dread - d3/db/d4f/d67/fa9 zero size 2024-04-20T21:59:00.921 INFO:tasks.workunit.client.1.smithi164.stdout:6/522: stat d0/c83 0 2024-04-20T21:59:00.924 INFO:tasks.workunit.client.1.smithi164.stdout:4/432: symlink d4/d28/l8b 0 2024-04-20T21:59:00.927 INFO:tasks.workunit.client.1.smithi164.stdout:7/452: dwrite d2/f26 [0,4194304] 0 2024-04-20T21:59:00.928 INFO:tasks.workunit.client.1.smithi164.stdout:6/523: stat d0/d3/d8/d81/f8b 0 2024-04-20T21:59:00.930 INFO:tasks.workunit.client.1.smithi164.stdout:0/450: dwrite d1/d4/d20/d74/f35 [0,4194304] 0 2024-04-20T21:59:00.933 INFO:tasks.workunit.client.1.smithi164.stdout:9/534: creat d3/db/d1b/d20/fb9 x:0 0 0 2024-04-20T21:59:00.933 INFO:tasks.workunit.client.1.smithi164.stdout:6/524: dread - d0/d3/d11/d5a/f89 zero size 2024-04-20T21:59:00.935 INFO:tasks.workunit.client.1.smithi164.stdout:7/453: mkdir d2/d21/d24/d60/d9e 0 2024-04-20T21:59:00.938 INFO:tasks.workunit.client.1.smithi164.stdout:0/451: rename d1/l1e to d1/d2b/l83 0 2024-04-20T21:59:00.940 INFO:tasks.workunit.client.1.smithi164.stdout:9/535: unlink d3/l58 0 2024-04-20T21:59:00.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:00 smithi142 ceph-mon[15828]: pgmap v7: 65 pgs: 65 active+clean; 2.8 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 33 MiB/s rd, 115 MiB/s wr, 264 op/s 2024-04-20T21:59:00.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:00 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:00.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:00 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:00.947 INFO:tasks.workunit.client.1.smithi164.stdout:6/525: unlink d0/d3/d11/d29/d6e/l7f 0 2024-04-20T21:59:00.947 INFO:tasks.workunit.client.1.smithi164.stdout:5/539: dread dc/d12/f18 [0,4194304] 0 2024-04-20T21:59:00.949 INFO:tasks.workunit.client.1.smithi164.stdout:0/452: mknod d1/d4/d26/d29/d2d/d54/d77/d3c/c84 0 2024-04-20T21:59:00.951 INFO:tasks.workunit.client.1.smithi164.stdout:0/453: fsync d1/f3e 0 2024-04-20T21:59:00.952 INFO:tasks.workunit.client.1.smithi164.stdout:6/526: write d0/d3/d15/d21/d4b/f4e [4790782,93161] 0 2024-04-20T21:59:00.954 INFO:tasks.workunit.client.1.smithi164.stdout:9/536: creat d3/db/d82/d98/fba x:0 0 0 2024-04-20T21:59:00.958 INFO:tasks.workunit.client.1.smithi164.stdout:8/405: write d0/d1e/f43 [767983,18308] 0 2024-04-20T21:59:00.960 INFO:tasks.workunit.client.1.smithi164.stdout:5/540: fsync f5 0 2024-04-20T21:59:00.962 INFO:tasks.workunit.client.1.smithi164.stdout:3/504: dread d12/d15/f24 [0,4194304] 0 2024-04-20T21:59:00.963 INFO:tasks.workunit.client.1.smithi164.stdout:4/433: dwrite d4/d9/d27/d3f/d67/d86/f84 [0,4194304] 0 2024-04-20T21:59:00.965 INFO:tasks.workunit.client.1.smithi164.stdout:3/505: read f11 [4611731,53349] 0 2024-04-20T21:59:00.965 INFO:tasks.workunit.client.1.smithi164.stdout:9/537: unlink d3/db/d1b/d1e/l57 0 2024-04-20T21:59:00.967 INFO:tasks.workunit.client.1.smithi164.stdout:6/527: truncate d0/f6 2648027 0 2024-04-20T21:59:00.969 INFO:tasks.workunit.client.1.smithi164.stdout:6/528: write d0/d3/d4a/f9f [561996,6843] 0 2024-04-20T21:59:00.970 INFO:tasks.workunit.client.1.smithi164.stdout:8/406: fdatasync d0/d14/fa 0 2024-04-20T21:59:00.972 INFO:tasks.workunit.client.1.smithi164.stdout:0/454: truncate d1/d4/df/f1a 1040195 0 2024-04-20T21:59:00.972 INFO:tasks.workunit.client.1.smithi164.stdout:8/407: chown d0/d14/l67 0 1 2024-04-20T21:59:00.973 INFO:tasks.workunit.client.1.smithi164.stdout:5/541: fsync dc/fd 0 2024-04-20T21:59:00.980 INFO:tasks.workunit.client.1.smithi164.stdout:4/434: truncate d4/d28/f6f 440866 0 2024-04-20T21:59:00.981 INFO:tasks.workunit.client.1.smithi164.stdout:3/506: mknod d12/d68/d6f/c9e 0 2024-04-20T21:59:00.983 INFO:tasks.workunit.client.1.smithi164.stdout:3/507: dread - d12/d6d/f85 zero size 2024-04-20T21:59:00.984 INFO:tasks.workunit.client.1.smithi164.stdout:0/455: dread d1/d4/d20/f79 [0,4194304] 0 2024-04-20T21:59:00.984 INFO:tasks.workunit.client.1.smithi164.stdout:6/529: mkdir d0/d3/d15/d21/db1 0 2024-04-20T21:59:00.986 INFO:tasks.workunit.client.1.smithi164.stdout:8/408: creat d0/d1e/f88 x:0 0 0 2024-04-20T21:59:00.987 INFO:tasks.workunit.client.1.smithi164.stdout:0/456: chown d1/d4/c4a 24 1 2024-04-20T21:59:00.990 INFO:tasks.workunit.client.1.smithi164.stdout:5/542: dwrite dc/d2c/d2e/d30/f55 [0,4194304] 0 2024-04-20T21:59:00.996 INFO:tasks.workunit.client.1.smithi164.stdout:6/530: rmdir d0/d3/d15/d23/d45/d4f 39 2024-04-20T21:59:01.004 INFO:tasks.workunit.client.1.smithi164.stdout:9/538: creat d3/db/d4f/fbb x:0 0 0 2024-04-20T21:59:01.007 INFO:tasks.workunit.client.1.smithi164.stdout:8/409: link d0/d14/d4e/f54 d0/d14/d16/d5a/f89 0 2024-04-20T21:59:01.007 INFO:tasks.workunit.client.1.smithi164.stdout:5/543: dwrite dc/d12/f8e [0,4194304] 0 2024-04-20T21:59:01.009 INFO:tasks.workunit.client.1.smithi164.stdout:5/544: chown dc/c14 7604794 1 2024-04-20T21:59:01.010 INFO:tasks.workunit.client.1.smithi164.stdout:6/531: rmdir d0/d3/d11/d29/d6e 39 2024-04-20T21:59:01.017 INFO:tasks.workunit.client.1.smithi164.stdout:4/435: dwrite f2 [0,4194304] 0 2024-04-20T21:59:01.018 INFO:tasks.workunit.client.1.smithi164.stdout:4/436: readlink d4/d9/l21 0 2024-04-20T21:59:01.022 INFO:tasks.workunit.client.1.smithi164.stdout:0/457: rename d1/d2b/c47 to d1/d4/df/d56/c85 0 2024-04-20T21:59:01.025 INFO:tasks.workunit.client.1.smithi164.stdout:0/458: write d1/d4/d26/f76 [231447,37975] 0 2024-04-20T21:59:01.027 INFO:tasks.workunit.client.1.smithi164.stdout:8/410: mknod d0/d1e/c8a 0 2024-04-20T21:59:01.028 INFO:tasks.workunit.client.1.smithi164.stdout:5/545: dwrite dc/d2c/d2e/d30/f77 [0,4194304] 0 2024-04-20T21:59:01.030 INFO:tasks.workunit.client.1.smithi164.stdout:0/459: readlink d1/d4/d26/d29/l7f 0 2024-04-20T21:59:01.030 INFO:tasks.workunit.client.1.smithi164.stdout:8/411: truncate d0/d14/d16/f7f 1009062 0 2024-04-20T21:59:01.033 INFO:tasks.workunit.client.1.smithi164.stdout:3/508: getdents d12/d20/d39 0 2024-04-20T21:59:01.034 INFO:tasks.workunit.client.1.smithi164.stdout:8/412: fdatasync d0/d14/d16/d5a/f71 0 2024-04-20T21:59:01.034 INFO:tasks.workunit.client.1.smithi164.stdout:5/546: mkdir dc/d2b/d6d/d73/db7 0 2024-04-20T21:59:01.034 INFO:tasks.workunit.client.1.smithi164.stdout:9/539: creat d3/d9f/da1/fbc x:0 0 0 2024-04-20T21:59:01.036 INFO:tasks.workunit.client.1.smithi164.stdout:6/532: mkdir d0/d3/d11/d29/d6e/db2 0 2024-04-20T21:59:01.036 INFO:tasks.workunit.client.1.smithi164.stdout:8/413: dread - d0/d14/d16/f70 zero size 2024-04-20T21:59:01.037 INFO:tasks.workunit.client.1.smithi164.stdout:0/460: mknod d1/d4/d26/d29/d2d/d54/d77/d3c/c86 0 2024-04-20T21:59:01.039 INFO:tasks.workunit.client.1.smithi164.stdout:1/429: sync 2024-04-20T21:59:01.039 INFO:tasks.workunit.client.1.smithi164.stdout:2/473: sync 2024-04-20T21:59:01.041 INFO:tasks.workunit.client.1.smithi164.stdout:1/430: chown d10/d16/d20/d81 61 1 2024-04-20T21:59:01.043 INFO:tasks.workunit.client.1.smithi164.stdout:6/533: chown d0/d3/d15/d21/d4b/l6b 44615704 1 2024-04-20T21:59:01.045 INFO:tasks.workunit.client.1.smithi164.stdout:8/414: write d0/f11 [327758,17195] 0 2024-04-20T21:59:01.046 INFO:tasks.workunit.client.1.smithi164.stdout:5/547: rename dc/d2b/l84 to dc/d2b/d6d/d73/lb8 0 2024-04-20T21:59:01.048 INFO:tasks.workunit.client.1.smithi164.stdout:0/461: mknod d1/d4/d20/c87 0 2024-04-20T21:59:01.050 INFO:tasks.workunit.client.1.smithi164.stdout:2/474: creat d2/d19/d28/d3e/d53/f90 x:0 0 0 2024-04-20T21:59:01.050 INFO:tasks.workunit.client.1.smithi164.stdout:8/415: dread - d0/f75 zero size 2024-04-20T21:59:01.052 INFO:tasks.workunit.client.1.smithi164.stdout:6/534: write d0/d3/d11/d5a/f89 [783388,299] 0 2024-04-20T21:59:01.056 INFO:tasks.workunit.client.1.smithi164.stdout:4/437: dwrite d4/d9/f17 [0,4194304] 0 2024-04-20T21:59:01.056 INFO:tasks.workunit.client.1.smithi164.stdout:9/540: rename d3/db/d4f to d3/db/d1b/d20/d3f/d8a/da7/dbd 0 2024-04-20T21:59:01.061 INFO:tasks.workunit.client.1.smithi164.stdout:1/431: mkdir d10/d8a 0 2024-04-20T21:59:01.065 INFO:tasks.workunit.client.1.smithi164.stdout:9/541: dread - d3/db/d82/fb2 zero size 2024-04-20T21:59:01.066 INFO:tasks.workunit.client.1.smithi164.stdout:1/432: truncate d10/d16/d19/f4e 1384802 0 2024-04-20T21:59:01.071 INFO:tasks.workunit.client.1.smithi164.stdout:9/542: chown d3/db/dd/d40/d2a/f77 9 1 2024-04-20T21:59:01.073 INFO:tasks.workunit.client.1.smithi164.stdout:0/462: mknod d1/d4/da/d27/c88 0 2024-04-20T21:59:01.075 INFO:tasks.workunit.client.1.smithi164.stdout:1/433: rmdir d10/d16 39 2024-04-20T21:59:01.080 INFO:tasks.workunit.client.1.smithi164.stdout:9/543: fdatasync d3/db/f38 0 2024-04-20T21:59:01.086 INFO:tasks.workunit.client.1.smithi164.stdout:1/434: mkdir d10/d33/d48/d8b 0 2024-04-20T21:59:01.086 INFO:tasks.workunit.client.1.smithi164.stdout:4/438: dwrite d4/d9/fc [0,4194304] 0 2024-04-20T21:59:01.089 INFO:tasks.workunit.client.1.smithi164.stdout:9/544: fdatasync d3/db/d82/fb2 0 2024-04-20T21:59:01.089 INFO:tasks.workunit.client.1.smithi164.stdout:8/416: dread d0/d14/d16/d5a/f6c [0,4194304] 0 2024-04-20T21:59:01.096 INFO:tasks.workunit.client.1.smithi164.stdout:2/475: dwrite d2/d30/f4b [4194304,4194304] 0 2024-04-20T21:59:01.101 INFO:tasks.workunit.client.1.smithi164.stdout:6/535: dwrite d0/d3/d15/d21/f91 [0,4194304] 0 2024-04-20T21:59:01.102 INFO:tasks.workunit.client.1.smithi164.stdout:2/476: write d2/d19/d28/d3e/d53/d62/f88 [166425,55538] 0 2024-04-20T21:59:01.105 INFO:tasks.workunit.client.1.smithi164.stdout:2/477: chown d2/d5/f11 15449 1 2024-04-20T21:59:01.105 INFO:tasks.workunit.client.1.smithi164.stdout:1/435: mkdir d10/d33/d7f/d8c 0 2024-04-20T21:59:01.108 INFO:tasks.workunit.client.1.smithi164.stdout:9/545: creat d3/db/dd/d40/d78/d86/fbe x:0 0 0 2024-04-20T21:59:01.109 INFO:tasks.workunit.client.1.smithi164.stdout:2/478: write d2/d5/d3a/f3b [51260,123982] 0 2024-04-20T21:59:01.111 INFO:tasks.workunit.client.1.smithi164.stdout:4/439: read d4/d28/f89 [2407484,67895] 0 2024-04-20T21:59:01.112 INFO:tasks.workunit.client.1.smithi164.stdout:1/436: write d10/f5e [807160,73567] 0 2024-04-20T21:59:01.112 INFO:tasks.workunit.client.1.smithi164.stdout:0/463: creat d1/d4/d26/d29/d2d/f89 x:0 0 0 2024-04-20T21:59:01.120 INFO:tasks.workunit.client.1.smithi164.stdout:5/548: dread dc/d2c/d2e/d30/f89 [0,4194304] 0 2024-04-20T21:59:01.124 INFO:tasks.workunit.client.1.smithi164.stdout:8/417: mknod d0/d14/d4e/c8b 0 2024-04-20T21:59:01.130 INFO:tasks.workunit.client.1.smithi164.stdout:7/454: sync 2024-04-20T21:59:01.130 INFO:tasks.workunit.client.1.smithi164.stdout:2/479: rmdir d2/d5f 39 2024-04-20T21:59:01.138 INFO:tasks.workunit.client.1.smithi164.stdout:8/418: read d0/f3a [1018065,6585] 0 2024-04-20T21:59:01.140 INFO:tasks.workunit.client.1.smithi164.stdout:2/480: write d2/f8f [337649,123682] 0 2024-04-20T21:59:01.141 INFO:tasks.workunit.client.1.smithi164.stdout:0/464: dwrite d1/d4/da/f64 [0,4194304] 0 2024-04-20T21:59:01.141 INFO:tasks.workunit.client.1.smithi164.stdout:9/546: mkdir d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/dbf 0 2024-04-20T21:59:01.142 INFO:tasks.workunit.client.1.smithi164.stdout:4/440: write d4/d28/f58 [314184,18121] 0 2024-04-20T21:59:01.145 INFO:tasks.workunit.client.1.smithi164.stdout:2/481: stat d2/d5/l64 0 2024-04-20T21:59:01.145 INFO:tasks.workunit.client.1.smithi164.stdout:8/419: chown d0/d14/d4e/d62 258700497 1 2024-04-20T21:59:01.146 INFO:tasks.workunit.client.1.smithi164.stdout:4/441: chown d4/d9/d27/f7d 103522034 1 2024-04-20T21:59:01.148 INFO:tasks.workunit.client.1.smithi164.stdout:2/482: dread - d2/d5/d3a/f5a zero size 2024-04-20T21:59:01.153 INFO:tasks.workunit.client.1.smithi164.stdout:5/549: dwrite dc/d2b/d52/d64/f7f [0,4194304] 0 2024-04-20T21:59:01.157 INFO:tasks.workunit.client.1.smithi164.stdout:5/550: dread dc/d2c/d2e/d30/f59 [0,4194304] 0 2024-04-20T21:59:01.158 INFO:tasks.workunit.client.1.smithi164.stdout:7/455: rename d2/f26 to d2/d21/d24/d60/f9f 0 2024-04-20T21:59:01.161 INFO:tasks.workunit.client.1.smithi164.stdout:8/420: creat d0/d14/d4e/d86/f8c x:0 0 0 2024-04-20T21:59:01.167 INFO:tasks.workunit.client.1.smithi164.stdout:8/421: read d0/d14/d16/f7f [785436,9501] 0 2024-04-20T21:59:01.168 INFO:tasks.workunit.client.1.smithi164.stdout:6/536: getdents d0/d3/d15/d23/d45/d69 0 2024-04-20T21:59:01.172 INFO:tasks.workunit.client.1.smithi164.stdout:9/547: mkdir d3/db0/dc0 0 2024-04-20T21:59:01.187 INFO:tasks.workunit.client.1.smithi164.stdout:1/437: mknod d10/d16/c8d 0 2024-04-20T21:59:01.188 INFO:tasks.workunit.client.1.smithi164.stdout:0/465: fsync d1/d4/df/f1a 0 2024-04-20T21:59:01.192 INFO:tasks.workunit.client.1.smithi164.stdout:4/442: rename d4/d28/d70 to d4/d9/d27/d3f/d8c 0 2024-04-20T21:59:01.195 INFO:tasks.workunit.client.1.smithi164.stdout:9/548: unlink d3/db/l63 0 2024-04-20T21:59:01.198 INFO:tasks.workunit.client.1.smithi164.stdout:8/422: dread d0/d14/f51 [0,4194304] 0 2024-04-20T21:59:01.199 INFO:tasks.workunit.client.1.smithi164.stdout:9/549: read - d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/fab zero size 2024-04-20T21:59:01.200 INFO:tasks.workunit.client.1.smithi164.stdout:7/456: symlink d2/d21/la0 0 2024-04-20T21:59:01.202 INFO:tasks.workunit.client.1.smithi164.stdout:7/457: fdatasync d2/d21/d24/f71 0 2024-04-20T21:59:01.204 INFO:tasks.workunit.client.1.smithi164.stdout:7/458: dread - d2/d21/d24/f4c zero size 2024-04-20T21:59:01.204 INFO:tasks.workunit.client.1.smithi164.stdout:5/551: dwrite dc/d2c/d2e/d30/d72/da9/fb2 [4194304,4194304] 0 2024-04-20T21:59:01.208 INFO:tasks.workunit.client.1.smithi164.stdout:2/483: dread d2/d5/d21/f2d [0,4194304] 0 2024-04-20T21:59:01.216 INFO:tasks.workunit.client.1.smithi164.stdout:1/438: rmdir d10/d16/d20/d66 39 2024-04-20T21:59:01.219 INFO:tasks.workunit.client.1.smithi164.stdout:8/423: rmdir d0/d14/d4e/d86 39 2024-04-20T21:59:01.221 INFO:tasks.workunit.client.1.smithi164.stdout:9/550: creat d3/d9f/fc1 x:0 0 0 2024-04-20T21:59:01.221 INFO:tasks.workunit.client.1.smithi164.stdout:9/551: readlink d3/l1c 0 2024-04-20T21:59:01.230 INFO:tasks.workunit.client.1.smithi164.stdout:7/459: rmdir d2/d21/d24/d31/d3a/d83/d63/d85 39 2024-04-20T21:59:01.232 INFO:tasks.workunit.client.1.smithi164.stdout:2/484: mknod d2/d5/d3a/d55/d58/c91 0 2024-04-20T21:59:01.242 INFO:tasks.workunit.client.1.smithi164.stdout:9/552: unlink d3/f91 0 2024-04-20T21:59:01.260 INFO:tasks.workunit.client.1.smithi164.stdout:3/509: sync 2024-04-20T21:59:01.261 INFO:tasks.workunit.client.1.smithi164.stdout:5/552: symlink dc/d2b/d6d/d73/dab/lb9 0 2024-04-20T21:59:01.261 INFO:tasks.workunit.client.1.smithi164.stdout:7/460: rename d2/d21/d24/d31/d3a/d83/d6a/l7c to d2/d21/d24/d60/d82/d93/la1 0 2024-04-20T21:59:01.262 INFO:tasks.workunit.client.1.smithi164.stdout:2/485: symlink d2/d19/d28/d3e/d53/d62/l92 0 2024-04-20T21:59:01.263 INFO:tasks.workunit.client.1.smithi164.stdout:8/424: creat d0/d14/d4e/d86/f8d x:0 0 0 2024-04-20T21:59:01.264 INFO:tasks.workunit.client.1.smithi164.stdout:0/466: truncate d1/d2b/f66 1511460 0 2024-04-20T21:59:01.267 INFO:tasks.workunit.client.1.smithi164.stdout:2/486: read - d2/d19/d28/d3e/d53/d62/f8c zero size 2024-04-20T21:59:01.269 INFO:tasks.workunit.client.1.smithi164.stdout:2/487: write d2/d5/d3a/f5a [654977,63296] 0 2024-04-20T21:59:01.272 INFO:tasks.workunit.client.1.smithi164.stdout:4/443: getdents d4/d28/d3e/d4a 0 2024-04-20T21:59:01.276 INFO:tasks.workunit.client.1.smithi164.stdout:7/461: dread d2/d21/d24/d31/f84 [0,4194304] 0 2024-04-20T21:59:01.277 INFO:tasks.workunit.client.1.smithi164.stdout:9/553: truncate d3/db/d1b/f8f 2471458 0 2024-04-20T21:59:01.278 INFO:tasks.workunit.client.1.smithi164.stdout:0/467: fdatasync d1/d4/d20/f79 0 2024-04-20T21:59:01.280 INFO:tasks.workunit.client.1.smithi164.stdout:0/468: write d1/d2b/f6b [879672,120916] 0 2024-04-20T21:59:01.280 INFO:tasks.workunit.client.1.smithi164.stdout:3/510: creat d12/d20/d39/d69/d9a/f9f x:0 0 0 2024-04-20T21:59:01.282 INFO:tasks.workunit.client.1.smithi164.stdout:4/444: readlink d4/d9/d27/d3f/d8c/l75 0 2024-04-20T21:59:01.282 INFO:tasks.workunit.client.1.smithi164.stdout:0/469: chown d1/d4/df/d56 158889 1 2024-04-20T21:59:01.283 INFO:tasks.workunit.client.1.smithi164.stdout:3/511: dread - d12/f60 zero size 2024-04-20T21:59:01.286 INFO:tasks.workunit.client.1.smithi164.stdout:5/553: link dc/d2b/d53/f96 dc/d2b/d6d/d73/fba 0 2024-04-20T21:59:01.287 INFO:tasks.workunit.client.1.smithi164.stdout:7/462: creat d2/d21/d24/d31/d3a/fa2 x:0 0 0 2024-04-20T21:59:01.288 INFO:tasks.workunit.client.1.smithi164.stdout:9/554: rmdir d3/db/dd 39 2024-04-20T21:59:01.290 INFO:tasks.workunit.client.1.smithi164.stdout:2/488: dwrite d2/d5/d21/f57 [0,4194304] 0 2024-04-20T21:59:01.291 INFO:tasks.workunit.client.1.smithi164.stdout:9/555: write d3/db/d1b/f46 [1718447,76640] 0 2024-04-20T21:59:01.295 INFO:tasks.workunit.client.1.smithi164.stdout:5/554: rmdir dc/d2b/da0 39 2024-04-20T21:59:01.297 INFO:tasks.workunit.client.1.smithi164.stdout:7/463: unlink d2/d21/d24/d60/f66 0 2024-04-20T21:59:01.299 INFO:tasks.workunit.client.1.smithi164.stdout:7/464: write d2/f16 [570804,113999] 0 2024-04-20T21:59:01.301 INFO:tasks.workunit.client.1.smithi164.stdout:0/470: dwrite d1/d4/d26/d29/d2d/d54/d77/f5d [0,4194304] 0 2024-04-20T21:59:01.303 INFO:tasks.workunit.client.1.smithi164.stdout:8/425: rename d0/d14/d16/d58/d73/f7e to d0/f8e 0 2024-04-20T21:59:01.307 INFO:tasks.workunit.client.1.smithi164.stdout:0/471: write d1/d4/d26/f76 [943668,44520] 0 2024-04-20T21:59:01.310 INFO:tasks.workunit.client.1.smithi164.stdout:2/489: unlink d2/d5/d3a/d55/f71 0 2024-04-20T21:59:01.314 INFO:tasks.workunit.client.1.smithi164.stdout:2/490: write d2/d5/d21/f2d [3148362,68066] 0 2024-04-20T21:59:01.317 INFO:tasks.workunit.client.1.smithi164.stdout:2/491: chown d2/d5/d3a/d65/d81/l8b 5 1 2024-04-20T21:59:01.319 INFO:tasks.workunit.client.1.smithi164.stdout:9/556: symlink d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/lc2 0 2024-04-20T21:59:01.319 INFO:tasks.workunit.client.1.smithi164.stdout:5/555: mkdir dc/d2c/d2e/d30/d72/da9/dbb 0 2024-04-20T21:59:01.319 INFO:tasks.workunit.client.1.smithi164.stdout:2/492: write d2/d5/d3a/d65/f7f [198039,40174] 0 2024-04-20T21:59:01.321 INFO:tasks.workunit.client.1.smithi164.stdout:2/493: stat d2/d30/f7a 0 2024-04-20T21:59:01.321 INFO:tasks.workunit.client.1.smithi164.stdout:7/465: fsync d2/d21/d24/d31/d3a/d83/d63/d85/f94 0 2024-04-20T21:59:01.322 INFO:tasks.workunit.client.1.smithi164.stdout:7/466: chown d2/d21/f25 31044 1 2024-04-20T21:59:01.324 INFO:tasks.workunit.client.1.smithi164.stdout:8/426: mkdir d0/d14/d4e/d62/d8f 0 2024-04-20T21:59:01.330 INFO:tasks.workunit.client.1.smithi164.stdout:3/512: truncate d12/f73 2208203 0 2024-04-20T21:59:01.338 INFO:tasks.workunit.client.1.smithi164.stdout:5/556: fdatasync dc/d2c/d2e/f46 0 2024-04-20T21:59:01.341 INFO:tasks.workunit.client.1.smithi164.stdout:0/472: dwrite d1/d4/d20/d74/f3f [0,4194304] 0 2024-04-20T21:59:01.345 INFO:tasks.workunit.client.1.smithi164.stdout:7/467: write d2/d21/d24/d31/d3a/d83/f96 [5309551,92049] 0 2024-04-20T21:59:01.347 INFO:tasks.workunit.client.1.smithi164.stdout:5/557: rmdir dc/d2c/d2e/d30/d5e 39 2024-04-20T21:59:01.352 INFO:tasks.workunit.client.1.smithi164.stdout:3/513: rename cc to d12/d20/d39/d55/d6b/d79/ca0 0 2024-04-20T21:59:01.359 INFO:tasks.workunit.client.1.smithi164.stdout:0/473: dwrite d1/d2b/f6b [0,4194304] 0 2024-04-20T21:59:01.369 INFO:tasks.workunit.client.1.smithi164.stdout:2/494: getdents d2 0 2024-04-20T21:59:01.371 INFO:tasks.workunit.client.1.smithi164.stdout:8/427: getdents d0/d14 0 2024-04-20T21:59:01.373 INFO:tasks.workunit.client.1.smithi164.stdout:5/558: symlink dc/d2c/d2e/lbc 0 2024-04-20T21:59:01.376 INFO:tasks.workunit.client.1.smithi164.stdout:2/495: creat d2/d30/d84/f93 x:0 0 0 2024-04-20T21:59:01.378 INFO:tasks.workunit.client.1.smithi164.stdout:8/428: mknod d0/d14/d16/d5a/c90 0 2024-04-20T21:59:01.378 INFO:tasks.workunit.client.1.smithi164.stdout:2/496: write d2/d5/d3a/d55/f56 [681922,93331] 0 2024-04-20T21:59:01.380 INFO:tasks.workunit.client.1.smithi164.stdout:2/497: dread - d2/d30/f7a zero size 2024-04-20T21:59:01.381 INFO:tasks.workunit.client.1.smithi164.stdout:0/474: creat d1/d4/d26/d29/d2d/f8a x:0 0 0 2024-04-20T21:59:01.382 INFO:tasks.workunit.client.1.smithi164.stdout:6/537: sync 2024-04-20T21:59:01.382 INFO:tasks.workunit.client.1.smithi164.stdout:7/468: rename d2/d21/d24/c9b to d2/ca3 0 2024-04-20T21:59:01.385 INFO:tasks.workunit.client.1.smithi164.stdout:7/469: chown d2/d21/d24/d31/d3a/d83/d6a/c6c 468 1 2024-04-20T21:59:01.386 INFO:tasks.workunit.client.1.smithi164.stdout:5/559: mkdir dc/d2c/d2e/dbd 0 2024-04-20T21:59:01.388 INFO:tasks.workunit.client.1.smithi164.stdout:8/429: creat d0/d14/d4e/d62/f91 x:0 0 0 2024-04-20T21:59:01.389 INFO:tasks.workunit.client.1.smithi164.stdout:3/514: dread d12/d2a/f42 [0,4194304] 0 2024-04-20T21:59:01.392 INFO:tasks.workunit.client.1.smithi164.stdout:6/538: creat d0/d3/d62/d75/fb3 x:0 0 0 2024-04-20T21:59:01.392 INFO:tasks.workunit.client.1.smithi164.stdout:5/560: creat dc/d2c/d2e/d30/d72/fbe x:0 0 0 2024-04-20T21:59:01.395 INFO:tasks.workunit.client.1.smithi164.stdout:8/430: mkdir d0/d14/d16/d58/d73/d92 0 2024-04-20T21:59:01.396 INFO:tasks.workunit.client.1.smithi164.stdout:2/498: symlink d2/d5/d3a/l94 0 2024-04-20T21:59:01.398 INFO:tasks.workunit.client.1.smithi164.stdout:3/515: creat d12/d15/fa1 x:0 0 0 2024-04-20T21:59:01.399 INFO:tasks.workunit.client.1.smithi164.stdout:3/516: write d12/d2a/f53 [584137,32780] 0 2024-04-20T21:59:01.400 INFO:tasks.workunit.client.1.smithi164.stdout:6/539: mkdir d0/d3/d11/d29/d6e/d5d/db4 0 2024-04-20T21:59:01.401 INFO:tasks.workunit.client.1.smithi164.stdout:3/517: stat d12/d20/d39/d55/d6b/c75 0 2024-04-20T21:59:01.403 INFO:tasks.workunit.client.1.smithi164.stdout:3/518: write d12/d68/d6f/f89 [933606,115523] 0 2024-04-20T21:59:01.404 INFO:tasks.workunit.client.1.smithi164.stdout:0/475: rename d1/d4/d20/l7d to d1/d4/da/l8b 0 2024-04-20T21:59:01.405 INFO:tasks.workunit.client.1.smithi164.stdout:3/519: chown d12/d20/d39 19061177 1 2024-04-20T21:59:01.407 INFO:tasks.workunit.client.1.smithi164.stdout:2/499: write d2/d5/d3a/f43 [6734556,1466] 0 2024-04-20T21:59:01.407 INFO:tasks.workunit.client.1.smithi164.stdout:5/561: symlink dc/d12/d1e/da8/lbf 0 2024-04-20T21:59:01.407 INFO:tasks.workunit.client.1.smithi164.stdout:0/476: readlink d1/d4/d26/d29/d2d/d54/d77/l51 0 2024-04-20T21:59:01.409 INFO:tasks.workunit.client.1.smithi164.stdout:5/562: write dc/d2c/d2e/f60 [7324636,8051] 0 2024-04-20T21:59:01.410 INFO:tasks.workunit.client.1.smithi164.stdout:7/470: rename d2/d21/d24/d31/d3a/d83/f58 to d2/d21/d24/d60/d9e/fa4 0 2024-04-20T21:59:01.416 INFO:tasks.workunit.client.1.smithi164.stdout:0/477: creat d1/d4/df/d56/f8c x:0 0 0 2024-04-20T21:59:01.420 INFO:tasks.workunit.client.1.smithi164.stdout:5/563: mknod dc/d2b/d53/cc0 0 2024-04-20T21:59:01.421 INFO:tasks.workunit.client.1.smithi164.stdout:7/471: dread d2/d21/d24/d31/f84 [0,4194304] 0 2024-04-20T21:59:01.422 INFO:tasks.workunit.client.1.smithi164.stdout:2/500: mknod d2/d19/d28/d3e/c95 0 2024-04-20T21:59:01.426 INFO:tasks.workunit.client.1.smithi164.stdout:6/540: rename d0/f6 to d0/d3/d8/d28/d6f/fb5 0 2024-04-20T21:59:01.427 INFO:tasks.workunit.client.1.smithi164.stdout:8/431: getdents d0/d14/d4e/d62 0 2024-04-20T21:59:01.429 INFO:tasks.workunit.client.1.smithi164.stdout:3/520: write d12/d20/d39/d55/d6b/f80 [898672,35729] 0 2024-04-20T21:59:01.430 INFO:tasks.workunit.client.1.smithi164.stdout:0/478: rmdir d1/d4/da/d5c/d6e 39 2024-04-20T21:59:01.431 INFO:tasks.workunit.client.1.smithi164.stdout:3/521: chown d12/d2a/c50 0 1 2024-04-20T21:59:01.433 INFO:tasks.workunit.client.1.smithi164.stdout:7/472: creat d2/d21/d33/fa5 x:0 0 0 2024-04-20T21:59:01.434 INFO:tasks.workunit.client.1.smithi164.stdout:2/501: dread d2/d5/d21/f57 [0,4194304] 0 2024-04-20T21:59:01.435 INFO:tasks.workunit.client.1.smithi164.stdout:7/473: chown d2/d21/d24/l90 87822 1 2024-04-20T21:59:01.435 INFO:tasks.workunit.client.1.smithi164.stdout:3/522: write d12/d20/d39/d55/f93 [232066,114134] 0 2024-04-20T21:59:01.436 INFO:tasks.workunit.client.1.smithi164.stdout:2/502: read - d2/d30/d84/f93 zero size 2024-04-20T21:59:01.437 INFO:tasks.workunit.client.1.smithi164.stdout:8/432: creat d0/d14/d16/d5a/f93 x:0 0 0 2024-04-20T21:59:01.443 INFO:tasks.workunit.client.1.smithi164.stdout:6/541: creat d0/d3/d11/d29/d6e/d5d/d97/fb6 x:0 0 0 2024-04-20T21:59:01.446 INFO:tasks.workunit.client.1.smithi164.stdout:6/542: write d0/d3/d15/d23/d3b/faa [16120,128045] 0 2024-04-20T21:59:01.446 INFO:tasks.workunit.client.1.smithi164.stdout:3/523: rmdir d12/d2a 39 2024-04-20T21:59:01.448 INFO:tasks.workunit.client.1.smithi164.stdout:7/474: mkdir d2/d21/d24/d60/d9e/da6 0 2024-04-20T21:59:01.451 INFO:tasks.workunit.client.1.smithi164.stdout:2/503: truncate d2/d5/d21/f2b 1897741 0 2024-04-20T21:59:01.452 INFO:tasks.workunit.client.1.smithi164.stdout:1/439: sync 2024-04-20T21:59:01.452 INFO:tasks.workunit.client.1.smithi164.stdout:2/504: readlink d2/d5/l7b 0 2024-04-20T21:59:01.454 INFO:tasks.workunit.client.1.smithi164.stdout:0/479: rename d1/d4/da/l8b to d1/d4/d26/d29/d2d/d54/d77/l8d 0 2024-04-20T21:59:01.457 INFO:tasks.workunit.client.1.smithi164.stdout:0/480: write d1/d4/d20/d74/f3f [3758098,65984] 0 2024-04-20T21:59:01.459 INFO:tasks.workunit.client.1.smithi164.stdout:6/543: creat d0/d3/d11/d29/d6e/d41/fb7 x:0 0 0 2024-04-20T21:59:01.459 INFO:tasks.workunit.client.1.smithi164.stdout:5/564: getdents dc/d2c/d2e/d30/d72/da9 0 2024-04-20T21:59:01.462 INFO:tasks.workunit.client.1.smithi164.stdout:3/524: mkdir d12/d20/da2 0 2024-04-20T21:59:01.464 INFO:tasks.workunit.client.1.smithi164.stdout:8/433: rmdir d0/d14/d16/d58/d73/d92 0 2024-04-20T21:59:01.465 INFO:tasks.workunit.client.1.smithi164.stdout:0/481: symlink d1/d4/da/d5c/d6e/l8e 0 2024-04-20T21:59:01.466 INFO:tasks.workunit.client.1.smithi164.stdout:5/565: rmdir dc/d2c/d2e/d30/d8c 39 2024-04-20T21:59:01.468 INFO:tasks.workunit.client.1.smithi164.stdout:0/482: readlink d1/d4/d26/d29/d2d/d54/d77/l30 0 2024-04-20T21:59:01.468 INFO:tasks.workunit.client.1.smithi164.stdout:7/475: dread d2/f1c [0,4194304] 0 2024-04-20T21:59:01.468 INFO:tasks.workunit.client.1.smithi164.stdout:1/440: mknod d10/c8e 0 2024-04-20T21:59:01.468 INFO:tasks.workunit.client.1.smithi164.stdout:3/525: mknod d12/d20/d39/d69/ca3 0 2024-04-20T21:59:01.470 INFO:tasks.workunit.client.1.smithi164.stdout:0/483: truncate d1/f1b 2240356 0 2024-04-20T21:59:01.470 INFO:tasks.workunit.client.1.smithi164.stdout:8/434: unlink d0/d14/f6 0 2024-04-20T21:59:01.470 INFO:tasks.workunit.client.1.smithi164.stdout:6/544: symlink d0/d3/d11/lb8 0 2024-04-20T21:59:01.471 INFO:tasks.workunit.client.1.smithi164.stdout:2/505: creat d2/d5/d3a/f96 x:0 0 0 2024-04-20T21:59:01.473 INFO:tasks.workunit.client.1.smithi164.stdout:7/476: chown f1 1839006 1 2024-04-20T21:59:01.474 INFO:tasks.workunit.client.1.smithi164.stdout:1/441: unlink d10/f14 0 2024-04-20T21:59:01.479 INFO:tasks.workunit.client.1.smithi164.stdout:2/506: creat d2/d5/d3a/d65/d81/f97 x:0 0 0 2024-04-20T21:59:01.482 INFO:tasks.workunit.client.1.smithi164.stdout:2/507: fdatasync d2/d19/d28/f38 0 2024-04-20T21:59:01.485 INFO:tasks.workunit.client.1.smithi164.stdout:6/545: creat d0/d3/d15/d23/d45/d4f/d9c/fb9 x:0 0 0 2024-04-20T21:59:01.486 INFO:tasks.workunit.client.1.smithi164.stdout:3/526: dwrite d12/f5a [0,4194304] 0 2024-04-20T21:59:01.490 INFO:tasks.workunit.client.1.smithi164.stdout:0/484: dwrite d1/d4/f7e [4194304,4194304] 0 2024-04-20T21:59:01.491 INFO:tasks.workunit.client.1.smithi164.stdout:7/477: symlink d2/d21/d24/d31/d3a/d83/d63/la7 0 2024-04-20T21:59:01.494 INFO:tasks.workunit.client.1.smithi164.stdout:3/527: fdatasync d12/d20/d39/d55/d6b/f80 0 2024-04-20T21:59:01.494 INFO:tasks.workunit.client.1.smithi164.stdout:9/557: sync 2024-04-20T21:59:01.494 INFO:tasks.workunit.client.1.smithi164.stdout:4/445: sync 2024-04-20T21:59:01.494 INFO:tasks.workunit.client.1.smithi164.stdout:0/485: stat d1/d4/d20/d74/f63 0 2024-04-20T21:59:01.499 INFO:tasks.workunit.client.1.smithi164.stdout:7/478: readlink d2/d21/d24/l90 0 2024-04-20T21:59:01.500 INFO:tasks.workunit.client.1.smithi164.stdout:0/486: dread - d1/d4/d20/d74/f63 zero size 2024-04-20T21:59:01.500 INFO:tasks.workunit.client.1.smithi164.stdout:5/566: dread dc/d12/d1e/f35 [4194304,4194304] 0 2024-04-20T21:59:01.505 INFO:tasks.workunit.client.1.smithi164.stdout:0/487: read - d1/d4/da/d27/f70 zero size 2024-04-20T21:59:01.505 INFO:tasks.workunit.client.1.smithi164.stdout:3/528: truncate d12/d68/d6f/d71/f9d 230932 0 2024-04-20T21:59:01.508 INFO:tasks.workunit.client.1.smithi164.stdout:5/567: creat dc/d12/d1e/fc1 x:0 0 0 2024-04-20T21:59:01.509 INFO:tasks.workunit.client.1.smithi164.stdout:4/446: creat d4/d9/d5c/f8d x:0 0 0 2024-04-20T21:59:01.512 INFO:tasks.workunit.client.1.smithi164.stdout:2/508: dwrite d2/d5/f11 [0,4194304] 0 2024-04-20T21:59:01.515 INFO:tasks.workunit.client.1.smithi164.stdout:9/558: chown d3/db/dd/d40/d2a/d36/d51/f70 1468582 1 2024-04-20T21:59:01.516 INFO:tasks.workunit.client.1.smithi164.stdout:7/479: link d2/l1a d2/d21/d24/d60/la8 0 2024-04-20T21:59:01.517 INFO:tasks.workunit.client.1.smithi164.stdout:3/529: rename d12/d20 to d12/d20/d39/d55/da4 22 2024-04-20T21:59:01.526 INFO:tasks.workunit.client.1.smithi164.stdout:5/568: creat dc/d2b/fc2 x:0 0 0 2024-04-20T21:59:01.526 INFO:tasks.workunit.client.1.smithi164.stdout:1/442: dwrite d10/d33/f3f [0,4194304] 0 2024-04-20T21:59:01.530 INFO:tasks.workunit.client.1.smithi164.stdout:0/488: rename d1/d4/da/f61 to d1/d2b/f8f 0 2024-04-20T21:59:01.535 INFO:tasks.workunit.client.1.smithi164.stdout:8/435: write d0/d14/fa [5557347,9121] 0 2024-04-20T21:59:01.535 INFO:tasks.workunit.client.1.smithi164.stdout:9/559: symlink d3/db0/dc0/lc3 0 2024-04-20T21:59:01.537 INFO:tasks.workunit.client.1.smithi164.stdout:8/436: chown d0/f75 296783 1 2024-04-20T21:59:01.539 INFO:tasks.workunit.client.1.smithi164.stdout:7/480: chown d2/l1a 51 1 2024-04-20T21:59:01.539 INFO:tasks.workunit.client.1.smithi164.stdout:6/546: dread d0/d3/d11/d29/f46 [0,4194304] 0 2024-04-20T21:59:01.544 INFO:tasks.workunit.client.1.smithi164.stdout:3/530: mkdir d12/d20/d39/d55/da5 0 2024-04-20T21:59:01.544 INFO:tasks.workunit.client.1.smithi164.stdout:6/547: mknod d0/d3/d27/d9d/cba 0 2024-04-20T21:59:01.545 INFO:tasks.workunit.client.1.smithi164.stdout:8/437: dread - d0/f4d zero size 2024-04-20T21:59:01.547 INFO:tasks.workunit.client.1.smithi164.stdout:7/481: truncate d2/d21/d44/f4e 685482 0 2024-04-20T21:59:01.554 INFO:tasks.workunit.client.1.smithi164.stdout:6/548: fsync d0/d3/d62/d75/fa1 0 2024-04-20T21:59:01.557 INFO:tasks.workunit.client.1.smithi164.stdout:4/447: dread d4/d9/d22/f52 [0,4194304] 0 2024-04-20T21:59:01.558 INFO:tasks.workunit.client.1.smithi164.stdout:8/438: mkdir d0/d14/d16/d58/d94 0 2024-04-20T21:59:01.558 INFO:tasks.workunit.client.1.smithi164.stdout:2/509: dwrite d2/fa [0,4194304] 0 2024-04-20T21:59:01.571 INFO:tasks.workunit.client.1.smithi164.stdout:1/443: dwrite d10/d16/d20/d26/d34/f7a [0,4194304] 0 2024-04-20T21:59:01.572 INFO:tasks.workunit.client.1.smithi164.stdout:3/531: dread d12/d20/d39/d55/d6b/f76 [0,4194304] 0 2024-04-20T21:59:01.574 INFO:tasks.workunit.client.1.smithi164.stdout:8/439: creat d0/d14/d5f/f95 x:0 0 0 2024-04-20T21:59:01.576 INFO:tasks.workunit.client.1.smithi164.stdout:4/448: dread d4/d9/d27/f7a [0,4194304] 0 2024-04-20T21:59:01.579 INFO:tasks.workunit.client.1.smithi164.stdout:2/510: fsync d2/d5/d21/f2b 0 2024-04-20T21:59:01.582 INFO:tasks.workunit.client.1.smithi164.stdout:1/444: rmdir d10/d33/d4d 39 2024-04-20T21:59:01.585 INFO:tasks.workunit.client.1.smithi164.stdout:9/560: dwrite d3/db/d1b/d1e/f81 [0,4194304] 0 2024-04-20T21:59:01.588 INFO:tasks.workunit.client.1.smithi164.stdout:5/569: dwrite f5 [0,4194304] 0 2024-04-20T21:59:01.593 INFO:tasks.workunit.client.1.smithi164.stdout:8/440: fdatasync d0/d14/d16/d5a/f5c 0 2024-04-20T21:59:01.596 INFO:tasks.workunit.client.1.smithi164.stdout:3/532: write d12/d6d/f96 [2755216,92081] 0 2024-04-20T21:59:01.596 INFO:tasks.workunit.client.1.smithi164.stdout:0/489: dwrite d1/d4/d26/d29/d2d/d54/d77/d3c/f58 [0,4194304] 0 2024-04-20T21:59:01.597 INFO:tasks.workunit.client.1.smithi164.stdout:7/482: write d2/d21/d44/f4e [813483,25668] 0 2024-04-20T21:59:01.603 INFO:tasks.workunit.client.1.smithi164.stdout:2/511: dread - d2/d19/d28/d3e/d53/f90 zero size 2024-04-20T21:59:01.603 INFO:tasks.workunit.client.1.smithi164.stdout:4/449: mknod d4/d9/c8e 0 2024-04-20T21:59:01.605 INFO:tasks.workunit.client.1.smithi164.stdout:3/533: chown d12/d15/l41 231546 1 2024-04-20T21:59:01.606 INFO:tasks.workunit.client.1.smithi164.stdout:9/561: write d3/f6 [2255507,105480] 0 2024-04-20T21:59:01.606 INFO:tasks.workunit.client.1.smithi164.stdout:7/483: fdatasync d2/d21/d33/fa5 0 2024-04-20T21:59:01.607 INFO:tasks.workunit.client.1.smithi164.stdout:5/570: mknod dc/cc3 0 2024-04-20T21:59:01.610 INFO:tasks.workunit.client.1.smithi164.stdout:6/549: dwrite d0/d3/f10 [0,4194304] 0 2024-04-20T21:59:01.610 INFO:tasks.workunit.client.1.smithi164.stdout:1/445: rename d10/d16/d19/f67 to d10/f8f 0 2024-04-20T21:59:01.611 INFO:tasks.workunit.client.1.smithi164.stdout:0/490: stat d1/d4/d26/d29/d2d/c31 0 2024-04-20T21:59:01.615 INFO:tasks.workunit.client.1.smithi164.stdout:0/491: write d1/f1b [2673509,92860] 0 2024-04-20T21:59:01.622 INFO:tasks.workunit.client.1.smithi164.stdout:4/450: mknod d4/d9/d5c/c8f 0 2024-04-20T21:59:01.622 INFO:tasks.workunit.client.1.smithi164.stdout:2/512: rmdir d2/d30/d84 39 2024-04-20T21:59:01.627 INFO:tasks.workunit.client.1.smithi164.stdout:1/446: readlink d10/d16/d19/l29 0 2024-04-20T21:59:01.627 INFO:tasks.workunit.client.1.smithi164.stdout:6/550: symlink d0/d3/d15/d23/d45/d4f/d61/lbb 0 2024-04-20T21:59:01.630 INFO:tasks.workunit.client.1.smithi164.stdout:0/492: dread - d1/f22 zero size 2024-04-20T21:59:01.631 INFO:tasks.workunit.client.1.smithi164.stdout:9/562: mkdir d3/db/dc4 0 2024-04-20T21:59:01.633 INFO:tasks.workunit.client.1.smithi164.stdout:5/571: getdents dc/d2b/d6d/d73/db7 0 2024-04-20T21:59:01.635 INFO:tasks.workunit.client.1.smithi164.stdout:3/534: mknod d12/d20/d39/d55/ca6 0 2024-04-20T21:59:01.636 INFO:tasks.workunit.client.1.smithi164.stdout:2/513: rename d2/d19/d28/d3e/d53/d62/l92 to d2/d5/d3a/d55/l98 0 2024-04-20T21:59:01.636 INFO:tasks.workunit.client.1.smithi164.stdout:8/441: dread d0/d14/d16/d58/d73/f85 [0,4194304] 0 2024-04-20T21:59:01.639 INFO:tasks.workunit.client.1.smithi164.stdout:4/451: symlink d4/d9/d22/l90 0 2024-04-20T21:59:01.643 INFO:tasks.workunit.client.1.smithi164.stdout:7/484: dwrite d2/f48 [0,4194304] 0 2024-04-20T21:59:01.651 INFO:tasks.workunit.client.1.smithi164.stdout:5/572: mknod dc/d2c/d2e/d30/d5e/cc4 0 2024-04-20T21:59:01.655 INFO:tasks.workunit.client.1.smithi164.stdout:5/573: write dc/d2b/d52/d64/f95 [66622,77631] 0 2024-04-20T21:59:01.658 INFO:tasks.workunit.client.1.smithi164.stdout:1/447: dwrite d10/d16/f27 [0,4194304] 0 2024-04-20T21:59:01.658 INFO:tasks.workunit.client.1.smithi164.stdout:0/493: creat d1/d4/da/d27/f90 x:0 0 0 2024-04-20T21:59:01.664 INFO:tasks.workunit.client.1.smithi164.stdout:6/551: truncate d0/d3/d15/d23/d45/d69/f93 3674662 0 2024-04-20T21:59:01.672 INFO:tasks.workunit.client.1.smithi164.stdout:9/563: link d3/db/dd/d40/d2a/d36/d51/f68 d3/db/dd/d40/d2a/d36/d51/fc5 0 2024-04-20T21:59:01.675 INFO:tasks.workunit.client.1.smithi164.stdout:9/564: write d3/f94 [276839,18321] 0 2024-04-20T21:59:01.679 INFO:tasks.workunit.client.1.smithi164.stdout:4/452: creat d4/d28/f91 x:0 0 0 2024-04-20T21:59:01.681 INFO:tasks.workunit.client.1.smithi164.stdout:2/514: link d2/c49 d2/d5/d3a/c99 0 2024-04-20T21:59:01.681 INFO:tasks.workunit.client.1.smithi164.stdout:3/535: link d12/d20/d39/d55/ca6 d12/d20/d39/d55/d87/ca7 0 2024-04-20T21:59:01.683 INFO:tasks.workunit.client.1.smithi164.stdout:6/552: mknod d0/d3/cbc 0 2024-04-20T21:59:01.688 INFO:tasks.workunit.client.1.smithi164.stdout:8/442: creat d0/d14/d4e/f96 x:0 0 0 2024-04-20T21:59:01.689 INFO:tasks.workunit.client.1.smithi164.stdout:4/453: creat d4/d9/d27/d3f/f92 x:0 0 0 2024-04-20T21:59:01.689 INFO:tasks.workunit.client.1.smithi164.stdout:7/485: getdents d2/d21/d24/d31/d3a/d83/d68 0 2024-04-20T21:59:01.689 INFO:tasks.workunit.client.1.smithi164.stdout:5/574: dread dc/d2c/f4f [0,4194304] 0 2024-04-20T21:59:01.691 INFO:tasks.workunit.client.1.smithi164.stdout:3/536: mknod d12/d20/d39/ca8 0 2024-04-20T21:59:01.692 INFO:tasks.workunit.client.1.smithi164.stdout:5/575: read dc/d2c/d2e/d30/f59 [203880,66675] 0 2024-04-20T21:59:01.693 INFO:tasks.workunit.client.1.smithi164.stdout:1/448: getdents d10/d33/d48 0 2024-04-20T21:59:01.697 INFO:tasks.workunit.client.1.smithi164.stdout:6/553: mkdir d0/d3/d11/d29/d6e/d5d/dbd 0 2024-04-20T21:59:01.699 INFO:tasks.workunit.client.1.smithi164.stdout:9/565: mkdir d3/db/dd/d40/d2a/dc6 0 2024-04-20T21:59:01.708 INFO:tasks.workunit.client.1.smithi164.stdout:0/494: dwrite d1/d4/d20/f79 [0,4194304] 0 2024-04-20T21:59:01.712 INFO:tasks.workunit.client.1.smithi164.stdout:3/537: creat d12/d6d/fa9 x:0 0 0 2024-04-20T21:59:01.714 INFO:tasks.workunit.client.1.smithi164.stdout:4/454: chown d4/d9/d22/f2f 8 1 2024-04-20T21:59:01.717 INFO:tasks.workunit.client.1.smithi164.stdout:5/576: symlink dc/d2b/d52/d99/lc5 0 2024-04-20T21:59:01.720 INFO:tasks.workunit.client.1.smithi164.stdout:9/566: unlink d3/f18 0 2024-04-20T21:59:01.720 INFO:tasks.workunit.client.1.smithi164.stdout:2/515: link d2/d5/l64 d2/l9a 0 2024-04-20T21:59:01.722 INFO:tasks.workunit.client.1.smithi164.stdout:8/443: mkdir d0/d14/d4e/d62/d82/d97 0 2024-04-20T21:59:01.726 INFO:tasks.workunit.client.1.smithi164.stdout:7/486: symlink d2/d21/d24/d60/d9e/da6/la9 0 2024-04-20T21:59:01.726 INFO:tasks.workunit.client.1.smithi164.stdout:1/449: symlink d10/d33/l90 0 2024-04-20T21:59:01.728 INFO:tasks.workunit.client.1.smithi164.stdout:7/487: dread - d2/d21/d24/d31/d3a/fa2 zero size 2024-04-20T21:59:01.728 INFO:tasks.workunit.client.1.smithi164.stdout:5/577: rename dc/d2b/d53/cc0 to dc/d2c/d2e/d30/d72/da9/cc6 0 2024-04-20T21:59:01.733 INFO:tasks.workunit.client.1.smithi164.stdout:0/495: fdatasync d1/d2b/f66 0 2024-04-20T21:59:01.737 INFO:tasks.workunit.client.1.smithi164.stdout:1/450: chown d10/d33/d41/f63 0 1 2024-04-20T21:59:01.737 INFO:tasks.workunit.client.1.smithi164.stdout:3/538: dwrite f10 [0,4194304] 0 2024-04-20T21:59:01.738 INFO:tasks.workunit.client.1.smithi164.stdout:5/578: mknod dc/d2b/d52/cc7 0 2024-04-20T21:59:01.740 INFO:tasks.workunit.client.1.smithi164.stdout:7/488: write d2/d21/d24/d60/f9f [4545929,25194] 0 2024-04-20T21:59:01.744 INFO:tasks.workunit.client.1.smithi164.stdout:8/444: write d0/d14/f4f [1735204,2787] 0 2024-04-20T21:59:01.747 INFO:tasks.workunit.client.1.smithi164.stdout:6/554: getdents d0/d3/d11/d29/d6e/d41 0 2024-04-20T21:59:01.755 INFO:tasks.workunit.client.1.smithi164.stdout:7/489: dread d2/f5f [0,4194304] 0 2024-04-20T21:59:01.758 INFO:tasks.workunit.client.1.smithi164.stdout:2/516: dread - d2/d5/d3a/d55/f73 zero size 2024-04-20T21:59:01.763 INFO:tasks.workunit.client.1.smithi164.stdout:4/455: rename d4/d28/d3e/f53 to d4/d28/d3e/f93 0 2024-04-20T21:59:01.765 INFO:tasks.workunit.client.1.smithi164.stdout:1/451: mkdir d10/d16/d20/d91 0 2024-04-20T21:59:01.767 INFO:tasks.workunit.client.1.smithi164.stdout:9/567: dwrite d3/db/dd/f23 [0,4194304] 0 2024-04-20T21:59:01.767 INFO:tasks.workunit.client.1.smithi164.stdout:7/490: write d2/d21/d24/f71 [922111,120852] 0 2024-04-20T21:59:01.769 INFO:tasks.workunit.client.1.smithi164.stdout:8/445: dwrite d0/d1e/f88 [0,4194304] 0 2024-04-20T21:59:01.769 INFO:tasks.workunit.client.1.smithi164.stdout:5/579: mkdir dc/d2b/dc8 0 2024-04-20T21:59:01.776 INFO:tasks.workunit.client.1.smithi164.stdout:2/517: write d2/f12 [5239667,123775] 0 2024-04-20T21:59:01.779 INFO:tasks.workunit.client.1.smithi164.stdout:3/539: truncate d12/f5f 639356 0 2024-04-20T21:59:01.779 INFO:tasks.workunit.client.1.smithi164.stdout:4/456: rmdir d4/d9/d27/d3f/d5f 39 2024-04-20T21:59:01.781 INFO:tasks.workunit.client.1.smithi164.stdout:7/491: write d2/d21/d24/d31/d3a/fa2 [741043,70868] 0 2024-04-20T21:59:01.781 INFO:tasks.workunit.client.1.smithi164.stdout:3/540: chown d12/d68 152247 1 2024-04-20T21:59:01.781 INFO:tasks.workunit.client.1.smithi164.stdout:0/496: link d1/d4/da/d27/l73 d1/d4/da/l91 0 2024-04-20T21:59:01.786 INFO:tasks.workunit.client.1.smithi164.stdout:9/568: mkdir d3/db/d1b/d20/d3f/dc7 0 2024-04-20T21:59:01.791 INFO:tasks.workunit.client.1.smithi164.stdout:3/541: read d12/d20/d39/d55/d6b/f80 [67238,90472] 0 2024-04-20T21:59:01.791 INFO:tasks.workunit.client.1.smithi164.stdout:8/446: rename d0/f8e to d0/d14/d16/d58/d94/f98 0 2024-04-20T21:59:01.798 INFO:tasks.workunit.client.1.smithi164.stdout:6/555: getdents d0/d3/d15/d23/d45 0 2024-04-20T21:59:01.798 INFO:tasks.workunit.client.1.smithi164.stdout:5/580: dread dc/d2c/d2e/d30/f77 [0,4194304] 0 2024-04-20T21:59:01.799 INFO:tasks.workunit.client.1.smithi164.stdout:8/447: truncate d0/d14/d5f/f95 290148 0 2024-04-20T21:59:01.803 INFO:tasks.workunit.client.1.smithi164.stdout:9/569: symlink d3/d9f/lc8 0 2024-04-20T21:59:01.803 INFO:tasks.workunit.client.1.smithi164.stdout:0/497: symlink d1/d4/l92 0 2024-04-20T21:59:01.805 INFO:tasks.workunit.client.1.smithi164.stdout:8/448: write d0/d14/d5f/f7a [744283,84793] 0 2024-04-20T21:59:01.808 INFO:tasks.workunit.client.1.smithi164.stdout:2/518: link d2/d5/d21/f2b d2/d5/f9b 0 2024-04-20T21:59:01.819 INFO:tasks.workunit.client.1.smithi164.stdout:5/581: creat dc/d2c/d2e/d30/d72/da9/dbb/fc9 x:0 0 0 2024-04-20T21:59:01.819 INFO:tasks.workunit.client.1.smithi164.stdout:4/457: dwrite d4/d28/d3e/d41/f4b [0,4194304] 0 2024-04-20T21:59:01.820 INFO:tasks.workunit.client.1.smithi164.stdout:9/570: dread d3/db/dd/f61 [0,4194304] 0 2024-04-20T21:59:01.822 INFO:tasks.workunit.client.1.smithi164.stdout:5/582: symlink dc/d2c/lca 0 2024-04-20T21:59:01.825 INFO:tasks.workunit.client.1.smithi164.stdout:2/519: truncate d2/f8a 447763 0 2024-04-20T21:59:01.825 INFO:tasks.workunit.client.1.smithi164.stdout:3/542: write d12/d15/f38 [3798263,52867] 0 2024-04-20T21:59:01.830 INFO:tasks.workunit.client.1.smithi164.stdout:9/571: dread - d3/db/d1b/d20/d3f/d8a/da7/dbd/fa2 zero size 2024-04-20T21:59:01.832 INFO:tasks.workunit.client.1.smithi164.stdout:1/452: dread d10/f5c [0,4194304] 0 2024-04-20T21:59:01.833 INFO:tasks.workunit.client.1.smithi164.stdout:5/583: chown dc/d2b/d52/l5c 1407730 1 2024-04-20T21:59:01.836 INFO:tasks.workunit.client.1.smithi164.stdout:3/543: unlink d12/d20/d39/c4a 0 2024-04-20T21:59:01.836 INFO:tasks.workunit.client.1.smithi164.stdout:4/458: unlink d4/d9/d27/d37/c6c 0 2024-04-20T21:59:01.839 INFO:tasks.workunit.client.1.smithi164.stdout:5/584: mknod dc/d2b/d6d/ccb 0 2024-04-20T21:59:01.842 INFO:tasks.workunit.client.1.smithi164.stdout:4/459: rmdir d4/d28/d3e 39 2024-04-20T21:59:01.842 INFO:tasks.workunit.client.1.smithi164.stdout:2/520: creat d2/f9c x:0 0 0 2024-04-20T21:59:01.844 INFO:tasks.workunit.client.1.smithi164.stdout:3/544: mknod d12/caa 0 2024-04-20T21:59:01.844 INFO:tasks.workunit.client.1.smithi164.stdout:4/460: chown d4/c12 27 1 2024-04-20T21:59:01.846 INFO:tasks.workunit.client.1.smithi164.stdout:7/492: dread f1 [4194304,4194304] 0 2024-04-20T21:59:01.846 INFO:tasks.workunit.client.1.smithi164.stdout:3/545: chown f10 63831 1 2024-04-20T21:59:01.852 INFO:tasks.workunit.client.1.smithi164.stdout:7/493: mkdir d2/d21/d24/d31/d3a/daa 0 2024-04-20T21:59:01.856 INFO:tasks.workunit.client.1.smithi164.stdout:9/572: dwrite d3/db/f5b [0,4194304] 0 2024-04-20T21:59:01.860 INFO:tasks.workunit.client.1.smithi164.stdout:3/546: creat d12/d68/d6f/d71/d7d/fab x:0 0 0 2024-04-20T21:59:01.864 INFO:tasks.workunit.client.1.smithi164.stdout:4/461: truncate d4/d9/fc 3586177 0 2024-04-20T21:59:01.866 INFO:tasks.workunit.client.1.smithi164.stdout:2/521: truncate d2/d5/f1d 2272243 0 2024-04-20T21:59:01.870 INFO:tasks.workunit.client.1.smithi164.stdout:3/547: unlink d12/f1e 0 2024-04-20T21:59:01.871 INFO:tasks.workunit.client.1.smithi164.stdout:5/585: dwrite dc/d2c/d2e/f46 [0,4194304] 0 2024-04-20T21:59:01.871 INFO:tasks.workunit.client.1.smithi164.stdout:9/573: mknod d3/db/dd/d40/d2a/cc9 0 2024-04-20T21:59:01.874 INFO:tasks.workunit.client.1.smithi164.stdout:9/574: chown d3/d9f/fc1 3767 1 2024-04-20T21:59:01.880 INFO:tasks.workunit.client.1.smithi164.stdout:9/575: read - d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/f97 zero size 2024-04-20T21:59:01.880 INFO:tasks.workunit.client.1.smithi164.stdout:4/462: creat d4/d9/d5c/f94 x:0 0 0 2024-04-20T21:59:01.882 INFO:tasks.workunit.client.1.smithi164.stdout:3/548: mkdir d12/d20/d39/dac 0 2024-04-20T21:59:01.883 INFO:tasks.workunit.client.1.smithi164.stdout:2/522: unlink d2/d19/d28/d3e/l6f 0 2024-04-20T21:59:01.889 INFO:tasks.workunit.client.1.smithi164.stdout:7/494: dwrite d2/d21/d24/d31/d3a/f81 [0,4194304] 0 2024-04-20T21:59:01.899 INFO:tasks.workunit.client.1.smithi164.stdout:2/523: unlink d2/d5/d21/l2c 0 2024-04-20T21:59:01.901 INFO:tasks.workunit.client.1.smithi164.stdout:3/549: mkdir d12/d20/d39/d69/dad 0 2024-04-20T21:59:01.905 INFO:tasks.workunit.client.1.smithi164.stdout:4/463: creat d4/d28/d3e/d4a/f95 x:0 0 0 2024-04-20T21:59:01.906 INFO:tasks.workunit.client.1.smithi164.stdout:2/524: symlink d2/d19/l9d 0 2024-04-20T21:59:01.911 INFO:tasks.workunit.client.1.smithi164.stdout:7/495: rename f1 to d2/d21/d24/d31/d3a/d83/d63/fab 0 2024-04-20T21:59:01.913 INFO:tasks.workunit.client.1.smithi164.stdout:4/464: fsync d4/fb 0 2024-04-20T21:59:01.913 INFO:tasks.workunit.client.1.smithi164.stdout:9/576: dwrite d3/db/dd/d40/d2a/d36/f48 [0,4194304] 0 2024-04-20T21:59:01.915 INFO:tasks.workunit.client.1.smithi164.stdout:5/586: truncate dc/d2c/d2e/d30/f77 2702322 0 2024-04-20T21:59:01.917 INFO:tasks.workunit.client.1.smithi164.stdout:4/465: write d4/d9/d27/f7b [2234103,22623] 0 2024-04-20T21:59:01.917 INFO:tasks.workunit.client.1.smithi164.stdout:7/496: unlink d2/d21/d44/c8f 0 2024-04-20T21:59:01.920 INFO:tasks.workunit.client.1.smithi164.stdout:2/525: mkdir d2/d19/d28/d3e/d9e 0 2024-04-20T21:59:01.922 INFO:tasks.workunit.client.1.smithi164.stdout:3/550: mkdir d12/d15/dae 0 2024-04-20T21:59:01.929 INFO:tasks.workunit.client.1.smithi164.stdout:4/466: fsync d4/d28/d3e/f59 0 2024-04-20T21:59:01.929 INFO:tasks.workunit.client.1.smithi164.stdout:4/467: fsync f2 0 2024-04-20T21:59:01.936 INFO:tasks.workunit.client.1.smithi164.stdout:5/587: rmdir dc/d2b/d6d/d73/db7 0 2024-04-20T21:59:01.938 INFO:tasks.workunit.client.1.smithi164.stdout:7/497: rename d2/d21/d44/l65 to d2/d21/d24/d31/d3a/d83/d63/lac 0 2024-04-20T21:59:01.939 INFO:tasks.workunit.client.1.smithi164.stdout:7/498: readlink d2/l39 0 2024-04-20T21:59:01.941 INFO:tasks.workunit.client.1.smithi164.stdout:5/588: symlink dc/d12/d81/lcc 0 2024-04-20T21:59:01.943 INFO:tasks.workunit.client.1.smithi164.stdout:3/551: getdents d12/d20/d39/d55/d87 0 2024-04-20T21:59:01.943 INFO:tasks.workunit.client.1.smithi164.stdout:4/468: rename d4/d9/d27/l2a to d4/d9/d27/d3f/d67/d86/l96 0 2024-04-20T21:59:01.945 INFO:tasks.workunit.client.1.smithi164.stdout:2/526: link d2/c48 d2/d5/d3a/d55/c9f 0 2024-04-20T21:59:01.949 INFO:tasks.workunit.client.1.smithi164.stdout:4/469: mkdir d4/d9/d5c/d97 0 2024-04-20T21:59:01.950 INFO:tasks.workunit.client.1.smithi164.stdout:2/527: symlink d2/d5/d3a/d65/la0 0 2024-04-20T21:59:01.955 INFO:tasks.workunit.client.1.smithi164.stdout:9/577: dread d3/db/d1b/f8f [0,4194304] 0 2024-04-20T21:59:01.955 INFO:tasks.workunit.client.1.smithi164.stdout:4/470: write d4/d9/d27/d3f/d5f/f80 [993478,36892] 0 2024-04-20T21:59:01.956 INFO:tasks.workunit.client.1.smithi164.stdout:2/528: creat d2/d5/d21/fa1 x:0 0 0 2024-04-20T21:59:01.960 INFO:tasks.workunit.client.1.smithi164.stdout:4/471: chown d4/d9/d27/d3f/f63 2 1 2024-04-20T21:59:01.961 INFO:tasks.workunit.client.1.smithi164.stdout:2/529: write d2/d5/d3a/f74 [698637,23552] 0 2024-04-20T21:59:01.964 INFO:tasks.workunit.client.1.smithi164.stdout:9/578: mknod d3/db/dc4/cca 0 2024-04-20T21:59:01.968 INFO:tasks.workunit.client.1.smithi164.stdout:3/552: dwrite d12/d6d/f96 [0,4194304] 0 2024-04-20T21:59:01.973 INFO:tasks.workunit.client.1.smithi164.stdout:2/530: read d2/f3c [2944151,49666] 0 2024-04-20T21:59:01.977 INFO:tasks.workunit.client.1.smithi164.stdout:5/589: dread dc/d2c/d2e/d30/f55 [0,4194304] 0 2024-04-20T21:59:01.985 INFO:tasks.workunit.client.1.smithi164.stdout:2/531: mkdir d2/d5/d3a/d55/d58/da2 0 2024-04-20T21:59:01.988 INFO:tasks.workunit.client.1.smithi164.stdout:7/499: dwrite d2/d21/f28 [0,4194304] 0 2024-04-20T21:59:01.993 INFO:tasks.workunit.client.1.smithi164.stdout:5/590: mknod dc/d2c/d2e/dbd/ccd 0 2024-04-20T21:59:01.993 INFO:tasks.workunit.client.1.smithi164.stdout:3/553: dwrite d12/d68/d6f/f89 [0,4194304] 0 2024-04-20T21:59:01.993 INFO:tasks.workunit.client.1.smithi164.stdout:4/472: dwrite d4/d9/f11 [0,4194304] 0 2024-04-20T21:59:01.994 INFO:tasks.workunit.client.1.smithi164.stdout:5/591: dread - dc/d2b/d53/f96 zero size 2024-04-20T21:59:02.011 INFO:tasks.workunit.client.1.smithi164.stdout:5/592: symlink dc/d2b/d53/lce 0 2024-04-20T21:59:02.012 INFO:tasks.workunit.client.1.smithi164.stdout:3/554: creat d12/d20/da2/faf x:0 0 0 2024-04-20T21:59:02.024 INFO:tasks.workunit.client.1.smithi164.stdout:2/532: dread d2/d19/d28/f29 [0,4194304] 0 2024-04-20T21:59:02.024 INFO:tasks.workunit.client.1.smithi164.stdout:5/593: mknod dc/d2b/d52/d99/ccf 0 2024-04-20T21:59:02.024 INFO:tasks.workunit.client.1.smithi164.stdout:2/533: stat d2/d19/d28/l33 0 2024-04-20T21:59:02.024 INFO:tasks.workunit.client.1.smithi164.stdout:3/555: truncate d12/d20/d39/f46 463917 0 2024-04-20T21:59:02.026 INFO:tasks.workunit.client.1.smithi164.stdout:5/594: chown dc/d2b/d6d/fa6 315650548 1 2024-04-20T21:59:02.027 INFO:tasks.workunit.client.1.smithi164.stdout:3/556: creat d12/d6d/fb0 x:0 0 0 2024-04-20T21:59:02.027 INFO:tasks.workunit.client.1.smithi164.stdout:2/534: fsync d2/d30/f4a 0 2024-04-20T21:59:02.035 INFO:tasks.workunit.client.1.smithi164.stdout:5/595: creat dc/d2b/da0/fd0 x:0 0 0 2024-04-20T21:59:02.036 INFO:tasks.workunit.client.1.smithi164.stdout:3/557: mkdir d12/d2a/db1 0 2024-04-20T21:59:02.038 INFO:tasks.workunit.client.1.smithi164.stdout:5/596: dread - dc/d2c/d2e/d30/d5e/fb0 zero size 2024-04-20T21:59:02.043 INFO:tasks.workunit.client.1.smithi164.stdout:2/535: getdents d2/d5/d21 0 2024-04-20T21:59:02.044 INFO:tasks.workunit.client.1.smithi164.stdout:5/597: fdatasync dc/d12/f4d 0 2024-04-20T21:59:02.049 INFO:tasks.workunit.client.1.smithi164.stdout:3/558: rename d12/l25 to d12/d20/d39/d69/d77/d81/lb2 0 2024-04-20T21:59:02.049 INFO:tasks.workunit.client.1.smithi164.stdout:7/500: dwrite d2/f5f [0,4194304] 0 2024-04-20T21:59:02.062 INFO:tasks.workunit.client.1.smithi164.stdout:7/501: symlink d2/d21/d24/d31/d3a/d83/d63/d85/lad 0 2024-04-20T21:59:02.065 INFO:tasks.workunit.client.1.smithi164.stdout:0/498: sync 2024-04-20T21:59:02.065 INFO:tasks.workunit.client.1.smithi164.stdout:8/449: sync 2024-04-20T21:59:02.065 INFO:tasks.workunit.client.1.smithi164.stdout:6/556: sync 2024-04-20T21:59:02.065 INFO:tasks.workunit.client.1.smithi164.stdout:1/453: sync 2024-04-20T21:59:02.067 INFO:tasks.workunit.client.1.smithi164.stdout:2/536: getdents d2/d30/d84 0 2024-04-20T21:59:02.071 INFO:tasks.workunit.client.1.smithi164.stdout:0/499: write d1/d2b/f65 [445769,113029] 0 2024-04-20T21:59:02.072 INFO:tasks.workunit.client.1.smithi164.stdout:8/450: rmdir d0/d1e 39 2024-04-20T21:59:02.074 INFO:tasks.workunit.client.1.smithi164.stdout:2/537: dread - d2/d30/f83 zero size 2024-04-20T21:59:02.076 INFO:tasks.workunit.client.1.smithi164.stdout:5/598: dwrite dc/d2c/d2e/d30/d5e/f9d [0,4194304] 0 2024-04-20T21:59:02.082 INFO:tasks.workunit.client.1.smithi164.stdout:8/451: chown d0/d14/d16/d5a/c78 1 1 2024-04-20T21:59:02.084 INFO:tasks.workunit.client.1.smithi164.stdout:4/473: dread d4/d28/f6b [0,4194304] 0 2024-04-20T21:59:02.084 INFO:tasks.workunit.client.1.smithi164.stdout:6/557: truncate d0/d3/d11/d29/d6e/d41/fb7 715728 0 2024-04-20T21:59:02.084 INFO:tasks.workunit.client.1.smithi164.stdout:2/538: symlink d2/d30/d84/la3 0 2024-04-20T21:59:02.088 INFO:tasks.workunit.client.1.smithi164.stdout:0/500: mknod d1/d4/da/c93 0 2024-04-20T21:59:02.089 INFO:tasks.workunit.client.1.smithi164.stdout:7/502: truncate d2/d21/d24/d60/d9e/fa4 2386280 0 2024-04-20T21:59:02.090 INFO:tasks.workunit.client.1.smithi164.stdout:3/559: unlink d12/d20/d39/d69/d77/d81/lb2 0 2024-04-20T21:59:02.094 INFO:tasks.workunit.client.1.smithi164.stdout:1/454: link d10/d16/d20/f69 d10/d33/d7f/d8c/f92 0 2024-04-20T21:59:02.096 INFO:tasks.workunit.client.1.smithi164.stdout:8/452: creat d0/d14/d4e/d62/f99 x:0 0 0 2024-04-20T21:59:02.101 INFO:tasks.workunit.client.1.smithi164.stdout:7/503: stat d2/d21/d24/d31/d3a/d83/d63/d85 0 2024-04-20T21:59:02.102 INFO:tasks.workunit.client.1.smithi164.stdout:1/455: creat d10/d33/d41/f93 x:0 0 0 2024-04-20T21:59:02.103 INFO:tasks.workunit.client.1.smithi164.stdout:7/504: fdatasync d2/f8e 0 2024-04-20T21:59:02.107 INFO:tasks.workunit.client.1.smithi164.stdout:0/501: creat d1/d4/da/d5c/f94 x:0 0 0 2024-04-20T21:59:02.108 INFO:tasks.workunit.client.1.smithi164.stdout:3/560: getdents d12/d20/d39/dac 0 2024-04-20T21:59:02.111 INFO:tasks.workunit.client.1.smithi164.stdout:0/502: write d1/d4/f7e [6369942,105892] 0 2024-04-20T21:59:02.112 INFO:tasks.workunit.client.1.smithi164.stdout:2/539: link d2/d5/d3a/f5a d2/d5/d3a/fa4 0 2024-04-20T21:59:02.115 INFO:tasks.workunit.client.1.smithi164.stdout:7/505: mkdir d2/d21/d24/d31/d3a/d83/d6a/dae 0 2024-04-20T21:59:02.116 INFO:tasks.workunit.client.1.smithi164.stdout:1/456: mknod d10/d33/d48/d8b/c94 0 2024-04-20T21:59:02.117 INFO:tasks.workunit.client.1.smithi164.stdout:8/453: fsync d0/d14/d16/d58/f60 0 2024-04-20T21:59:02.120 INFO:tasks.workunit.client.1.smithi164.stdout:3/561: chown d12/d68/d6f/c98 5343705 1 2024-04-20T21:59:02.123 INFO:tasks.workunit.client.1.smithi164.stdout:1/457: write d10/d33/f46 [156295,31003] 0 2024-04-20T21:59:02.125 INFO:tasks.workunit.client.1.smithi164.stdout:2/540: rmdir d2/d5/d3a/d65 39 2024-04-20T21:59:02.126 INFO:tasks.workunit.client.1.smithi164.stdout:9/579: sync 2024-04-20T21:59:02.130 INFO:tasks.workunit.client.1.smithi164.stdout:8/454: truncate d0/d14/d4e/d6f/f79 1630472 0 2024-04-20T21:59:02.130 INFO:tasks.workunit.client.1.smithi164.stdout:0/503: creat d1/d4/d49/f95 x:0 0 0 2024-04-20T21:59:02.134 INFO:tasks.workunit.client.1.smithi164.stdout:4/474: dwrite d4/d28/f6f [0,4194304] 0 2024-04-20T21:59:02.134 INFO:tasks.workunit.client.1.smithi164.stdout:7/506: mkdir d2/d21/d24/daf 0 2024-04-20T21:59:02.136 INFO:tasks.workunit.client.1.smithi164.stdout:5/599: dwrite dc/d12/f13 [0,4194304] 0 2024-04-20T21:59:02.137 INFO:tasks.workunit.client.1.smithi164.stdout:7/507: fsync d2/f48 0 2024-04-20T21:59:02.150 INFO:tasks.workunit.client.1.smithi164.stdout:1/458: mkdir d10/d16/d20/d25/d95 0 2024-04-20T21:59:02.150 INFO:tasks.workunit.client.1.smithi164.stdout:9/580: creat d3/db0/fcb x:0 0 0 2024-04-20T21:59:02.157 INFO:tasks.workunit.client.1.smithi164.stdout:7/508: symlink d2/d21/d24/d60/d82/lb0 0 2024-04-20T21:59:02.158 INFO:tasks.workunit.client.1.smithi164.stdout:6/558: dread d0/d3/d15/d23/d45/d4f/f68 [0,4194304] 0 2024-04-20T21:59:02.159 INFO:tasks.workunit.client.1.smithi164.stdout:0/504: unlink d1/d2b/c39 0 2024-04-20T21:59:02.162 INFO:tasks.workunit.client.1.smithi164.stdout:1/459: creat d10/d33/d7f/f96 x:0 0 0 2024-04-20T21:59:02.163 INFO:tasks.workunit.client.1.smithi164.stdout:3/562: rmdir d12/d20/d39/d55/da5 0 2024-04-20T21:59:02.164 INFO:tasks.workunit.client.1.smithi164.stdout:7/509: chown d2/d21/d24/d31/d3a/d83/d63/d85/f94 0 1 2024-04-20T21:59:02.166 INFO:tasks.workunit.client.1.smithi164.stdout:7/510: chown d2/d21/d24/d31/d3a/c56 30 1 2024-04-20T21:59:02.167 INFO:tasks.workunit.client.1.smithi164.stdout:9/581: mkdir d3/db/dcc 0 2024-04-20T21:59:02.168 INFO:tasks.workunit.client.1.smithi164.stdout:0/505: creat d1/d4/da/d5c/d6e/f96 x:0 0 0 2024-04-20T21:59:02.172 INFO:tasks.workunit.client.1.smithi164.stdout:7/511: chown d2/c1e 1754812 1 2024-04-20T21:59:02.174 INFO:tasks.workunit.client.1.smithi164.stdout:4/475: getdents d4/d9/d27/d3f/d5f 0 2024-04-20T21:59:02.174 INFO:tasks.workunit.client.1.smithi164.stdout:0/506: fsync d1/d2b/f65 0 2024-04-20T21:59:02.175 INFO:tasks.workunit.client.1.smithi164.stdout:9/582: rmdir d3/db/dc4 39 2024-04-20T21:59:02.175 INFO:tasks.workunit.client.1.smithi164.stdout:5/600: dwrite dc/d12/d1e/fc1 [0,4194304] 0 2024-04-20T21:59:02.178 INFO:tasks.workunit.client.1.smithi164.stdout:7/512: chown d2/d21/d24/d31/d3a/daa 2838239 1 2024-04-20T21:59:02.184 INFO:tasks.workunit.client.1.smithi164.stdout:4/476: unlink d4/d28/f89 0 2024-04-20T21:59:02.186 INFO:tasks.workunit.client.1.smithi164.stdout:4/477: stat d4/d9/d27/d37/f51 0 2024-04-20T21:59:02.193 INFO:tasks.workunit.client.1.smithi164.stdout:7/513: creat d2/d21/d44/fb1 x:0 0 0 2024-04-20T21:59:02.194 INFO:tasks.workunit.client.1.smithi164.stdout:1/460: write d10/d16/f70 [505787,32507] 0 2024-04-20T21:59:02.196 INFO:tasks.workunit.client.1.smithi164.stdout:3/563: write d12/f73 [932844,73602] 0 2024-04-20T21:59:02.199 INFO:tasks.workunit.client.1.smithi164.stdout:7/514: readlink d2/d21/d24/d60/l6d 0 2024-04-20T21:59:02.203 INFO:tasks.workunit.client.1.smithi164.stdout:6/559: dread d0/d3/d27/f43 [0,4194304] 0 2024-04-20T21:59:02.217 INFO:tasks.workunit.client.1.smithi164.stdout:3/564: write f6 [3738351,120679] 0 2024-04-20T21:59:02.218 INFO:tasks.workunit.client.1.smithi164.stdout:4/478: dread d4/d9/d27/f48 [0,4194304] 0 2024-04-20T21:59:02.220 INFO:tasks.workunit.client.1.smithi164.stdout:1/461: mknod d10/d16/d20/d25/d3d/c97 0 2024-04-20T21:59:02.222 INFO:tasks.workunit.client.1.smithi164.stdout:6/560: getdents d0/d3/d11/d29/d6e/d5d/dbd 0 2024-04-20T21:59:02.223 INFO:tasks.workunit.client.1.smithi164.stdout:5/601: getdents dc/d2c 0 2024-04-20T21:59:02.226 INFO:tasks.workunit.client.1.smithi164.stdout:0/507: getdents d1/d4/d26/d29/d2d/d54/d77/d3c 0 2024-04-20T21:59:02.229 INFO:tasks.workunit.client.1.smithi164.stdout:7/515: rename d2/d21/f3b to d2/d21/fb2 0 2024-04-20T21:59:02.231 INFO:tasks.workunit.client.1.smithi164.stdout:4/479: rename d4/d9/d5c/f8d to d4/d9/d27/d3f/d67/f98 0 2024-04-20T21:59:02.233 INFO:tasks.workunit.client.1.smithi164.stdout:1/462: symlink d10/d16/d19/d1a/d51/l98 0 2024-04-20T21:59:02.237 INFO:tasks.workunit.client.1.smithi164.stdout:3/565: write d12/d15/f6e [324133,124831] 0 2024-04-20T21:59:02.237 INFO:tasks.workunit.client.1.smithi164.stdout:0/508: mkdir d1/d4/d26/d29/d2d/d54/d97 0 2024-04-20T21:59:02.242 INFO:tasks.workunit.client.1.smithi164.stdout:3/566: stat d12/d20/d39 0 2024-04-20T21:59:02.245 INFO:tasks.workunit.client.1.smithi164.stdout:4/480: creat d4/d9/d42/f99 x:0 0 0 2024-04-20T21:59:02.246 INFO:tasks.workunit.client.1.smithi164.stdout:1/463: mknod d10/d16/d20/d25/d3d/c99 0 2024-04-20T21:59:02.247 INFO:tasks.workunit.client.1.smithi164.stdout:0/509: fdatasync d1/d4/d20/d74/f5e 0 2024-04-20T21:59:02.248 INFO:tasks.workunit.client.1.smithi164.stdout:7/516: dwrite d2/f16 [0,4194304] 0 2024-04-20T21:59:02.251 INFO:tasks.workunit.client.1.smithi164.stdout:4/481: fdatasync d4/d28/d3e/f79 0 2024-04-20T21:59:02.251 INFO:tasks.workunit.client.1.smithi164.stdout:1/464: write d10/d16/d20/f38 [5068353,20031] 0 2024-04-20T21:59:02.253 INFO:tasks.workunit.client.1.smithi164.stdout:5/602: rmdir dc/d2b/dc8 0 2024-04-20T21:59:02.256 INFO:tasks.workunit.client.1.smithi164.stdout:2/541: sync 2024-04-20T21:59:02.256 INFO:tasks.workunit.client.1.smithi164.stdout:8/455: sync 2024-04-20T21:59:02.258 INFO:tasks.workunit.client.1.smithi164.stdout:6/561: dread d0/d3/d8/f1f [0,4194304] 0 2024-04-20T21:59:02.260 INFO:tasks.workunit.client.1.smithi164.stdout:5/603: chown dc/d2c/d2e/l67 0 1 2024-04-20T21:59:02.264 INFO:tasks.workunit.client.1.smithi164.stdout:8/456: mknod d0/d14/d4e/d86/c9a 0 2024-04-20T21:59:02.267 INFO:tasks.workunit.client.1.smithi164.stdout:2/542: readlink d2/d5/d3a/d55/l98 0 2024-04-20T21:59:02.268 INFO:tasks.workunit.client.1.smithi164.stdout:1/465: read d10/d16/d20/d26/d34/f53 [225274,118939] 0 2024-04-20T21:59:02.270 INFO:tasks.workunit.client.1.smithi164.stdout:5/604: write dc/d2c/d2e/d30/d72/fb4 [1153089,70860] 0 2024-04-20T21:59:02.277 INFO:tasks.workunit.client.1.smithi164.stdout:6/562: creat d0/fbe x:0 0 0 2024-04-20T21:59:02.281 INFO:tasks.workunit.client.1.smithi164.stdout:2/543: mkdir d2/d30/da5 0 2024-04-20T21:59:02.283 INFO:tasks.workunit.client.1.smithi164.stdout:5/605: read dc/d12/d1e/fc1 [529070,65665] 0 2024-04-20T21:59:02.284 INFO:tasks.workunit.client.1.smithi164.stdout:3/567: dwrite d12/d2a/f4d [0,4194304] 0 2024-04-20T21:59:02.289 INFO:tasks.workunit.client.1.smithi164.stdout:7/517: dwrite d2/d21/d24/d31/d3a/f81 [0,4194304] 0 2024-04-20T21:59:02.289 INFO:tasks.workunit.client.1.smithi164.stdout:3/568: chown d12/d2a/f42 0 1 2024-04-20T21:59:02.289 INFO:tasks.workunit.client.1.smithi164.stdout:8/457: rename d0/d14/d16/d5a/c78 to d0/d14/c9b 0 2024-04-20T21:59:02.291 INFO:tasks.workunit.client.1.smithi164.stdout:5/606: rename dc to dc/d2b/d52/dd1 22 2024-04-20T21:59:02.291 INFO:tasks.workunit.client.1.smithi164.stdout:7/518: write d2/d21/f75 [531033,75955] 0 2024-04-20T21:59:02.291 INFO:tasks.workunit.client.1.smithi164.stdout:3/569: chown d12/d20/f22 121 1 2024-04-20T21:59:02.294 INFO:tasks.workunit.client.1.smithi164.stdout:1/466: symlink d10/d16/l9a 0 2024-04-20T21:59:02.295 INFO:tasks.workunit.client.1.smithi164.stdout:2/544: fdatasync d2/d19/d28/d3e/d53/d62/f8c 0 2024-04-20T21:59:02.296 INFO:tasks.workunit.client.1.smithi164.stdout:4/482: write d4/f19 [867280,55528] 0 2024-04-20T21:59:02.296 INFO:tasks.workunit.client.1.smithi164.stdout:3/570: fdatasync d12/d20/d39/d55/d6b/f80 0 2024-04-20T21:59:02.297 INFO:tasks.workunit.client.1.smithi164.stdout:5/607: stat dc/d12/ca4 0 2024-04-20T21:59:02.305 INFO:tasks.workunit.client.1.smithi164.stdout:6/563: rename d0/d3/d11/d29/d6e/d5d to d0/d3/d15/d21/d5c/dbf 0 2024-04-20T21:59:02.307 INFO:tasks.workunit.client.1.smithi164.stdout:7/519: mknod d2/d21/d24/d60/d9e/da6/cb3 0 2024-04-20T21:59:02.309 INFO:tasks.workunit.client.1.smithi164.stdout:7/520: fdatasync d2/f67 0 2024-04-20T21:59:02.312 INFO:tasks.workunit.client.1.smithi164.stdout:0/510: dread d1/d4/f7e [0,4194304] 0 2024-04-20T21:59:02.313 INFO:tasks.workunit.client.1.smithi164.stdout:2/545: mkdir d2/d19/da6 0 2024-04-20T21:59:02.319 INFO:tasks.workunit.client.1.smithi164.stdout:4/483: read d4/f39 [1918239,35064] 0 2024-04-20T21:59:02.322 INFO:tasks.workunit.client.1.smithi164.stdout:7/521: mknod d2/d21/d44/cb4 0 2024-04-20T21:59:02.324 INFO:tasks.workunit.client.1.smithi164.stdout:9/583: sync 2024-04-20T21:59:02.328 INFO:tasks.workunit.client.1.smithi164.stdout:1/467: dread f7 [0,4194304] 0 2024-04-20T21:59:02.331 INFO:tasks.workunit.client.1.smithi164.stdout:2/546: rmdir d2/d19/d28/d3e/d53/d62 39 2024-04-20T21:59:02.333 INFO:tasks.workunit.client.1.smithi164.stdout:5/608: creat dc/d2c/d2e/d30/d8c/fd2 x:0 0 0 2024-04-20T21:59:02.341 INFO:tasks.workunit.client.1.smithi164.stdout:6/564: dwrite d0/d3/d15/d21/d5c/f78 [0,4194304] 0 2024-04-20T21:59:02.343 INFO:tasks.workunit.client.1.smithi164.stdout:7/522: mknod d2/d21/d33/cb5 0 2024-04-20T21:59:02.349 INFO:tasks.workunit.client.1.smithi164.stdout:8/458: dwrite d0/d1e/f6b [0,4194304] 0 2024-04-20T21:59:02.349 INFO:tasks.workunit.client.1.smithi164.stdout:2/547: write d2/d5/d3a/d55/f73 [553299,112854] 0 2024-04-20T21:59:02.350 INFO:tasks.workunit.client.1.smithi164.stdout:3/571: dwrite d12/d2a/f42 [4194304,4194304] 0 2024-04-20T21:59:02.354 INFO:tasks.workunit.client.1.smithi164.stdout:9/584: rename d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/lb8 to d3/d9f/lcd 0 2024-04-20T21:59:02.359 INFO:tasks.workunit.client.1.smithi164.stdout:0/511: dwrite d1/d2b/f6b [0,4194304] 0 2024-04-20T21:59:02.362 INFO:tasks.workunit.client.1.smithi164.stdout:5/609: mknod dc/d2c/d2e/cd3 0 2024-04-20T21:59:02.362 INFO:tasks.workunit.client.1.smithi164.stdout:4/484: creat d4/d28/f9a x:0 0 0 2024-04-20T21:59:02.363 INFO:tasks.workunit.client.1.smithi164.stdout:6/565: mknod d0/d3/d15/d23/d45/d4f/cc0 0 2024-04-20T21:59:02.368 INFO:tasks.workunit.client.1.smithi164.stdout:9/585: stat d3/db/dd/fe 0 2024-04-20T21:59:02.370 INFO:tasks.workunit.client.1.smithi164.stdout:2/548: chown d2/d19/c3d 165 1 2024-04-20T21:59:02.371 INFO:tasks.workunit.client.1.smithi164.stdout:3/572: symlink d12/d68/d6f/lb3 0 2024-04-20T21:59:02.374 INFO:tasks.workunit.client.1.smithi164.stdout:9/586: dread - d3/f95 zero size 2024-04-20T21:59:02.377 INFO:tasks.workunit.client.1.smithi164.stdout:1/468: dwrite d10/f11 [0,4194304] 0 2024-04-20T21:59:02.382 INFO:tasks.workunit.client.1.smithi164.stdout:2/549: dread - d2/d30/f4a zero size 2024-04-20T21:59:02.387 INFO:tasks.workunit.client.1.smithi164.stdout:9/587: write d3/db/d1b/d20/fb4 [140063,114743] 0 2024-04-20T21:59:02.387 INFO:tasks.workunit.client.1.smithi164.stdout:7/523: symlink d2/d21/d24/daf/lb6 0 2024-04-20T21:59:02.389 INFO:tasks.workunit.client.1.smithi164.stdout:1/469: symlink d10/d16/d20/d26/d34/l9b 0 2024-04-20T21:59:02.390 INFO:tasks.workunit.client.1.smithi164.stdout:3/573: chown d12/d20/f2b 550779783 1 2024-04-20T21:59:02.390 INFO:tasks.workunit.client.1.smithi164.stdout:9/588: chown d3/db/f8c 73 1 2024-04-20T21:59:02.394 INFO:tasks.workunit.client.1.smithi164.stdout:8/459: rename d0/d14/d4e/f54 to d0/d14/d4e/d62/d82/d97/f9c 0 2024-04-20T21:59:02.396 INFO:tasks.workunit.client.1.smithi164.stdout:3/574: fsync d12/d20/da2/faf 0 2024-04-20T21:59:02.396 INFO:tasks.workunit.client.1.smithi164.stdout:9/589: chown d3/db/l5a 53065476 1 2024-04-20T21:59:02.405 INFO:tasks.workunit.client.1.smithi164.stdout:6/566: dread d0/d3/d27/d9d/fa3 [0,4194304] 0 2024-04-20T21:59:02.407 INFO:tasks.workunit.client.1.smithi164.stdout:4/485: getdents d4/d9/d27/d3f/d8c 0 2024-04-20T21:59:02.409 INFO:tasks.workunit.client.1.smithi164.stdout:7/524: fsync d2/d21/f45 0 2024-04-20T21:59:02.412 INFO:tasks.workunit.client.1.smithi164.stdout:8/460: mkdir d0/d14/d16/d9d 0 2024-04-20T21:59:02.414 INFO:tasks.workunit.client.1.smithi164.stdout:1/470: mknod d10/d33/d7f/d8c/c9c 0 2024-04-20T21:59:02.418 INFO:tasks.workunit.client.1.smithi164.stdout:7/525: write d2/f48 [4328638,72176] 0 2024-04-20T21:59:02.420 INFO:tasks.workunit.client.1.smithi164.stdout:6/567: chown d0/d3/d15/d21/d5c/c6c 12587 1 2024-04-20T21:59:02.422 INFO:tasks.workunit.client.1.smithi164.stdout:8/461: fsync d0/f40 0 2024-04-20T21:59:02.422 INFO:tasks.workunit.client.1.smithi164.stdout:5/610: dwrite dc/d2b/d6d/fa6 [0,4194304] 0 2024-04-20T21:59:02.425 INFO:tasks.workunit.client.1.smithi164.stdout:2/550: dwrite d2/d5/d3a/f6a [0,4194304] 0 2024-04-20T21:59:02.426 INFO:tasks.workunit.client.1.smithi164.stdout:0/512: dwrite d1/d4/d26/d29/d2d/f8a [0,4194304] 0 2024-04-20T21:59:02.430 INFO:tasks.workunit.client.1.smithi164.stdout:1/471: rmdir d10/d16/d19 39 2024-04-20T21:59:02.433 INFO:tasks.workunit.client.1.smithi164.stdout:3/575: dwrite d12/d20/d39/f54 [0,4194304] 0 2024-04-20T21:59:02.438 INFO:tasks.workunit.client.1.smithi164.stdout:1/472: read - d10/d16/f72 zero size 2024-04-20T21:59:02.442 INFO:tasks.workunit.client.1.smithi164.stdout:8/462: stat d0/d14/d4e/d86/f8c 0 2024-04-20T21:59:02.443 INFO:tasks.workunit.client.1.smithi164.stdout:0/513: truncate d1/d4/d26/f76 1459939 0 2024-04-20T21:59:02.445 INFO:tasks.workunit.client.1.smithi164.stdout:9/590: write d3/db/dd/d40/d2a/f77 [949448,58683] 0 2024-04-20T21:59:02.446 INFO:tasks.workunit.client.1.smithi164.stdout:3/576: symlink d12/d6d/lb4 0 2024-04-20T21:59:02.448 INFO:tasks.workunit.client.1.smithi164.stdout:2/551: unlink d2/d5/d3a/d55/d58/f5b 0 2024-04-20T21:59:02.453 INFO:tasks.workunit.client.1.smithi164.stdout:6/568: getdents d0/d3/d62/d8e 0 2024-04-20T21:59:02.457 INFO:tasks.workunit.client.1.smithi164.stdout:4/486: dwrite d4/d9/d27/d3f/d5f/f80 [0,4194304] 0 2024-04-20T21:59:02.459 INFO:tasks.workunit.client.1.smithi164.stdout:3/577: truncate d12/f90 63005 0 2024-04-20T21:59:02.460 INFO:tasks.workunit.client.1.smithi164.stdout:1/473: mkdir d10/d16/d20/d91/d9d 0 2024-04-20T21:59:02.462 INFO:tasks.workunit.client.1.smithi164.stdout:2/552: write d2/d5/d3a/f6a [1074741,99150] 0 2024-04-20T21:59:02.463 INFO:tasks.workunit.client.1.smithi164.stdout:6/569: fdatasync d0/d3/d62/d75/fa1 0 2024-04-20T21:59:02.463 INFO:tasks.workunit.client.1.smithi164.stdout:3/578: dread - d12/d6d/fa9 zero size 2024-04-20T21:59:02.469 INFO:tasks.workunit.client.1.smithi164.stdout:4/487: chown d4/d9/d22 17065 1 2024-04-20T21:59:02.472 INFO:tasks.workunit.client.1.smithi164.stdout:5/611: getdents dc/d2c/d2e/d30/d5e 0 2024-04-20T21:59:02.474 INFO:tasks.workunit.client.1.smithi164.stdout:9/591: mkdir d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/dce 0 2024-04-20T21:59:02.476 INFO:tasks.workunit.client.1.smithi164.stdout:0/514: getdents d1/d4/da/d27 0 2024-04-20T21:59:02.479 INFO:tasks.workunit.client.1.smithi164.stdout:3/579: fdatasync d12/d15/f1c 0 2024-04-20T21:59:02.485 INFO:tasks.workunit.client.1.smithi164.stdout:7/526: truncate d2/d21/d24/d31/d3a/f81 1335110 0 2024-04-20T21:59:02.486 INFO:tasks.workunit.client.1.smithi164.stdout:6/570: creat d0/d3/d11/d29/d6e/fc1 x:0 0 0 2024-04-20T21:59:02.488 INFO:tasks.workunit.client.1.smithi164.stdout:9/592: creat d3/db/dd/d40/d78/fcf x:0 0 0 2024-04-20T21:59:02.492 INFO:tasks.workunit.client.1.smithi164.stdout:2/553: rename d2/c4 to d2/d5/d3a/d55/d58/da2/ca7 0 2024-04-20T21:59:02.495 INFO:tasks.workunit.client.1.smithi164.stdout:3/580: mknod d12/d2a/cb5 0 2024-04-20T21:59:02.499 INFO:tasks.workunit.client.1.smithi164.stdout:6/571: creat d0/d3/d8/d81/fc2 x:0 0 0 2024-04-20T21:59:02.499 INFO:tasks.workunit.client.1.smithi164.stdout:9/593: symlink d3/db/dd/ld0 0 2024-04-20T21:59:02.502 INFO:tasks.workunit.client.1.smithi164.stdout:2/554: mknod d2/d5/d3a/d55/d58/ca8 0 2024-04-20T21:59:02.504 INFO:tasks.workunit.client.1.smithi164.stdout:1/474: truncate d10/d16/f43 2859921 0 2024-04-20T21:59:02.509 INFO:tasks.workunit.client.1.smithi164.stdout:7/527: dwrite d2/d21/f89 [0,4194304] 0 2024-04-20T21:59:02.510 INFO:tasks.workunit.client.1.smithi164.stdout:8/463: dread d0/f19 [0,4194304] 0 2024-04-20T21:59:02.513 INFO:tasks.workunit.client.1.smithi164.stdout:3/581: write d12/d20/f22 [470093,22462] 0 2024-04-20T21:59:02.516 INFO:tasks.workunit.client.1.smithi164.stdout:0/515: link d1/d4/da/d27/l73 d1/d4/da/d5c/l98 0 2024-04-20T21:59:02.519 INFO:tasks.workunit.client.1.smithi164.stdout:3/582: write d12/f51 [1042932,81894] 0 2024-04-20T21:59:02.520 INFO:tasks.workunit.client.1.smithi164.stdout:5/612: dwrite dc/d12/d81/f68 [0,4194304] 0 2024-04-20T21:59:02.524 INFO:tasks.workunit.client.1.smithi164.stdout:4/488: dread d4/d9/d27/d3f/f7f [0,4194304] 0 2024-04-20T21:59:02.524 INFO:tasks.workunit.client.1.smithi164.stdout:4/489: chown d4/c8 76 1 2024-04-20T21:59:02.526 INFO:tasks.workunit.client.1.smithi164.stdout:8/464: rename d0/d14/d16/d5a/c90 to d0/d14/d16/d58/d73/c9e 0 2024-04-20T21:59:02.527 INFO:tasks.workunit.client.1.smithi164.stdout:1/475: write d10/d16/d20/d26/d34/f89 [2551292,20026] 0 2024-04-20T21:59:02.528 INFO:tasks.workunit.client.1.smithi164.stdout:3/583: stat d12/d15/f70 0 2024-04-20T21:59:02.536 INFO:tasks.workunit.client.1.smithi164.stdout:6/572: truncate d0/d3/d11/f49 5304493 0 2024-04-20T21:59:02.538 INFO:tasks.workunit.client.1.smithi164.stdout:3/584: creat d12/d20/d39/d69/d83/fb6 x:0 0 0 2024-04-20T21:59:02.539 INFO:tasks.workunit.client.1.smithi164.stdout:8/465: read d0/d14/f13 [4835606,49554] 0 2024-04-20T21:59:02.543 INFO:tasks.workunit.client.1.smithi164.stdout:0/516: rename d1/d4/df/d56/c85 to d1/d4/df/c99 0 2024-04-20T21:59:02.544 INFO:tasks.workunit.client.1.smithi164.stdout:1/476: creat d10/f9e x:0 0 0 2024-04-20T21:59:02.545 INFO:tasks.workunit.client.1.smithi164.stdout:4/490: dwrite d4/d9/f1e [0,4194304] 0 2024-04-20T21:59:02.549 INFO:tasks.workunit.client.1.smithi164.stdout:6/573: write d0/d3/d15/d23/d45/d4f/f68 [1210799,15214] 0 2024-04-20T21:59:02.549 INFO:tasks.workunit.client.1.smithi164.stdout:5/613: getdents dc/d12/d1e 0 2024-04-20T21:59:02.555 INFO:tasks.workunit.client.1.smithi164.stdout:3/585: fsync d12/d20/f7e 0 2024-04-20T21:59:02.559 INFO:tasks.workunit.client.1.smithi164.stdout:0/517: unlink d1/d4/da/d27/l7b 0 2024-04-20T21:59:02.565 INFO:tasks.workunit.client.1.smithi164.stdout:6/574: mkdir d0/d3/d27/d9d/dc3 0 2024-04-20T21:59:02.570 INFO:tasks.workunit.client.1.smithi164.stdout:8/466: dread d0/d14/d4e/d6f/f79 [0,4194304] 0 2024-04-20T21:59:02.571 INFO:tasks.workunit.client.1.smithi164.stdout:4/491: mkdir d4/d9/d27/d3f/d9b 0 2024-04-20T21:59:02.574 INFO:tasks.workunit.client.1.smithi164.stdout:4/492: read - d4/d28/f9a zero size 2024-04-20T21:59:02.575 INFO:tasks.workunit.client.1.smithi164.stdout:6/575: write d0/d3/d15/d23/d45/d69/f8d [117964,72909] 0 2024-04-20T21:59:02.575 INFO:tasks.workunit.client.1.smithi164.stdout:5/614: dwrite f5 [4194304,4194304] 0 2024-04-20T21:59:02.576 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:02 smithi164 ceph-mon[23506]: pgmap v8: 65 pgs: 65 active+clean; 2.8 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 25 MiB/s rd, 89 MiB/s wr, 205 op/s 2024-04-20T21:59:02.576 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:02 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:02.576 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:02 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:02.584 INFO:tasks.workunit.client.1.smithi164.stdout:6/576: write d0/d3/d8/f3c [542934,43069] 0 2024-04-20T21:59:02.584 INFO:tasks.workunit.client.1.smithi164.stdout:1/477: truncate d10/d16/d19/d1a/f32 274584 0 2024-04-20T21:59:02.586 INFO:tasks.workunit.client.1.smithi164.stdout:3/586: truncate d12/d15/f19 798778 0 2024-04-20T21:59:02.588 INFO:tasks.workunit.client.1.smithi164.stdout:5/615: mknod dc/d12/cd4 0 2024-04-20T21:59:02.588 INFO:tasks.workunit.client.1.smithi164.stdout:0/518: dwrite d1/d4/d26/f46 [0,4194304] 0 2024-04-20T21:59:02.590 INFO:tasks.workunit.client.1.smithi164.stdout:1/478: readlink d10/d16/d20/d26/d34/l6d 0 2024-04-20T21:59:02.595 INFO:tasks.workunit.client.1.smithi164.stdout:3/587: creat d12/d20/d39/d69/d77/fb7 x:0 0 0 2024-04-20T21:59:02.596 INFO:tasks.workunit.client.1.smithi164.stdout:0/519: creat d1/d4/d20/f9a x:0 0 0 2024-04-20T21:59:02.600 INFO:tasks.workunit.client.1.smithi164.stdout:4/493: getdents d4/d28/d3e/d4a 0 2024-04-20T21:59:02.602 INFO:tasks.workunit.client.1.smithi164.stdout:3/588: mkdir d12/d20/d39/d69/db8 0 2024-04-20T21:59:02.607 INFO:tasks.workunit.client.1.smithi164.stdout:0/520: getdents d1/d4/d26/d29/d2d/d54 0 2024-04-20T21:59:02.607 INFO:tasks.workunit.client.1.smithi164.stdout:4/494: truncate d4/f39 1722244 0 2024-04-20T21:59:02.608 INFO:tasks.workunit.client.1.smithi164.stdout:3/589: read d12/d20/d39/f5d [138741,77615] 0 2024-04-20T21:59:02.610 INFO:tasks.workunit.client.1.smithi164.stdout:6/577: dwrite d0/d3/f80 [0,4194304] 0 2024-04-20T21:59:02.617 INFO:tasks.workunit.client.1.smithi164.stdout:0/521: read - d1/d4/da/d5c/d6e/f96 zero size 2024-04-20T21:59:02.618 INFO:tasks.workunit.client.1.smithi164.stdout:6/578: fdatasync d0/fbe 0 2024-04-20T21:59:02.618 INFO:tasks.workunit.client.1.smithi164.stdout:3/590: chown d12/d68/d6f/c98 36576985 1 2024-04-20T21:59:02.621 INFO:tasks.workunit.client.1.smithi164.stdout:4/495: mknod d4/d9/d22/c9c 0 2024-04-20T21:59:02.621 INFO:tasks.workunit.client.1.smithi164.stdout:5/616: dwrite dc/f16 [0,4194304] 0 2024-04-20T21:59:02.624 INFO:tasks.workunit.client.1.smithi164.stdout:5/617: fsync dc/f88 0 2024-04-20T21:59:02.629 INFO:tasks.workunit.client.1.smithi164.stdout:6/579: write d0/d3/d11/d5a/f90 [31084,8935] 0 2024-04-20T21:59:02.630 INFO:tasks.workunit.client.1.smithi164.stdout:1/479: truncate d10/d16/d19/d1a/f32 1000210 0 2024-04-20T21:59:02.632 INFO:tasks.workunit.client.1.smithi164.stdout:3/591: mkdir d12/d20/d39/d69/d83/db9 0 2024-04-20T21:59:02.632 INFO:tasks.workunit.client.1.smithi164.stdout:8/467: dread d0/d14/d16/d5a/f5c [0,4194304] 0 2024-04-20T21:59:02.635 INFO:tasks.workunit.client.1.smithi164.stdout:4/496: symlink d4/d9/d27/d3f/d67/d86/l9d 0 2024-04-20T21:59:02.636 INFO:tasks.workunit.client.1.smithi164.stdout:9/594: sync 2024-04-20T21:59:02.636 INFO:tasks.workunit.client.1.smithi164.stdout:5/618: creat dc/d2b/d52/fd5 x:0 0 0 2024-04-20T21:59:02.641 INFO:tasks.workunit.client.1.smithi164.stdout:1/480: symlink d10/d16/d20/d26/l9f 0 2024-04-20T21:59:02.642 INFO:tasks.workunit.client.1.smithi164.stdout:5/619: readlink dc/d12/d1e/da8/lbf 0 2024-04-20T21:59:02.643 INFO:tasks.workunit.client.1.smithi164.stdout:3/592: creat d12/d20/d39/d55/d87/fba x:0 0 0 2024-04-20T21:59:02.645 INFO:tasks.workunit.client.1.smithi164.stdout:9/595: mknod d3/d9f/cd1 0 2024-04-20T21:59:02.648 INFO:tasks.workunit.client.1.smithi164.stdout:0/522: dread d1/d4/d26/d29/d2d/f8a [0,4194304] 0 2024-04-20T21:59:02.648 INFO:tasks.workunit.client.1.smithi164.stdout:5/620: fdatasync dc/d2b/d6d/f6f 0 2024-04-20T21:59:02.649 INFO:tasks.workunit.client.1.smithi164.stdout:4/497: creat d4/d9/d27/d37/f9e x:0 0 0 2024-04-20T21:59:02.649 INFO:tasks.workunit.client.1.smithi164.stdout:1/481: read d10/f12 [585892,1672] 0 2024-04-20T21:59:02.649 INFO:tasks.workunit.client.1.smithi164.stdout:6/580: creat d0/d3/d27/fc4 x:0 0 0 2024-04-20T21:59:02.651 INFO:tasks.workunit.client.1.smithi164.stdout:9/596: stat d3/db 0 2024-04-20T21:59:02.653 INFO:tasks.workunit.client.1.smithi164.stdout:9/597: readlink d3/l31 0 2024-04-20T21:59:02.654 INFO:tasks.workunit.client.1.smithi164.stdout:5/621: unlink dc/d12/d1e/f1f 0 2024-04-20T21:59:02.655 INFO:tasks.workunit.client.1.smithi164.stdout:3/593: getdents d12/d20/d39/d69/d83/db9 0 2024-04-20T21:59:02.658 INFO:tasks.workunit.client.1.smithi164.stdout:4/498: creat d4/d28/d3e/d4a/f9f x:0 0 0 2024-04-20T21:59:02.658 INFO:tasks.workunit.client.1.smithi164.stdout:6/581: mknod d0/d3/d15/cc5 0 2024-04-20T21:59:02.659 INFO:tasks.workunit.client.1.smithi164.stdout:5/622: chown dc/d2c/l9c 572 1 2024-04-20T21:59:02.665 INFO:tasks.workunit.client.1.smithi164.stdout:8/468: dwrite d0/d14/d16/d58/f74 [0,4194304] 0 2024-04-20T21:59:02.667 INFO:tasks.workunit.client.1.smithi164.stdout:5/623: chown dc/d2b/d52/cc7 85729 1 2024-04-20T21:59:02.670 INFO:tasks.workunit.client.1.smithi164.stdout:6/582: rmdir d0/d3/d15/d21 39 2024-04-20T21:59:02.673 INFO:tasks.workunit.client.1.smithi164.stdout:1/482: dread d10/d33/f3f [4194304,4194304] 0 2024-04-20T21:59:02.676 INFO:tasks.workunit.client.1.smithi164.stdout:6/583: chown d0/c54 2 1 2024-04-20T21:59:02.676 INFO:tasks.workunit.client.1.smithi164.stdout:8/469: rename d0/d14/d4e/d62 to d0/d14/d4e/d62/d82/d9f 22 2024-04-20T21:59:02.678 INFO:tasks.workunit.client.1.smithi164.stdout:5/624: mkdir dc/d2b/d6d/d73/dd6 0 2024-04-20T21:59:02.683 INFO:tasks.workunit.client.1.smithi164.stdout:9/598: dwrite d3/db/dd/f23 [0,4194304] 0 2024-04-20T21:59:02.684 INFO:tasks.workunit.client.1.smithi164.stdout:6/584: chown d0/d3/d11/d29/l35 39311 1 2024-04-20T21:59:02.690 INFO:tasks.workunit.client.1.smithi164.stdout:6/585: fsync d0/d3/d15/f2c 0 2024-04-20T21:59:02.690 INFO:tasks.workunit.client.1.smithi164.stdout:4/499: truncate d4/d9/d27/d3f/f4f 491548 0 2024-04-20T21:59:02.691 INFO:tasks.workunit.client.1.smithi164.stdout:6/586: stat d0/d3/d62/d75/fa1 0 2024-04-20T21:59:02.694 INFO:tasks.workunit.client.1.smithi164.stdout:4/500: creat d4/d28/d3e/d41/fa0 x:0 0 0 2024-04-20T21:59:02.695 INFO:tasks.workunit.client.1.smithi164.stdout:8/470: rename d0/d14/d16/d5a/f71 to d0/d14/fa0 0 2024-04-20T21:59:02.697 INFO:tasks.workunit.client.1.smithi164.stdout:0/523: dread d1/d4/d20/d74/f35 [0,4194304] 0 2024-04-20T21:59:02.699 INFO:tasks.workunit.client.1.smithi164.stdout:8/471: write d0/f84 [984214,57830] 0 2024-04-20T21:59:02.699 INFO:tasks.workunit.client.1.smithi164.stdout:9/599: truncate d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/fa9 142070 0 2024-04-20T21:59:02.704 INFO:tasks.workunit.client.1.smithi164.stdout:4/501: mknod d4/d9/d27/d3f/d67/ca1 0 2024-04-20T21:59:02.707 INFO:tasks.workunit.client.1.smithi164.stdout:3/594: dread d12/d15/f21 [0,4194304] 0 2024-04-20T21:59:02.713 INFO:tasks.workunit.client.1.smithi164.stdout:3/595: dread - d12/d2a/f8a zero size 2024-04-20T21:59:02.713 INFO:tasks.workunit.client.1.smithi164.stdout:1/483: dwrite d10/f5c [0,4194304] 0 2024-04-20T21:59:02.714 INFO:tasks.workunit.client.1.smithi164.stdout:4/502: chown d4/d9/d27/d3f/d67/d86/l81 1 1 2024-04-20T21:59:02.715 INFO:tasks.workunit.client.1.smithi164.stdout:8/472: creat d0/d14/d4e/fa1 x:0 0 0 2024-04-20T21:59:02.725 INFO:tasks.workunit.client.1.smithi164.stdout:4/503: dread - d4/d9/d27/f35 zero size 2024-04-20T21:59:02.728 INFO:tasks.workunit.client.1.smithi164.stdout:3/596: rename d12/f5a to d12/d20/d39/d69/d77/d81/fbb 0 2024-04-20T21:59:02.729 INFO:tasks.workunit.client.1.smithi164.stdout:0/524: dwrite d1/d4/df/d56/f8c [0,4194304] 0 2024-04-20T21:59:02.737 INFO:tasks.workunit.client.1.smithi164.stdout:6/587: dwrite d0/d3/d15/d23/d45/d4f/f66 [0,4194304] 0 2024-04-20T21:59:02.745 INFO:tasks.workunit.client.1.smithi164.stdout:3/597: symlink d12/d68/d6f/d71/lbc 0 2024-04-20T21:59:02.745 INFO:tasks.workunit.client.1.smithi164.stdout:6/588: dread - d0/d3/d15/d23/d45/d4f/d9c/fb9 zero size 2024-04-20T21:59:02.746 INFO:tasks.workunit.client.1.smithi164.stdout:8/473: creat d0/d14/d4e/fa2 x:0 0 0 2024-04-20T21:59:02.746 INFO:tasks.workunit.client.1.smithi164.stdout:0/525: mkdir d1/d4/d26/d29/d2d/d9b 0 2024-04-20T21:59:02.747 INFO:tasks.workunit.client.1.smithi164.stdout:9/600: dread d3/db/f8c [0,4194304] 0 2024-04-20T21:59:02.748 INFO:tasks.workunit.client.1.smithi164.stdout:1/484: dwrite d10/f9e [0,4194304] 0 2024-04-20T21:59:02.755 INFO:tasks.workunit.client.1.smithi164.stdout:6/589: mknod d0/d3/d11/cc6 0 2024-04-20T21:59:02.761 INFO:tasks.workunit.client.1.smithi164.stdout:9/601: creat d3/db/dd/d40/d2a/fd2 x:0 0 0 2024-04-20T21:59:02.762 INFO:tasks.workunit.client.1.smithi164.stdout:8/474: symlink d0/d14/d4e/d6f/la3 0 2024-04-20T21:59:02.763 INFO:tasks.workunit.client.1.smithi164.stdout:1/485: creat d10/d7d/fa0 x:0 0 0 2024-04-20T21:59:02.764 INFO:tasks.workunit.client.1.smithi164.stdout:9/602: chown d3/db/dd/l37 633 1 2024-04-20T21:59:02.765 INFO:tasks.workunit.client.1.smithi164.stdout:4/504: dwrite d4/d28/f76 [0,4194304] 0 2024-04-20T21:59:02.765 INFO:tasks.workunit.client.1.smithi164.stdout:3/598: link d12/d2a/c2d d12/d2a/db1/cbd 0 2024-04-20T21:59:02.775 INFO:tasks.workunit.client.1.smithi164.stdout:9/603: mkdir d3/db0/dd3 0 2024-04-20T21:59:02.779 INFO:tasks.workunit.client.1.smithi164.stdout:9/604: readlink d3/db/d1b/l6d 0 2024-04-20T21:59:02.782 INFO:tasks.workunit.client.1.smithi164.stdout:1/486: rename d10/l1c to d10/d7d/la1 0 2024-04-20T21:59:02.782 INFO:tasks.workunit.client.1.smithi164.stdout:6/590: link d0/d3/d11/d5a/c8c d0/d3/d15/d21/d5c/dbf/dbd/cc7 0 2024-04-20T21:59:02.784 INFO:tasks.workunit.client.1.smithi164.stdout:0/526: dwrite d1/d4/da/f6d [0,4194304] 0 2024-04-20T21:59:02.788 INFO:tasks.workunit.client.1.smithi164.stdout:6/591: chown d0/d3/c95 2048 1 2024-04-20T21:59:02.788 INFO:tasks.workunit.client.1.smithi164.stdout:9/605: dread - d3/db/d1b/d20/d3f/d8a/da7/dbd/fa2 zero size 2024-04-20T21:59:02.788 INFO:tasks.workunit.client.1.smithi164.stdout:1/487: chown d10/d16/d19/d1a/l47 4549697 1 2024-04-20T21:59:02.789 INFO:tasks.workunit.client.1.smithi164.stdout:0/527: truncate d1/f12 4698562 0 2024-04-20T21:59:02.791 INFO:tasks.workunit.client.1.smithi164.stdout:9/606: write d3/f1f [1631341,61479] 0 2024-04-20T21:59:02.793 INFO:tasks.workunit.client.1.smithi164.stdout:0/528: chown d1/d4/df 456010775 1 2024-04-20T21:59:02.794 INFO:tasks.workunit.client.1.smithi164.stdout:2/555: sync 2024-04-20T21:59:02.795 INFO:tasks.workunit.client.1.smithi164.stdout:7/528: sync 2024-04-20T21:59:02.796 INFO:tasks.workunit.client.1.smithi164.stdout:2/556: fdatasync d2/d19/d28/f38 0 2024-04-20T21:59:02.799 INFO:tasks.workunit.client.1.smithi164.stdout:1/488: creat d10/d8a/fa2 x:0 0 0 2024-04-20T21:59:02.800 INFO:tasks.workunit.client.1.smithi164.stdout:7/529: write d2/d21/d24/d60/f9f [864313,16539] 0 2024-04-20T21:59:02.805 INFO:tasks.workunit.client.1.smithi164.stdout:0/529: unlink d1/d4/d20/f9a 0 2024-04-20T21:59:02.808 INFO:tasks.workunit.client.1.smithi164.stdout:2/557: creat d2/d5f/fa9 x:0 0 0 2024-04-20T21:59:02.809 INFO:tasks.workunit.client.1.smithi164.stdout:4/505: dwrite d4/d9/d27/d3f/d67/f98 [0,4194304] 0 2024-04-20T21:59:02.810 INFO:tasks.workunit.client.1.smithi164.stdout:7/530: write d2/d21/d33/f40 [477485,66946] 0 2024-04-20T21:59:02.815 INFO:tasks.workunit.client.1.smithi164.stdout:8/475: dwrite d0/d14/d16/d58/f60 [0,4194304] 0 2024-04-20T21:59:02.815 INFO:tasks.workunit.client.1.smithi164.stdout:6/592: rename d0/d3/d15/cc5 to d0/d3/d11/d29/cc8 0 2024-04-20T21:59:02.820 INFO:tasks.workunit.client.1.smithi164.stdout:1/489: creat d10/d33/d48/d8b/fa3 x:0 0 0 2024-04-20T21:59:02.820 INFO:tasks.workunit.client.1.smithi164.stdout:7/531: mknod d2/d21/d24/d60/d82/d93/cb7 0 2024-04-20T21:59:02.822 INFO:tasks.workunit.client.1.smithi164.stdout:6/593: stat d0/d3/d15/d21/d5c/f78 0 2024-04-20T21:59:02.822 INFO:tasks.workunit.client.1.smithi164.stdout:9/607: link d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/fab d3/db/d82/d98/db6/fd4 0 2024-04-20T21:59:02.823 INFO:tasks.workunit.client.1.smithi164.stdout:0/530: mknod d1/d4/df/d56/c9c 0 2024-04-20T21:59:02.825 INFO:tasks.workunit.client.1.smithi164.stdout:2/558: symlink d2/d30/laa 0 2024-04-20T21:59:02.825 INFO:tasks.workunit.client.1.smithi164.stdout:1/490: fsync d10/f73 0 2024-04-20T21:59:02.826 INFO:tasks.workunit.client.1.smithi164.stdout:6/594: readlink d0/d3/d27/l58 0 2024-04-20T21:59:02.827 INFO:tasks.workunit.client.1.smithi164.stdout:0/531: rmdir d1/d4/da 39 2024-04-20T21:59:02.833 INFO:tasks.workunit.client.1.smithi164.stdout:4/506: dwrite d4/d28/f91 [0,4194304] 0 2024-04-20T21:59:02.836 INFO:tasks.workunit.client.1.smithi164.stdout:6/595: dread - d0/d3/d15/d21/d5c/fa5 zero size 2024-04-20T21:59:02.840 INFO:tasks.workunit.client.1.smithi164.stdout:1/491: creat d10/d33/d48/fa4 x:0 0 0 2024-04-20T21:59:02.843 INFO:tasks.workunit.client.1.smithi164.stdout:8/476: link d0/d14/f2a d0/d14/d4e/d86/fa4 0 2024-04-20T21:59:02.846 INFO:tasks.workunit.client.1.smithi164.stdout:4/507: mknod d4/d9/d27/d3f/d67/d86/ca2 0 2024-04-20T21:59:02.846 INFO:tasks.workunit.client.1.smithi164.stdout:7/532: dwrite d2/f8e [0,4194304] 0 2024-04-20T21:59:02.848 INFO:tasks.workunit.client.1.smithi164.stdout:9/608: mkdir d3/db/d82/d98/db6/dd5 0 2024-04-20T21:59:02.850 INFO:tasks.workunit.client.1.smithi164.stdout:7/533: write d2/d21/d44/f98 [232657,15154] 0 2024-04-20T21:59:02.853 INFO:tasks.workunit.client.1.smithi164.stdout:1/492: creat d10/d7d/fa5 x:0 0 0 2024-04-20T21:59:02.853 INFO:tasks.workunit.client.1.smithi164.stdout:8/477: mkdir d0/d14/d16/d58/d94/da5 0 2024-04-20T21:59:02.858 INFO:tasks.workunit.client.1.smithi164.stdout:0/532: creat d1/d4/d26/f9d x:0 0 0 2024-04-20T21:59:02.862 INFO:tasks.workunit.client.1.smithi164.stdout:1/493: symlink d10/d33/d41/la6 0 2024-04-20T21:59:02.864 INFO:tasks.workunit.client.1.smithi164.stdout:1/494: truncate d10/f5e 4563671 0 2024-04-20T21:59:02.867 INFO:tasks.workunit.client.1.smithi164.stdout:0/533: fdatasync d1/f22 0 2024-04-20T21:59:02.869 INFO:tasks.workunit.client.1.smithi164.stdout:7/534: mkdir d2/d21/d24/d31/d3a/daa/db8 0 2024-04-20T21:59:02.873 INFO:tasks.workunit.client.1.smithi164.stdout:7/535: creat d2/d21/d24/d8a/fb9 x:0 0 0 2024-04-20T21:59:02.879 INFO:tasks.workunit.client.1.smithi164.stdout:4/508: write d4/f39 [1450772,6953] 0 2024-04-20T21:59:02.882 INFO:tasks.workunit.client.1.smithi164.stdout:7/536: dread d2/d21/fb2 [4194304,4194304] 0 2024-04-20T21:59:02.883 INFO:tasks.workunit.client.1.smithi164.stdout:8/478: dwrite d0/f1b [0,4194304] 0 2024-04-20T21:59:02.892 INFO:tasks.workunit.client.1.smithi164.stdout:4/509: truncate d4/d9/d27/f7d 64639 0 2024-04-20T21:59:02.893 INFO:tasks.workunit.client.1.smithi164.stdout:8/479: fdatasync d0/d14/d4e/d86/fa4 0 2024-04-20T21:59:02.899 INFO:tasks.workunit.client.1.smithi164.stdout:1/495: dwrite d10/d16/d19/f4e [0,4194304] 0 2024-04-20T21:59:02.902 INFO:tasks.workunit.client.1.smithi164.stdout:8/480: symlink d0/d14/d4e/d86/la6 0 2024-04-20T21:59:02.902 INFO:tasks.workunit.client.1.smithi164.stdout:9/609: dread d3/db/dd/d40/f56 [0,4194304] 0 2024-04-20T21:59:02.902 INFO:tasks.workunit.client.1.smithi164.stdout:4/510: creat d4/d9/d27/d3f/fa3 x:0 0 0 2024-04-20T21:59:02.906 INFO:tasks.workunit.client.1.smithi164.stdout:4/511: read - d4/d9/d27/f35 zero size 2024-04-20T21:59:02.906 INFO:tasks.workunit.client.1.smithi164.stdout:8/481: write d0/d14/d5f/f95 [714591,9408] 0 2024-04-20T21:59:02.910 INFO:tasks.workunit.client.1.smithi164.stdout:9/610: getdents d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/dbf 0 2024-04-20T21:59:02.911 INFO:tasks.workunit.client.1.smithi164.stdout:5/625: sync 2024-04-20T21:59:02.912 INFO:tasks.workunit.client.1.smithi164.stdout:8/482: write d0/d14/d4e/fa2 [5970,74572] 0 2024-04-20T21:59:02.915 INFO:tasks.workunit.client.1.smithi164.stdout:4/512: mkdir d4/d9/da4 0 2024-04-20T21:59:02.917 INFO:tasks.workunit.client.1.smithi164.stdout:8/483: read - d0/d14/d16/f70 zero size 2024-04-20T21:59:02.917 INFO:tasks.workunit.client.1.smithi164.stdout:7/537: dwrite d2/d21/d24/f4c [0,4194304] 0 2024-04-20T21:59:02.920 INFO:tasks.workunit.client.1.smithi164.stdout:5/626: fdatasync dc/d2b/d52/f76 0 2024-04-20T21:59:02.923 INFO:tasks.workunit.client.1.smithi164.stdout:4/513: symlink d4/d9/d27/d3f/d8c/la5 0 2024-04-20T21:59:02.923 INFO:tasks.workunit.client.1.smithi164.stdout:8/484: write d0/d14/d4e/d6f/f79 [1204562,1665] 0 2024-04-20T21:59:02.925 INFO:tasks.workunit.client.1.smithi164.stdout:4/514: stat d4/d9/d27/d37/f51 0 2024-04-20T21:59:02.927 INFO:tasks.workunit.client.1.smithi164.stdout:7/538: mkdir d2/d21/d24/d31/d3a/d83/dba 0 2024-04-20T21:59:02.932 INFO:tasks.workunit.client.1.smithi164.stdout:5/627: read dc/f7d [3454189,80329] 0 2024-04-20T21:59:02.932 INFO:tasks.workunit.client.1.smithi164.stdout:4/515: dread - d4/d9/d27/d3f/f92 zero size 2024-04-20T21:59:02.932 INFO:tasks.workunit.client.1.smithi164.stdout:7/539: readlink d2/d21/d24/d31/d3a/l6e 0 2024-04-20T21:59:02.936 INFO:tasks.workunit.client.1.smithi164.stdout:5/628: mknod dc/d2c/d2e/d30/d72/da9/dbb/cd7 0 2024-04-20T21:59:02.938 INFO:tasks.workunit.client.1.smithi164.stdout:7/540: readlink d2/d21/d24/d31/d3a/l6e 0 2024-04-20T21:59:02.942 INFO:tasks.workunit.client.1.smithi164.stdout:5/629: creat dc/d2c/d2e/d30/d72/fd8 x:0 0 0 2024-04-20T21:59:02.943 INFO:tasks.workunit.client.1.smithi164.stdout:9/611: dwrite d3/f95 [0,4194304] 0 2024-04-20T21:59:02.944 INFO:tasks.workunit.client.1.smithi164.stdout:7/541: write d2/d21/d24/d31/f7b [4876178,55104] 0 2024-04-20T21:59:02.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:02 smithi142 ceph-mon[15828]: pgmap v8: 65 pgs: 65 active+clean; 2.8 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 25 MiB/s rd, 89 MiB/s wr, 205 op/s 2024-04-20T21:59:02.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:02 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:02.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:02 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:02.948 INFO:tasks.workunit.client.1.smithi164.stdout:5/630: symlink dc/d2b/d6d/d73/ld9 0 2024-04-20T21:59:02.952 INFO:tasks.workunit.client.1.smithi164.stdout:9/612: mknod d3/db/d1b/cd6 0 2024-04-20T21:59:02.952 INFO:tasks.workunit.client.1.smithi164.stdout:8/485: dwrite d0/d14/d16/d58/f60 [0,4194304] 0 2024-04-20T21:59:02.959 INFO:tasks.workunit.client.1.smithi164.stdout:4/516: dwrite d4/d9/d27/d3f/f4f [0,4194304] 0 2024-04-20T21:59:02.962 INFO:tasks.workunit.client.1.smithi164.stdout:5/631: rmdir dc/d12 39 2024-04-20T21:59:02.963 INFO:tasks.workunit.client.1.smithi164.stdout:8/486: creat d0/d14/d4e/d62/fa7 x:0 0 0 2024-04-20T21:59:02.963 INFO:tasks.workunit.client.1.smithi164.stdout:7/542: mkdir d2/d21/d24/d31/d3a/d83/dba/dbb 0 2024-04-20T21:59:02.968 INFO:tasks.workunit.client.1.smithi164.stdout:8/487: fdatasync d0/d14/d4e/d6f/f79 0 2024-04-20T21:59:02.973 INFO:tasks.workunit.client.1.smithi164.stdout:4/517: creat d4/d9/da4/fa6 x:0 0 0 2024-04-20T21:59:02.978 INFO:tasks.workunit.client.1.smithi164.stdout:8/488: readlink d0/l1c 0 2024-04-20T21:59:02.979 INFO:tasks.workunit.client.1.smithi164.stdout:5/632: creat dc/d2b/fda x:0 0 0 2024-04-20T21:59:02.982 INFO:tasks.workunit.client.1.smithi164.stdout:8/489: dread - d0/d14/d4e/d86/f8d zero size 2024-04-20T21:59:02.983 INFO:tasks.workunit.client.1.smithi164.stdout:9/613: dwrite d3/db/dd/d40/d2a/f4a [0,4194304] 0 2024-04-20T21:59:02.984 INFO:tasks.workunit.client.1.smithi164.stdout:4/518: link d4/d28/f9a d4/d9/d27/d3f/d9b/fa7 0 2024-04-20T21:59:02.992 INFO:tasks.workunit.client.1.smithi164.stdout:7/543: dwrite d2/d21/d24/d31/f46 [0,4194304] 0 2024-04-20T21:59:02.997 INFO:tasks.workunit.client.1.smithi164.stdout:4/519: unlink d4/d28/f61 0 2024-04-20T21:59:02.997 INFO:tasks.workunit.client.1.smithi164.stdout:8/490: creat d0/fa8 x:0 0 0 2024-04-20T21:59:03.005 INFO:tasks.workunit.client.1.smithi164.stdout:5/633: write dc/d2c/d2e/d30/f77 [2206964,51517] 0 2024-04-20T21:59:03.007 INFO:tasks.workunit.client.1.smithi164.stdout:9/614: dwrite d3/db/dd/f6b [0,4194304] 0 2024-04-20T21:59:03.010 INFO:tasks.workunit.client.1.smithi164.stdout:7/544: dread d2/d21/d24/d31/f46 [0,4194304] 0 2024-04-20T21:59:03.017 INFO:tasks.workunit.client.1.smithi164.stdout:3/599: sync 2024-04-20T21:59:03.017 INFO:tasks.workunit.client.1.smithi164.stdout:5/634: mknod dc/d2c/d2e/d30/cdb 0 2024-04-20T21:59:03.021 INFO:tasks.workunit.client.1.smithi164.stdout:3/600: rmdir d12/d68 39 2024-04-20T21:59:03.023 INFO:tasks.workunit.client.1.smithi164.stdout:3/601: chown f10 82735591 1 2024-04-20T21:59:03.026 INFO:tasks.workunit.client.1.smithi164.stdout:8/491: dwrite d0/d14/fa [4194304,4194304] 0 2024-04-20T21:59:03.031 INFO:tasks.workunit.client.1.smithi164.stdout:9/615: dwrite d3/db/dd/d40/d78/fcf [0,4194304] 0 2024-04-20T21:59:03.035 INFO:tasks.workunit.client.1.smithi164.stdout:4/520: link d4/d9/d27/d3f/d8c/la5 d4/d9/la8 0 2024-04-20T21:59:03.038 INFO:tasks.workunit.client.1.smithi164.stdout:8/492: fsync d0/f19 0 2024-04-20T21:59:03.040 INFO:tasks.workunit.client.1.smithi164.stdout:3/602: mkdir d12/d20/d39/d69/d9a/dbe 0 2024-04-20T21:59:03.043 INFO:tasks.workunit.client.1.smithi164.stdout:8/493: write d0/f1b [2798872,20391] 0 2024-04-20T21:59:03.048 INFO:tasks.workunit.client.1.smithi164.stdout:5/635: creat dc/d2b/fdc x:0 0 0 2024-04-20T21:59:03.050 INFO:tasks.workunit.client.1.smithi164.stdout:5/636: fdatasync dc/d2c/d2e/f46 0 2024-04-20T21:59:03.051 INFO:tasks.workunit.client.1.smithi164.stdout:8/494: creat d0/d14/d4e/d62/d8f/fa9 x:0 0 0 2024-04-20T21:59:03.053 INFO:tasks.workunit.client.1.smithi164.stdout:9/616: dwrite d3/db/dd/d40/d2a/d36/f48 [0,4194304] 0 2024-04-20T21:59:03.055 INFO:tasks.workunit.client.1.smithi164.stdout:7/545: truncate d2/f72 2683217 0 2024-04-20T21:59:03.058 INFO:tasks.workunit.client.1.smithi164.stdout:8/495: symlink d0/d14/d16/d58/laa 0 2024-04-20T21:59:03.060 INFO:tasks.workunit.client.1.smithi164.stdout:8/496: stat d0/d1e/f22 0 2024-04-20T21:59:03.067 INFO:tasks.workunit.client.1.smithi164.stdout:7/546: mkdir d2/d21/d24/d31/d3a/d83/dba/dbc 0 2024-04-20T21:59:03.069 INFO:tasks.workunit.client.1.smithi164.stdout:7/547: read d2/d21/f89 [2071547,113847] 0 2024-04-20T21:59:03.073 INFO:tasks.workunit.client.1.smithi164.stdout:8/497: symlink d0/d14/d16/d9d/lab 0 2024-04-20T21:59:03.081 INFO:tasks.workunit.client.1.smithi164.stdout:4/521: dread d4/d9/d22/f52 [0,4194304] 0 2024-04-20T21:59:03.082 INFO:tasks.workunit.client.1.smithi164.stdout:7/548: creat d2/d21/d24/d31/d3a/d83/fbd x:0 0 0 2024-04-20T21:59:03.086 INFO:tasks.workunit.client.1.smithi164.stdout:8/498: dread d0/d14/d16/f34 [0,4194304] 0 2024-04-20T21:59:03.087 INFO:tasks.workunit.client.1.smithi164.stdout:8/499: stat d0/d14/d4e/d86 0 2024-04-20T21:59:03.092 INFO:tasks.workunit.client.1.smithi164.stdout:9/617: link d3/db/dc4/cca d3/db/d1b/d20/d3f/dc7/cd7 0 2024-04-20T21:59:03.094 INFO:tasks.workunit.client.1.smithi164.stdout:8/500: creat d0/d14/d5f/fac x:0 0 0 2024-04-20T21:59:03.098 INFO:tasks.workunit.client.1.smithi164.stdout:7/549: truncate d2/d21/d24/d31/f41 2726081 0 2024-04-20T21:59:03.099 INFO:tasks.workunit.client.1.smithi164.stdout:5/637: dwrite dc/d2b/d53/f96 [0,4194304] 0 2024-04-20T21:59:03.101 INFO:tasks.workunit.client.1.smithi164.stdout:7/550: chown d2/d21/d24/f9a 185 1 2024-04-20T21:59:03.103 INFO:tasks.workunit.client.1.smithi164.stdout:4/522: dwrite d4/d9/f1b [0,4194304] 0 2024-04-20T21:59:03.105 INFO:tasks.workunit.client.1.smithi164.stdout:7/551: chown d2/d21/d24/d31/d3a/d83/fbd 219018298 1 2024-04-20T21:59:03.105 INFO:tasks.workunit.client.1.smithi164.stdout:9/618: truncate d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/f97 586731 0 2024-04-20T21:59:03.107 INFO:tasks.workunit.client.1.smithi164.stdout:8/501: mkdir d0/d14/d16/d58/d94/da5/dad 0 2024-04-20T21:59:03.112 INFO:tasks.workunit.client.1.smithi164.stdout:4/523: rmdir d4/d28/d3e/d41 39 2024-04-20T21:59:03.114 INFO:tasks.workunit.client.1.smithi164.stdout:7/552: rmdir d2/d21/d24/daf 39 2024-04-20T21:59:03.115 INFO:tasks.workunit.client.1.smithi164.stdout:6/596: sync 2024-04-20T21:59:03.115 INFO:tasks.workunit.client.1.smithi164.stdout:2/559: sync 2024-04-20T21:59:03.115 INFO:tasks.workunit.client.1.smithi164.stdout:1/496: sync 2024-04-20T21:59:03.118 INFO:tasks.workunit.client.1.smithi164.stdout:9/619: symlink d3/db/dd/d40/d2a/d36/d51/ld8 0 2024-04-20T21:59:03.119 INFO:tasks.workunit.client.1.smithi164.stdout:8/502: creat d0/d14/d4e/d62/d8f/fae x:0 0 0 2024-04-20T21:59:03.120 INFO:tasks.workunit.client.1.smithi164.stdout:2/560: chown d2/d30/d84/f93 11553211 1 2024-04-20T21:59:03.121 INFO:tasks.workunit.client.1.smithi164.stdout:1/497: symlink d10/d7d/la7 0 2024-04-20T21:59:03.123 INFO:tasks.workunit.client.1.smithi164.stdout:2/561: fdatasync d2/d5/f82 0 2024-04-20T21:59:03.123 INFO:tasks.workunit.client.1.smithi164.stdout:8/503: write d0/d14/d16/d58/f74 [4856706,103341] 0 2024-04-20T21:59:03.125 INFO:tasks.workunit.client.1.smithi164.stdout:4/524: mknod d4/d9/d22/ca9 0 2024-04-20T21:59:03.131 INFO:tasks.workunit.client.1.smithi164.stdout:7/553: mkdir d2/d21/d24/d31/d3a/d83/d63/d85/dbe 0 2024-04-20T21:59:03.133 INFO:tasks.workunit.client.1.smithi164.stdout:5/638: getdents dc/d2c/d2e/d30/d72/da9/dbb 0 2024-04-20T21:59:03.136 INFO:tasks.workunit.client.1.smithi164.stdout:8/504: creat d0/d14/d16/d9d/faf x:0 0 0 2024-04-20T21:59:03.140 INFO:tasks.workunit.client.1.smithi164.stdout:6/597: link d0/d3/d8/f1f d0/fc9 0 2024-04-20T21:59:03.145 INFO:tasks.workunit.client.1.smithi164.stdout:7/554: chown d2/d21/d24/d60/d82/d93/la1 574080256 1 2024-04-20T21:59:03.147 INFO:tasks.workunit.client.1.smithi164.stdout:2/562: mkdir d2/dab 0 2024-04-20T21:59:03.148 INFO:tasks.workunit.client.1.smithi164.stdout:8/505: mknod d0/d14/d16/cb0 0 2024-04-20T21:59:03.148 INFO:tasks.workunit.client.1.smithi164.stdout:2/563: stat d2/d5/d3a/d55/c6c 0 2024-04-20T21:59:03.154 INFO:tasks.workunit.client.1.smithi164.stdout:9/620: link d3/l12 d3/db/dd/d40/d2a/d36/d51/d83/ld9 0 2024-04-20T21:59:03.158 INFO:tasks.workunit.client.1.smithi164.stdout:9/621: readlink d3/db/dd/d40/d2a/d36/d51/ld8 0 2024-04-20T21:59:03.159 INFO:tasks.workunit.client.1.smithi164.stdout:6/598: dwrite d0/d3/f1c [0,4194304] 0 2024-04-20T21:59:03.161 INFO:tasks.workunit.client.1.smithi164.stdout:5/639: dread dc/d2c/d2e/f60 [4194304,4194304] 0 2024-04-20T21:59:03.164 INFO:tasks.workunit.client.1.smithi164.stdout:8/506: rename d0/d14/d16/d58/f80 to d0/d14/d4e/d62/fb1 0 2024-04-20T21:59:03.165 INFO:tasks.workunit.client.1.smithi164.stdout:2/564: mkdir d2/d5/d3a/d65/d81/dac 0 2024-04-20T21:59:03.167 INFO:tasks.workunit.client.1.smithi164.stdout:7/555: rmdir d2/d21/d24/d31/d3a/d83/d6a/dae 0 2024-04-20T21:59:03.167 INFO:tasks.workunit.client.1.smithi164.stdout:5/640: fdatasync f7 0 2024-04-20T21:59:03.170 INFO:tasks.workunit.client.1.smithi164.stdout:6/599: rename d0/d3/l2e to d0/d3/d8/d28/lca 0 2024-04-20T21:59:03.174 INFO:tasks.workunit.client.1.smithi164.stdout:7/556: chown d2/d21/d24/d60/d9e/fa4 1 1 2024-04-20T21:59:03.179 INFO:tasks.workunit.client.1.smithi164.stdout:6/600: write d0/d3/d15/d21/f91 [1454500,5001] 0 2024-04-20T21:59:03.180 INFO:tasks.workunit.client.1.smithi164.stdout:7/557: stat d2/d21/d24/d60/d82 0 2024-04-20T21:59:03.205 INFO:tasks.workunit.client.1.smithi164.stdout:8/507: dread d0/d14/d16/d58/d73/f85 [0,4194304] 0 2024-04-20T21:59:03.209 INFO:tasks.workunit.client.1.smithi164.stdout:0/534: sync 2024-04-20T21:59:03.210 INFO:tasks.workunit.client.1.smithi164.stdout:3/603: sync 2024-04-20T21:59:03.211 INFO:tasks.workunit.client.1.smithi164.stdout:4/525: dwrite d4/d9/d27/f32 [0,4194304] 0 2024-04-20T21:59:03.214 INFO:tasks.workunit.client.1.smithi164.stdout:5/641: dwrite dc/d2c/f43 [0,4194304] 0 2024-04-20T21:59:03.220 INFO:tasks.workunit.client.1.smithi164.stdout:7/558: symlink d2/d21/d24/d31/d3a/d83/d63/d85/dbe/lbf 0 2024-04-20T21:59:03.220 INFO:tasks.workunit.client.1.smithi164.stdout:2/565: dwrite d2/d5/d21/f37 [0,4194304] 0 2024-04-20T21:59:03.222 INFO:tasks.workunit.client.1.smithi164.stdout:0/535: write d1/d4/d26/d29/d2d/d54/f57 [340856,4438] 0 2024-04-20T21:59:03.223 INFO:tasks.workunit.client.1.smithi164.stdout:5/642: fdatasync dc/d2c/d2e/d30/d8c/fd2 0 2024-04-20T21:59:03.224 INFO:tasks.workunit.client.1.smithi164.stdout:2/566: write d2/d5/d21/f4f [993182,128522] 0 2024-04-20T21:59:03.231 INFO:tasks.workunit.client.1.smithi164.stdout:6/601: link d0/d3/d8/f96 d0/d3/d15/d21/d5c/dbf/fcb 0 2024-04-20T21:59:03.234 INFO:tasks.workunit.client.1.smithi164.stdout:7/559: readlink d2/d21/d33/l4d 0 2024-04-20T21:59:03.236 INFO:tasks.workunit.client.1.smithi164.stdout:0/536: truncate d1/d4/d49/f4b 2663683 0 2024-04-20T21:59:03.236 INFO:tasks.workunit.client.1.smithi164.stdout:7/560: chown d2/d21/d24/d31/d3a/daa 10 1 2024-04-20T21:59:03.238 INFO:tasks.workunit.client.1.smithi164.stdout:4/526: mkdir d4/d9/d5c/d97/daa 0 2024-04-20T21:59:03.242 INFO:tasks.workunit.client.1.smithi164.stdout:2/567: creat d2/d19/da6/fad x:0 0 0 2024-04-20T21:59:03.243 INFO:tasks.workunit.client.1.smithi164.stdout:7/561: readlink d2/d21/d24/d31/d3a/d83/d63/la7 0 2024-04-20T21:59:03.243 INFO:tasks.workunit.client.1.smithi164.stdout:4/527: fdatasync d4/d9/d27/f7d 0 2024-04-20T21:59:03.244 INFO:tasks.workunit.client.1.smithi164.stdout:6/602: symlink d0/lcc 0 2024-04-20T21:59:03.248 INFO:tasks.workunit.client.1.smithi164.stdout:5/643: getdents dc/d2b/d6d/d73 0 2024-04-20T21:59:03.256 INFO:tasks.workunit.client.1.smithi164.stdout:0/537: dread - d1/d4/d49/f5f zero size 2024-04-20T21:59:03.258 INFO:tasks.workunit.client.1.smithi164.stdout:2/568: chown d2/d5/d3a/d55/d58/c91 4999 1 2024-04-20T21:59:03.261 INFO:tasks.workunit.client.1.smithi164.stdout:1/498: sync 2024-04-20T21:59:03.268 INFO:tasks.workunit.client.1.smithi164.stdout:5/644: creat dc/d2c/fdd x:0 0 0 2024-04-20T21:59:03.271 INFO:tasks.workunit.client.1.smithi164.stdout:8/508: dwrite d0/d14/d16/f6a [0,4194304] 0 2024-04-20T21:59:03.276 INFO:tasks.workunit.client.1.smithi164.stdout:1/499: creat d10/d7d/fa8 x:0 0 0 2024-04-20T21:59:03.277 INFO:tasks.workunit.client.1.smithi164.stdout:2/569: chown d2/d5/d3a/d55/d58/c91 146288 1 2024-04-20T21:59:03.279 INFO:tasks.workunit.client.1.smithi164.stdout:8/509: write d0/f56 [903754,83624] 0 2024-04-20T21:59:03.286 INFO:tasks.workunit.client.1.smithi164.stdout:7/562: mknod d2/d21/d24/d31/d3a/d83/d63/cc0 0 2024-04-20T21:59:03.287 INFO:tasks.workunit.client.1.smithi164.stdout:3/604: dwrite d12/d20/d39/d55/d87/fba [0,4194304] 0 2024-04-20T21:59:03.288 INFO:tasks.workunit.client.1.smithi164.stdout:2/570: rmdir d2/d5/d21 39 2024-04-20T21:59:03.289 INFO:tasks.workunit.client.1.smithi164.stdout:7/563: stat d2/d21/d24/d31/d3a/d83/d63/d85 0 2024-04-20T21:59:03.301 INFO:tasks.workunit.client.1.smithi164.stdout:6/603: dwrite d0/d3/d11/d29/d6e/d41/fb7 [0,4194304] 0 2024-04-20T21:59:03.304 INFO:tasks.workunit.client.1.smithi164.stdout:7/564: unlink d2/d21/d24/d31/d3a/l6e 0 2024-04-20T21:59:03.309 INFO:tasks.workunit.client.1.smithi164.stdout:9/622: dread d3/db/dd/d40/d2a/d36/d51/da3/fb7 [0,4194304] 0 2024-04-20T21:59:03.309 INFO:tasks.workunit.client.1.smithi164.stdout:6/604: chown d0/d3/d15/d21/d5c/dbf/db4 0 1 2024-04-20T21:59:03.311 INFO:tasks.workunit.client.1.smithi164.stdout:8/510: dwrite d0/f11 [0,4194304] 0 2024-04-20T21:59:03.319 INFO:tasks.workunit.client.1.smithi164.stdout:3/605: creat d12/d20/d39/d69/dad/fbf x:0 0 0 2024-04-20T21:59:03.319 INFO:tasks.workunit.client.1.smithi164.stdout:2/571: creat d2/d5/d3a/fae x:0 0 0 2024-04-20T21:59:03.322 INFO:tasks.workunit.client.1.smithi164.stdout:5/645: dread dc/d2b/d53/f96 [0,4194304] 0 2024-04-20T21:59:03.325 INFO:tasks.workunit.client.1.smithi164.stdout:4/528: write d4/d9/d22/f2f [3535181,42762] 0 2024-04-20T21:59:03.328 INFO:tasks.workunit.client.1.smithi164.stdout:3/606: readlink d12/d20/d39/d69/d83/l95 0 2024-04-20T21:59:03.331 INFO:tasks.workunit.client.1.smithi164.stdout:4/529: fdatasync d4/d9/d27/d3f/d5f/f8a 0 2024-04-20T21:59:03.339 INFO:tasks.workunit.client.1.smithi164.stdout:8/511: creat d0/d14/d4e/d62/d8f/fb2 x:0 0 0 2024-04-20T21:59:03.340 INFO:tasks.workunit.client.1.smithi164.stdout:1/500: dwrite d10/f11 [0,4194304] 0 2024-04-20T21:59:03.343 INFO:tasks.workunit.client.1.smithi164.stdout:1/501: dread - d10/d16/f72 zero size 2024-04-20T21:59:03.344 INFO:tasks.workunit.client.1.smithi164.stdout:7/565: rename d2/d21/d24/d60/d9e/fa4 to d2/d21/fc1 0 2024-04-20T21:59:03.350 INFO:tasks.workunit.client.1.smithi164.stdout:4/530: readlink d4/d28/l8b 0 2024-04-20T21:59:03.356 INFO:tasks.workunit.client.1.smithi164.stdout:3/607: mknod d12/d15/cc0 0 2024-04-20T21:59:03.357 INFO:tasks.workunit.client.1.smithi164.stdout:8/512: mkdir d0/db3 0 2024-04-20T21:59:03.363 INFO:tasks.workunit.client.1.smithi164.stdout:2/572: read d2/d5/d21/f2b [277666,69840] 0 2024-04-20T21:59:03.364 INFO:tasks.workunit.client.1.smithi164.stdout:0/538: dwrite d1/d4/df/f1a [0,4194304] 0 2024-04-20T21:59:03.373 INFO:tasks.workunit.client.1.smithi164.stdout:0/539: write d1/d4/d20/f79 [5232574,58082] 0 2024-04-20T21:59:03.376 INFO:tasks.workunit.client.1.smithi164.stdout:2/573: creat d2/d5f/faf x:0 0 0 2024-04-20T21:59:03.379 INFO:tasks.workunit.client.1.smithi164.stdout:9/623: dread d3/db/f38 [0,4194304] 0 2024-04-20T21:59:03.380 INFO:tasks.workunit.client.1.smithi164.stdout:5/646: rename dc/d2b/d6d/d73/ca3 to dc/d2c/d2e/cde 0 2024-04-20T21:59:03.382 INFO:tasks.workunit.client.1.smithi164.stdout:1/502: dwrite d10/d33/f87 [0,4194304] 0 2024-04-20T21:59:03.382 INFO:tasks.workunit.client.1.smithi164.stdout:2/574: stat d2/d5/l7b 0 2024-04-20T21:59:03.389 INFO:tasks.workunit.client.1.smithi164.stdout:0/540: mkdir d1/d4/d26/d29/d2d/d54/d77/d9e 0 2024-04-20T21:59:03.392 INFO:tasks.workunit.client.1.smithi164.stdout:4/531: rename d4/d9/d27/d3f/f7f to d4/d9/d5c/fab 0 2024-04-20T21:59:03.395 INFO:tasks.workunit.client.1.smithi164.stdout:1/503: write d10/f5e [1036697,18130] 0 2024-04-20T21:59:03.395 INFO:tasks.workunit.client.1.smithi164.stdout:7/566: dwrite d2/d21/d24/d8a/fb9 [0,4194304] 0 2024-04-20T21:59:03.400 INFO:tasks.workunit.client.1.smithi164.stdout:8/513: dwrite d0/d14/d4e/d86/f8c [0,4194304] 0 2024-04-20T21:59:03.402 INFO:tasks.workunit.client.1.smithi164.stdout:9/624: creat d3/d9f/fda x:0 0 0 2024-04-20T21:59:03.404 INFO:tasks.workunit.client.1.smithi164.stdout:8/514: dread - d0/d14/d4e/d62/f99 zero size 2024-04-20T21:59:03.405 INFO:tasks.workunit.client.1.smithi164.stdout:9/625: read - d3/d9f/fda zero size 2024-04-20T21:59:03.409 INFO:tasks.workunit.client.1.smithi164.stdout:9/626: readlink d3/db/dd/d75/l8e 0 2024-04-20T21:59:03.409 INFO:tasks.workunit.client.1.smithi164.stdout:8/515: chown d0/d14/d16/d58/d73/c7b 59 1 2024-04-20T21:59:03.411 INFO:tasks.workunit.client.1.smithi164.stdout:5/647: creat dc/d2c/d2e/d30/d72/fdf x:0 0 0 2024-04-20T21:59:03.411 INFO:tasks.workunit.client.1.smithi164.stdout:8/516: truncate d0/f4b 414228 0 2024-04-20T21:59:03.413 INFO:tasks.workunit.client.1.smithi164.stdout:9/627: chown d3/db/dd/d40/f56 211742990 1 2024-04-20T21:59:03.415 INFO:tasks.workunit.client.1.smithi164.stdout:5/648: dread - dc/d2b/d52/f76 zero size 2024-04-20T21:59:03.417 INFO:tasks.workunit.client.1.smithi164.stdout:1/504: rename d10/d33/d7f/d8c to d10/d16/d20/d26/d34/da9 0 2024-04-20T21:59:03.421 INFO:tasks.workunit.client.1.smithi164.stdout:9/628: mknod d3/db0/cdb 0 2024-04-20T21:59:03.425 INFO:tasks.workunit.client.1.smithi164.stdout:6/605: dread d0/f16 [0,4194304] 0 2024-04-20T21:59:03.426 INFO:tasks.workunit.client.1.smithi164.stdout:8/517: mkdir d0/d14/db4 0 2024-04-20T21:59:03.426 INFO:tasks.workunit.client.1.smithi164.stdout:5/649: mkdir dc/d2b/d6d/d73/de0 0 2024-04-20T21:59:03.429 INFO:tasks.workunit.client.1.smithi164.stdout:1/505: unlink f5 0 2024-04-20T21:59:03.430 INFO:tasks.workunit.client.1.smithi164.stdout:8/518: dread - d0/d14/d4e/d62/fa7 zero size 2024-04-20T21:59:03.434 INFO:tasks.workunit.client.1.smithi164.stdout:9/629: rmdir d3/db/d82 39 2024-04-20T21:59:03.436 INFO:tasks.workunit.client.1.smithi164.stdout:0/541: dwrite d1/d4/d20/d74/f63 [0,4194304] 0 2024-04-20T21:59:03.438 INFO:tasks.workunit.client.1.smithi164.stdout:1/506: mknod d10/d33/d48/caa 0 2024-04-20T21:59:03.439 INFO:tasks.workunit.client.1.smithi164.stdout:7/567: dwrite d2/d21/d44/f4b [0,4194304] 0 2024-04-20T21:59:03.445 INFO:tasks.workunit.client.1.smithi164.stdout:8/519: creat d0/d14/d5f/fb5 x:0 0 0 2024-04-20T21:59:03.445 INFO:tasks.workunit.client.1.smithi164.stdout:0/542: chown d1/d4/d26/l3a 385645442 1 2024-04-20T21:59:03.449 INFO:tasks.workunit.client.1.smithi164.stdout:5/650: fsync dc/d12/f18 0 2024-04-20T21:59:03.449 INFO:tasks.workunit.client.1.smithi164.stdout:7/568: mknod d2/d21/d24/d60/cc2 0 2024-04-20T21:59:03.451 INFO:tasks.workunit.client.1.smithi164.stdout:1/507: mknod d10/d16/d20/d91/cab 0 2024-04-20T21:59:03.456 INFO:tasks.workunit.client.1.smithi164.stdout:3/608: dwrite d12/d20/d39/f56 [0,4194304] 0 2024-04-20T21:59:03.456 INFO:tasks.workunit.client.1.smithi164.stdout:5/651: dread - dc/d2c/d2e/d30/d8c/fd2 zero size 2024-04-20T21:59:03.468 INFO:tasks.workunit.client.1.smithi164.stdout:8/520: write d0/d14/d4e/d86/f8c [3353736,13752] 0 2024-04-20T21:59:03.471 INFO:tasks.workunit.client.1.smithi164.stdout:2/575: dread d2/f20 [0,4194304] 0 2024-04-20T21:59:03.473 INFO:tasks.workunit.client.1.smithi164.stdout:1/508: symlink d10/d16/d20/d26/d34/da9/lac 0 2024-04-20T21:59:03.474 INFO:tasks.workunit.client.1.smithi164.stdout:6/606: dwrite d0/d3/d15/d21/f91 [0,4194304] 0 2024-04-20T21:59:03.482 INFO:tasks.workunit.client.1.smithi164.stdout:5/652: symlink dc/d2b/d6d/d73/de0/le1 0 2024-04-20T21:59:03.482 INFO:tasks.workunit.client.1.smithi164.stdout:0/543: creat d1/d4/d26/d29/f9f x:0 0 0 2024-04-20T21:59:03.483 INFO:tasks.workunit.client.1.smithi164.stdout:2/576: fsync d2/d5/d3a/d65/d81/f97 0 2024-04-20T21:59:03.483 INFO:tasks.workunit.client.1.smithi164.stdout:1/509: write d10/d16/f7b [238989,64801] 0 2024-04-20T21:59:03.484 INFO:tasks.workunit.client.1.smithi164.stdout:8/521: symlink d0/d14/d4e/d62/d82/lb6 0 2024-04-20T21:59:03.484 INFO:tasks.workunit.client.1.smithi164.stdout:3/609: write d12/d20/d39/f5d [725537,103463] 0 2024-04-20T21:59:03.490 INFO:tasks.workunit.client.1.smithi164.stdout:9/630: write d3/db/d1b/d1e/f3b [1293129,70053] 0 2024-04-20T21:59:03.493 INFO:tasks.workunit.client.1.smithi164.stdout:1/510: fsync d10/f12 0 2024-04-20T21:59:03.496 INFO:tasks.workunit.client.1.smithi164.stdout:8/522: dread d0/f50 [0,4194304] 0 2024-04-20T21:59:03.496 INFO:tasks.workunit.client.1.smithi164.stdout:2/577: mkdir d2/d5/d3a/d55/d58/da2/db0 0 2024-04-20T21:59:03.504 INFO:tasks.workunit.client.1.smithi164.stdout:3/610: symlink d12/d15/dae/lc1 0 2024-04-20T21:59:03.508 INFO:tasks.workunit.client.1.smithi164.stdout:6/607: getdents d0/d3/d15/d21 0 2024-04-20T21:59:03.513 INFO:tasks.workunit.client.1.smithi164.stdout:8/523: dread - d0/d14/f3e zero size 2024-04-20T21:59:03.515 INFO:tasks.workunit.client.1.smithi164.stdout:7/569: dread d2/f1c [0,4194304] 0 2024-04-20T21:59:03.515 INFO:tasks.workunit.client.1.smithi164.stdout:5/653: link dc/d41/lb6 dc/d2c/d2e/d30/d72/da9/le2 0 2024-04-20T21:59:03.517 INFO:tasks.workunit.client.1.smithi164.stdout:8/524: chown d0/l45 0 1 2024-04-20T21:59:03.518 INFO:tasks.workunit.client.1.smithi164.stdout:0/544: getdents d1/d2b 0 2024-04-20T21:59:03.519 INFO:tasks.workunit.client.1.smithi164.stdout:4/532: sync 2024-04-20T21:59:03.519 INFO:tasks.workunit.client.1.smithi164.stdout:5/654: chown dc/d2b/d6d/f6f 67 1 2024-04-20T21:59:03.520 INFO:tasks.workunit.client.1.smithi164.stdout:9/631: creat d3/db/dd/d40/fdc x:0 0 0 2024-04-20T21:59:03.520 INFO:tasks.workunit.client.1.smithi164.stdout:0/545: chown d1/d2b 351 1 2024-04-20T21:59:03.521 INFO:tasks.workunit.client.1.smithi164.stdout:8/525: chown d0/d1e/l57 84148 1 2024-04-20T21:59:03.524 INFO:tasks.workunit.client.1.smithi164.stdout:1/511: getdents d10/d16/d20 0 2024-04-20T21:59:03.525 INFO:tasks.workunit.client.1.smithi164.stdout:6/608: mkdir d0/d3/d15/d21/d5c/dbf/db4/dcd 0 2024-04-20T21:59:03.527 INFO:tasks.workunit.client.1.smithi164.stdout:0/546: unlink d1/d4/df/c1d 0 2024-04-20T21:59:03.527 INFO:tasks.workunit.client.1.smithi164.stdout:8/526: dread - d0/d14/d5f/fac zero size 2024-04-20T21:59:03.529 INFO:tasks.workunit.client.1.smithi164.stdout:9/632: fdatasync d3/db/dd/d40/fdc 0 2024-04-20T21:59:03.530 INFO:tasks.workunit.client.1.smithi164.stdout:1/512: creat d10/d16/d20/d25/fad x:0 0 0 2024-04-20T21:59:03.534 INFO:tasks.workunit.client.1.smithi164.stdout:7/570: mknod d2/d21/d24/d31/d3a/d83/dba/dbc/cc3 0 2024-04-20T21:59:03.536 INFO:tasks.workunit.client.1.smithi164.stdout:8/527: unlink d0/d14/d4e/d62/d82/lb6 0 2024-04-20T21:59:03.536 INFO:tasks.workunit.client.1.smithi164.stdout:6/609: fdatasync d0/d3/d11/d29/d6e/fc1 0 2024-04-20T21:59:03.538 INFO:tasks.workunit.client.1.smithi164.stdout:9/633: write d3/db/dd/f11 [1167523,20494] 0 2024-04-20T21:59:03.539 INFO:tasks.workunit.client.1.smithi164.stdout:0/547: dread - d1/d4/d26/d29/d2d/d54/d77/d3c/f82 zero size 2024-04-20T21:59:03.539 INFO:tasks.workunit.client.1.smithi164.stdout:1/513: chown d10/d16/d20/d25/l80 9 1 2024-04-20T21:59:03.541 INFO:tasks.workunit.client.1.smithi164.stdout:4/533: link d4/d9/f1e d4/d9/d42/fac 0 2024-04-20T21:59:03.542 INFO:tasks.workunit.client.1.smithi164.stdout:6/610: chown d0/d3/d15/d23/c7e 1187964 1 2024-04-20T21:59:03.542 INFO:tasks.workunit.client.1.smithi164.stdout:5/655: truncate dc/d2b/d52/f62 121546 0 2024-04-20T21:59:03.543 INFO:tasks.workunit.client.1.smithi164.stdout:8/528: chown d0/c4c 4 1 2024-04-20T21:59:03.545 INFO:tasks.workunit.client.1.smithi164.stdout:1/514: chown d10/d16/d20/d25/d3d 4 1 2024-04-20T21:59:03.546 INFO:tasks.workunit.client.1.smithi164.stdout:2/578: dread d2/f12 [0,4194304] 0 2024-04-20T21:59:03.548 INFO:tasks.workunit.client.1.smithi164.stdout:6/611: write d0/d3/d15/f5b [5180059,32906] 0 2024-04-20T21:59:03.550 INFO:tasks.workunit.client.1.smithi164.stdout:3/611: dread d12/d20/d39/d55/d6b/d79/f91 [4194304,4194304] 0 2024-04-20T21:59:03.553 INFO:tasks.workunit.client.1.smithi164.stdout:7/571: link d2/l1a d2/d21/d24/d31/d3a/d83/d6a/lc4 0 2024-04-20T21:59:03.553 INFO:tasks.workunit.client.1.smithi164.stdout:8/529: mkdir d0/db7 0 2024-04-20T21:59:03.555 INFO:tasks.workunit.client.1.smithi164.stdout:6/612: readlink d0/d3/d15/d23/d45/d69/lab 0 2024-04-20T21:59:03.555 INFO:tasks.workunit.client.1.smithi164.stdout:2/579: truncate d2/d19/d28/d3e/f59 4281017 0 2024-04-20T21:59:03.561 INFO:tasks.workunit.client.1.smithi164.stdout:9/634: read d3/db/dd/d40/d2a/d36/d51/f70 [303046,1518] 0 2024-04-20T21:59:03.561 INFO:tasks.workunit.client.1.smithi164.stdout:7/572: chown d2/d21/d24/d60/d9e/da6/la9 1645 1 2024-04-20T21:59:03.565 INFO:tasks.workunit.client.1.smithi164.stdout:3/612: creat d12/d2a/db1/fc2 x:0 0 0 2024-04-20T21:59:03.567 INFO:tasks.workunit.client.1.smithi164.stdout:8/530: rename d0/d1e/f20 to d0/d14/d16/d58/fb8 0 2024-04-20T21:59:03.567 INFO:tasks.workunit.client.1.smithi164.stdout:6/613: read - d0/d3/d15/d23/d45/d4f/d9c/fb9 zero size 2024-04-20T21:59:03.572 INFO:tasks.workunit.client.1.smithi164.stdout:2/580: mknod d2/d5/d3a/d55/d58/da2/db0/cb1 0 2024-04-20T21:59:03.574 INFO:tasks.workunit.client.1.smithi164.stdout:8/531: fdatasync d0/f61 0 2024-04-20T21:59:03.577 INFO:tasks.workunit.client.1.smithi164.stdout:2/581: fsync d2/d5/d21/f37 0 2024-04-20T21:59:03.578 INFO:tasks.workunit.client.1.smithi164.stdout:7/573: rmdir d2/d21/d24/d31/d3a/d83/d63/d85 39 2024-04-20T21:59:03.579 INFO:tasks.workunit.client.1.smithi164.stdout:4/534: dwrite d4/d9/d27/d37/f5b [0,4194304] 0 2024-04-20T21:59:03.580 INFO:tasks.workunit.client.1.smithi164.stdout:6/614: unlink d0/d3/d11/d5a/f90 0 2024-04-20T21:59:03.586 INFO:tasks.workunit.client.1.smithi164.stdout:9/635: mknod d3/db/dd/d40/d2a/cdd 0 2024-04-20T21:59:03.587 INFO:tasks.workunit.client.1.smithi164.stdout:5/656: dwrite dc/d2c/d2e/d30/f89 [0,4194304] 0 2024-04-20T21:59:03.587 INFO:tasks.workunit.client.1.smithi164.stdout:1/515: dwrite d10/d16/f27 [0,4194304] 0 2024-04-20T21:59:03.588 INFO:tasks.workunit.client.1.smithi164.stdout:8/532: mknod d0/d14/d16/d58/d94/cb9 0 2024-04-20T21:59:03.590 INFO:tasks.workunit.client.1.smithi164.stdout:6/615: write d0/d3/d62/d75/fb3 [183926,90593] 0 2024-04-20T21:59:03.600 INFO:tasks.workunit.client.1.smithi164.stdout:9/636: readlink d3/db/dd/d40/l66 0 2024-04-20T21:59:03.602 INFO:tasks.workunit.client.1.smithi164.stdout:9/637: stat d3/db/l16 0 2024-04-20T21:59:03.602 INFO:tasks.workunit.client.1.smithi164.stdout:2/582: unlink d2/d5/d3a/d65/d81/f97 0 2024-04-20T21:59:03.603 INFO:tasks.workunit.client.1.smithi164.stdout:1/516: rmdir d10/d16/d19/d1a/d51 39 2024-04-20T21:59:03.609 INFO:tasks.workunit.client.1.smithi164.stdout:2/583: chown d2/d19/c1e 117 1 2024-04-20T21:59:03.610 INFO:tasks.workunit.client.1.smithi164.stdout:6/616: mkdir d0/d3/d11/d29/dce 0 2024-04-20T21:59:03.612 INFO:tasks.workunit.client.1.smithi164.stdout:9/638: symlink d3/db/d1b/d1e/lde 0 2024-04-20T21:59:03.612 INFO:tasks.workunit.client.1.smithi164.stdout:1/517: write d10/d33/f3f [5060780,42856] 0 2024-04-20T21:59:03.613 INFO:tasks.workunit.client.1.smithi164.stdout:0/548: dread d1/d2b/f65 [0,4194304] 0 2024-04-20T21:59:03.617 INFO:tasks.workunit.client.1.smithi164.stdout:1/518: stat d10/d16/d19/f4e 0 2024-04-20T21:59:03.620 INFO:tasks.workunit.client.1.smithi164.stdout:0/549: write d1/f1b [2945641,127480] 0 2024-04-20T21:59:03.627 INFO:tasks.workunit.client.1.smithi164.stdout:0/550: fdatasync d1/d4/d20/f79 0 2024-04-20T21:59:03.627 INFO:tasks.workunit.client.1.smithi164.stdout:2/584: creat d2/d19/d28/d3e/d53/fb2 x:0 0 0 2024-04-20T21:59:03.628 INFO:tasks.workunit.client.1.smithi164.stdout:1/519: write d10/d7d/fa0 [965641,85007] 0 2024-04-20T21:59:03.628 INFO:tasks.workunit.client.1.smithi164.stdout:9/639: mknod d3/db/dd/d40/d2a/d36/d51/d83/cdf 0 2024-04-20T21:59:03.632 INFO:tasks.workunit.client.1.smithi164.stdout:7/574: truncate d2/f8e 3931447 0 2024-04-20T21:59:03.632 INFO:tasks.workunit.client.1.smithi164.stdout:4/535: dwrite d4/d9/d27/d37/f51 [4194304,4194304] 0 2024-04-20T21:59:03.635 INFO:tasks.workunit.client.1.smithi164.stdout:8/533: dwrite d0/d14/d4e/d86/f8c [0,4194304] 0 2024-04-20T21:59:03.637 INFO:tasks.workunit.client.1.smithi164.stdout:0/551: chown d1/d4/da/d27/f7c 1 1 2024-04-20T21:59:03.639 INFO:tasks.workunit.client.1.smithi164.stdout:1/520: symlink d10/d33/d7f/lae 0 2024-04-20T21:59:03.640 INFO:tasks.workunit.client.1.smithi164.stdout:9/640: mkdir d3/db0/de0 0 2024-04-20T21:59:03.641 INFO:tasks.workunit.client.1.smithi164.stdout:3/613: dread d12/d20/d39/f62 [0,4194304] 0 2024-04-20T21:59:03.646 INFO:tasks.workunit.client.1.smithi164.stdout:9/641: chown d3/db/dd/f61 456 1 2024-04-20T21:59:03.646 INFO:tasks.workunit.client.1.smithi164.stdout:3/614: fsync d12/d20/d39/d69/d77/f7f 0 2024-04-20T21:59:03.646 INFO:tasks.workunit.client.1.smithi164.stdout:2/585: mkdir d2/dab/db3 0 2024-04-20T21:59:03.647 INFO:tasks.workunit.client.1.smithi164.stdout:6/617: link d0/d3/d15/d23/d45/d4f/d61/lbb d0/d3/d15/d21/d5c/dbf/lcf 0 2024-04-20T21:59:03.653 INFO:tasks.workunit.client.1.smithi164.stdout:9/642: symlink d3/db/dd/d40/le1 0 2024-04-20T21:59:03.659 INFO:tasks.workunit.client.1.smithi164.stdout:6/618: write d0/d3/d27/f3f [42393,1492] 0 2024-04-20T21:59:03.660 INFO:tasks.workunit.client.1.smithi164.stdout:8/534: getdents d0/d14/d16/d9d 0 2024-04-20T21:59:03.660 INFO:tasks.workunit.client.1.smithi164.stdout:8/535: chown d0/l1c 248 1 2024-04-20T21:59:03.663 INFO:tasks.workunit.client.1.smithi164.stdout:2/586: link d2/l15 d2/d5/d21/lb4 0 2024-04-20T21:59:03.664 INFO:tasks.workunit.client.1.smithi164.stdout:8/536: write d0/d14/d16/f70 [298211,39542] 0 2024-04-20T21:59:03.668 INFO:tasks.workunit.client.1.smithi164.stdout:9/643: dread d3/db/dd/d40/d2a/d36/f64 [0,4194304] 0 2024-04-20T21:59:03.669 INFO:tasks.workunit.client.1.smithi164.stdout:6/619: link d0/d3/d8/d28/d6f/fac d0/d3/d15/d21/d5c/dbf/db4/fd0 0 2024-04-20T21:59:03.672 INFO:tasks.workunit.client.1.smithi164.stdout:2/587: mkdir d2/d5/d3a/d65/d81/db5 0 2024-04-20T21:59:03.672 INFO:tasks.workunit.client.1.smithi164.stdout:6/620: fdatasync d0/d3/d27/d9d/fa2 0 2024-04-20T21:59:03.684 INFO:tasks.workunit.client.1.smithi164.stdout:0/552: dwrite d1/d4/da/d27/f32 [4194304,4194304] 0 2024-04-20T21:59:03.687 INFO:tasks.workunit.client.1.smithi164.stdout:2/588: write d2/d5/d3a/f96 [357969,108530] 0 2024-04-20T21:59:03.687 INFO:tasks.workunit.client.1.smithi164.stdout:6/621: creat d0/d3/d15/d21/fd1 x:0 0 0 2024-04-20T21:59:03.693 INFO:tasks.workunit.client.1.smithi164.stdout:5/657: sync 2024-04-20T21:59:03.695 INFO:tasks.workunit.client.1.smithi164.stdout:2/589: symlink d2/d30/lb6 0 2024-04-20T21:59:03.700 INFO:tasks.workunit.client.1.smithi164.stdout:6/622: write d0/d3/d8/f3c [4206749,83469] 0 2024-04-20T21:59:03.702 INFO:tasks.workunit.client.1.smithi164.stdout:0/553: write d1/d4/d49/f4b [2446463,114526] 0 2024-04-20T21:59:03.703 INFO:tasks.workunit.client.1.smithi164.stdout:5/658: mkdir dc/d2b/d6d/d73/de3 0 2024-04-20T21:59:03.703 INFO:tasks.workunit.client.1.smithi164.stdout:4/536: dwrite d4/d28/d3e/f93 [0,4194304] 0 2024-04-20T21:59:03.710 INFO:tasks.workunit.client.1.smithi164.stdout:7/575: dread d2/d21/d24/d31/f84 [0,4194304] 0 2024-04-20T21:59:03.711 INFO:tasks.workunit.client.1.smithi164.stdout:5/659: write dc/f66 [3515071,38421] 0 2024-04-20T21:59:03.720 INFO:tasks.workunit.client.1.smithi164.stdout:1/521: dread d10/f73 [0,4194304] 0 2024-04-20T21:59:03.721 INFO:tasks.workunit.client.1.smithi164.stdout:8/537: dwrite d0/d14/d16/f7f [0,4194304] 0 2024-04-20T21:59:03.721 INFO:tasks.workunit.client.1.smithi164.stdout:0/554: truncate d1/d4/da/d27/f90 998326 0 2024-04-20T21:59:03.723 INFO:tasks.workunit.client.1.smithi164.stdout:4/537: write d4/d28/f91 [431756,43238] 0 2024-04-20T21:59:03.726 INFO:tasks.workunit.client.1.smithi164.stdout:9/644: dwrite d3/db/dd/d40/f56 [0,4194304] 0 2024-04-20T21:59:03.730 INFO:tasks.workunit.client.1.smithi164.stdout:6/623: dread d0/d3/d15/d23/d45/fae [0,4194304] 0 2024-04-20T21:59:03.734 INFO:tasks.workunit.client.1.smithi164.stdout:0/555: write d1/d4/d20/d74/f3f [4647974,5061] 0 2024-04-20T21:59:03.735 INFO:tasks.workunit.client.1.smithi164.stdout:7/576: mkdir d2/d21/d24/d31/d3a/d83/d6a/dc5 0 2024-04-20T21:59:03.742 INFO:tasks.workunit.client.1.smithi164.stdout:7/577: unlink d2/d21/d24/d60/l6d 0 2024-04-20T21:59:03.744 INFO:tasks.workunit.client.1.smithi164.stdout:2/590: dwrite d2/d5/d21/fa1 [0,4194304] 0 2024-04-20T21:59:03.744 INFO:tasks.workunit.client.1.smithi164.stdout:3/615: sync 2024-04-20T21:59:03.744 INFO:tasks.workunit.client.1.smithi164.stdout:1/522: link f7 d10/d16/d20/d91/faf 0 2024-04-20T21:59:03.747 INFO:tasks.workunit.client.1.smithi164.stdout:1/523: read - d10/d33/d7f/f96 zero size 2024-04-20T21:59:03.747 INFO:tasks.workunit.client.1.smithi164.stdout:3/616: stat d12/d20/d39/d69/d9a 0 2024-04-20T21:59:03.769 INFO:tasks.workunit.client.1.smithi164.stdout:3/617: creat d12/d20/d39/d69/d77/d81/fc3 x:0 0 0 2024-04-20T21:59:03.774 INFO:tasks.workunit.client.1.smithi164.stdout:7/578: truncate d2/d21/f25 3941360 0 2024-04-20T21:59:03.776 INFO:tasks.workunit.client.1.smithi164.stdout:9/645: dwrite d3/db/dd/d40/fdc [0,4194304] 0 2024-04-20T21:59:03.781 INFO:tasks.workunit.client.1.smithi164.stdout:8/538: dwrite d0/f24 [0,4194304] 0 2024-04-20T21:59:03.781 INFO:tasks.workunit.client.1.smithi164.stdout:7/579: fdatasync d2/d21/d44/f4b 0 2024-04-20T21:59:03.783 INFO:tasks.workunit.client.1.smithi164.stdout:0/556: truncate d1/d4/d20/d74/f35 3711079 0 2024-04-20T21:59:03.792 INFO:tasks.workunit.client.1.smithi164.stdout:1/524: link d10/l13 d10/d16/d19/d1a/d51/d85/lb0 0 2024-04-20T21:59:03.793 INFO:tasks.workunit.client.1.smithi164.stdout:4/538: dwrite d4/d28/d3e/f79 [0,4194304] 0 2024-04-20T21:59:03.793 INFO:tasks.workunit.client.1.smithi164.stdout:7/580: fsync d2/d21/f75 0 2024-04-20T21:59:03.796 INFO:tasks.workunit.client.1.smithi164.stdout:1/525: truncate d10/d33/f46 1026015 0 2024-04-20T21:59:03.800 INFO:tasks.workunit.client.1.smithi164.stdout:6/624: dwrite d0/d3/f12 [0,4194304] 0 2024-04-20T21:59:03.802 INFO:tasks.workunit.client.1.smithi164.stdout:5/660: dread dc/d12/f8e [0,4194304] 0 2024-04-20T21:59:03.805 INFO:tasks.workunit.client.1.smithi164.stdout:0/557: read d1/d4/d26/f46 [2496229,5888] 0 2024-04-20T21:59:03.812 INFO:tasks.workunit.client.1.smithi164.stdout:8/539: rmdir d0/d14/d16/d58/d94 39 2024-04-20T21:59:03.812 INFO:tasks.workunit.client.1.smithi164.stdout:9/646: rename d3/db/dd/d40/d2a/d36/f7b to d3/db0/dd3/fe2 0 2024-04-20T21:59:03.813 INFO:tasks.workunit.client.1.smithi164.stdout:9/647: stat d3/d9f 0 2024-04-20T21:59:03.813 INFO:tasks.workunit.client.1.smithi164.stdout:1/526: write d10/d16/d20/f2f [742234,1892] 0 2024-04-20T21:59:03.814 INFO:tasks.workunit.client.1.smithi164.stdout:5/661: mknod dc/d2b/d52/d64/ce4 0 2024-04-20T21:59:03.815 INFO:tasks.workunit.client.1.smithi164.stdout:0/558: unlink d1/d4/d26/d29/d2d/d54/d77/l30 0 2024-04-20T21:59:03.817 INFO:tasks.workunit.client.1.smithi164.stdout:5/662: dread - dc/d2b/fc2 zero size 2024-04-20T21:59:03.820 INFO:tasks.workunit.client.1.smithi164.stdout:6/625: mkdir d0/dd2 0 2024-04-20T21:59:03.821 INFO:tasks.workunit.client.1.smithi164.stdout:5/663: chown dc/d2b/d52/l5c 850 1 2024-04-20T21:59:03.827 INFO:tasks.workunit.client.1.smithi164.stdout:0/559: symlink d1/d4/d26/d29/d2d/d54/d77/la0 0 2024-04-20T21:59:03.827 INFO:tasks.workunit.client.1.smithi164.stdout:3/618: dread f6 [0,4194304] 0 2024-04-20T21:59:03.829 INFO:tasks.workunit.client.1.smithi164.stdout:9/648: mkdir d3/db/dcc/de3 0 2024-04-20T21:59:03.829 INFO:tasks.workunit.client.1.smithi164.stdout:6/626: read d0/d3/d11/d29/d6e/d41/fb7 [3103734,101093] 0 2024-04-20T21:59:03.832 INFO:tasks.workunit.client.1.smithi164.stdout:4/539: rename d4/d9/d27/d3f/d8c to d4/d28/dad 0 2024-04-20T21:59:03.832 INFO:tasks.workunit.client.1.smithi164.stdout:9/649: dread - d3/fb1 zero size 2024-04-20T21:59:03.834 INFO:tasks.workunit.client.1.smithi164.stdout:3/619: symlink d12/d20/d39/d69/dad/lc4 0 2024-04-20T21:59:03.834 INFO:tasks.workunit.client.1.smithi164.stdout:0/560: mknod d1/d4/d26/d29/d2d/d54/d77/d3c/ca1 0 2024-04-20T21:59:03.841 INFO:tasks.workunit.client.1.smithi164.stdout:6/627: creat d0/d3/d27/fd3 x:0 0 0 2024-04-20T21:59:03.843 INFO:tasks.workunit.client.1.smithi164.stdout:8/540: dwrite d0/d14/d4e/d62/d8f/fae [0,4194304] 0 2024-04-20T21:59:03.847 INFO:tasks.workunit.client.1.smithi164.stdout:6/628: fdatasync d0/d3/f3a 0 2024-04-20T21:59:03.848 INFO:tasks.workunit.client.1.smithi164.stdout:4/540: creat d4/d28/d3e/fae x:0 0 0 2024-04-20T21:59:03.850 INFO:tasks.workunit.client.1.smithi164.stdout:8/541: write d0/d14/d16/d5a/f5c [3683622,120075] 0 2024-04-20T21:59:03.852 INFO:tasks.workunit.client.1.smithi164.stdout:1/527: write d10/d16/d20/d26/d34/f53 [1523513,11509] 0 2024-04-20T21:59:03.855 INFO:tasks.workunit.client.1.smithi164.stdout:0/561: mkdir d1/d4/df/d56/da2 0 2024-04-20T21:59:03.858 INFO:tasks.workunit.client.1.smithi164.stdout:0/562: chown d1/d4/d26/d29/d2d 4921546 1 2024-04-20T21:59:03.861 INFO:tasks.workunit.client.1.smithi164.stdout:0/563: write d1/f8 [163418,124622] 0 2024-04-20T21:59:03.865 INFO:tasks.workunit.client.1.smithi164.stdout:8/542: rmdir d0/d14/d4e/d62/d8f 39 2024-04-20T21:59:03.868 INFO:tasks.workunit.client.1.smithi164.stdout:4/541: symlink d4/d28/d3e/d41/laf 0 2024-04-20T21:59:03.868 INFO:tasks.workunit.client.1.smithi164.stdout:0/564: rmdir d1/d4/df 39 2024-04-20T21:59:03.869 INFO:tasks.workunit.client.1.smithi164.stdout:4/542: chown d4/f15 1 1 2024-04-20T21:59:03.869 INFO:tasks.workunit.client.1.smithi164.stdout:5/664: dwrite dc/d2b/d52/d64/f7f [0,4194304] 0 2024-04-20T21:59:03.869 INFO:tasks.workunit.client.1.smithi164.stdout:3/620: dread d12/d2a/f4d [0,4194304] 0 2024-04-20T21:59:03.872 INFO:tasks.workunit.client.1.smithi164.stdout:2/591: sync 2024-04-20T21:59:03.873 INFO:tasks.workunit.client.1.smithi164.stdout:8/543: fdatasync d0/d14/d16/d58/fb8 0 2024-04-20T21:59:03.880 INFO:tasks.workunit.client.1.smithi164.stdout:1/528: creat d10/d16/d20/d81/fb1 x:0 0 0 2024-04-20T21:59:03.880 INFO:tasks.workunit.client.1.smithi164.stdout:0/565: chown d1/d4/d20/d74/f5e 13 1 2024-04-20T21:59:03.883 INFO:tasks.workunit.client.1.smithi164.stdout:5/665: creat dc/d12/d1e/da8/fe5 x:0 0 0 2024-04-20T21:59:03.885 INFO:tasks.workunit.client.1.smithi164.stdout:2/592: creat d2/d5/d3a/d55/d58/da2/fb7 x:0 0 0 2024-04-20T21:59:03.889 INFO:tasks.workunit.client.1.smithi164.stdout:0/566: chown d1/d4/da/d27/l6a 2 1 2024-04-20T21:59:03.889 INFO:tasks.workunit.client.1.smithi164.stdout:8/544: dread d0/f4b [0,4194304] 0 2024-04-20T21:59:03.889 INFO:tasks.workunit.client.1.smithi164.stdout:6/629: dwrite d0/d3/d15/d23/d45/d4f/f68 [0,4194304] 0 2024-04-20T21:59:03.893 INFO:tasks.workunit.client.1.smithi164.stdout:3/621: dread d12/d68/d6f/d71/f9d [0,4194304] 0 2024-04-20T21:59:03.896 INFO:tasks.workunit.client.1.smithi164.stdout:4/543: write d4/d9/fc [318406,110087] 0 2024-04-20T21:59:03.897 INFO:tasks.workunit.client.1.smithi164.stdout:2/593: mkdir d2/d5/d3a/d55/d58/db8 0 2024-04-20T21:59:03.898 INFO:tasks.workunit.client.1.smithi164.stdout:8/545: mknod d0/d14/d4e/d62/d82/cba 0 2024-04-20T21:59:03.900 INFO:tasks.workunit.client.1.smithi164.stdout:0/567: rename d1/d4/d26/f9d to d1/d4/d26/d29/d2d/d54/d77/d3c/fa3 0 2024-04-20T21:59:03.900 INFO:tasks.workunit.client.1.smithi164.stdout:8/546: stat d0/d14/d16/c47 0 2024-04-20T21:59:03.902 INFO:tasks.workunit.client.1.smithi164.stdout:3/622: mknod d12/d20/d39/d69/d83/cc5 0 2024-04-20T21:59:03.904 INFO:tasks.workunit.client.1.smithi164.stdout:6/630: creat d0/d3/d8/d81/fd4 x:0 0 0 2024-04-20T21:59:03.908 INFO:tasks.workunit.client.1.smithi164.stdout:8/547: chown d0/d14/d16/d58/d94 2 1 2024-04-20T21:59:03.912 INFO:tasks.workunit.client.1.smithi164.stdout:9/650: dread d3/db/f5b [0,4194304] 0 2024-04-20T21:59:03.912 INFO:tasks.workunit.client.1.smithi164.stdout:6/631: chown d0/d3/d8/d81/fd4 14 1 2024-04-20T21:59:03.917 INFO:tasks.workunit.client.1.smithi164.stdout:3/623: symlink d12/d20/d39/d69/db8/lc6 0 2024-04-20T21:59:03.917 INFO:tasks.workunit.client.1.smithi164.stdout:8/548: rmdir d0/d14/d4e/d62/d82/d97 39 2024-04-20T21:59:03.919 INFO:tasks.workunit.client.1.smithi164.stdout:5/666: dwrite dc/f16 [0,4194304] 0 2024-04-20T21:59:03.922 INFO:tasks.workunit.client.1.smithi164.stdout:6/632: creat d0/d3/d8/d28/d6f/fd5 x:0 0 0 2024-04-20T21:59:03.925 INFO:tasks.workunit.client.1.smithi164.stdout:9/651: mknod d3/db/d1b/d20/d3f/dc7/ce4 0 2024-04-20T21:59:03.926 INFO:tasks.workunit.client.1.smithi164.stdout:2/594: dwrite d2/d5/f11 [0,4194304] 0 2024-04-20T21:59:03.932 INFO:tasks.workunit.client.1.smithi164.stdout:4/544: dwrite d4/d9/d27/d3f/f92 [0,4194304] 0 2024-04-20T21:59:03.932 INFO:tasks.workunit.client.1.smithi164.stdout:6/633: chown d0/d3/d8/l1e 623201 1 2024-04-20T21:59:03.936 INFO:tasks.workunit.client.1.smithi164.stdout:5/667: creat dc/d12/d1e/da8/fe6 x:0 0 0 2024-04-20T21:59:03.936 INFO:tasks.workunit.client.1.smithi164.stdout:7/581: sync 2024-04-20T21:59:03.939 INFO:tasks.workunit.client.1.smithi164.stdout:9/652: mkdir d3/db/de5 0 2024-04-20T21:59:03.945 INFO:tasks.workunit.client.1.smithi164.stdout:4/545: symlink d4/d9/d42/lb0 0 2024-04-20T21:59:03.948 INFO:tasks.workunit.client.1.smithi164.stdout:7/582: readlink d2/d21/d24/d31/d3a/d83/d63/d85/l91 0 2024-04-20T21:59:03.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:03 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:03.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:03 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:03.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:03 smithi164 ceph-mon[23506]: pgmap v9: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 49 MiB/s rd, 152 MiB/s wr, 343 op/s 2024-04-20T21:59:03.953 INFO:tasks.workunit.client.1.smithi164.stdout:5/668: creat dc/d2b/d6d/d73/dd6/fe7 x:0 0 0 2024-04-20T21:59:03.954 INFO:tasks.workunit.client.1.smithi164.stdout:4/546: rmdir d4/d9/da4 39 2024-04-20T21:59:03.958 INFO:tasks.workunit.client.1.smithi164.stdout:2/595: link d2/d5/c24 d2/d5f/cb9 0 2024-04-20T21:59:03.962 INFO:tasks.workunit.client.1.smithi164.stdout:9/653: mknod d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/ce6 0 2024-04-20T21:59:03.966 INFO:tasks.workunit.client.1.smithi164.stdout:4/547: write d4/d28/d3e/d4a/f95 [407276,90513] 0 2024-04-20T21:59:03.966 INFO:tasks.workunit.client.1.smithi164.stdout:6/634: dwrite d0/d3/f12 [4194304,4194304] 0 2024-04-20T21:59:03.974 INFO:tasks.workunit.client.1.smithi164.stdout:8/549: dwrite d0/d14/f13 [0,4194304] 0 2024-04-20T21:59:03.974 INFO:tasks.workunit.client.1.smithi164.stdout:5/669: creat dc/d12/fe8 x:0 0 0 2024-04-20T21:59:03.977 INFO:tasks.workunit.client.1.smithi164.stdout:6/635: chown d0/d3/d11/d29/d6e/d41/fb7 27957 1 2024-04-20T21:59:03.979 INFO:tasks.workunit.client.1.smithi164.stdout:7/583: write d2/f16 [4974016,51581] 0 2024-04-20T21:59:03.982 INFO:tasks.workunit.client.1.smithi164.stdout:1/529: sync 2024-04-20T21:59:03.983 INFO:tasks.workunit.client.1.smithi164.stdout:5/670: write dc/d2c/f43 [393826,6203] 0 2024-04-20T21:59:03.984 INFO:tasks.workunit.client.1.smithi164.stdout:8/550: fdatasync d0/f50 0 2024-04-20T21:59:03.985 INFO:tasks.workunit.client.1.smithi164.stdout:7/584: write d2/f7 [3327217,55947] 0 2024-04-20T21:59:03.989 INFO:tasks.workunit.client.1.smithi164.stdout:9/654: rename d3/db/dd/d40/le1 to d3/db/d1b/d1e/le7 0 2024-04-20T21:59:03.991 INFO:tasks.workunit.client.1.smithi164.stdout:9/655: stat d3/db/dd 0 2024-04-20T21:59:03.994 INFO:tasks.workunit.client.1.smithi164.stdout:5/671: mknod dc/d2c/d2e/d30/d72/da9/ce9 0 2024-04-20T21:59:04.001 INFO:tasks.workunit.client.1.smithi164.stdout:0/568: dread d1/d4/df/f2f [0,4194304] 0 2024-04-20T21:59:04.005 INFO:tasks.workunit.client.1.smithi164.stdout:5/672: read dc/d41/fad [2597544,40582] 0 2024-04-20T21:59:04.005 INFO:tasks.workunit.client.1.smithi164.stdout:7/585: fsync d2/d21/d24/f30 0 2024-04-20T21:59:04.009 INFO:tasks.workunit.client.1.smithi164.stdout:1/530: rename d10/d16/d20/d26/d34/l3a to d10/d16/d20/d25/lb2 0 2024-04-20T21:59:04.009 INFO:tasks.workunit.client.1.smithi164.stdout:3/624: dread d12/d6d/f96 [0,4194304] 0 2024-04-20T21:59:04.010 INFO:tasks.workunit.client.1.smithi164.stdout:5/673: readlink dc/d12/d1e/l7e 0 2024-04-20T21:59:04.012 INFO:tasks.workunit.client.1.smithi164.stdout:6/636: dread d0/d3/d11/d29/d6e/d41/fb7 [0,4194304] 0 2024-04-20T21:59:04.017 INFO:tasks.workunit.client.1.smithi164.stdout:4/548: dwrite d4/d28/f91 [0,4194304] 0 2024-04-20T21:59:04.019 INFO:tasks.workunit.client.1.smithi164.stdout:7/586: write d2/f16 [2866498,20338] 0 2024-04-20T21:59:04.022 INFO:tasks.workunit.client.1.smithi164.stdout:6/637: mknod d0/d3/d4a/cd6 0 2024-04-20T21:59:04.023 INFO:tasks.workunit.client.1.smithi164.stdout:1/531: write d10/d16/f27 [6712703,97875] 0 2024-04-20T21:59:04.024 INFO:tasks.workunit.client.1.smithi164.stdout:2/596: dwrite d2/f1b [0,4194304] 0 2024-04-20T21:59:04.025 INFO:tasks.workunit.client.1.smithi164.stdout:4/549: read d4/d9/d22/f52 [4024559,89839] 0 2024-04-20T21:59:04.025 INFO:tasks.workunit.client.1.smithi164.stdout:7/587: chown d2/d21/f45 1070 1 2024-04-20T21:59:04.029 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:03 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:04.029 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:03 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:04.029 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:03 smithi142 ceph-mon[15828]: pgmap v9: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 49 MiB/s rd, 152 MiB/s wr, 343 op/s 2024-04-20T21:59:04.033 INFO:tasks.workunit.client.1.smithi164.stdout:9/656: truncate d3/db/d1b/d1e/f3b 1262965 0 2024-04-20T21:59:04.040 INFO:tasks.workunit.client.1.smithi164.stdout:7/588: write d2/d21/d24/d31/d3a/d83/d68/f8b [323323,20377] 0 2024-04-20T21:59:04.042 INFO:tasks.workunit.client.1.smithi164.stdout:3/625: link d12/d20/c27 d12/cc7 0 2024-04-20T21:59:04.044 INFO:tasks.workunit.client.1.smithi164.stdout:0/569: dwrite d1/d4/d49/f95 [0,4194304] 0 2024-04-20T21:59:04.045 INFO:tasks.workunit.client.1.smithi164.stdout:4/550: symlink d4/d9/d5c/d97/lb1 0 2024-04-20T21:59:04.051 INFO:tasks.workunit.client.1.smithi164.stdout:3/626: stat d12/d68/d6f/d71/f9d 0 2024-04-20T21:59:04.052 INFO:tasks.workunit.client.1.smithi164.stdout:7/589: write d2/f48 [4398216,108730] 0 2024-04-20T21:59:04.054 INFO:tasks.workunit.client.1.smithi164.stdout:3/627: fdatasync d12/d20/f63 0 2024-04-20T21:59:04.055 INFO:tasks.workunit.client.1.smithi164.stdout:0/570: read - d1/d4/d49/f5f zero size 2024-04-20T21:59:04.055 INFO:tasks.workunit.client.1.smithi164.stdout:5/674: dwrite dc/d2b/fdc [0,4194304] 0 2024-04-20T21:59:04.057 INFO:tasks.workunit.client.1.smithi164.stdout:9/657: symlink d3/db/d1b/d20/d3f/d8a/da7/le8 0 2024-04-20T21:59:04.063 INFO:tasks.workunit.client.1.smithi164.stdout:3/628: write d12/d20/d39/d69/d77/f7f [3442614,92259] 0 2024-04-20T21:59:04.067 INFO:tasks.workunit.client.1.smithi164.stdout:7/590: symlink d2/d21/d24/d31/d3a/lc6 0 2024-04-20T21:59:04.067 INFO:tasks.workunit.client.1.smithi164.stdout:2/597: rename d2/d19/d28/d3e/d53 to d2/d5/d3a/d65/d81/db5/dba 0 2024-04-20T21:59:04.070 INFO:tasks.workunit.client.1.smithi164.stdout:9/658: write d3/db/dd/d40/d78/d86/fb3 [5191521,54926] 0 2024-04-20T21:59:04.076 INFO:tasks.workunit.client.1.smithi164.stdout:6/638: dwrite d0/d3/d15/d23/f48 [0,4194304] 0 2024-04-20T21:59:04.077 INFO:tasks.workunit.client.1.smithi164.stdout:0/571: mknod d1/d4/da/d5c/d6e/ca4 0 2024-04-20T21:59:04.079 INFO:tasks.workunit.client.1.smithi164.stdout:9/659: fdatasync d3/db/dd/d40/d78/d86/fb3 0 2024-04-20T21:59:04.080 INFO:tasks.workunit.client.1.smithi164.stdout:6/639: write d0/d3/d15/d21/f91 [3377511,96902] 0 2024-04-20T21:59:04.087 INFO:tasks.workunit.client.1.smithi164.stdout:7/591: mknod d2/d21/d24/d31/d3a/cc7 0 2024-04-20T21:59:04.087 INFO:tasks.workunit.client.1.smithi164.stdout:4/551: symlink d4/d9/d27/d3f/d9b/lb2 0 2024-04-20T21:59:04.088 INFO:tasks.workunit.client.1.smithi164.stdout:1/532: truncate d10/d33/f87 16386 0 2024-04-20T21:59:04.093 INFO:tasks.workunit.client.1.smithi164.stdout:6/640: creat d0/d3/d15/d23/d45/d4f/d9c/fd7 x:0 0 0 2024-04-20T21:59:04.093 INFO:tasks.workunit.client.1.smithi164.stdout:7/592: read d2/d21/d24/d8a/fb9 [1733726,17617] 0 2024-04-20T21:59:04.096 INFO:tasks.workunit.client.1.smithi164.stdout:3/629: dwrite d12/d20/d39/d55/d6b/f97 [0,4194304] 0 2024-04-20T21:59:04.098 INFO:tasks.workunit.client.1.smithi164.stdout:7/593: fdatasync d2/d21/f23 0 2024-04-20T21:59:04.100 INFO:tasks.workunit.client.1.smithi164.stdout:2/598: rename d2/c1a to d2/d5/d3a/d55/d58/cbb 0 2024-04-20T21:59:04.105 INFO:tasks.workunit.client.1.smithi164.stdout:8/551: sync 2024-04-20T21:59:04.105 INFO:tasks.workunit.client.1.smithi164.stdout:4/552: creat d4/d9/da4/fb3 x:0 0 0 2024-04-20T21:59:04.110 INFO:tasks.workunit.client.1.smithi164.stdout:1/533: creat d10/d16/d20/d66/fb3 x:0 0 0 2024-04-20T21:59:04.115 INFO:tasks.workunit.client.1.smithi164.stdout:7/594: mknod d2/d21/d24/d60/d9e/cc8 0 2024-04-20T21:59:04.122 INFO:tasks.workunit.client.1.smithi164.stdout:6/641: symlink d0/ld8 0 2024-04-20T21:59:04.123 INFO:tasks.workunit.client.1.smithi164.stdout:4/553: symlink d4/d9/d27/d3f/d67/lb4 0 2024-04-20T21:59:04.125 INFO:tasks.workunit.client.1.smithi164.stdout:9/660: getdents d3/db/dd/d40/d78 0 2024-04-20T21:59:04.126 INFO:tasks.workunit.client.1.smithi164.stdout:1/534: symlink d10/d16/d20/d66/lb4 0 2024-04-20T21:59:04.127 INFO:tasks.workunit.client.1.smithi164.stdout:1/535: fsync d10/d33/d48/d8b/fa3 0 2024-04-20T21:59:04.129 INFO:tasks.workunit.client.1.smithi164.stdout:7/595: creat d2/d21/d33/fc9 x:0 0 0 2024-04-20T21:59:04.130 INFO:tasks.workunit.client.1.smithi164.stdout:8/552: symlink d0/d14/d16/d58/lbb 0 2024-04-20T21:59:04.131 INFO:tasks.workunit.client.1.smithi164.stdout:6/642: symlink d0/d3/d15/d21/ld9 0 2024-04-20T21:59:04.133 INFO:tasks.workunit.client.1.smithi164.stdout:6/643: chown d0/d3/d15/d23/d3b/f57 908 1 2024-04-20T21:59:04.134 INFO:tasks.workunit.client.1.smithi164.stdout:8/553: dread d0/d14/d16/f70 [0,4194304] 0 2024-04-20T21:59:04.134 INFO:tasks.workunit.client.1.smithi164.stdout:6/644: stat d0/d3/d8/f38 0 2024-04-20T21:59:04.135 INFO:tasks.workunit.client.1.smithi164.stdout:4/554: mkdir d4/d9/d22/db5 0 2024-04-20T21:59:04.136 INFO:tasks.workunit.client.1.smithi164.stdout:6/645: dread - d0/d3/d27/fc4 zero size 2024-04-20T21:59:04.137 INFO:tasks.workunit.client.1.smithi164.stdout:1/536: creat d10/d16/d20/d25/d95/fb5 x:0 0 0 2024-04-20T21:59:04.141 INFO:tasks.workunit.client.1.smithi164.stdout:9/661: creat d3/fe9 x:0 0 0 2024-04-20T21:59:04.145 INFO:tasks.workunit.client.1.smithi164.stdout:8/554: mknod d0/d14/cbc 0 2024-04-20T21:59:04.149 INFO:tasks.workunit.client.1.smithi164.stdout:1/537: chown d10/d16/d19/d1a/d51/d85/lb0 9 1 2024-04-20T21:59:04.155 INFO:tasks.workunit.client.1.smithi164.stdout:7/596: rmdir d2/d21/d24/d60 39 2024-04-20T21:59:04.155 INFO:tasks.workunit.client.1.smithi164.stdout:8/555: mknod d0/d1e/cbd 0 2024-04-20T21:59:04.157 INFO:tasks.workunit.client.1.smithi164.stdout:4/555: getdents d4/d9/d5c/d97 0 2024-04-20T21:59:04.157 INFO:tasks.workunit.client.1.smithi164.stdout:9/662: truncate d3/db/dd/f45 1591507 0 2024-04-20T21:59:04.165 INFO:tasks.workunit.client.1.smithi164.stdout:4/556: creat d4/d28/d3e/d41/fb6 x:0 0 0 2024-04-20T21:59:04.168 INFO:tasks.workunit.client.1.smithi164.stdout:3/630: truncate d12/f73 466884 0 2024-04-20T21:59:04.169 INFO:tasks.workunit.client.1.smithi164.stdout:9/663: write d3/db/dd/f11 [57645,37749] 0 2024-04-20T21:59:04.172 INFO:tasks.workunit.client.1.smithi164.stdout:7/597: mkdir d2/d21/d24/d60/d82/d93/dca 0 2024-04-20T21:59:04.175 INFO:tasks.workunit.client.1.smithi164.stdout:8/556: mkdir d0/d14/d4e/d62/d8f/dbe 0 2024-04-20T21:59:04.180 INFO:tasks.workunit.client.1.smithi164.stdout:3/631: fdatasync d12/d20/d39/f3c 0 2024-04-20T21:59:04.183 INFO:tasks.workunit.client.1.smithi164.stdout:9/664: readlink d3/db/dd/d40/d2a/d36/d51/ld8 0 2024-04-20T21:59:04.187 INFO:tasks.workunit.client.1.smithi164.stdout:1/538: rename d10/d16/d19/d1a/c7e to d10/d16/d19/cb6 0 2024-04-20T21:59:04.190 INFO:tasks.workunit.client.1.smithi164.stdout:2/599: dwrite d2/d5/f14 [0,4194304] 0 2024-04-20T21:59:04.192 INFO:tasks.workunit.client.1.smithi164.stdout:3/632: truncate d12/f32 1075420 0 2024-04-20T21:59:04.194 INFO:tasks.workunit.client.1.smithi164.stdout:1/539: chown d10/d16/d20/d91/d9d 70430819 1 2024-04-20T21:59:04.195 INFO:tasks.workunit.client.1.smithi164.stdout:6/646: dwrite d0/d3/d11/d29/f46 [4194304,4194304] 0 2024-04-20T21:59:04.198 INFO:tasks.workunit.client.1.smithi164.stdout:2/600: dread - d2/d5/d3a/fae zero size 2024-04-20T21:59:04.213 INFO:tasks.workunit.client.1.smithi164.stdout:7/598: rename d2/d21/d24/d31/d3a/l88 to d2/d21/d24/daf/lcb 0 2024-04-20T21:59:04.216 INFO:tasks.workunit.client.1.smithi164.stdout:3/633: write d12/d15/f38 [2831027,125290] 0 2024-04-20T21:59:04.216 INFO:tasks.workunit.client.1.smithi164.stdout:4/557: write f3 [4002282,105236] 0 2024-04-20T21:59:04.223 INFO:tasks.workunit.client.1.smithi164.stdout:7/599: readlink d2/d21/d24/d31/d3a/d83/d63/l70 0 2024-04-20T21:59:04.229 INFO:tasks.workunit.client.1.smithi164.stdout:8/557: dread d0/d14/d4e/d62/d8f/fae [0,4194304] 0 2024-04-20T21:59:04.229 INFO:tasks.workunit.client.1.smithi164.stdout:5/675: sync 2024-04-20T21:59:04.246 INFO:tasks.workunit.client.1.smithi164.stdout:9/665: dread d3/db/d1b/d1e/f73 [0,4194304] 0 2024-04-20T21:59:04.252 INFO:tasks.workunit.client.1.smithi164.stdout:8/558: dread d0/d14/d16/d58/f74 [0,4194304] 0 2024-04-20T21:59:04.255 INFO:tasks.workunit.client.1.smithi164.stdout:8/559: read d0/d14/d4e/d62/d8f/fae [3828826,128667] 0 2024-04-20T21:59:04.255 INFO:tasks.workunit.client.1.smithi164.stdout:6/647: creat d0/d3/d15/d21/d4b/fda x:0 0 0 2024-04-20T21:59:04.257 INFO:tasks.workunit.client.1.smithi164.stdout:6/648: fsync d0/d3/f1c 0 2024-04-20T21:59:04.260 INFO:tasks.workunit.client.1.smithi164.stdout:7/600: fsync d2/d21/d24/d8a/fb9 0 2024-04-20T21:59:04.261 INFO:tasks.workunit.client.1.smithi164.stdout:8/560: truncate d0/d14/d4e/d62/f5e 1236216 0 2024-04-20T21:59:04.261 INFO:tasks.workunit.client.1.smithi164.stdout:5/676: mkdir dc/d12/d1e/da8/dea 0 2024-04-20T21:59:04.262 INFO:tasks.workunit.client.1.smithi164.stdout:9/666: dwrite d3/db/dd/d40/f56 [0,4194304] 0 2024-04-20T21:59:04.262 INFO:tasks.workunit.client.1.smithi164.stdout:0/572: sync 2024-04-20T21:59:04.264 INFO:tasks.workunit.client.1.smithi164.stdout:0/573: chown d1/d4/df/f3b 130 1 2024-04-20T21:59:04.266 INFO:tasks.workunit.client.1.smithi164.stdout:2/601: getdents d2/d30/da5 0 2024-04-20T21:59:04.267 INFO:tasks.workunit.client.1.smithi164.stdout:0/574: write d1/d4/d26/d29/f9f [778619,29605] 0 2024-04-20T21:59:04.269 INFO:tasks.workunit.client.1.smithi164.stdout:0/575: readlink d1/d4/l92 0 2024-04-20T21:59:04.269 INFO:tasks.workunit.client.1.smithi164.stdout:3/634: mknod d12/d20/d39/d69/d83/db9/cc8 0 2024-04-20T21:59:04.270 INFO:tasks.workunit.client.1.smithi164.stdout:6/649: creat d0/d3/d4a/fdb x:0 0 0 2024-04-20T21:59:04.270 INFO:tasks.workunit.client.1.smithi164.stdout:8/561: mkdir d0/d14/d16/dbf 0 2024-04-20T21:59:04.278 INFO:tasks.workunit.client.1.smithi164.stdout:8/562: readlink d0/d14/d16/l31 0 2024-04-20T21:59:04.278 INFO:tasks.workunit.client.1.smithi164.stdout:7/601: rename d2/d21/d33/fa5 to d2/d21/d24/d31/d3a/daa/fcc 0 2024-04-20T21:59:04.278 INFO:tasks.workunit.client.1.smithi164.stdout:6/650: dread - d0/d3/d11/d29/d6e/fc1 zero size 2024-04-20T21:59:04.278 INFO:tasks.workunit.client.1.smithi164.stdout:8/563: write d0/d14/d4e/fa1 [349816,34349] 0 2024-04-20T21:59:04.278 INFO:tasks.workunit.client.1.smithi164.stdout:0/576: rmdir d1/d4/d26 39 2024-04-20T21:59:04.287 INFO:tasks.workunit.client.1.smithi164.stdout:3/635: creat d12/d20/d39/d55/fc9 x:0 0 0 2024-04-20T21:59:04.288 INFO:tasks.workunit.client.1.smithi164.stdout:6/651: rename d0/d3/d8/d81/fd4 to d0/d3/d62/d8e/fdc 0 2024-04-20T21:59:04.294 INFO:tasks.workunit.client.1.smithi164.stdout:4/558: write d4/fb [4284602,71066] 0 2024-04-20T21:59:04.294 INFO:tasks.workunit.client.1.smithi164.stdout:7/602: link d2/d21/d24/d60/f76 d2/d21/d24/d60/d9e/da6/fcd 0 2024-04-20T21:59:04.296 INFO:tasks.workunit.client.1.smithi164.stdout:1/540: truncate d10/f11 2208917 0 2024-04-20T21:59:04.297 INFO:tasks.workunit.client.1.smithi164.stdout:4/559: readlink d4/d9/d27/l2e 0 2024-04-20T21:59:04.299 INFO:tasks.workunit.client.1.smithi164.stdout:7/603: creat d2/d21/d44/fce x:0 0 0 2024-04-20T21:59:04.299 INFO:tasks.workunit.client.1.smithi164.stdout:1/541: fsync d10/d16/d19/f4e 0 2024-04-20T21:59:04.301 INFO:tasks.workunit.client.1.smithi164.stdout:4/560: fdatasync d4/d28/d3e/f79 0 2024-04-20T21:59:04.301 INFO:tasks.workunit.client.1.smithi164.stdout:3/636: creat d12/d20/d39/d55/fca x:0 0 0 2024-04-20T21:59:04.302 INFO:tasks.workunit.client.1.smithi164.stdout:1/542: readlink d10/d16/l1d 0 2024-04-20T21:59:04.306 INFO:tasks.workunit.client.1.smithi164.stdout:7/604: read d2/d21/d44/f4e [382864,16680] 0 2024-04-20T21:59:04.314 INFO:tasks.workunit.client.1.smithi164.stdout:6/652: dwrite d0/d3/d62/d75/fa1 [0,4194304] 0 2024-04-20T21:59:04.317 INFO:tasks.workunit.client.1.smithi164.stdout:7/605: fsync d2/d21/d44/f4b 0 2024-04-20T21:59:04.339 INFO:tasks.workunit.client.1.smithi164.stdout:0/577: dwrite d1/d4/d26/d29/d2d/d54/d77/d3c/f58 [0,4194304] 0 2024-04-20T21:59:04.341 INFO:tasks.workunit.client.1.smithi164.stdout:5/677: dwrite dc/d2c/d2e/f31 [0,4194304] 0 2024-04-20T21:59:04.350 INFO:tasks.workunit.client.1.smithi164.stdout:6/653: chown d0/d3/d8/d28/d6f/c73 2147843 1 2024-04-20T21:59:04.352 INFO:tasks.workunit.client.1.smithi164.stdout:9/667: dwrite d3/fa [0,4194304] 0 2024-04-20T21:59:04.362 INFO:tasks.workunit.client.1.smithi164.stdout:7/606: truncate d2/d21/d44/fce 1045727 0 2024-04-20T21:59:04.364 INFO:tasks.workunit.client.1.smithi164.stdout:2/602: dwrite d2/d19/f54 [0,4194304] 0 2024-04-20T21:59:04.365 INFO:tasks.workunit.client.1.smithi164.stdout:0/578: fdatasync d1/d4/da/d5c/d6e/f96 0 2024-04-20T21:59:04.368 INFO:tasks.workunit.client.1.smithi164.stdout:8/564: dwrite d0/d14/f3e [0,4194304] 0 2024-04-20T21:59:04.368 INFO:tasks.workunit.client.1.smithi164.stdout:3/637: dwrite f11 [0,4194304] 0 2024-04-20T21:59:04.380 INFO:tasks.workunit.client.1.smithi164.stdout:7/607: stat d2/d21/d44/l99 0 2024-04-20T21:59:04.381 INFO:tasks.workunit.client.1.smithi164.stdout:0/579: symlink d1/d4/df/la5 0 2024-04-20T21:59:04.383 INFO:tasks.workunit.client.1.smithi164.stdout:3/638: creat d12/d20/d39/d55/d6b/d79/fcb x:0 0 0 2024-04-20T21:59:04.384 INFO:tasks.workunit.client.1.smithi164.stdout:1/543: dwrite d10/f12 [0,4194304] 0 2024-04-20T21:59:04.384 INFO:tasks.workunit.client.1.smithi164.stdout:2/603: write d2/d5/d3a/d65/f7f [579853,35676] 0 2024-04-20T21:59:04.388 INFO:tasks.workunit.client.1.smithi164.stdout:0/580: chown d1/d4 4037 1 2024-04-20T21:59:04.391 INFO:tasks.workunit.client.1.smithi164.stdout:8/565: mknod d0/d14/d5f/cc0 0 2024-04-20T21:59:04.394 INFO:tasks.workunit.client.1.smithi164.stdout:9/668: creat d3/db/dd/d40/fea x:0 0 0 2024-04-20T21:59:04.395 INFO:tasks.workunit.client.1.smithi164.stdout:7/608: mkdir d2/d21/d24/d31/d3a/d83/dcf 0 2024-04-20T21:59:04.396 INFO:tasks.workunit.client.1.smithi164.stdout:3/639: chown d12/d20/f7e 3719355 1 2024-04-20T21:59:04.400 INFO:tasks.workunit.client.1.smithi164.stdout:6/654: truncate d0/d3/d8/fa 1148115 0 2024-04-20T21:59:04.400 INFO:tasks.workunit.client.1.smithi164.stdout:7/609: chown d2/d21/d44/f98 70935 1 2024-04-20T21:59:04.402 INFO:tasks.workunit.client.1.smithi164.stdout:8/566: truncate d0/d1e/f22 3168003 0 2024-04-20T21:59:04.403 INFO:tasks.workunit.client.1.smithi164.stdout:2/604: truncate d2/d30/d84/f93 863197 0 2024-04-20T21:59:04.403 INFO:tasks.workunit.client.1.smithi164.stdout:4/561: dread d4/d9/d27/d3f/f63 [0,4194304] 0 2024-04-20T21:59:04.405 INFO:tasks.workunit.client.1.smithi164.stdout:0/581: mknod d1/d4/da/d5c/ca6 0 2024-04-20T21:59:04.407 INFO:tasks.workunit.client.1.smithi164.stdout:6/655: dread - d0/d3/d11/f8f zero size 2024-04-20T21:59:04.408 INFO:tasks.workunit.client.1.smithi164.stdout:5/678: dwrite dc/d2c/d2e/f60 [8388608,4194304] 0 2024-04-20T21:59:04.408 INFO:tasks.workunit.client.1.smithi164.stdout:9/669: rename d3/f76 to d3/db/dcc/de3/feb 0 2024-04-20T21:59:04.414 INFO:tasks.workunit.client.1.smithi164.stdout:3/640: mkdir d12/d20/d39/d55/d6b/d79/dcc 0 2024-04-20T21:59:04.414 INFO:tasks.workunit.client.1.smithi164.stdout:2/605: mknod d2/d19/cbc 0 2024-04-20T21:59:04.417 INFO:tasks.workunit.client.1.smithi164.stdout:7/610: mknod d2/d21/d24/d31/d3a/d83/dba/dbc/cd0 0 2024-04-20T21:59:04.417 INFO:tasks.workunit.client.1.smithi164.stdout:6/656: chown d0/l7 1705441199 1 2024-04-20T21:59:04.418 INFO:tasks.workunit.client.1.smithi164.stdout:8/567: chown d0/d14/f51 113475 1 2024-04-20T21:59:04.418 INFO:tasks.workunit.client.1.smithi164.stdout:4/562: rmdir d4/d9/d27/d3f/d67/d86 39 2024-04-20T21:59:04.420 INFO:tasks.workunit.client.1.smithi164.stdout:3/641: write d12/d20/f88 [987916,51150] 0 2024-04-20T21:59:04.421 INFO:tasks.workunit.client.1.smithi164.stdout:9/670: mknod d3/db0/dc0/cec 0 2024-04-20T21:59:04.424 INFO:tasks.workunit.client.1.smithi164.stdout:9/671: write d3/fe9 [505231,72020] 0 2024-04-20T21:59:04.429 INFO:tasks.workunit.client.1.smithi164.stdout:3/642: truncate d12/d20/d39/f4b 1049893 0 2024-04-20T21:59:04.431 INFO:tasks.workunit.client.1.smithi164.stdout:1/544: truncate d10/d16/d20/d26/f74 409509 0 2024-04-20T21:59:04.433 INFO:tasks.workunit.client.1.smithi164.stdout:1/545: stat d10/d16/d20/d25/d95 0 2024-04-20T21:59:04.435 INFO:tasks.workunit.client.1.smithi164.stdout:7/611: rename d2/d21/d24/d31/d3a/d83 to d2/d21/d24/d31/d3a/d83/dba/dbb/dd1 22 2024-04-20T21:59:04.435 INFO:tasks.workunit.client.1.smithi164.stdout:6/657: rename d0/d3/d62/fa0 to d0/fdd 0 2024-04-20T21:59:04.436 INFO:tasks.workunit.client.1.smithi164.stdout:2/606: creat d2/d5/d3a/d55/d58/da2/db0/fbd x:0 0 0 2024-04-20T21:59:04.437 INFO:tasks.workunit.client.1.smithi164.stdout:9/672: mknod d3/db/dd/d75/ced 0 2024-04-20T21:59:04.438 INFO:tasks.workunit.client.1.smithi164.stdout:7/612: write d2/f67 [689433,60280] 0 2024-04-20T21:59:04.439 INFO:tasks.workunit.client.1.smithi164.stdout:0/582: write d1/d4/f28 [5334575,58039] 0 2024-04-20T21:59:04.448 INFO:tasks.workunit.client.1.smithi164.stdout:8/568: truncate d0/f1b 326833 0 2024-04-20T21:59:04.452 INFO:tasks.workunit.client.1.smithi164.stdout:1/546: fdatasync d10/d16/d20/d26/f74 0 2024-04-20T21:59:04.452 INFO:tasks.workunit.client.1.smithi164.stdout:5/679: dwrite dc/d12/d1e/da8/fe6 [0,4194304] 0 2024-04-20T21:59:04.453 INFO:tasks.workunit.client.1.smithi164.stdout:3/643: write d12/d68/d6f/d71/f9d [811433,69676] 0 2024-04-20T21:59:04.473 INFO:tasks.workunit.client.1.smithi164.stdout:2/607: rename d2/d19/d28/d3e/c8d to d2/d5/d3a/d65/d81/db5/cbe 0 2024-04-20T21:59:04.474 INFO:tasks.workunit.client.1.smithi164.stdout:4/563: dwrite d4/fb [0,4194304] 0 2024-04-20T21:59:04.477 INFO:tasks.workunit.client.1.smithi164.stdout:5/680: symlink dc/d2b/d6d/d73/leb 0 2024-04-20T21:59:04.478 INFO:tasks.workunit.client.1.smithi164.stdout:3/644: mknod d12/d20/d39/d69/d9a/ccd 0 2024-04-20T21:59:04.480 INFO:tasks.workunit.client.1.smithi164.stdout:4/564: chown d4/d28/d3e/f59 551 1 2024-04-20T21:59:04.481 INFO:tasks.workunit.client.1.smithi164.stdout:2/608: dread d2/d5f/f7d [0,4194304] 0 2024-04-20T21:59:04.484 INFO:tasks.workunit.client.1.smithi164.stdout:1/547: rename d10/d7d/fa0 to d10/d33/d48/fb7 0 2024-04-20T21:59:04.484 INFO:tasks.workunit.client.1.smithi164.stdout:3/645: read - d12/d20/d39/d69/dad/fbf zero size 2024-04-20T21:59:04.486 INFO:tasks.workunit.client.1.smithi164.stdout:9/673: dwrite d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/f97 [0,4194304] 0 2024-04-20T21:59:04.487 INFO:tasks.workunit.client.1.smithi164.stdout:1/548: chown d10/d33/d48/f6b 31664755 1 2024-04-20T21:59:04.489 INFO:tasks.workunit.client.1.smithi164.stdout:5/681: mkdir dc/d2b/d6d/d73/de0/dec 0 2024-04-20T21:59:04.494 INFO:tasks.workunit.client.1.smithi164.stdout:0/583: link d1/d4/d49/f95 d1/d4/d26/d29/d2d/fa7 0 2024-04-20T21:59:04.497 INFO:tasks.workunit.client.1.smithi164.stdout:5/682: symlink dc/d12/d1e/da8/led 0 2024-04-20T21:59:04.501 INFO:tasks.workunit.client.1.smithi164.stdout:1/549: dwrite d10/f5e [0,4194304] 0 2024-04-20T21:59:04.502 INFO:tasks.workunit.client.1.smithi164.stdout:0/584: link d1/f3e d1/d4/d26/fa8 0 2024-04-20T21:59:04.505 INFO:tasks.workunit.client.1.smithi164.stdout:5/683: mknod dc/d2c/d2e/d30/cee 0 2024-04-20T21:59:04.512 INFO:tasks.workunit.client.1.smithi164.stdout:0/585: creat d1/d4/d26/d29/d2d/d54/fa9 x:0 0 0 2024-04-20T21:59:04.514 INFO:tasks.workunit.client.1.smithi164.stdout:7/613: truncate d2/d21/d24/f71 901953 0 2024-04-20T21:59:04.522 INFO:tasks.workunit.client.1.smithi164.stdout:4/565: write d4/f7 [4784095,17516] 0 2024-04-20T21:59:04.523 INFO:tasks.workunit.client.1.smithi164.stdout:3/646: write d12/d20/f7e [1080681,71374] 0 2024-04-20T21:59:04.523 INFO:tasks.workunit.client.1.smithi164.stdout:5/684: dwrite dc/d12/d1e/da8/fe6 [0,4194304] 0 2024-04-20T21:59:04.524 INFO:tasks.workunit.client.1.smithi164.stdout:7/614: creat d2/d21/fd2 x:0 0 0 2024-04-20T21:59:04.528 INFO:tasks.workunit.client.1.smithi164.stdout:3/647: rmdir d12/d20/d39/d55/d6b/d79 39 2024-04-20T21:59:04.531 INFO:tasks.workunit.client.1.smithi164.stdout:4/566: symlink d4/d9/lb7 0 2024-04-20T21:59:04.532 INFO:tasks.workunit.client.1.smithi164.stdout:7/615: creat d2/d21/d33/fd3 x:0 0 0 2024-04-20T21:59:04.532 INFO:tasks.workunit.client.1.smithi164.stdout:5/685: mkdir dc/d12/d1e/def 0 2024-04-20T21:59:04.534 INFO:tasks.workunit.client.1.smithi164.stdout:5/686: write dc/d2b/d6d/fa6 [936498,48315] 0 2024-04-20T21:59:04.546 INFO:tasks.workunit.client.1.smithi164.stdout:5/687: mkdir dc/d2c/d2e/d30/d72/da9/df0 0 2024-04-20T21:59:04.547 INFO:tasks.workunit.client.1.smithi164.stdout:1/550: write d10/d33/d41/f58 [1157785,113598] 0 2024-04-20T21:59:04.547 INFO:tasks.workunit.client.1.smithi164.stdout:4/567: mknod d4/d9/cb8 0 2024-04-20T21:59:04.548 INFO:tasks.workunit.client.1.smithi164.stdout:9/674: dwrite d3/db/d1b/d1e/f79 [0,4194304] 0 2024-04-20T21:59:04.549 INFO:tasks.workunit.client.1.smithi164.stdout:4/568: stat d4/d9/d22/c9c 0 2024-04-20T21:59:04.551 INFO:tasks.workunit.client.1.smithi164.stdout:9/675: chown d3/db/d1b/d20/f7d 146760925 1 2024-04-20T21:59:04.551 INFO:tasks.workunit.client.1.smithi164.stdout:0/586: truncate d1/d4/df/f3b 689882 0 2024-04-20T21:59:04.556 INFO:tasks.workunit.client.1.smithi164.stdout:3/648: write ff [4160293,91108] 0 2024-04-20T21:59:04.571 INFO:tasks.workunit.client.1.smithi164.stdout:6/658: sync 2024-04-20T21:59:04.571 INFO:tasks.workunit.client.1.smithi164.stdout:4/569: dwrite d4/d9/f11 [0,4194304] 0 2024-04-20T21:59:04.571 INFO:tasks.workunit.client.1.smithi164.stdout:1/551: truncate d10/f12 474857 0 2024-04-20T21:59:04.574 INFO:tasks.workunit.client.1.smithi164.stdout:1/552: stat d10/d16/d20/d25/fad 0 2024-04-20T21:59:04.576 INFO:tasks.workunit.client.1.smithi164.stdout:7/616: dread d2/f72 [0,4194304] 0 2024-04-20T21:59:04.577 INFO:tasks.workunit.client.1.smithi164.stdout:1/553: stat d10/f8f 0 2024-04-20T21:59:04.577 INFO:tasks.workunit.client.1.smithi164.stdout:9/676: link d3/db/d1b/d20/d3f/d8a/da7/dbd/fa2 d3/db/d82/d98/db6/fee 0 2024-04-20T21:59:04.577 INFO:tasks.workunit.client.1.smithi164.stdout:3/649: write d12/f1f [1775730,80399] 0 2024-04-20T21:59:04.580 INFO:tasks.workunit.client.1.smithi164.stdout:9/677: readlink d3/d9f/lc8 0 2024-04-20T21:59:04.581 INFO:tasks.workunit.client.1.smithi164.stdout:6/659: dread - d0/d3/d15/d21/d5c/dbf/d97/fb6 zero size 2024-04-20T21:59:04.582 INFO:tasks.workunit.client.1.smithi164.stdout:4/570: mknod d4/d9/d27/d37/cb9 0 2024-04-20T21:59:04.586 INFO:tasks.workunit.client.1.smithi164.stdout:0/587: dwrite d1/d4/da/d27/f32 [0,4194304] 0 2024-04-20T21:59:04.586 INFO:tasks.workunit.client.1.smithi164.stdout:1/554: fdatasync d10/d33/d48/f4f 0 2024-04-20T21:59:04.595 INFO:tasks.workunit.client.1.smithi164.stdout:9/678: write d3/db/d1b/d20/d3f/d8a/da7/dbd/fbb [939329,129421] 0 2024-04-20T21:59:04.595 INFO:tasks.workunit.client.1.smithi164.stdout:1/555: fdatasync d10/d16/d20/d26/d34/f5d 0 2024-04-20T21:59:04.595 INFO:tasks.workunit.client.1.smithi164.stdout:7/617: rename d2/d21/d24/d60 to d2/d21/d44/dd4 0 2024-04-20T21:59:04.600 INFO:tasks.workunit.client.1.smithi164.stdout:6/660: truncate d0/d3/d15/d23/d45/d4f/d61/f72 707094 0 2024-04-20T21:59:04.603 INFO:tasks.workunit.client.1.smithi164.stdout:0/588: symlink d1/d4/da/d5c/d6e/laa 0 2024-04-20T21:59:04.605 INFO:tasks.workunit.client.1.smithi164.stdout:7/618: read d2/f29 [512,10518] 0 2024-04-20T21:59:04.606 INFO:tasks.workunit.client.1.smithi164.stdout:3/650: write d12/d20/d39/d55/d6b/d79/f91 [4834304,4914] 0 2024-04-20T21:59:04.609 INFO:tasks.workunit.client.1.smithi164.stdout:1/556: chown d10/d33/f87 40844233 1 2024-04-20T21:59:04.612 INFO:tasks.workunit.client.1.smithi164.stdout:3/651: chown d12/f73 793 1 2024-04-20T21:59:04.612 INFO:tasks.workunit.client.1.smithi164.stdout:5/688: dread dc/d12/f15 [0,4194304] 0 2024-04-20T21:59:04.613 INFO:tasks.workunit.client.1.smithi164.stdout:1/557: fsync d10/d16/d20/d81/fb1 0 2024-04-20T21:59:04.614 INFO:tasks.workunit.client.1.smithi164.stdout:6/661: mkdir d0/d3/d27/dde 0 2024-04-20T21:59:04.614 INFO:tasks.workunit.client.1.smithi164.stdout:4/571: dread d4/d28/d3e/f79 [0,4194304] 0 2024-04-20T21:59:04.616 INFO:tasks.workunit.client.1.smithi164.stdout:7/619: truncate d2/d21/d33/fc9 256026 0 2024-04-20T21:59:04.619 INFO:tasks.workunit.client.1.smithi164.stdout:0/589: symlink d1/d4/da/d5c/lab 0 2024-04-20T21:59:04.620 INFO:tasks.workunit.client.1.smithi164.stdout:8/569: sync 2024-04-20T21:59:04.620 INFO:tasks.workunit.client.1.smithi164.stdout:2/609: sync 2024-04-20T21:59:04.621 INFO:tasks.workunit.client.1.smithi164.stdout:0/590: write d1/d4/f2c [2826931,52858] 0 2024-04-20T21:59:04.621 INFO:tasks.workunit.client.1.smithi164.stdout:3/652: unlink d12/d6d/f96 0 2024-04-20T21:59:04.625 INFO:tasks.workunit.client.1.smithi164.stdout:5/689: rename dc/d2b/fda to dc/d2b/d52/ff1 0 2024-04-20T21:59:04.629 INFO:tasks.workunit.client.1.smithi164.stdout:4/572: symlink d4/d9/d5c/lba 0 2024-04-20T21:59:04.638 INFO:tasks.workunit.client.1.smithi164.stdout:1/558: rename d10/d16/f27 to d10/d16/d20/d91/d9d/fb8 0 2024-04-20T21:59:04.640 INFO:tasks.workunit.client.1.smithi164.stdout:1/559: chown d10/d16/d19/d1a/c37 0 1 2024-04-20T21:59:04.641 INFO:tasks.workunit.client.1.smithi164.stdout:9/679: link d3/db/d1b/d1e/l32 d3/db/dd/d40/d78/d86/lef 0 2024-04-20T21:59:04.642 INFO:tasks.workunit.client.1.smithi164.stdout:5/690: rmdir dc/d2c/d2e/d30 39 2024-04-20T21:59:04.644 INFO:tasks.workunit.client.1.smithi164.stdout:1/560: truncate d10/d16/d20/d81/fb1 974261 0 2024-04-20T21:59:04.645 INFO:tasks.workunit.client.1.smithi164.stdout:7/620: symlink d2/d21/d24/d31/d3a/d83/dcf/ld5 0 2024-04-20T21:59:04.646 INFO:tasks.workunit.client.1.smithi164.stdout:7/621: stat d2/d21/d24/f30 0 2024-04-20T21:59:04.647 INFO:tasks.workunit.client.1.smithi164.stdout:0/591: symlink d1/lac 0 2024-04-20T21:59:04.648 INFO:tasks.workunit.client.1.smithi164.stdout:7/622: fdatasync d2/d21/d24/f9a 0 2024-04-20T21:59:04.655 INFO:tasks.workunit.client.1.smithi164.stdout:6/662: rename d0/d3/d8 to d0/d3/d15/d21/d5c/dbf/dbd/ddf 0 2024-04-20T21:59:04.656 INFO:tasks.workunit.client.1.smithi164.stdout:5/691: symlink dc/d2b/d52/lf2 0 2024-04-20T21:59:04.657 INFO:tasks.workunit.client.1.smithi164.stdout:1/561: mkdir d10/d16/d20/d91/db9 0 2024-04-20T21:59:04.658 INFO:tasks.workunit.client.1.smithi164.stdout:4/573: symlink d4/d28/dad/lbb 0 2024-04-20T21:59:04.660 INFO:tasks.workunit.client.1.smithi164.stdout:9/680: dwrite d3/d9f/fda [0,4194304] 0 2024-04-20T21:59:04.660 INFO:tasks.workunit.client.1.smithi164.stdout:5/692: fdatasync dc/d2b/d52/fd5 0 2024-04-20T21:59:04.661 INFO:tasks.workunit.client.1.smithi164.stdout:6/663: write d0/d3/f12 [6124198,97203] 0 2024-04-20T21:59:04.667 INFO:tasks.workunit.client.1.smithi164.stdout:8/570: truncate d0/d14/d16/d5a/f6c 641425 0 2024-04-20T21:59:04.674 INFO:tasks.workunit.client.1.smithi164.stdout:1/562: mknod d10/d16/d20/cba 0 2024-04-20T21:59:04.674 INFO:tasks.workunit.client.1.smithi164.stdout:9/681: chown d3/db/dd/f23 1321 1 2024-04-20T21:59:04.676 INFO:tasks.workunit.client.1.smithi164.stdout:5/693: chown dc/d2c/d2e/d30/d5e/cb3 233249 1 2024-04-20T21:59:04.679 INFO:tasks.workunit.client.1.smithi164.stdout:9/682: write d3/f1f [2357388,18333] 0 2024-04-20T21:59:04.680 INFO:tasks.workunit.client.1.smithi164.stdout:2/610: dwrite d2/d5/f9b [0,4194304] 0 2024-04-20T21:59:04.685 INFO:tasks.workunit.client.1.smithi164.stdout:9/683: fsync d3/db0/fcb 0 2024-04-20T21:59:04.687 INFO:tasks.workunit.client.1.smithi164.stdout:8/571: mknod d0/d14/d4e/d62/d82/d97/cc1 0 2024-04-20T21:59:04.687 INFO:tasks.workunit.client.1.smithi164.stdout:3/653: rename d12/d20/d39/f46 to d12/fce 0 2024-04-20T21:59:04.687 INFO:tasks.workunit.client.1.smithi164.stdout:7/623: dwrite d2/d21/d24/d31/d3a/d83/d63/fab [4194304,4194304] 0 2024-04-20T21:59:04.693 INFO:tasks.workunit.client.1.smithi164.stdout:9/684: write d3/db/d1b/d1e/f81 [419145,123206] 0 2024-04-20T21:59:04.693 INFO:tasks.workunit.client.1.smithi164.stdout:3/654: readlink d12/d15/l29 0 2024-04-20T21:59:04.697 INFO:tasks.workunit.client.1.smithi164.stdout:0/592: dread d1/f3e [0,4194304] 0 2024-04-20T21:59:04.701 INFO:tasks.workunit.client.1.smithi164.stdout:9/685: fsync d3/f94 0 2024-04-20T21:59:04.703 INFO:tasks.workunit.client.1.smithi164.stdout:4/574: rename d4/d9/d27/d3f/d67/f98 to d4/d9/d5c/fbc 0 2024-04-20T21:59:04.703 INFO:tasks.workunit.client.1.smithi164.stdout:8/572: unlink d0/d14/cd 0 2024-04-20T21:59:04.704 INFO:tasks.workunit.client.1.smithi164.stdout:1/563: dread d10/d33/d41/f58 [0,4194304] 0 2024-04-20T21:59:04.708 INFO:tasks.workunit.client.1.smithi164.stdout:7/624: symlink d2/d21/d24/ld6 0 2024-04-20T21:59:04.708 INFO:tasks.workunit.client.1.smithi164.stdout:4/575: chown d4/d28/f58 77039285 1 2024-04-20T21:59:04.709 INFO:tasks.workunit.client.1.smithi164.stdout:0/593: mknod d1/d4/da/d27/cad 0 2024-04-20T21:59:04.709 INFO:tasks.workunit.client.1.smithi164.stdout:9/686: chown d3/db/de5 950 1 2024-04-20T21:59:04.713 INFO:tasks.workunit.client.1.smithi164.stdout:4/576: stat d4/d9/d27/f48 0 2024-04-20T21:59:04.713 INFO:tasks.workunit.client.1.smithi164.stdout:5/694: dwrite dc/d2b/da0/fd0 [0,4194304] 0 2024-04-20T21:59:04.716 INFO:tasks.workunit.client.1.smithi164.stdout:4/577: chown d4/d9/d5c/c8f 983608 1 2024-04-20T21:59:04.719 INFO:tasks.workunit.client.1.smithi164.stdout:2/611: truncate d2/d5/d3a/d55/d58/f85 1091099 0 2024-04-20T21:59:04.720 INFO:tasks.workunit.client.1.smithi164.stdout:4/578: write d4/d9/da4/fa6 [635514,96449] 0 2024-04-20T21:59:04.724 INFO:tasks.workunit.client.1.smithi164.stdout:7/625: symlink d2/d21/d24/d31/d3a/d83/d63/d85/ld7 0 2024-04-20T21:59:04.724 INFO:tasks.workunit.client.1.smithi164.stdout:0/594: mknod d1/d4/da/cae 0 2024-04-20T21:59:04.727 INFO:tasks.workunit.client.1.smithi164.stdout:3/655: dwrite d12/d20/d39/d55/d6b/f97 [0,4194304] 0 2024-04-20T21:59:04.729 INFO:tasks.workunit.client.1.smithi164.stdout:2/612: write d2/d5/d3a/f6a [4436387,95547] 0 2024-04-20T21:59:04.734 INFO:tasks.workunit.client.1.smithi164.stdout:3/656: readlink d12/d15/l3f 0 2024-04-20T21:59:04.734 INFO:tasks.workunit.client.1.smithi164.stdout:4/579: mkdir d4/d28/dad/dbd 0 2024-04-20T21:59:04.737 INFO:tasks.workunit.client.1.smithi164.stdout:2/613: write d2/d19/d28/f4e [382852,110976] 0 2024-04-20T21:59:04.739 INFO:tasks.workunit.client.1.smithi164.stdout:4/580: write d4/fe [2997083,121467] 0 2024-04-20T21:59:04.740 INFO:tasks.workunit.client.1.smithi164.stdout:2/614: chown d2/d19/d28/d3e/d9e 12547 1 2024-04-20T21:59:04.745 INFO:tasks.workunit.client.1.smithi164.stdout:1/564: dread d10/d16/d20/d26/f74 [0,4194304] 0 2024-04-20T21:59:04.745 INFO:tasks.workunit.client.1.smithi164.stdout:7/626: truncate d2/d21/d44/dd4/f76 6426050 0 2024-04-20T21:59:04.745 INFO:tasks.workunit.client.1.smithi164.stdout:3/657: mknod d12/d68/d6f/d71/ccf 0 2024-04-20T21:59:04.752 INFO:tasks.workunit.client.1.smithi164.stdout:2/615: fsync d2/d5/d3a/d65/d81/db5/dba/d62/f88 0 2024-04-20T21:59:04.758 INFO:tasks.workunit.client.1.smithi164.stdout:1/565: unlink d10/d33/d48/l59 0 2024-04-20T21:59:04.758 INFO:tasks.workunit.client.1.smithi164.stdout:1/566: readlink lc 0 2024-04-20T21:59:04.762 INFO:tasks.workunit.client.1.smithi164.stdout:8/573: dread d0/d14/d4e/d86/f8c [0,4194304] 0 2024-04-20T21:59:04.764 INFO:tasks.workunit.client.1.smithi164.stdout:0/595: dwrite d1/d4/d49/f5f [0,4194304] 0 2024-04-20T21:59:04.764 INFO:tasks.workunit.client.1.smithi164.stdout:8/574: readlink d0/l42 0 2024-04-20T21:59:04.766 INFO:tasks.workunit.client.1.smithi164.stdout:6/664: sync 2024-04-20T21:59:04.769 INFO:tasks.workunit.client.1.smithi164.stdout:5/695: dread dc/d2c/d2e/d30/d72/da9/fb2 [0,4194304] 0 2024-04-20T21:59:04.769 INFO:tasks.workunit.client.1.smithi164.stdout:7/627: truncate d2/f8e 1273294 0 2024-04-20T21:59:04.770 INFO:tasks.workunit.client.1.smithi164.stdout:4/581: truncate d4/fe 3042950 0 2024-04-20T21:59:04.770 INFO:tasks.workunit.client.1.smithi164.stdout:0/596: write d1/d4/d26/d29/d2d/d54/fa9 [649293,8862] 0 2024-04-20T21:59:04.773 INFO:tasks.workunit.client.1.smithi164.stdout:3/658: dread d12/f32 [0,4194304] 0 2024-04-20T21:59:04.774 INFO:tasks.workunit.client.1.smithi164.stdout:3/659: stat f9 0 2024-04-20T21:59:04.776 INFO:tasks.workunit.client.1.smithi164.stdout:4/582: fdatasync d4/d28/d3e/d4a/f9f 0 2024-04-20T21:59:04.779 INFO:tasks.workunit.client.1.smithi164.stdout:6/665: fsync d0/d3/d15/d21/d5c/dbf/dbd/ddf/f3c 0 2024-04-20T21:59:04.781 INFO:tasks.workunit.client.1.smithi164.stdout:8/575: creat d0/d14/d4e/d62/d8f/dbe/fc2 x:0 0 0 2024-04-20T21:59:04.784 INFO:tasks.workunit.client.1.smithi164.stdout:8/576: readlink d0/d14/d16/l38 0 2024-04-20T21:59:04.784 INFO:tasks.workunit.client.1.smithi164.stdout:0/597: truncate d1/d4/d20/f40 604589 0 2024-04-20T21:59:04.785 INFO:tasks.workunit.client.1.smithi164.stdout:6/666: read d0/d3/d11/d29/d6e/d41/fb7 [2216124,68566] 0 2024-04-20T21:59:04.789 INFO:tasks.workunit.client.1.smithi164.stdout:4/583: rename d4/d9/d22/l90 to d4/d9/da4/lbe 0 2024-04-20T21:59:04.797 INFO:tasks.workunit.client.1.smithi164.stdout:2/616: dwrite d2/d5/d3a/fa4 [0,4194304] 0 2024-04-20T21:59:04.797 INFO:tasks.workunit.client.1.smithi164.stdout:9/687: sync 2024-04-20T21:59:04.802 INFO:tasks.workunit.client.1.smithi164.stdout:1/567: dwrite d10/d16/d20/d25/fad [0,4194304] 0 2024-04-20T21:59:04.802 INFO:tasks.workunit.client.1.smithi164.stdout:3/660: rename d12/d20/da2 to d12/d20/d39/d55/d87/dd0 0 2024-04-20T21:59:04.804 INFO:tasks.workunit.client.1.smithi164.stdout:4/584: rmdir d4/d9/d27/d3f/d9b 39 2024-04-20T21:59:04.811 INFO:tasks.workunit.client.1.smithi164.stdout:7/628: write d2/d21/d24/d31/d3a/f81 [43514,117691] 0 2024-04-20T21:59:04.812 INFO:tasks.workunit.client.1.smithi164.stdout:5/696: dwrite dc/d2c/d2e/d30/f55 [4194304,4194304] 0 2024-04-20T21:59:04.816 INFO:tasks.workunit.client.1.smithi164.stdout:7/629: chown d2/d21/d24/d31/d3a/f81 70001 1 2024-04-20T21:59:04.817 INFO:tasks.workunit.client.1.smithi164.stdout:6/667: rename d0/d3/d15/d21/d5c/c86 to d0/d3/d11/d5a/ce0 0 2024-04-20T21:59:04.817 INFO:tasks.workunit.client.1.smithi164.stdout:5/697: write dc/d2b/d52/d64/f7f [2694133,51731] 0 2024-04-20T21:59:04.819 INFO:tasks.workunit.client.1.smithi164.stdout:7/630: dread - d2/f8c zero size 2024-04-20T21:59:04.820 INFO:tasks.workunit.client.1.smithi164.stdout:4/585: fsync d4/d28/d3e/d41/f6e 0 2024-04-20T21:59:04.826 INFO:tasks.workunit.client.1.smithi164.stdout:0/598: creat d1/d4/d26/d29/d2d/faf x:0 0 0 2024-04-20T21:59:04.826 INFO:tasks.workunit.client.1.smithi164.stdout:5/698: write dc/d2c/fdd [418527,130124] 0 2024-04-20T21:59:04.827 INFO:tasks.workunit.client.1.smithi164.stdout:2/617: rename d2/d19/c27 to d2/d5f/cbf 0 2024-04-20T21:59:04.828 INFO:tasks.workunit.client.1.smithi164.stdout:7/631: chown d2/d21/d24/d31/d3a/d83/f96 109716 1 2024-04-20T21:59:04.829 INFO:tasks.workunit.client.1.smithi164.stdout:9/688: creat d3/db/dd/d40/ff0 x:0 0 0 2024-04-20T21:59:04.830 INFO:tasks.workunit.client.1.smithi164.stdout:0/599: fsync d1/d2b/f6b 0 2024-04-20T21:59:04.834 INFO:tasks.workunit.client.1.smithi164.stdout:1/568: creat d10/fbb x:0 0 0 2024-04-20T21:59:04.835 INFO:tasks.workunit.client.1.smithi164.stdout:8/577: dread d0/f24 [0,4194304] 0 2024-04-20T21:59:04.835 INFO:tasks.workunit.client.1.smithi164.stdout:6/668: creat d0/d3/d15/d21/d5c/dbf/db4/dcd/fe1 x:0 0 0 2024-04-20T21:59:04.836 INFO:tasks.workunit.client.1.smithi164.stdout:5/699: truncate dc/fd 4964474 0 2024-04-20T21:59:04.836 INFO:tasks.workunit.client.1.smithi164.stdout:4/586: rename d4/d9/d27/d3f to d4/d9/d5c/d97/dbf 0 2024-04-20T21:59:04.837 INFO:tasks.workunit.client.1.smithi164.stdout:1/569: stat d10/d33/d41/f63 0 2024-04-20T21:59:04.838 INFO:tasks.workunit.client.1.smithi164.stdout:0/600: read d1/f23 [3646779,84682] 0 2024-04-20T21:59:04.838 INFO:tasks.workunit.client.1.smithi164.stdout:8/578: fsync d0/d14/d4e/d62/fa7 0 2024-04-20T21:59:04.846 INFO:tasks.workunit.client.1.smithi164.stdout:6/669: symlink d0/d3/d15/le2 0 2024-04-20T21:59:04.848 INFO:tasks.workunit.client.1.smithi164.stdout:1/570: creat d10/d16/d20/d25/d3d/fbc x:0 0 0 2024-04-20T21:59:04.854 INFO:tasks.workunit.client.1.smithi164.stdout:5/700: rename dc/d2b/ca7 to dc/d2b/d6d/d73/de3/cf3 0 2024-04-20T21:59:04.854 INFO:tasks.workunit.client.1.smithi164.stdout:6/670: readlink d0/d3/d15/d21/d5c/dbf/l63 0 2024-04-20T21:59:04.854 INFO:tasks.workunit.client.1.smithi164.stdout:3/661: dwrite d12/d6d/f85 [0,4194304] 0 2024-04-20T21:59:04.862 INFO:tasks.workunit.client.1.smithi164.stdout:0/601: write d1/f42 [3959086,26079] 0 2024-04-20T21:59:04.868 INFO:tasks.workunit.client.1.smithi164.stdout:4/587: dwrite d4/d9/fc [0,4194304] 0 2024-04-20T21:59:04.868 INFO:tasks.workunit.client.1.smithi164.stdout:6/671: symlink d0/d3/d15/d21/d5c/le3 0 2024-04-20T21:59:04.872 INFO:tasks.workunit.client.1.smithi164.stdout:7/632: rename d2/d21/d24/d31/d3a/d83/d63/lac to d2/d21/d24/d31/d3a/d83/d63/ld8 0 2024-04-20T21:59:04.873 INFO:tasks.workunit.client.1.smithi164.stdout:8/579: dwrite d0/d14/d16/d58/fb8 [0,4194304] 0 2024-04-20T21:59:04.877 INFO:tasks.workunit.client.1.smithi164.stdout:2/618: dread d2/d5/f82 [0,4194304] 0 2024-04-20T21:59:04.882 INFO:tasks.workunit.client.1.smithi164.stdout:2/619: write d2/d19/d28/f4e [142425,108717] 0 2024-04-20T21:59:04.884 INFO:tasks.workunit.client.1.smithi164.stdout:1/571: dread d10/d16/d19/d1a/f32 [0,4194304] 0 2024-04-20T21:59:04.919 INFO:tasks.workunit.client.1.smithi164.stdout:2/620: dread d2/d30/f4b [4194304,4194304] 0 2024-04-20T21:59:04.934 INFO:tasks.workunit.client.1.smithi164.stdout:2/621: dwrite d2/f9c [0,4194304] 0 2024-04-20T21:59:04.935 INFO:tasks.workunit.client.1.smithi164.stdout:2/622: chown d2/d5/d3a/d65/f7f 196284 1 2024-04-20T21:59:04.936 INFO:tasks.workunit.client.1.smithi164.stdout:5/701: link dc/d2c/l36 dc/d12/d1e/def/lf4 0 2024-04-20T21:59:04.944 INFO:tasks.workunit.client.1.smithi164.stdout:4/588: mknod d4/d28/d3e/d41/cc0 0 2024-04-20T21:59:04.948 INFO:tasks.workunit.client.1.smithi164.stdout:9/689: sync 2024-04-20T21:59:04.953 INFO:tasks.workunit.client.1.smithi164.stdout:6/672: dwrite d0/fdd [0,4194304] 0 2024-04-20T21:59:04.969 INFO:tasks.workunit.client.1.smithi164.stdout:7/633: dwrite d2/d21/fb2 [0,4194304] 0 2024-04-20T21:59:04.973 INFO:tasks.workunit.client.1.smithi164.stdout:7/634: stat d2/f1c 0 2024-04-20T21:59:04.974 INFO:tasks.workunit.client.1.smithi164.stdout:2/623: fsync d2/d19/d28/f32 0 2024-04-20T21:59:04.979 INFO:tasks.workunit.client.1.smithi164.stdout:5/702: rename dc/fd to dc/d2c/ff5 0 2024-04-20T21:59:04.991 INFO:tasks.workunit.client.1.smithi164.stdout:6/673: symlink d0/d3/d15/d23/d45/d4f/d61/le4 0 2024-04-20T21:59:04.994 INFO:tasks.workunit.client.1.smithi164.stdout:6/674: write d0/d3/d15/d23/d45/d4f/f68 [3895650,106456] 0 2024-04-20T21:59:04.996 INFO:tasks.workunit.client.1.smithi164.stdout:6/675: write d0/d3/d15/d21/f91 [925381,37214] 0 2024-04-20T21:59:05.005 INFO:tasks.workunit.client.1.smithi164.stdout:3/662: sync 2024-04-20T21:59:05.007 INFO:tasks.workunit.client.1.smithi164.stdout:3/663: write d12/d15/f38 [2918483,28249] 0 2024-04-20T21:59:05.012 INFO:tasks.workunit.client.1.smithi164.stdout:3/664: truncate d12/d20/f88 1399515 0 2024-04-20T21:59:05.021 INFO:tasks.workunit.client.1.smithi164.stdout:2/624: creat d2/d30/da5/fc0 x:0 0 0 2024-04-20T21:59:05.021 INFO:tasks.workunit.client.1.smithi164.stdout:6/676: dread d0/d3/d15/d23/d45/d4f/f66 [0,4194304] 0 2024-04-20T21:59:05.023 INFO:tasks.workunit.client.1.smithi164.stdout:9/690: rename d3/f94 to d3/ff1 0 2024-04-20T21:59:05.029 INFO:tasks.workunit.client.1.smithi164.stdout:4/589: rename d4/d9/d27/f7d to d4/d9/d5c/d97/dbf/d67/fc1 0 2024-04-20T21:59:05.034 INFO:tasks.workunit.client.1.smithi164.stdout:2/625: creat d2/d5/d3a/d55/d58/da2/fc1 x:0 0 0 2024-04-20T21:59:05.051 INFO:tasks.workunit.client.1.smithi164.stdout:2/626: creat d2/d5/d3a/d65/d81/fc2 x:0 0 0 2024-04-20T21:59:05.051 INFO:tasks.workunit.client.1.smithi164.stdout:8/580: symlink d0/d14/d16/lc3 0 2024-04-20T21:59:05.052 INFO:tasks.workunit.client.1.smithi164.stdout:2/627: dread - d2/d5f/faf zero size 2024-04-20T21:59:05.054 INFO:tasks.workunit.client.1.smithi164.stdout:0/602: truncate d1/d4/da/f2e 2224530 0 2024-04-20T21:59:05.055 INFO:tasks.workunit.client.1.smithi164.stdout:4/590: dread f3 [4194304,4194304] 0 2024-04-20T21:59:05.062 INFO:tasks.workunit.client.1.smithi164.stdout:2/628: creat d2/d19/d28/d3e/fc3 x:0 0 0 2024-04-20T21:59:05.064 INFO:tasks.workunit.client.1.smithi164.stdout:4/591: mkdir d4/d9/d22/dc2 0 2024-04-20T21:59:05.069 INFO:tasks.workunit.client.1.smithi164.stdout:2/629: creat d2/d19/d28/d3e/fc4 x:0 0 0 2024-04-20T21:59:05.071 INFO:tasks.workunit.client.1.smithi164.stdout:1/572: write d10/d16/d19/d1a/d51/f61 [1047203,22495] 0 2024-04-20T21:59:05.073 INFO:tasks.workunit.client.1.smithi164.stdout:2/630: fsync d2/d5/d3a/d65/d81/db5/dba/fb2 0 2024-04-20T21:59:05.077 INFO:tasks.workunit.client.1.smithi164.stdout:2/631: read - d2/f78 zero size 2024-04-20T21:59:05.082 INFO:tasks.workunit.client.1.smithi164.stdout:4/592: dwrite d4/f7 [0,4194304] 0 2024-04-20T21:59:05.085 INFO:tasks.workunit.client.1.smithi164.stdout:2/632: link d2/d5/d3a/d55/f69 d2/d19/d28/fc5 0 2024-04-20T21:59:05.086 INFO:tasks.workunit.client.1.smithi164.stdout:4/593: stat d4/d9/d22/c50 0 2024-04-20T21:59:05.090 INFO:tasks.workunit.client.1.smithi164.stdout:4/594: write d4/d9/d22/f77 [690229,1745] 0 2024-04-20T21:59:05.092 INFO:tasks.workunit.client.1.smithi164.stdout:2/633: write d2/d19/d28/d3e/f42 [1448030,37704] 0 2024-04-20T21:59:05.095 INFO:tasks.workunit.client.1.smithi164.stdout:1/573: symlink d10/d16/d19/d1a/lbd 0 2024-04-20T21:59:05.103 INFO:tasks.workunit.client.1.smithi164.stdout:0/603: mknod d1/cb0 0 2024-04-20T21:59:05.107 INFO:tasks.workunit.client.1.smithi164.stdout:7/635: dwrite d2/f8e [0,4194304] 0 2024-04-20T21:59:05.107 INFO:tasks.workunit.client.1.smithi164.stdout:4/595: dread d4/fb [0,4194304] 0 2024-04-20T21:59:05.109 INFO:tasks.workunit.client.1.smithi164.stdout:7/636: chown d2/d21/d24 26783774 1 2024-04-20T21:59:05.110 INFO:tasks.workunit.client.1.smithi164.stdout:4/596: chown d4/d9/d27 21 1 2024-04-20T21:59:05.111 INFO:tasks.workunit.client.1.smithi164.stdout:5/703: mkdir dc/d2b/df6 0 2024-04-20T21:59:05.115 INFO:tasks.workunit.client.1.smithi164.stdout:3/665: rename d12/f73 to d12/d20/d39/fd1 0 2024-04-20T21:59:05.117 INFO:tasks.workunit.client.1.smithi164.stdout:7/637: write d2/d21/fd2 [989136,101707] 0 2024-04-20T21:59:05.118 INFO:tasks.workunit.client.1.smithi164.stdout:5/704: write dc/d2c/d2e/f46 [1334128,87786] 0 2024-04-20T21:59:05.120 INFO:tasks.workunit.client.1.smithi164.stdout:2/634: dwrite d2/f3c [0,4194304] 0 2024-04-20T21:59:05.124 INFO:tasks.workunit.client.1.smithi164.stdout:9/691: rename d3/db/d1b/d20/d3f/d8a/da7/dbd/l74 to d3/db/dd/d40/d78/lf2 0 2024-04-20T21:59:05.127 INFO:tasks.workunit.client.1.smithi164.stdout:1/574: dwrite d10/f5c [8388608,4194304] 0 2024-04-20T21:59:05.129 INFO:tasks.workunit.client.1.smithi164.stdout:6/677: write d0/d3/d11/f49 [1738239,64786] 0 2024-04-20T21:59:05.134 INFO:tasks.workunit.client.1.smithi164.stdout:4/597: mkdir d4/d9/d5c/d97/dbf/d67/d86/dc3 0 2024-04-20T21:59:05.149 INFO:tasks.workunit.client.1.smithi164.stdout:5/705: symlink dc/d2b/d6d/d73/lf7 0 2024-04-20T21:59:05.150 INFO:tasks.workunit.client.1.smithi164.stdout:9/692: mknod d3/db/d82/cf3 0 2024-04-20T21:59:05.151 INFO:tasks.workunit.client.1.smithi164.stdout:8/581: rename d0/d14/f18 to d0/db7/fc4 0 2024-04-20T21:59:05.152 INFO:tasks.workunit.client.1.smithi164.stdout:5/706: write f5 [8685427,120033] 0 2024-04-20T21:59:05.159 INFO:tasks.workunit.client.1.smithi164.stdout:1/575: stat d10/d16/d20/d66/c79 0 2024-04-20T21:59:05.161 INFO:tasks.workunit.client.1.smithi164.stdout:2/635: symlink d2/d5/d3a/d55/d58/lc6 0 2024-04-20T21:59:05.163 INFO:tasks.workunit.client.1.smithi164.stdout:6/678: rmdir d0/d3/d15/d23/d45/d4f/d61 39 2024-04-20T21:59:05.163 INFO:tasks.workunit.client.1.smithi164.stdout:3/666: dread - d12/d20/d39/d55/d6b/f72 zero size 2024-04-20T21:59:05.164 INFO:tasks.workunit.client.1.smithi164.stdout:8/582: mknod d0/d14/d4e/d6f/cc5 0 2024-04-20T21:59:05.165 INFO:tasks.workunit.client.1.smithi164.stdout:5/707: mkdir dc/d2b/da0/df8 0 2024-04-20T21:59:05.167 INFO:tasks.workunit.client.1.smithi164.stdout:7/638: getdents d2/d21/d24/d31/d3a/d83/dba/dbb 0 2024-04-20T21:59:05.167 INFO:tasks.workunit.client.1.smithi164.stdout:9/693: getdents d3/db0/de0 0 2024-04-20T21:59:05.171 INFO:tasks.workunit.client.1.smithi164.stdout:8/583: chown d0/c49 11 1 2024-04-20T21:59:05.173 INFO:tasks.workunit.client.1.smithi164.stdout:5/708: write dc/f7d [3458347,98843] 0 2024-04-20T21:59:05.173 INFO:tasks.workunit.client.1.smithi164.stdout:7/639: stat d2/d21/d33/f54 0 2024-04-20T21:59:05.173 INFO:tasks.workunit.client.1.smithi164.stdout:6/679: rmdir d0/d3/d15/d23/d45/d4f/d9c 39 2024-04-20T21:59:05.174 INFO:tasks.workunit.client.1.smithi164.stdout:0/604: dread d1/d4/d49/f95 [0,4194304] 0 2024-04-20T21:59:05.176 INFO:tasks.workunit.client.1.smithi164.stdout:3/667: rename d12/d20/d39/d55/d6b/d79/fcb to d12/d68/d6f/fd2 0 2024-04-20T21:59:05.180 INFO:tasks.workunit.client.1.smithi164.stdout:9/694: creat d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/ff4 x:0 0 0 2024-04-20T21:59:05.182 INFO:tasks.workunit.client.1.smithi164.stdout:6/680: rmdir d0/d3/d15/d21 39 2024-04-20T21:59:05.184 INFO:tasks.workunit.client.1.smithi164.stdout:9/695: chown d3/f92 1489066 1 2024-04-20T21:59:05.187 INFO:tasks.workunit.client.1.smithi164.stdout:9/696: dread - d3/db/dd/d40/d2a/fd2 zero size 2024-04-20T21:59:05.187 INFO:tasks.workunit.client.1.smithi164.stdout:8/584: rename d0/d14/d16/l31 to d0/d14/d16/d9d/lc6 0 2024-04-20T21:59:05.195 INFO:tasks.workunit.client.1.smithi164.stdout:9/697: mknod d3/db/d82/cf5 0 2024-04-20T21:59:05.200 INFO:tasks.workunit.client.1.smithi164.stdout:8/585: link d0/d14/d4e/d62/d8f/fae d0/d14/d16/fc7 0 2024-04-20T21:59:05.204 INFO:tasks.workunit.client.1.smithi164.stdout:2/636: dwrite d2/d19/f80 [0,4194304] 0 2024-04-20T21:59:05.204 INFO:tasks.workunit.client.1.smithi164.stdout:5/709: truncate dc/d2b/fdc 3542913 0 2024-04-20T21:59:05.206 INFO:tasks.workunit.client.1.smithi164.stdout:6/681: chown d0/d3/d15/d21/d5c/dbf/lcf 854190 1 2024-04-20T21:59:05.206 INFO:tasks.workunit.client.1.smithi164.stdout:9/698: fdatasync d3/db/d1b/d20/d3f/f7c 0 2024-04-20T21:59:05.214 INFO:tasks.workunit.client.1.smithi164.stdout:6/682: fsync d0/d3/d15/f5b 0 2024-04-20T21:59:05.214 INFO:tasks.workunit.client.1.smithi164.stdout:1/576: rename d10/d33/d4d/l5b to d10/d16/d19/d1a/lbe 0 2024-04-20T21:59:05.217 INFO:tasks.workunit.client.1.smithi164.stdout:0/605: dread d1/d4/d26/d29/d2d/fa7 [0,4194304] 0 2024-04-20T21:59:05.217 INFO:tasks.workunit.client.1.smithi164.stdout:2/637: chown d2/d19/c3d 2956 1 2024-04-20T21:59:05.251 INFO:tasks.workunit.client.1.smithi164.stdout:0/606: readlink d1/d4/da/l91 0 2024-04-20T21:59:05.255 INFO:tasks.workunit.client.1.smithi164.stdout:7/640: rename d2/d21/d33/fd3 to d2/d21/d44/dd4/d9e/fd9 0 2024-04-20T21:59:05.257 INFO:tasks.workunit.client.1.smithi164.stdout:6/683: read - d0/d3/d15/d21/d5c/dbf/dbd/ddf/d28/f99 zero size 2024-04-20T21:59:05.259 INFO:tasks.workunit.client.1.smithi164.stdout:9/699: creat d3/db0/dc0/ff6 x:0 0 0 2024-04-20T21:59:05.260 INFO:tasks.workunit.client.1.smithi164.stdout:6/684: truncate d0/d3/d62/fa7 768828 0 2024-04-20T21:59:05.270 INFO:tasks.workunit.client.1.smithi164.stdout:6/685: rename d0/d3/d15/d21/d5c/dbf/dbd/ddf/d28/d6f/ca8 to d0/d3/d15/d21/d5c/dbf/dbd/ddf/d28/d6f/ce5 0 2024-04-20T21:59:05.270 INFO:tasks.workunit.client.1.smithi164.stdout:2/638: dwrite d2/f46 [0,4194304] 0 2024-04-20T21:59:05.272 INFO:tasks.workunit.client.1.smithi164.stdout:9/700: mknod d3/db0/de0/cf7 0 2024-04-20T21:59:05.274 INFO:tasks.workunit.client.1.smithi164.stdout:6/686: read - d0/d3/d15/d21/d5c/dbf/dbd/ddf/d81/fa9 zero size 2024-04-20T21:59:05.276 INFO:tasks.workunit.client.1.smithi164.stdout:2/639: creat d2/d5/d3a/d55/d58/da2/db0/fc7 x:0 0 0 2024-04-20T21:59:05.277 INFO:tasks.workunit.client.1.smithi164.stdout:2/640: fsync d2/f1b 0 2024-04-20T21:59:05.279 INFO:tasks.workunit.client.1.smithi164.stdout:1/577: write d10/d16/d19/d1a/f32 [132553,82701] 0 2024-04-20T21:59:05.279 INFO:tasks.workunit.client.1.smithi164.stdout:2/641: dread - d2/d19/d28/f32 zero size 2024-04-20T21:59:05.283 INFO:tasks.workunit.client.1.smithi164.stdout:4/598: sync 2024-04-20T21:59:05.285 INFO:tasks.workunit.client.1.smithi164.stdout:6/687: rename d0/d3/cc to d0/d3/d15/d21/d5c/dbf/dbd/ddf/d81/ce6 0 2024-04-20T21:59:05.287 INFO:tasks.workunit.client.1.smithi164.stdout:9/701: dread d3/db/d1b/d1e/f4b [0,4194304] 0 2024-04-20T21:59:05.292 INFO:tasks.workunit.client.1.smithi164.stdout:0/607: dread d1/d4/d26/d29/f5b [0,4194304] 0 2024-04-20T21:59:05.293 INFO:tasks.workunit.client.1.smithi164.stdout:4/599: dread - d4/d28/d3e/d4a/f69 zero size 2024-04-20T21:59:05.294 INFO:tasks.workunit.client.1.smithi164.stdout:1/578: rmdir d10/d16/d20/d81 39 2024-04-20T21:59:05.297 INFO:tasks.workunit.client.1.smithi164.stdout:0/608: write d1/d4/da/d27/f32 [5849254,106791] 0 2024-04-20T21:59:05.297 INFO:tasks.workunit.client.1.smithi164.stdout:4/600: write d4/d9/f11 [1996522,12740] 0 2024-04-20T21:59:05.301 INFO:tasks.workunit.client.1.smithi164.stdout:9/702: mknod d3/db/dd/d40/d2a/d36/cf8 0 2024-04-20T21:59:05.304 INFO:tasks.workunit.client.1.smithi164.stdout:2/642: write d2/d30/f4a [886585,116109] 0 2024-04-20T21:59:05.309 INFO:tasks.workunit.client.1.smithi164.stdout:7/641: dwrite d2/d21/d24/f52 [0,4194304] 0 2024-04-20T21:59:05.313 INFO:tasks.workunit.client.1.smithi164.stdout:4/601: mknod d4/d9/d5c/d97/dbf/d67/d86/cc4 0 2024-04-20T21:59:05.316 INFO:tasks.workunit.client.1.smithi164.stdout:4/602: write d4/d9/da4/fb3 [802032,70790] 0 2024-04-20T21:59:05.317 INFO:tasks.workunit.client.1.smithi164.stdout:7/642: symlink d2/lda 0 2024-04-20T21:59:05.322 INFO:tasks.workunit.client.1.smithi164.stdout:6/688: dwrite d0/d3/d15/f24 [0,4194304] 0 2024-04-20T21:59:05.323 INFO:tasks.workunit.client.1.smithi164.stdout:2/643: link d2/d19/d28/d3e/fc3 d2/d19/d28/d3e/d9e/fc8 0 2024-04-20T21:59:05.327 INFO:tasks.workunit.client.1.smithi164.stdout:1/579: write d10/d16/d20/d91/faf [2317594,12143] 0 2024-04-20T21:59:05.327 INFO:tasks.workunit.client.1.smithi164.stdout:4/603: dread - d4/d28/d3e/d41/fb6 zero size 2024-04-20T21:59:05.332 INFO:tasks.workunit.client.1.smithi164.stdout:2/644: write d2/d30/f7a [936055,26860] 0 2024-04-20T21:59:05.338 INFO:tasks.workunit.client.1.smithi164.stdout:6/689: chown d0/d3/d15/d21/d4b/fda 38180 1 2024-04-20T21:59:05.344 INFO:tasks.workunit.client.1.smithi164.stdout:0/609: dread d1/d4/d26/d29/d2d/fa7 [0,4194304] 0 2024-04-20T21:59:05.345 INFO:tasks.workunit.client.1.smithi164.stdout:9/703: dwrite d3/db/dd/f11 [0,4194304] 0 2024-04-20T21:59:05.345 INFO:tasks.workunit.client.1.smithi164.stdout:0/610: chown d1/d4/c4c 40982 1 2024-04-20T21:59:05.350 INFO:tasks.workunit.client.1.smithi164.stdout:7/643: mkdir d2/d21/d24/d31/d3a/d83/d63/d85/dbe/ddb 0 2024-04-20T21:59:05.351 INFO:tasks.workunit.client.1.smithi164.stdout:2/645: read d2/d19/d28/f40 [1584015,16275] 0 2024-04-20T21:59:05.354 INFO:tasks.workunit.client.1.smithi164.stdout:6/690: read d0/d3/d11/f39 [2771708,26255] 0 2024-04-20T21:59:05.355 INFO:tasks.workunit.client.1.smithi164.stdout:0/611: mknod d1/d4/d26/d29/cb1 0 2024-04-20T21:59:05.356 INFO:tasks.workunit.client.1.smithi164.stdout:4/604: dread d4/d9/fc [0,4194304] 0 2024-04-20T21:59:05.358 INFO:tasks.workunit.client.1.smithi164.stdout:9/704: creat d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/dce/ff9 x:0 0 0 2024-04-20T21:59:05.360 INFO:tasks.workunit.client.1.smithi164.stdout:0/612: write d1/d4/da/d5c/f94 [438761,9012] 0 2024-04-20T21:59:05.360 INFO:tasks.workunit.client.1.smithi164.stdout:7/644: unlink d2/d21/d24/d31/d3a/d83/dba/dbc/cc3 0 2024-04-20T21:59:05.364 INFO:tasks.workunit.client.1.smithi164.stdout:4/605: write d4/d28/f58 [981306,54343] 0 2024-04-20T21:59:05.364 INFO:tasks.workunit.client.1.smithi164.stdout:9/705: fsync d3/db/dd/d40/d2a/d36/f48 0 2024-04-20T21:59:05.364 INFO:tasks.workunit.client.1.smithi164.stdout:3/668: sync 2024-04-20T21:59:05.369 INFO:tasks.workunit.client.1.smithi164.stdout:2/646: creat d2/d5/d3a/d65/d81/db5/dba/fc9 x:0 0 0 2024-04-20T21:59:05.370 INFO:tasks.workunit.client.1.smithi164.stdout:1/580: truncate d10/d16/d19/d1a/d51/f61 306645 0 2024-04-20T21:59:05.370 INFO:tasks.workunit.client.1.smithi164.stdout:7/645: read d2/d21/d24/d31/d3a/fa2 [797717,98631] 0 2024-04-20T21:59:05.373 INFO:tasks.workunit.client.1.smithi164.stdout:4/606: readlink d4/d9/d5c/d97/dbf/d67/d86/l81 0 2024-04-20T21:59:05.376 INFO:tasks.workunit.client.1.smithi164.stdout:9/706: creat d3/db/dd/d40/d2a/d36/ffa x:0 0 0 2024-04-20T21:59:05.376 INFO:tasks.workunit.client.1.smithi164.stdout:3/669: mkdir d12/d15/dd3 0 2024-04-20T21:59:05.379 INFO:tasks.workunit.client.1.smithi164.stdout:6/691: link d0/d3/d15/d23/d45/d69/lab d0/d3/d11/d29/d6e/le7 0 2024-04-20T21:59:05.384 INFO:tasks.workunit.client.1.smithi164.stdout:7/646: fsync d2/d21/d24/d31/d3a/daa/fcc 0 2024-04-20T21:59:05.387 INFO:tasks.workunit.client.1.smithi164.stdout:4/607: mknod d4/d28/d3e/d41/cc5 0 2024-04-20T21:59:05.390 INFO:tasks.workunit.client.1.smithi164.stdout:7/647: truncate d2/d21/d33/f9c 280265 0 2024-04-20T21:59:05.392 INFO:tasks.workunit.client.1.smithi164.stdout:9/707: rmdir d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/dce 39 2024-04-20T21:59:05.393 INFO:tasks.workunit.client.1.smithi164.stdout:7/648: chown d2/d21/d44/l99 4694304 1 2024-04-20T21:59:05.398 INFO:tasks.workunit.client.1.smithi164.stdout:3/670: getdents d12/d20/d39/dac 0 2024-04-20T21:59:05.400 INFO:tasks.workunit.client.1.smithi164.stdout:0/613: dread d1/d4/d20/d74/f5e [0,4194304] 0 2024-04-20T21:59:05.403 INFO:tasks.workunit.client.1.smithi164.stdout:6/692: symlink d0/d3/d15/d23/d45/d4f/d9c/le8 0 2024-04-20T21:59:05.403 INFO:tasks.workunit.client.1.smithi164.stdout:4/608: mkdir d4/d9/d5c/d97/dbf/d67/d86/dc3/dc6 0 2024-04-20T21:59:05.404 INFO:tasks.workunit.client.1.smithi164.stdout:3/671: creat d12/d20/d39/d55/d87/fd4 x:0 0 0 2024-04-20T21:59:05.407 INFO:tasks.workunit.client.1.smithi164.stdout:1/581: dread d10/d16/d20/d26/d34/f7a [0,4194304] 0 2024-04-20T21:59:05.407 INFO:tasks.workunit.client.1.smithi164.stdout:4/609: write d4/d28/f6b [1594547,30274] 0 2024-04-20T21:59:05.408 INFO:tasks.workunit.client.1.smithi164.stdout:7/649: read d2/d21/d24/f57 [79748,57044] 0 2024-04-20T21:59:05.412 INFO:tasks.workunit.client.1.smithi164.stdout:1/582: write d10/d16/f72 [406152,95156] 0 2024-04-20T21:59:05.415 INFO:tasks.workunit.client.1.smithi164.stdout:6/693: rename d0/d3/d15/d23/d45/d4f/d9c/le8 to d0/d3/d27/d9d/dc3/le9 0 2024-04-20T21:59:05.418 INFO:tasks.workunit.client.1.smithi164.stdout:6/694: chown d0/d3/f10 878698 1 2024-04-20T21:59:05.419 INFO:tasks.workunit.client.1.smithi164.stdout:1/583: mkdir d10/d16/d20/dbf 0 2024-04-20T21:59:05.422 INFO:tasks.workunit.client.1.smithi164.stdout:9/708: dwrite d3/db/d1b/d1e/f81 [0,4194304] 0 2024-04-20T21:59:05.422 INFO:tasks.workunit.client.1.smithi164.stdout:6/695: chown d0/d3/d4a/l4c 118 1 2024-04-20T21:59:05.425 INFO:tasks.workunit.client.1.smithi164.stdout:7/650: link d2/d21/d24/f4f d2/d21/d24/d31/d3a/d83/d77/fdc 0 2024-04-20T21:59:05.426 INFO:tasks.workunit.client.1.smithi164.stdout:4/610: getdents d4/d9/d5c/d97/dbf/d67/d86/dc3 0 2024-04-20T21:59:05.426 INFO:tasks.workunit.client.1.smithi164.stdout:9/709: dread - d3/db/dd/d40/ff0 zero size 2024-04-20T21:59:05.432 INFO:tasks.workunit.client.1.smithi164.stdout:3/672: dwrite d12/d20/d39/d55/fc9 [0,4194304] 0 2024-04-20T21:59:05.435 INFO:tasks.workunit.client.1.smithi164.stdout:6/696: symlink d0/d3/d15/d21/d5c/dbf/db4/lea 0 2024-04-20T21:59:05.437 INFO:tasks.workunit.client.1.smithi164.stdout:7/651: mknod d2/d21/d33/cdd 0 2024-04-20T21:59:05.444 INFO:tasks.workunit.client.1.smithi164.stdout:9/710: dread - d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/fad zero size 2024-04-20T21:59:05.445 INFO:tasks.workunit.client.1.smithi164.stdout:3/673: fsync d12/d15/f70 0 2024-04-20T21:59:05.447 INFO:tasks.workunit.client.1.smithi164.stdout:1/584: link d10/d16/d19/f4e d10/d33/fc0 0 2024-04-20T21:59:05.448 INFO:tasks.workunit.client.1.smithi164.stdout:7/652: mknod d2/d21/d24/daf/cde 0 2024-04-20T21:59:05.451 INFO:tasks.workunit.client.1.smithi164.stdout:9/711: symlink d3/db0/dd3/lfb 0 2024-04-20T21:59:05.453 INFO:tasks.workunit.client.1.smithi164.stdout:3/674: mknod d12/d68/d6f/d71/cd5 0 2024-04-20T21:59:05.454 INFO:tasks.workunit.client.1.smithi164.stdout:4/611: rename d4/d9/d27/d37/l5d to d4/d28/lc7 0 2024-04-20T21:59:05.455 INFO:tasks.workunit.client.1.smithi164.stdout:1/585: fdatasync d10/d16/d20/d26/d34/da9/f92 0 2024-04-20T21:59:05.460 INFO:tasks.workunit.client.1.smithi164.stdout:6/697: creat d0/d3/d27/feb x:0 0 0 2024-04-20T21:59:05.463 INFO:tasks.workunit.client.1.smithi164.stdout:9/712: creat d3/db/dc4/ffc x:0 0 0 2024-04-20T21:59:05.464 INFO:tasks.workunit.client.1.smithi164.stdout:3/675: creat d12/d20/d39/d55/d87/fd6 x:0 0 0 2024-04-20T21:59:05.465 INFO:tasks.workunit.client.1.smithi164.stdout:9/713: chown d3/d9f/da1/fbc 346015 1 2024-04-20T21:59:05.467 INFO:tasks.workunit.client.1.smithi164.stdout:9/714: stat d3/db/dd/d40/d2a/d36/d51/d83 0 2024-04-20T21:59:05.469 INFO:tasks.workunit.client.1.smithi164.stdout:1/586: symlink d10/d16/d20/d25/d95/lc1 0 2024-04-20T21:59:05.470 INFO:tasks.workunit.client.1.smithi164.stdout:6/698: symlink d0/d3/d11/d29/d6e/d41/lec 0 2024-04-20T21:59:05.473 INFO:tasks.workunit.client.1.smithi164.stdout:5/710: sync 2024-04-20T21:59:05.473 INFO:tasks.workunit.client.1.smithi164.stdout:8/586: sync 2024-04-20T21:59:05.476 INFO:tasks.workunit.client.1.smithi164.stdout:3/676: symlink d12/d20/d39/d69/d83/db9/ld7 0 2024-04-20T21:59:05.477 INFO:tasks.workunit.client.1.smithi164.stdout:7/653: dwrite d2/d21/d44/dd4/f86 [4194304,4194304] 0 2024-04-20T21:59:05.478 INFO:tasks.workunit.client.1.smithi164.stdout:6/699: write d0/d3/d15/d21/d5c/dbf/dbd/ddf/d28/d6f/fd5 [477005,54639] 0 2024-04-20T21:59:05.481 INFO:tasks.workunit.client.1.smithi164.stdout:5/711: rmdir dc/d2c/d2e/d30 39 2024-04-20T21:59:05.482 INFO:tasks.workunit.client.1.smithi164.stdout:8/587: symlink d0/d14/d4e/d86/lc8 0 2024-04-20T21:59:05.485 INFO:tasks.workunit.client.1.smithi164.stdout:1/587: link d10/d16/d20/d25/l80 d10/d16/d20/d26/d34/lc2 0 2024-04-20T21:59:05.485 INFO:tasks.workunit.client.1.smithi164.stdout:4/612: dread d4/f15 [0,4194304] 0 2024-04-20T21:59:05.486 INFO:tasks.workunit.client.1.smithi164.stdout:6/700: chown d0/d3/d15/d21/d5c/dbf/dbd/ddf/d28/l77 70848 1 2024-04-20T21:59:05.487 INFO:tasks.workunit.client.1.smithi164.stdout:4/613: stat d4/c12 0 2024-04-20T21:59:05.490 INFO:tasks.workunit.client.1.smithi164.stdout:4/614: stat d4/d9/c83 0 2024-04-20T21:59:05.494 INFO:tasks.workunit.client.1.smithi164.stdout:1/588: creat d10/d16/d20/d26/d34/da9/fc3 x:0 0 0 2024-04-20T21:59:05.495 INFO:tasks.workunit.client.1.smithi164.stdout:4/615: dread - d4/d28/d3e/d41/fb6 zero size 2024-04-20T21:59:05.496 INFO:tasks.workunit.client.1.smithi164.stdout:1/589: chown d10/d16/d20/d25 3047 1 2024-04-20T21:59:05.498 INFO:tasks.workunit.client.1.smithi164.stdout:9/715: dwrite d3/ff1 [0,4194304] 0 2024-04-20T21:59:05.498 INFO:tasks.workunit.client.1.smithi164.stdout:1/590: stat d10/d33/d48/f6b 0 2024-04-20T21:59:05.499 INFO:tasks.workunit.client.1.smithi164.stdout:8/588: rename d0/d14/d4e/d62/d8f/dbe/fc2 to d0/d14/d16/d58/fc9 0 2024-04-20T21:59:05.503 INFO:tasks.workunit.client.1.smithi164.stdout:3/677: dwrite f10 [4194304,4194304] 0 2024-04-20T21:59:05.506 INFO:tasks.workunit.client.1.smithi164.stdout:7/654: write d2/d21/f89 [1511852,89223] 0 2024-04-20T21:59:05.508 INFO:tasks.workunit.client.1.smithi164.stdout:5/712: dread dc/d2b/da0/fd0 [0,4194304] 0 2024-04-20T21:59:05.513 INFO:tasks.workunit.client.1.smithi164.stdout:1/591: rename d10/d33/d7f to d10/d33/d4d/dc4 0 2024-04-20T21:59:05.513 INFO:tasks.workunit.client.1.smithi164.stdout:7/655: truncate d2/d21/d33/f9c 543767 0 2024-04-20T21:59:05.516 INFO:tasks.workunit.client.1.smithi164.stdout:6/701: dwrite d0/d3/d27/fd3 [0,4194304] 0 2024-04-20T21:59:05.523 INFO:tasks.workunit.client.1.smithi164.stdout:6/702: stat d0/d3/d15/d21/d5c/dbf/dbd/ddf/d81/fc2 0 2024-04-20T21:59:05.523 INFO:tasks.workunit.client.1.smithi164.stdout:8/589: write d0/d14/f2a [5026294,106315] 0 2024-04-20T21:59:05.527 INFO:tasks.workunit.client.1.smithi164.stdout:4/616: link d4/d9/d27/d37/f5b d4/d9/fc8 0 2024-04-20T21:59:05.528 INFO:tasks.workunit.client.1.smithi164.stdout:7/656: unlink d2/f1c 0 2024-04-20T21:59:05.533 INFO:tasks.workunit.client.1.smithi164.stdout:2/647: sync 2024-04-20T21:59:05.538 INFO:tasks.workunit.client.1.smithi164.stdout:8/590: creat d0/d14/d16/d9d/fca x:0 0 0 2024-04-20T21:59:05.541 INFO:tasks.workunit.client.1.smithi164.stdout:7/657: dread d2/f67 [0,4194304] 0 2024-04-20T21:59:05.545 INFO:tasks.workunit.client.1.smithi164.stdout:2/648: chown d2/d5/d3a/d55/d58/da2 29507 1 2024-04-20T21:59:05.546 INFO:tasks.workunit.client.1.smithi164.stdout:3/678: rename d12/d15/f26 to d12/fd8 0 2024-04-20T21:59:05.546 INFO:tasks.workunit.client.1.smithi164.stdout:1/592: dwrite d10/d16/d20/d26/d34/f53 [0,4194304] 0 2024-04-20T21:59:05.548 INFO:tasks.workunit.client.1.smithi164.stdout:8/591: rmdir d0/d14/d4e 39 2024-04-20T21:59:05.553 INFO:tasks.workunit.client.1.smithi164.stdout:3/679: fsync d12/d15/f37 0 2024-04-20T21:59:05.555 INFO:tasks.workunit.client.1.smithi164.stdout:8/592: write d0/d14/d5f/f7a [1752757,58586] 0 2024-04-20T21:59:05.559 INFO:tasks.workunit.client.1.smithi164.stdout:5/713: rename dc/d2b/d52/d64 to dc/d2c/d2e/dbd/df9 0 2024-04-20T21:59:05.560 INFO:tasks.workunit.client.1.smithi164.stdout:1/593: unlink d10/d33/d48/f71 0 2024-04-20T21:59:05.561 INFO:tasks.workunit.client.1.smithi164.stdout:9/716: dwrite d3/db/dd/d40/d2a/d36/d51/f9b [0,4194304] 0 2024-04-20T21:59:05.562 INFO:tasks.workunit.client.1.smithi164.stdout:8/593: dread - d0/f61 zero size 2024-04-20T21:59:05.564 INFO:tasks.workunit.client.1.smithi164.stdout:4/617: dwrite d4/d9/d5c/d97/dbf/f92 [0,4194304] 0 2024-04-20T21:59:05.571 INFO:tasks.workunit.client.1.smithi164.stdout:5/714: creat dc/d2b/d52/ffa x:0 0 0 2024-04-20T21:59:05.571 INFO:tasks.workunit.client.1.smithi164.stdout:3/680: write d12/d20/d39/d55/fc9 [1042977,125079] 0 2024-04-20T21:59:05.571 INFO:tasks.workunit.client.1.smithi164.stdout:1/594: chown d10/d16/f7b 12433428 1 2024-04-20T21:59:05.572 INFO:tasks.workunit.client.1.smithi164.stdout:6/703: dwrite d0/f52 [0,4194304] 0 2024-04-20T21:59:05.577 INFO:tasks.workunit.client.1.smithi164.stdout:4/618: mkdir d4/d9/d22/dc9 0 2024-04-20T21:59:05.578 INFO:tasks.workunit.client.1.smithi164.stdout:8/594: stat d0/d14/d4e/d62/d82/cba 0 2024-04-20T21:59:05.580 INFO:tasks.workunit.client.1.smithi164.stdout:5/715: rmdir dc/d2b/d6d 39 2024-04-20T21:59:05.582 INFO:tasks.workunit.client.1.smithi164.stdout:4/619: chown d4/d9/d5c/d97/dbf/d5f/c65 89674015 1 2024-04-20T21:59:05.586 INFO:tasks.workunit.client.1.smithi164.stdout:7/658: rename d2/d21/d24/d31/d3a/d83/d63/d85/dbe/lbf to d2/d21/d24/d31/d3a/d83/d63/d85/dbe/ldf 0 2024-04-20T21:59:05.590 INFO:tasks.workunit.client.1.smithi164.stdout:1/595: write d10/d16/d20/f38 [305965,6532] 0 2024-04-20T21:59:05.591 INFO:tasks.workunit.client.1.smithi164.stdout:4/620: write d4/d28/f6b [270465,114774] 0 2024-04-20T21:59:05.596 INFO:tasks.workunit.client.1.smithi164.stdout:9/717: rmdir d3/db/d82/d98/db6/dd5 0 2024-04-20T21:59:05.603 INFO:tasks.workunit.client.1.smithi164.stdout:1/596: read d10/d16/d20/d26/d34/f7a [2056869,87493] 0 2024-04-20T21:59:05.604 INFO:tasks.workunit.client.1.smithi164.stdout:9/718: fsync d3/db/d1b/d20/fb4 0 2024-04-20T21:59:05.606 INFO:tasks.workunit.client.1.smithi164.stdout:5/716: read f8 [3682049,69441] 0 2024-04-20T21:59:05.606 INFO:tasks.workunit.client.1.smithi164.stdout:7/659: unlink d2/d21/d24/f71 0 2024-04-20T21:59:05.608 INFO:tasks.workunit.client.1.smithi164.stdout:8/595: creat d0/d14/d16/d58/fcb x:0 0 0 2024-04-20T21:59:05.611 INFO:tasks.workunit.client.1.smithi164.stdout:4/621: write d4/f36 [1714156,63902] 0 2024-04-20T21:59:05.615 INFO:tasks.workunit.client.1.smithi164.stdout:6/704: dwrite d0/d3/d15/d21/d4b/fda [0,4194304] 0 2024-04-20T21:59:05.617 INFO:tasks.workunit.client.1.smithi164.stdout:4/622: write d4/d28/d3e/d4a/f9f [550141,18098] 0 2024-04-20T21:59:05.617 INFO:tasks.workunit.client.1.smithi164.stdout:3/681: dwrite d12/d15/f24 [4194304,4194304] 0 2024-04-20T21:59:05.619 INFO:tasks.workunit.client.1.smithi164.stdout:9/719: mknod d3/db/d82/d98/cfd 0 2024-04-20T21:59:05.629 INFO:tasks.workunit.client.1.smithi164.stdout:6/705: chown d0/l2 258 1 2024-04-20T21:59:05.630 INFO:tasks.workunit.client.1.smithi164.stdout:4/623: truncate d4/f16 869388 0 2024-04-20T21:59:05.630 INFO:tasks.workunit.client.1.smithi164.stdout:9/720: symlink d3/db/dd/d40/d78/lfe 0 2024-04-20T21:59:05.630 INFO:tasks.workunit.client.1.smithi164.stdout:3/682: mknod d12/d20/d39/d69/d83/db9/cd9 0 2024-04-20T21:59:05.633 INFO:tasks.workunit.client.1.smithi164.stdout:4/624: fsync d4/d28/d3e/d41/f4b 0 2024-04-20T21:59:05.636 INFO:tasks.workunit.client.1.smithi164.stdout:6/706: creat d0/d3/d62/d8e/fed x:0 0 0 2024-04-20T21:59:05.637 INFO:tasks.workunit.client.1.smithi164.stdout:3/683: symlink d12/d6d/lda 0 2024-04-20T21:59:05.637 INFO:tasks.workunit.client.1.smithi164.stdout:0/614: sync 2024-04-20T21:59:05.639 INFO:tasks.workunit.client.1.smithi164.stdout:4/625: unlink d4/d9/d5c/d97/lb1 0 2024-04-20T21:59:05.639 INFO:tasks.workunit.client.1.smithi164.stdout:0/615: fsync d1/d4/d26/f76 0 2024-04-20T21:59:05.640 INFO:tasks.workunit.client.1.smithi164.stdout:6/707: rmdir d0/d3 39 2024-04-20T21:59:05.643 INFO:tasks.workunit.client.1.smithi164.stdout:3/684: fdatasync d12/d20/d39/d69/d77/d81/f8c 0 2024-04-20T21:59:05.645 INFO:tasks.workunit.client.1.smithi164.stdout:8/596: dwrite d0/d14/d16/d58/f60 [0,4194304] 0 2024-04-20T21:59:05.646 INFO:tasks.workunit.client.1.smithi164.stdout:0/616: write d1/d4/d49/f5f [2803421,49172] 0 2024-04-20T21:59:05.647 INFO:tasks.workunit.client.1.smithi164.stdout:9/721: getdents d3/db/dd/d40/d2a/d36/d51/d83 0 2024-04-20T21:59:05.648 INFO:tasks.workunit.client.1.smithi164.stdout:3/685: write d12/d20/d39/f5d [314194,103630] 0 2024-04-20T21:59:05.648 INFO:tasks.workunit.client.1.smithi164.stdout:8/597: fsync d0/d14/d4e/fa2 0 2024-04-20T21:59:05.651 INFO:tasks.workunit.client.1.smithi164.stdout:9/722: chown d3/db/dd/d40/d2a/dc6 3936356 1 2024-04-20T21:59:05.653 INFO:tasks.workunit.client.1.smithi164.stdout:7/660: dread d2/d21/f89 [0,4194304] 0 2024-04-20T21:59:05.653 INFO:tasks.workunit.client.1.smithi164.stdout:1/597: dwrite d10/d33/f3f [0,4194304] 0 2024-04-20T21:59:05.654 INFO:tasks.workunit.client.1.smithi164.stdout:4/626: symlink d4/d9/d22/dc9/lca 0 2024-04-20T21:59:05.657 INFO:tasks.workunit.client.1.smithi164.stdout:4/627: truncate d4/d9/d42/f99 581803 0 2024-04-20T21:59:05.658 INFO:tasks.workunit.client.1.smithi164.stdout:4/628: fsync d4/d28/d3e/fae 0 2024-04-20T21:59:05.662 INFO:tasks.workunit.client.1.smithi164.stdout:9/723: creat d3/db/dc4/fff x:0 0 0 2024-04-20T21:59:05.666 INFO:tasks.workunit.client.1.smithi164.stdout:4/629: rename d4/d28/f91 to d4/d28/dad/dbd/fcb 0 2024-04-20T21:59:05.671 INFO:tasks.workunit.client.1.smithi164.stdout:0/617: dread d1/d4/d26/d29/f9f [0,4194304] 0 2024-04-20T21:59:05.672 INFO:tasks.workunit.client.1.smithi164.stdout:0/618: fsync d1/d4/df/d56/f8c 0 2024-04-20T21:59:05.673 INFO:tasks.workunit.client.1.smithi164.stdout:3/686: dwrite f6 [0,4194304] 0 2024-04-20T21:59:05.678 INFO:tasks.workunit.client.1.smithi164.stdout:1/598: link d10/d33/d4d/dc4/l83 d10/d16/d20/d25/d95/lc5 0 2024-04-20T21:59:05.686 INFO:tasks.workunit.client.1.smithi164.stdout:4/630: dwrite d4/d9/da4/fa6 [0,4194304] 0 2024-04-20T21:59:05.686 INFO:tasks.workunit.client.1.smithi164.stdout:0/619: mknod d1/d4/d26/d29/d2d/d54/d77/d9e/cb2 0 2024-04-20T21:59:05.688 INFO:tasks.workunit.client.1.smithi164.stdout:3/687: dread d12/d20/d39/f4b [0,4194304] 0 2024-04-20T21:59:05.691 INFO:tasks.workunit.client.1.smithi164.stdout:4/631: dread - d4/d9/d5c/d97/dbf/d5f/f8a zero size 2024-04-20T21:59:05.693 INFO:tasks.workunit.client.1.smithi164.stdout:9/724: dread d3/db/dd/f14 [0,4194304] 0 2024-04-20T21:59:05.694 INFO:tasks.workunit.client.1.smithi164.stdout:1/599: getdents d10/d16/d19/d1a/d51/d85 0 2024-04-20T21:59:05.697 INFO:tasks.workunit.client.1.smithi164.stdout:1/600: write d10/d16/d20/d25/d3d/fbc [290665,13798] 0 2024-04-20T21:59:05.697 INFO:tasks.workunit.client.1.smithi164.stdout:3/688: creat d12/d68/d6f/d71/d7d/fdb x:0 0 0 2024-04-20T21:59:05.701 INFO:tasks.workunit.client.1.smithi164.stdout:0/620: mkdir d1/d4/d26/d29/d2d/d54/d77/db3 0 2024-04-20T21:59:05.703 INFO:tasks.workunit.client.1.smithi164.stdout:4/632: rmdir d4/d9/d27/d37 39 2024-04-20T21:59:05.706 INFO:tasks.workunit.client.1.smithi164.stdout:9/725: truncate d3/db/dd/d40/d2a/d36/d51/fa5 369073 0 2024-04-20T21:59:05.709 INFO:tasks.workunit.client.1.smithi164.stdout:3/689: truncate d12/d6d/f8e 313468 0 2024-04-20T21:59:05.710 INFO:tasks.workunit.client.1.smithi164.stdout:3/690: fsync ff 0 2024-04-20T21:59:05.710 INFO:tasks.workunit.client.1.smithi164.stdout:7/661: truncate d2/d21/d24/d31/d3a/d83/d68/f8b 129734 0 2024-04-20T21:59:05.711 INFO:tasks.workunit.client.1.smithi164.stdout:1/601: dwrite f7 [0,4194304] 0 2024-04-20T21:59:05.712 INFO:tasks.workunit.client.1.smithi164.stdout:0/621: dread - d1/d4/df/f59 zero size 2024-04-20T21:59:05.724 INFO:tasks.workunit.client.1.smithi164.stdout:3/691: mkdir d12/d20/d39/ddc 0 2024-04-20T21:59:05.728 INFO:tasks.workunit.client.1.smithi164.stdout:4/633: dread d4/d9/fc8 [0,4194304] 0 2024-04-20T21:59:05.728 INFO:tasks.workunit.client.1.smithi164.stdout:1/602: creat d10/d16/d20/d26/fc6 x:0 0 0 2024-04-20T21:59:05.729 INFO:tasks.workunit.client.1.smithi164.stdout:0/622: rmdir d1/d4/d26/d29/d2d 39 2024-04-20T21:59:05.730 INFO:tasks.workunit.client.1.smithi164.stdout:4/634: write d4/d9/d22/f2f [2574287,130690] 0 2024-04-20T21:59:05.734 INFO:tasks.workunit.client.1.smithi164.stdout:0/623: dread d1/d4/d20/f40 [0,4194304] 0 2024-04-20T21:59:05.743 INFO:tasks.workunit.client.1.smithi164.stdout:1/603: dwrite d10/d16/d20/d26/d34/f5d [0,4194304] 0 2024-04-20T21:59:05.744 INFO:tasks.workunit.client.1.smithi164.stdout:9/726: link d3/db/dd/d40/d78/d86/fb3 d3/db/dd/d40/d2a/f100 0 2024-04-20T21:59:05.748 INFO:tasks.workunit.client.1.smithi164.stdout:4/635: stat d4/d9/d5c/d97/dbf/d9b/fa7 0 2024-04-20T21:59:05.749 INFO:tasks.workunit.client.1.smithi164.stdout:3/692: mknod d12/d20/d39/d69/d9a/dbe/cdd 0 2024-04-20T21:59:05.749 INFO:tasks.workunit.client.1.smithi164.stdout:4/636: truncate f3 8464954 0 2024-04-20T21:59:05.750 INFO:tasks.workunit.client.1.smithi164.stdout:3/693: stat d12/d2a/f3d 0 2024-04-20T21:59:05.756 INFO:tasks.workunit.client.1.smithi164.stdout:9/727: chown d3/db/d82/l9e 483177437 1 2024-04-20T21:59:05.760 INFO:tasks.workunit.client.1.smithi164.stdout:4/637: mkdir d4/d9/d5c/d97/dbf/d5f/dcc 0 2024-04-20T21:59:05.762 INFO:tasks.workunit.client.1.smithi164.stdout:9/728: fdatasync d3/db/d1b/d20/d3f/f7c 0 2024-04-20T21:59:05.762 INFO:tasks.workunit.client.1.smithi164.stdout:0/624: dread d1/d4/da/f6d [0,4194304] 0 2024-04-20T21:59:05.763 INFO:tasks.workunit.client.1.smithi164.stdout:7/662: dread d2/d21/d24/d31/d3a/f49 [0,4194304] 0 2024-04-20T21:59:05.769 INFO:tasks.workunit.client.1.smithi164.stdout:0/625: mknod d1/cb4 0 2024-04-20T21:59:05.772 INFO:tasks.workunit.client.1.smithi164.stdout:7/663: creat d2/d21/d24/d31/d3a/d83/d6a/fe0 x:0 0 0 2024-04-20T21:59:05.774 INFO:tasks.workunit.client.1.smithi164.stdout:7/664: read d2/d21/d33/f40 [434951,14152] 0 2024-04-20T21:59:05.778 INFO:tasks.workunit.client.1.smithi164.stdout:9/729: creat d3/db/d1b/d20/d3f/d8a/da7/dbd/f101 x:0 0 0 2024-04-20T21:59:05.782 INFO:tasks.workunit.client.1.smithi164.stdout:0/626: symlink d1/lb5 0 2024-04-20T21:59:05.784 INFO:tasks.workunit.client.1.smithi164.stdout:7/665: fsync d2/d21/d24/f61 0 2024-04-20T21:59:05.785 INFO:tasks.workunit.client.1.smithi164.stdout:0/627: stat d1/d4/da/d27/f90 0 2024-04-20T21:59:05.788 INFO:tasks.workunit.client.1.smithi164.stdout:9/730: rename d3/db/d82/fb2 to d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/f102 0 2024-04-20T21:59:05.790 INFO:tasks.workunit.client.1.smithi164.stdout:7/666: creat d2/d21/d24/d31/fe1 x:0 0 0 2024-04-20T21:59:05.793 INFO:tasks.workunit.client.1.smithi164.stdout:2/649: sync 2024-04-20T21:59:05.793 INFO:tasks.workunit.client.1.smithi164.stdout:1/604: dwrite d10/d33/d48/f4b [4194304,4194304] 0 2024-04-20T21:59:05.796 INFO:tasks.workunit.client.1.smithi164.stdout:3/694: dwrite d12/d15/f21 [0,4194304] 0 2024-04-20T21:59:05.798 INFO:tasks.workunit.client.1.smithi164.stdout:7/667: dread - d2/d21/d24/d31/d3a/d83/fbd zero size 2024-04-20T21:59:05.800 INFO:tasks.workunit.client.1.smithi164.stdout:4/638: dwrite d4/d9/d27/f48 [0,4194304] 0 2024-04-20T21:59:05.803 INFO:tasks.workunit.client.1.smithi164.stdout:2/650: truncate d2/d5/d3a/d55/d58/da2/db0/fc7 686629 0 2024-04-20T21:59:05.804 INFO:tasks.workunit.client.1.smithi164.stdout:7/668: rmdir d2/d21/d33 39 2024-04-20T21:59:05.807 INFO:tasks.workunit.client.1.smithi164.stdout:7/669: fdatasync d2/d21/f28 0 2024-04-20T21:59:05.807 INFO:tasks.workunit.client.1.smithi164.stdout:3/695: truncate ff 1959507 0 2024-04-20T21:59:05.811 INFO:tasks.workunit.client.1.smithi164.stdout:7/670: chown d2/d21/d44/c59 16534578 1 2024-04-20T21:59:05.814 INFO:tasks.workunit.client.1.smithi164.stdout:0/628: dwrite d1/d2b/f8f [0,4194304] 0 2024-04-20T21:59:05.818 INFO:tasks.workunit.client.1.smithi164.stdout:1/605: dwrite f7 [0,4194304] 0 2024-04-20T21:59:05.826 INFO:tasks.workunit.client.1.smithi164.stdout:4/639: link d4/d9/d42/lb0 d4/d9/d22/db5/lcd 0 2024-04-20T21:59:05.827 INFO:tasks.workunit.client.1.smithi164.stdout:2/651: dwrite d2/d5f/faf [0,4194304] 0 2024-04-20T21:59:05.829 INFO:tasks.workunit.client.1.smithi164.stdout:4/640: chown d4/d9/d5c/d97/dbf/d5f/f8a 7439 1 2024-04-20T21:59:05.835 INFO:tasks.workunit.client.1.smithi164.stdout:0/629: rmdir d1 39 2024-04-20T21:59:05.837 INFO:tasks.workunit.client.1.smithi164.stdout:3/696: rename d12/d20/d39/d69/d9a/dbe/cdd to d12/d20/d39/dac/cde 0 2024-04-20T21:59:05.846 INFO:tasks.workunit.client.1.smithi164.stdout:4/641: write d4/d28/dad/dbd/fcb [3719787,101361] 0 2024-04-20T21:59:05.853 INFO:tasks.workunit.client.1.smithi164.stdout:1/606: dread d10/f5c [8388608,4194304] 0 2024-04-20T21:59:05.854 INFO:tasks.workunit.client.1.smithi164.stdout:3/697: truncate d12/d15/f37 3058107 0 2024-04-20T21:59:05.856 INFO:tasks.workunit.client.1.smithi164.stdout:2/652: creat d2/d5/fca x:0 0 0 2024-04-20T21:59:05.859 INFO:tasks.workunit.client.1.smithi164.stdout:3/698: symlink d12/d20/d39/d69/d77/d81/ldf 0 2024-04-20T21:59:05.859 INFO:tasks.workunit.client.1.smithi164.stdout:7/671: dread d2/d21/d24/d31/d3a/d83/d77/f97 [0,4194304] 0 2024-04-20T21:59:05.860 INFO:tasks.workunit.client.1.smithi164.stdout:4/642: link d4/d9/d5c/d97/dbf/d67/fc1 d4/d9/d5c/d97/dbf/d5f/dcc/fce 0 2024-04-20T21:59:05.863 INFO:tasks.workunit.client.1.smithi164.stdout:4/643: fsync d4/d28/f76 0 2024-04-20T21:59:05.864 INFO:tasks.workunit.client.1.smithi164.stdout:0/630: dwrite d1/d2b/f6b [4194304,4194304] 0 2024-04-20T21:59:05.866 INFO:tasks.workunit.client.1.smithi164.stdout:4/644: readlink d4/d9/d5c/d97/dbf/d67/l87 0 2024-04-20T21:59:05.867 INFO:tasks.workunit.client.1.smithi164.stdout:0/631: chown d1/d4/da/d5c/d6e/f7a 12 1 2024-04-20T21:59:05.876 INFO:tasks.workunit.client.1.smithi164.stdout:2/653: truncate d2/d5/f1d 914935 0 2024-04-20T21:59:05.877 INFO:tasks.workunit.client.1.smithi164.stdout:7/672: mknod d2/d21/d24/d31/d3a/d83/d77/ce2 0 2024-04-20T21:59:05.878 INFO:tasks.workunit.client.1.smithi164.stdout:4/645: write f3 [9005636,81484] 0 2024-04-20T21:59:05.879 INFO:tasks.workunit.client.1.smithi164.stdout:1/607: dread d10/d16/d20/f2f [0,4194304] 0 2024-04-20T21:59:05.880 INFO:tasks.workunit.client.1.smithi164.stdout:3/699: dwrite d12/d20/d39/d55/d6b/f99 [0,4194304] 0 2024-04-20T21:59:05.890 INFO:tasks.workunit.client.1.smithi164.stdout:7/673: symlink d2/d21/d24/d31/d3a/d83/d6a/le3 0 2024-04-20T21:59:05.891 INFO:tasks.workunit.client.1.smithi164.stdout:0/632: mknod d1/d4/d26/d29/d2d/d54/d77/d3c/cb6 0 2024-04-20T21:59:05.895 INFO:tasks.workunit.client.1.smithi164.stdout:1/608: rename d10/d16/d19/f4e to d10/d16/d20/d25/d3d/fc7 0 2024-04-20T21:59:05.898 INFO:tasks.workunit.client.1.smithi164.stdout:4/646: dwrite d4/d9/d5c/f94 [0,4194304] 0 2024-04-20T21:59:05.900 INFO:tasks.workunit.client.1.smithi164.stdout:4/647: write d4/d28/d3e/fae [540364,12272] 0 2024-04-20T21:59:05.904 INFO:tasks.workunit.client.1.smithi164.stdout:4/648: truncate d4/d28/d3e/d41/f4b 4468987 0 2024-04-20T21:59:05.908 INFO:tasks.workunit.client.1.smithi164.stdout:6/708: sync 2024-04-20T21:59:05.908 INFO:tasks.workunit.client.1.smithi164.stdout:5/717: sync 2024-04-20T21:59:05.909 INFO:tasks.workunit.client.1.smithi164.stdout:7/674: write d2/d21/d44/f4e [1342052,105209] 0 2024-04-20T21:59:05.909 INFO:tasks.workunit.client.1.smithi164.stdout:4/649: write d4/d9/d5c/d97/dbf/f82 [2754387,24006] 0 2024-04-20T21:59:05.911 INFO:tasks.workunit.client.1.smithi164.stdout:5/718: stat dc/d2b/l26 0 2024-04-20T21:59:05.913 INFO:tasks.workunit.client.1.smithi164.stdout:7/675: chown d2/d21/d24/d31/d3a/d83/d63 433838 1 2024-04-20T21:59:05.920 INFO:tasks.workunit.client.1.smithi164.stdout:7/676: mkdir d2/d21/d24/d31/d3a/d83/d6a/de4 0 2024-04-20T21:59:05.920 INFO:tasks.workunit.client.1.smithi164.stdout:3/700: link d12/d20/d39/d69/d83/db9/ld7 d12/le0 0 2024-04-20T21:59:05.920 INFO:tasks.workunit.client.1.smithi164.stdout:5/719: chown dc/d2c/d2e/d30/d5e/fb0 37350 1 2024-04-20T21:59:05.921 INFO:tasks.workunit.client.1.smithi164.stdout:2/654: dread d2/d5/d3a/f76 [0,4194304] 0 2024-04-20T21:59:05.922 INFO:tasks.workunit.client.1.smithi164.stdout:3/701: stat d12/d68/d6f/c9e 0 2024-04-20T21:59:05.923 INFO:tasks.workunit.client.1.smithi164.stdout:6/709: creat d0/d3/d15/d21/d4b/fee x:0 0 0 2024-04-20T21:59:05.924 INFO:tasks.workunit.client.1.smithi164.stdout:7/677: write d2/d21/d24/d31/d3a/daa/fcc [593317,51269] 0 2024-04-20T21:59:05.925 INFO:tasks.workunit.client.1.smithi164.stdout:4/650: creat d4/d28/fcf x:0 0 0 2024-04-20T21:59:05.927 INFO:tasks.workunit.client.1.smithi164.stdout:1/609: link d10/c8e d10/d16/d20/d25/cc8 0 2024-04-20T21:59:05.927 INFO:tasks.workunit.client.1.smithi164.stdout:2/655: truncate d2/d5f/f7e 4762521 0 2024-04-20T21:59:05.928 INFO:tasks.workunit.client.1.smithi164.stdout:6/710: write d0/d3/d15/d23/d45/d69/f8d [872830,90077] 0 2024-04-20T21:59:05.935 INFO:tasks.workunit.client.1.smithi164.stdout:8/598: sync 2024-04-20T21:59:05.935 INFO:tasks.workunit.client.1.smithi164.stdout:9/731: sync 2024-04-20T21:59:05.935 INFO:tasks.workunit.client.1.smithi164.stdout:4/651: dread - d4/d9/d5c/d97/dbf/f6a zero size 2024-04-20T21:59:05.938 INFO:tasks.workunit.client.1.smithi164.stdout:2/656: truncate d2/d5f/f7d 810320 0 2024-04-20T21:59:05.948 INFO:tasks.workunit.client.1.smithi164.stdout:3/702: dwrite d12/d15/f21 [0,4194304] 0 2024-04-20T21:59:05.948 INFO:tasks.workunit.client.1.smithi164.stdout:1/610: link d10/f12 d10/d16/fc9 0 2024-04-20T21:59:05.950 INFO:tasks.workunit.client.1.smithi164.stdout:2/657: creat d2/d19/da6/fcb x:0 0 0 2024-04-20T21:59:05.955 INFO:tasks.workunit.client.1.smithi164.stdout:5/720: dread dc/d2c/d2e/d30/d72/da9/fb2 [0,4194304] 0 2024-04-20T21:59:05.956 INFO:tasks.workunit.client.1.smithi164.stdout:1/611: chown d10/d16/d19/l45 31659887 1 2024-04-20T21:59:05.957 INFO:tasks.workunit.client.1.smithi164.stdout:3/703: dread - d12/d20/d39/d55/fca zero size 2024-04-20T21:59:05.957 INFO:tasks.workunit.client.1.smithi164.stdout:0/633: dwrite d1/d4/da/f2e [0,4194304] 0 2024-04-20T21:59:05.958 INFO:tasks.workunit.client.1.smithi164.stdout:9/732: dread d3/db/d1b/f46 [0,4194304] 0 2024-04-20T21:59:05.959 INFO:tasks.workunit.client.1.smithi164.stdout:2/658: write d2/d5/d3a/fae [320560,76236] 0 2024-04-20T21:59:05.962 INFO:tasks.workunit.client.1.smithi164.stdout:7/678: dwrite d2/d21/d33/f9c [0,4194304] 0 2024-04-20T21:59:05.964 INFO:tasks.workunit.client.1.smithi164.stdout:7/679: chown d2/c5a 0 1 2024-04-20T21:59:05.965 INFO:tasks.workunit.client.1.smithi164.stdout:4/652: truncate d4/d9/d5c/fbc 1358122 0 2024-04-20T21:59:05.965 INFO:tasks.workunit.client.1.smithi164.stdout:2/659: write d2/d5/d3a/d55/d58/da2/fc1 [66879,8847] 0 2024-04-20T21:59:05.965 INFO:tasks.workunit.client.1.smithi164.stdout:6/711: dread d0/d3/d15/d21/d5c/dbf/fcb [0,4194304] 0 2024-04-20T21:59:05.968 INFO:tasks.workunit.client.1.smithi164.stdout:4/653: stat d4/d9/d5c/c8f 0 2024-04-20T21:59:05.968 INFO:tasks.workunit.client.1.smithi164.stdout:1/612: fsync d10/d33/f87 0 2024-04-20T21:59:05.969 INFO:tasks.workunit.client.1.smithi164.stdout:2/660: write d2/d5/f82 [370437,10900] 0 2024-04-20T21:59:05.969 INFO:tasks.workunit.client.1.smithi164.stdout:0/634: symlink d1/d4/d20/d74/lb7 0 2024-04-20T21:59:05.974 INFO:tasks.workunit.client.1.smithi164.stdout:9/733: creat d3/db/d1b/d20/d3f/dc7/f103 x:0 0 0 2024-04-20T21:59:05.974 INFO:tasks.workunit.client.1.smithi164.stdout:7/680: creat d2/d21/d33/fe5 x:0 0 0 2024-04-20T21:59:05.978 INFO:tasks.workunit.client.1.smithi164.stdout:3/704: creat d12/d20/fe1 x:0 0 0 2024-04-20T21:59:05.981 INFO:tasks.workunit.client.1.smithi164.stdout:4/654: mkdir d4/d9/d5c/d97/dbf/d9b/dd0 0 2024-04-20T21:59:05.984 INFO:tasks.workunit.client.1.smithi164.stdout:2/661: mkdir d2/d5/d3a/d55/d58/da2/dcc 0 2024-04-20T21:59:05.985 INFO:tasks.workunit.client.1.smithi164.stdout:8/599: truncate d0/d14/d5f/f95 90532 0 2024-04-20T21:59:05.986 INFO:tasks.workunit.client.1.smithi164.stdout:6/712: dwrite d0/d3/d15/d23/d3b/faa [0,4194304] 0 2024-04-20T21:59:05.990 INFO:tasks.workunit.client.1.smithi164.stdout:7/681: fdatasync d2/d21/f80 0 2024-04-20T21:59:05.991 INFO:tasks.workunit.client.1.smithi164.stdout:9/734: symlink d3/db0/dc0/l104 0 2024-04-20T21:59:05.993 INFO:tasks.workunit.client.1.smithi164.stdout:1/613: mkdir d10/dca 0 2024-04-20T21:59:05.994 INFO:tasks.workunit.client.1.smithi164.stdout:5/721: dwrite dc/f25 [0,4194304] 0 2024-04-20T21:59:05.997 INFO:tasks.workunit.client.1.smithi164.stdout:7/682: chown d2/d21/d24/d31/d3a/d83/d63/cc0 840 1 2024-04-20T21:59:05.999 INFO:tasks.workunit.client.1.smithi164.stdout:0/635: mknod d1/d4/d26/d29/d2d/d54/d77/db3/cb8 0 2024-04-20T21:59:06.000 INFO:tasks.workunit.client.1.smithi164.stdout:0/636: write d1/d4/df/f1a [4393580,43012] 0 2024-04-20T21:59:06.003 INFO:tasks.workunit.client.1.smithi164.stdout:6/713: mknod d0/d3/d15/d21/cef 0 2024-04-20T21:59:06.005 INFO:tasks.workunit.client.1.smithi164.stdout:6/714: chown d0/d3/d15/d21/d5c/dbf/db4/dcd 254411 1 2024-04-20T21:59:06.008 INFO:tasks.workunit.client.1.smithi164.stdout:9/735: creat d3/db/d1b/d1e/f105 x:0 0 0 2024-04-20T21:59:06.012 INFO:tasks.workunit.client.1.smithi164.stdout:5/722: rename dc/d2b/d52/f92 to dc/d2b/da0/ffb 0 2024-04-20T21:59:06.015 INFO:tasks.workunit.client.1.smithi164.stdout:0/637: mknod d1/d2b/cb9 0 2024-04-20T21:59:06.015 INFO:tasks.workunit.client.1.smithi164.stdout:5/723: chown dc/d2c/d2e/d30/d8c 317981 1 2024-04-20T21:59:06.015 INFO:tasks.workunit.client.1.smithi164.stdout:4/655: dwrite d4/d9/d27/d37/f9e [0,4194304] 0 2024-04-20T21:59:06.020 INFO:tasks.workunit.client.1.smithi164.stdout:2/662: link d2/d5f/fa9 d2/d5/d3a/d65/d81/dac/fcd 0 2024-04-20T21:59:06.021 INFO:tasks.workunit.client.1.smithi164.stdout:4/656: truncate d4/d9/d5c/d97/dbf/d5f/f80 4793106 0 2024-04-20T21:59:06.023 INFO:tasks.workunit.client.1.smithi164.stdout:2/663: write d2/d5/d3a/d55/d58/da2/db0/fc7 [1010939,78180] 0 2024-04-20T21:59:06.027 INFO:tasks.workunit.client.1.smithi164.stdout:9/736: symlink d3/db/dd/d40/d78/l106 0 2024-04-20T21:59:06.031 INFO:tasks.workunit.client.1.smithi164.stdout:7/683: mknod d2/d21/d24/d31/d3a/daa/db8/ce6 0 2024-04-20T21:59:06.032 INFO:tasks.workunit.client.1.smithi164.stdout:6/715: dread d0/d3/f80 [0,4194304] 0 2024-04-20T21:59:06.032 INFO:tasks.workunit.client.1.smithi164.stdout:0/638: creat d1/d4/d20/d74/fba x:0 0 0 2024-04-20T21:59:06.036 INFO:tasks.workunit.client.1.smithi164.stdout:8/600: creat d0/d14/d4e/d62/fcc x:0 0 0 2024-04-20T21:59:06.038 INFO:tasks.workunit.client.1.smithi164.stdout:8/601: write d0/d14/d4e/d62/fcc [983132,85852] 0 2024-04-20T21:59:06.040 INFO:tasks.workunit.client.1.smithi164.stdout:3/705: getdents d12/d20/d39/d69/d77/d81 0 2024-04-20T21:59:06.041 INFO:tasks.workunit.client.1.smithi164.stdout:3/706: chown d12/d68/d6f/c9e 547230096 1 2024-04-20T21:59:06.053 INFO:tasks.workunit.client.1.smithi164.stdout:9/737: dread d3/db/dd/d40/d2a/d36/f48 [0,4194304] 0 2024-04-20T21:59:06.057 INFO:tasks.workunit.client.1.smithi164.stdout:6/716: rmdir d0/d3/d15/d21/d5c/dbf/dbd/ddf/d28/d6f 39 2024-04-20T21:59:06.059 INFO:tasks.workunit.client.1.smithi164.stdout:8/602: chown d0/db7/fc4 198 1 2024-04-20T21:59:06.059 INFO:tasks.workunit.client.1.smithi164.stdout:6/717: write d0/d3/d62/d75/fb3 [238644,4564] 0 2024-04-20T21:59:06.060 INFO:tasks.workunit.client.1.smithi164.stdout:3/707: unlink d12/d20/d39/f4b 0 2024-04-20T21:59:06.064 INFO:tasks.workunit.client.1.smithi164.stdout:2/664: symlink d2/d5/d3a/d65/d81/db5/dba/lce 0 2024-04-20T21:59:06.066 INFO:tasks.workunit.client.1.smithi164.stdout:2/665: write d2/d5/d3a/d55/d58/da2/db0/fc7 [1260388,416] 0 2024-04-20T21:59:06.067 INFO:tasks.workunit.client.1.smithi164.stdout:9/738: creat d3/db/dd/d40/d2a/d36/d51/da3/f107 x:0 0 0 2024-04-20T21:59:06.072 INFO:tasks.workunit.client.1.smithi164.stdout:8/603: creat d0/db7/fcd x:0 0 0 2024-04-20T21:59:06.073 INFO:tasks.workunit.client.1.smithi164.stdout:7/684: write d2/d21/d24/d31/d3a/d83/d77/fdc [698792,40554] 0 2024-04-20T21:59:06.074 INFO:tasks.workunit.client.1.smithi164.stdout:6/718: chown d0/d3/d15/d21/c50 43217327 1 2024-04-20T21:59:06.076 INFO:tasks.workunit.client.1.smithi164.stdout:4/657: link d4/d9/d5c/d97/dbf/d67/l7e d4/d9/da4/ld1 0 2024-04-20T21:59:06.077 INFO:tasks.workunit.client.1.smithi164.stdout:1/614: link d10/d16/d19/d1a/l65 d10/d33/d4d/lcb 0 2024-04-20T21:59:06.078 INFO:tasks.workunit.client.1.smithi164.stdout:1/615: fsync d10/d16/d19/d1a/f32 0 2024-04-20T21:59:06.081 INFO:tasks.workunit.client.1.smithi164.stdout:0/639: rename d1/d4/d20/l34 to d1/d4/lbb 0 2024-04-20T21:59:06.081 INFO:tasks.workunit.client.1.smithi164.stdout:9/739: read d3/db/d1b/d1e/f3b [505394,48280] 0 2024-04-20T21:59:06.084 INFO:tasks.workunit.client.1.smithi164.stdout:3/708: truncate d12/d15/f19 1410988 0 2024-04-20T21:59:06.084 INFO:tasks.workunit.client.1.smithi164.stdout:3/709: stat d12/fd8 0 2024-04-20T21:59:06.084 INFO:tasks.workunit.client.1.smithi164.stdout:7/685: mkdir d2/d21/d24/d31/d3a/d83/d6a/de7 0 2024-04-20T21:59:06.086 INFO:tasks.workunit.client.1.smithi164.stdout:3/710: write d12/d68/d6f/d71/f7a [84234,110421] 0 2024-04-20T21:59:06.088 INFO:tasks.workunit.client.1.smithi164.stdout:2/666: unlink d2/d5/d21/lb4 0 2024-04-20T21:59:06.090 INFO:tasks.workunit.client.1.smithi164.stdout:2/667: readlink d2/d5/d3a/d65/d81/l8b 0 2024-04-20T21:59:06.093 INFO:tasks.workunit.client.1.smithi164.stdout:2/668: write d2/d5/d3a/d55/f68 [357938,125541] 0 2024-04-20T21:59:06.095 INFO:tasks.workunit.client.1.smithi164.stdout:9/740: rename d3/ff1 to d3/db/dd/d40/d2a/d36/d51/da3/f108 0 2024-04-20T21:59:06.098 INFO:tasks.workunit.client.1.smithi164.stdout:6/719: dread d0/d3/d15/d21/d5c/dbf/dbd/ddf/f38 [4194304,4194304] 0 2024-04-20T21:59:06.099 INFO:tasks.workunit.client.1.smithi164.stdout:4/658: creat d4/d9/d5c/d97/dbf/d9b/dd0/fd2 x:0 0 0 2024-04-20T21:59:06.099 INFO:tasks.workunit.client.1.smithi164.stdout:6/720: fdatasync d0/d3/f10 0 2024-04-20T21:59:06.100 INFO:tasks.workunit.client.1.smithi164.stdout:7/686: chown d2/d21/d24/d31/d3a/d83/d63/ld8 423 1 2024-04-20T21:59:06.100 INFO:tasks.workunit.client.1.smithi164.stdout:3/711: mkdir d12/d20/d39/d69/dad/de2 0 2024-04-20T21:59:06.101 INFO:tasks.workunit.client.1.smithi164.stdout:1/616: symlink d10/d16/d19/d1a/lcc 0 2024-04-20T21:59:06.105 INFO:tasks.workunit.client.1.smithi164.stdout:6/721: chown d0/d3/d15/d21/d5c/dbf/dbd/ddf/f96 55794 1 2024-04-20T21:59:06.106 INFO:tasks.workunit.client.1.smithi164.stdout:3/712: truncate d12/d68/d6f/d71/f9d 925721 0 2024-04-20T21:59:06.108 INFO:tasks.workunit.client.1.smithi164.stdout:0/640: dwrite d1/d4/d26/f46 [4194304,4194304] 0 2024-04-20T21:59:06.110 INFO:tasks.workunit.client.1.smithi164.stdout:5/724: sync 2024-04-20T21:59:06.111 INFO:tasks.workunit.client.1.smithi164.stdout:1/617: readlink d10/d33/d4d/dc4/l88 0 2024-04-20T21:59:06.112 INFO:tasks.workunit.client.1.smithi164.stdout:7/687: truncate d2/d21/f80 987643 0 2024-04-20T21:59:06.113 INFO:tasks.workunit.client.1.smithi164.stdout:2/669: creat d2/d5/d3a/d55/d58/db8/fcf x:0 0 0 2024-04-20T21:59:06.115 INFO:tasks.workunit.client.1.smithi164.stdout:3/713: mkdir d12/d20/d39/d69/d9a/dbe/de3 0 2024-04-20T21:59:06.120 INFO:tasks.workunit.client.1.smithi164.stdout:9/741: link d3/db/dd/d40/d78/d86/fb3 d3/db0/dd3/f109 0 2024-04-20T21:59:06.121 INFO:tasks.workunit.client.1.smithi164.stdout:7/688: rmdir d2/d21/d24/d31/d3a/d83/d63/d85/dbe 39 2024-04-20T21:59:06.123 INFO:tasks.workunit.client.1.smithi164.stdout:1/618: rmdir d10/d16/d20 39 2024-04-20T21:59:06.126 INFO:tasks.workunit.client.1.smithi164.stdout:8/604: write d0/f50 [473149,88350] 0 2024-04-20T21:59:06.129 INFO:tasks.workunit.client.1.smithi164.stdout:8/605: write d0/d14/d4e/d6f/f79 [2654817,10381] 0 2024-04-20T21:59:06.131 INFO:tasks.workunit.client.1.smithi164.stdout:5/725: unlink dc/d12/d1e/def/lf4 0 2024-04-20T21:59:06.132 INFO:tasks.workunit.client.1.smithi164.stdout:8/606: chown d0/d14/d16/d58/d94/f98 60883 1 2024-04-20T21:59:06.133 INFO:tasks.workunit.client.1.smithi164.stdout:9/742: write d3/db/dcc/de3/feb [4316278,99412] 0 2024-04-20T21:59:06.136 INFO:tasks.workunit.client.1.smithi164.stdout:1/619: creat d10/d33/d41/fcd x:0 0 0 2024-04-20T21:59:06.137 INFO:tasks.workunit.client.1.smithi164.stdout:7/689: rmdir d2/d21/d24/d31/d3a/d83/d63/d85/dbe 39 2024-04-20T21:59:06.140 INFO:tasks.workunit.client.1.smithi164.stdout:5/726: truncate dc/d2c/d2e/d30/d72/fdf 345951 0 2024-04-20T21:59:06.140 INFO:tasks.workunit.client.1.smithi164.stdout:2/670: rename d2/d5/d3a/d65/d81/db5 to d2/d19/d28/dd0 0 2024-04-20T21:59:06.142 INFO:tasks.workunit.client.1.smithi164.stdout:6/722: dread d0/d3/f3a [0,4194304] 0 2024-04-20T21:59:06.142 INFO:tasks.workunit.client.1.smithi164.stdout:8/607: creat d0/d14/d16/dbf/fce x:0 0 0 2024-04-20T21:59:06.144 INFO:tasks.workunit.client.1.smithi164.stdout:0/641: dread d1/f12 [0,4194304] 0 2024-04-20T21:59:06.144 INFO:tasks.workunit.client.1.smithi164.stdout:7/690: symlink d2/d21/d24/d31/d3a/daa/db8/le8 0 2024-04-20T21:59:06.145 INFO:tasks.workunit.client.1.smithi164.stdout:5/727: chown dc/d2b/d6d/d73/lf7 874674 1 2024-04-20T21:59:06.145 INFO:tasks.workunit.client.1.smithi164.stdout:9/743: mknod d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/c10a 0 2024-04-20T21:59:06.147 INFO:tasks.workunit.client.1.smithi164.stdout:8/608: mknod d0/d14/d16/ccf 0 2024-04-20T21:59:06.150 INFO:tasks.workunit.client.1.smithi164.stdout:8/609: truncate d0/d14/d4e/fa1 812535 0 2024-04-20T21:59:06.150 INFO:tasks.workunit.client.1.smithi164.stdout:7/691: mkdir d2/d21/d44/dd4/d9e/de9 0 2024-04-20T21:59:06.151 INFO:tasks.workunit.client.1.smithi164.stdout:0/642: symlink d1/d4/d26/d29/d2d/d54/d77/db3/lbc 0 2024-04-20T21:59:06.152 INFO:tasks.workunit.client.1.smithi164.stdout:8/610: read d0/d1e/f88 [880282,93124] 0 2024-04-20T21:59:06.152 INFO:tasks.workunit.client.1.smithi164.stdout:6/723: symlink d0/d3/d15/d21/db1/lf0 0 2024-04-20T21:59:06.152 INFO:tasks.workunit.client.1.smithi164.stdout:7/692: stat d2/d21/d24/d31/d3a/d83/d77/fdc 0 2024-04-20T21:59:06.153 INFO:tasks.workunit.client.1.smithi164.stdout:9/744: fsync d3/db/dd/d40/d2a/d36/d51/d83/f8b 0 2024-04-20T21:59:06.153 INFO:tasks.workunit.client.1.smithi164.stdout:0/643: readlink d1/d4/da/d27/l6a 0 2024-04-20T21:59:06.161 INFO:tasks.workunit.client.1.smithi164.stdout:1/620: rename d10/d16/d20/d25/d95/lc5 to d10/d16/lce 0 2024-04-20T21:59:06.163 INFO:tasks.workunit.client.1.smithi164.stdout:6/724: creat d0/d3/d15/d23/ff1 x:0 0 0 2024-04-20T21:59:06.166 INFO:tasks.workunit.client.1.smithi164.stdout:8/611: creat d0/d14/d16/d58/d73/fd0 x:0 0 0 2024-04-20T21:59:06.166 INFO:tasks.workunit.client.1.smithi164.stdout:2/671: link d2/d5/d3a/d55/d58/da2/db0/cb1 d2/d19/d28/d3e/d9e/cd1 0 2024-04-20T21:59:06.166 INFO:tasks.workunit.client.1.smithi164.stdout:7/693: dwrite d2/d21/d44/dd4/f9f [4194304,4194304] 0 2024-04-20T21:59:06.168 INFO:tasks.workunit.client.1.smithi164.stdout:9/745: unlink d3/db/d82/d98/fba 0 2024-04-20T21:59:06.172 INFO:tasks.workunit.client.1.smithi164.stdout:5/728: rename dc/d2b/d6d/fa6 to dc/d2c/d2e/dbd/df9/ffc 0 2024-04-20T21:59:06.176 INFO:tasks.workunit.client.1.smithi164.stdout:4/659: dwrite d4/d9/d5c/d97/dbf/d5f/dcc/fce [0,4194304] 0 2024-04-20T21:59:06.183 INFO:tasks.workunit.client.1.smithi164.stdout:8/612: fsync d0/d14/fa0 0 2024-04-20T21:59:06.191 INFO:tasks.workunit.client.1.smithi164.stdout:3/714: truncate d12/d20/d39/d55/d6b/f80 1134860 0 2024-04-20T21:59:06.194 INFO:tasks.workunit.client.1.smithi164.stdout:0/644: rename d1/c45 to d1/cbd 0 2024-04-20T21:59:06.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:05 smithi164 ceph-mon[23506]: pgmap v10: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 45 MiB/s rd, 139 MiB/s wr, 314 op/s 2024-04-20T21:59:06.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:05 smithi164 ceph-mon[23506]: Standby manager daemon smithi164.oejajr started 2024-04-20T21:59:06.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:05 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/4034212667' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/crt"}]: dispatch 2024-04-20T21:59:06.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:05 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/4034212667' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T21:59:06.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:05 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/4034212667' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/key"}]: dispatch 2024-04-20T21:59:06.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:05 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/4034212667' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T21:59:06.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:05 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:06.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:05 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:06.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:05 smithi142 ceph-mon[15828]: pgmap v10: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 45 MiB/s rd, 139 MiB/s wr, 314 op/s 2024-04-20T21:59:06.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:05 smithi142 ceph-mon[15828]: Standby manager daemon smithi164.oejajr started 2024-04-20T21:59:06.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:05 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.164:0/4034212667' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/crt"}]: dispatch 2024-04-20T21:59:06.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:05 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.164:0/4034212667' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T21:59:06.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:05 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.164:0/4034212667' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/key"}]: dispatch 2024-04-20T21:59:06.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:05 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.164:0/4034212667' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T21:59:06.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:05 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:06.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:05 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:06.198 INFO:tasks.workunit.client.1.smithi164.stdout:8/613: creat d0/d14/d4e/d86/fd1 x:0 0 0 2024-04-20T21:59:06.200 INFO:tasks.workunit.client.1.smithi164.stdout:8/614: fsync d0/d14/d16/d9d/faf 0 2024-04-20T21:59:06.205 INFO:tasks.workunit.client.1.smithi164.stdout:1/621: creat d10/d33/fcf x:0 0 0 2024-04-20T21:59:06.206 INFO:tasks.workunit.client.1.smithi164.stdout:1/622: chown d10/d16/d19 438406 1 2024-04-20T21:59:06.208 INFO:tasks.workunit.client.1.smithi164.stdout:9/746: rename d3/cc to d3/db/dd/d40/d2a/d36/d51/d83/c10b 0 2024-04-20T21:59:06.211 INFO:tasks.workunit.client.1.smithi164.stdout:6/725: creat d0/d3/d15/ff2 x:0 0 0 2024-04-20T21:59:06.211 INFO:tasks.workunit.client.1.smithi164.stdout:3/715: mknod d12/d68/d6f/d71/ce4 0 2024-04-20T21:59:06.220 INFO:tasks.workunit.client.1.smithi164.stdout:4/660: symlink d4/ld3 0 2024-04-20T21:59:06.222 INFO:tasks.workunit.client.1.smithi164.stdout:1/623: creat d10/d16/d20/d26/fd0 x:0 0 0 2024-04-20T21:59:06.224 INFO:tasks.workunit.client.1.smithi164.stdout:9/747: unlink d3/db/d1b/d1e/f81 0 2024-04-20T21:59:06.224 INFO:tasks.workunit.client.1.smithi164.stdout:4/661: stat d4/d28/d3e/d41/fb6 0 2024-04-20T21:59:06.228 INFO:tasks.workunit.client.1.smithi164.stdout:5/729: rename dc/d2b/d6d/d73/de0 to dc/d2b/d6d/d73/dd6/dfd 0 2024-04-20T21:59:06.231 INFO:tasks.workunit.client.1.smithi164.stdout:9/748: chown d3/db/d1b/d20/d3f/d8a/da7/dbd/d67 29 1 2024-04-20T21:59:06.247 INFO:tasks.workunit.client.1.smithi164.stdout:5/730: dwrite dc/d2c/d2e/d30/d72/fd8 [0,4194304] 0 2024-04-20T21:59:06.248 INFO:tasks.workunit.client.1.smithi164.stdout:5/731: chown dc/d12/c79 21 1 2024-04-20T21:59:06.262 INFO:tasks.workunit.client.1.smithi164.stdout:2/672: getdents d2 0 2024-04-20T21:59:06.263 INFO:tasks.workunit.client.1.smithi164.stdout:2/673: readlink d2/l2e 0 2024-04-20T21:59:06.265 INFO:tasks.workunit.client.1.smithi164.stdout:6/726: rmdir d0/d3/d11/d29/d6e 39 2024-04-20T21:59:06.269 INFO:tasks.workunit.client.1.smithi164.stdout:1/624: write d10/f73 [2340696,109427] 0 2024-04-20T21:59:06.270 INFO:tasks.workunit.client.1.smithi164.stdout:3/716: rename d12/d20/d39/d55/d87/fd6 to d12/d20/d39/d55/d87/dd0/fe5 0 2024-04-20T21:59:06.271 INFO:tasks.workunit.client.1.smithi164.stdout:1/625: chown d10/d16/f7b 6 1 2024-04-20T21:59:06.278 INFO:tasks.workunit.client.1.smithi164.stdout:7/694: write d2/d21/d24/d31/d3a/d83/d68/f8b [580889,35322] 0 2024-04-20T21:59:06.280 INFO:tasks.workunit.client.1.smithi164.stdout:6/727: rmdir d0/d3/d15/d23/d45/d4f 39 2024-04-20T21:59:06.281 INFO:tasks.workunit.client.1.smithi164.stdout:1/626: dread d10/d33/d41/f58 [0,4194304] 0 2024-04-20T21:59:06.285 INFO:tasks.workunit.client.1.smithi164.stdout:3/717: dread - d12/d15/fa1 zero size 2024-04-20T21:59:06.293 INFO:tasks.workunit.client.1.smithi164.stdout:5/732: dwrite dc/d2c/d2e/d30/f59 [0,4194304] 0 2024-04-20T21:59:06.295 INFO:tasks.workunit.client.1.smithi164.stdout:6/728: dwrite d0/d3/d15/d21/d4b/f4e [0,4194304] 0 2024-04-20T21:59:06.295 INFO:tasks.workunit.client.1.smithi164.stdout:3/718: unlink d12/d20/f7e 0 2024-04-20T21:59:06.301 INFO:tasks.workunit.client.1.smithi164.stdout:4/662: getdents d4/d9/d5c/d97 0 2024-04-20T21:59:06.307 INFO:tasks.workunit.client.1.smithi164.stdout:6/729: symlink d0/d3/d11/d29/d6e/lf3 0 2024-04-20T21:59:06.311 INFO:tasks.workunit.client.1.smithi164.stdout:5/733: dwrite dc/d12/f4d [0,4194304] 0 2024-04-20T21:59:06.312 INFO:tasks.workunit.client.1.smithi164.stdout:8/615: truncate d0/d14/fa 4916062 0 2024-04-20T21:59:06.315 INFO:tasks.workunit.client.1.smithi164.stdout:6/730: chown d0/d3/d15/d21/d5c/dbf/dbd/ddf/d81/f8b 949592 1 2024-04-20T21:59:06.316 INFO:tasks.workunit.client.1.smithi164.stdout:8/616: mknod d0/db7/cd2 0 2024-04-20T21:59:06.317 INFO:tasks.workunit.client.1.smithi164.stdout:9/749: write d3/db/dd/fe [391443,104004] 0 2024-04-20T21:59:06.318 INFO:tasks.workunit.client.1.smithi164.stdout:5/734: symlink dc/d2b/d52/lfe 0 2024-04-20T21:59:06.320 INFO:tasks.workunit.client.1.smithi164.stdout:9/750: fsync d3/db/dcc/de3/feb 0 2024-04-20T21:59:06.320 INFO:tasks.workunit.client.1.smithi164.stdout:6/731: mkdir d0/d3/d15/d21/d5c/df4 0 2024-04-20T21:59:06.322 INFO:tasks.workunit.client.1.smithi164.stdout:6/732: readlink d0/d3/d11/lb0 0 2024-04-20T21:59:06.324 INFO:tasks.workunit.client.1.smithi164.stdout:1/627: write d10/d33/d48/f6b [554924,89757] 0 2024-04-20T21:59:06.326 INFO:tasks.workunit.client.1.smithi164.stdout:0/645: sync 2024-04-20T21:59:06.328 INFO:tasks.workunit.client.1.smithi164.stdout:9/751: truncate d3/f41 4538049 0 2024-04-20T21:59:06.331 INFO:tasks.workunit.client.1.smithi164.stdout:8/617: mkdir d0/d14/d16/d58/d94/da5/dad/dd3 0 2024-04-20T21:59:06.332 INFO:tasks.workunit.client.1.smithi164.stdout:7/695: dwrite d2/d21/f7d [0,4194304] 0 2024-04-20T21:59:06.337 INFO:tasks.workunit.client.1.smithi164.stdout:3/719: dwrite d12/f5f [0,4194304] 0 2024-04-20T21:59:06.384 INFO:tasks.workunit.client.1.smithi164.stdout:6/733: mkdir d0/d3/d11/d29/d6e/db2/df5 0 2024-04-20T21:59:06.384 INFO:tasks.workunit.client.1.smithi164.stdout:1/628: chown d10/d16/d19/d1a/l65 101 1 2024-04-20T21:59:06.384 INFO:tasks.workunit.client.1.smithi164.stdout:3/720: chown d12/d68/d6f/d71/f7a 115105879 1 2024-04-20T21:59:06.387 INFO:tasks.workunit.client.1.smithi164.stdout:6/734: read - d0/d3/d27/d9d/fa2 zero size 2024-04-20T21:59:06.387 INFO:tasks.workunit.client.1.smithi164.stdout:7/696: getdents d2/d21/d44/dd4/d82/d93/dca 0 2024-04-20T21:59:06.390 INFO:tasks.workunit.client.1.smithi164.stdout:5/735: dread dc/d2c/d2e/d30/d5e/f9d [0,4194304] 0 2024-04-20T21:59:06.393 INFO:tasks.workunit.client.1.smithi164.stdout:5/736: fdatasync dc/d12/d1e/da8/fe6 0 2024-04-20T21:59:06.394 INFO:tasks.workunit.client.1.smithi164.stdout:6/735: creat d0/d3/d11/d5a/ff6 x:0 0 0 2024-04-20T21:59:06.395 INFO:tasks.workunit.client.1.smithi164.stdout:0/646: truncate d1/f8 7949531 0 2024-04-20T21:59:06.396 INFO:tasks.workunit.client.1.smithi164.stdout:0/647: stat d1/d4/d26/f76 0 2024-04-20T21:59:06.397 INFO:tasks.workunit.client.1.smithi164.stdout:8/618: write d0/d14/f3d [2289144,76189] 0 2024-04-20T21:59:06.400 INFO:tasks.workunit.client.1.smithi164.stdout:7/697: truncate d2/d21/d24/d31/d3a/f49 1236309 0 2024-04-20T21:59:06.401 INFO:tasks.workunit.client.1.smithi164.stdout:6/736: creat d0/d3/d15/d21/d5c/dbf/db4/dcd/ff7 x:0 0 0 2024-04-20T21:59:06.402 INFO:tasks.workunit.client.1.smithi164.stdout:5/737: dread - dc/d2c/d2e/d30/d5e/fa5 zero size 2024-04-20T21:59:06.402 INFO:tasks.workunit.client.1.smithi164.stdout:1/629: link d10/d16/d20/d25/d3d/l44 d10/d16/d20/ld1 0 2024-04-20T21:59:06.407 INFO:tasks.workunit.client.1.smithi164.stdout:7/698: mkdir d2/d21/d24/d31/d3a/d83/dcf/dea 0 2024-04-20T21:59:06.407 INFO:tasks.workunit.client.1.smithi164.stdout:1/630: symlink d10/d16/d20/d26/ld2 0 2024-04-20T21:59:06.411 INFO:tasks.workunit.client.1.smithi164.stdout:8/619: mkdir d0/d14/d16/d58/d94/da5/dad/dd3/dd4 0 2024-04-20T21:59:06.411 INFO:tasks.workunit.client.1.smithi164.stdout:1/631: read d10/d16/f7b [97522,47000] 0 2024-04-20T21:59:06.412 INFO:tasks.workunit.client.1.smithi164.stdout:7/699: symlink d2/d21/d44/leb 0 2024-04-20T21:59:06.415 INFO:tasks.workunit.client.1.smithi164.stdout:7/700: read d2/f29 [301588,45864] 0 2024-04-20T21:59:06.415 INFO:tasks.workunit.client.1.smithi164.stdout:3/721: dread d12/d20/d39/f65 [0,4194304] 0 2024-04-20T21:59:06.419 INFO:tasks.workunit.client.1.smithi164.stdout:8/620: creat d0/d14/d4e/d86/fd5 x:0 0 0 2024-04-20T21:59:06.422 INFO:tasks.workunit.client.1.smithi164.stdout:1/632: creat d10/d16/d20/d26/d34/da9/fd3 x:0 0 0 2024-04-20T21:59:06.422 INFO:tasks.workunit.client.1.smithi164.stdout:6/737: dread d0/d3/d15/d23/d45/d69/f8d [0,4194304] 0 2024-04-20T21:59:06.422 INFO:tasks.workunit.client.1.smithi164.stdout:7/701: dread d2/d21/f75 [0,4194304] 0 2024-04-20T21:59:06.428 INFO:tasks.workunit.client.1.smithi164.stdout:0/648: dwrite d1/d4/d26/d29/f5b [0,4194304] 0 2024-04-20T21:59:06.428 INFO:tasks.workunit.client.1.smithi164.stdout:5/738: dread dc/d12/f15 [0,4194304] 0 2024-04-20T21:59:06.430 INFO:tasks.workunit.client.1.smithi164.stdout:5/739: write dc/d12/f18 [3468309,33113] 0 2024-04-20T21:59:06.431 INFO:tasks.workunit.client.1.smithi164.stdout:7/702: creat d2/d21/d24/d31/d3a/daa/db8/fec x:0 0 0 2024-04-20T21:59:06.432 INFO:tasks.workunit.client.1.smithi164.stdout:1/633: fdatasync d10/f11 0 2024-04-20T21:59:06.433 INFO:tasks.workunit.client.1.smithi164.stdout:3/722: truncate d12/d15/f37 1439033 0 2024-04-20T21:59:06.436 INFO:tasks.workunit.client.1.smithi164.stdout:3/723: write d12/d20/d39/d69/d77/f7f [3153655,114886] 0 2024-04-20T21:59:06.440 INFO:tasks.workunit.client.1.smithi164.stdout:7/703: mknod d2/d21/d24/d31/d3a/d83/ced 0 2024-04-20T21:59:06.441 INFO:tasks.workunit.client.1.smithi164.stdout:1/634: unlink d10/d16/f70 0 2024-04-20T21:59:06.443 INFO:tasks.workunit.client.1.smithi164.stdout:5/740: creat dc/d2b/da0/df8/fff x:0 0 0 2024-04-20T21:59:06.445 INFO:tasks.workunit.client.1.smithi164.stdout:3/724: chown d12/d20/d39/d55/d6b/f80 1059769188 1 2024-04-20T21:59:06.445 INFO:tasks.workunit.client.1.smithi164.stdout:5/741: chown dc/d2b/d6d/d73/dab/lb9 0 1 2024-04-20T21:59:06.448 INFO:tasks.workunit.client.1.smithi164.stdout:1/635: unlink d10/d16/d20/d26/fc6 0 2024-04-20T21:59:06.449 INFO:tasks.workunit.client.1.smithi164.stdout:3/725: mkdir d12/d15/dae/de6 0 2024-04-20T21:59:06.451 INFO:tasks.workunit.client.1.smithi164.stdout:5/742: read dc/d2c/d2e/dbd/df9/ffc [2305845,82457] 0 2024-04-20T21:59:06.452 INFO:tasks.workunit.client.1.smithi164.stdout:2/674: sync 2024-04-20T21:59:06.452 INFO:tasks.workunit.client.1.smithi164.stdout:0/649: dread d1/fb [0,4194304] 0 2024-04-20T21:59:06.453 INFO:tasks.workunit.client.1.smithi164.stdout:2/675: fsync d2/d5/d21/f2b 0 2024-04-20T21:59:06.453 INFO:tasks.workunit.client.1.smithi164.stdout:8/621: write d0/d1e/f22 [532113,122948] 0 2024-04-20T21:59:06.455 INFO:tasks.workunit.client.1.smithi164.stdout:2/676: chown d2/d19/c3d 186 1 2024-04-20T21:59:06.455 INFO:tasks.workunit.client.1.smithi164.stdout:3/726: mknod d12/d20/d39/d69/db8/ce7 0 2024-04-20T21:59:06.466 INFO:tasks.workunit.client.1.smithi164.stdout:1/636: mknod d10/d16/d20/dbf/cd4 0 2024-04-20T21:59:06.467 INFO:tasks.workunit.client.1.smithi164.stdout:5/743: symlink dc/d2b/d6d/d73/dd6/dfd/l100 0 2024-04-20T21:59:06.468 INFO:tasks.workunit.client.1.smithi164.stdout:0/650: dwrite d1/d4/d26/d29/d2d/d54/d77/d3c/f58 [0,4194304] 0 2024-04-20T21:59:06.469 INFO:tasks.workunit.client.1.smithi164.stdout:7/704: write d2/d21/d44/dd4/d9e/da6/fcd [7353107,87993] 0 2024-04-20T21:59:06.471 INFO:tasks.workunit.client.1.smithi164.stdout:3/727: readlink d12/d20/d39/d69/d83/db9/ld7 0 2024-04-20T21:59:06.471 INFO:tasks.workunit.client.1.smithi164.stdout:8/622: fdatasync d0/d14/d5f/f95 0 2024-04-20T21:59:06.477 INFO:tasks.workunit.client.1.smithi164.stdout:5/744: mkdir dc/d12/d1e/d101 0 2024-04-20T21:59:06.477 INFO:tasks.workunit.client.1.smithi164.stdout:1/637: symlink d10/d16/d20/d91/d9d/ld5 0 2024-04-20T21:59:06.478 INFO:tasks.workunit.client.1.smithi164.stdout:2/677: symlink d2/d19/d28/ld2 0 2024-04-20T21:59:06.485 INFO:tasks.workunit.client.1.smithi164.stdout:8/623: symlink d0/d14/d16/d58/d94/da5/dad/ld6 0 2024-04-20T21:59:06.488 INFO:tasks.workunit.client.1.smithi164.stdout:8/624: write d0/d14/f13 [3184185,114971] 0 2024-04-20T21:59:06.488 INFO:tasks.workunit.client.1.smithi164.stdout:7/705: dwrite d2/d21/d33/fc9 [0,4194304] 0 2024-04-20T21:59:06.490 INFO:tasks.workunit.client.1.smithi164.stdout:1/638: symlink d10/d16/d19/d1a/d51/ld6 0 2024-04-20T21:59:06.496 INFO:tasks.workunit.client.1.smithi164.stdout:0/651: write d1/d2b/f66 [182455,45321] 0 2024-04-20T21:59:06.496 INFO:tasks.workunit.client.1.smithi164.stdout:3/728: getdents d12/d20/d39/ddc 0 2024-04-20T21:59:06.502 INFO:tasks.workunit.client.1.smithi164.stdout:5/745: write dc/d2c/d2e/d30/d72/da9/fb5 [582977,63243] 0 2024-04-20T21:59:06.504 INFO:tasks.workunit.client.1.smithi164.stdout:8/625: dwrite d0/d14/d4e/d6f/f79 [0,4194304] 0 2024-04-20T21:59:06.508 INFO:tasks.workunit.client.1.smithi164.stdout:8/626: write d0/d14/d4e/d62/d8f/fa9 [699194,59159] 0 2024-04-20T21:59:06.509 INFO:tasks.workunit.client.1.smithi164.stdout:7/706: rename d2/d21/d24/d31/d3a/d83/d63/cc0 to d2/d21/d24/d31/d3a/d83/d6a/dc5/cee 0 2024-04-20T21:59:06.510 INFO:tasks.workunit.client.1.smithi164.stdout:3/729: fdatasync d12/d2a/f64 0 2024-04-20T21:59:06.512 INFO:tasks.workunit.client.1.smithi164.stdout:7/707: truncate d2/f8e 5047237 0 2024-04-20T21:59:06.513 INFO:tasks.workunit.client.1.smithi164.stdout:0/652: rmdir d1/d4/da/d5c/d6e 39 2024-04-20T21:59:06.514 INFO:tasks.workunit.client.1.smithi164.stdout:1/639: mkdir d10/dca/dd7 0 2024-04-20T21:59:06.517 INFO:tasks.workunit.client.1.smithi164.stdout:5/746: rename dc/d2c/d2e/d30/f77 to dc/d2c/d2e/dbd/df9/f102 0 2024-04-20T21:59:06.518 INFO:tasks.workunit.client.1.smithi164.stdout:2/678: write d2/d5/d3a/d55/d58/f85 [592884,14426] 0 2024-04-20T21:59:06.520 INFO:tasks.workunit.client.1.smithi164.stdout:3/730: symlink d12/d20/d39/d69/le8 0 2024-04-20T21:59:06.520 INFO:tasks.workunit.client.1.smithi164.stdout:2/679: chown d2/d5/d3a/d65 701 1 2024-04-20T21:59:06.521 INFO:tasks.workunit.client.1.smithi164.stdout:8/627: dread d0/f84 [0,4194304] 0 2024-04-20T21:59:06.522 INFO:tasks.workunit.client.1.smithi164.stdout:7/708: mkdir d2/d21/d24/d31/d3a/d83/dba/def 0 2024-04-20T21:59:06.524 INFO:tasks.workunit.client.1.smithi164.stdout:2/680: truncate d2/d30/f83 877400 0 2024-04-20T21:59:06.527 INFO:tasks.workunit.client.1.smithi164.stdout:5/747: mknod dc/d2b/d53/c103 0 2024-04-20T21:59:06.527 INFO:tasks.workunit.client.1.smithi164.stdout:4/663: sync 2024-04-20T21:59:06.527 INFO:tasks.workunit.client.1.smithi164.stdout:9/752: sync 2024-04-20T21:59:06.529 INFO:tasks.workunit.client.1.smithi164.stdout:2/681: mknod d2/d19/d28/dd0/cd3 0 2024-04-20T21:59:06.529 INFO:tasks.workunit.client.1.smithi164.stdout:9/753: fsync d3/f95 0 2024-04-20T21:59:06.530 INFO:tasks.workunit.client.1.smithi164.stdout:0/653: dwrite d1/d4/f7e [0,4194304] 0 2024-04-20T21:59:06.534 INFO:tasks.workunit.client.1.smithi164.stdout:7/709: mkdir d2/d21/df0 0 2024-04-20T21:59:06.535 INFO:tasks.workunit.client.1.smithi164.stdout:1/640: link d10/d16/d19/d1a/d51/ld6 d10/d16/d20/d25/ld8 0 2024-04-20T21:59:06.539 INFO:tasks.workunit.client.1.smithi164.stdout:9/754: read - d3/d9f/da1/fbc zero size 2024-04-20T21:59:06.540 INFO:tasks.workunit.client.1.smithi164.stdout:0/654: mkdir d1/d4/df/dbe 0 2024-04-20T21:59:06.541 INFO:tasks.workunit.client.1.smithi164.stdout:9/755: chown d3/db/dc4/fff 135790 1 2024-04-20T21:59:06.543 INFO:tasks.workunit.client.1.smithi164.stdout:2/682: dwrite d2/d5/d3a/f5a [4194304,4194304] 0 2024-04-20T21:59:06.545 INFO:tasks.workunit.client.1.smithi164.stdout:2/683: truncate d2/f8a 1293320 0 2024-04-20T21:59:06.546 INFO:tasks.workunit.client.1.smithi164.stdout:3/731: rename d12/d6d/lda to d12/d20/d39/d55/le9 0 2024-04-20T21:59:06.549 INFO:tasks.workunit.client.1.smithi164.stdout:2/684: truncate d2/d30/d84/f93 1396076 0 2024-04-20T21:59:06.551 INFO:tasks.workunit.client.1.smithi164.stdout:4/664: symlink d4/d9/d5c/d97/dbf/d67/d86/dc3/dc6/ld4 0 2024-04-20T21:59:06.558 INFO:tasks.workunit.client.1.smithi164.stdout:8/628: rename d0/f3a to d0/d14/d16/d5a/fd7 0 2024-04-20T21:59:06.559 INFO:tasks.workunit.client.1.smithi164.stdout:1/641: truncate d10/f5c 13477429 0 2024-04-20T21:59:06.560 INFO:tasks.workunit.client.1.smithi164.stdout:7/710: dwrite d2/d21/d24/d31/d3a/d83/d77/f97 [0,4194304] 0 2024-04-20T21:59:06.562 INFO:tasks.workunit.client.1.smithi164.stdout:6/738: sync 2024-04-20T21:59:06.562 INFO:tasks.workunit.client.1.smithi164.stdout:7/711: chown d2/d21/la0 66281802 1 2024-04-20T21:59:06.564 INFO:tasks.workunit.client.1.smithi164.stdout:6/739: readlink d0/d3/d15/l31 0 2024-04-20T21:59:06.564 INFO:tasks.workunit.client.1.smithi164.stdout:9/756: write d3/db/d1b/d1e/f73 [1673164,14517] 0 2024-04-20T21:59:06.566 INFO:tasks.workunit.client.1.smithi164.stdout:4/665: chown d4/f16 431 1 2024-04-20T21:59:06.567 INFO:tasks.workunit.client.1.smithi164.stdout:5/748: getdents dc/d2c 0 2024-04-20T21:59:06.570 INFO:tasks.workunit.client.1.smithi164.stdout:7/712: read d2/d21/d24/d31/f84 [3600124,90400] 0 2024-04-20T21:59:06.570 INFO:tasks.workunit.client.1.smithi164.stdout:8/629: creat d0/d14/d4e/d62/d8f/dbe/fd8 x:0 0 0 2024-04-20T21:59:06.570 INFO:tasks.workunit.client.1.smithi164.stdout:0/655: creat d1/d4/da/fbf x:0 0 0 2024-04-20T21:59:06.570 INFO:tasks.workunit.client.1.smithi164.stdout:6/740: chown d0/d3/d15/d23/c7e 10326613 1 2024-04-20T21:59:06.571 INFO:tasks.workunit.client.1.smithi164.stdout:5/749: stat dc/d2b/d52/lfe 0 2024-04-20T21:59:06.572 INFO:tasks.workunit.client.1.smithi164.stdout:1/642: write d10/d33/d41/f58 [1945985,123710] 0 2024-04-20T21:59:06.573 INFO:tasks.workunit.client.1.smithi164.stdout:7/713: stat d2/d21/la0 0 2024-04-20T21:59:06.574 INFO:tasks.workunit.client.1.smithi164.stdout:8/630: write d0/f24 [3284558,59364] 0 2024-04-20T21:59:06.575 INFO:tasks.workunit.client.1.smithi164.stdout:1/643: readlink d10/d33/l90 0 2024-04-20T21:59:06.575 INFO:tasks.workunit.client.1.smithi164.stdout:4/666: write d4/d28/d3e/d4a/f9f [365740,6920] 0 2024-04-20T21:59:06.576 INFO:tasks.workunit.client.1.smithi164.stdout:0/656: mknod d1/d4/d20/cc0 0 2024-04-20T21:59:06.581 INFO:tasks.workunit.client.1.smithi164.stdout:7/714: truncate d2/d21/d33/fe5 601272 0 2024-04-20T21:59:06.582 INFO:tasks.workunit.client.1.smithi164.stdout:0/657: chown d1/d4/d20/f40 7 1 2024-04-20T21:59:06.585 INFO:tasks.workunit.client.1.smithi164.stdout:8/631: dread - d0/d14/d4e/d62/d82/d97/f9c zero size 2024-04-20T21:59:06.585 INFO:tasks.workunit.client.1.smithi164.stdout:0/658: chown d1/d2b/f6b 72 1 2024-04-20T21:59:06.586 INFO:tasks.workunit.client.1.smithi164.stdout:0/659: dread - d1/d4/da/d27/f70 zero size 2024-04-20T21:59:06.590 INFO:tasks.workunit.client.1.smithi164.stdout:4/667: truncate d4/f2b 615640 0 2024-04-20T21:59:06.592 INFO:tasks.workunit.client.1.smithi164.stdout:1/644: mkdir d10/d16/d20/d25/d95/dd9 0 2024-04-20T21:59:06.593 INFO:tasks.workunit.client.1.smithi164.stdout:4/668: readlink d4/d28/d3e/d41/laf 0 2024-04-20T21:59:06.595 INFO:tasks.workunit.client.1.smithi164.stdout:6/741: write d0/d3/d15/d23/d45/d69/fa6 [114498,2310] 0 2024-04-20T21:59:06.597 INFO:tasks.workunit.client.1.smithi164.stdout:3/732: dread f9 [0,4194304] 0 2024-04-20T21:59:06.598 INFO:tasks.workunit.client.1.smithi164.stdout:7/715: symlink d2/d21/d24/d31/d3a/d83/d77/lf1 0 2024-04-20T21:59:06.599 INFO:tasks.workunit.client.1.smithi164.stdout:1/645: chown d10/d16/d20/d26/ld2 22692 1 2024-04-20T21:59:06.600 INFO:tasks.workunit.client.1.smithi164.stdout:8/632: mkdir d0/d14/d16/d5a/dd9 0 2024-04-20T21:59:06.602 INFO:tasks.workunit.client.1.smithi164.stdout:0/660: creat d1/d2b/fc1 x:0 0 0 2024-04-20T21:59:06.602 INFO:tasks.workunit.client.1.smithi164.stdout:2/685: dwrite d2/d19/d28/f47 [0,4194304] 0 2024-04-20T21:59:06.603 INFO:tasks.workunit.client.1.smithi164.stdout:7/716: readlink d2/d21/d24/d31/l4a 0 2024-04-20T21:59:06.605 INFO:tasks.workunit.client.1.smithi164.stdout:4/669: creat d4/d9/d5c/d97/dbf/d5f/dcc/fd5 x:0 0 0 2024-04-20T21:59:06.605 INFO:tasks.workunit.client.1.smithi164.stdout:5/750: dwrite dc/d2c/d2e/dbd/df9/f95 [0,4194304] 0 2024-04-20T21:59:06.608 INFO:tasks.workunit.client.1.smithi164.stdout:8/633: write d0/d14/d4e/d62/f5e [1394831,77535] 0 2024-04-20T21:59:06.613 INFO:tasks.workunit.client.1.smithi164.stdout:1/646: unlink d10/d16/d19/d1a/c37 0 2024-04-20T21:59:06.614 INFO:tasks.workunit.client.1.smithi164.stdout:3/733: write d12/d20/d39/d69/dad/fbf [185068,64607] 0 2024-04-20T21:59:06.616 INFO:tasks.workunit.client.1.smithi164.stdout:4/670: unlink d4/d9/l30 0 2024-04-20T21:59:06.616 INFO:tasks.workunit.client.1.smithi164.stdout:9/757: dread d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/f97 [0,4194304] 0 2024-04-20T21:59:06.616 INFO:tasks.workunit.client.1.smithi164.stdout:7/717: mknod d2/d21/cf2 0 2024-04-20T21:59:06.616 INFO:tasks.workunit.client.1.smithi164.stdout:6/742: mknod d0/d3/d11/d29/d6e/db2/df5/cf8 0 2024-04-20T21:59:06.618 INFO:tasks.workunit.client.1.smithi164.stdout:5/751: mkdir dc/d2c/d2e/dbd/df9/d104 0 2024-04-20T21:59:06.620 INFO:tasks.workunit.client.1.smithi164.stdout:0/661: creat d1/d4/da/fc2 x:0 0 0 2024-04-20T21:59:06.622 INFO:tasks.workunit.client.1.smithi164.stdout:4/671: symlink d4/d28/dad/dbd/ld6 0 2024-04-20T21:59:06.625 INFO:tasks.workunit.client.1.smithi164.stdout:4/672: dread - d4/d9/d5c/d97/dbf/f6a zero size 2024-04-20T21:59:06.626 INFO:tasks.workunit.client.1.smithi164.stdout:6/743: mkdir d0/d3/d62/d8e/df9 0 2024-04-20T21:59:06.626 INFO:tasks.workunit.client.1.smithi164.stdout:5/752: rmdir dc/d12/d81 39 2024-04-20T21:59:06.630 INFO:tasks.workunit.client.1.smithi164.stdout:4/673: fdatasync f2 0 2024-04-20T21:59:06.631 INFO:tasks.workunit.client.1.smithi164.stdout:2/686: dwrite d2/d19/d28/f38 [0,4194304] 0 2024-04-20T21:59:06.631 INFO:tasks.workunit.client.1.smithi164.stdout:5/753: read dc/d2c/ff5 [4751419,53914] 0 2024-04-20T21:59:06.632 INFO:tasks.workunit.client.1.smithi164.stdout:3/734: link d12/d6d/f85 d12/d15/fea 0 2024-04-20T21:59:06.632 INFO:tasks.workunit.client.1.smithi164.stdout:7/718: creat d2/d21/d24/d31/d3a/d83/dcf/dea/ff3 x:0 0 0 2024-04-20T21:59:06.633 INFO:tasks.workunit.client.1.smithi164.stdout:6/744: write d0/d3/d15/d23/ff1 [363241,5535] 0 2024-04-20T21:59:06.634 INFO:tasks.workunit.client.1.smithi164.stdout:4/674: read - d4/d28/d3e/d4a/f69 zero size 2024-04-20T21:59:06.637 INFO:tasks.workunit.client.1.smithi164.stdout:6/745: fsync d0/d3/f10 0 2024-04-20T21:59:06.640 INFO:tasks.workunit.client.1.smithi164.stdout:5/754: symlink dc/d2c/d2e/dbd/df9/d104/l105 0 2024-04-20T21:59:06.641 INFO:tasks.workunit.client.1.smithi164.stdout:6/746: fsync d0/d3/d15/f5b 0 2024-04-20T21:59:06.643 INFO:tasks.workunit.client.1.smithi164.stdout:7/719: creat d2/d21/d24/daf/ff4 x:0 0 0 2024-04-20T21:59:06.643 INFO:tasks.workunit.client.1.smithi164.stdout:5/755: fsync dc/f88 0 2024-04-20T21:59:06.645 INFO:tasks.workunit.client.1.smithi164.stdout:6/747: readlink d0/d3/d27/l58 0 2024-04-20T21:59:06.645 INFO:tasks.workunit.client.1.smithi164.stdout:3/735: symlink d12/d20/d39/d69/d77/d81/leb 0 2024-04-20T21:59:06.646 INFO:tasks.workunit.client.1.smithi164.stdout:9/758: dwrite d3/db/dd/d40/d2a/f77 [0,4194304] 0 2024-04-20T21:59:06.647 INFO:tasks.workunit.client.1.smithi164.stdout:5/756: chown dc/d2c/d2e/dbd/df9/d104 38342551 1 2024-04-20T21:59:06.649 INFO:tasks.workunit.client.1.smithi164.stdout:5/757: chown dc/d2b/da0/df8/fff 7354 1 2024-04-20T21:59:06.650 INFO:tasks.workunit.client.1.smithi164.stdout:3/736: chown d12/d20/d39/d69/d77/fb7 414555 1 2024-04-20T21:59:06.651 INFO:tasks.workunit.client.1.smithi164.stdout:5/758: chown dc/d2b/d6d/d73/lf7 49677735 1 2024-04-20T21:59:06.657 INFO:tasks.workunit.client.1.smithi164.stdout:4/675: link d4/fe d4/d28/d3e/d41/fd7 0 2024-04-20T21:59:06.659 INFO:tasks.workunit.client.1.smithi164.stdout:1/647: write d10/d16/d20/f69 [126977,14080] 0 2024-04-20T21:59:06.660 INFO:tasks.workunit.client.1.smithi164.stdout:3/737: symlink d12/d68/d6f/d71/d7d/lec 0 2024-04-20T21:59:06.666 INFO:tasks.workunit.client.1.smithi164.stdout:7/720: link d2/d21/d33/fe5 d2/d21/d24/d31/d3a/d83/dba/ff5 0 2024-04-20T21:59:06.666 INFO:tasks.workunit.client.1.smithi164.stdout:2/687: link d2/c49 d2/d5/d3a/d55/d58/da2/cd4 0 2024-04-20T21:59:06.668 INFO:tasks.workunit.client.1.smithi164.stdout:1/648: fdatasync d10/d16/d20/d81/fb1 0 2024-04-20T21:59:06.669 INFO:tasks.workunit.client.1.smithi164.stdout:3/738: unlink f10 0 2024-04-20T21:59:06.671 INFO:tasks.workunit.client.1.smithi164.stdout:5/759: symlink dc/d12/d1e/da8/dea/l106 0 2024-04-20T21:59:06.672 INFO:tasks.workunit.client.1.smithi164.stdout:3/739: chown d12/d6d/f85 1492 1 2024-04-20T21:59:06.673 INFO:tasks.workunit.client.1.smithi164.stdout:0/662: dread d1/d4/d26/d29/d2d/fa7 [0,4194304] 0 2024-04-20T21:59:06.674 INFO:tasks.workunit.client.1.smithi164.stdout:1/649: write d10/d16/d20/d26/d34/da9/fc3 [85136,41086] 0 2024-04-20T21:59:06.677 INFO:tasks.workunit.client.1.smithi164.stdout:5/760: truncate dc/f24 3554678 0 2024-04-20T21:59:06.681 INFO:tasks.workunit.client.1.smithi164.stdout:2/688: dread d2/d5f/f60 [0,4194304] 0 2024-04-20T21:59:06.681 INFO:tasks.workunit.client.1.smithi164.stdout:3/740: fsync ff 0 2024-04-20T21:59:06.683 INFO:tasks.workunit.client.1.smithi164.stdout:0/663: symlink d1/d4/da/lc3 0 2024-04-20T21:59:06.685 INFO:tasks.workunit.client.1.smithi164.stdout:5/761: symlink dc/d2c/d2e/d30/d8c/l107 0 2024-04-20T21:59:06.686 INFO:tasks.workunit.client.1.smithi164.stdout:6/748: dread d0/d3/d11/d29/d6e/d41/fb7 [0,4194304] 0 2024-04-20T21:59:06.686 INFO:tasks.workunit.client.1.smithi164.stdout:3/741: read f6 [1773885,73467] 0 2024-04-20T21:59:06.688 INFO:tasks.workunit.client.1.smithi164.stdout:7/721: dwrite d2/d21/d24/d31/fe1 [0,4194304] 0 2024-04-20T21:59:06.689 INFO:tasks.workunit.client.1.smithi164.stdout:2/689: creat d2/dab/fd5 x:0 0 0 2024-04-20T21:59:06.692 INFO:tasks.workunit.client.1.smithi164.stdout:9/759: dwrite d3/db/dd/f5d [4194304,4194304] 0 2024-04-20T21:59:06.693 INFO:tasks.workunit.client.1.smithi164.stdout:5/762: mknod dc/d12/d1e/da8/c108 0 2024-04-20T21:59:06.693 INFO:tasks.workunit.client.1.smithi164.stdout:2/690: chown d2/d19/d28/ld2 89409287 1 2024-04-20T21:59:06.695 INFO:tasks.workunit.client.1.smithi164.stdout:7/722: dread - d2/d21/d24/d31/d3a/d83/fbd zero size 2024-04-20T21:59:06.696 INFO:tasks.workunit.client.1.smithi164.stdout:4/676: dread d4/fb [0,4194304] 0 2024-04-20T21:59:06.696 INFO:tasks.workunit.client.1.smithi164.stdout:5/763: chown dc/d2b/d6d/d73/dd6/dfd 8043560 1 2024-04-20T21:59:06.697 INFO:tasks.workunit.client.1.smithi164.stdout:1/650: link d10/f8f d10/d7d/fda 0 2024-04-20T21:59:06.701 INFO:tasks.workunit.client.1.smithi164.stdout:4/677: fdatasync d4/d28/fcf 0 2024-04-20T21:59:06.704 INFO:tasks.workunit.client.1.smithi164.stdout:0/664: unlink d1/d4/df/d56/l71 0 2024-04-20T21:59:06.704 INFO:tasks.workunit.client.1.smithi164.stdout:8/634: sync 2024-04-20T21:59:06.704 INFO:tasks.workunit.client.1.smithi164.stdout:8/635: stat d0/f19 0 2024-04-20T21:59:06.706 INFO:tasks.workunit.client.1.smithi164.stdout:8/636: chown d0/f48 37886 1 2024-04-20T21:59:06.709 INFO:tasks.workunit.client.1.smithi164.stdout:7/723: stat d2/d21/f35 0 2024-04-20T21:59:06.714 INFO:tasks.workunit.client.1.smithi164.stdout:5/764: rmdir dc/d2b/da0/df8 39 2024-04-20T21:59:06.717 INFO:tasks.workunit.client.1.smithi164.stdout:1/651: dread d10/d16/fc9 [0,4194304] 0 2024-04-20T21:59:06.719 INFO:tasks.workunit.client.1.smithi164.stdout:5/765: dread dc/d2c/d2e/d30/d72/fdf [0,4194304] 0 2024-04-20T21:59:06.719 INFO:tasks.workunit.client.1.smithi164.stdout:4/678: unlink d4/d28/d3e/d41/l46 0 2024-04-20T21:59:06.719 INFO:tasks.workunit.client.1.smithi164.stdout:1/652: write d10/d16/d20/d26/d34/f89 [4551428,60512] 0 2024-04-20T21:59:06.724 INFO:tasks.workunit.client.1.smithi164.stdout:8/637: rmdir d0/d14/d4e 39 2024-04-20T21:59:06.730 INFO:tasks.workunit.client.1.smithi164.stdout:3/742: dwrite d12/d20/d39/f3c [0,4194304] 0 2024-04-20T21:59:06.732 INFO:tasks.workunit.client.1.smithi164.stdout:3/743: chown f6 3161757 1 2024-04-20T21:59:06.735 INFO:tasks.workunit.client.1.smithi164.stdout:3/744: dread - d12/d20/d39/d55/d87/fd4 zero size 2024-04-20T21:59:06.735 INFO:tasks.workunit.client.1.smithi164.stdout:9/760: dread d3/db/dd/f6b [0,4194304] 0 2024-04-20T21:59:06.735 INFO:tasks.workunit.client.1.smithi164.stdout:5/766: dwrite dc/d2c/d2e/d30/f89 [0,4194304] 0 2024-04-20T21:59:06.737 INFO:tasks.workunit.client.1.smithi164.stdout:9/761: read - d3/db/dc4/fff zero size 2024-04-20T21:59:06.739 INFO:tasks.workunit.client.1.smithi164.stdout:6/749: write d0/d3/d15/d23/d45/d4f/f70 [1487232,58950] 0 2024-04-20T21:59:06.744 INFO:tasks.workunit.client.1.smithi164.stdout:8/638: mknod d0/d1e/cda 0 2024-04-20T21:59:06.747 INFO:tasks.workunit.client.1.smithi164.stdout:8/639: read d0/f50 [73815,58969] 0 2024-04-20T21:59:06.749 INFO:tasks.workunit.client.1.smithi164.stdout:3/745: mknod d12/d20/d39/dac/ced 0 2024-04-20T21:59:06.752 INFO:tasks.workunit.client.1.smithi164.stdout:2/691: dread d2/d5/d3a/f3b [0,4194304] 0 2024-04-20T21:59:06.754 INFO:tasks.workunit.client.1.smithi164.stdout:9/762: creat d3/db/dd/d40/d78/f10c x:0 0 0 2024-04-20T21:59:06.756 INFO:tasks.workunit.client.1.smithi164.stdout:9/763: chown d3/db/d1b/d20/d3f/l6e 7955657 1 2024-04-20T21:59:06.759 INFO:tasks.workunit.client.1.smithi164.stdout:6/750: rename d0/d3/d11/d29/d6e/l84 to d0/d3/d15/d21/d5c/lfa 0 2024-04-20T21:59:06.765 INFO:tasks.workunit.client.1.smithi164.stdout:5/767: dwrite dc/d2c/d2e/d30/d72/fdf [0,4194304] 0 2024-04-20T21:59:06.768 INFO:tasks.workunit.client.1.smithi164.stdout:5/768: dread - dc/d2b/d52/fd5 zero size 2024-04-20T21:59:06.769 INFO:tasks.workunit.client.1.smithi164.stdout:7/724: truncate d2/d21/d24/d31/f7b 1789222 0 2024-04-20T21:59:06.771 INFO:tasks.workunit.client.1.smithi164.stdout:2/692: fdatasync d2/d5/d3a/d55/f69 0 2024-04-20T21:59:06.773 INFO:tasks.workunit.client.1.smithi164.stdout:9/764: dwrite d3/db/dd/d40/d2a/d36/d51/f9b [0,4194304] 0 2024-04-20T21:59:06.776 INFO:tasks.workunit.client.1.smithi164.stdout:1/653: dwrite d10/d33/f75 [0,4194304] 0 2024-04-20T21:59:06.776 INFO:tasks.workunit.client.1.smithi164.stdout:2/693: chown d2/d19/d28/d3e/d9e/fc8 1747666 1 2024-04-20T21:59:06.779 INFO:tasks.workunit.client.1.smithi164.stdout:2/694: fdatasync d2/d30/d84/f93 0 2024-04-20T21:59:06.783 INFO:tasks.workunit.client.1.smithi164.stdout:3/746: dread d12/d15/f47 [0,4194304] 0 2024-04-20T21:59:06.783 INFO:tasks.workunit.client.1.smithi164.stdout:6/751: creat d0/d3/d27/d9d/dc3/ffb x:0 0 0 2024-04-20T21:59:06.786 INFO:tasks.workunit.client.1.smithi164.stdout:6/752: dread - d0/d3/d62/d8e/fdc zero size 2024-04-20T21:59:06.790 INFO:tasks.workunit.client.1.smithi164.stdout:8/640: write d0/f4b [268718,86353] 0 2024-04-20T21:59:06.792 INFO:tasks.workunit.client.1.smithi164.stdout:9/765: dread d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/f97 [0,4194304] 0 2024-04-20T21:59:06.792 INFO:tasks.workunit.client.1.smithi164.stdout:4/679: getdents d4/d9/d22/db5 0 2024-04-20T21:59:06.794 INFO:tasks.workunit.client.1.smithi164.stdout:9/766: readlink d3/db/dd/d40/d78/d86/la4 0 2024-04-20T21:59:06.794 INFO:tasks.workunit.client.1.smithi164.stdout:0/665: sync 2024-04-20T21:59:06.796 INFO:tasks.workunit.client.1.smithi164.stdout:7/725: creat d2/d21/d24/d31/d3a/ff6 x:0 0 0 2024-04-20T21:59:06.798 INFO:tasks.workunit.client.1.smithi164.stdout:7/726: chown d2/d21/d24/d31/d3a/c5b 2229499 1 2024-04-20T21:59:06.799 INFO:tasks.workunit.client.1.smithi164.stdout:9/767: truncate d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/ff4 335383 0 2024-04-20T21:59:06.802 INFO:tasks.workunit.client.1.smithi164.stdout:6/753: creat d0/d3/d15/d21/db1/ffc x:0 0 0 2024-04-20T21:59:06.802 INFO:tasks.workunit.client.1.smithi164.stdout:7/727: write d2/d21/d24/d31/d3a/d83/d77/fdc [484436,120145] 0 2024-04-20T21:59:06.804 INFO:tasks.workunit.client.1.smithi164.stdout:7/728: chown d2/d21/d24/f57 241051 1 2024-04-20T21:59:06.805 INFO:tasks.workunit.client.1.smithi164.stdout:4/680: creat d4/d9/d27/d37/fd8 x:0 0 0 2024-04-20T21:59:06.808 INFO:tasks.workunit.client.1.smithi164.stdout:2/695: mkdir d2/d5/d3a/d65/d81/dac/dd6 0 2024-04-20T21:59:06.810 INFO:tasks.workunit.client.1.smithi164.stdout:3/747: symlink d12/d20/d39/ddc/lee 0 2024-04-20T21:59:06.811 INFO:tasks.workunit.client.1.smithi164.stdout:3/748: write d12/d15/f24 [707921,73263] 0 2024-04-20T21:59:06.821 INFO:tasks.workunit.client.1.smithi164.stdout:0/666: mknod d1/d4/d26/d29/d2d/cc4 0 2024-04-20T21:59:06.822 INFO:tasks.workunit.client.1.smithi164.stdout:4/681: truncate d4/d9/f17 1004385 0 2024-04-20T21:59:06.826 INFO:tasks.workunit.client.1.smithi164.stdout:8/641: symlink d0/d14/d4e/ldb 0 2024-04-20T21:59:06.828 INFO:tasks.workunit.client.1.smithi164.stdout:4/682: read d4/d28/d3e/d41/f6e [27934,110001] 0 2024-04-20T21:59:06.828 INFO:tasks.workunit.client.1.smithi164.stdout:0/667: dread d1/d4/da/d27/f90 [0,4194304] 0 2024-04-20T21:59:06.830 INFO:tasks.workunit.client.1.smithi164.stdout:5/769: getdents dc/d12/d1e/da8 0 2024-04-20T21:59:06.831 INFO:tasks.workunit.client.1.smithi164.stdout:1/654: dwrite d10/d33/fc0 [0,4194304] 0 2024-04-20T21:59:06.831 INFO:tasks.workunit.client.1.smithi164.stdout:2/696: symlink d2/d19/d28/d3e/d9e/ld7 0 2024-04-20T21:59:06.834 INFO:tasks.workunit.client.1.smithi164.stdout:9/768: dread d3/f95 [0,4194304] 0 2024-04-20T21:59:06.837 INFO:tasks.workunit.client.1.smithi164.stdout:4/683: mkdir d4/d9/d5c/d97/dd9 0 2024-04-20T21:59:06.841 INFO:tasks.workunit.client.1.smithi164.stdout:5/770: symlink dc/d12/d1e/def/l109 0 2024-04-20T21:59:06.843 INFO:tasks.workunit.client.1.smithi164.stdout:5/771: stat dc/d12/f8e 0 2024-04-20T21:59:06.843 INFO:tasks.workunit.client.1.smithi164.stdout:6/754: dwrite d0/fc9 [0,4194304] 0 2024-04-20T21:59:06.844 INFO:tasks.workunit.client.1.smithi164.stdout:4/684: dread - d4/d9/d5c/d97/dbf/d5f/f8a zero size 2024-04-20T21:59:06.844 INFO:tasks.workunit.client.1.smithi164.stdout:7/729: truncate d2/f5f 2903702 0 2024-04-20T21:59:06.846 INFO:tasks.workunit.client.1.smithi164.stdout:5/772: chown dc/d12/d1e/d101 2 1 2024-04-20T21:59:06.848 INFO:tasks.workunit.client.1.smithi164.stdout:7/730: dread - d2/d21/d24/d31/d3a/d83/fbd zero size 2024-04-20T21:59:06.849 INFO:tasks.workunit.client.1.smithi164.stdout:4/685: write d4/d28/d3e/fae [941761,110765] 0 2024-04-20T21:59:06.853 INFO:tasks.workunit.client.1.smithi164.stdout:3/749: link d12/d15/c4e d12/d20/d39/dac/cef 0 2024-04-20T21:59:06.863 INFO:tasks.workunit.client.1.smithi164.stdout:0/668: dread d1/d2b/f66 [0,4194304] 0 2024-04-20T21:59:06.868 INFO:tasks.workunit.client.1.smithi164.stdout:4/686: dwrite d4/f39 [0,4194304] 0 2024-04-20T21:59:06.868 INFO:tasks.workunit.client.1.smithi164.stdout:5/773: mkdir dc/d2c/d2e/d30/d72/da9/d10a 0 2024-04-20T21:59:06.871 INFO:tasks.workunit.client.1.smithi164.stdout:4/687: read d4/d28/f76 [1535252,52069] 0 2024-04-20T21:59:06.871 INFO:tasks.workunit.client.1.smithi164.stdout:8/642: dread d0/f19 [0,4194304] 0 2024-04-20T21:59:06.873 INFO:tasks.workunit.client.1.smithi164.stdout:9/769: dread d3/db/dd/d40/d2a/d36/d51/f68 [0,4194304] 0 2024-04-20T21:59:06.873 INFO:tasks.workunit.client.1.smithi164.stdout:1/655: creat d10/d16/fdb x:0 0 0 2024-04-20T21:59:06.878 INFO:tasks.workunit.client.1.smithi164.stdout:0/669: unlink d1/d4/d20/d74/f63 0 2024-04-20T21:59:06.881 INFO:tasks.workunit.client.1.smithi164.stdout:2/697: getdents d2/d5/d3a/d65 0 2024-04-20T21:59:06.883 INFO:tasks.workunit.client.1.smithi164.stdout:2/698: readlink d2/d5/d3a/l89 0 2024-04-20T21:59:06.885 INFO:tasks.workunit.client.1.smithi164.stdout:1/656: symlink d10/d16/d20/d26/ldc 0 2024-04-20T21:59:06.885 INFO:tasks.workunit.client.1.smithi164.stdout:6/755: link d0/l51 d0/d3/d15/d21/d4b/lfd 0 2024-04-20T21:59:06.887 INFO:tasks.workunit.client.1.smithi164.stdout:8/643: dwrite d0/d14/d4e/f96 [0,4194304] 0 2024-04-20T21:59:06.889 INFO:tasks.workunit.client.1.smithi164.stdout:7/731: write d2/f48 [2127416,21199] 0 2024-04-20T21:59:06.890 INFO:tasks.workunit.client.1.smithi164.stdout:6/756: read d0/d3/d15/d23/d45/d69/f8d [775212,17659] 0 2024-04-20T21:59:06.890 INFO:tasks.workunit.client.1.smithi164.stdout:4/688: dwrite d4/d9/d5c/d97/dbf/d67/fc1 [0,4194304] 0 2024-04-20T21:59:06.892 INFO:tasks.workunit.client.1.smithi164.stdout:3/750: creat d12/d20/d39/d55/d6b/ff0 x:0 0 0 2024-04-20T21:59:06.893 INFO:tasks.workunit.client.1.smithi164.stdout:4/689: chown d4/d9/d5c/d97/dd9 129900 1 2024-04-20T21:59:06.900 INFO:tasks.workunit.client.1.smithi164.stdout:5/774: link dc/d2b/d6d/d73/leb dc/d2b/d6d/d73/dd6/dfd/dec/l10b 0 2024-04-20T21:59:06.902 INFO:tasks.workunit.client.1.smithi164.stdout:6/757: truncate d0/d3/d15/d21/d5c/dbf/dbd/ddf/d28/f99 173201 0 2024-04-20T21:59:06.904 INFO:tasks.workunit.client.1.smithi164.stdout:5/775: chown dc/d2c/d2e/d30/cee 1312265776 1 2024-04-20T21:59:06.906 INFO:tasks.workunit.client.1.smithi164.stdout:9/770: link d3/db/d1b/d20/d3f/dc7/ce4 d3/db0/de0/c10d 0 2024-04-20T21:59:06.909 INFO:tasks.workunit.client.1.smithi164.stdout:8/644: dread d0/d14/d4e/d62/fcc [0,4194304] 0 2024-04-20T21:59:06.909 INFO:tasks.workunit.client.1.smithi164.stdout:9/771: stat d3/db/dd/d40/f56 0 2024-04-20T21:59:06.910 INFO:tasks.workunit.client.1.smithi164.stdout:8/645: chown d0/d14/d5f/f7a 2998 1 2024-04-20T21:59:06.911 INFO:tasks.workunit.client.1.smithi164.stdout:2/699: creat d2/d5/d3a/d65/d81/dac/dd6/fd8 x:0 0 0 2024-04-20T21:59:06.912 INFO:tasks.workunit.client.1.smithi164.stdout:0/670: write d1/d4/da/f64 [5072054,99046] 0 2024-04-20T21:59:06.915 INFO:tasks.workunit.client.1.smithi164.stdout:1/657: dwrite d10/d16/d20/d25/fad [0,4194304] 0 2024-04-20T21:59:06.915 INFO:tasks.workunit.client.1.smithi164.stdout:8/646: chown d0/d14/d4e/d62/d8f/dbe/fd8 25713134 1 2024-04-20T21:59:06.920 INFO:tasks.workunit.client.1.smithi164.stdout:6/758: symlink d0/d3/d27/d9d/dc3/lfe 0 2024-04-20T21:59:06.920 INFO:tasks.workunit.client.1.smithi164.stdout:4/690: symlink d4/d9/d5c/d97/dd9/lda 0 2024-04-20T21:59:06.920 INFO:tasks.workunit.client.1.smithi164.stdout:8/647: chown d0/d14/d4e/d6f 1707957971 1 2024-04-20T21:59:06.926 INFO:tasks.workunit.client.1.smithi164.stdout:7/732: link d2/d21/d44/l99 d2/d21/d24/d31/d3a/d83/lf7 0 2024-04-20T21:59:06.927 INFO:tasks.workunit.client.1.smithi164.stdout:2/700: mknod d2/d5/d3a/d55/d58/db8/cd9 0 2024-04-20T21:59:06.929 INFO:tasks.workunit.client.1.smithi164.stdout:1/658: symlink d10/d16/d20/d91/d9d/ldd 0 2024-04-20T21:59:06.930 INFO:tasks.workunit.client.1.smithi164.stdout:7/733: chown d2/l43 29404 1 2024-04-20T21:59:06.932 INFO:tasks.workunit.client.1.smithi164.stdout:5/776: dwrite dc/d2c/d2e/d30/d72/fd8 [0,4194304] 0 2024-04-20T21:59:06.940 INFO:tasks.workunit.client.1.smithi164.stdout:7/734: dread - d2/d21/d44/fb1 zero size 2024-04-20T21:59:06.942 INFO:tasks.workunit.client.1.smithi164.stdout:5/777: mkdir dc/d2b/d6d/d73/dab/d10c 0 2024-04-20T21:59:06.948 INFO:tasks.workunit.client.1.smithi164.stdout:2/701: rename d2/d5/f11 to d2/d5/d3a/d65/d81/fda 0 2024-04-20T21:59:06.948 INFO:tasks.workunit.client.1.smithi164.stdout:1/659: creat d10/d16/d19/d1a/fde x:0 0 0 2024-04-20T21:59:06.949 INFO:tasks.workunit.client.1.smithi164.stdout:8/648: dwrite d0/d14/d5f/f7a [0,4194304] 0 2024-04-20T21:59:06.949 INFO:tasks.workunit.client.1.smithi164.stdout:4/691: write d4/d9/d5c/d97/dbf/d9b/fa7 [374507,19393] 0 2024-04-20T21:59:06.952 INFO:tasks.workunit.client.1.smithi164.stdout:0/671: dwrite d1/d4/d49/f5f [0,4194304] 0 2024-04-20T21:59:06.954 INFO:tasks.workunit.client.1.smithi164.stdout:7/735: write d2/d21/d24/d31/d3a/daa/fcc [1108802,30690] 0 2024-04-20T21:59:06.956 INFO:tasks.workunit.client.1.smithi164.stdout:3/751: dwrite d12/d20/d39/d55/d6b/f80 [0,4194304] 0 2024-04-20T21:59:06.957 INFO:tasks.workunit.client.1.smithi164.stdout:1/660: chown d10/d16/d20/d26/d34/da9/fd3 302263 1 2024-04-20T21:59:06.958 INFO:tasks.workunit.client.1.smithi164.stdout:0/672: write d1/d4/d49/f5f [2322257,75813] 0 2024-04-20T21:59:06.962 INFO:tasks.workunit.client.1.smithi164.stdout:3/752: write d12/d6d/fa9 [536858,95346] 0 2024-04-20T21:59:06.962 INFO:tasks.workunit.client.1.smithi164.stdout:9/772: dwrite d3/db/d1b/f8f [0,4194304] 0 2024-04-20T21:59:06.967 INFO:tasks.workunit.client.1.smithi164.stdout:4/692: chown d4/d28/dad/l88 0 1 2024-04-20T21:59:06.977 INFO:tasks.workunit.client.1.smithi164.stdout:1/661: dread d10/d33/f46 [0,4194304] 0 2024-04-20T21:59:06.980 INFO:tasks.workunit.client.1.smithi164.stdout:8/649: symlink d0/d14/d4e/d62/d82/d97/ldc 0 2024-04-20T21:59:06.981 INFO:tasks.workunit.client.1.smithi164.stdout:8/650: stat d0/d14/d16/c47 0 2024-04-20T21:59:06.982 INFO:tasks.workunit.client.1.smithi164.stdout:2/702: dwrite d2/d5/fca [0,4194304] 0 2024-04-20T21:59:06.984 INFO:tasks.workunit.client.1.smithi164.stdout:9/773: creat d3/db/d82/d98/db6/f10e x:0 0 0 2024-04-20T21:59:06.984 INFO:tasks.workunit.client.1.smithi164.stdout:4/693: mknod d4/d28/d3e/d41/cdb 0 2024-04-20T21:59:06.985 INFO:tasks.workunit.client.1.smithi164.stdout:5/778: write dc/d41/f50 [961050,21900] 0 2024-04-20T21:59:06.987 INFO:tasks.workunit.client.1.smithi164.stdout:3/753: mkdir d12/d20/d39/d69/dad/de2/df1 0 2024-04-20T21:59:06.989 INFO:tasks.workunit.client.1.smithi164.stdout:4/694: chown d4/d28/dad/dbd/ld6 5 1 2024-04-20T21:59:06.990 INFO:tasks.workunit.client.1.smithi164.stdout:9/774: stat d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/fad 0 2024-04-20T21:59:06.990 INFO:tasks.workunit.client.1.smithi164.stdout:5/779: dread - dc/d2b/d52/fd5 zero size 2024-04-20T21:59:06.992 INFO:tasks.workunit.client.1.smithi164.stdout:9/775: readlink d3/db0/dc0/l104 0 2024-04-20T21:59:06.995 INFO:tasks.workunit.client.1.smithi164.stdout:5/780: write dc/d2c/d2e/d30/d8c/fd2 [658308,21957] 0 2024-04-20T21:59:06.996 INFO:tasks.workunit.client.1.smithi164.stdout:4/695: stat d4/d9/d5c/l71 0 2024-04-20T21:59:06.997 INFO:tasks.workunit.client.1.smithi164.stdout:2/703: chown d2/d19/d28/d3e/d9e/cd1 454 1 2024-04-20T21:59:06.998 INFO:tasks.workunit.client.1.smithi164.stdout:9/776: creat d3/db/dd/d40/d78/d86/f10f x:0 0 0 2024-04-20T21:59:06.999 INFO:tasks.workunit.client.1.smithi164.stdout:8/651: rename d0/d14/l67 to d0/d14/d16/ldd 0 2024-04-20T21:59:07.001 INFO:tasks.workunit.client.1.smithi164.stdout:5/781: symlink dc/d2b/d6d/l10d 0 2024-04-20T21:59:07.003 INFO:tasks.workunit.client.1.smithi164.stdout:3/754: rename d12/d6d/f85 to d12/d20/d39/dac/ff2 0 2024-04-20T21:59:07.005 INFO:tasks.workunit.client.1.smithi164.stdout:7/736: dwrite d2/d21/d24/f57 [0,4194304] 0 2024-04-20T21:59:07.009 INFO:tasks.workunit.client.1.smithi164.stdout:6/759: sync 2024-04-20T21:59:07.011 INFO:tasks.workunit.client.1.smithi164.stdout:4/696: mknod d4/d9/d27/cdc 0 2024-04-20T21:59:07.012 INFO:tasks.workunit.client.1.smithi164.stdout:0/673: write d1/f8 [5967135,109083] 0 2024-04-20T21:59:07.015 INFO:tasks.workunit.client.1.smithi164.stdout:0/674: readlink d1/d4/d26/d29/l7f 0 2024-04-20T21:59:07.022 INFO:tasks.workunit.client.1.smithi164.stdout:2/704: getdents d2/d19/d28 0 2024-04-20T21:59:07.023 INFO:tasks.workunit.client.1.smithi164.stdout:6/760: write d0/d3/d15/d21/d4b/fee [636215,83431] 0 2024-04-20T21:59:07.031 INFO:tasks.workunit.client.1.smithi164.stdout:9/777: dwrite d3/db/dd/d40/d2a/fd2 [0,4194304] 0 2024-04-20T21:59:07.031 INFO:tasks.workunit.client.1.smithi164.stdout:2/705: chown d2/d19/f80 227279 1 2024-04-20T21:59:07.038 INFO:tasks.workunit.client.1.smithi164.stdout:2/706: stat d2/d30/laa 0 2024-04-20T21:59:07.040 INFO:tasks.workunit.client.1.smithi164.stdout:3/755: dwrite d12/d15/f1c [4194304,4194304] 0 2024-04-20T21:59:07.045 INFO:tasks.workunit.client.1.smithi164.stdout:1/662: dwrite d10/d16/f7b [0,4194304] 0 2024-04-20T21:59:07.045 INFO:tasks.workunit.client.1.smithi164.stdout:5/782: dwrite dc/d2c/d2e/d30/d72/fdf [4194304,4194304] 0 2024-04-20T21:59:07.045 INFO:tasks.workunit.client.1.smithi164.stdout:0/675: write d1/d4/da/d27/f90 [201316,59794] 0 2024-04-20T21:59:07.049 INFO:tasks.workunit.client.1.smithi164.stdout:9/778: symlink d3/db0/de0/l110 0 2024-04-20T21:59:07.056 INFO:tasks.workunit.client.1.smithi164.stdout:8/652: dwrite d0/d14/d16/f70 [0,4194304] 0 2024-04-20T21:59:07.065 INFO:tasks.workunit.client.1.smithi164.stdout:7/737: dread d2/d21/f45 [0,4194304] 0 2024-04-20T21:59:07.068 INFO:tasks.workunit.client.1.smithi164.stdout:1/663: dread - d10/d8a/fa2 zero size 2024-04-20T21:59:07.072 INFO:tasks.workunit.client.1.smithi164.stdout:1/664: write d10/d33/fcf [870185,63694] 0 2024-04-20T21:59:07.074 INFO:tasks.workunit.client.1.smithi164.stdout:0/676: dwrite d1/d4/da/d27/f7c [0,4194304] 0 2024-04-20T21:59:07.074 INFO:tasks.workunit.client.1.smithi164.stdout:6/761: creat d0/d3/d15/d23/d45/d4f/d61/fff x:0 0 0 2024-04-20T21:59:07.075 INFO:tasks.workunit.client.1.smithi164.stdout:2/707: symlink d2/d5/d3a/d55/d58/db8/ldb 0 2024-04-20T21:59:07.079 INFO:tasks.workunit.client.1.smithi164.stdout:5/783: write dc/d2c/d2e/dbd/df9/ffc [963953,48188] 0 2024-04-20T21:59:07.081 INFO:tasks.workunit.client.1.smithi164.stdout:8/653: fdatasync d0/d1e/f88 0 2024-04-20T21:59:07.084 INFO:tasks.workunit.client.1.smithi164.stdout:8/654: chown d0/d14/d4e/d62/d82/d97/f9c 1251 1 2024-04-20T21:59:07.086 INFO:tasks.workunit.client.1.smithi164.stdout:2/708: dread d2/d5/d21/f4f [0,4194304] 0 2024-04-20T21:59:07.087 INFO:tasks.workunit.client.1.smithi164.stdout:3/756: creat d12/ff3 x:0 0 0 2024-04-20T21:59:07.089 INFO:tasks.workunit.client.1.smithi164.stdout:3/757: chown d12/d20/d39/l59 223 1 2024-04-20T21:59:07.091 INFO:tasks.workunit.client.1.smithi164.stdout:1/665: creat d10/d16/d20/d25/fdf x:0 0 0 2024-04-20T21:59:07.092 INFO:tasks.workunit.client.1.smithi164.stdout:0/677: rmdir d1/d4/d26/d29 39 2024-04-20T21:59:07.099 INFO:tasks.workunit.client.1.smithi164.stdout:9/779: rename d3/db/dd/d40/d78/d86/fb3 to d3/db/dd/d75/f111 0 2024-04-20T21:59:07.101 INFO:tasks.workunit.client.1.smithi164.stdout:7/738: symlink d2/d21/d24/d31/d3a/d83/d63/d85/dbe/lf8 0 2024-04-20T21:59:07.101 INFO:tasks.workunit.client.1.smithi164.stdout:3/758: unlink f9 0 2024-04-20T21:59:07.104 INFO:tasks.workunit.client.1.smithi164.stdout:5/784: truncate dc/d2b/da0/ffb 2516409 0 2024-04-20T21:59:07.107 INFO:tasks.workunit.client.1.smithi164.stdout:2/709: rename d2/d5/d3a/d65/la0 to d2/dab/db3/ldc 0 2024-04-20T21:59:07.109 INFO:tasks.workunit.client.1.smithi164.stdout:1/666: dwrite d10/d16/d19/d1a/fde [0,4194304] 0 2024-04-20T21:59:07.109 INFO:tasks.workunit.client.1.smithi164.stdout:2/710: chown d2/d5/d3a/d65/d81/dac 18 1 2024-04-20T21:59:07.110 INFO:tasks.workunit.client.1.smithi164.stdout:9/780: unlink d3/db/dd/d40/d2a/d36/d51/fc5 0 2024-04-20T21:59:07.110 INFO:tasks.workunit.client.1.smithi164.stdout:0/678: rmdir d1/d4/da/d5c/d6e 39 2024-04-20T21:59:07.113 INFO:tasks.workunit.client.1.smithi164.stdout:7/739: symlink d2/d21/d24/d31/d3a/d83/dcf/dea/lf9 0 2024-04-20T21:59:07.113 INFO:tasks.workunit.client.1.smithi164.stdout:1/667: write d10/d16/d20/d26/d34/da9/f92 [448082,71479] 0 2024-04-20T21:59:07.115 INFO:tasks.workunit.client.1.smithi164.stdout:5/785: read - dc/d2c/d2e/d30/f74 zero size 2024-04-20T21:59:07.116 INFO:tasks.workunit.client.1.smithi164.stdout:6/762: dread d0/f25 [4194304,4194304] 0 2024-04-20T21:59:07.119 INFO:tasks.workunit.client.1.smithi164.stdout:5/786: readlink dc/d12/d1e/l3a 0 2024-04-20T21:59:07.120 INFO:tasks.workunit.client.1.smithi164.stdout:9/781: symlink d3/db/dd/l112 0 2024-04-20T21:59:07.123 INFO:tasks.workunit.client.1.smithi164.stdout:3/759: symlink d12/d20/d39/d55/d6b/d79/dcc/lf4 0 2024-04-20T21:59:07.125 INFO:tasks.workunit.client.1.smithi164.stdout:6/763: mkdir d0/d3/d15/d21/d100 0 2024-04-20T21:59:07.125 INFO:tasks.workunit.client.1.smithi164.stdout:0/679: dread d1/d4/df/f3b [0,4194304] 0 2024-04-20T21:59:07.129 INFO:tasks.workunit.client.1.smithi164.stdout:6/764: chown d0/d3/d15/f5b 1699562 1 2024-04-20T21:59:07.129 INFO:tasks.workunit.client.1.smithi164.stdout:3/760: truncate d12/d20/d39/d69/d83/fb6 455095 0 2024-04-20T21:59:07.132 INFO:tasks.workunit.client.1.smithi164.stdout:5/787: unlink dc/d12/d81/f68 0 2024-04-20T21:59:07.134 INFO:tasks.workunit.client.1.smithi164.stdout:3/761: chown d12/d20/d39/d55/c5c 2 1 2024-04-20T21:59:07.134 INFO:tasks.workunit.client.1.smithi164.stdout:0/680: dread d1/d2b/f66 [0,4194304] 0 2024-04-20T21:59:07.135 INFO:tasks.workunit.client.1.smithi164.stdout:6/765: truncate d0/d3/d27/fd3 5145790 0 2024-04-20T21:59:07.135 INFO:tasks.workunit.client.1.smithi164.stdout:5/788: readlink dc/d2c/d2e/d30/d5e/l61 0 2024-04-20T21:59:07.138 INFO:tasks.workunit.client.1.smithi164.stdout:9/782: dread d3/db/dd/d40/d2a/fd2 [0,4194304] 0 2024-04-20T21:59:07.141 INFO:tasks.workunit.client.1.smithi164.stdout:3/762: read d12/d20/d39/d69/d77/d81/fbb [484059,54418] 0 2024-04-20T21:59:07.142 INFO:tasks.workunit.client.1.smithi164.stdout:0/681: mkdir d1/dc5 0 2024-04-20T21:59:07.142 INFO:tasks.workunit.client.1.smithi164.stdout:1/668: dwrite d10/f9e [0,4194304] 0 2024-04-20T21:59:07.147 INFO:tasks.workunit.client.1.smithi164.stdout:6/766: rmdir d0/d3/d15/d23/d3b 39 2024-04-20T21:59:07.148 INFO:tasks.workunit.client.1.smithi164.stdout:9/783: chown d3/db0/dd3/fe2 29730467 1 2024-04-20T21:59:07.150 INFO:tasks.workunit.client.1.smithi164.stdout:7/740: dread d2/f8e [0,4194304] 0 2024-04-20T21:59:07.150 INFO:tasks.workunit.client.1.smithi164.stdout:3/763: rmdir d12/d68/d6f/d71/d7d 39 2024-04-20T21:59:07.154 INFO:tasks.workunit.client.1.smithi164.stdout:9/784: fsync d3/db/d1b/d1e/f9d 0 2024-04-20T21:59:07.158 INFO:tasks.workunit.client.1.smithi164.stdout:3/764: dread - d12/d68/d6f/d71/d7d/fab zero size 2024-04-20T21:59:07.162 INFO:tasks.workunit.client.1.smithi164.stdout:0/682: dwrite d1/d4/d26/f76 [0,4194304] 0 2024-04-20T21:59:07.165 INFO:tasks.workunit.client.1.smithi164.stdout:9/785: dread d3/db/d1b/d1e/f3b [0,4194304] 0 2024-04-20T21:59:07.167 INFO:tasks.workunit.client.1.smithi164.stdout:1/669: rename d10/d16/d20/d26 to d10/d16/d19/de0 0 2024-04-20T21:59:07.170 INFO:tasks.workunit.client.1.smithi164.stdout:2/711: dwrite d2/d5f/fa9 [0,4194304] 0 2024-04-20T21:59:07.177 INFO:tasks.workunit.client.1.smithi164.stdout:0/683: fsync d1/d4/d20/f40 0 2024-04-20T21:59:07.186 INFO:tasks.workunit.client.1.smithi164.stdout:9/786: symlink d3/db/dc4/l113 0 2024-04-20T21:59:07.189 INFO:tasks.workunit.client.1.smithi164.stdout:1/670: symlink d10/d8a/le1 0 2024-04-20T21:59:07.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:06 smithi164 ceph-mon[23506]: mgrmap e30: smithi142.zzmcfz(active, since 15s), standbys: smithi164.oejajr 2024-04-20T21:59:07.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:06 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr metadata", "who": "smithi164.oejajr", "id": "smithi164.oejajr"}]: dispatch 2024-04-20T21:59:07.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:06 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:59:07.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:06 smithi142 ceph-mon[15828]: mgrmap e30: smithi142.zzmcfz(active, since 15s), standbys: smithi164.oejajr 2024-04-20T21:59:07.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:06 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr metadata", "who": "smithi164.oejajr", "id": "smithi164.oejajr"}]: dispatch 2024-04-20T21:59:07.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:06 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:59:07.198 INFO:tasks.workunit.client.1.smithi164.stdout:2/712: creat d2/d5/d3a/d55/d58/da2/dcc/fdd x:0 0 0 2024-04-20T21:59:07.202 INFO:tasks.workunit.client.1.smithi164.stdout:2/713: dread - d2/d5/d3a/d55/d58/db8/fcf zero size 2024-04-20T21:59:07.204 INFO:tasks.workunit.client.1.smithi164.stdout:2/714: readlink d2/d5/d3a/d55/d58/lc6 0 2024-04-20T21:59:07.206 INFO:tasks.workunit.client.1.smithi164.stdout:0/684: creat d1/d4/d26/d29/d2d/d54/d77/db3/fc6 x:0 0 0 2024-04-20T21:59:07.207 INFO:tasks.workunit.client.1.smithi164.stdout:5/789: truncate dc/d2b/d53/f96 679990 0 2024-04-20T21:59:07.209 INFO:tasks.workunit.client.1.smithi164.stdout:0/685: readlink d1/d4/d26/d29/l7f 0 2024-04-20T21:59:07.210 INFO:tasks.workunit.client.1.smithi164.stdout:7/741: write d2/d21/d24/d31/f7b [2484526,17325] 0 2024-04-20T21:59:07.213 INFO:tasks.workunit.client.1.smithi164.stdout:7/742: truncate d2/f73 5032002 0 2024-04-20T21:59:07.218 INFO:tasks.workunit.client.1.smithi164.stdout:1/671: mknod d10/ce2 0 2024-04-20T21:59:07.227 INFO:tasks.workunit.client.1.smithi164.stdout:7/743: read d2/d21/d33/f54 [3530050,83673] 0 2024-04-20T21:59:07.227 INFO:tasks.workunit.client.1.smithi164.stdout:9/787: creat d3/db/d1b/d20/d3f/d8a/da7/dbd/f114 x:0 0 0 2024-04-20T21:59:07.229 INFO:tasks.workunit.client.1.smithi164.stdout:1/672: write d10/d7d/fa8 [603332,27820] 0 2024-04-20T21:59:07.231 INFO:tasks.workunit.client.1.smithi164.stdout:3/765: truncate d12/d6d/fa9 211646 0 2024-04-20T21:59:07.233 INFO:tasks.workunit.client.1.smithi164.stdout:0/686: creat d1/d4/d20/fc7 x:0 0 0 2024-04-20T21:59:07.234 INFO:tasks.workunit.client.1.smithi164.stdout:5/790: mkdir dc/d2c/d2e/d30/d72/da9/dbb/d10e 0 2024-04-20T21:59:07.234 INFO:tasks.workunit.client.1.smithi164.stdout:9/788: read d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/ff4 [306589,597] 0 2024-04-20T21:59:07.244 INFO:tasks.workunit.client.1.smithi164.stdout:7/744: dwrite d2/d21/d44/dd4/f9f [0,4194304] 0 2024-04-20T21:59:07.250 INFO:tasks.workunit.client.1.smithi164.stdout:7/745: truncate d2/d21/d24/d31/d3a/d83/d68/f8b 1039873 0 2024-04-20T21:59:07.253 INFO:tasks.workunit.client.1.smithi164.stdout:7/746: chown d2/d21/d24/d31/d3a/d83/dcf/dea 1244778 1 2024-04-20T21:59:07.255 INFO:tasks.workunit.client.1.smithi164.stdout:7/747: write d2/d21/d24/d31/d3a/daa/fcc [163156,671] 0 2024-04-20T21:59:07.256 INFO:tasks.workunit.client.1.smithi164.stdout:7/748: stat d2/f16 0 2024-04-20T21:59:07.267 INFO:tasks.workunit.client.1.smithi164.stdout:2/715: link d2/f12 d2/d19/d28/dd0/dba/d62/fde 0 2024-04-20T21:59:07.271 INFO:tasks.workunit.client.1.smithi164.stdout:3/766: dread - d12/f60 zero size 2024-04-20T21:59:07.281 INFO:tasks.workunit.client.1.smithi164.stdout:3/767: chown d12/d15/c4c 114 1 2024-04-20T21:59:07.287 INFO:tasks.workunit.client.1.smithi164.stdout:3/768: symlink d12/d68/d6f/lf5 0 2024-04-20T21:59:07.288 INFO:tasks.workunit.client.1.smithi164.stdout:9/789: dwrite d3/db/dd/f6b [0,4194304] 0 2024-04-20T21:59:07.289 INFO:tasks.workunit.client.1.smithi164.stdout:2/716: dread d2/d19/d28/d3e/f59 [0,4194304] 0 2024-04-20T21:59:07.291 INFO:tasks.workunit.client.1.smithi164.stdout:9/790: write d3/db/dc4/ffc [672144,98288] 0 2024-04-20T21:59:07.291 INFO:tasks.workunit.client.1.smithi164.stdout:3/769: creat d12/d20/d39/d55/d6b/d79/ff6 x:0 0 0 2024-04-20T21:59:07.293 INFO:tasks.workunit.client.1.smithi164.stdout:2/717: write d2/d5/fca [1526371,47793] 0 2024-04-20T21:59:07.295 INFO:tasks.workunit.client.1.smithi164.stdout:2/718: truncate d2/d30/da5/fc0 760385 0 2024-04-20T21:59:07.493 INFO:tasks.workunit.client.1.smithi164.stdout:3/770: write d12/d2a/f8a [663235,21827] 0 2024-04-20T21:59:07.493 INFO:tasks.workunit.client.1.smithi164.stdout:9/791: symlink d3/db/l115 0 2024-04-20T21:59:07.493 INFO:tasks.workunit.client.1.smithi164.stdout:2/719: mkdir d2/d30/da5/ddf 0 2024-04-20T21:59:07.493 INFO:tasks.workunit.client.1.smithi164.stdout:2/720: write d2/d5/d3a/f5a [2635721,34124] 0 2024-04-20T21:59:07.494 INFO:tasks.workunit.client.1.smithi164.stdout:9/792: read - d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/fad zero size 2024-04-20T21:59:07.494 INFO:tasks.workunit.client.1.smithi164.stdout:0/687: truncate d1/d4/f2c 1592968 0 2024-04-20T21:59:07.494 INFO:tasks.workunit.client.1.smithi164.stdout:9/793: read d3/f41 [2233897,40536] 0 2024-04-20T21:59:07.494 INFO:tasks.workunit.client.1.smithi164.stdout:2/721: link d2/d19/d28/f38 d2/dab/fe0 0 2024-04-20T21:59:07.494 INFO:tasks.workunit.client.1.smithi164.stdout:9/794: creat d3/db/dcc/de3/f116 x:0 0 0 2024-04-20T21:59:07.494 INFO:tasks.workunit.client.1.smithi164.stdout:2/722: rename d2/d30/da5/fc0 to d2/d5f/fe1 0 2024-04-20T21:59:07.494 INFO:tasks.workunit.client.1.smithi164.stdout:5/791: dread dc/d2b/d53/f96 [0,4194304] 0 2024-04-20T21:59:07.494 INFO:tasks.workunit.client.1.smithi164.stdout:3/771: dread d12/d15/f19 [0,4194304] 0 2024-04-20T21:59:07.494 INFO:tasks.workunit.client.1.smithi164.stdout:0/688: dwrite d1/d4/d20/d74/f5e [0,4194304] 0 2024-04-20T21:59:07.494 INFO:tasks.workunit.client.1.smithi164.stdout:9/795: creat d3/db/dd/d75/f117 x:0 0 0 2024-04-20T21:59:07.494 INFO:tasks.workunit.client.1.smithi164.stdout:2/723: unlink d2/d19/d28/dd0/dba/d62/f8c 0 2024-04-20T21:59:07.494 INFO:tasks.workunit.client.1.smithi164.stdout:3/772: mkdir d12/d20/d39/dac/df7 0 2024-04-20T21:59:07.494 INFO:tasks.workunit.client.1.smithi164.stdout:0/689: unlink d1/lb5 0 2024-04-20T21:59:07.494 INFO:tasks.workunit.client.1.smithi164.stdout:9/796: mkdir d3/db/dd/d40/d78/d86/d118 0 2024-04-20T21:59:07.494 INFO:tasks.workunit.client.1.smithi164.stdout:2/724: symlink d2/d19/d28/dd0/le2 0 2024-04-20T21:59:07.495 INFO:tasks.workunit.client.1.smithi164.stdout:2/725: fsync d2/d5/d3a/fa4 0 2024-04-20T21:59:07.495 INFO:tasks.workunit.client.1.smithi164.stdout:2/726: readlink d2/d5/l7b 0 2024-04-20T21:59:07.495 INFO:tasks.workunit.client.1.smithi164.stdout:3/773: symlink d12/d20/d39/d69/dad/de2/df1/lf8 0 2024-04-20T21:59:07.495 INFO:tasks.workunit.client.1.smithi164.stdout:2/727: creat d2/d19/da6/fe3 x:0 0 0 2024-04-20T21:59:07.495 INFO:tasks.workunit.client.1.smithi164.stdout:0/690: rename d1/d4/d49/c52 to d1/d2b/cc8 0 2024-04-20T21:59:07.495 INFO:tasks.workunit.client.1.smithi164.stdout:5/792: dread dc/d12/f4d [0,4194304] 0 2024-04-20T21:59:07.495 INFO:tasks.workunit.client.1.smithi164.stdout:2/728: unlink d2/d5/d3a/d65/d81/fc2 0 2024-04-20T21:59:07.495 INFO:tasks.workunit.client.1.smithi164.stdout:3/774: symlink d12/d15/lf9 0 2024-04-20T21:59:07.495 INFO:tasks.workunit.client.1.smithi164.stdout:9/797: dwrite d3/db/d1b/d1e/f9d [0,4194304] 0 2024-04-20T21:59:07.495 INFO:tasks.workunit.client.1.smithi164.stdout:5/793: write dc/d2b/d53/f96 [116778,59185] 0 2024-04-20T21:59:07.495 INFO:tasks.workunit.client.1.smithi164.stdout:3/775: symlink d12/d20/d39/d69/d9a/dbe/lfa 0 2024-04-20T21:59:07.495 INFO:tasks.workunit.client.1.smithi164.stdout:3/776: mknod d12/d20/d39/d69/dad/cfb 0 2024-04-20T21:59:07.495 INFO:tasks.workunit.client.1.smithi164.stdout:9/798: dread - d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/dce/ff9 zero size 2024-04-20T21:59:07.495 INFO:tasks.workunit.client.1.smithi164.stdout:5/794: dread dc/d2b/d6d/d73/fba [0,4194304] 0 2024-04-20T21:59:07.495 INFO:tasks.workunit.client.1.smithi164.stdout:8/655: sync 2024-04-20T21:59:07.496 INFO:tasks.workunit.client.1.smithi164.stdout:4/697: sync 2024-04-20T21:59:07.496 INFO:tasks.workunit.client.1.smithi164.stdout:3/777: creat d12/ffc x:0 0 0 2024-04-20T21:59:07.496 INFO:tasks.workunit.client.1.smithi164.stdout:9/799: dread - d3/db/dd/d40/d2a/f59 zero size 2024-04-20T21:59:07.496 INFO:tasks.workunit.client.1.smithi164.stdout:2/729: dwrite d2/d5f/faf [0,4194304] 0 2024-04-20T21:59:07.496 INFO:tasks.workunit.client.1.smithi164.stdout:4/698: write d4/d28/f6b [2453326,99754] 0 2024-04-20T21:59:07.496 INFO:tasks.workunit.client.1.smithi164.stdout:0/691: dwrite d1/d4/da/d5c/d6e/f96 [0,4194304] 0 2024-04-20T21:59:07.496 INFO:tasks.workunit.client.1.smithi164.stdout:8/656: chown d0/d14/d4e/d86/fd1 4796972 1 2024-04-20T21:59:07.496 INFO:tasks.workunit.client.1.smithi164.stdout:2/730: unlink d2/d5/d3a/d55/d58/db8/fcf 0 2024-04-20T21:59:07.496 INFO:tasks.workunit.client.1.smithi164.stdout:3/778: fsync d12/d15/f37 0 2024-04-20T21:59:07.496 INFO:tasks.workunit.client.1.smithi164.stdout:2/731: write d2/d19/d28/dd0/dba/fb2 [711376,34129] 0 2024-04-20T21:59:07.496 INFO:tasks.workunit.client.1.smithi164.stdout:8/657: rename d0/d14/d16/d9d/lab to d0/d14/d16/d58/d73/lde 0 2024-04-20T21:59:07.496 INFO:tasks.workunit.client.1.smithi164.stdout:2/732: readlink d2/d19/d28/dd0/le2 0 2024-04-20T21:59:07.496 INFO:tasks.workunit.client.1.smithi164.stdout:8/658: write d0/d14/d4e/d62/d8f/fa9 [1414272,117355] 0 2024-04-20T21:59:07.497 INFO:tasks.workunit.client.1.smithi164.stdout:3/779: symlink d12/d15/dae/lfd 0 2024-04-20T21:59:07.497 INFO:tasks.workunit.client.1.smithi164.stdout:5/795: dread dc/d12/f15 [0,4194304] 0 2024-04-20T21:59:07.497 INFO:tasks.workunit.client.1.smithi164.stdout:4/699: rename d4/d28/d3e/f93 to d4/d9/d5c/d97/dbf/d9b/fdd 0 2024-04-20T21:59:07.497 INFO:tasks.workunit.client.1.smithi164.stdout:5/796: chown dc/d12/d1e 81111 1 2024-04-20T21:59:07.497 INFO:tasks.workunit.client.1.smithi164.stdout:2/733: symlink d2/d19/d28/dd0/dba/d62/le4 0 2024-04-20T21:59:07.497 INFO:tasks.workunit.client.1.smithi164.stdout:9/800: dwrite d3/db/dd/d40/d78/d86/fbe [0,4194304] 0 2024-04-20T21:59:07.497 INFO:tasks.workunit.client.1.smithi164.stdout:2/734: symlink d2/d5/d3a/d55/d58/da2/db0/le5 0 2024-04-20T21:59:07.497 INFO:tasks.workunit.client.1.smithi164.stdout:0/692: truncate d1/d4/f7e 966369 0 2024-04-20T21:59:07.497 INFO:tasks.workunit.client.1.smithi164.stdout:2/735: mkdir d2/d5f/de6 0 2024-04-20T21:59:07.497 INFO:tasks.workunit.client.1.smithi164.stdout:4/700: dwrite d4/d28/f9a [0,4194304] 0 2024-04-20T21:59:07.497 INFO:tasks.workunit.client.1.smithi164.stdout:0/693: mknod d1/d4/d26/d29/d2d/d54/d77/cc9 0 2024-04-20T21:59:07.497 INFO:tasks.workunit.client.1.smithi164.stdout:0/694: read d1/fb [2387014,103505] 0 2024-04-20T21:59:07.497 INFO:tasks.workunit.client.1.smithi164.stdout:9/801: write d3/f99 [4169802,36994] 0 2024-04-20T21:59:07.497 INFO:tasks.workunit.client.1.smithi164.stdout:2/736: read d2/d5/d3a/f4c [822835,44275] 0 2024-04-20T21:59:07.497 INFO:tasks.workunit.client.1.smithi164.stdout:0/695: write d1/d4/da/d5c/f94 [333113,72328] 0 2024-04-20T21:59:07.497 INFO:tasks.workunit.client.1.smithi164.stdout:3/780: getdents d12/d15 0 2024-04-20T21:59:07.498 INFO:tasks.workunit.client.1.smithi164.stdout:5/797: dwrite dc/d2c/f98 [0,4194304] 0 2024-04-20T21:59:07.498 INFO:tasks.workunit.client.1.smithi164.stdout:9/802: mkdir d3/db/d1b/d119 0 2024-04-20T21:59:07.498 INFO:tasks.workunit.client.1.smithi164.stdout:2/737: creat d2/d5/d3a/d55/d58/da2/fe7 x:0 0 0 2024-04-20T21:59:07.498 INFO:tasks.workunit.client.1.smithi164.stdout:3/781: unlink d12/d20/f6a 0 2024-04-20T21:59:07.498 INFO:tasks.workunit.client.1.smithi164.stdout:5/798: fsync dc/d2c/d2e/d30/d72/fdf 0 2024-04-20T21:59:07.498 INFO:tasks.workunit.client.1.smithi164.stdout:8/659: dwrite d0/d14/f4f [0,4194304] 0 2024-04-20T21:59:07.498 INFO:tasks.workunit.client.1.smithi164.stdout:4/701: dwrite d4/d9/f1e [0,4194304] 0 2024-04-20T21:59:07.498 INFO:tasks.workunit.client.1.smithi164.stdout:5/799: creat dc/d2b/d53/f10f x:0 0 0 2024-04-20T21:59:07.498 INFO:tasks.workunit.client.1.smithi164.stdout:6/767: sync 2024-04-20T21:59:07.498 INFO:tasks.workunit.client.1.smithi164.stdout:5/800: write dc/d12/fe8 [770283,103509] 0 2024-04-20T21:59:07.498 INFO:tasks.workunit.client.1.smithi164.stdout:5/801: fdatasync f7 0 2024-04-20T21:59:07.498 INFO:tasks.workunit.client.1.smithi164.stdout:5/802: readlink dc/d2b/d52/lf2 0 2024-04-20T21:59:07.498 INFO:tasks.workunit.client.1.smithi164.stdout:9/803: rename d3/db/d82/d98/db6/fd4 to d3/db/dd/d40/d2a/d36/f11a 0 2024-04-20T21:59:07.498 INFO:tasks.workunit.client.1.smithi164.stdout:2/738: write d2/d19/d28/d3e/fc3 [484234,75551] 0 2024-04-20T21:59:07.498 INFO:tasks.workunit.client.1.smithi164.stdout:8/660: creat d0/d14/d4e/d62/d8f/dbe/fdf x:0 0 0 2024-04-20T21:59:07.499 INFO:tasks.workunit.client.1.smithi164.stdout:6/768: dread - d0/d3/d11/d5a/f6d zero size 2024-04-20T21:59:07.499 INFO:tasks.workunit.client.1.smithi164.stdout:9/804: mkdir d3/db/d1b/d20/d3f/d8a/da7/d11b 0 2024-04-20T21:59:07.499 INFO:tasks.workunit.client.1.smithi164.stdout:3/782: rmdir d12/d15/dae/de6 0 2024-04-20T21:59:07.499 INFO:tasks.workunit.client.1.smithi164.stdout:4/702: mkdir d4/d28/d3e/dde 0 2024-04-20T21:59:07.499 INFO:tasks.workunit.client.1.smithi164.stdout:2/739: mkdir d2/d30/de8 0 2024-04-20T21:59:07.499 INFO:tasks.workunit.client.1.smithi164.stdout:6/769: fdatasync d0/d3/d15/f5e 0 2024-04-20T21:59:07.499 INFO:tasks.workunit.client.1.smithi164.stdout:3/783: creat d12/d20/d39/d69/ffe x:0 0 0 2024-04-20T21:59:07.499 INFO:tasks.workunit.client.1.smithi164.stdout:4/703: write d4/d9/d22/f52 [5012583,57389] 0 2024-04-20T21:59:07.499 INFO:tasks.workunit.client.1.smithi164.stdout:3/784: chown d12/d2a/f8a 4295 1 2024-04-20T21:59:07.499 INFO:tasks.workunit.client.1.smithi164.stdout:8/661: dread d0/d14/f3e [0,4194304] 0 2024-04-20T21:59:07.499 INFO:tasks.workunit.client.1.smithi164.stdout:5/803: getdents dc/d2b/d53 0 2024-04-20T21:59:07.500 INFO:tasks.workunit.client.1.smithi164.stdout:6/770: rename d0/d3/d15/d23 to d0/d3/d15/d21/d101 0 2024-04-20T21:59:07.500 INFO:tasks.workunit.client.1.smithi164.stdout:5/804: rename dc/d2b/d52/c75 to dc/d2c/d2e/d30/d5e/c110 0 2024-04-20T21:59:07.504 INFO:tasks.workunit.client.1.smithi164.stdout:0/696: dwrite d1/d4/f7e [0,4194304] 0 2024-04-20T21:59:07.506 INFO:tasks.workunit.client.1.smithi164.stdout:3/785: creat d12/d20/fff x:0 0 0 2024-04-20T21:59:07.506 INFO:tasks.workunit.client.1.smithi164.stdout:7/749: sync 2024-04-20T21:59:07.506 INFO:tasks.workunit.client.1.smithi164.stdout:1/673: sync 2024-04-20T21:59:07.506 INFO:tasks.workunit.client.1.smithi164.stdout:2/740: write d2/dab/fe0 [18182,99547] 0 2024-04-20T21:59:07.510 INFO:tasks.workunit.client.1.smithi164.stdout:6/771: mknod d0/d3/d15/d21/d5c/dbf/dbd/ddf/d28/c102 0 2024-04-20T21:59:07.512 INFO:tasks.workunit.client.1.smithi164.stdout:4/704: getdents d4/d9/d5c 0 2024-04-20T21:59:07.514 INFO:tasks.workunit.client.1.smithi164.stdout:9/805: dwrite d3/db/dd/f61 [0,4194304] 0 2024-04-20T21:59:07.514 INFO:tasks.workunit.client.1.smithi164.stdout:6/772: readlink d0/lf 0 2024-04-20T21:59:07.517 INFO:tasks.workunit.client.1.smithi164.stdout:4/705: write d4/d9/d5c/f94 [4704217,117424] 0 2024-04-20T21:59:07.524 INFO:tasks.workunit.client.1.smithi164.stdout:8/662: dread d0/d14/d16/d5a/fd7 [0,4194304] 0 2024-04-20T21:59:07.527 INFO:tasks.workunit.client.1.smithi164.stdout:3/786: symlink d12/d20/d39/ddc/l100 0 2024-04-20T21:59:07.529 INFO:tasks.workunit.client.1.smithi164.stdout:5/805: truncate dc/d2c/f98 334668 0 2024-04-20T21:59:07.530 INFO:tasks.workunit.client.1.smithi164.stdout:1/674: mkdir d10/d33/d48/d8b/de3 0 2024-04-20T21:59:07.532 INFO:tasks.workunit.client.1.smithi164.stdout:2/741: dwrite d2/d5/d3a/f96 [0,4194304] 0 2024-04-20T21:59:07.532 INFO:tasks.workunit.client.1.smithi164.stdout:7/750: truncate d2/d21/d24/d31/d3a/fa2 292174 0 2024-04-20T21:59:07.533 INFO:tasks.workunit.client.1.smithi164.stdout:3/787: truncate d12/d68/d6f/d71/d7d/fab 306710 0 2024-04-20T21:59:07.535 INFO:tasks.workunit.client.1.smithi164.stdout:2/742: fdatasync d2/d5/d3a/d65/d81/dac/fcd 0 2024-04-20T21:59:07.536 INFO:tasks.workunit.client.1.smithi164.stdout:6/773: mkdir d0/d3/d15/d21/d101/d103 0 2024-04-20T21:59:07.537 INFO:tasks.workunit.client.1.smithi164.stdout:9/806: symlink d3/db/dd/d40/d2a/l11c 0 2024-04-20T21:59:07.538 INFO:tasks.workunit.client.1.smithi164.stdout:0/697: rmdir d1/d4/df/d56/da2 0 2024-04-20T21:59:07.540 INFO:tasks.workunit.client.1.smithi164.stdout:6/774: stat d0/d3/d62/d8e 0 2024-04-20T21:59:07.540 INFO:tasks.workunit.client.1.smithi164.stdout:7/751: symlink d2/d21/d24/d31/d3a/d83/d6a/dc5/lfa 0 2024-04-20T21:59:07.543 INFO:tasks.workunit.client.1.smithi164.stdout:4/706: creat d4/d9/d22/fdf x:0 0 0 2024-04-20T21:59:07.545 INFO:tasks.workunit.client.1.smithi164.stdout:3/788: rename d12/d20/d39/d69/d77/d81 to d12/d68/d101 0 2024-04-20T21:59:07.550 INFO:tasks.workunit.client.1.smithi164.stdout:1/675: dread d10/d33/d48/fb7 [0,4194304] 0 2024-04-20T21:59:07.551 INFO:tasks.workunit.client.1.smithi164.stdout:2/743: creat d2/d5/d3a/d65/d81/fe9 x:0 0 0 2024-04-20T21:59:07.554 INFO:tasks.workunit.client.1.smithi164.stdout:9/807: creat d3/db/dd/d40/d2a/d36/d51/da3/f11d x:0 0 0 2024-04-20T21:59:07.555 INFO:tasks.workunit.client.1.smithi164.stdout:0/698: write d1/d2b/f66 [2070231,114550] 0 2024-04-20T21:59:07.557 INFO:tasks.workunit.client.1.smithi164.stdout:5/806: creat dc/d2b/f111 x:0 0 0 2024-04-20T21:59:07.559 INFO:tasks.workunit.client.1.smithi164.stdout:8/663: dwrite d0/f84 [0,4194304] 0 2024-04-20T21:59:07.561 INFO:tasks.workunit.client.1.smithi164.stdout:3/789: symlink d12/d20/d39/d55/d87/l102 0 2024-04-20T21:59:07.561 INFO:tasks.workunit.client.1.smithi164.stdout:2/744: dread d2/d5/d3a/d55/d58/da2/fc1 [0,4194304] 0 2024-04-20T21:59:07.564 INFO:tasks.workunit.client.1.smithi164.stdout:6/775: dwrite d0/d3/d11/d29/f46 [4194304,4194304] 0 2024-04-20T21:59:07.566 INFO:tasks.workunit.client.1.smithi164.stdout:7/752: symlink d2/d21/d24/d31/d3a/d83/d63/d85/lfb 0 2024-04-20T21:59:07.568 INFO:tasks.workunit.client.1.smithi164.stdout:6/776: write d0/d3/d27/feb [298694,1996] 0 2024-04-20T21:59:07.572 INFO:tasks.workunit.client.1.smithi164.stdout:7/753: write d2/d21/d44/dd4/f76 [6496353,36288] 0 2024-04-20T21:59:07.573 INFO:tasks.workunit.client.1.smithi164.stdout:6/777: chown d0/d3/d62/d8e/l82 49 1 2024-04-20T21:59:07.575 INFO:tasks.workunit.client.1.smithi164.stdout:9/808: creat d3/db/dd/d40/d2a/d36/d51/f11e x:0 0 0 2024-04-20T21:59:07.577 INFO:tasks.workunit.client.1.smithi164.stdout:6/778: dread - d0/fbe zero size 2024-04-20T21:59:07.582 INFO:tasks.workunit.client.1.smithi164.stdout:2/745: creat d2/d5/d3a/d55/d58/da2/fea x:0 0 0 2024-04-20T21:59:07.582 INFO:tasks.workunit.client.1.smithi164.stdout:0/699: dwrite d1/d2b/f6b [0,4194304] 0 2024-04-20T21:59:07.586 INFO:tasks.workunit.client.1.smithi164.stdout:4/707: creat d4/d9/d5c/d97/dbf/d67/fe0 x:0 0 0 2024-04-20T21:59:07.588 INFO:tasks.workunit.client.1.smithi164.stdout:3/790: rename d12/d20/d39/d55/d6b/f72 to d12/d68/d6f/f103 0 2024-04-20T21:59:07.590 INFO:tasks.workunit.client.1.smithi164.stdout:7/754: symlink d2/d21/d24/d31/d3a/d83/dcf/lfc 0 2024-04-20T21:59:07.591 INFO:tasks.workunit.client.1.smithi164.stdout:1/676: dwrite d10/f11 [0,4194304] 0 2024-04-20T21:59:07.592 INFO:tasks.workunit.client.1.smithi164.stdout:9/809: mkdir d3/d9f/da1/d11f 0 2024-04-20T21:59:07.592 INFO:tasks.workunit.client.1.smithi164.stdout:0/700: truncate d1/f3e 4494945 0 2024-04-20T21:59:07.595 INFO:tasks.workunit.client.1.smithi164.stdout:6/779: mkdir d0/d3/d15/d21/d101/d45/d4f/d9c/d104 0 2024-04-20T21:59:07.597 INFO:tasks.workunit.client.1.smithi164.stdout:5/807: link dc/d12/d1e/da8/dea/l106 dc/d12/d1e/da8/l112 0 2024-04-20T21:59:07.599 INFO:tasks.workunit.client.1.smithi164.stdout:9/810: unlink d3/db/dd/f11 0 2024-04-20T21:59:07.600 INFO:tasks.workunit.client.1.smithi164.stdout:0/701: write d1/d4/df/d56/f8c [64399,58667] 0 2024-04-20T21:59:07.600 INFO:tasks.workunit.client.1.smithi164.stdout:4/708: mkdir d4/d28/dad/de1 0 2024-04-20T21:59:07.601 INFO:tasks.workunit.client.1.smithi164.stdout:8/664: dwrite d0/f4d [0,4194304] 0 2024-04-20T21:59:07.606 INFO:tasks.workunit.client.1.smithi164.stdout:3/791: creat d12/d15/dd3/f104 x:0 0 0 2024-04-20T21:59:07.606 INFO:tasks.workunit.client.1.smithi164.stdout:4/709: write d4/f36 [115275,50520] 0 2024-04-20T21:59:07.606 INFO:tasks.workunit.client.1.smithi164.stdout:7/755: mknod d2/d21/d24/d31/d3a/daa/db8/cfd 0 2024-04-20T21:59:07.608 INFO:tasks.workunit.client.1.smithi164.stdout:6/780: creat d0/d3/d27/d9d/dc3/f105 x:0 0 0 2024-04-20T21:59:07.610 INFO:tasks.workunit.client.1.smithi164.stdout:5/808: rmdir dc/d2b/d53 39 2024-04-20T21:59:07.613 INFO:tasks.workunit.client.1.smithi164.stdout:8/665: chown d0/fe 2181177 1 2024-04-20T21:59:07.613 INFO:tasks.workunit.client.1.smithi164.stdout:3/792: unlink d12/d68/f9c 0 2024-04-20T21:59:07.615 INFO:tasks.workunit.client.1.smithi164.stdout:2/746: dwrite d2/f8a [0,4194304] 0 2024-04-20T21:59:07.621 INFO:tasks.workunit.client.1.smithi164.stdout:9/811: mkdir d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/d120 0 2024-04-20T21:59:07.622 INFO:tasks.workunit.client.1.smithi164.stdout:0/702: mkdir d1/d4/d26/d29/d2d/d54/dca 0 2024-04-20T21:59:07.624 INFO:tasks.workunit.client.1.smithi164.stdout:0/703: fdatasync d1/d4/d26/d29/d2d/d54/d77/d3c/f58 0 2024-04-20T21:59:07.625 INFO:tasks.workunit.client.1.smithi164.stdout:6/781: truncate d0/d3/f1b 1884261 0 2024-04-20T21:59:07.629 INFO:tasks.workunit.client.1.smithi164.stdout:9/812: chown d3/db/d1b/d20/d3f/d8a/da7/dbd/f114 28 1 2024-04-20T21:59:07.630 INFO:tasks.workunit.client.1.smithi164.stdout:2/747: unlink d2/d5/d3a/f6a 0 2024-04-20T21:59:07.633 INFO:tasks.workunit.client.1.smithi164.stdout:0/704: write d1/d4/d26/d29/d2d/d54/d77/d3c/f82 [1017851,97997] 0 2024-04-20T21:59:07.633 INFO:tasks.workunit.client.1.smithi164.stdout:9/813: write d3/db/dd/d40/d2a/f77 [1486712,47619] 0 2024-04-20T21:59:07.638 INFO:tasks.workunit.client.1.smithi164.stdout:1/677: write d10/d16/d19/de0/d34/f60 [924474,113696] 0 2024-04-20T21:59:07.643 INFO:tasks.workunit.client.1.smithi164.stdout:2/748: rmdir d2/d5/d3a/d55/d58/da2 39 2024-04-20T21:59:07.644 INFO:tasks.workunit.client.1.smithi164.stdout:0/705: fsync d1/f23 0 2024-04-20T21:59:07.647 INFO:tasks.workunit.client.1.smithi164.stdout:9/814: symlink d3/db/dc4/l121 0 2024-04-20T21:59:07.649 INFO:tasks.workunit.client.1.smithi164.stdout:5/809: dread dc/d2c/d2e/d30/d72/fdf [0,4194304] 0 2024-04-20T21:59:07.649 INFO:tasks.workunit.client.1.smithi164.stdout:6/782: symlink d0/d3/d15/d21/d5c/dbf/dbd/ddf/d28/d6f/l106 0 2024-04-20T21:59:07.652 INFO:tasks.workunit.client.1.smithi164.stdout:7/756: dread d2/d21/d24/d31/f41 [0,4194304] 0 2024-04-20T21:59:07.654 INFO:tasks.workunit.client.1.smithi164.stdout:4/710: link d4/d28/d3e/d41/fd7 d4/d28/fe2 0 2024-04-20T21:59:07.656 INFO:tasks.workunit.client.1.smithi164.stdout:0/706: rmdir d1/d4/df/d56 39 2024-04-20T21:59:07.657 INFO:tasks.workunit.client.1.smithi164.stdout:2/749: dread d2/d19/d28/dd0/dba/d62/f88 [0,4194304] 0 2024-04-20T21:59:07.659 INFO:tasks.workunit.client.1.smithi164.stdout:5/810: write dc/d2b/d52/ffa [588984,65638] 0 2024-04-20T21:59:07.659 INFO:tasks.workunit.client.1.smithi164.stdout:8/666: dread d0/d14/d16/d58/fb8 [0,4194304] 0 2024-04-20T21:59:07.660 INFO:tasks.workunit.client.1.smithi164.stdout:9/815: rename d3/db/d82/cf3 to d3/db/dd/c122 0 2024-04-20T21:59:07.665 INFO:tasks.workunit.client.1.smithi164.stdout:1/678: dwrite d10/d16/d20/d25/fad [4194304,4194304] 0 2024-04-20T21:59:07.666 INFO:tasks.workunit.client.1.smithi164.stdout:3/793: dwrite d12/d2a/f3d [0,4194304] 0 2024-04-20T21:59:07.666 INFO:tasks.workunit.client.1.smithi164.stdout:9/816: chown d3/db/dd/d40/d2a/f77 0 1 2024-04-20T21:59:07.668 INFO:tasks.workunit.client.1.smithi164.stdout:3/794: write d12/f1f [1669571,106556] 0 2024-04-20T21:59:07.672 INFO:tasks.workunit.client.1.smithi164.stdout:4/711: creat d4/d9/d5c/d97/dbf/fe3 x:0 0 0 2024-04-20T21:59:07.677 INFO:tasks.workunit.client.1.smithi164.stdout:6/783: write d0/d3/d15/d21/d5c/dbf/dbd/ddf/fa [1843088,44343] 0 2024-04-20T21:59:07.677 INFO:tasks.workunit.client.1.smithi164.stdout:7/757: dwrite d2/d21/d24/d31/d3a/d83/d63/fab [4194304,4194304] 0 2024-04-20T21:59:07.685 INFO:tasks.workunit.client.1.smithi164.stdout:1/679: unlink d10/c3b 0 2024-04-20T21:59:07.689 INFO:tasks.workunit.client.1.smithi164.stdout:6/784: mkdir d0/d3/d15/d21/d5c/dbf/d107 0 2024-04-20T21:59:07.689 INFO:tasks.workunit.client.1.smithi164.stdout:8/667: truncate d0/f11 309377 0 2024-04-20T21:59:07.699 INFO:tasks.workunit.client.1.smithi164.stdout:3/795: write d12/d20/d39/d55/f93 [311166,58081] 0 2024-04-20T21:59:07.699 INFO:tasks.workunit.client.1.smithi164.stdout:8/668: creat d0/d14/d4e/d6f/fe0 x:0 0 0 2024-04-20T21:59:07.700 INFO:tasks.workunit.client.1.smithi164.stdout:6/785: symlink d0/d3/d11/d29/d6e/db2/df5/l108 0 2024-04-20T21:59:07.703 INFO:tasks.workunit.client.1.smithi164.stdout:4/712: write d4/f16 [1284626,48975] 0 2024-04-20T21:59:07.703 INFO:tasks.workunit.client.1.smithi164.stdout:5/811: link dc/d12/c6a dc/d2c/d2e/c113 0 2024-04-20T21:59:07.707 INFO:tasks.workunit.client.1.smithi164.stdout:7/758: rename d2/d21/d33/c37 to d2/d21/df0/cfe 0 2024-04-20T21:59:07.709 INFO:tasks.workunit.client.1.smithi164.stdout:6/786: creat d0/d3/d62/d8e/f109 x:0 0 0 2024-04-20T21:59:07.713 INFO:tasks.workunit.client.1.smithi164.stdout:1/680: rmdir d10/dca/dd7 0 2024-04-20T21:59:07.718 INFO:tasks.workunit.client.1.smithi164.stdout:5/812: creat dc/d2b/da0/df8/f114 x:0 0 0 2024-04-20T21:59:07.718 INFO:tasks.workunit.client.1.smithi164.stdout:7/759: truncate d2/d21/f80 167219 0 2024-04-20T21:59:07.719 INFO:tasks.workunit.client.1.smithi164.stdout:2/750: dread d2/d19/d28/dd0/dba/d62/fde [0,4194304] 0 2024-04-20T21:59:07.719 INFO:tasks.workunit.client.1.smithi164.stdout:5/813: readlink dc/d41/l9f 0 2024-04-20T21:59:07.720 INFO:tasks.workunit.client.1.smithi164.stdout:1/681: mkdir d10/d33/d48/d8b/de3/de4 0 2024-04-20T21:59:07.721 INFO:tasks.workunit.client.1.smithi164.stdout:2/751: chown d2/d5/d3a/d55/d58/lc6 2282 1 2024-04-20T21:59:07.726 INFO:tasks.workunit.client.1.smithi164.stdout:1/682: creat d10/d16/d19/de0/fe5 x:0 0 0 2024-04-20T21:59:07.726 INFO:tasks.workunit.client.1.smithi164.stdout:1/683: readlink l4 0 2024-04-20T21:59:07.728 INFO:tasks.workunit.client.1.smithi164.stdout:5/814: rename dc/l11 to dc/d2b/d6d/d73/dab/l115 0 2024-04-20T21:59:07.732 INFO:tasks.workunit.client.1.smithi164.stdout:6/787: dread d0/d3/fb [0,4194304] 0 2024-04-20T21:59:07.732 INFO:tasks.workunit.client.1.smithi164.stdout:5/815: mkdir dc/d12/d81/d116 0 2024-04-20T21:59:07.734 INFO:tasks.workunit.client.1.smithi164.stdout:3/796: truncate f11 2922434 0 2024-04-20T21:59:07.736 INFO:tasks.workunit.client.1.smithi164.stdout:3/797: fsync d12/d20/d39/f56 0 2024-04-20T21:59:07.738 INFO:tasks.workunit.client.1.smithi164.stdout:8/669: truncate d0/d14/d5f/f7a 3676355 0 2024-04-20T21:59:07.738 INFO:tasks.workunit.client.1.smithi164.stdout:2/752: dwrite d2/d5/d3a/d65/f7f [0,4194304] 0 2024-04-20T21:59:07.739 INFO:tasks.workunit.client.1.smithi164.stdout:3/798: chown d12/d68/d6f/d71/lbc 1062567 1 2024-04-20T21:59:07.739 INFO:tasks.workunit.client.1.smithi164.stdout:4/713: truncate d4/d9/d22/f77 2033932 0 2024-04-20T21:59:07.740 INFO:tasks.workunit.client.1.smithi164.stdout:6/788: truncate d0/d3/d15/d21/d5c/dbf/db4/dcd/fe1 893077 0 2024-04-20T21:59:07.740 INFO:tasks.workunit.client.1.smithi164.stdout:3/799: fsync d12/f1f 0 2024-04-20T21:59:07.745 INFO:tasks.workunit.client.1.smithi164.stdout:8/670: mknod d0/d14/d16/d58/d94/ce1 0 2024-04-20T21:59:07.745 INFO:tasks.workunit.client.1.smithi164.stdout:7/760: write d2/d21/d33/fe5 [111788,35741] 0 2024-04-20T21:59:07.748 INFO:tasks.workunit.client.1.smithi164.stdout:3/800: mkdir d12/d15/dae/d105 0 2024-04-20T21:59:07.782 INFO:tasks.workunit.client.1.smithi164.stdout:1/684: truncate d10/d33/d48/f6b 382171 0 2024-04-20T21:59:07.786 INFO:tasks.workunit.client.1.smithi164.stdout:3/801: symlink d12/d20/d39/ddc/l106 0 2024-04-20T21:59:07.789 INFO:tasks.workunit.client.1.smithi164.stdout:3/802: chown d12/d6d 23875 1 2024-04-20T21:59:07.789 INFO:tasks.workunit.client.1.smithi164.stdout:7/761: rename d2/d21/d44/dd4/d82/d93/dca to d2/d21/d24/d31/d3a/d83/dba/def/dff 0 2024-04-20T21:59:07.792 INFO:tasks.workunit.client.1.smithi164.stdout:6/789: link d0/d3/d11/c2f d0/d3/d62/d8e/c10a 0 2024-04-20T21:59:07.794 INFO:tasks.workunit.client.1.smithi164.stdout:3/803: symlink d12/d20/d39/d69/d83/l107 0 2024-04-20T21:59:07.795 INFO:tasks.workunit.client.1.smithi164.stdout:4/714: dwrite d4/d28/d3e/d41/fa0 [0,4194304] 0 2024-04-20T21:59:07.795 INFO:tasks.workunit.client.1.smithi164.stdout:5/816: dread dc/d12/f13 [0,4194304] 0 2024-04-20T21:59:07.796 INFO:tasks.workunit.client.1.smithi164.stdout:8/671: dwrite d0/d1e/f22 [0,4194304] 0 2024-04-20T21:59:07.805 INFO:tasks.workunit.client.1.smithi164.stdout:1/685: truncate d10/f11 4102546 0 2024-04-20T21:59:07.808 INFO:tasks.workunit.client.1.smithi164.stdout:3/804: rmdir d12/d6d 39 2024-04-20T21:59:07.810 INFO:tasks.workunit.client.1.smithi164.stdout:1/686: rmdir d10/d33/d48/d8b/de3 39 2024-04-20T21:59:07.810 INFO:tasks.workunit.client.1.smithi164.stdout:5/817: write dc/d41/fad [4137825,31029] 0 2024-04-20T21:59:07.814 INFO:tasks.workunit.client.1.smithi164.stdout:7/762: rename d2/d21/d24/d31/d3a/d83/d63/d85/f94 to d2/d21/d24/d31/d3a/d83/d63/f100 0 2024-04-20T21:59:07.814 INFO:tasks.workunit.client.1.smithi164.stdout:1/687: write d10/d16/d19/d1a/f32 [1912345,105531] 0 2024-04-20T21:59:07.814 INFO:tasks.workunit.client.1.smithi164.stdout:6/790: dwrite d0/d3/d62/fa7 [0,4194304] 0 2024-04-20T21:59:07.816 INFO:tasks.workunit.client.1.smithi164.stdout:7/763: chown d2/d21/fb2 516485 1 2024-04-20T21:59:07.817 INFO:tasks.workunit.client.1.smithi164.stdout:1/688: chown d10/d16/d20/d91/cab 42 1 2024-04-20T21:59:07.818 INFO:tasks.workunit.client.1.smithi164.stdout:6/791: chown d0/d3/d15/d21/d5c/dbf/dbd/ddf/d28/d6f 79122299 1 2024-04-20T21:59:07.819 INFO:tasks.workunit.client.1.smithi164.stdout:3/805: mkdir d12/d20/d39/d55/d87/d108 0 2024-04-20T21:59:07.823 INFO:tasks.workunit.client.1.smithi164.stdout:6/792: write d0/d3/d15/d21/d5c/dbf/dbd/ddf/f1f [3589512,79284] 0 2024-04-20T21:59:07.824 INFO:tasks.workunit.client.1.smithi164.stdout:5/818: mknod dc/d2c/d2e/d30/d72/da9/d10a/c117 0 2024-04-20T21:59:07.825 INFO:tasks.workunit.client.1.smithi164.stdout:5/819: readlink dc/d12/d1e/da8/laf 0 2024-04-20T21:59:07.827 INFO:tasks.workunit.client.1.smithi164.stdout:3/806: dread - d12/d20/d39/d69/d9a/f9f zero size 2024-04-20T21:59:07.827 INFO:tasks.workunit.client.1.smithi164.stdout:4/715: fsync d4/d28/d3e/d41/fa0 0 2024-04-20T21:59:07.830 INFO:tasks.workunit.client.1.smithi164.stdout:9/817: sync 2024-04-20T21:59:07.830 INFO:tasks.workunit.client.1.smithi164.stdout:0/707: sync 2024-04-20T21:59:07.835 INFO:tasks.workunit.client.1.smithi164.stdout:9/818: write d3/db/f8c [1092220,38551] 0 2024-04-20T21:59:07.835 INFO:tasks.workunit.client.1.smithi164.stdout:8/672: truncate d0/d14/d4e/d86/f8c 2287832 0 2024-04-20T21:59:07.839 INFO:tasks.workunit.client.1.smithi164.stdout:6/793: creat d0/f10b x:0 0 0 2024-04-20T21:59:07.841 INFO:tasks.workunit.client.1.smithi164.stdout:7/764: truncate d2/d21/d24/d31/d3a/d83/d63/fab 5992166 0 2024-04-20T21:59:07.841 INFO:tasks.workunit.client.1.smithi164.stdout:6/794: chown d0/d3/d27/dde 432224228 1 2024-04-20T21:59:07.938 INFO:tasks.workunit.client.1.smithi164.stdout:0/708: getdents d1/d4/d20/d74 0 2024-04-20T21:59:07.943 INFO:tasks.workunit.client.1.smithi164.stdout:8/673: link d0/d14/d16/l2d d0/le2 0 2024-04-20T21:59:07.943 INFO:tasks.workunit.client.1.smithi164.stdout:7/765: write d2/d21/d24/d31/d3a/d83/d77/fdc [1618007,1289] 0 2024-04-20T21:59:07.944 INFO:tasks.workunit.client.1.smithi164.stdout:3/807: dwrite d12/d68/d101/fbb [0,4194304] 0 2024-04-20T21:59:07.951 INFO:tasks.workunit.client.1.smithi164.stdout:0/709: chown d1/d4/d26/f76 2 1 2024-04-20T21:59:07.954 INFO:tasks.workunit.client.1.smithi164.stdout:8/674: mkdir d0/d14/d4e/d6f/de3 0 2024-04-20T21:59:07.960 INFO:tasks.workunit.client.1.smithi164.stdout:0/710: stat d1/d4/da/f2e 0 2024-04-20T21:59:07.961 INFO:tasks.workunit.client.1.smithi164.stdout:7/766: symlink d2/d21/d24/d8a/l101 0 2024-04-20T21:59:07.961 INFO:tasks.workunit.client.1.smithi164.stdout:4/716: dwrite d4/ff [0,4194304] 0 2024-04-20T21:59:07.965 INFO:tasks.workunit.client.1.smithi164.stdout:9/819: dwrite d3/db/f38 [4194304,4194304] 0 2024-04-20T21:59:07.967 INFO:tasks.workunit.client.1.smithi164.stdout:2/753: sync 2024-04-20T21:59:07.972 INFO:tasks.workunit.client.1.smithi164.stdout:0/711: chown d1/d4/d49/c62 192851396 1 2024-04-20T21:59:07.976 INFO:tasks.workunit.client.1.smithi164.stdout:4/717: creat d4/d9/d5c/d97/fe4 x:0 0 0 2024-04-20T21:59:07.978 INFO:tasks.workunit.client.1.smithi164.stdout:9/820: creat d3/db0/dd3/f123 x:0 0 0 2024-04-20T21:59:07.979 INFO:tasks.workunit.client.1.smithi164.stdout:6/795: dread d0/d3/fb [0,4194304] 0 2024-04-20T21:59:07.981 INFO:tasks.workunit.client.1.smithi164.stdout:0/712: chown d1/d4/d26/d29/d2d/c81 109 1 2024-04-20T21:59:07.988 INFO:tasks.workunit.client.1.smithi164.stdout:2/754: truncate d2/d19/d28/d3e/f59 1251569 0 2024-04-20T21:59:07.989 INFO:tasks.workunit.client.1.smithi164.stdout:4/718: mkdir d4/d28/d3e/d41/de5 0 2024-04-20T21:59:07.992 INFO:tasks.workunit.client.1.smithi164.stdout:3/808: write d12/d6d/fa9 [119760,69718] 0 2024-04-20T21:59:07.994 INFO:tasks.workunit.client.1.smithi164.stdout:9/821: truncate d3/db/f17 7488382 0 2024-04-20T21:59:07.995 INFO:tasks.workunit.client.1.smithi164.stdout:4/719: fdatasync d4/d28/f58 0 2024-04-20T21:59:07.997 INFO:tasks.workunit.client.1.smithi164.stdout:2/755: readlink d2/d5/d3a/d55/d58/db8/ldb 0 2024-04-20T21:59:07.998 INFO:tasks.workunit.client.1.smithi164.stdout:1/689: sync 2024-04-20T21:59:08.003 INFO:tasks.workunit.client.1.smithi164.stdout:2/756: chown d2/d5/d3a/d55/c70 2167239 1 2024-04-20T21:59:08.003 INFO:tasks.workunit.client.1.smithi164.stdout:3/809: mknod d12/d68/d101/c109 0 2024-04-20T21:59:08.006 INFO:tasks.workunit.client.1.smithi164.stdout:6/796: dread d0/d3/d15/d21/d5c/dbf/db4/dcd/fe1 [0,4194304] 0 2024-04-20T21:59:08.007 INFO:tasks.workunit.client.1.smithi164.stdout:4/720: mkdir d4/d28/d3e/d41/de6 0 2024-04-20T21:59:08.009 INFO:tasks.workunit.client.1.smithi164.stdout:7/767: dwrite d2/d21/d24/f52 [4194304,4194304] 0 2024-04-20T21:59:08.011 INFO:tasks.workunit.client.1.smithi164.stdout:2/757: chown d2/d5/d3a/d55/d58/da2/dcc 3 1 2024-04-20T21:59:08.011 INFO:tasks.workunit.client.1.smithi164.stdout:7/768: fsync d2/f48 0 2024-04-20T21:59:08.015 INFO:tasks.workunit.client.1.smithi164.stdout:3/810: creat d12/d68/d101/f10a x:0 0 0 2024-04-20T21:59:08.015 INFO:tasks.workunit.client.1.smithi164.stdout:6/797: symlink d0/l10c 0 2024-04-20T21:59:08.016 INFO:tasks.workunit.client.1.smithi164.stdout:3/811: chown d12/d15/f1b 0 1 2024-04-20T21:59:08.020 INFO:tasks.workunit.client.1.smithi164.stdout:6/798: write d0/d3/f3a [4060788,129995] 0 2024-04-20T21:59:08.023 INFO:tasks.workunit.client.1.smithi164.stdout:9/822: getdents d3/db/d1b/d20/d3f/dc7 0 2024-04-20T21:59:08.026 INFO:tasks.workunit.client.1.smithi164.stdout:8/675: dread d0/d14/d4e/d62/d8f/fae [0,4194304] 0 2024-04-20T21:59:08.027 INFO:tasks.workunit.client.1.smithi164.stdout:4/721: truncate d4/d28/d3e/d41/fa0 1691256 0 2024-04-20T21:59:08.030 INFO:tasks.workunit.client.1.smithi164.stdout:3/812: rename d12/d15/lf9 to d12/d2a/db1/l10b 0 2024-04-20T21:59:08.034 INFO:tasks.workunit.client.1.smithi164.stdout:7/769: fdatasync d2/d21/d24/d31/d3a/f49 0 2024-04-20T21:59:08.038 INFO:tasks.workunit.client.1.smithi164.stdout:2/758: dwrite d2/d30/f83 [0,4194304] 0 2024-04-20T21:59:08.039 INFO:tasks.workunit.client.1.smithi164.stdout:8/676: symlink d0/d14/d16/d58/d73/le4 0 2024-04-20T21:59:08.039 INFO:tasks.workunit.client.1.smithi164.stdout:7/770: read - d2/d21/d24/d31/d3a/daa/db8/fec zero size 2024-04-20T21:59:08.040 INFO:tasks.workunit.client.1.smithi164.stdout:0/713: dread d1/d4/d26/d29/f44 [4194304,4194304] 0 2024-04-20T21:59:08.041 INFO:tasks.workunit.client.1.smithi164.stdout:9/823: rename d3/db/l115 to d3/db/dd/d40/d78/d86/l124 0 2024-04-20T21:59:08.041 INFO:tasks.workunit.client.1.smithi164.stdout:5/820: sync 2024-04-20T21:59:08.048 INFO:tasks.workunit.client.1.smithi164.stdout:1/690: write d10/d16/d19/d1a/d51/f6a [1062896,37553] 0 2024-04-20T21:59:08.048 INFO:tasks.workunit.client.1.smithi164.stdout:0/714: write d1/d2b/fc1 [131875,20557] 0 2024-04-20T21:59:08.049 INFO:tasks.workunit.client.1.smithi164.stdout:6/799: dwrite d0/f52 [4194304,4194304] 0 2024-04-20T21:59:08.050 INFO:tasks.workunit.client.1.smithi164.stdout:2/759: mkdir d2/d30/d84/deb 0 2024-04-20T21:59:08.055 INFO:tasks.workunit.client.1.smithi164.stdout:2/760: fdatasync d2/d19/f54 0 2024-04-20T21:59:08.059 INFO:tasks.workunit.client.1.smithi164.stdout:1/691: write d10/d33/d48/fa4 [133488,39667] 0 2024-04-20T21:59:08.061 INFO:tasks.workunit.client.1.smithi164.stdout:7/771: creat d2/d21/d24/d31/d3a/d83/d6a/dc5/f102 x:0 0 0 2024-04-20T21:59:08.065 INFO:tasks.workunit.client.1.smithi164.stdout:1/692: chown d10/d33/fc0 98727965 1 2024-04-20T21:59:08.072 INFO:tasks.workunit.client.1.smithi164.stdout:9/824: creat d3/db/dd/d40/d2a/d36/d51/f125 x:0 0 0 2024-04-20T21:59:08.074 INFO:tasks.workunit.client.1.smithi164.stdout:8/677: dwrite d0/d14/d16/f6a [0,4194304] 0 2024-04-20T21:59:08.075 INFO:tasks.workunit.client.1.smithi164.stdout:5/821: mkdir dc/d2c/d2e/d30/d118 0 2024-04-20T21:59:08.080 INFO:tasks.workunit.client.1.smithi164.stdout:0/715: symlink d1/d4/d26/d29/d2d/d54/d77/d9e/lcb 0 2024-04-20T21:59:08.081 INFO:tasks.workunit.client.1.smithi164.stdout:2/761: mknod d2/d30/d84/cec 0 2024-04-20T21:59:08.082 INFO:tasks.workunit.client.1.smithi164.stdout:6/800: dwrite d0/d3/d15/d21/d5c/f78 [4194304,4194304] 0 2024-04-20T21:59:08.090 INFO:tasks.workunit.client.1.smithi164.stdout:9/825: creat d3/d9f/da1/f126 x:0 0 0 2024-04-20T21:59:08.091 INFO:tasks.workunit.client.1.smithi164.stdout:4/722: dread d4/d9/fc [0,4194304] 0 2024-04-20T21:59:08.091 INFO:tasks.workunit.client.1.smithi164.stdout:0/716: read d1/d4/d26/d29/d2d/d54/d77/d3c/f58 [1635856,24823] 0 2024-04-20T21:59:08.094 INFO:tasks.workunit.client.1.smithi164.stdout:8/678: symlink d0/d14/d5f/le5 0 2024-04-20T21:59:08.094 INFO:tasks.workunit.client.1.smithi164.stdout:3/813: dread d12/d20/d39/d55/d6b/f97 [0,4194304] 0 2024-04-20T21:59:08.098 INFO:tasks.workunit.client.1.smithi164.stdout:1/693: dwrite d10/d16/d19/de0/d34/da9/f92 [0,4194304] 0 2024-04-20T21:59:08.100 INFO:tasks.workunit.client.1.smithi164.stdout:7/772: dread d2/d21/d33/f40 [0,4194304] 0 2024-04-20T21:59:08.104 INFO:tasks.workunit.client.1.smithi164.stdout:8/679: chown d0/d14/d16/c15 129168456 1 2024-04-20T21:59:08.104 INFO:tasks.workunit.client.1.smithi164.stdout:2/762: rmdir d2/d5/d3a/d55/d58/db8 39 2024-04-20T21:59:08.106 INFO:tasks.workunit.client.1.smithi164.stdout:6/801: mkdir d0/d3/d11/d29/d6e/d41/d10d 0 2024-04-20T21:59:08.107 INFO:tasks.workunit.client.1.smithi164.stdout:5/822: dread dc/d2c/d2e/d30/d72/fdf [0,4194304] 0 2024-04-20T21:59:08.109 INFO:tasks.workunit.client.1.smithi164.stdout:1/694: read d10/d33/d48/f4b [3072078,79528] 0 2024-04-20T21:59:08.109 INFO:tasks.workunit.client.1.smithi164.stdout:3/814: truncate d12/d2a/db1/fc2 452538 0 2024-04-20T21:59:08.117 INFO:tasks.workunit.client.1.smithi164.stdout:8/680: readlink d0/d14/d16/d9d/lc6 0 2024-04-20T21:59:08.120 INFO:tasks.workunit.client.1.smithi164.stdout:9/826: dwrite d3/fa [4194304,4194304] 0 2024-04-20T21:59:08.121 INFO:tasks.workunit.client.1.smithi164.stdout:1/695: mkdir d10/d33/d48/de6 0 2024-04-20T21:59:08.128 INFO:tasks.workunit.client.1.smithi164.stdout:1/696: fdatasync d10/d16/d20/d25/fdf 0 2024-04-20T21:59:08.129 INFO:tasks.workunit.client.1.smithi164.stdout:7/773: dwrite d2/f8c [0,4194304] 0 2024-04-20T21:59:08.134 INFO:tasks.workunit.client.1.smithi164.stdout:1/697: write d10/d33/fcf [872982,90330] 0 2024-04-20T21:59:08.138 INFO:tasks.workunit.client.1.smithi164.stdout:1/698: write d10/d16/f72 [599087,53017] 0 2024-04-20T21:59:08.139 INFO:tasks.workunit.client.1.smithi164.stdout:9/827: rmdir d3/db0/dd3 39 2024-04-20T21:59:08.140 INFO:tasks.workunit.client.1.smithi164.stdout:0/717: link d1/d4/d26/d29/d2d/cc4 d1/d4/d26/d29/d2d/d54/d77/db3/ccc 0 2024-04-20T21:59:08.140 INFO:tasks.workunit.client.1.smithi164.stdout:4/723: dwrite d4/f15 [0,4194304] 0 2024-04-20T21:59:08.141 INFO:tasks.workunit.client.1.smithi164.stdout:7/774: readlink d2/d21/d44/l99 0 2024-04-20T21:59:08.147 INFO:tasks.workunit.client.1.smithi164.stdout:7/775: readlink d2/d21/d44/l6b 0 2024-04-20T21:59:08.148 INFO:tasks.workunit.client.1.smithi164.stdout:0/718: write d1/d4/d26/d29/d2d/faf [386699,82570] 0 2024-04-20T21:59:08.148 INFO:tasks.workunit.client.1.smithi164.stdout:2/763: dwrite d2/d5/d3a/d65/d81/dac/fcd [0,4194304] 0 2024-04-20T21:59:08.148 INFO:tasks.workunit.client.1.smithi164.stdout:1/699: unlink d10/f12 0 2024-04-20T21:59:08.152 INFO:tasks.workunit.client.1.smithi164.stdout:9/828: creat d3/db/dd/f127 x:0 0 0 2024-04-20T21:59:08.155 INFO:tasks.workunit.client.1.smithi164.stdout:1/700: creat d10/d16/d19/d1a/d51/d85/fe7 x:0 0 0 2024-04-20T21:59:08.160 INFO:tasks.workunit.client.1.smithi164.stdout:0/719: stat d1/d4/lbb 0 2024-04-20T21:59:08.160 INFO:tasks.workunit.client.1.smithi164.stdout:7/776: creat d2/d21/d24/d31/d3a/d83/d68/f103 x:0 0 0 2024-04-20T21:59:08.162 INFO:tasks.workunit.client.1.smithi164.stdout:0/720: stat d1/d2b/f8f 0 2024-04-20T21:59:08.172 INFO:tasks.workunit.client.1.smithi164.stdout:3/815: dread d12/d20/d39/dac/ff2 [0,4194304] 0 2024-04-20T21:59:08.172 INFO:tasks.workunit.client.1.smithi164.stdout:4/724: dwrite d4/d9/d5c/d97/dbf/d5f/f8a [0,4194304] 0 2024-04-20T21:59:08.174 INFO:tasks.workunit.client.1.smithi164.stdout:0/721: chown d1/c2a 5 1 2024-04-20T21:59:08.181 INFO:tasks.workunit.client.1.smithi164.stdout:5/823: dread dc/d12/d1e/f35 [4194304,4194304] 0 2024-04-20T21:59:08.183 INFO:tasks.workunit.client.1.smithi164.stdout:7/777: rename d2/ca3 to d2/d21/d44/dd4/d9e/de9/c104 0 2024-04-20T21:59:08.185 INFO:tasks.workunit.client.1.smithi164.stdout:4/725: rmdir d4 39 2024-04-20T21:59:08.188 INFO:tasks.workunit.client.1.smithi164.stdout:9/829: creat d3/db/d1b/d20/d3f/d8a/da7/dbd/f128 x:0 0 0 2024-04-20T21:59:08.191 INFO:tasks.workunit.client.1.smithi164.stdout:1/701: dwrite d10/d16/d19/de0/d34/f7a [0,4194304] 0 2024-04-20T21:59:08.191 INFO:tasks.workunit.client.1.smithi164.stdout:2/764: link d2/d30/d84/la3 d2/d30/d84/deb/led 0 2024-04-20T21:59:08.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:07 smithi142 ceph-mon[15828]: pgmap v11: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 50 MiB/s rd, 154 MiB/s wr, 334 op/s 2024-04-20T21:59:08.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:07 smithi164 ceph-mon[23506]: pgmap v11: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 50 MiB/s rd, 154 MiB/s wr, 334 op/s 2024-04-20T21:59:08.197 INFO:tasks.workunit.client.1.smithi164.stdout:3/816: symlink d12/l10c 0 2024-04-20T21:59:08.197 INFO:tasks.workunit.client.1.smithi164.stdout:1/702: write d10/d16/d19/de0/f74 [1116962,85819] 0 2024-04-20T21:59:08.199 INFO:tasks.workunit.client.1.smithi164.stdout:8/681: dwrite d0/fe [0,4194304] 0 2024-04-20T21:59:08.210 INFO:tasks.workunit.client.1.smithi164.stdout:4/726: chown d4/d9/d5c/d97/dbf/d5f 2 1 2024-04-20T21:59:08.215 INFO:tasks.workunit.client.1.smithi164.stdout:4/727: readlink d4/d9/d5c/d97/dbf/d67/l87 0 2024-04-20T21:59:08.223 INFO:tasks.workunit.client.1.smithi164.stdout:6/802: sync 2024-04-20T21:59:08.226 INFO:tasks.workunit.client.1.smithi164.stdout:8/682: creat d0/d14/d16/d9d/fe6 x:0 0 0 2024-04-20T21:59:08.227 INFO:tasks.workunit.client.1.smithi164.stdout:0/722: dread d1/d4/da/d27/f90 [0,4194304] 0 2024-04-20T21:59:08.235 INFO:tasks.workunit.client.1.smithi164.stdout:6/803: chown d0/d3/d15/d21/d5c/dbf/dbd/ddf/d81/fc2 2600 1 2024-04-20T21:59:08.238 INFO:tasks.workunit.client.1.smithi164.stdout:5/824: creat dc/d2b/d6d/d73/dab/d10c/f119 x:0 0 0 2024-04-20T21:59:08.241 INFO:tasks.workunit.client.1.smithi164.stdout:7/778: mknod d2/d21/d24/d31/d3a/d83/d6a/de4/c105 0 2024-04-20T21:59:08.241 INFO:tasks.workunit.client.1.smithi164.stdout:6/804: rename d0/d3 to d0/d3/d15/d21/d5c/dbf/d107/d10e 22 2024-04-20T21:59:08.244 INFO:tasks.workunit.client.1.smithi164.stdout:7/779: read - d2/d21/d24/f61 zero size 2024-04-20T21:59:08.244 INFO:tasks.workunit.client.1.smithi164.stdout:2/765: creat d2/d30/de8/fee x:0 0 0 2024-04-20T21:59:08.262 INFO:tasks.workunit.client.1.smithi164.stdout:2/766: dwrite d2/f1b [0,4194304] 0 2024-04-20T21:59:08.269 INFO:tasks.workunit.client.1.smithi164.stdout:1/703: dwrite d10/d33/d41/f63 [0,4194304] 0 2024-04-20T21:59:08.285 INFO:tasks.workunit.client.1.smithi164.stdout:8/683: unlink d0/d14/d16/l38 0 2024-04-20T21:59:08.287 INFO:tasks.workunit.client.1.smithi164.stdout:4/728: mknod d4/d28/dad/ce7 0 2024-04-20T21:59:08.288 INFO:tasks.workunit.client.1.smithi164.stdout:5/825: rename dc/d2b/d6d/ccb to dc/d12/d81/d116/c11a 0 2024-04-20T21:59:08.291 INFO:tasks.workunit.client.1.smithi164.stdout:6/805: chown d0/d3/d11/d29/d6e/d41/c79 51256 1 2024-04-20T21:59:08.292 INFO:tasks.workunit.client.1.smithi164.stdout:9/830: unlink d3/db0/dd3/fe2 0 2024-04-20T21:59:08.295 INFO:tasks.workunit.client.1.smithi164.stdout:7/780: mkdir d2/d21/d24/d31/d3a/d83/d106 0 2024-04-20T21:59:08.305 INFO:tasks.workunit.client.1.smithi164.stdout:4/729: dwrite d4/d9/d42/f99 [0,4194304] 0 2024-04-20T21:59:08.305 INFO:tasks.workunit.client.1.smithi164.stdout:1/704: dread d10/d33/d48/f6b [0,4194304] 0 2024-04-20T21:59:08.306 INFO:tasks.workunit.client.1.smithi164.stdout:0/723: symlink d1/d4/d26/d29/lcd 0 2024-04-20T21:59:08.306 INFO:tasks.workunit.client.1.smithi164.stdout:4/730: chown d4/d28/d3e/d41 1442184 1 2024-04-20T21:59:08.311 INFO:tasks.workunit.client.1.smithi164.stdout:9/831: dwrite d3/db/dd/d40/d78/f10c [0,4194304] 0 2024-04-20T21:59:08.313 INFO:tasks.workunit.client.1.smithi164.stdout:9/832: fsync d3/db/d1b/d1e/f105 0 2024-04-20T21:59:08.313 INFO:tasks.workunit.client.1.smithi164.stdout:5/826: mkdir dc/d12/d1e/def/d11b 0 2024-04-20T21:59:08.314 INFO:tasks.workunit.client.1.smithi164.stdout:5/827: chown dc/d2c 108 1 2024-04-20T21:59:08.317 INFO:tasks.workunit.client.1.smithi164.stdout:6/806: creat d0/d3/d15/d21/d5c/dbf/db4/dcd/f10f x:0 0 0 2024-04-20T21:59:08.317 INFO:tasks.workunit.client.1.smithi164.stdout:9/833: chown d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/l6c 786 1 2024-04-20T21:59:08.318 INFO:tasks.workunit.client.1.smithi164.stdout:2/767: mknod d2/d5/d3a/cef 0 2024-04-20T21:59:08.319 INFO:tasks.workunit.client.1.smithi164.stdout:9/834: dread - d3/db/dd/d40/ff0 zero size 2024-04-20T21:59:08.322 INFO:tasks.workunit.client.1.smithi164.stdout:7/781: mkdir d2/d21/d24/d31/d3a/d83/dcf/dea/d107 0 2024-04-20T21:59:08.323 INFO:tasks.workunit.client.1.smithi164.stdout:9/835: dread - d3/db/dc4/fff zero size 2024-04-20T21:59:08.324 INFO:tasks.workunit.client.1.smithi164.stdout:7/782: read d2/d21/d44/fce [328167,39620] 0 2024-04-20T21:59:08.326 INFO:tasks.workunit.client.1.smithi164.stdout:9/836: read - d3/db/dd/d75/f117 zero size 2024-04-20T21:59:08.330 INFO:tasks.workunit.client.1.smithi164.stdout:4/731: fdatasync d4/d9/d27/f7a 0 2024-04-20T21:59:08.333 INFO:tasks.workunit.client.1.smithi164.stdout:4/732: read d4/d28/f76 [2929018,36728] 0 2024-04-20T21:59:08.335 INFO:tasks.workunit.client.1.smithi164.stdout:6/807: mknod d0/d3/d62/d8e/c110 0 2024-04-20T21:59:08.338 INFO:tasks.workunit.client.1.smithi164.stdout:3/817: write d12/d15/f38 [2329882,28573] 0 2024-04-20T21:59:08.343 INFO:tasks.workunit.client.1.smithi164.stdout:8/684: creat d0/fe7 x:0 0 0 2024-04-20T21:59:08.348 INFO:tasks.workunit.client.1.smithi164.stdout:0/724: link d1/d4/d49/f95 d1/d4/d26/d29/d2d/d9b/fce 0 2024-04-20T21:59:08.360 INFO:tasks.workunit.client.1.smithi164.stdout:9/837: write d3/db/dd/d40/d2a/f4a [2338142,27180] 0 2024-04-20T21:59:08.367 INFO:tasks.workunit.client.1.smithi164.stdout:8/685: symlink d0/d14/d4e/d62/d8f/le8 0 2024-04-20T21:59:08.369 INFO:tasks.workunit.client.1.smithi164.stdout:4/733: write d4/d28/d3e/f59 [529535,85629] 0 2024-04-20T21:59:08.372 INFO:tasks.workunit.client.1.smithi164.stdout:4/734: dread - d4/d9/d27/d37/fd8 zero size 2024-04-20T21:59:08.376 INFO:tasks.workunit.client.1.smithi164.stdout:5/828: dwrite f9 [0,4194304] 0 2024-04-20T21:59:08.380 INFO:tasks.workunit.client.1.smithi164.stdout:6/808: dwrite d0/d3/d11/faf [0,4194304] 0 2024-04-20T21:59:08.385 INFO:tasks.workunit.client.1.smithi164.stdout:2/768: dwrite d2/d5/f1d [0,4194304] 0 2024-04-20T21:59:08.388 INFO:tasks.workunit.client.1.smithi164.stdout:0/725: creat d1/d4/df/dbe/fcf x:0 0 0 2024-04-20T21:59:08.391 INFO:tasks.workunit.client.1.smithi164.stdout:6/809: chown d0/d3/d15/d21/cef 3365 1 2024-04-20T21:59:08.395 INFO:tasks.workunit.client.1.smithi164.stdout:5/829: dwrite dc/d2c/d2e/f46 [0,4194304] 0 2024-04-20T21:59:08.402 INFO:tasks.workunit.client.1.smithi164.stdout:8/686: mknod d0/d14/d5f/ce9 0 2024-04-20T21:59:08.404 INFO:tasks.workunit.client.1.smithi164.stdout:2/769: dwrite d2/d5/d21/f37 [0,4194304] 0 2024-04-20T21:59:08.408 INFO:tasks.workunit.client.1.smithi164.stdout:2/770: read d2/f1b [832153,41462] 0 2024-04-20T21:59:08.409 INFO:tasks.workunit.client.1.smithi164.stdout:7/783: getdents d2/d21/d24/d31/d3a/daa/db8 0 2024-04-20T21:59:08.409 INFO:tasks.workunit.client.1.smithi164.stdout:9/838: write d3/db/dd/f6b [5235927,15568] 0 2024-04-20T21:59:08.412 INFO:tasks.workunit.client.1.smithi164.stdout:3/818: dwrite d12/d6d/f8e [0,4194304] 0 2024-04-20T21:59:08.425 INFO:tasks.workunit.client.1.smithi164.stdout:1/705: sync 2024-04-20T21:59:08.427 INFO:tasks.workunit.client.1.smithi164.stdout:4/735: rmdir d4/d28/d3e/d41/de6 0 2024-04-20T21:59:08.428 INFO:tasks.workunit.client.1.smithi164.stdout:7/784: symlink d2/d21/d24/l108 0 2024-04-20T21:59:08.430 INFO:tasks.workunit.client.1.smithi164.stdout:0/726: rename d1/d4/d20/f40 to d1/fd0 0 2024-04-20T21:59:08.432 INFO:tasks.workunit.client.1.smithi164.stdout:7/785: dread d2/d21/d33/f40 [0,4194304] 0 2024-04-20T21:59:08.432 INFO:tasks.workunit.client.1.smithi164.stdout:0/727: readlink d1/d4/da/d5c/d6e/laa 0 2024-04-20T21:59:08.433 INFO:tasks.workunit.client.1.smithi164.stdout:8/687: creat d0/d14/d16/d58/fea x:0 0 0 2024-04-20T21:59:08.434 INFO:tasks.workunit.client.1.smithi164.stdout:7/786: chown d2/d21/d44/c7a 3 1 2024-04-20T21:59:08.436 INFO:tasks.workunit.client.1.smithi164.stdout:0/728: read d1/d4/d26/d29/d2d/d9b/fce [2525480,62335] 0 2024-04-20T21:59:08.437 INFO:tasks.workunit.client.1.smithi164.stdout:6/810: write d0/d3/d11/d5a/f89 [1649297,72115] 0 2024-04-20T21:59:08.438 INFO:tasks.workunit.client.1.smithi164.stdout:4/736: creat d4/d28/d3e/d41/fe8 x:0 0 0 2024-04-20T21:59:08.441 INFO:tasks.workunit.client.1.smithi164.stdout:2/771: write d2/f78 [1006859,67181] 0 2024-04-20T21:59:08.444 INFO:tasks.workunit.client.1.smithi164.stdout:9/839: link d3/db/dd/d40/d2a/d36/f48 d3/db/d82/d98/f129 0 2024-04-20T21:59:08.445 INFO:tasks.workunit.client.1.smithi164.stdout:9/840: stat d3/d9f/da1/f126 0 2024-04-20T21:59:08.445 INFO:tasks.workunit.client.1.smithi164.stdout:9/841: chown d3/db0 160086 1 2024-04-20T21:59:08.449 INFO:tasks.workunit.client.1.smithi164.stdout:4/737: rmdir d4/d9/d5c 39 2024-04-20T21:59:08.450 INFO:tasks.workunit.client.1.smithi164.stdout:0/729: creat d1/d4/d20/d74/fd1 x:0 0 0 2024-04-20T21:59:08.450 INFO:tasks.workunit.client.1.smithi164.stdout:6/811: mknod d0/d3/d15/d21/d4b/c111 0 2024-04-20T21:59:08.452 INFO:tasks.workunit.client.1.smithi164.stdout:0/730: chown d1/d4/d26/d29/d2d/d54/d77/d3c 834 1 2024-04-20T21:59:08.452 INFO:tasks.workunit.client.1.smithi164.stdout:6/812: chown d0/d3/d11/d29/l35 13 1 2024-04-20T21:59:08.453 INFO:tasks.workunit.client.1.smithi164.stdout:5/830: rename dc/d12/c6a to dc/d2c/d2e/d30/d72/da9/df0/c11c 0 2024-04-20T21:59:08.454 INFO:tasks.workunit.client.1.smithi164.stdout:3/819: getdents d12/d20/d39/d69/d9a/dbe 0 2024-04-20T21:59:08.455 INFO:tasks.workunit.client.1.smithi164.stdout:5/831: chown dc/d2c/lca 323176 1 2024-04-20T21:59:08.458 INFO:tasks.workunit.client.1.smithi164.stdout:8/688: getdents d0/d14/d4e/d6f/de3 0 2024-04-20T21:59:08.462 INFO:tasks.workunit.client.1.smithi164.stdout:9/842: symlink d3/db/dd/d40/d2a/d36/d51/da3/l12a 0 2024-04-20T21:59:08.469 INFO:tasks.workunit.client.1.smithi164.stdout:3/820: creat d12/d15/dae/f10d x:0 0 0 2024-04-20T21:59:08.471 INFO:tasks.workunit.client.1.smithi164.stdout:7/787: write d2/d21/f28 [2783331,121814] 0 2024-04-20T21:59:08.471 INFO:tasks.workunit.client.1.smithi164.stdout:1/706: write d10/d16/d20/f69 [4279732,45346] 0 2024-04-20T21:59:08.475 INFO:tasks.workunit.client.1.smithi164.stdout:4/738: creat d4/d9/d5c/d97/fe9 x:0 0 0 2024-04-20T21:59:08.477 INFO:tasks.workunit.client.1.smithi164.stdout:0/731: mkdir d1/d4/da/dd2 0 2024-04-20T21:59:08.479 INFO:tasks.workunit.client.1.smithi164.stdout:5/832: mknod dc/d12/d1e/d101/c11d 0 2024-04-20T21:59:08.480 INFO:tasks.workunit.client.1.smithi164.stdout:3/821: mknod d12/d20/d39/d69/d9a/dbe/c10e 0 2024-04-20T21:59:08.482 INFO:tasks.workunit.client.1.smithi164.stdout:1/707: mknod d10/d7d/ce8 0 2024-04-20T21:59:08.483 INFO:tasks.workunit.client.1.smithi164.stdout:7/788: creat d2/d21/d24/d31/d3a/d83/d63/d85/dbe/f109 x:0 0 0 2024-04-20T21:59:08.484 INFO:tasks.workunit.client.1.smithi164.stdout:4/739: dread d4/d28/d3e/d4a/f9f [0,4194304] 0 2024-04-20T21:59:08.484 INFO:tasks.workunit.client.1.smithi164.stdout:6/813: dwrite d0/d3/d11/f39 [0,4194304] 0 2024-04-20T21:59:08.486 INFO:tasks.workunit.client.1.smithi164.stdout:2/772: rename d2/d19/d28/d3e/fc3 to d2/d30/ff0 0 2024-04-20T21:59:08.491 INFO:tasks.workunit.client.1.smithi164.stdout:4/740: stat d4/d9/d27/c33 0 2024-04-20T21:59:08.492 INFO:tasks.workunit.client.1.smithi164.stdout:3/822: write f6 [1869777,82908] 0 2024-04-20T21:59:08.497 INFO:tasks.workunit.client.1.smithi164.stdout:8/689: dwrite d0/d14/d16/d5a/f89 [0,4194304] 0 2024-04-20T21:59:08.497 INFO:tasks.workunit.client.1.smithi164.stdout:6/814: unlink d0/d3/d15/d21/d4b/l94 0 2024-04-20T21:59:08.503 INFO:tasks.workunit.client.1.smithi164.stdout:7/789: symlink d2/d21/d24/d31/d3a/d83/d6a/l10a 0 2024-04-20T21:59:08.505 INFO:tasks.workunit.client.1.smithi164.stdout:9/843: dwrite d3/db/d1b/d20/fb4 [0,4194304] 0 2024-04-20T21:59:08.509 INFO:tasks.workunit.client.1.smithi164.stdout:3/823: creat d12/d20/d39/d55/d6b/d79/dcc/f10f x:0 0 0 2024-04-20T21:59:08.515 INFO:tasks.workunit.client.1.smithi164.stdout:5/833: getdents dc/d2b/d6d/d73/de3 0 2024-04-20T21:59:08.516 INFO:tasks.workunit.client.1.smithi164.stdout:0/732: dread d1/d4/da/d5c/d6e/f7a [0,4194304] 0 2024-04-20T21:59:08.518 INFO:tasks.workunit.client.1.smithi164.stdout:2/773: rename d2/d5/d3a/c99 to d2/d5/d3a/d65/cf1 0 2024-04-20T21:59:08.523 INFO:tasks.workunit.client.1.smithi164.stdout:2/774: write d2/d5f/fa9 [4109714,73328] 0 2024-04-20T21:59:08.526 INFO:tasks.workunit.client.1.smithi164.stdout:8/690: write d0/d14/d5f/f6e [487301,91463] 0 2024-04-20T21:59:08.526 INFO:tasks.workunit.client.1.smithi164.stdout:2/775: chown d2/d5/d21 2568879 1 2024-04-20T21:59:08.529 INFO:tasks.workunit.client.1.smithi164.stdout:5/834: rename dc/l5b to dc/d12/d1e/d101/l11e 0 2024-04-20T21:59:08.534 INFO:tasks.workunit.client.1.smithi164.stdout:1/708: getdents d10/d16/d19/de0/d34/da9 0 2024-04-20T21:59:08.536 INFO:tasks.workunit.client.1.smithi164.stdout:6/815: truncate d0/d3/d11/faf 1151336 0 2024-04-20T21:59:08.538 INFO:tasks.workunit.client.1.smithi164.stdout:0/733: dwrite d1/d4/d20/f79 [0,4194304] 0 2024-04-20T21:59:08.544 INFO:tasks.workunit.client.1.smithi164.stdout:5/835: unlink dc/d2c/l5f 0 2024-04-20T21:59:08.548 INFO:tasks.workunit.client.1.smithi164.stdout:2/776: fdatasync d2/d19/d28/fc5 0 2024-04-20T21:59:08.552 INFO:tasks.workunit.client.1.smithi164.stdout:4/741: dread d4/d28/d3e/d41/fd7 [0,4194304] 0 2024-04-20T21:59:08.552 INFO:tasks.workunit.client.1.smithi164.stdout:9/844: getdents d3/db/d1b/d20/d3f/d8a/da7/dbd/d67 0 2024-04-20T21:59:08.553 INFO:tasks.workunit.client.1.smithi164.stdout:0/734: chown d1/d4/f2c 467630 1 2024-04-20T21:59:08.554 INFO:tasks.workunit.client.1.smithi164.stdout:8/691: dwrite d0/f4d [0,4194304] 0 2024-04-20T21:59:08.557 INFO:tasks.workunit.client.1.smithi164.stdout:7/790: dwrite d2/d21/d33/f40 [0,4194304] 0 2024-04-20T21:59:08.562 INFO:tasks.workunit.client.1.smithi164.stdout:5/836: write dc/d2b/d53/f10f [463278,72213] 0 2024-04-20T21:59:08.562 INFO:tasks.workunit.client.1.smithi164.stdout:3/824: dwrite f11 [0,4194304] 0 2024-04-20T21:59:08.569 INFO:tasks.workunit.client.1.smithi164.stdout:7/791: rmdir d2 39 2024-04-20T21:59:08.575 INFO:tasks.workunit.client.1.smithi164.stdout:1/709: creat d10/d33/d48/d8b/fe9 x:0 0 0 2024-04-20T21:59:08.577 INFO:tasks.workunit.client.1.smithi164.stdout:8/692: truncate d0/f48 7826 0 2024-04-20T21:59:08.577 INFO:tasks.workunit.client.1.smithi164.stdout:9/845: mknod d3/db/d82/d98/c12b 0 2024-04-20T21:59:08.578 INFO:tasks.workunit.client.1.smithi164.stdout:6/816: creat d0/d3/d15/d21/d5c/dbf/d107/f112 x:0 0 0 2024-04-20T21:59:08.581 INFO:tasks.workunit.client.1.smithi164.stdout:1/710: write d10/d16/d19/de0/d34/da9/fc3 [807481,64764] 0 2024-04-20T21:59:08.581 INFO:tasks.workunit.client.1.smithi164.stdout:2/777: mknod d2/d5/d3a/d55/d58/da2/db0/cf2 0 2024-04-20T21:59:08.581 INFO:tasks.workunit.client.1.smithi164.stdout:4/742: symlink d4/d9/d5c/d97/dbf/d67/d86/dc3/lea 0 2024-04-20T21:59:08.582 INFO:tasks.workunit.client.1.smithi164.stdout:5/837: mkdir dc/d2c/d2e/dbd/d11f 0 2024-04-20T21:59:08.584 INFO:tasks.workunit.client.1.smithi164.stdout:3/825: mkdir d12/d20/d39/d69/dad/d110 0 2024-04-20T21:59:08.589 INFO:tasks.workunit.client.1.smithi164.stdout:0/735: write d1/f12 [1553175,81697] 0 2024-04-20T21:59:08.593 INFO:tasks.workunit.client.1.smithi164.stdout:8/693: creat d0/d14/d4e/d6f/de3/feb x:0 0 0 2024-04-20T21:59:08.594 INFO:tasks.workunit.client.1.smithi164.stdout:7/792: mknod d2/d21/d24/d31/d3a/daa/db8/c10b 0 2024-04-20T21:59:08.595 INFO:tasks.workunit.client.1.smithi164.stdout:6/817: symlink d0/d3/d15/d21/d5c/df4/l113 0 2024-04-20T21:59:08.598 INFO:tasks.workunit.client.1.smithi164.stdout:9/846: mkdir d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/dbf/d12c 0 2024-04-20T21:59:08.605 INFO:tasks.workunit.client.1.smithi164.stdout:7/793: write d2/d21/d24/d31/d3a/d83/d68/f103 [815728,121684] 0 2024-04-20T21:59:08.606 INFO:tasks.workunit.client.1.smithi164.stdout:9/847: chown d3/db/dd/d40/d2a/cdd 27586678 1 2024-04-20T21:59:08.607 INFO:tasks.workunit.client.1.smithi164.stdout:8/694: symlink d0/d14/d4e/d86/lec 0 2024-04-20T21:59:08.611 INFO:tasks.workunit.client.1.smithi164.stdout:5/838: dwrite dc/d2b/da0/df8/f114 [0,4194304] 0 2024-04-20T21:59:08.612 INFO:tasks.workunit.client.1.smithi164.stdout:2/778: dwrite d2/d5/d3a/f5a [8388608,4194304] 0 2024-04-20T21:59:08.613 INFO:tasks.workunit.client.1.smithi164.stdout:1/711: dwrite d10/d16/d20/d66/fb3 [0,4194304] 0 2024-04-20T21:59:08.618 INFO:tasks.workunit.client.1.smithi164.stdout:9/848: fdatasync d3/db/d1b/f34 0 2024-04-20T21:59:08.622 INFO:tasks.workunit.client.1.smithi164.stdout:6/818: mkdir d0/d3/d15/d21/d101/d45/d4f/d9c/d104/d114 0 2024-04-20T21:59:08.623 INFO:tasks.workunit.client.1.smithi164.stdout:4/743: dwrite d4/d9/d27/f32 [4194304,4194304] 0 2024-04-20T21:59:08.688 INFO:tasks.workunit.client.1.smithi164.stdout:2/779: creat d2/ff3 x:0 0 0 2024-04-20T21:59:08.695 INFO:tasks.workunit.client.1.smithi164.stdout:5/839: dread dc/d41/f65 [0,4194304] 0 2024-04-20T21:59:08.695 INFO:tasks.workunit.client.1.smithi164.stdout:7/794: dwrite d2/d21/d24/d31/d3a/daa/db8/fec [0,4194304] 0 2024-04-20T21:59:08.696 INFO:tasks.workunit.client.1.smithi164.stdout:5/840: write dc/f25 [1876702,72193] 0 2024-04-20T21:59:08.699 INFO:tasks.workunit.client.1.smithi164.stdout:7/795: read d2/d21/d44/dd4/f9f [8044249,115428] 0 2024-04-20T21:59:08.713 INFO:tasks.workunit.client.1.smithi164.stdout:0/736: rename d1/d4/da/l4d to d1/d4/df/d56/ld3 0 2024-04-20T21:59:08.715 INFO:tasks.workunit.client.1.smithi164.stdout:0/737: write d1/d4/df/d56/f8c [3692676,84555] 0 2024-04-20T21:59:08.717 INFO:tasks.workunit.client.1.smithi164.stdout:4/744: mkdir d4/d9/d5c/d97/dbf/d5f/dcc/deb 0 2024-04-20T21:59:08.717 INFO:tasks.workunit.client.1.smithi164.stdout:3/826: sync 2024-04-20T21:59:08.717 INFO:tasks.workunit.client.1.smithi164.stdout:9/849: getdents d3/db/d1b/d20/d3f/d8a/da7/d11b 0 2024-04-20T21:59:08.720 INFO:tasks.workunit.client.1.smithi164.stdout:0/738: dread d1/d4/da/d27/f90 [0,4194304] 0 2024-04-20T21:59:08.739 INFO:tasks.workunit.client.1.smithi164.stdout:6/819: link d0/fdd d0/d3/d15/d21/d101/d45/d69/f115 0 2024-04-20T21:59:08.742 INFO:tasks.workunit.client.1.smithi164.stdout:8/695: truncate d0/d14/d4e/d6f/f79 2210926 0 2024-04-20T21:59:08.742 INFO:tasks.workunit.client.1.smithi164.stdout:8/696: stat d0/d14/d4e/l6d 0 2024-04-20T21:59:08.743 INFO:tasks.workunit.client.1.smithi164.stdout:3/827: unlink d12/c78 0 2024-04-20T21:59:08.743 INFO:tasks.workunit.client.1.smithi164.stdout:8/697: chown d0/d14/f2a 4025 1 2024-04-20T21:59:08.744 INFO:tasks.workunit.client.1.smithi164.stdout:4/745: mknod d4/d9/d5c/d97/dbf/d67/d86/cec 0 2024-04-20T21:59:08.746 INFO:tasks.workunit.client.1.smithi164.stdout:2/780: write d2/d5/d21/f57 [502819,58987] 0 2024-04-20T21:59:08.748 INFO:tasks.workunit.client.1.smithi164.stdout:7/796: mknod d2/d21/d24/d31/d3a/d83/d63/d85/c10c 0 2024-04-20T21:59:08.751 INFO:tasks.workunit.client.1.smithi164.stdout:6/820: mknod d0/d3/d15/d21/d5c/dbf/d97/c116 0 2024-04-20T21:59:08.754 INFO:tasks.workunit.client.1.smithi164.stdout:8/698: symlink d0/d14/d16/d58/d73/led 0 2024-04-20T21:59:08.756 INFO:tasks.workunit.client.1.smithi164.stdout:4/746: unlink d4/d9/d22/ca9 0 2024-04-20T21:59:08.756 INFO:tasks.workunit.client.1.smithi164.stdout:9/850: dwrite d3/db/f8c [4194304,4194304] 0 2024-04-20T21:59:08.756 INFO:tasks.workunit.client.1.smithi164.stdout:8/699: write d0/f4b [480056,63260] 0 2024-04-20T21:59:08.759 INFO:tasks.workunit.client.1.smithi164.stdout:9/851: readlink d3/d9f/lc8 0 2024-04-20T21:59:08.764 INFO:tasks.workunit.client.1.smithi164.stdout:2/781: unlink d2/d5/d3a/d55/f68 0 2024-04-20T21:59:08.765 INFO:tasks.workunit.client.1.smithi164.stdout:5/841: dwrite dc/d2c/f90 [0,4194304] 0 2024-04-20T21:59:08.769 INFO:tasks.workunit.client.1.smithi164.stdout:0/739: write d1/d4/d26/d29/d2d/f89 [1012398,55217] 0 2024-04-20T21:59:08.771 INFO:tasks.workunit.client.1.smithi164.stdout:0/740: chown d1/d4/l92 9 1 2024-04-20T21:59:08.772 INFO:tasks.workunit.client.1.smithi164.stdout:4/747: symlink d4/d9/d27/d37/led 0 2024-04-20T21:59:08.776 INFO:tasks.workunit.client.1.smithi164.stdout:1/712: sync 2024-04-20T21:59:08.784 INFO:tasks.workunit.client.1.smithi164.stdout:7/797: dwrite d2/d21/f89 [0,4194304] 0 2024-04-20T21:59:08.785 INFO:tasks.workunit.client.1.smithi164.stdout:3/828: dwrite f4 [0,4194304] 0 2024-04-20T21:59:08.792 INFO:tasks.workunit.client.1.smithi164.stdout:2/782: truncate d2/d5f/f60 736359 0 2024-04-20T21:59:08.792 INFO:tasks.workunit.client.1.smithi164.stdout:8/700: mkdir d0/d14/dee 0 2024-04-20T21:59:08.795 INFO:tasks.workunit.client.1.smithi164.stdout:4/748: rename d4/d9/lb7 to d4/d28/d3e/d41/lee 0 2024-04-20T21:59:08.795 INFO:tasks.workunit.client.1.smithi164.stdout:7/798: mkdir d2/d21/d24/d31/d3a/d10d 0 2024-04-20T21:59:08.798 INFO:tasks.workunit.client.1.smithi164.stdout:9/852: link d3/db/dd/d40/d2a/d36/fa0 d3/db/d1b/f12d 0 2024-04-20T21:59:08.803 INFO:tasks.workunit.client.1.smithi164.stdout:7/799: write d2/f16 [3095386,30364] 0 2024-04-20T21:59:08.804 INFO:tasks.workunit.client.1.smithi164.stdout:4/749: chown d4/d9/d27/d37/f51 410 1 2024-04-20T21:59:08.805 INFO:tasks.workunit.client.1.smithi164.stdout:3/829: mkdir d12/d20/d39/d69/dad/de2/d111 0 2024-04-20T21:59:08.807 INFO:tasks.workunit.client.1.smithi164.stdout:0/741: dwrite d1/d4/f7e [0,4194304] 0 2024-04-20T21:59:08.809 INFO:tasks.workunit.client.1.smithi164.stdout:4/750: chown d4/d28/f6f 14 1 2024-04-20T21:59:08.809 INFO:tasks.workunit.client.1.smithi164.stdout:1/713: dwrite d10/d16/d19/de0/fe5 [0,4194304] 0 2024-04-20T21:59:08.810 INFO:tasks.workunit.client.1.smithi164.stdout:6/821: truncate d0/fc9 3680832 0 2024-04-20T21:59:08.814 INFO:tasks.workunit.client.1.smithi164.stdout:9/853: mknod d3/db/d1b/d20/d3f/d8a/da7/d11b/c12e 0 2024-04-20T21:59:08.814 INFO:tasks.workunit.client.1.smithi164.stdout:0/742: chown d1/d4/d26/c50 64796 1 2024-04-20T21:59:08.814 INFO:tasks.workunit.client.1.smithi164.stdout:1/714: chown d10/d7d/la7 213296 1 2024-04-20T21:59:08.815 INFO:tasks.workunit.client.1.smithi164.stdout:8/701: rename d0/d14/d16/d58/d94/f98 to d0/d14/d16/d58/d94/da5/dad/fef 0 2024-04-20T21:59:08.821 INFO:tasks.workunit.client.1.smithi164.stdout:3/830: symlink d12/d20/d39/ddc/l112 0 2024-04-20T21:59:08.830 INFO:tasks.workunit.client.1.smithi164.stdout:5/842: write dc/d2b/fdc [1113882,106567] 0 2024-04-20T21:59:08.838 INFO:tasks.workunit.client.1.smithi164.stdout:6/822: rename d0/d3/d15/d21/d5c/dbf/dbd/ddf/d28/d6f/l106 to d0/d3/d4a/l117 0 2024-04-20T21:59:08.840 INFO:tasks.workunit.client.1.smithi164.stdout:3/831: truncate d12/d20/f48 747299 0 2024-04-20T21:59:08.840 INFO:tasks.workunit.client.1.smithi164.stdout:7/800: dread d2/d21/d24/d31/d3a/daa/fcc [0,4194304] 0 2024-04-20T21:59:08.841 INFO:tasks.workunit.client.1.smithi164.stdout:2/783: dread d2/d5/f82 [0,4194304] 0 2024-04-20T21:59:08.850 INFO:tasks.workunit.client.1.smithi164.stdout:5/843: mkdir dc/d12/d81/d120 0 2024-04-20T21:59:08.855 INFO:tasks.workunit.client.1.smithi164.stdout:3/832: mkdir d12/d6d/d113 0 2024-04-20T21:59:08.856 INFO:tasks.workunit.client.1.smithi164.stdout:7/801: chown d2/l1a 440 1 2024-04-20T21:59:08.858 INFO:tasks.workunit.client.1.smithi164.stdout:3/833: stat d12/d68/d6f/c9e 0 2024-04-20T21:59:08.859 INFO:tasks.workunit.client.1.smithi164.stdout:1/715: dread d10/f9e [0,4194304] 0 2024-04-20T21:59:08.860 INFO:tasks.workunit.client.1.smithi164.stdout:2/784: fsync d2/d5/d3a/f3b 0 2024-04-20T21:59:08.860 INFO:tasks.workunit.client.1.smithi164.stdout:7/802: chown d2/d21/d24/daf/lb6 534093370 1 2024-04-20T21:59:08.861 INFO:tasks.workunit.client.1.smithi164.stdout:8/702: dread d0/d14/d16/f70 [0,4194304] 0 2024-04-20T21:59:08.862 INFO:tasks.workunit.client.1.smithi164.stdout:1/716: write d10/d33/d48/d8b/fe9 [852069,66461] 0 2024-04-20T21:59:08.863 INFO:tasks.workunit.client.1.smithi164.stdout:0/743: creat d1/d4/da/d5c/fd4 x:0 0 0 2024-04-20T21:59:08.864 INFO:tasks.workunit.client.1.smithi164.stdout:6/823: symlink d0/d3/d15/d21/d100/l118 0 2024-04-20T21:59:08.865 INFO:tasks.workunit.client.1.smithi164.stdout:3/834: unlink d12/f90 0 2024-04-20T21:59:08.866 INFO:tasks.workunit.client.1.smithi164.stdout:4/751: write d4/d28/f6b [1859323,36507] 0 2024-04-20T21:59:08.867 INFO:tasks.workunit.client.1.smithi164.stdout:0/744: write d1/d4/f28 [1106000,40651] 0 2024-04-20T21:59:08.870 INFO:tasks.workunit.client.1.smithi164.stdout:7/803: rmdir d2/d21/d24/d31/d3a/d83/dcf 39 2024-04-20T21:59:08.871 INFO:tasks.workunit.client.1.smithi164.stdout:5/844: dread dc/d2c/d2e/dbd/df9/f102 [0,4194304] 0 2024-04-20T21:59:08.871 INFO:tasks.workunit.client.1.smithi164.stdout:8/703: fsync d0/d14/d4e/d86/fa4 0 2024-04-20T21:59:08.873 INFO:tasks.workunit.client.1.smithi164.stdout:0/745: read d1/f1b [479378,51998] 0 2024-04-20T21:59:08.880 INFO:tasks.workunit.client.1.smithi164.stdout:4/752: rename d4/d28 to d4/d9/d5c/d97/dbf/d67/d86/def 0 2024-04-20T21:59:08.884 INFO:tasks.workunit.client.1.smithi164.stdout:3/835: truncate d12/d15/f19 1634786 0 2024-04-20T21:59:08.885 INFO:tasks.workunit.client.1.smithi164.stdout:6/824: symlink d0/d3/d15/d21/d101/d3b/l119 0 2024-04-20T21:59:08.889 INFO:tasks.workunit.client.1.smithi164.stdout:0/746: creat d1/d4/d20/fd5 x:0 0 0 2024-04-20T21:59:08.889 INFO:tasks.workunit.client.1.smithi164.stdout:1/717: write d10/f8f [1007697,31077] 0 2024-04-20T21:59:08.889 INFO:tasks.workunit.client.1.smithi164.stdout:8/704: truncate d0/d1e/f6b 2161295 0 2024-04-20T21:59:08.892 INFO:tasks.workunit.client.1.smithi164.stdout:3/836: symlink d12/d20/d39/d69/dad/de2/l114 0 2024-04-20T21:59:08.893 INFO:tasks.workunit.client.1.smithi164.stdout:2/785: write d2/d5f/f7d [382090,127687] 0 2024-04-20T21:59:08.894 INFO:tasks.workunit.client.1.smithi164.stdout:7/804: symlink d2/d21/d24/d31/d3a/d83/d6a/de7/l10e 0 2024-04-20T21:59:08.896 INFO:tasks.workunit.client.1.smithi164.stdout:8/705: dread d0/f4b [0,4194304] 0 2024-04-20T21:59:08.898 INFO:tasks.workunit.client.1.smithi164.stdout:0/747: creat d1/d4/df/dbe/fd6 x:0 0 0 2024-04-20T21:59:08.901 INFO:tasks.workunit.client.1.smithi164.stdout:1/718: chown d10/d16/d19/de0/d34/lc2 25 1 2024-04-20T21:59:08.901 INFO:tasks.workunit.client.1.smithi164.stdout:0/748: chown d1/d4/da/d27/f70 4731746 1 2024-04-20T21:59:08.902 INFO:tasks.workunit.client.1.smithi164.stdout:2/786: mkdir d2/dab/df4 0 2024-04-20T21:59:08.905 INFO:tasks.workunit.client.1.smithi164.stdout:4/753: dread d4/d9/d22/f2f [0,4194304] 0 2024-04-20T21:59:08.905 INFO:tasks.workunit.client.1.smithi164.stdout:7/805: mkdir d2/d21/d24/d31/d3a/d83/d6a/de7/d10f 0 2024-04-20T21:59:08.906 INFO:tasks.workunit.client.1.smithi164.stdout:8/706: mknod d0/d14/d16/d58/d94/da5/dad/cf0 0 2024-04-20T21:59:08.908 INFO:tasks.workunit.client.1.smithi164.stdout:3/837: mknod d12/d20/d39/d69/dad/de2/d111/c115 0 2024-04-20T21:59:08.910 INFO:tasks.workunit.client.1.smithi164.stdout:3/838: read d12/d6d/f8e [2301033,109971] 0 2024-04-20T21:59:08.911 INFO:tasks.workunit.client.1.smithi164.stdout:4/754: dread - d4/d9/d5c/d97/dbf/fe3 zero size 2024-04-20T21:59:08.912 INFO:tasks.workunit.client.1.smithi164.stdout:6/825: dwrite d0/d3/d15/d21/d5c/dbf/fcb [0,4194304] 0 2024-04-20T21:59:08.914 INFO:tasks.workunit.client.1.smithi164.stdout:0/749: creat d1/d4/df/fd7 x:0 0 0 2024-04-20T21:59:08.915 INFO:tasks.workunit.client.1.smithi164.stdout:7/806: write d2/d21/d24/d31/d3a/d83/dcf/dea/ff3 [632838,8084] 0 2024-04-20T21:59:08.919 INFO:tasks.workunit.client.1.smithi164.stdout:3/839: creat d12/d2a/db1/f116 x:0 0 0 2024-04-20T21:59:08.923 INFO:tasks.workunit.client.1.smithi164.stdout:4/755: rmdir d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41 39 2024-04-20T21:59:08.926 INFO:tasks.workunit.client.1.smithi164.stdout:8/707: write d0/d14/d16/d5a/f6c [1331278,68466] 0 2024-04-20T21:59:08.927 INFO:tasks.workunit.client.1.smithi164.stdout:6/826: fdatasync d0/d3/d15/d21/d5c/dbf/dbd/ddf/fa 0 2024-04-20T21:59:08.927 INFO:tasks.workunit.client.1.smithi164.stdout:7/807: chown d2/d21/d24/d31/d3a/d83/d63/d85/ld7 1 1 2024-04-20T21:59:08.932 INFO:tasks.workunit.client.1.smithi164.stdout:1/719: dwrite d10/d16/d19/de0/fd0 [0,4194304] 0 2024-04-20T21:59:08.934 INFO:tasks.workunit.client.1.smithi164.stdout:8/708: chown d0/fa8 12 1 2024-04-20T21:59:08.935 INFO:tasks.workunit.client.1.smithi164.stdout:9/854: sync 2024-04-20T21:59:08.939 INFO:tasks.workunit.client.1.smithi164.stdout:8/709: read - d0/f75 zero size 2024-04-20T21:59:08.939 INFO:tasks.workunit.client.1.smithi164.stdout:2/787: dwrite d2/d19/da6/fcb [0,4194304] 0 2024-04-20T21:59:08.941 INFO:tasks.workunit.client.1.smithi164.stdout:8/710: stat d0/d14/dee 0 2024-04-20T21:59:08.942 INFO:tasks.workunit.client.1.smithi164.stdout:0/750: rename d1/d4/d20/c87 to d1/d4/d26/cd8 0 2024-04-20T21:59:08.947 INFO:tasks.workunit.client.1.smithi164.stdout:1/720: unlink d10/d33/f75 0 2024-04-20T21:59:08.950 INFO:tasks.workunit.client.1.smithi164.stdout:0/751: fdatasync d1/d4/d26/d29/d2d/d54/d77/d3c/f58 0 2024-04-20T21:59:08.952 INFO:tasks.workunit.client.1.smithi164.stdout:8/711: mknod d0/d14/d4e/d62/d8f/dbe/cf1 0 2024-04-20T21:59:08.952 INFO:tasks.workunit.client.1.smithi164.stdout:1/721: write d10/d7d/fda [611754,82065] 0 2024-04-20T21:59:08.952 INFO:tasks.workunit.client.1.smithi164.stdout:7/808: creat d2/d21/d24/d31/d3a/d83/dba/dbb/f110 x:0 0 0 2024-04-20T21:59:08.955 INFO:tasks.workunit.client.1.smithi164.stdout:2/788: write d2/d5/d3a/d55/d58/da2/dcc/fdd [606624,47832] 0 2024-04-20T21:59:08.957 INFO:tasks.workunit.client.1.smithi164.stdout:4/756: dread d4/f15 [0,4194304] 0 2024-04-20T21:59:08.958 INFO:tasks.workunit.client.1.smithi164.stdout:3/840: dwrite d12/d15/dd3/f104 [0,4194304] 0 2024-04-20T21:59:08.958 INFO:tasks.workunit.client.1.smithi164.stdout:0/752: unlink d1/d4/d20/d74/f5e 0 2024-04-20T21:59:08.964 INFO:tasks.workunit.client.1.smithi164.stdout:7/809: read d2/d21/d24/d31/d3a/d83/d68/f103 [406972,122284] 0 2024-04-20T21:59:08.966 INFO:tasks.workunit.client.1.smithi164.stdout:1/722: symlink d10/d16/d20/d25/d3d/lea 0 2024-04-20T21:59:08.966 INFO:tasks.workunit.client.1.smithi164.stdout:0/753: truncate d1/d4/da/d5c/fd4 925142 0 2024-04-20T21:59:08.972 INFO:tasks.workunit.client.1.smithi164.stdout:4/757: dread d4/f16 [0,4194304] 0 2024-04-20T21:59:08.981 INFO:tasks.workunit.client.1.smithi164.stdout:7/810: dwrite d2/d21/d24/d31/d3a/ff6 [0,4194304] 0 2024-04-20T21:59:08.985 INFO:tasks.workunit.client.1.smithi164.stdout:6/827: truncate d0/d3/f80 1891301 0 2024-04-20T21:59:08.985 INFO:tasks.workunit.client.1.smithi164.stdout:1/723: creat d10/d7d/feb x:0 0 0 2024-04-20T21:59:08.986 INFO:tasks.workunit.client.1.smithi164.stdout:3/841: truncate d12/d15/f19 110962 0 2024-04-20T21:59:08.987 INFO:tasks.workunit.client.1.smithi164.stdout:4/758: rmdir d4/d9/d5c/d97/dbf/d9b 39 2024-04-20T21:59:08.991 INFO:tasks.workunit.client.1.smithi164.stdout:9/855: link d3/db/d1b/d20/d3f/d8a/da7/dbd/fbb d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/dce/f12f 0 2024-04-20T21:59:08.998 INFO:tasks.workunit.client.1.smithi164.stdout:0/754: mknod d1/cd9 0 2024-04-20T21:59:09.009 INFO:tasks.workunit.client.1.smithi164.stdout:8/712: link d0/d14/c1f d0/d14/d16/d58/d94/cf2 0 2024-04-20T21:59:09.011 INFO:tasks.workunit.client.1.smithi164.stdout:8/713: write d0/fe [2252139,7114] 0 2024-04-20T21:59:09.011 INFO:tasks.workunit.client.1.smithi164.stdout:7/811: mkdir d2/d21/d24/d31/d3a/d83/dcf/dea/d107/d111 0 2024-04-20T21:59:09.014 INFO:tasks.workunit.client.1.smithi164.stdout:7/812: truncate d2/d21/f23 5226466 0 2024-04-20T21:59:09.015 INFO:tasks.workunit.client.1.smithi164.stdout:7/813: stat d2/d21/d44/f4e 0 2024-04-20T21:59:09.022 INFO:tasks.workunit.client.1.smithi164.stdout:4/759: creat d4/d9/d22/dc2/ff0 x:0 0 0 2024-04-20T21:59:09.028 INFO:tasks.workunit.client.1.smithi164.stdout:8/714: creat d0/d1e/ff3 x:0 0 0 2024-04-20T21:59:09.030 INFO:tasks.workunit.client.1.smithi164.stdout:8/715: write d0/d14/d4e/d62/fa7 [427258,75835] 0 2024-04-20T21:59:09.030 INFO:tasks.workunit.client.1.smithi164.stdout:6/828: creat d0/d3/d11/f11a x:0 0 0 2024-04-20T21:59:09.034 INFO:tasks.workunit.client.1.smithi164.stdout:9/856: write d3/db/d1b/f34 [5190864,118967] 0 2024-04-20T21:59:09.040 INFO:tasks.workunit.client.1.smithi164.stdout:5/845: sync 2024-04-20T21:59:09.044 INFO:tasks.workunit.client.1.smithi164.stdout:0/755: creat d1/d4/da/fda x:0 0 0 2024-04-20T21:59:09.045 INFO:tasks.workunit.client.1.smithi164.stdout:3/842: link d12/d15/f1b d12/d20/d39/d69/dad/de2/f117 0 2024-04-20T21:59:09.046 INFO:tasks.workunit.client.1.smithi164.stdout:9/857: unlink d3/db/dd/d40/fdc 0 2024-04-20T21:59:09.049 INFO:tasks.workunit.client.1.smithi164.stdout:4/760: rename d4/d9/d5c/d97/dbf/d9b/fdd to d4/d9/d5c/d97/dbf/d5f/ff1 0 2024-04-20T21:59:09.052 INFO:tasks.workunit.client.1.smithi164.stdout:1/724: dwrite d10/d16/d20/f28 [0,4194304] 0 2024-04-20T21:59:09.053 INFO:tasks.workunit.client.1.smithi164.stdout:3/843: chown d12/d15/f70 13204304 1 2024-04-20T21:59:09.054 INFO:tasks.workunit.client.1.smithi164.stdout:8/716: rmdir d0/d14/d16/d5a/dd9 0 2024-04-20T21:59:09.058 INFO:tasks.workunit.client.1.smithi164.stdout:5/846: rename dc/d12/d1e/f35 to dc/d2c/d2e/d30/d72/da9/d10a/f121 0 2024-04-20T21:59:09.058 INFO:tasks.workunit.client.1.smithi164.stdout:0/756: dread d1/d4/da/d5c/d6e/f7a [0,4194304] 0 2024-04-20T21:59:09.058 INFO:tasks.workunit.client.1.smithi164.stdout:5/847: readlink la 0 2024-04-20T21:59:09.061 INFO:tasks.workunit.client.1.smithi164.stdout:4/761: creat d4/d9/d5c/d97/dbf/d67/d86/ff2 x:0 0 0 2024-04-20T21:59:09.066 INFO:tasks.workunit.client.1.smithi164.stdout:5/848: rmdir dc/d2c/d2e 39 2024-04-20T21:59:09.072 INFO:tasks.workunit.client.1.smithi164.stdout:4/762: dread d4/d9/d42/f99 [0,4194304] 0 2024-04-20T21:59:09.075 INFO:tasks.workunit.client.1.smithi164.stdout:3/844: symlink d12/d20/d39/dac/df7/l118 0 2024-04-20T21:59:09.077 INFO:tasks.workunit.client.1.smithi164.stdout:0/757: symlink d1/ldb 0 2024-04-20T21:59:09.079 INFO:tasks.workunit.client.1.smithi164.stdout:0/758: readlink d1/d4/d26/d29/d2d/d54/d77/db3/lbc 0 2024-04-20T21:59:09.081 INFO:tasks.workunit.client.1.smithi164.stdout:3/845: mknod d12/d20/d39/d69/db8/c119 0 2024-04-20T21:59:09.083 INFO:tasks.workunit.client.1.smithi164.stdout:5/849: unlink dc/d2c/d2e/d30/d8c/l107 0 2024-04-20T21:59:09.090 INFO:tasks.workunit.client.1.smithi164.stdout:0/759: symlink d1/d4/d49/ldc 0 2024-04-20T21:59:09.092 INFO:tasks.workunit.client.1.smithi164.stdout:9/858: write d3/db/dd/d40/d2a/d36/fa0 [962761,127731] 0 2024-04-20T21:59:09.097 INFO:tasks.workunit.client.1.smithi164.stdout:3/846: dwrite d12/d68/d101/f10a [0,4194304] 0 2024-04-20T21:59:09.099 INFO:tasks.workunit.client.1.smithi164.stdout:9/859: write d3/db/d1b/d20/d3f/d8a/da7/dbd/f128 [707753,96234] 0 2024-04-20T21:59:09.102 INFO:tasks.workunit.client.1.smithi164.stdout:1/725: dwrite d10/d33/d48/f4b [0,4194304] 0 2024-04-20T21:59:09.104 INFO:tasks.workunit.client.1.smithi164.stdout:0/760: creat d1/d4/d26/fdd x:0 0 0 2024-04-20T21:59:09.113 INFO:tasks.workunit.client.1.smithi164.stdout:4/763: truncate d4/f7 1692784 0 2024-04-20T21:59:09.114 INFO:tasks.workunit.client.1.smithi164.stdout:1/726: mknod d10/d33/d4d/cec 0 2024-04-20T21:59:09.121 INFO:tasks.workunit.client.1.smithi164.stdout:1/727: write d10/d33/d48/f4b [1426598,105364] 0 2024-04-20T21:59:09.121 INFO:tasks.workunit.client.1.smithi164.stdout:4/764: fsync d4/d9/d5c/d97/dbf/d67/d86/def/f6b 0 2024-04-20T21:59:09.130 INFO:tasks.workunit.client.1.smithi164.stdout:0/761: dwrite d1/d4/d49/f4b [0,4194304] 0 2024-04-20T21:59:09.130 INFO:tasks.workunit.client.1.smithi164.stdout:3/847: dwrite d12/d2a/f4d [0,4194304] 0 2024-04-20T21:59:09.130 INFO:tasks.workunit.client.1.smithi164.stdout:9/860: getdents d3/db/d82/d98/db6 0 2024-04-20T21:59:09.135 INFO:tasks.workunit.client.1.smithi164.stdout:4/765: fsync d4/d9/d5c/d97/dbf/d67/d86/def/fe2 0 2024-04-20T21:59:09.143 INFO:tasks.workunit.client.1.smithi164.stdout:0/762: mknod d1/d4/da/d27/cde 0 2024-04-20T21:59:09.147 INFO:tasks.workunit.client.1.smithi164.stdout:5/850: dwrite dc/d12/d1e/f45 [0,4194304] 0 2024-04-20T21:59:09.155 INFO:tasks.workunit.client.1.smithi164.stdout:0/763: fsync d1/d4/d26/d29/f44 0 2024-04-20T21:59:09.155 INFO:tasks.workunit.client.1.smithi164.stdout:4/766: creat d4/d9/d5c/d97/dbf/d9b/dd0/ff3 x:0 0 0 2024-04-20T21:59:09.156 INFO:tasks.workunit.client.1.smithi164.stdout:5/851: mknod dc/d2b/d52/c122 0 2024-04-20T21:59:09.166 INFO:tasks.workunit.client.1.smithi164.stdout:3/848: dwrite d12/d2a/f3d [0,4194304] 0 2024-04-20T21:59:09.166 INFO:tasks.workunit.client.1.smithi164.stdout:1/728: dwrite d10/d16/d19/de0/fd0 [0,4194304] 0 2024-04-20T21:59:09.168 INFO:tasks.workunit.client.1.smithi164.stdout:0/764: rmdir d1/d4/d26/d29/d2d/d54/d77/d3c 39 2024-04-20T21:59:09.170 INFO:tasks.workunit.client.1.smithi164.stdout:1/729: write d10/d16/d19/de0/f74 [718585,37176] 0 2024-04-20T21:59:09.171 INFO:tasks.workunit.client.1.smithi164.stdout:4/767: unlink d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41/f4b 0 2024-04-20T21:59:09.175 INFO:tasks.workunit.client.1.smithi164.stdout:0/765: read d1/d4/d26/d29/d2d/faf [179142,66311] 0 2024-04-20T21:59:09.178 INFO:tasks.workunit.client.1.smithi164.stdout:0/766: write d1/d4/da/fbf [226346,76635] 0 2024-04-20T21:59:09.182 INFO:tasks.workunit.client.1.smithi164.stdout:0/767: dread - d1/d4/da/fda zero size 2024-04-20T21:59:09.182 INFO:tasks.workunit.client.1.smithi164.stdout:3/849: unlink d12/d68/d6f/d71/d7d/lec 0 2024-04-20T21:59:09.191 INFO:tasks.workunit.client.1.smithi164.stdout:5/852: link dc/d2b/d6d/d73/dab/d10c/f119 dc/d2c/d2e/d30/d72/da9/dbb/d10e/f123 0 2024-04-20T21:59:09.194 INFO:tasks.workunit.client.1.smithi164.stdout:5/853: stat dc/d2c/d2e/d30/d72/da9/fb5 0 2024-04-20T21:59:09.200 INFO:tasks.workunit.client.1.smithi164.stdout:1/730: creat d10/d33/d4d/fed x:0 0 0 2024-04-20T21:59:09.210 INFO:tasks.workunit.client.1.smithi164.stdout:1/731: creat d10/d16/d19/de0/d34/da9/fee x:0 0 0 2024-04-20T21:59:09.213 INFO:tasks.workunit.client.1.smithi164.stdout:1/732: write d10/d16/d19/d1a/d51/f6a [3530215,129218] 0 2024-04-20T21:59:09.215 INFO:tasks.workunit.client.1.smithi164.stdout:3/850: creat d12/d20/d39/d69/dad/d110/f11a x:0 0 0 2024-04-20T21:59:09.221 INFO:tasks.workunit.client.1.smithi164.stdout:2/789: sync 2024-04-20T21:59:09.221 INFO:tasks.workunit.client.1.smithi164.stdout:7/814: sync 2024-04-20T21:59:09.222 INFO:tasks.workunit.client.1.smithi164.stdout:6/829: sync 2024-04-20T21:59:09.222 INFO:tasks.workunit.client.1.smithi164.stdout:8/717: sync 2024-04-20T21:59:09.229 INFO:tasks.workunit.client.1.smithi164.stdout:2/790: dread d2/d5/d3a/fae [0,4194304] 0 2024-04-20T21:59:09.232 INFO:tasks.workunit.client.1.smithi164.stdout:7/815: write d2/d21/d24/d31/f46 [4701155,122128] 0 2024-04-20T21:59:09.238 INFO:tasks.workunit.client.1.smithi164.stdout:1/733: mknod d10/cef 0 2024-04-20T21:59:09.239 INFO:tasks.workunit.client.1.smithi164.stdout:7/816: stat d2/d21/d24/d31/d3a/d83/d63/d85/ld7 0 2024-04-20T21:59:09.239 INFO:tasks.workunit.client.1.smithi164.stdout:1/734: stat d10/d16/d20/d25 0 2024-04-20T21:59:09.241 INFO:tasks.workunit.client.1.smithi164.stdout:7/817: chown d2/d21/d44/l99 3 1 2024-04-20T21:59:09.249 INFO:tasks.workunit.client.1.smithi164.stdout:5/854: write dc/d12/f15 [3568862,117800] 0 2024-04-20T21:59:09.255 INFO:tasks.workunit.client.1.smithi164.stdout:2/791: dwrite d2/d19/d28/dd0/dba/d62/fde [0,4194304] 0 2024-04-20T21:59:09.288 INFO:tasks.workunit.client.1.smithi164.stdout:3/851: creat d12/d20/f11b x:0 0 0 2024-04-20T21:59:09.291 INFO:tasks.workunit.client.1.smithi164.stdout:8/718: creat d0/d14/ff4 x:0 0 0 2024-04-20T21:59:09.292 INFO:tasks.workunit.client.1.smithi164.stdout:7/818: rmdir d2/d21/d24/d31/d3a/d83/d63/d85/dbe 39 2024-04-20T21:59:09.293 INFO:tasks.workunit.client.1.smithi164.stdout:7/819: fsync d2/f16 0 2024-04-20T21:59:09.295 INFO:tasks.workunit.client.1.smithi164.stdout:5/855: rename dc/d2c/d2e/dbd/ccd to dc/d2b/d6d/d73/de3/c124 0 2024-04-20T21:59:09.297 INFO:tasks.workunit.client.1.smithi164.stdout:2/792: creat d2/d19/ff5 x:0 0 0 2024-04-20T21:59:09.302 INFO:tasks.workunit.client.1.smithi164.stdout:8/719: unlink d0/d14/d16/d9d/fca 0 2024-04-20T21:59:09.304 INFO:tasks.workunit.client.1.smithi164.stdout:7/820: mknod d2/d21/d44/dd4/c112 0 2024-04-20T21:59:09.308 INFO:tasks.workunit.client.1.smithi164.stdout:6/830: getdents d0/d3/d15/d21/d101/d45/d4f/d61 0 2024-04-20T21:59:09.311 INFO:tasks.workunit.client.1.smithi164.stdout:2/793: rmdir d2/d5/d3a 39 2024-04-20T21:59:09.314 INFO:tasks.workunit.client.1.smithi164.stdout:3/852: fsync d12/fce 0 2024-04-20T21:59:09.316 INFO:tasks.workunit.client.1.smithi164.stdout:7/821: dread d2/d21/d24/f4f [0,4194304] 0 2024-04-20T21:59:09.317 INFO:tasks.workunit.client.1.smithi164.stdout:5/856: mkdir dc/d2c/d2e/d30/d72/da9/dbb/d10e/d125 0 2024-04-20T21:59:09.321 INFO:tasks.workunit.client.1.smithi164.stdout:3/853: mknod d12/d15/dd3/c11c 0 2024-04-20T21:59:09.321 INFO:tasks.workunit.client.1.smithi164.stdout:8/720: dread d0/d14/d16/d58/fb8 [0,4194304] 0 2024-04-20T21:59:09.323 INFO:tasks.workunit.client.1.smithi164.stdout:7/822: unlink d2/f73 0 2024-04-20T21:59:09.325 INFO:tasks.workunit.client.1.smithi164.stdout:5/857: truncate dc/d12/f8e 2101193 0 2024-04-20T21:59:09.328 INFO:tasks.workunit.client.1.smithi164.stdout:2/794: dwrite d2/d19/da6/fe3 [0,4194304] 0 2024-04-20T21:59:09.329 INFO:tasks.workunit.client.1.smithi164.stdout:6/831: rmdir d0/d3/d62/d8e/df9 0 2024-04-20T21:59:09.330 INFO:tasks.workunit.client.1.smithi164.stdout:2/795: fdatasync d2/d19/d28/f4e 0 2024-04-20T21:59:09.333 INFO:tasks.workunit.client.1.smithi164.stdout:7/823: truncate d2/d21/d24/f61 728395 0 2024-04-20T21:59:09.336 INFO:tasks.workunit.client.1.smithi164.stdout:7/824: read d2/f5f [2159937,13995] 0 2024-04-20T21:59:09.336 INFO:tasks.workunit.client.1.smithi164.stdout:3/854: link d12/d68/d6f/d71/d7d/fab d12/d20/d39/dac/f11d 0 2024-04-20T21:59:09.342 INFO:tasks.workunit.client.1.smithi164.stdout:2/796: chown d2/d5/d3a/f43 1 1 2024-04-20T21:59:09.343 INFO:tasks.workunit.client.1.smithi164.stdout:1/735: truncate d10/f9e 2908210 0 2024-04-20T21:59:09.343 INFO:tasks.workunit.client.1.smithi164.stdout:6/832: write d0/d3/d15/d21/d101/d45/d69/f8d [1759222,91971] 0 2024-04-20T21:59:09.344 INFO:tasks.workunit.client.1.smithi164.stdout:8/721: creat d0/d14/d4e/ff5 x:0 0 0 2024-04-20T21:59:09.345 INFO:tasks.workunit.client.1.smithi164.stdout:8/722: chown d0/c49 130 1 2024-04-20T21:59:09.346 INFO:tasks.workunit.client.1.smithi164.stdout:5/858: creat dc/d2b/d6d/d73/dd6/dfd/dec/f126 x:0 0 0 2024-04-20T21:59:09.347 INFO:tasks.workunit.client.1.smithi164.stdout:2/797: mkdir d2/d30/de8/df6 0 2024-04-20T21:59:09.351 INFO:tasks.workunit.client.1.smithi164.stdout:2/798: write d2/d5/d3a/d55/d58/da2/db0/fbd [101709,70896] 0 2024-04-20T21:59:09.353 INFO:tasks.workunit.client.1.smithi164.stdout:2/799: write d2/d19/da6/fe3 [3103404,125044] 0 2024-04-20T21:59:09.353 INFO:tasks.workunit.client.1.smithi164.stdout:5/859: rmdir dc/d12/d1e/def 39 2024-04-20T21:59:09.357 INFO:tasks.workunit.client.1.smithi164.stdout:6/833: symlink d0/d3/l11b 0 2024-04-20T21:59:09.358 INFO:tasks.workunit.client.1.smithi164.stdout:8/723: mkdir d0/d14/df6 0 2024-04-20T21:59:09.361 INFO:tasks.workunit.client.1.smithi164.stdout:7/825: dread d2/d21/d44/f4b [0,4194304] 0 2024-04-20T21:59:09.361 INFO:tasks.workunit.client.1.smithi164.stdout:6/834: truncate d0/d3/d15/d21/f91 5147193 0 2024-04-20T21:59:09.363 INFO:tasks.workunit.client.1.smithi164.stdout:5/860: rmdir dc/d2c/d2e/dbd/df9 39 2024-04-20T21:59:09.366 INFO:tasks.workunit.client.1.smithi164.stdout:8/724: write d0/d14/f3e [1568336,99534] 0 2024-04-20T21:59:09.367 INFO:tasks.workunit.client.1.smithi164.stdout:6/835: mkdir d0/d3/d15/d21/d5c/dbf/dbd/ddf/d11c 0 2024-04-20T21:59:09.368 INFO:tasks.workunit.client.1.smithi164.stdout:8/725: chown d0/d14/f51 756176 1 2024-04-20T21:59:09.370 INFO:tasks.workunit.client.1.smithi164.stdout:2/800: mknod d2/d5/d3a/d55/d58/db8/cf7 0 2024-04-20T21:59:09.371 INFO:tasks.workunit.client.1.smithi164.stdout:2/801: stat d2/d5/d3a/l94 0 2024-04-20T21:59:09.373 INFO:tasks.workunit.client.1.smithi164.stdout:6/836: mkdir d0/d3/d4a/d11d 0 2024-04-20T21:59:09.375 INFO:tasks.workunit.client.1.smithi164.stdout:5/861: mknod dc/d2b/df6/c127 0 2024-04-20T21:59:09.380 INFO:tasks.workunit.client.1.smithi164.stdout:1/736: write d10/d16/f43 [2637599,96250] 0 2024-04-20T21:59:09.387 INFO:tasks.workunit.client.1.smithi164.stdout:5/862: fdatasync dc/d2c/d2e/d30/d5e/fa5 0 2024-04-20T21:59:09.389 INFO:tasks.workunit.client.1.smithi164.stdout:7/826: write d2/d21/d44/f98 [696262,15084] 0 2024-04-20T21:59:09.396 INFO:tasks.workunit.client.1.smithi164.stdout:1/737: dwrite d10/d16/d19/de0/d34/f60 [0,4194304] 0 2024-04-20T21:59:09.399 INFO:tasks.workunit.client.1.smithi164.stdout:2/802: getdents d2/d19/da6 0 2024-04-20T21:59:09.400 INFO:tasks.workunit.client.1.smithi164.stdout:5/863: rename dc/d2b/d6d/d73/dd6/dfd/dec to dc/d2c/d2e/d30/d72/da9/df0/d128 0 2024-04-20T21:59:09.407 INFO:tasks.workunit.client.1.smithi164.stdout:5/864: creat dc/d2c/d2e/d30/d72/f129 x:0 0 0 2024-04-20T21:59:09.411 INFO:tasks.workunit.client.1.smithi164.stdout:2/803: creat d2/d19/d28/dd0/dba/ff8 x:0 0 0 2024-04-20T21:59:09.413 INFO:tasks.workunit.client.1.smithi164.stdout:5/865: chown dc/d2b/d6d/d73/lac 25780 1 2024-04-20T21:59:09.413 INFO:tasks.workunit.client.1.smithi164.stdout:1/738: dread d10/d33/d48/d8b/fe9 [0,4194304] 0 2024-04-20T21:59:09.413 INFO:tasks.workunit.client.1.smithi164.stdout:8/726: dwrite d0/f11 [0,4194304] 0 2024-04-20T21:59:09.415 INFO:tasks.workunit.client.1.smithi164.stdout:2/804: mkdir d2/d19/d28/dd0/df9 0 2024-04-20T21:59:09.417 INFO:tasks.workunit.client.1.smithi164.stdout:5/866: fsync dc/d2c/d2e/d30/d72/fd8 0 2024-04-20T21:59:09.418 INFO:tasks.workunit.client.1.smithi164.stdout:1/739: mkdir d10/d16/d20/d91/df0 0 2024-04-20T21:59:09.418 INFO:tasks.workunit.client.1.smithi164.stdout:7/827: dwrite d2/f8c [4194304,4194304] 0 2024-04-20T21:59:09.421 INFO:tasks.workunit.client.1.smithi164.stdout:7/828: fdatasync d2/d21/f23 0 2024-04-20T21:59:09.426 INFO:tasks.workunit.client.1.smithi164.stdout:8/727: rename d0/d14/d4e/d62/fa7 to d0/d14/d4e/d6f/de3/ff7 0 2024-04-20T21:59:09.428 INFO:tasks.workunit.client.1.smithi164.stdout:8/728: fdatasync d0/d14/d16/d58/fcb 0 2024-04-20T21:59:09.431 INFO:tasks.workunit.client.1.smithi164.stdout:5/867: symlink dc/d2b/da0/l12a 0 2024-04-20T21:59:09.433 INFO:tasks.workunit.client.1.smithi164.stdout:5/868: write dc/f25 [2875021,97266] 0 2024-04-20T21:59:09.436 INFO:tasks.workunit.client.1.smithi164.stdout:2/805: write d2/d19/d28/dd0/dba/f90 [322686,124944] 0 2024-04-20T21:59:09.437 INFO:tasks.workunit.client.1.smithi164.stdout:1/740: write d10/d33/f87 [428403,127164] 0 2024-04-20T21:59:09.438 INFO:tasks.workunit.client.1.smithi164.stdout:2/806: chown d2/f1b 4916 1 2024-04-20T21:59:09.438 INFO:tasks.workunit.client.1.smithi164.stdout:7/829: dread d2/d21/f89 [0,4194304] 0 2024-04-20T21:59:09.439 INFO:tasks.workunit.client.1.smithi164.stdout:8/729: unlink d0/d14/d5f/le5 0 2024-04-20T21:59:09.439 INFO:tasks.workunit.client.1.smithi164.stdout:1/741: write d10/d16/f43 [2096460,56655] 0 2024-04-20T21:59:09.441 INFO:tasks.workunit.client.1.smithi164.stdout:8/730: chown d0/d14/d16/cb0 185 1 2024-04-20T21:59:09.443 INFO:tasks.workunit.client.1.smithi164.stdout:2/807: creat d2/dab/ffa x:0 0 0 2024-04-20T21:59:09.443 INFO:tasks.workunit.client.1.smithi164.stdout:8/731: dread - d0/d14/d16/d9d/faf zero size 2024-04-20T21:59:09.444 INFO:tasks.workunit.client.1.smithi164.stdout:5/869: mknod dc/d2c/d2e/d30/c12b 0 2024-04-20T21:59:09.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:09 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:09.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:09 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:09 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:59:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:09 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:59:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:09 smithi164 ceph-mon[23506]: Updating smithi142:/etc/ceph/ceph.conf 2024-04-20T21:59:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:09 smithi164 ceph-mon[23506]: Updating smithi164:/etc/ceph/ceph.conf 2024-04-20T21:59:09.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:09 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:09.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:09 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:09.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:09 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:59:09.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:09 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:59:09.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:09 smithi142 ceph-mon[15828]: Updating smithi142:/etc/ceph/ceph.conf 2024-04-20T21:59:09.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:09 smithi142 ceph-mon[15828]: Updating smithi164:/etc/ceph/ceph.conf 2024-04-20T21:59:09.451 INFO:tasks.workunit.client.1.smithi164.stdout:8/732: creat d0/d14/df6/ff8 x:0 0 0 2024-04-20T21:59:09.454 INFO:tasks.workunit.client.1.smithi164.stdout:2/808: getdents d2/d5 0 2024-04-20T21:59:09.459 INFO:tasks.workunit.client.1.smithi164.stdout:8/733: rename d0/f84 to d0/d14/d4e/d62/d82/ff9 0 2024-04-20T21:59:09.460 INFO:tasks.workunit.client.1.smithi164.stdout:8/734: chown d0/d14/d5f 27 1 2024-04-20T21:59:09.463 INFO:tasks.workunit.client.1.smithi164.stdout:5/870: rmdir dc/d2b/da0 39 2024-04-20T21:59:09.465 INFO:tasks.workunit.client.1.smithi164.stdout:5/871: chown dc/d12 117121 1 2024-04-20T21:59:09.466 INFO:tasks.workunit.client.1.smithi164.stdout:1/742: dread d10/d16/f43 [0,4194304] 0 2024-04-20T21:59:09.468 INFO:tasks.workunit.client.1.smithi164.stdout:5/872: chown dc/d2c/d2e/cde 4087289 1 2024-04-20T21:59:09.468 INFO:tasks.workunit.client.1.smithi164.stdout:2/809: link d2/d19/c36 d2/dab/df4/cfb 0 2024-04-20T21:59:09.472 INFO:tasks.workunit.client.1.smithi164.stdout:1/743: rmdir d10/d33 39 2024-04-20T21:59:09.475 INFO:tasks.workunit.client.1.smithi164.stdout:5/873: mkdir dc/d2b/d6d/d73/dd6/dfd/d12c 0 2024-04-20T21:59:09.475 INFO:tasks.workunit.client.1.smithi164.stdout:8/735: dread d0/d14/d4e/d6f/f79 [0,4194304] 0 2024-04-20T21:59:09.477 INFO:tasks.workunit.client.1.smithi164.stdout:2/810: creat d2/d30/da5/ddf/ffc x:0 0 0 2024-04-20T21:59:09.483 INFO:tasks.workunit.client.1.smithi164.stdout:2/811: rename d2/d5/d3a/d55/d58/lc6 to d2/dab/df4/lfd 0 2024-04-20T21:59:09.485 INFO:tasks.workunit.client.1.smithi164.stdout:2/812: write d2/d30/f83 [3809647,107254] 0 2024-04-20T21:59:09.485 INFO:tasks.workunit.client.1.smithi164.stdout:1/744: link d10/d16/d20/d66/c79 d10/d33/d48/de6/cf1 0 2024-04-20T21:59:09.486 INFO:tasks.workunit.client.1.smithi164.stdout:5/874: creat dc/d12/d1e/f12d x:0 0 0 2024-04-20T21:59:09.491 INFO:tasks.workunit.client.1.smithi164.stdout:1/745: write d10/d33/d48/fb7 [1148211,88545] 0 2024-04-20T21:59:09.492 INFO:tasks.workunit.client.1.smithi164.stdout:8/736: dwrite d0/d14/d16/d5a/f6c [0,4194304] 0 2024-04-20T21:59:09.494 INFO:tasks.workunit.client.1.smithi164.stdout:1/746: write d10/d16/d20/f38 [3385948,121944] 0 2024-04-20T21:59:09.503 INFO:tasks.workunit.client.1.smithi164.stdout:2/813: link d2/d5/d3a/d55/d58/da2/ca7 d2/cfe 0 2024-04-20T21:59:09.512 INFO:tasks.workunit.client.1.smithi164.stdout:8/737: dwrite d0/d14/d16/d9d/fe6 [0,4194304] 0 2024-04-20T21:59:09.514 INFO:tasks.workunit.client.1.smithi164.stdout:8/738: readlink d0/d14/d16/d9d/lc6 0 2024-04-20T21:59:09.516 INFO:tasks.workunit.client.1.smithi164.stdout:4/768: sync 2024-04-20T21:59:09.517 INFO:tasks.workunit.client.1.smithi164.stdout:2/814: write d2/d5/d3a/f43 [1687959,46998] 0 2024-04-20T21:59:09.517 INFO:tasks.workunit.client.1.smithi164.stdout:9/861: sync 2024-04-20T21:59:09.517 INFO:tasks.workunit.client.1.smithi164.stdout:0/768: sync 2024-04-20T21:59:09.527 INFO:tasks.workunit.client.1.smithi164.stdout:5/875: dread f8 [0,4194304] 0 2024-04-20T21:59:09.527 INFO:tasks.workunit.client.1.smithi164.stdout:9/862: chown d3/db/dd/d40/d2a/f100 3 1 2024-04-20T21:59:09.531 INFO:tasks.workunit.client.1.smithi164.stdout:2/815: mknod d2/d30/cff 0 2024-04-20T21:59:09.532 INFO:tasks.workunit.client.1.smithi164.stdout:4/769: creat d4/d9/d5c/d97/dbf/ff4 x:0 0 0 2024-04-20T21:59:09.533 INFO:tasks.workunit.client.1.smithi164.stdout:9/863: chown d3/db/l96 92 1 2024-04-20T21:59:09.535 INFO:tasks.workunit.client.1.smithi164.stdout:0/769: mkdir d1/d4/d26/d29/d2d/ddf 0 2024-04-20T21:59:09.541 INFO:tasks.workunit.client.1.smithi164.stdout:2/816: mkdir d2/d5/d3a/d65/d81/d100 0 2024-04-20T21:59:09.541 INFO:tasks.workunit.client.1.smithi164.stdout:4/770: readlink d4/d9/la8 0 2024-04-20T21:59:09.542 INFO:tasks.workunit.client.1.smithi164.stdout:0/770: unlink d1/d4/da/d27/c80 0 2024-04-20T21:59:09.542 INFO:tasks.workunit.client.1.smithi164.stdout:2/817: read - d2/d19/da6/fad zero size 2024-04-20T21:59:09.544 INFO:tasks.workunit.client.1.smithi164.stdout:5/876: unlink dc/d2b/d6d/d73/dab/l115 0 2024-04-20T21:59:09.545 INFO:tasks.workunit.client.1.smithi164.stdout:2/818: write d2/d5/d3a/fa4 [13233143,74986] 0 2024-04-20T21:59:09.545 INFO:tasks.workunit.client.1.smithi164.stdout:9/864: mknod d3/db/dd/d40/d78/d86/d118/c130 0 2024-04-20T21:59:09.548 INFO:tasks.workunit.client.1.smithi164.stdout:8/739: dread d0/d14/f4f [0,4194304] 0 2024-04-20T21:59:09.549 INFO:tasks.workunit.client.1.smithi164.stdout:0/771: rmdir d1/d4/da/d5c 39 2024-04-20T21:59:09.552 INFO:tasks.workunit.client.1.smithi164.stdout:9/865: creat d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/f131 x:0 0 0 2024-04-20T21:59:09.556 INFO:tasks.workunit.client.1.smithi164.stdout:0/772: unlink d1/d2b/l83 0 2024-04-20T21:59:09.557 INFO:tasks.workunit.client.1.smithi164.stdout:8/740: mknod d0/d14/d4e/d62/d82/d97/cfa 0 2024-04-20T21:59:09.562 INFO:tasks.workunit.client.1.smithi164.stdout:2/819: creat d2/d30/de8/df6/f101 x:0 0 0 2024-04-20T21:59:09.571 INFO:tasks.workunit.client.1.smithi164.stdout:9/866: mkdir d3/db0/d132 0 2024-04-20T21:59:09.573 INFO:tasks.workunit.client.1.smithi164.stdout:2/820: symlink d2/d5/d3a/d55/d58/l102 0 2024-04-20T21:59:09.574 INFO:tasks.workunit.client.1.smithi164.stdout:5/877: dread dc/d2c/f4f [4194304,4194304] 0 2024-04-20T21:59:09.576 INFO:tasks.workunit.client.1.smithi164.stdout:9/867: mknod d3/db/d1b/c133 0 2024-04-20T21:59:09.578 INFO:tasks.workunit.client.1.smithi164.stdout:2/821: dread d2/d5f/f7d [0,4194304] 0 2024-04-20T21:59:09.580 INFO:tasks.workunit.client.1.smithi164.stdout:9/868: write d3/db/dd/d40/d2a/d36/d51/f125 [911754,19440] 0 2024-04-20T21:59:09.581 INFO:tasks.workunit.client.1.smithi164.stdout:2/822: write d2/dab/fe0 [4537923,59226] 0 2024-04-20T21:59:09.583 INFO:tasks.workunit.client.1.smithi164.stdout:5/878: chown dc/d2c/l36 49 1 2024-04-20T21:59:09.585 INFO:tasks.workunit.client.1.smithi164.stdout:8/741: write d0/fc [3860409,55814] 0 2024-04-20T21:59:09.588 INFO:tasks.workunit.client.1.smithi164.stdout:0/773: dread d1/d4/df/d56/f8c [0,4194304] 0 2024-04-20T21:59:09.589 INFO:tasks.workunit.client.1.smithi164.stdout:2/823: mkdir d2/d5/d3a/d55/d58/db8/d103 0 2024-04-20T21:59:09.589 INFO:tasks.workunit.client.1.smithi164.stdout:0/774: write d1/f12 [2087548,72615] 0 2024-04-20T21:59:09.592 INFO:tasks.workunit.client.1.smithi164.stdout:5/879: mkdir dc/d2c/d2e/d30/d5e/d12e 0 2024-04-20T21:59:09.594 INFO:tasks.workunit.client.1.smithi164.stdout:5/880: read dc/d12/fe8 [841569,64971] 0 2024-04-20T21:59:09.595 INFO:tasks.workunit.client.1.smithi164.stdout:9/869: rmdir d3/db/dcc/de3 39 2024-04-20T21:59:09.611 INFO:tasks.workunit.client.1.smithi164.stdout:8/742: dwrite d0/fa8 [0,4194304] 0 2024-04-20T21:59:09.612 INFO:tasks.workunit.client.1.smithi164.stdout:9/870: creat d3/d9f/da1/d11f/f134 x:0 0 0 2024-04-20T21:59:09.615 INFO:tasks.workunit.client.1.smithi164.stdout:5/881: link dc/d12/d81/d116/c11a dc/d2c/d2e/d30/d118/c12f 0 2024-04-20T21:59:09.617 INFO:tasks.workunit.client.1.smithi164.stdout:9/871: mkdir d3/d9f/da1/d11f/d135 0 2024-04-20T21:59:09.618 INFO:tasks.workunit.client.1.smithi164.stdout:0/775: dwrite d1/d4/d20/d74/f35 [0,4194304] 0 2024-04-20T21:59:09.620 INFO:tasks.workunit.client.1.smithi164.stdout:8/743: unlink d0/d14/d4e/d62/d82/ff9 0 2024-04-20T21:59:09.620 INFO:tasks.workunit.client.1.smithi164.stdout:0/776: write d1/d2b/fc1 [677638,17732] 0 2024-04-20T21:59:09.624 INFO:tasks.workunit.client.1.smithi164.stdout:8/744: truncate d0/d14/d4e/d86/fd1 165762 0 2024-04-20T21:59:09.629 INFO:tasks.workunit.client.1.smithi164.stdout:9/872: mknod d3/db/dd/d40/d2a/d36/c136 0 2024-04-20T21:59:09.629 INFO:tasks.workunit.client.1.smithi164.stdout:8/745: creat d0/d14/df6/ffb x:0 0 0 2024-04-20T21:59:09.634 INFO:tasks.workunit.client.1.smithi164.stdout:9/873: creat d3/db/dd/f137 x:0 0 0 2024-04-20T21:59:09.635 INFO:tasks.workunit.client.1.smithi164.stdout:8/746: unlink d0/f48 0 2024-04-20T21:59:09.638 INFO:tasks.workunit.client.1.smithi164.stdout:3/855: sync 2024-04-20T21:59:09.641 INFO:tasks.workunit.client.1.smithi164.stdout:0/777: dwrite d1/d4/da/d27/f70 [0,4194304] 0 2024-04-20T21:59:09.642 INFO:tasks.workunit.client.1.smithi164.stdout:8/747: unlink d0/d14/d4e/d62/d82/d97/cfa 0 2024-04-20T21:59:09.647 INFO:tasks.workunit.client.1.smithi164.stdout:3/856: creat d12/d20/d39/f11e x:0 0 0 2024-04-20T21:59:09.653 INFO:tasks.workunit.client.1.smithi164.stdout:3/857: creat d12/d20/d39/d55/d87/f11f x:0 0 0 2024-04-20T21:59:09.657 INFO:tasks.workunit.client.1.smithi164.stdout:3/858: stat d12/d15/f37 0 2024-04-20T21:59:09.662 INFO:tasks.workunit.client.1.smithi164.stdout:5/882: dwrite dc/d12/f8e [0,4194304] 0 2024-04-20T21:59:09.669 INFO:tasks.workunit.client.1.smithi164.stdout:5/883: read dc/d2b/d52/f62 [77565,121455] 0 2024-04-20T21:59:09.669 INFO:tasks.workunit.client.1.smithi164.stdout:3/859: link d12/d2a/f8a d12/d20/d39/dac/f120 0 2024-04-20T21:59:09.670 INFO:tasks.workunit.client.1.smithi164.stdout:0/778: write d1/d4/d26/d29/d2d/f8a [4609431,40014] 0 2024-04-20T21:59:09.676 INFO:tasks.workunit.client.1.smithi164.stdout:3/860: read - d12/d20/d39/d69/d77/fb7 zero size 2024-04-20T21:59:09.676 INFO:tasks.workunit.client.1.smithi164.stdout:9/874: dwrite d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/fab [0,4194304] 0 2024-04-20T21:59:09.676 INFO:tasks.workunit.client.1.smithi164.stdout:5/884: mkdir dc/d2c/d2e/dbd/d11f/d130 0 2024-04-20T21:59:09.680 INFO:tasks.workunit.client.1.smithi164.stdout:7/830: sync 2024-04-20T21:59:09.680 INFO:tasks.workunit.client.1.smithi164.stdout:6/837: sync 2024-04-20T21:59:09.680 INFO:tasks.workunit.client.1.smithi164.stdout:3/861: write d12/d20/d39/f56 [4637418,34307] 0 2024-04-20T21:59:09.680 INFO:tasks.workunit.client.1.smithi164.stdout:5/885: chown dc/d12/l20 0 1 2024-04-20T21:59:09.684 INFO:tasks.workunit.client.1.smithi164.stdout:8/748: dwrite d0/d14/d4e/d6f/f79 [0,4194304] 0 2024-04-20T21:59:09.687 INFO:tasks.workunit.client.1.smithi164.stdout:0/779: getdents d1/d4/d26/d29/d2d/d54 0 2024-04-20T21:59:09.692 INFO:tasks.workunit.client.1.smithi164.stdout:0/780: truncate d1/d4/d26/fdd 634758 0 2024-04-20T21:59:09.695 INFO:tasks.workunit.client.1.smithi164.stdout:0/781: write d1/d4/d26/d29/d2d/d54/fa9 [416082,114575] 0 2024-04-20T21:59:09.698 INFO:tasks.workunit.client.1.smithi164.stdout:5/886: write dc/d2c/d2e/dbd/df9/f102 [340349,61693] 0 2024-04-20T21:59:09.702 INFO:tasks.workunit.client.1.smithi164.stdout:6/838: creat d0/d3/d11/d29/d6e/d41/d10d/f11e x:0 0 0 2024-04-20T21:59:09.707 INFO:tasks.workunit.client.1.smithi164.stdout:5/887: read dc/d2c/d2e/dbd/df9/f7f [2658948,87534] 0 2024-04-20T21:59:09.709 INFO:tasks.workunit.client.1.smithi164.stdout:5/888: chown dc/d2c/d2e/d30/d5e/d12e 327 1 2024-04-20T21:59:09.709 INFO:tasks.workunit.client.1.smithi164.stdout:3/862: symlink d12/d20/d39/d69/d9a/dbe/de3/l121 0 2024-04-20T21:59:09.711 INFO:tasks.workunit.client.1.smithi164.stdout:0/782: stat d1/d4/d26/d29/d2d/d54/d77/d3c/l48 0 2024-04-20T21:59:09.712 INFO:tasks.workunit.client.1.smithi164.stdout:3/863: fdatasync d12/d20/fe1 0 2024-04-20T21:59:09.712 INFO:tasks.workunit.client.1.smithi164.stdout:6/839: mknod d0/d3/d15/d21/db1/c11f 0 2024-04-20T21:59:09.713 INFO:tasks.workunit.client.1.smithi164.stdout:5/889: dread - dc/d2b/d52/f76 zero size 2024-04-20T21:59:09.713 INFO:tasks.workunit.client.1.smithi164.stdout:9/875: dwrite d3/db/dd/d75/f111 [4194304,4194304] 0 2024-04-20T21:59:09.714 INFO:tasks.workunit.client.1.smithi164.stdout:8/749: creat d0/ffc x:0 0 0 2024-04-20T21:59:09.715 INFO:tasks.workunit.client.1.smithi164.stdout:3/864: chown d12/d20/d39/f11e 15062 1 2024-04-20T21:59:09.719 INFO:tasks.workunit.client.1.smithi164.stdout:5/890: chown dc/d2c/d2e/d30/d118/c12f 4827 1 2024-04-20T21:59:09.722 INFO:tasks.workunit.client.1.smithi164.stdout:9/876: chown d3/db/d1b/d1e/f105 177 1 2024-04-20T21:59:09.722 INFO:tasks.workunit.client.1.smithi164.stdout:7/831: dread d2/d21/d44/dd4/d9e/da6/fcd [0,4194304] 0 2024-04-20T21:59:09.722 INFO:tasks.workunit.client.1.smithi164.stdout:0/783: unlink d1/d4/d26/d29/d2d/d54/d77/la0 0 2024-04-20T21:59:09.722 INFO:tasks.workunit.client.1.smithi164.stdout:6/840: write d0/d3/d62/d8e/fdc [89043,24512] 0 2024-04-20T21:59:09.725 INFO:tasks.workunit.client.1.smithi164.stdout:0/784: write d1/f12 [1516597,89788] 0 2024-04-20T21:59:09.727 INFO:tasks.workunit.client.1.smithi164.stdout:5/891: mkdir dc/d2c/d2e/d30/d72/da9/dbb/d10e/d131 0 2024-04-20T21:59:09.733 INFO:tasks.workunit.client.1.smithi164.stdout:7/832: read - d2/d21/d24/d31/d3a/d83/d63/f100 zero size 2024-04-20T21:59:09.735 INFO:tasks.workunit.client.1.smithi164.stdout:5/892: creat dc/d2b/d6d/d73/dd6/dfd/f132 x:0 0 0 2024-04-20T21:59:09.738 INFO:tasks.workunit.client.1.smithi164.stdout:5/893: chown dc/d12/d81/d116 515821775 1 2024-04-20T21:59:09.739 INFO:tasks.workunit.client.1.smithi164.stdout:9/877: rename d3/db/dd/d40/d2a/d36/d51/da3/l12a to d3/db/d1b/d20/d3f/dc7/l138 0 2024-04-20T21:59:09.743 INFO:tasks.workunit.client.1.smithi164.stdout:7/833: symlink d2/d21/d44/dd4/d9e/da6/l113 0 2024-04-20T21:59:09.745 INFO:tasks.workunit.client.1.smithi164.stdout:5/894: mknod dc/d2b/d6d/d73/dab/c133 0 2024-04-20T21:59:09.748 INFO:tasks.workunit.client.1.smithi164.stdout:3/865: dread f6 [0,4194304] 0 2024-04-20T21:59:09.749 INFO:tasks.workunit.client.1.smithi164.stdout:5/895: chown dc/d2c/d2e/d30/d72/da9/fb5 363 1 2024-04-20T21:59:09.753 INFO:tasks.workunit.client.1.smithi164.stdout:0/785: getdents d1/d4/d26/d29/d2d/d54/d77 0 2024-04-20T21:59:09.761 INFO:tasks.workunit.client.1.smithi164.stdout:8/750: dwrite d0/d14/d16/d58/f74 [4194304,4194304] 0 2024-04-20T21:59:09.765 INFO:tasks.workunit.client.1.smithi164.stdout:9/878: write d3/db/dd/d40/d2a/d36/d51/d83/f8b [34637,68403] 0 2024-04-20T21:59:09.765 INFO:tasks.workunit.client.1.smithi164.stdout:7/834: link d2/d21/d24/d31/d3a/d83/d77/ce2 d2/d21/d24/d31/d3a/d83/d6a/c114 0 2024-04-20T21:59:09.767 INFO:tasks.workunit.client.1.smithi164.stdout:0/786: symlink d1/d4/le0 0 2024-04-20T21:59:09.768 INFO:tasks.workunit.client.1.smithi164.stdout:3/866: dread f4 [0,4194304] 0 2024-04-20T21:59:09.772 INFO:tasks.workunit.client.1.smithi164.stdout:5/896: getdents dc/d2c/d2e/d30/d118 0 2024-04-20T21:59:09.774 INFO:tasks.workunit.client.1.smithi164.stdout:9/879: mknod d3/db/d1b/d119/c139 0 2024-04-20T21:59:09.780 INFO:tasks.workunit.client.1.smithi164.stdout:8/751: dwrite d0/d14/d16/d5a/fd7 [0,4194304] 0 2024-04-20T21:59:09.785 INFO:tasks.workunit.client.1.smithi164.stdout:8/752: read - d0/d14/d4e/d86/f8d zero size 2024-04-20T21:59:09.785 INFO:tasks.workunit.client.1.smithi164.stdout:7/835: dread d2/d21/fc1 [0,4194304] 0 2024-04-20T21:59:09.787 INFO:tasks.workunit.client.1.smithi164.stdout:8/753: chown d0/d14/df6 0 1 2024-04-20T21:59:09.788 INFO:tasks.workunit.client.1.smithi164.stdout:8/754: dread - d0/f75 zero size 2024-04-20T21:59:09.789 INFO:tasks.workunit.client.1.smithi164.stdout:7/836: write d2/d21/d24/d31/d3a/d83/d77/f97 [416631,112371] 0 2024-04-20T21:59:09.790 INFO:tasks.workunit.client.1.smithi164.stdout:1/747: sync 2024-04-20T21:59:09.790 INFO:tasks.workunit.client.1.smithi164.stdout:2/824: sync 2024-04-20T21:59:09.790 INFO:tasks.workunit.client.1.smithi164.stdout:4/771: sync 2024-04-20T21:59:09.793 INFO:tasks.workunit.client.1.smithi164.stdout:5/897: link dc/d12/d81/d116/c11a dc/d12/d1e/da8/c134 0 2024-04-20T21:59:09.793 INFO:tasks.workunit.client.1.smithi164.stdout:9/880: creat d3/db/dcc/f13a x:0 0 0 2024-04-20T21:59:09.799 INFO:tasks.workunit.client.1.smithi164.stdout:0/787: truncate d1/d4/da/f6d 2066529 0 2024-04-20T21:59:09.801 INFO:tasks.workunit.client.1.smithi164.stdout:8/755: creat d0/d14/d4e/d62/d8f/ffd x:0 0 0 2024-04-20T21:59:09.801 INFO:tasks.workunit.client.1.smithi164.stdout:3/867: dwrite d12/fce [0,4194304] 0 2024-04-20T21:59:09.803 INFO:tasks.workunit.client.1.smithi164.stdout:7/837: creat d2/d21/d44/dd4/d82/f115 x:0 0 0 2024-04-20T21:59:09.805 INFO:tasks.workunit.client.1.smithi164.stdout:3/868: write d12/d20/d39/d69/d83/fb6 [580545,97328] 0 2024-04-20T21:59:09.812 INFO:tasks.workunit.client.1.smithi164.stdout:5/898: dwrite dc/d12/d1e/f12d [0,4194304] 0 2024-04-20T21:59:09.815 INFO:tasks.workunit.client.1.smithi164.stdout:0/788: mkdir d1/d4/da/de1 0 2024-04-20T21:59:09.816 INFO:tasks.workunit.client.1.smithi164.stdout:5/899: write dc/d2c/d2e/d30/d72/fdf [7631836,62511] 0 2024-04-20T21:59:09.820 INFO:tasks.workunit.client.1.smithi164.stdout:2/825: link d2/d19/d28/ld2 d2/l104 0 2024-04-20T21:59:09.824 INFO:tasks.workunit.client.1.smithi164.stdout:9/881: creat d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/dce/f13b x:0 0 0 2024-04-20T21:59:09.826 INFO:tasks.workunit.client.1.smithi164.stdout:9/882: fdatasync d3/db/dd/fe 0 2024-04-20T21:59:09.827 INFO:tasks.workunit.client.1.smithi164.stdout:8/756: dwrite d0/d14/d16/d58/fb8 [0,4194304] 0 2024-04-20T21:59:09.831 INFO:tasks.workunit.client.1.smithi164.stdout:3/869: link d12/d20/f88 d12/d68/f122 0 2024-04-20T21:59:09.831 INFO:tasks.workunit.client.1.smithi164.stdout:5/900: unlink dc/d12/d1e/da8/fe5 0 2024-04-20T21:59:09.834 INFO:tasks.workunit.client.1.smithi164.stdout:4/772: getdents d4/d9/d5c/d97/dbf/d67/d86/dc3/dc6 0 2024-04-20T21:59:09.836 INFO:tasks.workunit.client.1.smithi164.stdout:2/826: rename d2/d19/d28/f4e to d2/d19/da6/f105 0 2024-04-20T21:59:09.838 INFO:tasks.workunit.client.1.smithi164.stdout:5/901: read dc/d2c/d2e/d30/d5e/f9d [1722657,128229] 0 2024-04-20T21:59:09.839 INFO:tasks.workunit.client.1.smithi164.stdout:8/757: mknod d0/d14/d16/d58/d94/da5/dad/dd3/cfe 0 2024-04-20T21:59:09.842 INFO:tasks.workunit.client.1.smithi164.stdout:6/841: sync 2024-04-20T21:59:09.842 INFO:tasks.workunit.client.1.smithi164.stdout:0/789: mknod d1/d4/d26/d29/d2d/ddf/ce2 0 2024-04-20T21:59:09.844 INFO:tasks.workunit.client.1.smithi164.stdout:7/838: truncate d2/d21/d24/d31/d3a/d83/f96 3319323 0 2024-04-20T21:59:09.847 INFO:tasks.workunit.client.1.smithi164.stdout:7/839: read d2/d21/d33/fe5 [276583,77198] 0 2024-04-20T21:59:09.849 INFO:tasks.workunit.client.1.smithi164.stdout:6/842: read d0/d3/d15/d21/d101/d45/d4f/d61/f72 [673077,51619] 0 2024-04-20T21:59:09.851 INFO:tasks.workunit.client.1.smithi164.stdout:2/827: rename d2/d5/l7b to d2/d30/da5/ddf/l106 0 2024-04-20T21:59:09.854 INFO:tasks.workunit.client.1.smithi164.stdout:0/790: dread d1/d4/d26/d29/f9f [0,4194304] 0 2024-04-20T21:59:09.855 INFO:tasks.workunit.client.1.smithi164.stdout:8/758: mknod d0/d14/d16/d5a/cff 0 2024-04-20T21:59:09.857 INFO:tasks.workunit.client.1.smithi164.stdout:5/902: dwrite dc/d2b/d53/f10f [0,4194304] 0 2024-04-20T21:59:09.864 INFO:tasks.workunit.client.1.smithi164.stdout:3/870: write d12/d68/d6f/d71/d7d/fab [841353,123158] 0 2024-04-20T21:59:09.864 INFO:tasks.workunit.client.1.smithi164.stdout:1/748: sync 2024-04-20T21:59:09.865 INFO:tasks.workunit.client.1.smithi164.stdout:1/749: chown d10/d16 99194014 1 2024-04-20T21:59:09.871 INFO:tasks.workunit.client.1.smithi164.stdout:0/791: creat d1/d4/df/dbe/fe3 x:0 0 0 2024-04-20T21:59:09.873 INFO:tasks.workunit.client.1.smithi164.stdout:8/759: chown d0/d1e/l2c 30 1 2024-04-20T21:59:09.877 INFO:tasks.workunit.client.1.smithi164.stdout:7/840: unlink d2/d21/d24/d31/d3a/d83/d77/ce2 0 2024-04-20T21:59:09.877 INFO:tasks.workunit.client.1.smithi164.stdout:5/903: truncate dc/d2b/da0/df8/fff 762248 0 2024-04-20T21:59:09.878 INFO:tasks.workunit.client.1.smithi164.stdout:3/871: creat d12/d68/d6f/d71/d7d/f123 x:0 0 0 2024-04-20T21:59:09.946 INFO:tasks.workunit.client.1.smithi164.stdout:2/828: symlink d2/d19/d28/dd0/dba/l107 0 2024-04-20T21:59:09.947 INFO:tasks.workunit.client.1.smithi164.stdout:0/792: creat d1/d2b/fe4 x:0 0 0 2024-04-20T21:59:09.949 INFO:tasks.workunit.client.1.smithi164.stdout:9/883: getdents d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a 0 2024-04-20T21:59:09.952 INFO:tasks.workunit.client.1.smithi164.stdout:9/884: chown d3/db/dd/d40/d2a/d36/fa0 343134 1 2024-04-20T21:59:09.962 INFO:tasks.workunit.client.1.smithi164.stdout:4/773: rename d4/d9/d5c/d97/dbf/d67/d86/def/dad/lbb to d4/d9/d5c/d97/dbf/lf5 0 2024-04-20T21:59:09.993 INFO:tasks.workunit.client.1.smithi164.stdout:4/774: unlink d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41/fd7 0 2024-04-20T21:59:09.994 INFO:tasks.workunit.client.1.smithi164.stdout:4/775: readlink d4/ld3 0 2024-04-20T21:59:09.996 INFO:tasks.workunit.client.1.smithi164.stdout:2/829: read d2/d5/d3a/f3b [3367700,28577] 0 2024-04-20T21:59:09.997 INFO:tasks.workunit.client.1.smithi164.stdout:2/830: chown d2/d30/l66 718 1 2024-04-20T21:59:09.999 INFO:tasks.workunit.client.1.smithi164.stdout:0/793: symlink d1/d4/d26/d29/d2d/le5 0 2024-04-20T21:59:10.002 INFO:tasks.workunit.client.1.smithi164.stdout:0/794: read d1/d4/f7e [486194,8519] 0 2024-04-20T21:59:10.009 INFO:tasks.workunit.client.1.smithi164.stdout:5/904: link dc/d2b/f3f dc/d2c/d2e/dbd/d11f/d130/f135 0 2024-04-20T21:59:10.021 INFO:tasks.workunit.client.1.smithi164.stdout:8/760: getdents d0/d14/d16/d9d 0 2024-04-20T21:59:10.023 INFO:tasks.workunit.client.1.smithi164.stdout:3/872: getdents d12/d2a 0 2024-04-20T21:59:10.024 INFO:tasks.workunit.client.1.smithi164.stdout:6/843: link d0/d3/c95 d0/d3/d15/d21/d101/c120 0 2024-04-20T21:59:10.025 INFO:tasks.workunit.client.1.smithi164.stdout:4/776: mkdir d4/d9/d5c/d97/dbf/d67/d86/def/dad/df6 0 2024-04-20T21:59:10.026 INFO:tasks.workunit.client.1.smithi164.stdout:2/831: creat d2/d19/d28/dd0/df9/f108 x:0 0 0 2024-04-20T21:59:10.028 INFO:tasks.workunit.client.1.smithi164.stdout:0/795: dread d1/d4/d26/d29/d2d/d54/d77/d3c/f58 [0,4194304] 0 2024-04-20T21:59:10.032 INFO:tasks.workunit.client.1.smithi164.stdout:5/905: mknod dc/d12/d81/d120/c136 0 2024-04-20T21:59:10.038 INFO:tasks.workunit.client.1.smithi164.stdout:2/832: creat d2/d5/d3a/d55/f109 x:0 0 0 2024-04-20T21:59:10.039 INFO:tasks.workunit.client.1.smithi164.stdout:2/833: chown d2/d5 650147350 1 2024-04-20T21:59:10.043 INFO:tasks.workunit.client.1.smithi164.stdout:3/873: dwrite d12/d20/d39/d55/d6b/f80 [0,4194304] 0 2024-04-20T21:59:10.046 INFO:tasks.workunit.client.1.smithi164.stdout:8/761: fdatasync d0/d14/d5f/f7a 0 2024-04-20T21:59:10.056 INFO:tasks.workunit.client.1.smithi164.stdout:0/796: dread d1/d2b/f66 [0,4194304] 0 2024-04-20T21:59:10.062 INFO:tasks.workunit.client.1.smithi164.stdout:5/906: dread dc/f25 [0,4194304] 0 2024-04-20T21:59:10.067 INFO:tasks.workunit.client.1.smithi164.stdout:3/874: dwrite d12/d20/d39/d69/ffe [0,4194304] 0 2024-04-20T21:59:10.071 INFO:tasks.workunit.client.1.smithi164.stdout:0/797: creat d1/d4/df/fe6 x:0 0 0 2024-04-20T21:59:10.084 INFO:tasks.workunit.client.1.smithi164.stdout:8/762: symlink d0/d14/d4e/d62/d8f/l100 0 2024-04-20T21:59:10.084 INFO:tasks.workunit.client.1.smithi164.stdout:5/907: dwrite dc/d2c/d2e/d30/f55 [4194304,4194304] 0 2024-04-20T21:59:10.088 INFO:tasks.workunit.client.1.smithi164.stdout:0/798: dread d1/d4/d49/f4b [0,4194304] 0 2024-04-20T21:59:10.094 INFO:tasks.workunit.client.1.smithi164.stdout:8/763: readlink d0/d1e/l72 0 2024-04-20T21:59:10.096 INFO:tasks.workunit.client.1.smithi164.stdout:1/750: truncate d10/d16/d20/d25/fad 1412186 0 2024-04-20T21:59:10.096 INFO:tasks.workunit.client.1.smithi164.stdout:8/764: fsync d0/d14/d16/f26 0 2024-04-20T21:59:10.097 INFO:tasks.workunit.client.1.smithi164.stdout:1/751: fdatasync d10/f73 0 2024-04-20T21:59:10.101 INFO:tasks.workunit.client.1.smithi164.stdout:1/752: write d10/d16/d19/de0/d34/da9/fc3 [617339,111761] 0 2024-04-20T21:59:10.108 INFO:tasks.workunit.client.1.smithi164.stdout:8/765: creat d0/d14/db4/f101 x:0 0 0 2024-04-20T21:59:10.110 INFO:tasks.workunit.client.1.smithi164.stdout:3/875: dread d12/fd8 [0,4194304] 0 2024-04-20T21:59:10.112 INFO:tasks.workunit.client.1.smithi164.stdout:0/799: dwrite d1/d4/d20/f79 [0,4194304] 0 2024-04-20T21:59:10.113 INFO:tasks.workunit.client.1.smithi164.stdout:8/766: stat d0/d14/d16/d58/fea 0 2024-04-20T21:59:10.114 INFO:tasks.workunit.client.1.smithi164.stdout:8/767: fsync d0/d14/d16/dbf/fce 0 2024-04-20T21:59:10.122 INFO:tasks.workunit.client.1.smithi164.stdout:7/841: rename d2/d21/d24/d31/d3a/d83/d63/c6f to d2/d21/d24/d31/d3a/d83/d6a/de4/c116 0 2024-04-20T21:59:10.124 INFO:tasks.workunit.client.1.smithi164.stdout:8/768: creat d0/d14/d4e/d86/f102 x:0 0 0 2024-04-20T21:59:10.124 INFO:tasks.workunit.client.1.smithi164.stdout:9/885: dwrite d3/db/d1b/d20/d3f/d8a/da7/dbd/fa2 [0,4194304] 0 2024-04-20T21:59:10.132 INFO:tasks.workunit.client.1.smithi164.stdout:2/834: rename d2/d30/f83 to d2/d5/d3a/d65/d81/dac/f10a 0 2024-04-20T21:59:10.133 INFO:tasks.workunit.client.1.smithi164.stdout:8/769: dread - d0/d14/d4e/d62/f99 zero size 2024-04-20T21:59:10.136 INFO:tasks.workunit.client.1.smithi164.stdout:3/876: rename d12/d68/d101 to d12/d20/d39/d69/d83/db9/d124 0 2024-04-20T21:59:10.141 INFO:tasks.workunit.client.1.smithi164.stdout:2/835: symlink d2/d5/d3a/d55/d58/da2/db0/l10b 0 2024-04-20T21:59:10.142 INFO:tasks.workunit.client.1.smithi164.stdout:8/770: mknod d0/db3/c103 0 2024-04-20T21:59:10.144 INFO:tasks.workunit.client.1.smithi164.stdout:2/836: chown d2/d19/d28/f29 0 1 2024-04-20T21:59:10.144 INFO:tasks.workunit.client.1.smithi164.stdout:3/877: creat d12/d20/d39/d69/dad/de2/d111/f125 x:0 0 0 2024-04-20T21:59:10.147 INFO:tasks.workunit.client.1.smithi164.stdout:3/878: mknod d12/d6d/c126 0 2024-04-20T21:59:10.151 INFO:tasks.workunit.client.1.smithi164.stdout:3/879: write d12/d20/d39/d55/d6b/f80 [3109145,69431] 0 2024-04-20T21:59:10.153 INFO:tasks.workunit.client.1.smithi164.stdout:3/880: readlink d12/l10c 0 2024-04-20T21:59:10.155 INFO:tasks.workunit.client.1.smithi164.stdout:3/881: stat d12/d20/l33 0 2024-04-20T21:59:10.155 INFO:tasks.workunit.client.1.smithi164.stdout:2/837: getdents d2/dab 0 2024-04-20T21:59:10.157 INFO:tasks.workunit.client.1.smithi164.stdout:8/771: dread d0/d14/d4e/d62/fcc [0,4194304] 0 2024-04-20T21:59:10.160 INFO:tasks.workunit.client.1.smithi164.stdout:2/838: creat d2/d5/d3a/d65/d81/dac/dd6/f10c x:0 0 0 2024-04-20T21:59:10.163 INFO:tasks.workunit.client.1.smithi164.stdout:8/772: unlink d0/d1e/ff3 0 2024-04-20T21:59:10.166 INFO:tasks.workunit.client.1.smithi164.stdout:3/882: rename d12/fd8 to d12/d15/f127 0 2024-04-20T21:59:10.169 INFO:tasks.workunit.client.1.smithi164.stdout:6/844: truncate d0/d3/d15/d21/d5c/dbf/dbd/ddf/f96 1655579 0 2024-04-20T21:59:10.171 INFO:tasks.workunit.client.1.smithi164.stdout:6/845: chown d0/d3/d27/d9d 18839177 1 2024-04-20T21:59:10.172 INFO:tasks.workunit.client.1.smithi164.stdout:8/773: creat d0/d14/d4e/f104 x:0 0 0 2024-04-20T21:59:10.174 INFO:tasks.workunit.client.1.smithi164.stdout:2/839: dwrite d2/ff3 [0,4194304] 0 2024-04-20T21:59:10.174 INFO:tasks.workunit.client.1.smithi164.stdout:3/883: creat d12/d15/dae/d105/f128 x:0 0 0 2024-04-20T21:59:10.177 INFO:tasks.workunit.client.1.smithi164.stdout:2/840: truncate d2/dab/fd5 822012 0 2024-04-20T21:59:10.183 INFO:tasks.workunit.client.1.smithi164.stdout:6/846: dread d0/d3/d15/d21/d101/d45/d69/f8d [0,4194304] 0 2024-04-20T21:59:10.183 INFO:tasks.workunit.client.1.smithi164.stdout:3/884: chown d12/l5e 1963 1 2024-04-20T21:59:10.184 INFO:tasks.workunit.client.1.smithi164.stdout:8/774: rename d0/l45 to d0/d14/d16/d58/d94/da5/dad/dd3/dd4/l105 0 2024-04-20T21:59:10.191 INFO:tasks.workunit.client.1.smithi164.stdout:8/775: creat d0/d14/d5f/f106 x:0 0 0 2024-04-20T21:59:10.191 INFO:tasks.workunit.client.1.smithi164.stdout:8/776: chown d0/d14/d16 131 1 2024-04-20T21:59:10.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:10 smithi142 ceph-mon[15828]: pgmap v12: 65 pgs: 65 active+clean; 3.0 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 70 MiB/s rd, 196 MiB/s wr, 455 op/s 2024-04-20T21:59:10.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:10 smithi142 ceph-mon[15828]: Updating smithi164:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T21:59:10.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:10 smithi142 ceph-mon[15828]: Updating smithi142:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T21:59:10.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:10 smithi142 ceph-mon[15828]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-04-20T21:59:10.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:10 smithi142 ceph-mon[15828]: Updating smithi164:/etc/ceph/ceph.client.admin.keyring 2024-04-20T21:59:10.197 INFO:tasks.workunit.client.1.smithi164.stdout:2/841: dread d2/d19/d28/f38 [0,4194304] 0 2024-04-20T21:59:10.202 INFO:tasks.workunit.client.1.smithi164.stdout:2/842: dread - d2/dab/ffa zero size 2024-04-20T21:59:10.204 INFO:tasks.workunit.client.1.smithi164.stdout:8/777: getdents d0/db7 0 2024-04-20T21:59:10.213 INFO:tasks.workunit.client.1.smithi164.stdout:2/843: mknod d2/d19/d28/dd0/df9/c10d 0 2024-04-20T21:59:10.218 INFO:tasks.workunit.client.1.smithi164.stdout:1/753: truncate d10/d16/d19/de0/fe5 2418236 0 2024-04-20T21:59:10.222 INFO:tasks.workunit.client.1.smithi164.stdout:1/754: dread - d10/d16/d19/d1a/d51/d85/fe7 zero size 2024-04-20T21:59:10.237 INFO:tasks.workunit.client.1.smithi164.stdout:8/778: dwrite d0/d14/d4e/d62/d82/d97/f9c [0,4194304] 0 2024-04-20T21:59:10.246 INFO:tasks.workunit.client.1.smithi164.stdout:1/755: mkdir d10/d33/d48/d8b/de3/de4/df2 0 2024-04-20T21:59:10.249 INFO:tasks.workunit.client.1.smithi164.stdout:9/886: dwrite d3/ff [0,4194304] 0 2024-04-20T21:59:10.257 INFO:tasks.workunit.client.1.smithi164.stdout:7/842: dwrite d2/d21/d24/d31/d3a/d83/f96 [0,4194304] 0 2024-04-20T21:59:10.280 INFO:tasks.workunit.client.1.smithi164.stdout:2/844: dread d2/f3c [0,4194304] 0 2024-04-20T21:59:10.299 INFO:tasks.workunit.client.1.smithi164.stdout:4/777: sync 2024-04-20T21:59:10.300 INFO:tasks.workunit.client.1.smithi164.stdout:7/843: fsync d2/d21/d24/d31/d3a/d83/f96 0 2024-04-20T21:59:10.314 INFO:tasks.workunit.client.1.smithi164.stdout:4/778: dwrite d4/d9/d5c/d97/dbf/d5f/dcc/fd5 [0,4194304] 0 2024-04-20T21:59:10.317 INFO:tasks.workunit.client.1.smithi164.stdout:4/779: write d4/d9/d5c/f94 [486824,63612] 0 2024-04-20T21:59:10.318 INFO:tasks.workunit.client.1.smithi164.stdout:6/847: dwrite d0/d3/d11/faf [0,4194304] 0 2024-04-20T21:59:10.355 INFO:tasks.workunit.client.1.smithi164.stdout:6/848: fsync d0/d3/d11/faf 0 2024-04-20T21:59:10.355 INFO:tasks.workunit.client.1.smithi164.stdout:8/779: symlink d0/db3/l107 0 2024-04-20T21:59:10.357 INFO:tasks.workunit.client.1.smithi164.stdout:1/756: mkdir d10/d33/d48/d8b/de3/df3 0 2024-04-20T21:59:10.359 INFO:tasks.workunit.client.1.smithi164.stdout:9/887: chown d3/db/d1b/d1e/le7 8019575 1 2024-04-20T21:59:10.364 INFO:tasks.workunit.client.1.smithi164.stdout:7/844: chown d2/d21/c95 19763 1 2024-04-20T21:59:10.369 INFO:tasks.workunit.client.1.smithi164.stdout:3/885: sync 2024-04-20T21:59:10.370 INFO:tasks.workunit.client.1.smithi164.stdout:5/908: sync 2024-04-20T21:59:10.370 INFO:tasks.workunit.client.1.smithi164.stdout:0/800: sync 2024-04-20T21:59:10.370 INFO:tasks.workunit.client.1.smithi164.stdout:3/886: fdatasync d12/fce 0 2024-04-20T21:59:10.371 INFO:tasks.workunit.client.1.smithi164.stdout:4/780: creat d4/d9/d5c/d97/dbf/d5f/ff7 x:0 0 0 2024-04-20T21:59:10.372 INFO:tasks.workunit.client.1.smithi164.stdout:3/887: stat d12/d15/dae/f10d 0 2024-04-20T21:59:10.374 INFO:tasks.workunit.client.1.smithi164.stdout:3/888: chown d12/d20/d39/ddc/lee 0 1 2024-04-20T21:59:10.374 INFO:tasks.workunit.client.1.smithi164.stdout:8/780: fsync d0/d14/f4f 0 2024-04-20T21:59:10.375 INFO:tasks.workunit.client.1.smithi164.stdout:6/849: fsync d0/d3/d15/d21/d101/d45/d4f/d9c/fb9 0 2024-04-20T21:59:10.378 INFO:tasks.workunit.client.1.smithi164.stdout:9/888: symlink d3/db/dd/d40/d78/d86/d118/l13c 0 2024-04-20T21:59:10.379 INFO:tasks.workunit.client.1.smithi164.stdout:9/889: chown d3/db0/dc0/ff6 2309577 1 2024-04-20T21:59:10.392 INFO:tasks.workunit.client.1.smithi164.stdout:8/781: mknod d0/d14/db4/c108 0 2024-04-20T21:59:10.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.392+0000 7f178fc00700 1 -- 172.21.15.142:0/2910762386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f178810a810 msgr2=0x7f178810cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:10.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.392+0000 7f178fc00700 1 --2- 172.21.15.142:0/2910762386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f178810a810 0x7f178810cc60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1774009910 tx=0x7f1774009c20 comp rx=0 tx=0).stop 2024-04-20T21:59:10.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.392+0000 7f178fc00700 1 -- 172.21.15.142:0/2910762386 shutdown_connections 2024-04-20T21:59:10.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.392+0000 7f178fc00700 1 --2- 172.21.15.142:0/2910762386 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f178810a810 0x7f178810cc60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:10.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.392+0000 7f178fc00700 1 --2- 172.21.15.142:0/2910762386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1788107ee0 0x7f178810a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:10.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.392+0000 7f178fc00700 1 -- 172.21.15.142:0/2910762386 >> 172.21.15.142:0/2910762386 conn(0x7f178806de40 msgr2=0x7f1788070260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:10.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.392+0000 7f178fc00700 1 -- 172.21.15.142:0/2910762386 shutdown_connections 2024-04-20T21:59:10.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.392+0000 7f178fc00700 1 -- 172.21.15.142:0/2910762386 wait complete. 2024-04-20T21:59:10.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.394+0000 7f178fc00700 1 Processor -- start 2024-04-20T21:59:10.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.394+0000 7f178fc00700 1 -- start start 2024-04-20T21:59:10.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.394+0000 7f178fc00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1788107ee0 0x7f17881a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:10.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.395+0000 7f178fc00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178810a810 0x7f17881a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:10.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.395+0000 7f178fc00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17881a1c00 con 0x7f178810a810 2024-04-20T21:59:10.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.395+0000 7f178fc00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17881a1d40 con 0x7f1788107ee0 2024-04-20T21:59:10.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.395+0000 7f178d200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1788107ee0 0x7f17881a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:10.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.395+0000 7f1787e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178810a810 0x7f17881a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:10.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.395+0000 7f178d200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1788107ee0 0x7f17881a10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:54690/0 (socket says 172.21.15.142:54690) 2024-04-20T21:59:10.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.395+0000 7f178d200700 1 -- 172.21.15.142:0/943711277 learned_addr learned my addr 172.21.15.142:0/943711277 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:59:10.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.396+0000 7f178d200700 1 -- 172.21.15.142:0/943711277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178810a810 msgr2=0x7f17881a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:10.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.396+0000 7f178d200700 1 --2- 172.21.15.142:0/943711277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178810a810 0x7f17881a15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:10.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.396+0000 7f178d200700 1 -- 172.21.15.142:0/943711277 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17740095f0 con 0x7f1788107ee0 2024-04-20T21:59:10.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.396+0000 7f178d200700 1 --2- 172.21.15.142:0/943711277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1788107ee0 0x7f17881a10a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f177c007b50 tx=0x7f177c007f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:10.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.396+0000 7f1785600700 1 -- 172.21.15.142:0/943711277 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f177c00f040 con 0x7f1788107ee0 2024-04-20T21:59:10.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.397+0000 7f1785600700 1 -- 172.21.15.142:0/943711277 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f177c00ed30 con 0x7f1788107ee0 2024-04-20T21:59:10.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.397+0000 7f1785600700 1 -- 172.21.15.142:0/943711277 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f177c0133d0 con 0x7f1788107ee0 2024-04-20T21:59:10.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.398+0000 7f178fc00700 1 -- 172.21.15.142:0/943711277 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17881a67a0 con 0x7f1788107ee0 2024-04-20T21:59:10.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.398+0000 7f178fc00700 1 -- 172.21.15.142:0/943711277 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17881a6d70 con 0x7f1788107ee0 2024-04-20T21:59:10.398 INFO:tasks.workunit.client.1.smithi164.stdout:7/845: mkdir d2/d21/d24/d31/d3a/d83/d63/d85/d117 0 2024-04-20T21:59:10.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.399+0000 7f178fc00700 1 -- 172.21.15.142:0/943711277 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178804ebb0 con 0x7f1788107ee0 2024-04-20T21:59:10.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.402+0000 7f1785600700 1 -- 172.21.15.142:0/943711277 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 30) v1 ==== 92710+0+0 (secure 0 0 0) 0x7f177c00e870 con 0x7f1788107ee0 2024-04-20T21:59:10.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.403+0000 7f1785600700 1 --2- 172.21.15.142:0/943711277 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f177006eac0 0x7f1770070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:10.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.403+0000 7f1785600700 1 -- 172.21.15.142:0/943711277 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f177c08e380 con 0x7f1788107ee0 2024-04-20T21:59:10.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.404+0000 7f1787e00700 1 --2- 172.21.15.142:0/943711277 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f177006eac0 0x7f1770070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:10.404 INFO:tasks.workunit.client.1.smithi164.stdout:0/801: creat d1/d4/da/de1/fe7 x:0 0 0 2024-04-20T21:59:10.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.406+0000 7f1787e00700 1 --2- 172.21.15.142:0/943711277 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f177006eac0 0x7f1770070f80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f177400d480 tx=0x7f177400f040 comp rx=0 tx=0).ready entity=mgr.14722 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:10.405 INFO:tasks.workunit.client.1.smithi164.stdout:4/781: fsync d4/fe 0 2024-04-20T21:59:10.406 INFO:tasks.workunit.client.1.smithi164.stdout:9/890: dread d3/db/dd/d40/d2a/d36/d51/f70 [0,4194304] 0 2024-04-20T21:59:10.409 INFO:tasks.workunit.client.1.smithi164.stdout:5/909: getdents dc/d2c/d2e/d30/d5e/d12e 0 2024-04-20T21:59:10.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.410+0000 7f1785600700 1 -- 172.21.15.142:0/943711277 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f177c05b100 con 0x7f1788107ee0 2024-04-20T21:59:10.410 INFO:tasks.workunit.client.1.smithi164.stdout:9/891: readlink d3/db/dd/d40/d78/lfe 0 2024-04-20T21:59:10.410 INFO:tasks.workunit.client.1.smithi164.stdout:3/889: creat d12/d6d/d113/f129 x:0 0 0 2024-04-20T21:59:10.411 INFO:tasks.workunit.client.1.smithi164.stdout:1/757: stat d10/d16/d20/d25/fad 0 2024-04-20T21:59:10.411 INFO:tasks.workunit.client.1.smithi164.stdout:5/910: readlink dc/d2b/d52/l5a 0 2024-04-20T21:59:10.415 INFO:tasks.workunit.client.1.smithi164.stdout:2/845: dwrite d2/d5/d3a/d55/d58/da2/fc1 [0,4194304] 0 2024-04-20T21:59:10.424 INFO:tasks.workunit.client.1.smithi164.stdout:4/782: creat d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41/ff8 x:0 0 0 2024-04-20T21:59:10.426 INFO:tasks.workunit.client.1.smithi164.stdout:3/890: creat d12/d20/d39/dac/df7/f12a x:0 0 0 2024-04-20T21:59:10.429 INFO:tasks.workunit.client.1.smithi164.stdout:3/891: dread - d12/d20/d39/d69/d83/db9/d124/f8c zero size 2024-04-20T21:59:10.429 INFO:tasks.workunit.client.1.smithi164.stdout:2/846: mknod d2/d5f/c10e 0 2024-04-20T21:59:10.431 INFO:tasks.workunit.client.1.smithi164.stdout:2/847: stat d2/d19/d28/dd0/dba/ff8 0 2024-04-20T21:59:10.432 INFO:tasks.workunit.client.1.smithi164.stdout:0/802: creat d1/d4/d26/d29/d2d/d54/d97/fe8 x:0 0 0 2024-04-20T21:59:10.433 INFO:tasks.workunit.client.1.smithi164.stdout:1/758: symlink d10/d16/d20/d25/d95/dd9/lf4 0 2024-04-20T21:59:10.434 INFO:tasks.workunit.client.1.smithi164.stdout:0/803: dread - d1/d4/d20/d74/fd1 zero size 2024-04-20T21:59:10.434 INFO:tasks.workunit.client.1.smithi164.stdout:1/759: chown d10/d8a/le1 1 1 2024-04-20T21:59:10.437 INFO:tasks.workunit.client.1.smithi164.stdout:0/804: write d1/d4/da/d27/f32 [1100210,68936] 0 2024-04-20T21:59:10.438 INFO:tasks.workunit.client.1.smithi164.stdout:6/850: rename d0/d3/c95 to d0/d3/d15/d21/d5c/dbf/dbd/ddf/d28/c121 0 2024-04-20T21:59:10.440 INFO:tasks.workunit.client.1.smithi164.stdout:4/783: rmdir d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41 39 2024-04-20T21:59:10.440 INFO:tasks.workunit.client.1.smithi164.stdout:3/892: creat d12/d6d/f12b x:0 0 0 2024-04-20T21:59:10.441 INFO:tasks.workunit.client.1.smithi164.stdout:0/805: chown d1/d4/d26/d29/d2d/d54/d77/d3c/cb6 5288 1 2024-04-20T21:59:10.441 INFO:tasks.workunit.client.1.smithi164.stdout:4/784: fdatasync d4/fb 0 2024-04-20T21:59:10.443 INFO:tasks.workunit.client.1.smithi164.stdout:3/893: write d12/d68/d6f/d71/f7a [981829,70729] 0 2024-04-20T21:59:10.445 INFO:tasks.workunit.client.1.smithi164.stdout:8/782: link d0/d14/l4a d0/d14/d4e/d6f/de3/l109 0 2024-04-20T21:59:10.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:10 smithi164 ceph-mon[23506]: pgmap v12: 65 pgs: 65 active+clean; 3.0 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 70 MiB/s rd, 196 MiB/s wr, 455 op/s 2024-04-20T21:59:10.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:10 smithi164 ceph-mon[23506]: Updating smithi164:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T21:59:10.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:10 smithi164 ceph-mon[23506]: Updating smithi142:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T21:59:10.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:10 smithi164 ceph-mon[23506]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-04-20T21:59:10.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:10 smithi164 ceph-mon[23506]: Updating smithi164:/etc/ceph/ceph.client.admin.keyring 2024-04-20T21:59:10.448 INFO:tasks.workunit.client.1.smithi164.stdout:1/760: write d10/d16/d20/d91/d9d/fb8 [2063491,60495] 0 2024-04-20T21:59:10.450 INFO:tasks.workunit.client.1.smithi164.stdout:5/911: rename dc/d12/l87 to dc/d2c/d2e/d30/d72/da9/df0/d128/l137 0 2024-04-20T21:59:10.454 INFO:tasks.workunit.client.1.smithi164.stdout:7/846: getdents d2/d21/d24/d31/d3a/d83/d63/d85 0 2024-04-20T21:59:10.457 INFO:tasks.workunit.client.1.smithi164.stdout:2/848: symlink d2/d19/d28/dd0/dba/l10f 0 2024-04-20T21:59:10.464 INFO:tasks.workunit.client.1.smithi164.stdout:3/894: mkdir d12/d20/d39/d69/d83/d12c 0 2024-04-20T21:59:10.468 INFO:tasks.workunit.client.1.smithi164.stdout:3/895: write d12/d2a/db1/f116 [286070,120209] 0 2024-04-20T21:59:10.472 INFO:tasks.workunit.client.1.smithi164.stdout:4/785: write d4/d9/d5c/fbc [824210,119591] 0 2024-04-20T21:59:10.474 INFO:tasks.workunit.client.1.smithi164.stdout:7/847: fdatasync d2/d21/f89 0 2024-04-20T21:59:10.475 INFO:tasks.workunit.client.1.smithi164.stdout:2/849: creat d2/d30/de8/f110 x:0 0 0 2024-04-20T21:59:10.477 INFO:tasks.workunit.client.1.smithi164.stdout:2/850: chown d2/f8f 552380840 1 2024-04-20T21:59:10.482 INFO:tasks.workunit.client.1.smithi164.stdout:6/851: truncate d0/d3/d15/d21/d4b/fee 107663 0 2024-04-20T21:59:10.486 INFO:tasks.workunit.client.1.smithi164.stdout:0/806: truncate d1/d4/d26/fa8 2355838 0 2024-04-20T21:59:10.486 INFO:tasks.workunit.client.1.smithi164.stdout:6/852: write d0/d3/d15/d21/d5c/dbf/db4/dcd/f10f [719686,88931] 0 2024-04-20T21:59:10.492 INFO:tasks.workunit.client.1.smithi164.stdout:7/848: creat d2/d21/d24/d31/d3a/d83/dba/dbc/f118 x:0 0 0 2024-04-20T21:59:10.493 INFO:tasks.workunit.client.1.smithi164.stdout:1/761: creat d10/d33/ff5 x:0 0 0 2024-04-20T21:59:10.495 INFO:tasks.workunit.client.1.smithi164.stdout:1/762: write d10/d33/f87 [469076,58915] 0 2024-04-20T21:59:10.496 INFO:tasks.workunit.client.1.smithi164.stdout:3/896: dwrite d12/d20/d39/fd1 [0,4194304] 0 2024-04-20T21:59:10.500 INFO:tasks.workunit.client.1.smithi164.stdout:2/851: dread d2/d5/d3a/d65/d81/dac/f10a [0,4194304] 0 2024-04-20T21:59:10.501 INFO:tasks.workunit.client.1.smithi164.stdout:0/807: mknod d1/d4/d26/d29/d2d/d54/d77/ce9 0 2024-04-20T21:59:10.506 INFO:tasks.workunit.client.1.smithi164.stdout:5/912: getdents dc/d2b/da0 0 2024-04-20T21:59:10.510 INFO:tasks.workunit.client.1.smithi164.stdout:9/892: sync 2024-04-20T21:59:10.511 INFO:tasks.workunit.client.1.smithi164.stdout:5/913: chown dc/d2b/d6d/d73/dab/d10c/f119 1 1 2024-04-20T21:59:10.515 INFO:tasks.workunit.client.1.smithi164.stdout:1/763: dread d10/d33/d41/f58 [0,4194304] 0 2024-04-20T21:59:10.516 INFO:tasks.workunit.client.1.smithi164.stdout:7/849: symlink d2/d21/d24/d31/d3a/daa/l119 0 2024-04-20T21:59:10.517 INFO:tasks.workunit.client.1.smithi164.stdout:1/764: dread - d10/d33/ff5 zero size 2024-04-20T21:59:10.519 INFO:tasks.workunit.client.1.smithi164.stdout:4/786: truncate d4/d9/d22/f2f 3402587 0 2024-04-20T21:59:10.521 INFO:tasks.workunit.client.1.smithi164.stdout:3/897: rmdir d12/d15/dae/d105 39 2024-04-20T21:59:10.523 INFO:tasks.workunit.client.1.smithi164.stdout:8/783: link d0/d14/c9b d0/d14/d4e/d62/d82/c10a 0 2024-04-20T21:59:10.527 INFO:tasks.workunit.client.1.smithi164.stdout:2/852: symlink d2/l111 0 2024-04-20T21:59:10.529 INFO:tasks.workunit.client.1.smithi164.stdout:2/853: chown d2/d5/d3a/d65/d81/fda 322217 1 2024-04-20T21:59:10.532 INFO:tasks.workunit.client.1.smithi164.stdout:2/854: write d2/d19/d28/dd0/dba/ff8 [923542,89676] 0 2024-04-20T21:59:10.534 INFO:tasks.workunit.client.1.smithi164.stdout:0/808: dread d1/d4/f2c [0,4194304] 0 2024-04-20T21:59:10.534 INFO:tasks.workunit.client.1.smithi164.stdout:2/855: stat d2/d30/d84 0 2024-04-20T21:59:10.536 INFO:tasks.workunit.client.1.smithi164.stdout:2/856: fsync d2/d19/d28/dd0/dba/fc9 0 2024-04-20T21:59:10.539 INFO:tasks.workunit.client.1.smithi164.stdout:0/809: chown d1/d4/d26/d29/d2d/le5 234 1 2024-04-20T21:59:10.539 INFO:tasks.workunit.client.1.smithi164.stdout:6/853: dwrite d0/d3/d11/f49 [0,4194304] 0 2024-04-20T21:59:10.544 INFO:tasks.workunit.client.1.smithi164.stdout:3/898: creat d12/d20/d39/d69/db8/f12d x:0 0 0 2024-04-20T21:59:10.544 INFO:tasks.workunit.client.1.smithi164.stdout:8/784: mknod d0/d14/d4e/d86/c10b 0 2024-04-20T21:59:10.546 INFO:tasks.workunit.client.1.smithi164.stdout:2/857: rmdir d2/d5/d3a 39 2024-04-20T21:59:10.549 INFO:tasks.workunit.client.1.smithi164.stdout:9/893: dwrite d3/db/dcc/de3/f116 [0,4194304] 0 2024-04-20T21:59:10.560 INFO:tasks.workunit.client.1.smithi164.stdout:0/810: mknod d1/d4/d26/d29/d2d/d54/cea 0 2024-04-20T21:59:10.560 INFO:tasks.workunit.client.1.smithi164.stdout:6/854: fdatasync d0/d3/d15/f2c 0 2024-04-20T21:59:10.562 INFO:tasks.workunit.client.1.smithi164.stdout:4/787: write d4/d9/d22/f2f [1550953,67840] 0 2024-04-20T21:59:10.564 INFO:tasks.workunit.client.1.smithi164.stdout:1/765: creat d10/d16/d20/ff6 x:0 0 0 2024-04-20T21:59:10.577 INFO:tasks.workunit.client.1.smithi164.stdout:5/914: getdents dc/d2c 0 2024-04-20T21:59:10.582 INFO:tasks.workunit.client.1.smithi164.stdout:0/811: truncate d1/d4/da/d27/f69 926114 0 2024-04-20T21:59:10.583 INFO:tasks.workunit.client.1.smithi164.stdout:7/850: link d2/d21/d33/f9c d2/d21/d24/d31/d3a/d83/d6a/f11a 0 2024-04-20T21:59:10.584 INFO:tasks.workunit.client.1.smithi164.stdout:3/899: symlink d12/d20/d39/d69/d83/d12c/l12e 0 2024-04-20T21:59:10.586 INFO:tasks.workunit.client.1.smithi164.stdout:3/900: readlink d12/d20/d39/ddc/l106 0 2024-04-20T21:59:10.589 INFO:tasks.workunit.client.1.smithi164.stdout:1/766: symlink d10/d16/d19/d1a/d51/d85/lf7 0 2024-04-20T21:59:10.596 INFO:tasks.workunit.client.1.smithi164.stdout:9/894: dwrite d3/db/dd/f6a [0,4194304] 0 2024-04-20T21:59:10.597 INFO:tasks.workunit.client.1.smithi164.stdout:5/915: rename dc/d2b/d52/ffa to dc/d2b/d6d/d73/de3/f138 0 2024-04-20T21:59:10.598 INFO:tasks.workunit.client.1.smithi164.stdout:6/855: dwrite d0/d3/f12 [4194304,4194304] 0 2024-04-20T21:59:10.598 INFO:tasks.workunit.client.1.smithi164.stdout:4/788: truncate d4/f2b 110508 0 2024-04-20T21:59:10.603 INFO:tasks.workunit.client.1.smithi164.stdout:7/851: mknod d2/d21/d24/d31/d3a/d83/dba/dbc/c11b 0 2024-04-20T21:59:10.610 INFO:tasks.workunit.client.1.smithi164.stdout:5/916: write dc/d2b/fdc [2297557,47153] 0 2024-04-20T21:59:10.610 INFO:tasks.workunit.client.1.smithi164.stdout:0/812: write d1/d4/da/d5c/d6e/f96 [4329230,17268] 0 2024-04-20T21:59:10.611 INFO:tasks.workunit.client.1.smithi164.stdout:8/785: dwrite d0/d14/fa [0,4194304] 0 2024-04-20T21:59:10.615 INFO:tasks.workunit.client.1.smithi164.stdout:2/858: link d2/d5/d21/fa1 d2/d30/de8/df6/f112 0 2024-04-20T21:59:10.624 INFO:tasks.workunit.client.1.smithi164.stdout:5/917: chown dc/d2c/d2e/dbd/df9/f95 26550089 1 2024-04-20T21:59:10.624 INFO:tasks.workunit.client.1.smithi164.stdout:9/895: mknod d3/db/d1b/d20/d3f/dc7/c13d 0 2024-04-20T21:59:10.625 INFO:tasks.workunit.client.1.smithi164.stdout:3/901: dwrite d12/d20/d39/d55/d6b/ff0 [0,4194304] 0 2024-04-20T21:59:10.640 INFO:tasks.workunit.client.1.smithi164.stdout:4/789: dwrite d4/d9/d22/f52 [0,4194304] 0 2024-04-20T21:59:10.641 INFO:tasks.workunit.client.1.smithi164.stdout:6/856: write d0/d3/d27/f43 [1358951,49045] 0 2024-04-20T21:59:10.644 INFO:tasks.workunit.client.1.smithi164.stdout:3/902: readlink d12/d15/l29 0 2024-04-20T21:59:10.647 INFO:tasks.workunit.client.1.smithi164.stdout:7/852: dwrite d2/d21/d24/f52 [4194304,4194304] 0 2024-04-20T21:59:10.657 INFO:tasks.workunit.client.1.smithi164.stdout:1/767: dread d10/f5c [0,4194304] 0 2024-04-20T21:59:10.658 INFO:tasks.workunit.client.1.smithi164.stdout:5/918: creat dc/d12/f139 x:0 0 0 2024-04-20T21:59:10.661 INFO:tasks.workunit.client.1.smithi164.stdout:3/903: mkdir d12/d20/d39/d69/d9a/d12f 0 2024-04-20T21:59:10.664 INFO:tasks.workunit.client.1.smithi164.stdout:2/859: dwrite d2/d5/d3a/d65/d81/fe9 [0,4194304] 0 2024-04-20T21:59:10.667 INFO:tasks.workunit.client.1.smithi164.stdout:8/786: dread d0/d14/d5f/f7a [0,4194304] 0 2024-04-20T21:59:10.667 INFO:tasks.workunit.client.1.smithi164.stdout:6/857: creat d0/d3/d15/d21/d5c/dbf/dbd/ddf/f122 x:0 0 0 2024-04-20T21:59:10.673 INFO:tasks.workunit.client.1.smithi164.stdout:0/813: dwrite d1/f1b [0,4194304] 0 2024-04-20T21:59:10.678 INFO:tasks.workunit.client.1.smithi164.stdout:9/896: rename d3/db/dd/d40/d2a/d36/d51/da3 to d3/db/dd/d40/d2a/dc6/d13e 0 2024-04-20T21:59:10.681 INFO:tasks.workunit.client.1.smithi164.stdout:4/790: write d4/d9/d5c/d97/dbf/f63 [834220,94607] 0 2024-04-20T21:59:10.689 INFO:tasks.workunit.client.1.smithi164.stdout:1/768: creat d10/d33/d41/ff8 x:0 0 0 2024-04-20T21:59:10.689 INFO:tasks.workunit.client.1.smithi164.stdout:5/919: symlink dc/d12/d81/d116/l13a 0 2024-04-20T21:59:10.690 INFO:tasks.workunit.client.1.smithi164.stdout:3/904: creat d12/d68/d6f/d71/d7d/f130 x:0 0 0 2024-04-20T21:59:10.691 INFO:tasks.workunit.client.1.smithi164.stdout:9/897: creat d3/db/d1b/d20/f13f x:0 0 0 2024-04-20T21:59:10.699 INFO:tasks.workunit.client.1.smithi164.stdout:2/860: dwrite d2/d30/f4a [0,4194304] 0 2024-04-20T21:59:10.700 INFO:tasks.workunit.client.1.smithi164.stdout:8/787: dwrite d0/d14/d16/d58/f60 [0,4194304] 0 2024-04-20T21:59:10.705 INFO:tasks.workunit.client.1.smithi164.stdout:1/769: creat d10/d33/d48/ff9 x:0 0 0 2024-04-20T21:59:10.705 INFO:tasks.workunit.client.1.smithi164.stdout:4/791: symlink d4/d9/d5c/d97/dbf/d67/d86/dc3/dc6/lf9 0 2024-04-20T21:59:10.706 INFO:tasks.workunit.client.1.smithi164.stdout:9/898: dread - d3/fb1 zero size 2024-04-20T21:59:10.707 INFO:tasks.workunit.client.1.smithi164.stdout:3/905: truncate d12/d15/f70 382711 0 2024-04-20T21:59:10.708 INFO:tasks.workunit.client.1.smithi164.stdout:8/788: truncate d0/d14/d4e/d62/d8f/fb2 3585 0 2024-04-20T21:59:10.710 INFO:tasks.workunit.client.1.smithi164.stdout:8/789: truncate d0/d14/df6/ffb 761239 0 2024-04-20T21:59:10.711 INFO:tasks.workunit.client.1.smithi164.stdout:5/920: getdents dc/d2c/d2e/d30/d118 0 2024-04-20T21:59:10.729 INFO:tasks.workunit.client.1.smithi164.stdout:4/792: rename d4/d9/c83 to d4/d9/d22/dc9/cfa 0 2024-04-20T21:59:10.730 INFO:tasks.workunit.client.1.smithi164.stdout:1/770: symlink d10/d16/d19/d1a/lfa 0 2024-04-20T21:59:10.732 INFO:tasks.workunit.client.1.smithi164.stdout:2/861: creat d2/d19/d28/d3e/f113 x:0 0 0 2024-04-20T21:59:10.735 INFO:tasks.workunit.client.1.smithi164.stdout:8/790: getdents d0/d14/d4e/d62/d82/d97 0 2024-04-20T21:59:10.735 INFO:tasks.workunit.client.1.smithi164.stdout:5/921: getdents dc/d2b/d6d 0 2024-04-20T21:59:10.736 INFO:tasks.workunit.client.1.smithi164.stdout:9/899: dread d3/f41 [0,4194304] 0 2024-04-20T21:59:10.738 INFO:tasks.workunit.client.1.smithi164.stdout:5/922: chown dc/d2c/d2e/d30/d5e/cb3 1072 1 2024-04-20T21:59:10.740 INFO:tasks.workunit.client.1.smithi164.stdout:2/862: unlink d2/d5/d3a/d55/d58/l102 0 2024-04-20T21:59:10.741 INFO:tasks.workunit.client.1.smithi164.stdout:5/923: read dc/d2c/d2e/d30/d72/da9/fb2 [1848132,30237] 0 2024-04-20T21:59:10.743 INFO:tasks.workunit.client.1.smithi164.stdout:1/771: rename d10/d16/d19/de0/d34/f5d to d10/d16/d20/d25/d95/dd9/ffb 0 2024-04-20T21:59:10.745 INFO:tasks.workunit.client.1.smithi164.stdout:4/793: unlink d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41/cc5 0 2024-04-20T21:59:10.751 INFO:tasks.workunit.client.1.smithi164.stdout:3/906: write d12/d6d/f8e [5112026,4397] 0 2024-04-20T21:59:10.752 INFO:tasks.workunit.client.1.smithi164.stdout:1/772: dread d10/d33/d48/fb7 [0,4194304] 0 2024-04-20T21:59:10.758 INFO:tasks.workunit.client.1.smithi164.stdout:9/900: dwrite d3/db/dd/d40/d2a/f3a [0,4194304] 0 2024-04-20T21:59:10.758 INFO:tasks.workunit.client.1.smithi164.stdout:2/863: dwrite d2/f8a [0,4194304] 0 2024-04-20T21:59:10.760 INFO:tasks.workunit.client.1.smithi164.stdout:2/864: read d2/d19/d28/dd0/dba/fb2 [714633,749] 0 2024-04-20T21:59:10.774 INFO:tasks.workunit.client.1.smithi164.stdout:5/924: creat dc/d12/d1e/def/f13b x:0 0 0 2024-04-20T21:59:10.776 INFO:tasks.workunit.client.1.smithi164.stdout:3/907: mknod d12/d20/d39/d69/d9a/dbe/c131 0 2024-04-20T21:59:10.786 INFO:tasks.workunit.client.1.smithi164.stdout:3/908: mkdir d12/d2a/db1/d132 0 2024-04-20T21:59:10.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.826+0000 7f178fc00700 1 -- 172.21.15.142:0/943711277 --> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f178810b2f0 con 0x7f177006eac0 2024-04-20T21:59:10.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.828+0000 7f1785600700 1 -- 172.21.15.142:0/943711277 <== mgr.14722 v2:172.21.15.142:6800/54392364 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f178810b2f0 con 0x7f177006eac0 2024-04-20T21:59:10.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.832+0000 7f178fc00700 1 -- 172.21.15.142:0/943711277 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f177006eac0 msgr2=0x7f1770070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:10.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.832+0000 7f178fc00700 1 --2- 172.21.15.142:0/943711277 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f177006eac0 0x7f1770070f80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f177400d480 tx=0x7f177400f040 comp rx=0 tx=0).stop 2024-04-20T21:59:10.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.832+0000 7f178fc00700 1 -- 172.21.15.142:0/943711277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1788107ee0 msgr2=0x7f17881a10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:10.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.832+0000 7f178fc00700 1 --2- 172.21.15.142:0/943711277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1788107ee0 0x7f17881a10a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f177c007b50 tx=0x7f177c007f10 comp rx=0 tx=0).stop 2024-04-20T21:59:10.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.834+0000 7f178fc00700 1 -- 172.21.15.142:0/943711277 shutdown_connections 2024-04-20T21:59:10.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.834+0000 7f178fc00700 1 --2- 172.21.15.142:0/943711277 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f177006eac0 0x7f1770070f80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:10.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.834+0000 7f178fc00700 1 --2- 172.21.15.142:0/943711277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1788107ee0 0x7f17881a10a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:10.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.834+0000 7f178fc00700 1 --2- 172.21.15.142:0/943711277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178810a810 0x7f17881a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:10.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.834+0000 7f178fc00700 1 -- 172.21.15.142:0/943711277 >> 172.21.15.142:0/943711277 conn(0x7f178806de40 msgr2=0x7f1788070230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:10.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.834+0000 7f178fc00700 1 -- 172.21.15.142:0/943711277 shutdown_connections 2024-04-20T21:59:10.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:10.834+0000 7f178fc00700 1 -- 172.21.15.142:0/943711277 wait complete. 2024-04-20T21:59:10.835 INFO:tasks.workunit.client.1.smithi164.stdout:7/853: sync 2024-04-20T21:59:10.837 INFO:tasks.workunit.client.1.smithi164.stdout:9/901: write d3/db/d1b/d1e/f4b [1363464,71078] 0 2024-04-20T21:59:10.840 INFO:tasks.workunit.client.1.smithi164.stdout:5/925: getdents dc/d2b/df6 0 2024-04-20T21:59:10.840 INFO:tasks.workunit.client.1.smithi164.stdout:7/854: read d2/d21/d33/fc9 [4097097,7672] 0 2024-04-20T21:59:10.841 INFO:tasks.workunit.client.1.smithi164.stdout:9/902: write d3/fa [1820629,120215] 0 2024-04-20T21:59:10.850 INFO:tasks.workunit.client.1.smithi164.stdout:4/794: dwrite d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41/fa0 [0,4194304] 0 2024-04-20T21:59:10.851 INFO:tasks.workunit.client.1.smithi164.stdout:1/773: dwrite d10/f9e [0,4194304] 0 2024-04-20T21:59:10.851 INFO:tasks.workunit.client.1.smithi164.stdout:2/865: dwrite d2/d30/f4b [0,4194304] 0 2024-04-20T21:59:10.854 INFO:tasks.workunit.client.1.smithi164.stdout:1/774: dread - d10/d16/d19/d1a/d51/d85/fe7 zero size 2024-04-20T21:59:10.854 INFO:tasks.workunit.client.1.smithi164.stdout:4/795: readlink d4/d9/d5c/d97/dbf/d67/d86/dc3/dc6/lf9 0 2024-04-20T21:59:10.855 INFO:tasks.workunit.client.1.smithi164.stdout:1/775: chown l4 66 1 2024-04-20T21:59:10.856 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T21:59:10.860 INFO:tasks.workunit.client.1.smithi164.stdout:1/776: chown d10/d16/d19/d1a/lbd 1 1 2024-04-20T21:59:10.863 INFO:tasks.workunit.client.1.smithi164.stdout:5/926: mkdir dc/d2c/d13c 0 2024-04-20T21:59:10.863 INFO:tasks.workunit.client.1.smithi164.stdout:9/903: mknod d3/db/dcc/de3/c140 0 2024-04-20T21:59:10.863 INFO:tasks.workunit.client.1.smithi164.stdout:3/909: fsync d12/d68/d6f/f103 0 2024-04-20T21:59:10.870 INFO:tasks.workunit.client.1.smithi164.stdout:7/855: rename d2/d21/d44/dd4/f86 to d2/d21/d44/dd4/d82/d93/f11c 0 2024-04-20T21:59:10.872 INFO:tasks.workunit.client.1.smithi164.stdout:4/796: symlink d4/d9/d5c/d97/dd9/lfb 0 2024-04-20T21:59:10.872 INFO:tasks.workunit.client.1.smithi164.stdout:1/777: mkdir d10/d33/d4d/dc4/dfc 0 2024-04-20T21:59:10.877 INFO:tasks.workunit.client.1.smithi164.stdout:1/778: chown d10/d33/d4d/dc4/l88 2 1 2024-04-20T21:59:10.879 INFO:tasks.workunit.client.1.smithi164.stdout:9/904: rmdir d3/d9f/da1/d11f 39 2024-04-20T21:59:10.882 INFO:tasks.workunit.client.1.smithi164.stdout:3/910: mkdir d12/d20/d39/d69/db8/d133 0 2024-04-20T21:59:10.884 INFO:tasks.workunit.client.1.smithi164.stdout:3/911: readlink d12/l10c 0 2024-04-20T21:59:10.888 INFO:tasks.workunit.client.1.smithi164.stdout:9/905: rmdir d3/db 39 2024-04-20T21:59:10.890 INFO:tasks.workunit.client.1.smithi164.stdout:2/866: dwrite d2/d19/d28/f38 [0,4194304] 0 2024-04-20T21:59:10.893 INFO:tasks.workunit.client.1.smithi164.stdout:3/912: creat d12/d20/d39/dac/f134 x:0 0 0 2024-04-20T21:59:10.893 INFO:tasks.workunit.client.1.smithi164.stdout:7/856: dread d2/d21/d24/d31/d3a/d83/d68/f8b [0,4194304] 0 2024-04-20T21:59:10.893 INFO:tasks.workunit.client.1.smithi164.stdout:2/867: stat d2/d5/d3a/d55/d58/da2/db0/fc7 0 2024-04-20T21:59:10.895 INFO:tasks.workunit.client.1.smithi164.stdout:3/913: fsync d12/d6d/f8e 0 2024-04-20T21:59:10.909 INFO:tasks.workunit.client.1.smithi164.stdout:3/914: truncate ff 1740605 0 2024-04-20T21:59:10.910 INFO:tasks.workunit.client.1.smithi164.stdout:1/779: creat d10/d33/ffd x:0 0 0 2024-04-20T21:59:10.911 INFO:tasks.workunit.client.1.smithi164.stdout:4/797: link d4/d9/d5c/d97/dbf/d67/d86/def/dad/ce7 d4/d9/d5c/d97/dbf/d67/d86/def/dad/df6/cfc 0 2024-04-20T21:59:10.912 INFO:tasks.workunit.client.1.smithi164.stdout:2/868: dwrite d2/d5/d21/f2b [0,4194304] 0 2024-04-20T21:59:10.913 INFO:tasks.workunit.client.1.smithi164.stdout:1/780: dread - d10/d16/d19/de0/d34/da9/fd3 zero size 2024-04-20T21:59:10.914 INFO:tasks.workunit.client.1.smithi164.stdout:2/869: chown d2/d5/d3a/d65/f7f 413 1 2024-04-20T21:59:10.915 INFO:tasks.workunit.client.1.smithi164.stdout:9/906: truncate d3/db/dd/d40/d2a/d36/f50 683486 0 2024-04-20T21:59:10.920 INFO:tasks.workunit.client.1.smithi164.stdout:1/781: dread - d10/d33/d41/f55 zero size 2024-04-20T21:59:10.922 INFO:tasks.workunit.client.1.smithi164.stdout:3/915: link f6 d12/d20/d39/f135 0 2024-04-20T21:59:10.925 INFO:tasks.workunit.client.1.smithi164.stdout:4/798: symlink d4/d9/d27/lfd 0 2024-04-20T21:59:10.928 INFO:tasks.workunit.client.1.smithi164.stdout:9/907: rename d3/db0/dc0/ff6 to d3/db0/d132/f141 0 2024-04-20T21:59:10.928 INFO:tasks.workunit.client.1.smithi164.stdout:1/782: truncate d10/d16/fdb 454859 0 2024-04-20T21:59:10.933 INFO:tasks.workunit.client.1.smithi164.stdout:2/870: dwrite d2/d19/da6/fe3 [0,4194304] 0 2024-04-20T21:59:10.933 INFO:tasks.workunit.client.1.smithi164.stdout:4/799: unlink d4/d9/d22/c9c 0 2024-04-20T21:59:10.935 INFO:tasks.workunit.client.1.smithi164.stdout:9/908: mknod d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/c142 0 2024-04-20T21:59:10.935 INFO:tasks.workunit.client.1.smithi164.stdout:2/871: stat d2/d5/d3a/d65/d81/fda 0 2024-04-20T21:59:10.937 INFO:tasks.workunit.client.1.smithi164.stdout:7/857: dread d2/d21/f25 [0,4194304] 0 2024-04-20T21:59:10.938 INFO:tasks.workunit.client.1.smithi164.stdout:2/872: fsync d2/d5/d3a/d55/d58/da2/fea 0 2024-04-20T21:59:10.939 INFO:tasks.workunit.client.1.smithi164.stdout:4/800: unlink d4/d9/da4/fb3 0 2024-04-20T21:59:10.942 INFO:tasks.workunit.client.1.smithi164.stdout:1/783: getdents d10/d16/d19/d1a/d51/d85 0 2024-04-20T21:59:10.947 INFO:tasks.workunit.client.1.smithi164.stdout:1/784: write d10/d16/d20/d91/d9d/fb8 [3812292,113563] 0 2024-04-20T21:59:10.951 INFO:tasks.workunit.client.1.smithi164.stdout:9/909: link d3/db/dd/f5d d3/f143 0 2024-04-20T21:59:10.952 INFO:tasks.workunit.client.1.smithi164.stdout:0/814: sync 2024-04-20T21:59:10.952 INFO:tasks.workunit.client.1.smithi164.stdout:6/858: sync 2024-04-20T21:59:10.953 INFO:tasks.workunit.client.1.smithi164.stdout:0/815: chown d1/d4 5509114 1 2024-04-20T21:59:10.954 INFO:tasks.workunit.client.1.smithi164.stdout:2/873: symlink d2/d5/d3a/d55/d58/da2/db0/l114 0 2024-04-20T21:59:10.957 INFO:tasks.workunit.client.1.smithi164.stdout:6/859: chown d0/d3/d15/d21/d5c/dbf/l63 40609 1 2024-04-20T21:59:10.957 INFO:tasks.workunit.client.1.smithi164.stdout:3/916: dread d12/d20/d39/d69/d83/db9/d124/fbb [0,4194304] 0 2024-04-20T21:59:10.966 INFO:tasks.workunit.client.1.smithi164.stdout:4/801: getdents d4/d9/d5c/d97/daa 0 2024-04-20T21:59:10.972 INFO:tasks.workunit.client.1.smithi164.stdout:7/858: truncate d2/d21/d44/f4e 310492 0 2024-04-20T21:59:10.973 INFO:tasks.workunit.client.1.smithi164.stdout:9/910: write d3/f41 [3121427,76474] 0 2024-04-20T21:59:10.975 INFO:tasks.workunit.client.1.smithi164.stdout:1/785: dread d10/d16/d19/d1a/d51/f6a [0,4194304] 0 2024-04-20T21:59:10.975 INFO:tasks.workunit.client.1.smithi164.stdout:3/917: unlink d12/d20/fff 0 2024-04-20T21:59:10.977 INFO:tasks.workunit.client.1.smithi164.stdout:4/802: mknod d4/d9/d27/d37/cfe 0 2024-04-20T21:59:10.979 INFO:tasks.workunit.client.1.smithi164.stdout:2/874: symlink d2/d5f/de6/l115 0 2024-04-20T21:59:10.984 INFO:tasks.workunit.client.1.smithi164.stdout:3/918: read d12/d15/f47 [1749760,4522] 0 2024-04-20T21:59:10.985 INFO:tasks.workunit.client.1.smithi164.stdout:1/786: fdatasync d10/d16/d20/d25/d95/fb5 0 2024-04-20T21:59:10.990 INFO:tasks.workunit.client.1.smithi164.stdout:2/875: truncate d2/f20 818271 0 2024-04-20T21:59:10.990 INFO:tasks.workunit.client.1.smithi164.stdout:9/911: mknod d3/c144 0 2024-04-20T21:59:10.995 INFO:tasks.workunit.client.1.smithi164.stdout:0/816: dread d1/d4/d26/d29/d2d/fa7 [0,4194304] 0 2024-04-20T21:59:11.001 INFO:tasks.workunit.client.1.smithi164.stdout:8/791: sync 2024-04-20T21:59:11.004 INFO:tasks.workunit.client.1.smithi164.stdout:6/860: dwrite d0/d3/d15/d21/d5c/dbf/dbd/ddf/f96 [0,4194304] 0 2024-04-20T21:59:11.007 INFO:tasks.workunit.client.1.smithi164.stdout:4/803: rename d4/d9/d5c/d97/dbf/d67/d86/def/dad/ce7 to d4/d9/d5c/d97/dbf/d5f/cff 0 2024-04-20T21:59:11.007 INFO:tasks.workunit.client.1.smithi164.stdout:3/919: symlink d12/d20/l136 0 2024-04-20T21:59:11.009 INFO:tasks.workunit.client.1.smithi164.stdout:1/787: symlink d10/d33/lfe 0 2024-04-20T21:59:11.009 INFO:tasks.workunit.client.1.smithi164.stdout:6/861: chown d0/d3/d11/d29/d6e/db2/df5/cf8 18887 1 2024-04-20T21:59:11.010 INFO:tasks.workunit.client.1.smithi164.stdout:7/859: link d2/d21/d44/dd4/c112 d2/d21/d24/d31/d3a/d83/d106/c11d 0 2024-04-20T21:59:11.015 INFO:tasks.workunit.client.1.smithi164.stdout:8/792: unlink d0/d14/d4e/d62/d8f/fae 0 2024-04-20T21:59:11.017 INFO:tasks.workunit.client.1.smithi164.stdout:4/804: rmdir d4/d9/d42 39 2024-04-20T21:59:11.018 INFO:tasks.workunit.client.1.smithi164.stdout:9/912: mkdir d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/d145 0 2024-04-20T21:59:11.021 INFO:tasks.workunit.client.1.smithi164.stdout:4/805: dread - d4/d9/d5c/d97/dbf/d67/fe0 zero size 2024-04-20T21:59:11.023 INFO:tasks.workunit.client.1.smithi164.stdout:6/862: creat d0/d3/d15/d21/d5c/dbf/d107/f123 x:0 0 0 2024-04-20T21:59:11.025 INFO:tasks.workunit.client.1.smithi164.stdout:7/860: creat d2/d21/d24/d31/d3a/d83/dba/def/f11e x:0 0 0 2024-04-20T21:59:11.030 INFO:tasks.workunit.client.1.smithi164.stdout:2/876: creat d2/d5/d3a/f116 x:0 0 0 2024-04-20T21:59:11.034 INFO:tasks.workunit.client.1.smithi164.stdout:3/920: unlink d12/d20/d39/dac/cef 0 2024-04-20T21:59:11.036 INFO:tasks.workunit.client.1.smithi164.stdout:3/921: chown d12/d20/d39/d69/db8/ce7 196297722 1 2024-04-20T21:59:11.037 INFO:tasks.workunit.client.1.smithi164.stdout:1/788: mkdir d10/d16/d19/d1a/dff 0 2024-04-20T21:59:11.039 INFO:tasks.workunit.client.1.smithi164.stdout:6/863: dwrite d0/d3/d15/d21/d101/d45/d69/fa6 [0,4194304] 0 2024-04-20T21:59:11.044 INFO:tasks.workunit.client.1.smithi164.stdout:0/817: getdents d1/d4/d26 0 2024-04-20T21:59:11.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.049+0000 7f7917e00700 1 -- 172.21.15.142:0/3360430279 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f790c00baf0 con 0x7f79180ff470 2024-04-20T21:59:11.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.049+0000 7f7920200700 1 -- 172.21.15.142:0/3360430279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79180ff470 msgr2=0x7f79181018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:11.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.049+0000 7f7920200700 1 --2- 172.21.15.142:0/3360430279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79180ff470 0x7f79181018a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f790c009910 tx=0x7f790c009c20 comp rx=0 tx=0).stop 2024-04-20T21:59:11.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.050+0000 7f7920200700 1 -- 172.21.15.142:0/3360430279 shutdown_connections 2024-04-20T21:59:11.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.050+0000 7f7920200700 1 --2- 172.21.15.142:0/3360430279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7918101de0 0x7f7918104270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:11.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.050+0000 7f7920200700 1 --2- 172.21.15.142:0/3360430279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79180ff470 0x7f79181018a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:11.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.050+0000 7f7920200700 1 -- 172.21.15.142:0/3360430279 >> 172.21.15.142:0/3360430279 conn(0x7f79180fb0d0 msgr2=0x7f79180fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:11.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.050+0000 7f7920200700 1 -- 172.21.15.142:0/3360430279 shutdown_connections 2024-04-20T21:59:11.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.050+0000 7f7920200700 1 -- 172.21.15.142:0/3360430279 wait complete. 2024-04-20T21:59:11.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.052+0000 7f7920200700 1 Processor -- start 2024-04-20T21:59:11.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.052+0000 7f7920200700 1 -- start start 2024-04-20T21:59:11.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.052+0000 7f7920200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79180ff470 0x7f791819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:11.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.052+0000 7f7920200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7918101de0 0x7f791819d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:11.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.052+0000 7f7920200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791819d790 con 0x7f7918101de0 2024-04-20T21:59:11.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.052+0000 7f7920200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791819d8d0 con 0x7f79180ff470 2024-04-20T21:59:11.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.053+0000 7f791ce00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7918101de0 0x7f791819d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:11.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.053+0000 7f791ce00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7918101de0 0x7f791819d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48720/0 (socket says 172.21.15.142:48720) 2024-04-20T21:59:11.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.053+0000 7f791ce00700 1 -- 172.21.15.142:0/1407287080 learned_addr learned my addr 172.21.15.142:0/1407287080 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:59:11.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.053+0000 7f791d800700 1 --2- 172.21.15.142:0/1407287080 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79180ff470 0x7f791819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:11.054 INFO:tasks.workunit.client.1.smithi164.stdout:1/789: creat d10/d33/d41/f100 x:0 0 0 2024-04-20T21:59:11.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.054+0000 7f791ce00700 1 -- 172.21.15.142:0/1407287080 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79180ff470 msgr2=0x7f791819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:11.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.054+0000 7f791ce00700 1 --2- 172.21.15.142:0/1407287080 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79180ff470 0x7f791819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:11.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.054+0000 7f791ce00700 1 -- 172.21.15.142:0/1407287080 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c0095f0 con 0x7f7918101de0 2024-04-20T21:59:11.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.054+0000 7f791ce00700 1 --2- 172.21.15.142:0/1407287080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7918101de0 0x7f791819d170 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f790400e920 tx=0x7f790400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:11.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.054+0000 7f7916000700 1 -- 172.21.15.142:0/1407287080 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7904009790 con 0x7f7918101de0 2024-04-20T21:59:11.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.055+0000 7f7916000700 1 -- 172.21.15.142:0/1407287080 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f790400cba0 con 0x7f7918101de0 2024-04-20T21:59:11.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.055+0000 7f7916000700 1 -- 172.21.15.142:0/1407287080 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7904018650 con 0x7f7918101de0 2024-04-20T21:59:11.055 INFO:tasks.workunit.client.1.smithi164.stdout:4/806: write d4/d9/d5c/d97/dbf/d67/d86/f84 [3659339,121729] 0 2024-04-20T21:59:11.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.055+0000 7f7920200700 1 -- 172.21.15.142:0/1407287080 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7918105c30 con 0x7f7918101de0 2024-04-20T21:59:11.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.055+0000 7f7920200700 1 -- 172.21.15.142:0/1407287080 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7918106200 con 0x7f7918101de0 2024-04-20T21:59:11.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.057+0000 7f7920200700 1 -- 172.21.15.142:0/1407287080 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7918062510 con 0x7f7918101de0 2024-04-20T21:59:11.057 INFO:tasks.workunit.client.1.smithi164.stdout:1/790: fsync d10/d33/d4d/fed 0 2024-04-20T21:59:11.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.058+0000 7f7916000700 1 -- 172.21.15.142:0/1407287080 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 30) v1 ==== 92710+0+0 (secure 0 0 0) 0x7f790400cd10 con 0x7f7918101de0 2024-04-20T21:59:11.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.059+0000 7f7916000700 1 --2- 172.21.15.142:0/1407287080 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f790006ea80 0x7f7900070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:11.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.059+0000 7f7916000700 1 -- 172.21.15.142:0/1407287080 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f7904014070 con 0x7f7918101de0 2024-04-20T21:59:11.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.060+0000 7f791d800700 1 --2- 172.21.15.142:0/1407287080 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f790006ea80 0x7f7900070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:11.060 INFO:tasks.workunit.client.1.smithi164.stdout:2/877: mknod d2/d5/d3a/d65/d81/d100/c117 0 2024-04-20T21:59:11.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.061+0000 7f791d800700 1 --2- 172.21.15.142:0/1407287080 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f790006ea80 0x7f7900070f40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f790c006010 tx=0x7f790c009f70 comp rx=0 tx=0).ready entity=mgr.14722 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:11.065 INFO:tasks.workunit.client.1.smithi164.stdout:6/864: dwrite d0/d3/d27/d9d/dc3/ffb [0,4194304] 0 2024-04-20T21:59:11.065 INFO:tasks.workunit.client.1.smithi164.stdout:1/791: dread - d10/d16/d20/ff6 zero size 2024-04-20T21:59:11.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.067+0000 7f7916000700 1 -- 172.21.15.142:0/1407287080 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f7904053f60 con 0x7f7918101de0 2024-04-20T21:59:11.067 INFO:tasks.workunit.client.1.smithi164.stdout:8/793: getdents d0/d14/d4e/d6f/de3 0 2024-04-20T21:59:11.067 INFO:tasks.workunit.client.1.smithi164.stdout:5/927: sync 2024-04-20T21:59:11.069 INFO:tasks.workunit.client.1.smithi164.stdout:8/794: fsync d0/d14/f3e 0 2024-04-20T21:59:11.069 INFO:tasks.workunit.client.1.smithi164.stdout:4/807: dread - d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d4a/f69 zero size 2024-04-20T21:59:11.071 INFO:tasks.workunit.client.1.smithi164.stdout:9/913: dwrite d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/fad [0,4194304] 0 2024-04-20T21:59:11.076 INFO:tasks.workunit.client.1.smithi164.stdout:7/861: write d2/d21/d44/f4e [405682,84835] 0 2024-04-20T21:59:11.078 INFO:tasks.workunit.client.1.smithi164.stdout:1/792: truncate d10/d16/d20/ff6 808966 0 2024-04-20T21:59:11.084 INFO:tasks.workunit.client.1.smithi164.stdout:0/818: dread d1/d4/d20/d74/f35 [0,4194304] 0 2024-04-20T21:59:11.091 INFO:tasks.workunit.client.1.smithi164.stdout:4/808: dread d4/d9/f17 [0,4194304] 0 2024-04-20T21:59:11.100 INFO:tasks.workunit.client.1.smithi164.stdout:1/793: stat l2 0 2024-04-20T21:59:11.102 INFO:tasks.workunit.client.1.smithi164.stdout:9/914: write d3/db/d1b/f46 [1238371,125226] 0 2024-04-20T21:59:11.103 INFO:tasks.workunit.client.1.smithi164.stdout:3/922: dread d12/d15/f24 [0,4194304] 0 2024-04-20T21:59:11.106 INFO:tasks.workunit.client.1.smithi164.stdout:5/928: mkdir dc/d2c/d2e/d30/d8c/d13d 0 2024-04-20T21:59:11.107 INFO:tasks.workunit.client.1.smithi164.stdout:8/795: stat d0/d14/d16/d5a/f93 0 2024-04-20T21:59:11.108 INFO:tasks.workunit.client.1.smithi164.stdout:3/923: read d12/d6d/fa9 [154416,128256] 0 2024-04-20T21:59:11.108 INFO:tasks.workunit.client.1.smithi164.stdout:6/865: symlink d0/d3/d15/d21/d5c/dbf/dbd/ddf/d11c/l124 0 2024-04-20T21:59:11.110 INFO:tasks.workunit.client.1.smithi164.stdout:5/929: write dc/d2c/d2e/d30/f55 [4195085,87056] 0 2024-04-20T21:59:11.113 INFO:tasks.workunit.client.1.smithi164.stdout:7/862: fsync d2/d21/d24/d31/d3a/d83/d6a/f11a 0 2024-04-20T21:59:11.114 INFO:tasks.workunit.client.1.smithi164.stdout:3/924: write d12/d20/d39/d69/ffe [4570817,50252] 0 2024-04-20T21:59:11.117 INFO:tasks.workunit.client.1.smithi164.stdout:5/930: write dc/d2c/d2e/dbd/df9/f95 [4757823,74043] 0 2024-04-20T21:59:11.118 INFO:tasks.workunit.client.1.smithi164.stdout:5/931: fdatasync dc/d12/f15 0 2024-04-20T21:59:11.122 INFO:tasks.workunit.client.1.smithi164.stdout:4/809: mkdir d4/d9/d5c/d97/dbf/d100 0 2024-04-20T21:59:11.125 INFO:tasks.workunit.client.1.smithi164.stdout:8/796: read - d0/d14/d16/d5a/f93 zero size 2024-04-20T21:59:11.128 INFO:tasks.workunit.client.1.smithi164.stdout:0/819: dread d1/d4/d26/f76 [0,4194304] 0 2024-04-20T21:59:11.131 INFO:tasks.workunit.client.1.smithi164.stdout:7/863: creat d2/d21/d24/d31/f11f x:0 0 0 2024-04-20T21:59:11.131 INFO:tasks.workunit.client.1.smithi164.stdout:2/878: dread d2/d5/d3a/d65/d81/dac/fcd [0,4194304] 0 2024-04-20T21:59:11.133 INFO:tasks.workunit.client.1.smithi164.stdout:7/864: chown d2/d21/d44/dd4/f76 15339539 1 2024-04-20T21:59:11.134 INFO:tasks.workunit.client.1.smithi164.stdout:9/915: fsync d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/dce/f12f 0 2024-04-20T21:59:11.143 INFO:tasks.workunit.client.1.smithi164.stdout:2/879: symlink d2/d5/d3a/d55/d58/db8/l118 0 2024-04-20T21:59:11.148 INFO:tasks.workunit.client.1.smithi164.stdout:9/916: rename d3/db/d1b/d20/d3f/dc7 to d3/db0/d132/d146 0 2024-04-20T21:59:11.149 INFO:tasks.workunit.client.1.smithi164.stdout:6/866: creat d0/d3/d15/d21/d101/f125 x:0 0 0 2024-04-20T21:59:11.150 INFO:tasks.workunit.client.1.smithi164.stdout:8/797: symlink d0/d14/d16/d58/d94/da5/dad/l10c 0 2024-04-20T21:59:11.151 INFO:tasks.workunit.client.1.smithi164.stdout:4/810: creat d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41/de5/f101 x:0 0 0 2024-04-20T21:59:11.152 INFO:tasks.workunit.client.1.smithi164.stdout:1/794: getdents d10/d33/d4d 0 2024-04-20T21:59:11.153 INFO:tasks.workunit.client.1.smithi164.stdout:0/820: mkdir d1/d4/da/d5c/deb 0 2024-04-20T21:59:11.153 INFO:tasks.workunit.client.1.smithi164.stdout:1/795: readlink d10/d16/d20/d25/d3d/lea 0 2024-04-20T21:59:11.155 INFO:tasks.workunit.client.1.smithi164.stdout:2/880: creat d2/d5/d3a/d55/d58/db8/f119 x:0 0 0 2024-04-20T21:59:11.155 INFO:tasks.workunit.client.1.smithi164.stdout:0/821: chown d1/d4/da 4720849 1 2024-04-20T21:59:11.155 INFO:tasks.workunit.client.1.smithi164.stdout:7/865: symlink d2/d21/d24/d31/d3a/d83/d6a/de4/l120 0 2024-04-20T21:59:11.156 INFO:tasks.workunit.client.1.smithi164.stdout:6/867: fsync d0/d3/d62/d75/fa1 0 2024-04-20T21:59:11.158 INFO:tasks.workunit.client.1.smithi164.stdout:6/868: readlink d0/ld8 0 2024-04-20T21:59:11.158 INFO:tasks.workunit.client.1.smithi164.stdout:9/917: creat d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/dce/f147 x:0 0 0 2024-04-20T21:59:11.159 INFO:tasks.workunit.client.1.smithi164.stdout:2/881: truncate d2/f8a 4713544 0 2024-04-20T21:59:11.161 INFO:tasks.workunit.client.1.smithi164.stdout:5/932: dread dc/f7d [0,4194304] 0 2024-04-20T21:59:11.161 INFO:tasks.workunit.client.1.smithi164.stdout:1/796: mknod d10/d33/d4d/dc4/dfc/c101 0 2024-04-20T21:59:11.167 INFO:tasks.workunit.client.1.smithi164.stdout:3/925: write d12/d20/d39/d69/d83/db9/d124/f8c [317856,73977] 0 2024-04-20T21:59:11.170 INFO:tasks.workunit.client.1.smithi164.stdout:5/933: mknod dc/d2c/d2e/dbd/df9/d104/c13e 0 2024-04-20T21:59:11.170 INFO:tasks.workunit.client.1.smithi164.stdout:3/926: readlink d12/d20/d39/d55/l5b 0 2024-04-20T21:59:11.176 INFO:tasks.workunit.client.1.smithi164.stdout:7/866: rename d2/d21/d24/d31/d3a/d83/d6a/l10a to d2/d21/d24/d31/d3a/d83/d63/d85/d117/l121 0 2024-04-20T21:59:11.178 INFO:tasks.workunit.client.1.smithi164.stdout:6/869: dwrite d0/d3/d15/d21/d101/f125 [0,4194304] 0 2024-04-20T21:59:11.183 INFO:tasks.workunit.client.1.smithi164.stdout:6/870: chown d0/d3/d62/d75/fb3 3799 1 2024-04-20T21:59:11.185 INFO:tasks.workunit.client.1.smithi164.stdout:3/927: mkdir d12/d20/d39/d69/dad/de2/d137 0 2024-04-20T21:59:11.188 INFO:tasks.workunit.client.1.smithi164.stdout:3/928: chown d12/d20/d39/d69/d9a/ccd 9213 1 2024-04-20T21:59:11.190 INFO:tasks.workunit.client.1.smithi164.stdout:3/929: readlink d12/d20/d39/d69/le8 0 2024-04-20T21:59:11.191 INFO:tasks.workunit.client.1.smithi164.stdout:7/867: rmdir d2/d21/d24/d31/d3a/d83/dcf/dea/d107 39 2024-04-20T21:59:11.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:11 smithi142 ceph-mon[15828]: Updating smithi142:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T21:59:11.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:11 smithi142 ceph-mon[15828]: Updating smithi164:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T21:59:11.196 INFO:tasks.workunit.client.1.smithi164.stdout:7/868: write d2/d21/d44/f98 [586336,113394] 0 2024-04-20T21:59:11.199 INFO:tasks.workunit.client.1.smithi164.stdout:3/930: symlink d12/d15/dd3/l138 0 2024-04-20T21:59:11.199 INFO:tasks.workunit.client.1.smithi164.stdout:5/934: link dc/d12/f13 dc/d2c/d2e/d30/d118/f13f 0 2024-04-20T21:59:11.200 INFO:tasks.workunit.client.1.smithi164.stdout:7/869: read d2/d21/f28 [2245098,205] 0 2024-04-20T21:59:11.215 INFO:tasks.workunit.client.1.smithi164.stdout:1/797: dread d10/d16/d19/de0/fd0 [0,4194304] 0 2024-04-20T21:59:11.216 INFO:tasks.workunit.client.1.smithi164.stdout:7/870: mknod d2/d21/d24/d31/d3a/d83/dba/c122 0 2024-04-20T21:59:11.220 INFO:tasks.workunit.client.1.smithi164.stdout:5/935: dwrite dc/d2b/da0/df8/fff [0,4194304] 0 2024-04-20T21:59:11.221 INFO:tasks.workunit.client.1.smithi164.stdout:2/882: write d2/fa [3964106,6043] 0 2024-04-20T21:59:11.224 INFO:tasks.workunit.client.1.smithi164.stdout:2/883: readlink d2/d5f/de6/l115 0 2024-04-20T21:59:11.224 INFO:tasks.workunit.client.1.smithi164.stdout:5/936: write dc/d41/fad [3308099,121178] 0 2024-04-20T21:59:11.227 INFO:tasks.workunit.client.1.smithi164.stdout:1/798: chown d10/d33/c42 149455703 1 2024-04-20T21:59:11.234 INFO:tasks.workunit.client.1.smithi164.stdout:7/871: creat d2/d21/d24/d31/d3a/d83/d63/d85/f123 x:0 0 0 2024-04-20T21:59:11.237 INFO:tasks.workunit.client.1.smithi164.stdout:7/872: write d2/d21/d24/d31/fe1 [3328945,85910] 0 2024-04-20T21:59:11.241 INFO:tasks.workunit.client.1.smithi164.stdout:3/931: dread d12/d6d/f8e [0,4194304] 0 2024-04-20T21:59:11.243 INFO:tasks.workunit.client.1.smithi164.stdout:2/884: creat d2/d5f/f11a x:0 0 0 2024-04-20T21:59:11.244 INFO:tasks.workunit.client.1.smithi164.stdout:2/885: chown d2/d5/d3a/d55/d58/c91 29947 1 2024-04-20T21:59:11.245 INFO:tasks.workunit.client.1.smithi164.stdout:1/799: readlink d10/d16/l9a 0 2024-04-20T21:59:11.252 INFO:tasks.workunit.client.1.smithi164.stdout:5/937: creat dc/d12/d1e/def/f140 x:0 0 0 2024-04-20T21:59:11.253 INFO:tasks.workunit.client.1.smithi164.stdout:0/822: truncate d1/d4/d26/d29/d2d/d54/d77/f5d 2705787 0 2024-04-20T21:59:11.253 INFO:tasks.workunit.client.1.smithi164.stdout:1/800: stat d10/d33/d4d/fed 0 2024-04-20T21:59:11.253 INFO:tasks.workunit.client.1.smithi164.stdout:3/932: fdatasync d12/d20/f2b 0 2024-04-20T21:59:11.255 INFO:tasks.workunit.client.1.smithi164.stdout:5/938: stat dc/d2c/d2e/d30/d8c/d13d 0 2024-04-20T21:59:11.257 INFO:tasks.workunit.client.1.smithi164.stdout:1/801: chown d10/d16/d19/de0/d34/da9/lac 5987 1 2024-04-20T21:59:11.259 INFO:tasks.workunit.client.1.smithi164.stdout:3/933: dread - d12/d20/d39/d55/d6b/d79/dcc/f10f zero size 2024-04-20T21:59:11.322 INFO:tasks.workunit.client.1.smithi164.stdout:8/798: sync 2024-04-20T21:59:11.328 INFO:tasks.workunit.client.1.smithi164.stdout:2/886: creat d2/d19/d28/d3e/d9e/f11b x:0 0 0 2024-04-20T21:59:11.332 INFO:tasks.workunit.client.1.smithi164.stdout:0/823: write d1/d4/d26/f76 [4349696,51693] 0 2024-04-20T21:59:11.334 INFO:tasks.workunit.client.1.smithi164.stdout:3/934: fsync d12/d20/d39/dac/ff2 0 2024-04-20T21:59:11.337 INFO:tasks.workunit.client.1.smithi164.stdout:3/935: chown d12/d20/d39/d69/d83/db9/cd9 23223968 1 2024-04-20T21:59:11.339 INFO:tasks.workunit.client.1.smithi164.stdout:8/799: creat d0/d14/d4e/d6f/de3/f10d x:0 0 0 2024-04-20T21:59:11.341 INFO:tasks.workunit.client.1.smithi164.stdout:7/873: mknod d2/d21/d24/d31/d3a/d83/dcf/dea/d107/d111/c124 0 2024-04-20T21:59:11.343 INFO:tasks.workunit.client.1.smithi164.stdout:5/939: rename dc/d2c/ff5 to dc/d2c/d2e/dbd/d11f/d130/f141 0 2024-04-20T21:59:11.343 INFO:tasks.workunit.client.1.smithi164.stdout:7/874: stat d2/d21/d44/dd4/cc2 0 2024-04-20T21:59:11.344 INFO:tasks.workunit.client.1.smithi164.stdout:0/824: readlink d1/d4/d26/d29/d2d/d54/d77/db3/lbc 0 2024-04-20T21:59:11.345 INFO:tasks.workunit.client.1.smithi164.stdout:2/887: dwrite d2/d19/d28/dd0/dba/ff8 [0,4194304] 0 2024-04-20T21:59:11.346 INFO:tasks.workunit.client.1.smithi164.stdout:1/802: link d10/d16/l9a d10/d16/d20/d25/d3d/l102 0 2024-04-20T21:59:11.347 INFO:tasks.workunit.client.1.smithi164.stdout:3/936: chown d12/d15/l3f 0 1 2024-04-20T21:59:11.349 INFO:tasks.workunit.client.1.smithi164.stdout:3/937: read - d12/d2a/f64 zero size 2024-04-20T21:59:11.351 INFO:tasks.workunit.client.1.smithi164.stdout:2/888: fdatasync d2/d19/d28/f29 0 2024-04-20T21:59:11.351 INFO:tasks.workunit.client.1.smithi164.stdout:5/940: symlink dc/d2c/d2e/d30/d72/da9/d10a/l142 0 2024-04-20T21:59:11.354 INFO:tasks.workunit.client.1.smithi164.stdout:7/875: mknod d2/d21/d24/d31/d3a/d83/dba/def/dff/c125 0 2024-04-20T21:59:11.357 INFO:tasks.workunit.client.1.smithi164.stdout:8/800: dwrite d0/d14/f4f [0,4194304] 0 2024-04-20T21:59:11.357 INFO:tasks.workunit.client.1.smithi164.stdout:1/803: unlink d10/d33/d48/c76 0 2024-04-20T21:59:11.358 INFO:tasks.workunit.client.1.smithi164.stdout:3/938: readlink d12/d2a/db1/l10b 0 2024-04-20T21:59:11.363 INFO:tasks.workunit.client.1.smithi164.stdout:0/825: dwrite d1/d4/df/fd7 [0,4194304] 0 2024-04-20T21:59:11.364 INFO:tasks.workunit.client.1.smithi164.stdout:5/941: rmdir dc/d2c/d2e/d30/d118 39 2024-04-20T21:59:11.364 INFO:tasks.workunit.client.1.smithi164.stdout:7/876: rmdir d2/d21/d24/d31/d3a/d83/d63 39 2024-04-20T21:59:11.368 INFO:tasks.workunit.client.1.smithi164.stdout:1/804: chown d10/d16/l18 30047211 1 2024-04-20T21:59:11.368 INFO:tasks.workunit.client.1.smithi164.stdout:3/939: creat d12/d15/dd3/f139 x:0 0 0 2024-04-20T21:59:11.371 INFO:tasks.workunit.client.1.smithi164.stdout:5/942: write dc/d2b/d52/ff1 [535945,80486] 0 2024-04-20T21:59:11.371 INFO:tasks.workunit.client.1.smithi164.stdout:0/826: unlink d1/d4/df/dbe/fcf 0 2024-04-20T21:59:11.374 INFO:tasks.workunit.client.1.smithi164.stdout:2/889: creat d2/d19/d28/d3e/f11c x:0 0 0 2024-04-20T21:59:11.378 INFO:tasks.workunit.client.1.smithi164.stdout:8/801: dread d0/f56 [0,4194304] 0 2024-04-20T21:59:11.378 INFO:tasks.workunit.client.1.smithi164.stdout:4/811: sync 2024-04-20T21:59:11.378 INFO:tasks.workunit.client.1.smithi164.stdout:9/918: sync 2024-04-20T21:59:11.381 INFO:tasks.workunit.client.1.smithi164.stdout:7/877: rename d2/d21/d44/c7a to d2/d21/d24/d31/d3a/daa/c126 0 2024-04-20T21:59:11.383 INFO:tasks.workunit.client.1.smithi164.stdout:5/943: mknod dc/d2c/d2e/d30/d5e/c143 0 2024-04-20T21:59:11.387 INFO:tasks.workunit.client.1.smithi164.stdout:9/919: truncate d3/db/dd/d40/d2a/f77 4520406 0 2024-04-20T21:59:11.388 INFO:tasks.workunit.client.1.smithi164.stdout:0/827: getdents d1/dc5 0 2024-04-20T21:59:11.388 INFO:tasks.workunit.client.1.smithi164.stdout:3/940: dread d12/d20/d39/d55/d6b/f76 [0,4194304] 0 2024-04-20T21:59:11.389 INFO:tasks.workunit.client.1.smithi164.stdout:2/890: mknod d2/d30/c11d 0 2024-04-20T21:59:11.390 INFO:tasks.workunit.client.1.smithi164.stdout:2/891: fsync d2/f46 0 2024-04-20T21:59:11.392 INFO:tasks.workunit.client.1.smithi164.stdout:2/892: stat d2/d30/de8 0 2024-04-20T21:59:11.394 INFO:tasks.workunit.client.1.smithi164.stdout:5/944: mknod dc/d2c/d2e/d30/d8c/c144 0 2024-04-20T21:59:11.397 INFO:tasks.workunit.client.1.smithi164.stdout:8/802: dread d0/d14/d4e/d62/d8f/fa9 [0,4194304] 0 2024-04-20T21:59:11.399 INFO:tasks.workunit.client.1.smithi164.stdout:3/941: dread d12/d68/f122 [0,4194304] 0 2024-04-20T21:59:11.400 INFO:tasks.workunit.client.1.smithi164.stdout:9/920: creat d3/db/d1b/d20/f148 x:0 0 0 2024-04-20T21:59:11.407 INFO:tasks.workunit.client.1.smithi164.stdout:2/893: dwrite d2/d19/d28/dd0/dba/d62/f88 [0,4194304] 0 2024-04-20T21:59:11.410 INFO:tasks.workunit.client.1.smithi164.stdout:1/805: rename d10/d16/d19/f52 to d10/d16/d20/f103 0 2024-04-20T21:59:11.414 INFO:tasks.workunit.client.1.smithi164.stdout:5/945: rmdir dc/d2c/d2e/dbd/d11f/d130 39 2024-04-20T21:59:11.416 INFO:tasks.workunit.client.1.smithi164.stdout:0/828: fdatasync d1/d4/d26/fa8 0 2024-04-20T21:59:11.416 INFO:tasks.workunit.client.1.smithi164.stdout:1/806: dread - d10/d33/d4d/fed zero size 2024-04-20T21:59:11.417 INFO:tasks.workunit.client.1.smithi164.stdout:8/803: creat d0/d14/d4e/d6f/f10e x:0 0 0 2024-04-20T21:59:11.423 INFO:tasks.workunit.client.1.smithi164.stdout:2/894: mknod d2/d5f/de6/c11e 0 2024-04-20T21:59:11.424 INFO:tasks.workunit.client.1.smithi164.stdout:4/812: dwrite d4/d9/fc8 [4194304,4194304] 0 2024-04-20T21:59:11.424 INFO:tasks.workunit.client.1.smithi164.stdout:0/829: symlink d1/d4/d26/lec 0 2024-04-20T21:59:11.426 INFO:tasks.workunit.client.1.smithi164.stdout:2/895: write d2/d5/d3a/d65/d81/fe9 [5145471,53779] 0 2024-04-20T21:59:11.429 INFO:tasks.workunit.client.1.smithi164.stdout:8/804: creat d0/d14/d4e/d6f/de3/f10f x:0 0 0 2024-04-20T21:59:11.434 INFO:tasks.workunit.client.1.smithi164.stdout:7/878: mknod d2/d21/d24/d31/d3a/d83/d63/d85/d117/c127 0 2024-04-20T21:59:11.437 INFO:tasks.workunit.client.1.smithi164.stdout:3/942: creat d12/d15/dae/f13a x:0 0 0 2024-04-20T21:59:11.438 INFO:tasks.workunit.client.1.smithi164.stdout:1/807: dwrite d10/d16/d19/de0/d34/da9/fc3 [0,4194304] 0 2024-04-20T21:59:11.443 INFO:tasks.workunit.client.1.smithi164.stdout:0/830: dread - d1/d4/d20/d74/fba zero size 2024-04-20T21:59:11.444 INFO:tasks.workunit.client.1.smithi164.stdout:9/921: creat d3/db/d1b/d20/d3f/d8a/da7/dbd/f149 x:0 0 0 2024-04-20T21:59:11.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:11 smithi164 ceph-mon[23506]: Updating smithi142:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T21:59:11.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:11 smithi164 ceph-mon[23506]: Updating smithi164:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T21:59:11.449 INFO:tasks.workunit.client.1.smithi164.stdout:5/946: dwrite dc/d2b/d6d/d73/dab/d10c/f119 [0,4194304] 0 2024-04-20T21:59:11.451 INFO:tasks.workunit.client.1.smithi164.stdout:6/871: sync 2024-04-20T21:59:11.454 INFO:tasks.workunit.client.1.smithi164.stdout:9/922: readlink d3/db/l5a 0 2024-04-20T21:59:11.454 INFO:tasks.workunit.client.1.smithi164.stdout:7/879: fsync d2/d21/d24/d31/d3a/fa2 0 2024-04-20T21:59:11.461 INFO:tasks.workunit.client.1.smithi164.stdout:2/896: dwrite d2/d5/f9b [4194304,4194304] 0 2024-04-20T21:59:11.463 INFO:tasks.workunit.client.1.smithi164.stdout:4/813: getdents d4/d9/d27/d37 0 2024-04-20T21:59:11.469 INFO:tasks.workunit.client.1.smithi164.stdout:1/808: rename d10/d7d/la7 to d10/d16/d19/d1a/l104 0 2024-04-20T21:59:11.472 INFO:tasks.workunit.client.1.smithi164.stdout:4/814: creat d4/d9/d22/db5/f102 x:0 0 0 2024-04-20T21:59:11.475 INFO:tasks.workunit.client.1.smithi164.stdout:8/805: dread d0/d14/d16/d5a/f89 [0,4194304] 0 2024-04-20T21:59:11.476 INFO:tasks.workunit.client.1.smithi164.stdout:9/923: mkdir d3/db/de5/d14a 0 2024-04-20T21:59:11.480 INFO:tasks.workunit.client.1.smithi164.stdout:6/872: getdents d0/d3/d62 0 2024-04-20T21:59:11.486 INFO:tasks.workunit.client.1.smithi164.stdout:9/924: mkdir d3/d9f/d14b 0 2024-04-20T21:59:11.487 INFO:tasks.workunit.client.1.smithi164.stdout:7/880: write d2/d21/f25 [4332307,109114] 0 2024-04-20T21:59:11.489 INFO:tasks.workunit.client.1.smithi164.stdout:2/897: creat d2/d30/f11f x:0 0 0 2024-04-20T21:59:11.491 INFO:tasks.workunit.client.1.smithi164.stdout:0/831: rename d1/d4/df/f3b to d1/d4/d26/d29/d2d/fed 0 2024-04-20T21:59:11.494 INFO:tasks.workunit.client.1.smithi164.stdout:7/881: stat d2/d21/d24/d31/d3a/d83/dba 0 2024-04-20T21:59:11.494 INFO:tasks.workunit.client.1.smithi164.stdout:4/815: creat d4/d9/f103 x:0 0 0 2024-04-20T21:59:11.495 INFO:tasks.workunit.client.1.smithi164.stdout:1/809: truncate d10/d16/f43 887671 0 2024-04-20T21:59:11.496 INFO:tasks.workunit.client.1.smithi164.stdout:8/806: dwrite d0/d14/df6/ff8 [0,4194304] 0 2024-04-20T21:59:11.496 INFO:tasks.workunit.client.1.smithi164.stdout:6/873: getdents d0/d3/d15/d21/d101/d103 0 2024-04-20T21:59:11.498 INFO:tasks.workunit.client.1.smithi164.stdout:2/898: unlink d2/d5/d3a/f43 0 2024-04-20T21:59:11.499 INFO:tasks.workunit.client.1.smithi164.stdout:7/882: unlink d2/d21/d44/c59 0 2024-04-20T21:59:11.500 INFO:tasks.workunit.client.1.smithi164.stdout:3/943: dread d12/d15/f6c [0,4194304] 0 2024-04-20T21:59:11.502 INFO:tasks.workunit.client.1.smithi164.stdout:4/816: chown d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d4a/c7c 23 1 2024-04-20T21:59:11.502 INFO:tasks.workunit.client.1.smithi164.stdout:8/807: chown d0/d14/f13 4795422 1 2024-04-20T21:59:11.503 INFO:tasks.workunit.client.1.smithi164.stdout:0/832: rename d1/c2a to d1/d4/d26/d29/d2d/d54/dca/cee 0 2024-04-20T21:59:11.505 INFO:tasks.workunit.client.1.smithi164.stdout:1/810: write d10/d16/d19/de0/d34/da9/f92 [2934847,15439] 0 2024-04-20T21:59:11.505 INFO:tasks.workunit.client.1.smithi164.stdout:9/925: getdents d3/db0/d132/d146 0 2024-04-20T21:59:11.505 INFO:tasks.workunit.client.1.smithi164.stdout:3/944: chown d12/d20/d39/d69/db8 3812 1 2024-04-20T21:59:11.506 INFO:tasks.workunit.client.1.smithi164.stdout:2/899: creat d2/d30/de8/f120 x:0 0 0 2024-04-20T21:59:11.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.507+0000 7f7920200700 1 -- 172.21.15.142:0/1407287080 --> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f79181028c0 con 0x7f790006ea80 2024-04-20T21:59:11.507 INFO:tasks.workunit.client.1.smithi164.stdout:6/874: creat d0/d3/d11/d29/d6e/db2/df5/f126 x:0 0 0 2024-04-20T21:59:11.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.509+0000 7f7916000700 1 -- 172.21.15.142:0/1407287080 <== mgr.14722 v2:172.21.15.142:6800/54392364 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f79181028c0 con 0x7f790006ea80 2024-04-20T21:59:11.511 INFO:tasks.workunit.client.1.smithi164.stdout:2/900: fdatasync d2/f12 0 2024-04-20T21:59:11.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.513+0000 7f7920200700 1 -- 172.21.15.142:0/1407287080 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f790006ea80 msgr2=0x7f7900070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:11.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.513+0000 7f7920200700 1 --2- 172.21.15.142:0/1407287080 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f790006ea80 0x7f7900070f40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f790c006010 tx=0x7f790c009f70 comp rx=0 tx=0).stop 2024-04-20T21:59:11.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.514+0000 7f7920200700 1 -- 172.21.15.142:0/1407287080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7918101de0 msgr2=0x7f791819d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:11.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.514+0000 7f7920200700 1 --2- 172.21.15.142:0/1407287080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7918101de0 0x7f791819d170 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f790400e920 tx=0x7f790400ece0 comp rx=0 tx=0).stop 2024-04-20T21:59:11.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.514+0000 7f7920200700 1 -- 172.21.15.142:0/1407287080 shutdown_connections 2024-04-20T21:59:11.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.514+0000 7f7920200700 1 --2- 172.21.15.142:0/1407287080 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f790006ea80 0x7f7900070f40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:11.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.514+0000 7f7920200700 1 --2- 172.21.15.142:0/1407287080 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79180ff470 0x7f791819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:11.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.514+0000 7f7920200700 1 --2- 172.21.15.142:0/1407287080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7918101de0 0x7f791819d170 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:11.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.514+0000 7f7920200700 1 -- 172.21.15.142:0/1407287080 >> 172.21.15.142:0/1407287080 conn(0x7f79180fb0d0 msgr2=0x7f79180fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:11.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.514+0000 7f7920200700 1 -- 172.21.15.142:0/1407287080 shutdown_connections 2024-04-20T21:59:11.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.514+0000 7f7920200700 1 -- 172.21.15.142:0/1407287080 wait complete. 2024-04-20T21:59:11.515 INFO:tasks.workunit.client.1.smithi164.stdout:7/883: rmdir d2/d21/d24/d31/d3a/d83/d6a/de4 39 2024-04-20T21:59:11.518 INFO:tasks.workunit.client.1.smithi164.stdout:0/833: dread d1/d4/da/fbf [0,4194304] 0 2024-04-20T21:59:11.519 INFO:tasks.workunit.client.1.smithi164.stdout:4/817: creat d4/d9/d5c/d97/dbf/d5f/f104 x:0 0 0 2024-04-20T21:59:11.521 INFO:tasks.workunit.client.1.smithi164.stdout:2/901: dread - d2/d5/d3a/d55/d58/da2/fb7 zero size 2024-04-20T21:59:11.523 INFO:tasks.workunit.client.1.smithi164.stdout:7/884: unlink d2/f67 0 2024-04-20T21:59:11.528 INFO:tasks.workunit.client.1.smithi164.stdout:3/945: rename d12/d20/f22 to d12/d20/d39/d69/dad/de2/f13b 0 2024-04-20T21:59:11.529 INFO:tasks.workunit.client.1.smithi164.stdout:0/834: symlink d1/d4/d26/d29/d2d/d54/lef 0 2024-04-20T21:59:11.531 INFO:tasks.workunit.client.1.smithi164.stdout:8/808: dwrite d0/d14/d4e/d86/f102 [0,4194304] 0 2024-04-20T21:59:11.531 INFO:tasks.workunit.client.1.smithi164.stdout:1/811: dread d10/d33/d41/f58 [0,4194304] 0 2024-04-20T21:59:11.532 INFO:tasks.workunit.client.1.smithi164.stdout:2/902: mknod d2/d5/d3a/d55/d58/da2/c121 0 2024-04-20T21:59:11.534 INFO:tasks.workunit.client.1.smithi164.stdout:6/875: rename d0/d3/d11/d29/d6e/c5f to d0/d3/d62/d75/c127 0 2024-04-20T21:59:11.536 INFO:tasks.workunit.client.1.smithi164.stdout:0/835: creat d1/d4/d49/ff0 x:0 0 0 2024-04-20T21:59:11.540 INFO:tasks.workunit.client.1.smithi164.stdout:8/809: creat d0/d14/db4/f110 x:0 0 0 2024-04-20T21:59:11.543 INFO:tasks.workunit.client.1.smithi164.stdout:7/885: dread d2/d21/d24/d31/d3a/daa/fcc [0,4194304] 0 2024-04-20T21:59:11.543 INFO:tasks.workunit.client.1.smithi164.stdout:3/946: symlink d12/d68/d6f/d71/l13c 0 2024-04-20T21:59:11.545 INFO:tasks.workunit.client.1.smithi164.stdout:2/903: creat d2/d5/d3a/d55/d58/da2/f122 x:0 0 0 2024-04-20T21:59:11.554 INFO:tasks.workunit.client.1.smithi164.stdout:8/810: dread - d0/d14/d16/dbf/fce zero size 2024-04-20T21:59:11.555 INFO:tasks.workunit.client.1.smithi164.stdout:0/836: creat d1/d4/d26/d29/ff1 x:0 0 0 2024-04-20T21:59:11.555 INFO:tasks.workunit.client.1.smithi164.stdout:1/812: rename d10/d33/d4d/dc4/c86 to d10/c105 0 2024-04-20T21:59:11.555 INFO:tasks.workunit.client.1.smithi164.stdout:9/926: dwrite d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/fa9 [0,4194304] 0 2024-04-20T21:59:11.558 INFO:tasks.workunit.client.1.smithi164.stdout:0/837: chown d1/d4/d26/d29/d2d/d54/dca 10 1 2024-04-20T21:59:11.566 INFO:tasks.workunit.client.1.smithi164.stdout:2/904: rename d2/d19/d28/f32 to d2/d5/d3a/d65/d81/f123 0 2024-04-20T21:59:11.569 INFO:tasks.workunit.client.1.smithi164.stdout:1/813: mknod d10/d16/d19/de0/d34/c106 0 2024-04-20T21:59:11.577 INFO:tasks.workunit.client.1.smithi164.stdout:3/947: dwrite d12/d20/d39/d55/f93 [0,4194304] 0 2024-04-20T21:59:11.580 INFO:tasks.workunit.client.1.smithi164.stdout:2/905: mkdir d2/d5/d124 0 2024-04-20T21:59:11.582 INFO:tasks.workunit.client.1.smithi164.stdout:7/886: dwrite d2/f29 [0,4194304] 0 2024-04-20T21:59:11.582 INFO:tasks.workunit.client.1.smithi164.stdout:6/876: dwrite d0/d3/d15/ff2 [0,4194304] 0 2024-04-20T21:59:11.585 INFO:tasks.workunit.client.1.smithi164.stdout:0/838: dwrite d1/d2b/f6b [0,4194304] 0 2024-04-20T21:59:11.589 INFO:tasks.workunit.client.1.smithi164.stdout:9/927: creat d3/db/d1b/d20/d3f/d8a/da7/dbd/f14c x:0 0 0 2024-04-20T21:59:11.593 INFO:tasks.workunit.client.1.smithi164.stdout:2/906: readlink d2/l9a 0 2024-04-20T21:59:11.593 INFO:tasks.workunit.client.1.smithi164.stdout:8/811: getdents d0/d1e 0 2024-04-20T21:59:11.599 INFO:tasks.workunit.client.1.smithi164.stdout:6/877: creat d0/d3/d15/d21/d101/d45/d4f/d61/f128 x:0 0 0 2024-04-20T21:59:11.602 INFO:tasks.workunit.client.1.smithi164.stdout:6/878: stat d0/d3/d15/d21/d5c/dbf/c7d 0 2024-04-20T21:59:11.602 INFO:tasks.workunit.client.1.smithi164.stdout:9/928: creat d3/db/de5/f14d x:0 0 0 2024-04-20T21:59:11.604 INFO:tasks.workunit.client.1.smithi164.stdout:3/948: dwrite d12/d20/d39/f56 [4194304,4194304] 0 2024-04-20T21:59:11.606 INFO:tasks.workunit.client.1.smithi164.stdout:6/879: fdatasync d0/d3/d11/d5a/f89 0 2024-04-20T21:59:11.608 INFO:tasks.workunit.client.1.smithi164.stdout:0/839: mknod d1/d4/d26/d29/d2d/d54/d77/cf2 0 2024-04-20T21:59:11.613 INFO:tasks.workunit.client.1.smithi164.stdout:6/880: rmdir d0/d3/d15/d21/d101/d45/d4f/d9c/d104 39 2024-04-20T21:59:11.617 INFO:tasks.workunit.client.1.smithi164.stdout:1/814: write d10/d16/d20/d25/fad [1040306,54618] 0 2024-04-20T21:59:11.618 INFO:tasks.workunit.client.1.smithi164.stdout:3/949: link d12/d20/d39/d55/d6b/d79/ff6 d12/d20/d39/d69/db8/f13d 0 2024-04-20T21:59:11.620 INFO:tasks.workunit.client.1.smithi164.stdout:1/815: stat d10/d33/d4d/lcb 0 2024-04-20T21:59:11.626 INFO:tasks.workunit.client.1.smithi164.stdout:8/812: write d0/d14/d5f/fac [753072,25295] 0 2024-04-20T21:59:11.627 INFO:tasks.workunit.client.1.smithi164.stdout:1/816: link d10/d16/d19/de0/d34/da9/fd3 d10/d7d/f107 0 2024-04-20T21:59:11.633 INFO:tasks.workunit.client.1.smithi164.stdout:8/813: creat d0/d14/d16/d58/d73/f111 x:0 0 0 2024-04-20T21:59:11.633 INFO:tasks.workunit.client.1.smithi164.stdout:1/817: write d10/d33/fc0 [5204398,6336] 0 2024-04-20T21:59:11.634 INFO:tasks.workunit.client.1.smithi164.stdout:6/881: dwrite d0/d3/d4a/f55 [0,4194304] 0 2024-04-20T21:59:11.635 INFO:tasks.workunit.client.1.smithi164.stdout:0/840: dwrite d1/f42 [0,4194304] 0 2024-04-20T21:59:11.635 INFO:tasks.workunit.client.1.smithi164.stdout:5/947: sync 2024-04-20T21:59:11.637 INFO:tasks.workunit.client.1.smithi164.stdout:3/950: write d12/d15/f19 [538660,54023] 0 2024-04-20T21:59:11.640 INFO:tasks.workunit.client.1.smithi164.stdout:1/818: write d10/d16/d20/d25/fad [784966,70410] 0 2024-04-20T21:59:11.643 INFO:tasks.workunit.client.1.smithi164.stdout:0/841: truncate d1/d4/df/fe6 324607 0 2024-04-20T21:59:11.644 INFO:tasks.workunit.client.1.smithi164.stdout:9/929: dread d3/db/d1b/d1e/f9d [0,4194304] 0 2024-04-20T21:59:11.648 INFO:tasks.workunit.client.1.smithi164.stdout:5/948: dread - dc/d2c/d2e/d30/d72/da9/dbb/fc9 zero size 2024-04-20T21:59:11.656 INFO:tasks.workunit.client.1.smithi164.stdout:9/930: creat d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/dbf/d12c/f14e x:0 0 0 2024-04-20T21:59:11.661 INFO:tasks.workunit.client.1.smithi164.stdout:5/949: link dc/d41/c94 dc/d2c/d2e/d30/d8c/d13d/c145 0 2024-04-20T21:59:11.667 INFO:tasks.workunit.client.1.smithi164.stdout:1/819: dwrite d10/d16/d20/d25/d3d/fc7 [0,4194304] 0 2024-04-20T21:59:11.668 INFO:tasks.workunit.client.1.smithi164.stdout:5/950: creat dc/d2b/d52/d99/f146 x:0 0 0 2024-04-20T21:59:11.669 INFO:tasks.workunit.client.1.smithi164.stdout:0/842: dwrite d1/d4/da/d27/f70 [0,4194304] 0 2024-04-20T21:59:11.670 INFO:tasks.workunit.client.1.smithi164.stdout:8/814: rmdir d0 39 2024-04-20T21:59:11.675 INFO:tasks.workunit.client.1.smithi164.stdout:0/843: unlink d1/d2b/f8f 0 2024-04-20T21:59:11.679 INFO:tasks.workunit.client.1.smithi164.stdout:5/951: mkdir dc/d2c/d2e/d30/d72/da9/dbb/d10e/d147 0 2024-04-20T21:59:11.680 INFO:tasks.workunit.client.1.smithi164.stdout:1/820: dread - d10/d33/d4d/dc4/f96 zero size 2024-04-20T21:59:11.683 INFO:tasks.workunit.client.1.smithi164.stdout:5/952: write dc/d2b/fdc [2356853,65483] 0 2024-04-20T21:59:11.684 INFO:tasks.workunit.client.1.smithi164.stdout:3/951: dwrite d12/f60 [0,4194304] 0 2024-04-20T21:59:11.684 INFO:tasks.workunit.client.1.smithi164.stdout:9/931: write d3/db/dd/d40/d78/fcf [3011742,115730] 0 2024-04-20T21:59:11.690 INFO:tasks.workunit.client.1.smithi164.stdout:3/952: mknod d12/d20/d39/ddc/c13e 0 2024-04-20T21:59:11.690 INFO:tasks.workunit.client.1.smithi164.stdout:6/882: dread d0/d3/d15/d21/d101/d45/d4f/f70 [0,4194304] 0 2024-04-20T21:59:11.694 INFO:tasks.workunit.client.1.smithi164.stdout:1/821: symlink d10/d16/d20/d25/d95/l108 0 2024-04-20T21:59:11.695 INFO:tasks.workunit.client.1.smithi164.stdout:8/815: dwrite d0/d14/d4e/d86/fd5 [0,4194304] 0 2024-04-20T21:59:11.702 INFO:tasks.workunit.client.1.smithi164.stdout:0/844: getdents d1/d4/d49 0 2024-04-20T21:59:11.705 INFO:tasks.workunit.client.1.smithi164.stdout:0/845: fsync d1/d4/d26/d29/d2d/f8a 0 2024-04-20T21:59:11.709 INFO:tasks.workunit.client.1.smithi164.stdout:6/883: mknod d0/d3/d15/d21/d101/c129 0 2024-04-20T21:59:11.709 INFO:tasks.workunit.client.1.smithi164.stdout:8/816: unlink d0/d14/d4e/d6f/fe0 0 2024-04-20T21:59:11.710 INFO:tasks.workunit.client.1.smithi164.stdout:5/953: rename dc/d12/d1e/da8/dea to dc/d2c/d148 0 2024-04-20T21:59:11.711 INFO:tasks.workunit.client.1.smithi164.stdout:8/817: fsync d0/d14/d16/d58/d73/f111 0 2024-04-20T21:59:11.711 INFO:tasks.workunit.client.1.smithi164.stdout:8/818: readlink d0/l1c 0 2024-04-20T21:59:11.713 INFO:tasks.workunit.client.1.smithi164.stdout:9/932: creat d3/db/dd/d40/d2a/f14f x:0 0 0 2024-04-20T21:59:11.715 INFO:tasks.workunit.client.1.smithi164.stdout:8/819: dread - d0/d14/d4e/d62/d8f/dbe/fdf zero size 2024-04-20T21:59:11.723 INFO:tasks.workunit.client.1.smithi164.stdout:3/953: dread d12/d68/d6f/d71/f7a [0,4194304] 0 2024-04-20T21:59:11.726 INFO:tasks.workunit.client.1.smithi164.stdout:8/820: write d0/d14/d4e/d62/d82/d97/f9c [1710825,97440] 0 2024-04-20T21:59:11.727 INFO:tasks.workunit.client.1.smithi164.stdout:3/954: dread d12/d68/f122 [0,4194304] 0 2024-04-20T21:59:11.729 INFO:tasks.workunit.client.1.smithi164.stdout:8/821: chown d0/d14/d4e/d62/d8f/fa9 0 1 2024-04-20T21:59:11.730 INFO:tasks.workunit.client.1.smithi164.stdout:6/884: mkdir d0/d3/d12a 0 2024-04-20T21:59:11.731 INFO:tasks.workunit.client.1.smithi164.stdout:3/955: write d12/d68/d6f/d71/d7d/fab [481197,128533] 0 2024-04-20T21:59:11.735 INFO:tasks.workunit.client.1.smithi164.stdout:4/818: sync 2024-04-20T21:59:11.737 INFO:tasks.workunit.client.1.smithi164.stdout:8/822: creat d0/d1e/f112 x:0 0 0 2024-04-20T21:59:11.739 INFO:tasks.workunit.client.1.smithi164.stdout:5/954: dread f5 [0,4194304] 0 2024-04-20T21:59:11.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.740+0000 7fc344400700 1 -- 172.21.15.142:0/892914382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c103fb0 msgr2=0x7fc33c1063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:11.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.740+0000 7fc344400700 1 --2- 172.21.15.142:0/892914382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c103fb0 0x7fc33c1063a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc328009910 tx=0x7fc328009c20 comp rx=0 tx=0).stop 2024-04-20T21:59:11.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.740+0000 7fc344400700 1 -- 172.21.15.142:0/892914382 shutdown_connections 2024-04-20T21:59:11.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.740+0000 7fc344400700 1 --2- 172.21.15.142:0/892914382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c103fb0 0x7fc33c1063a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:11.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.740+0000 7fc344400700 1 --2- 172.21.15.142:0/892914382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc33c101680 0x7fc33c103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:11.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.740+0000 7fc344400700 1 -- 172.21.15.142:0/892914382 >> 172.21.15.142:0/892914382 conn(0x7fc33c0fb0d0 msgr2=0x7fc33c0fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:11.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.740+0000 7fc344400700 1 -- 172.21.15.142:0/892914382 shutdown_connections 2024-04-20T21:59:11.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.740+0000 7fc344400700 1 -- 172.21.15.142:0/892914382 wait complete. 2024-04-20T21:59:11.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.742+0000 7fc344400700 1 Processor -- start 2024-04-20T21:59:11.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.742+0000 7fc344400700 1 -- start start 2024-04-20T21:59:11.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.742+0000 7fc344400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c101680 0x7fc33c196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:11.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.742+0000 7fc344400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc33c196db0 0x7fc33c19bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:11.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.742+0000 7fc344400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c1972c0 con 0x7fc33c101680 2024-04-20T21:59:11.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.742+0000 7fc344400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c197430 con 0x7fc33c196db0 2024-04-20T21:59:11.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.743+0000 7fc341a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c101680 0x7fc33c196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:11.743 INFO:tasks.workunit.client.1.smithi164.stdout:6/885: creat d0/d3/d11/d29/d6e/db2/f12b x:0 0 0 2024-04-20T21:59:11.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.743+0000 7fc341a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c101680 0x7fc33c196870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48744/0 (socket says 172.21.15.142:48744) 2024-04-20T21:59:11.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.743+0000 7fc341a00700 1 -- 172.21.15.142:0/1080701990 learned_addr learned my addr 172.21.15.142:0/1080701990 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:59:11.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.743+0000 7fc341000700 1 --2- 172.21.15.142:0/1080701990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc33c196db0 0x7fc33c19bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:11.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.744+0000 7fc341a00700 1 -- 172.21.15.142:0/1080701990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc33c196db0 msgr2=0x7fc33c19bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:11.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.744+0000 7fc341a00700 1 --2- 172.21.15.142:0/1080701990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc33c196db0 0x7fc33c19bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:11.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.744+0000 7fc341a00700 1 -- 172.21.15.142:0/1080701990 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280095f0 con 0x7fc33c101680 2024-04-20T21:59:11.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.744+0000 7fc341a00700 1 --2- 172.21.15.142:0/1080701990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c101680 0x7fc33c196870 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc33000e920 tx=0x7fc33000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:11.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.744+0000 7fc33a000700 1 -- 172.21.15.142:0/1080701990 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc33000c9d0 con 0x7fc33c101680 2024-04-20T21:59:11.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.744+0000 7fc33a000700 1 -- 172.21.15.142:0/1080701990 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc330010430 con 0x7fc33c101680 2024-04-20T21:59:11.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.744+0000 7fc33a000700 1 -- 172.21.15.142:0/1080701990 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc330018630 con 0x7fc33c101680 2024-04-20T21:59:11.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.744+0000 7fc344400700 1 -- 172.21.15.142:0/1080701990 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33c19c320 con 0x7fc33c101680 2024-04-20T21:59:11.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.744+0000 7fc344400700 1 -- 172.21.15.142:0/1080701990 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33c19c8f0 con 0x7fc33c101680 2024-04-20T21:59:11.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.746+0000 7fc344400700 1 -- 172.21.15.142:0/1080701990 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc33c062510 con 0x7fc33c101680 2024-04-20T21:59:11.746 INFO:tasks.workunit.client.1.smithi164.stdout:4/819: creat d4/d9/d22/db5/f105 x:0 0 0 2024-04-20T21:59:11.747 INFO:tasks.workunit.client.1.smithi164.stdout:9/933: getdents d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/dce 0 2024-04-20T21:59:11.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.748+0000 7fc33a000700 1 -- 172.21.15.142:0/1080701990 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 30) v1 ==== 92710+0+0 (secure 0 0 0) 0x7fc3300105a0 con 0x7fc33c101680 2024-04-20T21:59:11.748 INFO:tasks.workunit.client.1.smithi164.stdout:6/886: truncate d0/d3/d11/d29/d6e/db2/f12b 506245 0 2024-04-20T21:59:11.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.750+0000 7fc33a000700 1 --2- 172.21.15.142:0/1080701990 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fc32406ea70 0x7fc324070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:11.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.750+0000 7fc33a000700 1 -- 172.21.15.142:0/1080701990 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fc330014070 con 0x7fc33c101680 2024-04-20T21:59:11.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.750+0000 7fc341000700 1 --2- 172.21.15.142:0/1080701990 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fc32406ea70 0x7fc324070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:11.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.752+0000 7fc341000700 1 --2- 172.21.15.142:0/1080701990 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fc32406ea70 0x7fc324070f30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc328000c00 tx=0x7fc328005fb0 comp rx=0 tx=0).ready entity=mgr.14722 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:11.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:11.755+0000 7fc33a000700 1 -- 172.21.15.142:0/1080701990 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fc33005be70 con 0x7fc33c101680 2024-04-20T21:59:11.758 INFO:tasks.workunit.client.1.smithi164.stdout:8/823: dwrite d0/d14/ff4 [0,4194304] 0 2024-04-20T21:59:11.760 INFO:tasks.workunit.client.1.smithi164.stdout:1/822: dwrite d10/d16/f43 [0,4194304] 0 2024-04-20T21:59:11.762 INFO:tasks.workunit.client.1.smithi164.stdout:3/956: write d12/d20/d39/d69/d9a/f9f [1035221,85933] 0 2024-04-20T21:59:11.763 INFO:tasks.workunit.client.1.smithi164.stdout:9/934: creat d3/db/d1b/d20/d3f/d8a/da7/f150 x:0 0 0 2024-04-20T21:59:11.765 INFO:tasks.workunit.client.1.smithi164.stdout:0/846: dwrite d1/d4/d20/d74/f3f [0,4194304] 0 2024-04-20T21:59:11.769 INFO:tasks.workunit.client.1.smithi164.stdout:4/820: write d4/d9/d27/f35 [498885,91737] 0 2024-04-20T21:59:11.770 INFO:tasks.workunit.client.1.smithi164.stdout:0/847: readlink d1/d4/d49/ldc 0 2024-04-20T21:59:11.772 INFO:tasks.workunit.client.1.smithi164.stdout:3/957: readlink d12/d20/d39/d69/d9a/dbe/lfa 0 2024-04-20T21:59:11.777 INFO:tasks.workunit.client.1.smithi164.stdout:7/887: sync 2024-04-20T21:59:11.777 INFO:tasks.workunit.client.1.smithi164.stdout:2/907: sync 2024-04-20T21:59:11.779 INFO:tasks.workunit.client.1.smithi164.stdout:7/888: stat d2/d21/d24/daf 0 2024-04-20T21:59:11.779 INFO:tasks.workunit.client.1.smithi164.stdout:2/908: dread - d2/d5/d3a/f116 zero size 2024-04-20T21:59:11.782 INFO:tasks.workunit.client.1.smithi164.stdout:8/824: link d0/d14/db4/f101 d0/d14/dee/f113 0 2024-04-20T21:59:11.788 INFO:tasks.workunit.client.1.smithi164.stdout:4/821: fdatasync d4/d9/d5c/d97/dbf/d9b/dd0/fd2 0 2024-04-20T21:59:11.788 INFO:tasks.workunit.client.1.smithi164.stdout:3/958: dread d12/d20/d39/dac/f11d [0,4194304] 0 2024-04-20T21:59:11.791 INFO:tasks.workunit.client.1.smithi164.stdout:6/887: dwrite d0/d3/d15/d21/d4b/fda [0,4194304] 0 2024-04-20T21:59:11.792 INFO:tasks.workunit.client.1.smithi164.stdout:2/909: symlink d2/dab/df4/l125 0 2024-04-20T21:59:11.793 INFO:tasks.workunit.client.1.smithi164.stdout:8/825: rmdir d0/d14/d16/dbf 39 2024-04-20T21:59:11.796 INFO:tasks.workunit.client.1.smithi164.stdout:1/823: dwrite d10/d16/d20/d81/fb1 [0,4194304] 0 2024-04-20T21:59:11.800 INFO:tasks.workunit.client.1.smithi164.stdout:9/935: creat d3/db/d1b/d20/d3f/d8a/da7/dbd/f151 x:0 0 0 2024-04-20T21:59:11.803 INFO:tasks.workunit.client.1.smithi164.stdout:0/848: creat d1/d4/ff3 x:0 0 0 2024-04-20T21:59:11.805 INFO:tasks.workunit.client.1.smithi164.stdout:5/955: dwrite dc/d2c/d2e/d30/d118/f13f [4194304,4194304] 0 2024-04-20T21:59:11.810 INFO:tasks.workunit.client.1.smithi164.stdout:4/822: unlink d4/d9/d27/d37/f51 0 2024-04-20T21:59:11.810 INFO:tasks.workunit.client.1.smithi164.stdout:1/824: dread d10/d33/d48/fa4 [0,4194304] 0 2024-04-20T21:59:11.815 INFO:tasks.workunit.client.1.smithi164.stdout:8/826: dread - d0/d14/d4e/d62/f91 zero size 2024-04-20T21:59:11.817 INFO:tasks.workunit.client.1.smithi164.stdout:7/889: dread d2/d21/d24/d31/f41 [0,4194304] 0 2024-04-20T21:59:11.822 INFO:tasks.workunit.client.1.smithi164.stdout:1/825: creat d10/d16/d19/de0/d34/da9/f109 x:0 0 0 2024-04-20T21:59:11.823 INFO:tasks.workunit.client.1.smithi164.stdout:6/888: dwrite d0/d3/fb [0,4194304] 0 2024-04-20T21:59:11.831 INFO:tasks.workunit.client.1.smithi164.stdout:8/827: unlink d0/f61 0 2024-04-20T21:59:11.833 INFO:tasks.workunit.client.1.smithi164.stdout:4/823: dwrite d4/d9/d5c/d97/dbf/d67/d86/def/d3e/fae [0,4194304] 0 2024-04-20T21:59:11.836 INFO:tasks.workunit.client.1.smithi164.stdout:8/828: dread - d0/d14/db4/f101 zero size 2024-04-20T21:59:11.838 INFO:tasks.workunit.client.1.smithi164.stdout:0/849: fdatasync d1/d4/d26/d29/d2d/fed 0 2024-04-20T21:59:11.841 INFO:tasks.workunit.client.1.smithi164.stdout:1/826: unlink d10/d16/d19/de0/d34/f89 0 2024-04-20T21:59:11.846 INFO:tasks.workunit.client.1.smithi164.stdout:6/889: unlink d0/d3/f18 0 2024-04-20T21:59:11.848 INFO:tasks.workunit.client.1.smithi164.stdout:3/959: rename d12/d20/d39/d69/d77 to d12/d15/dae/d13f 0 2024-04-20T21:59:11.851 INFO:tasks.workunit.client.1.smithi164.stdout:3/960: chown d12/d20/d39/d69/le8 2 1 2024-04-20T21:59:11.852 INFO:tasks.workunit.client.1.smithi164.stdout:7/890: symlink d2/d21/l128 0 2024-04-20T21:59:11.854 INFO:tasks.workunit.client.1.smithi164.stdout:3/961: write d12/d6d/f8e [2549630,128438] 0 2024-04-20T21:59:11.855 INFO:tasks.workunit.client.1.smithi164.stdout:1/827: creat d10/d8a/f10a x:0 0 0 2024-04-20T21:59:11.856 INFO:tasks.workunit.client.1.smithi164.stdout:6/890: symlink d0/d3/d62/d75/l12c 0 2024-04-20T21:59:11.857 INFO:tasks.workunit.client.1.smithi164.stdout:4/824: mkdir d4/d106 0 2024-04-20T21:59:11.858 INFO:tasks.workunit.client.1.smithi164.stdout:6/891: stat d0/d3/d15/d21/f91 0 2024-04-20T21:59:11.858 INFO:tasks.workunit.client.1.smithi164.stdout:7/891: creat d2/d21/d44/f129 x:0 0 0 2024-04-20T21:59:11.860 INFO:tasks.workunit.client.1.smithi164.stdout:4/825: dread - d4/d9/d22/fdf zero size 2024-04-20T21:59:11.861 INFO:tasks.workunit.client.1.smithi164.stdout:3/962: fsync d12/d15/fea 0 2024-04-20T21:59:11.862 INFO:tasks.workunit.client.1.smithi164.stdout:2/910: dread d2/d19/da6/fe3 [0,4194304] 0 2024-04-20T21:59:11.864 INFO:tasks.workunit.client.1.smithi164.stdout:0/850: link d1/d4/da/d5c/f94 d1/d4/d26/d29/d2d/ff4 0 2024-04-20T21:59:11.866 INFO:tasks.workunit.client.1.smithi164.stdout:0/851: readlink d1/d4/da/d5c/lab 0 2024-04-20T21:59:11.867 INFO:tasks.workunit.client.1.smithi164.stdout:6/892: chown d0/d3/d15/d21/d5c/dbf/dbd/ddf/d28/d6f/fd5 2677735 1 2024-04-20T21:59:11.867 INFO:tasks.workunit.client.1.smithi164.stdout:8/829: link d0/d14/d16/fc7 d0/d14/d4e/d62/d8f/f114 0 2024-04-20T21:59:11.867 INFO:tasks.workunit.client.1.smithi164.stdout:9/936: dread d3/ff [0,4194304] 0 2024-04-20T21:59:11.868 INFO:tasks.workunit.client.1.smithi164.stdout:1/828: dread d10/d16/fc9 [0,4194304] 0 2024-04-20T21:59:11.869 INFO:tasks.workunit.client.1.smithi164.stdout:6/893: stat d0/d3/d15/d21/d4b/l6b 0 2024-04-20T21:59:11.871 INFO:tasks.workunit.client.1.smithi164.stdout:6/894: stat d0/d3/d11/d29/d6e/d41/fb7 0 2024-04-20T21:59:11.872 INFO:tasks.workunit.client.1.smithi164.stdout:2/911: link d2/d5/d3a/d55/d58/da2/f122 d2/dab/f126 0 2024-04-20T21:59:11.876 INFO:tasks.workunit.client.1.smithi164.stdout:8/830: chown d0/d14/d16/c3f 124247 1 2024-04-20T21:59:11.885 INFO:tasks.workunit.client.1.smithi164.stdout:1/829: mknod d10/dca/c10b 0 2024-04-20T21:59:11.885 INFO:tasks.workunit.client.1.smithi164.stdout:8/831: dread d0/d14/d4e/d62/d82/d97/f9c [0,4194304] 0 2024-04-20T21:59:11.887 INFO:tasks.workunit.client.1.smithi164.stdout:6/895: rmdir d0/d3/d15/d21/d5c/df4 39 2024-04-20T21:59:11.888 INFO:tasks.workunit.client.1.smithi164.stdout:6/896: readlink d0/d3/d11/lb8 0 2024-04-20T21:59:11.892 INFO:tasks.workunit.client.1.smithi164.stdout:0/852: mkdir d1/d4/df/d56/df5 0 2024-04-20T21:59:11.895 INFO:tasks.workunit.client.1.smithi164.stdout:3/963: link d12/d20/d39/d69/le8 d12/d20/l140 0 2024-04-20T21:59:11.897 INFO:tasks.workunit.client.1.smithi164.stdout:1/830: chown d10/d7d/la1 125483 1 2024-04-20T21:59:11.898 INFO:tasks.workunit.client.1.smithi164.stdout:9/937: link d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/fa9 d3/db/d1b/f152 0 2024-04-20T21:59:11.902 INFO:tasks.workunit.client.1.smithi164.stdout:0/853: rmdir d1/d4/da/d5c 39 2024-04-20T21:59:11.903 INFO:tasks.workunit.client.1.smithi164.stdout:4/826: link d4/f19 d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d4a/f107 0 2024-04-20T21:59:11.906 INFO:tasks.workunit.client.1.smithi164.stdout:2/912: creat d2/d19/d28/dd0/dba/f127 x:0 0 0 2024-04-20T21:59:11.913 INFO:tasks.workunit.client.1.smithi164.stdout:6/897: dread d0/d3/d62/fa7 [0,4194304] 0 2024-04-20T21:59:11.917 INFO:tasks.workunit.client.1.smithi164.stdout:1/831: truncate d10/f11 3605521 0 2024-04-20T21:59:11.918 INFO:tasks.workunit.client.1.smithi164.stdout:2/913: creat d2/d19/d28/dd0/df9/f128 x:0 0 0 2024-04-20T21:59:11.922 INFO:tasks.workunit.client.1.smithi164.stdout:1/832: dread d10/d16/fdb [0,4194304] 0 2024-04-20T21:59:11.922 INFO:tasks.workunit.client.1.smithi164.stdout:3/964: write d12/d6d/fa9 [851007,77912] 0 2024-04-20T21:59:11.922 INFO:tasks.workunit.client.1.smithi164.stdout:4/827: mkdir d4/d108 0 2024-04-20T21:59:11.924 INFO:tasks.workunit.client.1.smithi164.stdout:6/898: fsync d0/d3/d15/d21/d101/d45/d4f/d9c/fd7 0 2024-04-20T21:59:11.927 INFO:tasks.workunit.client.1.smithi164.stdout:9/938: link d3/d9f/da1/fbc d3/db/dd/d40/d78/d86/d118/f153 0 2024-04-20T21:59:11.927 INFO:tasks.workunit.client.1.smithi164.stdout:2/914: truncate d2/d30/f7a 952306 0 2024-04-20T21:59:11.928 INFO:tasks.workunit.client.1.smithi164.stdout:8/832: dwrite d0/d1e/f44 [4194304,4194304] 0 2024-04-20T21:59:11.930 INFO:tasks.workunit.client.1.smithi164.stdout:3/965: chown d12/d20/d39/d69/dad/de2/d111/c115 581632 1 2024-04-20T21:59:11.937 INFO:tasks.workunit.client.1.smithi164.stdout:0/854: dread d1/d4/da/f2e [0,4194304] 0 2024-04-20T21:59:11.942 INFO:tasks.workunit.client.1.smithi164.stdout:2/915: write d2/d5f/fe1 [665379,71332] 0 2024-04-20T21:59:11.945 INFO:tasks.workunit.client.1.smithi164.stdout:6/899: creat d0/d3/d15/d21/d5c/dbf/db4/f12d x:0 0 0 2024-04-20T21:59:11.945 INFO:tasks.workunit.client.1.smithi164.stdout:9/939: symlink d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/l154 0 2024-04-20T21:59:11.949 INFO:tasks.workunit.client.1.smithi164.stdout:3/966: rename d12/d15/dae/f13a to d12/d20/d39/d69/dad/de2/f141 0 2024-04-20T21:59:11.951 INFO:tasks.workunit.client.1.smithi164.stdout:4/828: symlink d4/d9/d5c/d97/daa/l109 0 2024-04-20T21:59:11.952 INFO:tasks.workunit.client.1.smithi164.stdout:5/956: sync 2024-04-20T21:59:11.957 INFO:tasks.workunit.client.1.smithi164.stdout:2/916: rmdir d2/d5/d3a/d55/d58/da2/dcc 39 2024-04-20T21:59:11.957 INFO:tasks.workunit.client.1.smithi164.stdout:1/833: dread d10/d16/d20/d25/d95/dd9/ffb [0,4194304] 0 2024-04-20T21:59:11.957 INFO:tasks.workunit.client.1.smithi164.stdout:0/855: chown d1/d4/d26/d29/d2d/d54/d77/d3c/cb6 7498 1 2024-04-20T21:59:11.958 INFO:tasks.workunit.client.1.smithi164.stdout:2/917: chown d2/d30/c11d 5 1 2024-04-20T21:59:11.959 INFO:tasks.workunit.client.1.smithi164.stdout:9/940: creat d3/db/d1b/d20/d3f/d8a/da7/d11b/f155 x:0 0 0 2024-04-20T21:59:11.959 INFO:tasks.workunit.client.1.smithi164.stdout:6/900: truncate d0/d3/d15/d21/d101/d3b/f42 2277141 0 2024-04-20T21:59:11.962 INFO:tasks.workunit.client.1.smithi164.stdout:4/829: write d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d4a/f9f [1526741,38335] 0 2024-04-20T21:59:11.963 INFO:tasks.workunit.client.1.smithi164.stdout:5/957: creat dc/d2b/d6d/d73/dd6/dfd/f149 x:0 0 0 2024-04-20T21:59:11.965 INFO:tasks.workunit.client.1.smithi164.stdout:6/901: write d0/d3/d15/d21/d5c/dbf/d107/f112 [472285,66557] 0 2024-04-20T21:59:11.966 INFO:tasks.workunit.client.1.smithi164.stdout:1/834: mknod d10/d16/d20/d66/c10c 0 2024-04-20T21:59:11.969 INFO:tasks.workunit.client.1.smithi164.stdout:8/833: dwrite d0/d14/d16/f70 [4194304,4194304] 0 2024-04-20T21:59:11.971 INFO:tasks.workunit.client.1.smithi164.stdout:0/856: rename d1/d4/d26 to d1/d4/d26/d29/d2d/df6 22 2024-04-20T21:59:11.975 INFO:tasks.workunit.client.1.smithi164.stdout:5/958: chown dc/d2c/d2e/d30/d72/da9/cc6 396 1 2024-04-20T21:59:11.976 INFO:tasks.workunit.client.1.smithi164.stdout:5/959: stat dc/c21 0 2024-04-20T21:59:11.978 INFO:tasks.workunit.client.1.smithi164.stdout:1/835: mknod d10/dca/c10d 0 2024-04-20T21:59:11.999 INFO:tasks.workunit.client.1.smithi164.stdout:6/902: rmdir d0/d3/d15/d21/d101/d45/d4f/d9c/d104 39 2024-04-20T21:59:12.000 INFO:tasks.workunit.client.1.smithi164.stdout:8/834: dwrite d0/d14/d16/d9d/fe6 [0,4194304] 0 2024-04-20T21:59:12.003 INFO:tasks.workunit.client.1.smithi164.stdout:7/892: sync 2024-04-20T21:59:12.003 INFO:tasks.workunit.client.1.smithi164.stdout:6/903: chown d0/d3/d15/d21/d5c/fa5 34131919 1 2024-04-20T21:59:12.003 INFO:tasks.workunit.client.1.smithi164.stdout:3/967: truncate d12/d20/d39/d69/d83/db9/d124/f10a 3419443 0 2024-04-20T21:59:12.004 INFO:tasks.workunit.client.1.smithi164.stdout:9/941: rename d3/db/dd/d40/d2a/d36/d51/d83/ld9 to d3/db/dd/d40/d2a/d36/l156 0 2024-04-20T21:59:12.005 INFO:tasks.workunit.client.1.smithi164.stdout:5/960: creat dc/d2c/d2e/d30/d72/da9/dbb/d10e/d147/f14a x:0 0 0 2024-04-20T21:59:12.005 INFO:tasks.workunit.client.1.smithi164.stdout:1/836: fsync d10/d16/d20/f103 0 2024-04-20T21:59:12.007 INFO:tasks.workunit.client.1.smithi164.stdout:8/835: mkdir d0/db3/d115 0 2024-04-20T21:59:12.011 INFO:tasks.workunit.client.1.smithi164.stdout:2/918: dwrite d2/d5/d3a/f4c [0,4194304] 0 2024-04-20T21:59:12.015 INFO:tasks.workunit.client.1.smithi164.stdout:7/893: mknod d2/d21/d44/dd4/c12a 0 2024-04-20T21:59:12.021 INFO:tasks.workunit.client.1.smithi164.stdout:4/830: dwrite d4/d9/d5c/d97/dbf/f92 [0,4194304] 0 2024-04-20T21:59:12.021 INFO:tasks.workunit.client.1.smithi164.stdout:0/857: rename d1/ldb to d1/d4/da/d5c/d6e/lf7 0 2024-04-20T21:59:12.023 INFO:tasks.workunit.client.1.smithi164.stdout:1/837: fdatasync d10/d7d/f107 0 2024-04-20T21:59:12.027 INFO:tasks.workunit.client.1.smithi164.stdout:3/968: read d12/f32 [1051220,59132] 0 2024-04-20T21:59:12.027 INFO:tasks.workunit.client.1.smithi164.stdout:6/904: read - d0/d3/d15/d21/d5c/dbf/dbd/ddf/d81/fc2 zero size 2024-04-20T21:59:12.028 INFO:tasks.workunit.client.1.smithi164.stdout:8/836: dread d0/f1b [0,4194304] 0 2024-04-20T21:59:12.030 INFO:tasks.workunit.client.1.smithi164.stdout:2/919: creat d2/d5/d21/f129 x:0 0 0 2024-04-20T21:59:12.031 INFO:tasks.workunit.client.1.smithi164.stdout:7/894: rmdir d2/d21/d24 39 2024-04-20T21:59:12.031 INFO:tasks.workunit.client.1.smithi164.stdout:3/969: fdatasync d12/d6d/fa9 0 2024-04-20T21:59:12.034 INFO:tasks.workunit.client.1.smithi164.stdout:2/920: write d2/d19/d28/dd0/dba/f127 [988435,129116] 0 2024-04-20T21:59:12.035 INFO:tasks.workunit.client.1.smithi164.stdout:5/961: dread dc/d2b/d6d/d73/de3/f138 [0,4194304] 0 2024-04-20T21:59:12.037 INFO:tasks.workunit.client.1.smithi164.stdout:9/942: rmdir d3/db/de5/d14a 0 2024-04-20T21:59:12.039 INFO:tasks.workunit.client.1.smithi164.stdout:2/921: truncate d2/d30/de8/f120 634070 0 2024-04-20T21:59:12.040 INFO:tasks.workunit.client.1.smithi164.stdout:8/837: fdatasync d0/d14/d16/f6a 0 2024-04-20T21:59:12.044 INFO:tasks.workunit.client.1.smithi164.stdout:4/831: creat d4/d9/d5c/d97/dbf/d67/d86/def/dad/de1/f10a x:0 0 0 2024-04-20T21:59:12.044 INFO:tasks.workunit.client.1.smithi164.stdout:6/905: mknod d0/d3/d11/c12e 0 2024-04-20T21:59:12.047 INFO:tasks.workunit.client.1.smithi164.stdout:8/838: read - d0/d14/d16/d5a/f93 zero size 2024-04-20T21:59:12.049 INFO:tasks.workunit.client.1.smithi164.stdout:1/838: dread d10/d33/fc0 [0,4194304] 0 2024-04-20T21:59:12.049 INFO:tasks.workunit.client.1.smithi164.stdout:0/858: dwrite d1/d4/d20/d74/fd1 [0,4194304] 0 2024-04-20T21:59:12.051 INFO:tasks.workunit.client.1.smithi164.stdout:0/859: read - d1/d4/da/fda zero size 2024-04-20T21:59:12.054 INFO:tasks.workunit.client.1.smithi164.stdout:0/860: dread - d1/d4/d26/d29/d2d/d54/d77/d3c/fa3 zero size 2024-04-20T21:59:12.057 INFO:tasks.workunit.client.1.smithi164.stdout:7/895: fdatasync d2/d21/d24/d31/d3a/d83/d63/fab 0 2024-04-20T21:59:12.060 INFO:tasks.workunit.client.1.smithi164.stdout:9/943: mkdir d3/d157 0 2024-04-20T21:59:12.062 INFO:tasks.workunit.client.1.smithi164.stdout:9/944: dread - d3/db0/d132/d146/f103 zero size 2024-04-20T21:59:12.063 INFO:tasks.workunit.client.1.smithi164.stdout:2/922: dwrite d2/d30/ff0 [0,4194304] 0 2024-04-20T21:59:12.065 INFO:tasks.workunit.client.1.smithi164.stdout:2/923: chown d2/d19/d28/dd0/le2 1491039 1 2024-04-20T21:59:12.068 INFO:tasks.workunit.client.1.smithi164.stdout:8/839: mkdir d0/d14/d16/d58/d94/da5/dad/d116 0 2024-04-20T21:59:12.068 INFO:tasks.workunit.client.1.smithi164.stdout:1/839: mkdir d10/d33/d41/d10e 0 2024-04-20T21:59:12.071 INFO:tasks.workunit.client.1.smithi164.stdout:1/840: write d10/d33/d41/f100 [56570,18877] 0 2024-04-20T21:59:12.077 INFO:tasks.workunit.client.1.smithi164.stdout:4/832: mkdir d4/d9/d22/d10b 0 2024-04-20T21:59:12.079 INFO:tasks.workunit.client.1.smithi164.stdout:7/896: symlink d2/d21/d24/d31/d3a/d83/dcf/l12b 0 2024-04-20T21:59:12.083 INFO:tasks.workunit.client.1.smithi164.stdout:9/945: rmdir d3/db0/dc0 39 2024-04-20T21:59:12.084 INFO:tasks.workunit.client.1.smithi164.stdout:2/924: creat d2/d5/d21/f12a x:0 0 0 2024-04-20T21:59:12.085 INFO:tasks.workunit.client.1.smithi164.stdout:3/970: getdents d12/d20/d39/d55 0 2024-04-20T21:59:12.087 INFO:tasks.workunit.client.1.smithi164.stdout:1/841: symlink d10/d33/d48/l10f 0 2024-04-20T21:59:12.089 INFO:tasks.workunit.client.1.smithi164.stdout:0/861: dwrite d1/d4/df/f2f [0,4194304] 0 2024-04-20T21:59:12.091 INFO:tasks.workunit.client.1.smithi164.stdout:5/962: getdents dc 0 2024-04-20T21:59:12.092 INFO:tasks.workunit.client.1.smithi164.stdout:6/906: creat d0/d3/d15/d21/d101/d45/d4f/d9c/f12f x:0 0 0 2024-04-20T21:59:12.104 INFO:tasks.workunit.client.1.smithi164.stdout:8/840: mknod d0/d14/d4e/d62/d82/c117 0 2024-04-20T21:59:12.111 INFO:tasks.workunit.client.1.smithi164.stdout:1/842: symlink d10/d16/d19/de0/d34/da9/l110 0 2024-04-20T21:59:12.113 INFO:tasks.workunit.client.1.smithi164.stdout:1/843: chown d10/d33/d41/f58 7335 1 2024-04-20T21:59:12.114 INFO:tasks.workunit.client.1.smithi164.stdout:1/844: dread - d10/d16/d20/d25/fdf zero size 2024-04-20T21:59:12.115 INFO:tasks.workunit.client.1.smithi164.stdout:5/963: symlink dc/d2c/d2e/d30/d72/da9/l14b 0 2024-04-20T21:59:12.116 INFO:tasks.workunit.client.1.smithi164.stdout:6/907: chown d0/d3/d15/d21/d5c/dbf/dbd/cc7 1428368802 1 2024-04-20T21:59:12.118 INFO:tasks.workunit.client.1.smithi164.stdout:1/845: write d10/d16/d19/d1a/fde [1613213,15328] 0 2024-04-20T21:59:12.119 INFO:tasks.workunit.client.1.smithi164.stdout:8/841: dwrite d0/d14/d16/d5a/f6c [0,4194304] 0 2024-04-20T21:59:12.120 INFO:tasks.workunit.client.1.smithi164.stdout:4/833: truncate d4/d9/d5c/d97/dbf/d67/d86/def/f58 231931 0 2024-04-20T21:59:12.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.124+0000 7fc344400700 1 -- 172.21.15.142:0/1080701990 --> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc33c1021a0 con 0x7fc32406ea70 2024-04-20T21:59:12.129 INFO:tasks.workunit.client.1.smithi164.stdout:9/946: creat d3/db/dc4/f158 x:0 0 0 2024-04-20T21:59:12.133 INFO:tasks.workunit.client.1.smithi164.stdout:9/947: write d3/db/d1b/d20/fb4 [2652445,74607] 0 2024-04-20T21:59:12.134 INFO:tasks.workunit.client.1.smithi164.stdout:3/971: fdatasync d12/d15/f6e 0 2024-04-20T21:59:12.142 INFO:tasks.workunit.client.1.smithi164.stdout:5/964: symlink dc/d2c/d2e/dbd/df9/d104/l14c 0 2024-04-20T21:59:12.146 INFO:tasks.workunit.client.1.smithi164.stdout:3/972: symlink d12/d20/d39/d69/d83/d12c/l142 0 2024-04-20T21:59:12.148 INFO:tasks.workunit.client.1.smithi164.stdout:3/973: stat d12/d68/d6f/d71/d7d/f130 0 2024-04-20T21:59:12.149 INFO:tasks.workunit.client.1.smithi164.stdout:5/965: write dc/d2c/d2e/d30/d118/f13f [2544410,46573] 0 2024-04-20T21:59:12.153 INFO:tasks.workunit.client.1.smithi164.stdout:5/966: chown dc/d12/d81/l6b 8649111 1 2024-04-20T21:59:12.154 INFO:tasks.workunit.client.1.smithi164.stdout:2/925: getdents d2/d19/d28 0 2024-04-20T21:59:12.159 INFO:tasks.workunit.client.1.smithi164.stdout:8/842: creat d0/d14/d4e/d62/f118 x:0 0 0 2024-04-20T21:59:12.163 INFO:tasks.workunit.client.1.smithi164.stdout:6/908: rename d0/d3/d15/d21/d5c/dbf/dbd/ddf/f96 to d0/d3/d15/d21/d101/f130 0 2024-04-20T21:59:12.167 INFO:tasks.workunit.client.1.smithi164.stdout:3/974: mknod d12/d20/d39/d55/d6b/d79/c143 0 2024-04-20T21:59:12.168 INFO:tasks.workunit.client.1.smithi164.stdout:1/846: getdents d10/d16/d20/d81 0 2024-04-20T21:59:12.170 INFO:tasks.workunit.client.1.smithi164.stdout:7/897: truncate d2/d21/d24/d31/f46 3149922 0 2024-04-20T21:59:12.174 INFO:tasks.workunit.client.1.smithi164.stdout:0/862: dwrite d1/f22 [0,4194304] 0 2024-04-20T21:59:12.174 INFO:tasks.workunit.client.1.smithi164.stdout:7/898: write d2/d21/f23 [105672,89664] 0 2024-04-20T21:59:12.176 INFO:tasks.workunit.client.1.smithi164.stdout:6/909: rmdir d0/d3/d15/d21/d101/d3b 39 2024-04-20T21:59:12.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.177+0000 7fc33a000700 1 -- 172.21.15.142:0/1080701990 <== mgr.14722 v2:172.21.15.142:6800/54392364 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fc33c1021a0 con 0x7fc32406ea70 2024-04-20T21:59:12.177 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T21:59:12.177 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (9m) 12s ago 11m 13.6M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T21:59:12.177 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (12m) 12s ago 12m 7914k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T21:59:12.177 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (10m) 9s ago 10m 7545k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T21:59:12.177 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (12m) 12s ago 12m 6665k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 56f2e41784f8 2024-04-20T21:59:12.177 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (10m) 9s ago 10m 6660k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 bce67525dd3e 2024-04-20T21:59:12.177 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (9m) 12s ago 11m 75.5M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T21:59:12.177 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (4m) 12s ago 4m 198M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 b68e279d7945 2024-04-20T21:59:12.177 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (4m) 12s ago 4m 14.1M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T21:59:12.178 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (4m) 9s ago 4m 14.2M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T21:59:12.178 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (4m) 9s ago 4m 14.5M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T21:59:12.178 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (62s) 12s ago 13m 479M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T21:59:12.178 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (2m) 9s ago 10m 132M - 19.0.0-3133-ga8c84f59 76bc6b91b726 b8f1c0f4899b 2024-04-20T21:59:12.178 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (13m) 12s ago 13m 53.9M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c076f7eb00ea 2024-04-20T21:59:12.178 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (10m) 9s ago 10m 40.8M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 2bacdeb02ee0 2024-04-20T21:59:12.178 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (11m) 12s ago 11m 8052k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T21:59:12.178 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (10m) 9s ago 10m 8178k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T21:59:12.178 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (9m) 12s ago 9m 187M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4361ae428e0d 2024-04-20T21:59:12.178 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (8m) 12s ago 8m 195M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 dd7e7cf8e8e1 2024-04-20T21:59:12.178 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (8m) 12s ago 8m 185M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 8e9165365127 2024-04-20T21:59:12.178 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (7m) 9s ago 7m 238M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c081911f56ab 2024-04-20T21:59:12.178 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (6m) 9s ago 6m 218M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 39e09d63d44f 2024-04-20T21:59:12.178 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (6m) 9s ago 6m 221M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4f36124aeb0d 2024-04-20T21:59:12.179 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (73s) 12s ago 11m 52.0M - 2.43.0 a07b618ecd1d c810d879d9e4 2024-04-20T21:59:12.179 INFO:tasks.workunit.client.1.smithi164.stdout:5/967: dwrite dc/f88 [0,4194304] 0 2024-04-20T21:59:12.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.181+0000 7fc344400700 1 -- 172.21.15.142:0/1080701990 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fc32406ea70 msgr2=0x7fc324070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:12.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.181+0000 7fc344400700 1 --2- 172.21.15.142:0/1080701990 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fc32406ea70 0x7fc324070f30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc328000c00 tx=0x7fc328005fb0 comp rx=0 tx=0).stop 2024-04-20T21:59:12.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.181+0000 7fc344400700 1 -- 172.21.15.142:0/1080701990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c101680 msgr2=0x7fc33c196870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:12.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.181+0000 7fc344400700 1 --2- 172.21.15.142:0/1080701990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c101680 0x7fc33c196870 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc33000e920 tx=0x7fc33000ec30 comp rx=0 tx=0).stop 2024-04-20T21:59:12.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.181+0000 7fc344400700 1 -- 172.21.15.142:0/1080701990 shutdown_connections 2024-04-20T21:59:12.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.181+0000 7fc344400700 1 --2- 172.21.15.142:0/1080701990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c101680 0x7fc33c196870 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:12.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.181+0000 7fc344400700 1 --2- 172.21.15.142:0/1080701990 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fc32406ea70 0x7fc324070f30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:12.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.181+0000 7fc344400700 1 --2- 172.21.15.142:0/1080701990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc33c196db0 0x7fc33c19bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:12.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.181+0000 7fc344400700 1 -- 172.21.15.142:0/1080701990 >> 172.21.15.142:0/1080701990 conn(0x7fc33c0fb0d0 msgr2=0x7fc33c0fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:12.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.181+0000 7fc344400700 1 -- 172.21.15.142:0/1080701990 shutdown_connections 2024-04-20T21:59:12.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.181+0000 7fc344400700 1 -- 172.21.15.142:0/1080701990 wait complete. 2024-04-20T21:59:12.190 INFO:tasks.workunit.client.1.smithi164.stdout:4/834: write d4/d9/d27/f48 [41496,75162] 0 2024-04-20T21:59:12.194 INFO:tasks.workunit.client.1.smithi164.stdout:8/843: symlink d0/d14/d16/d58/d94/da5/dad/d116/l119 0 2024-04-20T21:59:12.196 INFO:tasks.workunit.client.1.smithi164.stdout:8/844: fdatasync d0/d14/df6/ff8 0 2024-04-20T21:59:12.203 INFO:tasks.workunit.client.1.smithi164.stdout:9/948: dwrite d3/db/dd/d40/d78/d86/fb5 [0,4194304] 0 2024-04-20T21:59:12.209 INFO:tasks.workunit.client.1.smithi164.stdout:6/910: rename d0/d3/d15/d21/d101/d45/d4f/d61/f128 to d0/d3/d15/d21/d101/d45/d4f/d61/f131 0 2024-04-20T21:59:12.211 INFO:tasks.workunit.client.1.smithi164.stdout:6/911: chown d0/d3/d11/d29/d6e/fc1 64844576 1 2024-04-20T21:59:12.217 INFO:tasks.workunit.client.1.smithi164.stdout:3/975: write d12/d20/d39/dac/f120 [638530,59651] 0 2024-04-20T21:59:12.219 INFO:tasks.workunit.client.1.smithi164.stdout:4/835: rmdir d4/d9/d5c/d97/dbf/d67/d86/def/dad/de1 39 2024-04-20T21:59:12.225 INFO:tasks.workunit.client.1.smithi164.stdout:0/863: write d1/d4/d26/d29/d2d/fa7 [2789683,50327] 0 2024-04-20T21:59:12.226 INFO:tasks.workunit.client.1.smithi164.stdout:7/899: write d2/d21/fc1 [1332063,67192] 0 2024-04-20T21:59:12.228 INFO:tasks.workunit.client.1.smithi164.stdout:8/845: symlink d0/d14/d4e/d62/d82/d97/l11a 0 2024-04-20T21:59:12.232 INFO:tasks.workunit.client.1.smithi164.stdout:5/968: symlink dc/d2c/d2e/l14d 0 2024-04-20T21:59:12.236 INFO:tasks.workunit.client.1.smithi164.stdout:6/912: creat d0/d3/d62/d8e/f132 x:0 0 0 2024-04-20T21:59:12.236 INFO:tasks.workunit.client.1.smithi164.stdout:3/976: dwrite d12/d20/d39/d69/d83/fb6 [0,4194304] 0 2024-04-20T21:59:12.236 INFO:tasks.workunit.client.1.smithi164.stdout:1/847: link d10/cef d10/d16/d20/d81/c111 0 2024-04-20T21:59:12.239 INFO:tasks.workunit.client.1.smithi164.stdout:6/913: chown d0/d3/d15/d21/d5c/dbf/dbd/ddf/d28/c102 22 1 2024-04-20T21:59:12.241 INFO:tasks.workunit.client.1.smithi164.stdout:6/914: read - d0/d3/d27/d9d/dc3/f105 zero size 2024-04-20T21:59:12.242 INFO:tasks.workunit.client.1.smithi164.stdout:9/949: write d3/db/d1b/d20/fb9 [364064,40303] 0 2024-04-20T21:59:12.247 INFO:tasks.workunit.client.1.smithi164.stdout:8/846: symlink d0/d14/d16/d5a/l11b 0 2024-04-20T21:59:12.250 INFO:tasks.workunit.client.1.smithi164.stdout:5/969: rmdir dc/d12/d81/d120 39 2024-04-20T21:59:12.250 INFO:tasks.workunit.client.1.smithi164.stdout:8/847: chown d0/d14/d4e/d6f 2904 1 2024-04-20T21:59:12.251 INFO:tasks.workunit.client.1.smithi164.stdout:0/864: mknod d1/dc5/cf8 0 2024-04-20T21:59:12.259 INFO:tasks.workunit.client.1.smithi164.stdout:7/900: rmdir d2/d21/d24/d31/d3a/d83/d6a/de7 39 2024-04-20T21:59:12.260 INFO:tasks.workunit.client.1.smithi164.stdout:5/970: mkdir dc/d2b/d53/d14e 0 2024-04-20T21:59:12.260 INFO:tasks.workunit.client.1.smithi164.stdout:8/848: fsync d0/d14/d16/d5a/f89 0 2024-04-20T21:59:12.263 INFO:tasks.workunit.client.1.smithi164.stdout:8/849: chown d0/d1e/cda 109797 1 2024-04-20T21:59:12.264 INFO:tasks.workunit.client.1.smithi164.stdout:6/915: dread d0/d3/d15/d21/d4b/fee [0,4194304] 0 2024-04-20T21:59:12.268 INFO:tasks.workunit.client.1.smithi164.stdout:1/848: dread d10/f5c [4194304,4194304] 0 2024-04-20T21:59:12.276 INFO:tasks.workunit.client.1.smithi164.stdout:4/836: dread d4/d9/d42/f99 [0,4194304] 0 2024-04-20T21:59:12.292 INFO:tasks.workunit.client.1.smithi164.stdout:6/916: dread d0/d3/d11/faf [0,4194304] 0 2024-04-20T21:59:12.303 INFO:tasks.workunit.client.1.smithi164.stdout:9/950: creat d3/d9f/d14b/f159 x:0 0 0 2024-04-20T21:59:12.303 INFO:tasks.workunit.client.1.smithi164.stdout:7/901: rmdir d2/d21 39 2024-04-20T21:59:12.305 INFO:tasks.workunit.client.1.smithi164.stdout:7/902: chown d2/c8 1522943 1 2024-04-20T21:59:12.305 INFO:tasks.workunit.client.1.smithi164.stdout:0/865: chown d1/d4/d26/d29/d2d/d54/d77/l51 174545073 1 2024-04-20T21:59:12.305 INFO:tasks.workunit.client.1.smithi164.stdout:5/971: mknod dc/d2b/d52/c14f 0 2024-04-20T21:59:12.307 INFO:tasks.workunit.client.1.smithi164.stdout:9/951: truncate d3/db/dc4/ffc 1700769 0 2024-04-20T21:59:12.308 INFO:tasks.workunit.client.1.smithi164.stdout:1/849: mkdir d10/d33/d48/d8b/de3/d112 0 2024-04-20T21:59:12.310 INFO:tasks.workunit.client.1.smithi164.stdout:4/837: dread - d4/d9/d5c/d97/dbf/d67/d86/def/dad/de1/f10a zero size 2024-04-20T21:59:12.311 INFO:tasks.workunit.client.1.smithi164.stdout:6/917: creat d0/d3/d15/d21/d5c/dbf/f133 x:0 0 0 2024-04-20T21:59:12.313 INFO:tasks.workunit.client.1.smithi164.stdout:6/918: truncate d0/d3/d15/d21/d4b/fda 4666275 0 2024-04-20T21:59:12.319 INFO:tasks.workunit.client.1.smithi164.stdout:0/866: rename d1/f22 to d1/d4/d26/d29/d2d/d9b/ff9 0 2024-04-20T21:59:12.323 INFO:tasks.workunit.client.1.smithi164.stdout:7/903: read d2/d21/f7d [3819531,106950] 0 2024-04-20T21:59:12.327 INFO:tasks.workunit.client.1.smithi164.stdout:6/919: write d0/d3/d15/d21/db1/ffc [457817,64863] 0 2024-04-20T21:59:12.328 INFO:tasks.workunit.client.1.smithi164.stdout:5/972: dread dc/d2b/fdc [0,4194304] 0 2024-04-20T21:59:12.333 INFO:tasks.workunit.client.1.smithi164.stdout:4/838: creat d4/d9/d27/f10c x:0 0 0 2024-04-20T21:59:12.336 INFO:tasks.workunit.client.1.smithi164.stdout:4/839: chown d4/d9/d5c/d97/dbf/d67/d86/def/d3e 3135223 1 2024-04-20T21:59:12.336 INFO:tasks.workunit.client.1.smithi164.stdout:1/850: rename d10/d16/d19/cb6 to d10/d16/d20/d81/c113 0 2024-04-20T21:59:12.338 INFO:tasks.workunit.client.1.smithi164.stdout:6/920: dread d0/d3/d15/d21/d5c/dbf/dbd/ddf/d28/f99 [0,4194304] 0 2024-04-20T21:59:12.339 INFO:tasks.workunit.client.1.smithi164.stdout:9/952: dread d3/db/d1b/f8f [0,4194304] 0 2024-04-20T21:59:12.339 INFO:tasks.workunit.client.1.smithi164.stdout:7/904: symlink d2/d21/d24/d31/d3a/d83/d6a/de4/l12c 0 2024-04-20T21:59:12.340 INFO:tasks.workunit.client.1.smithi164.stdout:0/867: truncate d1/d4/da/d27/f7c 2177840 0 2024-04-20T21:59:12.341 INFO:tasks.workunit.client.1.smithi164.stdout:2/926: sync 2024-04-20T21:59:12.343 INFO:tasks.workunit.client.1.smithi164.stdout:5/973: mkdir dc/d2c/d2e/d150 0 2024-04-20T21:59:12.344 INFO:tasks.workunit.client.1.smithi164.stdout:4/840: readlink d4/d9/l38 0 2024-04-20T21:59:12.344 INFO:tasks.workunit.client.1.smithi164.stdout:9/953: read d3/db/dd/d40/d2a/f4a [2332678,18295] 0 2024-04-20T21:59:12.348 INFO:tasks.workunit.client.1.smithi164.stdout:9/954: write d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/fab [1537875,128200] 0 2024-04-20T21:59:12.350 INFO:tasks.workunit.client.1.smithi164.stdout:9/955: chown d3/db/dd/d40/d78 9825078 1 2024-04-20T21:59:12.351 INFO:tasks.workunit.client.1.smithi164.stdout:6/921: truncate d0/d3/d27/f3f 857243 0 2024-04-20T21:59:12.354 INFO:tasks.workunit.client.1.smithi164.stdout:4/841: dread d4/d9/d42/f99 [0,4194304] 0 2024-04-20T21:59:12.355 INFO:tasks.workunit.client.1.smithi164.stdout:0/868: creat d1/d4/d26/d29/d2d/d54/d77/d3c/ffa x:0 0 0 2024-04-20T21:59:12.357 INFO:tasks.workunit.client.1.smithi164.stdout:1/851: getdents d10/d33/d41/d10e 0 2024-04-20T21:59:12.359 INFO:tasks.workunit.client.1.smithi164.stdout:1/852: dread - d10/d16/d19/de0/d34/da9/fee zero size 2024-04-20T21:59:12.360 INFO:tasks.workunit.client.1.smithi164.stdout:1/853: stat d10/d16/d20/d25/d95 0 2024-04-20T21:59:12.365 INFO:tasks.workunit.client.1.smithi164.stdout:7/905: dread d2/f8c [4194304,4194304] 0 2024-04-20T21:59:12.367 INFO:tasks.workunit.client.1.smithi164.stdout:2/927: link d2/d19/d28/dd0/dba/f90 d2/d5/d3a/d65/d81/f12b 0 2024-04-20T21:59:12.371 INFO:tasks.workunit.client.1.smithi164.stdout:3/977: sync 2024-04-20T21:59:12.372 INFO:tasks.workunit.client.1.smithi164.stdout:9/956: symlink d3/db0/dc0/l15a 0 2024-04-20T21:59:12.372 INFO:tasks.workunit.client.1.smithi164.stdout:5/974: creat dc/d2b/f151 x:0 0 0 2024-04-20T21:59:12.376 INFO:tasks.workunit.client.1.smithi164.stdout:5/975: write dc/d2b/d6d/d73/dd6/dfd/f132 [139396,57829] 0 2024-04-20T21:59:12.378 INFO:tasks.workunit.client.1.smithi164.stdout:5/976: stat dc/d2b/da0/df8/fff 0 2024-04-20T21:59:12.379 INFO:tasks.workunit.client.1.smithi164.stdout:2/928: symlink d2/d30/de8/df6/l12c 0 2024-04-20T21:59:12.382 INFO:tasks.workunit.client.1.smithi164.stdout:1/854: link d10/d16/d20/f38 d10/d33/d4d/dc4/f114 0 2024-04-20T21:59:12.384 INFO:tasks.workunit.client.1.smithi164.stdout:0/869: rename d1/d4/d26/d29/d2d/d54/d77/d9e/lcb to d1/d4/df/dbe/lfb 0 2024-04-20T21:59:12.384 INFO:tasks.workunit.client.1.smithi164.stdout:1/855: fdatasync d10/d16/d19/d1a/fde 0 2024-04-20T21:59:12.386 INFO:tasks.workunit.client.1.smithi164.stdout:3/978: mkdir d12/d20/d39/d69/dad/de2/df1/d144 0 2024-04-20T21:59:12.386 INFO:tasks.workunit.client.1.smithi164.stdout:8/850: write d0/d14/d5f/f95 [254039,62186] 0 2024-04-20T21:59:12.390 INFO:tasks.workunit.client.1.smithi164.stdout:9/957: creat d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/f15b x:0 0 0 2024-04-20T21:59:12.390 INFO:tasks.workunit.client.1.smithi164.stdout:8/851: dread - d0/d14/d16/d58/fc9 zero size 2024-04-20T21:59:12.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.393+0000 7f3e30200700 1 -- 172.21.15.142:0/3003797147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e280ff470 msgr2=0x7f3e281018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:12.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.393+0000 7f3e30200700 1 --2- 172.21.15.142:0/3003797147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e280ff470 0x7f3e281018a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009910 tx=0x7f3e1c009c20 comp rx=0 tx=0).stop 2024-04-20T21:59:12.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.393+0000 7f3e30200700 1 -- 172.21.15.142:0/3003797147 shutdown_connections 2024-04-20T21:59:12.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.393+0000 7f3e30200700 1 --2- 172.21.15.142:0/3003797147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e28101de0 0x7f3e28104270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:12.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.393+0000 7f3e30200700 1 --2- 172.21.15.142:0/3003797147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e280ff470 0x7f3e281018a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:12.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.393+0000 7f3e30200700 1 -- 172.21.15.142:0/3003797147 >> 172.21.15.142:0/3003797147 conn(0x7f3e280fb0d0 msgr2=0x7f3e280fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:12.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.393+0000 7f3e30200700 1 -- 172.21.15.142:0/3003797147 shutdown_connections 2024-04-20T21:59:12.393 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:12 smithi142 ceph-mon[15828]: from='client.24477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:59:12.393 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:12 smithi142 ceph-mon[15828]: pgmap v13: 65 pgs: 65 active+clean; 3.0 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 54 MiB/s rd, 143 MiB/s wr, 319 op/s 2024-04-20T21:59:12.393 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:12 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:12.393 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:12 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:12.393 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:12 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:12.393 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:12 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:12.394 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:12 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:12.394 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:12 smithi142 ceph-mon[15828]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:59:12.394 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:12 smithi142 ceph-mon[15828]: Reconfiguring prometheus.smithi142 (dependencies changed)... 2024-04-20T21:59:12.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.393+0000 7f3e30200700 1 -- 172.21.15.142:0/3003797147 wait complete. 2024-04-20T21:59:12.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.394+0000 7f3e30200700 1 Processor -- start 2024-04-20T21:59:12.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.395+0000 7f3e30200700 1 -- start start 2024-04-20T21:59:12.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.395+0000 7f3e30200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e280ff470 0x7f3e2819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:12.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.395+0000 7f3e30200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e28101de0 0x7f3e2819d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:12.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.395+0000 7f3e30200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2819d790 con 0x7f3e28101de0 2024-04-20T21:59:12.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.395+0000 7f3e30200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2819d8d0 con 0x7f3e280ff470 2024-04-20T21:59:12.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.395+0000 7f3e2d800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e280ff470 0x7f3e2819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:12.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.396+0000 7f3e2ce00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e28101de0 0x7f3e2819d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:12.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.396+0000 7f3e2d800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e280ff470 0x7f3e2819cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:54730/0 (socket says 172.21.15.142:54730) 2024-04-20T21:59:12.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.396+0000 7f3e2d800700 1 -- 172.21.15.142:0/1719362651 learned_addr learned my addr 172.21.15.142:0/1719362651 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:59:12.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.396+0000 7f3e2ce00700 1 -- 172.21.15.142:0/1719362651 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e280ff470 msgr2=0x7f3e2819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:12.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.396+0000 7f3e2ce00700 1 --2- 172.21.15.142:0/1719362651 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e280ff470 0x7f3e2819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:12.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.396+0000 7f3e2ce00700 1 -- 172.21.15.142:0/1719362651 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c0095f0 con 0x7f3e28101de0 2024-04-20T21:59:12.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.397+0000 7f3e2ce00700 1 --2- 172.21.15.142:0/1719362651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e28101de0 0x7f3e2819d170 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400ca50 tx=0x7f3e1400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:12.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.397+0000 7f3e26000700 1 -- 172.21.15.142:0/1719362651 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e14004a00 con 0x7f3e28101de0 2024-04-20T21:59:12.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.397+0000 7f3e26000700 1 -- 172.21.15.142:0/1719362651 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3e140054e0 con 0x7f3e28101de0 2024-04-20T21:59:12.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.397+0000 7f3e30200700 1 -- 172.21.15.142:0/1719362651 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e281a22e0 con 0x7f3e28101de0 2024-04-20T21:59:12.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.397+0000 7f3e30200700 1 -- 172.21.15.142:0/1719362651 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e281a28b0 con 0x7f3e28101de0 2024-04-20T21:59:12.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.398+0000 7f3e26000700 1 -- 172.21.15.142:0/1719362651 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e14007d30 con 0x7f3e28101de0 2024-04-20T21:59:12.399 INFO:tasks.workunit.client.1.smithi164.stdout:5/977: creat dc/d2b/d52/f152 x:0 0 0 2024-04-20T21:59:12.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.399+0000 7f3e30200700 1 -- 172.21.15.142:0/1719362651 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e08005320 con 0x7f3e28101de0 2024-04-20T21:59:12.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.401+0000 7f3e26000700 1 -- 172.21.15.142:0/1719362651 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 30) v1 ==== 92710+0+0 (secure 0 0 0) 0x7f3e14005020 con 0x7f3e28101de0 2024-04-20T21:59:12.402 INFO:tasks.workunit.client.1.smithi164.stdout:1/856: dwrite d10/d7d/feb [0,4194304] 0 2024-04-20T21:59:12.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.402+0000 7f3e26000700 1 --2- 172.21.15.142:0/1719362651 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f3e1006ea70 0x7f3e10070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:12.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.402+0000 7f3e26000700 1 -- 172.21.15.142:0/1719362651 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f3e1408e9b0 con 0x7f3e28101de0 2024-04-20T21:59:12.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.403+0000 7f3e2d800700 1 --2- 172.21.15.142:0/1719362651 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f3e1006ea70 0x7f3e10070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:12.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.406+0000 7f3e2d800700 1 --2- 172.21.15.142:0/1719362651 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f3e1006ea70 0x7f3e10070f30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0051c0 tx=0x7f3e1c00b540 comp rx=0 tx=0).ready entity=mgr.14722 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:12.410 INFO:tasks.workunit.client.1.smithi164.stdout:6/922: getdents d0/d3 0 2024-04-20T21:59:12.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.410+0000 7f3e26000700 1 -- 172.21.15.142:0/1719362651 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f3e1405b580 con 0x7f3e28101de0 2024-04-20T21:59:12.411 INFO:tasks.workunit.client.1.smithi164.stdout:3/979: fdatasync d12/d6d/fb0 0 2024-04-20T21:59:12.413 INFO:tasks.workunit.client.1.smithi164.stdout:3/980: stat d12/d20/d39/dac/df7 0 2024-04-20T21:59:12.417 INFO:tasks.workunit.client.1.smithi164.stdout:9/958: mkdir d3/db/d1b/d20/d15c 0 2024-04-20T21:59:12.420 INFO:tasks.workunit.client.1.smithi164.stdout:8/852: mknod d0/d14/d4e/d86/c11c 0 2024-04-20T21:59:12.424 INFO:tasks.workunit.client.1.smithi164.stdout:0/870: dread d1/d4/d26/d29/d2d/d9b/fce [0,4194304] 0 2024-04-20T21:59:12.425 INFO:tasks.workunit.client.1.smithi164.stdout:4/842: write d4/f19 [1188987,9448] 0 2024-04-20T21:59:12.430 INFO:tasks.workunit.client.1.smithi164.stdout:7/906: link d2/c14 d2/d21/d24/d31/d3a/d83/dba/def/c12d 0 2024-04-20T21:59:12.431 INFO:tasks.workunit.client.1.smithi164.stdout:1/857: dread d10/d16/d19/d1a/d51/f61 [0,4194304] 0 2024-04-20T21:59:12.435 INFO:tasks.workunit.client.1.smithi164.stdout:6/923: rename d0/d3/d15/d21/d5c/dbf/dbd/ddf/d28/d6f to d0/d3/d15/d21/d101/d45/d69/d134 0 2024-04-20T21:59:12.438 INFO:tasks.workunit.client.1.smithi164.stdout:5/978: getdents dc/d2b/df6 0 2024-04-20T21:59:12.438 INFO:tasks.workunit.client.1.smithi164.stdout:2/929: write d2/d5/d3a/fae [136127,96160] 0 2024-04-20T21:59:12.439 INFO:tasks.workunit.client.1.smithi164.stdout:0/871: mkdir d1/d4/df/dbe/dfc 0 2024-04-20T21:59:12.441 INFO:tasks.workunit.client.1.smithi164.stdout:7/907: symlink d2/d21/d24/d31/d3a/d83/dba/l12e 0 2024-04-20T21:59:12.442 INFO:tasks.workunit.client.1.smithi164.stdout:6/924: read d0/d3/f12 [4989432,17] 0 2024-04-20T21:59:12.443 INFO:tasks.workunit.client.1.smithi164.stdout:9/959: rename d3/db/dcc/de3/f116 to d3/db0/dd3/f15d 0 2024-04-20T21:59:12.445 INFO:tasks.workunit.client.1.smithi164.stdout:4/843: dread d4/d9/d5c/d97/dbf/d67/d86/def/f6b [0,4194304] 0 2024-04-20T21:59:12.445 INFO:tasks.workunit.client.1.smithi164.stdout:7/908: chown d2/d21/d24/d31/d3a/c56 62049329 1 2024-04-20T21:59:12.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:12 smithi164 ceph-mon[23506]: from='client.24477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:59:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:12 smithi164 ceph-mon[23506]: pgmap v13: 65 pgs: 65 active+clean; 3.0 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 54 MiB/s rd, 143 MiB/s wr, 319 op/s 2024-04-20T21:59:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:12 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:12 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:12 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:12 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:12 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:12 smithi164 ceph-mon[23506]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:59:12.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:12 smithi164 ceph-mon[23506]: Reconfiguring prometheus.smithi142 (dependencies changed)... 2024-04-20T21:59:12.447 INFO:tasks.workunit.client.1.smithi164.stdout:1/858: dread d10/d7d/feb [0,4194304] 0 2024-04-20T21:59:12.452 INFO:tasks.workunit.client.1.smithi164.stdout:2/930: creat d2/d19/d28/dd0/f12d x:0 0 0 2024-04-20T21:59:12.453 INFO:tasks.workunit.client.1.smithi164.stdout:2/931: fdatasync d2/f12 0 2024-04-20T21:59:12.455 INFO:tasks.workunit.client.1.smithi164.stdout:6/925: mknod d0/d3/d62/d75/c135 0 2024-04-20T21:59:12.455 INFO:tasks.workunit.client.1.smithi164.stdout:2/932: fsync d2/d19/d28/dd0/dba/ff8 0 2024-04-20T21:59:12.456 INFO:tasks.workunit.client.1.smithi164.stdout:8/853: write d0/d14/d5f/f7a [3635858,92006] 0 2024-04-20T21:59:12.458 INFO:tasks.workunit.client.1.smithi164.stdout:0/872: chown d1/d4/df/d56/ld3 126888 1 2024-04-20T21:59:12.458 INFO:tasks.workunit.client.1.smithi164.stdout:2/933: fsync d2/d5/d3a/f96 0 2024-04-20T21:59:12.458 INFO:tasks.workunit.client.1.smithi164.stdout:0/873: readlink d1/d4/l92 0 2024-04-20T21:59:12.459 INFO:tasks.workunit.client.1.smithi164.stdout:8/854: dread - d0/d14/d4e/d62/f91 zero size 2024-04-20T21:59:12.461 INFO:tasks.workunit.client.1.smithi164.stdout:3/981: dwrite d12/d20/d39/d69/dad/fbf [0,4194304] 0 2024-04-20T21:59:12.462 INFO:tasks.workunit.client.1.smithi164.stdout:5/979: truncate dc/d2c/fdd 1011346 0 2024-04-20T21:59:12.462 INFO:tasks.workunit.client.1.smithi164.stdout:3/982: read - d12/ffc zero size 2024-04-20T21:59:12.469 INFO:tasks.workunit.client.1.smithi164.stdout:6/926: mknod d0/d3/c136 0 2024-04-20T21:59:12.471 INFO:tasks.workunit.client.1.smithi164.stdout:6/927: chown d0/lcc 748496 1 2024-04-20T21:59:12.473 INFO:tasks.workunit.client.1.smithi164.stdout:9/960: unlink d3/db/dd/d40/d2a/c35 0 2024-04-20T21:59:12.473 INFO:tasks.workunit.client.1.smithi164.stdout:2/934: dwrite d2/d5f/faf [0,4194304] 0 2024-04-20T21:59:12.482 INFO:tasks.workunit.client.1.smithi164.stdout:3/983: mknod d12/d2a/db1/c145 0 2024-04-20T21:59:12.483 INFO:tasks.workunit.client.1.smithi164.stdout:9/961: rmdir d3/db/d1b/d20/d3f/d8a/da7 39 2024-04-20T21:59:12.484 INFO:tasks.workunit.client.1.smithi164.stdout:2/935: mknod d2/dab/db3/c12e 0 2024-04-20T21:59:12.486 INFO:tasks.workunit.client.1.smithi164.stdout:4/844: creat d4/d9/d22/f10d x:0 0 0 2024-04-20T21:59:12.488 INFO:tasks.workunit.client.1.smithi164.stdout:0/874: symlink d1/d4/d26/d29/lfd 0 2024-04-20T21:59:12.489 INFO:tasks.workunit.client.1.smithi164.stdout:1/859: link d10/d16/d20/d25/c56 d10/d33/d41/d10e/c115 0 2024-04-20T21:59:12.490 INFO:tasks.workunit.client.1.smithi164.stdout:0/875: stat d1/d4/df/d56/df5 0 2024-04-20T21:59:12.492 INFO:tasks.workunit.client.1.smithi164.stdout:0/876: fsync d1/d4/d26/d29/ff1 0 2024-04-20T21:59:12.492 INFO:tasks.workunit.client.1.smithi164.stdout:7/909: getdents d2/d21/d44/dd4 0 2024-04-20T21:59:12.492 INFO:tasks.workunit.client.1.smithi164.stdout:8/855: write d0/d14/d4e/d62/d8f/dbe/fd8 [51270,52421] 0 2024-04-20T21:59:12.496 INFO:tasks.workunit.client.1.smithi164.stdout:3/984: read - d12/d68/d6f/d71/f74 zero size 2024-04-20T21:59:12.499 INFO:tasks.workunit.client.1.smithi164.stdout:4/845: mkdir d4/d9/d5c/d97/dbf/d67/d86/def/dad/de1/d10e 0 2024-04-20T21:59:12.499 INFO:tasks.workunit.client.1.smithi164.stdout:1/860: fsync d10/d16/fdb 0 2024-04-20T21:59:12.500 INFO:tasks.workunit.client.1.smithi164.stdout:4/846: chown d4/f16 0 1 2024-04-20T21:59:12.503 INFO:tasks.workunit.client.1.smithi164.stdout:0/877: readlink d1/d4/da/d5c/d6e/lf7 0 2024-04-20T21:59:12.508 INFO:tasks.workunit.client.1.smithi164.stdout:7/910: symlink d2/d21/d24/d31/d3a/d83/dba/def/dff/l12f 0 2024-04-20T21:59:12.510 INFO:tasks.workunit.client.1.smithi164.stdout:2/936: mkdir d2/d5/d3a/d12f 0 2024-04-20T21:59:12.511 INFO:tasks.workunit.client.1.smithi164.stdout:2/937: chown d2/d30/ff0 188 1 2024-04-20T21:59:12.518 INFO:tasks.workunit.client.1.smithi164.stdout:1/861: fdatasync d10/d16/d20/d25/d95/fb5 0 2024-04-20T21:59:12.520 INFO:tasks.workunit.client.1.smithi164.stdout:4/847: mkdir d4/d9/d5c/d97/dbf/d5f/d10f 0 2024-04-20T21:59:12.526 INFO:tasks.workunit.client.1.smithi164.stdout:3/985: dwrite d12/d20/d39/d69/dad/de2/f13b [0,4194304] 0 2024-04-20T21:59:12.529 INFO:tasks.workunit.client.1.smithi164.stdout:9/962: truncate d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/fa9 584632 0 2024-04-20T21:59:12.530 INFO:tasks.workunit.client.1.smithi164.stdout:3/986: dread d12/d15/f6e [0,4194304] 0 2024-04-20T21:59:12.531 INFO:tasks.workunit.client.1.smithi164.stdout:8/856: truncate d0/d14/d16/f70 5773787 0 2024-04-20T21:59:12.531 INFO:tasks.workunit.client.1.smithi164.stdout:5/980: link dc/d2c/d2e/d30/d72/da9/df0/d128/l137 dc/d2c/d2e/l153 0 2024-04-20T21:59:12.532 INFO:tasks.workunit.client.1.smithi164.stdout:9/963: chown d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/fad 850166718 1 2024-04-20T21:59:12.534 INFO:tasks.workunit.client.1.smithi164.stdout:1/862: readlink d10/d16/d20/d25/d3d/l102 0 2024-04-20T21:59:12.538 INFO:tasks.workunit.client.1.smithi164.stdout:6/928: creat d0/d3/d15/d21/d101/d45/d4f/f137 x:0 0 0 2024-04-20T21:59:12.542 INFO:tasks.workunit.client.1.smithi164.stdout:3/987: write d12/d68/d6f/fd2 [861937,2985] 0 2024-04-20T21:59:12.545 INFO:tasks.workunit.client.1.smithi164.stdout:9/964: dread - d3/db/d1b/d20/d3f/d8a/da7/dbd/f114 zero size 2024-04-20T21:59:12.545 INFO:tasks.workunit.client.1.smithi164.stdout:8/857: dread d0/d14/d4e/d86/fd5 [0,4194304] 0 2024-04-20T21:59:12.546 INFO:tasks.workunit.client.1.smithi164.stdout:2/938: rename d2/d5/d3a/d55/c70 to d2/d5/c130 0 2024-04-20T21:59:12.549 INFO:tasks.workunit.client.1.smithi164.stdout:2/939: write d2/d19/d28/d3e/d9e/fc8 [3663214,69532] 0 2024-04-20T21:59:12.556 INFO:tasks.workunit.client.1.smithi164.stdout:0/878: write d1/d4/da/d27/f7c [2860338,80562] 0 2024-04-20T21:59:12.557 INFO:tasks.workunit.client.1.smithi164.stdout:9/965: chown d3/db/dd/l37 1127041501 1 2024-04-20T21:59:12.558 INFO:tasks.workunit.client.1.smithi164.stdout:0/879: chown d1/d4/d26/d29/f5b 0 1 2024-04-20T21:59:12.560 INFO:tasks.workunit.client.1.smithi164.stdout:0/880: chown d1/d4/da/fc2 10 1 2024-04-20T21:59:12.562 INFO:tasks.workunit.client.1.smithi164.stdout:3/988: unlink d12/d68/d6f/d71/ce4 0 2024-04-20T21:59:12.570 INFO:tasks.workunit.client.1.smithi164.stdout:6/929: write d0/fdd [1021698,129544] 0 2024-04-20T21:59:12.570 INFO:tasks.workunit.client.1.smithi164.stdout:5/981: write dc/d2c/f43 [5020121,111789] 0 2024-04-20T21:59:12.572 INFO:tasks.workunit.client.1.smithi164.stdout:9/966: mkdir d3/db/d1b/d20/d3f/d15e 0 2024-04-20T21:59:12.576 INFO:tasks.workunit.client.1.smithi164.stdout:0/881: symlink d1/d4/d26/d29/d2d/d54/d77/d9e/lfe 0 2024-04-20T21:59:12.578 INFO:tasks.workunit.client.1.smithi164.stdout:8/858: dread d0/d14/d4e/d62/d82/d97/f9c [0,4194304] 0 2024-04-20T21:59:12.581 INFO:tasks.workunit.client.1.smithi164.stdout:5/982: stat dc/d2c/l9c 0 2024-04-20T21:59:12.582 INFO:tasks.workunit.client.1.smithi164.stdout:6/930: fsync d0/d3/d15/d21/d101/d45/d69/f8d 0 2024-04-20T21:59:12.582 INFO:tasks.workunit.client.1.smithi164.stdout:9/967: creat d3/db0/d132/d146/f15f x:0 0 0 2024-04-20T21:59:12.583 INFO:tasks.workunit.client.1.smithi164.stdout:0/882: mkdir d1/d4/d20/d74/dff 0 2024-04-20T21:59:12.585 INFO:tasks.workunit.client.1.smithi164.stdout:4/848: rename d4/d9/d5c/c8f to d4/d9/d27/c110 0 2024-04-20T21:59:12.586 INFO:tasks.workunit.client.1.smithi164.stdout:5/983: symlink dc/d2c/d2e/d30/d8c/l154 0 2024-04-20T21:59:12.588 INFO:tasks.workunit.client.1.smithi164.stdout:3/989: link d12/d15/l3f d12/d20/d39/d55/d87/d108/l146 0 2024-04-20T21:59:12.589 INFO:tasks.workunit.client.1.smithi164.stdout:2/940: rename d2/d19/d28/f29 to d2/d5/d3a/d65/f131 0 2024-04-20T21:59:12.590 INFO:tasks.workunit.client.1.smithi164.stdout:9/968: symlink d3/db/d1b/d20/d3f/d8a/da7/dbd/d9a/dbf/d12c/l160 0 2024-04-20T21:59:12.591 INFO:tasks.workunit.client.1.smithi164.stdout:4/849: write d4/d9/d5c/d97/dbf/d67/d86/def/d3e/f59 [1076294,117340] 0 2024-04-20T21:59:12.594 INFO:tasks.workunit.client.1.smithi164.stdout:9/969: dread - d3/db/d1b/d20/d3f/d8a/da7/d11b/f155 zero size 2024-04-20T21:59:12.596 INFO:tasks.workunit.client.1.smithi164.stdout:3/990: mknod d12/d6d/c147 0 2024-04-20T21:59:12.596 INFO:tasks.workunit.client.1.smithi164.stdout:5/984: mknod dc/d2c/d2e/d30/d72/da9/df0/d128/c155 0 2024-04-20T21:59:12.597 INFO:tasks.workunit.client.1.smithi164.stdout:5/985: read - dc/d2b/f111 zero size 2024-04-20T21:59:12.598 INFO:tasks.workunit.client.1.smithi164.stdout:4/850: mknod d4/d9/d22/dc2/c111 0 2024-04-20T21:59:12.601 INFO:tasks.workunit.client.1.smithi164.stdout:8/859: dread d0/d14/f3e [0,4194304] 0 2024-04-20T21:59:12.603 INFO:tasks.workunit.client.1.smithi164.stdout:9/970: symlink d3/db/d1b/d20/d3f/l161 0 2024-04-20T21:59:12.604 INFO:tasks.workunit.client.1.smithi164.stdout:9/971: dread - d3/db/dc4/fff zero size 2024-04-20T21:59:12.604 INFO:tasks.workunit.client.1.smithi164.stdout:3/991: chown d12/d15/f1c 399140 1 2024-04-20T21:59:12.606 INFO:tasks.workunit.client.1.smithi164.stdout:9/972: chown d3/c21 0 1 2024-04-20T21:59:12.608 INFO:tasks.workunit.client.1.smithi164.stdout:0/883: link d1/d4/d26/c37 d1/d4/da/d5c/c100 0 2024-04-20T21:59:12.612 INFO:tasks.workunit.client.1.smithi164.stdout:4/851: creat d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41/f112 x:0 0 0 2024-04-20T21:59:12.613 INFO:tasks.workunit.client.1.smithi164.stdout:3/992: truncate d12/d68/f122 1808677 0 2024-04-20T21:59:12.615 INFO:tasks.workunit.client.1.smithi164.stdout:9/973: mknod d3/d9f/d14b/c162 0 2024-04-20T21:59:12.615 INFO:tasks.workunit.client.1.smithi164.stdout:1/863: sync 2024-04-20T21:59:12.616 INFO:tasks.workunit.client.1.smithi164.stdout:7/911: sync 2024-04-20T21:59:12.616 INFO:tasks.workunit.client.1.smithi164.stdout:6/931: write d0/d3/d15/d21/d101/d3b/faa [2474498,120720] 0 2024-04-20T21:59:12.617 INFO:tasks.workunit.client.1.smithi164.stdout:5/986: dread dc/d2c/d2e/dbd/df9/f102 [0,4194304] 0 2024-04-20T21:59:12.618 INFO:tasks.workunit.client.1.smithi164.stdout:0/884: creat d1/d4/d49/f101 x:0 0 0 2024-04-20T21:59:12.618 INFO:tasks.workunit.client.1.smithi164.stdout:8/860: dwrite d0/d14/d16/d9d/fe6 [0,4194304] 0 2024-04-20T21:59:12.622 INFO:tasks.workunit.client.1.smithi164.stdout:0/885: truncate d1/d4/df/fe6 741512 0 2024-04-20T21:59:12.626 INFO:tasks.workunit.client.1.smithi164.stdout:2/941: truncate d2/d5/d3a/d65/f7f 277667 0 2024-04-20T21:59:12.626 INFO:tasks.workunit.client.1.smithi164.stdout:9/974: symlink d3/db/d1b/d20/d3f/d8a/da7/d11b/l163 0 2024-04-20T21:59:12.627 INFO:tasks.workunit.client.1.smithi164.stdout:8/861: creat d0/d14/d16/d58/d94/da5/f11d x:0 0 0 2024-04-20T21:59:12.630 INFO:tasks.workunit.client.1.smithi164.stdout:5/987: mknod dc/d2b/d6d/d73/de3/c156 0 2024-04-20T21:59:12.633 INFO:tasks.workunit.client.1.smithi164.stdout:4/852: creat d4/d9/d5c/d97/dbf/d67/d86/def/dad/f113 x:0 0 0 2024-04-20T21:59:12.634 INFO:tasks.workunit.client.1.smithi164.stdout:4/853: dread - d4/d9/d27/d37/fd8 zero size 2024-04-20T21:59:12.640 INFO:tasks.workunit.client.1.smithi164.stdout:5/988: mkdir dc/d2c/d2e/d30/d72/d157 0 2024-04-20T21:59:12.641 INFO:tasks.workunit.client.1.smithi164.stdout:8/862: mknod d0/d14/d4e/d86/c11e 0 2024-04-20T21:59:12.644 INFO:tasks.workunit.client.1.smithi164.stdout:8/863: rmdir d0/d14 39 2024-04-20T21:59:12.646 INFO:tasks.workunit.client.1.smithi164.stdout:5/989: write dc/d12/d1e/f45 [158762,67729] 0 2024-04-20T21:59:12.651 INFO:tasks.workunit.client.1.smithi164.stdout:9/975: dwrite d3/db/d1b/f12d [0,4194304] 0 2024-04-20T21:59:12.651 INFO:tasks.workunit.client.1.smithi164.stdout:7/912: dwrite d2/f8e [4194304,4194304] 0 2024-04-20T21:59:12.655 INFO:tasks.workunit.client.1.smithi164.stdout:5/990: write dc/d2c/d2e/d30/f55 [1802185,108030] 0 2024-04-20T21:59:12.656 INFO:tasks.workunit.client.1.smithi164.stdout:0/886: dread d1/d4/df/fd7 [0,4194304] 0 2024-04-20T21:59:12.667 INFO:tasks.workunit.client.1.smithi164.stdout:2/942: dread d2/d5f/fa9 [0,4194304] 0 2024-04-20T21:59:12.667 INFO:tasks.workunit.client.1.smithi164.stdout:6/932: dwrite d0/d3/d11/d29/d6e/d41/fb7 [0,4194304] 0 2024-04-20T21:59:12.667 INFO:tasks.workunit.client.1.smithi164.stdout:8/864: rename d0/d14/d5f to d0/d14/d16/d58/d94/da5/dad/d116/d11f 0 2024-04-20T21:59:12.670 INFO:tasks.workunit.client.1.smithi164.stdout:4/854: truncate d4/d9/fc8 8277375 0 2024-04-20T21:59:12.674 INFO:tasks.workunit.client.1.smithi164.stdout:7/913: creat d2/d21/d24/d31/d3a/d83/dcf/dea/d107/f130 x:0 0 0 2024-04-20T21:59:12.677 INFO:tasks.workunit.client.1.smithi164.stdout:9/976: fdatasync d3/db/f52 0 2024-04-20T21:59:12.677 INFO:tasks.workunit.client.1.smithi164.stdout:2/943: mkdir d2/d19/d28/d132 0 2024-04-20T21:59:12.678 INFO:tasks.workunit.client.1.smithi164.stdout:8/865: mkdir d0/d14/d16/d58/d94/da5/d120 0 2024-04-20T21:59:12.679 INFO:tasks.workunit.client.1.smithi164.stdout:5/991: symlink dc/d12/d1e/l158 0 2024-04-20T21:59:12.679 INFO:tasks.workunit.client.1.smithi164.stdout:4/855: chown d4/d9/d5c/d97/dbf/d67/d86/def/d3e/c74 29 1 2024-04-20T21:59:12.680 INFO:tasks.workunit.client.1.smithi164.stdout:7/914: creat d2/d21/d24/daf/f131 x:0 0 0 2024-04-20T21:59:12.681 INFO:tasks.workunit.client.1.smithi164.stdout:0/887: truncate d1/d4/da/f6d 1823973 0 2024-04-20T21:59:12.682 INFO:tasks.workunit.client.1.smithi164.stdout:2/944: mkdir d2/dab/df4/d133 0 2024-04-20T21:59:12.683 INFO:tasks.workunit.client.1.smithi164.stdout:4/856: fdatasync d4/d9/d5c/d97/dbf/ff4 0 2024-04-20T21:59:12.683 INFO:tasks.workunit.client.1.smithi164.stdout:9/977: read - d3/db/d1b/d20/d3f/f80 zero size 2024-04-20T21:59:12.685 INFO:tasks.workunit.client.1.smithi164.stdout:9/978: fsync d3/db/dcc/f13a 0 2024-04-20T21:59:12.688 INFO:tasks.workunit.client.1.smithi164.stdout:9/979: truncate d3/d9f/d14b/f159 491626 0 2024-04-20T21:59:12.689 INFO:tasks.workunit.client.1.smithi164.stdout:9/980: chown d3/db0/d132/d146 2 1 2024-04-20T21:59:12.692 INFO:tasks.workunit.client.1.smithi164.stdout:2/945: creat d2/d5f/de6/f134 x:0 0 0 2024-04-20T21:59:12.696 INFO:tasks.workunit.client.1.smithi164.stdout:4/857: creat d4/d9/d42/f114 x:0 0 0 2024-04-20T21:59:12.706 INFO:tasks.workunit.client.1.smithi164.stdout:7/915: write d2/d21/d24/f9a [696402,52960] 0 2024-04-20T21:59:12.707 INFO:tasks.workunit.client.1.smithi164.stdout:9/981: creat d3/db/d1b/d20/d15c/f164 x:0 0 0 2024-04-20T21:59:12.710 INFO:tasks.workunit.client.1.smithi164.stdout:2/946: dread d2/d5/d3a/d65/d81/fda [0,4194304] 0 2024-04-20T21:59:12.719 INFO:tasks.workunit.client.1.smithi164.stdout:0/888: write d1/d4/da/f6d [1268608,36261] 0 2024-04-20T21:59:12.719 INFO:tasks.workunit.client.1.smithi164.stdout:8/866: getdents d0/d14/d16/d58/d94/da5/dad/dd3/dd4 0 2024-04-20T21:59:12.721 INFO:tasks.workunit.client.1.smithi164.stdout:8/867: write d0/f11 [3885071,104772] 0 2024-04-20T21:59:12.722 INFO:tasks.workunit.client.1.smithi164.stdout:8/868: readlink d0/l59 0 2024-04-20T21:59:12.722 INFO:tasks.workunit.client.1.smithi164.stdout:7/916: symlink d2/d21/d24/d31/d3a/d83/dcf/l132 0 2024-04-20T21:59:12.723 INFO:tasks.workunit.client.1.smithi164.stdout:9/982: creat d3/db/d1b/d20/d15c/f165 x:0 0 0 2024-04-20T21:59:12.725 INFO:tasks.workunit.client.1.smithi164.stdout:2/947: rename d2/d19/d28/d3e/fc4 to d2/d19/d28/dd0/dba/d62/f135 0 2024-04-20T21:59:12.726 INFO:tasks.workunit.client.1.smithi164.stdout:5/992: link dc/d2c/d2e/d30/d72/c83 dc/d2c/d2e/dbd/d11f/c159 0 2024-04-20T21:59:12.728 INFO:tasks.workunit.client.1.smithi164.stdout:0/889: creat d1/d4/d49/f102 x:0 0 0 2024-04-20T21:59:12.730 INFO:tasks.workunit.client.1.smithi164.stdout:8/869: mknod d0/d14/d4e/d62/d8f/c121 0 2024-04-20T21:59:12.730 INFO:tasks.workunit.client.1.smithi164.stdout:0/890: stat d1/d4/d26/d29/d2d/d54/d77/d3c/cb6 0 2024-04-20T21:59:12.733 INFO:tasks.workunit.client.1.smithi164.stdout:9/983: fdatasync d3/d9f/da1/d11f/f134 0 2024-04-20T21:59:12.737 INFO:tasks.workunit.client.1.smithi164.stdout:4/858: getdents d4/d9/d5c/d97/dbf/d67/d86/def/dad/dbd 0 2024-04-20T21:59:12.738 INFO:tasks.workunit.client.1.smithi164.stdout:8/870: symlink d0/d14/d4e/d62/d82/d97/l122 0 2024-04-20T21:59:12.740 INFO:tasks.workunit.client.1.smithi164.stdout:2/948: dwrite d2/dab/fe0 [0,4194304] 0 2024-04-20T21:59:12.740 INFO:tasks.workunit.client.1.smithi164.stdout:8/871: stat d0/d14/d16/d58/d94/da5/d120 0 2024-04-20T21:59:12.741 INFO:tasks.workunit.client.1.smithi164.stdout:4/859: fdatasync d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41/f112 0 2024-04-20T21:59:12.744 INFO:tasks.workunit.client.1.smithi164.stdout:5/993: write f5 [1486426,547] 0 2024-04-20T21:59:12.744 INFO:tasks.workunit.client.1.smithi164.stdout:2/949: write d2/d5/d21/f2b [3383752,91462] 0 2024-04-20T21:59:12.747 INFO:tasks.workunit.client.1.smithi164.stdout:8/872: creat d0/d14/d16/d58/d94/da5/dad/f123 x:0 0 0 2024-04-20T21:59:12.751 INFO:tasks.workunit.client.1.smithi164.stdout:0/891: getdents d1/d4/d26/d29/d2d/d54/d77/d9e 0 2024-04-20T21:59:12.755 INFO:tasks.workunit.client.1.smithi164.stdout:4/860: mknod d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41/c115 0 2024-04-20T21:59:12.758 INFO:tasks.workunit.client.1.smithi164.stdout:7/917: dwrite d2/d21/d24/d31/d3a/f81 [0,4194304] 0 2024-04-20T21:59:12.760 INFO:tasks.workunit.client.1.smithi164.stdout:0/892: creat d1/d4/da/d5c/d6e/f103 x:0 0 0 2024-04-20T21:59:12.762 INFO:tasks.workunit.client.1.smithi164.stdout:9/984: link d3/db/dd/d40/d2a/cc9 d3/db/dd/d40/d78/d86/d118/c166 0 2024-04-20T21:59:12.763 INFO:tasks.workunit.client.1.smithi164.stdout:8/873: link d0/d1e/c8a d0/d14/d4e/d6f/de3/c124 0 2024-04-20T21:59:12.771 INFO:tasks.workunit.client.1.smithi164.stdout:3/993: sync 2024-04-20T21:59:12.773 INFO:tasks.workunit.client.1.smithi164.stdout:2/950: dwrite d2/d19/da6/fcb [0,4194304] 0 2024-04-20T21:59:12.776 INFO:tasks.workunit.client.1.smithi164.stdout:2/951: dread - d2/d19/d28/dd0/df9/f128 zero size 2024-04-20T21:59:12.778 INFO:tasks.workunit.client.1.smithi164.stdout:3/994: symlink d12/d20/d39/d69/d83/d12c/l148 0 2024-04-20T21:59:12.781 INFO:tasks.workunit.client.1.smithi164.stdout:7/918: truncate d2/f8c 1076850 0 2024-04-20T21:59:12.786 INFO:tasks.workunit.client.1.smithi164.stdout:7/919: read d2/d21/f28 [5135899,9438] 0 2024-04-20T21:59:12.787 INFO:tasks.workunit.client.1.smithi164.stdout:8/874: dwrite d0/d14/d16/d58/d94/da5/f11d [0,4194304] 0 2024-04-20T21:59:12.789 INFO:tasks.workunit.client.1.smithi164.stdout:2/952: rename d2/d5/d3a/f3b to d2/d30/d84/deb/f136 0 2024-04-20T21:59:12.794 INFO:tasks.workunit.client.1.smithi164.stdout:3/995: getdents d12/d20/d39/d55 0 2024-04-20T21:59:12.795 INFO:tasks.workunit.client.1.smithi164.stdout:0/893: dwrite d1/d4/d26/fa8 [0,4194304] 0 2024-04-20T21:59:12.797 INFO:tasks.workunit.client.1.smithi164.stdout:7/920: write d2/d21/d44/dd4/d9e/fd9 [379080,29079] 0 2024-04-20T21:59:12.798 INFO:tasks.workunit.client.1.smithi164.stdout:0/894: chown d1/d4/df/d56 7942 1 2024-04-20T21:59:12.798 INFO:tasks.workunit.client.1.smithi164.stdout:5/994: dread dc/d2c/d2e/d30/d72/da9/d10a/f121 [0,4194304] 0 2024-04-20T21:59:12.799 INFO:tasks.workunit.client.1.smithi164.stdout:8/875: mknod d0/d14/d16/c125 0 2024-04-20T21:59:12.811 INFO:tasks.workunit.client.1.smithi164.stdout:8/876: mkdir d0/d14/d16/d5a/d126 0 2024-04-20T21:59:12.814 INFO:tasks.workunit.client.1.smithi164.stdout:2/953: dread d2/d5/d3a/d65/d81/dac/fcd [0,4194304] 0 2024-04-20T21:59:12.814 INFO:tasks.workunit.client.1.smithi164.stdout:3/996: dwrite d12/ffc [0,4194304] 0 2024-04-20T21:59:12.824 INFO:tasks.workunit.client.1.smithi164.stdout:8/877: mkdir d0/d14/d16/d58/d94/d127 0 2024-04-20T21:59:12.825 INFO:tasks.workunit.client.1.smithi164.stdout:7/921: creat d2/d21/d24/d31/d3a/d83/d106/f133 x:0 0 0 2024-04-20T21:59:12.826 INFO:tasks.workunit.client.1.smithi164.stdout:2/954: mknod d2/d19/d28/c137 0 2024-04-20T21:59:12.828 INFO:tasks.workunit.client.1.smithi164.stdout:7/922: chown d2/d21/d44/dd4/cc2 19 1 2024-04-20T21:59:12.829 INFO:tasks.workunit.client.1.smithi164.stdout:7/923: chown d2/d21/f45 31959909 1 2024-04-20T21:59:12.830 INFO:tasks.workunit.client.1.smithi164.stdout:8/878: mkdir d0/d14/d16/d58/d128 0 2024-04-20T21:59:12.830 INFO:tasks.workunit.client.1.smithi164.stdout:2/955: truncate d2/d19/d28/d3e/f113 991763 0 2024-04-20T21:59:12.831 INFO:tasks.workunit.client.1.smithi164.stdout:3/997: rename d12/d20/d39/d69/d83/l95 to d12/l149 0 2024-04-20T21:59:12.832 INFO:tasks.workunit.client.1.smithi164.stdout:7/924: write d2/d21/d44/f129 [240427,59414] 0 2024-04-20T21:59:12.834 INFO:tasks.workunit.client.1.smithi164.stdout:0/895: dread d1/d4/d26/d29/f44 [0,4194304] 0 2024-04-20T21:59:12.834 INFO:tasks.workunit.client.1.smithi164.stdout:5/995: write dc/d2c/d2e/dbd/d11f/d130/f141 [732670,64681] 0 2024-04-20T21:59:12.836 INFO:tasks.workunit.client.1.smithi164.stdout:0/896: readlink d1/d4/d26/d29/d2d/le5 0 2024-04-20T21:59:12.838 INFO:tasks.workunit.client.1.smithi164.stdout:3/998: truncate d12/f32 377167 0 2024-04-20T21:59:12.848 INFO:tasks.workunit.client.1.smithi164.stdout:1/864: sync 2024-04-20T21:59:12.862 INFO:tasks.workunit.client.1.smithi164.stdout:9/985: dread d3/db/dcc/de3/feb [0,4194304] 0 2024-04-20T21:59:12.865 INFO:tasks.workunit.client.1.smithi164.stdout:7/925: symlink d2/d21/d24/d31/d3a/d83/d63/d85/dbe/l134 0 2024-04-20T21:59:12.867 INFO:tasks.workunit.client.1.smithi164.stdout:2/956: dread d2/d19/d28/d3e/d9e/fc8 [0,4194304] 0 2024-04-20T21:59:12.868 INFO:tasks.workunit.client.1.smithi164.stdout:7/926: read d2/d21/f28 [5213157,120647] 0 2024-04-20T21:59:12.870 INFO:tasks.workunit.client.1.smithi164.stdout:2/957: chown d2/d5f/f11a 804689 1 2024-04-20T21:59:12.871 INFO:tasks.workunit.client.1.smithi164.stdout:7/927: chown d2/d21/d24/d31/d3a/d83/dcf/dea/d107 64548 1 2024-04-20T21:59:12.872 INFO:tasks.workunit.client.1.smithi164.stdout:2/958: dread - d2/d5f/de6/f134 zero size 2024-04-20T21:59:12.873 INFO:tasks.workunit.client.1.smithi164.stdout:7/928: write d2/d21/d24/d31/fe1 [1055703,50679] 0 2024-04-20T21:59:12.875 INFO:tasks.workunit.client.1.smithi164.stdout:0/897: rename d1/fd0 to d1/d4/d26/d29/d2d/d54/d77/f104 0 2024-04-20T21:59:12.876 INFO:tasks.workunit.client.1.smithi164.stdout:7/929: readlink d2/d21/d24/d31/d3a/d83/dcf/dea/lf9 0 2024-04-20T21:59:12.880 INFO:tasks.workunit.client.1.smithi164.stdout:3/999: rename d12/d15/f6e to d12/d20/d39/d69/dad/de2/df1/d144/f14a 0 2024-04-20T21:59:12.881 INFO:tasks.workunit.client.1.smithi164.stdout:9/986: dwrite d3/db/d1b/d20/d3f/d8a/da7/dbd/f151 [0,4194304] 0 2024-04-20T21:59:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.886+0000 7f3e30200700 1 -- 172.21.15.142:0/1719362651 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3e080058a0 con 0x7f3e28101de0 2024-04-20T21:59:12.890 INFO:tasks.workunit.client.1.smithi164.stdout:5/996: truncate dc/d12/d1e/f12d 765248 0 2024-04-20T21:59:12.891 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T21:59:12.891 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T21:59:12.891 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 2 2024-04-20T21:59:12.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:59:12.891 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T21:59:12.891 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T21:59:12.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:59:12.891 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T21:59:12.891 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 6 2024-04-20T21:59:12.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:59:12.891 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T21:59:12.891 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4 2024-04-20T21:59:12.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:59:12.892 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T21:59:12.892 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 12, 2024-04-20T21:59:12.892 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T21:59:12.892 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T21:59:12.892 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T21:59:12.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.888+0000 7f3e26000700 1 -- 172.21.15.142:0/1719362651 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f3e1401d2f0 con 0x7f3e28101de0 2024-04-20T21:59:12.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.893+0000 7f3e30200700 1 -- 172.21.15.142:0/1719362651 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f3e1006ea70 msgr2=0x7f3e10070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:12.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.893+0000 7f3e30200700 1 --2- 172.21.15.142:0/1719362651 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f3e1006ea70 0x7f3e10070f30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0051c0 tx=0x7f3e1c00b540 comp rx=0 tx=0).stop 2024-04-20T21:59:12.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.893+0000 7f3e30200700 1 -- 172.21.15.142:0/1719362651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e28101de0 msgr2=0x7f3e2819d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:12.892 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.893+0000 7f3e30200700 1 --2- 172.21.15.142:0/1719362651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e28101de0 0x7f3e2819d170 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400ca50 tx=0x7f3e1400cd60 comp rx=0 tx=0).stop 2024-04-20T21:59:12.893 INFO:tasks.workunit.client.1.smithi164.stdout:1/865: write d10/d16/d19/de0/d34/f60 [4747611,92722] 0 2024-04-20T21:59:12.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.895+0000 7f3e30200700 1 -- 172.21.15.142:0/1719362651 shutdown_connections 2024-04-20T21:59:12.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.895+0000 7f3e30200700 1 --2- 172.21.15.142:0/1719362651 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f3e1006ea70 0x7f3e10070f30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:12.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.895+0000 7f3e30200700 1 --2- 172.21.15.142:0/1719362651 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3e280ff470 0x7f3e2819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:12.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.895+0000 7f3e30200700 1 --2- 172.21.15.142:0/1719362651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e28101de0 0x7f3e2819d170 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:12.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.895+0000 7f3e30200700 1 -- 172.21.15.142:0/1719362651 >> 172.21.15.142:0/1719362651 conn(0x7f3e280fb0d0 msgr2=0x7f3e280fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:12.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.896+0000 7f3e30200700 1 -- 172.21.15.142:0/1719362651 shutdown_connections 2024-04-20T21:59:12.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:12.896+0000 7f3e30200700 1 -- 172.21.15.142:0/1719362651 wait complete. 2024-04-20T21:59:12.898 INFO:tasks.workunit.client.1.smithi164.stdout:7/930: fdatasync d2/d21/d24/d31/d3a/fa2 0 2024-04-20T21:59:12.899 INFO:tasks.workunit.client.1.smithi164.stdout:0/898: dwrite d1/d4/d49/f95 [0,4194304] 0 2024-04-20T21:59:12.903 INFO:tasks.workunit.client.1.smithi164.stdout:5/997: dread dc/f88 [0,4194304] 0 2024-04-20T21:59:12.904 INFO:tasks.workunit.client.1.smithi164.stdout:5/998: chown dc/d12/d1e/l3a 182586 1 2024-04-20T21:59:12.906 INFO:tasks.workunit.client.1.smithi164.stdout:2/959: rename d2/d30/l66 to d2/d19/da6/l138 0 2024-04-20T21:59:12.908 INFO:tasks.workunit.client.1.smithi164.stdout:9/987: mknod d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/dce/c167 0 2024-04-20T21:59:12.910 INFO:tasks.workunit.client.1.smithi164.stdout:9/988: write d3/db/dc4/f158 [254575,5646] 0 2024-04-20T21:59:12.927 INFO:tasks.workunit.client.1.smithi164.stdout:7/931: mknod d2/d21/df0/c135 0 2024-04-20T21:59:12.927 INFO:tasks.workunit.client.1.smithi164.stdout:0/899: fsync d1/d2b/f66 0 2024-04-20T21:59:12.929 INFO:tasks.workunit.client.1.smithi164.stdout:4/861: sync 2024-04-20T21:59:12.929 INFO:tasks.workunit.client.1.smithi164.stdout:6/933: sync 2024-04-20T21:59:12.929 INFO:tasks.workunit.client.1.smithi164.stdout:7/932: write d2/d21/d44/f4b [2026971,92873] 0 2024-04-20T21:59:12.929 INFO:tasks.workunit.client.1.smithi164.stdout:5/999: creat dc/d2c/d2e/d30/d72/da9/f15a x:0 0 0 2024-04-20T21:59:12.930 INFO:tasks.workunit.client.1.smithi164.stdout:2/960: truncate d2/d5/d3a/d55/f56 610505 0 2024-04-20T21:59:12.933 INFO:tasks.workunit.client.1.smithi164.stdout:9/989: creat d3/db/d1b/d20/d3f/d8a/da7/d11b/f168 x:0 0 0 2024-04-20T21:59:12.936 INFO:tasks.workunit.client.1.smithi164.stdout:9/990: write d3/db/dd/f6a [653539,46553] 0 2024-04-20T21:59:12.937 INFO:tasks.workunit.client.1.smithi164.stdout:0/900: mknod d1/d4/d26/d29/d2d/ddf/c105 0 2024-04-20T21:59:12.938 INFO:tasks.workunit.client.1.smithi164.stdout:2/961: dread d2/d19/d28/dd0/dba/f127 [0,4194304] 0 2024-04-20T21:59:12.945 INFO:tasks.workunit.client.1.smithi164.stdout:7/933: rename d2/c14 to d2/d21/d24/d31/d3a/daa/db8/c136 0 2024-04-20T21:59:12.947 INFO:tasks.workunit.client.1.smithi164.stdout:4/862: dwrite d4/d9/d5c/d97/dbf/d5f/ff7 [0,4194304] 0 2024-04-20T21:59:12.951 INFO:tasks.workunit.client.1.smithi164.stdout:1/866: getdents d10/d33/d41 0 2024-04-20T21:59:12.953 INFO:tasks.workunit.client.1.smithi164.stdout:9/991: unlink d3/db/d1b/d20/d3f/f7c 0 2024-04-20T21:59:12.954 INFO:tasks.workunit.client.1.smithi164.stdout:2/962: mknod d2/d5/d3a/d65/d81/dac/dd6/c139 0 2024-04-20T21:59:12.956 INFO:tasks.workunit.client.1.smithi164.stdout:9/992: stat d3/db/dd/f127 0 2024-04-20T21:59:12.956 INFO:tasks.workunit.client.1.smithi164.stdout:1/867: truncate d10/d16/d20/d25/fad 2349200 0 2024-04-20T21:59:12.959 INFO:tasks.workunit.client.1.smithi164.stdout:8/879: sync 2024-04-20T21:59:12.961 INFO:tasks.workunit.client.1.smithi164.stdout:9/993: truncate d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/dce/f147 615202 0 2024-04-20T21:59:12.965 INFO:tasks.workunit.client.1.smithi164.stdout:4/863: truncate d4/d9/d5c/d97/dbf/f82 1762723 0 2024-04-20T21:59:12.966 INFO:tasks.workunit.client.1.smithi164.stdout:0/901: dwrite d1/d4/da/fbf [0,4194304] 0 2024-04-20T21:59:12.968 INFO:tasks.workunit.client.1.smithi164.stdout:4/864: write d4/d9/d27/f10c [981358,77740] 0 2024-04-20T21:59:12.970 INFO:tasks.workunit.client.1.smithi164.stdout:2/963: creat d2/dab/df4/f13a x:0 0 0 2024-04-20T21:59:12.970 INFO:tasks.workunit.client.1.smithi164.stdout:0/902: write d1/d4/d26/fa8 [1711502,74225] 0 2024-04-20T21:59:12.977 INFO:tasks.workunit.client.1.smithi164.stdout:6/934: getdents d0/d3/d62 0 2024-04-20T21:59:12.980 INFO:tasks.workunit.client.1.smithi164.stdout:4/865: unlink d4/d9/d5c/d97/dbf/d67/d86/def/dad/la5 0 2024-04-20T21:59:12.982 INFO:tasks.workunit.client.1.smithi164.stdout:9/994: dwrite d3/db/dd/d40/d2a/d36/d51/f11e [0,4194304] 0 2024-04-20T21:59:12.993 INFO:tasks.workunit.client.1.smithi164.stdout:7/934: getdents d2/d21/d24/d31/d3a/d83/dcf/dea 0 2024-04-20T21:59:12.994 INFO:tasks.workunit.client.1.smithi164.stdout:1/868: dread d10/d16/d20/d66/fb3 [0,4194304] 0 2024-04-20T21:59:12.998 INFO:tasks.workunit.client.1.smithi164.stdout:4/866: write d4/d9/f1b [4689525,109010] 0 2024-04-20T21:59:13.000 INFO:tasks.workunit.client.1.smithi164.stdout:0/903: creat d1/d4/d20/d74/dff/f106 x:0 0 0 2024-04-20T21:59:13.003 INFO:tasks.workunit.client.1.smithi164.stdout:8/880: getdents d0 0 2024-04-20T21:59:13.004 INFO:tasks.workunit.client.1.smithi164.stdout:6/935: symlink d0/d3/d15/d21/d5c/l138 0 2024-04-20T21:59:13.006 INFO:tasks.workunit.client.1.smithi164.stdout:1/869: fsync d10/d7d/feb 0 2024-04-20T21:59:13.009 INFO:tasks.workunit.client.1.smithi164.stdout:7/935: read d2/d21/d44/fce [1038210,94290] 0 2024-04-20T21:59:13.012 INFO:tasks.workunit.client.1.smithi164.stdout:8/881: rmdir d0/d14/d16/d58/d94/da5/dad 39 2024-04-20T21:59:13.014 INFO:tasks.workunit.client.1.smithi164.stdout:8/882: chown d0/d14/d16/d58/d94/da5 26736545 1 2024-04-20T21:59:13.015 INFO:tasks.workunit.client.1.smithi164.stdout:6/936: unlink d0/d3/d15/d21/d5c/f78 0 2024-04-20T21:59:13.016 INFO:tasks.workunit.client.1.smithi164.stdout:2/964: write d2/d19/d28/d3e/f59 [1172722,94281] 0 2024-04-20T21:59:13.016 INFO:tasks.workunit.client.1.smithi164.stdout:9/995: rmdir d3/db/d1b/d20/d3f/d8a/da7/dbd/d67/d145 0 2024-04-20T21:59:13.018 INFO:tasks.workunit.client.1.smithi164.stdout:0/904: dwrite d1/d4/d20/fd5 [0,4194304] 0 2024-04-20T21:59:13.019 INFO:tasks.workunit.client.1.smithi164.stdout:2/965: chown d2/d5/d3a/d55/d58/da2/fea 1 1 2024-04-20T21:59:13.021 INFO:tasks.workunit.client.1.smithi164.stdout:4/867: getdents d4/d9/d5c/d97/dbf/d5f/d10f 0 2024-04-20T21:59:13.025 INFO:tasks.workunit.client.1.smithi164.stdout:8/883: unlink d0/d1e/l2c 0 2024-04-20T21:59:13.026 INFO:tasks.workunit.client.1.smithi164.stdout:8/884: readlink d0/d14/d16/d58/lbb 0 2024-04-20T21:59:13.026 INFO:tasks.workunit.client.1.smithi164.stdout:6/937: creat d0/d3/d11/d29/d6e/d41/f139 x:0 0 0 2024-04-20T21:59:13.030 INFO:tasks.workunit.client.1.smithi164.stdout:9/996: creat d3/db/d1b/d119/f169 x:0 0 0 2024-04-20T21:59:13.031 INFO:tasks.workunit.client.1.smithi164.stdout:1/870: creat d10/d16/d20/d91/db9/f116 x:0 0 0 2024-04-20T21:59:13.035 INFO:tasks.workunit.client.1.smithi164.stdout:0/905: rename d1/d4/d20/d74/dff to d1/d4/da/de1/d107 0 2024-04-20T21:59:13.040 INFO:tasks.workunit.client.1.smithi164.stdout:6/938: truncate d0/d3/d11/f8f 540519 0 2024-04-20T21:59:13.041 INFO:tasks.workunit.client.1.smithi164.stdout:8/885: dread d0/d14/d4e/d62/d8f/fb2 [0,4194304] 0 2024-04-20T21:59:13.041 INFO:tasks.workunit.client.1.smithi164.stdout:1/871: truncate d10/d16/fdb 161521 0 2024-04-20T21:59:13.047 INFO:tasks.workunit.client.1.smithi164.stdout:9/997: dwrite d3/db/dd/f127 [0,4194304] 0 2024-04-20T21:59:13.050 INFO:tasks.workunit.client.1.smithi164.stdout:8/886: creat d0/d14/d4e/d6f/f129 x:0 0 0 2024-04-20T21:59:13.050 INFO:tasks.workunit.client.1.smithi164.stdout:6/939: symlink d0/d3/d27/d9d/dc3/l13a 0 2024-04-20T21:59:13.056 INFO:tasks.workunit.client.1.smithi164.stdout:0/906: dwrite d1/d2b/fe4 [0,4194304] 0 2024-04-20T21:59:13.057 INFO:tasks.workunit.client.1.smithi164.stdout:2/966: dread d2/d19/f80 [0,4194304] 0 2024-04-20T21:59:13.059 INFO:tasks.workunit.client.1.smithi164.stdout:9/998: chown d3/db/dd/d40/d2a/c71 122849670 1 2024-04-20T21:59:13.062 INFO:tasks.workunit.client.1.smithi164.stdout:8/887: dread d0/f56 [0,4194304] 0 2024-04-20T21:59:13.065 INFO:tasks.workunit.client.1.smithi164.stdout:2/967: creat d2/d5f/f13b x:0 0 0 2024-04-20T21:59:13.067 INFO:tasks.workunit.client.1.smithi164.stdout:4/868: link d4/d9/f103 d4/d9/d5c/d97/dbf/d5f/dcc/deb/f116 0 2024-04-20T21:59:13.069 INFO:tasks.workunit.client.1.smithi164.stdout:1/872: write d10/fbb [236276,120037] 0 2024-04-20T21:59:13.076 INFO:tasks.workunit.client.1.smithi164.stdout:1/873: chown d10/d16/d20/d91/db9/f116 366985905 1 2024-04-20T21:59:13.080 INFO:tasks.workunit.client.1.smithi164.stdout:6/940: write d0/d3/d4a/f9f [1470500,88202] 0 2024-04-20T21:59:13.084 INFO:tasks.workunit.client.1.smithi164.stdout:6/941: fdatasync d0/d3/d11/f49 0 2024-04-20T21:59:13.085 INFO:tasks.workunit.client.1.smithi164.stdout:8/888: creat d0/d14/d16/f12a x:0 0 0 2024-04-20T21:59:13.090 INFO:tasks.workunit.client.1.smithi164.stdout:0/907: dread d1/d4/d49/f4b [0,4194304] 0 2024-04-20T21:59:13.094 INFO:tasks.workunit.client.1.smithi164.stdout:9/999: dwrite d3/db0/d132/f141 [0,4194304] 0 2024-04-20T21:59:13.095 INFO:tasks.workunit.client.1.smithi164.stdout:4/869: dwrite d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41/fe8 [0,4194304] 0 2024-04-20T21:59:13.095 INFO:tasks.workunit.client.1.smithi164.stdout:8/889: write d0/d14/d16/f26 [5113941,15487] 0 2024-04-20T21:59:13.096 INFO:tasks.workunit.client.1.smithi164.stdout:0/908: fdatasync d1/d4/d49/f4b 0 2024-04-20T21:59:13.096 INFO:tasks.workunit.client.1.smithi164.stdout:7/936: sync 2024-04-20T21:59:13.102 INFO:tasks.workunit.client.1.smithi164.stdout:2/968: dwrite d2/d19/d28/dd0/dba/d62/f135 [0,4194304] 0 2024-04-20T21:59:13.105 INFO:tasks.workunit.client.1.smithi164.stdout:6/942: rename d0/d3/d15/d21/d101/c120 to d0/d3/d15/d21/d5c/dbf/dbd/c13b 0 2024-04-20T21:59:13.105 INFO:tasks.workunit.client.1.smithi164.stdout:1/874: dread d10/d16/f43 [0,4194304] 0 2024-04-20T21:59:13.107 INFO:tasks.workunit.client.1.smithi164.stdout:1/875: dread - d10/d33/d41/ff8 zero size 2024-04-20T21:59:13.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.113+0000 7f45eb800700 1 -- 172.21.15.142:0/2252919308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45e4107260 msgr2=0x7f45e4107680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:13.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.113+0000 7f45eb800700 1 --2- 172.21.15.142:0/2252919308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45e4107260 0x7f45e4107680 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f45d8009910 tx=0x7f45d8009c20 comp rx=0 tx=0).stop 2024-04-20T21:59:13.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.116+0000 7f45eb800700 1 -- 172.21.15.142:0/2252919308 shutdown_connections 2024-04-20T21:59:13.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.116+0000 7f45eb800700 1 --2- 172.21.15.142:0/2252919308 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45e4108430 0x7f45e41088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:13.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.116+0000 7f45eb800700 1 --2- 172.21.15.142:0/2252919308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45e4107260 0x7f45e4107680 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:13.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.116+0000 7f45eb800700 1 -- 172.21.15.142:0/2252919308 >> 172.21.15.142:0/2252919308 conn(0x7f45e4076400 msgr2=0x7f45e4078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:13.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.119+0000 7f45eb800700 1 -- 172.21.15.142:0/2252919308 shutdown_connections 2024-04-20T21:59:13.119 INFO:tasks.workunit.client.1.smithi164.stdout:8/890: creat d0/d14/d16/d58/d94/da5/dad/dd3/dd4/f12b x:0 0 0 2024-04-20T21:59:13.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.119+0000 7f45eb800700 1 -- 172.21.15.142:0/2252919308 wait complete. 2024-04-20T21:59:13.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.121+0000 7f45eb800700 1 Processor -- start 2024-04-20T21:59:13.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.121+0000 7f45eb800700 1 -- start start 2024-04-20T21:59:13.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.122+0000 7f45eb800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45e4107260 0x7f45e419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:13.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.122+0000 7f45eb800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45e4108430 0x7f45e419d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:13.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.122+0000 7f45eb800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e419d880 con 0x7f45e4108430 2024-04-20T21:59:13.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.122+0000 7f45eb800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e419d9f0 con 0x7f45e4107260 2024-04-20T21:59:13.122 INFO:tasks.workunit.client.1.smithi164.stdout:2/969: dread d2/d5/f14 [4194304,4194304] 0 2024-04-20T21:59:13.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.122+0000 7f45e3e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45e4108430 0x7f45e419d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:13.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.123+0000 7f45e3e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45e4108430 0x7f45e419d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48764/0 (socket says 172.21.15.142:48764) 2024-04-20T21:59:13.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.123+0000 7f45e3e00700 1 -- 172.21.15.142:0/809503991 learned_addr learned my addr 172.21.15.142:0/809503991 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:59:13.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.123+0000 7f45e3e00700 1 -- 172.21.15.142:0/809503991 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45e4107260 msgr2=0x7f45e419cd40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-20T21:59:13.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.123+0000 7f45e3e00700 1 --2- 172.21.15.142:0/809503991 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45e4107260 0x7f45e419cd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:13.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.123+0000 7f45e3e00700 1 -- 172.21.15.142:0/809503991 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d80095f0 con 0x7f45e4108430 2024-04-20T21:59:13.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.124+0000 7f45e3e00700 1 --2- 172.21.15.142:0/809503991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45e4108430 0x7f45e419d280 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f45d000b770 tx=0x7f45d000bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:13.124 INFO:tasks.workunit.client.1.smithi164.stdout:6/943: dwrite d0/d3/d15/d21/d101/d3b/faa [0,4194304] 0 2024-04-20T21:59:13.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.125+0000 7f45e1600700 1 -- 172.21.15.142:0/809503991 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45d000f630 con 0x7f45e4108430 2024-04-20T21:59:13.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.125+0000 7f45eb800700 1 -- 172.21.15.142:0/809503991 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e41a23e0 con 0x7f45e4108430 2024-04-20T21:59:13.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.125+0000 7f45eb800700 1 -- 172.21.15.142:0/809503991 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e41a29b0 con 0x7f45e4108430 2024-04-20T21:59:13.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.126+0000 7f45e1600700 1 -- 172.21.15.142:0/809503991 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45d000fc50 con 0x7f45e4108430 2024-04-20T21:59:13.126 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.126+0000 7f45e1600700 1 -- 172.21.15.142:0/809503991 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45d0017e80 con 0x7f45e4108430 2024-04-20T21:59:13.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.128+0000 7f45eb800700 1 -- 172.21.15.142:0/809503991 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c4005320 con 0x7f45e4108430 2024-04-20T21:59:13.128 INFO:tasks.workunit.client.1.smithi164.stdout:7/937: rename d2/l43 to d2/d21/d24/d31/d3a/d83/d63/d85/l137 0 2024-04-20T21:59:13.128 INFO:tasks.workunit.client.1.smithi164.stdout:8/891: creat d0/d14/d4e/d6f/f12c x:0 0 0 2024-04-20T21:59:13.135 INFO:tasks.workunit.client.1.smithi164.stdout:6/944: unlink d0/d3/d15/d21/d5c/dbf/db4/lea 0 2024-04-20T21:59:13.135 INFO:tasks.workunit.client.1.smithi164.stdout:4/870: rename d4/d9/d27 to d4/d9/d117 0 2024-04-20T21:59:13.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.139+0000 7f45e1600700 1 -- 172.21.15.142:0/809503991 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 30) v1 ==== 92710+0+0 (secure 0 0 0) 0x7f45d000f790 con 0x7f45e4108430 2024-04-20T21:59:13.139 INFO:tasks.workunit.client.1.smithi164.stdout:2/970: write d2/d5/f82 [2134336,53671] 0 2024-04-20T21:59:13.140 INFO:tasks.workunit.client.1.smithi164.stdout:1/876: rename d10/d33/c42 to d10/d33/d48/d8b/de3/c117 0 2024-04-20T21:59:13.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.140+0000 7f45e1600700 1 --2- 172.21.15.142:0/809503991 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f45cc06ea70 0x7f45cc070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:13.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.143+0000 7f45e8e00700 1 --2- 172.21.15.142:0/809503991 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f45cc06ea70 0x7f45cc070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:13.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.144+0000 7f45e1600700 1 -- 172.21.15.142:0/809503991 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f45d000fdc0 con 0x7f45e4108430 2024-04-20T21:59:13.144 INFO:tasks.workunit.client.1.smithi164.stdout:4/871: dread - d4/d9/d22/f10d zero size 2024-04-20T21:59:13.144 INFO:tasks.workunit.client.1.smithi164.stdout:6/945: read - d0/d3/d4a/fdb zero size 2024-04-20T21:59:13.146 INFO:tasks.workunit.client.1.smithi164.stdout:7/938: dwrite d2/d21/d24/d31/d3a/f81 [0,4194304] 0 2024-04-20T21:59:13.148 INFO:tasks.workunit.client.1.smithi164.stdout:2/971: mkdir d2/d5/d3a/d65/d81/dac/dd6/d13c 0 2024-04-20T21:59:13.149 INFO:tasks.workunit.client.1.smithi164.stdout:8/892: dwrite d0/d14/d16/f26 [0,4194304] 0 2024-04-20T21:59:13.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.150+0000 7f45e8e00700 1 --2- 172.21.15.142:0/809503991 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f45cc06ea70 0x7f45cc070f30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f45d800b5c0 tx=0x7f45d8005fb0 comp rx=0 tx=0).ready entity=mgr.14722 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:13.151 INFO:tasks.workunit.client.1.smithi164.stdout:6/946: creat d0/d3/d11/d29/d6e/d41/f13c x:0 0 0 2024-04-20T21:59:13.152 INFO:tasks.workunit.client.1.smithi164.stdout:8/893: readlink d0/d14/d16/d58/d94/da5/dad/ld6 0 2024-04-20T21:59:13.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.154+0000 7f45e1600700 1 -- 172.21.15.142:0/809503991 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f45d005b420 con 0x7f45e4108430 2024-04-20T21:59:13.154 INFO:tasks.workunit.client.1.smithi164.stdout:4/872: unlink d4/d9/d5c/d97/dbf/d67/d86/cec 0 2024-04-20T21:59:13.159 INFO:tasks.workunit.client.1.smithi164.stdout:8/894: rmdir d0/d14 39 2024-04-20T21:59:13.159 INFO:tasks.workunit.client.1.smithi164.stdout:7/939: creat d2/d21/d24/d31/d3a/d83/dba/dbb/f138 x:0 0 0 2024-04-20T21:59:13.162 INFO:tasks.workunit.client.1.smithi164.stdout:6/947: read - d0/d3/d15/d21/d101/d45/d4f/d61/fff zero size 2024-04-20T21:59:13.163 INFO:tasks.workunit.client.1.smithi164.stdout:1/877: dwrite d10/d16/f72 [0,4194304] 0 2024-04-20T21:59:13.168 INFO:tasks.workunit.client.1.smithi164.stdout:4/873: getdents d4/d9/d5c 0 2024-04-20T21:59:13.171 INFO:tasks.workunit.client.1.smithi164.stdout:7/940: rename d2/d21/d44 to d2/d21/d24/d31/d3a/d83/dba/def/dff/d139 0 2024-04-20T21:59:13.173 INFO:tasks.workunit.client.1.smithi164.stdout:7/941: chown d2/d21/fd2 0 1 2024-04-20T21:59:13.173 INFO:tasks.workunit.client.1.smithi164.stdout:0/909: write d1/d4/d20/fc7 [799566,54504] 0 2024-04-20T21:59:13.176 INFO:tasks.workunit.client.1.smithi164.stdout:6/948: fsync d0/d3/d15/d21/d5c/dbf/dbd/ddf/d81/fa9 0 2024-04-20T21:59:13.178 INFO:tasks.workunit.client.1.smithi164.stdout:7/942: chown d2/d21/d24/d31/d3a/d83/dba/def/dff/d139/l99 120 1 2024-04-20T21:59:13.179 INFO:tasks.workunit.client.1.smithi164.stdout:0/910: write d1/d4/d26/d29/d2d/d9b/ff9 [1216674,88950] 0 2024-04-20T21:59:13.185 INFO:tasks.workunit.client.1.smithi164.stdout:0/911: read - d1/d4/d49/ff0 zero size 2024-04-20T21:59:13.187 INFO:tasks.workunit.client.1.smithi164.stdout:0/912: chown d1/d4/d49/ff0 33544 1 2024-04-20T21:59:13.187 INFO:tasks.workunit.client.1.smithi164.stdout:8/895: link d0/d14/d4e/f96 d0/d14/d16/d58/d94/da5/dad/f12d 0 2024-04-20T21:59:13.188 INFO:tasks.workunit.client.1.smithi164.stdout:6/949: mknod d0/d3/d15/d21/d100/c13d 0 2024-04-20T21:59:13.190 INFO:tasks.workunit.client.1.smithi164.stdout:8/896: readlink d0/d14/d16/d58/laa 0 2024-04-20T21:59:13.191 INFO:tasks.workunit.client.1.smithi164.stdout:7/943: mknod d2/d21/d24/d31/d3a/d83/dcf/dea/c13a 0 2024-04-20T21:59:13.198 INFO:tasks.workunit.client.1.smithi164.stdout:8/897: creat d0/d14/db4/f12e x:0 0 0 2024-04-20T21:59:13.206 INFO:tasks.workunit.client.1.smithi164.stdout:1/878: dread d10/d33/d48/f4b [0,4194304] 0 2024-04-20T21:59:13.208 INFO:tasks.workunit.client.1.smithi164.stdout:0/913: dwrite d1/d4/da/de1/fe7 [0,4194304] 0 2024-04-20T21:59:13.212 INFO:tasks.workunit.client.1.smithi164.stdout:1/879: truncate d10/d33/d4d/fed 1038284 0 2024-04-20T21:59:13.212 INFO:tasks.workunit.client.1.smithi164.stdout:8/898: unlink d0/d14/d4e/l65 0 2024-04-20T21:59:13.213 INFO:tasks.workunit.client.1.smithi164.stdout:4/874: write d4/f78 [348473,42168] 0 2024-04-20T21:59:13.218 INFO:tasks.workunit.client.1.smithi164.stdout:8/899: stat d0/d1e/f88 0 2024-04-20T21:59:13.219 INFO:tasks.workunit.client.1.smithi164.stdout:7/944: dwrite d2/d21/d24/d31/d3a/d83/dba/def/dff/d139/f129 [0,4194304] 0 2024-04-20T21:59:13.221 INFO:tasks.workunit.client.1.smithi164.stdout:0/914: chown d1/d4/da/d5c/d6e/f96 4 1 2024-04-20T21:59:13.222 INFO:tasks.workunit.client.1.smithi164.stdout:1/880: rename d10/d33/d48/f6b to d10/d33/d48/d8b/de3/df3/f118 0 2024-04-20T21:59:13.226 INFO:tasks.workunit.client.1.smithi164.stdout:0/915: write d1/d2b/f6b [8244812,75365] 0 2024-04-20T21:59:13.229 INFO:tasks.workunit.client.1.smithi164.stdout:2/972: dwrite d2/f9c [0,4194304] 0 2024-04-20T21:59:13.229 INFO:tasks.workunit.client.1.smithi164.stdout:4/875: creat d4/d9/d5c/d97/dbf/d67/d86/dc3/f118 x:0 0 0 2024-04-20T21:59:13.229 INFO:tasks.workunit.client.1.smithi164.stdout:7/945: unlink d2/d21/f89 0 2024-04-20T21:59:13.234 INFO:tasks.workunit.client.1.smithi164.stdout:8/900: chown d0/d14/d4e/l68 498 1 2024-04-20T21:59:13.237 INFO:tasks.workunit.client.1.smithi164.stdout:4/876: chown d4/d9/d5c/d97/dbf/d9b/fa7 1563 1 2024-04-20T21:59:13.239 INFO:tasks.workunit.client.1.smithi164.stdout:4/877: stat d4/d9/d22/f52 0 2024-04-20T21:59:13.239 INFO:tasks.workunit.client.1.smithi164.stdout:6/950: write d0/d3/d15/d21/d101/d3b/f57 [90367,62740] 0 2024-04-20T21:59:13.240 INFO:tasks.workunit.client.1.smithi164.stdout:4/878: chown f3 1153981 1 2024-04-20T21:59:13.246 INFO:tasks.workunit.client.1.smithi164.stdout:2/973: dread d2/d5f/fe1 [0,4194304] 0 2024-04-20T21:59:13.249 INFO:tasks.workunit.client.1.smithi164.stdout:7/946: dwrite d2/d21/fc1 [0,4194304] 0 2024-04-20T21:59:13.265 INFO:tasks.workunit.client.1.smithi164.stdout:4/879: mkdir d4/d108/d119 0 2024-04-20T21:59:13.266 INFO:tasks.workunit.client.1.smithi164.stdout:6/951: link d0/d3/d27/f43 d0/d3/d15/d21/d5c/dbf/db4/f13e 0 2024-04-20T21:59:13.273 INFO:tasks.workunit.client.1.smithi164.stdout:2/974: dread d2/d5/d3a/d55/d58/da2/dcc/fdd [0,4194304] 0 2024-04-20T21:59:13.281 INFO:tasks.workunit.client.1.smithi164.stdout:4/880: dwrite d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41/fa0 [0,4194304] 0 2024-04-20T21:59:13.282 INFO:tasks.workunit.client.1.smithi164.stdout:0/916: dread d1/d4/d26/d29/d2d/d54/d77/f5d [0,4194304] 0 2024-04-20T21:59:13.310 INFO:tasks.workunit.client.1.smithi164.stdout:1/881: getdents d10/d33/d48/de6 0 2024-04-20T21:59:13.315 INFO:tasks.workunit.client.1.smithi164.stdout:4/881: unlink d4/d9/d5c/d97/dbf/d5f/ff7 0 2024-04-20T21:59:13.316 INFO:tasks.workunit.client.1.smithi164.stdout:0/917: creat d1/d4/df/dbe/f108 x:0 0 0 2024-04-20T21:59:13.320 INFO:tasks.workunit.client.1.smithi164.stdout:6/952: symlink d0/d3/d11/d29/dce/l13f 0 2024-04-20T21:59:13.321 INFO:tasks.workunit.client.1.smithi164.stdout:7/947: rename d2/d21/d24/d31/d3a/d83/dcf/dea/d107/d111 to d2/d21/d33/d13b 0 2024-04-20T21:59:13.325 INFO:tasks.workunit.client.1.smithi164.stdout:4/882: chown d4/d9/l21 60089838 1 2024-04-20T21:59:13.326 INFO:tasks.workunit.client.1.smithi164.stdout:6/953: fsync d0/d3/d27/fd3 0 2024-04-20T21:59:13.331 INFO:tasks.workunit.client.1.smithi164.stdout:1/882: dread d10/d16/d20/f38 [0,4194304] 0 2024-04-20T21:59:13.332 INFO:tasks.workunit.client.1.smithi164.stdout:4/883: symlink d4/d9/d5c/d97/dbf/d67/d86/l11a 0 2024-04-20T21:59:13.333 INFO:tasks.workunit.client.1.smithi164.stdout:7/948: rename d2/d21/f80 to d2/d21/df0/f13c 0 2024-04-20T21:59:13.334 INFO:tasks.workunit.client.1.smithi164.stdout:0/918: dwrite d1/d4/d26/d29/d2d/d54/d97/fe8 [0,4194304] 0 2024-04-20T21:59:13.336 INFO:tasks.workunit.client.1.smithi164.stdout:6/954: fsync d0/d3/d15/d21/d101/f48 0 2024-04-20T21:59:13.337 INFO:tasks.workunit.client.1.smithi164.stdout:0/919: chown d1/d4/da/d27/f7c 16224146 1 2024-04-20T21:59:13.337 INFO:tasks.workunit.client.1.smithi164.stdout:7/949: chown d2/d21/d24/d31/d3a/d83/f96 132930864 1 2024-04-20T21:59:13.339 INFO:tasks.workunit.client.1.smithi164.stdout:0/920: chown d1/d4/d20/d74/lb7 256 1 2024-04-20T21:59:13.341 INFO:tasks.workunit.client.1.smithi164.stdout:2/975: write d2/f8f [1017953,10902] 0 2024-04-20T21:59:13.341 INFO:tasks.workunit.client.1.smithi164.stdout:6/955: truncate d0/d3/d15/d21/d101/d3b/faa 5117938 0 2024-04-20T21:59:13.346 INFO:tasks.workunit.client.1.smithi164.stdout:4/884: rename d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41/ff8 to d4/d9/d5c/d97/daa/f11b 0 2024-04-20T21:59:13.348 INFO:tasks.workunit.client.1.smithi164.stdout:8/901: sync 2024-04-20T21:59:13.349 INFO:tasks.workunit.client.1.smithi164.stdout:0/921: fsync d1/d4/d26/d29/d2d/ff4 0 2024-04-20T21:59:13.353 INFO:tasks.workunit.client.1.smithi164.stdout:2/976: creat d2/d30/de8/f13d x:0 0 0 2024-04-20T21:59:13.356 INFO:tasks.workunit.client.1.smithi164.stdout:2/977: write d2/d19/d28/f38 [214742,27876] 0 2024-04-20T21:59:13.356 INFO:tasks.workunit.client.1.smithi164.stdout:6/956: creat d0/d3/d15/d21/d5c/dbf/dbd/ddf/d81/f140 x:0 0 0 2024-04-20T21:59:13.359 INFO:tasks.workunit.client.1.smithi164.stdout:6/957: write d0/d3/d11/d29/d6e/d41/f139 [550625,118603] 0 2024-04-20T21:59:13.366 INFO:tasks.workunit.client.1.smithi164.stdout:8/902: mknod d0/d14/d16/d58/d94/da5/dad/d116/c12f 0 2024-04-20T21:59:13.367 INFO:tasks.workunit.client.1.smithi164.stdout:1/883: truncate d10/d16/d20/f38 2988526 0 2024-04-20T21:59:13.368 INFO:tasks.workunit.client.1.smithi164.stdout:0/922: write d1/d4/df/fd7 [2401941,4553] 0 2024-04-20T21:59:13.372 INFO:tasks.workunit.client.1.smithi164.stdout:2/978: rename d2/d19/f77 to d2/d5/d3a/d12f/f13e 0 2024-04-20T21:59:13.374 INFO:tasks.workunit.client.1.smithi164.stdout:4/885: link d4/d9/d5c/d97/dbf/d67/d86/ff2 d4/d9/d22/d10b/f11c 0 2024-04-20T21:59:13.375 INFO:tasks.workunit.client.1.smithi164.stdout:6/958: mknod d0/d3/d15/d21/d5c/dbf/db4/c141 0 2024-04-20T21:59:13.376 INFO:tasks.workunit.client.1.smithi164.stdout:8/903: dread - d0/fe7 zero size 2024-04-20T21:59:13.377 INFO:tasks.workunit.client.1.smithi164.stdout:1/884: symlink d10/d16/d19/de0/d34/l119 0 2024-04-20T21:59:13.378 INFO:tasks.workunit.client.1.smithi164.stdout:7/950: dwrite d2/d21/d33/f9c [0,4194304] 0 2024-04-20T21:59:13.379 INFO:tasks.workunit.client.1.smithi164.stdout:8/904: dread - d0/d14/d16/d9d/faf zero size 2024-04-20T21:59:13.379 INFO:tasks.workunit.client.1.smithi164.stdout:0/923: chown d1/d4/df/dbe/lfb 97378324 1 2024-04-20T21:59:13.381 INFO:tasks.workunit.client.1.smithi164.stdout:2/979: mknod d2/d5/d3a/d55/d58/da2/dcc/c13f 0 2024-04-20T21:59:13.384 INFO:tasks.workunit.client.1.smithi164.stdout:1/885: creat d10/d16/d19/de0/d34/f11a x:0 0 0 2024-04-20T21:59:13.386 INFO:tasks.workunit.client.1.smithi164.stdout:8/905: symlink d0/d14/db4/l130 0 2024-04-20T21:59:13.388 INFO:tasks.workunit.client.1.smithi164.stdout:2/980: unlink d2/d19/l1f 0 2024-04-20T21:59:13.388 INFO:tasks.workunit.client.1.smithi164.stdout:8/906: stat d0/d14/d16/d58/f74 0 2024-04-20T21:59:13.390 INFO:tasks.workunit.client.1.smithi164.stdout:1/886: creat d10/d16/d20/d25/d95/dd9/f11b x:0 0 0 2024-04-20T21:59:13.392 INFO:tasks.workunit.client.1.smithi164.stdout:0/924: creat d1/d4/f109 x:0 0 0 2024-04-20T21:59:13.398 INFO:tasks.workunit.client.1.smithi164.stdout:7/951: rename d2/d21/d24/d31/d3a/d83/dba/def/dff/d139/l99 to d2/l13d 0 2024-04-20T21:59:13.402 INFO:tasks.workunit.client.1.smithi164.stdout:0/925: mkdir d1/d4/d26/d29/d2d/d54/d77/db3/d10a 0 2024-04-20T21:59:13.403 INFO:tasks.workunit.client.1.smithi164.stdout:8/907: write d0/d14/d4e/d86/fd1 [366393,85994] 0 2024-04-20T21:59:13.403 INFO:tasks.workunit.client.1.smithi164.stdout:6/959: rename d0/d3/d15/d21/d4b/f4e to d0/d3/d15/d21/d5c/df4/f142 0 2024-04-20T21:59:13.407 INFO:tasks.workunit.client.1.smithi164.stdout:0/926: chown d1/d4/df/d56/ld3 67117 1 2024-04-20T21:59:13.408 INFO:tasks.workunit.client.1.smithi164.stdout:6/960: readlink d0/d3/d15/d21/d5c/dbf/dbd/ddf/d28/l77 0 2024-04-20T21:59:13.411 INFO:tasks.workunit.client.1.smithi164.stdout:0/927: truncate d1/d4/da/d5c/fd4 1545527 0 2024-04-20T21:59:13.412 INFO:tasks.workunit.client.1.smithi164.stdout:7/952: creat d2/d21/d24/d31/d3a/d83/dba/def/dff/d139/dd4/f13e x:0 0 0 2024-04-20T21:59:13.414 INFO:tasks.workunit.client.1.smithi164.stdout:8/908: readlink d0/d14/d4e/d62/d8f/l100 0 2024-04-20T21:59:13.414 INFO:tasks.workunit.client.1.smithi164.stdout:2/981: dwrite d2/d5/f1d [0,4194304] 0 2024-04-20T21:59:13.416 INFO:tasks.workunit.client.1.smithi164.stdout:1/887: rename d10/d33/d48/de6/cf1 to d10/d16/d20/d91/db9/c11c 0 2024-04-20T21:59:13.416 INFO:tasks.workunit.client.1.smithi164.stdout:4/886: dread d4/d9/d5c/d97/dbf/d67/fc1 [0,4194304] 0 2024-04-20T21:59:13.417 INFO:tasks.workunit.client.1.smithi164.stdout:6/961: fsync d0/d3/d27/feb 0 2024-04-20T21:59:13.424 INFO:tasks.workunit.client.1.smithi164.stdout:2/982: chown d2/d5/c7c 95477 1 2024-04-20T21:59:13.427 INFO:tasks.workunit.client.1.smithi164.stdout:7/953: dwrite d2/d21/f25 [0,4194304] 0 2024-04-20T21:59:13.433 INFO:tasks.workunit.client.1.smithi164.stdout:6/962: creat d0/d3/d15/d21/db1/f143 x:0 0 0 2024-04-20T21:59:13.438 INFO:tasks.workunit.client.1.smithi164.stdout:2/983: creat d2/dab/f140 x:0 0 0 2024-04-20T21:59:13.443 INFO:tasks.workunit.client.1.smithi164.stdout:6/963: chown d0/d3/cbc 109278 1 2024-04-20T21:59:13.445 INFO:tasks.workunit.client.1.smithi164.stdout:6/964: dread - d0/d3/d15/d21/d5c/dbf/dbd/ddf/d81/f140 zero size 2024-04-20T21:59:13.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:13 smithi142 ceph-mon[15828]: Reconfiguring daemon prometheus.smithi142 on smithi142 2024-04-20T21:59:13.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:13 smithi142 ceph-mon[15828]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:59:13.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:13 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/1719362651' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T21:59:13.446 INFO:tasks.workunit.client.1.smithi164.stdout:0/928: creat d1/d4/d26/d29/d2d/d54/d77/f10b x:0 0 0 2024-04-20T21:59:13.447 INFO:tasks.workunit.client.1.smithi164.stdout:6/965: stat d0/d3/d15/d21/d101/d45/d69/d134/fac 0 2024-04-20T21:59:13.448 INFO:tasks.workunit.client.1.smithi164.stdout:4/887: creat d4/d9/d22/f11d x:0 0 0 2024-04-20T21:59:13.453 INFO:tasks.workunit.client.1.smithi164.stdout:7/954: creat d2/d21/d24/d31/d3a/d83/d6a/f13f x:0 0 0 2024-04-20T21:59:13.453 INFO:tasks.workunit.client.1.smithi164.stdout:0/929: symlink d1/d4/d26/d29/d2d/d54/l10c 0 2024-04-20T21:59:13.454 INFO:tasks.workunit.client.1.smithi164.stdout:6/966: mknod d0/d3/d11/d29/dce/c144 0 2024-04-20T21:59:13.456 INFO:tasks.workunit.client.1.smithi164.stdout:2/984: mknod d2/d5/d3a/d65/d81/dac/dd6/d13c/c141 0 2024-04-20T21:59:13.457 INFO:tasks.workunit.client.1.smithi164.stdout:4/888: chown d4/d9/d42/f114 51 1 2024-04-20T21:59:13.457 INFO:tasks.workunit.client.1.smithi164.stdout:0/930: write d1/d4/da/d5c/d6e/f103 [151743,86155] 0 2024-04-20T21:59:13.458 INFO:tasks.workunit.client.1.smithi164.stdout:1/888: rmdir d10/d33/d48/de6 0 2024-04-20T21:59:13.460 INFO:tasks.workunit.client.1.smithi164.stdout:8/909: dwrite d0/d14/d4e/fa1 [0,4194304] 0 2024-04-20T21:59:13.460 INFO:tasks.workunit.client.1.smithi164.stdout:2/985: stat d2/d19/d28/d3e/d9e/fc8 0 2024-04-20T21:59:13.461 INFO:tasks.workunit.client.1.smithi164.stdout:1/889: fsync d10/d33/d41/f100 0 2024-04-20T21:59:13.463 INFO:tasks.workunit.client.1.smithi164.stdout:1/890: dread - d10/d33/d41/f93 zero size 2024-04-20T21:59:13.464 INFO:tasks.workunit.client.1.smithi164.stdout:7/955: mkdir d2/d21/d24/d31/d3a/d83/dcf/dea/d107/d140 0 2024-04-20T21:59:13.469 INFO:tasks.workunit.client.1.smithi164.stdout:0/931: unlink d1/d4/f7e 0 2024-04-20T21:59:13.472 INFO:tasks.workunit.client.1.smithi164.stdout:6/967: write d0/d3/d27/feb [789868,35247] 0 2024-04-20T21:59:13.473 INFO:tasks.workunit.client.1.smithi164.stdout:8/910: chown d0/d14/d4e/d6f/f10e 0 1 2024-04-20T21:59:13.473 INFO:tasks.workunit.client.1.smithi164.stdout:2/986: rename d2/d30/cff to d2/d19/da6/c142 0 2024-04-20T21:59:13.475 INFO:tasks.workunit.client.1.smithi164.stdout:8/911: dread - d0/d14/d4e/d6f/f10e zero size 2024-04-20T21:59:13.476 INFO:tasks.workunit.client.1.smithi164.stdout:4/889: mknod d4/d9/d5c/d97/dbf/d67/d86/dc3/dc6/c11e 0 2024-04-20T21:59:13.476 INFO:tasks.workunit.client.1.smithi164.stdout:6/968: read - d0/d3/d15/d21/d5c/dbf/dbd/ddf/d81/fc2 zero size 2024-04-20T21:59:13.476 INFO:tasks.workunit.client.1.smithi164.stdout:1/891: creat d10/d16/d20/d25/d3d/f11d x:0 0 0 2024-04-20T21:59:13.477 INFO:tasks.workunit.client.1.smithi164.stdout:2/987: read d2/ff3 [3436286,19789] 0 2024-04-20T21:59:13.480 INFO:tasks.workunit.client.1.smithi164.stdout:6/969: dread - d0/d3/d11/d29/d6e/db2/df5/f126 zero size 2024-04-20T21:59:13.480 INFO:tasks.workunit.client.1.smithi164.stdout:2/988: write d2/d5f/f11a [301203,5620] 0 2024-04-20T21:59:13.482 INFO:tasks.workunit.client.1.smithi164.stdout:4/890: dread - d4/d9/d5c/d97/dbf/d67/d86/def/dad/de1/f10a zero size 2024-04-20T21:59:13.482 INFO:tasks.workunit.client.1.smithi164.stdout:1/892: chown d10/d16/d20/d25/ld8 40664 1 2024-04-20T21:59:13.483 INFO:tasks.workunit.client.1.smithi164.stdout:6/970: dread - d0/d3/d11/f11a zero size 2024-04-20T21:59:13.483 INFO:tasks.workunit.client.1.smithi164.stdout:0/932: dread d1/f3e [0,4194304] 0 2024-04-20T21:59:13.484 INFO:tasks.workunit.client.1.smithi164.stdout:2/989: write d2/dab/ffa [543978,53370] 0 2024-04-20T21:59:13.485 INFO:tasks.workunit.client.1.smithi164.stdout:8/912: rename d0/d14/d4e/d62/d82/d97/ldc to d0/d14/d16/d58/d94/da5/dad/d116/d11f/l131 0 2024-04-20T21:59:13.486 INFO:tasks.workunit.client.1.smithi164.stdout:2/990: readlink d2/d30/lb6 0 2024-04-20T21:59:13.488 INFO:tasks.workunit.client.1.smithi164.stdout:2/991: readlink d2/d5/d3a/l89 0 2024-04-20T21:59:13.491 INFO:tasks.workunit.client.1.smithi164.stdout:1/893: dread d10/d16/fc9 [0,4194304] 0 2024-04-20T21:59:13.491 INFO:tasks.workunit.client.1.smithi164.stdout:6/971: symlink d0/d3/d15/d21/d5c/df4/l145 0 2024-04-20T21:59:13.493 INFO:tasks.workunit.client.1.smithi164.stdout:0/933: dread d1/d4/f2c [0,4194304] 0 2024-04-20T21:59:13.493 INFO:tasks.workunit.client.1.smithi164.stdout:8/913: mknod d0/d14/df6/c132 0 2024-04-20T21:59:13.495 INFO:tasks.workunit.client.1.smithi164.stdout:2/992: creat d2/dab/db3/f143 x:0 0 0 2024-04-20T21:59:13.496 INFO:tasks.workunit.client.1.smithi164.stdout:1/894: creat d10/d7d/f11e x:0 0 0 2024-04-20T21:59:13.498 INFO:tasks.workunit.client.1.smithi164.stdout:6/972: creat d0/d3/d11/d29/d6e/d41/f146 x:0 0 0 2024-04-20T21:59:13.498 INFO:tasks.workunit.client.1.smithi164.stdout:8/914: dread - d0/f40 zero size 2024-04-20T21:59:13.499 INFO:tasks.workunit.client.1.smithi164.stdout:1/895: chown d10/d16/c6c 12051344 1 2024-04-20T21:59:13.500 INFO:tasks.workunit.client.1.smithi164.stdout:4/891: rename d4/d9/c13 to d4/c11f 0 2024-04-20T21:59:13.501 INFO:tasks.workunit.client.1.smithi164.stdout:1/896: dread - d10/d33/ff5 zero size 2024-04-20T21:59:13.502 INFO:tasks.workunit.client.1.smithi164.stdout:7/956: dread d2/d21/d24/d31/d3a/d83/dba/def/dff/d139/dd4/f9f [4194304,4194304] 0 2024-04-20T21:59:13.503 INFO:tasks.workunit.client.1.smithi164.stdout:6/973: symlink d0/d3/d11/d29/l147 0 2024-04-20T21:59:13.506 INFO:tasks.workunit.client.1.smithi164.stdout:1/897: dread - d10/d33/d41/f55 zero size 2024-04-20T21:59:13.506 INFO:tasks.workunit.client.1.smithi164.stdout:8/915: rename d0/d1e/l2f to d0/d14/d4e/d62/d8f/l133 0 2024-04-20T21:59:13.506 INFO:tasks.workunit.client.1.smithi164.stdout:0/934: dread d1/d4/da/d27/f32 [4194304,4194304] 0 2024-04-20T21:59:13.509 INFO:tasks.workunit.client.1.smithi164.stdout:0/935: chown d1/d4/da/de1/fe7 2296759 1 2024-04-20T21:59:13.511 INFO:tasks.workunit.client.1.smithi164.stdout:6/974: read - d0/d3/d15/d21/d5c/dbf/db4/dcd/ff7 zero size 2024-04-20T21:59:13.512 INFO:tasks.workunit.client.1.smithi164.stdout:8/916: write d0/d14/d16/dbf/fce [178133,32992] 0 2024-04-20T21:59:13.512 INFO:tasks.workunit.client.1.smithi164.stdout:1/898: truncate d10/d16/d20/f2f 3051390 0 2024-04-20T21:59:13.514 INFO:tasks.workunit.client.1.smithi164.stdout:4/892: rename d4/d9/d22/dc9 to d4/d9/d5c/d97/dbf/d67/d86/def/dad/df6/d120 0 2024-04-20T21:59:13.517 INFO:tasks.workunit.client.1.smithi164.stdout:2/993: dwrite d2/d19/d28/dd0/f12d [0,4194304] 0 2024-04-20T21:59:13.517 INFO:tasks.workunit.client.1.smithi164.stdout:8/917: stat d0/f24 0 2024-04-20T21:59:13.520 INFO:tasks.workunit.client.1.smithi164.stdout:1/899: dread - d10/d7d/fa5 zero size 2024-04-20T21:59:13.520 INFO:tasks.workunit.client.1.smithi164.stdout:6/975: read d0/d3/d15/d21/d101/f125 [104089,107936] 0 2024-04-20T21:59:13.520 INFO:tasks.workunit.client.1.smithi164.stdout:8/918: truncate d0/d1e/f44 8881033 0 2024-04-20T21:59:13.521 INFO:tasks.workunit.client.1.smithi164.stdout:4/893: creat d4/d9/d5c/d97/dbf/d5f/f121 x:0 0 0 2024-04-20T21:59:13.522 INFO:tasks.workunit.client.1.smithi164.stdout:0/936: creat d1/d4/d26/d29/d2d/f10d x:0 0 0 2024-04-20T21:59:13.524 INFO:tasks.workunit.client.1.smithi164.stdout:6/976: readlink d0/d3/d11/l85 0 2024-04-20T21:59:13.525 INFO:tasks.workunit.client.1.smithi164.stdout:2/994: mknod d2/d5/d3a/d55/d58/da2/dcc/c144 0 2024-04-20T21:59:13.526 INFO:tasks.workunit.client.1.smithi164.stdout:8/919: symlink d0/d14/d4e/d62/d8f/dbe/l134 0 2024-04-20T21:59:13.528 INFO:tasks.workunit.client.1.smithi164.stdout:4/894: unlink d4/d9/d5c/d97/daa/l109 0 2024-04-20T21:59:13.528 INFO:tasks.workunit.client.1.smithi164.stdout:6/977: stat d0/d3/d15/d21/d101/ff1 0 2024-04-20T21:59:13.528 INFO:tasks.workunit.client.1.smithi164.stdout:0/937: creat d1/d4/d26/f10e x:0 0 0 2024-04-20T21:59:13.532 INFO:tasks.workunit.client.1.smithi164.stdout:7/957: dwrite d2/d21/f7d [4194304,4194304] 0 2024-04-20T21:59:13.534 INFO:tasks.workunit.client.1.smithi164.stdout:0/938: rmdir d1/d4/da/de1 39 2024-04-20T21:59:13.537 INFO:tasks.workunit.client.1.smithi164.stdout:6/978: creat d0/d3/d11/d29/d6e/db2/df5/f148 x:0 0 0 2024-04-20T21:59:13.540 INFO:tasks.workunit.client.1.smithi164.stdout:6/979: stat d0/d3/d11/d29/d6e/d41/f146 0 2024-04-20T21:59:13.542 INFO:tasks.workunit.client.1.smithi164.stdout:4/895: dread - d4/d9/d22/f56 zero size 2024-04-20T21:59:13.544 INFO:tasks.workunit.client.1.smithi164.stdout:8/920: dwrite d0/d14/d4e/d86/f102 [0,4194304] 0 2024-04-20T21:59:13.545 INFO:tasks.workunit.client.1.smithi164.stdout:2/995: dwrite d2/d30/de8/df6/f101 [0,4194304] 0 2024-04-20T21:59:13.556 INFO:tasks.workunit.client.1.smithi164.stdout:4/896: readlink d4/d9/d42/lb0 0 2024-04-20T21:59:13.558 INFO:tasks.workunit.client.1.smithi164.stdout:1/900: dwrite d10/d33/d48/fa4 [0,4194304] 0 2024-04-20T21:59:13.560 INFO:tasks.workunit.client.1.smithi164.stdout:8/921: creat d0/d14/d16/d58/d94/da5/dad/dd3/f135 x:0 0 0 2024-04-20T21:59:13.562 INFO:tasks.workunit.client.1.smithi164.stdout:1/901: chown d10/d33/d48/d8b/c94 95 1 2024-04-20T21:59:13.563 INFO:tasks.workunit.client.1.smithi164.stdout:2/996: rename d2/l45 to d2/d5/d3a/d65/l145 0 2024-04-20T21:59:13.570 INFO:tasks.workunit.client.1.smithi164.stdout:7/958: creat d2/d21/d24/d31/d3a/d83/d63/f141 x:0 0 0 2024-04-20T21:59:13.570 INFO:tasks.workunit.client.1.smithi164.stdout:0/939: write d1/d4/df/f1a [735982,112617] 0 2024-04-20T21:59:13.574 INFO:tasks.workunit.client.1.smithi164.stdout:4/897: truncate d4/f39 1833452 0 2024-04-20T21:59:13.576 INFO:tasks.workunit.client.1.smithi164.stdout:4/898: fdatasync d4/d9/d5c/d97/dbf/d67/d86/dc3/f118 0 2024-04-20T21:59:13.578 INFO:tasks.workunit.client.1.smithi164.stdout:1/902: dread - d10/d33/d48/d8b/fa3 zero size 2024-04-20T21:59:13.579 INFO:tasks.workunit.client.1.smithi164.stdout:4/899: write d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41/fa0 [4084515,26204] 0 2024-04-20T21:59:13.580 INFO:tasks.workunit.client.1.smithi164.stdout:2/997: mknod d2/d19/da6/c146 0 2024-04-20T21:59:13.582 INFO:tasks.workunit.client.1.smithi164.stdout:0/940: write d1/d4/da/d27/f90 [302907,79845] 0 2024-04-20T21:59:13.582 INFO:tasks.workunit.client.1.smithi164.stdout:8/922: creat d0/d14/d16/d58/d128/f136 x:0 0 0 2024-04-20T21:59:13.582 INFO:tasks.workunit.client.1.smithi164.stdout:4/900: read d4/d9/d117/f32 [1396334,55650] 0 2024-04-20T21:59:13.584 INFO:tasks.workunit.client.1.smithi164.stdout:8/923: fsync d0/d14/d16/f6a 0 2024-04-20T21:59:13.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.585+0000 7f45eb800700 1 -- 172.21.15.142:0/809503991 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f45c40058a0 con 0x7f45e4108430 2024-04-20T21:59:13.585 INFO:tasks.workunit.client.1.smithi164.stdout:4/901: write d4/d9/d117/f48 [2133999,69191] 0 2024-04-20T21:59:13.585 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.586+0000 7f45e1600700 1 -- 172.21.15.142:0/809503991 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1853 (secure 0 0 0) 0x7f45d005afb0 con 0x7f45e4108430 2024-04-20T21:59:13.585 INFO:teuthology.orchestra.run.smithi142.stdout:e12 2024-04-20T21:59:13.586 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T21:59:13.586 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:59:13.586 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T21:59:13.586 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:59:13.586 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T21:59:13.586 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T21:59:13.586 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 12 2024-04-20T21:59:13.586 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T21:59:13.586 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T21:59:13.586 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:51.692699+0000 2024-04-20T21:59:13.586 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T21:59:13.586 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T21:59:13.586 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T21:59:13.587 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T21:59:13.587 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T21:59:13.587 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T21:59:13.587 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T21:59:13.587 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T21:59:13.587 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T21:59:13.587 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:59:13.587 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T21:59:13.587 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T21:59:13.587 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T21:59:13.587 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T21:59:13.587 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T21:59:13.587 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T21:59:13.587 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T21:59:13.587 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T21:59:13.587 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T21:59:13.588 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T21:59:13.588 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T21:59:13.588 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T21:59:13.588 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:59:13.588 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:59:13.588 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:59:13.588 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T21:59:13.588 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:59:13.588 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:59:13.588 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:59:13.588 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:59:13.589 INFO:tasks.workunit.client.1.smithi164.stdout:0/941: chown d1/d4/da/d5c/d6e/f96 849208 1 2024-04-20T21:59:13.589 INFO:tasks.workunit.client.1.smithi164.stdout:7/959: getdents d2/d21/d24/d31/d3a/d83/dba/def/dff 0 2024-04-20T21:59:13.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.590+0000 7f45eb800700 1 -- 172.21.15.142:0/809503991 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f45cc06ea70 msgr2=0x7f45cc070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:13.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.590+0000 7f45eb800700 1 --2- 172.21.15.142:0/809503991 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f45cc06ea70 0x7f45cc070f30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f45d800b5c0 tx=0x7f45d8005fb0 comp rx=0 tx=0).stop 2024-04-20T21:59:13.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.590+0000 7f45eb800700 1 -- 172.21.15.142:0/809503991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45e4108430 msgr2=0x7f45e419d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:13.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.590+0000 7f45eb800700 1 --2- 172.21.15.142:0/809503991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45e4108430 0x7f45e419d280 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f45d000b770 tx=0x7f45d000bb30 comp rx=0 tx=0).stop 2024-04-20T21:59:13.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.591+0000 7f45eb800700 1 -- 172.21.15.142:0/809503991 shutdown_connections 2024-04-20T21:59:13.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.591+0000 7f45eb800700 1 --2- 172.21.15.142:0/809503991 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f45cc06ea70 0x7f45cc070f30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:13.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.591+0000 7f45eb800700 1 --2- 172.21.15.142:0/809503991 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45e4107260 0x7f45e419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:13.590 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.591+0000 7f45eb800700 1 --2- 172.21.15.142:0/809503991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45e4108430 0x7f45e419d280 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:13.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.591+0000 7f45eb800700 1 -- 172.21.15.142:0/809503991 >> 172.21.15.142:0/809503991 conn(0x7f45e4076400 msgr2=0x7f45e410ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:13.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.591+0000 7f45eb800700 1 -- 172.21.15.142:0/809503991 shutdown_connections 2024-04-20T21:59:13.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.591+0000 7f45eb800700 1 -- 172.21.15.142:0/809503991 wait complete. 2024-04-20T21:59:13.591 INFO:tasks.workunit.client.1.smithi164.stdout:8/924: creat d0/d14/dee/f137 x:0 0 0 2024-04-20T21:59:13.591 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T21:59:13.593 INFO:tasks.workunit.client.1.smithi164.stdout:7/960: symlink d2/d21/d24/d31/d3a/d83/dba/def/dff/d139/dd4/d9e/de9/l142 0 2024-04-20T21:59:13.600 INFO:tasks.workunit.client.1.smithi164.stdout:7/961: fsync d2/d21/d24/d31/d3a/d83/fbd 0 2024-04-20T21:59:13.601 INFO:tasks.workunit.client.1.smithi164.stdout:8/925: truncate d0/db7/fcd 466240 0 2024-04-20T21:59:13.603 INFO:tasks.workunit.client.1.smithi164.stdout:7/962: chown d2/d21/d24/f30 33933412 1 2024-04-20T21:59:13.603 INFO:tasks.workunit.client.1.smithi164.stdout:0/942: dwrite d1/d4/d26/fa8 [0,4194304] 0 2024-04-20T21:59:13.604 INFO:tasks.workunit.client.1.smithi164.stdout:4/902: write d4/d9/fc [2330549,1231] 0 2024-04-20T21:59:13.605 INFO:tasks.workunit.client.1.smithi164.stdout:8/926: fdatasync d0/d14/d16/d58/f74 0 2024-04-20T21:59:13.613 INFO:tasks.workunit.client.1.smithi164.stdout:1/903: dwrite d10/d16/d20/f2f [0,4194304] 0 2024-04-20T21:59:13.613 INFO:tasks.workunit.client.1.smithi164.stdout:4/903: read d4/d9/d5c/d97/dbf/d5f/ff1 [13970,32781] 0 2024-04-20T21:59:13.620 INFO:tasks.workunit.client.1.smithi164.stdout:1/904: creat d10/d16/d19/d1a/d51/d85/f11f x:0 0 0 2024-04-20T21:59:13.693 INFO:tasks.workunit.client.1.smithi164.stdout:7/963: dwrite d2/d21/d24/d31/d3a/d83/d6a/f13f [0,4194304] 0 2024-04-20T21:59:13.694 INFO:tasks.workunit.client.1.smithi164.stdout:0/943: dwrite d1/d4/f2c [0,4194304] 0 2024-04-20T21:59:13.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:13 smithi164 ceph-mon[23506]: Reconfiguring daemon prometheus.smithi142 on smithi142 2024-04-20T21:59:13.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:13 smithi164 ceph-mon[23506]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:59:13.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:13 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/1719362651' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T21:59:13.696 INFO:tasks.workunit.client.1.smithi164.stdout:0/944: readlink d1/d4/d26/l3a 0 2024-04-20T21:59:13.697 INFO:tasks.workunit.client.1.smithi164.stdout:0/945: readlink d1/d4/d26/lec 0 2024-04-20T21:59:13.699 INFO:tasks.workunit.client.1.smithi164.stdout:1/905: link c8 d10/d33/d41/c120 0 2024-04-20T21:59:13.701 INFO:tasks.workunit.client.1.smithi164.stdout:4/904: write d4/f39 [1792036,29007] 0 2024-04-20T21:59:13.702 INFO:tasks.workunit.client.1.smithi164.stdout:0/946: truncate d1/d4/df/dbe/f108 42563 0 2024-04-20T21:59:13.705 INFO:tasks.workunit.client.1.smithi164.stdout:1/906: fdatasync d10/d33/d41/f93 0 2024-04-20T21:59:13.706 INFO:tasks.workunit.client.1.smithi164.stdout:0/947: write d1/d4/d49/f101 [950073,95663] 0 2024-04-20T21:59:13.707 INFO:tasks.workunit.client.1.smithi164.stdout:0/948: fdatasync d1/f42 0 2024-04-20T21:59:13.709 INFO:tasks.workunit.client.1.smithi164.stdout:0/949: write d1/f3e [3380994,52796] 0 2024-04-20T21:59:13.710 INFO:tasks.workunit.client.1.smithi164.stdout:4/905: mknod d4/d9/d5c/d97/dbf/d5f/d10f/c122 0 2024-04-20T21:59:13.712 INFO:tasks.workunit.client.1.smithi164.stdout:1/907: unlink d10/d16/d20/d25/d95/dd9/lf4 0 2024-04-20T21:59:13.715 INFO:tasks.workunit.client.1.smithi164.stdout:1/908: dread - d10/d33/ffd zero size 2024-04-20T21:59:13.716 INFO:tasks.workunit.client.1.smithi164.stdout:7/964: getdents d2/d21/d33 0 2024-04-20T21:59:13.719 INFO:tasks.workunit.client.1.smithi164.stdout:7/965: chown d2/d21/d24/d31/d3a/d83/fbd 3 1 2024-04-20T21:59:13.720 INFO:tasks.workunit.client.1.smithi164.stdout:0/950: mkdir d1/d4/d26/d29/d10f 0 2024-04-20T21:59:13.721 INFO:tasks.workunit.client.1.smithi164.stdout:1/909: symlink d10/d16/d20/dbf/l121 0 2024-04-20T21:59:13.721 INFO:tasks.workunit.client.1.smithi164.stdout:4/906: creat d4/d9/d5c/d97/dbf/d67/d86/def/d3e/dde/f123 x:0 0 0 2024-04-20T21:59:13.723 INFO:tasks.workunit.client.1.smithi164.stdout:1/910: readlink d10/d16/d19/d1a/lbd 0 2024-04-20T21:59:13.723 INFO:tasks.workunit.client.1.smithi164.stdout:7/966: dread - d2/d21/d24/d31/d3a/d83/dba/def/dff/d139/dd4/f13e zero size 2024-04-20T21:59:13.724 INFO:tasks.workunit.client.1.smithi164.stdout:4/907: unlink d4/f78 0 2024-04-20T21:59:13.727 INFO:tasks.workunit.client.1.smithi164.stdout:1/911: read d10/d16/d19/d1a/fde [3481046,2346] 0 2024-04-20T21:59:13.727 INFO:tasks.workunit.client.1.smithi164.stdout:4/908: creat d4/d9/d42/f124 x:0 0 0 2024-04-20T21:59:13.729 INFO:tasks.workunit.client.1.smithi164.stdout:1/912: dread - d10/d7d/f107 zero size 2024-04-20T21:59:13.731 INFO:tasks.workunit.client.1.smithi164.stdout:7/967: write d2/d21/d24/d31/d3a/d83/dba/def/dff/d139/dd4/f76 [7155673,51240] 0 2024-04-20T21:59:13.734 INFO:tasks.workunit.client.1.smithi164.stdout:1/913: mknod d10/d16/d19/d1a/dff/c122 0 2024-04-20T21:59:13.738 INFO:tasks.workunit.client.1.smithi164.stdout:7/968: creat d2/d21/d24/d31/d3a/d83/dba/f143 x:0 0 0 2024-04-20T21:59:13.742 INFO:tasks.workunit.client.1.smithi164.stdout:1/914: creat d10/d16/f123 x:0 0 0 2024-04-20T21:59:13.743 INFO:tasks.workunit.client.1.smithi164.stdout:6/980: sync 2024-04-20T21:59:13.744 INFO:tasks.workunit.client.1.smithi164.stdout:7/969: chown d2/d21/d24/d31/d3a/d83/d63/d85/l137 228 1 2024-04-20T21:59:13.748 INFO:tasks.workunit.client.1.smithi164.stdout:7/970: chown d2/d21/d24/d31/d3a/d83/d63 20441869 1 2024-04-20T21:59:13.752 INFO:tasks.workunit.client.1.smithi164.stdout:7/971: write d2/d21/d24/d31/d3a/d83/dba/dbb/f138 [569323,38700] 0 2024-04-20T21:59:13.752 INFO:tasks.workunit.client.1.smithi164.stdout:1/915: rename d10/d16/d20/d25/d95/l108 to d10/d16/d20/d81/l124 0 2024-04-20T21:59:13.753 INFO:tasks.workunit.client.1.smithi164.stdout:4/909: dread d4/d9/d5c/d97/dbf/f63 [0,4194304] 0 2024-04-20T21:59:13.755 INFO:tasks.workunit.client.1.smithi164.stdout:1/916: rmdir d10/d33/d48 39 2024-04-20T21:59:13.758 INFO:tasks.workunit.client.1.smithi164.stdout:1/917: mknod d10/d16/d20/d91/c125 0 2024-04-20T21:59:13.761 INFO:tasks.workunit.client.1.smithi164.stdout:1/918: write d10/d33/d48/fa4 [4486506,25211] 0 2024-04-20T21:59:13.775 INFO:tasks.workunit.client.1.smithi164.stdout:1/919: write d10/d16/d20/d25/d3d/fbc [868564,57985] 0 2024-04-20T21:59:13.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.796+0000 7fc71f200700 1 -- 172.21.15.142:0/1645334057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc718103e30 msgr2=0x7fc718104290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:13.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.796+0000 7fc71f200700 1 --2- 172.21.15.142:0/1645334057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc718103e30 0x7fc718104290 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc708009910 tx=0x7fc708009c20 comp rx=0 tx=0).stop 2024-04-20T21:59:13.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.797+0000 7fc71f200700 1 -- 172.21.15.142:0/1645334057 shutdown_connections 2024-04-20T21:59:13.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.797+0000 7fc71f200700 1 --2- 172.21.15.142:0/1645334057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc718103e30 0x7fc718104290 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:13.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.797+0000 7fc71f200700 1 --2- 172.21.15.142:0/1645334057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc718102c30 0x7fc718103050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:13.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.797+0000 7fc71f200700 1 -- 172.21.15.142:0/1645334057 >> 172.21.15.142:0/1645334057 conn(0x7fc7180fe210 msgr2=0x7fc718100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:13.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.797+0000 7fc71f200700 1 -- 172.21.15.142:0/1645334057 shutdown_connections 2024-04-20T21:59:13.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.797+0000 7fc71f200700 1 -- 172.21.15.142:0/1645334057 wait complete. 2024-04-20T21:59:13.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.798+0000 7fc71f200700 1 Processor -- start 2024-04-20T21:59:13.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.798+0000 7fc71f200700 1 -- start start 2024-04-20T21:59:13.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.799+0000 7fc71f200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc718102c30 0x7fc718198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:13.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.799+0000 7fc71f200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc718103e30 0x7fc718198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:13.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.799+0000 7fc71f200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181991b0 con 0x7fc718103e30 2024-04-20T21:59:13.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.799+0000 7fc71f200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181992f0 con 0x7fc718102c30 2024-04-20T21:59:13.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.799+0000 7fc71d400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc718103e30 0x7fc718198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:13.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.799+0000 7fc71d400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc718103e30 0x7fc718198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48770/0 (socket says 172.21.15.142:48770) 2024-04-20T21:59:13.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.799+0000 7fc71d400700 1 -- 172.21.15.142:0/2808064559 learned_addr learned my addr 172.21.15.142:0/2808064559 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:59:13.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.799+0000 7fc71de00700 1 --2- 172.21.15.142:0/2808064559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc718102c30 0x7fc718198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:13.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.800+0000 7fc71d400700 1 -- 172.21.15.142:0/2808064559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc718102c30 msgr2=0x7fc718198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:13.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.800+0000 7fc71d400700 1 --2- 172.21.15.142:0/2808064559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc718102c30 0x7fc718198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:13.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.800+0000 7fc71d400700 1 -- 172.21.15.142:0/2808064559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7080095f0 con 0x7fc718103e30 2024-04-20T21:59:13.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.800+0000 7fc71d400700 1 --2- 172.21.15.142:0/2808064559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc718103e30 0x7fc718198b90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc70800bda0 tx=0x7fc70800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:13.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.800+0000 7fc712a00700 1 -- 172.21.15.142:0/2808064559 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc70801d070 con 0x7fc718103e30 2024-04-20T21:59:13.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.800+0000 7fc712a00700 1 -- 172.21.15.142:0/2808064559 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc708005dc0 con 0x7fc718103e30 2024-04-20T21:59:13.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.800+0000 7fc712a00700 1 -- 172.21.15.142:0/2808064559 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc708021410 con 0x7fc718103e30 2024-04-20T21:59:13.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.800+0000 7fc71f200700 1 -- 172.21.15.142:0/2808064559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc71819dcf0 con 0x7fc718103e30 2024-04-20T21:59:13.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.801+0000 7fc71f200700 1 -- 172.21.15.142:0/2808064559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc71819e260 con 0x7fc718103e30 2024-04-20T21:59:13.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.802+0000 7fc71f200700 1 -- 172.21.15.142:0/2808064559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7181927b0 con 0x7fc718103e30 2024-04-20T21:59:13.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.804+0000 7fc712a00700 1 -- 172.21.15.142:0/2808064559 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 30) v1 ==== 92710+0+0 (secure 0 0 0) 0x7fc70800f7f0 con 0x7fc718103e30 2024-04-20T21:59:13.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.805+0000 7fc712a00700 1 --2- 172.21.15.142:0/2808064559 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fc70006ea70 0x7fc700070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:13.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.805+0000 7fc712a00700 1 -- 172.21.15.142:0/2808064559 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fc708090190 con 0x7fc718103e30 2024-04-20T21:59:13.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.807+0000 7fc71de00700 1 --2- 172.21.15.142:0/2808064559 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fc70006ea70 0x7fc700070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:13.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.808+0000 7fc71de00700 1 --2- 172.21.15.142:0/2808064559 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fc70006ea70 0x7fc700070f30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc70c005950 tx=0x7fc70c0058e0 comp rx=0 tx=0).ready entity=mgr.14722 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:13.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:13.809+0000 7fc712a00700 1 -- 172.21.15.142:0/2808064559 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fc70805cea0 con 0x7fc718103e30 2024-04-20T21:59:13.819 INFO:tasks.workunit.client.1.smithi164.stdout:6/981: dwrite d0/d3/d15/d21/d5c/dbf/db4/dcd/fe1 [0,4194304] 0 2024-04-20T21:59:13.820 INFO:tasks.workunit.client.1.smithi164.stdout:1/920: rename d10/d16/d20/d66 to d10/d16/d19/d126 0 2024-04-20T21:59:13.825 INFO:tasks.workunit.client.1.smithi164.stdout:6/982: mkdir d0/d3/d62/d75/d149 0 2024-04-20T21:59:13.833 INFO:tasks.workunit.client.1.smithi164.stdout:1/921: write d10/d33/f3f [1821595,24226] 0 2024-04-20T21:59:13.835 INFO:tasks.workunit.client.1.smithi164.stdout:6/983: symlink d0/d3/d15/d21/d5c/dbf/dbd/ddf/d11c/l14a 0 2024-04-20T21:59:13.835 INFO:tasks.workunit.client.1.smithi164.stdout:1/922: chown d10/d16/d20 17 1 2024-04-20T21:59:13.840 INFO:tasks.workunit.client.1.smithi164.stdout:6/984: chown d0/d3/d4a/l4c 181167 1 2024-04-20T21:59:13.842 INFO:tasks.workunit.client.1.smithi164.stdout:1/923: mknod d10/d16/d19/d1a/d51/c127 0 2024-04-20T21:59:13.846 INFO:tasks.workunit.client.1.smithi164.stdout:1/924: readlink d10/d16/d20/d25/d95/lc1 0 2024-04-20T21:59:13.848 INFO:tasks.workunit.client.1.smithi164.stdout:2/998: sync 2024-04-20T21:59:13.848 INFO:tasks.workunit.client.1.smithi164.stdout:1/925: readlink d10/d16/d19/d1a/lbd 0 2024-04-20T21:59:13.857 INFO:tasks.workunit.client.1.smithi164.stdout:1/926: symlink d10/d16/d20/d91/d9d/l128 0 2024-04-20T21:59:13.860 INFO:tasks.workunit.client.1.smithi164.stdout:1/927: fdatasync d10/d7d/feb 0 2024-04-20T21:59:13.861 INFO:tasks.workunit.client.1.smithi164.stdout:6/985: write d0/d3/d15/d21/d101/d45/fae [1459008,80308] 0 2024-04-20T21:59:13.864 INFO:tasks.workunit.client.1.smithi164.stdout:2/999: write d2/d5/f6d [536668,92671] 0 2024-04-20T21:59:13.868 INFO:tasks.workunit.client.1.smithi164.stdout:6/986: symlink d0/d3/d27/l14b 0 2024-04-20T21:59:13.873 INFO:tasks.workunit.client.1.smithi164.stdout:1/928: link d10/d16/d19/d1a/dff/c122 d10/d33/d48/c129 0 2024-04-20T21:59:13.888 INFO:tasks.workunit.client.1.smithi164.stdout:1/929: getdents d10/dca 0 2024-04-20T21:59:13.903 INFO:tasks.workunit.client.1.smithi164.stdout:6/987: dwrite d0/fc9 [0,4194304] 0 2024-04-20T21:59:13.907 INFO:tasks.workunit.client.1.smithi164.stdout:8/927: sync 2024-04-20T21:59:13.907 INFO:tasks.workunit.client.1.smithi164.stdout:0/951: sync 2024-04-20T21:59:13.918 INFO:tasks.workunit.client.1.smithi164.stdout:8/928: mkdir d0/db7/d138 0 2024-04-20T21:59:13.924 INFO:tasks.workunit.client.1.smithi164.stdout:6/988: creat d0/d3/d12a/f14c x:0 0 0 2024-04-20T21:59:13.929 INFO:tasks.workunit.client.1.smithi164.stdout:8/929: creat d0/d14/d4e/d62/d8f/dbe/f139 x:0 0 0 2024-04-20T21:59:13.932 INFO:tasks.workunit.client.1.smithi164.stdout:6/989: readlink d0/d3/d15/d21/d101/d45/d69/l7a 0 2024-04-20T21:59:13.936 INFO:tasks.workunit.client.1.smithi164.stdout:8/930: mknod d0/d14/df6/c13a 0 2024-04-20T21:59:13.936 INFO:tasks.workunit.client.1.smithi164.stdout:1/930: dwrite d10/d33/d41/fcd [0,4194304] 0 2024-04-20T21:59:13.938 INFO:tasks.workunit.client.1.smithi164.stdout:0/952: dread d1/d4/d20/fd5 [0,4194304] 0 2024-04-20T21:59:13.941 INFO:tasks.workunit.client.1.smithi164.stdout:1/931: write d10/d16/d20/d91/faf [2097434,4105] 0 2024-04-20T21:59:13.941 INFO:tasks.workunit.client.1.smithi164.stdout:0/953: write d1/f1b [1520571,42499] 0 2024-04-20T21:59:13.944 INFO:tasks.workunit.client.1.smithi164.stdout:1/932: fsync d10/d7d/fda 0 2024-04-20T21:59:13.946 INFO:tasks.workunit.client.1.smithi164.stdout:8/931: mkdir d0/d14/d16/d58/d94/da5/dad/dd3/dd4/d13b 0 2024-04-20T21:59:13.949 INFO:tasks.workunit.client.1.smithi164.stdout:0/954: mknod d1/d4/d26/d29/d2d/d54/c110 0 2024-04-20T21:59:13.949 INFO:tasks.workunit.client.1.smithi164.stdout:7/972: sync 2024-04-20T21:59:13.949 INFO:tasks.workunit.client.1.smithi164.stdout:4/910: sync 2024-04-20T21:59:13.952 INFO:tasks.workunit.client.1.smithi164.stdout:1/933: mkdir d10/d16/d20/d91/d9d/d12a 0 2024-04-20T21:59:13.954 INFO:tasks.workunit.client.1.smithi164.stdout:8/932: rmdir d0/d14/d4e/d6f/de3 39 2024-04-20T21:59:13.955 INFO:tasks.workunit.client.1.smithi164.stdout:6/990: link d0/d3/d15/d21/d5c/dbf/dbd/ddf/d28/c40 d0/d3/d15/d21/d5c/dbf/dbd/c14d 0 2024-04-20T21:59:13.955 INFO:tasks.workunit.client.1.smithi164.stdout:1/934: fdatasync d10/d16/d20/d25/d3d/fbc 0 2024-04-20T21:59:13.961 INFO:tasks.workunit.client.1.smithi164.stdout:4/911: mkdir d4/d9/d5c/d97/dbf/d5f/d125 0 2024-04-20T21:59:13.964 INFO:tasks.workunit.client.1.smithi164.stdout:8/933: rmdir d0/d1e 39 2024-04-20T21:59:13.972 INFO:tasks.workunit.client.1.smithi164.stdout:6/991: dread - d0/d3/d27/fc4 zero size 2024-04-20T21:59:13.974 INFO:tasks.workunit.client.1.smithi164.stdout:7/973: symlink d2/d21/l144 0 2024-04-20T21:59:13.979 INFO:tasks.workunit.client.1.smithi164.stdout:8/934: creat d0/db7/f13c x:0 0 0 2024-04-20T21:59:13.981 INFO:tasks.workunit.client.1.smithi164.stdout:1/935: symlink d10/l12b 0 2024-04-20T21:59:13.981 INFO:tasks.workunit.client.1.smithi164.stdout:6/992: creat d0/d3/d15/d21/d4b/f14e x:0 0 0 2024-04-20T21:59:13.982 INFO:tasks.workunit.client.1.smithi164.stdout:0/955: creat d1/d4/d26/d29/d2d/f111 x:0 0 0 2024-04-20T21:59:13.983 INFO:tasks.workunit.client.1.smithi164.stdout:7/974: mkdir d2/d21/d24/d8a/d145 0 2024-04-20T21:59:13.984 INFO:tasks.workunit.client.1.smithi164.stdout:8/935: readlink d0/l83 0 2024-04-20T21:59:13.988 INFO:tasks.workunit.client.1.smithi164.stdout:1/936: creat d10/d16/d19/d1a/d51/f12c x:0 0 0 2024-04-20T21:59:13.989 INFO:tasks.workunit.client.1.smithi164.stdout:8/936: chown d0/db7/f13c 405 1 2024-04-20T21:59:13.993 INFO:tasks.workunit.client.1.smithi164.stdout:7/975: symlink d2/d21/d24/d31/d3a/d83/d6a/de7/l146 0 2024-04-20T21:59:13.998 INFO:tasks.workunit.client.1.smithi164.stdout:8/937: symlink d0/d14/d4e/d62/l13d 0 2024-04-20T21:59:14.001 INFO:tasks.workunit.client.1.smithi164.stdout:4/912: dwrite d4/d9/d5c/d97/dbf/d5f/ff1 [4194304,4194304] 0 2024-04-20T21:59:14.004 INFO:tasks.workunit.client.1.smithi164.stdout:8/938: readlink d0/d14/d16/d58/d73/led 0 2024-04-20T21:59:14.007 INFO:tasks.workunit.client.1.smithi164.stdout:7/976: symlink d2/d21/d24/d31/d3a/d83/dcf/dea/l147 0 2024-04-20T21:59:14.012 INFO:tasks.workunit.client.1.smithi164.stdout:0/956: dwrite d1/d2b/f65 [4194304,4194304] 0 2024-04-20T21:59:14.012 INFO:tasks.workunit.client.1.smithi164.stdout:7/977: chown d2/d21/d24/d31/d3a/d83/d77 8213 1 2024-04-20T21:59:14.012 INFO:tasks.workunit.client.1.smithi164.stdout:4/913: mkdir d4/d9/d5c/d97/dbf/d67/d86/def/dad/d126 0 2024-04-20T21:59:14.017 INFO:tasks.workunit.client.1.smithi164.stdout:8/939: creat d0/d14/d16/d58/d94/da5/dad/dd3/dd4/d13b/f13e x:0 0 0 2024-04-20T21:59:14.017 INFO:tasks.workunit.client.1.smithi164.stdout:7/978: stat d2/d21/d24/d31/d3a/d83/dcf/dea/l147 0 2024-04-20T21:59:14.019 INFO:tasks.workunit.client.1.smithi164.stdout:0/957: fdatasync d1/d4/da/d27/f7c 0 2024-04-20T21:59:14.020 INFO:tasks.workunit.client.1.smithi164.stdout:1/937: dwrite d10/f11 [0,4194304] 0 2024-04-20T21:59:14.020 INFO:tasks.workunit.client.1.smithi164.stdout:8/940: dread - d0/d14/d4e/d6f/f12c zero size 2024-04-20T21:59:14.023 INFO:tasks.workunit.client.1.smithi164.stdout:1/938: stat d10/d33/d4d/dc4/dfc/c101 0 2024-04-20T21:59:14.031 INFO:tasks.workunit.client.1.smithi164.stdout:0/958: creat d1/d4/d49/f112 x:0 0 0 2024-04-20T21:59:14.031 INFO:tasks.workunit.client.1.smithi164.stdout:8/941: read d0/d14/d4e/d86/fd5 [215312,101859] 0 2024-04-20T21:59:14.037 INFO:tasks.workunit.client.1.smithi164.stdout:8/942: dread - d0/d14/d16/d58/fc9 zero size 2024-04-20T21:59:14.040 INFO:tasks.workunit.client.1.smithi164.stdout:4/914: truncate d4/d9/d22/f52 5035118 0 2024-04-20T21:59:14.040 INFO:tasks.workunit.client.1.smithi164.stdout:6/993: sync 2024-04-20T21:59:14.041 INFO:tasks.workunit.client.1.smithi164.stdout:0/959: dread d1/d4/da/d5c/fd4 [0,4194304] 0 2024-04-20T21:59:14.045 INFO:tasks.workunit.client.1.smithi164.stdout:0/960: fdatasync d1/f42 0 2024-04-20T21:59:14.047 INFO:tasks.workunit.client.1.smithi164.stdout:0/961: readlink d1/d4/df/dbe/lfb 0 2024-04-20T21:59:14.048 INFO:tasks.workunit.client.1.smithi164.stdout:7/979: dwrite d2/d21/d33/fe5 [0,4194304] 0 2024-04-20T21:59:14.050 INFO:tasks.workunit.client.1.smithi164.stdout:4/915: read d4/d9/da4/fa6 [1195765,1489] 0 2024-04-20T21:59:14.050 INFO:tasks.workunit.client.1.smithi164.stdout:6/994: chown d0/d3/d15/d21/d101/d45/d4f/f68 7179945 1 2024-04-20T21:59:14.051 INFO:tasks.workunit.client.1.smithi164.stdout:1/939: link d10/d16/d19/l29 d10/d16/d19/d1a/d51/l12d 0 2024-04-20T21:59:14.056 INFO:tasks.workunit.client.1.smithi164.stdout:6/995: write d0/d3/d11/d29/d6e/db2/df5/f148 [685253,81940] 0 2024-04-20T21:59:14.057 INFO:tasks.workunit.client.1.smithi164.stdout:7/980: dread d2/d21/df0/f13c [0,4194304] 0 2024-04-20T21:59:14.059 INFO:tasks.workunit.client.1.smithi164.stdout:7/981: chown d2/d21/d24/d31/d3a/d83/dba 137 1 2024-04-20T21:59:14.059 INFO:tasks.workunit.client.1.smithi164.stdout:6/996: truncate d0/d3/d62/d8e/f132 95774 0 2024-04-20T21:59:14.061 INFO:tasks.workunit.client.1.smithi164.stdout:7/982: chown d2/d21/d33/cdd 170049 1 2024-04-20T21:59:14.063 INFO:tasks.workunit.client.1.smithi164.stdout:4/916: link d4/d9/d5c/fbc d4/d108/d119/f127 0 2024-04-20T21:59:14.063 INFO:tasks.workunit.client.1.smithi164.stdout:6/997: write d0/d3/d15/d21/d101/d45/d4f/d9c/f12f [59417,127545] 0 2024-04-20T21:59:14.063 INFO:tasks.workunit.client.1.smithi164.stdout:8/943: write d0/d14/d16/d58/d73/fd0 [777619,130795] 0 2024-04-20T21:59:14.066 INFO:tasks.workunit.client.1.smithi164.stdout:0/962: dread d1/d4/da/fbf [0,4194304] 0 2024-04-20T21:59:14.068 INFO:tasks.workunit.client.1.smithi164.stdout:7/983: fdatasync d2/f8c 0 2024-04-20T21:59:14.068 INFO:tasks.workunit.client.1.smithi164.stdout:8/944: write d0/d14/d16/d58/d94/da5/dad/d116/d11f/fac [347834,116088] 0 2024-04-20T21:59:14.071 INFO:tasks.workunit.client.1.smithi164.stdout:4/917: symlink d4/d9/d5c/d97/dbf/d67/d86/dc3/dc6/l128 0 2024-04-20T21:59:14.074 INFO:tasks.workunit.client.1.smithi164.stdout:4/918: stat d4/d9/d5c/d97/dbf/d67/d86/def/d3e/f59 0 2024-04-20T21:59:14.074 INFO:tasks.workunit.client.1.smithi164.stdout:6/998: rename d0/d3/d15/d21/d101/d45/d69/d134/fac to d0/d3/d27/dde/f14f 0 2024-04-20T21:59:14.078 INFO:tasks.workunit.client.1.smithi164.stdout:8/945: symlink d0/d14/dee/l13f 0 2024-04-20T21:59:14.078 INFO:tasks.workunit.client.1.smithi164.stdout:6/999: read d0/d3/d15/d21/d101/f130 [1251748,55369] 0 2024-04-20T21:59:14.079 INFO:tasks.workunit.client.1.smithi164.stdout:8/946: chown d0/d14/d16/d5a/d126 8 1 2024-04-20T21:59:14.080 INFO:tasks.workunit.client.1.smithi164.stdout:0/963: fsync d1/d4/da/f2e 0 2024-04-20T21:59:14.081 INFO:tasks.workunit.client.1.smithi164.stdout:7/984: unlink d2/d21/d24/d31/d3a/d83/d6a/de4/c116 0 2024-04-20T21:59:14.082 INFO:tasks.workunit.client.1.smithi164.stdout:4/919: write d4/d9/d5c/d97/daa/f11b [554851,60999] 0 2024-04-20T21:59:14.093 INFO:tasks.workunit.client.1.smithi164.stdout:0/964: dwrite d1/d4/df/f2f [0,4194304] 0 2024-04-20T21:59:14.133 INFO:tasks.workunit.client.1.smithi164.stdout:1/940: sync 2024-04-20T21:59:14.135 INFO:tasks.workunit.client.1.smithi164.stdout:1/941: read - d10/d16/d20/d91/db9/f116 zero size 2024-04-20T21:59:14.139 INFO:tasks.workunit.client.1.smithi164.stdout:1/942: fsync d10/d16/d19/de0/d34/da9/f109 0 2024-04-20T21:59:14.142 INFO:tasks.workunit.client.1.smithi164.stdout:1/943: write d10/d33/f87 [993986,122470] 0 2024-04-20T21:59:14.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.146+0000 7fc71f200700 1 -- 172.21.15.142:0/2808064559 --> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc71802ceb0 con 0x7fc70006ea70 2024-04-20T21:59:14.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.148+0000 7fc712a00700 1 -- 172.21.15.142:0/2808064559 <== mgr.14722 v2:172.21.15.142:6800/54392364 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fc71802ceb0 con 0x7fc70006ea70 2024-04-20T21:59:14.147 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T21:59:14.147 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T21:59:14.148 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T21:59:14.148 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T21:59:14.148 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T21:59:14.148 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr" 2024-04-20T21:59:14.148 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T21:59:14.148 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "2/23 daemons upgraded", 2024-04-20T21:59:14.148 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "", 2024-04-20T21:59:14.148 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T21:59:14.148 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T21:59:14.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.150+0000 7fc71f200700 1 -- 172.21.15.142:0/2808064559 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fc70006ea70 msgr2=0x7fc700070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:14.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.150+0000 7fc71f200700 1 --2- 172.21.15.142:0/2808064559 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fc70006ea70 0x7fc700070f30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc70c005950 tx=0x7fc70c0058e0 comp rx=0 tx=0).stop 2024-04-20T21:59:14.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.150+0000 7fc71f200700 1 -- 172.21.15.142:0/2808064559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc718103e30 msgr2=0x7fc718198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:14.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.150+0000 7fc71f200700 1 --2- 172.21.15.142:0/2808064559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc718103e30 0x7fc718198b90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc70800bda0 tx=0x7fc70800be80 comp rx=0 tx=0).stop 2024-04-20T21:59:14.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.151+0000 7fc71f200700 1 -- 172.21.15.142:0/2808064559 shutdown_connections 2024-04-20T21:59:14.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.151+0000 7fc71f200700 1 --2- 172.21.15.142:0/2808064559 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fc70006ea70 0x7fc700070f30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:14.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.151+0000 7fc71f200700 1 --2- 172.21.15.142:0/2808064559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc718102c30 0x7fc718198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:14.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.151+0000 7fc71f200700 1 --2- 172.21.15.142:0/2808064559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc718103e30 0x7fc718198b90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:14.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.151+0000 7fc71f200700 1 -- 172.21.15.142:0/2808064559 >> 172.21.15.142:0/2808064559 conn(0x7fc7180fe210 msgr2=0x7fc7181073d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:14.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.151+0000 7fc71f200700 1 -- 172.21.15.142:0/2808064559 shutdown_connections 2024-04-20T21:59:14.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.151+0000 7fc71f200700 1 -- 172.21.15.142:0/2808064559 wait complete. 2024-04-20T21:59:14.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.303+0000 7fe18ae00700 1 -- 172.21.15.142:0/1220529231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1841070f0 msgr2=0x7fe184107510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:14.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.303+0000 7fe18ae00700 1 --2- 172.21.15.142:0/1220529231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1841070f0 0x7fe184107510 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe178009910 tx=0x7fe178009c20 comp rx=0 tx=0).stop 2024-04-20T21:59:14.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.303+0000 7fe18ae00700 1 -- 172.21.15.142:0/1220529231 shutdown_connections 2024-04-20T21:59:14.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.303+0000 7fe18ae00700 1 --2- 172.21.15.142:0/1220529231 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe184108290 0x7fe1841086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:14.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.303+0000 7fe18ae00700 1 --2- 172.21.15.142:0/1220529231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1841070f0 0x7fe184107510 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:14.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.303+0000 7fe18ae00700 1 -- 172.21.15.142:0/1220529231 >> 172.21.15.142:0/1220529231 conn(0x7fe1840761d0 msgr2=0x7fe184078610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:14.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.303+0000 7fe18ae00700 1 -- 172.21.15.142:0/1220529231 shutdown_connections 2024-04-20T21:59:14.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.303+0000 7fe18ae00700 1 -- 172.21.15.142:0/1220529231 wait complete. 2024-04-20T21:59:14.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.304+0000 7fe18ae00700 1 Processor -- start 2024-04-20T21:59:14.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.304+0000 7fe18ae00700 1 -- start start 2024-04-20T21:59:14.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.304+0000 7fe18ae00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1841070f0 0x7fe18419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:14.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.304+0000 7fe18ae00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe184108290 0x7fe18419d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:14.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.304+0000 7fe18ae00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18419d720 con 0x7fe184108290 2024-04-20T21:59:14.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.304+0000 7fe18ae00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18419d860 con 0x7fe1841070f0 2024-04-20T21:59:14.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.305+0000 7fe189000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe184108290 0x7fe18419d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:14.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.305+0000 7fe189000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe184108290 0x7fe18419d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48778/0 (socket says 172.21.15.142:48778) 2024-04-20T21:59:14.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.305+0000 7fe189000700 1 -- 172.21.15.142:0/3278246731 learned_addr learned my addr 172.21.15.142:0/3278246731 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:59:14.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.305+0000 7fe189a00700 1 --2- 172.21.15.142:0/3278246731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1841070f0 0x7fe18419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:14.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.305+0000 7fe189000700 1 -- 172.21.15.142:0/3278246731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1841070f0 msgr2=0x7fe18419cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:14.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.305+0000 7fe189000700 1 --2- 172.21.15.142:0/3278246731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1841070f0 0x7fe18419cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:14.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.305+0000 7fe189000700 1 -- 172.21.15.142:0/3278246731 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1780095f0 con 0x7fe184108290 2024-04-20T21:59:14.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.305+0000 7fe189000700 1 --2- 172.21.15.142:0/3278246731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe184108290 0x7fe18419d100 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe17400b4b0 tx=0x7fe17400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:14.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.306+0000 7fe182000700 1 -- 172.21.15.142:0/3278246731 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe174011800 con 0x7fe184108290 2024-04-20T21:59:14.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.306+0000 7fe182000700 1 -- 172.21.15.142:0/3278246731 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe174011e20 con 0x7fe184108290 2024-04-20T21:59:14.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.306+0000 7fe182000700 1 -- 172.21.15.142:0/3278246731 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe17400f2e0 con 0x7fe184108290 2024-04-20T21:59:14.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.306+0000 7fe18ae00700 1 -- 172.21.15.142:0/3278246731 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1841a2270 con 0x7fe184108290 2024-04-20T21:59:14.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.306+0000 7fe18ae00700 1 -- 172.21.15.142:0/3278246731 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1841a2840 con 0x7fe184108290 2024-04-20T21:59:14.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.307+0000 7fe18ae00700 1 -- 172.21.15.142:0/3278246731 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe184196c90 con 0x7fe184108290 2024-04-20T21:59:14.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.308+0000 7fe182000700 1 -- 172.21.15.142:0/3278246731 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 30) v1 ==== 92710+0+0 (secure 0 0 0) 0x7fe174010380 con 0x7fe184108290 2024-04-20T21:59:14.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.309+0000 7fe182000700 1 --2- 172.21.15.142:0/3278246731 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fe16c06ea70 0x7fe16c070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:14.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.309+0000 7fe182000700 1 -- 172.21.15.142:0/3278246731 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fe17408e5f0 con 0x7fe184108290 2024-04-20T21:59:14.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.309+0000 7fe189a00700 1 --2- 172.21.15.142:0/3278246731 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fe16c06ea70 0x7fe16c070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:14.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.310+0000 7fe189a00700 1 --2- 172.21.15.142:0/3278246731 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fe16c06ea70 0x7fe16c070f30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe178006010 tx=0x7fe17800b540 comp rx=0 tx=0).ready entity=mgr.14722 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:14.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.313+0000 7fe182000700 1 -- 172.21.15.142:0/3278246731 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fe17405b380 con 0x7fe184108290 2024-04-20T21:59:14.360 INFO:tasks.workunit.client.1.smithi164.stdout:0/965: fsync d1/d4/da/de1/d107/f106 0 2024-04-20T21:59:14.364 INFO:tasks.workunit.client.1.smithi164.stdout:0/966: readlink d1/d4/df/d56/ld3 0 2024-04-20T21:59:14.365 INFO:tasks.workunit.client.1.smithi164.stdout:1/944: creat d10/d33/d41/f12e x:0 0 0 2024-04-20T21:59:14.414 INFO:tasks.workunit.client.1.smithi164.stdout:8/947: unlink d0/d1e/f44 0 2024-04-20T21:59:14.427 INFO:tasks.workunit.client.1.smithi164.stdout:1/945: fdatasync d10/d33/d48/d8b/fa3 0 2024-04-20T21:59:14.431 INFO:tasks.workunit.client.1.smithi164.stdout:4/920: link d4/d9/d5c/d97/dbf/d5f/f8a d4/d9/d22/f129 0 2024-04-20T21:59:14.435 INFO:tasks.workunit.client.1.smithi164.stdout:8/948: write d0/fa8 [1704770,82157] 0 2024-04-20T21:59:14.436 INFO:tasks.workunit.client.1.smithi164.stdout:0/967: rename d1/d4/d26/d29/d2d/d54/d77/d3c/l48 to d1/d4/df/d56/l113 0 2024-04-20T21:59:14.442 INFO:tasks.workunit.client.1.smithi164.stdout:1/946: creat d10/d33/d48/d8b/de3/de4/df2/f12f x:0 0 0 2024-04-20T21:59:14.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:14 smithi142 ceph-mon[15828]: pgmap v14: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 81 MiB/s rd, 209 MiB/s wr, 479 op/s 2024-04-20T21:59:14.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:14 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/809503991' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:59:14.450 INFO:tasks.workunit.client.1.smithi164.stdout:8/949: mkdir d0/d14/d16/d5a/d140 0 2024-04-20T21:59:14.450 INFO:tasks.workunit.client.1.smithi164.stdout:4/921: mkdir d4/d9/d22/d10b/d12a 0 2024-04-20T21:59:14.453 INFO:tasks.workunit.client.1.smithi164.stdout:1/947: mknod d10/d16/d19/d1a/d51/c130 0 2024-04-20T21:59:14.454 INFO:tasks.workunit.client.1.smithi164.stdout:4/922: write d4/d9/fc [4297624,36071] 0 2024-04-20T21:59:14.457 INFO:tasks.workunit.client.1.smithi164.stdout:1/948: write d10/d16/d20/d25/fad [2192697,123264] 0 2024-04-20T21:59:14.460 INFO:tasks.workunit.client.1.smithi164.stdout:8/950: rmdir d0/d14/d4e/d62/d82 39 2024-04-20T21:59:14.461 INFO:tasks.workunit.client.1.smithi164.stdout:1/949: chown d10/d16/d20/d91/d9d/ldd 2 1 2024-04-20T21:59:14.463 INFO:tasks.workunit.client.1.smithi164.stdout:8/951: chown d0/d14/d16/f26 110663295 1 2024-04-20T21:59:14.469 INFO:tasks.workunit.client.1.smithi164.stdout:4/923: symlink d4/d9/d5c/d97/dbf/d5f/d10f/l12b 0 2024-04-20T21:59:14.470 INFO:tasks.workunit.client.1.smithi164.stdout:0/968: link d1/d4/d26/d29/lfd d1/d4/da/d5c/deb/l114 0 2024-04-20T21:59:14.471 INFO:tasks.workunit.client.1.smithi164.stdout:1/950: mkdir d10/d8a/d131 0 2024-04-20T21:59:14.477 INFO:tasks.workunit.client.1.smithi164.stdout:8/952: chown d0/d14/d4e/d6f/de3/f10d 154982320 1 2024-04-20T21:59:14.479 INFO:tasks.workunit.client.1.smithi164.stdout:4/924: creat d4/d9/d5c/d97/dbf/d67/d86/def/dad/d126/f12c x:0 0 0 2024-04-20T21:59:14.480 INFO:tasks.workunit.client.1.smithi164.stdout:1/951: truncate d10/f5c 6235154 0 2024-04-20T21:59:14.483 INFO:tasks.workunit.client.1.smithi164.stdout:1/952: dread - d10/d33/d48/d8b/fa3 zero size 2024-04-20T21:59:14.487 INFO:tasks.workunit.client.1.smithi164.stdout:4/925: creat d4/d9/d5c/d97/dbf/d5f/d125/f12d x:0 0 0 2024-04-20T21:59:14.490 INFO:tasks.workunit.client.1.smithi164.stdout:0/969: dwrite d1/f12 [0,4194304] 0 2024-04-20T21:59:14.491 INFO:tasks.workunit.client.1.smithi164.stdout:1/953: rmdir d10/d16/d20/d91/df0 0 2024-04-20T21:59:14.492 INFO:tasks.workunit.client.1.smithi164.stdout:4/926: write d4/d9/d5c/d97/dbf/d5f/f104 [611154,17656] 0 2024-04-20T21:59:14.498 INFO:tasks.workunit.client.1.smithi164.stdout:8/953: dwrite d0/d14/d4e/d86/fd1 [0,4194304] 0 2024-04-20T21:59:14.501 INFO:tasks.workunit.client.1.smithi164.stdout:7/985: truncate d2/d21/d24/d31/d3a/d83/dba/def/dff/d139/f129 2563230 0 2024-04-20T21:59:14.501 INFO:tasks.workunit.client.1.smithi164.stdout:0/970: dread d1/d4/df/dbe/f108 [0,4194304] 0 2024-04-20T21:59:14.505 INFO:tasks.workunit.client.1.smithi164.stdout:1/954: rename d10/d33/d4d/dc4/dfc/c101 to d10/dca/c132 0 2024-04-20T21:59:14.506 INFO:tasks.workunit.client.1.smithi164.stdout:1/955: fdatasync d10/d33/d4d/fed 0 2024-04-20T21:59:14.507 INFO:tasks.workunit.client.1.smithi164.stdout:8/954: fsync d0/db7/fc4 0 2024-04-20T21:59:14.519 INFO:tasks.workunit.client.1.smithi164.stdout:0/971: mknod d1/d4/d26/d29/d2d/d54/d77/db3/d10a/c115 0 2024-04-20T21:59:14.519 INFO:tasks.workunit.client.1.smithi164.stdout:7/986: truncate d2/d21/d24/d31/d3a/d83/d63/d85/dbe/f109 49621 0 2024-04-20T21:59:14.523 INFO:tasks.workunit.client.1.smithi164.stdout:1/956: rmdir d10/d8a 39 2024-04-20T21:59:14.523 INFO:tasks.workunit.client.1.smithi164.stdout:8/955: dwrite d0/d14/d16/d58/f74 [8388608,4194304] 0 2024-04-20T21:59:14.524 INFO:tasks.workunit.client.1.smithi164.stdout:1/957: fsync d10/d33/d41/f12e 0 2024-04-20T21:59:14.537 INFO:tasks.workunit.client.1.smithi164.stdout:4/927: write d4/d9/d5c/d97/dbf/d67/d86/def/dad/dbd/fcb [2572703,111947] 0 2024-04-20T21:59:14.541 INFO:tasks.workunit.client.1.smithi164.stdout:7/987: dwrite d2/f29 [0,4194304] 0 2024-04-20T21:59:14.542 INFO:tasks.workunit.client.1.smithi164.stdout:0/972: write d1/f8 [2509505,46202] 0 2024-04-20T21:59:14.545 INFO:tasks.workunit.client.1.smithi164.stdout:4/928: fsync d4/d9/fc8 0 2024-04-20T21:59:14.547 INFO:tasks.workunit.client.1.smithi164.stdout:8/956: write d0/d14/d16/d58/fea [766443,118131] 0 2024-04-20T21:59:14.550 INFO:tasks.workunit.client.1.smithi164.stdout:1/958: dwrite d10/d16/d19/d1a/d51/d85/f11f [0,4194304] 0 2024-04-20T21:59:14.556 INFO:tasks.workunit.client.1.smithi164.stdout:4/929: unlink d4/d9/d22/c45 0 2024-04-20T21:59:14.556 INFO:tasks.workunit.client.1.smithi164.stdout:8/957: rmdir d0/d14/d4e/d62/d8f 39 2024-04-20T21:59:14.557 INFO:tasks.workunit.client.1.smithi164.stdout:1/959: unlink d10/d33/fc0 0 2024-04-20T21:59:14.559 INFO:tasks.workunit.client.1.smithi164.stdout:0/973: mkdir d1/d4/da/d5c/d116 0 2024-04-20T21:59:14.561 INFO:tasks.workunit.client.1.smithi164.stdout:7/988: chown d2/d21/d24/d31/d3a/d83/dba/def/dff/d139/dd4/d9e/da6/fcd 65164 1 2024-04-20T21:59:14.562 INFO:tasks.workunit.client.1.smithi164.stdout:1/960: write d10/d16/d19/de0/fd0 [839854,87502] 0 2024-04-20T21:59:14.564 INFO:tasks.workunit.client.1.smithi164.stdout:4/930: truncate d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d4a/f9f 1724036 0 2024-04-20T21:59:14.565 INFO:tasks.workunit.client.1.smithi164.stdout:0/974: truncate d1/d4/d26/d29/f9f 1180058 0 2024-04-20T21:59:14.568 INFO:tasks.workunit.client.1.smithi164.stdout:8/958: creat d0/d14/d16/f141 x:0 0 0 2024-04-20T21:59:14.571 INFO:tasks.workunit.client.1.smithi164.stdout:0/975: rmdir d1/d4/d20/d74 39 2024-04-20T21:59:14.576 INFO:tasks.workunit.client.1.smithi164.stdout:8/959: dread d0/d14/d16/d58/d73/fd0 [0,4194304] 0 2024-04-20T21:59:14.577 INFO:tasks.workunit.client.1.smithi164.stdout:0/976: mkdir d1/d4/d26/d29/d2d/d54/d117 0 2024-04-20T21:59:14.580 INFO:tasks.workunit.client.1.smithi164.stdout:8/960: fsync d0/d14/d16/d58/d94/da5/dad/d116/d11f/f95 0 2024-04-20T21:59:14.584 INFO:tasks.workunit.client.1.smithi164.stdout:7/989: dread d2/d21/d24/f4f [0,4194304] 0 2024-04-20T21:59:14.585 INFO:tasks.workunit.client.1.smithi164.stdout:4/931: dwrite d4/d9/d5c/d97/dbf/d67/d86/def/f6b [0,4194304] 0 2024-04-20T21:59:14.589 INFO:tasks.workunit.client.1.smithi164.stdout:8/961: mkdir d0/d14/d4e/d86/d142 0 2024-04-20T21:59:14.591 INFO:tasks.workunit.client.1.smithi164.stdout:8/962: write d0/d14/dee/f137 [293789,27299] 0 2024-04-20T21:59:14.593 INFO:tasks.workunit.client.1.smithi164.stdout:1/961: truncate d10/d33/d48/f4b 4740123 0 2024-04-20T21:59:14.594 INFO:tasks.workunit.client.1.smithi164.stdout:4/932: rename d4/d9/d5c/d97/dbf/d67/d86/def/f6f to d4/d108/f12e 0 2024-04-20T21:59:14.596 INFO:tasks.workunit.client.1.smithi164.stdout:7/990: dread d2/d21/d24/d31/d3a/d83/dba/def/dff/d139/fce [0,4194304] 0 2024-04-20T21:59:14.598 INFO:tasks.workunit.client.1.smithi164.stdout:1/962: symlink d10/d16/d20/dbf/l133 0 2024-04-20T21:59:14.601 INFO:tasks.workunit.client.1.smithi164.stdout:8/963: mkdir d0/d14/d16/d5a/d140/d143 0 2024-04-20T21:59:14.601 INFO:tasks.workunit.client.1.smithi164.stdout:0/977: write d1/d4/df/f59 [845885,111744] 0 2024-04-20T21:59:14.603 INFO:tasks.workunit.client.1.smithi164.stdout:8/964: write d0/d14/d4e/d86/fd1 [273993,97469] 0 2024-04-20T21:59:14.606 INFO:tasks.workunit.client.1.smithi164.stdout:4/933: creat d4/d106/f12f x:0 0 0 2024-04-20T21:59:14.608 INFO:tasks.workunit.client.1.smithi164.stdout:1/963: truncate d10/f5e 5494294 0 2024-04-20T21:59:14.609 INFO:tasks.workunit.client.1.smithi164.stdout:0/978: getdents d1/d4/df/d56/df5 0 2024-04-20T21:59:14.611 INFO:tasks.workunit.client.1.smithi164.stdout:7/991: dread d2/d21/d24/d31/d3a/d83/dcf/dea/ff3 [0,4194304] 0 2024-04-20T21:59:14.618 INFO:tasks.workunit.client.1.smithi164.stdout:1/964: mkdir d10/d16/d19/d1a/dff/d134 0 2024-04-20T21:59:14.622 INFO:tasks.workunit.client.1.smithi164.stdout:8/965: creat d0/d14/d4e/d62/d8f/dbe/f144 x:0 0 0 2024-04-20T21:59:14.626 INFO:tasks.workunit.client.1.smithi164.stdout:8/966: chown d0/d14/d16/d58/d94/da5/dad/d116/d11f/fb5 182625 1 2024-04-20T21:59:14.627 INFO:tasks.workunit.client.1.smithi164.stdout:4/934: dwrite d4/d9/f1b [4194304,4194304] 0 2024-04-20T21:59:14.628 INFO:tasks.workunit.client.1.smithi164.stdout:8/967: fsync d0/d14/d16/f141 0 2024-04-20T21:59:14.642 INFO:tasks.workunit.client.1.smithi164.stdout:7/992: rename d2/l39 to d2/d21/d24/d31/d3a/d83/dba/def/dff/d139/l148 0 2024-04-20T21:59:14.642 INFO:tasks.workunit.client.1.smithi164.stdout:8/968: dwrite d0/d14/d16/d58/d94/da5/dad/d116/d11f/f7a [0,4194304] 0 2024-04-20T21:59:14.645 INFO:tasks.workunit.client.1.smithi164.stdout:0/979: getdents d1/d4/d26/d29/d2d/d54 0 2024-04-20T21:59:14.646 INFO:tasks.workunit.client.1.smithi164.stdout:1/965: write d10/f5e [3079702,42290] 0 2024-04-20T21:59:14.650 INFO:tasks.workunit.client.1.smithi164.stdout:8/969: unlink d0/d14/d4e/d6f/de3/f10d 0 2024-04-20T21:59:14.650 INFO:tasks.workunit.client.1.smithi164.stdout:1/966: truncate d10/d33/d41/f100 816094 0 2024-04-20T21:59:14.652 INFO:tasks.workunit.client.1.smithi164.stdout:0/980: readlink d1/d4/d20/d74/lb7 0 2024-04-20T21:59:14.655 INFO:tasks.workunit.client.1.smithi164.stdout:8/970: creat d0/d14/d16/d9d/f145 x:0 0 0 2024-04-20T21:59:14.661 INFO:tasks.workunit.client.1.smithi164.stdout:1/967: dread - d10/d8a/fa2 zero size 2024-04-20T21:59:14.661 INFO:tasks.workunit.client.1.smithi164.stdout:7/993: link d2/d21/d24/f4f d2/d21/d24/d31/d3a/d83/d63/d85/d117/f149 0 2024-04-20T21:59:14.661 INFO:tasks.workunit.client.1.smithi164.stdout:8/971: mknod d0/d14/d16/d58/d94/da5/dad/d116/d11f/c146 0 2024-04-20T21:59:14.673 INFO:tasks.workunit.client.1.smithi164.stdout:0/981: write d1/d4/d26/d29/f5b [7939,31410] 0 2024-04-20T21:59:14.675 INFO:tasks.workunit.client.1.smithi164.stdout:7/994: link d2/d21/d24/d31/d3a/d83/f96 d2/d21/d24/d31/d3a/d83/d68/f14a 0 2024-04-20T21:59:14.678 INFO:tasks.workunit.client.1.smithi164.stdout:1/968: dwrite d10/d16/d20/f2f [0,4194304] 0 2024-04-20T21:59:14.679 INFO:tasks.workunit.client.1.smithi164.stdout:4/935: dread d4/d9/d5c/f94 [0,4194304] 0 2024-04-20T21:59:14.680 INFO:tasks.workunit.client.1.smithi164.stdout:8/972: dwrite d0/d14/d16/d58/fea [0,4194304] 0 2024-04-20T21:59:14.684 INFO:tasks.workunit.client.1.smithi164.stdout:4/936: chown d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41/fa0 552591 1 2024-04-20T21:59:14.684 INFO:tasks.workunit.client.1.smithi164.stdout:7/995: symlink d2/d21/d24/d31/d3a/d83/dba/def/dff/d139/dd4/d9e/l14b 0 2024-04-20T21:59:14.687 INFO:tasks.workunit.client.1.smithi164.stdout:8/973: unlink d0/d14/d16/c125 0 2024-04-20T21:59:14.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:14 smithi164 ceph-mon[23506]: pgmap v14: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 81 MiB/s rd, 209 MiB/s wr, 479 op/s 2024-04-20T21:59:14.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:14 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/809503991' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:59:14.699 INFO:tasks.workunit.client.1.smithi164.stdout:7/996: mkdir d2/d21/d24/d31/d3a/d83/d63/d85/d117/d14c 0 2024-04-20T21:59:14.701 INFO:tasks.workunit.client.1.smithi164.stdout:8/974: readlink d0/l3c 0 2024-04-20T21:59:14.703 INFO:tasks.workunit.client.1.smithi164.stdout:7/997: readlink d2/d21/d24/d31/d3a/d83/l62 0 2024-04-20T21:59:14.703 INFO:tasks.workunit.client.1.smithi164.stdout:8/975: fsync d0/d14/d4e/d6f/f129 0 2024-04-20T21:59:14.707 INFO:tasks.workunit.client.1.smithi164.stdout:0/982: dread d1/d4/df/d56/f8c [0,4194304] 0 2024-04-20T21:59:14.709 INFO:tasks.workunit.client.1.smithi164.stdout:1/969: write d10/d16/d19/de0/fe5 [3071558,88047] 0 2024-04-20T21:59:14.710 INFO:tasks.workunit.client.1.smithi164.stdout:8/976: mkdir d0/db3/d147 0 2024-04-20T21:59:14.712 INFO:tasks.workunit.client.1.smithi164.stdout:0/983: mkdir d1/d4/da/d5c/d6e/d118 0 2024-04-20T21:59:14.713 INFO:tasks.workunit.client.1.smithi164.stdout:7/998: dread d2/d21/d24/f61 [0,4194304] 0 2024-04-20T21:59:14.714 INFO:tasks.workunit.client.1.smithi164.stdout:1/970: chown d10/d16/d20/d81/c113 95 1 2024-04-20T21:59:14.714 INFO:tasks.workunit.client.1.smithi164.stdout:8/977: mkdir d0/d14/d16/d5a/d148 0 2024-04-20T21:59:14.716 INFO:tasks.workunit.client.1.smithi164.stdout:7/999: readlink d2/d21/d24/d31/d3a/daa/db8/le8 0 2024-04-20T21:59:14.718 INFO:tasks.workunit.client.1.smithi164.stdout:0/984: truncate d1/d4/f28 6019648 0 2024-04-20T21:59:14.719 INFO:tasks.workunit.client.1.smithi164.stdout:4/937: dwrite d4/d9/d5c/d97/dbf/d67/d86/def/f9a [4194304,4194304] 0 2024-04-20T21:59:14.720 INFO:tasks.workunit.client.1.smithi164.stdout:8/978: dread d0/f1b [0,4194304] 0 2024-04-20T21:59:14.723 INFO:tasks.workunit.client.1.smithi164.stdout:8/979: readlink d0/d14/d16/d58/d94/da5/dad/dd3/dd4/l105 0 2024-04-20T21:59:14.732 INFO:tasks.workunit.client.1.smithi164.stdout:8/980: rename d0/d14/d16/ccf to d0/d14/d16/d5a/c149 0 2024-04-20T21:59:14.739 INFO:tasks.workunit.client.1.smithi164.stdout:4/938: getdents d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41/de5 0 2024-04-20T21:59:14.746 INFO:tasks.workunit.client.1.smithi164.stdout:4/939: write d4/d9/d5c/d97/dbf/f63 [4434675,31161] 0 2024-04-20T21:59:14.751 INFO:tasks.workunit.client.1.smithi164.stdout:0/985: dread d1/d4/d26/d29/d2d/d9b/fce [0,4194304] 0 2024-04-20T21:59:14.756 INFO:tasks.workunit.client.1.smithi164.stdout:4/940: creat d4/d9/d5c/d97/dbf/d67/d86/def/d3e/f130 x:0 0 0 2024-04-20T21:59:14.757 INFO:tasks.workunit.client.1.smithi164.stdout:0/986: mknod d1/d4/da/d5c/d6e/d118/c119 0 2024-04-20T21:59:14.758 INFO:tasks.workunit.client.1.smithi164.stdout:8/981: dread d0/d14/f2a [0,4194304] 0 2024-04-20T21:59:14.762 INFO:tasks.workunit.client.1.smithi164.stdout:4/941: creat d4/d9/d5c/d97/dbf/d9b/f131 x:0 0 0 2024-04-20T21:59:14.762 INFO:tasks.workunit.client.1.smithi164.stdout:0/987: mkdir d1/d4/d26/d29/d2d/d54/d97/d11a 0 2024-04-20T21:59:14.764 INFO:tasks.workunit.client.1.smithi164.stdout:8/982: fdatasync d0/d14/d16/d5a/f5c 0 2024-04-20T21:59:14.768 INFO:tasks.workunit.client.1.smithi164.stdout:0/988: mknod d1/d4/da/d5c/deb/c11b 0 2024-04-20T21:59:14.772 INFO:tasks.workunit.client.1.smithi164.stdout:8/983: rmdir d0/d14/d16/d58/d94/da5/d120 0 2024-04-20T21:59:14.774 INFO:tasks.workunit.client.1.smithi164.stdout:8/984: readlink d0/d14/d16/d58/d73/le4 0 2024-04-20T21:59:14.774 INFO:tasks.workunit.client.1.smithi164.stdout:4/942: rename d4/d9/d5c/d97/dbf/d67/d86/def/dad/d126 to d4/d9/d5c/d97/dbf/d67/d86/def/dad/d132 0 2024-04-20T21:59:14.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.781+0000 7fe18ae00700 1 -- 172.21.15.142:0/3278246731 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe18404f400 con 0x7fe184108290 2024-04-20T21:59:14.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.781+0000 7fe182000700 1 -- 172.21.15.142:0/3278246731 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe17405af10 con 0x7fe184108290 2024-04-20T21:59:14.781 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_OK 2024-04-20T21:59:14.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.784+0000 7fe18ae00700 1 -- 172.21.15.142:0/3278246731 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fe16c06ea70 msgr2=0x7fe16c070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:14.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.784+0000 7fe18ae00700 1 --2- 172.21.15.142:0/3278246731 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fe16c06ea70 0x7fe16c070f30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe178006010 tx=0x7fe17800b540 comp rx=0 tx=0).stop 2024-04-20T21:59:14.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.784+0000 7fe18ae00700 1 -- 172.21.15.142:0/3278246731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe184108290 msgr2=0x7fe18419d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:14.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.784+0000 7fe18ae00700 1 --2- 172.21.15.142:0/3278246731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe184108290 0x7fe18419d100 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe17400b4b0 tx=0x7fe17400b870 comp rx=0 tx=0).stop 2024-04-20T21:59:14.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.784+0000 7fe18ae00700 1 -- 172.21.15.142:0/3278246731 shutdown_connections 2024-04-20T21:59:14.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.785+0000 7fe18ae00700 1 --2- 172.21.15.142:0/3278246731 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fe16c06ea70 0x7fe16c070f30 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe178006010 tx=0x7fe17800b540 comp rx=0 tx=0).stop 2024-04-20T21:59:14.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.785+0000 7fe18ae00700 1 --2- 172.21.15.142:0/3278246731 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1841070f0 0x7fe18419cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:14.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.785+0000 7fe18ae00700 1 --2- 172.21.15.142:0/3278246731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe184108290 0x7fe18419d100 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:14.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.785+0000 7fe18ae00700 1 -- 172.21.15.142:0/3278246731 >> 172.21.15.142:0/3278246731 conn(0x7fe1840761d0 msgr2=0x7fe18410b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:14.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.785+0000 7fe18ae00700 1 -- 172.21.15.142:0/3278246731 shutdown_connections 2024-04-20T21:59:14.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:14.785+0000 7fe18ae00700 1 -- 172.21.15.142:0/3278246731 wait complete. 2024-04-20T21:59:14.789 INFO:tasks.workunit.client.1.smithi164.stdout:8/985: rename d0/d14/d4e/ff5 to d0/d14/d16/f14a 0 2024-04-20T21:59:14.794 INFO:tasks.workunit.client.1.smithi164.stdout:8/986: truncate d0/d14/d16/d58/d94/da5/dad/f123 254361 0 2024-04-20T21:59:14.802 INFO:tasks.workunit.client.1.smithi164.stdout:4/943: dread d4/d9/d117/d37/f9e [0,4194304] 0 2024-04-20T21:59:14.810 INFO:tasks.workunit.client.1.smithi164.stdout:4/944: creat d4/d9/d5c/d97/dbf/d67/d86/def/d3e/f133 x:0 0 0 2024-04-20T21:59:14.811 INFO:tasks.workunit.client.1.smithi164.stdout:8/987: dread d0/d1e/f6b [0,4194304] 0 2024-04-20T21:59:14.815 INFO:tasks.workunit.client.1.smithi164.stdout:8/988: mkdir d0/d14/d4e/d62/d8f/d14b 0 2024-04-20T21:59:14.822 INFO:tasks.workunit.client.1.smithi164.stdout:4/945: write d4/d9/d5c/d97/dbf/d5f/f80 [3550918,93802] 0 2024-04-20T21:59:14.823 INFO:tasks.workunit.client.1.smithi164.stdout:8/989: rmdir d0/d14/d16/d5a/d126 0 2024-04-20T21:59:14.828 INFO:tasks.workunit.client.1.smithi164.stdout:8/990: mknod d0/d14/d4e/c14c 0 2024-04-20T21:59:14.833 INFO:tasks.workunit.client.1.smithi164.stdout:4/946: link d4/d9/d5c/d97/dbf/d67/lb4 d4/d9/d5c/d97/daa/l134 0 2024-04-20T21:59:14.834 INFO:tasks.workunit.client.1.smithi164.stdout:8/991: rmdir d0/d14/d4e/d62/d82 39 2024-04-20T21:59:14.841 INFO:tasks.workunit.client.1.smithi164.stdout:4/947: rename d4/f16 to d4/d9/d5c/d97/dbf/d67/f135 0 2024-04-20T21:59:14.849 INFO:tasks.workunit.client.1.smithi164.stdout:4/948: write d4/d9/d5c/d97/dbf/d67/d86/def/dad/de1/f10a [387726,58573] 0 2024-04-20T21:59:14.851 INFO:tasks.workunit.client.1.smithi164.stdout:0/989: sync 2024-04-20T21:59:14.853 INFO:tasks.workunit.client.1.smithi164.stdout:1/971: sync 2024-04-20T21:59:14.856 INFO:tasks.workunit.client.1.smithi164.stdout:4/949: symlink d4/l136 0 2024-04-20T21:59:14.861 INFO:tasks.workunit.client.1.smithi164.stdout:1/972: creat d10/d33/d48/d8b/de3/de4/f135 x:0 0 0 2024-04-20T21:59:14.862 INFO:tasks.workunit.client.1.smithi164.stdout:4/950: mknod d4/d9/da4/c137 0 2024-04-20T21:59:14.867 INFO:tasks.workunit.client.1.smithi164.stdout:8/992: dwrite d0/d14/d4e/d62/d8f/dbe/f139 [0,4194304] 0 2024-04-20T21:59:14.871 INFO:tasks.workunit.client.1.smithi164.stdout:4/951: fdatasync d4/d9/d5c/fab 0 2024-04-20T21:59:14.872 INFO:tasks.workunit.client.1.smithi164.stdout:1/973: symlink d10/d16/d19/l136 0 2024-04-20T21:59:14.888 INFO:tasks.workunit.client.1.smithi164.stdout:0/990: dwrite d1/d4/df/fe6 [0,4194304] 0 2024-04-20T21:59:14.954 INFO:tasks.workunit.client.1.smithi164.stdout:1/974: unlink d10/d16/d19/de0/d34/da9/fc3 0 2024-04-20T21:59:14.971 INFO:tasks.workunit.client.1.smithi164.stdout:1/975: unlink d10/d16/d20/f69 0 2024-04-20T21:59:14.973 INFO:tasks.workunit.client.1.smithi164.stdout:1/976: dread - d10/d16/f123 zero size 2024-04-20T21:59:14.986 INFO:tasks.workunit.client.1.smithi164.stdout:1/977: creat d10/d33/d48/f137 x:0 0 0 2024-04-20T21:59:14.991 INFO:tasks.workunit.client.1.smithi164.stdout:0/991: getdents d1/d4/d26/d29/d2d/d9b 0 2024-04-20T21:59:14.998 INFO:tasks.workunit.client.1.smithi164.stdout:0/992: mkdir d1/d4/d26/d29/d2d/d9b/d11c 0 2024-04-20T21:59:15.001 INFO:tasks.workunit.client.1.smithi164.stdout:0/993: chown d1/d4/d26/d29/d2d/d54/dca 501968 1 2024-04-20T21:59:15.016 INFO:tasks.workunit.client.1.smithi164.stdout:0/994: dread d1/d4/f2c [0,4194304] 0 2024-04-20T21:59:15.022 INFO:tasks.workunit.client.1.smithi164.stdout:0/995: creat d1/d4/da/d5c/d116/f11d x:0 0 0 2024-04-20T21:59:15.027 INFO:tasks.workunit.client.1.smithi164.stdout:4/952: mkdir d4/d9/d5c/d97/dbf/d67/d86/def/dad/d138 0 2024-04-20T21:59:15.030 INFO:tasks.workunit.client.1.smithi164.stdout:4/953: read - d4/d9/d5c/d97/fe9 zero size 2024-04-20T21:59:15.039 INFO:tasks.workunit.client.1.smithi164.stdout:4/954: link d4/d9/d5c/d97/dbf/d5f/c65 d4/d9/d5c/d97/dbf/d67/d86/def/dad/df6/c139 0 2024-04-20T21:59:15.040 INFO:tasks.workunit.client.1.smithi164.stdout:8/993: write d0/f4d [3582652,94178] 0 2024-04-20T21:59:15.044 INFO:tasks.workunit.client.1.smithi164.stdout:8/994: chown d0/le2 3995 1 2024-04-20T21:59:15.046 INFO:tasks.workunit.client.1.smithi164.stdout:4/955: mknod d4/d9/d5c/d97/dbf/d67/d86/def/dad/de1/d10e/c13a 0 2024-04-20T21:59:15.047 INFO:tasks.workunit.client.1.smithi164.stdout:8/995: write d0/d14/df6/ff8 [1537222,75583] 0 2024-04-20T21:59:15.050 INFO:tasks.workunit.client.1.smithi164.stdout:4/956: fsync d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41/fa0 0 2024-04-20T21:59:15.053 INFO:tasks.workunit.client.1.smithi164.stdout:8/996: creat d0/d14/dee/f14d x:0 0 0 2024-04-20T21:59:15.056 INFO:tasks.workunit.client.1.smithi164.stdout:4/957: unlink d4/d9/d5c/d97/dbf/d67/d86/dc3/f118 0 2024-04-20T21:59:15.062 INFO:tasks.workunit.client.1.smithi164.stdout:4/958: creat d4/d108/d119/f13b x:0 0 0 2024-04-20T21:59:15.064 INFO:tasks.workunit.client.1.smithi164.stdout:4/959: read - d4/d9/d22/f56 zero size 2024-04-20T21:59:15.069 INFO:tasks.workunit.client.1.smithi164.stdout:4/960: mkdir d4/d9/d22/d13c 0 2024-04-20T21:59:15.076 INFO:tasks.workunit.client.1.smithi164.stdout:0/996: unlink d1/lac 0 2024-04-20T21:59:15.077 INFO:tasks.workunit.client.1.smithi164.stdout:4/961: creat d4/d9/d5c/d97/dbf/d67/d86/def/dad/df6/f13d x:0 0 0 2024-04-20T21:59:15.080 INFO:tasks.workunit.client.1.smithi164.stdout:1/978: dwrite d10/d16/d19/d1a/f32 [0,4194304] 0 2024-04-20T21:59:15.081 INFO:tasks.workunit.client.1.smithi164.stdout:4/962: mknod d4/d9/d42/c13e 0 2024-04-20T21:59:15.086 INFO:tasks.workunit.client.1.smithi164.stdout:0/997: getdents d1/d4/d26/d29/d2d/d54/d77 0 2024-04-20T21:59:15.086 INFO:tasks.workunit.client.1.smithi164.stdout:8/997: write d0/f56 [1077176,102030] 0 2024-04-20T21:59:15.091 INFO:tasks.workunit.client.1.smithi164.stdout:8/998: read d0/d14/d4e/d62/f5e [441619,37481] 0 2024-04-20T21:59:15.091 INFO:tasks.workunit.client.1.smithi164.stdout:0/998: creat d1/d4/da/d5c/d6e/d118/f11e x:0 0 0 2024-04-20T21:59:15.096 INFO:tasks.workunit.client.1.smithi164.stdout:4/963: dread d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41/f6e [0,4194304] 0 2024-04-20T21:59:15.096 INFO:tasks.workunit.client.1.smithi164.stdout:0/999: mkdir d1/d4/d26/d29/d2d/d54/d11f 0 2024-04-20T21:59:15.097 INFO:tasks.workunit.client.1.smithi164.stdout:8/999: symlink d0/d14/d16/d58/d94/da5/dad/d116/d11f/l14e 0 2024-04-20T21:59:15.100 INFO:tasks.workunit.client.1.smithi164.stdout:4/964: read d4/d9/d5c/d97/dbf/d67/d86/def/f6b [3646345,63656] 0 2024-04-20T21:59:15.119 INFO:tasks.workunit.client.1.smithi164.stdout:4/965: dwrite d4/d9/f103 [0,4194304] 0 2024-04-20T21:59:15.130 INFO:tasks.workunit.client.1.smithi164.stdout:4/966: symlink d4/d9/d5c/d97/dbf/d67/d86/def/dad/d138/l13f 0 2024-04-20T21:59:15.137 INFO:tasks.workunit.client.1.smithi164.stdout:4/967: creat d4/d9/d5c/d97/dbf/d67/d86/def/dad/df6/f140 x:0 0 0 2024-04-20T21:59:15.142 INFO:tasks.workunit.client.1.smithi164.stdout:4/968: rmdir d4/d9/d5c/d97/dbf/d67/d86/def/dad/de1 39 2024-04-20T21:59:15.150 INFO:tasks.workunit.client.1.smithi164.stdout:4/969: rename d4/d9/f1b to d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41/f141 0 2024-04-20T21:59:15.161 INFO:tasks.workunit.client.1.smithi164.stdout:4/970: truncate d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d4a/f95 338348 0 2024-04-20T21:59:15.171 INFO:tasks.workunit.client.1.smithi164.stdout:4/971: link d4/f15 d4/d9/d5c/d97/dbf/d5f/dcc/deb/f142 0 2024-04-20T21:59:15.179 INFO:tasks.workunit.client.1.smithi164.stdout:4/972: mkdir d4/d9/d5c/d97/dbf/d67/d86/dc3/d143 0 2024-04-20T21:59:15.184 INFO:tasks.workunit.client.1.smithi164.stdout:1/979: sync 2024-04-20T21:59:15.184 INFO:tasks.workunit.client.1.smithi164.stdout:4/973: stat d4/d9/d5c/d97/dbf/d67/d86/def/f76 0 2024-04-20T21:59:15.221 INFO:tasks.workunit.client.1.smithi164.stdout:4/974: dwrite d4/d9/d117/f10c [0,4194304] 0 2024-04-20T21:59:15.224 INFO:tasks.workunit.client.1.smithi164.stdout:1/980: dread d10/d16/f72 [0,4194304] 0 2024-04-20T21:59:15.228 INFO:tasks.workunit.client.1.smithi164.stdout:1/981: write d10/f73 [513043,56321] 0 2024-04-20T21:59:15.234 INFO:tasks.workunit.client.1.smithi164.stdout:1/982: mkdir d10/d33/d48/d138 0 2024-04-20T21:59:15.238 INFO:tasks.workunit.client.1.smithi164.stdout:4/975: write d4/d9/f1e [3486687,3065] 0 2024-04-20T21:59:15.239 INFO:tasks.workunit.client.1.smithi164.stdout:1/983: write d10/d33/d41/f12e [1025758,112479] 0 2024-04-20T21:59:15.247 INFO:tasks.workunit.client.1.smithi164.stdout:4/976: rename d4/f36 to d4/d9/d22/d13c/f144 0 2024-04-20T21:59:15.252 INFO:tasks.workunit.client.1.smithi164.stdout:1/984: mkdir d10/d16/d19/de0/d34/da9/d139 0 2024-04-20T21:59:15.252 INFO:tasks.workunit.client.1.smithi164.stdout:4/977: symlink d4/d108/l145 0 2024-04-20T21:59:15.258 INFO:tasks.workunit.client.1.smithi164.stdout:1/985: write d10/d16/d19/d1a/f32 [2272874,79129] 0 2024-04-20T21:59:15.265 INFO:tasks.workunit.client.1.smithi164.stdout:1/986: readlink d10/d16/d20/d91/d9d/ldd 0 2024-04-20T21:59:15.267 INFO:tasks.workunit.client.1.smithi164.stdout:1/987: stat d10/d16/d20/d91/c125 0 2024-04-20T21:59:15.273 INFO:tasks.workunit.client.1.smithi164.stdout:1/988: creat d10/d16/d20/d25/d95/dd9/f13a x:0 0 0 2024-04-20T21:59:15.278 INFO:tasks.workunit.client.1.smithi164.stdout:1/989: read d10/d16/f43 [49077,101766] 0 2024-04-20T21:59:15.288 INFO:tasks.workunit.client.1.smithi164.stdout:1/990: write d10/d16/d20/d91/faf [7479049,54134] 0 2024-04-20T21:59:15.292 INFO:tasks.workunit.client.1.smithi164.stdout:4/978: dwrite d4/d9/d5c/d97/dbf/d67/d86/def/d3e/f130 [0,4194304] 0 2024-04-20T21:59:15.397 INFO:tasks.workunit.client.1.smithi164.stdout:1/991: write d10/d33/d41/f58 [2017575,30055] 0 2024-04-20T21:59:15.406 INFO:tasks.workunit.client.1.smithi164.stdout:4/979: dwrite d4/d9/d5c/d97/dbf/d67/d86/def/d3e/fae [4194304,4194304] 0 2024-04-20T21:59:15.411 INFO:tasks.workunit.client.1.smithi164.stdout:1/992: dread d10/d16/d19/de0/f74 [0,4194304] 0 2024-04-20T21:59:15.414 INFO:tasks.workunit.client.1.smithi164.stdout:1/993: creat d10/d16/d19/de0/f13b x:0 0 0 2024-04-20T21:59:15.421 INFO:tasks.workunit.client.1.smithi164.stdout:4/980: dread d4/d9/d22/f77 [0,4194304] 0 2024-04-20T21:59:15.425 INFO:tasks.workunit.client.1.smithi164.stdout:4/981: symlink d4/d9/d5c/d97/dbf/d67/d86/dc3/l146 0 2024-04-20T21:59:15.435 INFO:tasks.workunit.client.1.smithi164.stdout:4/982: write d4/d9/d5c/d97/dbf/d67/d86/def/fe2 [3802871,116925] 0 2024-04-20T21:59:15.437 INFO:tasks.workunit.client.1.smithi164.stdout:4/983: fsync d4/d9/d22/db5/f105 0 2024-04-20T21:59:15.440 INFO:tasks.workunit.client.1.smithi164.stdout:4/984: write d4/d9/d5c/d97/dbf/d67/d86/def/d3e/f130 [1956774,74492] 0 2024-04-20T21:59:15.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:15 smithi164 ceph-mon[23506]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:59:15.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:15 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/3278246731' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T21:59:15.462 INFO:tasks.workunit.client.1.smithi164.stdout:4/985: dread d4/d9/d5c/d97/dbf/f92 [0,4194304] 0 2024-04-20T21:59:15.465 INFO:tasks.workunit.client.1.smithi164.stdout:4/986: mkdir d4/d9/d22/dc2/d147 0 2024-04-20T21:59:15.486 INFO:tasks.workunit.client.1.smithi164.stdout:4/987: dwrite d4/d9/d22/f56 [0,4194304] 0 2024-04-20T21:59:15.494 INFO:tasks.workunit.client.1.smithi164.stdout:4/988: mknod d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d4a/c148 0 2024-04-20T21:59:15.511 INFO:tasks.workunit.client.1.smithi164.stdout:1/994: sync 2024-04-20T21:59:15.515 INFO:tasks.workunit.client.1.smithi164.stdout:1/995: chown d10/d16/d19/d1a/d51/c130 4789904 1 2024-04-20T21:59:15.519 INFO:tasks.workunit.client.1.smithi164.stdout:1/996: read - d10/d33/d41/f55 zero size 2024-04-20T21:59:15.526 INFO:tasks.workunit.client.1.smithi164.stdout:4/989: dwrite d4/d9/d5c/d97/dbf/d67/d86/def/f58 [0,4194304] 0 2024-04-20T21:59:15.527 INFO:tasks.workunit.client.1.smithi164.stdout:1/997: chown d10/d16/d19/de0/d34/da9/fd3 337 1 2024-04-20T21:59:15.530 INFO:tasks.workunit.client.1.smithi164.stdout:4/990: dread - d4/d9/d5c/d97/dbf/d67/d86/def/dad/d132/f12c zero size 2024-04-20T21:59:15.552 INFO:tasks.workunit.client.1.smithi164.stdout:1/998: dwrite d10/d16/d19/de0/fe5 [0,4194304] 0 2024-04-20T21:59:15.556 INFO:tasks.workunit.client.1.smithi164.stdout:1/999: readlink d10/d16/d19/l45 0 2024-04-20T21:59:15.561 INFO:tasks.workunit.client.1.smithi164.stdout:4/991: dwrite d4/d9/d117/f7a [0,4194304] 0 2024-04-20T21:59:15.583 INFO:tasks.workunit.client.1.smithi164.stdout:4/992: dread d4/d9/d5c/d97/dbf/f92 [0,4194304] 0 2024-04-20T21:59:15.592 INFO:tasks.workunit.client.1.smithi164.stdout:4/993: unlink d4/d9/d117/d37/led 0 2024-04-20T21:59:15.608 INFO:tasks.workunit.client.1.smithi164.stdout:4/994: link d4/d9/d5c/d97/dbf/d67/l7e d4/d9/d5c/d97/dbf/d67/d86/def/d3e/d41/l149 0 2024-04-20T21:59:15.625 INFO:tasks.workunit.client.1.smithi164.stdout:4/995: write d4/d9/d5c/d97/dbf/d9b/dd0/fd2 [855151,95183] 0 2024-04-20T21:59:15.636 INFO:tasks.workunit.client.1.smithi164.stdout:4/996: creat d4/d9/d5c/d97/dbf/d67/f14a x:0 0 0 2024-04-20T21:59:15.641 INFO:tasks.workunit.client.1.smithi164.stdout:4/997: chown d4/d9/d5c/d97/dbf/d67/d86/dc3 2134057693 1 2024-04-20T21:59:15.675 INFO:tasks.workunit.client.1.smithi164.stdout:4/998: dread d4/d9/d5c/d97/dbf/d67/fc1 [0,4194304] 0 2024-04-20T21:59:15.685 INFO:tasks.workunit.client.1.smithi164.stdout:4/999: mkdir d4/d9/d22/d10b/d12a/d14b 0 2024-04-20T21:59:15.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:15 smithi142 ceph-mon[15828]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:59:15.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:15 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/3278246731' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T21:59:15.700 INFO:tasks.workunit.client.1.smithi164.stderr:+ rm -rf -- ./tmp.lgAE8GKzHj 2024-04-20T21:59:16.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:16 smithi142 ceph-mon[15828]: pgmap v15: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 56 MiB/s rd, 137 MiB/s wr, 319 op/s 2024-04-20T21:59:16.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:16 smithi164 ceph-mon[23506]: pgmap v15: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 56 MiB/s rd, 137 MiB/s wr, 319 op/s 2024-04-20T21:59:18.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:18 smithi142 ceph-mon[15828]: pgmap v16: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 64 MiB/s rd, 146 MiB/s wr, 346 op/s 2024-04-20T21:59:18.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:18 smithi164 ceph-mon[23506]: pgmap v16: 65 pgs: 65 active+clean; 3.0 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 64 MiB/s rd, 146 MiB/s wr, 346 op/s 2024-04-20T21:59:20.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:20 smithi142 ceph-mon[15828]: pgmap v17: 65 pgs: 65 active+clean; 3.0 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 65 MiB/s rd, 154 MiB/s wr, 404 op/s 2024-04-20T21:59:20.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:20 smithi164 ceph-mon[23506]: pgmap v17: 65 pgs: 65 active+clean; 3.0 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 65 MiB/s rd, 154 MiB/s wr, 404 op/s 2024-04-20T21:59:21.474 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:21 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:59:21.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:21 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:59:22.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:22 smithi142 ceph-mon[15828]: pgmap v18: 65 pgs: 65 active+clean; 3.0 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 42 MiB/s rd, 98 MiB/s wr, 265 op/s 2024-04-20T21:59:22.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:22 smithi164 ceph-mon[23506]: pgmap v18: 65 pgs: 65 active+clean; 3.0 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 42 MiB/s rd, 98 MiB/s wr, 265 op/s 2024-04-20T21:59:23.546 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-20T21:59:23.546 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-20T21:59:24.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:24 smithi142 ceph-mon[15828]: pgmap v19: 65 pgs: 65 active+clean; 2.3 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 42 MiB/s rd, 99 MiB/s wr, 318 op/s 2024-04-20T21:59:24.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:24 smithi164 ceph-mon[23506]: pgmap v19: 65 pgs: 65 active+clean; 2.3 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 42 MiB/s rd, 99 MiB/s wr, 318 op/s 2024-04-20T21:59:26.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:26 smithi164 ceph-mon[23506]: pgmap v20: 65 pgs: 65 active+clean; 2.3 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 15 MiB/s rd, 33 MiB/s wr, 158 op/s 2024-04-20T21:59:26.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:26 smithi142 ceph-mon[15828]: pgmap v20: 65 pgs: 65 active+clean; 2.3 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 15 MiB/s rd, 33 MiB/s wr, 158 op/s 2024-04-20T21:59:28.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:28 smithi142 ceph-mon[15828]: pgmap v21: 65 pgs: 65 active+clean; 2.2 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 15 MiB/s rd, 33 MiB/s wr, 165 op/s 2024-04-20T21:59:28.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:28 smithi164 ceph-mon[23506]: pgmap v21: 65 pgs: 65 active+clean; 2.2 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 15 MiB/s rd, 33 MiB/s wr, 165 op/s 2024-04-20T21:59:30.778 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:30 smithi164 ceph-mon[23506]: pgmap v22: 65 pgs: 65 active+clean; 1.7 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 7.2 MiB/s rd, 24 MiB/s wr, 194 op/s 2024-04-20T21:59:30.778 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:30 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:30.778 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:30 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:30.778 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:30 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-20T21:59:30.778 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:30 smithi164 ceph-mon[23506]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-20T21:59:30.778 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:30 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:59:30.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:30 smithi142 ceph-mon[15828]: pgmap v22: 65 pgs: 65 active+clean; 1.7 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 7.2 MiB/s rd, 24 MiB/s wr, 194 op/s 2024-04-20T21:59:30.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:30 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:30.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:30 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:30.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:30 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-20T21:59:30.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:30 smithi142 ceph-mon[15828]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-20T21:59:30.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:30 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:59:32.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:32 smithi164 ceph-mon[23506]: pgmap v23: 65 pgs: 65 active+clean; 1.7 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 16 KiB/s rd, 813 KiB/s wr, 116 op/s 2024-04-20T21:59:32.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:32 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi164.oejajr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T21:59:32.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:32 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T21:59:32.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:32 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:59:32.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:32 smithi142 ceph-mon[15828]: pgmap v23: 65 pgs: 65 active+clean; 1.7 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 16 KiB/s rd, 813 KiB/s wr, 116 op/s 2024-04-20T21:59:32.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:32 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi164.oejajr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T21:59:32.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:32 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T21:59:32.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:32 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:59:33.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:33 smithi164 ceph-mon[23506]: Upgrade: Updating mgr.smithi164.oejajr 2024-04-20T21:59:33.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:33 smithi164 ceph-mon[23506]: Deploying daemon mgr.smithi164.oejajr on smithi164 2024-04-20T21:59:33.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:33 smithi142 ceph-mon[15828]: Upgrade: Updating mgr.smithi164.oejajr 2024-04-20T21:59:33.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:33 smithi142 ceph-mon[15828]: Deploying daemon mgr.smithi164.oejajr on smithi164 2024-04-20T21:59:34.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:34 smithi142 ceph-mon[15828]: pgmap v24: 65 pgs: 65 active+clean; 1.5 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 193 op/s 2024-04-20T21:59:34.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:34 smithi164 ceph-mon[23506]: pgmap v24: 65 pgs: 65 active+clean; 1.5 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 26 KiB/s rd, 1.2 MiB/s wr, 193 op/s 2024-04-20T21:59:36.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:36 smithi164 ceph-mon[23506]: pgmap v25: 65 pgs: 65 active+clean; 1.5 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 18 KiB/s rd, 806 KiB/s wr, 139 op/s 2024-04-20T21:59:36.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:36 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:59:36.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:36 smithi142 ceph-mon[15828]: pgmap v25: 65 pgs: 65 active+clean; 1.5 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 18 KiB/s rd, 806 KiB/s wr, 139 op/s 2024-04-20T21:59:36.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:36 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:59:38.587 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:38 smithi164 ceph-mon[23506]: pgmap v26: 65 pgs: 65 active+clean; 1.4 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 28 KiB/s rd, 816 KiB/s wr, 162 op/s 2024-04-20T21:59:38.847 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:38 smithi142 ceph-mon[15828]: pgmap v26: 65 pgs: 65 active+clean; 1.4 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 28 KiB/s rd, 816 KiB/s wr, 162 op/s 2024-04-20T21:59:39.863 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:39 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:39.863 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:39 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:39.864 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:39 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:59:39.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:39 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:39.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:39 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:39.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:39 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:59:40.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:40 smithi164 ceph-mon[23506]: pgmap v27: 65 pgs: 65 active+clean; 1.1 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 217 op/s 2024-04-20T21:59:40.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:40 smithi142 ceph-mon[15828]: pgmap v27: 65 pgs: 65 active+clean; 1.1 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 217 op/s 2024-04-20T21:59:42.834 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:42 smithi164 ceph-mon[23506]: pgmap v28: 65 pgs: 65 active+clean; 1.1 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 19 KiB/s rd, 819 KiB/s wr, 160 op/s 2024-04-20T21:59:42.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:42 smithi142 ceph-mon[15828]: pgmap v28: 65 pgs: 65 active+clean; 1.1 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 19 KiB/s rd, 819 KiB/s wr, 160 op/s 2024-04-20T21:59:44.876 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:44 smithi164 ceph-mon[23506]: pgmap v29: 65 pgs: 65 active+clean; 744 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.1 MiB/s wr, 236 op/s 2024-04-20T21:59:44.876 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:44 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:44.876 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:44 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:44.886 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:44 smithi142 ceph-mon[15828]: pgmap v29: 65 pgs: 65 active+clean; 744 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.1 MiB/s wr, 236 op/s 2024-04-20T21:59:44.886 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:44 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:44.886 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:44 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:44.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.979+0000 7fbdb2a00700 1 -- 172.21.15.142:0/755585109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdac101e70 msgr2=0x7fbdac1022d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:44.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.979+0000 7fbdb2a00700 1 --2- 172.21.15.142:0/755585109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdac101e70 0x7fbdac1022d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009910 tx=0x7fbd98009c20 comp rx=0 tx=0).stop 2024-04-20T21:59:44.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.979+0000 7fbdb2a00700 1 -- 172.21.15.142:0/755585109 shutdown_connections 2024-04-20T21:59:44.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.979+0000 7fbdb2a00700 1 --2- 172.21.15.142:0/755585109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdac101e70 0x7fbdac1022d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:44.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.979+0000 7fbdb2a00700 1 --2- 172.21.15.142:0/755585109 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdac100c70 0x7fbdac101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:44.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.979+0000 7fbdb2a00700 1 -- 172.21.15.142:0/755585109 >> 172.21.15.142:0/755585109 conn(0x7fbdac0fc1f0 msgr2=0x7fbdac0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:44.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.979+0000 7fbdb2a00700 1 -- 172.21.15.142:0/755585109 shutdown_connections 2024-04-20T21:59:44.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.979+0000 7fbdb2a00700 1 -- 172.21.15.142:0/755585109 wait complete. 2024-04-20T21:59:44.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.980+0000 7fbdb2a00700 1 Processor -- start 2024-04-20T21:59:44.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.981+0000 7fbdb2a00700 1 -- start start 2024-04-20T21:59:44.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.981+0000 7fbdb2a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdac100c70 0x7fbdac196600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:44.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.981+0000 7fbdb2a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdac101e70 0x7fbdac196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:44.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.981+0000 7fbdb2a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac197160 con 0x7fbdac100c70 2024-04-20T21:59:44.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.981+0000 7fbdb2a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac1972a0 con 0x7fbdac101e70 2024-04-20T21:59:44.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.981+0000 7fbdabe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdac100c70 0x7fbdac196600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:44.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.981+0000 7fbdabe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdac100c70 0x7fbdac196600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60958/0 (socket says 172.21.15.142:60958) 2024-04-20T21:59:44.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.981+0000 7fbdabe00700 1 -- 172.21.15.142:0/377229303 learned_addr learned my addr 172.21.15.142:0/377229303 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:59:44.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.982+0000 7fbdab400700 1 --2- 172.21.15.142:0/377229303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdac101e70 0x7fbdac196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:44.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.982+0000 7fbdabe00700 1 -- 172.21.15.142:0/377229303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdac101e70 msgr2=0x7fbdac196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:44.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.982+0000 7fbdabe00700 1 --2- 172.21.15.142:0/377229303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdac101e70 0x7fbdac196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:44.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.982+0000 7fbdabe00700 1 -- 172.21.15.142:0/377229303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd980095f0 con 0x7fbdac100c70 2024-04-20T21:59:44.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.983+0000 7fbdabe00700 1 --2- 172.21.15.142:0/377229303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdac100c70 0x7fbdac196600 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00d900 tx=0x7fbd9c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:44.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.983+0000 7fbda8c00700 1 -- 172.21.15.142:0/377229303 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd9c0041f0 con 0x7fbdac100c70 2024-04-20T21:59:44.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.983+0000 7fbda8c00700 1 -- 172.21.15.142:0/377229303 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbd9c004350 con 0x7fbdac100c70 2024-04-20T21:59:44.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.983+0000 7fbdb2a00700 1 -- 172.21.15.142:0/377229303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdac19bd00 con 0x7fbdac100c70 2024-04-20T21:59:44.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.983+0000 7fbda8c00700 1 -- 172.21.15.142:0/377229303 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd9c003cf0 con 0x7fbdac100c70 2024-04-20T21:59:44.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.984+0000 7fbdb2a00700 1 -- 172.21.15.142:0/377229303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdac19c270 con 0x7fbdac100c70 2024-04-20T21:59:44.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.985+0000 7fbdb2a00700 1 -- 172.21.15.142:0/377229303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdac04ec20 con 0x7fbdac100c70 2024-04-20T21:59:44.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.988+0000 7fbda8c00700 1 -- 172.21.15.142:0/377229303 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 30) v1 ==== 92710+0+0 (secure 0 0 0) 0x7fbd9c009730 con 0x7fbdac100c70 2024-04-20T21:59:44.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.990+0000 7fbda8c00700 1 --2- 172.21.15.142:0/377229303 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fbd9006eac0 0x7fbd90070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:44.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.990+0000 7fbda8c00700 1 -- 172.21.15.142:0/377229303 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fbd9c08e9a0 con 0x7fbdac100c70 2024-04-20T21:59:44.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.991+0000 7fbdab400700 1 --2- 172.21.15.142:0/377229303 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fbd9006eac0 0x7fbd90070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:44.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.992+0000 7fbdab400700 1 --2- 172.21.15.142:0/377229303 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fbd9006eac0 0x7fbd90070f80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbd98006010 tx=0x7fbd98005180 comp rx=0 tx=0).ready entity=mgr.14722 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:44.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:44.997+0000 7fbda8c00700 1 -- 172.21.15.142:0/377229303 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fbdac04ec20 con 0x7fbdac100c70 2024-04-20T21:59:45.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.406+0000 7fbdb2a00700 1 -- 172.21.15.142:0/377229303 --> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdac04ebb0 con 0x7fbd9006eac0 2024-04-20T21:59:45.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.408+0000 7fbda8c00700 1 -- 172.21.15.142:0/377229303 <== mgr.14722 v2:172.21.15.142:6800/54392364 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fbdac04ebb0 con 0x7fbd9006eac0 2024-04-20T21:59:45.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.411+0000 7fbdb2a00700 1 -- 172.21.15.142:0/377229303 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fbd9006eac0 msgr2=0x7fbd90070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:45.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.411+0000 7fbdb2a00700 1 --2- 172.21.15.142:0/377229303 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fbd9006eac0 0x7fbd90070f80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbd98006010 tx=0x7fbd98005180 comp rx=0 tx=0).stop 2024-04-20T21:59:45.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.411+0000 7fbdb2a00700 1 -- 172.21.15.142:0/377229303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdac100c70 msgr2=0x7fbdac196600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:45.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.411+0000 7fbdb2a00700 1 --2- 172.21.15.142:0/377229303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdac100c70 0x7fbdac196600 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00d900 tx=0x7fbd9c00dc10 comp rx=0 tx=0).stop 2024-04-20T21:59:45.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.411+0000 7fbdb2a00700 1 -- 172.21.15.142:0/377229303 shutdown_connections 2024-04-20T21:59:45.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.411+0000 7fbdb2a00700 1 --2- 172.21.15.142:0/377229303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdac100c70 0x7fbdac196600 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:45.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.411+0000 7fbdb2a00700 1 --2- 172.21.15.142:0/377229303 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fbd9006eac0 0x7fbd90070f80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:45.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.411+0000 7fbdb2a00700 1 --2- 172.21.15.142:0/377229303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdac101e70 0x7fbdac196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:45.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.411+0000 7fbdb2a00700 1 -- 172.21.15.142:0/377229303 >> 172.21.15.142:0/377229303 conn(0x7fbdac0fc1f0 msgr2=0x7fbdac105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:45.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.411+0000 7fbdb2a00700 1 -- 172.21.15.142:0/377229303 shutdown_connections 2024-04-20T21:59:45.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.411+0000 7fbdb2a00700 1 -- 172.21.15.142:0/377229303 wait complete. 2024-04-20T21:59:45.429 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T21:59:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.592+0000 7fbeaa000700 1 -- 172.21.15.142:0/1864820234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbea4101e00 msgr2=0x7fbea4102260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.592+0000 7fbeaa000700 1 --2- 172.21.15.142:0/1864820234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbea4101e00 0x7fbea4102260 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009910 tx=0x7fbe90009c20 comp rx=0 tx=0).stop 2024-04-20T21:59:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.592+0000 7fbeaa000700 1 -- 172.21.15.142:0/1864820234 shutdown_connections 2024-04-20T21:59:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.592+0000 7fbeaa000700 1 --2- 172.21.15.142:0/1864820234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbea4101e00 0x7fbea4102260 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.592+0000 7fbeaa000700 1 --2- 172.21.15.142:0/1864820234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbea4100c00 0x7fbea4101020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.592+0000 7fbeaa000700 1 -- 172.21.15.142:0/1864820234 >> 172.21.15.142:0/1864820234 conn(0x7fbea40fc1c0 msgr2=0x7fbea40fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.593+0000 7fbeaa000700 1 -- 172.21.15.142:0/1864820234 shutdown_connections 2024-04-20T21:59:45.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.593+0000 7fbeaa000700 1 -- 172.21.15.142:0/1864820234 wait complete. 2024-04-20T21:59:45.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.594+0000 7fbeaa000700 1 Processor -- start 2024-04-20T21:59:45.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.595+0000 7fbeaa000700 1 -- start start 2024-04-20T21:59:45.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.595+0000 7fbeaa000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbea4100c00 0x7fbea4198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:45.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.595+0000 7fbeaa000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbea4101e00 0x7fbea4198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:45.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.595+0000 7fbeaa000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea41993d0 con 0x7fbea4101e00 2024-04-20T21:59:45.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.595+0000 7fbeaa000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea4199510 con 0x7fbea4100c00 2024-04-20T21:59:45.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.595+0000 7fbea2a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbea4101e00 0x7fbea4198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:45.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.595+0000 7fbea2a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbea4101e00 0x7fbea4198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60978/0 (socket says 172.21.15.142:60978) 2024-04-20T21:59:45.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.595+0000 7fbea2a00700 1 -- 172.21.15.142:0/2606519710 learned_addr learned my addr 172.21.15.142:0/2606519710 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:59:45.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.596+0000 7fbea3400700 1 --2- 172.21.15.142:0/2606519710 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbea4100c00 0x7fbea4198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:45.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.596+0000 7fbea2a00700 1 -- 172.21.15.142:0/2606519710 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbea4100c00 msgr2=0x7fbea4198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:45.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.596+0000 7fbea2a00700 1 --2- 172.21.15.142:0/2606519710 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbea4100c00 0x7fbea4198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:45.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.596+0000 7fbea2a00700 1 -- 172.21.15.142:0/2606519710 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe900095f0 con 0x7fbea4101e00 2024-04-20T21:59:45.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.596+0000 7fbea2a00700 1 --2- 172.21.15.142:0/2606519710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbea4101e00 0x7fbea4198db0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000bd70 tx=0x7fbe9000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:45.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.596+0000 7fbe9be00700 1 -- 172.21.15.142:0/2606519710 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe9001d070 con 0x7fbea4101e00 2024-04-20T21:59:45.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.597+0000 7fbe9be00700 1 -- 172.21.15.142:0/2606519710 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe9000f460 con 0x7fbea4101e00 2024-04-20T21:59:45.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.597+0000 7fbe9be00700 1 -- 172.21.15.142:0/2606519710 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe90021620 con 0x7fbea4101e00 2024-04-20T21:59:45.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.597+0000 7fbeaa000700 1 -- 172.21.15.142:0/2606519710 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea419dec0 con 0x7fbea4101e00 2024-04-20T21:59:45.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.597+0000 7fbeaa000700 1 -- 172.21.15.142:0/2606519710 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea419e3b0 con 0x7fbea4101e00 2024-04-20T21:59:45.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.598+0000 7fbeaa000700 1 -- 172.21.15.142:0/2606519710 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea41067d0 con 0x7fbea4101e00 2024-04-20T21:59:45.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.599+0000 7fbe9be00700 1 -- 172.21.15.142:0/2606519710 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 30) v1 ==== 92710+0+0 (secure 0 0 0) 0x7fbe9000fa70 con 0x7fbea4101e00 2024-04-20T21:59:45.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.600+0000 7fbe9be00700 1 --2- 172.21.15.142:0/2606519710 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fbe8806ea70 0x7fbe88070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:45.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.600+0000 7fbe9be00700 1 -- 172.21.15.142:0/2606519710 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fbe9008fed0 con 0x7fbea4101e00 2024-04-20T21:59:45.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.601+0000 7fbea3400700 1 --2- 172.21.15.142:0/2606519710 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fbe8806ea70 0x7fbe88070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:45.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.602+0000 7fbea3400700 1 --2- 172.21.15.142:0/2606519710 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fbe8806ea70 0x7fbe88070f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbe94005fd0 tx=0x7fbe9400a560 comp rx=0 tx=0).ready entity=mgr.14722 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:45.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.606+0000 7fbe9be00700 1 -- 172.21.15.142:0/2606519710 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fbe9005caa0 con 0x7fbea4101e00 2024-04-20T21:59:45.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.931+0000 7fbeaa000700 1 -- 172.21.15.142:0/2606519710 --> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbea402ce50 con 0x7fbe8806ea70 2024-04-20T21:59:45.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.932+0000 7fbe9be00700 1 -- 172.21.15.142:0/2606519710 <== mgr.14722 v2:172.21.15.142:6800/54392364 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fbea402ce50 con 0x7fbe8806ea70 2024-04-20T21:59:45.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.935+0000 7fbeaa000700 1 -- 172.21.15.142:0/2606519710 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fbe8806ea70 msgr2=0x7fbe88070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:45.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.935+0000 7fbeaa000700 1 --2- 172.21.15.142:0/2606519710 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fbe8806ea70 0x7fbe88070f30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbe94005fd0 tx=0x7fbe9400a560 comp rx=0 tx=0).stop 2024-04-20T21:59:45.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.935+0000 7fbeaa000700 1 -- 172.21.15.142:0/2606519710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbea4101e00 msgr2=0x7fbea4198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:45.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.935+0000 7fbeaa000700 1 --2- 172.21.15.142:0/2606519710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbea4101e00 0x7fbea4198db0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000bd70 tx=0x7fbe9000be50 comp rx=0 tx=0).stop 2024-04-20T21:59:45.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.935+0000 7fbeaa000700 1 -- 172.21.15.142:0/2606519710 shutdown_connections 2024-04-20T21:59:45.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.935+0000 7fbeaa000700 1 --2- 172.21.15.142:0/2606519710 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fbe8806ea70 0x7fbe88070f30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:45.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.935+0000 7fbeaa000700 1 --2- 172.21.15.142:0/2606519710 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbea4100c00 0x7fbea4198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:45.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.935+0000 7fbeaa000700 1 --2- 172.21.15.142:0/2606519710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbea4101e00 0x7fbea4198db0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:45.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.935+0000 7fbeaa000700 1 -- 172.21.15.142:0/2606519710 >> 172.21.15.142:0/2606519710 conn(0x7fbea40fc1c0 msgr2=0x7fbea4073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:45.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.935+0000 7fbeaa000700 1 -- 172.21.15.142:0/2606519710 shutdown_connections 2024-04-20T21:59:45.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:45.935+0000 7fbeaa000700 1 -- 172.21.15.142:0/2606519710 wait complete. 2024-04-20T21:59:46.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.133+0000 7fb1f4400700 1 -- 172.21.15.142:0/531644150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1ec074f10 msgr2=0x7fb1ec073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:46.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.133+0000 7fb1f4400700 1 --2- 172.21.15.142:0/531644150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1ec074f10 0x7fb1ec073370 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009870 tx=0x7fb1e0009b80 comp rx=0 tx=0).stop 2024-04-20T21:59:46.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.133+0000 7fb1f4400700 1 -- 172.21.15.142:0/531644150 shutdown_connections 2024-04-20T21:59:46.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.133+0000 7fb1f4400700 1 --2- 172.21.15.142:0/531644150 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1ec073940 0x7fb1ec073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:46.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.133+0000 7fb1f4400700 1 --2- 172.21.15.142:0/531644150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1ec074f10 0x7fb1ec073370 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:46.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.133+0000 7fb1f4400700 1 -- 172.21.15.142:0/531644150 >> 172.21.15.142:0/531644150 conn(0x7fb1ec0fc1c0 msgr2=0x7fb1ec0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:46.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.136+0000 7fb1f4400700 1 -- 172.21.15.142:0/531644150 shutdown_connections 2024-04-20T21:59:46.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.136+0000 7fb1f4400700 1 -- 172.21.15.142:0/531644150 wait complete. 2024-04-20T21:59:46.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.137+0000 7fb1f4400700 1 Processor -- start 2024-04-20T21:59:46.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.137+0000 7fb1f4400700 1 -- start start 2024-04-20T21:59:46.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.138+0000 7fb1f4400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1ec073940 0x7fb1ec19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:46.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.138+0000 7fb1f4400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1ec074f10 0x7fb1ec19d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:46.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.138+0000 7fb1f4400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec19d780 con 0x7fb1ec073940 2024-04-20T21:59:46.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.138+0000 7fb1f4400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec19d8c0 con 0x7fb1ec074f10 2024-04-20T21:59:46.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.138+0000 7fb1f1a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1ec073940 0x7fb1ec19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:46.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.138+0000 7fb1f1a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1ec073940 0x7fb1ec19cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60996/0 (socket says 172.21.15.142:60996) 2024-04-20T21:59:46.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.138+0000 7fb1f1a00700 1 -- 172.21.15.142:0/1450367648 learned_addr learned my addr 172.21.15.142:0/1450367648 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:59:46.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.138+0000 7fb1f1000700 1 --2- 172.21.15.142:0/1450367648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1ec074f10 0x7fb1ec19d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:46.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.139+0000 7fb1f1a00700 1 -- 172.21.15.142:0/1450367648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1ec074f10 msgr2=0x7fb1ec19d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:46.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.139+0000 7fb1f1a00700 1 --2- 172.21.15.142:0/1450367648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1ec074f10 0x7fb1ec19d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:46.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.139+0000 7fb1f1a00700 1 -- 172.21.15.142:0/1450367648 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e0009520 con 0x7fb1ec073940 2024-04-20T21:59:46.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.139+0000 7fb1f1a00700 1 --2- 172.21.15.142:0/1450367648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1ec073940 0x7fb1ec19cc20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009230 tx=0x7fb1e000f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:46.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.139+0000 7fb1ea000700 1 -- 172.21.15.142:0/1450367648 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1e001c070 con 0x7fb1ec073940 2024-04-20T21:59:46.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.139+0000 7fb1ea000700 1 -- 172.21.15.142:0/1450367648 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1e000fe50 con 0x7fb1ec073940 2024-04-20T21:59:46.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.139+0000 7fb1ea000700 1 -- 172.21.15.142:0/1450367648 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1e00173f0 con 0x7fb1ec073940 2024-04-20T21:59:46.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.140+0000 7fb1f4400700 1 -- 172.21.15.142:0/1450367648 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ec1a22c0 con 0x7fb1ec073940 2024-04-20T21:59:46.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.140+0000 7fb1f4400700 1 -- 172.21.15.142:0/1450367648 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ec1a2830 con 0x7fb1ec073940 2024-04-20T21:59:46.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.141+0000 7fb1f4400700 1 -- 172.21.15.142:0/1450367648 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ec196d90 con 0x7fb1ec073940 2024-04-20T21:59:46.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.143+0000 7fb1ea000700 1 -- 172.21.15.142:0/1450367648 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 30) v1 ==== 92710+0+0 (secure 0 0 0) 0x7fb1e0020070 con 0x7fb1ec073940 2024-04-20T21:59:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.144+0000 7fb1ea000700 1 --2- 172.21.15.142:0/1450367648 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fb1d406ea80 0x7fb1d4070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.144+0000 7fb1ea000700 1 -- 172.21.15.142:0/1450367648 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fb1e008fc20 con 0x7fb1ec073940 2024-04-20T21:59:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.144+0000 7fb1f1000700 1 --2- 172.21.15.142:0/1450367648 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fb1d406ea80 0x7fb1d4070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:46.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.145+0000 7fb1f1000700 1 --2- 172.21.15.142:0/1450367648 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fb1d406ea80 0x7fb1d4070f40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec074c40 tx=0x7fb1d8009310 comp rx=0 tx=0).ready entity=mgr.14722 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:46.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.149+0000 7fb1ea000700 1 -- 172.21.15.142:0/1450367648 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fb1e005c8a0 con 0x7fb1ec073940 2024-04-20T21:59:46.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.503+0000 7fb1f4400700 1 -- 172.21.15.142:0/1450367648 --> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1ec02ce80 con 0x7fb1d406ea80 2024-04-20T21:59:46.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.523+0000 7fb1ea000700 1 -- 172.21.15.142:0/1450367648 <== mgr.14722 v2:172.21.15.142:6800/54392364 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fb1ec02ce80 con 0x7fb1d406ea80 2024-04-20T21:59:46.524 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T21:59:46.524 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (10m) 47s ago 12m 13.6M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T21:59:46.524 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (12m) 47s ago 12m 7914k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T21:59:46.524 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (11m) 2s ago 11m 7608k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T21:59:46.524 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (12m) 47s ago 12m 6665k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 56f2e41784f8 2024-04-20T21:59:46.524 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (11m) 2s ago 11m 6660k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 bce67525dd3e 2024-04-20T21:59:46.524 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (10m) 47s ago 12m 75.5M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T21:59:46.524 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (5m) 47s ago 5m 198M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 b68e279d7945 2024-04-20T21:59:46.524 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (5m) 47s ago 5m 14.1M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T21:59:46.524 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (4m) 2s ago 4m 14.6M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T21:59:46.524 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (5m) 2s ago 5m 14.8M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T21:59:46.524 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (96s) 47s ago 14m 479M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T21:59:46.524 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (8s) 2s ago 11m 64.5M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T21:59:46.524 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (14m) 47s ago 14m 53.9M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c076f7eb00ea 2024-04-20T21:59:46.524 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (10m) 2s ago 10m 42.6M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 2bacdeb02ee0 2024-04-20T21:59:46.525 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (12m) 47s ago 12m 8052k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T21:59:46.525 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (11m) 2s ago 11m 7906k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T21:59:46.525 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (9m) 47s ago 9m 187M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4361ae428e0d 2024-04-20T21:59:46.525 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (9m) 47s ago 9m 195M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 dd7e7cf8e8e1 2024-04-20T21:59:46.525 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (8m) 47s ago 8m 185M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 8e9165365127 2024-04-20T21:59:46.525 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (8m) 2s ago 8m 255M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c081911f56ab 2024-04-20T21:59:46.525 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (7m) 2s ago 7m 220M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 39e09d63d44f 2024-04-20T21:59:46.525 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (6m) 2s ago 6m 203M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4f36124aeb0d 2024-04-20T21:59:46.525 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 starting - - - - 2024-04-20T21:59:46.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.529+0000 7fb1f4400700 1 -- 172.21.15.142:0/1450367648 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fb1d406ea80 msgr2=0x7fb1d4070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:46.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.529+0000 7fb1f4400700 1 --2- 172.21.15.142:0/1450367648 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fb1d406ea80 0x7fb1d4070f40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec074c40 tx=0x7fb1d8009310 comp rx=0 tx=0).stop 2024-04-20T21:59:46.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.529+0000 7fb1f4400700 1 -- 172.21.15.142:0/1450367648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1ec073940 msgr2=0x7fb1ec19cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:46.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.529+0000 7fb1f4400700 1 --2- 172.21.15.142:0/1450367648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1ec073940 0x7fb1ec19cc20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009230 tx=0x7fb1e000f740 comp rx=0 tx=0).stop 2024-04-20T21:59:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.529+0000 7fb1f4400700 1 -- 172.21.15.142:0/1450367648 shutdown_connections 2024-04-20T21:59:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.529+0000 7fb1f4400700 1 --2- 172.21.15.142:0/1450367648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb1ec073940 0x7fb1ec19cc20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.529+0000 7fb1f4400700 1 --2- 172.21.15.142:0/1450367648 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fb1d406ea80 0x7fb1d4070f40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.529+0000 7fb1f4400700 1 --2- 172.21.15.142:0/1450367648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb1ec074f10 0x7fb1ec19d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.529+0000 7fb1f4400700 1 -- 172.21.15.142:0/1450367648 >> 172.21.15.142:0/1450367648 conn(0x7fb1ec0fc1c0 msgr2=0x7fb1ec1029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.529+0000 7fb1f4400700 1 -- 172.21.15.142:0/1450367648 shutdown_connections 2024-04-20T21:59:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.530+0000 7fb1f4400700 1 -- 172.21.15.142:0/1450367648 wait complete. 2024-04-20T21:59:46.616 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-20T21:59:46.616 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-04-20T21:59:46.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.714+0000 7fb56fe00700 1 -- 172.21.15.142:0/3715193997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb570101c40 msgr2=0x7fb5701020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:46.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.714+0000 7fb56fe00700 1 --2- 172.21.15.142:0/3715193997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb570101c40 0x7fb5701020a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009910 tx=0x7fb55c009c20 comp rx=0 tx=0).stop 2024-04-20T21:59:46.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.715+0000 7fb56fe00700 1 -- 172.21.15.142:0/3715193997 shutdown_connections 2024-04-20T21:59:46.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.715+0000 7fb56fe00700 1 --2- 172.21.15.142:0/3715193997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb570101c40 0x7fb5701020a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:46.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.715+0000 7fb56fe00700 1 --2- 172.21.15.142:0/3715193997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb570100a40 0x7fb570100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:46.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.715+0000 7fb56fe00700 1 -- 172.21.15.142:0/3715193997 >> 172.21.15.142:0/3715193997 conn(0x7fb5700fc000 msgr2=0x7fb5700fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:46.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.715+0000 7fb56fe00700 1 -- 172.21.15.142:0/3715193997 shutdown_connections 2024-04-20T21:59:46.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.715+0000 7fb56fe00700 1 -- 172.21.15.142:0/3715193997 wait complete. 2024-04-20T21:59:46.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.716+0000 7fb56fe00700 1 Processor -- start 2024-04-20T21:59:46.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.716+0000 7fb56fe00700 1 -- start start 2024-04-20T21:59:46.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.716+0000 7fb56fe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb570100a40 0x7fb570196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:46.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.716+0000 7fb56fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb570101c40 0x7fb570196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:46.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.716+0000 7fb56fe00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb570196f90 con 0x7fb570101c40 2024-04-20T21:59:46.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.716+0000 7fb56fe00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5701970d0 con 0x7fb570100a40 2024-04-20T21:59:46.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.717+0000 7fb56ea00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb570100a40 0x7fb570196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:46.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.717+0000 7fb56e000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb570101c40 0x7fb570196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:46.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.717+0000 7fb56ea00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb570100a40 0x7fb570196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:48272/0 (socket says 172.21.15.142:48272) 2024-04-20T21:59:46.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.717+0000 7fb56ea00700 1 -- 172.21.15.142:0/210060465 learned_addr learned my addr 172.21.15.142:0/210060465 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:59:46.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.717+0000 7fb56ea00700 1 -- 172.21.15.142:0/210060465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb570101c40 msgr2=0x7fb570196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:46.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.717+0000 7fb56ea00700 1 --2- 172.21.15.142:0/210060465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb570101c40 0x7fb570196970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:46.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.717+0000 7fb56ea00700 1 -- 172.21.15.142:0/210060465 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c0095f0 con 0x7fb570100a40 2024-04-20T21:59:46.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.718+0000 7fb56ea00700 1 --2- 172.21.15.142:0/210060465 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb570100a40 0x7fb570196430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb56000e8f0 tx=0x7fb56000ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:46.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.718+0000 7fb574a00700 1 -- 172.21.15.142:0/210060465 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb560009790 con 0x7fb570100a40 2024-04-20T21:59:46.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.718+0000 7fb574a00700 1 -- 172.21.15.142:0/210060465 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb56000c810 con 0x7fb570100a40 2024-04-20T21:59:46.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.718+0000 7fb574a00700 1 -- 172.21.15.142:0/210060465 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb560003d20 con 0x7fb570100a40 2024-04-20T21:59:46.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.718+0000 7fb56fe00700 1 -- 172.21.15.142:0/210060465 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57019bb30 con 0x7fb570100a40 2024-04-20T21:59:46.718 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.718+0000 7fb56fe00700 1 -- 172.21.15.142:0/210060465 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57019c080 con 0x7fb570100a40 2024-04-20T21:59:46.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.719+0000 7fb56fe00700 1 -- 172.21.15.142:0/210060465 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5701905c0 con 0x7fb570100a40 2024-04-20T21:59:46.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.721+0000 7fb574a00700 1 -- 172.21.15.142:0/210060465 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 30) v1 ==== 92710+0+0 (secure 0 0 0) 0x7fb5600041f0 con 0x7fb570100a40 2024-04-20T21:59:46.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.721+0000 7fb574a00700 1 --2- 172.21.15.142:0/210060465 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fb55406ea70 0x7fb554070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:46.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.722+0000 7fb574a00700 1 -- 172.21.15.142:0/210060465 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fb560014070 con 0x7fb570100a40 2024-04-20T21:59:46.721 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.722+0000 7fb56e000700 1 --2- 172.21.15.142:0/210060465 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fb55406ea70 0x7fb554070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:46.722 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.723+0000 7fb56e000700 1 --2- 172.21.15.142:0/210060465 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fb55406ea70 0x7fb554070f30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00b6f0 tx=0x7fb55c005fb0 comp rx=0 tx=0).ready entity=mgr.14722 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:46.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:46.728+0000 7fb574a00700 1 -- 172.21.15.142:0/210060465 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fb560095080 con 0x7fb570100a40 2024-04-20T21:59:46.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:46 smithi142 ceph-mon[15828]: pgmap v30: 65 pgs: 65 active+clean; 744 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 742 KiB/s wr, 160 op/s 2024-04-20T21:59:46.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:46 smithi142 ceph-mon[15828]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:59:46.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:46 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:46.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:46 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:46.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:46 smithi164 ceph-mon[23506]: pgmap v30: 65 pgs: 65 active+clean; 744 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 742 KiB/s wr, 160 op/s 2024-04-20T21:59:46.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:46 smithi164 ceph-mon[23506]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:59:46.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:46 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:46.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:46 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:47.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.184+0000 7fb56fe00700 1 -- 172.21.15.142:0/210060465 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb570109670 con 0x7fb570100a40 2024-04-20T21:59:47.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.186+0000 7fb574a00700 1 -- 172.21.15.142:0/210060465 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fb560062020 con 0x7fb570100a40 2024-04-20T21:59:47.189 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T21:59:47.189 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T21:59:47.189 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 2 2024-04-20T21:59:47.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:59:47.190 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T21:59:47.190 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T21:59:47.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:59:47.190 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T21:59:47.190 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 6 2024-04-20T21:59:47.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:59:47.190 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T21:59:47.190 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4 2024-04-20T21:59:47.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T21:59:47.190 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T21:59:47.190 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 12, 2024-04-20T21:59:47.190 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T21:59:47.190 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T21:59:47.190 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T21:59:47.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.191+0000 7fb56fe00700 1 -- 172.21.15.142:0/210060465 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fb55406ea70 msgr2=0x7fb554070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:47.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.191+0000 7fb56fe00700 1 --2- 172.21.15.142:0/210060465 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fb55406ea70 0x7fb554070f30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00b6f0 tx=0x7fb55c005fb0 comp rx=0 tx=0).stop 2024-04-20T21:59:47.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.191+0000 7fb56fe00700 1 -- 172.21.15.142:0/210060465 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb570100a40 msgr2=0x7fb570196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:47.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.191+0000 7fb56fe00700 1 --2- 172.21.15.142:0/210060465 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb570100a40 0x7fb570196430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb56000e8f0 tx=0x7fb56000ec00 comp rx=0 tx=0).stop 2024-04-20T21:59:47.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.191+0000 7fb56fe00700 1 -- 172.21.15.142:0/210060465 shutdown_connections 2024-04-20T21:59:47.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.191+0000 7fb56fe00700 1 --2- 172.21.15.142:0/210060465 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fb55406ea70 0x7fb554070f30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:47.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.191+0000 7fb56fe00700 1 --2- 172.21.15.142:0/210060465 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb570100a40 0x7fb570196430 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb56000e8f0 tx=0x7fb56000ec00 comp rx=0 tx=0).stop 2024-04-20T21:59:47.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.191+0000 7fb56fe00700 1 --2- 172.21.15.142:0/210060465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb570101c40 0x7fb570196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:47.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.191+0000 7fb56fe00700 1 -- 172.21.15.142:0/210060465 >> 172.21.15.142:0/210060465 conn(0x7fb5700fc000 msgr2=0x7fb570105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:47.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.192+0000 7fb56fe00700 1 -- 172.21.15.142:0/210060465 shutdown_connections 2024-04-20T21:59:47.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.192+0000 7fb56fe00700 1 -- 172.21.15.142:0/210060465 wait complete. 2024-04-20T21:59:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.386+0000 7f55cc600700 1 -- 172.21.15.142:0/4237935933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55c4101720 msgr2=0x7f55c4103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.386+0000 7f55cc600700 1 --2- 172.21.15.142:0/4237935933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55c4101720 0x7f55c4103b10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f55b8009910 tx=0x7f55b8009c20 comp rx=0 tx=0).stop 2024-04-20T21:59:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.386+0000 7f55cc600700 1 -- 172.21.15.142:0/4237935933 shutdown_connections 2024-04-20T21:59:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.386+0000 7f55cc600700 1 --2- 172.21.15.142:0/4237935933 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55c4104050 0x7f55c4106440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.386+0000 7f55cc600700 1 --2- 172.21.15.142:0/4237935933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55c4101720 0x7f55c4103b10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.386+0000 7f55cc600700 1 -- 172.21.15.142:0/4237935933 >> 172.21.15.142:0/4237935933 conn(0x7f55c40fb0d0 msgr2=0x7f55c40fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.386+0000 7f55cc600700 1 -- 172.21.15.142:0/4237935933 shutdown_connections 2024-04-20T21:59:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.386+0000 7f55cc600700 1 -- 172.21.15.142:0/4237935933 wait complete. 2024-04-20T21:59:47.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.387+0000 7f55cc600700 1 Processor -- start 2024-04-20T21:59:47.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.388+0000 7f55cc600700 1 -- start start 2024-04-20T21:59:47.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.388+0000 7f55cc600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55c4101720 0x7f55c4101030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.388+0000 7f55cc600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55c4104050 0x7f55c40ff6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.388+0000 7f55cc600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c419a210 con 0x7f55c4104050 2024-04-20T21:59:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.388+0000 7f55cc600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c419a350 con 0x7f55c4101720 2024-04-20T21:59:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.388+0000 7f55c9200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55c4104050 0x7f55c40ff6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.388+0000 7f55c9200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55c4104050 0x7f55c40ff6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55610/0 (socket says 172.21.15.142:55610) 2024-04-20T21:59:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.388+0000 7f55c9200700 1 -- 172.21.15.142:0/3832646730 learned_addr learned my addr 172.21.15.142:0/3832646730 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:59:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.388+0000 7f55c9c00700 1 --2- 172.21.15.142:0/3832646730 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55c4101720 0x7f55c4101030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.389+0000 7f55c9200700 1 -- 172.21.15.142:0/3832646730 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55c4101720 msgr2=0x7f55c4101030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:47.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.389+0000 7f55c9200700 1 --2- 172.21.15.142:0/3832646730 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55c4101720 0x7f55c4101030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:47.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.389+0000 7f55c9200700 1 -- 172.21.15.142:0/3832646730 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b80095f0 con 0x7f55c4104050 2024-04-20T21:59:47.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.389+0000 7f55c9200700 1 --2- 172.21.15.142:0/3832646730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55c4104050 0x7f55c40ff6d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f55b000c8a0 tx=0x7f55b000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:47.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.390+0000 7f55c2000700 1 -- 172.21.15.142:0/3832646730 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55b000cea0 con 0x7f55c4104050 2024-04-20T21:59:47.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.390+0000 7f55c2000700 1 -- 172.21.15.142:0/3832646730 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f55b0004830 con 0x7f55c4104050 2024-04-20T21:59:47.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.390+0000 7f55c2000700 1 -- 172.21.15.142:0/3832646730 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55b00055b0 con 0x7f55c4104050 2024-04-20T21:59:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.390+0000 7f55cc600700 1 -- 172.21.15.142:0/3832646730 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c419a630 con 0x7f55c4104050 2024-04-20T21:59:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.390+0000 7f55cc600700 1 -- 172.21.15.142:0/3832646730 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c419ac00 con 0x7f55c4104050 2024-04-20T21:59:47.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.391+0000 7f55cc600700 1 -- 172.21.15.142:0/3832646730 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c4062510 con 0x7f55c4104050 2024-04-20T21:59:47.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.393+0000 7f55c2000700 1 -- 172.21.15.142:0/3832646730 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 30) v1 ==== 92710+0+0 (secure 0 0 0) 0x7f55b00049a0 con 0x7f55c4104050 2024-04-20T21:59:47.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.394+0000 7f55c2000700 1 --2- 172.21.15.142:0/3832646730 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f55ac06eac0 0x7f55ac070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:47.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.394+0000 7f55c2000700 1 -- 172.21.15.142:0/3832646730 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f55b008ec20 con 0x7f55c4104050 2024-04-20T21:59:47.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.395+0000 7f55c9c00700 1 --2- 172.21.15.142:0/3832646730 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f55ac06eac0 0x7f55ac070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:47.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.395+0000 7f55c9c00700 1 --2- 172.21.15.142:0/3832646730 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f55ac06eac0 0x7f55ac070f80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f55b80051c0 tx=0x7f55b800b540 comp rx=0 tx=0).ready entity=mgr.14722 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:47.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.398+0000 7f55c2000700 1 -- 172.21.15.142:0/3832646730 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f55b005b870 con 0x7f55c4104050 2024-04-20T21:59:47.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.748+0000 7f55cc600700 1 -- 172.21.15.142:0/3832646730 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f55c4109760 con 0x7f55c4104050 2024-04-20T21:59:47.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.748+0000 7f55c2000700 1 -- 172.21.15.142:0/3832646730 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1853 (secure 0 0 0) 0x7f55b0004c50 con 0x7f55c4104050 2024-04-20T21:59:47.748 INFO:teuthology.orchestra.run.smithi142.stdout:e12 2024-04-20T21:59:47.748 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T21:59:47.748 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:59:47.748 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T21:59:47.748 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:59:47.748 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T21:59:47.749 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T21:59:47.749 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 12 2024-04-20T21:59:47.749 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T21:59:47.749 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T21:59:47.749 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:51.692699+0000 2024-04-20T21:59:47.749 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T21:59:47.749 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T21:59:47.749 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T21:59:47.749 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T21:59:47.749 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T21:59:47.749 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T21:59:47.749 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T21:59:47.749 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T21:59:47.749 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T21:59:47.750 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T21:59:47.750 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T21:59:47.750 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T21:59:47.750 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T21:59:47.750 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T21:59:47.750 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T21:59:47.750 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T21:59:47.750 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T21:59:47.750 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T21:59:47.750 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T21:59:47.750 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T21:59:47.750 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T21:59:47.751 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T21:59:47.751 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:59:47.751 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:59:47.751 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:59:47.751 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T21:59:47.751 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T21:59:47.751 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:59:47.751 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:59:47.751 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T21:59:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.751+0000 7f55cc600700 1 -- 172.21.15.142:0/3832646730 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f55ac06eac0 msgr2=0x7f55ac070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.751+0000 7f55cc600700 1 --2- 172.21.15.142:0/3832646730 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f55ac06eac0 0x7f55ac070f80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f55b80051c0 tx=0x7f55b800b540 comp rx=0 tx=0).stop 2024-04-20T21:59:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.751+0000 7f55cc600700 1 -- 172.21.15.142:0/3832646730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55c4104050 msgr2=0x7f55c40ff6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.751+0000 7f55cc600700 1 --2- 172.21.15.142:0/3832646730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55c4104050 0x7f55c40ff6d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f55b000c8a0 tx=0x7f55b000cc60 comp rx=0 tx=0).stop 2024-04-20T21:59:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.751+0000 7f55cc600700 1 -- 172.21.15.142:0/3832646730 shutdown_connections 2024-04-20T21:59:47.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.751+0000 7f55cc600700 1 --2- 172.21.15.142:0/3832646730 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f55ac06eac0 0x7f55ac070f80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.751+0000 7f55cc600700 1 --2- 172.21.15.142:0/3832646730 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55c4101720 0x7f55c4101030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.751+0000 7f55cc600700 1 --2- 172.21.15.142:0/3832646730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55c4104050 0x7f55c40ff6d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.751+0000 7f55cc600700 1 -- 172.21.15.142:0/3832646730 >> 172.21.15.142:0/3832646730 conn(0x7f55c40fb0d0 msgr2=0x7f55c40fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.751+0000 7f55cc600700 1 -- 172.21.15.142:0/3832646730 shutdown_connections 2024-04-20T21:59:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.751+0000 7f55cc600700 1 -- 172.21.15.142:0/3832646730 wait complete. 2024-04-20T21:59:47.753 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T21:59:47.827 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:47 smithi142 ceph-mon[15828]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:59:47.827 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:47 smithi142 ceph-mon[15828]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:59:47.827 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:47 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/210060465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T21:59:47.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.930+0000 7fe9f6800700 1 -- 172.21.15.142:0/2639112835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9f0100c00 msgr2=0x7fe9f0101020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:47.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.930+0000 7fe9f6800700 1 --2- 172.21.15.142:0/2639112835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9f0100c00 0x7fe9f0101020 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009910 tx=0x7fe9e0009c20 comp rx=0 tx=0).stop 2024-04-20T21:59:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.930+0000 7fe9f6800700 1 -- 172.21.15.142:0/2639112835 shutdown_connections 2024-04-20T21:59:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.931+0000 7fe9f6800700 1 --2- 172.21.15.142:0/2639112835 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9f0101e00 0x7fe9f0102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.931+0000 7fe9f6800700 1 --2- 172.21.15.142:0/2639112835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9f0100c00 0x7fe9f0101020 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.931+0000 7fe9f6800700 1 -- 172.21.15.142:0/2639112835 >> 172.21.15.142:0/2639112835 conn(0x7fe9f00fc1c0 msgr2=0x7fe9f00fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.931+0000 7fe9f6800700 1 -- 172.21.15.142:0/2639112835 shutdown_connections 2024-04-20T21:59:47.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.931+0000 7fe9f6800700 1 -- 172.21.15.142:0/2639112835 wait complete. 2024-04-20T21:59:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.932+0000 7fe9f6800700 1 Processor -- start 2024-04-20T21:59:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.932+0000 7fe9f6800700 1 -- start start 2024-04-20T21:59:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.932+0000 7fe9f6800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9f0100c00 0x7fe9f0198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.932+0000 7fe9f6800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9f0101e00 0x7fe9f0198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.932+0000 7fe9f6800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f01993d0 con 0x7fe9f0100c00 2024-04-20T21:59:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.932+0000 7fe9f6800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f0199510 con 0x7fe9f0101e00 2024-04-20T21:59:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.933+0000 7fe9ef400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9f0100c00 0x7fe9f0198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.933+0000 7fe9ef400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9f0100c00 0x7fe9f0198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55624/0 (socket says 172.21.15.142:55624) 2024-04-20T21:59:47.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.933+0000 7fe9ef400700 1 -- 172.21.15.142:0/3195481274 learned_addr learned my addr 172.21.15.142:0/3195481274 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:59:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.933+0000 7fe9eea00700 1 --2- 172.21.15.142:0/3195481274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9f0101e00 0x7fe9f0198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.933+0000 7fe9ef400700 1 -- 172.21.15.142:0/3195481274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9f0101e00 msgr2=0x7fe9f0198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.933+0000 7fe9ef400700 1 --2- 172.21.15.142:0/3195481274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9f0101e00 0x7fe9f0198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.933+0000 7fe9ef400700 1 -- 172.21.15.142:0/3195481274 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e00095f0 con 0x7fe9f0100c00 2024-04-20T21:59:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.933+0000 7fe9eea00700 1 --2- 172.21.15.142:0/3195481274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9f0101e00 0x7fe9f0198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T21:59:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.933+0000 7fe9ef400700 1 --2- 172.21.15.142:0/3195481274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9f0100c00 0x7fe9f0198870 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000b620 tx=0x7fe9e000f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.934+0000 7fe9e7e00700 1 -- 172.21.15.142:0/3195481274 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9e001d070 con 0x7fe9f0100c00 2024-04-20T21:59:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.934+0000 7fe9e7e00700 1 -- 172.21.15.142:0/3195481274 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9e00052a0 con 0x7fe9f0100c00 2024-04-20T21:59:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.934+0000 7fe9f6800700 1 -- 172.21.15.142:0/3195481274 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f019dec0 con 0x7fe9f0100c00 2024-04-20T21:59:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.934+0000 7fe9f6800700 1 -- 172.21.15.142:0/3195481274 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f019e3b0 con 0x7fe9f0100c00 2024-04-20T21:59:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.934+0000 7fe9e7e00700 1 -- 172.21.15.142:0/3195481274 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9e0017400 con 0x7fe9f0100c00 2024-04-20T21:59:47.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.935+0000 7fe9f6800700 1 -- 172.21.15.142:0/3195481274 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f01067d0 con 0x7fe9f0100c00 2024-04-20T21:59:47.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.936+0000 7fe9e7e00700 1 -- 172.21.15.142:0/3195481274 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 30) v1 ==== 92710+0+0 (secure 0 0 0) 0x7fe9e0003810 con 0x7fe9f0100c00 2024-04-20T21:59:47.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.938+0000 7fe9e7e00700 1 --2- 172.21.15.142:0/3195481274 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fe9d406ea70 0x7fe9d4070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:47.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.938+0000 7fe9e7e00700 1 -- 172.21.15.142:0/3195481274 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fe9e008ffd0 con 0x7fe9f0100c00 2024-04-20T21:59:47.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.938+0000 7fe9eea00700 1 --2- 172.21.15.142:0/3195481274 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fe9d406ea70 0x7fe9d4070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:47.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.939+0000 7fe9eea00700 1 --2- 172.21.15.142:0/3195481274 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fe9d406ea70 0x7fe9d4070f30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009be0 tx=0x7fe9dc009260 comp rx=0 tx=0).ready entity=mgr.14722 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:47.943+0000 7fe9e7e00700 1 -- 172.21.15.142:0/3195481274 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7fe9e00c4f60 con 0x7fe9f0100c00 2024-04-20T21:59:47.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:47 smithi164 ceph-mon[23506]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:59:47.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:47 smithi164 ceph-mon[23506]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:59:47.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:47 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/210060465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T21:59:48.294 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.294+0000 7fe9f6800700 1 -- 172.21.15.142:0/3195481274 --> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9f002ce50 con 0x7fe9d406ea70 2024-04-20T21:59:48.295 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.296+0000 7fe9e7e00700 1 -- 172.21.15.142:0/3195481274 <== mgr.14722 v2:172.21.15.142:6800/54392364 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fe9f002ce50 con 0x7fe9d406ea70 2024-04-20T21:59:48.295 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T21:59:48.295 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T21:59:48.295 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T21:59:48.295 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T21:59:48.296 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T21:59:48.296 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr" 2024-04-20T21:59:48.296 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T21:59:48.296 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "2/23 daemons upgraded", 2024-04-20T21:59:48.296 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading mgr daemons", 2024-04-20T21:59:48.296 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T21:59:48.296 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T21:59:48.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.298+0000 7fe9f6800700 1 -- 172.21.15.142:0/3195481274 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fe9d406ea70 msgr2=0x7fe9d4070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:48.298 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.299+0000 7fe9f6800700 1 --2- 172.21.15.142:0/3195481274 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fe9d406ea70 0x7fe9d4070f30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009be0 tx=0x7fe9dc009260 comp rx=0 tx=0).stop 2024-04-20T21:59:48.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.299+0000 7fe9f6800700 1 -- 172.21.15.142:0/3195481274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9f0100c00 msgr2=0x7fe9f0198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:48.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.299+0000 7fe9f6800700 1 --2- 172.21.15.142:0/3195481274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9f0100c00 0x7fe9f0198870 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000b620 tx=0x7fe9e000f510 comp rx=0 tx=0).stop 2024-04-20T21:59:48.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.299+0000 7fe9f6800700 1 -- 172.21.15.142:0/3195481274 shutdown_connections 2024-04-20T21:59:48.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.299+0000 7fe9f6800700 1 --2- 172.21.15.142:0/3195481274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9f0100c00 0x7fe9f0198870 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:48.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.299+0000 7fe9f6800700 1 --2- 172.21.15.142:0/3195481274 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7fe9d406ea70 0x7fe9d4070f30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:48.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.299+0000 7fe9f6800700 1 --2- 172.21.15.142:0/3195481274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9f0101e00 0x7fe9f0198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:48.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.299+0000 7fe9f6800700 1 -- 172.21.15.142:0/3195481274 >> 172.21.15.142:0/3195481274 conn(0x7fe9f00fc1c0 msgr2=0x7fe9f00734e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:48.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.299+0000 7fe9f6800700 1 -- 172.21.15.142:0/3195481274 shutdown_connections 2024-04-20T21:59:48.299 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.299+0000 7fe9f6800700 1 -- 172.21.15.142:0/3195481274 wait complete. 2024-04-20T21:59:48.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.468+0000 7f7934a00700 1 -- 172.21.15.142:0/3576434570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7930101e00 msgr2=0x7f7930102260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:48.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.468+0000 7f7934a00700 1 --2- 172.21.15.142:0/3576434570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7930101e00 0x7f7930102260 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f791c009910 tx=0x7f791c009c20 comp rx=0 tx=0).stop 2024-04-20T21:59:48.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.468+0000 7f7934a00700 1 -- 172.21.15.142:0/3576434570 shutdown_connections 2024-04-20T21:59:48.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.468+0000 7f7934a00700 1 --2- 172.21.15.142:0/3576434570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7930101e00 0x7f7930102260 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:48.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.468+0000 7f7934a00700 1 --2- 172.21.15.142:0/3576434570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7930100c00 0x7f7930101020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:48.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.468+0000 7f7934a00700 1 -- 172.21.15.142:0/3576434570 >> 172.21.15.142:0/3576434570 conn(0x7f79300fc1c0 msgr2=0x7f79300fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:48.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.469+0000 7f7934a00700 1 -- 172.21.15.142:0/3576434570 shutdown_connections 2024-04-20T21:59:48.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.469+0000 7f7934a00700 1 -- 172.21.15.142:0/3576434570 wait complete. 2024-04-20T21:59:48.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.470+0000 7f7934a00700 1 Processor -- start 2024-04-20T21:59:48.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.470+0000 7f7934a00700 1 -- start start 2024-04-20T21:59:48.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.470+0000 7f7934a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7930100c00 0x7f7930198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:48.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.470+0000 7f7934a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7930101e00 0x7f7930198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:48.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.471+0000 7f7934a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79301993b0 con 0x7f7930101e00 2024-04-20T21:59:48.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.471+0000 7f7934a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79301994f0 con 0x7f7930100c00 2024-04-20T21:59:48.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.471+0000 7f792d400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7930101e00 0x7f7930198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:48.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.471+0000 7f792d400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7930101e00 0x7f7930198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55646/0 (socket says 172.21.15.142:55646) 2024-04-20T21:59:48.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.471+0000 7f792d400700 1 -- 172.21.15.142:0/515879880 learned_addr learned my addr 172.21.15.142:0/515879880 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T21:59:48.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.471+0000 7f792de00700 1 --2- 172.21.15.142:0/515879880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7930100c00 0x7f7930198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:48.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.471+0000 7f792d400700 1 -- 172.21.15.142:0/515879880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7930100c00 msgr2=0x7f7930198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:48.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.471+0000 7f792d400700 1 --2- 172.21.15.142:0/515879880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7930100c00 0x7f7930198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:48.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.471+0000 7f792d400700 1 -- 172.21.15.142:0/515879880 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c0095f0 con 0x7f7930101e00 2024-04-20T21:59:48.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.472+0000 7f792de00700 1 --2- 172.21.15.142:0/515879880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7930100c00 0x7f7930198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T21:59:48.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.472+0000 7f792d400700 1 --2- 172.21.15.142:0/515879880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7930101e00 0x7f7930198d90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f791c005f30 tx=0x7f791c00f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:48.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.472+0000 7f7926a00700 1 -- 172.21.15.142:0/515879880 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f791c01d070 con 0x7f7930101e00 2024-04-20T21:59:48.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.472+0000 7f7926a00700 1 -- 172.21.15.142:0/515879880 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f791c00fe30 con 0x7f7930101e00 2024-04-20T21:59:48.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.472+0000 7f7926a00700 1 -- 172.21.15.142:0/515879880 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f791c017400 con 0x7f7930101e00 2024-04-20T21:59:48.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.472+0000 7f7934a00700 1 -- 172.21.15.142:0/515879880 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793019dea0 con 0x7f7930101e00 2024-04-20T21:59:48.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.472+0000 7f7934a00700 1 -- 172.21.15.142:0/515879880 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793019e3e0 con 0x7f7930101e00 2024-04-20T21:59:48.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.474+0000 7f7934a00700 1 -- 172.21.15.142:0/515879880 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79301067d0 con 0x7f7930101e00 2024-04-20T21:59:48.474 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.475+0000 7f7926a00700 1 -- 172.21.15.142:0/515879880 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 30) v1 ==== 92710+0+0 (secure 0 0 0) 0x7f791c003880 con 0x7f7930101e00 2024-04-20T21:59:48.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.476+0000 7f7926a00700 1 --2- 172.21.15.142:0/515879880 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f791406ea80 0x7f7914070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T21:59:48.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.476+0000 7f7926a00700 1 -- 172.21.15.142:0/515879880 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f791c08ff00 con 0x7f7930101e00 2024-04-20T21:59:48.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.476+0000 7f792de00700 1 --2- 172.21.15.142:0/515879880 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f791406ea80 0x7f7914070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T21:59:48.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.477+0000 7f792de00700 1 --2- 172.21.15.142:0/515879880 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f791406ea80 0x7f7914070f40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7930101c60 tx=0x7f7920009260 comp rx=0 tx=0).ready entity=mgr.14722 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T21:59:48.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.482+0000 7f7926a00700 1 -- 172.21.15.142:0/515879880 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188226 (secure 0 0 0) 0x7f791c05cb70 con 0x7f7930101e00 2024-04-20T21:59:48.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:48 smithi164 ceph-mon[23506]: pgmap v31: 65 pgs: 65 active+clean; 680 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 896 KiB/s wr, 192 op/s 2024-04-20T21:59:48.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:48 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/3832646730' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:59:48.839 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:48 smithi142 ceph-mon[15828]: pgmap v31: 65 pgs: 65 active+clean; 680 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 896 KiB/s wr, 192 op/s 2024-04-20T21:59:48.840 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:48 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/3832646730' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T21:59:48.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.923+0000 7f7934a00700 1 -- 172.21.15.142:0/515879880 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7930062510 con 0x7f7930101e00 2024-04-20T21:59:48.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.924+0000 7f7926a00700 1 -- 172.21.15.142:0/515879880 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f791c05c700 con 0x7f7930101e00 2024-04-20T21:59:48.924 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_OK 2024-04-20T21:59:48.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.927+0000 7f7934a00700 1 -- 172.21.15.142:0/515879880 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f791406ea80 msgr2=0x7f7914070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:48.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.927+0000 7f7934a00700 1 --2- 172.21.15.142:0/515879880 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f791406ea80 0x7f7914070f40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7930101c60 tx=0x7f7920009260 comp rx=0 tx=0).stop 2024-04-20T21:59:48.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.927+0000 7f7934a00700 1 -- 172.21.15.142:0/515879880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7930101e00 msgr2=0x7f7930198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T21:59:48.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.927+0000 7f7934a00700 1 --2- 172.21.15.142:0/515879880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7930101e00 0x7f7930198d90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f791c005f30 tx=0x7f791c00f510 comp rx=0 tx=0).stop 2024-04-20T21:59:48.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.928+0000 7f7934a00700 1 -- 172.21.15.142:0/515879880 shutdown_connections 2024-04-20T21:59:48.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.928+0000 7f7934a00700 1 --2- 172.21.15.142:0/515879880 >> [v2:172.21.15.142:6800/54392364,v1:172.21.15.142:6801/54392364] conn(0x7f791406ea80 0x7f7914070f40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:48.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.928+0000 7f7934a00700 1 --2- 172.21.15.142:0/515879880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7930100c00 0x7f7930198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:48.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.928+0000 7f7934a00700 1 --2- 172.21.15.142:0/515879880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7930101e00 0x7f7930198d90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T21:59:48.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.928+0000 7f7934a00700 1 -- 172.21.15.142:0/515879880 >> 172.21.15.142:0/515879880 conn(0x7f79300fc1c0 msgr2=0x7f7930073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T21:59:48.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.928+0000 7f7934a00700 1 -- 172.21.15.142:0/515879880 shutdown_connections 2024-04-20T21:59:48.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T21:59:48.928+0000 7f7934a00700 1 -- 172.21.15.142:0/515879880 wait complete. 2024-04-20T21:59:49.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:49 smithi142 ceph-mon[15828]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:59:49.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:49 smithi142 ceph-mon[15828]: from='client.? 172.21.15.142:0/515879880' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T21:59:49.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:49 smithi142 ceph-mon[15828]: Standby manager daemon smithi164.oejajr restarted 2024-04-20T21:59:49.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:49 smithi142 ceph-mon[15828]: Standby manager daemon smithi164.oejajr started 2024-04-20T21:59:49.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:49 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.164:0/1886152948' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/crt"}]: dispatch 2024-04-20T21:59:49.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:49 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.164:0/1886152948' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T21:59:49.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:49 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.164:0/1886152948' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/key"}]: dispatch 2024-04-20T21:59:49.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:49 smithi142 ceph-mon[15828]: from='mgr.? 172.21.15.164:0/1886152948' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T21:59:49.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:49 smithi164 ceph-mon[23506]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T21:59:49.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:49 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/515879880' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T21:59:49.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:49 smithi164 ceph-mon[23506]: Standby manager daemon smithi164.oejajr restarted 2024-04-20T21:59:49.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:49 smithi164 ceph-mon[23506]: Standby manager daemon smithi164.oejajr started 2024-04-20T21:59:49.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:49 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/1886152948' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/crt"}]: dispatch 2024-04-20T21:59:49.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:49 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/1886152948' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T21:59:49.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:49 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/1886152948' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/key"}]: dispatch 2024-04-20T21:59:49.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:49 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/1886152948' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T21:59:50.873 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:50 smithi164 ceph-mon[23506]: pgmap v32: 65 pgs: 65 active+clean; 480 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 1.2 MiB/s wr, 234 op/s 2024-04-20T21:59:50.873 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:50 smithi164 ceph-mon[23506]: mgrmap e31: smithi142.zzmcfz(active, since 58s), standbys: smithi164.oejajr 2024-04-20T21:59:50.873 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:50 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:50.874 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:50 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:50.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:50 smithi142 ceph-mon[15828]: pgmap v32: 65 pgs: 65 active+clean; 480 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 1.2 MiB/s wr, 234 op/s 2024-04-20T21:59:50.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:50 smithi142 ceph-mon[15828]: mgrmap e31: smithi142.zzmcfz(active, since 58s), standbys: smithi164.oejajr 2024-04-20T21:59:50.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:50 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:50.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:50 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:51.942 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:51 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:59:51.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:51 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T21:59:52.905 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:52 smithi142 ceph-mon[15828]: pgmap v33: 65 pgs: 65 active+clean; 480 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 850 KiB/s wr, 173 op/s 2024-04-20T21:59:52.905 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:52 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:52.905 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:52 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:52.905 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:52 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:59:52.905 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:52 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:59:52.905 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:52 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:52.905 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:52 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:59:52.906 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:52 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T21:59:52.906 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:52 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:52.906 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:52 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi142.zzmcfz"}]: dispatch 2024-04-20T21:59:52.906 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:52 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi142.zzmcfz"}]': finished 2024-04-20T21:59:52.906 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:52 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi164.oejajr"}]: dispatch 2024-04-20T21:59:52.906 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:52 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi164.oejajr"}]': finished 2024-04-20T21:59:52.906 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:52 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-20T21:59:52.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:52 smithi164 ceph-mon[23506]: pgmap v33: 65 pgs: 65 active+clean; 480 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 850 KiB/s wr, 173 op/s 2024-04-20T21:59:52.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:52 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:52.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:52 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:52.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:52 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:59:52.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:52 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T21:59:52.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:52 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:52.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:52 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T21:59:52.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:52 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T21:59:52.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:52 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:52.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:52 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi142.zzmcfz"}]: dispatch 2024-04-20T21:59:52.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:52 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi142.zzmcfz"}]': finished 2024-04-20T21:59:52.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:52 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi164.oejajr"}]: dispatch 2024-04-20T21:59:52.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:52 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi164.oejajr"}]': finished 2024-04-20T21:59:52.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:52 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-20T21:59:53.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:53 smithi142 ceph-mon[15828]: Upgrade: Setting container_image for all mgr 2024-04-20T21:59:53.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:53 smithi164 ceph-mon[23506]: Upgrade: Setting container_image for all mgr 2024-04-20T21:59:54.893 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:54 smithi142 ceph-mon[15828]: pgmap v34: 65 pgs: 65 active+clean; 285 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 275 op/s 2024-04-20T21:59:54.945 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:54 smithi164 ceph-mon[23506]: pgmap v34: 65 pgs: 65 active+clean; 285 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 275 op/s 2024-04-20T21:59:56.195 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:55 smithi142 ceph-mon[15828]: pgmap v35: 65 pgs: 65 active+clean; 285 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 21 KiB/s rd, 938 KiB/s wr, 199 op/s 2024-04-20T21:59:56.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:55 smithi142 ceph-mon[15828]: Upgrade: Updating mon.smithi142 2024-04-20T21:59:56.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:55 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:56.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:55 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T21:59:56.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:55 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T21:59:56.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:55 smithi142 ceph-mon[15828]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:59:56.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:55 smithi142 ceph-mon[15828]: Deploying daemon mon.smithi142 on smithi142 2024-04-20T21:59:56.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:55 smithi164 ceph-mon[23506]: pgmap v35: 65 pgs: 65 active+clean; 285 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 21 KiB/s rd, 938 KiB/s wr, 199 op/s 2024-04-20T21:59:56.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:55 smithi164 ceph-mon[23506]: Upgrade: Updating mon.smithi142 2024-04-20T21:59:56.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:55 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' 2024-04-20T21:59:56.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:55 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T21:59:56.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:55 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T21:59:56.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:55 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T21:59:56.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:55 smithi164 ceph-mon[23506]: Deploying daemon mon.smithi142 on smithi142 2024-04-20T21:59:58.168 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 21:59:57 smithi164 ceph-mon[23506]: pgmap v36: 65 pgs: 65 active+clean; 283 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.2 MiB/s wr, 243 op/s 2024-04-20T21:59:58.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:57 smithi142 ceph-mon[15828]: pgmap v36: 65 pgs: 65 active+clean; 283 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s rd, 1.2 MiB/s wr, 243 op/s 2024-04-20T21:59:58.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:58 smithi142 systemd[1]: Stopping Ceph mon.smithi142 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T21:59:59.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:58 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142[15823]: 2024-04-20T21:59:58.883+0000 7fc749c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi142 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T21:59:59.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:58 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142[15823]: 2024-04-20T21:59:58.883+0000 7fc749c00700 -1 mon.smithi142@0(leader) e2 *** Got Signal Terminated *** 2024-04-20T21:59:59.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:58 smithi142 podman[79236]: 2024-04-20 21:59:58.99593806 +0000 UTC m=+0.254074106 container died c076f7eb00ea069949471cd9b44607437211566911d9032ddf62c4e631213cf1 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-646b8c7, ceph=True, io.buildah.version=1.33.5) 2024-04-20T21:59:59.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:59 smithi142 podman[79236]: 2024-04-20 21:59:59.59513049 +0000 UTC m=+0.853266535 container cleanup c076f7eb00ea069949471cd9b44607437211566911d9032ddf62c4e631213cf1 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=reef-646b8c7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-20T21:59:59.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:59 smithi142 bash[79236]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142 2024-04-20T21:59:59.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 21:59:59 smithi142 podman[79259]: 2024-04-20 21:59:59.805390453 +0000 UTC m=+0.800624608 container remove c076f7eb00ea069949471cd9b44607437211566911d9032ddf62c4e631213cf1 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=reef-646b8c7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-20T22:00:00.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:00 smithi142 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mon.smithi142.service: Deactivated successfully. 2024-04-20T22:00:00.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:00 smithi142 systemd[1]: Stopped Ceph mon.smithi142 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T22:00:00.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:00 smithi142 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mon.smithi142.service: Consumed 25.606s CPU time. 2024-04-20T22:00:01.078 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:00 smithi142 systemd[1]: Starting Ceph mon.smithi142 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:00:01.393 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 podman[79383]: 2024-04-20 22:00:00.985412245 +0000 UTC m=+0.035237815 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:00:01.393 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 podman[79383]: 2024-04-20 22:00:01.107041998 +0000 UTC m=+0.156867571 container create af10a542c918d7cf23a9d488900532e6ab789ea5062ae796a1d9fa142bc457fa (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-20T22:00:01.394 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 podman[79383]: 2024-04-20 22:00:01.394005784 +0000 UTC m=+0.443831362 container init af10a542c918d7cf23a9d488900532e6ab789ea5062ae796a1d9fa142bc457fa (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2) 2024-04-20T22:00:01.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 podman[79383]: 2024-04-20 22:00:01.404031234 +0000 UTC m=+0.453856793 container start af10a542c918d7cf23a9d488900532e6ab789ea5062ae796a1d9fa142bc457fa (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, io.buildah.version=1.33.5) 2024-04-20T22:00:01.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: set uid:gid to 167:167 (ceph:ceph) 2024-04-20T22:00:01.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev), process ceph-mon, pid 2 2024-04-20T22:00:01.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: pidfile_write: ignore empty --pid-file 2024-04-20T22:00:01.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: load: jerasure load: lrc 2024-04-20T22:00:01.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: RocksDB version: 7.9.2 2024-04-20T22:00:01.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Git sha 0 2024-04-20T22:00:01.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Compile date 2024-04-17 00:07:32 2024-04-20T22:00:01.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: DB SUMMARY 2024-04-20T22:00:01.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: DB Session ID: SUN9951CPH126UMVMLGP 2024-04-20T22:00:01.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: CURRENT file: CURRENT 2024-04-20T22:00:01.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: IDENTITY file: IDENTITY 2024-04-20T22:00:01.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1497 Bytes 2024-04-20T22:00:01.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi142/store.db dir, Total Num: 1, files: 000032.sst 2024-04-20T22:00:01.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi142/store.db: 000030.log size: 2401920 ; 2024-04-20T22:00:01.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.error_if_exists: 0 2024-04-20T22:00:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.create_if_missing: 0 2024-04-20T22:00:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.paranoid_checks: 1 2024-04-20T22:00:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-20T22:00:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-20T22:00:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-20T22:00:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.env: 0x556fd66a0cc0 2024-04-20T22:00:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.fs: PosixFileSystem 2024-04-20T22:00:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.info_log: 0x556fff717b00 2024-04-20T22:00:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_file_opening_threads: 16 2024-04-20T22:00:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.statistics: (nil) 2024-04-20T22:00:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.use_fsync: 0 2024-04-20T22:00:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_log_file_size: 0 2024-04-20T22:00:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-20T22:00:01.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-20T22:00:01.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.keep_log_file_num: 1000 2024-04-20T22:00:01.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.recycle_log_file_num: 0 2024-04-20T22:00:01.699 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.allow_fallocate: 1 2024-04-20T22:00:01.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.allow_mmap_reads: 0 2024-04-20T22:00:01.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.allow_mmap_writes: 0 2024-04-20T22:00:01.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.use_direct_reads: 0 2024-04-20T22:00:01.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-20T22:00:01.701 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.create_missing_column_families: 0 2024-04-20T22:00:01.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.db_log_dir: 2024-04-20T22:00:01.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.wal_dir: 2024-04-20T22:00:01.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-20T22:00:01.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-20T22:00:01.702 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-20T22:00:01.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-20T22:00:01.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-20T22:00:01.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-20T22:00:01.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.advise_random_on_open: 1 2024-04-20T22:00:01.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.db_write_buffer_size: 0 2024-04-20T22:00:01.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.write_buffer_manager: 0x556fff6e61e0 2024-04-20T22:00:01.703 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-20T22:00:01.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-20T22:00:01.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-20T22:00:01.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.rate_limiter: (nil) 2024-04-20T22:00:01.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-20T22:00:01.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.wal_recovery_mode: 2 2024-04-20T22:00:01.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.enable_thread_tracking: 0 2024-04-20T22:00:01.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.enable_pipelined_write: 0 2024-04-20T22:00:01.704 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.unordered_write: 0 2024-04-20T22:00:01.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-20T22:00:01.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-20T22:00:01.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-20T22:00:01.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-20T22:00:01.705 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.row_cache: None 2024-04-20T22:00:01.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.wal_filter: None 2024-04-20T22:00:01.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-20T22:00:01.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.allow_ingest_behind: 0 2024-04-20T22:00:01.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.two_write_queues: 0 2024-04-20T22:00:01.706 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.manual_wal_flush: 0 2024-04-20T22:00:01.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.wal_compression: 0 2024-04-20T22:00:01.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.atomic_flush: 0 2024-04-20T22:00:01.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-20T22:00:01.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-20T22:00:01.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-20T22:00:01.707 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.log_readahead_size: 0 2024-04-20T22:00:01.708 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-20T22:00:01.708 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.best_efforts_recovery: 0 2024-04-20T22:00:01.708 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-20T22:00:01.708 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-20T22:00:01.708 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.allow_data_in_errors: 0 2024-04-20T22:00:01.708 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.db_host_id: __hostname__ 2024-04-20T22:00:01.709 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-20T22:00:01.709 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_background_jobs: 2 2024-04-20T22:00:01.709 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_background_compactions: -1 2024-04-20T22:00:01.709 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_subcompactions: 1 2024-04-20T22:00:01.709 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-20T22:00:01.710 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-20T22:00:01.710 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-20T22:00:01.710 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_total_wal_size: 0 2024-04-20T22:00:01.710 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-20T22:00:01.710 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-20T22:00:01.710 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-20T22:00:01.711 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-20T22:00:01.711 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_open_files: -1 2024-04-20T22:00:01.711 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.bytes_per_sync: 0 2024-04-20T22:00:01.711 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-20T22:00:01.711 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-20T22:00:01.711 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compaction_readahead_size: 0 2024-04-20T22:00:01.712 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_background_flushes: -1 2024-04-20T22:00:01.712 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Compression algorithms supported: 2024-04-20T22:00:01.712 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-20T22:00:01.712 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: kZSTD supported: 0 2024-04-20T22:00:01.712 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: kXpressCompression supported: 0 2024-04-20T22:00:01.712 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: kLZ4HCCompression supported: 1 2024-04-20T22:00:01.713 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: kZlibCompression supported: 1 2024-04-20T22:00:01.713 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: kSnappyCompression supported: 1 2024-04-20T22:00:01.713 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: kLZ4Compression supported: 1 2024-04-20T22:00:01.713 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: kBZip2Compression supported: 0 2024-04-20T22:00:01.713 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-20T22:00:01.713 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-20T22:00:01.714 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi142/store.db/MANIFEST-000015 2024-04-20T22:00:01.714 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-20T22:00:01.714 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-20T22:00:01.714 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.merge_operator: 2024-04-20T22:00:01.714 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compaction_filter: None 2024-04-20T22:00:01.715 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compaction_filter_factory: None 2024-04-20T22:00:01.715 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.sst_partitioner_factory: None 2024-04-20T22:00:01.715 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-20T22:00:01.715 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-20T22:00:01.715 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556fff717ce0) 2024-04-20T22:00:01.715 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: cache_index_and_filter_blocks: 1 2024-04-20T22:00:01.716 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-20T22:00:01.716 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-20T22:00:01.716 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: pin_top_level_index_and_filter: 1 2024-04-20T22:00:01.716 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: index_type: 0 2024-04-20T22:00:01.716 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: data_block_index_type: 0 2024-04-20T22:00:01.717 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: index_shortening: 1 2024-04-20T22:00:01.717 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-20T22:00:01.717 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: checksum: 4 2024-04-20T22:00:01.717 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: no_block_cache: 0 2024-04-20T22:00:01.717 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_cache: 0x556fff719090 2024-04-20T22:00:01.718 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_cache_name: BinnedLRUCache 2024-04-20T22:00:01.718 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_cache_options: 2024-04-20T22:00:01.718 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: capacity : 536870912 2024-04-20T22:00:01.718 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: num_shard_bits : 4 2024-04-20T22:00:01.718 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: strict_capacity_limit : 0 2024-04-20T22:00:01.718 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: high_pri_pool_ratio: 0.000 2024-04-20T22:00:01.719 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_cache_compressed: (nil) 2024-04-20T22:00:01.719 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: persistent_cache: (nil) 2024-04-20T22:00:01.719 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_size: 4096 2024-04-20T22:00:01.719 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_size_deviation: 10 2024-04-20T22:00:01.719 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_restart_interval: 16 2024-04-20T22:00:01.719 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: index_block_restart_interval: 1 2024-04-20T22:00:01.720 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: metadata_block_size: 4096 2024-04-20T22:00:01.720 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: partition_filters: 0 2024-04-20T22:00:01.720 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: use_delta_encoding: 1 2024-04-20T22:00:01.720 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: filter_policy: bloomfilter 2024-04-20T22:00:01.720 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: whole_key_filtering: 1 2024-04-20T22:00:01.720 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: verify_compression: 0 2024-04-20T22:00:01.721 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: read_amp_bytes_per_bit: 0 2024-04-20T22:00:01.721 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: format_version: 5 2024-04-20T22:00:01.721 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: enable_index_compression: 1 2024-04-20T22:00:01.721 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: block_align: 0 2024-04-20T22:00:01.721 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: max_auto_readahead_size: 262144 2024-04-20T22:00:01.721 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: prepopulate_block_cache: 0 2024-04-20T22:00:01.722 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: initial_auto_readahead_size: 8192 2024-04-20T22:00:01.722 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: num_file_reads_for_auto_readahead: 2 2024-04-20T22:00:01.722 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.write_buffer_size: 33554432 2024-04-20T22:00:01.722 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_write_buffer_number: 2 2024-04-20T22:00:01.722 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compression: NoCompression 2024-04-20T22:00:01.723 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.bottommost_compression: Disabled 2024-04-20T22:00:01.723 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.prefix_extractor: nullptr 2024-04-20T22:00:01.723 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-20T22:00:01.723 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.num_levels: 7 2024-04-20T22:00:01.723 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-20T22:00:01.723 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-20T22:00:01.724 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-20T22:00:01.724 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-20T22:00:01.724 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-20T22:00:01.724 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-20T22:00:01.724 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-20T22:00:01.724 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-20T22:00:01.725 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-20T22:00:01.725 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-20T22:00:01.725 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-20T22:00:01.725 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-20T22:00:01.725 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-20T22:00:01.725 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compression_opts.level: 32767 2024-04-20T22:00:01.726 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compression_opts.strategy: 0 2024-04-20T22:00:01.726 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-20T22:00:01.726 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-20T22:00:01.726 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-20T22:00:01.726 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-20T22:00:01.726 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compression_opts.enabled: false 2024-04-20T22:00:01.727 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-20T22:00:01.727 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-20T22:00:01.727 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-20T22:00:01.727 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-20T22:00:01.727 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.target_file_size_base: 67108864 2024-04-20T22:00:01.727 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-20T22:00:01.728 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-20T22:00:01.728 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-20T22:00:01.728 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-20T22:00:01.728 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-20T22:00:01.728 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-20T22:00:01.728 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-20T22:00:01.729 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-20T22:00:01.729 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-20T22:00:01.729 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-20T22:00:01.729 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-20T22:00:01.729 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-20T22:00:01.729 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-20T22:00:01.730 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-20T22:00:01.730 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.arena_block_size: 1048576 2024-04-20T22:00:01.730 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-20T22:00:01.730 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-20T22:00:01.730 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.disable_auto_compactions: 0 2024-04-20T22:00:01.731 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-20T22:00:01.731 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-20T22:00:01.731 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-20T22:00:01.731 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-20T22:00:01.731 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-20T22:00:01.731 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-20T22:00:01.732 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-20T22:00:01.732 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-20T22:00:01.732 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-20T22:00:01.732 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-20T22:00:01.732 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-20T22:00:01.733 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.inplace_update_support: 0 2024-04-20T22:00:01.733 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-20T22:00:01.733 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-20T22:00:01.733 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-20T22:00:01.733 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-20T22:00:01.733 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.bloom_locality: 0 2024-04-20T22:00:01.734 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.max_successive_merges: 0 2024-04-20T22:00:01.734 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-20T22:00:01.734 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.paranoid_file_checks: 0 2024-04-20T22:00:01.734 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.force_consistency_checks: 1 2024-04-20T22:00:01.734 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.report_bg_io_stats: 0 2024-04-20T22:00:01.735 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.ttl: 2592000 2024-04-20T22:00:01.735 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-20T22:00:01.735 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-20T22:00:01.735 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-20T22:00:01.735 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.enable_blob_files: false 2024-04-20T22:00:01.735 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.min_blob_size: 0 2024-04-20T22:00:01.736 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.blob_file_size: 268435456 2024-04-20T22:00:01.736 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-20T22:00:01.736 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-20T22:00:01.736 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-20T22:00:01.736 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-20T22:00:01.736 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-20T22:00:01.737 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.blob_file_starting_level: 0 2024-04-20T22:00:01.737 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-20T22:00:01.737 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-20T22:00:01.737 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi142/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 11792, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-04-20T22:00:01.737 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-04-20T22:00:01.737 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c0c1d3d1-daa4-45d8-be05-2d3f70d52c1f 2024-04-20T22:00:01.738 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713650401473933, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-04-20T22:00:01.738 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-04-20T22:00:01.738 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713650401493084, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 2206729, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11793, "largest_seqno": 12905, "table_properties": {"data_size": 2200740, "index_size": 3664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1285, "raw_key_size": 11172, "raw_average_key_size": 22, "raw_value_size": 2189865, "raw_average_value_size": 4469, "num_data_blocks": 168, "num_entries": 490, "num_filter_entries": 490, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713650401, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c0c1d3d1-daa4-45d8-be05-2d3f70d52c1f", "db_session_id": "SUN9951CPH126UMVMLGP", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-04-20T22:00:01.738 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713650401493327, "job": 1, "event": "recovery_finished"} 2024-04-20T22:00:01.738 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-04-20T22:00:01.738 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-20T22:00:01.739 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi142/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-20T22:00:01.739 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556fff806000 2024-04-20T22:00:01.739 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: DB pointer 0x556fff7f0000 2024-04-20T22:00:01.739 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-20T22:00:01.739 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-20T22:00:01.739 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ** DB Stats ** 2024-04-20T22:00:01.740 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-20T22:00:01.740 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-20T22:00:01.740 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-20T22:00:01.740 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-20T22:00:01.740 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-20T22:00:01.740 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-20T22:00:01.741 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-20T22:00:01.741 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-04-20T22:00:01.741 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ** Compaction Stats [default] ** 2024-04-20T22:00:01.741 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-20T22:00:01.741 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-20T22:00:01.741 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: L0 1/0 2.10 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 278.2 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-20T22:00:01.742 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: L6 1/0 5.40 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-20T22:00:01.742 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Sum 2/0 7.51 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 278.2 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-20T22:00:01.742 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 278.2 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-20T22:00:01.742 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-04-20T22:00:01.742 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ** Compaction Stats [default] ** 2024-04-20T22:00:01.743 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-20T22:00:01.743 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-20T22:00:01.743 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 278.2 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-04-20T22:00:01.743 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-04-20T22:00:01.743 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-20T22:00:01.743 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-04-20T22:00:01.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-20T22:00:01.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-04-20T22:00:01.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-20T22:00:01.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-20T22:00:01.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-20T22:00:01.744 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-20T22:00:01.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Cumulative compaction: 0.00 GB write, 68.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-20T22:00:01.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Interval compaction: 0.00 GB write, 68.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-20T22:00:01.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-20T22:00:01.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Block cache BinnedLRUCache@0x556fff719090#2 capacity: 512.00 MB usage: 5.48 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.7e-05 secs_since: 0 2024-04-20T22:00:01.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.41 KB,0.000268221%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-04-20T22:00:01.745 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-04-20T22:00:01.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-20T22:00:01.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: starting mon.smithi142 rank 0 at public addrs [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] at bind addrs [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi142 fsid 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T22:00:01.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: mon.smithi142@-1(???) e2 preinit fsid 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T22:00:01.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: mon.smithi142@-1(???).mds e12 new map 2024-04-20T22:00:01.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: mon.smithi142@-1(???).mds e12 print_map 2024-04-20T22:00:01.746 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: e12 2024-04-20T22:00:01.747 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:00:01.747 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:00:01.747 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: legacy client fscid: 1 2024-04-20T22:00:01.747 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-04-20T22:00:01.747 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Filesystem 'cephfs' (1) 2024-04-20T22:00:01.747 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: fs_name cephfs 2024-04-20T22:00:01.748 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: epoch 12 2024-04-20T22:00:01.748 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:00:01.748 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:00:01.748 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: modified 2024-04-20T21:54:51.692699+0000 2024-04-20T22:00:01.748 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: tableserver 0 2024-04-20T22:00:01.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: root 0 2024-04-20T22:00:01.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: session_timeout 60 2024-04-20T22:00:01.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: session_autoclose 300 2024-04-20T22:00:01.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: max_file_size 1099511627776 2024-04-20T22:00:01.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: max_xattr_size 65536 2024-04-20T22:00:01.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: required_client_features {} 2024-04-20T22:00:01.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: last_failure 0 2024-04-20T22:00:01.749 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: last_failure_osd_epoch 0 2024-04-20T22:00:01.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: snap_rstat 1 2024-04-20T22:00:01.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:00:01.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: max_mds 1 2024-04-20T22:00:01.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: in 0 2024-04-20T22:00:01.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: up {0=14468} 2024-04-20T22:00:01.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: failed 2024-04-20T22:00:01.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: damaged 2024-04-20T22:00:01.750 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: stopped 2024-04-20T22:00:01.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: data_pools [3] 2024-04-20T22:00:01.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: metadata_pool 2 2024-04-20T22:00:01.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: inline_data disabled 2024-04-20T22:00:01.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: balancer 2024-04-20T22:00:01.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: bal_rank_mask -1 2024-04-20T22:00:01.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: standby_count_wanted 1 2024-04-20T22:00:01.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: qdb_cluster leader: 0 members: 2024-04-20T22:00:01.751 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: [mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:00:01.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-04-20T22:00:01.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-04-20T22:00:01.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: Standby daemons: 2024-04-20T22:00:01.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: 2024-04-20T22:00:01.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: [mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:00:01.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: [mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:00:01.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout: [mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:00:01.752 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: mon.smithi142@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-20T22:00:01.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: mon.smithi142@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-20T22:00:01.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: mon.smithi142@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-20T22:00:01.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 ceph-mon[79401]: mon.smithi142@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-20T22:00:01.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 bash[79383]: af10a542c918d7cf23a9d488900532e6ab789ea5062ae796a1d9fa142bc457fa 2024-04-20T22:00:01.753 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:01 smithi142 systemd[1]: Started Ceph mon.smithi142 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T22:00:02.498 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:02 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T22:00:02.498 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:02 smithi164 ceph-mon[23506]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T22:00:02.498 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:02 smithi164 ceph-mon[23506]: pgmap v38: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 942 KiB/s wr, 234 op/s 2024-04-20T22:00:02.498 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:02 smithi164 ceph-mon[23506]: mon.smithi142 calling monitor election 2024-04-20T22:00:02.498 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:02 smithi164 ceph-mon[23506]: mon.smithi142 is new leader, mons smithi142,smithi164 in quorum (ranks 0,1) 2024-04-20T22:00:02.498 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:02 smithi164 ceph-mon[23506]: monmap epoch 2 2024-04-20T22:00:02.498 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:02 smithi164 ceph-mon[23506]: fsid 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T22:00:02.498 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:02 smithi164 ceph-mon[23506]: last_changed 2024-04-20T21:48:50.292622+0000 2024-04-20T22:00:02.499 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:02 smithi164 ceph-mon[23506]: created 2024-04-20T21:45:23.189616+0000 2024-04-20T22:00:02.499 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:02 smithi164 ceph-mon[23506]: min_mon_release 18 (reef) 2024-04-20T22:00:02.499 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:02 smithi164 ceph-mon[23506]: election_strategy: 1 2024-04-20T22:00:02.499 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:02 smithi164 ceph-mon[23506]: 0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.smithi142 2024-04-20T22:00:02.499 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:02 smithi164 ceph-mon[23506]: 1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.smithi164 2024-04-20T22:00:02.499 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:02 smithi164 ceph-mon[23506]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 3 up:standby 2024-04-20T22:00:02.499 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:02 smithi164 ceph-mon[23506]: osdmap e49: 6 total, 6 up, 6 in 2024-04-20T22:00:02.499 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:02 smithi164 ceph-mon[23506]: mgrmap e31: smithi142.zzmcfz(active, since 71s), standbys: smithi164.oejajr 2024-04-20T22:00:02.499 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:02 smithi164 ceph-mon[23506]: overall HEALTH_OK 2024-04-20T22:00:02.499 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:02 smithi164 ceph-mon[23506]: from='mgr.14722 ' entity='' 2024-04-20T22:00:02.499 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:02 smithi164 ceph-mon[23506]: mgrmap e32: smithi142.zzmcfz(active, since 71s), standbys: smithi164.oejajr 2024-04-20T22:00:02.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:02 smithi142 ceph-mon[79401]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T22:00:02.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:02 smithi142 ceph-mon[79401]: from='mgr.14722 172.21.15.142:0/3211145057' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T22:00:02.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:02 smithi142 ceph-mon[79401]: pgmap v38: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 942 KiB/s wr, 234 op/s 2024-04-20T22:00:02.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:02 smithi142 ceph-mon[79401]: mon.smithi142 calling monitor election 2024-04-20T22:00:02.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:02 smithi142 ceph-mon[79401]: mon.smithi142 is new leader, mons smithi142,smithi164 in quorum (ranks 0,1) 2024-04-20T22:00:02.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:02 smithi142 ceph-mon[79401]: monmap epoch 2 2024-04-20T22:00:02.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:02 smithi142 ceph-mon[79401]: fsid 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T22:00:02.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:02 smithi142 ceph-mon[79401]: last_changed 2024-04-20T21:48:50.292622+0000 2024-04-20T22:00:02.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:02 smithi142 ceph-mon[79401]: created 2024-04-20T21:45:23.189616+0000 2024-04-20T22:00:02.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:02 smithi142 ceph-mon[79401]: min_mon_release 18 (reef) 2024-04-20T22:00:02.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:02 smithi142 ceph-mon[79401]: election_strategy: 1 2024-04-20T22:00:02.580 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:02 smithi142 ceph-mon[79401]: 0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.smithi142 2024-04-20T22:00:02.581 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:02 smithi142 ceph-mon[79401]: 1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.smithi164 2024-04-20T22:00:02.581 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:02 smithi142 ceph-mon[79401]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 3 up:standby 2024-04-20T22:00:02.581 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:02 smithi142 ceph-mon[79401]: osdmap e49: 6 total, 6 up, 6 in 2024-04-20T22:00:02.581 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:02 smithi142 ceph-mon[79401]: mgrmap e31: smithi142.zzmcfz(active, since 71s), standbys: smithi164.oejajr 2024-04-20T22:00:02.581 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:02 smithi142 ceph-mon[79401]: overall HEALTH_OK 2024-04-20T22:00:02.581 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:02 smithi142 ceph-mon[79401]: from='mgr.14722 ' entity='' 2024-04-20T22:00:02.581 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:02 smithi142 ceph-mon[79401]: mgrmap e32: smithi142.zzmcfz(active, since 71s), standbys: smithi164.oejajr 2024-04-20T22:00:12.700 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:12 smithi164 ceph-mon[23506]: Standby manager daemon smithi164.oejajr restarted 2024-04-20T22:00:12.700 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:12 smithi164 ceph-mon[23506]: Standby manager daemon smithi164.oejajr started 2024-04-20T22:00:12.700 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:12 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/3572672987' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/crt"}]: dispatch 2024-04-20T22:00:12.700 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:12 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/3572672987' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T22:00:12.700 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:12 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/3572672987' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/key"}]: dispatch 2024-04-20T22:00:12.700 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:12 smithi164 ceph-mon[23506]: from='mgr.? 172.21.15.164:0/3572672987' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T22:00:12.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:12 smithi142 ceph-mon[79401]: Standby manager daemon smithi164.oejajr restarted 2024-04-20T22:00:12.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:12 smithi142 ceph-mon[79401]: Standby manager daemon smithi164.oejajr started 2024-04-20T22:00:12.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:12 smithi142 ceph-mon[79401]: from='mgr.? 172.21.15.164:0/3572672987' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/crt"}]: dispatch 2024-04-20T22:00:12.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:12 smithi142 ceph-mon[79401]: from='mgr.? 172.21.15.164:0/3572672987' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T22:00:12.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:12 smithi142 ceph-mon[79401]: from='mgr.? 172.21.15.164:0/3572672987' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi164.oejajr/key"}]: dispatch 2024-04-20T22:00:12.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:12 smithi142 ceph-mon[79401]: from='mgr.? 172.21.15.164:0/3572672987' entity='mgr.smithi164.oejajr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T22:00:13.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:13 smithi164 ceph-mon[23506]: mgrmap e33: smithi142.zzmcfz(active, since 81s), standbys: smithi164.oejajr 2024-04-20T22:00:13.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:13 smithi142 ceph-mon[79401]: mgrmap e33: smithi142.zzmcfz(active, since 81s), standbys: smithi164.oejajr 2024-04-20T22:00:14.635 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: Active manager daemon smithi142.zzmcfz restarted 2024-04-20T22:00:14.635 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: Activating manager daemon smithi142.zzmcfz 2024-04-20T22:00:14.635 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: osdmap e50: 6 total, 6 up, 6 in 2024-04-20T22:00:14.635 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: mgrmap e34: smithi142.zzmcfz(active, starting, since 0.0129398s), standbys: smithi164.oejajr 2024-04-20T22:00:14.636 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T22:00:14.636 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T22:00:14.636 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lirkws"}]: dispatch 2024-04-20T22:00:14.636 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lrvfgg"}]: dispatch 2024-04-20T22:00:14.636 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.ybvzha"}]: dispatch 2024-04-20T22:00:14.636 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.gmmrfu"}]: dispatch 2024-04-20T22:00:14.636 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr metadata", "who": "smithi142.zzmcfz", "id": "smithi142.zzmcfz"}]: dispatch 2024-04-20T22:00:14.636 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr metadata", "who": "smithi164.oejajr", "id": "smithi164.oejajr"}]: dispatch 2024-04-20T22:00:14.636 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T22:00:14.636 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T22:00:14.636 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T22:00:14.636 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T22:00:14.636 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T22:00:14.636 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T22:00:14.637 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-20T22:00:14.637 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-20T22:00:14.637 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-20T22:00:14.637 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: Manager daemon smithi142.zzmcfz is now available 2024-04-20T22:00:14.637 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:00:14.637 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:00:14.637 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.zzmcfz/mirror_snapshot_schedule"}]: dispatch 2024-04-20T22:00:14.637 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.zzmcfz/trash_purge_schedule"}]: dispatch 2024-04-20T22:00:14.838 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: Active manager daemon smithi142.zzmcfz restarted 2024-04-20T22:00:14.839 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: Activating manager daemon smithi142.zzmcfz 2024-04-20T22:00:14.839 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: osdmap e50: 6 total, 6 up, 6 in 2024-04-20T22:00:14.839 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: mgrmap e34: smithi142.zzmcfz(active, starting, since 0.0129398s), standbys: smithi164.oejajr 2024-04-20T22:00:14.839 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T22:00:14.839 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T22:00:14.839 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lirkws"}]: dispatch 2024-04-20T22:00:14.839 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lrvfgg"}]: dispatch 2024-04-20T22:00:14.839 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.ybvzha"}]: dispatch 2024-04-20T22:00:14.839 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.gmmrfu"}]: dispatch 2024-04-20T22:00:14.839 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr metadata", "who": "smithi142.zzmcfz", "id": "smithi142.zzmcfz"}]: dispatch 2024-04-20T22:00:14.839 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr metadata", "who": "smithi164.oejajr", "id": "smithi164.oejajr"}]: dispatch 2024-04-20T22:00:14.839 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T22:00:14.839 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T22:00:14.840 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T22:00:14.840 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T22:00:14.840 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T22:00:14.840 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T22:00:14.840 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-20T22:00:14.840 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-20T22:00:14.840 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-20T22:00:14.840 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: Manager daemon smithi142.zzmcfz is now available 2024-04-20T22:00:14.840 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:00:14.840 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:00:14.840 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.zzmcfz/mirror_snapshot_schedule"}]: dispatch 2024-04-20T22:00:14.840 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:14 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi142.zzmcfz/trash_purge_schedule"}]: dispatch 2024-04-20T22:00:16.685 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:16 smithi142 ceph-mon[79401]: mgrmap e35: smithi142.zzmcfz(active, since 1.02253s), standbys: smithi164.oejajr 2024-04-20T22:00:16.685 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:16 smithi142 ceph-mon[79401]: [20/Apr/2024:22:00:15] ENGINE Bus STARTING 2024-04-20T22:00:16.685 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:16 smithi142 ceph-mon[79401]: [20/Apr/2024:22:00:15] ENGINE Serving on https://172.21.15.142:7150 2024-04-20T22:00:16.685 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:16 smithi142 ceph-mon[79401]: [20/Apr/2024:22:00:15] ENGINE Serving on http://172.21.15.142:8765 2024-04-20T22:00:16.685 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:16 smithi142 ceph-mon[79401]: [20/Apr/2024:22:00:15] ENGINE Bus STARTED 2024-04-20T22:00:16.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:16 smithi164 ceph-mon[23506]: mgrmap e35: smithi142.zzmcfz(active, since 1.02253s), standbys: smithi164.oejajr 2024-04-20T22:00:16.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:16 smithi164 ceph-mon[23506]: [20/Apr/2024:22:00:15] ENGINE Bus STARTING 2024-04-20T22:00:16.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:16 smithi164 ceph-mon[23506]: [20/Apr/2024:22:00:15] ENGINE Serving on https://172.21.15.142:7150 2024-04-20T22:00:16.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:16 smithi164 ceph-mon[23506]: [20/Apr/2024:22:00:15] ENGINE Serving on http://172.21.15.142:8765 2024-04-20T22:00:16.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:16 smithi164 ceph-mon[23506]: [20/Apr/2024:22:00:15] ENGINE Bus STARTED 2024-04-20T22:00:17.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:17 smithi164 ceph-mon[23506]: pgmap v4: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:00:17.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:17 smithi164 ceph-mon[23506]: mgrmap e36: smithi142.zzmcfz(active, since 2s), standbys: smithi164.oejajr 2024-04-20T22:00:17.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:17 smithi142 ceph-mon[79401]: pgmap v4: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:00:17.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:17 smithi142 ceph-mon[79401]: mgrmap e36: smithi142.zzmcfz(active, since 2s), standbys: smithi164.oejajr 2024-04-20T22:00:19.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.114+0000 7f0363400700 1 -- 172.21.15.142:0/3562786008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f035c073940 msgr2=0x7f035c073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:19.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.114+0000 7f0363400700 1 --2- 172.21.15.142:0/3562786008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f035c073940 0x7f035c073dc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0348009910 tx=0x7f0348009c20 comp rx=0 tx=0).stop 2024-04-20T22:00:19.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.115+0000 7f0363400700 1 -- 172.21.15.142:0/3562786008 shutdown_connections 2024-04-20T22:00:19.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.115+0000 7f0363400700 1 --2- 172.21.15.142:0/3562786008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f035c073940 0x7f035c073dc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:19.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.115+0000 7f0363400700 1 --2- 172.21.15.142:0/3562786008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f035c074f10 0x7f035c073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:19.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.115+0000 7f0363400700 1 -- 172.21.15.142:0/3562786008 >> 172.21.15.142:0/3562786008 conn(0x7f035c0fc1c0 msgr2=0x7f035c0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:19.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.116+0000 7f0363400700 1 -- 172.21.15.142:0/3562786008 shutdown_connections 2024-04-20T22:00:19.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.116+0000 7f0363400700 1 -- 172.21.15.142:0/3562786008 wait complete. 2024-04-20T22:00:19.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.117+0000 7f0363400700 1 Processor -- start 2024-04-20T22:00:19.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.117+0000 7f0363400700 1 -- start start 2024-04-20T22:00:19.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.117+0000 7f0363400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f035c073940 0x7f035c19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:19.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.117+0000 7f0363400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f035c074f10 0x7f035c19d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:19.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.117+0000 7f0363400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c19d780 con 0x7f035c073940 2024-04-20T22:00:19.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.117+0000 7f0363400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c19d8c0 con 0x7f035c074f10 2024-04-20T22:00:19.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.118+0000 7f0360a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f035c073940 0x7f035c19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:19.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.118+0000 7f0360a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f035c073940 0x7f035c19cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43204/0 (socket says 172.21.15.142:43204) 2024-04-20T22:00:19.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.118+0000 7f0360a00700 1 -- 172.21.15.142:0/3110876660 learned_addr learned my addr 172.21.15.142:0/3110876660 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:00:19.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.118+0000 7f035be00700 1 --2- 172.21.15.142:0/3110876660 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f035c074f10 0x7f035c19d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:19.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.118+0000 7f0360a00700 1 -- 172.21.15.142:0/3110876660 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f035c074f10 msgr2=0x7f035c19d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:19.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.118+0000 7f0360a00700 1 --2- 172.21.15.142:0/3110876660 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f035c074f10 0x7f035c19d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:19.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.118+0000 7f0360a00700 1 -- 172.21.15.142:0/3110876660 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03480095f0 con 0x7f035c073940 2024-04-20T22:00:19.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.119+0000 7f0360a00700 1 --2- 172.21.15.142:0/3110876660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f035c073940 0x7f035c19cc20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f035000c8f0 tx=0x7f035000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:19.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.119+0000 7f0359600700 1 -- 172.21.15.142:0/3110876660 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0350007a50 con 0x7f035c073940 2024-04-20T22:00:19.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.119+0000 7f0363400700 1 -- 172.21.15.142:0/3110876660 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f035c1a2320 con 0x7f035c073940 2024-04-20T22:00:19.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.119+0000 7f0359600700 1 -- 172.21.15.142:0/3110876660 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0350007bb0 con 0x7f035c073940 2024-04-20T22:00:19.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.119+0000 7f0359600700 1 -- 172.21.15.142:0/3110876660 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0350018630 con 0x7f035c073940 2024-04-20T22:00:19.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.119+0000 7f0363400700 1 -- 172.21.15.142:0/3110876660 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f035c1a28f0 con 0x7f035c073940 2024-04-20T22:00:19.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.121+0000 7f0363400700 1 -- 172.21.15.142:0/3110876660 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033c005320 con 0x7f035c073940 2024-04-20T22:00:19.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.123+0000 7f0359600700 1 -- 172.21.15.142:0/3110876660 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7f0350004830 con 0x7f035c073940 2024-04-20T22:00:19.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.124+0000 7f0359600700 1 --2- 172.21.15.142:0/3110876660 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f034406edf0 0x7f03440712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:19.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.124+0000 7f0359600700 1 -- 172.21.15.142:0/3110876660 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f035008efe0 con 0x7f035c073940 2024-04-20T22:00:19.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.125+0000 7f035be00700 1 --2- 172.21.15.142:0/3110876660 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f034406edf0 0x7f03440712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:19.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.125+0000 7f035be00700 1 --2- 172.21.15.142:0/3110876660 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f034406edf0 0x7f03440712b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f034800b5c0 tx=0x7f0348005160 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:19.130 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.130+0000 7f0359600700 1 -- 172.21.15.142:0/3110876660 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f035005b720 con 0x7f035c073940 2024-04-20T22:00:19.401 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:19 smithi142 ceph-mon[79401]: pgmap v5: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:00:19.401 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:19 smithi142 ceph-mon[79401]: mgrmap e37: smithi142.zzmcfz(active, since 4s), standbys: smithi164.oejajr 2024-04-20T22:00:19.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.474+0000 7f0363400700 1 -- 172.21.15.142:0/3110876660 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f033c000bf0 con 0x7f034406edf0 2024-04-20T22:00:19.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.476+0000 7f0359600700 1 -- 172.21.15.142:0/3110876660 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f033c000bf0 con 0x7f034406edf0 2024-04-20T22:00:19.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.480+0000 7f0363400700 1 -- 172.21.15.142:0/3110876660 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f034406edf0 msgr2=0x7f03440712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:19.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.480+0000 7f0363400700 1 --2- 172.21.15.142:0/3110876660 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f034406edf0 0x7f03440712b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f034800b5c0 tx=0x7f0348005160 comp rx=0 tx=0).stop 2024-04-20T22:00:19.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.480+0000 7f0363400700 1 -- 172.21.15.142:0/3110876660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f035c073940 msgr2=0x7f035c19cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:19.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.480+0000 7f0363400700 1 --2- 172.21.15.142:0/3110876660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f035c073940 0x7f035c19cc20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f035000c8f0 tx=0x7f035000ccb0 comp rx=0 tx=0).stop 2024-04-20T22:00:19.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.480+0000 7f0363400700 1 -- 172.21.15.142:0/3110876660 shutdown_connections 2024-04-20T22:00:19.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.480+0000 7f0363400700 1 --2- 172.21.15.142:0/3110876660 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f034406edf0 0x7f03440712b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:19.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.480+0000 7f0363400700 1 --2- 172.21.15.142:0/3110876660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f035c073940 0x7f035c19cc20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:19.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.480+0000 7f0363400700 1 --2- 172.21.15.142:0/3110876660 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f035c074f10 0x7f035c19d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:19.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.480+0000 7f0363400700 1 -- 172.21.15.142:0/3110876660 >> 172.21.15.142:0/3110876660 conn(0x7f035c0fc1c0 msgr2=0x7f035c102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:19.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.481+0000 7f0363400700 1 -- 172.21.15.142:0/3110876660 shutdown_connections 2024-04-20T22:00:19.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.481+0000 7f0363400700 1 -- 172.21.15.142:0/3110876660 wait complete. 2024-04-20T22:00:19.502 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T22:00:19.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.669+0000 7fd91dc00700 1 -- 172.21.15.142:0/4126549226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd918103f90 msgr2=0x7fd918104410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:19.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.669+0000 7fd91dc00700 1 --2- 172.21.15.142:0/4126549226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd918103f90 0x7fd918104410 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd904009910 tx=0x7fd904009c20 comp rx=0 tx=0).stop 2024-04-20T22:00:19.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.669+0000 7fd91dc00700 1 -- 172.21.15.142:0/4126549226 shutdown_connections 2024-04-20T22:00:19.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.669+0000 7fd91dc00700 1 --2- 172.21.15.142:0/4126549226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd918103f90 0x7fd918104410 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:19.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.669+0000 7fd91dc00700 1 --2- 172.21.15.142:0/4126549226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd918102e30 0x7fd918103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:19.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.669+0000 7fd91dc00700 1 -- 172.21.15.142:0/4126549226 >> 172.21.15.142:0/4126549226 conn(0x7fd9180fe3d0 msgr2=0x7fd918100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:19.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.670+0000 7fd91dc00700 1 -- 172.21.15.142:0/4126549226 shutdown_connections 2024-04-20T22:00:19.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.670+0000 7fd91dc00700 1 -- 172.21.15.142:0/4126549226 wait complete. 2024-04-20T22:00:19.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.671+0000 7fd91dc00700 1 Processor -- start 2024-04-20T22:00:19.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.671+0000 7fd91dc00700 1 -- start start 2024-04-20T22:00:19.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.672+0000 7fd91dc00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd918102e30 0x7fd9181987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:19.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.672+0000 7fd91dc00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd918103f90 0x7fd918198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:19.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.672+0000 7fd91dc00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd918199320 con 0x7fd918102e30 2024-04-20T22:00:19.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.672+0000 7fd91dc00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd918199460 con 0x7fd918103f90 2024-04-20T22:00:19.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.672+0000 7fd916000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd918103f90 0x7fd918198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:19.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.672+0000 7fd916000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd918103f90 0x7fd918198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:49532/0 (socket says 172.21.15.142:49532) 2024-04-20T22:00:19.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.672+0000 7fd916000700 1 -- 172.21.15.142:0/426445203 learned_addr learned my addr 172.21.15.142:0/426445203 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:00:19.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.673+0000 7fd916a00700 1 --2- 172.21.15.142:0/426445203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd918102e30 0x7fd9181987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:19.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.673+0000 7fd916000700 1 -- 172.21.15.142:0/426445203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd918102e30 msgr2=0x7fd9181987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:19.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.673+0000 7fd916000700 1 --2- 172.21.15.142:0/426445203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd918102e30 0x7fd9181987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:19.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.673+0000 7fd916000700 1 -- 172.21.15.142:0/426445203 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9040095f0 con 0x7fd918103f90 2024-04-20T22:00:19.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.673+0000 7fd916000700 1 --2- 172.21.15.142:0/426445203 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd918103f90 0x7fd918198d00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd90400b650 tx=0x7fd90400f510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:19.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.673+0000 7fd90f400700 1 -- 172.21.15.142:0/426445203 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd90401d070 con 0x7fd918103f90 2024-04-20T22:00:19.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.674+0000 7fd91dc00700 1 -- 172.21.15.142:0/426445203 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91819de60 con 0x7fd918103f90 2024-04-20T22:00:19.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.674+0000 7fd91dc00700 1 -- 172.21.15.142:0/426445203 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91819e3a0 con 0x7fd918103f90 2024-04-20T22:00:19.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.674+0000 7fd90f400700 1 -- 172.21.15.142:0/426445203 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd90400fe70 con 0x7fd918103f90 2024-04-20T22:00:19.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.674+0000 7fd90f400700 1 -- 172.21.15.142:0/426445203 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd904017400 con 0x7fd918103f90 2024-04-20T22:00:19.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.675+0000 7fd91dc00700 1 -- 172.21.15.142:0/426445203 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f8005320 con 0x7fd918103f90 2024-04-20T22:00:19.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.676+0000 7fd90f400700 1 -- 172.21.15.142:0/426445203 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7fd904003680 con 0x7fd918103f90 2024-04-20T22:00:19.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.677+0000 7fd90f400700 1 --2- 172.21.15.142:0/426445203 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd8fc06edf0 0x7fd8fc0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:19.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.678+0000 7fd90f400700 1 -- 172.21.15.142:0/426445203 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd9040903f0 con 0x7fd918103f90 2024-04-20T22:00:19.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.678+0000 7fd916a00700 1 --2- 172.21.15.142:0/426445203 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd8fc06edf0 0x7fd8fc0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:19.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.679+0000 7fd916a00700 1 --2- 172.21.15.142:0/426445203 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd8fc06edf0 0x7fd8fc0712b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd908009bf0 tx=0x7fd908009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:19.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:19.684+0000 7fd90f400700 1 -- 172.21.15.142:0/426445203 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fd90405cb90 con 0x7fd918103f90 2024-04-20T22:00:19.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:19 smithi164 ceph-mon[23506]: pgmap v5: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:00:19.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:19 smithi164 ceph-mon[23506]: mgrmap e37: smithi142.zzmcfz(active, since 4s), standbys: smithi164.oejajr 2024-04-20T22:00:20.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.138+0000 7fd91dc00700 1 -- 172.21.15.142:0/426445203 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8f8000bf0 con 0x7fd8fc06edf0 2024-04-20T22:00:20.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.141+0000 7fd90f400700 1 -- 172.21.15.142:0/426445203 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fd8f8000bf0 con 0x7fd8fc06edf0 2024-04-20T22:00:20.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.146+0000 7fd91dc00700 1 -- 172.21.15.142:0/426445203 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd8fc06edf0 msgr2=0x7fd8fc0712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:20.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.146+0000 7fd91dc00700 1 --2- 172.21.15.142:0/426445203 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd8fc06edf0 0x7fd8fc0712b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd908009bf0 tx=0x7fd908009260 comp rx=0 tx=0).stop 2024-04-20T22:00:20.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.146+0000 7fd91dc00700 1 -- 172.21.15.142:0/426445203 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd918103f90 msgr2=0x7fd918198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:20.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.146+0000 7fd91dc00700 1 --2- 172.21.15.142:0/426445203 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd918103f90 0x7fd918198d00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd90400b650 tx=0x7fd90400f510 comp rx=0 tx=0).stop 2024-04-20T22:00:20.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.147+0000 7fd91dc00700 1 -- 172.21.15.142:0/426445203 shutdown_connections 2024-04-20T22:00:20.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.147+0000 7fd91dc00700 1 --2- 172.21.15.142:0/426445203 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd8fc06edf0 0x7fd8fc0712b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:20.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.147+0000 7fd91dc00700 1 --2- 172.21.15.142:0/426445203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd918102e30 0x7fd9181987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:20.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.147+0000 7fd91dc00700 1 --2- 172.21.15.142:0/426445203 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd918103f90 0x7fd918198d00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:20.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.147+0000 7fd91dc00700 1 -- 172.21.15.142:0/426445203 >> 172.21.15.142:0/426445203 conn(0x7fd9180fe3d0 msgr2=0x7fd918107570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:20.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.147+0000 7fd91dc00700 1 -- 172.21.15.142:0/426445203 shutdown_connections 2024-04-20T22:00:20.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.147+0000 7fd91dc00700 1 -- 172.21.15.142:0/426445203 wait complete. 2024-04-20T22:00:20.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.340+0000 7f90fc600700 1 -- 172.21.15.142:0/154454365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f40ff470 msgr2=0x7f90f41018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:20.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.340+0000 7f90fc600700 1 --2- 172.21.15.142:0/154454365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f40ff470 0x7f90f41018a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009870 tx=0x7f90e8009b80 comp rx=0 tx=0).stop 2024-04-20T22:00:20.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.340+0000 7f90fc600700 1 -- 172.21.15.142:0/154454365 shutdown_connections 2024-04-20T22:00:20.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.340+0000 7f90fc600700 1 --2- 172.21.15.142:0/154454365 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90f4101de0 0x7f90f4104270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:20.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.340+0000 7f90fc600700 1 --2- 172.21.15.142:0/154454365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f40ff470 0x7f90f41018a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:20.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.340+0000 7f90fc600700 1 -- 172.21.15.142:0/154454365 >> 172.21.15.142:0/154454365 conn(0x7f90f40fb0d0 msgr2=0x7f90f40fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:20.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.340+0000 7f90fc600700 1 -- 172.21.15.142:0/154454365 shutdown_connections 2024-04-20T22:00:20.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.340+0000 7f90fc600700 1 -- 172.21.15.142:0/154454365 wait complete. 2024-04-20T22:00:20.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.342+0000 7f90fc600700 1 Processor -- start 2024-04-20T22:00:20.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.342+0000 7f90fc600700 1 -- start start 2024-04-20T22:00:20.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.342+0000 7f90fc600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f40ff470 0x7f90f419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:20.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.342+0000 7f90fc600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90f4101de0 0x7f90f419d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:20.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.342+0000 7f90fc600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f419d790 con 0x7f90f40ff470 2024-04-20T22:00:20.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.342+0000 7f90fc600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f419d8d0 con 0x7f90f4101de0 2024-04-20T22:00:20.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.343+0000 7f90f9200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90f4101de0 0x7f90f419d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:20.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.343+0000 7f90f9c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f40ff470 0x7f90f419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:20.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.343+0000 7f90f9200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90f4101de0 0x7f90f419d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:49538/0 (socket says 172.21.15.142:49538) 2024-04-20T22:00:20.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.343+0000 7f90f9200700 1 -- 172.21.15.142:0/3070485799 learned_addr learned my addr 172.21.15.142:0/3070485799 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:00:20.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.343+0000 7f90f9c00700 1 -- 172.21.15.142:0/3070485799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90f4101de0 msgr2=0x7f90f419d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:20.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.343+0000 7f90f9c00700 1 --2- 172.21.15.142:0/3070485799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90f4101de0 0x7f90f419d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:20.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.343+0000 7f90f9c00700 1 -- 172.21.15.142:0/3070485799 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e8009520 con 0x7f90f40ff470 2024-04-20T22:00:20.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.343+0000 7f90f9c00700 1 --2- 172.21.15.142:0/3070485799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f40ff470 0x7f90f419cc30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f90e8000c00 tx=0x7f90e800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:20.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.344+0000 7f90f2000700 1 -- 172.21.15.142:0/3070485799 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90e801c070 con 0x7f90f40ff470 2024-04-20T22:00:20.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.344+0000 7f90f2000700 1 -- 172.21.15.142:0/3070485799 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f90e800fe20 con 0x7f90f40ff470 2024-04-20T22:00:20.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.344+0000 7f90f2000700 1 -- 172.21.15.142:0/3070485799 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90e80173f0 con 0x7f90f40ff470 2024-04-20T22:00:20.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.344+0000 7f90fc600700 1 -- 172.21.15.142:0/3070485799 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f4105bd0 con 0x7f90f40ff470 2024-04-20T22:00:20.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.345+0000 7f90fc600700 1 -- 172.21.15.142:0/3070485799 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f4106140 con 0x7f90f40ff470 2024-04-20T22:00:20.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.346+0000 7f90fc600700 1 -- 172.21.15.142:0/3070485799 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f4062510 con 0x7f90f40ff470 2024-04-20T22:00:20.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.347+0000 7f90f2000700 1 -- 172.21.15.142:0/3070485799 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7f90e8020070 con 0x7f90f40ff470 2024-04-20T22:00:20.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.349+0000 7f90f2000700 1 --2- 172.21.15.142:0/3070485799 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f90dc06ee30 0x7f90dc0712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:20.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.349+0000 7f90f2000700 1 -- 172.21.15.142:0/3070485799 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f90e8090400 con 0x7f90f40ff470 2024-04-20T22:00:20.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.351+0000 7f90f9200700 1 --2- 172.21.15.142:0/3070485799 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f90dc06ee30 0x7f90dc0712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:20.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.353+0000 7f90f9200700 1 --2- 172.21.15.142:0/3070485799 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f90dc06ee30 0x7f90dc0712f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f90e0005950 tx=0x7f90e0009310 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:20.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.356+0000 7f90f2000700 1 -- 172.21.15.142:0/3070485799 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f90e805cb80 con 0x7f90f40ff470 2024-04-20T22:00:20.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.622+0000 7f90fc600700 1 -- 172.21.15.142:0/3070485799 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f90f41028c0 con 0x7f90dc06ee30 2024-04-20T22:00:20.622 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:20 smithi142 ceph-mon[79401]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:00:20.622 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:20 smithi142 ceph-mon[79401]: from='client.24545 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:00:20.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.653+0000 7f90f2000700 1 -- 172.21.15.142:0/3070485799 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f90f41028c0 con 0x7f90dc06ee30 2024-04-20T22:00:20.653 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:00:20.654 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (11m) 30s ago 12m 13.6M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T22:00:20.654 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (13m) 30s ago 13m 8010k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T22:00:20.654 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (11m) 36s ago 11m 7608k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T22:00:20.654 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (13m) 30s ago 13m 6665k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 56f2e41784f8 2024-04-20T22:00:20.654 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (11m) 36s ago 11m 6660k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 bce67525dd3e 2024-04-20T22:00:20.654 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (10m) 30s ago 12m 75.8M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T22:00:20.654 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (5m) 30s ago 5m 211M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 b68e279d7945 2024-04-20T22:00:20.654 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (5m) 30s ago 5m 14.6M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T22:00:20.654 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (5m) 36s ago 5m 14.6M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T22:00:20.654 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (5m) 36s ago 5m 14.8M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T22:00:20.654 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (2m) 30s ago 14m 496M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:00:20.654 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (42s) 36s ago 11m 64.5M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:00:20.654 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (14m) 30s ago 14m 54.3M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c076f7eb00ea 2024-04-20T22:00:20.655 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (11m) 36s ago 11m 42.6M 2048M 18.2.2-1237-g646b8c7d 9900ed1a6b81 2bacdeb02ee0 2024-04-20T22:00:20.655 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (13m) 30s ago 13m 8102k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T22:00:20.655 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (11m) 36s ago 11m 7906k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T22:00:20.655 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (10m) 30s ago 10m 198M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4361ae428e0d 2024-04-20T22:00:20.655 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (9m) 30s ago 9m 206M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 dd7e7cf8e8e1 2024-04-20T22:00:20.655 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (9m) 30s ago 9m 178M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 8e9165365127 2024-04-20T22:00:20.655 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (8m) 36s ago 8m 255M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c081911f56ab 2024-04-20T22:00:20.655 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (8m) 36s ago 8m 220M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 39e09d63d44f 2024-04-20T22:00:20.655 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (7m) 36s ago 7m 203M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4f36124aeb0d 2024-04-20T22:00:20.655 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (51s) 30s ago 12m 45.6M - 2.43.0 a07b618ecd1d 46b76c20eae5 2024-04-20T22:00:20.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.656+0000 7f90fc600700 1 -- 172.21.15.142:0/3070485799 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f90dc06ee30 msgr2=0x7f90dc0712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:20.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.656+0000 7f90fc600700 1 --2- 172.21.15.142:0/3070485799 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f90dc06ee30 0x7f90dc0712f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f90e0005950 tx=0x7f90e0009310 comp rx=0 tx=0).stop 2024-04-20T22:00:20.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.656+0000 7f90fc600700 1 -- 172.21.15.142:0/3070485799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f40ff470 msgr2=0x7f90f419cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:20.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.656+0000 7f90fc600700 1 --2- 172.21.15.142:0/3070485799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f40ff470 0x7f90f419cc30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f90e8000c00 tx=0x7f90e800f740 comp rx=0 tx=0).stop 2024-04-20T22:00:20.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.656+0000 7f90fc600700 1 -- 172.21.15.142:0/3070485799 shutdown_connections 2024-04-20T22:00:20.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.656+0000 7f90fc600700 1 --2- 172.21.15.142:0/3070485799 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f90dc06ee30 0x7f90dc0712f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:20.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.656+0000 7f90fc600700 1 --2- 172.21.15.142:0/3070485799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f40ff470 0x7f90f419cc30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:20.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.656+0000 7f90fc600700 1 --2- 172.21.15.142:0/3070485799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90f4101de0 0x7f90f419d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:20.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.657+0000 7f90fc600700 1 -- 172.21.15.142:0/3070485799 >> 172.21.15.142:0/3070485799 conn(0x7f90f40fb0d0 msgr2=0x7f90f40fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:20.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.657+0000 7f90fc600700 1 -- 172.21.15.142:0/3070485799 shutdown_connections 2024-04-20T22:00:20.657 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.657+0000 7f90fc600700 1 -- 172.21.15.142:0/3070485799 wait complete. 2024-04-20T22:00:20.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:20 smithi164 ceph-mon[23506]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:00:20.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:20 smithi164 ceph-mon[23506]: from='client.24545 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:00:20.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.803+0000 7f4e5fe00700 1 -- 172.21.15.142:0/3977628732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e580ffdd0 msgr2=0x7f4e58100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:20.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.803+0000 7f4e5fe00700 1 --2- 172.21.15.142:0/3977628732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e580ffdd0 0x7f4e58100250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009910 tx=0x7f4e44009c20 comp rx=0 tx=0).stop 2024-04-20T22:00:20.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.804+0000 7f4e5fe00700 1 -- 172.21.15.142:0/3977628732 shutdown_connections 2024-04-20T22:00:20.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.804+0000 7f4e5fe00700 1 --2- 172.21.15.142:0/3977628732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e580ffdd0 0x7f4e58100250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:20.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.804+0000 7f4e5fe00700 1 --2- 172.21.15.142:0/3977628732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e580ff470 0x7f4e580ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:20.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.804+0000 7f4e5fe00700 1 -- 172.21.15.142:0/3977628732 >> 172.21.15.142:0/3977628732 conn(0x7f4e580fb0d0 msgr2=0x7f4e580fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:20.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.804+0000 7f4e5fe00700 1 -- 172.21.15.142:0/3977628732 shutdown_connections 2024-04-20T22:00:20.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.804+0000 7f4e5fe00700 1 -- 172.21.15.142:0/3977628732 wait complete. 2024-04-20T22:00:20.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.805+0000 7f4e5fe00700 1 Processor -- start 2024-04-20T22:00:20.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.805+0000 7f4e5fe00700 1 -- start start 2024-04-20T22:00:20.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.805+0000 7f4e5fe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e580ff470 0x7f4e58198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:20.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.805+0000 7f4e5fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e580ffdd0 0x7f4e58198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:20.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.805+0000 7f4e5fe00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e58199460 con 0x7f4e580ffdd0 2024-04-20T22:00:20.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.805+0000 7f4e5fe00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e581995a0 con 0x7f4e580ff470 2024-04-20T22:00:20.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.805+0000 7f4e5ca00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e580ffdd0 0x7f4e58198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:20.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.805+0000 7f4e5ca00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e580ffdd0 0x7f4e58198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43254/0 (socket says 172.21.15.142:43254) 2024-04-20T22:00:20.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.805+0000 7f4e5ca00700 1 -- 172.21.15.142:0/2799079433 learned_addr learned my addr 172.21.15.142:0/2799079433 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:00:20.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.806+0000 7f4e5ca00700 1 -- 172.21.15.142:0/2799079433 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e580ff470 msgr2=0x7f4e58198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:20.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.806+0000 7f4e5ca00700 1 --2- 172.21.15.142:0/2799079433 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e580ff470 0x7f4e58198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:20.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.806+0000 7f4e5ca00700 1 -- 172.21.15.142:0/2799079433 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e440095f0 con 0x7f4e580ffdd0 2024-04-20T22:00:20.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.806+0000 7f4e5ca00700 1 --2- 172.21.15.142:0/2799079433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e580ffdd0 0x7f4e58198e40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400bd70 tx=0x7f4e4400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:20.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.806+0000 7f4e56000700 1 -- 172.21.15.142:0/2799079433 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e4401d070 con 0x7f4e580ffdd0 2024-04-20T22:00:20.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.806+0000 7f4e56000700 1 -- 172.21.15.142:0/2799079433 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e4400f460 con 0x7f4e580ffdd0 2024-04-20T22:00:20.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.806+0000 7f4e56000700 1 -- 172.21.15.142:0/2799079433 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e44021620 con 0x7f4e580ffdd0 2024-04-20T22:00:20.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.806+0000 7f4e5fe00700 1 -- 172.21.15.142:0/2799079433 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5819dfa0 con 0x7f4e580ffdd0 2024-04-20T22:00:20.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.807+0000 7f4e5fe00700 1 -- 172.21.15.142:0/2799079433 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5819e4e0 con 0x7f4e580ffdd0 2024-04-20T22:00:20.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.808+0000 7f4e5fe00700 1 -- 172.21.15.142:0/2799079433 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e581929e0 con 0x7f4e580ffdd0 2024-04-20T22:00:20.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.809+0000 7f4e56000700 1 -- 172.21.15.142:0/2799079433 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7f4e4400fa70 con 0x7f4e580ffdd0 2024-04-20T22:00:20.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.809+0000 7f4e56000700 1 --2- 172.21.15.142:0/2799079433 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4e4006edf0 0x7f4e400712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:20.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.809+0000 7f4e56000700 1 -- 172.21.15.142:0/2799079433 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4e440903e0 con 0x7f4e580ffdd0 2024-04-20T22:00:20.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.810+0000 7f4e5d400700 1 --2- 172.21.15.142:0/2799079433 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4e4006edf0 0x7f4e400712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:20.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.810+0000 7f4e5d400700 1 --2- 172.21.15.142:0/2799079433 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4e4006edf0 0x7f4e400712b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0097b0 tx=0x7f4e4c006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:20.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:20.814+0000 7f4e56000700 1 -- 172.21.15.142:0/2799079433 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f4e4405cae0 con 0x7f4e580ffdd0 2024-04-20T22:00:21.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.257+0000 7f4e5fe00700 1 -- 172.21.15.142:0/2799079433 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4e58062510 con 0x7f4e580ffdd0 2024-04-20T22:00:21.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.257+0000 7f4e56000700 1 -- 172.21.15.142:0/2799079433 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f4e4405c670 con 0x7f4e580ffdd0 2024-04-20T22:00:21.257 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:00:21.257 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:00:21.257 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 1, 2024-04-20T22:00:21.257 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 1 2024-04-20T22:00:21.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:00:21.257 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:00:21.257 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:00:21.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:00:21.258 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:00:21.258 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 6 2024-04-20T22:00:21.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:00:21.258 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:00:21.258 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4 2024-04-20T22:00:21.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:00:21.258 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:00:21.258 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 11, 2024-04-20T22:00:21.258 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 3 2024-04-20T22:00:21.258 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:00:21.258 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:00:21.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.261+0000 7f4e5fe00700 1 -- 172.21.15.142:0/2799079433 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4e4006edf0 msgr2=0x7f4e400712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:21.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.261+0000 7f4e5fe00700 1 --2- 172.21.15.142:0/2799079433 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4e4006edf0 0x7f4e400712b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0097b0 tx=0x7f4e4c006d20 comp rx=0 tx=0).stop 2024-04-20T22:00:21.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.261+0000 7f4e5fe00700 1 -- 172.21.15.142:0/2799079433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e580ffdd0 msgr2=0x7f4e58198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:21.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.261+0000 7f4e5fe00700 1 --2- 172.21.15.142:0/2799079433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e580ffdd0 0x7f4e58198e40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400bd70 tx=0x7f4e4400be50 comp rx=0 tx=0).stop 2024-04-20T22:00:21.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.261+0000 7f4e5fe00700 1 -- 172.21.15.142:0/2799079433 shutdown_connections 2024-04-20T22:00:21.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.261+0000 7f4e5fe00700 1 --2- 172.21.15.142:0/2799079433 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4e4006edf0 0x7f4e400712b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:21.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.261+0000 7f4e5fe00700 1 --2- 172.21.15.142:0/2799079433 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e580ff470 0x7f4e58198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:21.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.261+0000 7f4e5fe00700 1 --2- 172.21.15.142:0/2799079433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e580ffdd0 0x7f4e58198e40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:21.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.261+0000 7f4e5fe00700 1 -- 172.21.15.142:0/2799079433 >> 172.21.15.142:0/2799079433 conn(0x7f4e580fb0d0 msgr2=0x7f4e58107ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:21.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.262+0000 7f4e5fe00700 1 -- 172.21.15.142:0/2799079433 shutdown_connections 2024-04-20T22:00:21.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.262+0000 7f4e5fe00700 1 -- 172.21.15.142:0/2799079433 wait complete. 2024-04-20T22:00:21.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.430+0000 7f6f53200700 1 -- 172.21.15.142:0/2047284365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f54103ef0 msgr2=0x7f6f541062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:21.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.430+0000 7f6f53200700 1 --2- 172.21.15.142:0/2047284365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f54103ef0 0x7f6f541062e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009910 tx=0x7f6f40009c20 comp rx=0 tx=0).stop 2024-04-20T22:00:21.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.430+0000 7f6f53200700 1 -- 172.21.15.142:0/2047284365 shutdown_connections 2024-04-20T22:00:21.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.430+0000 7f6f53200700 1 --2- 172.21.15.142:0/2047284365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f54103ef0 0x7f6f541062e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:21.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.430+0000 7f6f53200700 1 --2- 172.21.15.142:0/2047284365 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f541015c0 0x7f6f541039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:21.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.430+0000 7f6f53200700 1 -- 172.21.15.142:0/2047284365 >> 172.21.15.142:0/2047284365 conn(0x7f6f540faf10 msgr2=0x7f6f540fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:21.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.430+0000 7f6f53200700 1 -- 172.21.15.142:0/2047284365 shutdown_connections 2024-04-20T22:00:21.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.430+0000 7f6f53200700 1 -- 172.21.15.142:0/2047284365 wait complete. 2024-04-20T22:00:21.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.431+0000 7f6f53200700 1 Processor -- start 2024-04-20T22:00:21.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.431+0000 7f6f53200700 1 -- start start 2024-04-20T22:00:21.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.431+0000 7f6f53200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f541015c0 0x7f6f54100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:21.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.431+0000 7f6f53200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f54103ef0 0x7f6f540ff570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:21.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.431+0000 7f6f53200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f540ffab0 con 0x7f6f541015c0 2024-04-20T22:00:21.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.431+0000 7f6f53200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f540ffbf0 con 0x7f6f54103ef0 2024-04-20T22:00:21.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.432+0000 7f6f51e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f541015c0 0x7f6f54100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:21.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.432+0000 7f6f51e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f541015c0 0x7f6f54100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43266/0 (socket says 172.21.15.142:43266) 2024-04-20T22:00:21.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.432+0000 7f6f51e00700 1 -- 172.21.15.142:0/1946906911 learned_addr learned my addr 172.21.15.142:0/1946906911 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:00:21.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.432+0000 7f6f51400700 1 --2- 172.21.15.142:0/1946906911 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f54103ef0 0x7f6f540ff570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:21.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.432+0000 7f6f51e00700 1 -- 172.21.15.142:0/1946906911 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f54103ef0 msgr2=0x7f6f540ff570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:21.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.432+0000 7f6f51e00700 1 --2- 172.21.15.142:0/1946906911 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f54103ef0 0x7f6f540ff570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:21.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.432+0000 7f6f51e00700 1 -- 172.21.15.142:0/1946906911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f400095f0 con 0x7f6f541015c0 2024-04-20T22:00:21.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.433+0000 7f6f51e00700 1 --2- 172.21.15.142:0/1946906911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f541015c0 0x7f6f54100ed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400c8a0 tx=0x7f6f4400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:21.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.433+0000 7f6f4aa00700 1 -- 172.21.15.142:0/1946906911 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f4400cea0 con 0x7f6f541015c0 2024-04-20T22:00:21.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.433+0000 7f6f4aa00700 1 -- 172.21.15.142:0/1946906911 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f44004830 con 0x7f6f541015c0 2024-04-20T22:00:21.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.433+0000 7f6f4aa00700 1 -- 172.21.15.142:0/1946906911 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f440055b0 con 0x7f6f541015c0 2024-04-20T22:00:21.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.433+0000 7f6f53200700 1 -- 172.21.15.142:0/1946906911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f540ffed0 con 0x7f6f541015c0 2024-04-20T22:00:21.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.433+0000 7f6f53200700 1 -- 172.21.15.142:0/1946906911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5419e4a0 con 0x7f6f541015c0 2024-04-20T22:00:21.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.434+0000 7f6f53200700 1 -- 172.21.15.142:0/1946906911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5404f400 con 0x7f6f541015c0 2024-04-20T22:00:21.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.435+0000 7f6f4aa00700 1 -- 172.21.15.142:0/1946906911 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7f6f440049a0 con 0x7f6f541015c0 2024-04-20T22:00:21.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.436+0000 7f6f4aa00700 1 --2- 172.21.15.142:0/1946906911 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6f3806edf0 0x7f6f380712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:21.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.436+0000 7f6f4aa00700 1 -- 172.21.15.142:0/1946906911 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6f4408e980 con 0x7f6f541015c0 2024-04-20T22:00:21.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.436+0000 7f6f51400700 1 --2- 172.21.15.142:0/1946906911 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6f3806edf0 0x7f6f380712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:21.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.437+0000 7f6f51400700 1 --2- 172.21.15.142:0/1946906911 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6f3806edf0 0x7f6f380712b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6f400051c0 tx=0x7f6f4000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:21.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.441+0000 7f6f4aa00700 1 -- 172.21.15.142:0/1946906911 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f6f4405b1c0 con 0x7f6f541015c0 2024-04-20T22:00:21.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.800+0000 7f6f53200700 1 -- 172.21.15.142:0/1946906911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6f5419e750 con 0x7f6f541015c0 2024-04-20T22:00:21.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.801+0000 7f6f4aa00700 1 -- 172.21.15.142:0/1946906911 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1898 (secure 0 0 0) 0x7f6f4401d780 con 0x7f6f541015c0 2024-04-20T22:00:21.801 INFO:teuthology.orchestra.run.smithi142.stdout:e12 2024-04-20T22:00:21.801 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:00:21.801 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:00:21.801 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T22:00:21.802 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:00:21.802 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T22:00:21.802 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T22:00:21.802 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 12 2024-04-20T22:00:21.802 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:00:21.802 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:00:21.802 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:51.692699+0000 2024-04-20T22:00:21.802 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T22:00:21.802 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T22:00:21.802 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T22:00:21.802 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T22:00:21.802 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T22:00:21.802 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T22:00:21.802 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T22:00:21.803 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T22:00:21.803 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T22:00:21.803 INFO:teuthology.orchestra.run.smithi142.stdout:snap_rstat 1 2024-04-20T22:00:21.803 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:00:21.803 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T22:00:21.803 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T22:00:21.803 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T22:00:21.803 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T22:00:21.803 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T22:00:21.803 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T22:00:21.803 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T22:00:21.803 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T22:00:21.803 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T22:00:21.803 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T22:00:21.803 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T22:00:21.804 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T22:00:21.804 INFO:teuthology.orchestra.run.smithi142.stdout:qdb_cluster leader: 0 members: 2024-04-20T22:00:21.804 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:00:21.804 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:00:21.804 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:00:21.804 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T22:00:21.804 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:00:21.804 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:00:21.804 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:00:21.804 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:00:21.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.807+0000 7f6f53200700 1 -- 172.21.15.142:0/1946906911 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6f3806edf0 msgr2=0x7f6f380712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:21.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.807+0000 7f6f53200700 1 --2- 172.21.15.142:0/1946906911 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6f3806edf0 0x7f6f380712b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6f400051c0 tx=0x7f6f4000b540 comp rx=0 tx=0).stop 2024-04-20T22:00:21.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.807+0000 7f6f53200700 1 -- 172.21.15.142:0/1946906911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f541015c0 msgr2=0x7f6f54100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:21.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.807+0000 7f6f53200700 1 --2- 172.21.15.142:0/1946906911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f541015c0 0x7f6f54100ed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400c8a0 tx=0x7f6f4400cc60 comp rx=0 tx=0).stop 2024-04-20T22:00:21.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.807+0000 7f6f53200700 1 -- 172.21.15.142:0/1946906911 shutdown_connections 2024-04-20T22:00:21.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.807+0000 7f6f53200700 1 --2- 172.21.15.142:0/1946906911 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6f3806edf0 0x7f6f380712b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:21.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.807+0000 7f6f53200700 1 --2- 172.21.15.142:0/1946906911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f541015c0 0x7f6f54100ed0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:21.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.807+0000 7f6f53200700 1 --2- 172.21.15.142:0/1946906911 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f54103ef0 0x7f6f540ff570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:21.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.807+0000 7f6f53200700 1 -- 172.21.15.142:0/1946906911 >> 172.21.15.142:0/1946906911 conn(0x7f6f540faf10 msgr2=0x7f6f540fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:21.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.808+0000 7f6f53200700 1 -- 172.21.15.142:0/1946906911 shutdown_connections 2024-04-20T22:00:21.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.808+0000 7f6f53200700 1 -- 172.21.15.142:0/1946906911 wait complete. 2024-04-20T22:00:21.809 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T22:00:21.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.995+0000 7f4a16c00700 1 -- 172.21.15.142:0/4201436513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a10100c20 msgr2=0x7f4a10101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:21.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.995+0000 7f4a16c00700 1 --2- 172.21.15.142:0/4201436513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a10100c20 0x7f4a10101040 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009910 tx=0x7f4a00009c20 comp rx=0 tx=0).stop 2024-04-20T22:00:21.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.995+0000 7f4a16c00700 1 -- 172.21.15.142:0/4201436513 shutdown_connections 2024-04-20T22:00:21.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.995+0000 7f4a16c00700 1 --2- 172.21.15.142:0/4201436513 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a10101e20 0x7f4a10102280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:21.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.995+0000 7f4a16c00700 1 --2- 172.21.15.142:0/4201436513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a10100c20 0x7f4a10101040 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:21.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.995+0000 7f4a16c00700 1 -- 172.21.15.142:0/4201436513 >> 172.21.15.142:0/4201436513 conn(0x7f4a100fc1e0 msgr2=0x7f4a100fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:21.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.995+0000 7f4a16c00700 1 -- 172.21.15.142:0/4201436513 shutdown_connections 2024-04-20T22:00:21.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.995+0000 7f4a16c00700 1 -- 172.21.15.142:0/4201436513 wait complete. 2024-04-20T22:00:21.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.996+0000 7f4a16c00700 1 Processor -- start 2024-04-20T22:00:21.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.997+0000 7f4a16c00700 1 -- start start 2024-04-20T22:00:21.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.997+0000 7f4a16c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a10100c20 0x7f4a10198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:21.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.997+0000 7f4a16c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a10101e20 0x7f4a10198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:21.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.997+0000 7f4a16c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a10199390 con 0x7f4a10101e20 2024-04-20T22:00:21.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.997+0000 7f4a16c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a101994d0 con 0x7f4a10100c20 2024-04-20T22:00:21.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.998+0000 7f4a0fe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a10100c20 0x7f4a10198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:21.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.998+0000 7f4a0f400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a10101e20 0x7f4a10198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:21.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.998+0000 7f4a0f400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a10101e20 0x7f4a10198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43292/0 (socket says 172.21.15.142:43292) 2024-04-20T22:00:21.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.998+0000 7f4a0f400700 1 -- 172.21.15.142:0/3861400347 learned_addr learned my addr 172.21.15.142:0/3861400347 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:00:21.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.998+0000 7f4a0f400700 1 -- 172.21.15.142:0/3861400347 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a10100c20 msgr2=0x7f4a10198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:21.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.998+0000 7f4a0f400700 1 --2- 172.21.15.142:0/3861400347 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a10100c20 0x7f4a10198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:21.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.998+0000 7f4a0f400700 1 -- 172.21.15.142:0/3861400347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a000095f0 con 0x7f4a10101e20 2024-04-20T22:00:21.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.999+0000 7f4a0f400700 1 --2- 172.21.15.142:0/3861400347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a10101e20 0x7f4a10198d70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00c8a0 tx=0x7f49fc00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:21.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.999+0000 7f4a0cc00700 1 -- 172.21.15.142:0/3861400347 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49fc0078e0 con 0x7f4a10101e20 2024-04-20T22:00:21.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.999+0000 7f4a0cc00700 1 -- 172.21.15.142:0/3861400347 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49fc00f450 con 0x7f4a10101e20 2024-04-20T22:00:21.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.999+0000 7f4a0cc00700 1 -- 172.21.15.142:0/3861400347 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49fc00e5e0 con 0x7f4a10101e20 2024-04-20T22:00:21.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.999+0000 7f4a16c00700 1 -- 172.21.15.142:0/3861400347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1019dee0 con 0x7f4a10101e20 2024-04-20T22:00:21.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:21.999+0000 7f4a16c00700 1 -- 172.21.15.142:0/3861400347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1019e480 con 0x7f4a10101e20 2024-04-20T22:00:22.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.001+0000 7f4a16c00700 1 -- 172.21.15.142:0/3861400347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a101062d0 con 0x7f4a10101e20 2024-04-20T22:00:22.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.001+0000 7f4a0cc00700 1 -- 172.21.15.142:0/3861400347 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7f49fc00f5c0 con 0x7f4a10101e20 2024-04-20T22:00:22.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.002+0000 7f4a0cc00700 1 --2- 172.21.15.142:0/3861400347 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f49f406edf0 0x7f49f40712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:22.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.002+0000 7f4a0cc00700 1 -- 172.21.15.142:0/3861400347 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f49fc08f0b0 con 0x7f4a10101e20 2024-04-20T22:00:22.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.003+0000 7f4a0fe00700 1 --2- 172.21.15.142:0/3861400347 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f49f406edf0 0x7f49f40712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:22.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.004+0000 7f4a0fe00700 1 --2- 172.21.15.142:0/3861400347 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f49f406edf0 0x7f49f40712b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4a00005090 tx=0x7f4a00005180 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:22.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.010+0000 7f4a0cc00700 1 -- 172.21.15.142:0/3861400347 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f49fc05b730 con 0x7f4a10101e20 2024-04-20T22:00:22.062 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:21 smithi142 ceph-mon[79401]: pgmap v6: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:00:22.062 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:21 smithi142 ceph-mon[79401]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:00:22.062 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:21 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:22.062 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:21 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:22.062 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:21 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2799079433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:00:22.063 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:21 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1946906911' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:00:22.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:21 smithi164 ceph-mon[23506]: pgmap v6: 65 pgs: 65 active+clean; 281 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:00:22.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:21 smithi164 ceph-mon[23506]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:00:22.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:21 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:22.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:21 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:22.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:21 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/2799079433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:00:22.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:21 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/1946906911' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:00:22.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.396+0000 7f4a16c00700 1 -- 172.21.15.142:0/3861400347 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a1002ce50 con 0x7f49f406edf0 2024-04-20T22:00:22.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.399+0000 7f4a0cc00700 1 -- 172.21.15.142:0/3861400347 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f4a1002ce50 con 0x7f49f406edf0 2024-04-20T22:00:22.399 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:00:22.399 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T22:00:22.399 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T22:00:22.399 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T22:00:22.399 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T22:00:22.399 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr" 2024-04-20T22:00:22.399 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T22:00:22.399 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "2/23 daemons upgraded", 2024-04-20T22:00:22.399 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "", 2024-04-20T22:00:22.399 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T22:00:22.400 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:00:22.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.404+0000 7f4a16c00700 1 -- 172.21.15.142:0/3861400347 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f49f406edf0 msgr2=0x7f49f40712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:22.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.404+0000 7f4a16c00700 1 --2- 172.21.15.142:0/3861400347 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f49f406edf0 0x7f49f40712b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4a00005090 tx=0x7f4a00005180 comp rx=0 tx=0).stop 2024-04-20T22:00:22.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.404+0000 7f4a16c00700 1 -- 172.21.15.142:0/3861400347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a10101e20 msgr2=0x7f4a10198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:22.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.404+0000 7f4a16c00700 1 --2- 172.21.15.142:0/3861400347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a10101e20 0x7f4a10198d70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00c8a0 tx=0x7f49fc00cbb0 comp rx=0 tx=0).stop 2024-04-20T22:00:22.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.404+0000 7f4a16c00700 1 -- 172.21.15.142:0/3861400347 shutdown_connections 2024-04-20T22:00:22.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.404+0000 7f4a16c00700 1 --2- 172.21.15.142:0/3861400347 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f49f406edf0 0x7f49f40712b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:22.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.404+0000 7f4a16c00700 1 --2- 172.21.15.142:0/3861400347 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a10100c20 0x7f4a10198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:22.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.404+0000 7f4a16c00700 1 --2- 172.21.15.142:0/3861400347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a10101e20 0x7f4a10198d70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:22.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.404+0000 7f4a16c00700 1 -- 172.21.15.142:0/3861400347 >> 172.21.15.142:0/3861400347 conn(0x7f4a100fc1e0 msgr2=0x7f4a10103410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:22.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.404+0000 7f4a16c00700 1 -- 172.21.15.142:0/3861400347 shutdown_connections 2024-04-20T22:00:22.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.404+0000 7f4a16c00700 1 -- 172.21.15.142:0/3861400347 wait complete. 2024-04-20T22:00:22.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.601+0000 7f1861000700 1 -- 172.21.15.142:0/1776062757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f185c074eb0 msgr2=0x7f185c073310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:22.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.601+0000 7f1861000700 1 --2- 172.21.15.142:0/1776062757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f185c074eb0 0x7f185c073310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f184c009910 tx=0x7f184c009c20 comp rx=0 tx=0).stop 2024-04-20T22:00:22.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.602+0000 7f1861000700 1 -- 172.21.15.142:0/1776062757 shutdown_connections 2024-04-20T22:00:22.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.602+0000 7f1861000700 1 --2- 172.21.15.142:0/1776062757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f185c0738e0 0x7f185c073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:22.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.602+0000 7f1861000700 1 --2- 172.21.15.142:0/1776062757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f185c074eb0 0x7f185c073310 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:22.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.602+0000 7f1861000700 1 -- 172.21.15.142:0/1776062757 >> 172.21.15.142:0/1776062757 conn(0x7f185c0fc1e0 msgr2=0x7f185c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:22.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.602+0000 7f1861000700 1 -- 172.21.15.142:0/1776062757 shutdown_connections 2024-04-20T22:00:22.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.602+0000 7f1861000700 1 -- 172.21.15.142:0/1776062757 wait complete. 2024-04-20T22:00:22.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.603+0000 7f1861000700 1 Processor -- start 2024-04-20T22:00:22.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.603+0000 7f1861000700 1 -- start start 2024-04-20T22:00:22.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.604+0000 7f1861000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f185c0738e0 0x7f185c1944e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:22.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.604+0000 7f1861000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f185c074eb0 0x7f185c194a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:22.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.604+0000 7f1861000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c194ff0 con 0x7f185c074eb0 2024-04-20T22:00:22.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.604+0000 7f1861000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c195160 con 0x7f185c0738e0 2024-04-20T22:00:22.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.605+0000 7f1859400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f185c074eb0 0x7f185c194a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:22.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.605+0000 7f1859e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f185c0738e0 0x7f185c1944e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:22.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.605+0000 7f1859e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f185c0738e0 0x7f185c1944e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:49620/0 (socket says 172.21.15.142:49620) 2024-04-20T22:00:22.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.605+0000 7f1859e00700 1 -- 172.21.15.142:0/3022592200 learned_addr learned my addr 172.21.15.142:0/3022592200 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:00:22.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.605+0000 7f1859400700 1 -- 172.21.15.142:0/3022592200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f185c0738e0 msgr2=0x7f185c1944e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:22.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.605+0000 7f1859400700 1 --2- 172.21.15.142:0/3022592200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f185c0738e0 0x7f185c1944e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:22.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.605+0000 7f1859400700 1 -- 172.21.15.142:0/3022592200 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c0095f0 con 0x7f185c074eb0 2024-04-20T22:00:22.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.606+0000 7f1859400700 1 --2- 172.21.15.142:0/3022592200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f185c074eb0 0x7f185c194a20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f184800b400 tx=0x7f184800b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:22.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.606+0000 7f1852a00700 1 -- 172.21.15.142:0/3022592200 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1848011800 con 0x7f185c074eb0 2024-04-20T22:00:22.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.606+0000 7f1861000700 1 -- 172.21.15.142:0/3022592200 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185c1aac00 con 0x7f185c074eb0 2024-04-20T22:00:22.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.606+0000 7f1861000700 1 -- 172.21.15.142:0/3022592200 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185c1ab1d0 con 0x7f185c074eb0 2024-04-20T22:00:22.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.607+0000 7f1852a00700 1 -- 172.21.15.142:0/3022592200 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f184800be80 con 0x7f185c074eb0 2024-04-20T22:00:22.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.607+0000 7f1852a00700 1 -- 172.21.15.142:0/3022592200 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f184801ae90 con 0x7f185c074eb0 2024-04-20T22:00:22.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.608+0000 7f1861000700 1 -- 172.21.15.142:0/3022592200 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183c0052f0 con 0x7f185c074eb0 2024-04-20T22:00:22.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.611+0000 7f1852a00700 1 -- 172.21.15.142:0/3022592200 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7f184801a400 con 0x7f185c074eb0 2024-04-20T22:00:22.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.613+0000 7f1852a00700 1 --2- 172.21.15.142:0/3022592200 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f184006edf0 0x7f18400712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:22.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.613+0000 7f1852a00700 1 -- 172.21.15.142:0/3022592200 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f184808ed00 con 0x7f185c074eb0 2024-04-20T22:00:22.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.613+0000 7f1859e00700 1 --2- 172.21.15.142:0/3022592200 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f184006edf0 0x7f18400712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:22.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.615+0000 7f1859e00700 1 --2- 172.21.15.142:0/3022592200 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f184006edf0 0x7f18400712b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f184c0051c0 tx=0x7f184c00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:22.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:22.617+0000 7f1852a00700 1 -- 172.21.15.142:0/3022592200 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f184805b590 con 0x7f185c074eb0 2024-04-20T22:00:23.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:23.095+0000 7f1861000700 1 -- 172.21.15.142:0/3022592200 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f183c005160 con 0x7f185c074eb0 2024-04-20T22:00:23.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:23.097+0000 7f1852a00700 1 -- 172.21.15.142:0/3022592200 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f184805b120 con 0x7f185c074eb0 2024-04-20T22:00:23.097 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_OK 2024-04-20T22:00:23.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:23.100+0000 7f1861000700 1 -- 172.21.15.142:0/3022592200 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f184006edf0 msgr2=0x7f18400712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:23.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:23.100+0000 7f1861000700 1 --2- 172.21.15.142:0/3022592200 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f184006edf0 0x7f18400712b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f184c0051c0 tx=0x7f184c00b540 comp rx=0 tx=0).stop 2024-04-20T22:00:23.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:23.100+0000 7f1861000700 1 -- 172.21.15.142:0/3022592200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f185c074eb0 msgr2=0x7f185c194a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:23.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:23.100+0000 7f1861000700 1 --2- 172.21.15.142:0/3022592200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f185c074eb0 0x7f185c194a20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f184800b400 tx=0x7f184800b710 comp rx=0 tx=0).stop 2024-04-20T22:00:23.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:23.100+0000 7f1861000700 1 -- 172.21.15.142:0/3022592200 shutdown_connections 2024-04-20T22:00:23.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:23.100+0000 7f1861000700 1 --2- 172.21.15.142:0/3022592200 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f184006edf0 0x7f18400712b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:23.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:23.100+0000 7f1861000700 1 --2- 172.21.15.142:0/3022592200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f185c0738e0 0x7f185c1944e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:23.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:23.100+0000 7f1861000700 1 --2- 172.21.15.142:0/3022592200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f185c074eb0 0x7f185c194a20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:23.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:23.100+0000 7f1861000700 1 -- 172.21.15.142:0/3022592200 >> 172.21.15.142:0/3022592200 conn(0x7f185c0fc1e0 msgr2=0x7f185c102a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:23.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:23.101+0000 7f1861000700 1 -- 172.21.15.142:0/3022592200 shutdown_connections 2024-04-20T22:00:23.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:23.101+0000 7f1861000700 1 -- 172.21.15.142:0/3022592200 wait complete. 2024-04-20T22:00:24.302 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:24 smithi142 ceph-mon[79401]: pgmap v7: 65 pgs: 65 active+clean; 279 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 802 KiB/s wr, 411 op/s 2024-04-20T22:00:24.302 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:24 smithi142 ceph-mon[79401]: from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:00:24.302 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:24 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:24.302 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:24 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:24.302 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:24 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3022592200' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:00:24.380 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:24 smithi164 ceph-mon[23506]: pgmap v7: 65 pgs: 65 active+clean; 279 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 802 KiB/s wr, 411 op/s 2024-04-20T22:00:24.380 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:24 smithi164 ceph-mon[23506]: from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:00:24.380 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:24 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:24.380 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:24 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:24.381 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:24 smithi164 ceph-mon[23506]: from='client.? 172.21.15.142:0/3022592200' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:00:26.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:26 smithi142 ceph-mon[79401]: pgmap v8: 65 pgs: 65 active+clean; 279 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 623 KiB/s wr, 319 op/s 2024-04-20T22:00:26.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:26 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:26.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:26 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:26.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:26 smithi164 ceph-mon[23506]: pgmap v8: 65 pgs: 65 active+clean; 279 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 623 KiB/s wr, 319 op/s 2024-04-20T22:00:26.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:26 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:26.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:26 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:28.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:28 smithi164 ceph-mon[23506]: pgmap v9: 65 pgs: 65 active+clean; 275 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 994 KiB/s wr, 476 op/s 2024-04-20T22:00:28.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:28 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:28.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:28 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:28.578 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:28 smithi142 ceph-mon[79401]: pgmap v9: 65 pgs: 65 active+clean; 275 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 994 KiB/s wr, 476 op/s 2024-04-20T22:00:28.578 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:28 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:28.578 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:28 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:30.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:29 smithi164 ceph-mon[23506]: pgmap v10: 65 pgs: 65 active+clean; 275 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 910 KiB/s wr, 435 op/s 2024-04-20T22:00:30.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:29 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:30.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:29 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:30.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:29 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:00:30.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:29 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:00:30.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:29 smithi164 ceph-mon[23506]: Updating smithi142:/etc/ceph/ceph.conf 2024-04-20T22:00:30.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:29 smithi164 ceph-mon[23506]: Updating smithi164:/etc/ceph/ceph.conf 2024-04-20T22:00:30.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:29 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:00:30.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:29 smithi142 ceph-mon[79401]: pgmap v10: 65 pgs: 65 active+clean; 275 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 910 KiB/s wr, 435 op/s 2024-04-20T22:00:30.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:30.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:30.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:00:30.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:00:30.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:29 smithi142 ceph-mon[79401]: Updating smithi142:/etc/ceph/ceph.conf 2024-04-20T22:00:30.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:29 smithi142 ceph-mon[79401]: Updating smithi164:/etc/ceph/ceph.conf 2024-04-20T22:00:30.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:00:31.102 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:30 smithi142 ceph-mon[79401]: Updating smithi164:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T22:00:31.103 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:30 smithi142 ceph-mon[79401]: Updating smithi142:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T22:00:31.103 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:30 smithi142 ceph-mon[79401]: Updating smithi164:/etc/ceph/ceph.client.admin.keyring 2024-04-20T22:00:31.103 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:30 smithi142 ceph-mon[79401]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-04-20T22:00:31.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:30 smithi164 ceph-mon[23506]: Updating smithi164:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T22:00:31.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:30 smithi164 ceph-mon[23506]: Updating smithi142:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.conf 2024-04-20T22:00:31.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:30 smithi164 ceph-mon[23506]: Updating smithi164:/etc/ceph/ceph.client.admin.keyring 2024-04-20T22:00:31.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:30 smithi164 ceph-mon[23506]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-04-20T22:00:32.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:31 smithi164 ceph-mon[23506]: pgmap v11: 65 pgs: 65 active+clean; 275 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 910 KiB/s wr, 435 op/s 2024-04-20T22:00:32.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:31 smithi164 ceph-mon[23506]: Updating smithi164:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T22:00:32.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:31 smithi164 ceph-mon[23506]: Updating smithi142:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T22:00:32.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:31 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:32.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:31 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:32.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:31 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:32.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:31 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:32.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:31 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:32.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:31 smithi142 ceph-mon[79401]: pgmap v11: 65 pgs: 65 active+clean; 275 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 910 KiB/s wr, 435 op/s 2024-04-20T22:00:32.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:31 smithi142 ceph-mon[79401]: Updating smithi164:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T22:00:32.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:31 smithi142 ceph-mon[79401]: Updating smithi142:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T22:00:32.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:31 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:32.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:31 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:32.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:31 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:32.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:31 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:32.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:31 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:33.033 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:32 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:00:33.033 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:32 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:00:33.033 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:32 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-20T22:00:33.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:32 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:00:33.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:32 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:00:33.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:32 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-20T22:00:33.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:33 smithi142 ceph-mon[79401]: pgmap v12: 65 pgs: 65 active+clean; 262 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 51 KiB/s rd, 1.4 MiB/s wr, 617 op/s 2024-04-20T22:00:34.179 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:33 smithi164 ceph-mon[23506]: pgmap v12: 65 pgs: 65 active+clean; 262 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 51 KiB/s rd, 1.4 MiB/s wr, 617 op/s 2024-04-20T22:00:35.626 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:35 smithi164 ceph-mon[23506]: Upgrade: Updating mon.smithi164 2024-04-20T22:00:35.627 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:35 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:35.627 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:35 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T22:00:35.627 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:35 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T22:00:35.627 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:35 smithi164 ceph-mon[23506]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:00:35.627 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:35 smithi164 ceph-mon[23506]: Deploying daemon mon.smithi164 on smithi164 2024-04-20T22:00:35.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:35 smithi142 ceph-mon[79401]: Upgrade: Updating mon.smithi164 2024-04-20T22:00:35.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:35 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:35.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:35 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T22:00:35.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:35 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T22:00:35.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:35 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:00:35.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:35 smithi142 ceph-mon[79401]: Deploying daemon mon.smithi164 on smithi164 2024-04-20T22:00:36.319 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:36 smithi164 ceph-mon[23506]: pgmap v13: 65 pgs: 65 active+clean; 262 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 940 KiB/s wr, 378 op/s 2024-04-20T22:00:36.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:36 smithi142 ceph-mon[79401]: pgmap v13: 65 pgs: 65 active+clean; 262 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 940 KiB/s wr, 378 op/s 2024-04-20T22:00:37.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:36 smithi164 systemd[1]: Stopping Ceph mon.smithi164 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:00:37.661 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:37 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi164[23502]: 2024-04-20T22:00:37.405+0000 7f1391400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi164 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T22:00:37.661 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:37 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi164[23502]: 2024-04-20T22:00:37.405+0000 7f1391400700 -1 mon.smithi164@1(peon) e2 *** Got Signal Terminated *** 2024-04-20T22:00:38.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:37 smithi164 podman[69626]: 2024-04-20 22:00:37.661496302 +0000 UTC m=+0.409172460 container died 2bacdeb02ee02b216e24e970275c8b80080d6a7173935e00212817718805a038 (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi164, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=reef-646b8c7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-04-20T22:00:38.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:38 smithi164 podman[69626]: 2024-04-20 22:00:38.103666658 +0000 UTC m=+0.851342808 container cleanup 2bacdeb02ee02b216e24e970275c8b80080d6a7173935e00212817718805a038 (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi164, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=reef-646b8c7, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-20T22:00:38.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:38 smithi164 bash[69626]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi164 2024-04-20T22:00:38.826 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:38 smithi164 podman[69640]: 2024-04-20 22:00:38.447297536 +0000 UTC m=+0.762392615 container remove 2bacdeb02ee02b216e24e970275c8b80080d6a7173935e00212817718805a038 (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi164, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, RELEASE=reef-646b8c7) 2024-04-20T22:00:39.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:38 smithi164 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mon.smithi164.service: Deactivated successfully. 2024-04-20T22:00:39.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:38 smithi164 systemd[1]: Stopped Ceph mon.smithi164 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T22:00:39.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:38 smithi164 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mon.smithi164.service: Consumed 15.876s CPU time. 2024-04-20T22:00:39.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:39 smithi164 systemd[1]: Starting Ceph mon.smithi164 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:00:40.078 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:39 smithi164 podman[69766]: 2024-04-20 22:00:39.634455204 +0000 UTC m=+0.036559563 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:00:40.078 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:39 smithi164 podman[69766]: 2024-04-20 22:00:39.789684347 +0000 UTC m=+0.191788743 container create 133512694d4633656297593db3e471bf23b273b45bf9e5f2859e8ae3f239a7a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi164, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-20T22:00:40.078 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 podman[69766]: 2024-04-20 22:00:40.078317998 +0000 UTC m=+0.480422371 container init 133512694d4633656297593db3e471bf23b273b45bf9e5f2859e8ae3f239a7a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi164, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-20T22:00:40.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 podman[69766]: 2024-04-20 22:00:40.097576194 +0000 UTC m=+0.499680552 container start 133512694d4633656297593db3e471bf23b273b45bf9e5f2859e8ae3f239a7a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi164, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0) 2024-04-20T22:00:40.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: set uid:gid to 167:167 (ceph:ceph) 2024-04-20T22:00:40.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev), process ceph-mon, pid 2 2024-04-20T22:00:40.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: pidfile_write: ignore empty --pid-file 2024-04-20T22:00:40.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: load: jerasure load: lrc 2024-04-20T22:00:40.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: RocksDB version: 7.9.2 2024-04-20T22:00:40.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Git sha 0 2024-04-20T22:00:40.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Compile date 2024-04-17 00:07:32 2024-04-20T22:00:40.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: DB SUMMARY 2024-04-20T22:00:40.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: DB Session ID: CDQOVH8JVTEP54VGC0WE 2024-04-20T22:00:40.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: CURRENT file: CURRENT 2024-04-20T22:00:40.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: IDENTITY file: IDENTITY 2024-04-20T22:00:40.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1390 Bytes 2024-04-20T22:00:40.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi164/store.db dir, Total Num: 1, files: 000027.sst 2024-04-20T22:00:40.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi164/store.db: 000025.log size: 6570860 ; 2024-04-20T22:00:40.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.error_if_exists: 0 2024-04-20T22:00:40.450 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.create_if_missing: 0 2024-04-20T22:00:40.450 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.paranoid_checks: 1 2024-04-20T22:00:40.450 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-20T22:00:40.450 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-20T22:00:40.450 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-20T22:00:40.450 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.env: 0x55f2ef198cc0 2024-04-20T22:00:40.450 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.fs: PosixFileSystem 2024-04-20T22:00:40.450 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.info_log: 0x55f310a79b00 2024-04-20T22:00:40.450 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_file_opening_threads: 16 2024-04-20T22:00:40.450 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.statistics: (nil) 2024-04-20T22:00:40.450 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.use_fsync: 0 2024-04-20T22:00:40.450 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_log_file_size: 0 2024-04-20T22:00:40.450 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-20T22:00:40.450 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-20T22:00:40.451 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.keep_log_file_num: 1000 2024-04-20T22:00:40.451 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.recycle_log_file_num: 0 2024-04-20T22:00:40.451 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.allow_fallocate: 1 2024-04-20T22:00:40.451 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.allow_mmap_reads: 0 2024-04-20T22:00:40.451 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.allow_mmap_writes: 0 2024-04-20T22:00:40.451 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.use_direct_reads: 0 2024-04-20T22:00:40.451 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-20T22:00:40.451 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.create_missing_column_families: 0 2024-04-20T22:00:40.451 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.db_log_dir: 2024-04-20T22:00:40.451 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.wal_dir: 2024-04-20T22:00:40.452 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-20T22:00:40.452 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-20T22:00:40.452 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-20T22:00:40.452 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-20T22:00:40.452 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-20T22:00:40.452 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-20T22:00:40.452 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.advise_random_on_open: 1 2024-04-20T22:00:40.452 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.db_write_buffer_size: 0 2024-04-20T22:00:40.452 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.write_buffer_manager: 0x55f310a481e0 2024-04-20T22:00:40.452 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-20T22:00:40.452 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-20T22:00:40.452 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-20T22:00:40.452 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.rate_limiter: (nil) 2024-04-20T22:00:40.452 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-20T22:00:40.452 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.wal_recovery_mode: 2 2024-04-20T22:00:40.453 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.enable_thread_tracking: 0 2024-04-20T22:00:40.453 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.enable_pipelined_write: 0 2024-04-20T22:00:40.453 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.unordered_write: 0 2024-04-20T22:00:40.453 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-20T22:00:40.453 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-20T22:00:40.453 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-20T22:00:40.453 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-20T22:00:40.453 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.row_cache: None 2024-04-20T22:00:40.453 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.wal_filter: None 2024-04-20T22:00:40.453 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-20T22:00:40.453 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.allow_ingest_behind: 0 2024-04-20T22:00:40.453 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.two_write_queues: 0 2024-04-20T22:00:40.453 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.manual_wal_flush: 0 2024-04-20T22:00:40.453 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.wal_compression: 0 2024-04-20T22:00:40.453 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.atomic_flush: 0 2024-04-20T22:00:40.454 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-20T22:00:40.454 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-20T22:00:40.454 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-20T22:00:40.454 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.log_readahead_size: 0 2024-04-20T22:00:40.454 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-20T22:00:40.454 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.best_efforts_recovery: 0 2024-04-20T22:00:40.454 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-20T22:00:40.455 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-20T22:00:40.455 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.allow_data_in_errors: 0 2024-04-20T22:00:40.455 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.db_host_id: __hostname__ 2024-04-20T22:00:40.455 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-20T22:00:40.455 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_background_jobs: 2 2024-04-20T22:00:40.455 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_background_compactions: -1 2024-04-20T22:00:40.455 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_subcompactions: 1 2024-04-20T22:00:40.455 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-20T22:00:40.455 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-20T22:00:40.455 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-20T22:00:40.455 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_total_wal_size: 0 2024-04-20T22:00:40.455 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-20T22:00:40.455 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-20T22:00:40.456 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-20T22:00:40.456 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-20T22:00:40.456 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_open_files: -1 2024-04-20T22:00:40.456 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.bytes_per_sync: 0 2024-04-20T22:00:40.456 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-20T22:00:40.456 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-20T22:00:40.456 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compaction_readahead_size: 0 2024-04-20T22:00:40.456 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_background_flushes: -1 2024-04-20T22:00:40.456 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Compression algorithms supported: 2024-04-20T22:00:40.456 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-20T22:00:40.456 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: kZSTD supported: 0 2024-04-20T22:00:40.456 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: kXpressCompression supported: 0 2024-04-20T22:00:40.456 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: kLZ4HCCompression supported: 1 2024-04-20T22:00:40.456 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: kZlibCompression supported: 1 2024-04-20T22:00:40.457 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: kSnappyCompression supported: 1 2024-04-20T22:00:40.457 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: kLZ4Compression supported: 1 2024-04-20T22:00:40.457 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: kBZip2Compression supported: 0 2024-04-20T22:00:40.457 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-20T22:00:40.457 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-20T22:00:40.457 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi164/store.db/MANIFEST-000010 2024-04-20T22:00:40.457 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-20T22:00:40.457 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-20T22:00:40.457 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.merge_operator: 2024-04-20T22:00:40.457 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compaction_filter: None 2024-04-20T22:00:40.457 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compaction_filter_factory: None 2024-04-20T22:00:40.457 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.sst_partitioner_factory: None 2024-04-20T22:00:40.457 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-20T22:00:40.458 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-20T22:00:40.458 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f310a79ce0) 2024-04-20T22:00:40.458 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: cache_index_and_filter_blocks: 1 2024-04-20T22:00:40.458 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-20T22:00:40.458 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-20T22:00:40.458 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: pin_top_level_index_and_filter: 1 2024-04-20T22:00:40.458 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: index_type: 0 2024-04-20T22:00:40.458 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: data_block_index_type: 0 2024-04-20T22:00:40.458 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: index_shortening: 1 2024-04-20T22:00:40.458 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-20T22:00:40.458 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: checksum: 4 2024-04-20T22:00:40.458 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: no_block_cache: 0 2024-04-20T22:00:40.458 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: block_cache: 0x55f310a7b090 2024-04-20T22:00:40.458 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: block_cache_name: BinnedLRUCache 2024-04-20T22:00:40.458 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: block_cache_options: 2024-04-20T22:00:40.459 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: capacity : 536870912 2024-04-20T22:00:40.459 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: num_shard_bits : 4 2024-04-20T22:00:40.459 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: strict_capacity_limit : 0 2024-04-20T22:00:40.459 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: high_pri_pool_ratio: 0.000 2024-04-20T22:00:40.459 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: block_cache_compressed: (nil) 2024-04-20T22:00:40.459 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: persistent_cache: (nil) 2024-04-20T22:00:40.459 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: block_size: 4096 2024-04-20T22:00:40.459 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: block_size_deviation: 10 2024-04-20T22:00:40.459 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: block_restart_interval: 16 2024-04-20T22:00:40.459 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: index_block_restart_interval: 1 2024-04-20T22:00:40.459 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: metadata_block_size: 4096 2024-04-20T22:00:40.459 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: partition_filters: 0 2024-04-20T22:00:40.459 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: use_delta_encoding: 1 2024-04-20T22:00:40.459 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: filter_policy: bloomfilter 2024-04-20T22:00:40.459 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: whole_key_filtering: 1 2024-04-20T22:00:40.460 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: verify_compression: 0 2024-04-20T22:00:40.460 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: read_amp_bytes_per_bit: 0 2024-04-20T22:00:40.460 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: format_version: 5 2024-04-20T22:00:40.460 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: enable_index_compression: 1 2024-04-20T22:00:40.460 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: block_align: 0 2024-04-20T22:00:40.460 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: max_auto_readahead_size: 262144 2024-04-20T22:00:40.460 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: prepopulate_block_cache: 0 2024-04-20T22:00:40.460 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: initial_auto_readahead_size: 8192 2024-04-20T22:00:40.460 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: num_file_reads_for_auto_readahead: 2 2024-04-20T22:00:40.460 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.write_buffer_size: 33554432 2024-04-20T22:00:40.460 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_write_buffer_number: 2 2024-04-20T22:00:40.460 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compression: NoCompression 2024-04-20T22:00:40.460 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.bottommost_compression: Disabled 2024-04-20T22:00:40.460 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.prefix_extractor: nullptr 2024-04-20T22:00:40.460 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-20T22:00:40.461 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.num_levels: 7 2024-04-20T22:00:40.461 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-20T22:00:40.462 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-20T22:00:40.462 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-20T22:00:40.462 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-20T22:00:40.462 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-20T22:00:40.462 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-20T22:00:40.462 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-20T22:00:40.462 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-20T22:00:40.462 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-20T22:00:40.462 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-20T22:00:40.462 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-20T22:00:40.463 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-20T22:00:40.463 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-20T22:00:40.463 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compression_opts.level: 32767 2024-04-20T22:00:40.463 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compression_opts.strategy: 0 2024-04-20T22:00:40.463 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-20T22:00:40.463 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-20T22:00:40.463 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-20T22:00:40.463 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-20T22:00:40.463 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compression_opts.enabled: false 2024-04-20T22:00:40.463 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-20T22:00:40.463 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-20T22:00:40.463 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-20T22:00:40.463 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-20T22:00:40.463 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.target_file_size_base: 67108864 2024-04-20T22:00:40.464 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-20T22:00:40.464 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-20T22:00:40.464 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-20T22:00:40.464 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-20T22:00:40.464 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-20T22:00:40.464 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-20T22:00:40.464 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-20T22:00:40.464 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-20T22:00:40.464 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-20T22:00:40.464 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-20T22:00:40.464 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-20T22:00:40.464 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-20T22:00:40.464 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-20T22:00:40.464 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-20T22:00:40.464 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.arena_block_size: 1048576 2024-04-20T22:00:40.465 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-20T22:00:40.465 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-20T22:00:40.465 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.disable_auto_compactions: 0 2024-04-20T22:00:40.465 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-20T22:00:40.465 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-20T22:00:40.465 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-20T22:00:40.465 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-20T22:00:40.465 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-20T22:00:40.465 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-20T22:00:40.465 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-20T22:00:40.465 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-20T22:00:40.465 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-20T22:00:40.465 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-20T22:00:40.465 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-20T22:00:40.466 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.inplace_update_support: 0 2024-04-20T22:00:40.466 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-20T22:00:40.466 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-20T22:00:40.466 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-20T22:00:40.466 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-20T22:00:40.466 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.bloom_locality: 0 2024-04-20T22:00:40.466 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.max_successive_merges: 0 2024-04-20T22:00:40.466 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-20T22:00:40.466 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.paranoid_file_checks: 0 2024-04-20T22:00:40.466 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.force_consistency_checks: 1 2024-04-20T22:00:40.466 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.report_bg_io_stats: 0 2024-04-20T22:00:40.466 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.ttl: 2592000 2024-04-20T22:00:40.466 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-20T22:00:40.466 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-20T22:00:40.467 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-20T22:00:40.467 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.enable_blob_files: false 2024-04-20T22:00:40.467 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.min_blob_size: 0 2024-04-20T22:00:40.467 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.blob_file_size: 268435456 2024-04-20T22:00:40.467 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-20T22:00:40.467 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-20T22:00:40.467 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-20T22:00:40.467 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-20T22:00:40.467 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-20T22:00:40.467 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.blob_file_starting_level: 0 2024-04-20T22:00:40.467 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-20T22:00:40.467 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-20T22:00:40.467 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi164/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 11790, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-04-20T22:00:40.467 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-04-20T22:00:40.467 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: cfdfdd8c-7e27-4b06-bb42-b3d4a042fb42 2024-04-20T22:00:40.468 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713650440183900, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-04-20T22:00:40.468 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-04-20T22:00:40.468 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 bash[69766]: 133512694d4633656297593db3e471bf23b273b45bf9e5f2859e8ae3f239a7a6 2024-04-20T22:00:40.468 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 systemd[1]: Started Ceph mon.smithi164 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T22:00:40.468 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713650440215960, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 3979304, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11795, "largest_seqno": 13596, "table_properties": {"data_size": 3970965, "index_size": 5437, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1861, "raw_key_size": 16541, "raw_average_key_size": 22, "raw_value_size": 3955072, "raw_average_value_size": 5470, "num_data_blocks": 247, "num_entries": 723, "num_filter_entries": 723, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713650440, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "cfdfdd8c-7e27-4b06-bb42-b3d4a042fb42", "db_session_id": "CDQOVH8JVTEP54VGC0WE", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-04-20T22:00:40.468 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713650440216181, "job": 1, "event": "recovery_finished"} 2024-04-20T22:00:40.468 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-04-20T22:00:40.468 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-20T22:00:40.468 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi164/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-20T22:00:40.468 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f310b64000 2024-04-20T22:00:40.468 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: DB pointer 0x55f310b52000 2024-04-20T22:00:40.468 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-20T22:00:40.468 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-20T22:00:40.468 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: ** DB Stats ** 2024-04-20T22:00:40.469 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-20T22:00:40.469 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-20T22:00:40.469 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-20T22:00:40.469 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-20T22:00:40.469 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-20T22:00:40.469 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-20T22:00:40.469 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-20T22:00:40.469 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: 2024-04-20T22:00:40.469 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: ** Compaction Stats [default] ** 2024-04-20T22:00:40.469 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-20T22:00:40.469 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-20T22:00:40.469 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: L0 1/0 3.79 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 370.9 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-04-20T22:00:40.469 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: L6 1/0 5.40 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-20T22:00:40.469 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Sum 2/0 9.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 370.9 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-04-20T22:00:40.469 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 370.9 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-04-20T22:00:40.470 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: 2024-04-20T22:00:40.470 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: ** Compaction Stats [default] ** 2024-04-20T22:00:40.470 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-20T22:00:40.470 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-20T22:00:40.470 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 370.9 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-04-20T22:00:40.470 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: 2024-04-20T22:00:40.470 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-20T22:00:40.470 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: 2024-04-20T22:00:40.470 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-20T22:00:40.470 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-04-20T22:00:40.470 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-20T22:00:40.470 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-20T22:00:40.470 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-20T22:00:40.470 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-20T22:00:40.470 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Cumulative compaction: 0.00 GB write, 97.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-20T22:00:40.471 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Interval compaction: 0.00 GB write, 97.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-20T22:00:40.471 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-20T22:00:40.471 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Block cache BinnedLRUCache@0x55f310a7b090#2 capacity: 512.00 MB usage: 8.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-04-20T22:00:40.471 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-04-20T22:00:40.471 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: 2024-04-20T22:00:40.471 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-20T22:00:40.471 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: starting mon.smithi164 rank 1 at public addrs [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] at bind addrs [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi164 fsid 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T22:00:40.471 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: mon.smithi164@-1(???) e2 preinit fsid 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T22:00:40.471 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: mon.smithi164@-1(???).mds e12 new map 2024-04-20T22:00:40.471 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: mon.smithi164@-1(???).mds e12 print_map 2024-04-20T22:00:40.471 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: e12 2024-04-20T22:00:40.471 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:00:40.471 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:00:40.471 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: legacy client fscid: 1 2024-04-20T22:00:40.471 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: 2024-04-20T22:00:40.472 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Filesystem 'cephfs' (1) 2024-04-20T22:00:40.472 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: fs_name cephfs 2024-04-20T22:00:40.472 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: epoch 12 2024-04-20T22:00:40.472 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:00:40.472 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:00:40.472 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: modified 2024-04-20T21:54:51.692699+0000 2024-04-20T22:00:40.472 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: tableserver 0 2024-04-20T22:00:40.472 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: root 0 2024-04-20T22:00:40.472 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: session_timeout 60 2024-04-20T22:00:40.472 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: session_autoclose 300 2024-04-20T22:00:40.472 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: max_file_size 1099511627776 2024-04-20T22:00:40.472 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: max_xattr_size 65536 2024-04-20T22:00:40.472 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: required_client_features {} 2024-04-20T22:00:40.472 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: last_failure 0 2024-04-20T22:00:40.473 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: last_failure_osd_epoch 0 2024-04-20T22:00:40.473 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: snap_rstat 1 2024-04-20T22:00:40.473 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:00:40.473 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: max_mds 1 2024-04-20T22:00:40.473 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: in 0 2024-04-20T22:00:40.473 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: up {0=14468} 2024-04-20T22:00:40.473 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: failed 2024-04-20T22:00:40.473 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: damaged 2024-04-20T22:00:40.473 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: stopped 2024-04-20T22:00:40.473 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: data_pools [3] 2024-04-20T22:00:40.473 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: metadata_pool 2 2024-04-20T22:00:40.473 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: inline_data disabled 2024-04-20T22:00:40.473 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: balancer 2024-04-20T22:00:40.473 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: bal_rank_mask -1 2024-04-20T22:00:40.473 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: standby_count_wanted 1 2024-04-20T22:00:40.473 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: qdb_cluster leader: 0 members: 2024-04-20T22:00:40.474 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: [mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:00:40.474 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: 2024-04-20T22:00:40.474 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: 2024-04-20T22:00:40.474 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: Standby daemons: 2024-04-20T22:00:40.474 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: 2024-04-20T22:00:40.474 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: [mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:00:40.474 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: [mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:00:40.474 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout: [mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:00:40.474 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: mon.smithi164@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-20T22:00:40.474 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: mon.smithi164@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-04-20T22:00:40.474 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: mon.smithi164@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-04-20T22:00:40.474 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: mon.smithi164@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-04-20T22:00:40.474 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:40 smithi164 ceph-mon[69784]: mon.smithi164@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-04-20T22:00:41.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:41 smithi164 ceph-mon[69784]: pgmap v14: 65 pgs: 65 active+clean; 255 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 1.4 MiB/s wr, 586 op/s 2024-04-20T22:00:41.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:41 smithi142 ceph-mon[79401]: pgmap v14: 65 pgs: 65 active+clean; 255 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 1.4 MiB/s wr, 586 op/s 2024-04-20T22:00:42.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: pgmap v16: 65 pgs: 65 active+clean; 255 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 994 KiB/s wr, 389 op/s 2024-04-20T22:00:42.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T22:00:42.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T22:00:42.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: mon.smithi142 calling monitor election 2024-04-20T22:00:42.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: mon.smithi164 calling monitor election 2024-04-20T22:00:42.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: mon.smithi142 is new leader, mons smithi142,smithi164 in quorum (ranks 0,1) 2024-04-20T22:00:42.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: monmap epoch 3 2024-04-20T22:00:42.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: fsid 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T22:00:42.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: last_changed 2024-04-20T22:00:41.166975+0000 2024-04-20T22:00:42.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: created 2024-04-20T21:45:23.189616+0000 2024-04-20T22:00:42.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: min_mon_release 19 (squid) 2024-04-20T22:00:42.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: election_strategy: 1 2024-04-20T22:00:42.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: 0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.smithi142 2024-04-20T22:00:42.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: 1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.smithi164 2024-04-20T22:00:42.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 3 up:standby 2024-04-20T22:00:42.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: osdmap e50: 6 total, 6 up, 6 in 2024-04-20T22:00:42.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: mgrmap e37: smithi142.zzmcfz(active, since 26s), standbys: smithi164.oejajr 2024-04-20T22:00:42.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: overall HEALTH_OK 2024-04-20T22:00:42.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:42.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:42.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:42 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:00:42.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: pgmap v16: 65 pgs: 65 active+clean; 255 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 26 KiB/s rd, 994 KiB/s wr, 389 op/s 2024-04-20T22:00:42.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi142"}]: dispatch 2024-04-20T22:00:42.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mon metadata", "id": "smithi164"}]: dispatch 2024-04-20T22:00:42.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: mon.smithi142 calling monitor election 2024-04-20T22:00:42.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: mon.smithi164 calling monitor election 2024-04-20T22:00:42.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: mon.smithi142 is new leader, mons smithi142,smithi164 in quorum (ranks 0,1) 2024-04-20T22:00:42.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: monmap epoch 3 2024-04-20T22:00:42.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: fsid 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T22:00:42.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: last_changed 2024-04-20T22:00:41.166975+0000 2024-04-20T22:00:42.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: created 2024-04-20T21:45:23.189616+0000 2024-04-20T22:00:42.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: min_mon_release 19 (squid) 2024-04-20T22:00:42.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: election_strategy: 1 2024-04-20T22:00:42.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: 0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.smithi142 2024-04-20T22:00:42.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: 1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.smithi164 2024-04-20T22:00:42.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 3 up:standby 2024-04-20T22:00:42.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: osdmap e50: 6 total, 6 up, 6 in 2024-04-20T22:00:42.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: mgrmap e37: smithi142.zzmcfz(active, since 26s), standbys: smithi164.oejajr 2024-04-20T22:00:42.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: overall HEALTH_OK 2024-04-20T22:00:42.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:42.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:42.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:42 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:00:44.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:44 smithi142 ceph-mon[79401]: pgmap v17: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 1.3 MiB/s wr, 494 op/s 2024-04-20T22:00:44.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:44 smithi164 ceph-mon[69784]: pgmap v17: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 1.3 MiB/s wr, 494 op/s 2024-04-20T22:00:45.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:00:45.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:00:46.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:46 smithi142 ceph-mon[79401]: pgmap v18: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 872 KiB/s wr, 311 op/s 2024-04-20T22:00:46.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:46 smithi164 ceph-mon[69784]: pgmap v18: 65 pgs: 65 active+clean; 249 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 872 KiB/s wr, 311 op/s 2024-04-20T22:00:47.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:47.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:47.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:47.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:48.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:48 smithi142 ceph-mon[79401]: pgmap v19: 65 pgs: 65 active+clean; 241 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.1 MiB/s wr, 416 op/s 2024-04-20T22:00:48.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:48 smithi164 ceph-mon[69784]: pgmap v19: 65 pgs: 65 active+clean; 241 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.1 MiB/s wr, 416 op/s 2024-04-20T22:00:49.304 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:49 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:49.305 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:49 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:49.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:49 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:49.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:49 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:50.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:50 smithi164 ceph-mon[69784]: pgmap v20: 65 pgs: 65 active+clean; 241 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 671 KiB/s wr, 208 op/s 2024-04-20T22:00:50.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:50 smithi142 ceph-mon[79401]: pgmap v20: 65 pgs: 65 active+clean; 241 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 671 KiB/s wr, 208 op/s 2024-04-20T22:00:52.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:52 smithi164 ceph-mon[69784]: pgmap v21: 65 pgs: 65 active+clean; 241 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 671 KiB/s wr, 208 op/s 2024-04-20T22:00:52.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:52 smithi142 ceph-mon[79401]: pgmap v21: 65 pgs: 65 active+clean; 241 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 671 KiB/s wr, 208 op/s 2024-04-20T22:00:53.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.329+0000 7fc245a00700 1 -- 172.21.15.142:0/2263377808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc240100c00 msgr2=0x7fc240101020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:53.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.329+0000 7fc245a00700 1 --2- 172.21.15.142:0/2263377808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc240100c00 0x7fc240101020 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc230009910 tx=0x7fc230009c20 comp rx=0 tx=0).stop 2024-04-20T22:00:53.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.332+0000 7fc245a00700 1 -- 172.21.15.142:0/2263377808 shutdown_connections 2024-04-20T22:00:53.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.332+0000 7fc245a00700 1 --2- 172.21.15.142:0/2263377808 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc240101e00 0x7fc240102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:53.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.332+0000 7fc245a00700 1 --2- 172.21.15.142:0/2263377808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc240100c00 0x7fc240101020 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:53.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.332+0000 7fc245a00700 1 -- 172.21.15.142:0/2263377808 >> 172.21.15.142:0/2263377808 conn(0x7fc2400fc1c0 msgr2=0x7fc2400fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:53.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.333+0000 7fc245a00700 1 -- 172.21.15.142:0/2263377808 shutdown_connections 2024-04-20T22:00:53.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.333+0000 7fc245a00700 1 -- 172.21.15.142:0/2263377808 wait complete. 2024-04-20T22:00:53.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.334+0000 7fc245a00700 1 Processor -- start 2024-04-20T22:00:53.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.335+0000 7fc245a00700 1 -- start start 2024-04-20T22:00:53.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.336+0000 7fc245a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc240100c00 0x7fc240194460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:53.335 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.336+0000 7fc245a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc240101e00 0x7fc2401949a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:53.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.337+0000 7fc23ea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc240100c00 0x7fc240194460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:53.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.337+0000 7fc23ea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc240100c00 0x7fc240194460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46560/0 (socket says 172.21.15.142:46560) 2024-04-20T22:00:53.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.337+0000 7fc23ea00700 1 -- 172.21.15.142:0/2758342994 learned_addr learned my addr 172.21.15.142:0/2758342994 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:00:53.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.337+0000 7fc245a00700 1 -- 172.21.15.142:0/2758342994 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc240194fc0 con 0x7fc240100c00 2024-04-20T22:00:53.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.337+0000 7fc245a00700 1 -- 172.21.15.142:0/2758342994 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc240195100 con 0x7fc240101e00 2024-04-20T22:00:53.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.338+0000 7fc23e000700 1 --2- 172.21.15.142:0/2758342994 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc240101e00 0x7fc2401949a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:53.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.339+0000 7fc23ea00700 1 -- 172.21.15.142:0/2758342994 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc240101e00 msgr2=0x7fc2401949a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:53.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.339+0000 7fc23ea00700 1 --2- 172.21.15.142:0/2758342994 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc240101e00 0x7fc2401949a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:53.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.339+0000 7fc23ea00700 1 -- 172.21.15.142:0/2758342994 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2300095f0 con 0x7fc240100c00 2024-04-20T22:00:53.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.339+0000 7fc23e000700 1 --2- 172.21.15.142:0/2758342994 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc240101e00 0x7fc2401949a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T22:00:53.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.340+0000 7fc23ea00700 1 --2- 172.21.15.142:0/2758342994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc240100c00 0x7fc240194460 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc23000bd70 tx=0x7fc23000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:53.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.341+0000 7fc237400700 1 -- 172.21.15.142:0/2758342994 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc23001d070 con 0x7fc240100c00 2024-04-20T22:00:53.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.341+0000 7fc245a00700 1 -- 172.21.15.142:0/2758342994 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc240199ab0 con 0x7fc240100c00 2024-04-20T22:00:53.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.342+0000 7fc245a00700 1 -- 172.21.15.142:0/2758342994 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc240199fa0 con 0x7fc240100c00 2024-04-20T22:00:53.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.342+0000 7fc237400700 1 -- 172.21.15.142:0/2758342994 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc230005dc0 con 0x7fc240100c00 2024-04-20T22:00:53.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.343+0000 7fc237400700 1 -- 172.21.15.142:0/2758342994 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc230021410 con 0x7fc240100c00 2024-04-20T22:00:53.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.345+0000 7fc234c00700 1 -- 172.21.15.142:0/2758342994 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2180052f0 con 0x7fc240100c00 2024-04-20T22:00:53.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.355+0000 7fc237400700 1 -- 172.21.15.142:0/2758342994 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7fc23000f820 con 0x7fc240100c00 2024-04-20T22:00:53.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.358+0000 7fc237400700 1 --2- 172.21.15.142:0/2758342994 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc22406ee40 0x7fc224071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:53.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.358+0000 7fc237400700 1 -- 172.21.15.142:0/2758342994 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc2300907c0 con 0x7fc240100c00 2024-04-20T22:00:53.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.359+0000 7fc23e000700 1 --2- 172.21.15.142:0/2758342994 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc22406ee40 0x7fc224071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:53.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.362+0000 7fc23e000700 1 --2- 172.21.15.142:0/2758342994 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc22406ee40 0x7fc224071300 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc22c017480 tx=0x7fc22c013040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:53.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.367+0000 7fc237400700 1 -- 172.21.15.142:0/2758342994 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fc23005cec0 con 0x7fc240100c00 2024-04-20T22:00:53.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.726+0000 7fc234c00700 1 -- 172.21.15.142:0/2758342994 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc218000bc0 con 0x7fc22406ee40 2024-04-20T22:00:53.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.728+0000 7fc237400700 1 -- 172.21.15.142:0/2758342994 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fc218000bc0 con 0x7fc22406ee40 2024-04-20T22:00:53.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.730+0000 7fc234c00700 1 -- 172.21.15.142:0/2758342994 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc22406ee40 msgr2=0x7fc224071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:53.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.730+0000 7fc234c00700 1 --2- 172.21.15.142:0/2758342994 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc22406ee40 0x7fc224071300 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc22c017480 tx=0x7fc22c013040 comp rx=0 tx=0).stop 2024-04-20T22:00:53.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.730+0000 7fc234c00700 1 -- 172.21.15.142:0/2758342994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc240100c00 msgr2=0x7fc240194460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:53.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.730+0000 7fc234c00700 1 --2- 172.21.15.142:0/2758342994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc240100c00 0x7fc240194460 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc23000bd70 tx=0x7fc23000be50 comp rx=0 tx=0).stop 2024-04-20T22:00:53.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.730+0000 7fc234c00700 1 -- 172.21.15.142:0/2758342994 shutdown_connections 2024-04-20T22:00:53.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.730+0000 7fc234c00700 1 --2- 172.21.15.142:0/2758342994 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc22406ee40 0x7fc224071300 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:53.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.730+0000 7fc234c00700 1 --2- 172.21.15.142:0/2758342994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc240100c00 0x7fc240194460 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:53.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.730+0000 7fc234c00700 1 --2- 172.21.15.142:0/2758342994 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc240101e00 0x7fc2401949a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:53.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.730+0000 7fc234c00700 1 -- 172.21.15.142:0/2758342994 >> 172.21.15.142:0/2758342994 conn(0x7fc2400fc1c0 msgr2=0x7fc240105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:53.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.731+0000 7fc234c00700 1 -- 172.21.15.142:0/2758342994 shutdown_connections 2024-04-20T22:00:53.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.731+0000 7fc234c00700 1 -- 172.21.15.142:0/2758342994 wait complete. 2024-04-20T22:00:53.748 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T22:00:53.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.923+0000 7ffb7e000700 1 -- 172.21.15.142:0/2778636154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb78103fb0 msgr2=0x7ffb781063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:53.923 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.923+0000 7ffb7e000700 1 --2- 172.21.15.142:0/2778636154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb78103fb0 0x7ffb781063a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb64009910 tx=0x7ffb64009c20 comp rx=0 tx=0).stop 2024-04-20T22:00:53.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.924+0000 7ffb7e000700 1 -- 172.21.15.142:0/2778636154 shutdown_connections 2024-04-20T22:00:53.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.924+0000 7ffb7e000700 1 --2- 172.21.15.142:0/2778636154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb78103fb0 0x7ffb781063a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:53.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.924+0000 7ffb7e000700 1 --2- 172.21.15.142:0/2778636154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb78101680 0x7ffb78103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:53.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.924+0000 7ffb7e000700 1 -- 172.21.15.142:0/2778636154 >> 172.21.15.142:0/2778636154 conn(0x7ffb780fb0d0 msgr2=0x7ffb780fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:53.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.925+0000 7ffb7e000700 1 -- 172.21.15.142:0/2778636154 shutdown_connections 2024-04-20T22:00:53.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.925+0000 7ffb7e000700 1 -- 172.21.15.142:0/2778636154 wait complete. 2024-04-20T22:00:53.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.926+0000 7ffb7e000700 1 Processor -- start 2024-04-20T22:00:53.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.926+0000 7ffb7e000700 1 -- start start 2024-04-20T22:00:53.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.926+0000 7ffb7e000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb78101680 0x7ffb781965b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:53.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.926+0000 7ffb7e000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb78103fb0 0x7ffb78196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:53.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.926+0000 7ffb7e000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78197110 con 0x7ffb78101680 2024-04-20T22:00:53.926 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.926+0000 7ffb7e000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78197250 con 0x7ffb78103fb0 2024-04-20T22:00:53.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.927+0000 7ffb77400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb78101680 0x7ffb781965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:53.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.927+0000 7ffb77400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb78101680 0x7ffb781965b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46582/0 (socket says 172.21.15.142:46582) 2024-04-20T22:00:53.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.927+0000 7ffb77400700 1 -- 172.21.15.142:0/1776964244 learned_addr learned my addr 172.21.15.142:0/1776964244 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:00:53.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.927+0000 7ffb76a00700 1 --2- 172.21.15.142:0/1776964244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb78103fb0 0x7ffb78196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:53.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.927+0000 7ffb77400700 1 -- 172.21.15.142:0/1776964244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb78103fb0 msgr2=0x7ffb78196af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:53.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.927+0000 7ffb77400700 1 --2- 172.21.15.142:0/1776964244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb78103fb0 0x7ffb78196af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:53.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.927+0000 7ffb77400700 1 -- 172.21.15.142:0/1776964244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb640095f0 con 0x7ffb78101680 2024-04-20T22:00:53.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.927+0000 7ffb76a00700 1 --2- 172.21.15.142:0/1776964244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb78103fb0 0x7ffb78196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T22:00:53.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.928+0000 7ffb77400700 1 --2- 172.21.15.142:0/1776964244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb78101680 0x7ffb781965b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800d8d0 tx=0x7ffb6800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:53.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.928+0000 7ffb6fe00700 1 -- 172.21.15.142:0/1776964244 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb68009940 con 0x7ffb78101680 2024-04-20T22:00:53.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.928+0000 7ffb6fe00700 1 -- 172.21.15.142:0/1776964244 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffb68010460 con 0x7ffb78101680 2024-04-20T22:00:53.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.928+0000 7ffb7e000700 1 -- 172.21.15.142:0/1776964244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7819bcb0 con 0x7ffb78101680 2024-04-20T22:00:53.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.928+0000 7ffb7e000700 1 -- 172.21.15.142:0/1776964244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7819c230 con 0x7ffb78101680 2024-04-20T22:00:53.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.929+0000 7ffb6fe00700 1 -- 172.21.15.142:0/1776964244 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb6800f5f0 con 0x7ffb78101680 2024-04-20T22:00:53.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.930+0000 7ffb7e000700 1 -- 172.21.15.142:0/1776964244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb78062510 con 0x7ffb78101680 2024-04-20T22:00:53.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.931+0000 7ffb6fe00700 1 -- 172.21.15.142:0/1776964244 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7ffb680105d0 con 0x7ffb78101680 2024-04-20T22:00:53.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.933+0000 7ffb6fe00700 1 --2- 172.21.15.142:0/1776964244 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7ffb5c06edf0 0x7ffb5c0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:53.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.933+0000 7ffb6fe00700 1 -- 172.21.15.142:0/1776964244 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ffb6808f0a0 con 0x7ffb78101680 2024-04-20T22:00:53.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.933+0000 7ffb76a00700 1 --2- 172.21.15.142:0/1776964244 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7ffb5c06edf0 0x7ffb5c0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:53.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.934+0000 7ffb76a00700 1 --2- 172.21.15.142:0/1776964244 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7ffb5c06edf0 0x7ffb5c0712b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffb64006010 tx=0x7ffb6400b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:53.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:53.938+0000 7ffb6fe00700 1 -- 172.21.15.142:0/1776964244 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7ffb6805b7c0 con 0x7ffb78101680 2024-04-20T22:00:54.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.329+0000 7ffb7e000700 1 -- 172.21.15.142:0/1776964244 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb78105eb0 con 0x7ffb5c06edf0 2024-04-20T22:00:54.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.332+0000 7ffb6fe00700 1 -- 172.21.15.142:0/1776964244 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7ffb78105eb0 con 0x7ffb5c06edf0 2024-04-20T22:00:54.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.336+0000 7ffb7e000700 1 -- 172.21.15.142:0/1776964244 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7ffb5c06edf0 msgr2=0x7ffb5c0712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:54.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.337+0000 7ffb7e000700 1 --2- 172.21.15.142:0/1776964244 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7ffb5c06edf0 0x7ffb5c0712b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffb64006010 tx=0x7ffb6400b560 comp rx=0 tx=0).stop 2024-04-20T22:00:54.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.337+0000 7ffb7e000700 1 -- 172.21.15.142:0/1776964244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb78101680 msgr2=0x7ffb781965b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:54.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.337+0000 7ffb7e000700 1 --2- 172.21.15.142:0/1776964244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb78101680 0x7ffb781965b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800d8d0 tx=0x7ffb6800dc90 comp rx=0 tx=0).stop 2024-04-20T22:00:54.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.337+0000 7ffb7e000700 1 -- 172.21.15.142:0/1776964244 shutdown_connections 2024-04-20T22:00:54.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.337+0000 7ffb7e000700 1 --2- 172.21.15.142:0/1776964244 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7ffb5c06edf0 0x7ffb5c0712b0 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffb64006010 tx=0x7ffb6400b560 comp rx=0 tx=0).stop 2024-04-20T22:00:54.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.337+0000 7ffb7e000700 1 --2- 172.21.15.142:0/1776964244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb78101680 0x7ffb781965b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:54.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.337+0000 7ffb7e000700 1 --2- 172.21.15.142:0/1776964244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffb78103fb0 0x7ffb78196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:54.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.337+0000 7ffb7e000700 1 -- 172.21.15.142:0/1776964244 >> 172.21.15.142:0/1776964244 conn(0x7ffb780fb0d0 msgr2=0x7ffb780fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:54.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.337+0000 7ffb7e000700 1 -- 172.21.15.142:0/1776964244 shutdown_connections 2024-04-20T22:00:54.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.337+0000 7ffb7e000700 1 -- 172.21.15.142:0/1776964244 wait complete. 2024-04-20T22:00:54.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:54 smithi142 ceph-mon[79401]: pgmap v22: 65 pgs: 65 active+clean; 238 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.0 MiB/s wr, 316 op/s 2024-04-20T22:00:54.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:54 smithi164 ceph-mon[69784]: pgmap v22: 65 pgs: 65 active+clean; 238 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.0 MiB/s wr, 316 op/s 2024-04-20T22:00:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.544+0000 7f30abe00700 1 -- 172.21.15.142:0/2089525828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30a4102e20 msgr2=0x7f30a4103240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.544+0000 7f30abe00700 1 --2- 172.21.15.142:0/2089525828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30a4102e20 0x7f30a4103240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3098009910 tx=0x7f3098009c20 comp rx=0 tx=0).stop 2024-04-20T22:00:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.544+0000 7f30abe00700 1 -- 172.21.15.142:0/2089525828 shutdown_connections 2024-04-20T22:00:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.544+0000 7f30abe00700 1 --2- 172.21.15.142:0/2089525828 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30a4103f80 0x7f30a4104400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.544+0000 7f30abe00700 1 --2- 172.21.15.142:0/2089525828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30a4102e20 0x7f30a4103240 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.544+0000 7f30abe00700 1 -- 172.21.15.142:0/2089525828 >> 172.21.15.142:0/2089525828 conn(0x7f30a40fe3a0 msgr2=0x7f30a4100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.545+0000 7f30abe00700 1 -- 172.21.15.142:0/2089525828 shutdown_connections 2024-04-20T22:00:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.545+0000 7f30abe00700 1 -- 172.21.15.142:0/2089525828 wait complete. 2024-04-20T22:00:54.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.546+0000 7f30abe00700 1 Processor -- start 2024-04-20T22:00:54.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.547+0000 7f30abe00700 1 -- start start 2024-04-20T22:00:54.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.548+0000 7f30abe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30a4102e20 0x7f30a4198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:54.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.548+0000 7f30abe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30a4103f80 0x7f30a4198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:54.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.548+0000 7f30abe00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a4199380 con 0x7f30a4102e20 2024-04-20T22:00:54.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.548+0000 7f30abe00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a41994c0 con 0x7f30a4103f80 2024-04-20T22:00:54.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.548+0000 7f30a9400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30a4102e20 0x7f30a4198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:54.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.548+0000 7f30a9400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30a4102e20 0x7f30a4198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46604/0 (socket says 172.21.15.142:46604) 2024-04-20T22:00:54.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.548+0000 7f30a9400700 1 -- 172.21.15.142:0/406142926 learned_addr learned my addr 172.21.15.142:0/406142926 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:00:54.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.549+0000 7f30a9400700 1 -- 172.21.15.142:0/406142926 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30a4103f80 msgr2=0x7f30a4198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:54.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.549+0000 7f30a8a00700 1 --2- 172.21.15.142:0/406142926 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30a4103f80 0x7f30a4198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:54.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.549+0000 7f30a9400700 1 --2- 172.21.15.142:0/406142926 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30a4103f80 0x7f30a4198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:54.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.549+0000 7f30a9400700 1 -- 172.21.15.142:0/406142926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30980095f0 con 0x7f30a4102e20 2024-04-20T22:00:54.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.549+0000 7f30a9400700 1 --2- 172.21.15.142:0/406142926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30a4102e20 0x7f30a4198820 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f309800bd70 tx=0x7f309800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:54.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.550+0000 7f30a2000700 1 -- 172.21.15.142:0/406142926 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f309801d070 con 0x7f30a4102e20 2024-04-20T22:00:54.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.550+0000 7f30a2000700 1 -- 172.21.15.142:0/406142926 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3098005dc0 con 0x7f30a4102e20 2024-04-20T22:00:54.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.550+0000 7f30a2000700 1 -- 172.21.15.142:0/406142926 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3098021410 con 0x7f30a4102e20 2024-04-20T22:00:54.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.550+0000 7f30abe00700 1 -- 172.21.15.142:0/406142926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a419de70 con 0x7f30a4102e20 2024-04-20T22:00:54.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.550+0000 7f30abe00700 1 -- 172.21.15.142:0/406142926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a419e2a0 con 0x7f30a4102e20 2024-04-20T22:00:54.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.552+0000 7f30abe00700 1 -- 172.21.15.142:0/406142926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a4192920 con 0x7f30a4102e20 2024-04-20T22:00:54.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.553+0000 7f30a2000700 1 -- 172.21.15.142:0/406142926 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7f309800f820 con 0x7f30a4102e20 2024-04-20T22:00:54.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.553+0000 7f30a2000700 1 --2- 172.21.15.142:0/406142926 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f308c06edf0 0x7f308c0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:54.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.554+0000 7f30a2000700 1 -- 172.21.15.142:0/406142926 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3098090240 con 0x7f30a4102e20 2024-04-20T22:00:54.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.554+0000 7f30a8a00700 1 --2- 172.21.15.142:0/406142926 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f308c06edf0 0x7f308c0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:54.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.555+0000 7f30a8a00700 1 --2- 172.21.15.142:0/406142926 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f308c06edf0 0x7f308c0712b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3090005950 tx=0x7f30900058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:54.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.564+0000 7f30a2000700 1 -- 172.21.15.142:0/406142926 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f309805c9e0 con 0x7f30a4102e20 2024-04-20T22:00:54.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.860+0000 7f30abe00700 1 -- 172.21.15.142:0/406142926 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f30a402cea0 con 0x7f308c06edf0 2024-04-20T22:00:54.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.877+0000 7f30a2000700 1 -- 172.21.15.142:0/406142926 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f30a402cea0 con 0x7f308c06edf0 2024-04-20T22:00:54.877 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:00:54.877 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (11m) 29s ago 13m 13.6M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T22:00:54.877 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (13m) 29s ago 13m 8070k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T22:00:54.877 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (12m) 8s ago 12m 7688k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T22:00:54.877 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (13m) 29s ago 13m 6665k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 56f2e41784f8 2024-04-20T22:00:54.877 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (12m) 8s ago 12m 6660k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 bce67525dd3e 2024-04-20T22:00:54.877 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (11m) 29s ago 13m 77.1M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T22:00:54.877 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (6m) 29s ago 6m 213M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 b68e279d7945 2024-04-20T22:00:54.877 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (6m) 29s ago 6m 15.0M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T22:00:54.877 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (6m) 8s ago 6m 15.2M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T22:00:54.878 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (6m) 8s ago 6m 15.6M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T22:00:54.878 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (2m) 29s ago 15m 478M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:00:54.878 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (77s) 8s ago 12m 449M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:00:54.878 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (53s) 29s ago 15m 32.0M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 af10a542c918 2024-04-20T22:00:54.878 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (15s) 8s ago 12m 22.5M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 133512694d46 2024-04-20T22:00:54.878 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (13m) 29s ago 13m 7730k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T22:00:54.878 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (12m) 8s ago 12m 8158k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T22:00:54.878 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (11m) 29s ago 11m 206M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4361ae428e0d 2024-04-20T22:00:54.878 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (10m) 29s ago 10m 213M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 dd7e7cf8e8e1 2024-04-20T22:00:54.878 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (9m) 29s ago 9m 188M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 8e9165365127 2024-04-20T22:00:54.878 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (9m) 8s ago 9m 277M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c081911f56ab 2024-04-20T22:00:54.878 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (8m) 8s ago 8m 241M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 39e09d63d44f 2024-04-20T22:00:54.878 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (8m) 8s ago 8m 220M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4f36124aeb0d 2024-04-20T22:00:54.878 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (86s) 29s ago 12m 55.4M - 2.43.0 a07b618ecd1d 46b76c20eae5 2024-04-20T22:00:54.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.880+0000 7f30abe00700 1 -- 172.21.15.142:0/406142926 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f308c06edf0 msgr2=0x7f308c0712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:54.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.880+0000 7f30abe00700 1 --2- 172.21.15.142:0/406142926 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f308c06edf0 0x7f308c0712b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3090005950 tx=0x7f30900058e0 comp rx=0 tx=0).stop 2024-04-20T22:00:54.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.880+0000 7f30abe00700 1 -- 172.21.15.142:0/406142926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30a4102e20 msgr2=0x7f30a4198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:54.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.880+0000 7f30abe00700 1 --2- 172.21.15.142:0/406142926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30a4102e20 0x7f30a4198820 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f309800bd70 tx=0x7f309800be50 comp rx=0 tx=0).stop 2024-04-20T22:00:54.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.880+0000 7f30abe00700 1 -- 172.21.15.142:0/406142926 shutdown_connections 2024-04-20T22:00:54.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.880+0000 7f30abe00700 1 --2- 172.21.15.142:0/406142926 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f308c06edf0 0x7f308c0712b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:54.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.880+0000 7f30abe00700 1 --2- 172.21.15.142:0/406142926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30a4102e20 0x7f30a4198820 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:54.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.880+0000 7f30abe00700 1 --2- 172.21.15.142:0/406142926 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30a4103f80 0x7f30a4198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:54.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.880+0000 7f30abe00700 1 -- 172.21.15.142:0/406142926 >> 172.21.15.142:0/406142926 conn(0x7f30a40fe3a0 msgr2=0x7f30a4107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:54.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.880+0000 7f30abe00700 1 -- 172.21.15.142:0/406142926 shutdown_connections 2024-04-20T22:00:54.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:54.880+0000 7f30abe00700 1 -- 172.21.15.142:0/406142926 wait complete. 2024-04-20T22:00:55.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.075+0000 7f8f01200700 1 -- 172.21.15.142:0/3154867287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8efc101c40 msgr2=0x7f8efc1020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:55.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.075+0000 7f8f01200700 1 --2- 172.21.15.142:0/3154867287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8efc101c40 0x7f8efc1020a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8009910 tx=0x7f8ee8009c20 comp rx=0 tx=0).stop 2024-04-20T22:00:55.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.075+0000 7f8f01200700 1 -- 172.21.15.142:0/3154867287 shutdown_connections 2024-04-20T22:00:55.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.075+0000 7f8f01200700 1 --2- 172.21.15.142:0/3154867287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8efc101c40 0x7f8efc1020a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:55.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.075+0000 7f8f01200700 1 --2- 172.21.15.142:0/3154867287 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8efc100a40 0x7f8efc100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:55.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.075+0000 7f8f01200700 1 -- 172.21.15.142:0/3154867287 >> 172.21.15.142:0/3154867287 conn(0x7f8efc0fc000 msgr2=0x7f8efc0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:55.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.075+0000 7f8f01200700 1 -- 172.21.15.142:0/3154867287 shutdown_connections 2024-04-20T22:00:55.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.075+0000 7f8f01200700 1 -- 172.21.15.142:0/3154867287 wait complete. 2024-04-20T22:00:55.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.076+0000 7f8f01200700 1 Processor -- start 2024-04-20T22:00:55.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.077+0000 7f8f01200700 1 -- start start 2024-04-20T22:00:55.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.077+0000 7f8f01200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8efc100a40 0x7f8efc19ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:55.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.077+0000 7f8f01200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8efc101c40 0x7f8efc19cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:55.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.078+0000 7f8f01200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc19d5d0 con 0x7f8efc101c40 2024-04-20T22:00:55.077 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.078+0000 7f8f01200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc19d710 con 0x7f8efc100a40 2024-04-20T22:00:55.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.078+0000 7f8efb400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8efc100a40 0x7f8efc19ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:55.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.078+0000 7f8efaa00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8efc101c40 0x7f8efc19cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:55.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.078+0000 7f8efb400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8efc100a40 0x7f8efc19ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:46788/0 (socket says 172.21.15.142:46788) 2024-04-20T22:00:55.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.078+0000 7f8efb400700 1 -- 172.21.15.142:0/1833487343 learned_addr learned my addr 172.21.15.142:0/1833487343 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:00:55.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.078+0000 7f8efaa00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8efc101c40 0x7f8efc19cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46630/0 (socket says 172.21.15.142:46630) 2024-04-20T22:00:55.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.078+0000 7f8efaa00700 1 -- 172.21.15.142:0/1833487343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8efc100a40 msgr2=0x7f8efc19ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:55.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.078+0000 7f8efaa00700 1 --2- 172.21.15.142:0/1833487343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8efc100a40 0x7f8efc19ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:55.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.078+0000 7f8efaa00700 1 -- 172.21.15.142:0/1833487343 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee80095f0 con 0x7f8efc101c40 2024-04-20T22:00:55.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.079+0000 7f8efaa00700 1 --2- 172.21.15.142:0/1833487343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8efc101c40 0x7f8efc19cfb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8000c00 tx=0x7f8ee8005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:55.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.080+0000 7f8ef3e00700 1 -- 172.21.15.142:0/1833487343 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ee801d070 con 0x7f8efc101c40 2024-04-20T22:00:55.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.080+0000 7f8ef3e00700 1 -- 172.21.15.142:0/1833487343 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ee80052a0 con 0x7f8efc101c40 2024-04-20T22:00:55.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.080+0000 7f8ef3e00700 1 -- 172.21.15.142:0/1833487343 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ee8017400 con 0x7f8efc101c40 2024-04-20T22:00:55.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.080+0000 7f8f01200700 1 -- 172.21.15.142:0/1833487343 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8efc1a20c0 con 0x7f8efc101c40 2024-04-20T22:00:55.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.080+0000 7f8f01200700 1 -- 172.21.15.142:0/1833487343 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8efc1a2630 con 0x7f8efc101c40 2024-04-20T22:00:55.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.081+0000 7f8f01200700 1 -- 172.21.15.142:0/1833487343 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8efc106140 con 0x7f8efc101c40 2024-04-20T22:00:55.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.084+0000 7f8ef3e00700 1 -- 172.21.15.142:0/1833487343 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7f8ee8003780 con 0x7f8efc101c40 2024-04-20T22:00:55.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.085+0000 7f8ef3e00700 1 --2- 172.21.15.142:0/1833487343 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8ee006ee30 0x7f8ee00712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:55.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.085+0000 7f8ef3e00700 1 -- 172.21.15.142:0/1833487343 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8ee8090380 con 0x7f8efc101c40 2024-04-20T22:00:55.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.085+0000 7f8efb400700 1 --2- 172.21.15.142:0/1833487343 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8ee006ee30 0x7f8ee00712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:55.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.086+0000 7f8efb400700 1 --2- 172.21.15.142:0/1833487343 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8ee006ee30 0x7f8ee00712f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8eec005950 tx=0x7f8eec009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:55.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.090+0000 7f8ef3e00700 1 -- 172.21.15.142:0/1833487343 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f8ee805cb00 con 0x7f8efc101c40 2024-04-20T22:00:55.631 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:55 smithi142 ceph-mon[79401]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:00:55.631 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:55 smithi142 ceph-mon[79401]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:00:55.631 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:55 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:55.631 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:55 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:55.631 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:55 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:00:55.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:55 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:00:55.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:55 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:55.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:55 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T22:00:55.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:55 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T22:00:55.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:55 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:00:55.633 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-20T22:00:55.634 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-20T22:00:55.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.634+0000 7f8f01200700 1 -- 172.21.15.142:0/1833487343 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8efc1095a0 con 0x7f8efc101c40 2024-04-20T22:00:55.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.635+0000 7f8ef3e00700 1 -- 172.21.15.142:0/1833487343 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f8ee805c690 con 0x7f8efc101c40 2024-04-20T22:00:55.635 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:00:55.635 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:00:55.635 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:00:55.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:00:55.636 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:00:55.636 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:00:55.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:00:55.636 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:00:55.636 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 6 2024-04-20T22:00:55.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:00:55.636 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:00:55.636 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4 2024-04-20T22:00:55.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:00:55.636 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:00:55.636 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 10, 2024-04-20T22:00:55.636 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 4 2024-04-20T22:00:55.637 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:00:55.637 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:00:55.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.638+0000 7f8f01200700 1 -- 172.21.15.142:0/1833487343 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8ee006ee30 msgr2=0x7f8ee00712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:55.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.638+0000 7f8f01200700 1 --2- 172.21.15.142:0/1833487343 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8ee006ee30 0x7f8ee00712f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8eec005950 tx=0x7f8eec009260 comp rx=0 tx=0).stop 2024-04-20T22:00:55.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.638+0000 7f8f01200700 1 -- 172.21.15.142:0/1833487343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8efc101c40 msgr2=0x7f8efc19cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:55.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.638+0000 7f8f01200700 1 --2- 172.21.15.142:0/1833487343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8efc101c40 0x7f8efc19cfb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8000c00 tx=0x7f8ee8005f00 comp rx=0 tx=0).stop 2024-04-20T22:00:55.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.638+0000 7f8f01200700 1 -- 172.21.15.142:0/1833487343 shutdown_connections 2024-04-20T22:00:55.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.638+0000 7f8f01200700 1 --2- 172.21.15.142:0/1833487343 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8ee006ee30 0x7f8ee00712f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:55.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.638+0000 7f8f01200700 1 --2- 172.21.15.142:0/1833487343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8efc100a40 0x7f8efc19ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:55.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.638+0000 7f8f01200700 1 --2- 172.21.15.142:0/1833487343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8efc101c40 0x7f8efc19cfb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:55.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.638+0000 7f8f01200700 1 -- 172.21.15.142:0/1833487343 >> 172.21.15.142:0/1833487343 conn(0x7f8efc0fc000 msgr2=0x7f8efc103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:55.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.638+0000 7f8f01200700 1 -- 172.21.15.142:0/1833487343 shutdown_connections 2024-04-20T22:00:55.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.639+0000 7f8f01200700 1 -- 172.21.15.142:0/1833487343 wait complete. 2024-04-20T22:00:55.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:55 smithi164 ceph-mon[69784]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:00:55.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:55 smithi164 ceph-mon[69784]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:00:55.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:55 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:55.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:55 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:55.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:55 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:00:55.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:55 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:00:55.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:55 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:55.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:55 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T22:00:55.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:55 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T22:00:55.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:55 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:00:55.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.803+0000 7efeece00700 1 -- 172.21.15.142:0/3200385126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee8101de0 msgr2=0x7efee8104270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:55.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.803+0000 7efeece00700 1 --2- 172.21.15.142:0/3200385126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee8101de0 0x7efee8104270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efed4009910 tx=0x7efed4009c20 comp rx=0 tx=0).stop 2024-04-20T22:00:55.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.804+0000 7efeece00700 1 -- 172.21.15.142:0/3200385126 shutdown_connections 2024-04-20T22:00:55.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.804+0000 7efeece00700 1 --2- 172.21.15.142:0/3200385126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee8101de0 0x7efee8104270 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:55.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.804+0000 7efeece00700 1 --2- 172.21.15.142:0/3200385126 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efee80ff470 0x7efee81018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:55.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.804+0000 7efeece00700 1 -- 172.21.15.142:0/3200385126 >> 172.21.15.142:0/3200385126 conn(0x7efee80fb0d0 msgr2=0x7efee80fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:55.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.805+0000 7efeece00700 1 -- 172.21.15.142:0/3200385126 shutdown_connections 2024-04-20T22:00:55.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.805+0000 7efeece00700 1 -- 172.21.15.142:0/3200385126 wait complete. 2024-04-20T22:00:55.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.806+0000 7efeece00700 1 Processor -- start 2024-04-20T22:00:55.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.806+0000 7efeece00700 1 -- start start 2024-04-20T22:00:55.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.806+0000 7efeece00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efee80ff470 0x7efee819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:55.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.806+0000 7efeece00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee8101de0 0x7efee819d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:55.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.806+0000 7efeece00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee819d820 con 0x7efee8101de0 2024-04-20T22:00:55.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.806+0000 7efeece00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee819d990 con 0x7efee80ff470 2024-04-20T22:00:55.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.807+0000 7efee5400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee8101de0 0x7efee819d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:55.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.807+0000 7efee5400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee8101de0 0x7efee819d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46644/0 (socket says 172.21.15.142:46644) 2024-04-20T22:00:55.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.807+0000 7efee5400700 1 -- 172.21.15.142:0/4177590531 learned_addr learned my addr 172.21.15.142:0/4177590531 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:00:55.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.807+0000 7efee5e00700 1 --2- 172.21.15.142:0/4177590531 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efee80ff470 0x7efee819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:55.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.807+0000 7efee5400700 1 -- 172.21.15.142:0/4177590531 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efee80ff470 msgr2=0x7efee819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:55.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.807+0000 7efee5400700 1 --2- 172.21.15.142:0/4177590531 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efee80ff470 0x7efee819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:55.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.807+0000 7efee5400700 1 -- 172.21.15.142:0/4177590531 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed40095f0 con 0x7efee8101de0 2024-04-20T22:00:55.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.807+0000 7efee5400700 1 --2- 172.21.15.142:0/4177590531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee8101de0 0x7efee819d220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efed4006010 tx=0x7efed400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:55.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.808+0000 7efedea00700 1 -- 172.21.15.142:0/4177590531 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efed401d070 con 0x7efee8101de0 2024-04-20T22:00:55.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.808+0000 7efedea00700 1 -- 172.21.15.142:0/4177590531 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efed400f460 con 0x7efee8101de0 2024-04-20T22:00:55.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.808+0000 7efeece00700 1 -- 172.21.15.142:0/4177590531 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee81a2370 con 0x7efee8101de0 2024-04-20T22:00:55.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.808+0000 7efedea00700 1 -- 172.21.15.142:0/4177590531 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efed4021640 con 0x7efee8101de0 2024-04-20T22:00:55.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.808+0000 7efeece00700 1 -- 172.21.15.142:0/4177590531 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee81a28e0 con 0x7efee8101de0 2024-04-20T22:00:55.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.810+0000 7efeece00700 1 -- 172.21.15.142:0/4177590531 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec8005320 con 0x7efee8101de0 2024-04-20T22:00:55.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.811+0000 7efedea00700 1 -- 172.21.15.142:0/4177590531 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7efed4003a60 con 0x7efee8101de0 2024-04-20T22:00:55.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.812+0000 7efedea00700 1 --2- 172.21.15.142:0/4177590531 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7efecc06edf0 0x7efecc0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:55.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.812+0000 7efedea00700 1 -- 172.21.15.142:0/4177590531 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7efed4090350 con 0x7efee8101de0 2024-04-20T22:00:55.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.813+0000 7efee5e00700 1 --2- 172.21.15.142:0/4177590531 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7efecc06edf0 0x7efecc0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:55.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.814+0000 7efee5e00700 1 --2- 172.21.15.142:0/4177590531 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7efecc06edf0 0x7efecc0712b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efed8006fd0 tx=0x7efed8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:55.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:55.818+0000 7efedea00700 1 -- 172.21.15.142:0/4177590531 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7efed4058f20 con 0x7efee8101de0 2024-04-20T22:00:56.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.134+0000 7efeece00700 1 -- 172.21.15.142:0/4177590531 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efec80058a0 con 0x7efee8101de0 2024-04-20T22:00:56.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.135+0000 7efedea00700 1 -- 172.21.15.142:0/4177590531 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1898 (secure 0 0 0) 0x7efed405c5e0 con 0x7efee8101de0 2024-04-20T22:00:56.136 INFO:teuthology.orchestra.run.smithi142.stdout:e12 2024-04-20T22:00:56.136 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:00:56.136 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:00:56.136 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T22:00:56.136 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:00:56.137 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T22:00:56.137 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T22:00:56.137 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 12 2024-04-20T22:00:56.137 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:00:56.137 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:00:56.137 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:51.692699+0000 2024-04-20T22:00:56.137 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T22:00:56.138 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T22:00:56.138 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T22:00:56.138 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T22:00:56.138 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T22:00:56.138 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T22:00:56.138 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T22:00:56.139 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T22:00:56.139 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T22:00:56.139 INFO:teuthology.orchestra.run.smithi142.stdout:snap_rstat 1 2024-04-20T22:00:56.139 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:00:56.139 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T22:00:56.139 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T22:00:56.139 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T22:00:56.140 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T22:00:56.140 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T22:00:56.140 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T22:00:56.140 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T22:00:56.140 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T22:00:56.140 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T22:00:56.141 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T22:00:56.141 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T22:00:56.141 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T22:00:56.141 INFO:teuthology.orchestra.run.smithi142.stdout:qdb_cluster leader: 0 members: 2024-04-20T22:00:56.141 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:00:56.141 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:00:56.142 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:00:56.142 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T22:00:56.142 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:00:56.142 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:00:56.142 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:00:56.142 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:00:56.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.139+0000 7efeece00700 1 -- 172.21.15.142:0/4177590531 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7efecc06edf0 msgr2=0x7efecc0712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:56.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.139+0000 7efeece00700 1 --2- 172.21.15.142:0/4177590531 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7efecc06edf0 0x7efecc0712b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efed8006fd0 tx=0x7efed8008040 comp rx=0 tx=0).stop 2024-04-20T22:00:56.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.139+0000 7efeece00700 1 -- 172.21.15.142:0/4177590531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee8101de0 msgr2=0x7efee819d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:56.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.139+0000 7efeece00700 1 --2- 172.21.15.142:0/4177590531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee8101de0 0x7efee819d220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efed4006010 tx=0x7efed400be20 comp rx=0 tx=0).stop 2024-04-20T22:00:56.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.139+0000 7efeece00700 1 -- 172.21.15.142:0/4177590531 shutdown_connections 2024-04-20T22:00:56.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.139+0000 7efeece00700 1 --2- 172.21.15.142:0/4177590531 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7efecc06edf0 0x7efecc0712b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:56.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.139+0000 7efeece00700 1 --2- 172.21.15.142:0/4177590531 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efee80ff470 0x7efee819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:56.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.139+0000 7efeece00700 1 --2- 172.21.15.142:0/4177590531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efee8101de0 0x7efee819d220 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:56.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.139+0000 7efeece00700 1 -- 172.21.15.142:0/4177590531 >> 172.21.15.142:0/4177590531 conn(0x7efee80fb0d0 msgr2=0x7efee80fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:56.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.140+0000 7efeece00700 1 -- 172.21.15.142:0/4177590531 shutdown_connections 2024-04-20T22:00:56.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.140+0000 7efeece00700 1 -- 172.21.15.142:0/4177590531 wait complete. 2024-04-20T22:00:56.145 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T22:00:56.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.347+0000 7f1e8b000700 1 -- 172.21.15.142:0/2280005829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e84101680 msgr2=0x7f1e84103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:56.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.347+0000 7f1e8b000700 1 --2- 172.21.15.142:0/2280005829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e84101680 0x7f1e84103a70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1e74009910 tx=0x7f1e74009c20 comp rx=0 tx=0).stop 2024-04-20T22:00:56.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.347+0000 7f1e8b000700 1 -- 172.21.15.142:0/2280005829 shutdown_connections 2024-04-20T22:00:56.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.347+0000 7f1e8b000700 1 --2- 172.21.15.142:0/2280005829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e84103fb0 0x7f1e841063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:56.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.347+0000 7f1e8b000700 1 --2- 172.21.15.142:0/2280005829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e84101680 0x7f1e84103a70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:56.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.347+0000 7f1e8b000700 1 -- 172.21.15.142:0/2280005829 >> 172.21.15.142:0/2280005829 conn(0x7f1e840fb0d0 msgr2=0x7f1e840fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:56.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.347+0000 7f1e8b000700 1 -- 172.21.15.142:0/2280005829 shutdown_connections 2024-04-20T22:00:56.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.348+0000 7f1e8b000700 1 -- 172.21.15.142:0/2280005829 wait complete. 2024-04-20T22:00:56.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.350+0000 7f1e8b000700 1 Processor -- start 2024-04-20T22:00:56.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.350+0000 7f1e8b000700 1 -- start start 2024-04-20T22:00:56.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.350+0000 7f1e8b000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e84101680 0x7f1e84198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:56.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.350+0000 7f1e8b000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e84103fb0 0x7f1e84198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:56.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.350+0000 7f1e8b000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e84199330 con 0x7f1e84101680 2024-04-20T22:00:56.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.350+0000 7f1e8b000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e84199470 con 0x7f1e84103fb0 2024-04-20T22:00:56.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.351+0000 7f1e83e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e84101680 0x7f1e84198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:56.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.351+0000 7f1e83e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e84101680 0x7f1e84198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46648/0 (socket says 172.21.15.142:46648) 2024-04-20T22:00:56.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.351+0000 7f1e83e00700 1 -- 172.21.15.142:0/1110008937 learned_addr learned my addr 172.21.15.142:0/1110008937 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:00:56.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.351+0000 7f1e7be00700 1 --2- 172.21.15.142:0/1110008937 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e84103fb0 0x7f1e84198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:56.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.352+0000 7f1e7be00700 1 -- 172.21.15.142:0/1110008937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e84101680 msgr2=0x7f1e84198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:56.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.352+0000 7f1e7be00700 1 --2- 172.21.15.142:0/1110008937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e84101680 0x7f1e84198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:56.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.352+0000 7f1e7be00700 1 -- 172.21.15.142:0/1110008937 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e740095f0 con 0x7f1e84103fb0 2024-04-20T22:00:56.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.352+0000 7f1e83e00700 1 --2- 172.21.15.142:0/1110008937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e84101680 0x7f1e84198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T22:00:56.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.352+0000 7f1e7be00700 1 --2- 172.21.15.142:0/1110008937 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e84103fb0 0x7f1e84198da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00c8f0 tx=0x7f1e6c00cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:56.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.353+0000 7f1e81600700 1 -- 172.21.15.142:0/1110008937 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e6c0041f0 con 0x7f1e84103fb0 2024-04-20T22:00:56.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.353+0000 7f1e81600700 1 -- 172.21.15.142:0/1110008937 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e6c004cf0 con 0x7f1e84103fb0 2024-04-20T22:00:56.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.353+0000 7f1e81600700 1 -- 172.21.15.142:0/1110008937 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e6c0076d0 con 0x7f1e84103fb0 2024-04-20T22:00:56.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.353+0000 7f1e8b000700 1 -- 172.21.15.142:0/1110008937 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8406aa20 con 0x7f1e84103fb0 2024-04-20T22:00:56.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.354+0000 7f1e8b000700 1 -- 172.21.15.142:0/1110008937 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8406afc0 con 0x7f1e84103fb0 2024-04-20T22:00:56.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.355+0000 7f1e8b000700 1 -- 172.21.15.142:0/1110008937 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e84062510 con 0x7f1e84103fb0 2024-04-20T22:00:56.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.358+0000 7f1e81600700 1 -- 172.21.15.142:0/1110008937 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7f1e6c004350 con 0x7f1e84103fb0 2024-04-20T22:00:56.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.359+0000 7f1e81600700 1 --2- 172.21.15.142:0/1110008937 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f1e6406edf0 0x7f1e640712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:56.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.359+0000 7f1e81600700 1 -- 172.21.15.142:0/1110008937 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1e6c08ed30 con 0x7f1e84103fb0 2024-04-20T22:00:56.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.360+0000 7f1e83e00700 1 --2- 172.21.15.142:0/1110008937 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f1e6406edf0 0x7f1e640712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:56.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.362+0000 7f1e83e00700 1 --2- 172.21.15.142:0/1110008937 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f1e6406edf0 0x7f1e640712b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1e740051c0 tx=0x7f1e7400b560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:56.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.366+0000 7f1e81600700 1 -- 172.21.15.142:0/1110008937 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f1e6c05b4b0 con 0x7f1e84103fb0 2024-04-20T22:00:56.392 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:56 smithi142 ceph-mon[79401]: pgmap v23: 65 pgs: 65 active+clean; 238 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 669 KiB/s wr, 211 op/s 2024-04-20T22:00:56.392 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:56 smithi142 ceph-mon[79401]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:00:56.392 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:56 smithi142 ceph-mon[79401]: Reconfiguring mon.smithi142 (monmap changed)... 2024-04-20T22:00:56.392 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:56 smithi142 ceph-mon[79401]: Reconfiguring daemon mon.smithi142 on smithi142 2024-04-20T22:00:56.393 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:56 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1833487343' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:00:56.393 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:56 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/4177590531' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:00:56.600 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:56 smithi164 ceph-mon[69784]: pgmap v23: 65 pgs: 65 active+clean; 238 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 669 KiB/s wr, 211 op/s 2024-04-20T22:00:56.600 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:56 smithi164 ceph-mon[69784]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:00:56.600 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:56 smithi164 ceph-mon[69784]: Reconfiguring mon.smithi142 (monmap changed)... 2024-04-20T22:00:56.600 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:56 smithi164 ceph-mon[69784]: Reconfiguring daemon mon.smithi142 on smithi142 2024-04-20T22:00:56.600 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:56 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/1833487343' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:00:56.600 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:56 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/4177590531' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:00:56.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.649+0000 7f1e8b000700 1 -- 172.21.15.142:0/1110008937 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e840ffec0 con 0x7f1e6406edf0 2024-04-20T22:00:56.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.651+0000 7f1e81600700 1 -- 172.21.15.142:0/1110008937 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f1e840ffec0 con 0x7f1e6406edf0 2024-04-20T22:00:56.651 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:00:56.651 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T22:00:56.651 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T22:00:56.651 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T22:00:56.651 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T22:00:56.651 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr", 2024-04-20T22:00:56.651 INFO:teuthology.orchestra.run.smithi142.stdout: "mon" 2024-04-20T22:00:56.651 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T22:00:56.651 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "4/23 daemons upgraded", 2024-04-20T22:00:56.651 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading mon daemons", 2024-04-20T22:00:56.651 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T22:00:56.652 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:00:56.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.654+0000 7f1e8b000700 1 -- 172.21.15.142:0/1110008937 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f1e6406edf0 msgr2=0x7f1e640712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:56.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.654+0000 7f1e8b000700 1 --2- 172.21.15.142:0/1110008937 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f1e6406edf0 0x7f1e640712b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1e740051c0 tx=0x7f1e7400b560 comp rx=0 tx=0).stop 2024-04-20T22:00:56.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.654+0000 7f1e8b000700 1 -- 172.21.15.142:0/1110008937 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e84103fb0 msgr2=0x7f1e84198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:56.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.654+0000 7f1e8b000700 1 --2- 172.21.15.142:0/1110008937 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e84103fb0 0x7f1e84198da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00c8f0 tx=0x7f1e6c00cc00 comp rx=0 tx=0).stop 2024-04-20T22:00:56.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.654+0000 7f1e8b000700 1 -- 172.21.15.142:0/1110008937 shutdown_connections 2024-04-20T22:00:56.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.654+0000 7f1e8b000700 1 --2- 172.21.15.142:0/1110008937 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f1e6406edf0 0x7f1e640712b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:56.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.654+0000 7f1e8b000700 1 --2- 172.21.15.142:0/1110008937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e84101680 0x7f1e84198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:56.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.654+0000 7f1e8b000700 1 --2- 172.21.15.142:0/1110008937 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e84103fb0 0x7f1e84198da0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:56.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.654+0000 7f1e8b000700 1 -- 172.21.15.142:0/1110008937 >> 172.21.15.142:0/1110008937 conn(0x7f1e840fb0d0 msgr2=0x7f1e840ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:56.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.654+0000 7f1e8b000700 1 -- 172.21.15.142:0/1110008937 shutdown_connections 2024-04-20T22:00:56.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.654+0000 7f1e8b000700 1 -- 172.21.15.142:0/1110008937 wait complete. 2024-04-20T22:00:56.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.814+0000 7fc81de00700 1 -- 172.21.15.142:0/1845660182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc818100c30 msgr2=0x7fc818101050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:56.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.814+0000 7fc81de00700 1 --2- 172.21.15.142:0/1845660182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc818100c30 0x7fc818101050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc808009910 tx=0x7fc808009c20 comp rx=0 tx=0).stop 2024-04-20T22:00:56.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.814+0000 7fc81de00700 1 -- 172.21.15.142:0/1845660182 shutdown_connections 2024-04-20T22:00:56.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.814+0000 7fc81de00700 1 --2- 172.21.15.142:0/1845660182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc818101e30 0x7fc818102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:56.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.814+0000 7fc81de00700 1 --2- 172.21.15.142:0/1845660182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc818100c30 0x7fc818101050 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:56.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.814+0000 7fc81de00700 1 -- 172.21.15.142:0/1845660182 >> 172.21.15.142:0/1845660182 conn(0x7fc8180fc1f0 msgr2=0x7fc8180fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:56.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.814+0000 7fc81de00700 1 -- 172.21.15.142:0/1845660182 shutdown_connections 2024-04-20T22:00:56.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.814+0000 7fc81de00700 1 -- 172.21.15.142:0/1845660182 wait complete. 2024-04-20T22:00:56.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.816+0000 7fc81de00700 1 Processor -- start 2024-04-20T22:00:56.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.816+0000 7fc81de00700 1 -- start start 2024-04-20T22:00:56.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.816+0000 7fc81de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc818100c30 0x7fc818198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:56.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.816+0000 7fc81de00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc818101e30 0x7fc818198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:56.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.816+0000 7fc81de00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc818199490 con 0x7fc818100c30 2024-04-20T22:00:56.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.816+0000 7fc81de00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8181995d0 con 0x7fc818101e30 2024-04-20T22:00:56.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.817+0000 7fc816a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc818100c30 0x7fc818198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:56.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.817+0000 7fc816a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc818100c30 0x7fc818198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46668/0 (socket says 172.21.15.142:46668) 2024-04-20T22:00:56.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.817+0000 7fc816a00700 1 -- 172.21.15.142:0/1989859315 learned_addr learned my addr 172.21.15.142:0/1989859315 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:00:56.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.817+0000 7fc816000700 1 --2- 172.21.15.142:0/1989859315 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc818101e30 0x7fc818198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:56.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.817+0000 7fc816a00700 1 -- 172.21.15.142:0/1989859315 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc818101e30 msgr2=0x7fc818198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:56.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.817+0000 7fc816a00700 1 --2- 172.21.15.142:0/1989859315 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc818101e30 0x7fc818198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:56.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.817+0000 7fc816a00700 1 -- 172.21.15.142:0/1989859315 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8080095f0 con 0x7fc818100c30 2024-04-20T22:00:56.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.818+0000 7fc816a00700 1 --2- 172.21.15.142:0/1989859315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc818100c30 0x7fc818198930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc80800bd70 tx=0x7fc80800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:56.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.818+0000 7fc81ca00700 1 -- 172.21.15.142:0/1989859315 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc80801d070 con 0x7fc818100c30 2024-04-20T22:00:56.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.818+0000 7fc81ca00700 1 -- 172.21.15.142:0/1989859315 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc80800f460 con 0x7fc818100c30 2024-04-20T22:00:56.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.818+0000 7fc81ca00700 1 -- 172.21.15.142:0/1989859315 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc808021620 con 0x7fc818100c30 2024-04-20T22:00:56.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.818+0000 7fc81de00700 1 -- 172.21.15.142:0/1989859315 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81819dfd0 con 0x7fc818100c30 2024-04-20T22:00:56.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.818+0000 7fc81de00700 1 -- 172.21.15.142:0/1989859315 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81819e4c0 con 0x7fc818100c30 2024-04-20T22:00:56.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.821+0000 7fc81de00700 1 -- 172.21.15.142:0/1989859315 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f8005320 con 0x7fc818100c30 2024-04-20T22:00:56.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.822+0000 7fc81ca00700 1 -- 172.21.15.142:0/1989859315 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7fc808003a60 con 0x7fc818100c30 2024-04-20T22:00:56.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.823+0000 7fc81ca00700 1 --2- 172.21.15.142:0/1989859315 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc7fc06ee40 0x7fc7fc071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:00:56.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.823+0000 7fc81ca00700 1 -- 172.21.15.142:0/1989859315 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc80808fda0 con 0x7fc818100c30 2024-04-20T22:00:56.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.824+0000 7fc816000700 1 --2- 172.21.15.142:0/1989859315 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc7fc06ee40 0x7fc7fc071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:00:56.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.825+0000 7fc816000700 1 --2- 172.21.15.142:0/1989859315 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc7fc06ee40 0x7fc7fc071300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc804006fd0 tx=0x7fc804008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:00:56.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:56.829+0000 7fc81ca00700 1 -- 172.21.15.142:0/1989859315 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fc80805c520 con 0x7fc818100c30 2024-04-20T22:00:57.031 DEBUG:teuthology.parallel:result is None 2024-04-20T22:00:57.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:57.161+0000 7fc81de00700 1 -- 172.21.15.142:0/1989859315 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc7f8005190 con 0x7fc818100c30 2024-04-20T22:00:57.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:57.162+0000 7fc81ca00700 1 -- 172.21.15.142:0/1989859315 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc80805c0b0 con 0x7fc818100c30 2024-04-20T22:00:57.162 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_OK 2024-04-20T22:00:57.164 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:57.165+0000 7fc81de00700 1 -- 172.21.15.142:0/1989859315 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc7fc06ee40 msgr2=0x7fc7fc071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:57.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:57.165+0000 7fc81de00700 1 --2- 172.21.15.142:0/1989859315 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc7fc06ee40 0x7fc7fc071300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc804006fd0 tx=0x7fc804008040 comp rx=0 tx=0).stop 2024-04-20T22:00:57.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:57.165+0000 7fc81de00700 1 -- 172.21.15.142:0/1989859315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc818100c30 msgr2=0x7fc818198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:00:57.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:57.165+0000 7fc81de00700 1 --2- 172.21.15.142:0/1989859315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc818100c30 0x7fc818198930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc80800bd70 tx=0x7fc80800be50 comp rx=0 tx=0).stop 2024-04-20T22:00:57.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:57.165+0000 7fc81de00700 1 -- 172.21.15.142:0/1989859315 shutdown_connections 2024-04-20T22:00:57.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:57.165+0000 7fc81de00700 1 --2- 172.21.15.142:0/1989859315 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc7fc06ee40 0x7fc7fc071300 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:57.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:57.165+0000 7fc81de00700 1 --2- 172.21.15.142:0/1989859315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc818100c30 0x7fc818198930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:57.165 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:57.165+0000 7fc81de00700 1 --2- 172.21.15.142:0/1989859315 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc818101e30 0x7fc818198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:00:57.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:57.165+0000 7fc81de00700 1 -- 172.21.15.142:0/1989859315 >> 172.21.15.142:0/1989859315 conn(0x7fc8180fc1f0 msgr2=0x7fc818073530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:00:57.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:57.165+0000 7fc81de00700 1 -- 172.21.15.142:0/1989859315 shutdown_connections 2024-04-20T22:00:57.166 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:00:57.165+0000 7fc81de00700 1 -- 172.21.15.142:0/1989859315 wait complete. 2024-04-20T22:00:57.639 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:57 smithi164 ceph-mon[69784]: pgmap v24: 65 pgs: 65 active+clean; 237 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.1 MiB/s wr, 314 op/s 2024-04-20T22:00:57.639 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:57 smithi164 ceph-mon[69784]: from='client.44115 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:00:57.639 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:57 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/1989859315' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:00:57.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:57 smithi142 ceph-mon[79401]: pgmap v24: 65 pgs: 65 active+clean; 237 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 29 KiB/s rd, 1.1 MiB/s wr, 314 op/s 2024-04-20T22:00:57.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:57 smithi142 ceph-mon[79401]: from='client.44115 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:00:57.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:57 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1989859315' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:00:59.227 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:59 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:59.229 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:59 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:59.229 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:59 smithi142 ceph-mon[79401]: Reconfiguring mgr.smithi142.zzmcfz (monmap changed)... 2024-04-20T22:00:59.229 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:59 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.zzmcfz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T22:00:59.229 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:59 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T22:00:59.229 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:59 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:00:59.229 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:00:59 smithi142 ceph-mon[79401]: Reconfiguring daemon mgr.smithi142.zzmcfz on smithi142 2024-04-20T22:00:59.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:59 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:59.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:59 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:00:59.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:59 smithi164 ceph-mon[69784]: Reconfiguring mgr.smithi142.zzmcfz (monmap changed)... 2024-04-20T22:00:59.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:59 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi142.zzmcfz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T22:00:59.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:59 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T22:00:59.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:59 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:00:59.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:00:59 smithi164 ceph-mon[69784]: Reconfiguring daemon mgr.smithi142.zzmcfz on smithi142 2024-04-20T22:01:00.490 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:00 smithi142 ceph-mon[79401]: pgmap v25: 65 pgs: 65 active+clean; 237 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 800 KiB/s wr, 210 op/s 2024-04-20T22:01:00.491 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:00 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:01:00.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:00 smithi164 ceph-mon[69784]: pgmap v25: 65 pgs: 65 active+clean; 237 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 800 KiB/s wr, 210 op/s 2024-04-20T22:01:00.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:00 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:01:02.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:02 smithi142 ceph-mon[79401]: pgmap v26: 65 pgs: 65 active+clean; 235 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 800 KiB/s wr, 236 op/s 2024-04-20T22:01:02.503 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:02 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:02.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:02 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:02.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:02 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-20T22:01:02.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:02 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-20T22:01:02.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:02 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-20T22:01:02.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:02 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi142"}]: dispatch 2024-04-20T22:01:02.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:02 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:02.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:02 smithi164 ceph-mon[69784]: pgmap v26: 65 pgs: 65 active+clean; 235 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 800 KiB/s wr, 236 op/s 2024-04-20T22:01:02.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:02 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:02.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:02 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:02.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:02 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-20T22:01:02.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:02 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-20T22:01:02.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:02 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-20T22:01:02.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:02 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi142"}]: dispatch 2024-04-20T22:01:02.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:02 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:03.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:03 smithi142 ceph-mon[79401]: Reconfiguring ceph-exporter.smithi142 (monmap changed)... 2024-04-20T22:01:03.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:03 smithi142 ceph-mon[79401]: Unable to update caps for client.ceph-exporter.smithi142 2024-04-20T22:01:03.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:03 smithi142 ceph-mon[79401]: Reconfiguring daemon ceph-exporter.smithi142 on smithi142 2024-04-20T22:01:03.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:03 smithi164 ceph-mon[69784]: Reconfiguring ceph-exporter.smithi142 (monmap changed)... 2024-04-20T22:01:03.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:03 smithi164 ceph-mon[69784]: Unable to update caps for client.ceph-exporter.smithi142 2024-04-20T22:01:03.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:03 smithi164 ceph-mon[69784]: Reconfiguring daemon ceph-exporter.smithi142 on smithi142 2024-04-20T22:01:04.695 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:04 smithi142 ceph-mon[79401]: pgmap v27: 65 pgs: 65 active+clean; 230 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 997 KiB/s wr, 291 op/s 2024-04-20T22:01:04.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:04 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:04.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:04 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:04.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:04 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-20T22:01:04.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:04 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:04.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:04 smithi164 ceph-mon[69784]: pgmap v27: 65 pgs: 65 active+clean; 230 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 997 KiB/s wr, 291 op/s 2024-04-20T22:01:04.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:04 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:04.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:04 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:04.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:04 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-20T22:01:04.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:04 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:05.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:05 smithi164 ceph-mon[69784]: Reconfiguring crash.smithi142 (monmap changed)... 2024-04-20T22:01:05.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:05 smithi164 ceph-mon[69784]: Reconfiguring daemon crash.smithi142 on smithi142 2024-04-20T22:01:05.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:05 smithi142 ceph-mon[79401]: Reconfiguring crash.smithi142 (monmap changed)... 2024-04-20T22:01:05.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:05 smithi142 ceph-mon[79401]: Reconfiguring daemon crash.smithi142 on smithi142 2024-04-20T22:01:06.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:06 smithi142 ceph-mon[79401]: pgmap v28: 65 pgs: 65 active+clean; 230 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 624 KiB/s wr, 184 op/s 2024-04-20T22:01:06.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:06 smithi164 ceph-mon[69784]: pgmap v28: 65 pgs: 65 active+clean; 230 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 624 KiB/s wr, 184 op/s 2024-04-20T22:01:08.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:07 smithi164 ceph-mon[69784]: pgmap v29: 65 pgs: 65 active+clean; 230 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 818 KiB/s wr, 237 op/s 2024-04-20T22:01:08.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:07 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:08.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:07 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:08.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:07 smithi164 ceph-mon[69784]: Reconfiguring osd.0 (monmap changed)... 2024-04-20T22:01:08.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:07 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-20T22:01:08.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:07 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:08.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:07 smithi164 ceph-mon[69784]: Reconfiguring daemon osd.0 on smithi142 2024-04-20T22:01:08.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:07 smithi142 ceph-mon[79401]: pgmap v29: 65 pgs: 65 active+clean; 230 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 818 KiB/s wr, 237 op/s 2024-04-20T22:01:08.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:07 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:08.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:07 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:08.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:07 smithi142 ceph-mon[79401]: Reconfiguring osd.0 (monmap changed)... 2024-04-20T22:01:08.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:07 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-20T22:01:08.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:07 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:08.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:07 smithi142 ceph-mon[79401]: Reconfiguring daemon osd.0 on smithi142 2024-04-20T22:01:10.371 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:09 smithi142 ceph-mon[79401]: pgmap v30: 65 pgs: 65 active+clean; 230 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 12 KiB/s rd, 391 KiB/s wr, 134 op/s 2024-04-20T22:01:10.371 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:09 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:10.372 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:09 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:10.372 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:09 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-20T22:01:10.372 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:09 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:10.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:09 smithi164 ceph-mon[69784]: pgmap v30: 65 pgs: 65 active+clean; 230 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 12 KiB/s rd, 391 KiB/s wr, 134 op/s 2024-04-20T22:01:10.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:09 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:10.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:09 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:10.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:09 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-20T22:01:10.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:09 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:11.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:10 smithi142 ceph-mon[79401]: Reconfiguring osd.1 (monmap changed)... 2024-04-20T22:01:11.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:10 smithi142 ceph-mon[79401]: Reconfiguring daemon osd.1 on smithi142 2024-04-20T22:01:11.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:10 smithi164 ceph-mon[69784]: Reconfiguring osd.1 (monmap changed)... 2024-04-20T22:01:11.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:10 smithi164 ceph-mon[69784]: Reconfiguring daemon osd.1 on smithi142 2024-04-20T22:01:12.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:11 smithi142 ceph-mon[79401]: pgmap v31: 65 pgs: 65 active+clean; 230 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 12 KiB/s rd, 539 KiB/s wr, 153 op/s 2024-04-20T22:01:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:11 smithi164 ceph-mon[69784]: pgmap v31: 65 pgs: 65 active+clean; 230 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 12 KiB/s rd, 539 KiB/s wr, 153 op/s 2024-04-20T22:01:13.774 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:13 smithi142 ceph-mon[79401]: pgmap v32: 65 pgs: 65 active+clean; 224 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 544 KiB/s wr, 153 op/s 2024-04-20T22:01:13.774 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:13 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:13.774 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:13 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:13.774 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:13 smithi142 ceph-mon[79401]: Reconfiguring osd.2 (monmap changed)... 2024-04-20T22:01:13.775 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:13 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-20T22:01:13.775 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:13 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:13.775 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:13 smithi142 ceph-mon[79401]: Reconfiguring daemon osd.2 on smithi142 2024-04-20T22:01:13.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:13 smithi164 ceph-mon[69784]: pgmap v32: 65 pgs: 65 active+clean; 224 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 17 KiB/s rd, 544 KiB/s wr, 153 op/s 2024-04-20T22:01:13.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:13 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:13.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:13 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:13.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:13 smithi164 ceph-mon[69784]: Reconfiguring osd.2 (monmap changed)... 2024-04-20T22:01:13.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:13 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-20T22:01:13.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:13 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:13.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:13 smithi164 ceph-mon[69784]: Reconfiguring daemon osd.2 on smithi142 2024-04-20T22:01:14.795 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:01:14.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:01:16.409 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:16 smithi142 ceph-mon[79401]: pgmap v33: 65 pgs: 65 active+clean; 224 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.8 KiB/s rd, 347 KiB/s wr, 97 op/s 2024-04-20T22:01:16.409 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:16 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:16.409 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:16 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:16.410 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:16 smithi142 ceph-mon[79401]: Reconfiguring mds.cephfs.smithi142.lirkws (monmap changed)... 2024-04-20T22:01:16.410 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:16 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.lirkws", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T22:01:16.410 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:16 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:16.410 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:16 smithi142 ceph-mon[79401]: Reconfiguring daemon mds.cephfs.smithi142.lirkws on smithi142 2024-04-20T22:01:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:16 smithi164 ceph-mon[69784]: pgmap v33: 65 pgs: 65 active+clean; 224 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.8 KiB/s rd, 347 KiB/s wr, 97 op/s 2024-04-20T22:01:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:16 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:16 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:16 smithi164 ceph-mon[69784]: Reconfiguring mds.cephfs.smithi142.lirkws (monmap changed)... 2024-04-20T22:01:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:16 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.lirkws", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T22:01:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:16 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:16 smithi164 ceph-mon[69784]: Reconfiguring daemon mds.cephfs.smithi142.lirkws on smithi142 2024-04-20T22:01:18.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:18 smithi142 ceph-mon[79401]: pgmap v34: 65 pgs: 65 active+clean; 218 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 514 KiB/s wr, 148 op/s 2024-04-20T22:01:18.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:18 smithi164 ceph-mon[69784]: pgmap v34: 65 pgs: 65 active+clean; 218 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 14 KiB/s rd, 514 KiB/s wr, 148 op/s 2024-04-20T22:01:19.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:19 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:19.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:19 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:19.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:19 smithi142 ceph-mon[79401]: Reconfiguring mds.cephfs.smithi142.lrvfgg (monmap changed)... 2024-04-20T22:01:19.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:19 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.lrvfgg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T22:01:19.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:19 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:19.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:19 smithi142 ceph-mon[79401]: Reconfiguring daemon mds.cephfs.smithi142.lrvfgg on smithi142 2024-04-20T22:01:19.578 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:19 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:19.578 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:19 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:19.578 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:19 smithi164 ceph-mon[69784]: Reconfiguring mds.cephfs.smithi142.lrvfgg (monmap changed)... 2024-04-20T22:01:19.578 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:19 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.lrvfgg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T22:01:19.578 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:19 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:19.578 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:19 smithi164 ceph-mon[69784]: Reconfiguring daemon mds.cephfs.smithi142.lrvfgg on smithi142 2024-04-20T22:01:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:20 smithi142 ceph-mon[79401]: pgmap v35: 65 pgs: 65 active+clean; 218 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.3 KiB/s rd, 321 KiB/s wr, 95 op/s 2024-04-20T22:01:20.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:20 smithi164 ceph-mon[69784]: pgmap v35: 65 pgs: 65 active+clean; 218 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.3 KiB/s rd, 321 KiB/s wr, 95 op/s 2024-04-20T22:01:21.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:21 smithi142 ceph-mon[79401]: pgmap v36: 65 pgs: 65 active+clean; 218 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.3 KiB/s rd, 321 KiB/s wr, 105 op/s 2024-04-20T22:01:21.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:21 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:21.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:21 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:21.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:21 smithi142 ceph-mon[79401]: Reconfiguring ceph-exporter.smithi164 (monmap changed)... 2024-04-20T22:01:21.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:21 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi164", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-20T22:01:21.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:21 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi164", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-20T22:01:21.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:21 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi164", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-20T22:01:21.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:21 smithi142 ceph-mon[79401]: Unable to update caps for client.ceph-exporter.smithi164 2024-04-20T22:01:21.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:21 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi164"}]: dispatch 2024-04-20T22:01:21.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:21 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:21.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:21 smithi142 ceph-mon[79401]: Reconfiguring daemon ceph-exporter.smithi164 on smithi164 2024-04-20T22:01:21.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:21 smithi164 ceph-mon[69784]: pgmap v36: 65 pgs: 65 active+clean; 218 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.3 KiB/s rd, 321 KiB/s wr, 105 op/s 2024-04-20T22:01:21.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:21 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:21.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:21 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:21.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:21 smithi164 ceph-mon[69784]: Reconfiguring ceph-exporter.smithi164 (monmap changed)... 2024-04-20T22:01:21.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:21 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi164", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-20T22:01:21.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:21 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi164", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-20T22:01:21.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:21 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi164", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-04-20T22:01:21.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:21 smithi164 ceph-mon[69784]: Unable to update caps for client.ceph-exporter.smithi164 2024-04-20T22:01:21.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:21 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi164"}]: dispatch 2024-04-20T22:01:21.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:21 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:21.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:21 smithi164 ceph-mon[69784]: Reconfiguring daemon ceph-exporter.smithi164 on smithi164 2024-04-20T22:01:24.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:23 smithi164 ceph-mon[69784]: pgmap v37: 65 pgs: 65 active+clean; 218 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 13 KiB/s rd, 343 KiB/s wr, 127 op/s 2024-04-20T22:01:24.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:23 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:24.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:23 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:24.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:23 smithi164 ceph-mon[69784]: Reconfiguring crash.smithi164 (monmap changed)... 2024-04-20T22:01:24.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:23 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi164", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-20T22:01:24.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:23 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:24.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:23 smithi164 ceph-mon[69784]: Reconfiguring daemon crash.smithi164 on smithi164 2024-04-20T22:01:24.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:23 smithi142 ceph-mon[79401]: pgmap v37: 65 pgs: 65 active+clean; 218 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 13 KiB/s rd, 343 KiB/s wr, 127 op/s 2024-04-20T22:01:24.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:23 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:24.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:23 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:24.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:23 smithi142 ceph-mon[79401]: Reconfiguring crash.smithi164 (monmap changed)... 2024-04-20T22:01:24.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:23 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi164", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-20T22:01:24.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:23 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:24.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:23 smithi142 ceph-mon[79401]: Reconfiguring daemon crash.smithi164 on smithi164 2024-04-20T22:01:26.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:25 smithi142 ceph-mon[79401]: pgmap v38: 65 pgs: 65 active+clean; 218 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.4 KiB/s rd, 337 KiB/s wr, 102 op/s 2024-04-20T22:01:26.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:25 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:26.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:25 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:26.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:25 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi164.oejajr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T22:01:26.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:25 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T22:01:26.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:25 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:26.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:25 smithi164 ceph-mon[69784]: pgmap v38: 65 pgs: 65 active+clean; 218 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.4 KiB/s rd, 337 KiB/s wr, 102 op/s 2024-04-20T22:01:26.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:25 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:26.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:25 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:26.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:25 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi164.oejajr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T22:01:26.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:25 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T22:01:26.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:25 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:27.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.343+0000 7fcbb7800700 1 -- 172.21.15.142:0/1462532618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb0104070 msgr2=0x7fcbb0106460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:27.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.343+0000 7fcbb7800700 1 --2- 172.21.15.142:0/1462532618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb0104070 0x7fcbb0106460 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009910 tx=0x7fcb9c009c20 comp rx=0 tx=0).stop 2024-04-20T22:01:27.343 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:26 smithi142 ceph-mon[79401]: Reconfiguring mgr.smithi164.oejajr (monmap changed)... 2024-04-20T22:01:27.343 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:26 smithi142 ceph-mon[79401]: Reconfiguring daemon mgr.smithi164.oejajr on smithi164 2024-04-20T22:01:27.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.343+0000 7fcbb7800700 1 -- 172.21.15.142:0/1462532618 shutdown_connections 2024-04-20T22:01:27.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.343+0000 7fcbb7800700 1 --2- 172.21.15.142:0/1462532618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb0104070 0x7fcbb0106460 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:27.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.343+0000 7fcbb7800700 1 --2- 172.21.15.142:0/1462532618 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbb0101740 0x7fcbb0103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:27.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.343+0000 7fcbb7800700 1 -- 172.21.15.142:0/1462532618 >> 172.21.15.142:0/1462532618 conn(0x7fcbb00fb0d0 msgr2=0x7fcbb00fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:01:27.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.343+0000 7fcbb7800700 1 -- 172.21.15.142:0/1462532618 shutdown_connections 2024-04-20T22:01:27.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.343+0000 7fcbb7800700 1 -- 172.21.15.142:0/1462532618 wait complete. 2024-04-20T22:01:27.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.345+0000 7fcbb7800700 1 Processor -- start 2024-04-20T22:01:27.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.345+0000 7fcbb7800700 1 -- start start 2024-04-20T22:01:27.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.346+0000 7fcbb7800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb0101740 0x7fcbb01987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:27.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.346+0000 7fcbb7800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbb0104070 0x7fcbb0198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:27.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.346+0000 7fcbb7800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb0199340 con 0x7fcbb0101740 2024-04-20T22:01:27.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.346+0000 7fcbb7800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb0199480 con 0x7fcbb0104070 2024-04-20T22:01:27.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.346+0000 7fcbb4e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb0101740 0x7fcbb01987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:27.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.346+0000 7fcbb4e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb0101740 0x7fcbb01987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47006/0 (socket says 172.21.15.142:47006) 2024-04-20T22:01:27.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.346+0000 7fcbb4e00700 1 -- 172.21.15.142:0/1049222355 learned_addr learned my addr 172.21.15.142:0/1049222355 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:01:27.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.346+0000 7fcbafe00700 1 --2- 172.21.15.142:0/1049222355 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbb0104070 0x7fcbb0198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:27.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.347+0000 7fcbb4e00700 1 -- 172.21.15.142:0/1049222355 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbb0104070 msgr2=0x7fcbb0198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:27.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.347+0000 7fcbb4e00700 1 --2- 172.21.15.142:0/1049222355 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbb0104070 0x7fcbb0198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:27.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.347+0000 7fcbb4e00700 1 -- 172.21.15.142:0/1049222355 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c0095f0 con 0x7fcbb0101740 2024-04-20T22:01:27.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.347+0000 7fcbafe00700 1 --2- 172.21.15.142:0/1049222355 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbb0104070 0x7fcbb0198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:01:27.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.347+0000 7fcbb4e00700 1 --2- 172.21.15.142:0/1049222355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb0101740 0x7fcbb01987e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcba400d8d0 tx=0x7fcba400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:01:27.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.347+0000 7fcbad600700 1 -- 172.21.15.142:0/1049222355 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcba4009940 con 0x7fcbb0101740 2024-04-20T22:01:27.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.347+0000 7fcbb7800700 1 -- 172.21.15.142:0/1049222355 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb019dee0 con 0x7fcbb0101740 2024-04-20T22:01:27.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.347+0000 7fcbad600700 1 -- 172.21.15.142:0/1049222355 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcba4010460 con 0x7fcbb0101740 2024-04-20T22:01:27.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.347+0000 7fcbad600700 1 -- 172.21.15.142:0/1049222355 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcba400f5f0 con 0x7fcbb0101740 2024-04-20T22:01:27.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.348+0000 7fcbb7800700 1 -- 172.21.15.142:0/1049222355 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb019e420 con 0x7fcbb0101740 2024-04-20T22:01:27.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.349+0000 7fcbb7800700 1 -- 172.21.15.142:0/1049222355 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb00fcc50 con 0x7fcbb0101740 2024-04-20T22:01:27.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.350+0000 7fcbad600700 1 -- 172.21.15.142:0/1049222355 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7fcba40105d0 con 0x7fcbb0101740 2024-04-20T22:01:27.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.351+0000 7fcbad600700 1 --2- 172.21.15.142:0/1049222355 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcb9806ee00 0x7fcb980712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:27.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.351+0000 7fcbad600700 1 -- 172.21.15.142:0/1049222355 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fcba408ef70 con 0x7fcbb0101740 2024-04-20T22:01:27.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.351+0000 7fcbafe00700 1 --2- 172.21.15.142:0/1049222355 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcb9806ee00 0x7fcb980712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:27.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.352+0000 7fcbafe00700 1 --2- 172.21.15.142:0/1049222355 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcb9806ee00 0x7fcb980712c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00b5c0 tx=0x7fcb9c005180 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:01:27.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.357+0000 7fcbad600700 1 -- 172.21.15.142:0/1049222355 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fcba40c3ff0 con 0x7fcbb0101740 2024-04-20T22:01:27.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:26 smithi164 ceph-mon[69784]: Reconfiguring mgr.smithi164.oejajr (monmap changed)... 2024-04-20T22:01:27.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:26 smithi164 ceph-mon[69784]: Reconfiguring daemon mgr.smithi164.oejajr on smithi164 2024-04-20T22:01:27.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.675+0000 7fcbb7800700 1 -- 172.21.15.142:0/1049222355 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbb002cde0 con 0x7fcb9806ee00 2024-04-20T22:01:27.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.677+0000 7fcbad600700 1 -- 172.21.15.142:0/1049222355 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fcbb002cde0 con 0x7fcb9806ee00 2024-04-20T22:01:27.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.683+0000 7fcbb7800700 1 -- 172.21.15.142:0/1049222355 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcb9806ee00 msgr2=0x7fcb980712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:27.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.683+0000 7fcbb7800700 1 --2- 172.21.15.142:0/1049222355 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcb9806ee00 0x7fcb980712c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00b5c0 tx=0x7fcb9c005180 comp rx=0 tx=0).stop 2024-04-20T22:01:27.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.683+0000 7fcbb7800700 1 -- 172.21.15.142:0/1049222355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb0101740 msgr2=0x7fcbb01987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:27.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.683+0000 7fcbb7800700 1 --2- 172.21.15.142:0/1049222355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb0101740 0x7fcbb01987e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcba400d8d0 tx=0x7fcba400dc90 comp rx=0 tx=0).stop 2024-04-20T22:01:27.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.683+0000 7fcbb7800700 1 -- 172.21.15.142:0/1049222355 shutdown_connections 2024-04-20T22:01:27.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.683+0000 7fcbb7800700 1 --2- 172.21.15.142:0/1049222355 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcb9806ee00 0x7fcb980712c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:27.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.683+0000 7fcbb7800700 1 --2- 172.21.15.142:0/1049222355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbb0101740 0x7fcbb01987e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:27.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.683+0000 7fcbb7800700 1 --2- 172.21.15.142:0/1049222355 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbb0104070 0x7fcbb0198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:27.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.683+0000 7fcbb7800700 1 -- 172.21.15.142:0/1049222355 >> 172.21.15.142:0/1049222355 conn(0x7fcbb00fb0d0 msgr2=0x7fcbb0100fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:01:27.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.684+0000 7fcbb7800700 1 -- 172.21.15.142:0/1049222355 shutdown_connections 2024-04-20T22:01:27.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.684+0000 7fcbb7800700 1 -- 172.21.15.142:0/1049222355 wait complete. 2024-04-20T22:01:27.706 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T22:01:27.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.861+0000 7fa6db400700 1 -- 172.21.15.142:0/1370024251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6d4101740 msgr2=0x7fa6d4103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:27.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.861+0000 7fa6db400700 1 --2- 172.21.15.142:0/1370024251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6d4101740 0x7fa6d4103b30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8009910 tx=0x7fa6c8009c20 comp rx=0 tx=0).stop 2024-04-20T22:01:27.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.861+0000 7fa6db400700 1 -- 172.21.15.142:0/1370024251 shutdown_connections 2024-04-20T22:01:27.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.861+0000 7fa6db400700 1 --2- 172.21.15.142:0/1370024251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6d4104070 0x7fa6d4106460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:27.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.861+0000 7fa6db400700 1 --2- 172.21.15.142:0/1370024251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6d4101740 0x7fa6d4103b30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:27.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.861+0000 7fa6db400700 1 -- 172.21.15.142:0/1370024251 >> 172.21.15.142:0/1370024251 conn(0x7fa6d40fb0b0 msgr2=0x7fa6d40fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:01:27.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.861+0000 7fa6db400700 1 -- 172.21.15.142:0/1370024251 shutdown_connections 2024-04-20T22:01:27.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.861+0000 7fa6db400700 1 -- 172.21.15.142:0/1370024251 wait complete. 2024-04-20T22:01:27.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.862+0000 7fa6db400700 1 Processor -- start 2024-04-20T22:01:27.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.862+0000 7fa6db400700 1 -- start start 2024-04-20T22:01:27.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.863+0000 7fa6db400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6d4101740 0x7fa6d4198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:27.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.863+0000 7fa6db400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6d4104070 0x7fa6d4198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:27.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.863+0000 7fa6db400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d4199460 con 0x7fa6d4104070 2024-04-20T22:01:27.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.863+0000 7fa6db400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d41995a0 con 0x7fa6d4101740 2024-04-20T22:01:27.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.863+0000 7fa6d3e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6d4104070 0x7fa6d4198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:27.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.863+0000 7fa6d3e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6d4104070 0x7fa6d4198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47018/0 (socket says 172.21.15.142:47018) 2024-04-20T22:01:27.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.863+0000 7fa6d3e00700 1 -- 172.21.15.142:0/3798887601 learned_addr learned my addr 172.21.15.142:0/3798887601 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:01:27.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.863+0000 7fa6d8a00700 1 --2- 172.21.15.142:0/3798887601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6d4101740 0x7fa6d4198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:27.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.864+0000 7fa6d3e00700 1 -- 172.21.15.142:0/3798887601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6d4101740 msgr2=0x7fa6d4198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:27.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.864+0000 7fa6d3e00700 1 --2- 172.21.15.142:0/3798887601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6d4101740 0x7fa6d4198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:27.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.864+0000 7fa6d3e00700 1 -- 172.21.15.142:0/3798887601 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c80095f0 con 0x7fa6d4104070 2024-04-20T22:01:27.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.864+0000 7fa6d3e00700 1 --2- 172.21.15.142:0/3798887601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6d4104070 0x7fa6d4198e40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000b4b0 tx=0x7fa6c000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:01:27.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.864+0000 7fa6d1600700 1 -- 172.21.15.142:0/3798887601 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6c0011800 con 0x7fa6d4104070 2024-04-20T22:01:27.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.864+0000 7fa6d1600700 1 -- 172.21.15.142:0/3798887601 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa6c0011e20 con 0x7fa6d4104070 2024-04-20T22:01:27.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.864+0000 7fa6db400700 1 -- 172.21.15.142:0/3798887601 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d419e000 con 0x7fa6d4104070 2024-04-20T22:01:27.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.864+0000 7fa6d1600700 1 -- 172.21.15.142:0/3798887601 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6c000f2e0 con 0x7fa6d4104070 2024-04-20T22:01:27.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.865+0000 7fa6db400700 1 -- 172.21.15.142:0/3798887601 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d419e5a0 con 0x7fa6d4104070 2024-04-20T22:01:27.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.866+0000 7fa6db400700 1 -- 172.21.15.142:0/3798887601 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d404ebb0 con 0x7fa6d4104070 2024-04-20T22:01:27.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.867+0000 7fa6d1600700 1 -- 172.21.15.142:0/3798887601 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7fa6c0010380 con 0x7fa6d4104070 2024-04-20T22:01:27.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.868+0000 7fa6d1600700 1 --2- 172.21.15.142:0/3798887601 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa6bc06edf0 0x7fa6bc0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:27.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.868+0000 7fa6d8a00700 1 --2- 172.21.15.142:0/3798887601 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa6bc06edf0 0x7fa6bc0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:27.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.869+0000 7fa6d1600700 1 -- 172.21.15.142:0/3798887601 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa6c008ec00 con 0x7fa6d4104070 2024-04-20T22:01:27.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.869+0000 7fa6d8a00700 1 --2- 172.21.15.142:0/3798887601 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa6bc06edf0 0x7fa6bc0712b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80051c0 tx=0x7fa6c800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:01:27.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:27.874+0000 7fa6d1600700 1 -- 172.21.15.142:0/3798887601 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fa6c005b390 con 0x7fa6d4104070 2024-04-20T22:01:28.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.140+0000 7fa6db400700 1 -- 172.21.15.142:0/3798887601 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6d4100cc0 con 0x7fa6bc06edf0 2024-04-20T22:01:28.142 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.143+0000 7fa6d1600700 1 -- 172.21.15.142:0/3798887601 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fa6d4100cc0 con 0x7fa6bc06edf0 2024-04-20T22:01:28.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.146+0000 7fa6db400700 1 -- 172.21.15.142:0/3798887601 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa6bc06edf0 msgr2=0x7fa6bc0712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:28.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.146+0000 7fa6db400700 1 --2- 172.21.15.142:0/3798887601 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa6bc06edf0 0x7fa6bc0712b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80051c0 tx=0x7fa6c800b540 comp rx=0 tx=0).stop 2024-04-20T22:01:28.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.146+0000 7fa6db400700 1 -- 172.21.15.142:0/3798887601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6d4104070 msgr2=0x7fa6d4198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:28.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.146+0000 7fa6db400700 1 --2- 172.21.15.142:0/3798887601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6d4104070 0x7fa6d4198e40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000b4b0 tx=0x7fa6c000b870 comp rx=0 tx=0).stop 2024-04-20T22:01:28.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.147+0000 7fa6db400700 1 -- 172.21.15.142:0/3798887601 shutdown_connections 2024-04-20T22:01:28.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.147+0000 7fa6db400700 1 --2- 172.21.15.142:0/3798887601 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa6bc06edf0 0x7fa6bc0712b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:28.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.147+0000 7fa6db400700 1 --2- 172.21.15.142:0/3798887601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa6d4101740 0x7fa6d4198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:28.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.147+0000 7fa6db400700 1 --2- 172.21.15.142:0/3798887601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6d4104070 0x7fa6d4198e40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:28.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.147+0000 7fa6db400700 1 -- 172.21.15.142:0/3798887601 >> 172.21.15.142:0/3798887601 conn(0x7fa6d40fb0b0 msgr2=0x7fa6d41005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:01:28.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.147+0000 7fa6db400700 1 -- 172.21.15.142:0/3798887601 shutdown_connections 2024-04-20T22:01:28.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.147+0000 7fa6db400700 1 -- 172.21.15.142:0/3798887601 wait complete. 2024-04-20T22:01:28.324 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:27 smithi142 ceph-mon[79401]: pgmap v39: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 13 KiB/s rd, 509 KiB/s wr, 152 op/s 2024-04-20T22:01:28.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.324+0000 7f96ffe00700 1 -- 172.21.15.142:0/949267742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97001070f0 msgr2=0x7f9700107510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:28.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.324+0000 7f96ffe00700 1 --2- 172.21.15.142:0/949267742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97001070f0 0x7f9700107510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f96f0009910 tx=0x7f96f0009c20 comp rx=0 tx=0).stop 2024-04-20T22:01:28.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.324+0000 7f96ffe00700 1 -- 172.21.15.142:0/949267742 shutdown_connections 2024-04-20T22:01:28.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.324+0000 7f96ffe00700 1 --2- 172.21.15.142:0/949267742 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9700108290 0x7f97001086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:28.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.324+0000 7f96ffe00700 1 --2- 172.21.15.142:0/949267742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97001070f0 0x7f9700107510 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:28.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.324+0000 7f96ffe00700 1 -- 172.21.15.142:0/949267742 >> 172.21.15.142:0/949267742 conn(0x7f97000761d0 msgr2=0x7f9700078610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:01:28.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.324+0000 7f96ffe00700 1 -- 172.21.15.142:0/949267742 shutdown_connections 2024-04-20T22:01:28.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.325+0000 7f96ffe00700 1 -- 172.21.15.142:0/949267742 wait complete. 2024-04-20T22:01:28.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.326+0000 7f96ffe00700 1 Processor -- start 2024-04-20T22:01:28.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.326+0000 7f96ffe00700 1 -- start start 2024-04-20T22:01:28.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.326+0000 7f96ffe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97001070f0 0x7f970019cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:28.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.327+0000 7f96ffe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9700108290 0x7f970019d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:28.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.327+0000 7f96ffe00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970019d660 con 0x7f97001070f0 2024-04-20T22:01:28.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.327+0000 7f96ffe00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970019d7a0 con 0x7f9700108290 2024-04-20T22:01:28.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.327+0000 7f96fea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97001070f0 0x7f970019cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:28.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.327+0000 7f96fea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97001070f0 0x7f970019cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47030/0 (socket says 172.21.15.142:47030) 2024-04-20T22:01:28.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.327+0000 7f96fea00700 1 -- 172.21.15.142:0/473289263 learned_addr learned my addr 172.21.15.142:0/473289263 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:01:28.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.327+0000 7f96fe000700 1 --2- 172.21.15.142:0/473289263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9700108290 0x7f970019d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:28.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.327+0000 7f96fea00700 1 -- 172.21.15.142:0/473289263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9700108290 msgr2=0x7f970019d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:28.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.327+0000 7f96fea00700 1 --2- 172.21.15.142:0/473289263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9700108290 0x7f970019d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:28.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.327+0000 7f96fea00700 1 -- 172.21.15.142:0/473289263 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f00095f0 con 0x7f97001070f0 2024-04-20T22:01:28.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.327+0000 7f96fe000700 1 --2- 172.21.15.142:0/473289263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9700108290 0x7f970019d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T22:01:28.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.328+0000 7f96fea00700 1 --2- 172.21.15.142:0/473289263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97001070f0 0x7f970019cb00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f96f000b620 tx=0x7f96f000f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:01:28.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.328+0000 7f9704a00700 1 -- 172.21.15.142:0/473289263 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96f001d070 con 0x7f97001070f0 2024-04-20T22:01:28.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.328+0000 7f9704a00700 1 -- 172.21.15.142:0/473289263 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f96f00052a0 con 0x7f97001070f0 2024-04-20T22:01:28.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.328+0000 7f96ffe00700 1 -- 172.21.15.142:0/473289263 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97001a2150 con 0x7f97001070f0 2024-04-20T22:01:28.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.328+0000 7f9704a00700 1 -- 172.21.15.142:0/473289263 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96f0017400 con 0x7f97001070f0 2024-04-20T22:01:28.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.328+0000 7f96ffe00700 1 -- 172.21.15.142:0/473289263 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97001a26c0 con 0x7f97001070f0 2024-04-20T22:01:28.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.330+0000 7f96ffe00700 1 -- 172.21.15.142:0/473289263 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9700196c10 con 0x7f97001070f0 2024-04-20T22:01:28.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.331+0000 7f9704a00700 1 -- 172.21.15.142:0/473289263 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7f96f0003810 con 0x7f97001070f0 2024-04-20T22:01:28.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.332+0000 7f9704a00700 1 --2- 172.21.15.142:0/473289263 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f96e406edf0 0x7f96e40712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:28.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.332+0000 7f9704a00700 1 -- 172.21.15.142:0/473289263 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f96f0090490 con 0x7f97001070f0 2024-04-20T22:01:28.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.332+0000 7f96fe000700 1 --2- 172.21.15.142:0/473289263 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f96e406edf0 0x7f96e40712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:28.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.333+0000 7f96fe000700 1 --2- 172.21.15.142:0/473289263 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f96e406edf0 0x7f96e40712b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f96ec009cb0 tx=0x7f96ec009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:01:28.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.340+0000 7f9704a00700 1 -- 172.21.15.142:0/473289263 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f96f005cc30 con 0x7f97001070f0 2024-04-20T22:01:28.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:27 smithi164 ceph-mon[69784]: pgmap v39: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 13 KiB/s rd, 509 KiB/s wr, 152 op/s 2024-04-20T22:01:28.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.596+0000 7f96ffe00700 1 -- 172.21.15.142:0/473289263 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f970002ce30 con 0x7f96e406edf0 2024-04-20T22:01:28.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.614+0000 7f9704a00700 1 -- 172.21.15.142:0/473289263 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f970002ce30 con 0x7f96e406edf0 2024-04-20T22:01:28.614 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:01:28.614 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (12m) 63s ago 14m 13.6M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T22:01:28.614 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (14m) 63s ago 14m 8070k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T22:01:28.614 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (13m) 42s ago 13m 7688k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T22:01:28.614 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (14m) 63s ago 14m 6665k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 56f2e41784f8 2024-04-20T22:01:28.614 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (12m) 42s ago 12m 6660k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 bce67525dd3e 2024-04-20T22:01:28.614 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (11m) 63s ago 13m 77.1M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T22:01:28.614 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (6m) 63s ago 6m 213M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 b68e279d7945 2024-04-20T22:01:28.615 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (6m) 63s ago 6m 15.0M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T22:01:28.615 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (6m) 42s ago 6m 15.2M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T22:01:28.615 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (6m) 42s ago 6m 15.6M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T22:01:28.615 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (3m) 63s ago 15m 478M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:01:28.615 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (110s) 42s ago 12m 449M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:01:28.615 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (87s) 63s ago 16m 32.0M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 af10a542c918 2024-04-20T22:01:28.615 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (48s) 42s ago 12m 22.5M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 133512694d46 2024-04-20T22:01:28.615 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (14m) 63s ago 14m 7730k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T22:01:28.615 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (12m) 42s ago 12m 8158k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T22:01:28.615 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (11m) 63s ago 11m 206M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4361ae428e0d 2024-04-20T22:01:28.615 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (11m) 63s ago 11m 213M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 dd7e7cf8e8e1 2024-04-20T22:01:28.615 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (10m) 63s ago 10m 188M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 8e9165365127 2024-04-20T22:01:28.615 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (9m) 42s ago 9m 277M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c081911f56ab 2024-04-20T22:01:28.615 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (9m) 42s ago 9m 241M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 39e09d63d44f 2024-04-20T22:01:28.615 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (8m) 42s ago 8m 220M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4f36124aeb0d 2024-04-20T22:01:28.616 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (119s) 63s ago 13m 55.4M - 2.43.0 a07b618ecd1d 46b76c20eae5 2024-04-20T22:01:28.617 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.618+0000 7f96ffe00700 1 -- 172.21.15.142:0/473289263 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f96e406edf0 msgr2=0x7f96e40712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:28.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.618+0000 7f96ffe00700 1 --2- 172.21.15.142:0/473289263 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f96e406edf0 0x7f96e40712b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f96ec009cb0 tx=0x7f96ec009260 comp rx=0 tx=0).stop 2024-04-20T22:01:28.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.618+0000 7f96ffe00700 1 -- 172.21.15.142:0/473289263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97001070f0 msgr2=0x7f970019cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:28.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.618+0000 7f96ffe00700 1 --2- 172.21.15.142:0/473289263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97001070f0 0x7f970019cb00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f96f000b620 tx=0x7f96f000f510 comp rx=0 tx=0).stop 2024-04-20T22:01:28.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.618+0000 7f96ffe00700 1 -- 172.21.15.142:0/473289263 shutdown_connections 2024-04-20T22:01:28.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.618+0000 7f96ffe00700 1 --2- 172.21.15.142:0/473289263 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f96e406edf0 0x7f96e40712b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:28.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.618+0000 7f96ffe00700 1 --2- 172.21.15.142:0/473289263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97001070f0 0x7f970019cb00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:28.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.618+0000 7f96ffe00700 1 --2- 172.21.15.142:0/473289263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9700108290 0x7f970019d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:28.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.618+0000 7f96ffe00700 1 -- 172.21.15.142:0/473289263 >> 172.21.15.142:0/473289263 conn(0x7f97000761d0 msgr2=0x7f970010b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:01:28.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.618+0000 7f96ffe00700 1 -- 172.21.15.142:0/473289263 shutdown_connections 2024-04-20T22:01:28.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.618+0000 7f96ffe00700 1 -- 172.21.15.142:0/473289263 wait complete. 2024-04-20T22:01:28.656 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-04-20T22:01:28.656 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-04-20T22:01:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.821+0000 7fcba3200700 1 -- 172.21.15.142:0/3418943924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb9c103fa0 msgr2=0x7fcb9c104420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.821+0000 7fcba3200700 1 --2- 172.21.15.142:0/3418943924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb9c103fa0 0x7fcb9c104420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009910 tx=0x7fcb88009c20 comp rx=0 tx=0).stop 2024-04-20T22:01:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.821+0000 7fcba3200700 1 -- 172.21.15.142:0/3418943924 shutdown_connections 2024-04-20T22:01:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.821+0000 7fcba3200700 1 --2- 172.21.15.142:0/3418943924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb9c103fa0 0x7fcb9c104420 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.821+0000 7fcba3200700 1 --2- 172.21.15.142:0/3418943924 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb9c102e40 0x7fcb9c103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.821+0000 7fcba3200700 1 -- 172.21.15.142:0/3418943924 >> 172.21.15.142:0/3418943924 conn(0x7fcb9c0fe420 msgr2=0x7fcb9c100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:01:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.821+0000 7fcba3200700 1 -- 172.21.15.142:0/3418943924 shutdown_connections 2024-04-20T22:01:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.821+0000 7fcba3200700 1 -- 172.21.15.142:0/3418943924 wait complete. 2024-04-20T22:01:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.822+0000 7fcba3200700 1 Processor -- start 2024-04-20T22:01:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.822+0000 7fcba3200700 1 -- start start 2024-04-20T22:01:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.823+0000 7fcba3200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb9c102e40 0x7fcb9c1987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.823+0000 7fcba3200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb9c103fa0 0x7fcb9c198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.823+0000 7fcba3200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c199330 con 0x7fcb9c103fa0 2024-04-20T22:01:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.823+0000 7fcba3200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c199470 con 0x7fcb9c102e40 2024-04-20T22:01:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.823+0000 7fcb9b400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb9c103fa0 0x7fcb9c198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.823+0000 7fcb9be00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb9c102e40 0x7fcb9c1987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.823+0000 7fcb9be00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb9c102e40 0x7fcb9c1987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:42854/0 (socket says 172.21.15.142:42854) 2024-04-20T22:01:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.823+0000 7fcb9b400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb9c103fa0 0x7fcb9c198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47052/0 (socket says 172.21.15.142:47052) 2024-04-20T22:01:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.823+0000 7fcb9be00700 1 -- 172.21.15.142:0/463703184 learned_addr learned my addr 172.21.15.142:0/463703184 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:01:28.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.824+0000 7fcb9be00700 1 -- 172.21.15.142:0/463703184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb9c103fa0 msgr2=0x7fcb9c198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:28.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.824+0000 7fcb9be00700 1 --2- 172.21.15.142:0/463703184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb9c103fa0 0x7fcb9c198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:28.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.824+0000 7fcb9be00700 1 -- 172.21.15.142:0/463703184 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb880095f0 con 0x7fcb9c102e40 2024-04-20T22:01:28.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.824+0000 7fcb9b400700 1 --2- 172.21.15.142:0/463703184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb9c103fa0 0x7fcb9c198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T22:01:28.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.824+0000 7fcb9be00700 1 --2- 172.21.15.142:0/463703184 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb9c102e40 0x7fcb9c1987d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00e920 tx=0x7fcb8c00ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:01:28.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.824+0000 7fcb98c00700 1 -- 172.21.15.142:0/463703184 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb8c00c9d0 con 0x7fcb9c102e40 2024-04-20T22:01:28.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.824+0000 7fcb98c00700 1 -- 172.21.15.142:0/463703184 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb8c010430 con 0x7fcb9c102e40 2024-04-20T22:01:28.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.824+0000 7fcba3200700 1 -- 172.21.15.142:0/463703184 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb9c19ded0 con 0x7fcb9c102e40 2024-04-20T22:01:28.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.825+0000 7fcb98c00700 1 -- 172.21.15.142:0/463703184 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb8c018630 con 0x7fcb9c102e40 2024-04-20T22:01:28.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.825+0000 7fcba3200700 1 -- 172.21.15.142:0/463703184 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9c19e410 con 0x7fcb9c102e40 2024-04-20T22:01:28.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.826+0000 7fcba3200700 1 -- 172.21.15.142:0/463703184 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9c192940 con 0x7fcb9c102e40 2024-04-20T22:01:28.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.827+0000 7fcb98c00700 1 -- 172.21.15.142:0/463703184 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7fcb8c0105a0 con 0x7fcb9c102e40 2024-04-20T22:01:28.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.828+0000 7fcb98c00700 1 --2- 172.21.15.142:0/463703184 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcb8006edf0 0x7fcb800712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:28.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.828+0000 7fcb98c00700 1 -- 172.21.15.142:0/463703184 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fcb8c014070 con 0x7fcb9c102e40 2024-04-20T22:01:28.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.828+0000 7fcb9b400700 1 --2- 172.21.15.142:0/463703184 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcb8006edf0 0x7fcb800712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:28.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.829+0000 7fcb9b400700 1 --2- 172.21.15.142:0/463703184 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcb8006edf0 0x7fcb800712b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcb8800b800 tx=0x7fcb88009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:01:28.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:28.833+0000 7fcb98c00700 1 -- 172.21.15.142:0/463703184 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fcb8c053ff0 con 0x7fcb9c102e40 2024-04-20T22:01:29.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.144+0000 7fcba3200700 1 -- 172.21.15.142:0/463703184 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcb9c10ba30 con 0x7fcb9c102e40 2024-04-20T22:01:29.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.146+0000 7fcb98c00700 1 -- 172.21.15.142:0/463703184 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7fcb8c05ba30 con 0x7fcb9c102e40 2024-04-20T22:01:29.146 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:01:29.146 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:01:29.146 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:01:29.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:01:29.146 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:01:29.146 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:01:29.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:01:29.146 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:01:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 6 2024-04-20T22:01:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:01:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:01:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4 2024-04-20T22:01:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:01:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:01:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 10, 2024-04-20T22:01:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 4 2024-04-20T22:01:29.147 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:01:29.147 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:01:29.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.149+0000 7fcba3200700 1 -- 172.21.15.142:0/463703184 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcb8006edf0 msgr2=0x7fcb800712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:29.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.149+0000 7fcba3200700 1 --2- 172.21.15.142:0/463703184 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcb8006edf0 0x7fcb800712b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcb8800b800 tx=0x7fcb88009f70 comp rx=0 tx=0).stop 2024-04-20T22:01:29.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.149+0000 7fcba3200700 1 -- 172.21.15.142:0/463703184 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb9c102e40 msgr2=0x7fcb9c1987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:29.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.149+0000 7fcba3200700 1 --2- 172.21.15.142:0/463703184 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb9c102e40 0x7fcb9c1987d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00e920 tx=0x7fcb8c00ec30 comp rx=0 tx=0).stop 2024-04-20T22:01:29.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.149+0000 7fcba3200700 1 -- 172.21.15.142:0/463703184 shutdown_connections 2024-04-20T22:01:29.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.149+0000 7fcba3200700 1 --2- 172.21.15.142:0/463703184 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcb8006edf0 0x7fcb800712b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:29.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.149+0000 7fcba3200700 1 --2- 172.21.15.142:0/463703184 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcb9c102e40 0x7fcb9c1987d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:29.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.149+0000 7fcba3200700 1 --2- 172.21.15.142:0/463703184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb9c103fa0 0x7fcb9c198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:29.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.149+0000 7fcba3200700 1 -- 172.21.15.142:0/463703184 >> 172.21.15.142:0/463703184 conn(0x7fcb9c0fe420 msgr2=0x7fcb9c107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:01:29.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.149+0000 7fcba3200700 1 -- 172.21.15.142:0/463703184 shutdown_connections 2024-04-20T22:01:29.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.149+0000 7fcba3200700 1 -- 172.21.15.142:0/463703184 wait complete. 2024-04-20T22:01:29.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.301+0000 7f795ac00700 1 -- 172.21.15.142:0/2289488541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7954073940 msgr2=0x7f7954073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:29.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.301+0000 7f795ac00700 1 --2- 172.21.15.142:0/2289488541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7954073940 0x7f7954073dc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f793c00b0a0 tx=0x7f793c00b3b0 comp rx=0 tx=0).stop 2024-04-20T22:01:29.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.301+0000 7f795ac00700 1 -- 172.21.15.142:0/2289488541 shutdown_connections 2024-04-20T22:01:29.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.301+0000 7f795ac00700 1 --2- 172.21.15.142:0/2289488541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7954073940 0x7f7954073dc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:29.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.301+0000 7f795ac00700 1 --2- 172.21.15.142:0/2289488541 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7954074f10 0x7f7954073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:29.301 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.301+0000 7f795ac00700 1 -- 172.21.15.142:0/2289488541 >> 172.21.15.142:0/2289488541 conn(0x7f79540fc1c0 msgr2=0x7f79540fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:01:29.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.301+0000 7f795ac00700 1 -- 172.21.15.142:0/2289488541 shutdown_connections 2024-04-20T22:01:29.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.301+0000 7f795ac00700 1 -- 172.21.15.142:0/2289488541 wait complete. 2024-04-20T22:01:29.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.302+0000 7f795ac00700 1 Processor -- start 2024-04-20T22:01:29.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.302+0000 7f795ac00700 1 -- start start 2024-04-20T22:01:29.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.303+0000 7f795ac00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7954073940 0x7f795419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:29.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.303+0000 7f795ac00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7954074f10 0x7f795419d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:29.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.303+0000 7f795ac00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795419d800 con 0x7f7954073940 2024-04-20T22:01:29.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.303+0000 7f795ac00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79541a21c0 con 0x7f7954074f10 2024-04-20T22:01:29.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.303+0000 7f7953e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7954073940 0x7f795419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:29.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.303+0000 7f7953e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7954073940 0x7f795419cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47072/0 (socket says 172.21.15.142:47072) 2024-04-20T22:01:29.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.303+0000 7f7953e00700 1 -- 172.21.15.142:0/3043683504 learned_addr learned my addr 172.21.15.142:0/3043683504 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:01:29.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.303+0000 7f794b400700 1 --2- 172.21.15.142:0/3043683504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7954074f10 0x7f795419d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:29.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.303+0000 7f7953e00700 1 -- 172.21.15.142:0/3043683504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7954074f10 msgr2=0x7f795419d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:29.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.303+0000 7f7953e00700 1 --2- 172.21.15.142:0/3043683504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7954074f10 0x7f795419d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:29.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.303+0000 7f7953e00700 1 -- 172.21.15.142:0/3043683504 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c009d00 con 0x7f7954073940 2024-04-20T22:01:29.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.303+0000 7f794b400700 1 --2- 172.21.15.142:0/3043683504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7954074f10 0x7f795419d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:01:29.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.304+0000 7f7953e00700 1 --2- 172.21.15.142:0/3043683504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7954073940 0x7f795419cca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f794400c8f0 tx=0x7f794400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:01:29.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.304+0000 7f7951600700 1 -- 172.21.15.142:0/3043683504 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7944007a50 con 0x7f7954073940 2024-04-20T22:01:29.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.304+0000 7f7951600700 1 -- 172.21.15.142:0/3043683504 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7944007bb0 con 0x7f7954073940 2024-04-20T22:01:29.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.304+0000 7f7951600700 1 -- 172.21.15.142:0/3043683504 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7944018630 con 0x7f7954073940 2024-04-20T22:01:29.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.304+0000 7f795ac00700 1 -- 172.21.15.142:0/3043683504 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79541a23c0 con 0x7f7954073940 2024-04-20T22:01:29.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.304+0000 7f795ac00700 1 -- 172.21.15.142:0/3043683504 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79541a2960 con 0x7f7954073940 2024-04-20T22:01:29.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.305+0000 7f795ac00700 1 -- 172.21.15.142:0/3043683504 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7954062510 con 0x7f7954073940 2024-04-20T22:01:29.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.306+0000 7f7951600700 1 -- 172.21.15.142:0/3043683504 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7f7944007d20 con 0x7f7954073940 2024-04-20T22:01:29.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.307+0000 7f7951600700 1 --2- 172.21.15.142:0/3043683504 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f793806edf0 0x7f79380712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:29.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.307+0000 7f7951600700 1 -- 172.21.15.142:0/3043683504 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f794408efa0 con 0x7f7954073940 2024-04-20T22:01:29.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.308+0000 7f794b400700 1 --2- 172.21.15.142:0/3043683504 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f793806edf0 0x7f79380712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:29.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.308+0000 7f794b400700 1 --2- 172.21.15.142:0/3043683504 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f793806edf0 0x7f79380712b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f793c00b070 tx=0x7f793c0078f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:01:29.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.314+0000 7f7951600700 1 -- 172.21.15.142:0/3043683504 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f7944057c10 con 0x7f7954073940 2024-04-20T22:01:29.409 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:29 smithi164 ceph-mon[69784]: from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:01:29.409 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:29 smithi164 ceph-mon[69784]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:01:29.409 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:29.409 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:29.409 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:29 smithi164 ceph-mon[69784]: Reconfiguring mon.smithi164 (monmap changed)... 2024-04-20T22:01:29.410 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T22:01:29.410 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T22:01:29.410 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:29.410 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:29 smithi164 ceph-mon[69784]: Reconfiguring daemon mon.smithi164 on smithi164 2024-04-20T22:01:29.410 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:29 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/463703184' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:01:29.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:29 smithi142 ceph-mon[79401]: from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:01:29.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:29 smithi142 ceph-mon[79401]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:01:29.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:29.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:29.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:29 smithi142 ceph-mon[79401]: Reconfiguring mon.smithi164 (monmap changed)... 2024-04-20T22:01:29.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T22:01:29.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T22:01:29.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:29.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:29 smithi142 ceph-mon[79401]: Reconfiguring daemon mon.smithi164 on smithi164 2024-04-20T22:01:29.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:29 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/463703184' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:01:29.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.602+0000 7f795ac00700 1 -- 172.21.15.142:0/3043683504 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7954110000 con 0x7f7954073940 2024-04-20T22:01:29.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.602+0000 7f7951600700 1 -- 172.21.15.142:0/3043683504 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1898 (secure 0 0 0) 0x7f794405b2d0 con 0x7f7954073940 2024-04-20T22:01:29.603 INFO:teuthology.orchestra.run.smithi142.stdout:e12 2024-04-20T22:01:29.603 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:01:29.603 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:01:29.603 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T22:01:29.603 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:01:29.603 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T22:01:29.604 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T22:01:29.604 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 12 2024-04-20T22:01:29.604 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:01:29.604 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:01:29.604 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:51.692699+0000 2024-04-20T22:01:29.604 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T22:01:29.604 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T22:01:29.604 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T22:01:29.604 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T22:01:29.604 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T22:01:29.604 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T22:01:29.604 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T22:01:29.604 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T22:01:29.604 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T22:01:29.605 INFO:teuthology.orchestra.run.smithi142.stdout:snap_rstat 1 2024-04-20T22:01:29.605 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:01:29.605 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T22:01:29.605 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T22:01:29.605 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T22:01:29.605 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T22:01:29.605 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T22:01:29.605 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T22:01:29.605 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T22:01:29.605 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T22:01:29.605 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T22:01:29.605 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T22:01:29.605 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T22:01:29.605 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T22:01:29.606 INFO:teuthology.orchestra.run.smithi142.stdout:qdb_cluster leader: 0 members: 2024-04-20T22:01:29.606 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:01:29.606 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:01:29.606 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:01:29.606 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T22:01:29.606 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:01:29.606 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:01:29.606 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:01:29.606 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:01:29.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.605+0000 7f795ac00700 1 -- 172.21.15.142:0/3043683504 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f793806edf0 msgr2=0x7f79380712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:29.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.605+0000 7f795ac00700 1 --2- 172.21.15.142:0/3043683504 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f793806edf0 0x7f79380712b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f793c00b070 tx=0x7f793c0078f0 comp rx=0 tx=0).stop 2024-04-20T22:01:29.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.605+0000 7f795ac00700 1 -- 172.21.15.142:0/3043683504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7954073940 msgr2=0x7f795419cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:29.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.605+0000 7f795ac00700 1 --2- 172.21.15.142:0/3043683504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7954073940 0x7f795419cca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f794400c8f0 tx=0x7f794400ccb0 comp rx=0 tx=0).stop 2024-04-20T22:01:29.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.606+0000 7f795ac00700 1 -- 172.21.15.142:0/3043683504 shutdown_connections 2024-04-20T22:01:29.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.606+0000 7f795ac00700 1 --2- 172.21.15.142:0/3043683504 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f793806edf0 0x7f79380712b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:29.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.606+0000 7f795ac00700 1 --2- 172.21.15.142:0/3043683504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7954073940 0x7f795419cca0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:29.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.606+0000 7f795ac00700 1 --2- 172.21.15.142:0/3043683504 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7954074f10 0x7f795419d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:29.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.606+0000 7f795ac00700 1 -- 172.21.15.142:0/3043683504 >> 172.21.15.142:0/3043683504 conn(0x7f79540fc1c0 msgr2=0x7f7954102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:01:29.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.606+0000 7f795ac00700 1 -- 172.21.15.142:0/3043683504 shutdown_connections 2024-04-20T22:01:29.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.606+0000 7f795ac00700 1 -- 172.21.15.142:0/3043683504 wait complete. 2024-04-20T22:01:29.608 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T22:01:29.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.800+0000 7fb9c7000700 1 -- 172.21.15.142:0/2369998515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9c0103fa0 msgr2=0x7fb9c0104420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.800+0000 7fb9c7000700 1 --2- 172.21.15.142:0/2369998515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9c0103fa0 0x7fb9c0104420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009910 tx=0x7fb9ac009c20 comp rx=0 tx=0).stop 2024-04-20T22:01:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.800+0000 7fb9c7000700 1 -- 172.21.15.142:0/2369998515 shutdown_connections 2024-04-20T22:01:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.801+0000 7fb9c7000700 1 --2- 172.21.15.142:0/2369998515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9c0103fa0 0x7fb9c0104420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.801+0000 7fb9c7000700 1 --2- 172.21.15.142:0/2369998515 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9c0102e40 0x7fb9c0103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.801+0000 7fb9c7000700 1 -- 172.21.15.142:0/2369998515 >> 172.21.15.142:0/2369998515 conn(0x7fb9c00fe420 msgr2=0x7fb9c0100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:01:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.801+0000 7fb9c7000700 1 -- 172.21.15.142:0/2369998515 shutdown_connections 2024-04-20T22:01:29.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.801+0000 7fb9c7000700 1 -- 172.21.15.142:0/2369998515 wait complete. 2024-04-20T22:01:29.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.802+0000 7fb9c7000700 1 Processor -- start 2024-04-20T22:01:29.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.802+0000 7fb9c7000700 1 -- start start 2024-04-20T22:01:29.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.802+0000 7fb9c7000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9c0102e40 0x7fb9c01987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.802+0000 7fb9c7000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9c0103fa0 0x7fb9c0198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.802+0000 7fb9c7000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c0199330 con 0x7fb9c0102e40 2024-04-20T22:01:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.802+0000 7fb9c7000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c0199470 con 0x7fb9c0103fa0 2024-04-20T22:01:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.802+0000 7fb9bfe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9c0102e40 0x7fb9c01987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.802+0000 7fb9bf400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9c0103fa0 0x7fb9c0198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.802+0000 7fb9bfe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9c0102e40 0x7fb9c01987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47080/0 (socket says 172.21.15.142:47080) 2024-04-20T22:01:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.802+0000 7fb9bfe00700 1 -- 172.21.15.142:0/2564622602 learned_addr learned my addr 172.21.15.142:0/2564622602 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:01:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.803+0000 7fb9bf400700 1 -- 172.21.15.142:0/2564622602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9c0102e40 msgr2=0x7fb9c01987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.803+0000 7fb9bf400700 1 --2- 172.21.15.142:0/2564622602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9c0102e40 0x7fb9c01987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.803+0000 7fb9bf400700 1 -- 172.21.15.142:0/2564622602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac0095f0 con 0x7fb9c0103fa0 2024-04-20T22:01:29.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.803+0000 7fb9bf400700 1 --2- 172.21.15.142:0/2564622602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9c0103fa0 0x7fb9c0198d10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac006010 tx=0x7fb9ac005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:01:29.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.803+0000 7fb9bcc00700 1 -- 172.21.15.142:0/2564622602 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9ac01d070 con 0x7fb9c0103fa0 2024-04-20T22:01:29.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.803+0000 7fb9bcc00700 1 -- 172.21.15.142:0/2564622602 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9ac0052a0 con 0x7fb9c0103fa0 2024-04-20T22:01:29.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.803+0000 7fb9c7000700 1 -- 172.21.15.142:0/2564622602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c019de70 con 0x7fb9c0103fa0 2024-04-20T22:01:29.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.804+0000 7fb9bcc00700 1 -- 172.21.15.142:0/2564622602 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9ac017400 con 0x7fb9c0103fa0 2024-04-20T22:01:29.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.804+0000 7fb9c7000700 1 -- 172.21.15.142:0/2564622602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c019e3b0 con 0x7fb9c0103fa0 2024-04-20T22:01:29.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.805+0000 7fb9c7000700 1 -- 172.21.15.142:0/2564622602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c0192940 con 0x7fb9c0103fa0 2024-04-20T22:01:29.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.806+0000 7fb9bcc00700 1 -- 172.21.15.142:0/2564622602 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7fb9ac0037f0 con 0x7fb9c0103fa0 2024-04-20T22:01:29.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.807+0000 7fb9bcc00700 1 --2- 172.21.15.142:0/2564622602 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb9a406edf0 0x7fb9a40712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:29.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.807+0000 7fb9bcc00700 1 -- 172.21.15.142:0/2564622602 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb9ac090300 con 0x7fb9c0103fa0 2024-04-20T22:01:29.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.807+0000 7fb9bfe00700 1 --2- 172.21.15.142:0/2564622602 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb9a406edf0 0x7fb9a40712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:29.807 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.808+0000 7fb9bfe00700 1 --2- 172.21.15.142:0/2564622602 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb9a406edf0 0x7fb9a40712b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0009d20 tx=0x7fb9b0009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:01:29.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:29.812+0000 7fb9bcc00700 1 -- 172.21.15.142:0/2564622602 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fb9ac05ca00 con 0x7fb9c0103fa0 2024-04-20T22:01:29.840 DEBUG:teuthology.parallel:result is None 2024-04-20T22:01:29.841 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-20T22:01:29.912 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-20T22:01:29.913 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-04-20T22:01:30.014 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-04-20T22:01:30.014 DEBUG:teuthology.parallel:result is None 2024-04-20T22:01:30.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.065+0000 7fb9c7000700 1 -- 172.21.15.142:0/2564622602 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9c002ce50 con 0x7fb9a406edf0 2024-04-20T22:01:30.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.067+0000 7fb9bcc00700 1 -- 172.21.15.142:0/2564622602 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fb9c002ce50 con 0x7fb9a406edf0 2024-04-20T22:01:30.067 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:01:30.067 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T22:01:30.067 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T22:01:30.067 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T22:01:30.067 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T22:01:30.067 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr", 2024-04-20T22:01:30.068 INFO:teuthology.orchestra.run.smithi142.stdout: "mon" 2024-04-20T22:01:30.068 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T22:01:30.068 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "4/23 daemons upgraded", 2024-04-20T22:01:30.068 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading mon daemons", 2024-04-20T22:01:30.068 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T22:01:30.068 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:01:30.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.071+0000 7fb9c7000700 1 -- 172.21.15.142:0/2564622602 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb9a406edf0 msgr2=0x7fb9a40712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:30.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.071+0000 7fb9c7000700 1 --2- 172.21.15.142:0/2564622602 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb9a406edf0 0x7fb9a40712b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0009d20 tx=0x7fb9b0009260 comp rx=0 tx=0).stop 2024-04-20T22:01:30.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.071+0000 7fb9c7000700 1 -- 172.21.15.142:0/2564622602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9c0103fa0 msgr2=0x7fb9c0198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:30.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.071+0000 7fb9c7000700 1 --2- 172.21.15.142:0/2564622602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9c0103fa0 0x7fb9c0198d10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac006010 tx=0x7fb9ac005f00 comp rx=0 tx=0).stop 2024-04-20T22:01:30.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.071+0000 7fb9c7000700 1 -- 172.21.15.142:0/2564622602 shutdown_connections 2024-04-20T22:01:30.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.071+0000 7fb9c7000700 1 --2- 172.21.15.142:0/2564622602 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb9a406edf0 0x7fb9a40712b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:30.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.071+0000 7fb9c7000700 1 --2- 172.21.15.142:0/2564622602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9c0102e40 0x7fb9c01987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:30.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.071+0000 7fb9c7000700 1 --2- 172.21.15.142:0/2564622602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9c0103fa0 0x7fb9c0198d10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:30.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.071+0000 7fb9c7000700 1 -- 172.21.15.142:0/2564622602 >> 172.21.15.142:0/2564622602 conn(0x7fb9c00fe420 msgr2=0x7fb9c0107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:01:30.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.071+0000 7fb9c7000700 1 -- 172.21.15.142:0/2564622602 shutdown_connections 2024-04-20T22:01:30.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.071+0000 7fb9c7000700 1 -- 172.21.15.142:0/2564622602 wait complete. 2024-04-20T22:01:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.224+0000 7f1092a00700 1 -- 172.21.15.142:0/3482486789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f108c101e00 msgr2=0x7f108c102260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.224+0000 7f1092a00700 1 --2- 172.21.15.142:0/3482486789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f108c101e00 0x7f108c102260 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1074009910 tx=0x7f1074009c20 comp rx=0 tx=0).stop 2024-04-20T22:01:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.224+0000 7f1092a00700 1 -- 172.21.15.142:0/3482486789 shutdown_connections 2024-04-20T22:01:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.224+0000 7f1092a00700 1 --2- 172.21.15.142:0/3482486789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f108c101e00 0x7f108c102260 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.224+0000 7f1092a00700 1 --2- 172.21.15.142:0/3482486789 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f108c100c00 0x7f108c101020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.224+0000 7f1092a00700 1 -- 172.21.15.142:0/3482486789 >> 172.21.15.142:0/3482486789 conn(0x7f108c0fc1c0 msgr2=0x7f108c0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:01:30.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.224+0000 7f1092a00700 1 -- 172.21.15.142:0/3482486789 shutdown_connections 2024-04-20T22:01:30.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.224+0000 7f1092a00700 1 -- 172.21.15.142:0/3482486789 wait complete. 2024-04-20T22:01:30.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.225+0000 7f1092a00700 1 Processor -- start 2024-04-20T22:01:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.226+0000 7f1092a00700 1 -- start start 2024-04-20T22:01:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.226+0000 7f1092a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f108c100c00 0x7f108c1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.226+0000 7f1092a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f108c101e00 0x7f108c198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.226+0000 7f1092a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c199320 con 0x7f108c101e00 2024-04-20T22:01:30.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.226+0000 7f1092a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c199460 con 0x7f108c100c00 2024-04-20T22:01:30.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.226+0000 7f1083e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f108c101e00 0x7f108c198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:30.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.226+0000 7f1083e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f108c101e00 0x7f108c198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47090/0 (socket says 172.21.15.142:47090) 2024-04-20T22:01:30.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.226+0000 7f1083e00700 1 -- 172.21.15.142:0/2094818185 learned_addr learned my addr 172.21.15.142:0/2094818185 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:01:30.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.227+0000 7f108be00700 1 --2- 172.21.15.142:0/2094818185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f108c100c00 0x7f108c1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:30.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.227+0000 7f1083e00700 1 -- 172.21.15.142:0/2094818185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f108c100c00 msgr2=0x7f108c1987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:30.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.227+0000 7f1083e00700 1 --2- 172.21.15.142:0/2094818185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f108c100c00 0x7f108c1987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:30.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.227+0000 7f1083e00700 1 -- 172.21.15.142:0/2094818185 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10740095f0 con 0x7f108c101e00 2024-04-20T22:01:30.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.227+0000 7f1083e00700 1 --2- 172.21.15.142:0/2094818185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f108c101e00 0x7f108c198d00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1074006010 tx=0x7f107400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:01:30.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.228+0000 7f1089600700 1 -- 172.21.15.142:0/2094818185 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f107401d070 con 0x7f108c101e00 2024-04-20T22:01:30.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.228+0000 7f1089600700 1 -- 172.21.15.142:0/2094818185 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f107400f460 con 0x7f108c101e00 2024-04-20T22:01:30.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.228+0000 7f1092a00700 1 -- 172.21.15.142:0/2094818185 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108c19de60 con 0x7f108c101e00 2024-04-20T22:01:30.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.228+0000 7f1089600700 1 -- 172.21.15.142:0/2094818185 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1074021640 con 0x7f108c101e00 2024-04-20T22:01:30.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.228+0000 7f1092a00700 1 -- 172.21.15.142:0/2094818185 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108c19e3a0 con 0x7f108c101e00 2024-04-20T22:01:30.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.229+0000 7f1092a00700 1 -- 172.21.15.142:0/2094818185 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108c1062b0 con 0x7f108c101e00 2024-04-20T22:01:30.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.230+0000 7f1089600700 1 -- 172.21.15.142:0/2094818185 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 37) v1 ==== 92849+0+0 (secure 0 0 0) 0x7f107400fab0 con 0x7f108c101e00 2024-04-20T22:01:30.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.231+0000 7f1089600700 1 --2- 172.21.15.142:0/2094818185 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f107006ee00 0x7f10700712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:01:30.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.231+0000 7f1089600700 1 -- 172.21.15.142:0/2094818185 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1074090460 con 0x7f108c101e00 2024-04-20T22:01:30.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.231+0000 7f108be00700 1 --2- 172.21.15.142:0/2094818185 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f107006ee00 0x7f10700712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:01:30.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.232+0000 7f108be00700 1 --2- 172.21.15.142:0/2094818185 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f107006ee00 0x7f10700712c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f107c005fd0 tx=0x7f107c005dd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:01:30.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.236+0000 7f1089600700 1 -- 172.21.15.142:0/2094818185 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f107405cb80 con 0x7f108c101e00 2024-04-20T22:01:30.429 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:30 smithi164 ceph-mon[69784]: pgmap v40: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 9.3 KiB/s rd, 342 KiB/s wr, 100 op/s 2024-04-20T22:01:30.429 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:30 smithi164 ceph-mon[69784]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:01:30.429 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:01:30.429 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:30 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3043683504' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:01:30.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:30 smithi142 ceph-mon[79401]: pgmap v40: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 9.3 KiB/s rd, 342 KiB/s wr, 100 op/s 2024-04-20T22:01:30.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:30 smithi142 ceph-mon[79401]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:01:30.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:01:30.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:30 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3043683504' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:01:30.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.554+0000 7f1092a00700 1 -- 172.21.15.142:0/2094818185 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f108c062510 con 0x7f108c101e00 2024-04-20T22:01:30.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.559+0000 7f1089600700 1 -- 172.21.15.142:0/2094818185 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f107405c710 con 0x7f108c101e00 2024-04-20T22:01:30.559 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_OK 2024-04-20T22:01:30.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.563+0000 7f1092a00700 1 -- 172.21.15.142:0/2094818185 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f107006ee00 msgr2=0x7f10700712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:30.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.563+0000 7f1092a00700 1 --2- 172.21.15.142:0/2094818185 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f107006ee00 0x7f10700712c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f107c005fd0 tx=0x7f107c005dd0 comp rx=0 tx=0).stop 2024-04-20T22:01:30.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.563+0000 7f1092a00700 1 -- 172.21.15.142:0/2094818185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f108c101e00 msgr2=0x7f108c198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:01:30.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.563+0000 7f1092a00700 1 --2- 172.21.15.142:0/2094818185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f108c101e00 0x7f108c198d00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1074006010 tx=0x7f107400be20 comp rx=0 tx=0).stop 2024-04-20T22:01:30.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.563+0000 7f1092a00700 1 -- 172.21.15.142:0/2094818185 shutdown_connections 2024-04-20T22:01:30.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.563+0000 7f1092a00700 1 --2- 172.21.15.142:0/2094818185 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f107006ee00 0x7f10700712c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:30.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.563+0000 7f1092a00700 1 --2- 172.21.15.142:0/2094818185 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f108c100c00 0x7f108c1987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:30.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.563+0000 7f1092a00700 1 --2- 172.21.15.142:0/2094818185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f108c101e00 0x7f108c198d00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:01:30.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.563+0000 7f1092a00700 1 -- 172.21.15.142:0/2094818185 >> 172.21.15.142:0/2094818185 conn(0x7f108c0fc1c0 msgr2=0x7f108c1033f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:01:30.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.564+0000 7f1092a00700 1 -- 172.21.15.142:0/2094818185 shutdown_connections 2024-04-20T22:01:30.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:01:30.564+0000 7f1092a00700 1 -- 172.21.15.142:0/2094818185 wait complete. 2024-04-20T22:01:31.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:31 smithi164 ceph-mon[69784]: from='client.44133 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:01:31.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:31 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:31.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:31 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/2094818185' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:01:31.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:31 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:31.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:31 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-20T22:01:31.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:31 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:31.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:31 smithi142 ceph-mon[79401]: from='client.44133 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:01:31.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:31 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:31.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:31 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2094818185' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:01:31.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:31 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:31.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:31 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-20T22:01:31.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:31 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:32.551 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:32 smithi164 ceph-mon[69784]: pgmap v41: 65 pgs: 65 active+clean; 211 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.3 KiB/s rd, 342 KiB/s wr, 116 op/s 2024-04-20T22:01:32.551 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:32 smithi164 ceph-mon[69784]: Reconfiguring osd.3 (monmap changed)... 2024-04-20T22:01:32.551 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:32 smithi164 ceph-mon[69784]: Reconfiguring daemon osd.3 on smithi164 2024-04-20T22:01:32.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:32 smithi142 ceph-mon[79401]: pgmap v41: 65 pgs: 65 active+clean; 211 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.3 KiB/s rd, 342 KiB/s wr, 116 op/s 2024-04-20T22:01:32.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:32 smithi142 ceph-mon[79401]: Reconfiguring osd.3 (monmap changed)... 2024-04-20T22:01:32.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:32 smithi142 ceph-mon[79401]: Reconfiguring daemon osd.3 on smithi164 2024-04-20T22:01:34.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:33 smithi164 ceph-mon[69784]: pgmap v42: 65 pgs: 65 active+clean; 210 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 498 KiB/s wr, 143 op/s 2024-04-20T22:01:34.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:33 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:34.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:33 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:34.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:33 smithi164 ceph-mon[69784]: Reconfiguring osd.4 (monmap changed)... 2024-04-20T22:01:34.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:33 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-20T22:01:34.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:33 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:34.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:33 smithi164 ceph-mon[69784]: Reconfiguring daemon osd.4 on smithi164 2024-04-20T22:01:34.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:33 smithi142 ceph-mon[79401]: pgmap v42: 65 pgs: 65 active+clean; 210 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 498 KiB/s wr, 143 op/s 2024-04-20T22:01:34.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:33 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:34.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:33 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:34.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:33 smithi142 ceph-mon[79401]: Reconfiguring osd.4 (monmap changed)... 2024-04-20T22:01:34.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:33 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-20T22:01:34.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:33 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:34.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:33 smithi142 ceph-mon[79401]: Reconfiguring daemon osd.4 on smithi164 2024-04-20T22:01:36.299 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:35 smithi164 ceph-mon[69784]: pgmap v43: 65 pgs: 65 active+clean; 210 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 10 KiB/s rd, 328 KiB/s wr, 102 op/s 2024-04-20T22:01:36.299 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:35 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:36.300 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:35 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:36.300 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:35 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-20T22:01:36.300 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:35 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:36.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:35 smithi142 ceph-mon[79401]: pgmap v43: 65 pgs: 65 active+clean; 210 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 10 KiB/s rd, 328 KiB/s wr, 102 op/s 2024-04-20T22:01:36.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:35 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:36.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:35 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:36.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:35 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-20T22:01:36.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:35 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:37.370 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:36 smithi164 ceph-mon[69784]: Reconfiguring osd.5 (monmap changed)... 2024-04-20T22:01:37.371 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:36 smithi164 ceph-mon[69784]: Reconfiguring daemon osd.5 on smithi164 2024-04-20T22:01:37.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:36 smithi142 ceph-mon[79401]: Reconfiguring osd.5 (monmap changed)... 2024-04-20T22:01:37.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:36 smithi142 ceph-mon[79401]: Reconfiguring daemon osd.5 on smithi164 2024-04-20T22:01:38.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:37 smithi142 ceph-mon[79401]: pgmap v44: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 11 KiB/s rd, 335 KiB/s wr, 111 op/s 2024-04-20T22:01:38.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:37 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:38.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:37 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:38.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:37 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi164.ybvzha", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T22:01:38.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:37 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:38.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:37 smithi164 ceph-mon[69784]: pgmap v44: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 11 KiB/s rd, 335 KiB/s wr, 111 op/s 2024-04-20T22:01:38.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:37 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:38.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:37 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:38.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:37 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi164.ybvzha", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T22:01:38.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:37 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:39.101 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:39 smithi164 ceph-mon[69784]: Reconfiguring mds.cephfs.smithi164.ybvzha (monmap changed)... 2024-04-20T22:01:39.101 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:39 smithi164 ceph-mon[69784]: Reconfiguring daemon mds.cephfs.smithi164.ybvzha on smithi164 2024-04-20T22:01:39.348 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:39 smithi142 ceph-mon[79401]: Reconfiguring mds.cephfs.smithi164.ybvzha (monmap changed)... 2024-04-20T22:01:39.348 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:39 smithi142 ceph-mon[79401]: Reconfiguring daemon mds.cephfs.smithi164.ybvzha on smithi164 2024-04-20T22:01:40.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:40 smithi164 ceph-mon[69784]: pgmap v45: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 6.6 KiB/s rd, 164 KiB/s wr, 61 op/s 2024-04-20T22:01:40.382 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:40 smithi142 ceph-mon[79401]: pgmap v45: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 6.6 KiB/s rd, 164 KiB/s wr, 61 op/s 2024-04-20T22:01:41.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:41.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:41.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:41 smithi164 ceph-mon[69784]: Reconfiguring mds.cephfs.smithi164.gmmrfu (monmap changed)... 2024-04-20T22:01:41.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi164.gmmrfu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T22:01:41.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:41.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:41 smithi164 ceph-mon[69784]: Reconfiguring daemon mds.cephfs.smithi164.gmmrfu on smithi164 2024-04-20T22:01:41.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:41.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:41.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:41 smithi142 ceph-mon[79401]: Reconfiguring mds.cephfs.smithi164.gmmrfu (monmap changed)... 2024-04-20T22:01:41.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi164.gmmrfu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T22:01:41.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:41.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:41 smithi142 ceph-mon[79401]: Reconfiguring daemon mds.cephfs.smithi164.gmmrfu on smithi164 2024-04-20T22:01:42.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:42 smithi164 ceph-mon[69784]: pgmap v46: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 6.6 KiB/s rd, 164 KiB/s wr, 61 op/s 2024-04-20T22:01:42.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:42 smithi142 ceph-mon[79401]: pgmap v46: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 6.6 KiB/s rd, 164 KiB/s wr, 61 op/s 2024-04-20T22:01:43.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:43 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:43.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:43 smithi142 ceph-mon[79401]: pgmap v47: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 6.7 KiB/s rd, 164 KiB/s wr, 46 op/s 2024-04-20T22:01:43.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:43 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:43.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:43 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:01:43.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:43 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:01:43.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:43 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:01:43.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:43 smithi142 ceph-mon[79401]: Upgrade: Setting container_image for all mon 2024-04-20T22:01:43.633 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:43 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:43.633 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:43 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi142"}]: dispatch 2024-04-20T22:01:43.633 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:43 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi142"}]': finished 2024-04-20T22:01:43.633 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:43 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi164"}]: dispatch 2024-04-20T22:01:43.633 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:43 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi164"}]': finished 2024-04-20T22:01:43.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:43 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:43.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:43 smithi164 ceph-mon[69784]: pgmap v47: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 6.7 KiB/s rd, 164 KiB/s wr, 46 op/s 2024-04-20T22:01:43.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:43 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:43.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:43 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:01:43.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:43 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:01:43.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:43 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:01:43.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:43 smithi164 ceph-mon[69784]: Upgrade: Setting container_image for all mon 2024-04-20T22:01:43.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:43 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:43.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:43 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi142"}]: dispatch 2024-04-20T22:01:43.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:43 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi142"}]': finished 2024-04-20T22:01:43.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:43 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi164"}]: dispatch 2024-04-20T22:01:43.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:43 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi164"}]': finished 2024-04-20T22:01:45.755 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:45 smithi142 ceph-mon[79401]: pgmap v48: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 8.1 KiB/s wr, 9 op/s 2024-04-20T22:01:45.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:01:45.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:45 smithi142 ceph-mon[79401]: Upgrade: Updating crash.smithi142 (1/2) 2024-04-20T22:01:45.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:45.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-20T22:01:45.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:45.756 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:45 smithi142 ceph-mon[79401]: Deploying daemon crash.smithi142 on smithi142 2024-04-20T22:01:45.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:45 smithi164 ceph-mon[69784]: pgmap v48: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 8.1 KiB/s wr, 9 op/s 2024-04-20T22:01:45.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:01:45.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:45 smithi164 ceph-mon[69784]: Upgrade: Updating crash.smithi142 (1/2) 2024-04-20T22:01:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi142", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-20T22:01:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:45 smithi164 ceph-mon[69784]: Deploying daemon crash.smithi142 on smithi142 2024-04-20T22:01:47.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:47 smithi164 ceph-mon[69784]: pgmap v49: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 8.2 KiB/s wr, 9 op/s 2024-04-20T22:01:47.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:47 smithi164 ceph-mon[69784]: mgrmap e38: smithi142.zzmcfz(active, since 92s), standbys: smithi164.oejajr 2024-04-20T22:01:47.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:47 smithi142 ceph-mon[79401]: pgmap v49: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 8.2 KiB/s wr, 9 op/s 2024-04-20T22:01:47.950 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:47 smithi142 ceph-mon[79401]: mgrmap e38: smithi142.zzmcfz(active, since 92s), standbys: smithi164.oejajr 2024-04-20T22:01:49.877 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:49 smithi142 ceph-mon[79401]: pgmap v50: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 426 B/s wr, 0 op/s 2024-04-20T22:01:49.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:49 smithi164 ceph-mon[69784]: pgmap v50: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 426 B/s wr, 0 op/s 2024-04-20T22:01:51.292 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:51 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:51.292 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:51 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:51.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:51 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:51.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:51 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:52.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:52 smithi164 ceph-mon[69784]: pgmap v51: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 426 B/s wr, 0 op/s 2024-04-20T22:01:52.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:52 smithi142 ceph-mon[79401]: pgmap v51: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 426 B/s wr, 0 op/s 2024-04-20T22:01:53.463 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:53 smithi164 ceph-mon[69784]: Upgrade: Updating crash.smithi164 (2/2) 2024-04-20T22:01:53.463 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:53 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:53.463 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:53 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi164", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-20T22:01:53.463 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:53 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:53.463 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:53 smithi164 ceph-mon[69784]: Deploying daemon crash.smithi164 on smithi164 2024-04-20T22:01:53.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:53 smithi142 ceph-mon[79401]: Upgrade: Updating crash.smithi164 (2/2) 2024-04-20T22:01:53.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:53 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:53.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:53 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi164", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-20T22:01:53.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:53 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:01:53.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:53 smithi142 ceph-mon[79401]: Deploying daemon crash.smithi164 on smithi164 2024-04-20T22:01:54.365 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:54 smithi164 ceph-mon[69784]: pgmap v52: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 426 B/s wr, 0 op/s 2024-04-20T22:01:54.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:54 smithi142 ceph-mon[79401]: pgmap v52: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 85 B/s rd, 426 B/s wr, 0 op/s 2024-04-20T22:01:56.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:56 smithi164 ceph-mon[69784]: pgmap v53: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-20T22:01:56.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:56 smithi142 ceph-mon[79401]: pgmap v53: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-20T22:01:58.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:58 smithi164 ceph-mon[69784]: pgmap v54: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-20T22:01:58.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:58 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:58.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:58 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:58.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:01:58 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:01:58.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:58 smithi142 ceph-mon[79401]: pgmap v54: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-20T22:01:58.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:58 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:58.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:58 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:01:58.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:01:58 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:02:00.569 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:00 smithi164 ceph-mon[69784]: pgmap v55: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:00.569 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:00 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:02:00.569 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:00 smithi142 ceph-mon[79401]: pgmap v55: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:00.570 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:00 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:02:00.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.726+0000 7f62c0400700 1 -- 172.21.15.142:0/2002267112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62b8101e30 msgr2=0x7f62b8102290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:00.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.726+0000 7f62c0400700 1 --2- 172.21.15.142:0/2002267112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62b8101e30 0x7f62b8102290 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009910 tx=0x7f62a4009c20 comp rx=0 tx=0).stop 2024-04-20T22:02:00.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.726+0000 7f62c0400700 1 -- 172.21.15.142:0/2002267112 shutdown_connections 2024-04-20T22:02:00.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.726+0000 7f62c0400700 1 --2- 172.21.15.142:0/2002267112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62b8101e30 0x7f62b8102290 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:00.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.726+0000 7f62c0400700 1 --2- 172.21.15.142:0/2002267112 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62b8100c30 0x7f62b8101050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:00.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.726+0000 7f62c0400700 1 -- 172.21.15.142:0/2002267112 >> 172.21.15.142:0/2002267112 conn(0x7f62b80fc1f0 msgr2=0x7f62b80fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:00.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.726+0000 7f62c0400700 1 -- 172.21.15.142:0/2002267112 shutdown_connections 2024-04-20T22:02:00.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.726+0000 7f62c0400700 1 -- 172.21.15.142:0/2002267112 wait complete. 2024-04-20T22:02:00.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.728+0000 7f62c0400700 1 Processor -- start 2024-04-20T22:02:00.730 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.728+0000 7f62c0400700 1 -- start start 2024-04-20T22:02:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.728+0000 7f62c0400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62b8100c30 0x7f62b8198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.728+0000 7f62c0400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62b8101e30 0x7f62b8198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.728+0000 7f62c0400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b81993b0 con 0x7f62b8100c30 2024-04-20T22:02:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.728+0000 7f62c0400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b81994f0 con 0x7f62b8101e30 2024-04-20T22:02:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.728+0000 7f62bda00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62b8100c30 0x7f62b8198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.729+0000 7f62bda00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62b8100c30 0x7f62b8198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56664/0 (socket says 172.21.15.142:56664) 2024-04-20T22:02:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.729+0000 7f62bda00700 1 -- 172.21.15.142:0/3757337786 learned_addr learned my addr 172.21.15.142:0/3757337786 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:02:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.729+0000 7f62bd000700 1 --2- 172.21.15.142:0/3757337786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62b8101e30 0x7f62b8198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.729+0000 7f62bda00700 1 -- 172.21.15.142:0/3757337786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62b8101e30 msgr2=0x7f62b8198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.729+0000 7f62bda00700 1 --2- 172.21.15.142:0/3757337786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62b8101e30 0x7f62b8198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.729+0000 7f62bda00700 1 -- 172.21.15.142:0/3757337786 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a40095f0 con 0x7f62b8100c30 2024-04-20T22:02:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.729+0000 7f62bd000700 1 --2- 172.21.15.142:0/3757337786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62b8101e30 0x7f62b8198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:02:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.729+0000 7f62bda00700 1 --2- 172.21.15.142:0/3757337786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62b8100c30 0x7f62b8198850 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00c8f0 tx=0x7f62ac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.730+0000 7f62b6000700 1 -- 172.21.15.142:0/3757337786 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62ac007a70 con 0x7f62b8100c30 2024-04-20T22:02:00.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.730+0000 7f62b6000700 1 -- 172.21.15.142:0/3757337786 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f62ac007bd0 con 0x7f62b8100c30 2024-04-20T22:02:00.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.730+0000 7f62c0400700 1 -- 172.21.15.142:0/3757337786 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b819df50 con 0x7f62b8100c30 2024-04-20T22:02:00.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.730+0000 7f62b6000700 1 -- 172.21.15.142:0/3757337786 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62ac018630 con 0x7f62b8100c30 2024-04-20T22:02:00.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.730+0000 7f62c0400700 1 -- 172.21.15.142:0/3757337786 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b819e490 con 0x7f62b8100c30 2024-04-20T22:02:00.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.731+0000 7f62c0400700 1 -- 172.21.15.142:0/3757337786 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b8106800 con 0x7f62b8100c30 2024-04-20T22:02:00.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.732+0000 7f62b6000700 1 -- 172.21.15.142:0/3757337786 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f62ac00f450 con 0x7f62b8100c30 2024-04-20T22:02:00.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.733+0000 7f62b6000700 1 --2- 172.21.15.142:0/3757337786 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f62a006ecd0 0x7f62a0071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:00.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.733+0000 7f62b6000700 1 -- 172.21.15.142:0/3757337786 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f62ac08eeb0 con 0x7f62b8100c30 2024-04-20T22:02:00.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.734+0000 7f62bd000700 1 --2- 172.21.15.142:0/3757337786 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f62a006ecd0 0x7f62a0071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:00.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.734+0000 7f62bd000700 1 --2- 172.21.15.142:0/3757337786 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f62a006ecd0 0x7f62a0071190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f62a400b5c0 tx=0x7f62a4005160 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:00.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.739+0000 7f62b6000700 1 -- 172.21.15.142:0/3757337786 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f62ac05b880 con 0x7f62b8100c30 2024-04-20T22:02:00.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.984+0000 7f62c0400700 1 -- 172.21.15.142:0/3757337786 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f62b802ceb0 con 0x7f62a006ecd0 2024-04-20T22:02:00.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.986+0000 7f62b6000700 1 -- 172.21.15.142:0/3757337786 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f62b802ceb0 con 0x7f62a006ecd0 2024-04-20T22:02:00.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.989+0000 7f62c0400700 1 -- 172.21.15.142:0/3757337786 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f62a006ecd0 msgr2=0x7f62a0071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:00.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.989+0000 7f62c0400700 1 --2- 172.21.15.142:0/3757337786 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f62a006ecd0 0x7f62a0071190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f62a400b5c0 tx=0x7f62a4005160 comp rx=0 tx=0).stop 2024-04-20T22:02:00.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.989+0000 7f62c0400700 1 -- 172.21.15.142:0/3757337786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62b8100c30 msgr2=0x7f62b8198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:00.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.989+0000 7f62c0400700 1 --2- 172.21.15.142:0/3757337786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62b8100c30 0x7f62b8198850 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00c8f0 tx=0x7f62ac00ccb0 comp rx=0 tx=0).stop 2024-04-20T22:02:00.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.989+0000 7f62c0400700 1 -- 172.21.15.142:0/3757337786 shutdown_connections 2024-04-20T22:02:00.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.989+0000 7f62c0400700 1 --2- 172.21.15.142:0/3757337786 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f62a006ecd0 0x7f62a0071190 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:00.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.989+0000 7f62c0400700 1 --2- 172.21.15.142:0/3757337786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62b8100c30 0x7f62b8198850 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:00.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.989+0000 7f62c0400700 1 --2- 172.21.15.142:0/3757337786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f62b8101e30 0x7f62b8198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:00.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.989+0000 7f62c0400700 1 -- 172.21.15.142:0/3757337786 >> 172.21.15.142:0/3757337786 conn(0x7f62b80fc1f0 msgr2=0x7f62b8073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:00.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.989+0000 7f62c0400700 1 -- 172.21.15.142:0/3757337786 shutdown_connections 2024-04-20T22:02:00.991 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:00.989+0000 7f62c0400700 1 -- 172.21.15.142:0/3757337786 wait complete. 2024-04-20T22:02:01.006 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T22:02:01.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.146+0000 7f8a84c00700 1 -- 172.21.15.142:0/1983288974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a800ff4d0 msgr2=0x7f8a800ff8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:01.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.146+0000 7f8a84c00700 1 --2- 172.21.15.142:0/1983288974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a800ff4d0 0x7f8a800ff8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009910 tx=0x7f8a70009c20 comp rx=0 tx=0).stop 2024-04-20T22:02:01.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.146+0000 7f8a84c00700 1 -- 172.21.15.142:0/1983288974 shutdown_connections 2024-04-20T22:02:01.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.146+0000 7f8a84c00700 1 --2- 172.21.15.142:0/1983288974 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a800ffe30 0x7f8a801002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:01.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.146+0000 7f8a84c00700 1 --2- 172.21.15.142:0/1983288974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a800ff4d0 0x7f8a800ff8f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:01.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.146+0000 7f8a84c00700 1 -- 172.21.15.142:0/1983288974 >> 172.21.15.142:0/1983288974 conn(0x7f8a800fb0d0 msgr2=0x7f8a800fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:01.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.146+0000 7f8a84c00700 1 -- 172.21.15.142:0/1983288974 shutdown_connections 2024-04-20T22:02:01.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.146+0000 7f8a84c00700 1 -- 172.21.15.142:0/1983288974 wait complete. 2024-04-20T22:02:01.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.147+0000 7f8a84c00700 1 Processor -- start 2024-04-20T22:02:01.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.148+0000 7f8a84c00700 1 -- start start 2024-04-20T22:02:01.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.148+0000 7f8a84c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a800ff4d0 0x7f8a80104fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:01.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.148+0000 7f8a84c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a800ffe30 0x7f8a801054f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:01.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.148+0000 7f8a84c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a80101b40 con 0x7f8a800ff4d0 2024-04-20T22:02:01.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.148+0000 7f8a84c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a80101c80 con 0x7f8a800ffe30 2024-04-20T22:02:01.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.149+0000 7f8a7de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a800ff4d0 0x7f8a80104fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:01.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.149+0000 7f8a7de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a800ff4d0 0x7f8a80104fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56684/0 (socket says 172.21.15.142:56684) 2024-04-20T22:02:01.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.149+0000 7f8a7de00700 1 -- 172.21.15.142:0/1293775233 learned_addr learned my addr 172.21.15.142:0/1293775233 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:02:01.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.149+0000 7f8a7d400700 1 --2- 172.21.15.142:0/1293775233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a800ffe30 0x7f8a801054f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:01.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.149+0000 7f8a7de00700 1 -- 172.21.15.142:0/1293775233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a800ffe30 msgr2=0x7f8a801054f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:01.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.149+0000 7f8a7de00700 1 --2- 172.21.15.142:0/1293775233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a800ffe30 0x7f8a801054f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:01.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.149+0000 7f8a7de00700 1 -- 172.21.15.142:0/1293775233 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a700095f0 con 0x7f8a800ff4d0 2024-04-20T22:02:01.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.150+0000 7f8a7de00700 1 --2- 172.21.15.142:0/1293775233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a800ff4d0 0x7f8a80104fb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000bd70 tx=0x7f8a7000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:01.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.150+0000 7f8a76a00700 1 -- 172.21.15.142:0/1293775233 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a7001d070 con 0x7f8a800ff4d0 2024-04-20T22:02:01.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.150+0000 7f8a76a00700 1 -- 172.21.15.142:0/1293775233 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a70005dc0 con 0x7f8a800ff4d0 2024-04-20T22:02:01.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.150+0000 7f8a84c00700 1 -- 172.21.15.142:0/1293775233 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a80101f00 con 0x7f8a800ff4d0 2024-04-20T22:02:01.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.150+0000 7f8a84c00700 1 -- 172.21.15.142:0/1293775233 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a80102470 con 0x7f8a800ff4d0 2024-04-20T22:02:01.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.150+0000 7f8a76a00700 1 -- 172.21.15.142:0/1293775233 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a70021410 con 0x7f8a800ff4d0 2024-04-20T22:02:01.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.152+0000 7f8a84c00700 1 -- 172.21.15.142:0/1293775233 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a80192970 con 0x7f8a800ff4d0 2024-04-20T22:02:01.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.152+0000 7f8a76a00700 1 -- 172.21.15.142:0/1293775233 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f8a7000f820 con 0x7f8a800ff4d0 2024-04-20T22:02:01.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.153+0000 7f8a76a00700 1 --2- 172.21.15.142:0/1293775233 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8a6406ecc0 0x7f8a64071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:01.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.153+0000 7f8a76a00700 1 -- 172.21.15.142:0/1293775233 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8a700900a0 con 0x7f8a800ff4d0 2024-04-20T22:02:01.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.154+0000 7f8a7d400700 1 --2- 172.21.15.142:0/1293775233 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8a6406ecc0 0x7f8a64071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:01.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.154+0000 7f8a7d400700 1 --2- 172.21.15.142:0/1293775233 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8a6406ecc0 0x7f8a64071180 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c005950 tx=0x7f8a6c0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:01.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.161+0000 7f8a76a00700 1 -- 172.21.15.142:0/1293775233 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f8a7005c9c0 con 0x7f8a800ff4d0 2024-04-20T22:02:01.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.415+0000 7f8a84c00700 1 -- 172.21.15.142:0/1293775233 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a8010bc10 con 0x7f8a6406ecc0 2024-04-20T22:02:01.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.417+0000 7f8a76a00700 1 -- 172.21.15.142:0/1293775233 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f8a8010bc10 con 0x7f8a6406ecc0 2024-04-20T22:02:01.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.419+0000 7f8a84c00700 1 -- 172.21.15.142:0/1293775233 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8a6406ecc0 msgr2=0x7f8a64071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:01.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.419+0000 7f8a84c00700 1 --2- 172.21.15.142:0/1293775233 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8a6406ecc0 0x7f8a64071180 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c005950 tx=0x7f8a6c0058e0 comp rx=0 tx=0).stop 2024-04-20T22:02:01.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.419+0000 7f8a84c00700 1 -- 172.21.15.142:0/1293775233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a800ff4d0 msgr2=0x7f8a80104fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:01.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.419+0000 7f8a84c00700 1 --2- 172.21.15.142:0/1293775233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a800ff4d0 0x7f8a80104fb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000bd70 tx=0x7f8a7000be50 comp rx=0 tx=0).stop 2024-04-20T22:02:01.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.419+0000 7f8a84c00700 1 -- 172.21.15.142:0/1293775233 shutdown_connections 2024-04-20T22:02:01.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.419+0000 7f8a84c00700 1 --2- 172.21.15.142:0/1293775233 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8a6406ecc0 0x7f8a64071180 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:01.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.419+0000 7f8a84c00700 1 --2- 172.21.15.142:0/1293775233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a800ff4d0 0x7f8a80104fb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:01.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.419+0000 7f8a84c00700 1 --2- 172.21.15.142:0/1293775233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a800ffe30 0x7f8a801054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:01.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.419+0000 7f8a84c00700 1 -- 172.21.15.142:0/1293775233 >> 172.21.15.142:0/1293775233 conn(0x7f8a800fb0d0 msgr2=0x7f8a80107f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:01.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.419+0000 7f8a84c00700 1 -- 172.21.15.142:0/1293775233 shutdown_connections 2024-04-20T22:02:01.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.420+0000 7f8a84c00700 1 -- 172.21.15.142:0/1293775233 wait complete. 2024-04-20T22:02:01.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.564+0000 7fc506800700 1 -- 172.21.15.142:0/1477829474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc500101c40 msgr2=0x7fc5001020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:01.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.564+0000 7fc506800700 1 --2- 172.21.15.142:0/1477829474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc500101c40 0x7fc5001020a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009910 tx=0x7fc4ec009c20 comp rx=0 tx=0).stop 2024-04-20T22:02:01.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.565+0000 7fc506800700 1 -- 172.21.15.142:0/1477829474 shutdown_connections 2024-04-20T22:02:01.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.565+0000 7fc506800700 1 --2- 172.21.15.142:0/1477829474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc500101c40 0x7fc5001020a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:01.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.565+0000 7fc506800700 1 --2- 172.21.15.142:0/1477829474 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc500100a40 0x7fc500100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:01.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.565+0000 7fc506800700 1 -- 172.21.15.142:0/1477829474 >> 172.21.15.142:0/1477829474 conn(0x7fc5000fc000 msgr2=0x7fc5000fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:01.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.565+0000 7fc506800700 1 -- 172.21.15.142:0/1477829474 shutdown_connections 2024-04-20T22:02:01.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.565+0000 7fc506800700 1 -- 172.21.15.142:0/1477829474 wait complete. 2024-04-20T22:02:01.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.567+0000 7fc506800700 1 Processor -- start 2024-04-20T22:02:01.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.567+0000 7fc506800700 1 -- start start 2024-04-20T22:02:01.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.567+0000 7fc506800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc500100a40 0x7fc500198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:01.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.567+0000 7fc506800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc500101c40 0x7fc500198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:01.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.567+0000 7fc506800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5001991e0 con 0x7fc500101c40 2024-04-20T22:02:01.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.567+0000 7fc506800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc500199320 con 0x7fc500100a40 2024-04-20T22:02:01.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.567+0000 7fc504a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc500101c40 0x7fc500198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:01.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.567+0000 7fc504a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc500101c40 0x7fc500198bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56698/0 (socket says 172.21.15.142:56698) 2024-04-20T22:02:01.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.567+0000 7fc504a00700 1 -- 172.21.15.142:0/2877361447 learned_addr learned my addr 172.21.15.142:0/2877361447 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:02:01.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.568+0000 7fc504a00700 1 -- 172.21.15.142:0/2877361447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc500100a40 msgr2=0x7fc500198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:01.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.568+0000 7fc505400700 1 --2- 172.21.15.142:0/2877361447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc500100a40 0x7fc500198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:01.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.568+0000 7fc504a00700 1 --2- 172.21.15.142:0/2877361447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc500100a40 0x7fc500198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:01.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.568+0000 7fc504a00700 1 -- 172.21.15.142:0/2877361447 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec0095f0 con 0x7fc500101c40 2024-04-20T22:02:01.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.568+0000 7fc505400700 1 --2- 172.21.15.142:0/2877361447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc500100a40 0x7fc500198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:02:01.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.568+0000 7fc504a00700 1 --2- 172.21.15.142:0/2877361447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc500101c40 0x7fc500198bc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00bd70 tx=0x7fc4ec00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:01.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.568+0000 7fc4fe000700 1 -- 172.21.15.142:0/2877361447 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4ec01d070 con 0x7fc500101c40 2024-04-20T22:02:01.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.568+0000 7fc4fe000700 1 -- 172.21.15.142:0/2877361447 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc4ec00f460 con 0x7fc500101c40 2024-04-20T22:02:01.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.569+0000 7fc4fe000700 1 -- 172.21.15.142:0/2877361447 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4ec021620 con 0x7fc500101c40 2024-04-20T22:02:01.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.569+0000 7fc506800700 1 -- 172.21.15.142:0/2877361447 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc50019dcd0 con 0x7fc500101c40 2024-04-20T22:02:01.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.569+0000 7fc506800700 1 -- 172.21.15.142:0/2877361447 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc50019e1f0 con 0x7fc500101c40 2024-04-20T22:02:01.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.570+0000 7fc506800700 1 -- 172.21.15.142:0/2877361447 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc500106610 con 0x7fc500101c40 2024-04-20T22:02:01.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.571+0000 7fc4fe000700 1 -- 172.21.15.142:0/2877361447 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fc4ec00fa70 con 0x7fc500101c40 2024-04-20T22:02:01.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.572+0000 7fc4fe000700 1 --2- 172.21.15.142:0/2877361447 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc4e806ecc0 0x7fc4e8071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:01.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.572+0000 7fc4fe000700 1 -- 172.21.15.142:0/2877361447 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc4ec0901a0 con 0x7fc500101c40 2024-04-20T22:02:01.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.573+0000 7fc505400700 1 --2- 172.21.15.142:0/2877361447 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc4e806ecc0 0x7fc4e8071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:01.574 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.574+0000 7fc505400700 1 --2- 172.21.15.142:0/2877361447 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc4e806ecc0 0x7fc4e8071180 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4005fd0 tx=0x7fc4f4005dc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:01.583 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.583+0000 7fc4fe000700 1 -- 172.21.15.142:0/2877361447 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fc4ec05cac0 con 0x7fc500101c40 2024-04-20T22:02:01.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.826+0000 7fc506800700 1 -- 172.21.15.142:0/2877361447 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc50002ce50 con 0x7fc4e806ecc0 2024-04-20T22:02:01.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.848+0000 7fc4fe000700 1 -- 172.21.15.142:0/2877361447 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fc50002ce50 con 0x7fc4e806ecc0 2024-04-20T22:02:01.849 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:02:01.850 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (12m) 96s ago 14m 13.6M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T22:02:01.850 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (14m) 96s ago 14m 8070k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T22:02:01.850 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (13m) 75s ago 13m 7688k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T22:02:01.850 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 starting - - - - 2024-04-20T22:02:01.850 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 starting - - - - 2024-04-20T22:02:01.850 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (12m) 96s ago 14m 77.1M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T22:02:01.850 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (7m) 96s ago 7m 213M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 b68e279d7945 2024-04-20T22:02:01.850 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (7m) 96s ago 7m 15.0M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T22:02:01.850 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (7m) 75s ago 7m 15.2M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T22:02:01.850 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (7m) 75s ago 7m 15.6M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T22:02:01.850 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (3m) 96s ago 16m 478M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:02:01.850 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (2m) 75s ago 13m 449M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:02:01.850 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (2m) 96s ago 16m 32.0M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 af10a542c918 2024-04-20T22:02:01.851 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (82s) 75s ago 13m 22.5M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 133512694d46 2024-04-20T22:02:01.851 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (14m) 96s ago 14m 7730k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T22:02:01.851 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (13m) 75s ago 13m 8158k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T22:02:01.851 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (12m) 96s ago 12m 206M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4361ae428e0d 2024-04-20T22:02:01.851 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (11m) 96s ago 11m 213M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 dd7e7cf8e8e1 2024-04-20T22:02:01.851 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (10m) 96s ago 10m 188M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 8e9165365127 2024-04-20T22:02:01.851 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (10m) 75s ago 10m 277M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c081911f56ab 2024-04-20T22:02:01.851 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (9m) 75s ago 9m 241M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 39e09d63d44f 2024-04-20T22:02:01.851 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (9m) 75s ago 9m 220M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4f36124aeb0d 2024-04-20T22:02:01.851 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (2m) 96s ago 14m 55.4M - 2.43.0 a07b618ecd1d 46b76c20eae5 2024-04-20T22:02:01.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.851+0000 7fc506800700 1 -- 172.21.15.142:0/2877361447 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc4e806ecc0 msgr2=0x7fc4e8071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:01.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.851+0000 7fc506800700 1 --2- 172.21.15.142:0/2877361447 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc4e806ecc0 0x7fc4e8071180 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4005fd0 tx=0x7fc4f4005dc0 comp rx=0 tx=0).stop 2024-04-20T22:02:01.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.851+0000 7fc506800700 1 -- 172.21.15.142:0/2877361447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc500101c40 msgr2=0x7fc500198bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:01.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.851+0000 7fc506800700 1 --2- 172.21.15.142:0/2877361447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc500101c40 0x7fc500198bc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00bd70 tx=0x7fc4ec00be50 comp rx=0 tx=0).stop 2024-04-20T22:02:01.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.851+0000 7fc506800700 1 -- 172.21.15.142:0/2877361447 shutdown_connections 2024-04-20T22:02:01.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.851+0000 7fc506800700 1 --2- 172.21.15.142:0/2877361447 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc4e806ecc0 0x7fc4e8071180 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:01.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.851+0000 7fc506800700 1 --2- 172.21.15.142:0/2877361447 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc500100a40 0x7fc500198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:01.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.851+0000 7fc506800700 1 --2- 172.21.15.142:0/2877361447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc500101c40 0x7fc500198bc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:01.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.851+0000 7fc506800700 1 -- 172.21.15.142:0/2877361447 >> 172.21.15.142:0/2877361447 conn(0x7fc5000fc000 msgr2=0x7fc500073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:01.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.852+0000 7fc506800700 1 -- 172.21.15.142:0/2877361447 shutdown_connections 2024-04-20T22:02:01.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:01.852+0000 7fc506800700 1 -- 172.21.15.142:0/2877361447 wait complete. 2024-04-20T22:02:02.008 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.008+0000 7fdac2200700 1 -- 172.21.15.142:0/2007711811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdabc074f10 msgr2=0x7fdabc073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:02.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.008+0000 7fdac2200700 1 --2- 172.21.15.142:0/2007711811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdabc074f10 0x7fdabc073370 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00b0a0 tx=0x7fdaac00b3b0 comp rx=0 tx=0).stop 2024-04-20T22:02:02.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.008+0000 7fdac2200700 1 -- 172.21.15.142:0/2007711811 shutdown_connections 2024-04-20T22:02:02.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.008+0000 7fdac2200700 1 --2- 172.21.15.142:0/2007711811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdabc073940 0x7fdabc073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:02.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.008+0000 7fdac2200700 1 --2- 172.21.15.142:0/2007711811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdabc074f10 0x7fdabc073370 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:02.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.008+0000 7fdac2200700 1 -- 172.21.15.142:0/2007711811 >> 172.21.15.142:0/2007711811 conn(0x7fdabc0fc1c0 msgr2=0x7fdabc0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:02.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.008+0000 7fdac2200700 1 -- 172.21.15.142:0/2007711811 shutdown_connections 2024-04-20T22:02:02.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.008+0000 7fdac2200700 1 -- 172.21.15.142:0/2007711811 wait complete. 2024-04-20T22:02:02.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.009+0000 7fdac2200700 1 Processor -- start 2024-04-20T22:02:02.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.010+0000 7fdac2200700 1 -- start start 2024-04-20T22:02:02.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.010+0000 7fdac2200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdabc073940 0x7fdabc19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:02.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.010+0000 7fdac2200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdabc074f10 0x7fdabc19d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:02.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.010+0000 7fdac2200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc19d7f0 con 0x7fdabc074f10 2024-04-20T22:02:02.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.010+0000 7fdac2200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc1a21b0 con 0x7fdabc073940 2024-04-20T22:02:02.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.011+0000 7fdab2a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdabc074f10 0x7fdabc19d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:02.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.011+0000 7fdabb400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdabc073940 0x7fdabc19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:02.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.011+0000 7fdab2a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdabc074f10 0x7fdabc19d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56714/0 (socket says 172.21.15.142:56714) 2024-04-20T22:02:02.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.011+0000 7fdab2a00700 1 -- 172.21.15.142:0/1055163563 learned_addr learned my addr 172.21.15.142:0/1055163563 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:02:02.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.011+0000 7fdab2a00700 1 -- 172.21.15.142:0/1055163563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdabc073940 msgr2=0x7fdabc19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:02.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.011+0000 7fdab2a00700 1 --2- 172.21.15.142:0/1055163563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdabc073940 0x7fdabc19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:02.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.011+0000 7fdab2a00700 1 -- 172.21.15.142:0/1055163563 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac009d00 con 0x7fdabc074f10 2024-04-20T22:02:02.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.011+0000 7fdabb400700 1 --2- 172.21.15.142:0/1055163563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdabc073940 0x7fdabc19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T22:02:02.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.012+0000 7fdab2a00700 1 --2- 172.21.15.142:0/1055163563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdabc074f10 0x7fdabc19d1d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400d900 tx=0x7fdaa400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:02.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.012+0000 7fdab8c00700 1 -- 172.21.15.142:0/1055163563 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaa40041f0 con 0x7fdabc074f10 2024-04-20T22:02:02.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.012+0000 7fdab8c00700 1 -- 172.21.15.142:0/1055163563 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdaa4004350 con 0x7fdabc074f10 2024-04-20T22:02:02.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.012+0000 7fdab8c00700 1 -- 172.21.15.142:0/1055163563 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaa4003cf0 con 0x7fdabc074f10 2024-04-20T22:02:02.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.012+0000 7fdac2200700 1 -- 172.21.15.142:0/1055163563 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdabc1a23b0 con 0x7fdabc074f10 2024-04-20T22:02:02.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.013+0000 7fdac2200700 1 -- 172.21.15.142:0/1055163563 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdabc1a2950 con 0x7fdabc074f10 2024-04-20T22:02:02.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.014+0000 7fdac2200700 1 -- 172.21.15.142:0/1055163563 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdabc196d90 con 0x7fdabc074f10 2024-04-20T22:02:02.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.015+0000 7fdab8c00700 1 -- 172.21.15.142:0/1055163563 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fdaa4009730 con 0x7fdabc074f10 2024-04-20T22:02:02.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.016+0000 7fdab8c00700 1 --2- 172.21.15.142:0/1055163563 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdaa006ecc0 0x7fdaa0071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:02.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.017+0000 7fdab8c00700 1 -- 172.21.15.142:0/1055163563 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdaa408eca0 con 0x7fdabc074f10 2024-04-20T22:02:02.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.017+0000 7fdabb400700 1 --2- 172.21.15.142:0/1055163563 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdaa006ecc0 0x7fdaa0071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:02.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.018+0000 7fdabb400700 1 --2- 172.21.15.142:0/1055163563 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdaa006ecc0 0x7fdaa0071180 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdabc19e120 tx=0x7fdaac007910 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:02.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.021+0000 7fdab8c00700 1 -- 172.21.15.142:0/1055163563 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fdaa4057a90 con 0x7fdabc074f10 2024-04-20T22:02:02.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.360+0000 7fdac2200700 1 -- 172.21.15.142:0/1055163563 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdabc062510 con 0x7fdabc074f10 2024-04-20T22:02:02.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.362+0000 7fdab8c00700 1 -- 172.21.15.142:0/1055163563 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7fdaa405b150 con 0x7fdabc074f10 2024-04-20T22:02:02.362 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:02:02.363 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:02:02.363 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:02:02.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:02:02.363 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:02:02.363 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:02:02.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:02:02.363 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:02:02.363 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 6 2024-04-20T22:02:02.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:02:02.363 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:02:02.363 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4 2024-04-20T22:02:02.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:02:02.363 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:02:02.363 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 10, 2024-04-20T22:02:02.364 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 4 2024-04-20T22:02:02.364 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:02:02.364 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:02:02.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.364+0000 7fdac2200700 1 -- 172.21.15.142:0/1055163563 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdaa006ecc0 msgr2=0x7fdaa0071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:02.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.364+0000 7fdac2200700 1 --2- 172.21.15.142:0/1055163563 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdaa006ecc0 0x7fdaa0071180 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdabc19e120 tx=0x7fdaac007910 comp rx=0 tx=0).stop 2024-04-20T22:02:02.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.364+0000 7fdac2200700 1 -- 172.21.15.142:0/1055163563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdabc074f10 msgr2=0x7fdabc19d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:02.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.364+0000 7fdac2200700 1 --2- 172.21.15.142:0/1055163563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdabc074f10 0x7fdabc19d1d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400d900 tx=0x7fdaa400dc10 comp rx=0 tx=0).stop 2024-04-20T22:02:02.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.365+0000 7fdac2200700 1 -- 172.21.15.142:0/1055163563 shutdown_connections 2024-04-20T22:02:02.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.365+0000 7fdac2200700 1 --2- 172.21.15.142:0/1055163563 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdaa006ecc0 0x7fdaa0071180 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:02.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.365+0000 7fdac2200700 1 --2- 172.21.15.142:0/1055163563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdabc073940 0x7fdabc19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:02.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.365+0000 7fdac2200700 1 --2- 172.21.15.142:0/1055163563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdabc074f10 0x7fdabc19d1d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:02.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.365+0000 7fdac2200700 1 -- 172.21.15.142:0/1055163563 >> 172.21.15.142:0/1055163563 conn(0x7fdabc0fc1c0 msgr2=0x7fdabc102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:02.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.365+0000 7fdac2200700 1 -- 172.21.15.142:0/1055163563 shutdown_connections 2024-04-20T22:02:02.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.365+0000 7fdac2200700 1 -- 172.21.15.142:0/1055163563 wait complete. 2024-04-20T22:02:02.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.513+0000 7f635e600700 1 -- 172.21.15.142:0/3353643791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63580ff4d0 msgr2=0x7f63580ff8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:02.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.513+0000 7f635e600700 1 --2- 172.21.15.142:0/3353643791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63580ff4d0 0x7f63580ff8f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6348009910 tx=0x7f6348009c20 comp rx=0 tx=0).stop 2024-04-20T22:02:02.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.513+0000 7f635e600700 1 -- 172.21.15.142:0/3353643791 shutdown_connections 2024-04-20T22:02:02.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.513+0000 7f635e600700 1 --2- 172.21.15.142:0/3353643791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63580ffe30 0x7f63581002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:02.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.513+0000 7f635e600700 1 --2- 172.21.15.142:0/3353643791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63580ff4d0 0x7f63580ff8f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:02.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.513+0000 7f635e600700 1 -- 172.21.15.142:0/3353643791 >> 172.21.15.142:0/3353643791 conn(0x7f63580fb0d0 msgr2=0x7f63580fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:02.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.513+0000 7f635e600700 1 -- 172.21.15.142:0/3353643791 shutdown_connections 2024-04-20T22:02:02.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.513+0000 7f635e600700 1 -- 172.21.15.142:0/3353643791 wait complete. 2024-04-20T22:02:02.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.514+0000 7f635e600700 1 Processor -- start 2024-04-20T22:02:02.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.515+0000 7f635e600700 1 -- start start 2024-04-20T22:02:02.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.515+0000 7f635e600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63580ff4d0 0x7f6358198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:02.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.515+0000 7f635e600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63580ffe30 0x7f6358198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:02.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.515+0000 7f635e600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63581993a0 con 0x7f63580ffe30 2024-04-20T22:02:02.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.515+0000 7f635e600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63581994e0 con 0x7f63580ff4d0 2024-04-20T22:02:02.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.515+0000 7f6356a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63580ffe30 0x7f6358198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:02.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.515+0000 7f6356a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63580ffe30 0x7f6358198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56746/0 (socket says 172.21.15.142:56746) 2024-04-20T22:02:02.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.515+0000 7f6356a00700 1 -- 172.21.15.142:0/4159011018 learned_addr learned my addr 172.21.15.142:0/4159011018 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:02:02.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.515+0000 7f6357400700 1 --2- 172.21.15.142:0/4159011018 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63580ff4d0 0x7f6358198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:02.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.516+0000 7f6356a00700 1 -- 172.21.15.142:0/4159011018 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63580ff4d0 msgr2=0x7f6358198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:02.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.516+0000 7f6356a00700 1 --2- 172.21.15.142:0/4159011018 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63580ff4d0 0x7f6358198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:02.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.516+0000 7f6356a00700 1 -- 172.21.15.142:0/4159011018 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63480095f0 con 0x7f63580ffe30 2024-04-20T22:02:02.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.516+0000 7f6356a00700 1 --2- 172.21.15.142:0/4159011018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63580ffe30 0x7f6358198d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f634400e920 tx=0x7f634400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:02.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.516+0000 7f634fe00700 1 -- 172.21.15.142:0/4159011018 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f634400c9d0 con 0x7f63580ffe30 2024-04-20T22:02:02.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.516+0000 7f634fe00700 1 -- 172.21.15.142:0/4159011018 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6344010430 con 0x7f63580ffe30 2024-04-20T22:02:02.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.516+0000 7f635e600700 1 -- 172.21.15.142:0/4159011018 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f635819def0 con 0x7f63580ffe30 2024-04-20T22:02:02.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.516+0000 7f634fe00700 1 -- 172.21.15.142:0/4159011018 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6344018630 con 0x7f63580ffe30 2024-04-20T22:02:02.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.516+0000 7f635e600700 1 -- 172.21.15.142:0/4159011018 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f635819e490 con 0x7f63580ffe30 2024-04-20T22:02:02.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.518+0000 7f635e600700 1 -- 172.21.15.142:0/4159011018 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6338005320 con 0x7f63580ffe30 2024-04-20T22:02:02.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.519+0000 7f634fe00700 1 -- 172.21.15.142:0/4159011018 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f634400cb30 con 0x7f63580ffe30 2024-04-20T22:02:02.520 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.520+0000 7f634fe00700 1 --2- 172.21.15.142:0/4159011018 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f633c06ecc0 0x7f633c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:02.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.520+0000 7f634fe00700 1 -- 172.21.15.142:0/4159011018 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6344014070 con 0x7f63580ffe30 2024-04-20T22:02:02.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.520+0000 7f6357400700 1 --2- 172.21.15.142:0/4159011018 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f633c06ecc0 0x7f633c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:02.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.521+0000 7f6357400700 1 --2- 172.21.15.142:0/4159011018 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f633c06ecc0 0x7f633c071180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f634800b6f0 tx=0x7f6348005fb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:02.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.527+0000 7f634fe00700 1 -- 172.21.15.142:0/4159011018 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f6344053ff0 con 0x7f63580ffe30 2024-04-20T22:02:02.588 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:02 smithi142 ceph-mon[79401]: pgmap v56: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:02.588 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:02 smithi142 ceph-mon[79401]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:02:02.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:02 smithi164 ceph-mon[69784]: pgmap v56: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:02.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:02 smithi164 ceph-mon[69784]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:02:02.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.815+0000 7f635e600700 1 -- 172.21.15.142:0/4159011018 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6338005de0 con 0x7f63580ffe30 2024-04-20T22:02:02.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.816+0000 7f634fe00700 1 -- 172.21.15.142:0/4159011018 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1898 (secure 0 0 0) 0x7f6344090070 con 0x7f63580ffe30 2024-04-20T22:02:02.817 INFO:teuthology.orchestra.run.smithi142.stdout:e12 2024-04-20T22:02:02.817 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:02:02.817 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:02:02.817 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T22:02:02.817 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:02:02.818 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T22:02:02.818 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T22:02:02.818 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 12 2024-04-20T22:02:02.818 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:02:02.818 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:02:02.818 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:51.692699+0000 2024-04-20T22:02:02.818 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T22:02:02.818 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T22:02:02.818 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T22:02:02.818 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T22:02:02.818 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T22:02:02.818 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T22:02:02.818 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T22:02:02.818 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T22:02:02.819 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T22:02:02.819 INFO:teuthology.orchestra.run.smithi142.stdout:snap_rstat 1 2024-04-20T22:02:02.819 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:02:02.819 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T22:02:02.819 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T22:02:02.819 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T22:02:02.819 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T22:02:02.819 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T22:02:02.819 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T22:02:02.819 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T22:02:02.819 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T22:02:02.819 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T22:02:02.819 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T22:02:02.819 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T22:02:02.819 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T22:02:02.819 INFO:teuthology.orchestra.run.smithi142.stdout:qdb_cluster leader: 0 members: 2024-04-20T22:02:02.820 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:02:02.820 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:02:02.820 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:02:02.820 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T22:02:02.820 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:02:02.820 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:02:02.820 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:02:02.820 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:02:02.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.819+0000 7f635e600700 1 -- 172.21.15.142:0/4159011018 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f633c06ecc0 msgr2=0x7f633c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:02.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.819+0000 7f635e600700 1 --2- 172.21.15.142:0/4159011018 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f633c06ecc0 0x7f633c071180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f634800b6f0 tx=0x7f6348005fb0 comp rx=0 tx=0).stop 2024-04-20T22:02:02.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.819+0000 7f635e600700 1 -- 172.21.15.142:0/4159011018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63580ffe30 msgr2=0x7f6358198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:02.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.819+0000 7f635e600700 1 --2- 172.21.15.142:0/4159011018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63580ffe30 0x7f6358198d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f634400e920 tx=0x7f634400ec30 comp rx=0 tx=0).stop 2024-04-20T22:02:02.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.819+0000 7f635e600700 1 -- 172.21.15.142:0/4159011018 shutdown_connections 2024-04-20T22:02:02.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.819+0000 7f635e600700 1 --2- 172.21.15.142:0/4159011018 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f633c06ecc0 0x7f633c071180 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:02.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.819+0000 7f635e600700 1 --2- 172.21.15.142:0/4159011018 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63580ff4d0 0x7f6358198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:02.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.819+0000 7f635e600700 1 --2- 172.21.15.142:0/4159011018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63580ffe30 0x7f6358198d80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:02.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.819+0000 7f635e600700 1 -- 172.21.15.142:0/4159011018 >> 172.21.15.142:0/4159011018 conn(0x7f63580fb0d0 msgr2=0x7f6358107f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:02.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.820+0000 7f635e600700 1 -- 172.21.15.142:0/4159011018 shutdown_connections 2024-04-20T22:02:02.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.820+0000 7f635e600700 1 -- 172.21.15.142:0/4159011018 wait complete. 2024-04-20T22:02:02.822 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T22:02:02.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.980+0000 7f3f8f600700 1 -- 172.21.15.142:0/2172958900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f88073940 msgr2=0x7f3f88073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:02.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.980+0000 7f3f8f600700 1 --2- 172.21.15.142:0/2172958900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f88073940 0x7f3f88073dc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3f74009910 tx=0x7f3f74009c20 comp rx=0 tx=0).stop 2024-04-20T22:02:02.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.980+0000 7f3f8f600700 1 -- 172.21.15.142:0/2172958900 shutdown_connections 2024-04-20T22:02:02.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.980+0000 7f3f8f600700 1 --2- 172.21.15.142:0/2172958900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f88073940 0x7f3f88073dc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:02.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.980+0000 7f3f8f600700 1 --2- 172.21.15.142:0/2172958900 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f88074f10 0x7f3f88073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:02.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.980+0000 7f3f8f600700 1 -- 172.21.15.142:0/2172958900 >> 172.21.15.142:0/2172958900 conn(0x7f3f880fc1c0 msgr2=0x7f3f880fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:02.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.980+0000 7f3f8f600700 1 -- 172.21.15.142:0/2172958900 shutdown_connections 2024-04-20T22:02:02.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.980+0000 7f3f8f600700 1 -- 172.21.15.142:0/2172958900 wait complete. 2024-04-20T22:02:02.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.981+0000 7f3f8f600700 1 Processor -- start 2024-04-20T22:02:02.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.981+0000 7f3f8f600700 1 -- start start 2024-04-20T22:02:02.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.982+0000 7f3f8f600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f88073940 0x7f3f88198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:02.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.982+0000 7f3f8f600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f88074f10 0x7f3f88198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:02.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.982+0000 7f3f8f600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f881993a0 con 0x7f3f88074f10 2024-04-20T22:02:02.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.982+0000 7f3f8f600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f881994e0 con 0x7f3f88073940 2024-04-20T22:02:02.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.982+0000 7f3f87e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f88074f10 0x7f3f88198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:02.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.982+0000 7f3f87e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f88074f10 0x7f3f88198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56774/0 (socket says 172.21.15.142:56774) 2024-04-20T22:02:02.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.982+0000 7f3f87e00700 1 -- 172.21.15.142:0/2514788443 learned_addr learned my addr 172.21.15.142:0/2514788443 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:02:02.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.982+0000 7f3f8cc00700 1 --2- 172.21.15.142:0/2514788443 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f88073940 0x7f3f88198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:02.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.983+0000 7f3f87e00700 1 -- 172.21.15.142:0/2514788443 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f88073940 msgr2=0x7f3f88198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:02.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.983+0000 7f3f87e00700 1 --2- 172.21.15.142:0/2514788443 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f88073940 0x7f3f88198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:02.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.983+0000 7f3f87e00700 1 -- 172.21.15.142:0/2514788443 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f740095f0 con 0x7f3f88074f10 2024-04-20T22:02:02.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.983+0000 7f3f8cc00700 1 --2- 172.21.15.142:0/2514788443 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f88073940 0x7f3f88198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:02:02.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.983+0000 7f3f87e00700 1 --2- 172.21.15.142:0/2514788443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f88074f10 0x7f3f88198d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3f7400bd70 tx=0x7f3f7400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:02.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.983+0000 7f3f85600700 1 -- 172.21.15.142:0/2514788443 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f7401d070 con 0x7f3f88074f10 2024-04-20T22:02:02.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.983+0000 7f3f8f600700 1 -- 172.21.15.142:0/2514788443 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8819dee0 con 0x7f3f88074f10 2024-04-20T22:02:02.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.983+0000 7f3f85600700 1 -- 172.21.15.142:0/2514788443 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f74005dc0 con 0x7f3f88074f10 2024-04-20T22:02:02.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.984+0000 7f3f8f600700 1 -- 172.21.15.142:0/2514788443 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8819e3d0 con 0x7f3f88074f10 2024-04-20T22:02:02.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.984+0000 7f3f85600700 1 -- 172.21.15.142:0/2514788443 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f7402b440 con 0x7f3f88074f10 2024-04-20T22:02:02.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.985+0000 7f3f8f600700 1 -- 172.21.15.142:0/2514788443 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f881929d0 con 0x7f3f88074f10 2024-04-20T22:02:02.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.986+0000 7f3f85600700 1 -- 172.21.15.142:0/2514788443 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f3f7400f820 con 0x7f3f88074f10 2024-04-20T22:02:02.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.987+0000 7f3f85600700 1 --2- 172.21.15.142:0/2514788443 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3f7006ecc0 0x7f3f70071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:02.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.987+0000 7f3f85600700 1 -- 172.21.15.142:0/2514788443 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3f7408fff0 con 0x7f3f88074f10 2024-04-20T22:02:02.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.987+0000 7f3f8cc00700 1 --2- 172.21.15.142:0/2514788443 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3f7006ecc0 0x7f3f70071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:02.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.988+0000 7f3f8cc00700 1 --2- 172.21.15.142:0/2514788443 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3f7006ecc0 0x7f3f70071180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c005fd0 tx=0x7f3f7c005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:02.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:02.994+0000 7f3f85600700 1 -- 172.21.15.142:0/2514788443 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f3f7405c960 con 0x7f3f88074f10 2024-04-20T22:02:03.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.244+0000 7f3f8f600700 1 -- 172.21.15.142:0/2514788443 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f8802cde0 con 0x7f3f7006ecc0 2024-04-20T22:02:03.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.246+0000 7f3f85600700 1 -- 172.21.15.142:0/2514788443 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f3f8802cde0 con 0x7f3f7006ecc0 2024-04-20T22:02:03.247 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:02:03.247 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T22:02:03.247 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T22:02:03.248 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T22:02:03.248 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T22:02:03.248 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr", 2024-04-20T22:02:03.248 INFO:teuthology.orchestra.run.smithi142.stdout: "mon" 2024-04-20T22:02:03.248 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T22:02:03.248 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "5/23 daemons upgraded", 2024-04-20T22:02:03.248 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading crash daemons", 2024-04-20T22:02:03.248 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T22:02:03.248 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:02:03.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.252+0000 7f3f8f600700 1 -- 172.21.15.142:0/2514788443 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3f7006ecc0 msgr2=0x7f3f70071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:03.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.252+0000 7f3f8f600700 1 --2- 172.21.15.142:0/2514788443 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3f7006ecc0 0x7f3f70071180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c005fd0 tx=0x7f3f7c005ee0 comp rx=0 tx=0).stop 2024-04-20T22:02:03.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.252+0000 7f3f8f600700 1 -- 172.21.15.142:0/2514788443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f88074f10 msgr2=0x7f3f88198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:03.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.252+0000 7f3f8f600700 1 --2- 172.21.15.142:0/2514788443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f88074f10 0x7f3f88198d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3f7400bd70 tx=0x7f3f7400be50 comp rx=0 tx=0).stop 2024-04-20T22:02:03.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.252+0000 7f3f8f600700 1 -- 172.21.15.142:0/2514788443 shutdown_connections 2024-04-20T22:02:03.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.252+0000 7f3f8f600700 1 --2- 172.21.15.142:0/2514788443 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3f7006ecc0 0x7f3f70071180 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:03.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.252+0000 7f3f8f600700 1 --2- 172.21.15.142:0/2514788443 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f88073940 0x7f3f88198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:03.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.252+0000 7f3f8f600700 1 --2- 172.21.15.142:0/2514788443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f88074f10 0x7f3f88198d80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:03.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.252+0000 7f3f8f600700 1 -- 172.21.15.142:0/2514788443 >> 172.21.15.142:0/2514788443 conn(0x7f3f880fc1c0 msgr2=0x7f3f88106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:03.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.252+0000 7f3f8f600700 1 -- 172.21.15.142:0/2514788443 shutdown_connections 2024-04-20T22:02:03.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.252+0000 7f3f8f600700 1 -- 172.21.15.142:0/2514788443 wait complete. 2024-04-20T22:02:03.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.411+0000 7f4adaa00700 1 -- 172.21.15.142:0/2518268130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ad41016e0 msgr2=0x7f4ad4103ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:03.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.411+0000 7f4adaa00700 1 --2- 172.21.15.142:0/2518268130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ad41016e0 0x7f4ad4103ad0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009910 tx=0x7f4ac4009c20 comp rx=0 tx=0).stop 2024-04-20T22:02:03.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.411+0000 7f4adaa00700 1 -- 172.21.15.142:0/2518268130 shutdown_connections 2024-04-20T22:02:03.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.411+0000 7f4adaa00700 1 --2- 172.21.15.142:0/2518268130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ad4104010 0x7f4ad4106400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:03.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.411+0000 7f4adaa00700 1 --2- 172.21.15.142:0/2518268130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ad41016e0 0x7f4ad4103ad0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:03.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.411+0000 7f4adaa00700 1 -- 172.21.15.142:0/2518268130 >> 172.21.15.142:0/2518268130 conn(0x7f4ad40fb0d0 msgr2=0x7f4ad40fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:03.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.411+0000 7f4adaa00700 1 -- 172.21.15.142:0/2518268130 shutdown_connections 2024-04-20T22:02:03.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.411+0000 7f4adaa00700 1 -- 172.21.15.142:0/2518268130 wait complete. 2024-04-20T22:02:03.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.412+0000 7f4adaa00700 1 Processor -- start 2024-04-20T22:02:03.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.412+0000 7f4adaa00700 1 -- start start 2024-04-20T22:02:03.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.413+0000 7f4adaa00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ad41016e0 0x7f4ad4100ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:03.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.413+0000 7f4adaa00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ad4104010 0x7f4ad40ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:03.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.413+0000 7f4adaa00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad40ffbd0 con 0x7f4ad4104010 2024-04-20T22:02:03.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.413+0000 7f4adaa00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad40ffd10 con 0x7f4ad41016e0 2024-04-20T22:02:03.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.413+0000 7f4ad3400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ad4104010 0x7f4ad40ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:03.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.413+0000 7f4ad3400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ad4104010 0x7f4ad40ff690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56794/0 (socket says 172.21.15.142:56794) 2024-04-20T22:02:03.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.413+0000 7f4ad3400700 1 -- 172.21.15.142:0/3023772926 learned_addr learned my addr 172.21.15.142:0/3023772926 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:02:03.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.413+0000 7f4ad3e00700 1 --2- 172.21.15.142:0/3023772926 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ad41016e0 0x7f4ad4100ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:03.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.414+0000 7f4ad3400700 1 -- 172.21.15.142:0/3023772926 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ad41016e0 msgr2=0x7f4ad4100ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:03.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.414+0000 7f4ad3400700 1 --2- 172.21.15.142:0/3023772926 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ad41016e0 0x7f4ad4100ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:03.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.414+0000 7f4ad3400700 1 -- 172.21.15.142:0/3023772926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac40095f0 con 0x7f4ad4104010 2024-04-20T22:02:03.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.414+0000 7f4ad3400700 1 --2- 172.21.15.142:0/3023772926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ad4104010 0x7f4ad40ff690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000d8d0 tx=0x7f4ac000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:03.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.414+0000 7f4ad0c00700 1 -- 172.21.15.142:0/3023772926 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ac00098a0 con 0x7f4ad4104010 2024-04-20T22:02:03.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.414+0000 7f4ad0c00700 1 -- 172.21.15.142:0/3023772926 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ac0010460 con 0x7f4ad4104010 2024-04-20T22:02:03.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.414+0000 7f4adaa00700 1 -- 172.21.15.142:0/3023772926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad40ffff0 con 0x7f4ad4104010 2024-04-20T22:02:03.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.414+0000 7f4ad0c00700 1 -- 172.21.15.142:0/3023772926 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ac000f5f0 con 0x7f4ad4104010 2024-04-20T22:02:03.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.414+0000 7f4adaa00700 1 -- 172.21.15.142:0/3023772926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad419e610 con 0x7f4ad4104010 2024-04-20T22:02:03.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.416+0000 7f4adaa00700 1 -- 172.21.15.142:0/3023772926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad4062510 con 0x7f4ad4104010 2024-04-20T22:02:03.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.417+0000 7f4ad0c00700 1 -- 172.21.15.142:0/3023772926 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f4ac0009a00 con 0x7f4ad4104010 2024-04-20T22:02:03.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.418+0000 7f4ad0c00700 1 --2- 172.21.15.142:0/3023772926 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4ab806ecc0 0x7f4ab8071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:03.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.419+0000 7f4ad0c00700 1 -- 172.21.15.142:0/3023772926 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4ac008ec70 con 0x7f4ad4104010 2024-04-20T22:02:03.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.419+0000 7f4ad3e00700 1 --2- 172.21.15.142:0/3023772926 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4ab806ecc0 0x7f4ab8071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:03.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.420+0000 7f4ad3e00700 1 --2- 172.21.15.142:0/3023772926 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4ab806ecc0 0x7f4ab8071180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009fd0 tx=0x7f4ac4005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:03.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.423+0000 7f4ad0c00700 1 -- 172.21.15.142:0/3023772926 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f4ac0095080 con 0x7f4ad4104010 2024-04-20T22:02:03.507 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:03 smithi142 ceph-mon[79401]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:02:03.507 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:03 smithi142 ceph-mon[79401]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:02:03.508 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:03 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1055163563' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:02:03.508 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:03.508 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:03.508 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:03 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/4159011018' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:02:03.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:03 smithi164 ceph-mon[69784]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:02:03.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:03 smithi164 ceph-mon[69784]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:02:03.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:03 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/1055163563' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:02:03.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:03.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:03.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:03 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/4159011018' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:02:03.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.759+0000 7f4adaa00700 1 -- 172.21.15.142:0/3023772926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4ad4109750 con 0x7f4ad4104010 2024-04-20T22:02:03.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.761+0000 7f4ad0c00700 1 -- 172.21.15.142:0/3023772926 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f4ac005b590 con 0x7f4ad4104010 2024-04-20T22:02:03.761 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_OK 2024-04-20T22:02:03.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.764+0000 7f4adaa00700 1 -- 172.21.15.142:0/3023772926 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4ab806ecc0 msgr2=0x7f4ab8071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:03.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.764+0000 7f4adaa00700 1 --2- 172.21.15.142:0/3023772926 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4ab806ecc0 0x7f4ab8071180 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009fd0 tx=0x7f4ac4005960 comp rx=0 tx=0).stop 2024-04-20T22:02:03.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.764+0000 7f4adaa00700 1 -- 172.21.15.142:0/3023772926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ad4104010 msgr2=0x7f4ad40ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:03.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.764+0000 7f4adaa00700 1 --2- 172.21.15.142:0/3023772926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ad4104010 0x7f4ad40ff690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000d8d0 tx=0x7f4ac000dbe0 comp rx=0 tx=0).stop 2024-04-20T22:02:03.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.764+0000 7f4adaa00700 1 -- 172.21.15.142:0/3023772926 shutdown_connections 2024-04-20T22:02:03.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.764+0000 7f4adaa00700 1 --2- 172.21.15.142:0/3023772926 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4ab806ecc0 0x7f4ab8071180 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:03.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.764+0000 7f4adaa00700 1 --2- 172.21.15.142:0/3023772926 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ad41016e0 0x7f4ad4100ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:03.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.764+0000 7f4adaa00700 1 --2- 172.21.15.142:0/3023772926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ad4104010 0x7f4ad40ff690 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:03.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.764+0000 7f4adaa00700 1 -- 172.21.15.142:0/3023772926 >> 172.21.15.142:0/3023772926 conn(0x7f4ad40fb0d0 msgr2=0x7f4ad40fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:03.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.765+0000 7f4adaa00700 1 -- 172.21.15.142:0/3023772926 shutdown_connections 2024-04-20T22:02:03.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:03.765+0000 7f4adaa00700 1 -- 172.21.15.142:0/3023772926 wait complete. 2024-04-20T22:02:04.592 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:04 smithi142 ceph-mon[79401]: pgmap v57: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:04.592 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:04 smithi142 ceph-mon[79401]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:02:04.592 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:04 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3023772926' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:02:04.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:04 smithi164 ceph-mon[69784]: pgmap v57: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:04.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:04 smithi164 ceph-mon[69784]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:02:04.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:04 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3023772926' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:02:05.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:05 smithi164 ceph-mon[69784]: pgmap v58: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:05.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:05 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:05.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:05 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:05.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:05 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:05.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:05 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:05.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:05 smithi142 ceph-mon[79401]: pgmap v58: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:05.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:05 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:05.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:05 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:05.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:05 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:05.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:05 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:07.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:07 smithi164 ceph-mon[69784]: pgmap v59: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:07.945 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:07 smithi142 ceph-mon[79401]: pgmap v59: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:09.154 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:08 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:09.155 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:08 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:09.166 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:08 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:09.166 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:08 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:10.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:09 smithi142 ceph-mon[79401]: pgmap v60: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:10.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:09 smithi164 ceph-mon[69784]: pgmap v60: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:11.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:10 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:11.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:10 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:11.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:10 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:11.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:10 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:12.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:12 smithi142 ceph-mon[79401]: pgmap v61: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:12 smithi164 ceph-mon[69784]: pgmap v61: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:14.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:14 smithi164 ceph-mon[69784]: pgmap v62: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:14.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:14.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:14.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:02:14.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:02:14.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:14.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:14 smithi142 ceph-mon[79401]: pgmap v62: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:14.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:14.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:14.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:02:14.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:02:14.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:15.337 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:02:15.337 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:02:15.337 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:02:15.337 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:02:15.337 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:15 smithi142 ceph-mon[79401]: Upgrade: Setting container_image for all crash 2024-04-20T22:02:15.337 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:15.338 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi142"}]: dispatch 2024-04-20T22:02:15.338 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi142"}]': finished 2024-04-20T22:02:15.338 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi164"}]: dispatch 2024-04-20T22:02:15.338 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi164"}]': finished 2024-04-20T22:02:15.338 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-20T22:02:15.338 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:15 smithi142 ceph-mon[79401]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-20T22:02:15.338 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:15 smithi142 ceph-mon[79401]: Upgrade: osd.0 is safe to restart 2024-04-20T22:02:15.338 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:02:15.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:02:15.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:02:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:02:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:02:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:15 smithi164 ceph-mon[69784]: Upgrade: Setting container_image for all crash 2024-04-20T22:02:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi142"}]: dispatch 2024-04-20T22:02:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi142"}]': finished 2024-04-20T22:02:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi164"}]: dispatch 2024-04-20T22:02:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi164"}]': finished 2024-04-20T22:02:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-20T22:02:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:15 smithi164 ceph-mon[69784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-20T22:02:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:15 smithi164 ceph-mon[69784]: Upgrade: osd.0 is safe to restart 2024-04-20T22:02:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:02:16.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:16 smithi142 ceph-mon[79401]: pgmap v63: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:16 smithi164 ceph-mon[69784]: pgmap v63: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:17.528 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:17 smithi142 ceph-mon[79401]: Upgrade: Updating osd.0 2024-04-20T22:02:17.528 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:17 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:17.529 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:17 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-20T22:02:17.529 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:17 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:02:17.529 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:17 smithi142 ceph-mon[79401]: Deploying daemon osd.0 on smithi142 2024-04-20T22:02:17.529 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:17 smithi142 ceph-mon[79401]: pgmap v64: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:17.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:17 smithi164 ceph-mon[69784]: Upgrade: Updating osd.0 2024-04-20T22:02:17.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:17 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:17.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:17 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-20T22:02:17.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:17 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:02:17.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:17 smithi164 ceph-mon[69784]: Deploying daemon osd.0 on smithi142 2024-04-20T22:02:17.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:17 smithi164 ceph-mon[69784]: pgmap v64: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:19.585 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:19 smithi142 ceph-mon[79401]: pgmap v65: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:19.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:19 smithi164 ceph-mon[69784]: pgmap v65: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:21.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:21 smithi142 ceph-mon[79401]: pgmap v66: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:21.696 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:21 smithi142 systemd[1]: Stopping Ceph osd.0 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:02:21.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:21 smithi164 ceph-mon[69784]: pgmap v66: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:22.196 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:21 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0[34479]: 2024-04-20T22:02:21.816+0000 7fae5aa00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T22:02:22.196 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:21 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0[34479]: 2024-04-20T22:02:21.816+0000 7fae5aa00700 -1 osd.0 50 *** Got signal Terminated *** 2024-04-20T22:02:22.196 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:21 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0[34479]: 2024-04-20T22:02:21.816+0000 7fae5aa00700 -1 osd.0 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T22:02:22.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:22 smithi164 ceph-mon[69784]: osd.0 marked itself down and dead 2024-04-20T22:02:22.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:22 smithi142 ceph-mon[79401]: osd.0 marked itself down and dead 2024-04-20T22:02:23.308 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:22 smithi142 podman[88136]: 2024-04-20 22:02:22.959135176 +0000 UTC m=+1.258783480 container died 4361ae428e0dc1ed7c935fa6ef5bb023e02ea3c76756f48d02792f3c09b5d68a (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, RELEASE=reef-646b8c7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T22:02:23.653 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:23 smithi142 ceph-mon[79401]: pgmap v67: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:23.654 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:23 smithi142 ceph-mon[79401]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-20T22:02:23.654 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:23 smithi142 ceph-mon[79401]: osdmap e51: 6 total, 5 up, 6 in 2024-04-20T22:02:23.654 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:23 smithi142 podman[88136]: 2024-04-20 22:02:23.444296345 +0000 UTC m=+1.743944642 container cleanup 4361ae428e0dc1ed7c935fa6ef5bb023e02ea3c76756f48d02792f3c09b5d68a (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0, io.buildah.version=1.33.5, RELEASE=reef-646b8c7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-20T22:02:23.654 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:23 smithi142 bash[88136]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0 2024-04-20T22:02:23.946 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:23 smithi142 podman[88152]: 2024-04-20 22:02:23.654123271 +0000 UTC m=+0.679576601 container remove 4361ae428e0dc1ed7c935fa6ef5bb023e02ea3c76756f48d02792f3c09b5d68a (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=reef-646b8c7, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-20T22:02:23.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:23 smithi164 ceph-mon[69784]: pgmap v67: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:23.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:23 smithi164 ceph-mon[69784]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-20T22:02:23.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:23 smithi164 ceph-mon[69784]: osdmap e51: 6 total, 5 up, 6 in 2024-04-20T22:02:24.781 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:24 smithi142 ceph-mon[79401]: osdmap e52: 6 total, 5 up, 6 in 2024-04-20T22:02:24.781 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:24 smithi142 podman[88241]: 2024-04-20 22:02:24.393380281 +0000 UTC m=+0.033757816 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:02:24.781 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:24 smithi142 podman[88241]: 2024-04-20 22:02:24.513725355 +0000 UTC m=+0.154102941 container create 020c3dd299810eeb91068a60653786039a6ab2b19f2919f0fb3593c6aafc7b58 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-04-20T22:02:24.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:24 smithi164 ceph-mon[69784]: osdmap e52: 6 total, 5 up, 6 in 2024-04-20T22:02:25.041 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:24 smithi142 podman[88241]: 2024-04-20 22:02:24.953248807 +0000 UTC m=+0.593626386 container init 020c3dd299810eeb91068a60653786039a6ab2b19f2919f0fb3593c6aafc7b58 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-20T22:02:25.041 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:24 smithi142 podman[88241]: 2024-04-20 22:02:24.966518203 +0000 UTC m=+0.606895754 container start 020c3dd299810eeb91068a60653786039a6ab2b19f2919f0fb3593c6aafc7b58 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-20T22:02:25.041 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:25 smithi142 podman[88241]: 2024-04-20 22:02:25.041475014 +0000 UTC m=+0.681852622 container attach 020c3dd299810eeb91068a60653786039a6ab2b19f2919f0fb3593c6aafc7b58 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-20T22:02:25.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:25 smithi142 ceph-mon[79401]: pgmap v70: 65 pgs: 9 stale+active+clean, 56 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:25.696 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:25 smithi142 podman[88241]: 2024-04-20 22:02:25.41681488 +0000 UTC m=+1.057192498 container died 020c3dd299810eeb91068a60653786039a6ab2b19f2919f0fb3593c6aafc7b58 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416) 2024-04-20T22:02:25.877 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:25 smithi164 ceph-mon[69784]: pgmap v70: 65 pgs: 9 stale+active+clean, 56 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:26.446 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:26 smithi142 podman[88267]: 2024-04-20 22:02:26.078124753 +0000 UTC m=+0.646077053 container remove 020c3dd299810eeb91068a60653786039a6ab2b19f2919f0fb3593c6aafc7b58 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-20T22:02:26.446 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:26 smithi142 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.0.service: Deactivated successfully. 2024-04-20T22:02:26.447 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:26 smithi142 systemd[1]: Stopped Ceph osd.0 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T22:02:26.447 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:26 smithi142 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.0.service: Consumed 1min 40.531s CPU time. 2024-04-20T22:02:26.907 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:26 smithi164 ceph-mon[69784]: Health check failed: Degraded data redundancy: 41/231 objects degraded (17.749%), 18 pgs degraded (PG_DEGRADED) 2024-04-20T22:02:26.910 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:26 smithi142 systemd[1]: Starting Ceph osd.0 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:02:26.910 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:26 smithi142 ceph-mon[79401]: Health check failed: Degraded data redundancy: 41/231 objects degraded (17.749%), 18 pgs degraded (PG_DEGRADED) 2024-04-20T22:02:27.196 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:26 smithi142 podman[88366]: 2024-04-20 22:02:26.81549235 +0000 UTC m=+0.031698596 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:02:27.196 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:26 smithi142 podman[88366]: 2024-04-20 22:02:26.946148691 +0000 UTC m=+0.162354974 container create db96a7c1a069b56b07c62fccfb1850fda141efca376f489f4fc5444ef3477a46 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-activate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-20T22:02:27.569 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:27 smithi142 podman[88366]: 2024-04-20 22:02:27.227144087 +0000 UTC m=+0.443350427 container init db96a7c1a069b56b07c62fccfb1850fda141efca376f489f4fc5444ef3477a46 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-activate, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T22:02:27.569 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:27 smithi142 podman[88366]: 2024-04-20 22:02:27.239216406 +0000 UTC m=+0.455422672 container start db96a7c1a069b56b07c62fccfb1850fda141efca376f489f4fc5444ef3477a46 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2) 2024-04-20T22:02:27.569 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:27 smithi142 podman[88366]: 2024-04-20 22:02:27.335300048 +0000 UTC m=+0.551506371 container attach db96a7c1a069b56b07c62fccfb1850fda141efca376f489f4fc5444ef3477a46 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-20T22:02:27.867 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:27 smithi164 ceph-mon[69784]: pgmap v71: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:02:27.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:27 smithi142 ceph-mon[79401]: pgmap v71: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:02:28.627 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-activate[88380]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:02:28.627 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-activate[88380]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:02:28.627 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 bash[88366]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:02:28.627 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 bash[88366]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:02:28.627 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 bash[88366]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-20T22:02:28.627 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 bash[88366]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-20T22:02:28.627 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 bash[88366]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-20T22:02:28.627 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 bash[88366]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-20T22:02:28.627 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 bash[88366]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-20T22:02:28.627 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 bash[88366]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-20T22:02:28.627 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 bash[88366]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-20T22:02:28.627 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-activate[88380]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-20T22:02:28.627 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-activate[88380]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-20T22:02:28.628 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-activate[88380]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-20T22:02:28.628 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-activate[88380]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-20T22:02:28.628 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-activate[88380]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-20T22:02:28.628 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-activate[88380]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-20T22:02:28.628 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-activate[88380]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-20T22:02:28.628 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 podman[88366]: 2024-04-20 22:02:28.266545645 +0000 UTC m=+1.482751982 container died db96a7c1a069b56b07c62fccfb1850fda141efca376f489f4fc5444ef3477a46 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-activate, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-20T22:02:29.309 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:28 smithi142 podman[88511]: 2024-04-20 22:02:28.960303499 +0000 UTC m=+0.674473491 container remove db96a7c1a069b56b07c62fccfb1850fda141efca376f489f4fc5444ef3477a46 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True) 2024-04-20T22:02:29.595 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:29 smithi142 podman[88576]: 2024-04-20 22:02:29.214733299 +0000 UTC m=+0.033306833 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:02:29.595 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:29 smithi142 podman[88576]: 2024-04-20 22:02:29.319494854 +0000 UTC m=+0.138068414 container create b7206d05a7cdd2d282851c11b1f88cbd5738e603b2b4891706d7ee81ff552e17 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-20T22:02:29.853 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:29 smithi142 ceph-mon[79401]: pgmap v72: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:02:29.853 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:29.853 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:02:29.853 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:29 smithi142 podman[88576]: 2024-04-20 22:02:29.641379384 +0000 UTC m=+0.459952944 container init b7206d05a7cdd2d282851c11b1f88cbd5738e603b2b4891706d7ee81ff552e17 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-20T22:02:29.853 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:29 smithi142 podman[88576]: 2024-04-20 22:02:29.652389575 +0000 UTC m=+0.470963135 container start b7206d05a7cdd2d282851c11b1f88cbd5738e603b2b4891706d7ee81ff552e17 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-20T22:02:29.853 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:29 smithi142 ceph-osd[88595]: -- 172.21.15.142:0/1058354496 <== mon.0 v2:172.21.15.142:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f553fdb680 con 0x55f553fa4c00 2024-04-20T22:02:29.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:29 smithi164 ceph-mon[69784]: pgmap v72: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:02:29.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:29.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:02:30.196 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:29 smithi142 bash[88576]: b7206d05a7cdd2d282851c11b1f88cbd5738e603b2b4891706d7ee81ff552e17 2024-04-20T22:02:30.196 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:29 smithi142 systemd[1]: Started Ceph osd.0 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T22:02:30.696 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:30 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0[88591]: 2024-04-20T22:02:30.236+0000 7f3520d3c7c0 -1 Falling back to public interface 2024-04-20T22:02:31.263 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:31 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:31.263 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:31 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:31.263 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:31 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:02:31.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:31 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:31.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:31 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:31.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:31 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:02:32.286 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:32 smithi142 ceph-mon[79401]: pgmap v73: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:02:32.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:32 smithi164 ceph-mon[69784]: pgmap v73: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:02:33.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.931+0000 7f83cec00700 1 -- 172.21.15.142:0/3892534102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83c8100c30 msgr2=0x7f83c8101050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:33.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.931+0000 7f83cec00700 1 --2- 172.21.15.142:0/3892534102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83c8100c30 0x7f83c8101050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009910 tx=0x7f83b8009c20 comp rx=0 tx=0).stop 2024-04-20T22:02:33.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.931+0000 7f83cec00700 1 -- 172.21.15.142:0/3892534102 shutdown_connections 2024-04-20T22:02:33.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.931+0000 7f83cec00700 1 --2- 172.21.15.142:0/3892534102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83c8101e30 0x7f83c8102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:33.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.931+0000 7f83cec00700 1 --2- 172.21.15.142:0/3892534102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83c8100c30 0x7f83c8101050 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:33.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.931+0000 7f83cec00700 1 -- 172.21.15.142:0/3892534102 >> 172.21.15.142:0/3892534102 conn(0x7f83c80fc1f0 msgr2=0x7f83c80fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:33.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.932+0000 7f83cec00700 1 -- 172.21.15.142:0/3892534102 shutdown_connections 2024-04-20T22:02:33.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.932+0000 7f83cec00700 1 -- 172.21.15.142:0/3892534102 wait complete. 2024-04-20T22:02:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.933+0000 7f83cec00700 1 Processor -- start 2024-04-20T22:02:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.933+0000 7f83cec00700 1 -- start start 2024-04-20T22:02:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.933+0000 7f83cec00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83c8100c30 0x7f83c8198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.933+0000 7f83cec00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83c8101e30 0x7f83c8198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.933+0000 7f83cec00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c8199380 con 0x7f83c8101e30 2024-04-20T22:02:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.933+0000 7f83cec00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c81994c0 con 0x7f83c8100c30 2024-04-20T22:02:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.934+0000 7f83c7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83c8101e30 0x7f83c8198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.934+0000 7f83c7400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83c8101e30 0x7f83c8198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46966/0 (socket says 172.21.15.142:46966) 2024-04-20T22:02:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.934+0000 7f83c7400700 1 -- 172.21.15.142:0/4263196980 learned_addr learned my addr 172.21.15.142:0/4263196980 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:02:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.934+0000 7f83c7e00700 1 --2- 172.21.15.142:0/4263196980 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83c8100c30 0x7f83c8198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.935+0000 7f83c7400700 1 -- 172.21.15.142:0/4263196980 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83c8100c30 msgr2=0x7f83c8198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.935+0000 7f83c7400700 1 --2- 172.21.15.142:0/4263196980 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83c8100c30 0x7f83c8198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.935+0000 7f83c7400700 1 -- 172.21.15.142:0/4263196980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b80095f0 con 0x7f83c8101e30 2024-04-20T22:02:33.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.935+0000 7f83c7400700 1 --2- 172.21.15.142:0/4263196980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83c8101e30 0x7f83c8198d60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f83b400c8a0 tx=0x7f83b400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:33.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.935+0000 7f83c4c00700 1 -- 172.21.15.142:0/4263196980 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83b400cea0 con 0x7f83c8101e30 2024-04-20T22:02:33.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.935+0000 7f83c4c00700 1 -- 172.21.15.142:0/4263196980 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83b4004830 con 0x7f83c8101e30 2024-04-20T22:02:33.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.935+0000 7f83cec00700 1 -- 172.21.15.142:0/4263196980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c819df20 con 0x7f83c8101e30 2024-04-20T22:02:33.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.935+0000 7f83c4c00700 1 -- 172.21.15.142:0/4263196980 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83b40055b0 con 0x7f83c8101e30 2024-04-20T22:02:33.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.936+0000 7f83cec00700 1 -- 172.21.15.142:0/4263196980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c819e4c0 con 0x7f83c8101e30 2024-04-20T22:02:33.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.937+0000 7f83cec00700 1 -- 172.21.15.142:0/4263196980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c804ebb0 con 0x7f83c8101e30 2024-04-20T22:02:33.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.938+0000 7f83c4c00700 1 -- 172.21.15.142:0/4263196980 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f83b40049a0 con 0x7f83c8101e30 2024-04-20T22:02:33.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.939+0000 7f83c4c00700 1 --2- 172.21.15.142:0/4263196980 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f83ac06ecc0 0x7f83ac071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:33.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.939+0000 7f83c4c00700 1 -- 172.21.15.142:0/4263196980 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f83b408e9f0 con 0x7f83c8101e30 2024-04-20T22:02:33.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.940+0000 7f83c7e00700 1 --2- 172.21.15.142:0/4263196980 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f83ac06ecc0 0x7f83ac071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:33.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.940+0000 7f83c7e00700 1 --2- 172.21.15.142:0/4263196980 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f83ac06ecc0 0x7f83ac071180 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f83b8006010 tx=0x7f83b800b580 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:33.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:33.945+0000 7f83c4c00700 1 -- 172.21.15.142:0/4263196980 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f83b4090e60 con 0x7f83c8101e30 2024-04-20T22:02:34.189 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:34 smithi142 ceph-mon[79401]: pgmap v74: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:02:34.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.202+0000 7f83cec00700 1 -- 172.21.15.142:0/4263196980 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f83c8074b50 con 0x7f83ac06ecc0 2024-04-20T22:02:34.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.203+0000 7f83c4c00700 1 -- 172.21.15.142:0/4263196980 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f83c8074b50 con 0x7f83ac06ecc0 2024-04-20T22:02:34.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.207+0000 7f83cec00700 1 -- 172.21.15.142:0/4263196980 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f83ac06ecc0 msgr2=0x7f83ac071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:34.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.207+0000 7f83cec00700 1 --2- 172.21.15.142:0/4263196980 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f83ac06ecc0 0x7f83ac071180 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f83b8006010 tx=0x7f83b800b580 comp rx=0 tx=0).stop 2024-04-20T22:02:34.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.207+0000 7f83cec00700 1 -- 172.21.15.142:0/4263196980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83c8101e30 msgr2=0x7f83c8198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:34.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.207+0000 7f83cec00700 1 --2- 172.21.15.142:0/4263196980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83c8101e30 0x7f83c8198d60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f83b400c8a0 tx=0x7f83b400cc60 comp rx=0 tx=0).stop 2024-04-20T22:02:34.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.207+0000 7f83cec00700 1 -- 172.21.15.142:0/4263196980 shutdown_connections 2024-04-20T22:02:34.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.207+0000 7f83cec00700 1 --2- 172.21.15.142:0/4263196980 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f83ac06ecc0 0x7f83ac071180 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:34.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.208+0000 7f83cec00700 1 --2- 172.21.15.142:0/4263196980 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f83c8100c30 0x7f83c8198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:34.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.208+0000 7f83cec00700 1 --2- 172.21.15.142:0/4263196980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83c8101e30 0x7f83c8198d60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:34.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.208+0000 7f83cec00700 1 -- 172.21.15.142:0/4263196980 >> 172.21.15.142:0/4263196980 conn(0x7f83c80fc1f0 msgr2=0x7f83c8073430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:34.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.208+0000 7f83cec00700 1 -- 172.21.15.142:0/4263196980 shutdown_connections 2024-04-20T22:02:34.208 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.208+0000 7f83cec00700 1 -- 172.21.15.142:0/4263196980 wait complete. 2024-04-20T22:02:34.223 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T22:02:34.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.360+0000 7fa71f200700 1 -- 172.21.15.142:0/2939172480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa720101c70 msgr2=0x7fa7201020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:34.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.360+0000 7fa71f200700 1 --2- 172.21.15.142:0/2939172480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa720101c70 0x7fa7201020d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009910 tx=0x7fa70c009c20 comp rx=0 tx=0).stop 2024-04-20T22:02:34.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.360+0000 7fa71f200700 1 -- 172.21.15.142:0/2939172480 shutdown_connections 2024-04-20T22:02:34.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.360+0000 7fa71f200700 1 --2- 172.21.15.142:0/2939172480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa720101c70 0x7fa7201020d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:34.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.360+0000 7fa71f200700 1 --2- 172.21.15.142:0/2939172480 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa720100a70 0x7fa720100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:34.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.360+0000 7fa71f200700 1 -- 172.21.15.142:0/2939172480 >> 172.21.15.142:0/2939172480 conn(0x7fa7200fc050 msgr2=0x7fa7200fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:34.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.360+0000 7fa71f200700 1 -- 172.21.15.142:0/2939172480 shutdown_connections 2024-04-20T22:02:34.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.360+0000 7fa71f200700 1 -- 172.21.15.142:0/2939172480 wait complete. 2024-04-20T22:02:34.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.361+0000 7fa71f200700 1 Processor -- start 2024-04-20T22:02:34.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.361+0000 7fa71f200700 1 -- start start 2024-04-20T22:02:34.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.362+0000 7fa71f200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa720100a70 0x7fa720196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:34.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.362+0000 7fa71f200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa720101c70 0x7fa720196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:34.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.362+0000 7fa71f200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7201970c0 con 0x7fa720100a70 2024-04-20T22:02:34.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.362+0000 7fa71f200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa720197200 con 0x7fa720101c70 2024-04-20T22:02:34.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.362+0000 7fa71de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa720100a70 0x7fa720196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:34.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.362+0000 7fa71de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa720100a70 0x7fa720196560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46994/0 (socket says 172.21.15.142:46994) 2024-04-20T22:02:34.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.362+0000 7fa71de00700 1 -- 172.21.15.142:0/1438622894 learned_addr learned my addr 172.21.15.142:0/1438622894 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:02:34.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.362+0000 7fa71de00700 1 -- 172.21.15.142:0/1438622894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa720101c70 msgr2=0x7fa720196aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:34.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.362+0000 7fa71de00700 1 --2- 172.21.15.142:0/1438622894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa720101c70 0x7fa720196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:34.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.362+0000 7fa71de00700 1 -- 172.21.15.142:0/1438622894 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70c0095f0 con 0x7fa720100a70 2024-04-20T22:02:34.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.363+0000 7fa71de00700 1 --2- 172.21.15.142:0/1438622894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa720100a70 0x7fa720196560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa71000b480 tx=0x7fa71000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:34.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.363+0000 7fa716a00700 1 -- 172.21.15.142:0/1438622894 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7100118c0 con 0x7fa720100a70 2024-04-20T22:02:34.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.363+0000 7fa716a00700 1 -- 172.21.15.142:0/1438622894 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa710010380 con 0x7fa720100a70 2024-04-20T22:02:34.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.363+0000 7fa716a00700 1 -- 172.21.15.142:0/1438622894 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa71000f4f0 con 0x7fa720100a70 2024-04-20T22:02:34.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.363+0000 7fa71f200700 1 -- 172.21.15.142:0/1438622894 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa72019bc60 con 0x7fa720100a70 2024-04-20T22:02:34.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.363+0000 7fa71f200700 1 -- 172.21.15.142:0/1438622894 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72019c230 con 0x7fa720100a70 2024-04-20T22:02:34.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.364+0000 7fa71f200700 1 -- 172.21.15.142:0/1438622894 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa720190690 con 0x7fa720100a70 2024-04-20T22:02:34.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.365+0000 7fa716a00700 1 -- 172.21.15.142:0/1438622894 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fa7100104f0 con 0x7fa720100a70 2024-04-20T22:02:34.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.366+0000 7fa716a00700 1 --2- 172.21.15.142:0/1438622894 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa70406ecd0 0x7fa704071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:34.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.366+0000 7fa716a00700 1 -- 172.21.15.142:0/1438622894 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa71008ea30 con 0x7fa720100a70 2024-04-20T22:02:34.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.366+0000 7fa71d400700 1 --2- 172.21.15.142:0/1438622894 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa70406ecd0 0x7fa704071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:34.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.367+0000 7fa71d400700 1 --2- 172.21.15.142:0/1438622894 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa70406ecd0 0x7fa704071190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa70c00b5c0 tx=0x7fa70c005160 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:34.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.371+0000 7fa716a00700 1 -- 172.21.15.142:0/1438622894 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fa71005b350 con 0x7fa720100a70 2024-04-20T22:02:34.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:34 smithi164 ceph-mon[69784]: pgmap v74: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:02:34.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.642+0000 7fa71f200700 1 -- 172.21.15.142:0/1438622894 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa72002ce50 con 0x7fa70406ecd0 2024-04-20T22:02:34.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.644+0000 7fa716a00700 1 -- 172.21.15.142:0/1438622894 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa72002ce50 con 0x7fa70406ecd0 2024-04-20T22:02:34.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.647+0000 7fa71f200700 1 -- 172.21.15.142:0/1438622894 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa70406ecd0 msgr2=0x7fa704071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:34.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.647+0000 7fa71f200700 1 --2- 172.21.15.142:0/1438622894 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa70406ecd0 0x7fa704071190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa70c00b5c0 tx=0x7fa70c005160 comp rx=0 tx=0).stop 2024-04-20T22:02:34.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.647+0000 7fa71f200700 1 -- 172.21.15.142:0/1438622894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa720100a70 msgr2=0x7fa720196560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:34.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.647+0000 7fa71f200700 1 --2- 172.21.15.142:0/1438622894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa720100a70 0x7fa720196560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa71000b480 tx=0x7fa71000b840 comp rx=0 tx=0).stop 2024-04-20T22:02:34.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.647+0000 7fa71f200700 1 -- 172.21.15.142:0/1438622894 shutdown_connections 2024-04-20T22:02:34.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.647+0000 7fa71f200700 1 --2- 172.21.15.142:0/1438622894 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa70406ecd0 0x7fa704071190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:34.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.647+0000 7fa71f200700 1 --2- 172.21.15.142:0/1438622894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa720100a70 0x7fa720196560 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:34.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.647+0000 7fa71f200700 1 --2- 172.21.15.142:0/1438622894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa720101c70 0x7fa720196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:34.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.647+0000 7fa71f200700 1 -- 172.21.15.142:0/1438622894 >> 172.21.15.142:0/1438622894 conn(0x7fa7200fc050 msgr2=0x7fa720105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:34.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.647+0000 7fa71f200700 1 -- 172.21.15.142:0/1438622894 shutdown_connections 2024-04-20T22:02:34.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.647+0000 7fa71f200700 1 -- 172.21.15.142:0/1438622894 wait complete. 2024-04-20T22:02:34.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.818+0000 7f2991200700 1 -- 172.21.15.142:0/1864292821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f298c074f10 msgr2=0x7f298c073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:34.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.818+0000 7f2991200700 1 --2- 172.21.15.142:0/1864292821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f298c074f10 0x7f298c073370 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f297c009910 tx=0x7f297c009c20 comp rx=0 tx=0).stop 2024-04-20T22:02:34.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.818+0000 7f2991200700 1 -- 172.21.15.142:0/1864292821 shutdown_connections 2024-04-20T22:02:34.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.818+0000 7f2991200700 1 --2- 172.21.15.142:0/1864292821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f298c073940 0x7f298c073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:34.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.818+0000 7f2991200700 1 --2- 172.21.15.142:0/1864292821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f298c074f10 0x7f298c073370 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:34.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.818+0000 7f2991200700 1 -- 172.21.15.142:0/1864292821 >> 172.21.15.142:0/1864292821 conn(0x7f298c0fc1c0 msgr2=0x7f298c0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:34.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.818+0000 7f2991200700 1 -- 172.21.15.142:0/1864292821 shutdown_connections 2024-04-20T22:02:34.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.818+0000 7f2991200700 1 -- 172.21.15.142:0/1864292821 wait complete. 2024-04-20T22:02:34.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.819+0000 7f2991200700 1 Processor -- start 2024-04-20T22:02:34.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.819+0000 7f2991200700 1 -- start start 2024-04-20T22:02:34.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.820+0000 7f2991200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f298c073940 0x7f298c198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:34.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.820+0000 7f2991200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f298c074f10 0x7f298c198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:34.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.820+0000 7f2991200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c1993d0 con 0x7f298c073940 2024-04-20T22:02:34.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.820+0000 7f2991200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c199510 con 0x7f298c074f10 2024-04-20T22:02:34.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.820+0000 7f2989e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f298c073940 0x7f298c198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:34.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.820+0000 7f2989e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f298c073940 0x7f298c198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47006/0 (socket says 172.21.15.142:47006) 2024-04-20T22:02:34.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.820+0000 7f2989e00700 1 -- 172.21.15.142:0/309152770 learned_addr learned my addr 172.21.15.142:0/309152770 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:02:34.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.821+0000 7f2989e00700 1 -- 172.21.15.142:0/309152770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f298c074f10 msgr2=0x7f298c198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:34.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.821+0000 7f2989e00700 1 --2- 172.21.15.142:0/309152770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f298c074f10 0x7f298c198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:34.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.821+0000 7f2989e00700 1 -- 172.21.15.142:0/309152770 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c0095f0 con 0x7f298c073940 2024-04-20T22:02:34.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.821+0000 7f2989e00700 1 --2- 172.21.15.142:0/309152770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f298c073940 0x7f298c198870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f297c00bd70 tx=0x7f297c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:34.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.821+0000 7f2982a00700 1 -- 172.21.15.142:0/309152770 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f297c01d070 con 0x7f298c073940 2024-04-20T22:02:34.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.821+0000 7f2982a00700 1 -- 172.21.15.142:0/309152770 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f297c005dc0 con 0x7f298c073940 2024-04-20T22:02:34.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.821+0000 7f2982a00700 1 -- 172.21.15.142:0/309152770 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f297c021410 con 0x7f298c073940 2024-04-20T22:02:34.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.821+0000 7f2991200700 1 -- 172.21.15.142:0/309152770 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298c19dec0 con 0x7f298c073940 2024-04-20T22:02:34.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.821+0000 7f2991200700 1 -- 172.21.15.142:0/309152770 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298c19e3e0 con 0x7f298c073940 2024-04-20T22:02:34.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.823+0000 7f2991200700 1 -- 172.21.15.142:0/309152770 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298c192990 con 0x7f298c073940 2024-04-20T22:02:34.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.825+0000 7f2982a00700 1 -- 172.21.15.142:0/309152770 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f297c00f820 con 0x7f298c073940 2024-04-20T22:02:34.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.826+0000 7f2982a00700 1 --2- 172.21.15.142:0/309152770 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f297006ed10 0x7f29700711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:34.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.826+0000 7f2982a00700 1 -- 172.21.15.142:0/309152770 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f297c08fed0 con 0x7f298c073940 2024-04-20T22:02:34.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.826+0000 7f2989400700 1 --2- 172.21.15.142:0/309152770 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f297006ed10 0x7f29700711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:34.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.827+0000 7f2989400700 1 --2- 172.21.15.142:0/309152770 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f297006ed10 0x7f29700711d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f298c074c40 tx=0x7f2978009470 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:34.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:34.830+0000 7f2982a00700 1 -- 172.21.15.142:0/309152770 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f297c05c930 con 0x7f298c073940 2024-04-20T22:02:35.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.069+0000 7f2991200700 1 -- 172.21.15.142:0/309152770 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f298c02ce50 con 0x7f297006ed10 2024-04-20T22:02:35.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.087+0000 7f2982a00700 1 -- 172.21.15.142:0/309152770 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f298c02ce50 con 0x7f297006ed10 2024-04-20T22:02:35.087 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:02:35.087 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (13m) 29s ago 15m 13.5M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T22:02:35.088 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (15m) 29s ago 15m 8204k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T22:02:35.088 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (14m) 32s ago 14m 7784k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T22:02:35.088 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (45s) 29s ago 15m 6665k - 19.0.0-3133-ga8c84f59 76bc6b91b726 64521ed7125b 2024-04-20T22:02:35.088 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (37s) 32s ago 14m 6656k - 19.0.0-3133-ga8c84f59 76bc6b91b726 893c6f16ee6d 2024-04-20T22:02:35.088 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (13m) 29s ago 14m 75.1M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T22:02:35.088 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (8m) 29s ago 7m 141M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 b68e279d7945 2024-04-20T22:02:35.088 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (7m) 29s ago 7m 15.8M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T22:02:35.088 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (7m) 32s ago 7m 15.7M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T22:02:35.088 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (7m) 32s ago 7m 16.1M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T22:02:35.088 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (4m) 29s ago 16m 500M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:02:35.088 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (2m) 32s ago 13m 451M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:02:35.088 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (2m) 29s ago 17m 44.9M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 af10a542c918 2024-04-20T22:02:35.088 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (115s) 32s ago 13m 33.5M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 133512694d46 2024-04-20T22:02:35.088 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (15m) 29s ago 15m 8212k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T22:02:35.089 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (13m) 32s ago 13m 7990k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T22:02:35.089 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 starting - - - 1216M 2024-04-20T22:02:35.089 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (12m) 29s ago 12m 236M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 dd7e7cf8e8e1 2024-04-20T22:02:35.089 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (11m) 29s ago 11m 210M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 8e9165365127 2024-04-20T22:02:35.089 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (10m) 32s ago 10m 293M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c081911f56ab 2024-04-20T22:02:35.089 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (10m) 32s ago 10m 249M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 39e09d63d44f 2024-04-20T22:02:35.089 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (9m) 32s ago 9m 229M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4f36124aeb0d 2024-04-20T22:02:35.089 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (3m) 29s ago 14m 69.0M - 2.43.0 a07b618ecd1d 46b76c20eae5 2024-04-20T22:02:35.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.090+0000 7f2991200700 1 -- 172.21.15.142:0/309152770 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f297006ed10 msgr2=0x7f29700711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:35.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.090+0000 7f2991200700 1 --2- 172.21.15.142:0/309152770 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f297006ed10 0x7f29700711d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f298c074c40 tx=0x7f2978009470 comp rx=0 tx=0).stop 2024-04-20T22:02:35.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.090+0000 7f2991200700 1 -- 172.21.15.142:0/309152770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f298c073940 msgr2=0x7f298c198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:35.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.090+0000 7f2991200700 1 --2- 172.21.15.142:0/309152770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f298c073940 0x7f298c198870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f297c00bd70 tx=0x7f297c00be50 comp rx=0 tx=0).stop 2024-04-20T22:02:35.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.090+0000 7f2991200700 1 -- 172.21.15.142:0/309152770 shutdown_connections 2024-04-20T22:02:35.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.090+0000 7f2991200700 1 --2- 172.21.15.142:0/309152770 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f297006ed10 0x7f29700711d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:35.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.090+0000 7f2991200700 1 --2- 172.21.15.142:0/309152770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f298c073940 0x7f298c198870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:35.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.090+0000 7f2991200700 1 --2- 172.21.15.142:0/309152770 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f298c074f10 0x7f298c198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:35.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.090+0000 7f2991200700 1 -- 172.21.15.142:0/309152770 >> 172.21.15.142:0/309152770 conn(0x7f298c0fc1c0 msgr2=0x7f298c106e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:35.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.091+0000 7f2991200700 1 -- 172.21.15.142:0/309152770 shutdown_connections 2024-04-20T22:02:35.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.091+0000 7f2991200700 1 -- 172.21.15.142:0/309152770 wait complete. 2024-04-20T22:02:35.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.260+0000 7f187d400700 1 -- 172.21.15.142:0/1066071498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1878100c20 msgr2=0x7f1878101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:35.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.260+0000 7f187d400700 1 --2- 172.21.15.142:0/1066071498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1878100c20 0x7f1878101040 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1868009910 tx=0x7f1868009c20 comp rx=0 tx=0).stop 2024-04-20T22:02:35.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.260+0000 7f187d400700 1 -- 172.21.15.142:0/1066071498 shutdown_connections 2024-04-20T22:02:35.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.260+0000 7f187d400700 1 --2- 172.21.15.142:0/1066071498 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1878101e20 0x7f1878102280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:35.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.260+0000 7f187d400700 1 --2- 172.21.15.142:0/1066071498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1878100c20 0x7f1878101040 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:35.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.260+0000 7f187d400700 1 -- 172.21.15.142:0/1066071498 >> 172.21.15.142:0/1066071498 conn(0x7f18780fc1c0 msgr2=0x7f18780fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:35.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.260+0000 7f187d400700 1 -- 172.21.15.142:0/1066071498 shutdown_connections 2024-04-20T22:02:35.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.260+0000 7f187d400700 1 -- 172.21.15.142:0/1066071498 wait complete. 2024-04-20T22:02:35.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.262+0000 7f187d400700 1 Processor -- start 2024-04-20T22:02:35.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.262+0000 7f187d400700 1 -- start start 2024-04-20T22:02:35.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.262+0000 7f187d400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1878100c20 0x7f1878196660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:35.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.262+0000 7f187d400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1878101e20 0x7f1878196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:35.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.262+0000 7f187d400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18781971c0 con 0x7f1878100c20 2024-04-20T22:02:35.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.262+0000 7f187d400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1878197300 con 0x7f1878101e20 2024-04-20T22:02:35.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.263+0000 7f1876800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1878100c20 0x7f1878196660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:35.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.263+0000 7f1876800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1878100c20 0x7f1878196660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47024/0 (socket says 172.21.15.142:47024) 2024-04-20T22:02:35.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.263+0000 7f1876800700 1 -- 172.21.15.142:0/323748644 learned_addr learned my addr 172.21.15.142:0/323748644 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:02:35.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.263+0000 7f1875e00700 1 --2- 172.21.15.142:0/323748644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1878101e20 0x7f1878196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:35.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.263+0000 7f1876800700 1 -- 172.21.15.142:0/323748644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1878101e20 msgr2=0x7f1878196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:35.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.263+0000 7f1876800700 1 --2- 172.21.15.142:0/323748644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1878101e20 0x7f1878196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:35.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.263+0000 7f1876800700 1 -- 172.21.15.142:0/323748644 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18680095f0 con 0x7f1878100c20 2024-04-20T22:02:35.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.264+0000 7f1876800700 1 --2- 172.21.15.142:0/323748644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1878100c20 0x7f1878196660 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f186800bd70 tx=0x7f186800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:35.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.264+0000 7f186f400700 1 -- 172.21.15.142:0/323748644 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f186801d070 con 0x7f1878100c20 2024-04-20T22:02:35.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.264+0000 7f186f400700 1 -- 172.21.15.142:0/323748644 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1868005dc0 con 0x7f1878100c20 2024-04-20T22:02:35.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.264+0000 7f186f400700 1 -- 172.21.15.142:0/323748644 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1868021410 con 0x7f1878100c20 2024-04-20T22:02:35.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.264+0000 7f187d400700 1 -- 172.21.15.142:0/323748644 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187819bcb0 con 0x7f1878100c20 2024-04-20T22:02:35.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.264+0000 7f187d400700 1 -- 172.21.15.142:0/323748644 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187819c1a0 con 0x7f1878100c20 2024-04-20T22:02:35.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.265+0000 7f187d400700 1 -- 172.21.15.142:0/323748644 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18781907a0 con 0x7f1878100c20 2024-04-20T22:02:35.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.267+0000 7f186f400700 1 -- 172.21.15.142:0/323748644 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f186800f820 con 0x7f1878100c20 2024-04-20T22:02:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.268+0000 7f186f400700 1 --2- 172.21.15.142:0/323748644 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f185c06ecc0 0x7f185c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.268+0000 7f186f400700 1 -- 172.21.15.142:0/323748644 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f186808fff0 con 0x7f1878100c20 2024-04-20T22:02:35.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.269+0000 7f1875e00700 1 --2- 172.21.15.142:0/323748644 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f185c06ecc0 0x7f185c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:35.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.269+0000 7f1875e00700 1 --2- 172.21.15.142:0/323748644 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f185c06ecc0 0x7f185c071180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1864005950 tx=0x7f18640058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:35.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.273+0000 7f186f400700 1 -- 172.21.15.142:0/323748644 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f186805c930 con 0x7f1878100c20 2024-04-20T22:02:35.369 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:35 smithi142 ceph-mon[79401]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:02:35.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:35 smithi164 ceph-mon[69784]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:02:35.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.608+0000 7f187d400700 1 -- 172.21.15.142:0/323748644 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1878062560 con 0x7f1878100c20 2024-04-20T22:02:35.608 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.608+0000 7f186f400700 1 -- 172.21.15.142:0/323748644 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+732 (secure 0 0 0) 0x7f186805c4c0 con 0x7f1878100c20 2024-04-20T22:02:35.608 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:02:35.608 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:02:35.608 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:02:35.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:02:35.609 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:02:35.609 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:02:35.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:02:35.609 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:02:35.609 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 5 2024-04-20T22:02:35.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:02:35.609 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:02:35.609 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4 2024-04-20T22:02:35.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:02:35.609 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:02:35.609 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 9, 2024-04-20T22:02:35.609 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 4 2024-04-20T22:02:35.610 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:02:35.610 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:02:35.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.611+0000 7f187d400700 1 -- 172.21.15.142:0/323748644 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f185c06ecc0 msgr2=0x7f185c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:35.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.611+0000 7f187d400700 1 --2- 172.21.15.142:0/323748644 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f185c06ecc0 0x7f185c071180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1864005950 tx=0x7f18640058e0 comp rx=0 tx=0).stop 2024-04-20T22:02:35.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.611+0000 7f187d400700 1 -- 172.21.15.142:0/323748644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1878100c20 msgr2=0x7f1878196660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:35.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.611+0000 7f187d400700 1 --2- 172.21.15.142:0/323748644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1878100c20 0x7f1878196660 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f186800bd70 tx=0x7f186800be50 comp rx=0 tx=0).stop 2024-04-20T22:02:35.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.611+0000 7f187d400700 1 -- 172.21.15.142:0/323748644 shutdown_connections 2024-04-20T22:02:35.611 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.611+0000 7f187d400700 1 --2- 172.21.15.142:0/323748644 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f185c06ecc0 0x7f185c071180 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:35.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.611+0000 7f187d400700 1 --2- 172.21.15.142:0/323748644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1878100c20 0x7f1878196660 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:35.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.611+0000 7f187d400700 1 --2- 172.21.15.142:0/323748644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1878101e20 0x7f1878196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:35.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.611+0000 7f187d400700 1 -- 172.21.15.142:0/323748644 >> 172.21.15.142:0/323748644 conn(0x7f18780fc1c0 msgr2=0x7f18781053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:35.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.611+0000 7f187d400700 1 -- 172.21.15.142:0/323748644 shutdown_connections 2024-04-20T22:02:35.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.612+0000 7f187d400700 1 -- 172.21.15.142:0/323748644 wait complete. 2024-04-20T22:02:35.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.762+0000 7fdb14e00700 1 -- 172.21.15.142:0/2560030923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb10074f10 msgr2=0x7fdb10073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:35.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.762+0000 7fdb14e00700 1 --2- 172.21.15.142:0/2560030923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb10074f10 0x7fdb10073370 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdb00009910 tx=0x7fdb00009c20 comp rx=0 tx=0).stop 2024-04-20T22:02:35.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.763+0000 7fdb14e00700 1 -- 172.21.15.142:0/2560030923 shutdown_connections 2024-04-20T22:02:35.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.763+0000 7fdb14e00700 1 --2- 172.21.15.142:0/2560030923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb10073940 0x7fdb10073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:35.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.763+0000 7fdb14e00700 1 --2- 172.21.15.142:0/2560030923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb10074f10 0x7fdb10073370 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:35.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.763+0000 7fdb14e00700 1 -- 172.21.15.142:0/2560030923 >> 172.21.15.142:0/2560030923 conn(0x7fdb100fc000 msgr2=0x7fdb100fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:35.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.763+0000 7fdb14e00700 1 -- 172.21.15.142:0/2560030923 shutdown_connections 2024-04-20T22:02:35.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.763+0000 7fdb14e00700 1 -- 172.21.15.142:0/2560030923 wait complete. 2024-04-20T22:02:35.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.764+0000 7fdb14e00700 1 Processor -- start 2024-04-20T22:02:35.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.764+0000 7fdb14e00700 1 -- start start 2024-04-20T22:02:35.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.765+0000 7fdb14e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb10073940 0x7fdb101986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:35.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.765+0000 7fdb14e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb10074f10 0x7fdb10198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:35.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.765+0000 7fdb14e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb10199200 con 0x7fdb10074f10 2024-04-20T22:02:35.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.765+0000 7fdb14e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb10199340 con 0x7fdb10073940 2024-04-20T22:02:35.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.765+0000 7fdb0ea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb10074f10 0x7fdb10198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:35.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.765+0000 7fdb0ea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb10074f10 0x7fdb10198be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47042/0 (socket says 172.21.15.142:47042) 2024-04-20T22:02:35.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.765+0000 7fdb0ea00700 1 -- 172.21.15.142:0/1866230653 learned_addr learned my addr 172.21.15.142:0/1866230653 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:02:35.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.765+0000 7fdb0f400700 1 --2- 172.21.15.142:0/1866230653 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb10073940 0x7fdb101986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:35.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.766+0000 7fdb0ea00700 1 -- 172.21.15.142:0/1866230653 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb10073940 msgr2=0x7fdb101986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:35.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.766+0000 7fdb0ea00700 1 --2- 172.21.15.142:0/1866230653 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb10073940 0x7fdb101986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:35.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.766+0000 7fdb0ea00700 1 -- 172.21.15.142:0/1866230653 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb000095f0 con 0x7fdb10074f10 2024-04-20T22:02:35.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.766+0000 7fdb0ea00700 1 --2- 172.21.15.142:0/1866230653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb10074f10 0x7fdb10198be0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00c8f0 tx=0x7fdafc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:35.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.766+0000 7fdb07e00700 1 -- 172.21.15.142:0/1866230653 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdafc007a70 con 0x7fdb10074f10 2024-04-20T22:02:35.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.766+0000 7fdb07e00700 1 -- 172.21.15.142:0/1866230653 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdafc007bd0 con 0x7fdb10074f10 2024-04-20T22:02:35.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.766+0000 7fdb14e00700 1 -- 172.21.15.142:0/1866230653 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1019dd50 con 0x7fdb10074f10 2024-04-20T22:02:35.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.767+0000 7fdb14e00700 1 -- 172.21.15.142:0/1866230653 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1019e320 con 0x7fdb10074f10 2024-04-20T22:02:35.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.767+0000 7fdb07e00700 1 -- 172.21.15.142:0/1866230653 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdafc018630 con 0x7fdb10074f10 2024-04-20T22:02:35.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.768+0000 7fdb05600700 1 -- 172.21.15.142:0/1866230653 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf0005320 con 0x7fdb10074f10 2024-04-20T22:02:35.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.769+0000 7fdb07e00700 1 -- 172.21.15.142:0/1866230653 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fdafc018870 con 0x7fdb10074f10 2024-04-20T22:02:35.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.770+0000 7fdb07e00700 1 --2- 172.21.15.142:0/1866230653 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdaf406ecc0 0x7fdaf4071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:35.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.770+0000 7fdb07e00700 1 -- 172.21.15.142:0/1866230653 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdafc08ecd0 con 0x7fdb10074f10 2024-04-20T22:02:35.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.770+0000 7fdb0f400700 1 --2- 172.21.15.142:0/1866230653 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdaf406ecc0 0x7fdaf4071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:35.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.771+0000 7fdb0f400700 1 --2- 172.21.15.142:0/1866230653 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdaf406ecc0 0x7fdaf4071180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdb00006010 tx=0x7fdb0000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:35.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:35.778+0000 7fdb07e00700 1 -- 172.21.15.142:0/1866230653 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fdafc007d40 con 0x7fdb10074f10 2024-04-20T22:02:36.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.105+0000 7fdb05600700 1 -- 172.21.15.142:0/1866230653 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdaf0005de0 con 0x7fdb10074f10 2024-04-20T22:02:36.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.105+0000 7fdb07e00700 1 -- 172.21.15.142:0/1866230653 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1898 (secure 0 0 0) 0x7fdafc007d40 con 0x7fdb10074f10 2024-04-20T22:02:36.105 INFO:teuthology.orchestra.run.smithi142.stdout:e12 2024-04-20T22:02:36.105 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:02:36.105 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:02:36.105 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T22:02:36.106 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:02:36.106 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T22:02:36.106 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T22:02:36.106 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 12 2024-04-20T22:02:36.106 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:02:36.106 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:02:36.106 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:51.692699+0000 2024-04-20T22:02:36.106 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T22:02:36.106 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T22:02:36.106 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T22:02:36.106 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T22:02:36.106 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T22:02:36.106 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T22:02:36.107 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T22:02:36.107 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T22:02:36.107 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T22:02:36.107 INFO:teuthology.orchestra.run.smithi142.stdout:snap_rstat 1 2024-04-20T22:02:36.107 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:02:36.107 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T22:02:36.107 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T22:02:36.107 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T22:02:36.107 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T22:02:36.107 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T22:02:36.107 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T22:02:36.107 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T22:02:36.107 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T22:02:36.107 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T22:02:36.107 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T22:02:36.107 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T22:02:36.108 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T22:02:36.108 INFO:teuthology.orchestra.run.smithi142.stdout:qdb_cluster leader: 0 members: 2024-04-20T22:02:36.108 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:02:36.108 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:02:36.108 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:02:36.108 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T22:02:36.108 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:02:36.108 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:02:36.108 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:02:36.108 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:02:36.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.109+0000 7fdb05600700 1 -- 172.21.15.142:0/1866230653 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdaf406ecc0 msgr2=0x7fdaf4071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:36.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.109+0000 7fdb05600700 1 --2- 172.21.15.142:0/1866230653 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdaf406ecc0 0x7fdaf4071180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdb00006010 tx=0x7fdb0000b540 comp rx=0 tx=0).stop 2024-04-20T22:02:36.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.109+0000 7fdb05600700 1 -- 172.21.15.142:0/1866230653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb10074f10 msgr2=0x7fdb10198be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:36.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.109+0000 7fdb05600700 1 --2- 172.21.15.142:0/1866230653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb10074f10 0x7fdb10198be0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00c8f0 tx=0x7fdafc00ccb0 comp rx=0 tx=0).stop 2024-04-20T22:02:36.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.110+0000 7fdb05600700 1 -- 172.21.15.142:0/1866230653 shutdown_connections 2024-04-20T22:02:36.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.110+0000 7fdb05600700 1 --2- 172.21.15.142:0/1866230653 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdaf406ecc0 0x7fdaf4071180 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:36.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.110+0000 7fdb05600700 1 --2- 172.21.15.142:0/1866230653 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb10073940 0x7fdb101986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:36.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.110+0000 7fdb05600700 1 --2- 172.21.15.142:0/1866230653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb10074f10 0x7fdb10198be0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:36.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.110+0000 7fdb05600700 1 -- 172.21.15.142:0/1866230653 >> 172.21.15.142:0/1866230653 conn(0x7fdb100fc000 msgr2=0x7fdb10106bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:36.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.110+0000 7fdb05600700 1 -- 172.21.15.142:0/1866230653 shutdown_connections 2024-04-20T22:02:36.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.110+0000 7fdb05600700 1 -- 172.21.15.142:0/1866230653 wait complete. 2024-04-20T22:02:36.110 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T22:02:36.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.272+0000 7f755ce00700 1 -- 172.21.15.142:0/706200535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7558103fb0 msgr2=0x7f75581063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:36.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.272+0000 7f755ce00700 1 --2- 172.21.15.142:0/706200535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7558103fb0 0x7f75581063a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7544009910 tx=0x7f7544009c20 comp rx=0 tx=0).stop 2024-04-20T22:02:36.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.272+0000 7f755ce00700 1 -- 172.21.15.142:0/706200535 shutdown_connections 2024-04-20T22:02:36.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.272+0000 7f755ce00700 1 --2- 172.21.15.142:0/706200535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7558103fb0 0x7f75581063a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:36.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.272+0000 7f755ce00700 1 --2- 172.21.15.142:0/706200535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7558101680 0x7f7558103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:36.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.272+0000 7f755ce00700 1 -- 172.21.15.142:0/706200535 >> 172.21.15.142:0/706200535 conn(0x7f75580fb0d0 msgr2=0x7f75580fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:36.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.272+0000 7f755ce00700 1 -- 172.21.15.142:0/706200535 shutdown_connections 2024-04-20T22:02:36.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.273+0000 7f755ce00700 1 -- 172.21.15.142:0/706200535 wait complete. 2024-04-20T22:02:36.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.274+0000 7f755ce00700 1 Processor -- start 2024-04-20T22:02:36.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.274+0000 7f755ce00700 1 -- start start 2024-04-20T22:02:36.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.274+0000 7f755ce00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7558101680 0x7f7558196590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:36.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.274+0000 7f755ce00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7558103fb0 0x7f7558196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:36.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.274+0000 7f755ce00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75581970f0 con 0x7f7558103fb0 2024-04-20T22:02:36.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.274+0000 7f755ce00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7558197230 con 0x7f7558101680 2024-04-20T22:02:36.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.275+0000 7f7555400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7558103fb0 0x7f7558196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:36.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.275+0000 7f7555400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7558103fb0 0x7f7558196ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47080/0 (socket says 172.21.15.142:47080) 2024-04-20T22:02:36.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.275+0000 7f7555400700 1 -- 172.21.15.142:0/10636990 learned_addr learned my addr 172.21.15.142:0/10636990 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:02:36.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.275+0000 7f7555e00700 1 --2- 172.21.15.142:0/10636990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7558101680 0x7f7558196590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:36.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.275+0000 7f7555400700 1 -- 172.21.15.142:0/10636990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7558101680 msgr2=0x7f7558196590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:36.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.275+0000 7f7555400700 1 --2- 172.21.15.142:0/10636990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7558101680 0x7f7558196590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:36.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.275+0000 7f7555400700 1 -- 172.21.15.142:0/10636990 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75440095f0 con 0x7f7558103fb0 2024-04-20T22:02:36.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.276+0000 7f7555400700 1 --2- 172.21.15.142:0/10636990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7558103fb0 0x7f7558196ad0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7544006010 tx=0x7f754400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:36.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.276+0000 7f754ea00700 1 -- 172.21.15.142:0/10636990 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f754401d070 con 0x7f7558103fb0 2024-04-20T22:02:36.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.276+0000 7f754ea00700 1 -- 172.21.15.142:0/10636990 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f754400f460 con 0x7f7558103fb0 2024-04-20T22:02:36.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.276+0000 7f755ce00700 1 -- 172.21.15.142:0/10636990 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755819bc30 con 0x7f7558103fb0 2024-04-20T22:02:36.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.276+0000 7f754ea00700 1 -- 172.21.15.142:0/10636990 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7544021640 con 0x7f7558103fb0 2024-04-20T22:02:36.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.276+0000 7f755ce00700 1 -- 172.21.15.142:0/10636990 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755819c1a0 con 0x7f7558103fb0 2024-04-20T22:02:36.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.277+0000 7f755ce00700 1 -- 172.21.15.142:0/10636990 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7558062510 con 0x7f7558103fb0 2024-04-20T22:02:36.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.280+0000 7f754ea00700 1 -- 172.21.15.142:0/10636990 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f754400fa40 con 0x7f7558103fb0 2024-04-20T22:02:36.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.281+0000 7f754ea00700 1 --2- 172.21.15.142:0/10636990 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f753c06ecc0 0x7f753c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:36.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.281+0000 7f754ea00700 1 -- 172.21.15.142:0/10636990 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7544090400 con 0x7f7558103fb0 2024-04-20T22:02:36.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.281+0000 7f7555e00700 1 --2- 172.21.15.142:0/10636990 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f753c06ecc0 0x7f753c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:36.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.282+0000 7f7555e00700 1 --2- 172.21.15.142:0/10636990 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f753c06ecc0 0x7f753c071180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7548005950 tx=0x7f75480058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:36.286 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.286+0000 7f754ea00700 1 -- 172.21.15.142:0/10636990 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f754405cf80 con 0x7f7558103fb0 2024-04-20T22:02:36.286 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:36 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0[88591]: 2024-04-20T22:02:36.033+0000 7f3520d3c7c0 -1 osd.0 50 log_to_monitors true 2024-04-20T22:02:36.287 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:36 smithi142 ceph-mon[79401]: pgmap v75: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:02:36.287 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:36 smithi142 ceph-mon[79401]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:02:36.287 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:36 smithi142 ceph-mon[79401]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:02:36.287 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:36 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/323748644' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:02:36.287 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:36 smithi142 ceph-mon[79401]: from='osd.0 [v2:172.21.15.142:6802/838783033,v1:172.21.15.142:6803/838783033]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-20T22:02:36.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:36 smithi164 ceph-mon[69784]: pgmap v75: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:02:36.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:36 smithi164 ceph-mon[69784]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:02:36.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:36 smithi164 ceph-mon[69784]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:02:36.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:36 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/323748644' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:02:36.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:36 smithi164 ceph-mon[69784]: from='osd.0 [v2:172.21.15.142:6802/838783033,v1:172.21.15.142:6803/838783033]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-20T22:02:36.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.637+0000 7f755ce00700 1 -- 172.21.15.142:0/10636990 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7558105e90 con 0x7f753c06ecc0 2024-04-20T22:02:36.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.639+0000 7f754ea00700 1 -- 172.21.15.142:0/10636990 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7558105e90 con 0x7f753c06ecc0 2024-04-20T22:02:36.638 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:02:36.638 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T22:02:36.638 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T22:02:36.639 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T22:02:36.639 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T22:02:36.639 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr", 2024-04-20T22:02:36.639 INFO:teuthology.orchestra.run.smithi142.stdout: "mon", 2024-04-20T22:02:36.639 INFO:teuthology.orchestra.run.smithi142.stdout: "crash" 2024-04-20T22:02:36.639 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T22:02:36.639 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "6/23 daemons upgraded", 2024-04-20T22:02:36.639 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading osd daemons", 2024-04-20T22:02:36.639 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T22:02:36.639 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:02:36.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.641+0000 7f755ce00700 1 -- 172.21.15.142:0/10636990 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f753c06ecc0 msgr2=0x7f753c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:36.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.641+0000 7f755ce00700 1 --2- 172.21.15.142:0/10636990 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f753c06ecc0 0x7f753c071180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7548005950 tx=0x7f75480058e0 comp rx=0 tx=0).stop 2024-04-20T22:02:36.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.641+0000 7f755ce00700 1 -- 172.21.15.142:0/10636990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7558103fb0 msgr2=0x7f7558196ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:36.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.641+0000 7f755ce00700 1 --2- 172.21.15.142:0/10636990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7558103fb0 0x7f7558196ad0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7544006010 tx=0x7f754400be20 comp rx=0 tx=0).stop 2024-04-20T22:02:36.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.642+0000 7f755ce00700 1 -- 172.21.15.142:0/10636990 shutdown_connections 2024-04-20T22:02:36.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.642+0000 7f755ce00700 1 --2- 172.21.15.142:0/10636990 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f753c06ecc0 0x7f753c071180 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:36.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.642+0000 7f755ce00700 1 --2- 172.21.15.142:0/10636990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7558101680 0x7f7558196590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:36.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.642+0000 7f755ce00700 1 --2- 172.21.15.142:0/10636990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7558103fb0 0x7f7558196ad0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:36.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.642+0000 7f755ce00700 1 -- 172.21.15.142:0/10636990 >> 172.21.15.142:0/10636990 conn(0x7f75580fb0d0 msgr2=0x7f75580fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:36.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.642+0000 7f755ce00700 1 -- 172.21.15.142:0/10636990 shutdown_connections 2024-04-20T22:02:36.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.642+0000 7f755ce00700 1 -- 172.21.15.142:0/10636990 wait complete. 2024-04-20T22:02:36.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.828+0000 7f1804a00700 1 -- 172.21.15.142:0/4069962750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1800074eb0 msgr2=0x7f1800073310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:36.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.828+0000 7f1804a00700 1 --2- 172.21.15.142:0/4069962750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1800074eb0 0x7f1800073310 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f17f0009910 tx=0x7f17f0009c20 comp rx=0 tx=0).stop 2024-04-20T22:02:36.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.829+0000 7f1804a00700 1 -- 172.21.15.142:0/4069962750 shutdown_connections 2024-04-20T22:02:36.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.829+0000 7f1804a00700 1 --2- 172.21.15.142:0/4069962750 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18000738e0 0x7f1800073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:36.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.829+0000 7f1804a00700 1 --2- 172.21.15.142:0/4069962750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1800074eb0 0x7f1800073310 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:36.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.829+0000 7f1804a00700 1 -- 172.21.15.142:0/4069962750 >> 172.21.15.142:0/4069962750 conn(0x7f18000fc1e0 msgr2=0x7f18000fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:36.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.829+0000 7f1804a00700 1 -- 172.21.15.142:0/4069962750 shutdown_connections 2024-04-20T22:02:36.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.829+0000 7f1804a00700 1 -- 172.21.15.142:0/4069962750 wait complete. 2024-04-20T22:02:36.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.830+0000 7f1804a00700 1 Processor -- start 2024-04-20T22:02:36.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.830+0000 7f1804a00700 1 -- start start 2024-04-20T22:02:36.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.830+0000 7f1804a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18000738e0 0x7f1800198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:36.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.831+0000 7f1804a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1800074eb0 0x7f1800198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:36.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.831+0000 7f1804a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1800199380 con 0x7f18000738e0 2024-04-20T22:02:36.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.831+0000 7f1804a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18001994c0 con 0x7f1800074eb0 2024-04-20T22:02:36.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.831+0000 7f17fde00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18000738e0 0x7f1800198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:36.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.831+0000 7f17fde00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18000738e0 0x7f1800198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47106/0 (socket says 172.21.15.142:47106) 2024-04-20T22:02:36.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.831+0000 7f17fde00700 1 -- 172.21.15.142:0/914392583 learned_addr learned my addr 172.21.15.142:0/914392583 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:02:36.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.832+0000 7f17fd400700 1 --2- 172.21.15.142:0/914392583 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1800074eb0 0x7f1800198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:36.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.832+0000 7f17fde00700 1 -- 172.21.15.142:0/914392583 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1800074eb0 msgr2=0x7f1800198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:36.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.832+0000 7f17fde00700 1 --2- 172.21.15.142:0/914392583 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1800074eb0 0x7f1800198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:36.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.832+0000 7f17fde00700 1 -- 172.21.15.142:0/914392583 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f00095f0 con 0x7f18000738e0 2024-04-20T22:02:36.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.832+0000 7f17fd400700 1 --2- 172.21.15.142:0/914392583 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1800074eb0 0x7f1800198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T22:02:36.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.833+0000 7f17fde00700 1 --2- 172.21.15.142:0/914392583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18000738e0 0x7f1800198820 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f17f000bd70 tx=0x7f17f000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:36.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.833+0000 7f17f6a00700 1 -- 172.21.15.142:0/914392583 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17f001d070 con 0x7f18000738e0 2024-04-20T22:02:36.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.833+0000 7f17f6a00700 1 -- 172.21.15.142:0/914392583 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17f000f460 con 0x7f18000738e0 2024-04-20T22:02:36.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.833+0000 7f1804a00700 1 -- 172.21.15.142:0/914392583 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180006aa40 con 0x7f18000738e0 2024-04-20T22:02:36.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.833+0000 7f1804a00700 1 -- 172.21.15.142:0/914392583 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180006afb0 con 0x7f18000738e0 2024-04-20T22:02:36.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.833+0000 7f17f6a00700 1 -- 172.21.15.142:0/914392583 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17f0021620 con 0x7f18000738e0 2024-04-20T22:02:36.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.835+0000 7f1804a00700 1 -- 172.21.15.142:0/914392583 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e0005320 con 0x7f18000738e0 2024-04-20T22:02:36.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.837+0000 7f17f6a00700 1 -- 172.21.15.142:0/914392583 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f17f000fa70 con 0x7f18000738e0 2024-04-20T22:02:36.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.838+0000 7f17f6a00700 1 --2- 172.21.15.142:0/914392583 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f17e406ed10 0x7f17e40711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:02:36.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.838+0000 7f17f6a00700 1 -- 172.21.15.142:0/914392583 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f17f008ffc0 con 0x7f18000738e0 2024-04-20T22:02:36.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.839+0000 7f17fd400700 1 --2- 172.21.15.142:0/914392583 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f17e406ed10 0x7f17e40711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:02:36.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.840+0000 7f17fd400700 1 --2- 172.21.15.142:0/914392583 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f17e406ed10 0x7f17e40711d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f17ec005950 tx=0x7f17ec005f50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:02:36.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:36.844+0000 7f17f6a00700 1 -- 172.21.15.142:0/914392583 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f17f005ca20 con 0x7f18000738e0 2024-04-20T22:02:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:37.214+0000 7f1804a00700 1 -- 172.21.15.142:0/914392583 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f17e0005190 con 0x7f18000738e0 2024-04-20T22:02:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:37.215+0000 7f17f6a00700 1 -- 172.21.15.142:0/914392583 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1271 (secure 0 0 0) 0x7f17f005c5b0 con 0x7f18000738e0 2024-04-20T22:02:37.215 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 41/231 objects degraded (17.749%), 18 pgs degraded 2024-04-20T22:02:37.215 INFO:teuthology.orchestra.run.smithi142.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-20T22:02:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: osd.0 (root=default,host=smithi142) is down 2024-04-20T22:02:37.215 INFO:teuthology.orchestra.run.smithi142.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 41/231 objects degraded (17.749%), 18 pgs degraded 2024-04-20T22:02:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-04-20T22:02:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-04-20T22:02:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-04-20T22:02:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-04-20T22:02:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-04-20T22:02:37.215 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-04-20T22:02:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-04-20T22:02:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-04-20T22:02:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-04-20T22:02:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-04-20T22:02:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-04-20T22:02:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-04-20T22:02:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-04-20T22:02:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-04-20T22:02:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-04-20T22:02:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-04-20T22:02:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-04-20T22:02:37.216 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-04-20T22:02:37.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:37.218+0000 7f1804a00700 1 -- 172.21.15.142:0/914392583 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f17e406ed10 msgr2=0x7f17e40711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:37.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:37.218+0000 7f1804a00700 1 --2- 172.21.15.142:0/914392583 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f17e406ed10 0x7f17e40711d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f17ec005950 tx=0x7f17ec005f50 comp rx=0 tx=0).stop 2024-04-20T22:02:37.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:37.218+0000 7f1804a00700 1 -- 172.21.15.142:0/914392583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18000738e0 msgr2=0x7f1800198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:02:37.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:37.218+0000 7f1804a00700 1 --2- 172.21.15.142:0/914392583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18000738e0 0x7f1800198820 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f17f000bd70 tx=0x7f17f000be50 comp rx=0 tx=0).stop 2024-04-20T22:02:37.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:37.218+0000 7f1804a00700 1 -- 172.21.15.142:0/914392583 shutdown_connections 2024-04-20T22:02:37.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:37.218+0000 7f1804a00700 1 --2- 172.21.15.142:0/914392583 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f17e406ed10 0x7f17e40711d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:37.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:37.218+0000 7f1804a00700 1 --2- 172.21.15.142:0/914392583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18000738e0 0x7f1800198820 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:37.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:37.218+0000 7f1804a00700 1 --2- 172.21.15.142:0/914392583 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1800074eb0 0x7f1800198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:02:37.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:37.218+0000 7f1804a00700 1 -- 172.21.15.142:0/914392583 >> 172.21.15.142:0/914392583 conn(0x7f18000fc1e0 msgr2=0x7f1800106e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:02:37.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:37.219+0000 7f1804a00700 1 -- 172.21.15.142:0/914392583 shutdown_connections 2024-04-20T22:02:37.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:02:37.219+0000 7f1804a00700 1 -- 172.21.15.142:0/914392583 wait complete. 2024-04-20T22:02:37.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:37 smithi164 ceph-mon[69784]: from='osd.0 [v2:172.21.15.142:6802/838783033,v1:172.21.15.142:6803/838783033]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-20T22:02:37.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:37 smithi164 ceph-mon[69784]: osdmap e53: 6 total, 5 up, 6 in 2024-04-20T22:02:37.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:37 smithi164 ceph-mon[69784]: from='osd.0 [v2:172.21.15.142:6802/838783033,v1:172.21.15.142:6803/838783033]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-04-20T22:02:37.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:37 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/1866230653' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:02:37.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:37 smithi142 ceph-mon[79401]: from='osd.0 [v2:172.21.15.142:6802/838783033,v1:172.21.15.142:6803/838783033]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-20T22:02:37.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:37 smithi142 ceph-mon[79401]: osdmap e53: 6 total, 5 up, 6 in 2024-04-20T22:02:37.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:37 smithi142 ceph-mon[79401]: from='osd.0 [v2:172.21.15.142:6802/838783033,v1:172.21.15.142:6803/838783033]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-04-20T22:02:37.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:37 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1866230653' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:02:37.447 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:02:37 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0[88591]: 2024-04-20T22:02:37.084+0000 7f350b000700 -1 osd.0 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T22:02:38.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:38 smithi142 ceph-mon[79401]: pgmap v77: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:02:38.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:38 smithi142 ceph-mon[79401]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:02:38.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:38 smithi142 ceph-mon[79401]: from='osd.0 [v2:172.21.15.142:6802/838783033,v1:172.21.15.142:6803/838783033]' entity='osd.0' 2024-04-20T22:02:38.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:38 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/914392583' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:02:38.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:38 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:38.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:38 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:38.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:38 smithi164 ceph-mon[69784]: pgmap v77: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:02:38.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:38 smithi164 ceph-mon[69784]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:02:38.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:38 smithi164 ceph-mon[69784]: from='osd.0 [v2:172.21.15.142:6802/838783033,v1:172.21.15.142:6803/838783033]' entity='osd.0' 2024-04-20T22:02:38.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:38 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/914392583' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:02:38.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:38 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:38.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:38 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:39.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:39 smithi142 ceph-mon[79401]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-20T22:02:39.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:39 smithi142 ceph-mon[79401]: osd.0 [v2:172.21.15.142:6802/838783033,v1:172.21.15.142:6803/838783033] boot 2024-04-20T22:02:39.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:39 smithi142 ceph-mon[79401]: osdmap e54: 6 total, 6 up, 6 in 2024-04-20T22:02:39.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:39 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T22:02:39.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:39 smithi164 ceph-mon[69784]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-20T22:02:39.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:39 smithi164 ceph-mon[69784]: osd.0 [v2:172.21.15.142:6802/838783033,v1:172.21.15.142:6803/838783033] boot 2024-04-20T22:02:39.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:39 smithi164 ceph-mon[69784]: osdmap e54: 6 total, 6 up, 6 in 2024-04-20T22:02:39.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:39 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T22:02:40.174 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:40 smithi142 ceph-mon[79401]: pgmap v79: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:02:40.174 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:40 smithi142 ceph-mon[79401]: osdmap e55: 6 total, 6 up, 6 in 2024-04-20T22:02:40.174 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:40 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:40.174 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:40 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:40.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:40 smithi164 ceph-mon[69784]: pgmap v79: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:02:40.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:40 smithi164 ceph-mon[69784]: osdmap e55: 6 total, 6 up, 6 in 2024-04-20T22:02:40.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:40 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:40.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:40 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:41.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:41 smithi164 ceph-mon[69784]: Health check update: Degraded data redundancy: 7/231 objects degraded (3.030%), 3 pgs degraded (PG_DEGRADED) 2024-04-20T22:02:41.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:41 smithi142 ceph-mon[79401]: Health check update: Degraded data redundancy: 7/231 objects degraded (3.030%), 3 pgs degraded (PG_DEGRADED) 2024-04-20T22:02:42.422 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:42 smithi142 ceph-mon[79401]: pgmap v81: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7/231 objects degraded (3.030%) 2024-04-20T22:02:42.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:42 smithi164 ceph-mon[69784]: pgmap v81: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 7/231 objects degraded (3.030%) 2024-04-20T22:02:43.510 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:43 smithi142 ceph-mon[79401]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/231 objects degraded (3.030%), 3 pgs degraded) 2024-04-20T22:02:43.510 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:43 smithi142 ceph-mon[79401]: Cluster is now healthy 2024-04-20T22:02:43.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:43 smithi164 ceph-mon[69784]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/231 objects degraded (3.030%), 3 pgs degraded) 2024-04-20T22:02:43.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:43 smithi164 ceph-mon[69784]: Cluster is now healthy 2024-04-20T22:02:44.673 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:44 smithi142 ceph-mon[79401]: pgmap v82: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:44.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:44 smithi164 ceph-mon[69784]: pgmap v82: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:45.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:45 smithi164 ceph-mon[69784]: pgmap v83: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:45.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:02:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:02:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:02:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:02:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:02:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:02:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:02:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-20T22:02:45.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:45 smithi142 ceph-mon[79401]: pgmap v83: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:45.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:45.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:02:45.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:45.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:45.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:02:45.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:02:45.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:45.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:02:45.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:02:45.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:02:45.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:02:45.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-20T22:02:46.659 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:46 smithi142 ceph-mon[79401]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-20T22:02:46.659 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:46 smithi142 ceph-mon[79401]: Upgrade: osd.1 is safe to restart 2024-04-20T22:02:46.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:46 smithi164 ceph-mon[69784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-20T22:02:46.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:46 smithi164 ceph-mon[69784]: Upgrade: osd.1 is safe to restart 2024-04-20T22:02:47.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:47 smithi142 ceph-mon[79401]: pgmap v84: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:47.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:47 smithi164 ceph-mon[69784]: pgmap v84: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:48.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:48 smithi142 ceph-mon[79401]: Upgrade: Updating osd.1 2024-04-20T22:02:48.798 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:48 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:48.798 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:48 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-20T22:02:48.798 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:48 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:02:48.798 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:48 smithi142 ceph-mon[79401]: Deploying daemon osd.1 on smithi142 2024-04-20T22:02:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:48 smithi164 ceph-mon[69784]: Upgrade: Updating osd.1 2024-04-20T22:02:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:48 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:48 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-20T22:02:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:48 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:02:48.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:48 smithi164 ceph-mon[69784]: Deploying daemon osd.1 on smithi142 2024-04-20T22:02:49.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:49 smithi164 ceph-mon[69784]: pgmap v85: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:49.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:49 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:49.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:49 smithi142 ceph-mon[79401]: pgmap v85: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:49.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:49 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:51.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:51 smithi142 ceph-mon[79401]: pgmap v86: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:51.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:51 smithi164 ceph-mon[69784]: pgmap v86: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:52.697 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:52 smithi142 systemd[1]: Stopping Ceph osd.1 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:02:53.197 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:52 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1[41926]: 2024-04-20T22:02:52.876+0000 7f7e7ca00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T22:02:53.197 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:52 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1[41926]: 2024-04-20T22:02:52.876+0000 7f7e7ca00700 -1 osd.1 55 *** Got signal Terminated *** 2024-04-20T22:02:53.197 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:52 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1[41926]: 2024-04-20T22:02:52.876+0000 7f7e7ca00700 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T22:02:53.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:53 smithi164 ceph-mon[69784]: pgmap v87: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:53.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:53 smithi164 ceph-mon[69784]: osd.1 marked itself down and dead 2024-04-20T22:02:53.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:53 smithi142 ceph-mon[79401]: pgmap v87: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:53.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:53 smithi142 ceph-mon[79401]: osd.1 marked itself down and dead 2024-04-20T22:02:54.517 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:54 smithi142 podman[93505]: 2024-04-20 22:02:54.222126436 +0000 UTC m=+1.482635942 container died dd7e7cf8e8e1dca14c5bed1e2b518f96b8200f0b9d1a5ab279a6d36008135a1b (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, RELEASE=reef-646b8c7) 2024-04-20T22:02:54.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:54 smithi164 ceph-mon[69784]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-20T22:02:54.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:54 smithi164 ceph-mon[69784]: osdmap e56: 6 total, 5 up, 6 in 2024-04-20T22:02:54.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:54 smithi142 ceph-mon[79401]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-20T22:02:54.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:54 smithi142 ceph-mon[79401]: osdmap e56: 6 total, 5 up, 6 in 2024-04-20T22:02:54.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:54 smithi142 podman[93505]: 2024-04-20 22:02:54.736976454 +0000 UTC m=+1.997485942 container cleanup dd7e7cf8e8e1dca14c5bed1e2b518f96b8200f0b9d1a5ab279a6d36008135a1b (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=reef-646b8c7, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T22:02:54.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:54 smithi142 bash[93505]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1 2024-04-20T22:02:55.446 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:55 smithi142 podman[93524]: 2024-04-20 22:02:55.030402391 +0000 UTC m=+0.789039142 container remove dd7e7cf8e8e1dca14c5bed1e2b518f96b8200f0b9d1a5ab279a6d36008135a1b (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=reef-646b8c7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-20T22:02:55.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:55 smithi164 ceph-mon[69784]: pgmap v89: 65 pgs: 12 stale+active+clean, 53 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:55.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:55 smithi164 ceph-mon[69784]: osdmap e57: 6 total, 5 up, 6 in 2024-04-20T22:02:55.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:55 smithi142 ceph-mon[79401]: pgmap v89: 65 pgs: 12 stale+active+clean, 53 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:02:55.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:55 smithi142 ceph-mon[79401]: osdmap e57: 6 total, 5 up, 6 in 2024-04-20T22:02:55.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:55 smithi142 podman[93613]: 2024-04-20 22:02:55.76142041 +0000 UTC m=+0.034477933 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:02:55.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:55 smithi142 podman[93613]: 2024-04-20 22:02:55.881406115 +0000 UTC m=+0.154463675 container create 1941abaded4be1aad90d6666409a2c20ac9375e4fde64f983dc7f9e9abd869a4 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-20T22:02:56.316 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:56 smithi142 podman[93613]: 2024-04-20 22:02:56.219061753 +0000 UTC m=+0.492119323 container init 1941abaded4be1aad90d6666409a2c20ac9375e4fde64f983dc7f9e9abd869a4 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-20T22:02:56.317 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:56 smithi142 podman[93613]: 2024-04-20 22:02:56.233230895 +0000 UTC m=+0.506288438 container start 1941abaded4be1aad90d6666409a2c20ac9375e4fde64f983dc7f9e9abd869a4 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5) 2024-04-20T22:02:56.674 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:56 smithi142 podman[93613]: 2024-04-20 22:02:56.317391596 +0000 UTC m=+0.590449180 container attach 1941abaded4be1aad90d6666409a2c20ac9375e4fde64f983dc7f9e9abd869a4 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416) 2024-04-20T22:02:56.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:56 smithi142 ceph-mon[79401]: Health check failed: Degraded data redundancy: 28/231 objects degraded (12.121%), 12 pgs degraded (PG_DEGRADED) 2024-04-20T22:02:56.946 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:56 smithi142 podman[93613]: 2024-04-20 22:02:56.675439844 +0000 UTC m=+0.948497457 container died 1941abaded4be1aad90d6666409a2c20ac9375e4fde64f983dc7f9e9abd869a4 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T22:02:57.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:56 smithi164 ceph-mon[69784]: Health check failed: Degraded data redundancy: 28/231 objects degraded (12.121%), 12 pgs degraded (PG_DEGRADED) 2024-04-20T22:02:57.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:57 smithi142 ceph-mon[79401]: pgmap v91: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/231 objects degraded (12.121%) 2024-04-20T22:02:57.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:57 smithi142 podman[93639]: 2024-04-20 22:02:57.58021882 +0000 UTC m=+0.885458211 container remove 1941abaded4be1aad90d6666409a2c20ac9375e4fde64f983dc7f9e9abd869a4 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-deactivate, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-20T22:02:57.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:57 smithi142 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.1.service: Deactivated successfully. 2024-04-20T22:02:57.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:57 smithi142 systemd[1]: Stopped Ceph osd.1 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T22:02:57.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:57 smithi142 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.1.service: Consumed 1min 48.421s CPU time. 2024-04-20T22:02:58.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:57 smithi164 ceph-mon[69784]: pgmap v91: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/231 objects degraded (12.121%) 2024-04-20T22:02:58.356 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:58 smithi142 systemd[1]: Starting Ceph osd.1 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:02:58.695 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:58 smithi142 podman[93745]: 2024-04-20 22:02:58.261012043 +0000 UTC m=+0.031885682 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:02:58.695 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:58 smithi142 podman[93745]: 2024-04-20 22:02:58.37269239 +0000 UTC m=+0.143566065 container create 5fdb8c3dffa999f0df4f841005043e9ec80fb9fd9d1f625bd39c924fb2613405 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-activate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5) 2024-04-20T22:02:58.695 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:58 smithi142 podman[93745]: 2024-04-20 22:02:58.694460691 +0000 UTC m=+0.465334423 container init 5fdb8c3dffa999f0df4f841005043e9ec80fb9fd9d1f625bd39c924fb2613405 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-activate, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-20T22:02:58.946 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:58 smithi142 podman[93745]: 2024-04-20 22:02:58.705836582 +0000 UTC m=+0.476710231 container start 5fdb8c3dffa999f0df4f841005043e9ec80fb9fd9d1f625bd39c924fb2613405 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-20T22:02:58.946 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:58 smithi142 podman[93745]: 2024-04-20 22:02:58.825473644 +0000 UTC m=+0.596347372 container attach 5fdb8c3dffa999f0df4f841005043e9ec80fb9fd9d1f625bd39c924fb2613405 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-activate, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2) 2024-04-20T22:02:59.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:59 smithi142 ceph-mon[79401]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/231 objects degraded (12.121%) 2024-04-20T22:02:59.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:59 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:02:59.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:02:59 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:02:59.946 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:59 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-activate[93759]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:02:59.946 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:59 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-activate[93759]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:02:59.946 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:59 smithi142 bash[93745]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:02:59.946 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:59 smithi142 bash[93745]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:02:59.946 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:59 smithi142 bash[93745]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-20T22:02:59.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:59 smithi142 bash[93745]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-20T22:02:59.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:59 smithi142 bash[93745]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-20T22:02:59.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:59 smithi142 bash[93745]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-20T22:02:59.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:59 smithi142 bash[93745]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-20T22:02:59.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:59 smithi142 bash[93745]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-20T22:02:59.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:59 smithi142 bash[93745]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-20T22:02:59.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:59 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-activate[93759]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-20T22:02:59.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:59 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-activate[93759]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-20T22:02:59.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:59 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-activate[93759]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-20T22:02:59.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:59 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-activate[93759]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-20T22:02:59.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:59 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-activate[93759]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-20T22:02:59.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:59 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-activate[93759]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-20T22:02:59.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:59 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-activate[93759]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-20T22:02:59.947 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:02:59 smithi142 podman[93745]: 2024-04-20 22:02:59.696064197 +0000 UTC m=+1.466937842 container died 5fdb8c3dffa999f0df4f841005043e9ec80fb9fd9d1f625bd39c924fb2613405 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-20T22:03:00.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:59 smithi164 ceph-mon[69784]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/231 objects degraded (12.121%) 2024-04-20T22:03:00.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:59 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:00.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:02:59 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:03:00.696 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:03:00 smithi142 podman[93895]: 2024-04-20 22:03:00.370984057 +0000 UTC m=+0.655831871 container remove 5fdb8c3dffa999f0df4f841005043e9ec80fb9fd9d1f625bd39c924fb2613405 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-20T22:03:00.975 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:03:00 smithi142 podman[93960]: 2024-04-20 22:03:00.617517443 +0000 UTC m=+0.032125710 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:03:00.975 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:03:00 smithi142 podman[93960]: 2024-04-20 22:03:00.730239054 +0000 UTC m=+0.144847358 container create 82bcc0c46762a845d620769fd565225434d170c700ae9b8ef825716918b55633 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-20T22:03:00.975 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:03:00 smithi142 podman[93960]: 2024-04-20 22:03:00.975367051 +0000 UTC m=+0.389975362 container init 82bcc0c46762a845d620769fd565225434d170c700ae9b8ef825716918b55633 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-20T22:03:01.447 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:03:00 smithi142 podman[93960]: 2024-04-20 22:03:00.9868577 +0000 UTC m=+0.401466011 container start 82bcc0c46762a845d620769fd565225434d170c700ae9b8ef825716918b55633 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-04-20T22:03:01.447 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:03:01 smithi142 ceph-osd[93979]: -- 172.21.15.142:0/257936037 <== mon.0 v2:172.21.15.142:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5612d483d680 con 0x5612d4807000 2024-04-20T22:03:01.447 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:03:01 smithi142 bash[93960]: 82bcc0c46762a845d620769fd565225434d170c700ae9b8ef825716918b55633 2024-04-20T22:03:01.447 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:03:01 smithi142 systemd[1]: Started Ceph osd.1 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T22:03:01.946 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:03:01 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1[93975]: 2024-04-20T22:03:01.566+0000 7f383af507c0 -1 Falling back to public interface 2024-04-20T22:03:02.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:02 smithi142 ceph-mon[79401]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/231 objects degraded (12.121%) 2024-04-20T22:03:02.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:02 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:02.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:02 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:02.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:02 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:03:02.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:02 smithi164 ceph-mon[69784]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/231 objects degraded (12.121%) 2024-04-20T22:03:02.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:02 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:02.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:02 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:02.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:02 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:03:04.564 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:04 smithi142 ceph-mon[79401]: pgmap v94: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/231 objects degraded (12.121%) 2024-04-20T22:03:04.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:04 smithi164 ceph-mon[69784]: pgmap v94: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/231 objects degraded (12.121%) 2024-04-20T22:03:06.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:06 smithi142 ceph-mon[79401]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/231 objects degraded (12.121%) 2024-04-20T22:03:06.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:06 smithi164 ceph-mon[69784]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/231 objects degraded (12.121%) 2024-04-20T22:03:07.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.400+0000 7fa1eec00700 1 -- 172.21.15.142:0/1913220514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e81016e0 msgr2=0x7fa1e8103ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:07.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.400+0000 7fa1eec00700 1 --2- 172.21.15.142:0/1913220514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e81016e0 0x7fa1e8103ad0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8009910 tx=0x7fa1d8009c20 comp rx=0 tx=0).stop 2024-04-20T22:03:07.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.400+0000 7fa1eec00700 1 -- 172.21.15.142:0/1913220514 shutdown_connections 2024-04-20T22:03:07.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.400+0000 7fa1eec00700 1 --2- 172.21.15.142:0/1913220514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1e8104010 0x7fa1e8106400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:07.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.400+0000 7fa1eec00700 1 --2- 172.21.15.142:0/1913220514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e81016e0 0x7fa1e8103ad0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:07.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.400+0000 7fa1eec00700 1 -- 172.21.15.142:0/1913220514 >> 172.21.15.142:0/1913220514 conn(0x7fa1e80fb0d0 msgr2=0x7fa1e80fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:07.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.401+0000 7fa1eec00700 1 -- 172.21.15.142:0/1913220514 shutdown_connections 2024-04-20T22:03:07.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.401+0000 7fa1eec00700 1 -- 172.21.15.142:0/1913220514 wait complete. 2024-04-20T22:03:07.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.402+0000 7fa1eec00700 1 Processor -- start 2024-04-20T22:03:07.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.402+0000 7fa1eec00700 1 -- start start 2024-04-20T22:03:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.402+0000 7fa1eec00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e81016e0 0x7fa1e81988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.402+0000 7fa1eec00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1e8104010 0x7fa1e8198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.402+0000 7fa1eec00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e8199410 con 0x7fa1e81016e0 2024-04-20T22:03:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.402+0000 7fa1eec00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e8199550 con 0x7fa1e8104010 2024-04-20T22:03:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.402+0000 7fa1e7e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e81016e0 0x7fa1e81988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.403+0000 7fa1e7e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e81016e0 0x7fa1e81988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39944/0 (socket says 172.21.15.142:39944) 2024-04-20T22:03:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.403+0000 7fa1e7e00700 1 -- 172.21.15.142:0/1287327407 learned_addr learned my addr 172.21.15.142:0/1287327407 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:03:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.403+0000 7fa1e7400700 1 --2- 172.21.15.142:0/1287327407 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1e8104010 0x7fa1e8198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.403+0000 7fa1e7e00700 1 -- 172.21.15.142:0/1287327407 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1e8104010 msgr2=0x7fa1e8198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.403+0000 7fa1e7e00700 1 --2- 172.21.15.142:0/1287327407 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1e8104010 0x7fa1e8198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.403+0000 7fa1e7e00700 1 -- 172.21.15.142:0/1287327407 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d80095f0 con 0x7fa1e81016e0 2024-04-20T22:03:07.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.403+0000 7fa1e7e00700 1 --2- 172.21.15.142:0/1287327407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e81016e0 0x7fa1e81988b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800bd70 tx=0x7fa1d800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:07.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.404+0000 7fa1e4c00700 1 -- 172.21.15.142:0/1287327407 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1d801d070 con 0x7fa1e81016e0 2024-04-20T22:03:07.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.404+0000 7fa1e4c00700 1 -- 172.21.15.142:0/1287327407 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa1d800f460 con 0x7fa1e81016e0 2024-04-20T22:03:07.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.404+0000 7fa1eec00700 1 -- 172.21.15.142:0/1287327407 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e819df50 con 0x7fa1e81016e0 2024-04-20T22:03:07.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.404+0000 7fa1e4c00700 1 -- 172.21.15.142:0/1287327407 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1d8021620 con 0x7fa1e81016e0 2024-04-20T22:03:07.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.404+0000 7fa1eec00700 1 -- 172.21.15.142:0/1287327407 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e819e440 con 0x7fa1e81016e0 2024-04-20T22:03:07.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.405+0000 7fa1eec00700 1 -- 172.21.15.142:0/1287327407 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e80fcc50 con 0x7fa1e81016e0 2024-04-20T22:03:07.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.406+0000 7fa1e4c00700 1 -- 172.21.15.142:0/1287327407 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fa1d8003a60 con 0x7fa1e81016e0 2024-04-20T22:03:07.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.407+0000 7fa1e4c00700 1 --2- 172.21.15.142:0/1287327407 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa1cc06ecc0 0x7fa1cc071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:07.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.407+0000 7fa1e4c00700 1 -- 172.21.15.142:0/1287327407 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa1d808ff10 con 0x7fa1e81016e0 2024-04-20T22:03:07.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.407+0000 7fa1e7400700 1 --2- 172.21.15.142:0/1287327407 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa1cc06ecc0 0x7fa1cc071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:07.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.408+0000 7fa1e7400700 1 --2- 172.21.15.142:0/1287327407 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa1cc06ecc0 0x7fa1cc071180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4006fd0 tx=0x7fa1d4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:07.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.412+0000 7fa1e4c00700 1 -- 172.21.15.142:0/1287327407 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fa1d8095060 con 0x7fa1e81016e0 2024-04-20T22:03:07.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.656+0000 7fa1eec00700 1 -- 172.21.15.142:0/1287327407 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1e802ceb0 con 0x7fa1cc06ecc0 2024-04-20T22:03:07.657 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:03:07 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1[93975]: 2024-04-20T22:03:07.415+0000 7f383af507c0 -1 osd.1 55 log_to_monitors true 2024-04-20T22:03:07.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.659+0000 7fa1e4c00700 1 -- 172.21.15.142:0/1287327407 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa1e802ceb0 con 0x7fa1cc06ecc0 2024-04-20T22:03:07.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.661+0000 7fa1eec00700 1 -- 172.21.15.142:0/1287327407 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa1cc06ecc0 msgr2=0x7fa1cc071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:07.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.661+0000 7fa1eec00700 1 --2- 172.21.15.142:0/1287327407 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa1cc06ecc0 0x7fa1cc071180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4006fd0 tx=0x7fa1d4008040 comp rx=0 tx=0).stop 2024-04-20T22:03:07.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.661+0000 7fa1eec00700 1 -- 172.21.15.142:0/1287327407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e81016e0 msgr2=0x7fa1e81988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:07.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.661+0000 7fa1eec00700 1 --2- 172.21.15.142:0/1287327407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e81016e0 0x7fa1e81988b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800bd70 tx=0x7fa1d800be50 comp rx=0 tx=0).stop 2024-04-20T22:03:07.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.661+0000 7fa1eec00700 1 -- 172.21.15.142:0/1287327407 shutdown_connections 2024-04-20T22:03:07.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.661+0000 7fa1eec00700 1 --2- 172.21.15.142:0/1287327407 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa1cc06ecc0 0x7fa1cc071180 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:07.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.661+0000 7fa1eec00700 1 --2- 172.21.15.142:0/1287327407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1e81016e0 0x7fa1e81988b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:07.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.661+0000 7fa1eec00700 1 --2- 172.21.15.142:0/1287327407 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa1e8104010 0x7fa1e8198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:07.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.661+0000 7fa1eec00700 1 -- 172.21.15.142:0/1287327407 >> 172.21.15.142:0/1287327407 conn(0x7fa1e80fb0d0 msgr2=0x7fa1e81049f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:07.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.662+0000 7fa1eec00700 1 -- 172.21.15.142:0/1287327407 shutdown_connections 2024-04-20T22:03:07.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.662+0000 7fa1eec00700 1 -- 172.21.15.142:0/1287327407 wait complete. 2024-04-20T22:03:07.676 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T22:03:07.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.822+0000 7f0b7f000700 1 -- 172.21.15.142:0/728934122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b78103fd0 msgr2=0x7f0b781063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:07.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.822+0000 7f0b7f000700 1 --2- 172.21.15.142:0/728934122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b78103fd0 0x7f0b781063c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009910 tx=0x7f0b60009c20 comp rx=0 tx=0).stop 2024-04-20T22:03:07.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.822+0000 7f0b7f000700 1 -- 172.21.15.142:0/728934122 shutdown_connections 2024-04-20T22:03:07.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.822+0000 7f0b7f000700 1 --2- 172.21.15.142:0/728934122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b78103fd0 0x7f0b781063c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:07.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.822+0000 7f0b7f000700 1 --2- 172.21.15.142:0/728934122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b781016a0 0x7f0b78103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:07.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.822+0000 7f0b7f000700 1 -- 172.21.15.142:0/728934122 >> 172.21.15.142:0/728934122 conn(0x7f0b780fb0d0 msgr2=0x7f0b780fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:07.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.823+0000 7f0b7f000700 1 -- 172.21.15.142:0/728934122 shutdown_connections 2024-04-20T22:03:07.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.823+0000 7f0b7f000700 1 -- 172.21.15.142:0/728934122 wait complete. 2024-04-20T22:03:07.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.824+0000 7f0b7f000700 1 Processor -- start 2024-04-20T22:03:07.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.824+0000 7f0b7f000700 1 -- start start 2024-04-20T22:03:07.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.824+0000 7f0b7f000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b781016a0 0x7f0b781988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:07.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.824+0000 7f0b7f000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b78103fd0 0x7f0b78198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:07.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.824+0000 7f0b7f000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b78199450 con 0x7f0b781016a0 2024-04-20T22:03:07.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.824+0000 7f0b7f000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b78199590 con 0x7f0b78103fd0 2024-04-20T22:03:07.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.825+0000 7f0b77e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b781016a0 0x7f0b781988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:07.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.825+0000 7f0b77e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b781016a0 0x7f0b781988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39974/0 (socket says 172.21.15.142:39974) 2024-04-20T22:03:07.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.825+0000 7f0b77e00700 1 -- 172.21.15.142:0/3721300786 learned_addr learned my addr 172.21.15.142:0/3721300786 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:03:07.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.825+0000 7f0b77400700 1 --2- 172.21.15.142:0/3721300786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b78103fd0 0x7f0b78198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:07.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.825+0000 7f0b77e00700 1 -- 172.21.15.142:0/3721300786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b78103fd0 msgr2=0x7f0b78198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:07.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.825+0000 7f0b77e00700 1 --2- 172.21.15.142:0/3721300786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b78103fd0 0x7f0b78198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:07.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.825+0000 7f0b77e00700 1 -- 172.21.15.142:0/3721300786 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b600095f0 con 0x7f0b781016a0 2024-04-20T22:03:07.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.826+0000 7f0b77e00700 1 --2- 172.21.15.142:0/3721300786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b781016a0 0x7f0b781988f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800b4b0 tx=0x7f0b6800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:07.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.826+0000 7f0b74c00700 1 -- 172.21.15.142:0/3721300786 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b68011800 con 0x7f0b781016a0 2024-04-20T22:03:07.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.826+0000 7f0b7f000700 1 -- 172.21.15.142:0/3721300786 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b7819dff0 con 0x7f0b781016a0 2024-04-20T22:03:07.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.826+0000 7f0b74c00700 1 -- 172.21.15.142:0/3721300786 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b68011e20 con 0x7f0b781016a0 2024-04-20T22:03:07.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.826+0000 7f0b74c00700 1 -- 172.21.15.142:0/3721300786 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b6800f2e0 con 0x7f0b781016a0 2024-04-20T22:03:07.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.826+0000 7f0b7f000700 1 -- 172.21.15.142:0/3721300786 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b7819e530 con 0x7f0b781016a0 2024-04-20T22:03:07.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.827+0000 7f0b7f000700 1 -- 172.21.15.142:0/3721300786 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b78062510 con 0x7f0b781016a0 2024-04-20T22:03:07.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.828+0000 7f0b74c00700 1 -- 172.21.15.142:0/3721300786 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f0b68010380 con 0x7f0b781016a0 2024-04-20T22:03:07.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.829+0000 7f0b74c00700 1 --2- 172.21.15.142:0/3721300786 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0b5c06ecc0 0x7f0b5c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:07.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.829+0000 7f0b74c00700 1 -- 172.21.15.142:0/3721300786 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0b6808e8e0 con 0x7f0b781016a0 2024-04-20T22:03:07.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.829+0000 7f0b77400700 1 --2- 172.21.15.142:0/3721300786 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0b5c06ecc0 0x7f0b5c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:07.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.830+0000 7f0b77400700 1 --2- 172.21.15.142:0/3721300786 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0b5c06ecc0 0x7f0b5c071180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0b600051c0 tx=0x7f0b6000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:07.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:07.834+0000 7f0b74c00700 1 -- 172.21.15.142:0/3721300786 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f0b6805b2a0 con 0x7f0b781016a0 2024-04-20T22:03:08.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.101+0000 7f0b7f000700 1 -- 172.21.15.142:0/3721300786 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b780ffe40 con 0x7f0b5c06ecc0 2024-04-20T22:03:08.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.103+0000 7f0b74c00700 1 -- 172.21.15.142:0/3721300786 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0b780ffe40 con 0x7f0b5c06ecc0 2024-04-20T22:03:08.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.106+0000 7f0b7f000700 1 -- 172.21.15.142:0/3721300786 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0b5c06ecc0 msgr2=0x7f0b5c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:08.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.106+0000 7f0b7f000700 1 --2- 172.21.15.142:0/3721300786 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0b5c06ecc0 0x7f0b5c071180 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0b600051c0 tx=0x7f0b6000b540 comp rx=0 tx=0).stop 2024-04-20T22:03:08.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.106+0000 7f0b7f000700 1 -- 172.21.15.142:0/3721300786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b781016a0 msgr2=0x7f0b781988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:08.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.106+0000 7f0b7f000700 1 --2- 172.21.15.142:0/3721300786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b781016a0 0x7f0b781988f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800b4b0 tx=0x7f0b6800b870 comp rx=0 tx=0).stop 2024-04-20T22:03:08.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.106+0000 7f0b7f000700 1 -- 172.21.15.142:0/3721300786 shutdown_connections 2024-04-20T22:03:08.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.106+0000 7f0b7f000700 1 --2- 172.21.15.142:0/3721300786 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0b5c06ecc0 0x7f0b5c071180 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:08.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.106+0000 7f0b7f000700 1 --2- 172.21.15.142:0/3721300786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b781016a0 0x7f0b781988f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:08.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.106+0000 7f0b7f000700 1 --2- 172.21.15.142:0/3721300786 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0b78103fd0 0x7f0b78198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:08.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.106+0000 7f0b7f000700 1 -- 172.21.15.142:0/3721300786 >> 172.21.15.142:0/3721300786 conn(0x7f0b780fb0d0 msgr2=0x7f0b780ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:08.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.107+0000 7f0b7f000700 1 -- 172.21.15.142:0/3721300786 shutdown_connections 2024-04-20T22:03:08.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.107+0000 7f0b7f000700 1 -- 172.21.15.142:0/3721300786 wait complete. 2024-04-20T22:03:08.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.277+0000 7fbb82800700 1 -- 172.21.15.142:0/3070695644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb7c1070f0 msgr2=0x7fbb7c107510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:08.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.277+0000 7fbb82800700 1 --2- 172.21.15.142:0/3070695644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb7c1070f0 0x7fbb7c107510 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009910 tx=0x7fbb70009c20 comp rx=0 tx=0).stop 2024-04-20T22:03:08.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.277+0000 7fbb82800700 1 -- 172.21.15.142:0/3070695644 shutdown_connections 2024-04-20T22:03:08.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.277+0000 7fbb82800700 1 --2- 172.21.15.142:0/3070695644 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb7c108290 0x7fbb7c1086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:08.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.277+0000 7fbb82800700 1 --2- 172.21.15.142:0/3070695644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb7c1070f0 0x7fbb7c107510 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:08.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.277+0000 7fbb82800700 1 -- 172.21.15.142:0/3070695644 >> 172.21.15.142:0/3070695644 conn(0x7fbb7c0761d0 msgr2=0x7fbb7c078610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:08.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.277+0000 7fbb82800700 1 -- 172.21.15.142:0/3070695644 shutdown_connections 2024-04-20T22:03:08.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.278+0000 7fbb82800700 1 -- 172.21.15.142:0/3070695644 wait complete. 2024-04-20T22:03:08.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.278+0000 7fbb82800700 1 Processor -- start 2024-04-20T22:03:08.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.279+0000 7fbb82800700 1 -- start start 2024-04-20T22:03:08.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.279+0000 7fbb82800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb7c1070f0 0x7fbb7c19cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:08.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.279+0000 7fbb82800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb7c108290 0x7fbb7c19d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:08.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.279+0000 7fbb82800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c19d5d0 con 0x7fbb7c1070f0 2024-04-20T22:03:08.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.279+0000 7fbb82800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c19d710 con 0x7fbb7c108290 2024-04-20T22:03:08.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.279+0000 7fbb81400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb7c1070f0 0x7fbb7c19cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:08.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.279+0000 7fbb81400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb7c1070f0 0x7fbb7c19cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39984/0 (socket says 172.21.15.142:39984) 2024-04-20T22:03:08.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.279+0000 7fbb81400700 1 -- 172.21.15.142:0/2964045385 learned_addr learned my addr 172.21.15.142:0/2964045385 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:03:08.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.280+0000 7fbb80a00700 1 --2- 172.21.15.142:0/2964045385 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb7c108290 0x7fbb7c19d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:08.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.280+0000 7fbb81400700 1 -- 172.21.15.142:0/2964045385 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb7c108290 msgr2=0x7fbb7c19d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:08.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.280+0000 7fbb81400700 1 --2- 172.21.15.142:0/2964045385 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb7c108290 0x7fbb7c19d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:08.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.280+0000 7fbb81400700 1 -- 172.21.15.142:0/2964045385 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb700095f0 con 0x7fbb7c1070f0 2024-04-20T22:03:08.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.280+0000 7fbb81400700 1 --2- 172.21.15.142:0/2964045385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb7c1070f0 0x7fbb7c19cb00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000bd70 tx=0x7fbb7000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:08.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.280+0000 7fbb7a000700 1 -- 172.21.15.142:0/2964045385 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb7001d070 con 0x7fbb7c1070f0 2024-04-20T22:03:08.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.280+0000 7fbb7a000700 1 -- 172.21.15.142:0/2964045385 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb7000f460 con 0x7fbb7c1070f0 2024-04-20T22:03:08.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.280+0000 7fbb7a000700 1 -- 172.21.15.142:0/2964045385 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb70021620 con 0x7fbb7c1070f0 2024-04-20T22:03:08.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.280+0000 7fbb82800700 1 -- 172.21.15.142:0/2964045385 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb7c1a20d0 con 0x7fbb7c1070f0 2024-04-20T22:03:08.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.281+0000 7fbb82800700 1 -- 172.21.15.142:0/2964045385 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7c1a2610 con 0x7fbb7c1070f0 2024-04-20T22:03:08.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.282+0000 7fbb82800700 1 -- 172.21.15.142:0/2964045385 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb7c196c10 con 0x7fbb7c1070f0 2024-04-20T22:03:08.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.283+0000 7fbb7a000700 1 -- 172.21.15.142:0/2964045385 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fbb7000fa70 con 0x7fbb7c1070f0 2024-04-20T22:03:08.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.284+0000 7fbb7a000700 1 --2- 172.21.15.142:0/2964045385 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fbb6406ecd0 0x7fbb64071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:08.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.284+0000 7fbb7a000700 1 -- 172.21.15.142:0/2964045385 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fbb700900b0 con 0x7fbb7c1070f0 2024-04-20T22:03:08.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.285+0000 7fbb80a00700 1 --2- 172.21.15.142:0/2964045385 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fbb6406ecd0 0x7fbb64071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:08.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.285+0000 7fbb80a00700 1 --2- 172.21.15.142:0/2964045385 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fbb6406ecd0 0x7fbb64071190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800ba60 tx=0x7fbb68005d50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:08.289 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.289+0000 7fbb7a000700 1 -- 172.21.15.142:0/2964045385 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fbb7005ca70 con 0x7fbb7c1070f0 2024-04-20T22:03:08.446 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:03:08 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1[93975]: 2024-04-20T22:03:08.241+0000 7f382a200700 -1 osd.1 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T22:03:08.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:08 smithi142 ceph-mon[79401]: pgmap v96: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/231 objects degraded (12.121%) 2024-04-20T22:03:08.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:08 smithi142 ceph-mon[79401]: from='osd.1 [v2:172.21.15.142:6810/3789493679,v1:172.21.15.142:6811/3789493679]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-20T22:03:08.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.523+0000 7fbb82800700 1 -- 172.21.15.142:0/2964045385 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb7c02cde0 con 0x7fbb6406ecd0 2024-04-20T22:03:08.555 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.555+0000 7fbb7a000700 1 -- 172.21.15.142:0/2964045385 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fbb7c02cde0 con 0x7fbb6406ecd0 2024-04-20T22:03:08.556 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:03:08.556 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (13m) 0s ago 15m 13.6M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T22:03:08.556 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (16m) 0s ago 16m 8404k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T22:03:08.556 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (14m) 65s ago 14m 7784k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T22:03:08.556 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (79s) 0s ago 15m 6665k - 19.0.0-3133-ga8c84f59 76bc6b91b726 64521ed7125b 2024-04-20T22:03:08.556 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (71s) 65s ago 14m 6656k - 19.0.0-3133-ga8c84f59 76bc6b91b726 893c6f16ee6d 2024-04-20T22:03:08.556 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (13m) 0s ago 15m 76.0M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T22:03:08.556 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (8m) 0s ago 8m 140M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 b68e279d7945 2024-04-20T22:03:08.556 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (8m) 0s ago 8m 16.2M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T22:03:08.556 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (8m) 65s ago 8m 15.7M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T22:03:08.557 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (8m) 65s ago 8m 16.1M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T22:03:08.557 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (4m) 0s ago 17m 504M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:03:08.557 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (3m) 65s ago 14m 451M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:03:08.557 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (3m) 0s ago 17m 48.3M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 af10a542c918 2024-04-20T22:03:08.557 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (2m) 65s ago 14m 33.5M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 133512694d46 2024-04-20T22:03:08.557 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (15m) 0s ago 15m 8262k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T22:03:08.557 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (14m) 65s ago 14m 7990k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T22:03:08.557 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (39s) 0s ago 13m 94.1M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 b7206d05a7cd 2024-04-20T22:03:08.557 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (7s) 0s ago 12m 11.1M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 82bcc0c46762 2024-04-20T22:03:08.557 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (12m) 0s ago 12m 208M 1216M 18.2.2-1237-g646b8c7d 9900ed1a6b81 8e9165365127 2024-04-20T22:03:08.557 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (11m) 65s ago 11m 293M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c081911f56ab 2024-04-20T22:03:08.557 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (10m) 65s ago 10m 249M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 39e09d63d44f 2024-04-20T22:03:08.557 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (10m) 65s ago 10m 229M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4f36124aeb0d 2024-04-20T22:03:08.558 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (3m) 0s ago 15m 72.7M - 2.43.0 a07b618ecd1d 46b76c20eae5 2024-04-20T22:03:08.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.559+0000 7fbb82800700 1 -- 172.21.15.142:0/2964045385 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fbb6406ecd0 msgr2=0x7fbb64071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:08.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.559+0000 7fbb82800700 1 --2- 172.21.15.142:0/2964045385 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fbb6406ecd0 0x7fbb64071190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800ba60 tx=0x7fbb68005d50 comp rx=0 tx=0).stop 2024-04-20T22:03:08.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.559+0000 7fbb82800700 1 -- 172.21.15.142:0/2964045385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb7c1070f0 msgr2=0x7fbb7c19cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:08.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.559+0000 7fbb82800700 1 --2- 172.21.15.142:0/2964045385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb7c1070f0 0x7fbb7c19cb00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000bd70 tx=0x7fbb7000be50 comp rx=0 tx=0).stop 2024-04-20T22:03:08.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.559+0000 7fbb82800700 1 -- 172.21.15.142:0/2964045385 shutdown_connections 2024-04-20T22:03:08.559 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.559+0000 7fbb82800700 1 --2- 172.21.15.142:0/2964045385 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fbb6406ecd0 0x7fbb64071190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:08.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.559+0000 7fbb82800700 1 --2- 172.21.15.142:0/2964045385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbb7c1070f0 0x7fbb7c19cb00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:08.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.559+0000 7fbb82800700 1 --2- 172.21.15.142:0/2964045385 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb7c108290 0x7fbb7c19d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:08.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.559+0000 7fbb82800700 1 -- 172.21.15.142:0/2964045385 >> 172.21.15.142:0/2964045385 conn(0x7fbb7c0761d0 msgr2=0x7fbb7c10b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:08.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.559+0000 7fbb82800700 1 -- 172.21.15.142:0/2964045385 shutdown_connections 2024-04-20T22:03:08.560 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.559+0000 7fbb82800700 1 -- 172.21.15.142:0/2964045385 wait complete. 2024-04-20T22:03:08.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:08 smithi164 ceph-mon[69784]: pgmap v96: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/231 objects degraded (12.121%) 2024-04-20T22:03:08.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:08 smithi164 ceph-mon[69784]: from='osd.1 [v2:172.21.15.142:6810/3789493679,v1:172.21.15.142:6811/3789493679]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-20T22:03:08.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.705+0000 7fe7e2200700 1 -- 172.21.15.142:0/3246711314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7dc0ffdd0 msgr2=0x7fe7dc100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:08.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.705+0000 7fe7e2200700 1 --2- 172.21.15.142:0/3246711314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7dc0ffdd0 0x7fe7dc100250 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009910 tx=0x7fe7c4009c20 comp rx=0 tx=0).stop 2024-04-20T22:03:08.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.705+0000 7fe7e2200700 1 -- 172.21.15.142:0/3246711314 shutdown_connections 2024-04-20T22:03:08.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.705+0000 7fe7e2200700 1 --2- 172.21.15.142:0/3246711314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7dc0ffdd0 0x7fe7dc100250 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:08.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.705+0000 7fe7e2200700 1 --2- 172.21.15.142:0/3246711314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7dc0ff470 0x7fe7dc0ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:08.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.705+0000 7fe7e2200700 1 -- 172.21.15.142:0/3246711314 >> 172.21.15.142:0/3246711314 conn(0x7fe7dc0fb0d0 msgr2=0x7fe7dc0fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:08.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.705+0000 7fe7e2200700 1 -- 172.21.15.142:0/3246711314 shutdown_connections 2024-04-20T22:03:08.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.705+0000 7fe7e2200700 1 -- 172.21.15.142:0/3246711314 wait complete. 2024-04-20T22:03:08.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.706+0000 7fe7e2200700 1 Processor -- start 2024-04-20T22:03:08.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.707+0000 7fe7e2200700 1 -- start start 2024-04-20T22:03:08.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.707+0000 7fe7e2200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7dc0ff470 0x7fe7dc1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:08.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.707+0000 7fe7e2200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7dc0ffdd0 0x7fe7dc198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:08.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.707+0000 7fe7e2200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc199320 con 0x7fe7dc0ff470 2024-04-20T22:03:08.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.707+0000 7fe7e2200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc199460 con 0x7fe7dc0ffdd0 2024-04-20T22:03:08.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.707+0000 7fe7db400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7dc0ff470 0x7fe7dc1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:08.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.707+0000 7fe7db400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7dc0ff470 0x7fe7dc1987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40004/0 (socket says 172.21.15.142:40004) 2024-04-20T22:03:08.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.707+0000 7fe7db400700 1 -- 172.21.15.142:0/381331141 learned_addr learned my addr 172.21.15.142:0/381331141 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:03:08.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.708+0000 7fe7db400700 1 -- 172.21.15.142:0/381331141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7dc0ffdd0 msgr2=0x7fe7dc198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:08.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.708+0000 7fe7db400700 1 --2- 172.21.15.142:0/381331141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7dc0ffdd0 0x7fe7dc198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:08.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.708+0000 7fe7db400700 1 -- 172.21.15.142:0/381331141 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c40095f0 con 0x7fe7dc0ff470 2024-04-20T22:03:08.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.708+0000 7fe7db400700 1 --2- 172.21.15.142:0/381331141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7dc0ff470 0x7fe7dc1987c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00ada0 tx=0x7fe7cc00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:08.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.708+0000 7fe7d8c00700 1 -- 172.21.15.142:0/381331141 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7cc00f070 con 0x7fe7dc0ff470 2024-04-20T22:03:08.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.708+0000 7fe7d8c00700 1 -- 172.21.15.142:0/381331141 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe7cc007bf0 con 0x7fe7dc0ff470 2024-04-20T22:03:08.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.708+0000 7fe7e2200700 1 -- 172.21.15.142:0/381331141 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7dc19dec0 con 0x7fe7dc0ff470 2024-04-20T22:03:08.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.708+0000 7fe7d8c00700 1 -- 172.21.15.142:0/381331141 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7cc005690 con 0x7fe7dc0ff470 2024-04-20T22:03:08.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.709+0000 7fe7e2200700 1 -- 172.21.15.142:0/381331141 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7dc19e430 con 0x7fe7dc0ff470 2024-04-20T22:03:08.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.710+0000 7fe7e2200700 1 -- 172.21.15.142:0/381331141 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7dc192960 con 0x7fe7dc0ff470 2024-04-20T22:03:08.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.711+0000 7fe7d8c00700 1 -- 172.21.15.142:0/381331141 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fe7cc00c900 con 0x7fe7dc0ff470 2024-04-20T22:03:08.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.712+0000 7fe7d8c00700 1 --2- 172.21.15.142:0/381331141 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe7c006ecc0 0x7fe7c0071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:08.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.712+0000 7fe7d8c00700 1 -- 172.21.15.142:0/381331141 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe7cc08e8d0 con 0x7fe7dc0ff470 2024-04-20T22:03:08.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.712+0000 7fe7d2a00700 1 --2- 172.21.15.142:0/381331141 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe7c006ecc0 0x7fe7c0071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:08.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.713+0000 7fe7d2a00700 1 --2- 172.21.15.142:0/381331141 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe7c006ecc0 0x7fe7c0071180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40051c0 tx=0x7fe7c4005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:08.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:08.717+0000 7fe7d8c00700 1 -- 172.21.15.142:0/381331141 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fe7cc05b170 con 0x7fe7dc0ff470 2024-04-20T22:03:09.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.035+0000 7fe7e2200700 1 -- 172.21.15.142:0/381331141 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe7dc02ced0 con 0x7fe7dc0ff470 2024-04-20T22:03:09.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.036+0000 7fe7d8c00700 1 -- 172.21.15.142:0/381331141 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+836 (secure 0 0 0) 0x7fe7cc05ad00 con 0x7fe7dc0ff470 2024-04-20T22:03:09.035 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:03:09.036 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:03:09.036 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:03:09.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:03:09.036 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:03:09.036 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:03:09.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:03:09.036 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:03:09.036 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4, 2024-04-20T22:03:09.036 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 1 2024-04-20T22:03:09.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:03:09.036 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:03:09.036 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4 2024-04-20T22:03:09.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:03:09.036 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:03:09.037 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 8, 2024-04-20T22:03:09.037 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 5 2024-04-20T22:03:09.037 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:03:09.037 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:03:09.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.039+0000 7fe7e2200700 1 -- 172.21.15.142:0/381331141 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe7c006ecc0 msgr2=0x7fe7c0071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:09.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.039+0000 7fe7e2200700 1 --2- 172.21.15.142:0/381331141 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe7c006ecc0 0x7fe7c0071180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40051c0 tx=0x7fe7c4005fd0 comp rx=0 tx=0).stop 2024-04-20T22:03:09.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.039+0000 7fe7e2200700 1 -- 172.21.15.142:0/381331141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7dc0ff470 msgr2=0x7fe7dc1987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:09.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.039+0000 7fe7e2200700 1 --2- 172.21.15.142:0/381331141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7dc0ff470 0x7fe7dc1987c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00ada0 tx=0x7fe7cc00c330 comp rx=0 tx=0).stop 2024-04-20T22:03:09.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.039+0000 7fe7e2200700 1 -- 172.21.15.142:0/381331141 shutdown_connections 2024-04-20T22:03:09.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.039+0000 7fe7e2200700 1 --2- 172.21.15.142:0/381331141 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe7c006ecc0 0x7fe7c0071180 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:09.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.039+0000 7fe7e2200700 1 --2- 172.21.15.142:0/381331141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7dc0ff470 0x7fe7dc1987c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:09.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.039+0000 7fe7e2200700 1 --2- 172.21.15.142:0/381331141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7dc0ffdd0 0x7fe7dc198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:09.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.039+0000 7fe7e2200700 1 -- 172.21.15.142:0/381331141 >> 172.21.15.142:0/381331141 conn(0x7fe7dc0fb0d0 msgr2=0x7fe7dc107e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:09.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.039+0000 7fe7e2200700 1 -- 172.21.15.142:0/381331141 shutdown_connections 2024-04-20T22:03:09.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.040+0000 7fe7e2200700 1 -- 172.21.15.142:0/381331141 wait complete. 2024-04-20T22:03:09.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.197+0000 7f11ec400700 1 -- 172.21.15.142:0/1223341411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11e4074f10 msgr2=0x7f11e4073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:09.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.197+0000 7f11ec400700 1 --2- 172.21.15.142:0/1223341411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11e4074f10 0x7f11e4073370 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f11d8009910 tx=0x7f11d8009c20 comp rx=0 tx=0).stop 2024-04-20T22:03:09.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.197+0000 7f11ec400700 1 -- 172.21.15.142:0/1223341411 shutdown_connections 2024-04-20T22:03:09.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.197+0000 7f11ec400700 1 --2- 172.21.15.142:0/1223341411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11e4073940 0x7f11e4073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:09.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.197+0000 7f11ec400700 1 --2- 172.21.15.142:0/1223341411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11e4074f10 0x7f11e4073370 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:09.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.197+0000 7f11ec400700 1 -- 172.21.15.142:0/1223341411 >> 172.21.15.142:0/1223341411 conn(0x7f11e40fc1c0 msgr2=0x7f11e40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:09.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.197+0000 7f11ec400700 1 -- 172.21.15.142:0/1223341411 shutdown_connections 2024-04-20T22:03:09.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.197+0000 7f11ec400700 1 -- 172.21.15.142:0/1223341411 wait complete. 2024-04-20T22:03:09.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.198+0000 7f11ec400700 1 Processor -- start 2024-04-20T22:03:09.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.198+0000 7f11ec400700 1 -- start start 2024-04-20T22:03:09.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.199+0000 7f11ec400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11e4073940 0x7f11e419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:09.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.199+0000 7f11ec400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11e4074f10 0x7f11e419d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:09.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.199+0000 7f11ec400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e419d7c0 con 0x7f11e4073940 2024-04-20T22:03:09.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.199+0000 7f11ec400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e41a2180 con 0x7f11e4074f10 2024-04-20T22:03:09.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.199+0000 7f11e9a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11e4073940 0x7f11e419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:09.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.199+0000 7f11e9a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11e4073940 0x7f11e419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40024/0 (socket says 172.21.15.142:40024) 2024-04-20T22:03:09.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.199+0000 7f11e9a00700 1 -- 172.21.15.142:0/3177308646 learned_addr learned my addr 172.21.15.142:0/3177308646 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:03:09.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.200+0000 7f11e9000700 1 --2- 172.21.15.142:0/3177308646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11e4074f10 0x7f11e419d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:09.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.200+0000 7f11e9a00700 1 -- 172.21.15.142:0/3177308646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11e4074f10 msgr2=0x7f11e419d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:09.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.200+0000 7f11e9a00700 1 --2- 172.21.15.142:0/3177308646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11e4074f10 0x7f11e419d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:09.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.200+0000 7f11e9a00700 1 -- 172.21.15.142:0/3177308646 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d80095f0 con 0x7f11e4073940 2024-04-20T22:03:09.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.200+0000 7f11e9a00700 1 --2- 172.21.15.142:0/3177308646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11e4073940 0x7f11e419cc60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f11d80059d0 tx=0x7f11d800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:09.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.200+0000 7f11e2000700 1 -- 172.21.15.142:0/3177308646 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11d801d070 con 0x7f11e4073940 2024-04-20T22:03:09.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.200+0000 7f11e2000700 1 -- 172.21.15.142:0/3177308646 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f11d800f460 con 0x7f11e4073940 2024-04-20T22:03:09.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.201+0000 7f11e2000700 1 -- 172.21.15.142:0/3177308646 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11d8021640 con 0x7f11e4073940 2024-04-20T22:03:09.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.201+0000 7f11ec400700 1 -- 172.21.15.142:0/3177308646 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e41a2320 con 0x7f11e4073940 2024-04-20T22:03:09.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.201+0000 7f11ec400700 1 -- 172.21.15.142:0/3177308646 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e41a2810 con 0x7f11e4073940 2024-04-20T22:03:09.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.202+0000 7f11ec400700 1 -- 172.21.15.142:0/3177308646 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e4196db0 con 0x7f11e4073940 2024-04-20T22:03:09.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.204+0000 7f11e2000700 1 -- 172.21.15.142:0/3177308646 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f11d800f5d0 con 0x7f11e4073940 2024-04-20T22:03:09.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.204+0000 7f11e2000700 1 --2- 172.21.15.142:0/3177308646 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f11cc06ecc0 0x7f11cc071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:09.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.205+0000 7f11e2000700 1 -- 172.21.15.142:0/3177308646 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f11d808ff10 con 0x7f11e4073940 2024-04-20T22:03:09.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.205+0000 7f11e9000700 1 --2- 172.21.15.142:0/3177308646 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f11cc06ecc0 0x7f11cc071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:09.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.205+0000 7f11e9000700 1 --2- 172.21.15.142:0/3177308646 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f11cc06ecc0 0x7f11cc071180 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f11d0005fd0 tx=0x7f11d0005dd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:09.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.212+0000 7f11e2000700 1 -- 172.21.15.142:0/3177308646 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f11d8058c80 con 0x7f11e4073940 2024-04-20T22:03:09.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:09 smithi142 ceph-mon[79401]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:03:09.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:09 smithi142 ceph-mon[79401]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:03:09.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:09 smithi142 ceph-mon[79401]: from='osd.1 [v2:172.21.15.142:6810/3789493679,v1:172.21.15.142:6811/3789493679]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-20T22:03:09.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:09 smithi142 ceph-mon[79401]: osdmap e58: 6 total, 5 up, 6 in 2024-04-20T22:03:09.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:09 smithi142 ceph-mon[79401]: from='osd.1 [v2:172.21.15.142:6810/3789493679,v1:172.21.15.142:6811/3789493679]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-04-20T22:03:09.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:09 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:09.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:09 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:09.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:09 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/381331141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:03:09.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.518+0000 7f11ec400700 1 -- 172.21.15.142:0/3177308646 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f11e402cd70 con 0x7f11e4073940 2024-04-20T22:03:09.518 INFO:teuthology.orchestra.run.smithi142.stdout:e12 2024-04-20T22:03:09.519 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:03:09.519 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:03:09.519 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T22:03:09.519 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:03:09.519 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T22:03:09.519 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T22:03:09.519 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 12 2024-04-20T22:03:09.519 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:03:09.519 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:03:09.519 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:51.692699+0000 2024-04-20T22:03:09.519 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T22:03:09.519 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T22:03:09.519 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T22:03:09.519 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T22:03:09.520 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T22:03:09.520 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T22:03:09.520 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T22:03:09.520 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T22:03:09.520 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T22:03:09.520 INFO:teuthology.orchestra.run.smithi142.stdout:snap_rstat 1 2024-04-20T22:03:09.520 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:03:09.520 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T22:03:09.520 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T22:03:09.520 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T22:03:09.520 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T22:03:09.520 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T22:03:09.520 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T22:03:09.520 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T22:03:09.520 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T22:03:09.521 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T22:03:09.521 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T22:03:09.521 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T22:03:09.521 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T22:03:09.521 INFO:teuthology.orchestra.run.smithi142.stdout:qdb_cluster leader: 0 members: 2024-04-20T22:03:09.521 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:03:09.521 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:03:09.521 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:03:09.521 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T22:03:09.521 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:03:09.521 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:03:09.521 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:03:09.521 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:03:09.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.518+0000 7f11e2000700 1 -- 172.21.15.142:0/3177308646 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1898 (secure 0 0 0) 0x7f11d805c340 con 0x7f11e4073940 2024-04-20T22:03:09.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.521+0000 7f11ec400700 1 -- 172.21.15.142:0/3177308646 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f11cc06ecc0 msgr2=0x7f11cc071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:09.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.521+0000 7f11ec400700 1 --2- 172.21.15.142:0/3177308646 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f11cc06ecc0 0x7f11cc071180 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f11d0005fd0 tx=0x7f11d0005dd0 comp rx=0 tx=0).stop 2024-04-20T22:03:09.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.521+0000 7f11ec400700 1 -- 172.21.15.142:0/3177308646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11e4073940 msgr2=0x7f11e419cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:09.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.521+0000 7f11ec400700 1 --2- 172.21.15.142:0/3177308646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11e4073940 0x7f11e419cc60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f11d80059d0 tx=0x7f11d800be20 comp rx=0 tx=0).stop 2024-04-20T22:03:09.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.522+0000 7f11ec400700 1 -- 172.21.15.142:0/3177308646 shutdown_connections 2024-04-20T22:03:09.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.522+0000 7f11ec400700 1 --2- 172.21.15.142:0/3177308646 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f11cc06ecc0 0x7f11cc071180 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:09.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.522+0000 7f11ec400700 1 --2- 172.21.15.142:0/3177308646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11e4073940 0x7f11e419cc60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:09.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.522+0000 7f11ec400700 1 --2- 172.21.15.142:0/3177308646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11e4074f10 0x7f11e419d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:09.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.522+0000 7f11ec400700 1 -- 172.21.15.142:0/3177308646 >> 172.21.15.142:0/3177308646 conn(0x7f11e40fc1c0 msgr2=0x7f11e41029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:09.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.522+0000 7f11ec400700 1 -- 172.21.15.142:0/3177308646 shutdown_connections 2024-04-20T22:03:09.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.522+0000 7f11ec400700 1 -- 172.21.15.142:0/3177308646 wait complete. 2024-04-20T22:03:09.523 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T22:03:09.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.675+0000 7ff46ee00700 1 -- 172.21.15.142:0/3413369282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff468073940 msgr2=0x7ff468073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:09.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.675+0000 7ff46ee00700 1 --2- 172.21.15.142:0/3413369282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff468073940 0x7ff468073dc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff454009910 tx=0x7ff454009c20 comp rx=0 tx=0).stop 2024-04-20T22:03:09.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.675+0000 7ff46ee00700 1 -- 172.21.15.142:0/3413369282 shutdown_connections 2024-04-20T22:03:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.675+0000 7ff46ee00700 1 --2- 172.21.15.142:0/3413369282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff468073940 0x7ff468073dc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.675+0000 7ff46ee00700 1 --2- 172.21.15.142:0/3413369282 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff468074f10 0x7ff468073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.675+0000 7ff46ee00700 1 -- 172.21.15.142:0/3413369282 >> 172.21.15.142:0/3413369282 conn(0x7ff4680fc1c0 msgr2=0x7ff4680fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.675+0000 7ff46ee00700 1 -- 172.21.15.142:0/3413369282 shutdown_connections 2024-04-20T22:03:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.676+0000 7ff46ee00700 1 -- 172.21.15.142:0/3413369282 wait complete. 2024-04-20T22:03:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.677+0000 7ff46ee00700 1 Processor -- start 2024-04-20T22:03:09.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.677+0000 7ff46ee00700 1 -- start start 2024-04-20T22:03:09.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.677+0000 7ff46ee00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff468073940 0x7ff46819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:09.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.677+0000 7ff46ee00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff468074f10 0x7ff46819d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:09.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.677+0000 7ff46ee00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46819d7d0 con 0x7ff468073940 2024-04-20T22:03:09.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.677+0000 7ff46ee00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4681a2190 con 0x7ff468074f10 2024-04-20T22:03:09.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.678+0000 7ff467e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff468073940 0x7ff46819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:09.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.678+0000 7ff467e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff468073940 0x7ff46819cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40040/0 (socket says 172.21.15.142:40040) 2024-04-20T22:03:09.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.678+0000 7ff467e00700 1 -- 172.21.15.142:0/3784208494 learned_addr learned my addr 172.21.15.142:0/3784208494 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:03:09.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.678+0000 7ff467400700 1 --2- 172.21.15.142:0/3784208494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff468074f10 0x7ff46819d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:09.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.678+0000 7ff467e00700 1 -- 172.21.15.142:0/3784208494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff468074f10 msgr2=0x7ff46819d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:09.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.678+0000 7ff467e00700 1 --2- 172.21.15.142:0/3784208494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff468074f10 0x7ff46819d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:09.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.678+0000 7ff467e00700 1 -- 172.21.15.142:0/3784208494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4540095f0 con 0x7ff468073940 2024-04-20T22:03:09.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.679+0000 7ff467e00700 1 --2- 172.21.15.142:0/3784208494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff468073940 0x7ff46819cc70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff45800c8f0 tx=0x7ff45800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:09.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.679+0000 7ff464c00700 1 -- 172.21.15.142:0/3784208494 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff458007a50 con 0x7ff468073940 2024-04-20T22:03:09.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.679+0000 7ff464c00700 1 -- 172.21.15.142:0/3784208494 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff458007bb0 con 0x7ff468073940 2024-04-20T22:03:09.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.679+0000 7ff46ee00700 1 -- 172.21.15.142:0/3784208494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4681a2390 con 0x7ff468073940 2024-04-20T22:03:09.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.679+0000 7ff46ee00700 1 -- 172.21.15.142:0/3784208494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4681a2930 con 0x7ff468073940 2024-04-20T22:03:09.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.679+0000 7ff464c00700 1 -- 172.21.15.142:0/3784208494 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff458018630 con 0x7ff468073940 2024-04-20T22:03:09.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.680+0000 7ff46ee00700 1 -- 172.21.15.142:0/3784208494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff468062510 con 0x7ff468073940 2024-04-20T22:03:09.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.682+0000 7ff464c00700 1 -- 172.21.15.142:0/3784208494 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7ff45800f450 con 0x7ff468073940 2024-04-20T22:03:09.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.683+0000 7ff464c00700 1 --2- 172.21.15.142:0/3784208494 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7ff44c06ecc0 0x7ff44c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:09.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.684+0000 7ff464c00700 1 -- 172.21.15.142:0/3784208494 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff45808eec0 con 0x7ff468073940 2024-04-20T22:03:09.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.684+0000 7ff467400700 1 --2- 172.21.15.142:0/3784208494 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7ff44c06ecc0 0x7ff44c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:09.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.685+0000 7ff467400700 1 --2- 172.21.15.142:0/3784208494 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7ff44c06ecc0 0x7ff44c071180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff454006010 tx=0x7ff45400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:09.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.687+0000 7ff464c00700 1 -- 172.21.15.142:0/3784208494 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7ff458057df0 con 0x7ff468073940 2024-04-20T22:03:09.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:09 smithi164 ceph-mon[69784]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:03:09.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:09 smithi164 ceph-mon[69784]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:03:09.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:09 smithi164 ceph-mon[69784]: from='osd.1 [v2:172.21.15.142:6810/3789493679,v1:172.21.15.142:6811/3789493679]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-20T22:03:09.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:09 smithi164 ceph-mon[69784]: osdmap e58: 6 total, 5 up, 6 in 2024-04-20T22:03:09.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:09 smithi164 ceph-mon[69784]: from='osd.1 [v2:172.21.15.142:6810/3789493679,v1:172.21.15.142:6811/3789493679]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-04-20T22:03:09.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:09 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:09.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:09 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:09.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:09 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/381331141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:03:09.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.927+0000 7ff46ee00700 1 -- 172.21.15.142:0/3784208494 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff468103bc0 con 0x7ff44c06ecc0 2024-04-20T22:03:09.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.929+0000 7ff464c00700 1 -- 172.21.15.142:0/3784208494 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff468103bc0 con 0x7ff44c06ecc0 2024-04-20T22:03:09.929 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:03:09.929 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T22:03:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T22:03:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T22:03:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T22:03:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr", 2024-04-20T22:03:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: "mon", 2024-04-20T22:03:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: "crash" 2024-04-20T22:03:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T22:03:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "8/23 daemons upgraded", 2024-04-20T22:03:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading osd daemons", 2024-04-20T22:03:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T22:03:09.930 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:03:09.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.932+0000 7ff46ee00700 1 -- 172.21.15.142:0/3784208494 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7ff44c06ecc0 msgr2=0x7ff44c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:09.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.932+0000 7ff46ee00700 1 --2- 172.21.15.142:0/3784208494 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7ff44c06ecc0 0x7ff44c071180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff454006010 tx=0x7ff45400b540 comp rx=0 tx=0).stop 2024-04-20T22:03:09.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.932+0000 7ff46ee00700 1 -- 172.21.15.142:0/3784208494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff468073940 msgr2=0x7ff46819cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:09.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.932+0000 7ff46ee00700 1 --2- 172.21.15.142:0/3784208494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff468073940 0x7ff46819cc70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff45800c8f0 tx=0x7ff45800ccb0 comp rx=0 tx=0).stop 2024-04-20T22:03:09.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.932+0000 7ff46ee00700 1 -- 172.21.15.142:0/3784208494 shutdown_connections 2024-04-20T22:03:09.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.932+0000 7ff46ee00700 1 --2- 172.21.15.142:0/3784208494 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7ff44c06ecc0 0x7ff44c071180 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:09.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.932+0000 7ff46ee00700 1 --2- 172.21.15.142:0/3784208494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff468073940 0x7ff46819cc70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:09.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.932+0000 7ff46ee00700 1 --2- 172.21.15.142:0/3784208494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff468074f10 0x7ff46819d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:09.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.932+0000 7ff46ee00700 1 -- 172.21.15.142:0/3784208494 >> 172.21.15.142:0/3784208494 conn(0x7ff4680fc1c0 msgr2=0x7ff4681024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:09.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.933+0000 7ff46ee00700 1 -- 172.21.15.142:0/3784208494 shutdown_connections 2024-04-20T22:03:09.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:09.933+0000 7ff46ee00700 1 -- 172.21.15.142:0/3784208494 wait complete. 2024-04-20T22:03:10.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.083+0000 7fd3d3800700 1 -- 172.21.15.142:0/939724993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3cc073940 msgr2=0x7fd3cc073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:10.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.083+0000 7fd3d3800700 1 --2- 172.21.15.142:0/939724993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3cc073940 0x7fd3cc073dc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8009910 tx=0x7fd3b8009c20 comp rx=0 tx=0).stop 2024-04-20T22:03:10.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.083+0000 7fd3d3800700 1 -- 172.21.15.142:0/939724993 shutdown_connections 2024-04-20T22:03:10.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.083+0000 7fd3d3800700 1 --2- 172.21.15.142:0/939724993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3cc073940 0x7fd3cc073dc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:10.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.083+0000 7fd3d3800700 1 --2- 172.21.15.142:0/939724993 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3cc074f10 0x7fd3cc073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:10.083 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.083+0000 7fd3d3800700 1 -- 172.21.15.142:0/939724993 >> 172.21.15.142:0/939724993 conn(0x7fd3cc0fc1c0 msgr2=0x7fd3cc0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:10.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.083+0000 7fd3d3800700 1 -- 172.21.15.142:0/939724993 shutdown_connections 2024-04-20T22:03:10.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.083+0000 7fd3d3800700 1 -- 172.21.15.142:0/939724993 wait complete. 2024-04-20T22:03:10.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.085+0000 7fd3d3800700 1 Processor -- start 2024-04-20T22:03:10.084 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.085+0000 7fd3d3800700 1 -- start start 2024-04-20T22:03:10.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.085+0000 7fd3d3800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3cc073940 0x7fd3cc198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:10.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.085+0000 7fd3d3800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3cc074f10 0x7fd3cc198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:10.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.085+0000 7fd3d3800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc199380 con 0x7fd3cc074f10 2024-04-20T22:03:10.085 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.085+0000 7fd3d3800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc1994c0 con 0x7fd3cc073940 2024-04-20T22:03:10.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.086+0000 7fd3cbe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3cc074f10 0x7fd3cc198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:10.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.086+0000 7fd3d0e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3cc073940 0x7fd3cc198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:10.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.086+0000 7fd3cbe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3cc074f10 0x7fd3cc198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40056/0 (socket says 172.21.15.142:40056) 2024-04-20T22:03:10.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.086+0000 7fd3cbe00700 1 -- 172.21.15.142:0/2861444092 learned_addr learned my addr 172.21.15.142:0/2861444092 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:03:10.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.087+0000 7fd3d0e00700 1 -- 172.21.15.142:0/2861444092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3cc074f10 msgr2=0x7fd3cc198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:10.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.087+0000 7fd3d0e00700 1 --2- 172.21.15.142:0/2861444092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3cc074f10 0x7fd3cc198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:10.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.087+0000 7fd3d0e00700 1 -- 172.21.15.142:0/2861444092 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b80095f0 con 0x7fd3cc073940 2024-04-20T22:03:10.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.087+0000 7fd3d0e00700 1 --2- 172.21.15.142:0/2861444092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3cc073940 0x7fd3cc198820 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000c8c0 tx=0x7fd3c000cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:10.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.088+0000 7fd3c9600700 1 -- 172.21.15.142:0/2861444092 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3c0004a00 con 0x7fd3cc073940 2024-04-20T22:03:10.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.088+0000 7fd3c9600700 1 -- 172.21.15.142:0/2861444092 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3c00054e0 con 0x7fd3cc073940 2024-04-20T22:03:10.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.088+0000 7fd3d3800700 1 -- 172.21.15.142:0/2861444092 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3cc19df20 con 0x7fd3cc073940 2024-04-20T22:03:10.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.088+0000 7fd3c9600700 1 -- 172.21.15.142:0/2861444092 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3c000ecc0 con 0x7fd3cc073940 2024-04-20T22:03:10.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.088+0000 7fd3d3800700 1 -- 172.21.15.142:0/2861444092 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3cc19e460 con 0x7fd3cc073940 2024-04-20T22:03:10.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.089+0000 7fd3d3800700 1 -- 172.21.15.142:0/2861444092 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3cc1929b0 con 0x7fd3cc073940 2024-04-20T22:03:10.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.092+0000 7fd3c9600700 1 -- 172.21.15.142:0/2861444092 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fd3c0005000 con 0x7fd3cc073940 2024-04-20T22:03:10.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.093+0000 7fd3c9600700 1 --2- 172.21.15.142:0/2861444092 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd3b406ecc0 0x7fd3b4071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:10.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.094+0000 7fd3c9600700 1 -- 172.21.15.142:0/2861444092 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd3c008ed40 con 0x7fd3cc073940 2024-04-20T22:03:10.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.094+0000 7fd3cbe00700 1 --2- 172.21.15.142:0/2861444092 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd3b406ecc0 0x7fd3b4071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:10.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.095+0000 7fd3cbe00700 1 --2- 172.21.15.142:0/2861444092 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd3b406ecc0 0x7fd3b4071180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8006010 tx=0x7fd3b800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:10.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.108+0000 7fd3c9600700 1 -- 172.21.15.142:0/2861444092 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fd3c005b6e0 con 0x7fd3cc073940 2024-04-20T22:03:10.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:10 smithi142 ceph-mon[79401]: pgmap v98: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/231 objects degraded (12.121%) 2024-04-20T22:03:10.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:10 smithi142 ceph-mon[79401]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:03:10.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:10 smithi142 ceph-mon[79401]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-20T22:03:10.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:10 smithi142 ceph-mon[79401]: osd.1 [v2:172.21.15.142:6810/3789493679,v1:172.21.15.142:6811/3789493679] boot 2024-04-20T22:03:10.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:10 smithi142 ceph-mon[79401]: osdmap e59: 6 total, 6 up, 6 in 2024-04-20T22:03:10.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:10 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T22:03:10.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:10 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3177308646' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:03:10.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:10 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:10.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:10 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:10.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:10 smithi142 ceph-mon[79401]: osdmap e60: 6 total, 6 up, 6 in 2024-04-20T22:03:10.459 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.459+0000 7fd3d3800700 1 -- 172.21.15.142:0/2861444092 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd3cc062560 con 0x7fd3cc073940 2024-04-20T22:03:10.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.460+0000 7fd3c9600700 1 -- 172.21.15.142:0/2861444092 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+847 (secure 0 0 0) 0x7fd3c001d360 con 0x7fd3cc073940 2024-04-20T22:03:10.460 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_WARN Degraded data redundancy: 28/231 objects degraded (12.121%), 12 pgs degraded 2024-04-20T22:03:10.460 INFO:teuthology.orchestra.run.smithi142.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 28/231 objects degraded (12.121%), 12 pgs degraded 2024-04-20T22:03:10.460 INFO:teuthology.orchestra.run.smithi142.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-04-20T22:03:10.461 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-04-20T22:03:10.461 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-04-20T22:03:10.461 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-04-20T22:03:10.461 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-04-20T22:03:10.461 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-04-20T22:03:10.461 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-04-20T22:03:10.461 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-04-20T22:03:10.461 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-04-20T22:03:10.461 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-04-20T22:03:10.461 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-04-20T22:03:10.461 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-04-20T22:03:10.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.463+0000 7fd3d3800700 1 -- 172.21.15.142:0/2861444092 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd3b406ecc0 msgr2=0x7fd3b4071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:10.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.463+0000 7fd3d3800700 1 --2- 172.21.15.142:0/2861444092 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd3b406ecc0 0x7fd3b4071180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8006010 tx=0x7fd3b800b540 comp rx=0 tx=0).stop 2024-04-20T22:03:10.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.463+0000 7fd3d3800700 1 -- 172.21.15.142:0/2861444092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3cc073940 msgr2=0x7fd3cc198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:10.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.463+0000 7fd3d3800700 1 --2- 172.21.15.142:0/2861444092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3cc073940 0x7fd3cc198820 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000c8c0 tx=0x7fd3c000cbd0 comp rx=0 tx=0).stop 2024-04-20T22:03:10.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.463+0000 7fd3d3800700 1 -- 172.21.15.142:0/2861444092 shutdown_connections 2024-04-20T22:03:10.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.463+0000 7fd3d3800700 1 --2- 172.21.15.142:0/2861444092 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd3b406ecc0 0x7fd3b4071180 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:10.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.463+0000 7fd3d3800700 1 --2- 172.21.15.142:0/2861444092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd3cc073940 0x7fd3cc198820 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:10.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.463+0000 7fd3d3800700 1 --2- 172.21.15.142:0/2861444092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3cc074f10 0x7fd3cc198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:10.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.463+0000 7fd3d3800700 1 -- 172.21.15.142:0/2861444092 >> 172.21.15.142:0/2861444092 conn(0x7fd3cc0fc1c0 msgr2=0x7fd3cc106dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:10.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.464+0000 7fd3d3800700 1 -- 172.21.15.142:0/2861444092 shutdown_connections 2024-04-20T22:03:10.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:10.464+0000 7fd3d3800700 1 -- 172.21.15.142:0/2861444092 wait complete. 2024-04-20T22:03:10.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:10 smithi164 ceph-mon[69784]: pgmap v98: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 28/231 objects degraded (12.121%) 2024-04-20T22:03:10.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:10 smithi164 ceph-mon[69784]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:03:10.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:10 smithi164 ceph-mon[69784]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-20T22:03:10.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:10 smithi164 ceph-mon[69784]: osd.1 [v2:172.21.15.142:6810/3789493679,v1:172.21.15.142:6811/3789493679] boot 2024-04-20T22:03:10.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:10 smithi164 ceph-mon[69784]: osdmap e59: 6 total, 6 up, 6 in 2024-04-20T22:03:10.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:10 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T22:03:10.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:10 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3177308646' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:03:10.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:10 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:10.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:10 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:10.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:10 smithi164 ceph-mon[69784]: osdmap e60: 6 total, 6 up, 6 in 2024-04-20T22:03:11.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:11 smithi142 ceph-mon[79401]: from='client.34296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:03:11.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:11 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2861444092' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:03:11.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:11 smithi164 ceph-mon[69784]: from='client.34296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:03:11.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:11 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/2861444092' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:03:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:12 smithi164 ceph-mon[69784]: pgmap v101: 65 pgs: 6 active+undersized+degraded, 8 active+undersized, 51 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 15/231 objects degraded (6.494%) 2024-04-20T22:03:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:12 smithi164 ceph-mon[69784]: Health check update: Degraded data redundancy: 15/231 objects degraded (6.494%), 6 pgs degraded (PG_DEGRADED) 2024-04-20T22:03:12.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:12 smithi142 ceph-mon[79401]: pgmap v101: 65 pgs: 6 active+undersized+degraded, 8 active+undersized, 51 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 15/231 objects degraded (6.494%) 2024-04-20T22:03:12.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:12 smithi142 ceph-mon[79401]: Health check update: Degraded data redundancy: 15/231 objects degraded (6.494%), 6 pgs degraded (PG_DEGRADED) 2024-04-20T22:03:14.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:14 smithi164 ceph-mon[69784]: pgmap v102: 65 pgs: 6 active+undersized+degraded, 6 active+undersized, 53 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 15/231 objects degraded (6.494%) 2024-04-20T22:03:14.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:14 smithi142 ceph-mon[79401]: pgmap v102: 65 pgs: 6 active+undersized+degraded, 6 active+undersized, 53 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 15/231 objects degraded (6.494%) 2024-04-20T22:03:15.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:15 smithi164 ceph-mon[69784]: pgmap v103: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:15.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:15.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:03:15.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:15 smithi164 ceph-mon[69784]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/231 objects degraded (6.494%), 6 pgs degraded) 2024-04-20T22:03:15.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:15 smithi164 ceph-mon[69784]: Cluster is now healthy 2024-04-20T22:03:15.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:15 smithi142 ceph-mon[79401]: pgmap v103: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:15.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:15.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:03:15.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:15 smithi142 ceph-mon[79401]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/231 objects degraded (6.494%), 6 pgs degraded) 2024-04-20T22:03:15.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:15 smithi142 ceph-mon[79401]: Cluster is now healthy 2024-04-20T22:03:17.367 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:17 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:17.368 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:17 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:17.368 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:17 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:03:17.368 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:17 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:03:17.368 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:17 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:17.368 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:17 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:03:17.368 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:17 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:03:17.368 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:17 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:03:17.368 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:17 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:03:17.368 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:17 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-20T22:03:17.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:17 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:17.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:17 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:17.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:17 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:03:17.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:17 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:03:17.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:17 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:17.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:17 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:03:17.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:17 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:03:17.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:17 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:03:17.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:17 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:03:17.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:17 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-20T22:03:18.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:18 smithi142 ceph-mon[79401]: pgmap v104: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:18.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:18 smithi142 ceph-mon[79401]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-20T22:03:18.431 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:18 smithi142 ceph-mon[79401]: Upgrade: osd.2 is safe to restart 2024-04-20T22:03:18.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:18 smithi164 ceph-mon[69784]: pgmap v104: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:18.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:18 smithi164 ceph-mon[69784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-20T22:03:18.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:18 smithi164 ceph-mon[69784]: Upgrade: osd.2 is safe to restart 2024-04-20T22:03:19.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:19 smithi142 ceph-mon[79401]: pgmap v105: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:19.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:19 smithi142 ceph-mon[79401]: Upgrade: Updating osd.2 2024-04-20T22:03:19.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:19 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:19.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:19 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-20T22:03:19.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:19 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:03:19.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:19 smithi142 ceph-mon[79401]: Deploying daemon osd.2 on smithi142 2024-04-20T22:03:19.938 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:19 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:20.198 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:19 smithi164 ceph-mon[69784]: pgmap v105: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:20.198 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:19 smithi164 ceph-mon[69784]: Upgrade: Updating osd.2 2024-04-20T22:03:20.198 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:19 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:20.199 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:19 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-20T22:03:20.199 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:19 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:03:20.199 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:19 smithi164 ceph-mon[69784]: Deploying daemon osd.2 on smithi142 2024-04-20T22:03:20.199 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:19 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:22.051 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:21 smithi142 ceph-mon[79401]: pgmap v106: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:22.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:21 smithi164 ceph-mon[69784]: pgmap v106: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:23.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:23 smithi142 ceph-mon[79401]: pgmap v107: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:23.946 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:23 smithi142 systemd[1]: Stopping Ceph osd.2 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:03:24.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:23 smithi164 ceph-mon[69784]: pgmap v107: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:24.446 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:24 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2[49574]: 2024-04-20T22:03:24.119+0000 7f75abe00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T22:03:24.447 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:24 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2[49574]: 2024-04-20T22:03:24.119+0000 7f75abe00700 -1 osd.2 60 *** Got signal Terminated *** 2024-04-20T22:03:24.447 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:24 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2[49574]: 2024-04-20T22:03:24.119+0000 7f75abe00700 -1 osd.2 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T22:03:25.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:24 smithi164 ceph-mon[69784]: osd.2 marked itself down and dead 2024-04-20T22:03:25.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:24 smithi142 ceph-mon[79401]: osd.2 marked itself down and dead 2024-04-20T22:03:25.789 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:25 smithi142 podman[98883]: 2024-04-20 22:03:25.466875048 +0000 UTC m=+1.497308302 container died 8e91653651273589ce02344898d63ff7e338db7c6c561c25f7bf79c04c2c51c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-646b8c7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, io.buildah.version=1.33.5) 2024-04-20T22:03:26.098 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:25 smithi164 ceph-mon[69784]: pgmap v108: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:26.098 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:25 smithi164 ceph-mon[69784]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-20T22:03:26.098 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:25 smithi164 ceph-mon[69784]: osdmap e61: 6 total, 5 up, 6 in 2024-04-20T22:03:26.171 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:25 smithi142 ceph-mon[79401]: pgmap v108: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:26.171 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:25 smithi142 ceph-mon[79401]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-20T22:03:26.171 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:25 smithi142 ceph-mon[79401]: osdmap e61: 6 total, 5 up, 6 in 2024-04-20T22:03:26.171 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:25 smithi142 podman[98883]: 2024-04-20 22:03:25.95363261 +0000 UTC m=+1.984065865 container cleanup 8e91653651273589ce02344898d63ff7e338db7c6c561c25f7bf79c04c2c51c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-646b8c7, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-20T22:03:26.171 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:25 smithi142 bash[98883]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2 2024-04-20T22:03:26.446 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:26 smithi142 podman[98902]: 2024-04-20 22:03:26.171363957 +0000 UTC m=+0.694136372 container remove 8e91653651273589ce02344898d63ff7e338db7c6c561c25f7bf79c04c2c51c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=reef-646b8c7, io.buildah.version=1.33.5) 2024-04-20T22:03:27.168 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:26 smithi142 ceph-mon[79401]: osdmap e62: 6 total, 5 up, 6 in 2024-04-20T22:03:27.168 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:26 smithi142 podman[98987]: 2024-04-20 22:03:26.890328628 +0000 UTC m=+0.032487359 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:03:27.169 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:26 smithi142 podman[98987]: 2024-04-20 22:03:26.997118503 +0000 UTC m=+0.139277270 container create c366a36d7c791255881b3ba9e0d480ad35e42300f9eaa34c6f795505a9cd233b (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-20T22:03:27.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:26 smithi164 ceph-mon[69784]: osdmap e62: 6 total, 5 up, 6 in 2024-04-20T22:03:27.446 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:27 smithi142 podman[98987]: 2024-04-20 22:03:27.276189897 +0000 UTC m=+0.418348671 container init c366a36d7c791255881b3ba9e0d480ad35e42300f9eaa34c6f795505a9cd233b (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-20T22:03:27.446 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:27 smithi142 podman[98987]: 2024-04-20 22:03:27.288645239 +0000 UTC m=+0.430803976 container start c366a36d7c791255881b3ba9e0d480ad35e42300f9eaa34c6f795505a9cd233b (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5) 2024-04-20T22:03:27.447 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:27 smithi142 podman[98987]: 2024-04-20 22:03:27.366279731 +0000 UTC m=+0.508438541 container attach c366a36d7c791255881b3ba9e0d480ad35e42300f9eaa34c6f795505a9cd233b (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T22:03:27.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:27 smithi142 ceph-mon[79401]: pgmap v111: 65 pgs: 4 active+undersized+degraded, 12 peering, 4 stale+active+clean, 4 active+undersized, 41 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 9/231 objects degraded (3.896%) 2024-04-20T22:03:27.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:27 smithi142 ceph-mon[79401]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-20T22:03:27.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:27 smithi142 ceph-mon[79401]: Health check failed: Degraded data redundancy: 9/231 objects degraded (3.896%), 4 pgs degraded (PG_DEGRADED) 2024-04-20T22:03:27.947 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:27 smithi142 podman[98987]: 2024-04-20 22:03:27.751713892 +0000 UTC m=+0.893872669 container died c366a36d7c791255881b3ba9e0d480ad35e42300f9eaa34c6f795505a9cd233b (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-20T22:03:28.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:27 smithi164 ceph-mon[69784]: pgmap v111: 65 pgs: 4 active+undersized+degraded, 12 peering, 4 stale+active+clean, 4 active+undersized, 41 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 9/231 objects degraded (3.896%) 2024-04-20T22:03:28.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:27 smithi164 ceph-mon[69784]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-20T22:03:28.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:27 smithi164 ceph-mon[69784]: Health check failed: Degraded data redundancy: 9/231 objects degraded (3.896%), 4 pgs degraded (PG_DEGRADED) 2024-04-20T22:03:28.696 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:28 smithi142 podman[99012]: 2024-04-20 22:03:28.444678025 +0000 UTC m=+0.675885244 container remove c366a36d7c791255881b3ba9e0d480ad35e42300f9eaa34c6f795505a9cd233b (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5) 2024-04-20T22:03:28.696 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:28 smithi142 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.2.service: Deactivated successfully. 2024-04-20T22:03:28.696 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:28 smithi142 systemd[1]: Stopped Ceph osd.2 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T22:03:28.697 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:28 smithi142 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.2.service: Consumed 1min 36.905s CPU time. 2024-04-20T22:03:29.196 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:28 smithi142 systemd[1]: Starting Ceph osd.2 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:03:29.583 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:29 smithi142 podman[99113]: 2024-04-20 22:03:29.167393142 +0000 UTC m=+0.033409200 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:03:29.583 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:29 smithi142 podman[99113]: 2024-04-20 22:03:29.296035194 +0000 UTC m=+0.162051289 container create 61af200697f7bf5aaef66f2ce0bf08f9bd2f8fef6f4fb40a597963e0045338f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-activate, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T22:03:29.583 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:29 smithi142 podman[99113]: 2024-04-20 22:03:29.583235866 +0000 UTC m=+0.449251988 container init 61af200697f7bf5aaef66f2ce0bf08f9bd2f8fef6f4fb40a597963e0045338f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-20T22:03:29.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:29 smithi142 ceph-mon[79401]: pgmap v112: 65 pgs: 7 active+undersized+degraded, 12 peering, 8 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 20/231 objects degraded (8.658%) 2024-04-20T22:03:29.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:29.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:03:29.946 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:29 smithi142 podman[99113]: 2024-04-20 22:03:29.595642346 +0000 UTC m=+0.461658410 container start 61af200697f7bf5aaef66f2ce0bf08f9bd2f8fef6f4fb40a597963e0045338f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-20T22:03:29.946 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:29 smithi142 podman[99113]: 2024-04-20 22:03:29.715171639 +0000 UTC m=+0.581187794 container attach 61af200697f7bf5aaef66f2ce0bf08f9bd2f8fef6f4fb40a597963e0045338f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-20T22:03:30.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:29 smithi164 ceph-mon[69784]: pgmap v112: 65 pgs: 7 active+undersized+degraded, 12 peering, 8 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 20/231 objects degraded (8.658%) 2024-04-20T22:03:30.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:30.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:03:30.874 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:30 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-activate[99128]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:03:30.874 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:30 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-activate[99128]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:03:30.874 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:30 smithi142 bash[99113]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:03:30.874 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:30 smithi142 bash[99113]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:03:30.874 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:30 smithi142 bash[99113]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-20T22:03:30.874 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:30 smithi142 bash[99113]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-20T22:03:30.874 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:30 smithi142 bash[99113]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-20T22:03:30.874 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:30 smithi142 bash[99113]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-20T22:03:30.874 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:30 smithi142 bash[99113]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-20T22:03:30.874 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:30 smithi142 bash[99113]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-20T22:03:30.874 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:30 smithi142 bash[99113]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-20T22:03:30.875 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:30 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-activate[99128]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-20T22:03:30.875 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:30 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-activate[99128]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-20T22:03:30.875 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:30 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-activate[99128]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-20T22:03:30.875 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:30 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-activate[99128]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-20T22:03:30.875 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:30 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-activate[99128]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-20T22:03:30.875 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:30 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-activate[99128]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-20T22:03:30.875 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:30 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-activate[99128]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-20T22:03:30.875 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:30 smithi142 podman[99113]: 2024-04-20 22:03:30.55705282 +0000 UTC m=+1.423068922 container died 61af200697f7bf5aaef66f2ce0bf08f9bd2f8fef6f4fb40a597963e0045338f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-activate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-20T22:03:31.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:30 smithi164 ceph-mon[69784]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-20T22:03:31.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:30 smithi142 ceph-mon[79401]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-20T22:03:31.696 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:31 smithi142 podman[99257]: 2024-04-20 22:03:31.319070161 +0000 UTC m=+0.745300535 container remove 61af200697f7bf5aaef66f2ce0bf08f9bd2f8fef6f4fb40a597963e0045338f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-activate, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=) 2024-04-20T22:03:32.011 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:31 smithi142 ceph-mon[79401]: pgmap v113: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/231 objects degraded (12.987%) 2024-04-20T22:03:32.011 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:31 smithi142 podman[99315]: 2024-04-20 22:03:31.608772772 +0000 UTC m=+0.037425570 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:03:32.011 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:31 smithi142 podman[99315]: 2024-04-20 22:03:31.786768132 +0000 UTC m=+0.215420967 container create 3e2d91f49494be369b503fec77a1fe3807f7a04f89b2e03efe702bfe689cabdb (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-20T22:03:32.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:31 smithi164 ceph-mon[69784]: pgmap v113: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/231 objects degraded (12.987%) 2024-04-20T22:03:32.446 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:32 smithi142 podman[99315]: 2024-04-20 22:03:32.098688129 +0000 UTC m=+0.527340970 container init 3e2d91f49494be369b503fec77a1fe3807f7a04f89b2e03efe702bfe689cabdb (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-20T22:03:32.446 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:32 smithi142 podman[99315]: 2024-04-20 22:03:32.109481424 +0000 UTC m=+0.538134266 container start 3e2d91f49494be369b503fec77a1fe3807f7a04f89b2e03efe702bfe689cabdb (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-20T22:03:32.446 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:32 smithi142 ceph-osd[99334]: -- 172.21.15.142:0/2373433416 <== mon.0 v2:172.21.15.142:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55652d18d680 con 0x55652d157000 2024-04-20T22:03:32.446 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:32 smithi142 bash[99315]: 3e2d91f49494be369b503fec77a1fe3807f7a04f89b2e03efe702bfe689cabdb 2024-04-20T22:03:32.446 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:32 smithi142 systemd[1]: Started Ceph osd.2 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T22:03:32.946 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:32 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2[99330]: 2024-04-20T22:03:32.680+0000 7fb64ea7c7c0 -1 Falling back to public interface 2024-04-20T22:03:33.579 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:33 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:33.579 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:33 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:33.579 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:33 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:03:33.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:33 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:33.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:33 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:33.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:33 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:03:34.610 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:34 smithi142 ceph-mon[79401]: pgmap v114: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/231 objects degraded (12.987%) 2024-04-20T22:03:34.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:34 smithi164 ceph-mon[69784]: pgmap v114: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/231 objects degraded (12.987%) 2024-04-20T22:03:36.661 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:36 smithi142 ceph-mon[79401]: pgmap v115: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/231 objects degraded (12.987%) 2024-04-20T22:03:36.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:36 smithi164 ceph-mon[69784]: pgmap v115: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/231 objects degraded (12.987%) 2024-04-20T22:03:37.593 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:37 smithi142 ceph-mon[79401]: Health check update: Degraded data redundancy: 30/231 objects degraded (12.987%), 12 pgs degraded (PG_DEGRADED) 2024-04-20T22:03:37.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:37 smithi164 ceph-mon[69784]: Health check update: Degraded data redundancy: 30/231 objects degraded (12.987%), 12 pgs degraded (PG_DEGRADED) 2024-04-20T22:03:38.196 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:37 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2[99330]: 2024-04-20T22:03:37.893+0000 7fb64ea7c7c0 -1 osd.2 60 log_to_monitors true 2024-04-20T22:03:38.567 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:38 smithi142 ceph-mon[79401]: pgmap v116: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/231 objects degraded (12.987%) 2024-04-20T22:03:38.567 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:38 smithi142 ceph-mon[79401]: from='osd.2 [v2:172.21.15.142:6818/4113404383,v1:172.21.15.142:6819/4113404383]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-20T22:03:38.567 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:03:38 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2[99330]: 2024-04-20T22:03:38.359+0000 7fb63de00700 -1 osd.2 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T22:03:38.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:38 smithi164 ceph-mon[69784]: pgmap v116: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/231 objects degraded (12.987%) 2024-04-20T22:03:38.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:38 smithi164 ceph-mon[69784]: from='osd.2 [v2:172.21.15.142:6818/4113404383,v1:172.21.15.142:6819/4113404383]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-20T22:03:39.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:39 smithi142 ceph-mon[79401]: from='osd.2 [v2:172.21.15.142:6818/4113404383,v1:172.21.15.142:6819/4113404383]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-20T22:03:39.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:39 smithi142 ceph-mon[79401]: osdmap e63: 6 total, 5 up, 6 in 2024-04-20T22:03:39.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:39 smithi142 ceph-mon[79401]: from='osd.2 [v2:172.21.15.142:6818/4113404383,v1:172.21.15.142:6819/4113404383]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-04-20T22:03:39.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:39 smithi164 ceph-mon[69784]: from='osd.2 [v2:172.21.15.142:6818/4113404383,v1:172.21.15.142:6819/4113404383]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-20T22:03:39.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:39 smithi164 ceph-mon[69784]: osdmap e63: 6 total, 5 up, 6 in 2024-04-20T22:03:39.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:39 smithi164 ceph-mon[69784]: from='osd.2 [v2:172.21.15.142:6818/4113404383,v1:172.21.15.142:6819/4113404383]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2024-04-20T22:03:40.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:40 smithi142 ceph-mon[79401]: pgmap v118: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/231 objects degraded (12.987%) 2024-04-20T22:03:40.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:40 smithi142 ceph-mon[79401]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-20T22:03:40.632 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:40 smithi142 ceph-mon[79401]: osd.2 [v2:172.21.15.142:6818/4113404383,v1:172.21.15.142:6819/4113404383] boot 2024-04-20T22:03:40.633 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:40 smithi142 ceph-mon[79401]: osdmap e64: 6 total, 6 up, 6 in 2024-04-20T22:03:40.633 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:40 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T22:03:40.633 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:40 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:40.633 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:40 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:40.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.632+0000 7f98aa000700 1 -- 172.21.15.142:0/2739164811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98a4100d30 msgr2=0x7f98a41011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:40.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.632+0000 7f98aa000700 1 --2- 172.21.15.142:0/2739164811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98a4100d30 0x7f98a41011b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9890009910 tx=0x7f9890009c20 comp rx=0 tx=0).stop 2024-04-20T22:03:40.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.632+0000 7f98aa000700 1 -- 172.21.15.142:0/2739164811 shutdown_connections 2024-04-20T22:03:40.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.632+0000 7f98aa000700 1 --2- 172.21.15.142:0/2739164811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98a4100d30 0x7f98a41011b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:40.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.632+0000 7f98aa000700 1 --2- 172.21.15.142:0/2739164811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a4100010 0x7f98a4100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:40.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.632+0000 7f98aa000700 1 -- 172.21.15.142:0/2739164811 >> 172.21.15.142:0/2739164811 conn(0x7f98a40fa810 msgr2=0x7f98a40fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:40.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.632+0000 7f98aa000700 1 -- 172.21.15.142:0/2739164811 shutdown_connections 2024-04-20T22:03:40.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.632+0000 7f98aa000700 1 -- 172.21.15.142:0/2739164811 wait complete. 2024-04-20T22:03:40.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.633+0000 7f98aa000700 1 Processor -- start 2024-04-20T22:03:40.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.633+0000 7f98aa000700 1 -- start start 2024-04-20T22:03:40.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.634+0000 7f98aa000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a4100010 0x7f98a4198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:40.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.634+0000 7f98aa000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98a4100d30 0x7f98a4198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:40.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.634+0000 7f98aa000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a41993c0 con 0x7f98a4100d30 2024-04-20T22:03:40.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.634+0000 7f98aa000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a4199500 con 0x7f98a4100010 2024-04-20T22:03:40.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.634+0000 7f98a2a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98a4100d30 0x7f98a4198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:40.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.634+0000 7f98a2a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98a4100d30 0x7f98a4198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38244/0 (socket says 172.21.15.142:38244) 2024-04-20T22:03:40.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.634+0000 7f98a2a00700 1 -- 172.21.15.142:0/2634688563 learned_addr learned my addr 172.21.15.142:0/2634688563 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:03:40.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.635+0000 7f98a3400700 1 --2- 172.21.15.142:0/2634688563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a4100010 0x7f98a4198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:40.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.635+0000 7f98a2a00700 1 -- 172.21.15.142:0/2634688563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a4100010 msgr2=0x7f98a4198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:40.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.635+0000 7f98a2a00700 1 --2- 172.21.15.142:0/2634688563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a4100010 0x7f98a4198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:40.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.635+0000 7f98a2a00700 1 -- 172.21.15.142:0/2634688563 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98900095f0 con 0x7f98a4100d30 2024-04-20T22:03:40.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.635+0000 7f98a2a00700 1 --2- 172.21.15.142:0/2634688563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98a4100d30 0x7f98a4198da0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f989000bd70 tx=0x7f989000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:40.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.636+0000 7f989be00700 1 -- 172.21.15.142:0/2634688563 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f989001d070 con 0x7f98a4100d30 2024-04-20T22:03:40.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.636+0000 7f989be00700 1 -- 172.21.15.142:0/2634688563 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f989000f460 con 0x7f98a4100d30 2024-04-20T22:03:40.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.636+0000 7f98aa000700 1 -- 172.21.15.142:0/2634688563 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a419df00 con 0x7f98a4100d30 2024-04-20T22:03:40.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.636+0000 7f989be00700 1 -- 172.21.15.142:0/2634688563 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9890021640 con 0x7f98a4100d30 2024-04-20T22:03:40.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.637+0000 7f98aa000700 1 -- 172.21.15.142:0/2634688563 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a419e3a0 con 0x7f98a4100d30 2024-04-20T22:03:40.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.638+0000 7f98aa000700 1 -- 172.21.15.142:0/2634688563 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a4062510 con 0x7f98a4100d30 2024-04-20T22:03:40.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.640+0000 7f989be00700 1 -- 172.21.15.142:0/2634688563 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f989000fab0 con 0x7f98a4100d30 2024-04-20T22:03:40.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.641+0000 7f989be00700 1 --2- 172.21.15.142:0/2634688563 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f988806ecc0 0x7f9888071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:40.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.641+0000 7f989be00700 1 -- 172.21.15.142:0/2634688563 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9890090600 con 0x7f98a4100d30 2024-04-20T22:03:40.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.642+0000 7f98a3400700 1 --2- 172.21.15.142:0/2634688563 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f988806ecc0 0x7f9888071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:40.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.643+0000 7f98a3400700 1 --2- 172.21.15.142:0/2634688563 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f988806ecc0 0x7f9888071180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f98a40680e0 tx=0x7f989400a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:40.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.645+0000 7f989be00700 1 -- 172.21.15.142:0/2634688563 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f989005cfc0 con 0x7f98a4100d30 2024-04-20T22:03:40.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:40 smithi164 ceph-mon[69784]: pgmap v118: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/231 objects degraded (12.987%) 2024-04-20T22:03:40.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:40 smithi164 ceph-mon[69784]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-20T22:03:40.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:40 smithi164 ceph-mon[69784]: osd.2 [v2:172.21.15.142:6818/4113404383,v1:172.21.15.142:6819/4113404383] boot 2024-04-20T22:03:40.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:40 smithi164 ceph-mon[69784]: osdmap e64: 6 total, 6 up, 6 in 2024-04-20T22:03:40.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:40 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T22:03:40.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:40 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:40.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:40 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:40.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.888+0000 7f98aa000700 1 -- 172.21.15.142:0/2634688563 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98a40fc7c0 con 0x7f988806ecc0 2024-04-20T22:03:40.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.890+0000 7f989be00700 1 -- 172.21.15.142:0/2634688563 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f98a40fc7c0 con 0x7f988806ecc0 2024-04-20T22:03:40.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.894+0000 7f98aa000700 1 -- 172.21.15.142:0/2634688563 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f988806ecc0 msgr2=0x7f9888071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:40.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.894+0000 7f98aa000700 1 --2- 172.21.15.142:0/2634688563 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f988806ecc0 0x7f9888071180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f98a40680e0 tx=0x7f989400a380 comp rx=0 tx=0).stop 2024-04-20T22:03:40.893 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.894+0000 7f98aa000700 1 -- 172.21.15.142:0/2634688563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98a4100d30 msgr2=0x7f98a4198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:40.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.894+0000 7f98aa000700 1 --2- 172.21.15.142:0/2634688563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98a4100d30 0x7f98a4198da0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f989000bd70 tx=0x7f989000bda0 comp rx=0 tx=0).stop 2024-04-20T22:03:40.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.894+0000 7f98aa000700 1 -- 172.21.15.142:0/2634688563 shutdown_connections 2024-04-20T22:03:40.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.894+0000 7f98aa000700 1 --2- 172.21.15.142:0/2634688563 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f988806ecc0 0x7f9888071180 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:40.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.894+0000 7f98aa000700 1 --2- 172.21.15.142:0/2634688563 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a4100010 0x7f98a4198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:40.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.894+0000 7f98aa000700 1 --2- 172.21.15.142:0/2634688563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98a4100d30 0x7f98a4198da0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:40.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.894+0000 7f98aa000700 1 -- 172.21.15.142:0/2634688563 >> 172.21.15.142:0/2634688563 conn(0x7f98a40fa810 msgr2=0x7f98a40fc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:40.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.894+0000 7f98aa000700 1 -- 172.21.15.142:0/2634688563 shutdown_connections 2024-04-20T22:03:40.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:40.895+0000 7f98aa000700 1 -- 172.21.15.142:0/2634688563 wait complete. 2024-04-20T22:03:40.919 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T22:03:41.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.062+0000 7f78da000700 1 -- 172.21.15.142:0/1572654395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d40ff930 msgr2=0x7f78d40ffd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:41.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.062+0000 7f78da000700 1 --2- 172.21.15.142:0/1572654395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d40ff930 0x7f78d40ffd50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009910 tx=0x7f78c8009c20 comp rx=0 tx=0).stop 2024-04-20T22:03:41.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.062+0000 7f78da000700 1 -- 172.21.15.142:0/1572654395 shutdown_connections 2024-04-20T22:03:41.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.062+0000 7f78da000700 1 --2- 172.21.15.142:0/1572654395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78d4100b30 0x7f78d4100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:41.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.062+0000 7f78da000700 1 --2- 172.21.15.142:0/1572654395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d40ff930 0x7f78d40ffd50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:41.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.062+0000 7f78da000700 1 -- 172.21.15.142:0/1572654395 >> 172.21.15.142:0/1572654395 conn(0x7f78d40faef0 msgr2=0x7f78d40fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:41.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.063+0000 7f78da000700 1 -- 172.21.15.142:0/1572654395 shutdown_connections 2024-04-20T22:03:41.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.063+0000 7f78da000700 1 -- 172.21.15.142:0/1572654395 wait complete. 2024-04-20T22:03:41.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.064+0000 7f78da000700 1 Processor -- start 2024-04-20T22:03:41.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.064+0000 7f78da000700 1 -- start start 2024-04-20T22:03:41.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.064+0000 7f78da000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78d40ff930 0x7f78d4196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:41.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.064+0000 7f78da000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d4100b30 0x7f78d41969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:41.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.064+0000 7f78da000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d4196fe0 con 0x7f78d4100b30 2024-04-20T22:03:41.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.064+0000 7f78da000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d4197120 con 0x7f78d40ff930 2024-04-20T22:03:41.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.064+0000 7f78d3e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d4100b30 0x7f78d41969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:41.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.064+0000 7f78d3e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d4100b30 0x7f78d41969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38258/0 (socket says 172.21.15.142:38258) 2024-04-20T22:03:41.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.064+0000 7f78d3e00700 1 -- 172.21.15.142:0/1076598462 learned_addr learned my addr 172.21.15.142:0/1076598462 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:03:41.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.065+0000 7f78d8c00700 1 --2- 172.21.15.142:0/1076598462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78d40ff930 0x7f78d4196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:41.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.065+0000 7f78d3e00700 1 -- 172.21.15.142:0/1076598462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78d40ff930 msgr2=0x7f78d4196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:41.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.065+0000 7f78d3e00700 1 --2- 172.21.15.142:0/1076598462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78d40ff930 0x7f78d4196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:41.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.065+0000 7f78d3e00700 1 -- 172.21.15.142:0/1076598462 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c80095f0 con 0x7f78d4100b30 2024-04-20T22:03:41.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.065+0000 7f78d8c00700 1 --2- 172.21.15.142:0/1076598462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78d40ff930 0x7f78d4196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T22:03:41.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.065+0000 7f78d3e00700 1 --2- 172.21.15.142:0/1076598462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d4100b30 0x7f78d41969c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f78c000d8d0 tx=0x7f78c000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:41.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.066+0000 7f78d1600700 1 -- 172.21.15.142:0/1076598462 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78c0009940 con 0x7f78d4100b30 2024-04-20T22:03:41.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.066+0000 7f78da000700 1 -- 172.21.15.142:0/1076598462 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d419bb80 con 0x7f78d4100b30 2024-04-20T22:03:41.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.066+0000 7f78d1600700 1 -- 172.21.15.142:0/1076598462 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f78c0010460 con 0x7f78d4100b30 2024-04-20T22:03:41.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.066+0000 7f78d1600700 1 -- 172.21.15.142:0/1076598462 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78c000f5f0 con 0x7f78d4100b30 2024-04-20T22:03:41.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.066+0000 7f78da000700 1 -- 172.21.15.142:0/1076598462 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d419c150 con 0x7f78d4100b30 2024-04-20T22:03:41.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.067+0000 7f78da000700 1 -- 172.21.15.142:0/1076598462 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d4062510 con 0x7f78d4100b30 2024-04-20T22:03:41.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.068+0000 7f78d1600700 1 -- 172.21.15.142:0/1076598462 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f78c00105d0 con 0x7f78d4100b30 2024-04-20T22:03:41.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.069+0000 7f78d1600700 1 --2- 172.21.15.142:0/1076598462 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f78bc06ecc0 0x7f78bc071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:41.069 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.069+0000 7f78d1600700 1 -- 172.21.15.142:0/1076598462 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f78c008ee10 con 0x7f78d4100b30 2024-04-20T22:03:41.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.070+0000 7f78d8c00700 1 --2- 172.21.15.142:0/1076598462 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f78bc06ecc0 0x7f78bc071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:41.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.071+0000 7f78d8c00700 1 --2- 172.21.15.142:0/1076598462 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f78bc06ecc0 0x7f78bc071180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f78c8006010 tx=0x7f78c800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:41.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.075+0000 7f78d1600700 1 -- 172.21.15.142:0/1076598462 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f78c005b750 con 0x7f78d4100b30 2024-04-20T22:03:41.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.317+0000 7f78da000700 1 -- 172.21.15.142:0/1076598462 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f78d4068cf0 con 0x7f78bc06ecc0 2024-04-20T22:03:41.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.319+0000 7f78d1600700 1 -- 172.21.15.142:0/1076598462 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f78d4068cf0 con 0x7f78bc06ecc0 2024-04-20T22:03:41.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.321+0000 7f78da000700 1 -- 172.21.15.142:0/1076598462 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f78bc06ecc0 msgr2=0x7f78bc071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:41.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.321+0000 7f78da000700 1 --2- 172.21.15.142:0/1076598462 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f78bc06ecc0 0x7f78bc071180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f78c8006010 tx=0x7f78c800b540 comp rx=0 tx=0).stop 2024-04-20T22:03:41.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.321+0000 7f78da000700 1 -- 172.21.15.142:0/1076598462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d4100b30 msgr2=0x7f78d41969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:41.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.321+0000 7f78da000700 1 --2- 172.21.15.142:0/1076598462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d4100b30 0x7f78d41969c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f78c000d8d0 tx=0x7f78c000dc90 comp rx=0 tx=0).stop 2024-04-20T22:03:41.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.321+0000 7f78da000700 1 -- 172.21.15.142:0/1076598462 shutdown_connections 2024-04-20T22:03:41.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.321+0000 7f78da000700 1 --2- 172.21.15.142:0/1076598462 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f78bc06ecc0 0x7f78bc071180 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:41.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.321+0000 7f78da000700 1 --2- 172.21.15.142:0/1076598462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78d40ff930 0x7f78d4196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:41.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.321+0000 7f78da000700 1 --2- 172.21.15.142:0/1076598462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78d4100b30 0x7f78d41969c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:41.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.321+0000 7f78da000700 1 -- 172.21.15.142:0/1076598462 >> 172.21.15.142:0/1076598462 conn(0x7f78d40faef0 msgr2=0x7f78d40685e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:41.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.322+0000 7f78da000700 1 -- 172.21.15.142:0/1076598462 shutdown_connections 2024-04-20T22:03:41.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.322+0000 7f78da000700 1 -- 172.21.15.142:0/1076598462 wait complete. 2024-04-20T22:03:41.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.477+0000 7f1453200700 1 -- 172.21.15.142:0/2521175784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1454101500 msgr2=0x7f14541038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:41.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.477+0000 7f1453200700 1 --2- 172.21.15.142:0/2521175784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1454101500 0x7f14541038f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1444009910 tx=0x7f1444009c20 comp rx=0 tx=0).stop 2024-04-20T22:03:41.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.477+0000 7f1453200700 1 -- 172.21.15.142:0/2521175784 shutdown_connections 2024-04-20T22:03:41.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.477+0000 7f1453200700 1 --2- 172.21.15.142:0/2521175784 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1454103e30 0x7f1454106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:41.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.477+0000 7f1453200700 1 --2- 172.21.15.142:0/2521175784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1454101500 0x7f14541038f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:41.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.477+0000 7f1453200700 1 -- 172.21.15.142:0/2521175784 >> 172.21.15.142:0/2521175784 conn(0x7f14540faf10 msgr2=0x7f14540fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:41.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.477+0000 7f1453200700 1 -- 172.21.15.142:0/2521175784 shutdown_connections 2024-04-20T22:03:41.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.477+0000 7f1453200700 1 -- 172.21.15.142:0/2521175784 wait complete. 2024-04-20T22:03:41.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.478+0000 7f1453200700 1 Processor -- start 2024-04-20T22:03:41.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.478+0000 7f1453200700 1 -- start start 2024-04-20T22:03:41.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.479+0000 7f1453200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1454101500 0x7f14541964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:41.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.479+0000 7f1453200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1454103e30 0x7f1454196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:41.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.479+0000 7f1453200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1454197050 con 0x7f1454101500 2024-04-20T22:03:41.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.479+0000 7f1453200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1454197190 con 0x7f1454103e30 2024-04-20T22:03:41.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.479+0000 7f1451e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1454101500 0x7f14541964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:41.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.479+0000 7f1451e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1454101500 0x7f14541964f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38272/0 (socket says 172.21.15.142:38272) 2024-04-20T22:03:41.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.479+0000 7f1451e00700 1 -- 172.21.15.142:0/2246275559 learned_addr learned my addr 172.21.15.142:0/2246275559 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:03:41.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.480+0000 7f1451400700 1 --2- 172.21.15.142:0/2246275559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1454103e30 0x7f1454196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:41.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.480+0000 7f1451e00700 1 -- 172.21.15.142:0/2246275559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1454103e30 msgr2=0x7f1454196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:41.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.480+0000 7f1451e00700 1 --2- 172.21.15.142:0/2246275559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1454103e30 0x7f1454196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:41.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.480+0000 7f1451e00700 1 -- 172.21.15.142:0/2246275559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14440095f0 con 0x7f1454101500 2024-04-20T22:03:41.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.480+0000 7f1451e00700 1 --2- 172.21.15.142:0/2246275559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1454101500 0x7f14541964f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f144400bd70 tx=0x7f144400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:41.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.480+0000 7f144aa00700 1 -- 172.21.15.142:0/2246275559 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f144401d070 con 0x7f1454101500 2024-04-20T22:03:41.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.481+0000 7f144aa00700 1 -- 172.21.15.142:0/2246275559 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f144400f460 con 0x7f1454101500 2024-04-20T22:03:41.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.481+0000 7f1453200700 1 -- 172.21.15.142:0/2246275559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145419bb90 con 0x7f1454101500 2024-04-20T22:03:41.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.481+0000 7f144aa00700 1 -- 172.21.15.142:0/2246275559 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1444021620 con 0x7f1454101500 2024-04-20T22:03:41.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.481+0000 7f1453200700 1 -- 172.21.15.142:0/2246275559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145419c080 con 0x7f1454101500 2024-04-20T22:03:41.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.482+0000 7f1453200700 1 -- 172.21.15.142:0/2246275559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145404f400 con 0x7f1454101500 2024-04-20T22:03:41.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.484+0000 7f144aa00700 1 -- 172.21.15.142:0/2246275559 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f144400fa70 con 0x7f1454101500 2024-04-20T22:03:41.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.485+0000 7f144aa00700 1 --2- 172.21.15.142:0/2246275559 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f143806ecd0 0x7f1438071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:41.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.485+0000 7f144aa00700 1 -- 172.21.15.142:0/2246275559 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1444090280 con 0x7f1454101500 2024-04-20T22:03:41.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.485+0000 7f1451400700 1 --2- 172.21.15.142:0/2246275559 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f143806ecd0 0x7f1438071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:41.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.486+0000 7f1451400700 1 --2- 172.21.15.142:0/2246275559 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f143806ecd0 0x7f1438071190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1440006fd0 tx=0x7f1440008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:41.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.490+0000 7f144aa00700 1 -- 172.21.15.142:0/2246275559 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f144405cb20 con 0x7f1454101500 2024-04-20T22:03:41.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:41 smithi164 ceph-mon[69784]: osdmap e65: 6 total, 6 up, 6 in 2024-04-20T22:03:41.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:41 smithi164 ceph-mon[69784]: pgmap v121: 65 pgs: 8 active+undersized+degraded, 9 active+undersized, 48 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 21/231 objects degraded (9.091%) 2024-04-20T22:03:41.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:41 smithi164 ceph-mon[69784]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:03:41.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:41.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:41.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:41 smithi164 ceph-mon[69784]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:03:41.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:41 smithi142 ceph-mon[79401]: osdmap e65: 6 total, 6 up, 6 in 2024-04-20T22:03:41.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:41 smithi142 ceph-mon[79401]: pgmap v121: 65 pgs: 8 active+undersized+degraded, 9 active+undersized, 48 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 21/231 objects degraded (9.091%) 2024-04-20T22:03:41.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:41 smithi142 ceph-mon[79401]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:03:41.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:41.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:41.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:41 smithi142 ceph-mon[79401]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:03:41.719 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.719+0000 7f1453200700 1 -- 172.21.15.142:0/2246275559 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1454104810 con 0x7f143806ecd0 2024-04-20T22:03:41.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.732+0000 7f144aa00700 1 -- 172.21.15.142:0/2246275559 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f1454104810 con 0x7f143806ecd0 2024-04-20T22:03:41.732 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:03:41.732 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (14m) 2s ago 16m 13.7M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T22:03:41.732 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (16m) 2s ago 16m 8682k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T22:03:41.732 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (15m) 99s ago 15m 7784k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T22:03:41.733 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (112s) 2s ago 16m 6665k - 19.0.0-3133-ga8c84f59 76bc6b91b726 64521ed7125b 2024-04-20T22:03:41.733 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (104s) 99s ago 15m 6656k - 19.0.0-3133-ga8c84f59 76bc6b91b726 893c6f16ee6d 2024-04-20T22:03:41.733 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (14m) 2s ago 15m 76.6M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T22:03:41.733 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (9m) 2s ago 9m 140M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 b68e279d7945 2024-04-20T22:03:41.733 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (8m) 2s ago 8m 16.4M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T22:03:41.733 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (8m) 99s ago 8m 15.7M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T22:03:41.733 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (9m) 99s ago 9m 16.1M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T22:03:41.733 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (5m) 2s ago 18m 505M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:03:41.733 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (4m) 99s ago 14m 451M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:03:41.733 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (3m) 2s ago 18m 47.0M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 af10a542c918 2024-04-20T22:03:41.733 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (3m) 99s ago 14m 33.5M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 133512694d46 2024-04-20T22:03:41.733 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (16m) 2s ago 16m 7894k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T22:03:41.733 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (15m) 99s ago 15m 7990k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T22:03:41.733 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (72s) 2s ago 13m 95.7M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 b7206d05a7cd 2024-04-20T22:03:41.733 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (41s) 2s ago 13m 91.8M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 82bcc0c46762 2024-04-20T22:03:41.734 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (10s) 2s ago 12m 12.6M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 3e2d91f49494 2024-04-20T22:03:41.734 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (12m) 99s ago 12m 293M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 c081911f56ab 2024-04-20T22:03:41.734 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (11m) 99s ago 11m 249M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 39e09d63d44f 2024-04-20T22:03:41.734 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (10m) 99s ago 10m 229M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4f36124aeb0d 2024-04-20T22:03:41.734 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (4m) 2s ago 15m 73.0M - 2.43.0 a07b618ecd1d 46b76c20eae5 2024-04-20T22:03:41.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.735+0000 7f1453200700 1 -- 172.21.15.142:0/2246275559 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f143806ecd0 msgr2=0x7f1438071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:41.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.735+0000 7f1453200700 1 --2- 172.21.15.142:0/2246275559 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f143806ecd0 0x7f1438071190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1440006fd0 tx=0x7f1440008040 comp rx=0 tx=0).stop 2024-04-20T22:03:41.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.735+0000 7f1453200700 1 -- 172.21.15.142:0/2246275559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1454101500 msgr2=0x7f14541964f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:41.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.735+0000 7f1453200700 1 --2- 172.21.15.142:0/2246275559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1454101500 0x7f14541964f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f144400bd70 tx=0x7f144400be50 comp rx=0 tx=0).stop 2024-04-20T22:03:41.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.735+0000 7f1453200700 1 -- 172.21.15.142:0/2246275559 shutdown_connections 2024-04-20T22:03:41.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.735+0000 7f1453200700 1 --2- 172.21.15.142:0/2246275559 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f143806ecd0 0x7f1438071190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:41.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.735+0000 7f1453200700 1 --2- 172.21.15.142:0/2246275559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1454101500 0x7f14541964f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:41.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.735+0000 7f1453200700 1 --2- 172.21.15.142:0/2246275559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1454103e30 0x7f1454196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:41.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.735+0000 7f1453200700 1 -- 172.21.15.142:0/2246275559 >> 172.21.15.142:0/2246275559 conn(0x7f14540faf10 msgr2=0x7f14540fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:41.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.735+0000 7f1453200700 1 -- 172.21.15.142:0/2246275559 shutdown_connections 2024-04-20T22:03:41.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.735+0000 7f1453200700 1 -- 172.21.15.142:0/2246275559 wait complete. 2024-04-20T22:03:41.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.884+0000 7fb752c00700 1 -- 172.21.15.142:0/3051890351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb74c103fe0 msgr2=0x7fb74c1063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:41.884 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.884+0000 7fb752c00700 1 --2- 172.21.15.142:0/3051890351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb74c103fe0 0x7fb74c1063d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb738009910 tx=0x7fb738009c20 comp rx=0 tx=0).stop 2024-04-20T22:03:41.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.884+0000 7fb752c00700 1 -- 172.21.15.142:0/3051890351 shutdown_connections 2024-04-20T22:03:41.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.884+0000 7fb752c00700 1 --2- 172.21.15.142:0/3051890351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb74c103fe0 0x7fb74c1063d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:41.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.884+0000 7fb752c00700 1 --2- 172.21.15.142:0/3051890351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb74c1016b0 0x7fb74c103aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:41.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.884+0000 7fb752c00700 1 -- 172.21.15.142:0/3051890351 >> 172.21.15.142:0/3051890351 conn(0x7fb74c0fb0e0 msgr2=0x7fb74c0fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:41.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.884+0000 7fb752c00700 1 -- 172.21.15.142:0/3051890351 shutdown_connections 2024-04-20T22:03:41.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.885+0000 7fb752c00700 1 -- 172.21.15.142:0/3051890351 wait complete. 2024-04-20T22:03:41.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.885+0000 7fb752c00700 1 Processor -- start 2024-04-20T22:03:41.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.886+0000 7fb752c00700 1 -- start start 2024-04-20T22:03:41.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.886+0000 7fb752c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb74c1016b0 0x7fb74c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:41.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.886+0000 7fb752c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb74c103fe0 0x7fb74c198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:41.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.886+0000 7fb752c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c199340 con 0x7fb74c103fe0 2024-04-20T22:03:41.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.886+0000 7fb752c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c199480 con 0x7fb74c1016b0 2024-04-20T22:03:41.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.886+0000 7fb74b400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb74c103fe0 0x7fb74c198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:41.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.886+0000 7fb74b400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb74c103fe0 0x7fb74c198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38278/0 (socket says 172.21.15.142:38278) 2024-04-20T22:03:41.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.886+0000 7fb74b400700 1 -- 172.21.15.142:0/3612133623 learned_addr learned my addr 172.21.15.142:0/3612133623 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:03:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.887+0000 7fb74be00700 1 --2- 172.21.15.142:0/3612133623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb74c1016b0 0x7fb74c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.887+0000 7fb74b400700 1 -- 172.21.15.142:0/3612133623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb74c1016b0 msgr2=0x7fb74c1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.887+0000 7fb74b400700 1 --2- 172.21.15.142:0/3612133623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb74c1016b0 0x7fb74c1987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.887+0000 7fb74b400700 1 -- 172.21.15.142:0/3612133623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7380095f0 con 0x7fb74c103fe0 2024-04-20T22:03:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.887+0000 7fb74b400700 1 --2- 172.21.15.142:0/3612133623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb74c103fe0 0x7fb74c198d20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb738006010 tx=0x7fb73800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.888+0000 7fb748c00700 1 -- 172.21.15.142:0/3612133623 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb73801d070 con 0x7fb74c103fe0 2024-04-20T22:03:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.888+0000 7fb748c00700 1 -- 172.21.15.142:0/3612133623 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb73800f460 con 0x7fb74c103fe0 2024-04-20T22:03:41.888 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.888+0000 7fb752c00700 1 -- 172.21.15.142:0/3612133623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74c19de10 con 0x7fb74c103fe0 2024-04-20T22:03:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.888+0000 7fb748c00700 1 -- 172.21.15.142:0/3612133623 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb738021640 con 0x7fb74c103fe0 2024-04-20T22:03:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.888+0000 7fb752c00700 1 -- 172.21.15.142:0/3612133623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74c19e350 con 0x7fb74c103fe0 2024-04-20T22:03:41.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.889+0000 7fb752c00700 1 -- 172.21.15.142:0/3612133623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74c0fcc60 con 0x7fb74c103fe0 2024-04-20T22:03:41.890 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.891+0000 7fb748c00700 1 -- 172.21.15.142:0/3612133623 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fb73800fab0 con 0x7fb74c103fe0 2024-04-20T22:03:41.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.892+0000 7fb748c00700 1 --2- 172.21.15.142:0/3612133623 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb73006ecc0 0x7fb730071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:41.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.892+0000 7fb748c00700 1 -- 172.21.15.142:0/3612133623 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb738090220 con 0x7fb74c103fe0 2024-04-20T22:03:41.894 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.892+0000 7fb74be00700 1 --2- 172.21.15.142:0/3612133623 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb73006ecc0 0x7fb730071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:41.895 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.893+0000 7fb74be00700 1 --2- 172.21.15.142:0/3612133623 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb73006ecc0 0x7fb730071180 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb73c005fd0 tx=0x7fb73c00a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:41.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:41.898+0000 7fb748c00700 1 -- 172.21.15.142:0/3612133623 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fb73805cac0 con 0x7fb74c103fe0 2024-04-20T22:03:42.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.228+0000 7fb752c00700 1 -- 172.21.15.142:0/3612133623 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb74c04ebb0 con 0x7fb74c103fe0 2024-04-20T22:03:42.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.229+0000 7fb748c00700 1 -- 172.21.15.142:0/3612133623 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+836 (secure 0 0 0) 0x7fb73805c650 con 0x7fb74c103fe0 2024-04-20T22:03:42.229 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:03:42.229 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:03:42.229 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:03:42.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:03:42.229 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:03:42.229 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:03:42.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:03:42.229 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:03:42.229 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 3, 2024-04-20T22:03:42.229 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 3 2024-04-20T22:03:42.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:03:42.230 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:03:42.230 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4 2024-04-20T22:03:42.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:03:42.230 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:03:42.230 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 7, 2024-04-20T22:03:42.230 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 7 2024-04-20T22:03:42.230 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:03:42.230 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:03:42.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.232+0000 7fb752c00700 1 -- 172.21.15.142:0/3612133623 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb73006ecc0 msgr2=0x7fb730071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:42.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.232+0000 7fb752c00700 1 --2- 172.21.15.142:0/3612133623 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb73006ecc0 0x7fb730071180 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb73c005fd0 tx=0x7fb73c00a560 comp rx=0 tx=0).stop 2024-04-20T22:03:42.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.232+0000 7fb752c00700 1 -- 172.21.15.142:0/3612133623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb74c103fe0 msgr2=0x7fb74c198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:42.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.232+0000 7fb752c00700 1 --2- 172.21.15.142:0/3612133623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb74c103fe0 0x7fb74c198d20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb738006010 tx=0x7fb73800be20 comp rx=0 tx=0).stop 2024-04-20T22:03:42.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.232+0000 7fb752c00700 1 -- 172.21.15.142:0/3612133623 shutdown_connections 2024-04-20T22:03:42.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.232+0000 7fb752c00700 1 --2- 172.21.15.142:0/3612133623 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb73006ecc0 0x7fb730071180 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:42.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.232+0000 7fb752c00700 1 --2- 172.21.15.142:0/3612133623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb74c1016b0 0x7fb74c1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:42.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.232+0000 7fb752c00700 1 --2- 172.21.15.142:0/3612133623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb74c103fe0 0x7fb74c198d20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:42.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.232+0000 7fb752c00700 1 -- 172.21.15.142:0/3612133623 >> 172.21.15.142:0/3612133623 conn(0x7fb74c0fb0e0 msgr2=0x7fb74c100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:42.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.232+0000 7fb752c00700 1 -- 172.21.15.142:0/3612133623 shutdown_connections 2024-04-20T22:03:42.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.232+0000 7fb752c00700 1 -- 172.21.15.142:0/3612133623 wait complete. 2024-04-20T22:03:42.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.388+0000 7fce75000700 1 -- 172.21.15.142:0/3248245046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce70101e20 msgr2=0x7fce70102280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:42.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.388+0000 7fce75000700 1 --2- 172.21.15.142:0/3248245046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce70101e20 0x7fce70102280 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fce5c009910 tx=0x7fce5c009c20 comp rx=0 tx=0).stop 2024-04-20T22:03:42.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.388+0000 7fce75000700 1 -- 172.21.15.142:0/3248245046 shutdown_connections 2024-04-20T22:03:42.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.388+0000 7fce75000700 1 --2- 172.21.15.142:0/3248245046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce70101e20 0x7fce70102280 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:42.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.388+0000 7fce75000700 1 --2- 172.21.15.142:0/3248245046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce70100c20 0x7fce70101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:42.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.388+0000 7fce75000700 1 -- 172.21.15.142:0/3248245046 >> 172.21.15.142:0/3248245046 conn(0x7fce700fc1c0 msgr2=0x7fce700fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:42.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.388+0000 7fce75000700 1 -- 172.21.15.142:0/3248245046 shutdown_connections 2024-04-20T22:03:42.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.388+0000 7fce75000700 1 -- 172.21.15.142:0/3248245046 wait complete. 2024-04-20T22:03:42.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.389+0000 7fce75000700 1 Processor -- start 2024-04-20T22:03:42.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.389+0000 7fce75000700 1 -- start start 2024-04-20T22:03:42.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.390+0000 7fce75000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce70100c20 0x7fce70198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:42.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.390+0000 7fce75000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce70101e20 0x7fce70198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:42.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.390+0000 7fce75000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce701993b0 con 0x7fce70101e20 2024-04-20T22:03:42.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.390+0000 7fce75000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce701994f0 con 0x7fce70100c20 2024-04-20T22:03:42.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.390+0000 7fce6d400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce70101e20 0x7fce70198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:42.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.390+0000 7fce6d400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce70101e20 0x7fce70198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38302/0 (socket says 172.21.15.142:38302) 2024-04-20T22:03:42.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.390+0000 7fce6d400700 1 -- 172.21.15.142:0/3981448834 learned_addr learned my addr 172.21.15.142:0/3981448834 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:03:42.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.390+0000 7fce6d400700 1 -- 172.21.15.142:0/3981448834 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce70100c20 msgr2=0x7fce70198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:42.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.390+0000 7fce6d400700 1 --2- 172.21.15.142:0/3981448834 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce70100c20 0x7fce70198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:42.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.390+0000 7fce6d400700 1 -- 172.21.15.142:0/3981448834 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5c0095f0 con 0x7fce70101e20 2024-04-20T22:03:42.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.391+0000 7fce6d400700 1 --2- 172.21.15.142:0/3981448834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce70101e20 0x7fce70198d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fce5c006010 tx=0x7fce5c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:42.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.391+0000 7fce66a00700 1 -- 172.21.15.142:0/3981448834 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce5c01d070 con 0x7fce70101e20 2024-04-20T22:03:42.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.391+0000 7fce66a00700 1 -- 172.21.15.142:0/3981448834 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce5c005dc0 con 0x7fce70101e20 2024-04-20T22:03:42.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.391+0000 7fce75000700 1 -- 172.21.15.142:0/3981448834 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7019dea0 con 0x7fce70101e20 2024-04-20T22:03:42.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.391+0000 7fce66a00700 1 -- 172.21.15.142:0/3981448834 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce5c021640 con 0x7fce70101e20 2024-04-20T22:03:42.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.391+0000 7fce75000700 1 -- 172.21.15.142:0/3981448834 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7019e3e0 con 0x7fce70101e20 2024-04-20T22:03:42.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.393+0000 7fce75000700 1 -- 172.21.15.142:0/3981448834 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce701929b0 con 0x7fce70101e20 2024-04-20T22:03:42.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.394+0000 7fce66a00700 1 -- 172.21.15.142:0/3981448834 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fce5c003a60 con 0x7fce70101e20 2024-04-20T22:03:42.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.394+0000 7fce66a00700 1 --2- 172.21.15.142:0/3981448834 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fce5406ecc0 0x7fce54071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:42.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.395+0000 7fce66a00700 1 -- 172.21.15.142:0/3981448834 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fce5c0900c0 con 0x7fce70101e20 2024-04-20T22:03:42.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.395+0000 7fce6de00700 1 --2- 172.21.15.142:0/3981448834 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fce5406ecc0 0x7fce54071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:42.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.395+0000 7fce6de00700 1 --2- 172.21.15.142:0/3981448834 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fce5406ecc0 0x7fce54071180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fce70101c80 tx=0x7fce60009470 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:42.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.400+0000 7fce66a00700 1 -- 172.21.15.142:0/3981448834 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fce5c05ca00 con 0x7fce70101e20 2024-04-20T22:03:42.538 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:42 smithi142 ceph-mon[79401]: Health check update: Degraded data redundancy: 21/231 objects degraded (9.091%), 8 pgs degraded (PG_DEGRADED) 2024-04-20T22:03:42.538 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:42 smithi142 ceph-mon[79401]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:03:42.538 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:42 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3612133623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:03:42.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.681+0000 7fce75000700 1 -- 172.21.15.142:0/3981448834 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fce70062510 con 0x7fce70101e20 2024-04-20T22:03:42.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.682+0000 7fce66a00700 1 -- 172.21.15.142:0/3981448834 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1898 (secure 0 0 0) 0x7fce5c063070 con 0x7fce70101e20 2024-04-20T22:03:42.682 INFO:teuthology.orchestra.run.smithi142.stdout:e12 2024-04-20T22:03:42.683 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:03:42.683 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:03:42.683 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T22:03:42.683 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:03:42.683 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T22:03:42.683 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T22:03:42.683 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 12 2024-04-20T22:03:42.683 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:03:42.683 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:03:42.683 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:51.692699+0000 2024-04-20T22:03:42.683 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T22:03:42.683 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T22:03:42.683 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T22:03:42.683 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T22:03:42.683 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T22:03:42.684 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T22:03:42.684 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T22:03:42.684 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T22:03:42.684 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T22:03:42.684 INFO:teuthology.orchestra.run.smithi142.stdout:snap_rstat 1 2024-04-20T22:03:42.684 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:03:42.684 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T22:03:42.684 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T22:03:42.684 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T22:03:42.684 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T22:03:42.684 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T22:03:42.684 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T22:03:42.684 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T22:03:42.684 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T22:03:42.685 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T22:03:42.685 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T22:03:42.685 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T22:03:42.685 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T22:03:42.685 INFO:teuthology.orchestra.run.smithi142.stdout:qdb_cluster leader: 0 members: 2024-04-20T22:03:42.685 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:03:42.685 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:03:42.685 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:03:42.685 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T22:03:42.685 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:03:42.685 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:03:42.685 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:03:42.685 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:03:42.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.685+0000 7fce75000700 1 -- 172.21.15.142:0/3981448834 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fce5406ecc0 msgr2=0x7fce54071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:42.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.685+0000 7fce75000700 1 --2- 172.21.15.142:0/3981448834 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fce5406ecc0 0x7fce54071180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fce70101c80 tx=0x7fce60009470 comp rx=0 tx=0).stop 2024-04-20T22:03:42.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.685+0000 7fce75000700 1 -- 172.21.15.142:0/3981448834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce70101e20 msgr2=0x7fce70198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:42.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.685+0000 7fce75000700 1 --2- 172.21.15.142:0/3981448834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce70101e20 0x7fce70198d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fce5c006010 tx=0x7fce5c00be20 comp rx=0 tx=0).stop 2024-04-20T22:03:42.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.685+0000 7fce75000700 1 -- 172.21.15.142:0/3981448834 shutdown_connections 2024-04-20T22:03:42.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.685+0000 7fce75000700 1 --2- 172.21.15.142:0/3981448834 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fce5406ecc0 0x7fce54071180 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:42.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.685+0000 7fce75000700 1 --2- 172.21.15.142:0/3981448834 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fce70100c20 0x7fce70198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:42.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.685+0000 7fce75000700 1 --2- 172.21.15.142:0/3981448834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce70101e20 0x7fce70198d90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:42.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.685+0000 7fce75000700 1 -- 172.21.15.142:0/3981448834 >> 172.21.15.142:0/3981448834 conn(0x7fce700fc1c0 msgr2=0x7fce70105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:42.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.685+0000 7fce75000700 1 -- 172.21.15.142:0/3981448834 shutdown_connections 2024-04-20T22:03:42.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.685+0000 7fce75000700 1 -- 172.21.15.142:0/3981448834 wait complete. 2024-04-20T22:03:42.687 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T22:03:42.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:42 smithi164 ceph-mon[69784]: Health check update: Degraded data redundancy: 21/231 objects degraded (9.091%), 8 pgs degraded (PG_DEGRADED) 2024-04-20T22:03:42.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:42 smithi164 ceph-mon[69784]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:03:42.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:42 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3612133623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:03:42.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.830+0000 7f9f2fe00700 1 -- 172.21.15.142:0/1245641302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f300ff2b0 msgr2=0x7f9f300ff6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:42.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.830+0000 7f9f2fe00700 1 --2- 172.21.15.142:0/1245641302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f300ff2b0 0x7f9f300ff6d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9f20009910 tx=0x7f9f20009c20 comp rx=0 tx=0).stop 2024-04-20T22:03:42.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.830+0000 7f9f2fe00700 1 -- 172.21.15.142:0/1245641302 shutdown_connections 2024-04-20T22:03:42.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.830+0000 7f9f2fe00700 1 --2- 172.21.15.142:0/1245641302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f300ffc10 0x7f9f30100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:42.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.830+0000 7f9f2fe00700 1 --2- 172.21.15.142:0/1245641302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f300ff2b0 0x7f9f300ff6d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:42.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.830+0000 7f9f2fe00700 1 -- 172.21.15.142:0/1245641302 >> 172.21.15.142:0/1245641302 conn(0x7f9f300faef0 msgr2=0x7f9f300fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:42.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.830+0000 7f9f2fe00700 1 -- 172.21.15.142:0/1245641302 shutdown_connections 2024-04-20T22:03:42.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.830+0000 7f9f2fe00700 1 -- 172.21.15.142:0/1245641302 wait complete. 2024-04-20T22:03:42.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.832+0000 7f9f2fe00700 1 Processor -- start 2024-04-20T22:03:42.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.832+0000 7f9f2fe00700 1 -- start start 2024-04-20T22:03:42.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.832+0000 7f9f2fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f300ff2b0 0x7f9f30198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:42.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.832+0000 7f9f2fe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f300ffc10 0x7f9f30198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:42.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.832+0000 7f9f2fe00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f301991c0 con 0x7f9f300ff2b0 2024-04-20T22:03:42.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.832+0000 7f9f2fe00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f30199300 con 0x7f9f300ffc10 2024-04-20T22:03:42.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.832+0000 7f9f2ea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f300ff2b0 0x7f9f30198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:42.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.833+0000 7f9f2ea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f300ff2b0 0x7f9f30198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38322/0 (socket says 172.21.15.142:38322) 2024-04-20T22:03:42.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.833+0000 7f9f2ea00700 1 -- 172.21.15.142:0/1200709816 learned_addr learned my addr 172.21.15.142:0/1200709816 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:03:42.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.833+0000 7f9f2e000700 1 --2- 172.21.15.142:0/1200709816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f300ffc10 0x7f9f30198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:42.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.833+0000 7f9f2ea00700 1 -- 172.21.15.142:0/1200709816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f300ffc10 msgr2=0x7f9f30198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:42.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.833+0000 7f9f2ea00700 1 --2- 172.21.15.142:0/1200709816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f300ffc10 0x7f9f30198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:42.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.833+0000 7f9f2ea00700 1 -- 172.21.15.142:0/1200709816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f200095f0 con 0x7f9f300ff2b0 2024-04-20T22:03:42.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.833+0000 7f9f2ea00700 1 --2- 172.21.15.142:0/1200709816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f300ff2b0 0x7f9f30198660 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9f200092e0 tx=0x7f9f2000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:42.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.833+0000 7f9f2e000700 1 --2- 172.21.15.142:0/1200709816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f300ffc10 0x7f9f30198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:03:42.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.834+0000 7f9f27400700 1 -- 172.21.15.142:0/1200709816 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f2001d070 con 0x7f9f300ff2b0 2024-04-20T22:03:42.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.834+0000 7f9f27400700 1 -- 172.21.15.142:0/1200709816 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f2000f460 con 0x7f9f300ff2b0 2024-04-20T22:03:42.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.834+0000 7f9f2fe00700 1 -- 172.21.15.142:0/1200709816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3019dcb0 con 0x7f9f300ff2b0 2024-04-20T22:03:42.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.834+0000 7f9f27400700 1 -- 172.21.15.142:0/1200709816 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f20021640 con 0x7f9f300ff2b0 2024-04-20T22:03:42.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.834+0000 7f9f2fe00700 1 -- 172.21.15.142:0/1200709816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3019e1a0 con 0x7f9f300ff2b0 2024-04-20T22:03:42.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.835+0000 7f9f2fe00700 1 -- 172.21.15.142:0/1200709816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f301927a0 con 0x7f9f300ff2b0 2024-04-20T22:03:42.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.837+0000 7f9f27400700 1 -- 172.21.15.142:0/1200709816 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f9f2000f5d0 con 0x7f9f300ff2b0 2024-04-20T22:03:42.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.838+0000 7f9f27400700 1 --2- 172.21.15.142:0/1200709816 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9f1406ecc0 0x7f9f14071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:42.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.838+0000 7f9f27400700 1 -- 172.21.15.142:0/1200709816 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9f200901f0 con 0x7f9f300ff2b0 2024-04-20T22:03:42.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.839+0000 7f9f2e000700 1 --2- 172.21.15.142:0/1200709816 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9f1406ecc0 0x7f9f14071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:42.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.839+0000 7f9f2e000700 1 --2- 172.21.15.142:0/1200709816 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9f1406ecc0 0x7f9f14071180 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c005fd0 tx=0x7f9f1c005dc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:42.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:42.843+0000 7f9f27400700 1 -- 172.21.15.142:0/1200709816 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f9f2005cb10 con 0x7f9f300ff2b0 2024-04-20T22:03:43.088 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.088+0000 7f9f2fe00700 1 -- 172.21.15.142:0/1200709816 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f3002cea0 con 0x7f9f1406ecc0 2024-04-20T22:03:43.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.090+0000 7f9f27400700 1 -- 172.21.15.142:0/1200709816 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9f3002cea0 con 0x7f9f1406ecc0 2024-04-20T22:03:43.090 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:03:43.090 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T22:03:43.090 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T22:03:43.091 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T22:03:43.091 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T22:03:43.091 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr", 2024-04-20T22:03:43.091 INFO:teuthology.orchestra.run.smithi142.stdout: "mon", 2024-04-20T22:03:43.091 INFO:teuthology.orchestra.run.smithi142.stdout: "crash" 2024-04-20T22:03:43.091 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T22:03:43.091 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "9/23 daemons upgraded", 2024-04-20T22:03:43.091 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading osd daemons", 2024-04-20T22:03:43.091 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T22:03:43.092 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:03:43.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.093+0000 7f9f2fe00700 1 -- 172.21.15.142:0/1200709816 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9f1406ecc0 msgr2=0x7f9f14071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:43.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.093+0000 7f9f2fe00700 1 --2- 172.21.15.142:0/1200709816 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9f1406ecc0 0x7f9f14071180 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c005fd0 tx=0x7f9f1c005dc0 comp rx=0 tx=0).stop 2024-04-20T22:03:43.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.093+0000 7f9f2fe00700 1 -- 172.21.15.142:0/1200709816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f300ff2b0 msgr2=0x7f9f30198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:43.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.093+0000 7f9f2fe00700 1 --2- 172.21.15.142:0/1200709816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f300ff2b0 0x7f9f30198660 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9f200092e0 tx=0x7f9f2000be20 comp rx=0 tx=0).stop 2024-04-20T22:03:43.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.093+0000 7f9f2fe00700 1 -- 172.21.15.142:0/1200709816 shutdown_connections 2024-04-20T22:03:43.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.093+0000 7f9f2fe00700 1 --2- 172.21.15.142:0/1200709816 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9f1406ecc0 0x7f9f14071180 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:43.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.093+0000 7f9f2fe00700 1 --2- 172.21.15.142:0/1200709816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f300ff2b0 0x7f9f30198660 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:43.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.093+0000 7f9f2fe00700 1 --2- 172.21.15.142:0/1200709816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f300ffc10 0x7f9f30198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:43.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.093+0000 7f9f2fe00700 1 -- 172.21.15.142:0/1200709816 >> 172.21.15.142:0/1200709816 conn(0x7f9f300faef0 msgr2=0x7f9f30107cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:43.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.093+0000 7f9f2fe00700 1 -- 172.21.15.142:0/1200709816 shutdown_connections 2024-04-20T22:03:43.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.093+0000 7f9f2fe00700 1 -- 172.21.15.142:0/1200709816 wait complete. 2024-04-20T22:03:43.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.251+0000 7efe8ae00700 1 -- 172.21.15.142:0/1611602348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe84100a40 msgr2=0x7efe84100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:43.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.251+0000 7efe8ae00700 1 --2- 172.21.15.142:0/1611602348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe84100a40 0x7efe84100e60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efe78009910 tx=0x7efe78009c20 comp rx=0 tx=0).stop 2024-04-20T22:03:43.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.251+0000 7efe8ae00700 1 -- 172.21.15.142:0/1611602348 shutdown_connections 2024-04-20T22:03:43.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.251+0000 7efe8ae00700 1 --2- 172.21.15.142:0/1611602348 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe84101c40 0x7efe841020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:43.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.251+0000 7efe8ae00700 1 --2- 172.21.15.142:0/1611602348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe84100a40 0x7efe84100e60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:43.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.251+0000 7efe8ae00700 1 -- 172.21.15.142:0/1611602348 >> 172.21.15.142:0/1611602348 conn(0x7efe840fc000 msgr2=0x7efe840fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:43.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.251+0000 7efe8ae00700 1 -- 172.21.15.142:0/1611602348 shutdown_connections 2024-04-20T22:03:43.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.251+0000 7efe8ae00700 1 -- 172.21.15.142:0/1611602348 wait complete. 2024-04-20T22:03:43.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.252+0000 7efe8ae00700 1 Processor -- start 2024-04-20T22:03:43.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.252+0000 7efe8ae00700 1 -- start start 2024-04-20T22:03:43.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.253+0000 7efe8ae00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe84100a40 0x7efe84074be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:43.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.253+0000 7efe8ae00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe84101c40 0x7efe840732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:43.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.253+0000 7efe8ae00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe84073810 con 0x7efe84101c40 2024-04-20T22:03:43.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.253+0000 7efe8ae00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe84073950 con 0x7efe84100a40 2024-04-20T22:03:43.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.253+0000 7efe89000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe84101c40 0x7efe840732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.253+0000 7efe89000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe84101c40 0x7efe840732d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38352/0 (socket says 172.21.15.142:38352) 2024-04-20T22:03:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.253+0000 7efe89000700 1 -- 172.21.15.142:0/261079917 learned_addr learned my addr 172.21.15.142:0/261079917 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:03:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.253+0000 7efe89a00700 1 --2- 172.21.15.142:0/261079917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe84100a40 0x7efe84074be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.253+0000 7efe89000700 1 -- 172.21.15.142:0/261079917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe84100a40 msgr2=0x7efe84074be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.254+0000 7efe89000700 1 --2- 172.21.15.142:0/261079917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe84100a40 0x7efe84074be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.254+0000 7efe89000700 1 -- 172.21.15.142:0/261079917 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe780095f0 con 0x7efe84101c40 2024-04-20T22:03:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.254+0000 7efe89000700 1 --2- 172.21.15.142:0/261079917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe84101c40 0x7efe840732d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe7000d8d0 tx=0x7efe7000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.254+0000 7efe82000700 1 -- 172.21.15.142:0/261079917 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe70009940 con 0x7efe84101c40 2024-04-20T22:03:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.254+0000 7efe82000700 1 -- 172.21.15.142:0/261079917 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe70010460 con 0x7efe84101c40 2024-04-20T22:03:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.254+0000 7efe8ae00700 1 -- 172.21.15.142:0/261079917 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe84073c30 con 0x7efe84101c40 2024-04-20T22:03:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.254+0000 7efe82000700 1 -- 172.21.15.142:0/261079917 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe7000f5f0 con 0x7efe84101c40 2024-04-20T22:03:43.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.254+0000 7efe8ae00700 1 -- 172.21.15.142:0/261079917 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8419e540 con 0x7efe84101c40 2024-04-20T22:03:43.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.255+0000 7efe8ae00700 1 -- 172.21.15.142:0/261079917 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe841905c0 con 0x7efe84101c40 2024-04-20T22:03:43.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.256+0000 7efe82000700 1 -- 172.21.15.142:0/261079917 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7efe700105d0 con 0x7efe84101c40 2024-04-20T22:03:43.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.257+0000 7efe82000700 1 --2- 172.21.15.142:0/261079917 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7efe6c06ecc0 0x7efe6c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:03:43.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.257+0000 7efe82000700 1 -- 172.21.15.142:0/261079917 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7efe7008edb0 con 0x7efe84101c40 2024-04-20T22:03:43.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.258+0000 7efe89a00700 1 --2- 172.21.15.142:0/261079917 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7efe6c06ecc0 0x7efe6c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:03:43.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.258+0000 7efe89a00700 1 --2- 172.21.15.142:0/261079917 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7efe6c06ecc0 0x7efe6c071180 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efe78006010 tx=0x7efe7800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:03:43.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.262+0000 7efe82000700 1 -- 172.21.15.142:0/261079917 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7efe7005b6d0 con 0x7efe84101c40 2024-04-20T22:03:43.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.569+0000 7efe8ae00700 1 -- 172.21.15.142:0/261079917 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efe84062510 con 0x7efe84101c40 2024-04-20T22:03:43.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.570+0000 7efe82000700 1 -- 172.21.15.142:0/261079917 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+513 (secure 0 0 0) 0x7efe70016220 con 0x7efe84101c40 2024-04-20T22:03:43.570 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_WARN Degraded data redundancy: 17/231 objects degraded (7.359%), 6 pgs degraded 2024-04-20T22:03:43.570 INFO:teuthology.orchestra.run.smithi142.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 17/231 objects degraded (7.359%), 6 pgs degraded 2024-04-20T22:03:43.570 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-04-20T22:03:43.570 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-04-20T22:03:43.570 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-04-20T22:03:43.570 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-04-20T22:03:43.570 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-04-20T22:03:43.570 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-04-20T22:03:43.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.572+0000 7efe8ae00700 1 -- 172.21.15.142:0/261079917 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7efe6c06ecc0 msgr2=0x7efe6c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:43.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.572+0000 7efe8ae00700 1 --2- 172.21.15.142:0/261079917 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7efe6c06ecc0 0x7efe6c071180 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efe78006010 tx=0x7efe7800b540 comp rx=0 tx=0).stop 2024-04-20T22:03:43.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.572+0000 7efe8ae00700 1 -- 172.21.15.142:0/261079917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe84101c40 msgr2=0x7efe840732d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:03:43.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.572+0000 7efe8ae00700 1 --2- 172.21.15.142:0/261079917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe84101c40 0x7efe840732d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe7000d8d0 tx=0x7efe7000dc90 comp rx=0 tx=0).stop 2024-04-20T22:03:43.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.573+0000 7efe8ae00700 1 -- 172.21.15.142:0/261079917 shutdown_connections 2024-04-20T22:03:43.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.573+0000 7efe8ae00700 1 --2- 172.21.15.142:0/261079917 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7efe6c06ecc0 0x7efe6c071180 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:43.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.573+0000 7efe8ae00700 1 --2- 172.21.15.142:0/261079917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe84100a40 0x7efe84074be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:43.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.573+0000 7efe8ae00700 1 --2- 172.21.15.142:0/261079917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe84101c40 0x7efe840732d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:03:43.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.573+0000 7efe8ae00700 1 -- 172.21.15.142:0/261079917 >> 172.21.15.142:0/261079917 conn(0x7efe840fc000 msgr2=0x7efe84105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:03:43.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.573+0000 7efe8ae00700 1 -- 172.21.15.142:0/261079917 shutdown_connections 2024-04-20T22:03:43.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:03:43.573+0000 7efe8ae00700 1 -- 172.21.15.142:0/261079917 wait complete. 2024-04-20T22:03:43.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:43 smithi142 ceph-mon[79401]: pgmap v122: 65 pgs: 6 active+undersized+degraded, 6 active+undersized, 53 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 17/231 objects degraded (7.359%) 2024-04-20T22:03:43.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:43 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3981448834' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:03:43.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:43 smithi142 ceph-mon[79401]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:03:43.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:43 smithi164 ceph-mon[69784]: pgmap v122: 65 pgs: 6 active+undersized+degraded, 6 active+undersized, 53 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 17/231 objects degraded (7.359%) 2024-04-20T22:03:43.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:43 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3981448834' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:03:43.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:43 smithi164 ceph-mon[69784]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:03:44.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:44 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/261079917' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:03:44.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:44 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/261079917' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:03:45.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:45 smithi142 ceph-mon[79401]: pgmap v123: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:45.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:45.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:03:45.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:45 smithi142 ceph-mon[79401]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/231 objects degraded (7.359%), 6 pgs degraded) 2024-04-20T22:03:45.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:45 smithi142 ceph-mon[79401]: Cluster is now healthy 2024-04-20T22:03:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:45 smithi164 ceph-mon[69784]: pgmap v123: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:03:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:45 smithi164 ceph-mon[69784]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/231 objects degraded (7.359%), 6 pgs degraded) 2024-04-20T22:03:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:45 smithi164 ceph-mon[69784]: Cluster is now healthy 2024-04-20T22:03:48.083 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:47 smithi164 ceph-mon[69784]: pgmap v124: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:48.083 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:48.083 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:48.083 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:03:48.083 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:03:48.083 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:48.083 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:03:48.083 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:03:48.083 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:03:48.083 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:03:48.083 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-20T22:03:48.083 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:47 smithi164 ceph-mon[69784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-20T22:03:48.083 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:47 smithi164 ceph-mon[69784]: Upgrade: osd.3 is safe to restart 2024-04-20T22:03:48.111 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:47 smithi142 ceph-mon[79401]: pgmap v124: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:48.111 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:48.111 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:48.111 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:03:48.111 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:03:48.111 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:48.111 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:03:48.111 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:03:48.111 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:03:48.111 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:03:48.112 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-20T22:03:48.112 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:47 smithi142 ceph-mon[79401]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-20T22:03:48.112 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:47 smithi142 ceph-mon[79401]: Upgrade: osd.3 is safe to restart 2024-04-20T22:03:50.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:49 smithi164 ceph-mon[69784]: pgmap v125: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:50.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:49 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:50.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:49 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-20T22:03:50.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:49 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:03:50.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:49 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:50.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:49 smithi142 ceph-mon[79401]: pgmap v125: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:50.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:49 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:50.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:49 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-20T22:03:50.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:49 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:03:50.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:49 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:03:51.106 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:50 smithi142 ceph-mon[79401]: Upgrade: Updating osd.3 2024-04-20T22:03:51.106 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:50 smithi142 ceph-mon[79401]: Deploying daemon osd.3 on smithi164 2024-04-20T22:03:51.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:50 smithi164 ceph-mon[69784]: Upgrade: Updating osd.3 2024-04-20T22:03:51.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:50 smithi164 ceph-mon[69784]: Deploying daemon osd.3 on smithi164 2024-04-20T22:03:51.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:51 smithi164 ceph-mon[69784]: pgmap v126: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:52.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:51 smithi142 ceph-mon[79401]: pgmap v126: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:54.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:53 smithi142 ceph-mon[79401]: pgmap v127: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:54.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:53 smithi164 ceph-mon[69784]: pgmap v127: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:54.697 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:54 smithi164 systemd[1]: Stopping Ceph osd.3 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:03:55.196 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:54 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3[29535]: 2024-04-20T22:03:54.777+0000 7f8c11000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T22:03:55.196 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:54 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3[29535]: 2024-04-20T22:03:54.777+0000 7f8c11000700 -1 osd.3 65 *** Got signal Terminated *** 2024-04-20T22:03:55.196 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:54 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3[29535]: 2024-04-20T22:03:54.777+0000 7f8c11000700 -1 osd.3 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T22:03:55.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:54 smithi164 ceph-mon[69784]: osd.3 marked itself down and dead 2024-04-20T22:03:55.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:54 smithi142 ceph-mon[79401]: osd.3 marked itself down and dead 2024-04-20T22:03:55.800 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:55 smithi164 podman[79032]: 2024-04-20 22:03:55.486269856 +0000 UTC m=+0.861141400 container died c081911f56ab6c1b24b7e56da8e87d0d8f6309c843bd1f08522ec941d0d4a457 (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=reef-646b8c7, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-04-20T22:03:56.169 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:55 smithi164 ceph-mon[69784]: pgmap v128: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:56.169 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:55 smithi164 ceph-mon[69784]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-20T22:03:56.169 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:55 smithi164 ceph-mon[69784]: osdmap e66: 6 total, 5 up, 6 in 2024-04-20T22:03:56.170 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:55 smithi164 podman[79032]: 2024-04-20 22:03:55.934818893 +0000 UTC m=+1.309690456 container cleanup c081911f56ab6c1b24b7e56da8e87d0d8f6309c843bd1f08522ec941d0d4a457 (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=reef-646b8c7, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-20T22:03:56.170 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:55 smithi164 bash[79032]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3 2024-04-20T22:03:56.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:55 smithi142 ceph-mon[79401]: pgmap v128: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:03:56.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:55 smithi142 ceph-mon[79401]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-20T22:03:56.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:55 smithi142 ceph-mon[79401]: osdmap e66: 6 total, 5 up, 6 in 2024-04-20T22:03:56.446 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:56 smithi164 podman[79053]: 2024-04-20 22:03:56.169607164 +0000 UTC m=+0.674372517 container remove c081911f56ab6c1b24b7e56da8e87d0d8f6309c843bd1f08522ec941d0d4a457 (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=reef-646b8c7, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.build-date=20240416, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-20T22:03:57.189 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:56 smithi164 ceph-mon[69784]: osdmap e67: 6 total, 5 up, 6 in 2024-04-20T22:03:57.189 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:57 smithi164 podman[79141]: 2024-04-20 22:03:56.977264954 +0000 UTC m=+0.033864149 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:03:57.189 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:57 smithi164 podman[79141]: 2024-04-20 22:03:57.087171175 +0000 UTC m=+0.143770401 container create ec46f43145fe7e31c02485787daee64202185fc7c113b816769b3568f7a0c208 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-20T22:03:57.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:56 smithi142 ceph-mon[79401]: osdmap e67: 6 total, 5 up, 6 in 2024-04-20T22:03:57.446 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:57 smithi164 podman[79141]: 2024-04-20 22:03:57.390846122 +0000 UTC m=+0.447445355 container init ec46f43145fe7e31c02485787daee64202185fc7c113b816769b3568f7a0c208 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-20T22:03:57.446 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:57 smithi164 podman[79141]: 2024-04-20 22:03:57.404109342 +0000 UTC m=+0.460708543 container start ec46f43145fe7e31c02485787daee64202185fc7c113b816769b3568f7a0c208 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240416) 2024-04-20T22:03:57.865 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:57 smithi164 podman[79141]: 2024-04-20 22:03:57.489859566 +0000 UTC m=+0.546458815 container attach ec46f43145fe7e31c02485787daee64202185fc7c113b816769b3568f7a0c208 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416) 2024-04-20T22:03:58.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:57 smithi142 ceph-mon[79401]: pgmap v131: 65 pgs: 3 active+undersized+degraded, 18 peering, 3 stale+active+clean, 4 active+undersized, 37 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/231 objects degraded (3.030%) 2024-04-20T22:03:58.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:57 smithi142 ceph-mon[79401]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-04-20T22:03:58.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:57 smithi142 ceph-mon[79401]: Health check failed: Degraded data redundancy: 7/231 objects degraded (3.030%), 3 pgs degraded (PG_DEGRADED) 2024-04-20T22:03:58.197 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:57 smithi164 podman[79167]: 2024-04-20 22:03:57.927595387 +0000 UTC m=+0.037570583 container died ec46f43145fe7e31c02485787daee64202185fc7c113b816769b3568f7a0c208 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2) 2024-04-20T22:03:58.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:57 smithi164 ceph-mon[69784]: pgmap v131: 65 pgs: 3 active+undersized+degraded, 18 peering, 3 stale+active+clean, 4 active+undersized, 37 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/231 objects degraded (3.030%) 2024-04-20T22:03:58.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:57 smithi164 ceph-mon[69784]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-04-20T22:03:58.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:57 smithi164 ceph-mon[69784]: Health check failed: Degraded data redundancy: 7/231 objects degraded (3.030%), 3 pgs degraded (PG_DEGRADED) 2024-04-20T22:03:58.946 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:58 smithi164 podman[79167]: 2024-04-20 22:03:58.634808517 +0000 UTC m=+0.744783740 container remove ec46f43145fe7e31c02485787daee64202185fc7c113b816769b3568f7a0c208 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-20T22:03:58.946 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:58 smithi164 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.3.service: Deactivated successfully. 2024-04-20T22:03:58.947 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:58 smithi164 systemd[1]: Stopped Ceph osd.3 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T22:03:58.947 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:58 smithi164 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.3.service: Consumed 2min 34.951s CPU time. 2024-04-20T22:03:59.407 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:59 smithi164 systemd[1]: Starting Ceph osd.3 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:03:59.696 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:59 smithi164 podman[79266]: 2024-04-20 22:03:59.314388018 +0000 UTC m=+0.036914901 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:03:59.696 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:59 smithi164 podman[79266]: 2024-04-20 22:03:59.427504825 +0000 UTC m=+0.150031738 container create f99edebb084da2b04fc2c17dc1ba0153265464d46f6f3daec3f5eef1d8224399 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240416) 2024-04-20T22:04:00.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:59 smithi142 ceph-mon[79401]: pgmap v132: 65 pgs: 10 active+undersized+degraded, 18 peering, 10 active+undersized, 27 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25/231 objects degraded (10.823%) 2024-04-20T22:04:00.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:59 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:00.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:03:59 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:04:00.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:59 smithi164 ceph-mon[69784]: pgmap v132: 65 pgs: 10 active+undersized+degraded, 18 peering, 10 active+undersized, 27 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 25/231 objects degraded (10.823%) 2024-04-20T22:04:00.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:59 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:00.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:03:59 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:04:00.197 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:59 smithi164 podman[79266]: 2024-04-20 22:03:59.772868684 +0000 UTC m=+0.495395614 container init f99edebb084da2b04fc2c17dc1ba0153265464d46f6f3daec3f5eef1d8224399 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True) 2024-04-20T22:04:00.197 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:59 smithi164 podman[79266]: 2024-04-20 22:03:59.786193033 +0000 UTC m=+0.508719912 container start f99edebb084da2b04fc2c17dc1ba0153265464d46f6f3daec3f5eef1d8224399 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-activate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T22:04:00.197 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:03:59 smithi164 podman[79266]: 2024-04-20 22:03:59.87159202 +0000 UTC m=+0.594118953 container attach f99edebb084da2b04fc2c17dc1ba0153265464d46f6f3daec3f5eef1d8224399 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-20T22:04:01.162 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:00 smithi164 ceph-mon[69784]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-04-20T22:04:01.163 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:00 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-activate[79281]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:04:01.163 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:00 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-activate[79281]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:04:01.163 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:00 smithi164 bash[79266]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:04:01.163 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:00 smithi164 bash[79266]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:04:01.163 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:00 smithi164 bash[79266]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-20T22:04:01.163 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:00 smithi164 bash[79266]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-20T22:04:01.163 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:00 smithi164 bash[79266]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-20T22:04:01.163 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:00 smithi164 bash[79266]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-20T22:04:01.163 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:00 smithi164 bash[79266]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-20T22:04:01.163 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:00 smithi164 bash[79266]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-20T22:04:01.163 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:00 smithi164 bash[79266]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-20T22:04:01.164 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:00 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-activate[79281]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-20T22:04:01.164 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:00 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-activate[79281]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-20T22:04:01.164 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:00 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-activate[79281]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-20T22:04:01.164 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:00 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-activate[79281]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-20T22:04:01.164 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:00 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-activate[79281]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-20T22:04:01.164 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:00 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-activate[79281]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-20T22:04:01.164 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:00 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-activate[79281]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-20T22:04:01.164 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:00 smithi164 podman[79266]: 2024-04-20 22:04:00.800795841 +0000 UTC m=+1.523322757 container died f99edebb084da2b04fc2c17dc1ba0153265464d46f6f3daec3f5eef1d8224399 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-20T22:04:01.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:00 smithi142 ceph-mon[79401]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-04-20T22:04:01.889 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:01 smithi164 podman[79407]: 2024-04-20 22:04:01.524889638 +0000 UTC m=+0.702042879 container remove f99edebb084da2b04fc2c17dc1ba0153265464d46f6f3daec3f5eef1d8224399 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-20T22:04:02.170 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:01 smithi164 ceph-mon[69784]: pgmap v133: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 55/231 objects degraded (23.810%) 2024-04-20T22:04:02.170 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:01 smithi164 podman[79469]: 2024-04-20 22:04:01.795467899 +0000 UTC m=+0.033180367 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:04:02.170 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:01 smithi164 podman[79469]: 2024-04-20 22:04:01.917242972 +0000 UTC m=+0.154955476 container create a898b8b77c519e12b08f77519fa079dd55d047b6c510d35b822a311da9d980e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5) 2024-04-20T22:04:02.170 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:02 smithi164 podman[79469]: 2024-04-20 22:04:02.170988438 +0000 UTC m=+0.408700966 container init a898b8b77c519e12b08f77519fa079dd55d047b6c510d35b822a311da9d980e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416) 2024-04-20T22:04:02.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:01 smithi142 ceph-mon[79401]: pgmap v133: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 55/231 objects degraded (23.810%) 2024-04-20T22:04:02.446 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:02 smithi164 podman[79469]: 2024-04-20 22:04:02.18133642 +0000 UTC m=+0.419048907 container start a898b8b77c519e12b08f77519fa079dd55d047b6c510d35b822a311da9d980e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-20T22:04:02.446 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:02 smithi164 ceph-osd[79488]: -- 172.21.15.164:0/3078348798 <== mon.1 v2:172.21.15.164:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d689b7b680 con 0x55d689b45000 2024-04-20T22:04:02.446 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:02 smithi164 bash[79469]: a898b8b77c519e12b08f77519fa079dd55d047b6c510d35b822a311da9d980e0 2024-04-20T22:04:02.446 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:02 smithi164 systemd[1]: Started Ceph osd.3 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T22:04:03.195 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:02 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3[79484]: 2024-04-20T22:04:02.763+0000 7f3c5fb9b7c0 -1 Falling back to public interface 2024-04-20T22:04:03.676 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:03.676 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:03.676 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:04:03.677 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:03 smithi164 ceph-mon[69784]: pgmap v134: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 55/231 objects degraded (23.810%) 2024-04-20T22:04:03.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:03.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:03.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:04:03.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:03 smithi142 ceph-mon[79401]: pgmap v134: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 55/231 objects degraded (23.810%) 2024-04-20T22:04:05.813 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:05 smithi164 ceph-mon[69784]: pgmap v135: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 55/231 objects degraded (23.810%) 2024-04-20T22:04:05.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:05 smithi142 ceph-mon[79401]: pgmap v135: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 55/231 objects degraded (23.810%) 2024-04-20T22:04:07.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:07 smithi164 ceph-mon[69784]: pgmap v136: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 55/231 objects degraded (23.810%) 2024-04-20T22:04:07.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:07 smithi164 ceph-mon[69784]: Health check update: Degraded data redundancy: 55/231 objects degraded (23.810%), 18 pgs degraded (PG_DEGRADED) 2024-04-20T22:04:07.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:07 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:07.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:07 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:07.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:07 smithi142 ceph-mon[79401]: pgmap v136: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 55/231 objects degraded (23.810%) 2024-04-20T22:04:07.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:07 smithi142 ceph-mon[79401]: Health check update: Degraded data redundancy: 55/231 objects degraded (23.810%), 18 pgs degraded (PG_DEGRADED) 2024-04-20T22:04:07.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:07 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:07.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:07 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:09.446 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:09 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3[79484]: 2024-04-20T22:04:09.051+0000 7f3c5fb9b7c0 -1 osd.3 65 log_to_monitors true 2024-04-20T22:04:10.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:09 smithi164 ceph-mon[69784]: pgmap v137: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 55/231 objects degraded (23.810%) 2024-04-20T22:04:10.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:09 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:10.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:09 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:10.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:09 smithi164 ceph-mon[69784]: from='osd.3 [v2:172.21.15.164:6800/2211531735,v1:172.21.15.164:6801/2211531735]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-20T22:04:10.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:09 smithi164 ceph-mon[69784]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-20T22:04:10.197 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:04:09 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3[79484]: 2024-04-20T22:04:09.981+0000 7f3c4f000700 -1 osd.3 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T22:04:10.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:09 smithi142 ceph-mon[79401]: pgmap v137: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 55/231 objects degraded (23.810%) 2024-04-20T22:04:10.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:09 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:10.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:09 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:10.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:09 smithi142 ceph-mon[79401]: from='osd.3 [v2:172.21.15.164:6800/2211531735,v1:172.21.15.164:6801/2211531735]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-20T22:04:10.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:09 smithi142 ceph-mon[79401]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-20T22:04:11.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:10 smithi142 ceph-mon[79401]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-20T22:04:11.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:10 smithi142 ceph-mon[79401]: osdmap e68: 6 total, 5 up, 6 in 2024-04-20T22:04:11.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:10 smithi142 ceph-mon[79401]: from='osd.3 [v2:172.21.15.164:6800/2211531735,v1:172.21.15.164:6801/2211531735]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T22:04:11.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:10 smithi142 ceph-mon[79401]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T22:04:11.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:10 smithi164 ceph-mon[69784]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-20T22:04:11.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:10 smithi164 ceph-mon[69784]: osdmap e68: 6 total, 5 up, 6 in 2024-04-20T22:04:11.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:10 smithi164 ceph-mon[69784]: from='osd.3 [v2:172.21.15.164:6800/2211531735,v1:172.21.15.164:6801/2211531735]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T22:04:11.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:10 smithi164 ceph-mon[69784]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T22:04:12.105 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:11 smithi164 ceph-mon[69784]: pgmap v139: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 55/231 objects degraded (23.810%) 2024-04-20T22:04:12.105 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:11 smithi164 ceph-mon[69784]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-20T22:04:12.105 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:11 smithi164 ceph-mon[69784]: osd.3 [v2:172.21.15.164:6800/2211531735,v1:172.21.15.164:6801/2211531735] boot 2024-04-20T22:04:12.105 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:11 smithi164 ceph-mon[69784]: osdmap e69: 6 total, 6 up, 6 in 2024-04-20T22:04:12.105 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:11 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T22:04:12.105 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:11 smithi164 ceph-mon[69784]: osdmap e70: 6 total, 6 up, 6 in 2024-04-20T22:04:12.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:11 smithi142 ceph-mon[79401]: pgmap v139: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 55/231 objects degraded (23.810%) 2024-04-20T22:04:12.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:11 smithi142 ceph-mon[79401]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-20T22:04:12.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:11 smithi142 ceph-mon[79401]: osd.3 [v2:172.21.15.164:6800/2211531735,v1:172.21.15.164:6801/2211531735] boot 2024-04-20T22:04:12.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:11 smithi142 ceph-mon[79401]: osdmap e69: 6 total, 6 up, 6 in 2024-04-20T22:04:12.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:11 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T22:04:12.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:11 smithi142 ceph-mon[79401]: osdmap e70: 6 total, 6 up, 6 in 2024-04-20T22:04:13.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:13 smithi164 ceph-mon[69784]: Health check update: Degraded data redundancy: 52/231 objects degraded (22.511%), 17 pgs degraded (PG_DEGRADED) 2024-04-20T22:04:13.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:13 smithi142 ceph-mon[79401]: Health check update: Degraded data redundancy: 52/231 objects degraded (22.511%), 17 pgs degraded (PG_DEGRADED) 2024-04-20T22:04:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.745+0000 7f172c000700 1 -- 172.21.15.142:0/2889142906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1724102e50 msgr2=0x7f1724103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.745+0000 7f172c000700 1 --2- 172.21.15.142:0/2889142906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1724102e50 0x7f1724103270 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1718009910 tx=0x7f1718009c20 comp rx=0 tx=0).stop 2024-04-20T22:04:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.746+0000 7f172c000700 1 -- 172.21.15.142:0/2889142906 shutdown_connections 2024-04-20T22:04:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.746+0000 7f172c000700 1 --2- 172.21.15.142:0/2889142906 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1724103fb0 0x7f1724104430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.746+0000 7f172c000700 1 --2- 172.21.15.142:0/2889142906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1724102e50 0x7f1724103270 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.746+0000 7f172c000700 1 -- 172.21.15.142:0/2889142906 >> 172.21.15.142:0/2889142906 conn(0x7f17240fe3d0 msgr2=0x7f1724100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.746+0000 7f172c000700 1 -- 172.21.15.142:0/2889142906 shutdown_connections 2024-04-20T22:04:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.746+0000 7f172c000700 1 -- 172.21.15.142:0/2889142906 wait complete. 2024-04-20T22:04:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.747+0000 7f172c000700 1 Processor -- start 2024-04-20T22:04:13.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.747+0000 7f172c000700 1 -- start start 2024-04-20T22:04:13.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.747+0000 7f172c000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1724102e50 0x7f17241987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:13.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.747+0000 7f172c000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1724103fb0 0x7f1724198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:13.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.748+0000 7f172c000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1724199340 con 0x7f1724102e50 2024-04-20T22:04:13.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.748+0000 7f172c000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1724199480 con 0x7f1724103fb0 2024-04-20T22:04:13.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.748+0000 7f1729600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1724102e50 0x7f17241987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:13.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.748+0000 7f1729600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1724102e50 0x7f17241987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60912/0 (socket says 172.21.15.142:60912) 2024-04-20T22:04:13.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.748+0000 7f1729600700 1 -- 172.21.15.142:0/2416734404 learned_addr learned my addr 172.21.15.142:0/2416734404 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:04:13.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.748+0000 7f1729600700 1 -- 172.21.15.142:0/2416734404 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1724103fb0 msgr2=0x7f1724198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:13.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.748+0000 7f1729600700 1 --2- 172.21.15.142:0/2416734404 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1724103fb0 0x7f1724198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:13.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.748+0000 7f1729600700 1 -- 172.21.15.142:0/2416734404 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17180095f0 con 0x7f1724102e50 2024-04-20T22:04:13.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.748+0000 7f1729600700 1 --2- 172.21.15.142:0/2416734404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1724102e50 0x7f17241987e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1718006010 tx=0x7f171800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:13.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.749+0000 7f1722000700 1 -- 172.21.15.142:0/2416734404 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f171801d070 con 0x7f1724102e50 2024-04-20T22:04:13.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.749+0000 7f1722000700 1 -- 172.21.15.142:0/2416734404 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1718005dc0 con 0x7f1724102e50 2024-04-20T22:04:13.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.749+0000 7f172c000700 1 -- 172.21.15.142:0/2416734404 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172419de80 con 0x7f1724102e50 2024-04-20T22:04:13.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.749+0000 7f1722000700 1 -- 172.21.15.142:0/2416734404 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1718021640 con 0x7f1724102e50 2024-04-20T22:04:13.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.749+0000 7f172c000700 1 -- 172.21.15.142:0/2416734404 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172419e3a0 con 0x7f1724102e50 2024-04-20T22:04:13.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.750+0000 7f172c000700 1 -- 172.21.15.142:0/2416734404 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1724192950 con 0x7f1724102e50 2024-04-20T22:04:13.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.751+0000 7f1722000700 1 -- 172.21.15.142:0/2416734404 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f171800f880 con 0x7f1724102e50 2024-04-20T22:04:13.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.752+0000 7f1722000700 1 --2- 172.21.15.142:0/2416734404 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f170c06ecd0 0x7f170c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:13.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.752+0000 7f1722000700 1 -- 172.21.15.142:0/2416734404 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1718090160 con 0x7f1724102e50 2024-04-20T22:04:13.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.753+0000 7f1728c00700 1 --2- 172.21.15.142:0/2416734404 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f170c06ecd0 0x7f170c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:13.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.753+0000 7f1728c00700 1 --2- 172.21.15.142:0/2416734404 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f170c06ecd0 0x7f170c071190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1710005950 tx=0x7f17100058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:13.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:13.758+0000 7f1722000700 1 -- 172.21.15.142:0/2416734404 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f171805ca00 con 0x7f1724102e50 2024-04-20T22:04:14.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.006+0000 7f172c000700 1 -- 172.21.15.142:0/2416734404 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f172402ce50 con 0x7f170c06ecd0 2024-04-20T22:04:14.009 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.009+0000 7f1722000700 1 -- 172.21.15.142:0/2416734404 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f172402ce50 con 0x7f170c06ecd0 2024-04-20T22:04:14.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.013+0000 7f172c000700 1 -- 172.21.15.142:0/2416734404 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f170c06ecd0 msgr2=0x7f170c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:14.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.013+0000 7f172c000700 1 --2- 172.21.15.142:0/2416734404 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f170c06ecd0 0x7f170c071190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1710005950 tx=0x7f17100058e0 comp rx=0 tx=0).stop 2024-04-20T22:04:14.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.013+0000 7f172c000700 1 -- 172.21.15.142:0/2416734404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1724102e50 msgr2=0x7f17241987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:14.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.013+0000 7f172c000700 1 --2- 172.21.15.142:0/2416734404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1724102e50 0x7f17241987e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1718006010 tx=0x7f171800be20 comp rx=0 tx=0).stop 2024-04-20T22:04:14.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.013+0000 7f172c000700 1 -- 172.21.15.142:0/2416734404 shutdown_connections 2024-04-20T22:04:14.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.013+0000 7f172c000700 1 --2- 172.21.15.142:0/2416734404 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f170c06ecd0 0x7f170c071190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:14.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.013+0000 7f172c000700 1 --2- 172.21.15.142:0/2416734404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1724102e50 0x7f17241987e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:14.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.013+0000 7f172c000700 1 --2- 172.21.15.142:0/2416734404 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1724103fb0 0x7f1724198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:14.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.013+0000 7f172c000700 1 -- 172.21.15.142:0/2416734404 >> 172.21.15.142:0/2416734404 conn(0x7f17240fe3d0 msgr2=0x7f1724107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:14.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.014+0000 7f172c000700 1 -- 172.21.15.142:0/2416734404 shutdown_connections 2024-04-20T22:04:14.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.014+0000 7f172c000700 1 -- 172.21.15.142:0/2416734404 wait complete. 2024-04-20T22:04:14.029 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T22:04:14.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.171+0000 7f8a18c00700 1 -- 172.21.15.142:0/1577928773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a14108430 msgr2=0x7f8a141088b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:14.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.171+0000 7f8a18c00700 1 --2- 172.21.15.142:0/1577928773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a14108430 0x7f8a141088b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009910 tx=0x7f8a00009c20 comp rx=0 tx=0).stop 2024-04-20T22:04:14.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.171+0000 7f8a18c00700 1 -- 172.21.15.142:0/1577928773 shutdown_connections 2024-04-20T22:04:14.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.171+0000 7f8a18c00700 1 --2- 172.21.15.142:0/1577928773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a14108430 0x7f8a141088b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:14.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.171+0000 7f8a18c00700 1 --2- 172.21.15.142:0/1577928773 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a14107260 0x7f8a14107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:14.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.171+0000 7f8a18c00700 1 -- 172.21.15.142:0/1577928773 >> 172.21.15.142:0/1577928773 conn(0x7f8a14076400 msgr2=0x7f8a14078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:14.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.171+0000 7f8a18c00700 1 -- 172.21.15.142:0/1577928773 shutdown_connections 2024-04-20T22:04:14.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.171+0000 7f8a18c00700 1 -- 172.21.15.142:0/1577928773 wait complete. 2024-04-20T22:04:14.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.172+0000 7f8a18c00700 1 Processor -- start 2024-04-20T22:04:14.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.173+0000 7f8a18c00700 1 -- start start 2024-04-20T22:04:14.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.173+0000 7f8a18c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a14107260 0x7f8a1419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:14.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.173+0000 7f8a18c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a14108430 0x7f8a1419d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:14.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.173+0000 7f8a18c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1419d730 con 0x7f8a14107260 2024-04-20T22:04:14.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.173+0000 7f8a18c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1419d870 con 0x7f8a14108430 2024-04-20T22:04:14.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.173+0000 7f8a11e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a14107260 0x7f8a1419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:14.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.173+0000 7f8a11e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a14107260 0x7f8a1419cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60922/0 (socket says 172.21.15.142:60922) 2024-04-20T22:04:14.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.173+0000 7f8a11e00700 1 -- 172.21.15.142:0/1644204865 learned_addr learned my addr 172.21.15.142:0/1644204865 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:04:14.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.174+0000 7f8a11400700 1 --2- 172.21.15.142:0/1644204865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a14108430 0x7f8a1419d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:14.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.174+0000 7f8a11e00700 1 -- 172.21.15.142:0/1644204865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a14108430 msgr2=0x7f8a1419d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:14.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.174+0000 7f8a11e00700 1 --2- 172.21.15.142:0/1644204865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a14108430 0x7f8a1419d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:14.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.174+0000 7f8a11e00700 1 -- 172.21.15.142:0/1644204865 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a000095f0 con 0x7f8a14107260 2024-04-20T22:04:14.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.174+0000 7f8a11e00700 1 --2- 172.21.15.142:0/1644204865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a14107260 0x7f8a1419cbd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400c8a0 tx=0x7f8a0400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:14.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.174+0000 7f8a0aa00700 1 -- 172.21.15.142:0/1644204865 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a0400cea0 con 0x7f8a14107260 2024-04-20T22:04:14.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.174+0000 7f8a0aa00700 1 -- 172.21.15.142:0/1644204865 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a04004830 con 0x7f8a14107260 2024-04-20T22:04:14.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.174+0000 7f8a0aa00700 1 -- 172.21.15.142:0/1644204865 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a040055b0 con 0x7f8a14107260 2024-04-20T22:04:14.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.174+0000 7f8a18c00700 1 -- 172.21.15.142:0/1644204865 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a141a22d0 con 0x7f8a14107260 2024-04-20T22:04:14.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.174+0000 7f8a18c00700 1 -- 172.21.15.142:0/1644204865 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a141a28a0 con 0x7f8a14107260 2024-04-20T22:04:14.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.176+0000 7f8a18c00700 1 -- 172.21.15.142:0/1644204865 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a14196dd0 con 0x7f8a14107260 2024-04-20T22:04:14.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.177+0000 7f8a0aa00700 1 -- 172.21.15.142:0/1644204865 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f8a040049a0 con 0x7f8a14107260 2024-04-20T22:04:14.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.178+0000 7f8a0aa00700 1 --2- 172.21.15.142:0/1644204865 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f89f806ecd0 0x7f89f8071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:14.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.178+0000 7f8a0aa00700 1 -- 172.21.15.142:0/1644204865 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8a0408ea90 con 0x7f8a14107260 2024-04-20T22:04:14.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.178+0000 7f8a11400700 1 --2- 172.21.15.142:0/1644204865 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f89f806ecd0 0x7f89f8071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:14.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.179+0000 7f8a11400700 1 --2- 172.21.15.142:0/1644204865 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f89f806ecd0 0x7f89f8071190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000b5c0 tx=0x7f8a00005160 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:14.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.183+0000 7f8a0aa00700 1 -- 172.21.15.142:0/1644204865 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f8a0405b3b0 con 0x7f8a14107260 2024-04-20T22:04:14.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.432+0000 7f8a18c00700 1 -- 172.21.15.142:0/1644204865 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a1402ceb0 con 0x7f89f806ecd0 2024-04-20T22:04:14.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:14 smithi142 ceph-mon[79401]: pgmap v142: 65 pgs: 4 peering, 17 active+undersized+degraded, 17 active+undersized, 27 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/231 objects degraded (22.511%) 2024-04-20T22:04:14.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.437+0000 7f8a0aa00700 1 -- 172.21.15.142:0/1644204865 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f8a1402ceb0 con 0x7f89f806ecd0 2024-04-20T22:04:14.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.441+0000 7f8a18c00700 1 -- 172.21.15.142:0/1644204865 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f89f806ecd0 msgr2=0x7f89f8071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:14.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.441+0000 7f8a18c00700 1 --2- 172.21.15.142:0/1644204865 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f89f806ecd0 0x7f89f8071190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000b5c0 tx=0x7f8a00005160 comp rx=0 tx=0).stop 2024-04-20T22:04:14.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.441+0000 7f8a18c00700 1 -- 172.21.15.142:0/1644204865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a14107260 msgr2=0x7f8a1419cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:14.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.441+0000 7f8a18c00700 1 --2- 172.21.15.142:0/1644204865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a14107260 0x7f8a1419cbd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400c8a0 tx=0x7f8a0400cc60 comp rx=0 tx=0).stop 2024-04-20T22:04:14.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.441+0000 7f8a18c00700 1 -- 172.21.15.142:0/1644204865 shutdown_connections 2024-04-20T22:04:14.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.441+0000 7f8a18c00700 1 --2- 172.21.15.142:0/1644204865 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f89f806ecd0 0x7f89f8071190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:14.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.441+0000 7f8a18c00700 1 --2- 172.21.15.142:0/1644204865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a14107260 0x7f8a1419cbd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:14.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.441+0000 7f8a18c00700 1 --2- 172.21.15.142:0/1644204865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a14108430 0x7f8a1419d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:14.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.441+0000 7f8a18c00700 1 -- 172.21.15.142:0/1644204865 >> 172.21.15.142:0/1644204865 conn(0x7f8a14076400 msgr2=0x7f8a1410b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:14.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.441+0000 7f8a18c00700 1 -- 172.21.15.142:0/1644204865 shutdown_connections 2024-04-20T22:04:14.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.441+0000 7f8a18c00700 1 -- 172.21.15.142:0/1644204865 wait complete. 2024-04-20T22:04:14.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:14 smithi164 ceph-mon[69784]: pgmap v142: 65 pgs: 4 peering, 17 active+undersized+degraded, 17 active+undersized, 27 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 52/231 objects degraded (22.511%) 2024-04-20T22:04:14.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.597+0000 7f64a0800700 1 -- 172.21.15.142:0/4220641760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6498108430 msgr2=0x7f64981088b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:14.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.597+0000 7f64a0800700 1 --2- 172.21.15.142:0/4220641760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6498108430 0x7f64981088b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6488009910 tx=0x7f6488009c20 comp rx=0 tx=0).stop 2024-04-20T22:04:14.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.597+0000 7f64a0800700 1 -- 172.21.15.142:0/4220641760 shutdown_connections 2024-04-20T22:04:14.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.597+0000 7f64a0800700 1 --2- 172.21.15.142:0/4220641760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6498108430 0x7f64981088b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:14.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.597+0000 7f64a0800700 1 --2- 172.21.15.142:0/4220641760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6498107260 0x7f6498107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:14.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.597+0000 7f64a0800700 1 -- 172.21.15.142:0/4220641760 >> 172.21.15.142:0/4220641760 conn(0x7f6498076400 msgr2=0x7f6498078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:14.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.598+0000 7f64a0800700 1 -- 172.21.15.142:0/4220641760 shutdown_connections 2024-04-20T22:04:14.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.598+0000 7f64a0800700 1 -- 172.21.15.142:0/4220641760 wait complete. 2024-04-20T22:04:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.599+0000 7f64a0800700 1 Processor -- start 2024-04-20T22:04:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.599+0000 7f64a0800700 1 -- start start 2024-04-20T22:04:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.599+0000 7f64a0800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6498107260 0x7f649819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.599+0000 7f64a0800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6498108430 0x7f649819d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.599+0000 7f64a0800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649819d8a0 con 0x7f6498107260 2024-04-20T22:04:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.599+0000 7f64a0800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64981a2260 con 0x7f6498108430 2024-04-20T22:04:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.599+0000 7f649de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6498107260 0x7f649819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.599+0000 7f649de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6498107260 0x7f649819cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60934/0 (socket says 172.21.15.142:60934) 2024-04-20T22:04:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.599+0000 7f649de00700 1 -- 172.21.15.142:0/4106398507 learned_addr learned my addr 172.21.15.142:0/4106398507 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:04:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.600+0000 7f649d400700 1 --2- 172.21.15.142:0/4106398507 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6498108430 0x7f649819d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:14.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.600+0000 7f649de00700 1 -- 172.21.15.142:0/4106398507 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6498108430 msgr2=0x7f649819d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:14.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.600+0000 7f649de00700 1 --2- 172.21.15.142:0/4106398507 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6498108430 0x7f649819d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:14.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.600+0000 7f649de00700 1 -- 172.21.15.142:0/4106398507 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64880095f0 con 0x7f6498107260 2024-04-20T22:04:14.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.600+0000 7f649de00700 1 --2- 172.21.15.142:0/4106398507 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6498107260 0x7f649819cd40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f648c00b4b0 tx=0x7f648c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:14.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.600+0000 7f6492a00700 1 -- 172.21.15.142:0/4106398507 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f648c011800 con 0x7f6498107260 2024-04-20T22:04:14.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.600+0000 7f6492a00700 1 -- 172.21.15.142:0/4106398507 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f648c011e20 con 0x7f6498107260 2024-04-20T22:04:14.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.600+0000 7f6492a00700 1 -- 172.21.15.142:0/4106398507 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f648c00f2e0 con 0x7f6498107260 2024-04-20T22:04:14.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.600+0000 7f64a0800700 1 -- 172.21.15.142:0/4106398507 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64981a2460 con 0x7f6498107260 2024-04-20T22:04:14.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.601+0000 7f64a0800700 1 -- 172.21.15.142:0/4106398507 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64981a2a00 con 0x7f6498107260 2024-04-20T22:04:14.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.602+0000 7f64a0800700 1 -- 172.21.15.142:0/4106398507 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6498196e50 con 0x7f6498107260 2024-04-20T22:04:14.602 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.603+0000 7f6492a00700 1 -- 172.21.15.142:0/4106398507 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f648c010380 con 0x7f6498107260 2024-04-20T22:04:14.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.604+0000 7f6492a00700 1 --2- 172.21.15.142:0/4106398507 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f648006ecc0 0x7f6480071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:14.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.604+0000 7f6492a00700 1 -- 172.21.15.142:0/4106398507 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f648c08e8f0 con 0x7f6498107260 2024-04-20T22:04:14.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.604+0000 7f649d400700 1 --2- 172.21.15.142:0/4106398507 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f648006ecc0 0x7f6480071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:14.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.605+0000 7f649d400700 1 --2- 172.21.15.142:0/4106398507 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f648006ecc0 0x7f6480071180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6488006010 tx=0x7f648800b580 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:14.609 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.609+0000 7f6492a00700 1 -- 172.21.15.142:0/4106398507 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f648c057780 con 0x7f6498107260 2024-04-20T22:04:14.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.839+0000 7f64a0800700 1 -- 172.21.15.142:0/4106398507 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f649802cdb0 con 0x7f648006ecc0 2024-04-20T22:04:14.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.871+0000 7f6492a00700 1 -- 172.21.15.142:0/4106398507 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f649802cdb0 con 0x7f648006ecc0 2024-04-20T22:04:14.871 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:04:14.871 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (14m) 35s ago 16m 13.7M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T22:04:14.871 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (17m) 35s ago 17m 8682k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T22:04:14.871 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (15m) 8s ago 15m 7948k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T22:04:14.871 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (2m) 35s ago 17m 6665k - 19.0.0-3133-ga8c84f59 76bc6b91b726 64521ed7125b 2024-04-20T22:04:14.872 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (2m) 8s ago 15m 6656k - 19.0.0-3133-ga8c84f59 76bc6b91b726 893c6f16ee6d 2024-04-20T22:04:14.872 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (14m) 35s ago 16m 76.6M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T22:04:14.872 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (9m) 35s ago 9m 140M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 b68e279d7945 2024-04-20T22:04:14.872 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (9m) 35s ago 9m 16.4M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T22:04:14.872 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (9m) 8s ago 9m 16.6M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T22:04:14.872 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (9m) 8s ago 9m 16.9M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T22:04:14.872 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (6m) 35s ago 18m 505M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:04:14.872 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (4m) 8s ago 15m 452M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:04:14.872 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (4m) 35s ago 18m 47.0M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 af10a542c918 2024-04-20T22:04:14.872 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (3m) 8s ago 15m 34.9M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 133512694d46 2024-04-20T22:04:14.872 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (16m) 35s ago 16m 7894k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T22:04:14.872 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (15m) 8s ago 15m 7884k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T22:04:14.872 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (105s) 35s ago 14m 95.7M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 b7206d05a7cd 2024-04-20T22:04:14.873 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (74s) 35s ago 13m 91.8M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 82bcc0c46762 2024-04-20T22:04:14.873 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (43s) 35s ago 13m 12.6M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 3e2d91f49494 2024-04-20T22:04:14.873 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (13s) 8s ago 12m 11.1M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 a898b8b77c51 2024-04-20T22:04:14.873 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (12m) 8s ago 12m 250M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 39e09d63d44f 2024-04-20T22:04:14.873 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (11m) 8s ago 11m 225M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4f36124aeb0d 2024-04-20T22:04:14.873 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (4m) 35s ago 16m 73.0M - 2.43.0 a07b618ecd1d 46b76c20eae5 2024-04-20T22:04:14.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.874+0000 7f64a0800700 1 -- 172.21.15.142:0/4106398507 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f648006ecc0 msgr2=0x7f6480071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:14.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.874+0000 7f64a0800700 1 --2- 172.21.15.142:0/4106398507 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f648006ecc0 0x7f6480071180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6488006010 tx=0x7f648800b580 comp rx=0 tx=0).stop 2024-04-20T22:04:14.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.874+0000 7f64a0800700 1 -- 172.21.15.142:0/4106398507 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6498107260 msgr2=0x7f649819cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:14.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.874+0000 7f64a0800700 1 --2- 172.21.15.142:0/4106398507 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6498107260 0x7f649819cd40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f648c00b4b0 tx=0x7f648c00b870 comp rx=0 tx=0).stop 2024-04-20T22:04:14.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.874+0000 7f64a0800700 1 -- 172.21.15.142:0/4106398507 shutdown_connections 2024-04-20T22:04:14.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.874+0000 7f64a0800700 1 --2- 172.21.15.142:0/4106398507 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f648006ecc0 0x7f6480071180 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:14.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.874+0000 7f64a0800700 1 --2- 172.21.15.142:0/4106398507 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6498107260 0x7f649819cd40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:14.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.874+0000 7f64a0800700 1 --2- 172.21.15.142:0/4106398507 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6498108430 0x7f649819d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:14.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.874+0000 7f64a0800700 1 -- 172.21.15.142:0/4106398507 >> 172.21.15.142:0/4106398507 conn(0x7f6498076400 msgr2=0x7f649810ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:14.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.875+0000 7f64a0800700 1 -- 172.21.15.142:0/4106398507 shutdown_connections 2024-04-20T22:04:14.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:14.875+0000 7f64a0800700 1 -- 172.21.15.142:0/4106398507 wait complete. 2024-04-20T22:04:15.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.032+0000 7feebb200700 1 -- 172.21.15.142:0/4093768577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb4103df0 msgr2=0x7feeb41061e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:15.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.032+0000 7feebb200700 1 --2- 172.21.15.142:0/4093768577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb4103df0 0x7feeb41061e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7feea4009910 tx=0x7feea4009c20 comp rx=0 tx=0).stop 2024-04-20T22:04:15.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.032+0000 7feebb200700 1 -- 172.21.15.142:0/4093768577 shutdown_connections 2024-04-20T22:04:15.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.032+0000 7feebb200700 1 --2- 172.21.15.142:0/4093768577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb4103df0 0x7feeb41061e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:15.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.032+0000 7feebb200700 1 --2- 172.21.15.142:0/4093768577 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb41014c0 0x7feeb41038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:15.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.032+0000 7feebb200700 1 -- 172.21.15.142:0/4093768577 >> 172.21.15.142:0/4093768577 conn(0x7feeb40faef0 msgr2=0x7feeb40fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:15.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.032+0000 7feebb200700 1 -- 172.21.15.142:0/4093768577 shutdown_connections 2024-04-20T22:04:15.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.032+0000 7feebb200700 1 -- 172.21.15.142:0/4093768577 wait complete. 2024-04-20T22:04:15.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.033+0000 7feebb200700 1 Processor -- start 2024-04-20T22:04:15.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.033+0000 7feebb200700 1 -- start start 2024-04-20T22:04:15.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.033+0000 7feebb200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb41014c0 0x7feeb4196500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:15.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.033+0000 7feebb200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb4103df0 0x7feeb4196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:15.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.033+0000 7feebb200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb4197060 con 0x7feeb4103df0 2024-04-20T22:04:15.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.033+0000 7feebb200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb41971a0 con 0x7feeb41014c0 2024-04-20T22:04:15.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.034+0000 7feeb9400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb4103df0 0x7feeb4196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:15.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.034+0000 7feeb9400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb4103df0 0x7feeb4196a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60950/0 (socket says 172.21.15.142:60950) 2024-04-20T22:04:15.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.034+0000 7feeb9400700 1 -- 172.21.15.142:0/519622765 learned_addr learned my addr 172.21.15.142:0/519622765 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:04:15.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.034+0000 7feeb9e00700 1 --2- 172.21.15.142:0/519622765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb41014c0 0x7feeb4196500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:15.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.034+0000 7feeb9400700 1 -- 172.21.15.142:0/519622765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb41014c0 msgr2=0x7feeb4196500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:15.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.034+0000 7feeb9400700 1 --2- 172.21.15.142:0/519622765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb41014c0 0x7feeb4196500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:15.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.034+0000 7feeb9400700 1 -- 172.21.15.142:0/519622765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea40095f0 con 0x7feeb4103df0 2024-04-20T22:04:15.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.034+0000 7feeb9e00700 1 --2- 172.21.15.142:0/519622765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb41014c0 0x7feeb4196500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:04:15.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.035+0000 7feeb9400700 1 --2- 172.21.15.142:0/519622765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb4103df0 0x7feeb4196a40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7feea4006010 tx=0x7feea400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:15.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.035+0000 7feeaea00700 1 -- 172.21.15.142:0/519622765 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea401d070 con 0x7feeb4103df0 2024-04-20T22:04:15.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.035+0000 7feeaea00700 1 -- 172.21.15.142:0/519622765 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feea400f460 con 0x7feeb4103df0 2024-04-20T22:04:15.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.035+0000 7feeaea00700 1 -- 172.21.15.142:0/519622765 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feea4021640 con 0x7feeb4103df0 2024-04-20T22:04:15.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.035+0000 7feebb200700 1 -- 172.21.15.142:0/519622765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb419bba0 con 0x7feeb4103df0 2024-04-20T22:04:15.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.035+0000 7feebb200700 1 -- 172.21.15.142:0/519622765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb419c0c0 con 0x7feeb4103df0 2024-04-20T22:04:15.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.036+0000 7feebb200700 1 -- 172.21.15.142:0/519622765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb4062510 con 0x7feeb4103df0 2024-04-20T22:04:15.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.038+0000 7feeaea00700 1 -- 172.21.15.142:0/519622765 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7feea400fab0 con 0x7feeb4103df0 2024-04-20T22:04:15.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.038+0000 7feeaea00700 1 --2- 172.21.15.142:0/519622765 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fee9c06ecc0 0x7fee9c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:15.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.039+0000 7feeaea00700 1 -- 172.21.15.142:0/519622765 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6414+0+0 (secure 0 0 0) 0x7feea40901a0 con 0x7feeb4103df0 2024-04-20T22:04:15.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.039+0000 7feeb9e00700 1 --2- 172.21.15.142:0/519622765 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fee9c06ecc0 0x7fee9c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:15.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.039+0000 7feeb9e00700 1 --2- 172.21.15.142:0/519622765 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fee9c06ecc0 0x7fee9c071180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feea8007900 tx=0x7feea8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:15.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.043+0000 7feeaea00700 1 -- 172.21.15.142:0/519622765 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7feea405cac0 con 0x7feeb4103df0 2024-04-20T22:04:15.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:15 smithi142 ceph-mon[79401]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:04:15.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:15.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:04:15.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:15.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:15.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:04:15.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:04:15.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:15.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:04:15.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:04:15.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:04:15.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:04:15.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-20T22:04:15.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.367+0000 7feebb200700 1 -- 172.21.15.142:0/519622765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feeb4109610 con 0x7feeb4103df0 2024-04-20T22:04:15.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.368+0000 7feeaea00700 1 -- 172.21.15.142:0/519622765 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+836 (secure 0 0 0) 0x7feea405c650 con 0x7feeb4103df0 2024-04-20T22:04:15.368 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:04:15.368 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:04:15.368 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:04:15.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:04:15.368 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:04:15.368 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:04:15.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:04:15.368 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:04:15.368 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 2, 2024-04-20T22:04:15.368 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 4 2024-04-20T22:04:15.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:04:15.369 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:04:15.369 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4 2024-04-20T22:04:15.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:04:15.369 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:04:15.369 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 6, 2024-04-20T22:04:15.369 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 8 2024-04-20T22:04:15.369 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:04:15.369 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:04:15.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.372+0000 7feebb200700 1 -- 172.21.15.142:0/519622765 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fee9c06ecc0 msgr2=0x7fee9c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:15.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.372+0000 7feebb200700 1 --2- 172.21.15.142:0/519622765 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fee9c06ecc0 0x7fee9c071180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feea8007900 tx=0x7feea8008040 comp rx=0 tx=0).stop 2024-04-20T22:04:15.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.372+0000 7feebb200700 1 -- 172.21.15.142:0/519622765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb4103df0 msgr2=0x7feeb4196a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:15.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.372+0000 7feebb200700 1 --2- 172.21.15.142:0/519622765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb4103df0 0x7feeb4196a40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7feea4006010 tx=0x7feea400be20 comp rx=0 tx=0).stop 2024-04-20T22:04:15.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.372+0000 7feebb200700 1 -- 172.21.15.142:0/519622765 shutdown_connections 2024-04-20T22:04:15.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.372+0000 7feebb200700 1 --2- 172.21.15.142:0/519622765 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fee9c06ecc0 0x7fee9c071180 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:15.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.372+0000 7feebb200700 1 --2- 172.21.15.142:0/519622765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb41014c0 0x7feeb4196500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:15.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.372+0000 7feebb200700 1 --2- 172.21.15.142:0/519622765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb4103df0 0x7feeb4196a40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:15.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.372+0000 7feebb200700 1 -- 172.21.15.142:0/519622765 >> 172.21.15.142:0/519622765 conn(0x7feeb40faef0 msgr2=0x7feeb40fd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:15.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.372+0000 7feebb200700 1 -- 172.21.15.142:0/519622765 shutdown_connections 2024-04-20T22:04:15.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.372+0000 7feebb200700 1 -- 172.21.15.142:0/519622765 wait complete. 2024-04-20T22:04:15.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:15 smithi164 ceph-mon[69784]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:04:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:04:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:04:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:04:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:04:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:04:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:04:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:04:15.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-20T22:04:15.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.530+0000 7fa824e00700 1 -- 172.21.15.142:0/2497861045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa820100a70 msgr2=0x7fa820100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:15.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.530+0000 7fa824e00700 1 --2- 172.21.15.142:0/2497861045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa820100a70 0x7fa820100e90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa810009910 tx=0x7fa810009c20 comp rx=0 tx=0).stop 2024-04-20T22:04:15.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.531+0000 7fa824e00700 1 -- 172.21.15.142:0/2497861045 shutdown_connections 2024-04-20T22:04:15.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.531+0000 7fa824e00700 1 --2- 172.21.15.142:0/2497861045 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa820101c70 0x7fa8201020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:15.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.531+0000 7fa824e00700 1 --2- 172.21.15.142:0/2497861045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa820100a70 0x7fa820100e90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:15.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.531+0000 7fa824e00700 1 -- 172.21.15.142:0/2497861045 >> 172.21.15.142:0/2497861045 conn(0x7fa8200fc050 msgr2=0x7fa8200fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:15.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.531+0000 7fa824e00700 1 -- 172.21.15.142:0/2497861045 shutdown_connections 2024-04-20T22:04:15.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.531+0000 7fa824e00700 1 -- 172.21.15.142:0/2497861045 wait complete. 2024-04-20T22:04:15.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.532+0000 7fa824e00700 1 Processor -- start 2024-04-20T22:04:15.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.532+0000 7fa824e00700 1 -- start start 2024-04-20T22:04:15.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.532+0000 7fa824e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa820100a70 0x7fa8201986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:15.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.532+0000 7fa824e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa820101c70 0x7fa820198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:15.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.532+0000 7fa824e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa820199230 con 0x7fa820100a70 2024-04-20T22:04:15.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.532+0000 7fa824e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa820199370 con 0x7fa820101c70 2024-04-20T22:04:15.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.533+0000 7fa81f400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa820100a70 0x7fa8201986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:15.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.533+0000 7fa81f400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa820100a70 0x7fa8201986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60964/0 (socket says 172.21.15.142:60964) 2024-04-20T22:04:15.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.533+0000 7fa81f400700 1 -- 172.21.15.142:0/843135461 learned_addr learned my addr 172.21.15.142:0/843135461 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:04:15.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.533+0000 7fa81ea00700 1 --2- 172.21.15.142:0/843135461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa820101c70 0x7fa820198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:15.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.533+0000 7fa81f400700 1 -- 172.21.15.142:0/843135461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa820101c70 msgr2=0x7fa820198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:15.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.533+0000 7fa81f400700 1 --2- 172.21.15.142:0/843135461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa820101c70 0x7fa820198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:15.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.533+0000 7fa81f400700 1 -- 172.21.15.142:0/843135461 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8100095f0 con 0x7fa820100a70 2024-04-20T22:04:15.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.534+0000 7fa81f400700 1 --2- 172.21.15.142:0/843135461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa820100a70 0x7fa8201986d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa81000bd70 tx=0x7fa81000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:15.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.534+0000 7fa817e00700 1 -- 172.21.15.142:0/843135461 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa81001d070 con 0x7fa820100a70 2024-04-20T22:04:15.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.534+0000 7fa817e00700 1 -- 172.21.15.142:0/843135461 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa810005dc0 con 0x7fa820100a70 2024-04-20T22:04:15.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.534+0000 7fa824e00700 1 -- 172.21.15.142:0/843135461 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82019dd70 con 0x7fa820100a70 2024-04-20T22:04:15.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.534+0000 7fa817e00700 1 -- 172.21.15.142:0/843135461 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa810021410 con 0x7fa820100a70 2024-04-20T22:04:15.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.534+0000 7fa824e00700 1 -- 172.21.15.142:0/843135461 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82019e280 con 0x7fa820100a70 2024-04-20T22:04:15.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.535+0000 7fa824e00700 1 -- 172.21.15.142:0/843135461 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82004f470 con 0x7fa820100a70 2024-04-20T22:04:15.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.537+0000 7fa817e00700 1 -- 172.21.15.142:0/843135461 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fa81000f820 con 0x7fa820100a70 2024-04-20T22:04:15.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.537+0000 7fa817e00700 1 --2- 172.21.15.142:0/843135461 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa80406ecd0 0x7fa804071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:15.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.538+0000 7fa817e00700 1 -- 172.21.15.142:0/843135461 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa8100900f0 con 0x7fa820100a70 2024-04-20T22:04:15.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.538+0000 7fa81ea00700 1 --2- 172.21.15.142:0/843135461 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa80406ecd0 0x7fa804071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:15.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.539+0000 7fa81ea00700 1 --2- 172.21.15.142:0/843135461 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa80406ecd0 0x7fa804071190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa80c005950 tx=0x7fa80c0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:15.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.543+0000 7fa817e00700 1 -- 172.21.15.142:0/843135461 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fa82004f470 con 0x7fa820100a70 2024-04-20T22:04:15.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.812+0000 7fa824e00700 1 -- 172.21.15.142:0/843135461 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa820106640 con 0x7fa820100a70 2024-04-20T22:04:15.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.813+0000 7fa817e00700 1 -- 172.21.15.142:0/843135461 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1898 (secure 0 0 0) 0x7fa81005c700 con 0x7fa820100a70 2024-04-20T22:04:15.813 INFO:teuthology.orchestra.run.smithi142.stdout:e12 2024-04-20T22:04:15.813 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:04:15.813 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:04:15.813 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T22:04:15.814 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:04:15.814 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T22:04:15.814 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T22:04:15.814 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 12 2024-04-20T22:04:15.814 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:04:15.814 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:04:15.814 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:51.692699+0000 2024-04-20T22:04:15.814 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T22:04:15.814 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T22:04:15.814 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T22:04:15.814 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T22:04:15.814 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T22:04:15.814 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T22:04:15.815 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T22:04:15.815 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T22:04:15.815 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T22:04:15.815 INFO:teuthology.orchestra.run.smithi142.stdout:snap_rstat 1 2024-04-20T22:04:15.815 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:04:15.815 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T22:04:15.815 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T22:04:15.815 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T22:04:15.815 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T22:04:15.815 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T22:04:15.815 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T22:04:15.815 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T22:04:15.815 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T22:04:15.815 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T22:04:15.815 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T22:04:15.816 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T22:04:15.816 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T22:04:15.816 INFO:teuthology.orchestra.run.smithi142.stdout:qdb_cluster leader: 0 members: 2024-04-20T22:04:15.816 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:04:15.816 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:04:15.816 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:04:15.816 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T22:04:15.816 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:04:15.816 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:04:15.816 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:04:15.816 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:04:15.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.816+0000 7fa824e00700 1 -- 172.21.15.142:0/843135461 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa80406ecd0 msgr2=0x7fa804071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:15.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.816+0000 7fa824e00700 1 --2- 172.21.15.142:0/843135461 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa80406ecd0 0x7fa804071190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa80c005950 tx=0x7fa80c0058e0 comp rx=0 tx=0).stop 2024-04-20T22:04:15.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.816+0000 7fa824e00700 1 -- 172.21.15.142:0/843135461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa820100a70 msgr2=0x7fa8201986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:15.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.816+0000 7fa824e00700 1 --2- 172.21.15.142:0/843135461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa820100a70 0x7fa8201986d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa81000bd70 tx=0x7fa81000be50 comp rx=0 tx=0).stop 2024-04-20T22:04:15.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.816+0000 7fa824e00700 1 -- 172.21.15.142:0/843135461 shutdown_connections 2024-04-20T22:04:15.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.816+0000 7fa824e00700 1 --2- 172.21.15.142:0/843135461 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa80406ecd0 0x7fa804071190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:15.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.816+0000 7fa824e00700 1 --2- 172.21.15.142:0/843135461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa820100a70 0x7fa8201986d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:15.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.816+0000 7fa824e00700 1 --2- 172.21.15.142:0/843135461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa820101c70 0x7fa820198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:15.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.816+0000 7fa824e00700 1 -- 172.21.15.142:0/843135461 >> 172.21.15.142:0/843135461 conn(0x7fa8200fc050 msgr2=0x7fa820073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:15.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.816+0000 7fa824e00700 1 -- 172.21.15.142:0/843135461 shutdown_connections 2024-04-20T22:04:15.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.816+0000 7fa824e00700 1 -- 172.21.15.142:0/843135461 wait complete. 2024-04-20T22:04:15.818 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T22:04:15.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.971+0000 7f93dda00700 1 -- 172.21.15.142:0/961835691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93d8108430 msgr2=0x7f93d81088b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:15.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.971+0000 7f93dda00700 1 --2- 172.21.15.142:0/961835691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93d8108430 0x7f93d81088b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009910 tx=0x7f93c4009c20 comp rx=0 tx=0).stop 2024-04-20T22:04:15.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.971+0000 7f93dda00700 1 -- 172.21.15.142:0/961835691 shutdown_connections 2024-04-20T22:04:15.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.971+0000 7f93dda00700 1 --2- 172.21.15.142:0/961835691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93d8108430 0x7f93d81088b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:15.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.971+0000 7f93dda00700 1 --2- 172.21.15.142:0/961835691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93d8107260 0x7f93d8107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:15.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.971+0000 7f93dda00700 1 -- 172.21.15.142:0/961835691 >> 172.21.15.142:0/961835691 conn(0x7f93d8076400 msgr2=0x7f93d8078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:15.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.971+0000 7f93dda00700 1 -- 172.21.15.142:0/961835691 shutdown_connections 2024-04-20T22:04:15.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.971+0000 7f93dda00700 1 -- 172.21.15.142:0/961835691 wait complete. 2024-04-20T22:04:15.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.972+0000 7f93dda00700 1 Processor -- start 2024-04-20T22:04:15.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.973+0000 7f93dda00700 1 -- start start 2024-04-20T22:04:15.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.973+0000 7f93dda00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93d8107260 0x7f93d819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:15.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.973+0000 7f93dda00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93d8108430 0x7f93d819d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:15.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.973+0000 7f93dda00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d819d6a0 con 0x7f93d8107260 2024-04-20T22:04:15.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.973+0000 7f93dda00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d819d7e0 con 0x7f93d8108430 2024-04-20T22:04:15.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.973+0000 7f93d6a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93d8107260 0x7f93d819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:15.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.973+0000 7f93d6a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93d8107260 0x7f93d819cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60988/0 (socket says 172.21.15.142:60988) 2024-04-20T22:04:15.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.973+0000 7f93d6a00700 1 -- 172.21.15.142:0/3619641204 learned_addr learned my addr 172.21.15.142:0/3619641204 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:04:15.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.974+0000 7f93d6a00700 1 -- 172.21.15.142:0/3619641204 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93d8108430 msgr2=0x7f93d819d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:15.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.974+0000 7f93d6a00700 1 --2- 172.21.15.142:0/3619641204 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93d8108430 0x7f93d819d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:15.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.974+0000 7f93d6a00700 1 -- 172.21.15.142:0/3619641204 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c40095f0 con 0x7f93d8107260 2024-04-20T22:04:15.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.974+0000 7f93d6a00700 1 --2- 172.21.15.142:0/3619641204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93d8107260 0x7f93d819cbd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f93c800c930 tx=0x7f93c800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:15.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.974+0000 7f93cf400700 1 -- 172.21.15.142:0/3619641204 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c8007ad0 con 0x7f93d8107260 2024-04-20T22:04:15.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.974+0000 7f93cf400700 1 -- 172.21.15.142:0/3619641204 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93c8007c30 con 0x7f93d8107260 2024-04-20T22:04:15.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.974+0000 7f93dda00700 1 -- 172.21.15.142:0/3619641204 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d81a2250 con 0x7f93d8107260 2024-04-20T22:04:15.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.974+0000 7f93cf400700 1 -- 172.21.15.142:0/3619641204 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c8018610 con 0x7f93d8107260 2024-04-20T22:04:15.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.974+0000 7f93dda00700 1 -- 172.21.15.142:0/3619641204 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d81a27a0 con 0x7f93d8107260 2024-04-20T22:04:15.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.975+0000 7f93dda00700 1 -- 172.21.15.142:0/3619641204 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d8196dd0 con 0x7f93d8107260 2024-04-20T22:04:15.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.976+0000 7f93cf400700 1 -- 172.21.15.142:0/3619641204 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f93c800f450 con 0x7f93d8107260 2024-04-20T22:04:15.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.977+0000 7f93cf400700 1 --2- 172.21.15.142:0/3619641204 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f93bc06ecd0 0x7f93bc071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:15.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.977+0000 7f93cf400700 1 -- 172.21.15.142:0/3619641204 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f93c808f0c0 con 0x7f93d8107260 2024-04-20T22:04:15.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.978+0000 7f93d6000700 1 --2- 172.21.15.142:0/3619641204 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f93bc06ecd0 0x7f93bc071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:15.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.978+0000 7f93d6000700 1 --2- 172.21.15.142:0/3619641204 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f93bc06ecd0 0x7f93bc071190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f93c40051c0 tx=0x7f93c4005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:15.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:15.982+0000 7f93cf400700 1 -- 172.21.15.142:0/3619641204 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f93c805b960 con 0x7f93d8107260 2024-04-20T22:04:16.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:16 smithi142 ceph-mon[79401]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:04:16.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:16 smithi142 ceph-mon[79401]: pgmap v143: 65 pgs: 4 peering, 11 active+undersized+degraded, 13 active+undersized, 37 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 35/231 objects degraded (15.152%) 2024-04-20T22:04:16.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:16 smithi142 ceph-mon[79401]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:04:16.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:16 smithi142 ceph-mon[79401]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-20T22:04:16.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:16 smithi142 ceph-mon[79401]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-04-20T22:04:16.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:16 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/519622765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:04:16.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:16 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/843135461' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:04:16.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.230+0000 7f93dda00700 1 -- 172.21.15.142:0/3619641204 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f93d802cf30 con 0x7f93bc06ecd0 2024-04-20T22:04:16.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.232+0000 7f93cf400700 1 -- 172.21.15.142:0/3619641204 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f93d802cf30 con 0x7f93bc06ecd0 2024-04-20T22:04:16.232 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:04:16.232 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T22:04:16.232 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T22:04:16.232 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T22:04:16.233 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T22:04:16.233 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr", 2024-04-20T22:04:16.233 INFO:teuthology.orchestra.run.smithi142.stdout: "mon", 2024-04-20T22:04:16.233 INFO:teuthology.orchestra.run.smithi142.stdout: "crash" 2024-04-20T22:04:16.233 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T22:04:16.233 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "10/23 daemons upgraded", 2024-04-20T22:04:16.233 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading osd daemons", 2024-04-20T22:04:16.233 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T22:04:16.233 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:04:16.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.235+0000 7f93dda00700 1 -- 172.21.15.142:0/3619641204 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f93bc06ecd0 msgr2=0x7f93bc071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:16.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.235+0000 7f93dda00700 1 --2- 172.21.15.142:0/3619641204 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f93bc06ecd0 0x7f93bc071190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f93c40051c0 tx=0x7f93c4005fd0 comp rx=0 tx=0).stop 2024-04-20T22:04:16.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.235+0000 7f93dda00700 1 -- 172.21.15.142:0/3619641204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93d8107260 msgr2=0x7f93d819cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:16.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.235+0000 7f93dda00700 1 --2- 172.21.15.142:0/3619641204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93d8107260 0x7f93d819cbd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f93c800c930 tx=0x7f93c800ccf0 comp rx=0 tx=0).stop 2024-04-20T22:04:16.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.236+0000 7f93dda00700 1 -- 172.21.15.142:0/3619641204 shutdown_connections 2024-04-20T22:04:16.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.236+0000 7f93dda00700 1 --2- 172.21.15.142:0/3619641204 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f93bc06ecd0 0x7f93bc071190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:16.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.236+0000 7f93dda00700 1 --2- 172.21.15.142:0/3619641204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93d8107260 0x7f93d819cbd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:16.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.236+0000 7f93dda00700 1 --2- 172.21.15.142:0/3619641204 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93d8108430 0x7f93d819d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:16.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.236+0000 7f93dda00700 1 -- 172.21.15.142:0/3619641204 >> 172.21.15.142:0/3619641204 conn(0x7f93d8076400 msgr2=0x7f93d810b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:16.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.236+0000 7f93dda00700 1 -- 172.21.15.142:0/3619641204 shutdown_connections 2024-04-20T22:04:16.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.236+0000 7f93dda00700 1 -- 172.21.15.142:0/3619641204 wait complete. 2024-04-20T22:04:16.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.391+0000 7f3d13200700 1 -- 172.21.15.142:0/3547286014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d0c103f80 msgr2=0x7f3d0c104400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:16.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.391+0000 7f3d13200700 1 --2- 172.21.15.142:0/3547286014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d0c103f80 0x7f3d0c104400 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009910 tx=0x7f3cf8009c20 comp rx=0 tx=0).stop 2024-04-20T22:04:16.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.391+0000 7f3d13200700 1 -- 172.21.15.142:0/3547286014 shutdown_connections 2024-04-20T22:04:16.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.391+0000 7f3d13200700 1 --2- 172.21.15.142:0/3547286014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d0c103f80 0x7f3d0c104400 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:16.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.391+0000 7f3d13200700 1 --2- 172.21.15.142:0/3547286014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d0c102e20 0x7f3d0c103240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:16.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.391+0000 7f3d13200700 1 -- 172.21.15.142:0/3547286014 >> 172.21.15.142:0/3547286014 conn(0x7f3d0c0fe3a0 msgr2=0x7f3d0c100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:16.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.391+0000 7f3d13200700 1 -- 172.21.15.142:0/3547286014 shutdown_connections 2024-04-20T22:04:16.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.391+0000 7f3d13200700 1 -- 172.21.15.142:0/3547286014 wait complete. 2024-04-20T22:04:16.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.392+0000 7f3d13200700 1 Processor -- start 2024-04-20T22:04:16.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.392+0000 7f3d13200700 1 -- start start 2024-04-20T22:04:16.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.392+0000 7f3d13200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d0c102e20 0x7f3d0c1987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:16.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.392+0000 7f3d13200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d0c103f80 0x7f3d0c198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:16.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.392+0000 7f3d13200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c199330 con 0x7f3d0c103f80 2024-04-20T22:04:16.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.392+0000 7f3d13200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c199470 con 0x7f3d0c102e20 2024-04-20T22:04:16.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.393+0000 7f3d0b400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d0c103f80 0x7f3d0c198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:16.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.393+0000 7f3d0b400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d0c103f80 0x7f3d0c198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:32778/0 (socket says 172.21.15.142:32778) 2024-04-20T22:04:16.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.393+0000 7f3d0b400700 1 -- 172.21.15.142:0/2656797824 learned_addr learned my addr 172.21.15.142:0/2656797824 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:04:16.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.393+0000 7f3d0be00700 1 --2- 172.21.15.142:0/2656797824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d0c102e20 0x7f3d0c1987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:16.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.393+0000 7f3d0b400700 1 -- 172.21.15.142:0/2656797824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d0c102e20 msgr2=0x7f3d0c1987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:16.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.393+0000 7f3d0b400700 1 --2- 172.21.15.142:0/2656797824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d0c102e20 0x7f3d0c1987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:16.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.393+0000 7f3d0b400700 1 -- 172.21.15.142:0/2656797824 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf80095f0 con 0x7f3d0c103f80 2024-04-20T22:04:16.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.394+0000 7f3d0b400700 1 --2- 172.21.15.142:0/2656797824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d0c103f80 0x7f3d0c198d10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800bd70 tx=0x7f3cf800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:16.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.394+0000 7f3d08c00700 1 -- 172.21.15.142:0/2656797824 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cf801d070 con 0x7f3d0c103f80 2024-04-20T22:04:16.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.394+0000 7f3d08c00700 1 -- 172.21.15.142:0/2656797824 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3cf800f460 con 0x7f3d0c103f80 2024-04-20T22:04:16.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.394+0000 7f3d13200700 1 -- 172.21.15.142:0/2656797824 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0c19de70 con 0x7f3d0c103f80 2024-04-20T22:04:16.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.394+0000 7f3d08c00700 1 -- 172.21.15.142:0/2656797824 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cf8021620 con 0x7f3d0c103f80 2024-04-20T22:04:16.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.394+0000 7f3d13200700 1 -- 172.21.15.142:0/2656797824 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0c19e3b0 con 0x7f3d0c103f80 2024-04-20T22:04:16.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.395+0000 7f3d13200700 1 -- 172.21.15.142:0/2656797824 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d0c192920 con 0x7f3d0c103f80 2024-04-20T22:04:16.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.397+0000 7f3d08c00700 1 -- 172.21.15.142:0/2656797824 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f3cf800fa70 con 0x7f3d0c103f80 2024-04-20T22:04:16.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.398+0000 7f3d08c00700 1 --2- 172.21.15.142:0/2656797824 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3cf006ecc0 0x7f3cf0071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:16.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.398+0000 7f3d08c00700 1 -- 172.21.15.142:0/2656797824 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3cf8090180 con 0x7f3d0c103f80 2024-04-20T22:04:16.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.398+0000 7f3d0be00700 1 --2- 172.21.15.142:0/2656797824 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3cf006ecc0 0x7f3cf0071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:16.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.399+0000 7f3d0be00700 1 --2- 172.21.15.142:0/2656797824 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3cf006ecc0 0x7f3cf0071180 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc005fd0 tx=0x7f3cfc00a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:16.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.403+0000 7f3d08c00700 1 -- 172.21.15.142:0/2656797824 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f3cf805cac0 con 0x7f3d0c103f80 2024-04-20T22:04:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:16 smithi164 ceph-mon[69784]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:04:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:16 smithi164 ceph-mon[69784]: pgmap v143: 65 pgs: 4 peering, 11 active+undersized+degraded, 13 active+undersized, 37 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 35/231 objects degraded (15.152%) 2024-04-20T22:04:16.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:16 smithi164 ceph-mon[69784]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:04:16.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:16 smithi164 ceph-mon[69784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-20T22:04:16.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:16 smithi164 ceph-mon[69784]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-04-20T22:04:16.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:16 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/519622765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:04:16.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:16 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/843135461' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:04:16.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.709+0000 7f3d13200700 1 -- 172.21.15.142:0/2656797824 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3d0c062510 con 0x7f3d0c103f80 2024-04-20T22:04:16.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.710+0000 7f3d08c00700 1 -- 172.21.15.142:0/2656797824 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+795 (secure 0 0 0) 0x7f3cf805c650 con 0x7f3d0c103f80 2024-04-20T22:04:16.710 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_WARN Degraded data redundancy: 35/231 objects degraded (15.152%), 11 pgs degraded 2024-04-20T22:04:16.710 INFO:teuthology.orchestra.run.smithi142.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 35/231 objects degraded (15.152%), 11 pgs degraded 2024-04-20T22:04:16.710 INFO:teuthology.orchestra.run.smithi142.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-04-20T22:04:16.710 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-04-20T22:04:16.710 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-04-20T22:04:16.710 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-04-20T22:04:16.710 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-04-20T22:04:16.710 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-04-20T22:04:16.710 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-04-20T22:04:16.711 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-04-20T22:04:16.711 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-04-20T22:04:16.711 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-04-20T22:04:16.711 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-04-20T22:04:16.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.712+0000 7f3d13200700 1 -- 172.21.15.142:0/2656797824 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3cf006ecc0 msgr2=0x7f3cf0071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:16.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.712+0000 7f3d13200700 1 --2- 172.21.15.142:0/2656797824 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3cf006ecc0 0x7f3cf0071180 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc005fd0 tx=0x7f3cfc00a560 comp rx=0 tx=0).stop 2024-04-20T22:04:16.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.712+0000 7f3d13200700 1 -- 172.21.15.142:0/2656797824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d0c103f80 msgr2=0x7f3d0c198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:16.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.712+0000 7f3d13200700 1 --2- 172.21.15.142:0/2656797824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d0c103f80 0x7f3d0c198d10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800bd70 tx=0x7f3cf800be50 comp rx=0 tx=0).stop 2024-04-20T22:04:16.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.712+0000 7f3d13200700 1 -- 172.21.15.142:0/2656797824 shutdown_connections 2024-04-20T22:04:16.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.712+0000 7f3d13200700 1 --2- 172.21.15.142:0/2656797824 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3cf006ecc0 0x7f3cf0071180 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:16.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.712+0000 7f3d13200700 1 --2- 172.21.15.142:0/2656797824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d0c102e20 0x7f3d0c1987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:16.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.712+0000 7f3d13200700 1 --2- 172.21.15.142:0/2656797824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d0c103f80 0x7f3d0c198d10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:16.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.712+0000 7f3d13200700 1 -- 172.21.15.142:0/2656797824 >> 172.21.15.142:0/2656797824 conn(0x7f3d0c0fe3a0 msgr2=0x7f3d0c107570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:16.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.713+0000 7f3d13200700 1 -- 172.21.15.142:0/2656797824 shutdown_connections 2024-04-20T22:04:16.713 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:16.713+0000 7f3d13200700 1 -- 172.21.15.142:0/2656797824 wait complete. 2024-04-20T22:04:17.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:17 smithi164 ceph-mon[69784]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:04:17.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:17 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/2656797824' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:04:17.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:17 smithi142 ceph-mon[79401]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:04:17.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:17 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2656797824' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:04:18.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:18 smithi164 ceph-mon[69784]: pgmap v144: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:18.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:18 smithi164 ceph-mon[69784]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/231 objects degraded (15.152%), 11 pgs degraded) 2024-04-20T22:04:18.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:18 smithi164 ceph-mon[69784]: Cluster is now healthy 2024-04-20T22:04:18.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:18 smithi142 ceph-mon[79401]: pgmap v144: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:18.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:18 smithi142 ceph-mon[79401]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 35/231 objects degraded (15.152%), 11 pgs degraded) 2024-04-20T22:04:18.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:18 smithi142 ceph-mon[79401]: Cluster is now healthy 2024-04-20T22:04:20.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:20 smithi164 ceph-mon[69784]: pgmap v145: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:20 smithi142 ceph-mon[79401]: pgmap v145: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:22.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:22 smithi164 ceph-mon[69784]: pgmap v146: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:22.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:22 smithi142 ceph-mon[79401]: pgmap v146: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:24.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:24 smithi164 ceph-mon[69784]: pgmap v147: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:24.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:24 smithi142 ceph-mon[79401]: pgmap v147: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:25.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:25 smithi164 ceph-mon[69784]: pgmap v148: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:25.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:25 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:25.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:25 smithi142 ceph-mon[79401]: pgmap v148: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:25.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:25 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:27.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:27 smithi164 ceph-mon[69784]: pgmap v149: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:27.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:27 smithi142 ceph-mon[79401]: pgmap v149: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:29.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:29 smithi142 ceph-mon[79401]: pgmap v150: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:29.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:29.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:04:29.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:29 smithi164 ceph-mon[69784]: pgmap v150: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:29.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:29.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:04:30.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-20T22:04:30.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:30 smithi164 ceph-mon[69784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-20T22:04:30.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:30 smithi164 ceph-mon[69784]: Upgrade: osd.4 is safe to restart 2024-04-20T22:04:30.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-20T22:04:30.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:30 smithi142 ceph-mon[79401]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-20T22:04:30.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:30 smithi142 ceph-mon[79401]: Upgrade: osd.4 is safe to restart 2024-04-20T22:04:31.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:31 smithi164 ceph-mon[69784]: pgmap v151: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:31.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:31 smithi142 ceph-mon[79401]: pgmap v151: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:33.586 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:33 smithi164 ceph-mon[69784]: Upgrade: Updating osd.4 2024-04-20T22:04:33.586 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:33 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:33.586 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:33 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-20T22:04:33.586 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:33 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:04:33.586 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:33 smithi164 ceph-mon[69784]: Deploying daemon osd.4 on smithi164 2024-04-20T22:04:33.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:33 smithi142 ceph-mon[79401]: Upgrade: Updating osd.4 2024-04-20T22:04:33.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:33 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:33.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:33 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-20T22:04:33.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:33 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:04:33.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:33 smithi142 ceph-mon[79401]: Deploying daemon osd.4 on smithi164 2024-04-20T22:04:34.637 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:34 smithi142 ceph-mon[79401]: pgmap v152: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:34.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:34 smithi164 ceph-mon[69784]: pgmap v152: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:36.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:36 smithi142 ceph-mon[79401]: pgmap v153: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:36.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:36 smithi164 ceph-mon[69784]: pgmap v153: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:37.946 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:37 smithi164 systemd[1]: Stopping Ceph osd.4 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:04:38.402 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:38 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[36403]: 2024-04-20T22:04:38.007+0000 7f5dc0c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T22:04:38.402 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:38 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[36403]: 2024-04-20T22:04:38.007+0000 7f5dc0c00700 -1 osd.4 70 *** Got signal Terminated *** 2024-04-20T22:04:38.402 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:38 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[36403]: 2024-04-20T22:04:38.007+0000 7f5dc0c00700 -1 osd.4 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T22:04:38.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:38 smithi164 ceph-mon[69784]: pgmap v154: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:38.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:38 smithi164 ceph-mon[69784]: osd.4 marked itself down and dead 2024-04-20T22:04:38.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:38 smithi142 ceph-mon[79401]: pgmap v154: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:38.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:38 smithi142 ceph-mon[79401]: osd.4 marked itself down and dead 2024-04-20T22:04:39.250 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:38 smithi164 podman[83894]: 2024-04-20 22:04:38.996807985 +0000 UTC m=+1.116504429 container died 39e09d63d44f2cb9e585c65aa3231b32b048f3c6fefc9b4507da689fd6f107cb (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=reef-646b8c7, ceph=True, org.label-schema.build-date=20240416, GIT_CLEAN=True) 2024-04-20T22:04:39.601 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:39 smithi164 podman[83894]: 2024-04-20 22:04:39.367694356 +0000 UTC m=+1.487390814 container cleanup 39e09d63d44f2cb9e585c65aa3231b32b048f3c6fefc9b4507da689fd6f107cb (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=reef-646b8c7, ceph=True) 2024-04-20T22:04:39.602 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:39 smithi164 bash[83894]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4 2024-04-20T22:04:39.602 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:39 smithi164 ceph-mon[69784]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-20T22:04:39.602 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:39 smithi164 ceph-mon[69784]: osdmap e71: 6 total, 5 up, 6 in 2024-04-20T22:04:39.602 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:39 smithi164 ceph-mon[69784]: pgmap v156: 65 pgs: 6 stale+active+clean, 59 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:39.602 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:39 smithi164 ceph-mon[69784]: osdmap e72: 6 total, 5 up, 6 in 2024-04-20T22:04:39.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:39 smithi142 ceph-mon[79401]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-20T22:04:39.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:39 smithi142 ceph-mon[79401]: osdmap e71: 6 total, 5 up, 6 in 2024-04-20T22:04:39.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:39 smithi142 ceph-mon[79401]: pgmap v156: 65 pgs: 6 stale+active+clean, 59 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-20T22:04:39.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:39 smithi142 ceph-mon[79401]: osdmap e72: 6 total, 5 up, 6 in 2024-04-20T22:04:39.946 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:39 smithi164 podman[83915]: 2024-04-20 22:04:39.602140757 +0000 UTC m=+0.593068187 container remove 39e09d63d44f2cb9e585c65aa3231b32b048f3c6fefc9b4507da689fd6f107cb (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=reef-646b8c7, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T22:04:40.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:40 smithi164 ceph-mon[69784]: Health check failed: Degraded data redundancy: 26/231 objects degraded (11.255%), 7 pgs degraded (PG_DEGRADED) 2024-04-20T22:04:40.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:40 smithi164 podman[84000]: 2024-04-20 22:04:40.315131212 +0000 UTC m=+0.037978048 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:04:40.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:40 smithi164 podman[84000]: 2024-04-20 22:04:40.42803493 +0000 UTC m=+0.150881790 container create 182c3827ff1b794bb089062831bef431414e03ed049caf6a5196658168b034f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T22:04:40.896 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:40 smithi142 ceph-mon[79401]: Health check failed: Degraded data redundancy: 26/231 objects degraded (11.255%), 7 pgs degraded (PG_DEGRADED) 2024-04-20T22:04:41.197 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:40 smithi164 podman[84000]: 2024-04-20 22:04:40.756923935 +0000 UTC m=+0.479770838 container init 182c3827ff1b794bb089062831bef431414e03ed049caf6a5196658168b034f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-deactivate, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T22:04:41.197 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:40 smithi164 podman[84000]: 2024-04-20 22:04:40.768527987 +0000 UTC m=+0.491374822 container start 182c3827ff1b794bb089062831bef431414e03ed049caf6a5196658168b034f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-20T22:04:41.197 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:40 smithi164 podman[84000]: 2024-04-20 22:04:40.897250878 +0000 UTC m=+0.620097745 container attach 182c3827ff1b794bb089062831bef431414e03ed049caf6a5196658168b034f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux ) 2024-04-20T22:04:41.591 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:41 smithi164 podman[84000]: 2024-04-20 22:04:41.229558786 +0000 UTC m=+0.952405653 container died 182c3827ff1b794bb089062831bef431414e03ed049caf6a5196658168b034f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True) 2024-04-20T22:04:41.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:41 smithi142 ceph-mon[79401]: pgmap v158: 65 pgs: 7 active+undersized+degraded, 4 stale+active+clean, 9 active+undersized, 45 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26/231 objects degraded (11.255%) 2024-04-20T22:04:41.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:41 smithi164 ceph-mon[69784]: pgmap v158: 65 pgs: 7 active+undersized+degraded, 4 stale+active+clean, 9 active+undersized, 45 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26/231 objects degraded (11.255%) 2024-04-20T22:04:42.428 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:42 smithi164 podman[84026]: 2024-04-20 22:04:42.011110827 +0000 UTC m=+0.762527808 container remove 182c3827ff1b794bb089062831bef431414e03ed049caf6a5196658168b034f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2) 2024-04-20T22:04:42.428 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:42 smithi164 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.4.service: Deactivated successfully. 2024-04-20T22:04:42.428 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:42 smithi164 systemd[1]: Stopped Ceph osd.4 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T22:04:42.428 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:42 smithi164 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.4.service: Consumed 2min 8.146s CPU time. 2024-04-20T22:04:42.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:42 smithi164 systemd[1]: Starting Ceph osd.4 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:04:43.107 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:42 smithi164 podman[84124]: 2024-04-20 22:04:42.699868469 +0000 UTC m=+0.036367303 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:04:43.107 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:42 smithi164 podman[84124]: 2024-04-20 22:04:42.812015383 +0000 UTC m=+0.148514250 container create 96521e358ccaa894dbbb16ad51bf8886e11497932d8e5a2a082b96b50c55ff8a (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-activate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-20T22:04:43.107 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:43 smithi164 podman[84124]: 2024-04-20 22:04:43.107040759 +0000 UTC m=+0.443539636 container init 96521e358ccaa894dbbb16ad51bf8886e11497932d8e5a2a082b96b50c55ff8a (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-activate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5) 2024-04-20T22:04:43.446 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:43 smithi164 podman[84124]: 2024-04-20 22:04:43.118987557 +0000 UTC m=+0.455486398 container start 96521e358ccaa894dbbb16ad51bf8886e11497932d8e5a2a082b96b50c55ff8a (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-activate, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-20T22:04:43.446 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:43 smithi164 podman[84124]: 2024-04-20 22:04:43.256052474 +0000 UTC m=+0.592551350 container attach 96521e358ccaa894dbbb16ad51bf8886e11497932d8e5a2a082b96b50c55ff8a (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=) 2024-04-20T22:04:43.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:43 smithi164 ceph-mon[69784]: pgmap v159: 65 pgs: 11 active+undersized+degraded, 2 stale+active+clean, 13 active+undersized, 39 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 35/231 objects degraded (15.152%) 2024-04-20T22:04:43.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:43 smithi142 ceph-mon[79401]: pgmap v159: 65 pgs: 11 active+undersized+degraded, 2 stale+active+clean, 13 active+undersized, 39 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 35/231 objects degraded (15.152%) 2024-04-20T22:04:44.314 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-activate[84139]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:04:44.314 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-activate[84139]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:04:44.314 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 bash[84124]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:04:44.314 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 bash[84124]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:04:44.314 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 bash[84124]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-20T22:04:44.314 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 bash[84124]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-20T22:04:44.315 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 bash[84124]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-20T22:04:44.315 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 bash[84124]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-20T22:04:44.315 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 bash[84124]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-20T22:04:44.315 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 bash[84124]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-20T22:04:44.315 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 bash[84124]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-20T22:04:44.315 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-activate[84139]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-20T22:04:44.315 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-activate[84139]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-20T22:04:44.315 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-activate[84139]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-20T22:04:44.315 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-activate[84139]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-20T22:04:44.315 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-activate[84139]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-20T22:04:44.315 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-activate[84139]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-20T22:04:44.315 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-activate[84139]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-20T22:04:44.315 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 podman[84124]: 2024-04-20 22:04:44.120685365 +0000 UTC m=+1.457184242 container died 96521e358ccaa894dbbb16ad51bf8886e11497932d8e5a2a082b96b50c55ff8a (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=) 2024-04-20T22:04:45.196 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:44 smithi164 podman[84265]: 2024-04-20 22:04:44.851299097 +0000 UTC m=+0.709923348 container remove 96521e358ccaa894dbbb16ad51bf8886e11497932d8e5a2a082b96b50c55ff8a (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-20T22:04:45.509 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:45 smithi164 podman[84328]: 2024-04-20 22:04:45.111661844 +0000 UTC m=+0.033710285 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:04:45.509 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:45 smithi164 podman[84328]: 2024-04-20 22:04:45.252144247 +0000 UTC m=+0.174192724 container create 539c4026f9fb3db356050e48f40371327020f9948f4353ecab9f19d66d829625 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416) 2024-04-20T22:04:45.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:45 smithi142 ceph-mon[79401]: pgmap v160: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:04:45.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:45.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:04:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:45 smithi164 ceph-mon[69784]: pgmap v160: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:04:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:04:45.947 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:45 smithi164 podman[84328]: 2024-04-20 22:04:45.556388956 +0000 UTC m=+0.478437443 container init 539c4026f9fb3db356050e48f40371327020f9948f4353ecab9f19d66d829625 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-20T22:04:45.947 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:45 smithi164 podman[84328]: 2024-04-20 22:04:45.568183362 +0000 UTC m=+0.490231812 container start 539c4026f9fb3db356050e48f40371327020f9948f4353ecab9f19d66d829625 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416) 2024-04-20T22:04:45.947 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:45 smithi164 ceph-osd[84346]: -- 172.21.15.164:0/3959638616 <== mon.1 v2:172.21.15.164:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558674159680 con 0x558674122c00 2024-04-20T22:04:45.947 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:45 smithi164 bash[84328]: 539c4026f9fb3db356050e48f40371327020f9948f4353ecab9f19d66d829625 2024-04-20T22:04:45.947 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:45 smithi164 systemd[1]: Started Ceph osd.4 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T22:04:46.446 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:46 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:04:46.145+0000 7fd22ed347c0 -1 Falling back to public interface 2024-04-20T22:04:46.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.871+0000 7f6f38a00700 1 -- 172.21.15.142:0/3199384754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34101e00 msgr2=0x7f6f34102260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:46.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.871+0000 7f6f38a00700 1 --2- 172.21.15.142:0/3199384754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34101e00 0x7f6f34102260 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6f20009910 tx=0x7f6f20009c20 comp rx=0 tx=0).stop 2024-04-20T22:04:46.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.871+0000 7f6f38a00700 1 -- 172.21.15.142:0/3199384754 shutdown_connections 2024-04-20T22:04:46.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.871+0000 7f6f38a00700 1 --2- 172.21.15.142:0/3199384754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34101e00 0x7f6f34102260 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:46.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.871+0000 7f6f38a00700 1 --2- 172.21.15.142:0/3199384754 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f34100c00 0x7f6f34101020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:46.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.871+0000 7f6f38a00700 1 -- 172.21.15.142:0/3199384754 >> 172.21.15.142:0/3199384754 conn(0x7f6f340fc1c0 msgr2=0x7f6f340fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:46.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.872+0000 7f6f38a00700 1 -- 172.21.15.142:0/3199384754 shutdown_connections 2024-04-20T22:04:46.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.872+0000 7f6f38a00700 1 -- 172.21.15.142:0/3199384754 wait complete. 2024-04-20T22:04:46.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.872+0000 7f6f38a00700 1 Processor -- start 2024-04-20T22:04:46.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.873+0000 7f6f38a00700 1 -- start start 2024-04-20T22:04:46.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.873+0000 7f6f38a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34100c00 0x7f6f34074c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:46.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.873+0000 7f6f38a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f34101e00 0x7f6f340732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:46.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.873+0000 7f6f38a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3419a240 con 0x7f6f34100c00 2024-04-20T22:04:46.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.873+0000 7f6f38a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3419a380 con 0x7f6f34101e00 2024-04-20T22:04:46.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.873+0000 7f6f31e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34100c00 0x7f6f34074c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:46.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.873+0000 7f6f31e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34100c00 0x7f6f34074c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48966/0 (socket says 172.21.15.142:48966) 2024-04-20T22:04:46.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.873+0000 7f6f31e00700 1 -- 172.21.15.142:0/1170496102 learned_addr learned my addr 172.21.15.142:0/1170496102 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:04:46.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.873+0000 7f6f31400700 1 --2- 172.21.15.142:0/1170496102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f34101e00 0x7f6f340732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:46.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.874+0000 7f6f31e00700 1 -- 172.21.15.142:0/1170496102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f34101e00 msgr2=0x7f6f340732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:46.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.874+0000 7f6f31e00700 1 --2- 172.21.15.142:0/1170496102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f34101e00 0x7f6f340732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:46.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.874+0000 7f6f31e00700 1 -- 172.21.15.142:0/1170496102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f200095f0 con 0x7f6f34100c00 2024-04-20T22:04:46.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.874+0000 7f6f31400700 1 --2- 172.21.15.142:0/1170496102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f34101e00 0x7f6f340732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T22:04:46.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.874+0000 7f6f31e00700 1 --2- 172.21.15.142:0/1170496102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34100c00 0x7f6f34074c30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400e8f0 tx=0x7f6f2400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:46.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.874+0000 7f6f2aa00700 1 -- 172.21.15.142:0/1170496102 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f24009790 con 0x7f6f34100c00 2024-04-20T22:04:46.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.874+0000 7f6f2aa00700 1 -- 172.21.15.142:0/1170496102 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f2400c810 con 0x7f6f34100c00 2024-04-20T22:04:46.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.874+0000 7f6f38a00700 1 -- 172.21.15.142:0/1170496102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f34073810 con 0x7f6f34100c00 2024-04-20T22:04:46.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.874+0000 7f6f2aa00700 1 -- 172.21.15.142:0/1170496102 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f24003d20 con 0x7f6f34100c00 2024-04-20T22:04:46.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.875+0000 7f6f38a00700 1 -- 172.21.15.142:0/1170496102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f34073db0 con 0x7f6f34100c00 2024-04-20T22:04:46.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.876+0000 7f6f38a00700 1 -- 172.21.15.142:0/1170496102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f34190780 con 0x7f6f34100c00 2024-04-20T22:04:46.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.877+0000 7f6f2aa00700 1 -- 172.21.15.142:0/1170496102 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f6f240041f0 con 0x7f6f34100c00 2024-04-20T22:04:46.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.878+0000 7f6f2aa00700 1 --2- 172.21.15.142:0/1170496102 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6f1806ecc0 0x7f6f18071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:46.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.878+0000 7f6f2aa00700 1 -- 172.21.15.142:0/1170496102 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6f24014070 con 0x7f6f34100c00 2024-04-20T22:04:46.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.878+0000 7f6f31400700 1 --2- 172.21.15.142:0/1170496102 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6f1806ecc0 0x7f6f18071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:46.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.879+0000 7f6f31400700 1 --2- 172.21.15.142:0/1170496102 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6f1806ecc0 0x7f6f18071180 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000b800 tx=0x7f6f20009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:46.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:46.883+0000 7f6f2aa00700 1 -- 172.21.15.142:0/1170496102 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f6f2405ba10 con 0x7f6f34100c00 2024-04-20T22:04:47.110 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:46 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:47.110 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:46 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:47.110 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:46 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:04:47.110 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:46 smithi164 ceph-mon[69784]: Health check update: Degraded data redundancy: 41/231 objects degraded (17.749%), 15 pgs degraded (PG_DEGRADED) 2024-04-20T22:04:47.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.140+0000 7f6f38a00700 1 -- 172.21.15.142:0/1170496102 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f341099d0 con 0x7f6f1806ecc0 2024-04-20T22:04:47.140 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:46 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:47.140 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:46 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:47.140 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:46 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:04:47.140 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:46 smithi142 ceph-mon[79401]: Health check update: Degraded data redundancy: 41/231 objects degraded (17.749%), 15 pgs degraded (PG_DEGRADED) 2024-04-20T22:04:47.141 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.141+0000 7f6f2aa00700 1 -- 172.21.15.142:0/1170496102 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f6f341099d0 con 0x7f6f1806ecc0 2024-04-20T22:04:47.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.144+0000 7f6f38a00700 1 -- 172.21.15.142:0/1170496102 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6f1806ecc0 msgr2=0x7f6f18071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:47.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.144+0000 7f6f38a00700 1 --2- 172.21.15.142:0/1170496102 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6f1806ecc0 0x7f6f18071180 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000b800 tx=0x7f6f20009f70 comp rx=0 tx=0).stop 2024-04-20T22:04:47.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.144+0000 7f6f38a00700 1 -- 172.21.15.142:0/1170496102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34100c00 msgr2=0x7f6f34074c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:47.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.144+0000 7f6f38a00700 1 --2- 172.21.15.142:0/1170496102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34100c00 0x7f6f34074c30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400e8f0 tx=0x7f6f2400ec00 comp rx=0 tx=0).stop 2024-04-20T22:04:47.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.145+0000 7f6f38a00700 1 -- 172.21.15.142:0/1170496102 shutdown_connections 2024-04-20T22:04:47.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.145+0000 7f6f38a00700 1 --2- 172.21.15.142:0/1170496102 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6f1806ecc0 0x7f6f18071180 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:47.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.145+0000 7f6f38a00700 1 --2- 172.21.15.142:0/1170496102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34100c00 0x7f6f34074c30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:47.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.145+0000 7f6f38a00700 1 --2- 172.21.15.142:0/1170496102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f34101e00 0x7f6f340732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:47.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.145+0000 7f6f38a00700 1 -- 172.21.15.142:0/1170496102 >> 172.21.15.142:0/1170496102 conn(0x7f6f340fc1c0 msgr2=0x7f6f34105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:47.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.145+0000 7f6f38a00700 1 -- 172.21.15.142:0/1170496102 shutdown_connections 2024-04-20T22:04:47.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.145+0000 7f6f38a00700 1 -- 172.21.15.142:0/1170496102 wait complete. 2024-04-20T22:04:47.160 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T22:04:47.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.302+0000 7f869e800700 1 -- 172.21.15.142:0/706004950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8698108430 msgr2=0x7f86981088b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:47.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.302+0000 7f869e800700 1 --2- 172.21.15.142:0/706004950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8698108430 0x7f86981088b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8684009910 tx=0x7f8684009c20 comp rx=0 tx=0).stop 2024-04-20T22:04:47.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.302+0000 7f869e800700 1 -- 172.21.15.142:0/706004950 shutdown_connections 2024-04-20T22:04:47.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.302+0000 7f869e800700 1 --2- 172.21.15.142:0/706004950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8698108430 0x7f86981088b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:47.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.302+0000 7f869e800700 1 --2- 172.21.15.142:0/706004950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8698107260 0x7f8698107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:47.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.302+0000 7f869e800700 1 -- 172.21.15.142:0/706004950 >> 172.21.15.142:0/706004950 conn(0x7f8698076400 msgr2=0x7f8698078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:47.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.302+0000 7f869e800700 1 -- 172.21.15.142:0/706004950 shutdown_connections 2024-04-20T22:04:47.302 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.302+0000 7f869e800700 1 -- 172.21.15.142:0/706004950 wait complete. 2024-04-20T22:04:47.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.303+0000 7f869e800700 1 Processor -- start 2024-04-20T22:04:47.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.303+0000 7f869e800700 1 -- start start 2024-04-20T22:04:47.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.304+0000 7f869e800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8698107260 0x7f869819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:47.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.304+0000 7f869e800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8698108430 0x7f869819d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:47.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.304+0000 7f869e800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869819d730 con 0x7f8698107260 2024-04-20T22:04:47.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.304+0000 7f869e800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869819d870 con 0x7f8698108430 2024-04-20T22:04:47.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.304+0000 7f8697400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8698107260 0x7f869819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:47.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.304+0000 7f8697400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8698107260 0x7f869819cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48988/0 (socket says 172.21.15.142:48988) 2024-04-20T22:04:47.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.304+0000 7f8697400700 1 -- 172.21.15.142:0/4161848476 learned_addr learned my addr 172.21.15.142:0/4161848476 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:04:47.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.304+0000 7f8696a00700 1 --2- 172.21.15.142:0/4161848476 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8698108430 0x7f869819d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:47.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.305+0000 7f8697400700 1 -- 172.21.15.142:0/4161848476 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8698108430 msgr2=0x7f869819d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:47.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.305+0000 7f8697400700 1 --2- 172.21.15.142:0/4161848476 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8698108430 0x7f869819d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:47.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.305+0000 7f8697400700 1 -- 172.21.15.142:0/4161848476 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86840095f0 con 0x7f8698107260 2024-04-20T22:04:47.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.305+0000 7f8697400700 1 --2- 172.21.15.142:0/4161848476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8698107260 0x7f869819cbd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f868800d8d0 tx=0x7f868800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:47.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.305+0000 7f868fe00700 1 -- 172.21.15.142:0/4161848476 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86880098a0 con 0x7f8698107260 2024-04-20T22:04:47.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.305+0000 7f868fe00700 1 -- 172.21.15.142:0/4161848476 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8688010460 con 0x7f8698107260 2024-04-20T22:04:47.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.305+0000 7f869e800700 1 -- 172.21.15.142:0/4161848476 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86981a22d0 con 0x7f8698107260 2024-04-20T22:04:47.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.305+0000 7f868fe00700 1 -- 172.21.15.142:0/4161848476 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f868800f5f0 con 0x7f8698107260 2024-04-20T22:04:47.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.305+0000 7f869e800700 1 -- 172.21.15.142:0/4161848476 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86981a28a0 con 0x7f8698107260 2024-04-20T22:04:47.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.306+0000 7f869e800700 1 -- 172.21.15.142:0/4161848476 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8698196dd0 con 0x7f8698107260 2024-04-20T22:04:47.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.308+0000 7f868fe00700 1 -- 172.21.15.142:0/4161848476 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f8688009a00 con 0x7f8698107260 2024-04-20T22:04:47.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.308+0000 7f868fe00700 1 --2- 172.21.15.142:0/4161848476 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f867c06ecd0 0x7f867c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:47.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.309+0000 7f868fe00700 1 -- 172.21.15.142:0/4161848476 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f868808ecd0 con 0x7f8698107260 2024-04-20T22:04:47.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.309+0000 7f8696a00700 1 --2- 172.21.15.142:0/4161848476 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f867c06ecd0 0x7f867c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:47.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.310+0000 7f8696a00700 1 --2- 172.21.15.142:0/4161848476 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f867c06ecd0 0x7f867c071190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8684006010 tx=0x7f8684005180 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:47.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.314+0000 7f868fe00700 1 -- 172.21.15.142:0/4161848476 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f868805b610 con 0x7f8698107260 2024-04-20T22:04:47.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.566+0000 7f869e800700 1 -- 172.21.15.142:0/4161848476 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f869802ce80 con 0x7f867c06ecd0 2024-04-20T22:04:47.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.568+0000 7f868fe00700 1 -- 172.21.15.142:0/4161848476 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f869802ce80 con 0x7f867c06ecd0 2024-04-20T22:04:47.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.571+0000 7f869e800700 1 -- 172.21.15.142:0/4161848476 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f867c06ecd0 msgr2=0x7f867c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:47.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.571+0000 7f869e800700 1 --2- 172.21.15.142:0/4161848476 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f867c06ecd0 0x7f867c071190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8684006010 tx=0x7f8684005180 comp rx=0 tx=0).stop 2024-04-20T22:04:47.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.571+0000 7f869e800700 1 -- 172.21.15.142:0/4161848476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8698107260 msgr2=0x7f869819cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:47.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.571+0000 7f869e800700 1 --2- 172.21.15.142:0/4161848476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8698107260 0x7f869819cbd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f868800d8d0 tx=0x7f868800dbe0 comp rx=0 tx=0).stop 2024-04-20T22:04:47.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.572+0000 7f869e800700 1 -- 172.21.15.142:0/4161848476 shutdown_connections 2024-04-20T22:04:47.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.572+0000 7f869e800700 1 --2- 172.21.15.142:0/4161848476 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f867c06ecd0 0x7f867c071190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:47.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.572+0000 7f869e800700 1 --2- 172.21.15.142:0/4161848476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8698107260 0x7f869819cbd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:47.572 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.572+0000 7f869e800700 1 --2- 172.21.15.142:0/4161848476 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8698108430 0x7f869819d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:47.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.572+0000 7f869e800700 1 -- 172.21.15.142:0/4161848476 >> 172.21.15.142:0/4161848476 conn(0x7f8698076400 msgr2=0x7f869810b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:47.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.572+0000 7f869e800700 1 -- 172.21.15.142:0/4161848476 shutdown_connections 2024-04-20T22:04:47.573 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.572+0000 7f869e800700 1 -- 172.21.15.142:0/4161848476 wait complete. 2024-04-20T22:04:47.732 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.732+0000 7fc8b7a00700 1 -- 172.21.15.142:0/2110011484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8b0104050 msgr2=0x7fc8b0106440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.732+0000 7fc8b7a00700 1 --2- 172.21.15.142:0/2110011484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8b0104050 0x7fc8b0106440 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc898009910 tx=0x7fc898009c20 comp rx=0 tx=0).stop 2024-04-20T22:04:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.732+0000 7fc8b7a00700 1 -- 172.21.15.142:0/2110011484 shutdown_connections 2024-04-20T22:04:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.732+0000 7fc8b7a00700 1 --2- 172.21.15.142:0/2110011484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8b0104050 0x7fc8b0106440 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.732+0000 7fc8b7a00700 1 --2- 172.21.15.142:0/2110011484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b0101720 0x7fc8b0103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.732+0000 7fc8b7a00700 1 -- 172.21.15.142:0/2110011484 >> 172.21.15.142:0/2110011484 conn(0x7fc8b00fb0d0 msgr2=0x7fc8b00fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.733+0000 7fc8b7a00700 1 -- 172.21.15.142:0/2110011484 shutdown_connections 2024-04-20T22:04:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.733+0000 7fc8b7a00700 1 -- 172.21.15.142:0/2110011484 wait complete. 2024-04-20T22:04:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.734+0000 7fc8b7a00700 1 Processor -- start 2024-04-20T22:04:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.734+0000 7fc8b7a00700 1 -- start start 2024-04-20T22:04:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.734+0000 7fc8b7a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b0101720 0x7fc8b0198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.734+0000 7fc8b7a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8b0104050 0x7fc8b0198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.734+0000 7fc8b7a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b0199380 con 0x7fc8b0104050 2024-04-20T22:04:47.734 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.734+0000 7fc8b7a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b01994c0 con 0x7fc8b0101720 2024-04-20T22:04:47.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.735+0000 7fc8a7e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8b0104050 0x7fc8b0198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.735+0000 7fc8b5000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b0101720 0x7fc8b0198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.735+0000 7fc8a7e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8b0104050 0x7fc8b0198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49008/0 (socket says 172.21.15.142:49008) 2024-04-20T22:04:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.735+0000 7fc8b5000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b0101720 0x7fc8b0198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:56056/0 (socket says 172.21.15.142:56056) 2024-04-20T22:04:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.735+0000 7fc8a7e00700 1 -- 172.21.15.142:0/4158009880 learned_addr learned my addr 172.21.15.142:0/4158009880 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:04:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.735+0000 7fc8a7e00700 1 -- 172.21.15.142:0/4158009880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b0101720 msgr2=0x7fc8b0198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.735+0000 7fc8a7e00700 1 --2- 172.21.15.142:0/4158009880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b0101720 0x7fc8b0198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.735+0000 7fc8a7e00700 1 -- 172.21.15.142:0/4158009880 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8980095f0 con 0x7fc8b0104050 2024-04-20T22:04:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.735+0000 7fc8a7e00700 1 --2- 172.21.15.142:0/4158009880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8b0104050 0x7fc8b0198d60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc89800b650 tx=0x7fc898005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.736+0000 7fc8ae000700 1 -- 172.21.15.142:0/4158009880 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc89801d070 con 0x7fc8b0104050 2024-04-20T22:04:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.736+0000 7fc8ae000700 1 -- 172.21.15.142:0/4158009880 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8980052a0 con 0x7fc8b0104050 2024-04-20T22:04:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.736+0000 7fc8ae000700 1 -- 172.21.15.142:0/4158009880 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc898017400 con 0x7fc8b0104050 2024-04-20T22:04:47.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.736+0000 7fc8b7a00700 1 -- 172.21.15.142:0/4158009880 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b019de70 con 0x7fc8b0104050 2024-04-20T22:04:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.736+0000 7fc8b7a00700 1 -- 172.21.15.142:0/4158009880 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b019e3b0 con 0x7fc8b0104050 2024-04-20T22:04:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.737+0000 7fc8b7a00700 1 -- 172.21.15.142:0/4158009880 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b0062510 con 0x7fc8b0104050 2024-04-20T22:04:47.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.738+0000 7fc8ae000700 1 -- 172.21.15.142:0/4158009880 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fc898003810 con 0x7fc8b0104050 2024-04-20T22:04:47.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.739+0000 7fc8ae000700 1 --2- 172.21.15.142:0/4158009880 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc89406ecc0 0x7fc894071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:47.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.739+0000 7fc8ae000700 1 -- 172.21.15.142:0/4158009880 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc8980900c0 con 0x7fc8b0104050 2024-04-20T22:04:47.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.739+0000 7fc8b5000700 1 --2- 172.21.15.142:0/4158009880 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc89406ecc0 0x7fc894071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:47.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.740+0000 7fc8b5000700 1 --2- 172.21.15.142:0/4158009880 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc89406ecc0 0x7fc894071180 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0009c60 tx=0x7fc8a0009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:47.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.744+0000 7fc8ae000700 1 -- 172.21.15.142:0/4158009880 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fc89805ca80 con 0x7fc8b0104050 2024-04-20T22:04:47.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:47 smithi142 ceph-mon[79401]: pgmap v161: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:04:47.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:47 smithi142 ceph-mon[79401]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:04:47.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:47.980+0000 7fc8b7a00700 1 -- 172.21.15.142:0/4158009880 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8b00ffe60 con 0x7fc89406ecc0 2024-04-20T22:04:48.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.011+0000 7fc8ae000700 1 -- 172.21.15.142:0/4158009880 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fc8b00ffe60 con 0x7fc89406ecc0 2024-04-20T22:04:48.011 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:04:48.012 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (15m) 68s ago 17m 13.7M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T22:04:48.012 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (17m) 68s ago 17m 8682k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T22:04:48.012 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (16m) 41s ago 16m 7948k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T22:04:48.012 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (2m) 68s ago 17m 6665k - 19.0.0-3133-ga8c84f59 76bc6b91b726 64521ed7125b 2024-04-20T22:04:48.012 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (2m) 41s ago 16m 6656k - 19.0.0-3133-ga8c84f59 76bc6b91b726 893c6f16ee6d 2024-04-20T22:04:48.012 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (15m) 68s ago 17m 76.6M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T22:04:48.012 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (10m) 68s ago 10m 140M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 b68e279d7945 2024-04-20T22:04:48.012 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (10m) 68s ago 10m 16.4M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T22:04:48.012 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (10m) 41s ago 10m 16.6M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T22:04:48.012 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (10m) 41s ago 10m 16.9M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T22:04:48.012 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (6m) 68s ago 19m 505M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:04:48.012 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (5m) 41s ago 16m 452M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:04:48.012 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (4m) 68s ago 19m 47.0M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 af10a542c918 2024-04-20T22:04:48.012 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (4m) 41s ago 15m 34.9M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 133512694d46 2024-04-20T22:04:48.013 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (17m) 68s ago 17m 7894k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T22:04:48.013 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (16m) 41s ago 16m 7884k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T22:04:48.013 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (2m) 68s ago 15m 95.7M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 b7206d05a7cd 2024-04-20T22:04:48.013 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (107s) 68s ago 14m 91.8M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 82bcc0c46762 2024-04-20T22:04:48.013 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (76s) 68s ago 13m 12.6M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 3e2d91f49494 2024-04-20T22:04:48.013 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (46s) 41s ago 13m 11.1M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 a898b8b77c51 2024-04-20T22:04:48.013 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 starting - - - 2240M 2024-04-20T22:04:48.013 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (11m) 41s ago 11m 225M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4f36124aeb0d 2024-04-20T22:04:48.013 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (5m) 68s ago 16m 73.0M - 2.43.0 a07b618ecd1d 46b76c20eae5 2024-04-20T22:04:48.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.014+0000 7fc8b7a00700 1 -- 172.21.15.142:0/4158009880 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc89406ecc0 msgr2=0x7fc894071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:48.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.014+0000 7fc8b7a00700 1 --2- 172.21.15.142:0/4158009880 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc89406ecc0 0x7fc894071180 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0009c60 tx=0x7fc8a0009260 comp rx=0 tx=0).stop 2024-04-20T22:04:48.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.014+0000 7fc8b7a00700 1 -- 172.21.15.142:0/4158009880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8b0104050 msgr2=0x7fc8b0198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:48.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.014+0000 7fc8b7a00700 1 --2- 172.21.15.142:0/4158009880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8b0104050 0x7fc8b0198d60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc89800b650 tx=0x7fc898005f00 comp rx=0 tx=0).stop 2024-04-20T22:04:48.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.014+0000 7fc8b7a00700 1 -- 172.21.15.142:0/4158009880 shutdown_connections 2024-04-20T22:04:48.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.014+0000 7fc8b7a00700 1 --2- 172.21.15.142:0/4158009880 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc89406ecc0 0x7fc894071180 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:48.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.014+0000 7fc8b7a00700 1 --2- 172.21.15.142:0/4158009880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b0101720 0x7fc8b0198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:48.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.014+0000 7fc8b7a00700 1 --2- 172.21.15.142:0/4158009880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc8b0104050 0x7fc8b0198d60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:48.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.014+0000 7fc8b7a00700 1 -- 172.21.15.142:0/4158009880 >> 172.21.15.142:0/4158009880 conn(0x7fc8b00fb0d0 msgr2=0x7fc8b00ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:48.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.014+0000 7fc8b7a00700 1 -- 172.21.15.142:0/4158009880 shutdown_connections 2024-04-20T22:04:48.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.015+0000 7fc8b7a00700 1 -- 172.21.15.142:0/4158009880 wait complete. 2024-04-20T22:04:48.162 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:47 smithi164 ceph-mon[69784]: pgmap v161: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:04:48.163 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:47 smithi164 ceph-mon[69784]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:04:48.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.169+0000 7f8994c00700 1 -- 172.21.15.142:0/4125750087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89901016e0 msgr2=0x7f8990103ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:48.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.169+0000 7f8994c00700 1 --2- 172.21.15.142:0/4125750087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89901016e0 0x7f8990103ad0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8980009910 tx=0x7f8980009c20 comp rx=0 tx=0).stop 2024-04-20T22:04:48.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.169+0000 7f8994c00700 1 -- 172.21.15.142:0/4125750087 shutdown_connections 2024-04-20T22:04:48.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.169+0000 7f8994c00700 1 --2- 172.21.15.142:0/4125750087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8990104010 0x7f8990106400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:48.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.169+0000 7f8994c00700 1 --2- 172.21.15.142:0/4125750087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89901016e0 0x7f8990103ad0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:48.169 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.169+0000 7f8994c00700 1 -- 172.21.15.142:0/4125750087 >> 172.21.15.142:0/4125750087 conn(0x7f89900fb0d0 msgr2=0x7f89900fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:48.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.169+0000 7f8994c00700 1 -- 172.21.15.142:0/4125750087 shutdown_connections 2024-04-20T22:04:48.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.169+0000 7f8994c00700 1 -- 172.21.15.142:0/4125750087 wait complete. 2024-04-20T22:04:48.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.170+0000 7f8994c00700 1 Processor -- start 2024-04-20T22:04:48.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.171+0000 7f8994c00700 1 -- start start 2024-04-20T22:04:48.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.171+0000 7f8994c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89901016e0 0x7f8990198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:48.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.171+0000 7f8994c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8990104010 0x7f8990198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:48.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.171+0000 7f8994c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8990199350 con 0x7f89901016e0 2024-04-20T22:04:48.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.171+0000 7f8994c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8990199490 con 0x7f8990104010 2024-04-20T22:04:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.171+0000 7f898de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89901016e0 0x7f8990198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.171+0000 7f898de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89901016e0 0x7f8990198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49020/0 (socket says 172.21.15.142:49020) 2024-04-20T22:04:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.171+0000 7f898de00700 1 -- 172.21.15.142:0/3782577869 learned_addr learned my addr 172.21.15.142:0/3782577869 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:04:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.172+0000 7f898d400700 1 --2- 172.21.15.142:0/3782577869 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8990104010 0x7f8990198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.172+0000 7f898de00700 1 -- 172.21.15.142:0/3782577869 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8990104010 msgr2=0x7f8990198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.172+0000 7f898de00700 1 --2- 172.21.15.142:0/3782577869 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8990104010 0x7f8990198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.172+0000 7f898de00700 1 -- 172.21.15.142:0/3782577869 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89800095f0 con 0x7f89901016e0 2024-04-20T22:04:48.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.172+0000 7f898de00700 1 --2- 172.21.15.142:0/3782577869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89901016e0 0x7f8990198880 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f898000bd70 tx=0x7f898000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:48.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.173+0000 7f8986a00700 1 -- 172.21.15.142:0/3782577869 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f898001d070 con 0x7f89901016e0 2024-04-20T22:04:48.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.173+0000 7f8986a00700 1 -- 172.21.15.142:0/3782577869 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f898000f460 con 0x7f89901016e0 2024-04-20T22:04:48.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.173+0000 7f8994c00700 1 -- 172.21.15.142:0/3782577869 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899019de00 con 0x7f89901016e0 2024-04-20T22:04:48.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.173+0000 7f8986a00700 1 -- 172.21.15.142:0/3782577869 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8980021620 con 0x7f89901016e0 2024-04-20T22:04:48.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.173+0000 7f8994c00700 1 -- 172.21.15.142:0/3782577869 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899019e2e0 con 0x7f89901016e0 2024-04-20T22:04:48.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.174+0000 7f8994c00700 1 -- 172.21.15.142:0/3782577869 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8990062510 con 0x7f89901016e0 2024-04-20T22:04:48.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.175+0000 7f8986a00700 1 -- 172.21.15.142:0/3782577869 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f898000fa70 con 0x7f89901016e0 2024-04-20T22:04:48.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.176+0000 7f8986a00700 1 --2- 172.21.15.142:0/3782577869 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f897406ecc0 0x7f8974071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:48.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.176+0000 7f8986a00700 1 -- 172.21.15.142:0/3782577869 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f89800901b0 con 0x7f89901016e0 2024-04-20T22:04:48.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.177+0000 7f898d400700 1 --2- 172.21.15.142:0/3782577869 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f897406ecc0 0x7f8974071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:48.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.177+0000 7f898d400700 1 --2- 172.21.15.142:0/3782577869 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f897406ecc0 0x7f8974071180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f897c005ea0 tx=0x7f897c005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:48.181 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.181+0000 7f8986a00700 1 -- 172.21.15.142:0/3782577869 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f898005caf0 con 0x7f89901016e0 2024-04-20T22:04:48.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.502+0000 7f8994c00700 1 -- 172.21.15.142:0/3782577869 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f89901099f0 con 0x7f89901016e0 2024-04-20T22:04:48.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.504+0000 7f8986a00700 1 -- 172.21.15.142:0/3782577869 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+836 (secure 0 0 0) 0x7f898005c680 con 0x7f89901016e0 2024-04-20T22:04:48.504 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:04:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:04:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:04:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:04:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:04:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:04:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:04:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:04:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 1, 2024-04-20T22:04:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 4 2024-04-20T22:04:48.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:04:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:04:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4 2024-04-20T22:04:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:04:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:04:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 5, 2024-04-20T22:04:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 8 2024-04-20T22:04:48.505 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:04:48.505 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:04:48.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.506+0000 7f8994c00700 1 -- 172.21.15.142:0/3782577869 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f897406ecc0 msgr2=0x7f8974071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:48.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.506+0000 7f8994c00700 1 --2- 172.21.15.142:0/3782577869 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f897406ecc0 0x7f8974071180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f897c005ea0 tx=0x7f897c005e30 comp rx=0 tx=0).stop 2024-04-20T22:04:48.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.506+0000 7f8994c00700 1 -- 172.21.15.142:0/3782577869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89901016e0 msgr2=0x7f8990198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:48.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.506+0000 7f8994c00700 1 --2- 172.21.15.142:0/3782577869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89901016e0 0x7f8990198880 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f898000bd70 tx=0x7f898000be50 comp rx=0 tx=0).stop 2024-04-20T22:04:48.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.507+0000 7f8994c00700 1 -- 172.21.15.142:0/3782577869 shutdown_connections 2024-04-20T22:04:48.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.507+0000 7f8994c00700 1 --2- 172.21.15.142:0/3782577869 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f897406ecc0 0x7f8974071180 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:48.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.507+0000 7f8994c00700 1 --2- 172.21.15.142:0/3782577869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89901016e0 0x7f8990198880 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:48.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.507+0000 7f8994c00700 1 --2- 172.21.15.142:0/3782577869 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8990104010 0x7f8990198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:48.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.507+0000 7f8994c00700 1 -- 172.21.15.142:0/3782577869 >> 172.21.15.142:0/3782577869 conn(0x7f89900fb0d0 msgr2=0x7f89900ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:48.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.507+0000 7f8994c00700 1 -- 172.21.15.142:0/3782577869 shutdown_connections 2024-04-20T22:04:48.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.507+0000 7f8994c00700 1 -- 172.21.15.142:0/3782577869 wait complete. 2024-04-20T22:04:48.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.670+0000 7f7182000700 1 -- 172.21.15.142:0/3792886481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f717c074f10 msgr2=0x7f717c073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:48.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.670+0000 7f7182000700 1 --2- 172.21.15.142:0/3792886481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f717c074f10 0x7f717c073370 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f716c00b0a0 tx=0x7f716c00b3b0 comp rx=0 tx=0).stop 2024-04-20T22:04:48.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.670+0000 7f7182000700 1 -- 172.21.15.142:0/3792886481 shutdown_connections 2024-04-20T22:04:48.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.670+0000 7f7182000700 1 --2- 172.21.15.142:0/3792886481 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f717c073940 0x7f717c073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:48.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.670+0000 7f7182000700 1 --2- 172.21.15.142:0/3792886481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f717c074f10 0x7f717c073370 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:48.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.670+0000 7f7182000700 1 -- 172.21.15.142:0/3792886481 >> 172.21.15.142:0/3792886481 conn(0x7f717c0fc1c0 msgr2=0x7f717c0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:48.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.670+0000 7f7182000700 1 -- 172.21.15.142:0/3792886481 shutdown_connections 2024-04-20T22:04:48.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.671+0000 7f7182000700 1 -- 172.21.15.142:0/3792886481 wait complete. 2024-04-20T22:04:48.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.671+0000 7f7182000700 1 Processor -- start 2024-04-20T22:04:48.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.672+0000 7f7182000700 1 -- start start 2024-04-20T22:04:48.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.672+0000 7f7182000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f717c073940 0x7f717c198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:48.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.672+0000 7f7182000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f717c074f10 0x7f717c198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:48.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.672+0000 7f7182000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c199340 con 0x7f717c074f10 2024-04-20T22:04:48.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.672+0000 7f7182000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c199480 con 0x7f717c073940 2024-04-20T22:04:48.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.672+0000 7f7172a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f717c074f10 0x7f717c198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:48.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.672+0000 7f717b400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f717c073940 0x7f717c198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:48.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.672+0000 7f7172a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f717c074f10 0x7f717c198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49034/0 (socket says 172.21.15.142:49034) 2024-04-20T22:04:48.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.672+0000 7f7172a00700 1 -- 172.21.15.142:0/4276840047 learned_addr learned my addr 172.21.15.142:0/4276840047 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:04:48.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.673+0000 7f7172a00700 1 -- 172.21.15.142:0/4276840047 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f717c073940 msgr2=0x7f717c198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:48.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.673+0000 7f7172a00700 1 --2- 172.21.15.142:0/4276840047 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f717c073940 0x7f717c198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:48.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.673+0000 7f7172a00700 1 -- 172.21.15.142:0/4276840047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c009d00 con 0x7f717c074f10 2024-04-20T22:04:48.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.673+0000 7f7172a00700 1 --2- 172.21.15.142:0/4276840047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f717c074f10 0x7f717c198db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f716400c910 tx=0x7f716400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:48.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.674+0000 7f7178c00700 1 -- 172.21.15.142:0/4276840047 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71640041f0 con 0x7f717c074f10 2024-04-20T22:04:48.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.674+0000 7f7178c00700 1 -- 172.21.15.142:0/4276840047 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f716400ce60 con 0x7f717c074f10 2024-04-20T22:04:48.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.674+0000 7f7182000700 1 -- 172.21.15.142:0/4276840047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717c19dea0 con 0x7f717c074f10 2024-04-20T22:04:48.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.674+0000 7f7178c00700 1 -- 172.21.15.142:0/4276840047 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7164003d90 con 0x7f717c074f10 2024-04-20T22:04:48.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.674+0000 7f7182000700 1 -- 172.21.15.142:0/4276840047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717c19e440 con 0x7f717c074f10 2024-04-20T22:04:48.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.675+0000 7f7182000700 1 -- 172.21.15.142:0/4276840047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f717c192990 con 0x7f717c074f10 2024-04-20T22:04:48.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.676+0000 7f7178c00700 1 -- 172.21.15.142:0/4276840047 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f7164007900 con 0x7f717c074f10 2024-04-20T22:04:48.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.677+0000 7f7178c00700 1 --2- 172.21.15.142:0/4276840047 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f716006ecc0 0x7f7160071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:48.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.677+0000 7f7178c00700 1 -- 172.21.15.142:0/4276840047 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f716408eeb0 con 0x7f717c074f10 2024-04-20T22:04:48.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.677+0000 7f717b400700 1 --2- 172.21.15.142:0/4276840047 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f716006ecc0 0x7f7160071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:48.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.678+0000 7f717b400700 1 --2- 172.21.15.142:0/4276840047 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f716006ecc0 0x7f7160071180 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f716c009fd0 tx=0x7f716c006000 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.681+0000 7f7178c00700 1 -- 172.21.15.142:0/4276840047 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f716405b910 con 0x7f717c074f10 2024-04-20T22:04:48.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.951+0000 7f7182000700 1 -- 172.21.15.142:0/4276840047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f717c062560 con 0x7f717c074f10 2024-04-20T22:04:48.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.952+0000 7f7178c00700 1 -- 172.21.15.142:0/4276840047 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1898 (secure 0 0 0) 0x7f716401d780 con 0x7f717c074f10 2024-04-20T22:04:48.953 INFO:teuthology.orchestra.run.smithi142.stdout:e12 2024-04-20T22:04:48.953 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:04:48.953 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:04:48.953 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T22:04:48.953 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:04:48.953 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T22:04:48.953 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T22:04:48.953 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 12 2024-04-20T22:04:48.953 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:04:48.953 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:04:48.953 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:51.692699+0000 2024-04-20T22:04:48.953 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T22:04:48.953 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T22:04:48.954 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T22:04:48.954 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T22:04:48.954 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T22:04:48.954 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T22:04:48.954 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T22:04:48.954 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T22:04:48.954 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T22:04:48.954 INFO:teuthology.orchestra.run.smithi142.stdout:snap_rstat 1 2024-04-20T22:04:48.954 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:04:48.954 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T22:04:48.954 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T22:04:48.954 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T22:04:48.954 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T22:04:48.954 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T22:04:48.955 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T22:04:48.955 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T22:04:48.955 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T22:04:48.955 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T22:04:48.955 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T22:04:48.955 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T22:04:48.955 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T22:04:48.955 INFO:teuthology.orchestra.run.smithi142.stdout:qdb_cluster leader: 0 members: 2024-04-20T22:04:48.955 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:04:48.955 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:04:48.955 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:04:48.955 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T22:04:48.955 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:04:48.955 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:04:48.955 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:04:48.956 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:04:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.955+0000 7f7182000700 1 -- 172.21.15.142:0/4276840047 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f716006ecc0 msgr2=0x7f7160071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:48.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.955+0000 7f7182000700 1 --2- 172.21.15.142:0/4276840047 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f716006ecc0 0x7f7160071180 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f716c009fd0 tx=0x7f716c006000 comp rx=0 tx=0).stop 2024-04-20T22:04:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.955+0000 7f7182000700 1 -- 172.21.15.142:0/4276840047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f717c074f10 msgr2=0x7f717c198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.955+0000 7f7182000700 1 --2- 172.21.15.142:0/4276840047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f717c074f10 0x7f717c198db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f716400c910 tx=0x7f716400cc20 comp rx=0 tx=0).stop 2024-04-20T22:04:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.956+0000 7f7182000700 1 -- 172.21.15.142:0/4276840047 shutdown_connections 2024-04-20T22:04:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.956+0000 7f7182000700 1 --2- 172.21.15.142:0/4276840047 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f716006ecc0 0x7f7160071180 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.956+0000 7f7182000700 1 --2- 172.21.15.142:0/4276840047 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f717c073940 0x7f717c198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.956+0000 7f7182000700 1 --2- 172.21.15.142:0/4276840047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f717c074f10 0x7f717c198db0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.956+0000 7f7182000700 1 -- 172.21.15.142:0/4276840047 >> 172.21.15.142:0/4276840047 conn(0x7f717c0fc1c0 msgr2=0x7f717c106e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.956+0000 7f7182000700 1 -- 172.21.15.142:0/4276840047 shutdown_connections 2024-04-20T22:04:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:48.956+0000 7f7182000700 1 -- 172.21.15.142:0/4276840047 wait complete. 2024-04-20T22:04:48.958 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T22:04:49.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.103+0000 7f5609600700 1 -- 172.21.15.142:0/2060255075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5604101680 msgr2=0x7f5604103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:49.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.103+0000 7f5609600700 1 --2- 172.21.15.142:0/2060255075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5604101680 0x7f5604103a70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f55f4009910 tx=0x7f55f4009c20 comp rx=0 tx=0).stop 2024-04-20T22:04:49.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.103+0000 7f5609600700 1 -- 172.21.15.142:0/2060255075 shutdown_connections 2024-04-20T22:04:49.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.103+0000 7f5609600700 1 --2- 172.21.15.142:0/2060255075 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5604103fb0 0x7f56041063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:49.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.103+0000 7f5609600700 1 --2- 172.21.15.142:0/2060255075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5604101680 0x7f5604103a70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:49.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.103+0000 7f5609600700 1 -- 172.21.15.142:0/2060255075 >> 172.21.15.142:0/2060255075 conn(0x7f56040fb0d0 msgr2=0x7f56040fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:49.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.103+0000 7f5609600700 1 -- 172.21.15.142:0/2060255075 shutdown_connections 2024-04-20T22:04:49.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.103+0000 7f5609600700 1 -- 172.21.15.142:0/2060255075 wait complete. 2024-04-20T22:04:49.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:48 smithi142 ceph-mon[79401]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:04:49.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:48 smithi142 ceph-mon[79401]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:04:49.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:48 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3782577869' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:04:49.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.104+0000 7f5609600700 1 Processor -- start 2024-04-20T22:04:49.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.104+0000 7f5609600700 1 -- start start 2024-04-20T22:04:49.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.105+0000 7f5609600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5604101680 0x7f56041987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:49.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.105+0000 7f5609600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5604103fb0 0x7f5604198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:49.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.105+0000 7f5609600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5604199300 con 0x7f5604101680 2024-04-20T22:04:49.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.105+0000 7f5609600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5604199440 con 0x7f5604103fb0 2024-04-20T22:04:49.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.105+0000 7f5602a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5604101680 0x7f56041987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:49.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.105+0000 7f5602a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5604101680 0x7f56041987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49046/0 (socket says 172.21.15.142:49046) 2024-04-20T22:04:49.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.105+0000 7f5602a00700 1 -- 172.21.15.142:0/3183668951 learned_addr learned my addr 172.21.15.142:0/3183668951 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:04:49.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.105+0000 7f55fa000700 1 --2- 172.21.15.142:0/3183668951 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5604103fb0 0x7f5604198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:49.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.105+0000 7f5602a00700 1 -- 172.21.15.142:0/3183668951 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5604103fb0 msgr2=0x7f5604198ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:49.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.105+0000 7f5602a00700 1 --2- 172.21.15.142:0/3183668951 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5604103fb0 0x7f5604198ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:49.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.105+0000 7f5602a00700 1 -- 172.21.15.142:0/3183668951 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f40095f0 con 0x7f5604101680 2024-04-20T22:04:49.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.106+0000 7f5602a00700 1 --2- 172.21.15.142:0/3183668951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5604101680 0x7f56041987a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f55f40092e0 tx=0x7f55f400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:49.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.106+0000 7f55fbe00700 1 -- 172.21.15.142:0/3183668951 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55f401d070 con 0x7f5604101680 2024-04-20T22:04:49.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.106+0000 7f55fbe00700 1 -- 172.21.15.142:0/3183668951 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f55f400f460 con 0x7f5604101680 2024-04-20T22:04:49.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.106+0000 7f5609600700 1 -- 172.21.15.142:0/3183668951 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560419de40 con 0x7f5604101680 2024-04-20T22:04:49.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.106+0000 7f55fbe00700 1 -- 172.21.15.142:0/3183668951 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55f4021640 con 0x7f5604101680 2024-04-20T22:04:49.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.106+0000 7f5609600700 1 -- 172.21.15.142:0/3183668951 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560419e330 con 0x7f5604101680 2024-04-20T22:04:49.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.107+0000 7f5609600700 1 -- 172.21.15.142:0/3183668951 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56040fcc50 con 0x7f5604101680 2024-04-20T22:04:49.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.110+0000 7f55fbe00700 1 -- 172.21.15.142:0/3183668951 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f55f400fad0 con 0x7f5604101680 2024-04-20T22:04:49.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.111+0000 7f55fbe00700 1 --2- 172.21.15.142:0/3183668951 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f55e806ecc0 0x7f55e8071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:49.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.111+0000 7f55fbe00700 1 -- 172.21.15.142:0/3183668951 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f55f408fed0 con 0x7f5604101680 2024-04-20T22:04:49.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.111+0000 7f55fa000700 1 --2- 172.21.15.142:0/3183668951 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f55e806ecc0 0x7f55e8071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:49.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.112+0000 7f55fa000700 1 --2- 172.21.15.142:0/3183668951 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f55e806ecc0 0x7f55e8071180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f55ec005950 tx=0x7f55ec0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:49.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.116+0000 7f55fbe00700 1 -- 172.21.15.142:0/3183668951 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f55f405c940 con 0x7f5604101680 2024-04-20T22:04:49.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:48 smithi164 ceph-mon[69784]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:04:49.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:48 smithi164 ceph-mon[69784]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:04:49.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:48 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3782577869' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:04:49.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.344+0000 7f5609600700 1 -- 172.21.15.142:0/3183668951 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f560402ce50 con 0x7f55e806ecc0 2024-04-20T22:04:49.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.346+0000 7f55fbe00700 1 -- 172.21.15.142:0/3183668951 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f560402ce50 con 0x7f55e806ecc0 2024-04-20T22:04:49.346 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:04:49.347 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T22:04:49.347 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T22:04:49.347 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T22:04:49.347 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T22:04:49.347 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr", 2024-04-20T22:04:49.347 INFO:teuthology.orchestra.run.smithi142.stdout: "mon", 2024-04-20T22:04:49.347 INFO:teuthology.orchestra.run.smithi142.stdout: "crash" 2024-04-20T22:04:49.347 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T22:04:49.347 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "10/23 daemons upgraded", 2024-04-20T22:04:49.347 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading osd daemons", 2024-04-20T22:04:49.347 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T22:04:49.347 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:04:49.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.349+0000 7f5609600700 1 -- 172.21.15.142:0/3183668951 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f55e806ecc0 msgr2=0x7f55e8071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:49.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.349+0000 7f5609600700 1 --2- 172.21.15.142:0/3183668951 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f55e806ecc0 0x7f55e8071180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f55ec005950 tx=0x7f55ec0058e0 comp rx=0 tx=0).stop 2024-04-20T22:04:49.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.349+0000 7f5609600700 1 -- 172.21.15.142:0/3183668951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5604101680 msgr2=0x7f56041987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:49.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.349+0000 7f5609600700 1 --2- 172.21.15.142:0/3183668951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5604101680 0x7f56041987a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f55f40092e0 tx=0x7f55f400be20 comp rx=0 tx=0).stop 2024-04-20T22:04:49.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.350+0000 7f5609600700 1 -- 172.21.15.142:0/3183668951 shutdown_connections 2024-04-20T22:04:49.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.350+0000 7f5609600700 1 --2- 172.21.15.142:0/3183668951 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f55e806ecc0 0x7f55e8071180 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:49.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.350+0000 7f5609600700 1 --2- 172.21.15.142:0/3183668951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5604101680 0x7f56041987a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:49.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.350+0000 7f5609600700 1 --2- 172.21.15.142:0/3183668951 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5604103fb0 0x7f5604198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:49.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.350+0000 7f5609600700 1 -- 172.21.15.142:0/3183668951 >> 172.21.15.142:0/3183668951 conn(0x7f56040fb0d0 msgr2=0x7f5604100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:49.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.350+0000 7f5609600700 1 -- 172.21.15.142:0/3183668951 shutdown_connections 2024-04-20T22:04:49.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.350+0000 7f5609600700 1 -- 172.21.15.142:0/3183668951 wait complete. 2024-04-20T22:04:49.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.506+0000 7f1a09c00700 1 -- 172.21.15.142:0/1637239273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a04101c40 msgr2=0x7f1a041020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:49.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.506+0000 7f1a09c00700 1 --2- 172.21.15.142:0/1637239273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a04101c40 0x7f1a041020a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009870 tx=0x7f19f0009b80 comp rx=0 tx=0).stop 2024-04-20T22:04:49.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.506+0000 7f1a09c00700 1 -- 172.21.15.142:0/1637239273 shutdown_connections 2024-04-20T22:04:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.506+0000 7f1a09c00700 1 --2- 172.21.15.142:0/1637239273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a04101c40 0x7f1a041020a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.506+0000 7f1a09c00700 1 --2- 172.21.15.142:0/1637239273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a04100a40 0x7f1a04100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.506+0000 7f1a09c00700 1 -- 172.21.15.142:0/1637239273 >> 172.21.15.142:0/1637239273 conn(0x7f1a040fc000 msgr2=0x7f1a040fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.506+0000 7f1a09c00700 1 -- 172.21.15.142:0/1637239273 shutdown_connections 2024-04-20T22:04:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.506+0000 7f1a09c00700 1 -- 172.21.15.142:0/1637239273 wait complete. 2024-04-20T22:04:49.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.507+0000 7f1a09c00700 1 Processor -- start 2024-04-20T22:04:49.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.507+0000 7f1a09c00700 1 -- start start 2024-04-20T22:04:49.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.508+0000 7f1a09c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a04100a40 0x7f1a04198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:49.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.508+0000 7f1a09c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a04101c40 0x7f1a04198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:49.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.508+0000 7f1a09c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a041991e0 con 0x7f1a04101c40 2024-04-20T22:04:49.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.508+0000 7f1a09c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a04199320 con 0x7f1a04100a40 2024-04-20T22:04:49.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.508+0000 7f1a03400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a04101c40 0x7f1a04198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:49.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.508+0000 7f1a03400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a04101c40 0x7f1a04198bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49052/0 (socket says 172.21.15.142:49052) 2024-04-20T22:04:49.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.508+0000 7f1a03400700 1 -- 172.21.15.142:0/2402413590 learned_addr learned my addr 172.21.15.142:0/2402413590 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:04:49.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.508+0000 7f1a03e00700 1 --2- 172.21.15.142:0/2402413590 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a04100a40 0x7f1a04198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:49.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.509+0000 7f1a03400700 1 -- 172.21.15.142:0/2402413590 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a04100a40 msgr2=0x7f1a04198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:49.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.509+0000 7f1a03400700 1 --2- 172.21.15.142:0/2402413590 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a04100a40 0x7f1a04198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:49.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.509+0000 7f1a03400700 1 -- 172.21.15.142:0/2402413590 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f0009520 con 0x7f1a04101c40 2024-04-20T22:04:49.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.509+0000 7f1a03400700 1 --2- 172.21.15.142:0/2402413590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a04101c40 0x7f1a04198bc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009230 tx=0x7f19f000f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:49.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.509+0000 7f1a00c00700 1 -- 172.21.15.142:0/2402413590 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19f001c070 con 0x7f1a04101c40 2024-04-20T22:04:49.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.509+0000 7f1a09c00700 1 -- 172.21.15.142:0/2402413590 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0419dd20 con 0x7f1a04101c40 2024-04-20T22:04:49.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.509+0000 7f1a00c00700 1 -- 172.21.15.142:0/2402413590 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f19f000b4e0 con 0x7f1a04101c40 2024-04-20T22:04:49.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.509+0000 7f1a00c00700 1 -- 172.21.15.142:0/2402413590 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19f0022de0 con 0x7f1a04101c40 2024-04-20T22:04:49.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.510+0000 7f1a09c00700 1 -- 172.21.15.142:0/2402413590 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0419e290 con 0x7f1a04101c40 2024-04-20T22:04:49.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.511+0000 7f1a09c00700 1 -- 172.21.15.142:0/2402413590 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a04106610 con 0x7f1a04101c40 2024-04-20T22:04:49.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.512+0000 7f1a00c00700 1 -- 172.21.15.142:0/2402413590 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f19f0020070 con 0x7f1a04101c40 2024-04-20T22:04:49.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.513+0000 7f1a00c00700 1 --2- 172.21.15.142:0/2402413590 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f19e806ecc0 0x7f19e8071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:04:49.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.513+0000 7f1a00c00700 1 -- 172.21.15.142:0/2402413590 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f19f008fff0 con 0x7f1a04101c40 2024-04-20T22:04:49.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.513+0000 7f1a03e00700 1 --2- 172.21.15.142:0/2402413590 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f19e806ecc0 0x7f19e8071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:04:49.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.514+0000 7f1a03e00700 1 --2- 172.21.15.142:0/2402413590 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f19e806ecc0 0x7f19e8071180 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a04101aa0 tx=0x7f19f4009310 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:04:49.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.517+0000 7f1a00c00700 1 -- 172.21.15.142:0/2402413590 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f19f005c8d0 con 0x7f1a04101c40 2024-04-20T22:04:49.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.824+0000 7f1a09c00700 1 -- 172.21.15.142:0/2402413590 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1a04062510 con 0x7f1a04101c40 2024-04-20T22:04:49.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.824+0000 7f1a00c00700 1 -- 172.21.15.142:0/2402413590 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1106 (secure 0 0 0) 0x7f19f005c460 con 0x7f1a04101c40 2024-04-20T22:04:49.825 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 41/231 objects degraded (17.749%), 15 pgs degraded 2024-04-20T22:04:49.825 INFO:teuthology.orchestra.run.smithi142.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-20T22:04:49.825 INFO:teuthology.orchestra.run.smithi142.stdout: osd.4 (root=default,host=smithi164) is down 2024-04-20T22:04:49.825 INFO:teuthology.orchestra.run.smithi142.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 41/231 objects degraded (17.749%), 15 pgs degraded 2024-04-20T22:04:49.825 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-04-20T22:04:49.825 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-04-20T22:04:49.825 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-04-20T22:04:49.825 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-04-20T22:04:49.825 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-04-20T22:04:49.825 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-04-20T22:04:49.825 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-04-20T22:04:49.825 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-04-20T22:04:49.825 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-04-20T22:04:49.825 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-04-20T22:04:49.825 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-04-20T22:04:49.825 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-04-20T22:04:49.826 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-04-20T22:04:49.826 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-04-20T22:04:49.826 INFO:teuthology.orchestra.run.smithi142.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-04-20T22:04:49.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.827+0000 7f1a09c00700 1 -- 172.21.15.142:0/2402413590 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f19e806ecc0 msgr2=0x7f19e8071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:49.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.827+0000 7f1a09c00700 1 --2- 172.21.15.142:0/2402413590 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f19e806ecc0 0x7f19e8071180 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a04101aa0 tx=0x7f19f4009310 comp rx=0 tx=0).stop 2024-04-20T22:04:49.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.827+0000 7f1a09c00700 1 -- 172.21.15.142:0/2402413590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a04101c40 msgr2=0x7f1a04198bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:04:49.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.827+0000 7f1a09c00700 1 --2- 172.21.15.142:0/2402413590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a04101c40 0x7f1a04198bc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009230 tx=0x7f19f000f740 comp rx=0 tx=0).stop 2024-04-20T22:04:49.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.827+0000 7f1a09c00700 1 -- 172.21.15.142:0/2402413590 shutdown_connections 2024-04-20T22:04:49.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.827+0000 7f1a09c00700 1 --2- 172.21.15.142:0/2402413590 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f19e806ecc0 0x7f19e8071180 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:49.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.827+0000 7f1a09c00700 1 --2- 172.21.15.142:0/2402413590 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a04100a40 0x7f1a04198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:49.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.827+0000 7f1a09c00700 1 --2- 172.21.15.142:0/2402413590 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a04101c40 0x7f1a04198bc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:04:49.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.827+0000 7f1a09c00700 1 -- 172.21.15.142:0/2402413590 >> 172.21.15.142:0/2402413590 conn(0x7f1a040fc000 msgr2=0x7f1a040734e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:04:49.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.827+0000 7f1a09c00700 1 -- 172.21.15.142:0/2402413590 shutdown_connections 2024-04-20T22:04:49.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:04:49.827+0000 7f1a09c00700 1 -- 172.21.15.142:0/2402413590 wait complete. 2024-04-20T22:04:50.158 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:49 smithi142 ceph-mon[79401]: pgmap v162: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:04:50.159 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:49 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/4276840047' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:04:50.159 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:49 smithi142 ceph-mon[79401]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:04:50.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:49 smithi164 ceph-mon[69784]: pgmap v162: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:04:50.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:49 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/4276840047' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:04:50.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:49 smithi164 ceph-mon[69784]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:04:51.105 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:50 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2402413590' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:04:51.105 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:50 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:51.105 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:50 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:51.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:50 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/2402413590' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:04:51.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:50 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:51.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:50 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:52.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:52 smithi142 ceph-mon[79401]: pgmap v163: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:04:52.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:52 smithi164 ceph-mon[69784]: pgmap v163: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:04:52.446 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:52 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:04:52.379+0000 7fd22ed347c0 -1 osd.4 70 log_to_monitors true 2024-04-20T22:04:53.401 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:04:53 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:04:53.243+0000 7fd219000700 -1 osd.4 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T22:04:53.402 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:53 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:53.402 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:53 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:53.402 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:53 smithi164 ceph-mon[69784]: from='osd.4 [v2:172.21.15.164:6808/155884460,v1:172.21.15.164:6809/155884460]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-20T22:04:53.402 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:53 smithi164 ceph-mon[69784]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-20T22:04:53.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:53 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:53.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:53 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:53.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:53 smithi142 ceph-mon[79401]: from='osd.4 [v2:172.21.15.164:6808/155884460,v1:172.21.15.164:6809/155884460]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-20T22:04:53.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:53 smithi142 ceph-mon[79401]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-20T22:04:54.647 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:54 smithi164 ceph-mon[69784]: pgmap v164: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:04:54.647 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:54 smithi164 ceph-mon[69784]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-20T22:04:54.647 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:54 smithi164 ceph-mon[69784]: osdmap e73: 6 total, 5 up, 6 in 2024-04-20T22:04:54.647 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:54 smithi164 ceph-mon[69784]: from='osd.4 [v2:172.21.15.164:6808/155884460,v1:172.21.15.164:6809/155884460]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T22:04:54.647 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:54 smithi164 ceph-mon[69784]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T22:04:54.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:54 smithi142 ceph-mon[79401]: pgmap v164: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:04:54.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:54 smithi142 ceph-mon[79401]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-20T22:04:54.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:54 smithi142 ceph-mon[79401]: osdmap e73: 6 total, 5 up, 6 in 2024-04-20T22:04:54.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:54 smithi142 ceph-mon[79401]: from='osd.4 [v2:172.21.15.164:6808/155884460,v1:172.21.15.164:6809/155884460]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T22:04:54.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:54 smithi142 ceph-mon[79401]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T22:04:55.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:55 smithi164 ceph-mon[69784]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-20T22:04:55.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:55 smithi164 ceph-mon[69784]: osd.4 [v2:172.21.15.164:6808/155884460,v1:172.21.15.164:6809/155884460] boot 2024-04-20T22:04:55.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:55 smithi164 ceph-mon[69784]: osdmap e74: 6 total, 6 up, 6 in 2024-04-20T22:04:55.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:55 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T22:04:55.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:55 smithi142 ceph-mon[79401]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-20T22:04:55.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:55 smithi142 ceph-mon[79401]: osd.4 [v2:172.21.15.164:6808/155884460,v1:172.21.15.164:6809/155884460] boot 2024-04-20T22:04:55.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:55 smithi142 ceph-mon[79401]: osdmap e74: 6 total, 6 up, 6 in 2024-04-20T22:04:55.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:55 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T22:04:56.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:56 smithi164 ceph-mon[69784]: pgmap v167: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 983 MiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:04:56.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:56 smithi164 ceph-mon[69784]: osdmap e75: 6 total, 6 up, 6 in 2024-04-20T22:04:56.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:56 smithi142 ceph-mon[79401]: pgmap v167: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 209 MiB data, 983 MiB used, 535 GiB / 536 GiB avail; 41/231 objects degraded (17.749%) 2024-04-20T22:04:56.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:56 smithi142 ceph-mon[79401]: osdmap e75: 6 total, 6 up, 6 in 2024-04-20T22:04:57.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:57 smithi164 ceph-mon[69784]: Health check update: Degraded data redundancy: 10/231 objects degraded (4.329%), 6 pgs degraded (PG_DEGRADED) 2024-04-20T22:04:57.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:57 smithi142 ceph-mon[79401]: Health check update: Degraded data redundancy: 10/231 objects degraded (4.329%), 6 pgs degraded (PG_DEGRADED) 2024-04-20T22:04:58.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:58 smithi164 ceph-mon[69784]: pgmap v169: 65 pgs: 10 peering, 6 active+undersized+degraded, 8 active+undersized, 41 active+clean; 209 MiB data, 983 MiB used, 535 GiB / 536 GiB avail; 10/231 objects degraded (4.329%) 2024-04-20T22:04:58.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:58 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:58.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:58 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:58.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:58 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:04:58.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:58 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:04:58.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:58 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:58.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:58 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:04:58.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:58 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:04:58.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:58 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:04:58.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:58 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:04:58.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:58 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-20T22:04:58.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:58 smithi142 ceph-mon[79401]: pgmap v169: 65 pgs: 10 peering, 6 active+undersized+degraded, 8 active+undersized, 41 active+clean; 209 MiB data, 983 MiB used, 535 GiB / 536 GiB avail; 10/231 objects degraded (4.329%) 2024-04-20T22:04:58.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:58 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:58.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:58 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:58.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:58 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:04:58.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:58 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:04:58.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:58 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:04:58.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:58 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:04:58.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:58 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:04:58.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:58 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:04:58.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:58 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:04:58.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:58 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-20T22:04:59.557 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:59 smithi164 ceph-mon[69784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-20T22:04:59.558 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:04:59 smithi164 ceph-mon[69784]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-04-20T22:04:59.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:59 smithi142 ceph-mon[79401]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-20T22:04:59.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:04:59 smithi142 ceph-mon[79401]: Upgrade: unsafe to stop osd(s) at this time (7 PGs are or would become offline) 2024-04-20T22:05:00.592 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:00 smithi164 ceph-mon[69784]: pgmap v170: 65 pgs: 10 peering, 55 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:00.592 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:00 smithi164 ceph-mon[69784]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/231 objects degraded (4.329%), 6 pgs degraded) 2024-04-20T22:05:00.592 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:00 smithi164 ceph-mon[69784]: Cluster is now healthy 2024-04-20T22:05:00.592 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:00 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:00.592 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:00 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:05:00.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:00 smithi142 ceph-mon[79401]: pgmap v170: 65 pgs: 10 peering, 55 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:00.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:00 smithi142 ceph-mon[79401]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/231 objects degraded (4.329%), 6 pgs degraded) 2024-04-20T22:05:00.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:00 smithi142 ceph-mon[79401]: Cluster is now healthy 2024-04-20T22:05:00.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:00 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:00.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:00 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:05:02.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:02 smithi164 ceph-mon[69784]: pgmap v171: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:02.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:02 smithi142 ceph-mon[79401]: pgmap v171: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:04.640 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:04 smithi164 ceph-mon[69784]: pgmap v172: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:04.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:04 smithi142 ceph-mon[79401]: pgmap v172: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:06.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:06 smithi164 ceph-mon[69784]: pgmap v173: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:06.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:06 smithi142 ceph-mon[79401]: pgmap v173: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:08.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:08 smithi164 ceph-mon[69784]: pgmap v174: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:08.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:08 smithi142 ceph-mon[79401]: pgmap v174: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:10.690 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:10 smithi164 ceph-mon[69784]: pgmap v175: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:10.690 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:10 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:10.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:10 smithi142 ceph-mon[79401]: pgmap v175: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:10.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:10 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:12.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:12 smithi164 ceph-mon[69784]: pgmap v176: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:12.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:12 smithi142 ceph-mon[79401]: pgmap v176: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:13.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:13 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-20T22:05:13.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:13 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-20T22:05:14.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:14 smithi142 ceph-mon[79401]: pgmap v177: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:14.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:14 smithi142 ceph-mon[79401]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-20T22:05:14.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:14 smithi142 ceph-mon[79401]: Upgrade: osd.5 is safe to restart 2024-04-20T22:05:14.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:14 smithi164 ceph-mon[69784]: pgmap v177: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:14.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:14 smithi164 ceph-mon[69784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-20T22:05:14.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:14 smithi164 ceph-mon[69784]: Upgrade: osd.5 is safe to restart 2024-04-20T22:05:15.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:05:15.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:15.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-20T22:05:15.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:05:15.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:05:15.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:15.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-20T22:05:15.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:05:16.529 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:16 smithi164 ceph-mon[69784]: pgmap v178: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:16.529 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:16 smithi164 ceph-mon[69784]: Upgrade: Updating osd.5 2024-04-20T22:05:16.529 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:16 smithi164 ceph-mon[69784]: Deploying daemon osd.5 on smithi164 2024-04-20T22:05:16.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:16 smithi142 ceph-mon[79401]: pgmap v178: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:16.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:16 smithi142 ceph-mon[79401]: Upgrade: Updating osd.5 2024-04-20T22:05:16.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:16 smithi142 ceph-mon[79401]: Deploying daemon osd.5 on smithi164 2024-04-20T22:05:18.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:18 smithi142 ceph-mon[79401]: pgmap v179: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:18.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:18 smithi164 ceph-mon[69784]: pgmap v179: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:19.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:19.998+0000 7f0109600700 1 -- 172.21.15.142:0/3877959697 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0104103fb0 msgr2=0x7f0104104430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:19.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:19.998+0000 7f0109600700 1 --2- 172.21.15.142:0/3877959697 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0104103fb0 0x7f0104104430 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f00f0009870 tx=0x7f00f0009b80 comp rx=0 tx=0).stop 2024-04-20T22:05:19.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:19.998+0000 7f0109600700 1 -- 172.21.15.142:0/3877959697 shutdown_connections 2024-04-20T22:05:19.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:19.998+0000 7f0109600700 1 --2- 172.21.15.142:0/3877959697 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0104103fb0 0x7f0104104430 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:19.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:19.998+0000 7f0109600700 1 --2- 172.21.15.142:0/3877959697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0104102e50 0x7f0104103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:19.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:19.998+0000 7f0109600700 1 -- 172.21.15.142:0/3877959697 >> 172.21.15.142:0/3877959697 conn(0x7f01040fe3d0 msgr2=0x7f0104100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:19.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:19.999+0000 7f0109600700 1 -- 172.21.15.142:0/3877959697 shutdown_connections 2024-04-20T22:05:19.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:19.999+0000 7f0109600700 1 -- 172.21.15.142:0/3877959697 wait complete. 2024-04-20T22:05:20.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.000+0000 7f0109600700 1 Processor -- start 2024-04-20T22:05:20.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.000+0000 7f0109600700 1 -- start start 2024-04-20T22:05:20.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.000+0000 7f0109600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0104102e50 0x7f0104198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:20.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.000+0000 7f0109600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0104103fb0 0x7f0104198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:20.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.000+0000 7f0109600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0104199370 con 0x7f0104103fb0 2024-04-20T22:05:20.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.001+0000 7f0109600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01041994b0 con 0x7f0104102e50 2024-04-20T22:05:20.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.001+0000 7f0102000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0104103fb0 0x7f0104198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:20.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.001+0000 7f0102a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0104102e50 0x7f0104198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:20.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.001+0000 7f0102a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0104102e50 0x7f0104198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:44490/0 (socket says 172.21.15.142:44490) 2024-04-20T22:05:20.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.001+0000 7f0102000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0104103fb0 0x7f0104198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42204/0 (socket says 172.21.15.142:42204) 2024-04-20T22:05:20.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.001+0000 7f0102a00700 1 -- 172.21.15.142:0/2767284241 learned_addr learned my addr 172.21.15.142:0/2767284241 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:05:20.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.001+0000 7f0102a00700 1 -- 172.21.15.142:0/2767284241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0104103fb0 msgr2=0x7f0104198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:20.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.001+0000 7f0102a00700 1 --2- 172.21.15.142:0/2767284241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0104103fb0 0x7f0104198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:20.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.001+0000 7f0102a00700 1 -- 172.21.15.142:0/2767284241 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f40095f0 con 0x7f0104102e50 2024-04-20T22:05:20.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.002+0000 7f0102a00700 1 --2- 172.21.15.142:0/2767284241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0104102e50 0x7f0104198810 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f00f400eb90 tx=0x7f00f400eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:20.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.002+0000 7f00fb400700 1 -- 172.21.15.142:0/2767284241 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00f400ccc0 con 0x7f0104102e50 2024-04-20T22:05:20.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.002+0000 7f00fb400700 1 -- 172.21.15.142:0/2767284241 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f00f400ce20 con 0x7f0104102e50 2024-04-20T22:05:20.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.002+0000 7f0109600700 1 -- 172.21.15.142:0/2767284241 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f0009520 con 0x7f0104102e50 2024-04-20T22:05:20.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.002+0000 7f00fb400700 1 -- 172.21.15.142:0/2767284241 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00f4010660 con 0x7f0104102e50 2024-04-20T22:05:20.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.002+0000 7f0109600700 1 -- 172.21.15.142:0/2767284241 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010419e2f0 con 0x7f0104102e50 2024-04-20T22:05:20.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.003+0000 7f0109600700 1 -- 172.21.15.142:0/2767284241 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0104192950 con 0x7f0104102e50 2024-04-20T22:05:20.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.004+0000 7f00fb400700 1 -- 172.21.15.142:0/2767284241 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f00f4003e50 con 0x7f0104102e50 2024-04-20T22:05:20.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.005+0000 7f00fb400700 1 --2- 172.21.15.142:0/2767284241 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f00e806ecc0 0x7f00e8071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:20.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.005+0000 7f00fb400700 1 -- 172.21.15.142:0/2767284241 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f00f4014070 con 0x7f0104102e50 2024-04-20T22:05:20.005 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.005+0000 7f0102000700 1 --2- 172.21.15.142:0/2767284241 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f00e806ecc0 0x7f00e8071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:20.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.006+0000 7f0102000700 1 --2- 172.21.15.142:0/2767284241 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f00e806ecc0 0x7f00e8071180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00f000b6f0 tx=0x7f00f0019040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:20.010 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.011+0000 7f00fb400700 1 -- 172.21.15.142:0/2767284241 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f00f405bdd0 con 0x7f0104102e50 2024-04-20T22:05:20.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.261+0000 7f0109600700 1 -- 172.21.15.142:0/2767284241 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f010402cf00 con 0x7f00e806ecc0 2024-04-20T22:05:20.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.264+0000 7f00fb400700 1 -- 172.21.15.142:0/2767284241 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f010402cf00 con 0x7f00e806ecc0 2024-04-20T22:05:20.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.267+0000 7f0109600700 1 -- 172.21.15.142:0/2767284241 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f00e806ecc0 msgr2=0x7f00e8071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:20.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.267+0000 7f0109600700 1 --2- 172.21.15.142:0/2767284241 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f00e806ecc0 0x7f00e8071180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00f000b6f0 tx=0x7f00f0019040 comp rx=0 tx=0).stop 2024-04-20T22:05:20.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.267+0000 7f0109600700 1 -- 172.21.15.142:0/2767284241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0104102e50 msgr2=0x7f0104198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:20.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.267+0000 7f0109600700 1 --2- 172.21.15.142:0/2767284241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0104102e50 0x7f0104198810 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f00f400eb90 tx=0x7f00f400eea0 comp rx=0 tx=0).stop 2024-04-20T22:05:20.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.267+0000 7f0109600700 1 -- 172.21.15.142:0/2767284241 shutdown_connections 2024-04-20T22:05:20.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.267+0000 7f0109600700 1 --2- 172.21.15.142:0/2767284241 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f00e806ecc0 0x7f00e8071180 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:20.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.267+0000 7f0109600700 1 --2- 172.21.15.142:0/2767284241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0104102e50 0x7f0104198810 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:20.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.267+0000 7f0109600700 1 --2- 172.21.15.142:0/2767284241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0104103fb0 0x7f0104198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:20.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.267+0000 7f0109600700 1 -- 172.21.15.142:0/2767284241 >> 172.21.15.142:0/2767284241 conn(0x7f01040fe3d0 msgr2=0x7f0104107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:20.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.267+0000 7f0109600700 1 -- 172.21.15.142:0/2767284241 shutdown_connections 2024-04-20T22:05:20.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.268+0000 7f0109600700 1 -- 172.21.15.142:0/2767284241 wait complete. 2024-04-20T22:05:20.284 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T22:05:20.397 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:19 smithi164 systemd[1]: Stopping Ceph osd.5 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:05:20.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.430+0000 7fa59a000700 1 -- 172.21.15.142:0/3659421278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa594101e30 msgr2=0x7fa594102290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:20.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.430+0000 7fa59a000700 1 --2- 172.21.15.142:0/3659421278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa594101e30 0x7fa594102290 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa580009910 tx=0x7fa580009c20 comp rx=0 tx=0).stop 2024-04-20T22:05:20.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.430+0000 7fa59a000700 1 -- 172.21.15.142:0/3659421278 shutdown_connections 2024-04-20T22:05:20.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.430+0000 7fa59a000700 1 --2- 172.21.15.142:0/3659421278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa594101e30 0x7fa594102290 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:20.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.430+0000 7fa59a000700 1 --2- 172.21.15.142:0/3659421278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa594100c30 0x7fa594101050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:20.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.430+0000 7fa59a000700 1 -- 172.21.15.142:0/3659421278 >> 172.21.15.142:0/3659421278 conn(0x7fa5940fc1d0 msgr2=0x7fa5940fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:20.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.430+0000 7fa59a000700 1 -- 172.21.15.142:0/3659421278 shutdown_connections 2024-04-20T22:05:20.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.430+0000 7fa59a000700 1 -- 172.21.15.142:0/3659421278 wait complete. 2024-04-20T22:05:20.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.431+0000 7fa59a000700 1 Processor -- start 2024-04-20T22:05:20.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.431+0000 7fa59a000700 1 -- start start 2024-04-20T22:05:20.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.432+0000 7fa59a000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa594100c30 0x7fa594198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:20.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.432+0000 7fa59a000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa594101e30 0x7fa594198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:20.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.432+0000 7fa59a000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa594199380 con 0x7fa594100c30 2024-04-20T22:05:20.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.432+0000 7fa59a000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5941994c0 con 0x7fa594101e30 2024-04-20T22:05:20.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.432+0000 7fa593400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa594100c30 0x7fa594198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:20.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.432+0000 7fa593400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa594100c30 0x7fa594198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42224/0 (socket says 172.21.15.142:42224) 2024-04-20T22:05:20.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.432+0000 7fa593400700 1 -- 172.21.15.142:0/3266994805 learned_addr learned my addr 172.21.15.142:0/3266994805 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:05:20.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.432+0000 7fa592a00700 1 --2- 172.21.15.142:0/3266994805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa594101e30 0x7fa594198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:20.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.433+0000 7fa593400700 1 -- 172.21.15.142:0/3266994805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa594101e30 msgr2=0x7fa594198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:20.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.433+0000 7fa593400700 1 --2- 172.21.15.142:0/3266994805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa594101e30 0x7fa594198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:20.433 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.433+0000 7fa593400700 1 -- 172.21.15.142:0/3266994805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5800095f0 con 0x7fa594100c30 2024-04-20T22:05:20.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.433+0000 7fa593400700 1 --2- 172.21.15.142:0/3266994805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa594100c30 0x7fa594198820 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa58400d900 tx=0x7fa58400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:20.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.433+0000 7fa58be00700 1 -- 172.21.15.142:0/3266994805 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5840041f0 con 0x7fa594100c30 2024-04-20T22:05:20.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.433+0000 7fa58be00700 1 -- 172.21.15.142:0/3266994805 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa584004350 con 0x7fa594100c30 2024-04-20T22:05:20.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.433+0000 7fa59a000700 1 -- 172.21.15.142:0/3266994805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa59419ded0 con 0x7fa594100c30 2024-04-20T22:05:20.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.433+0000 7fa58be00700 1 -- 172.21.15.142:0/3266994805 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa584003cf0 con 0x7fa594100c30 2024-04-20T22:05:20.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.434+0000 7fa59a000700 1 -- 172.21.15.142:0/3266994805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59419e410 con 0x7fa594100c30 2024-04-20T22:05:20.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.435+0000 7fa59a000700 1 -- 172.21.15.142:0/3266994805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa594106800 con 0x7fa594100c30 2024-04-20T22:05:20.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.436+0000 7fa58be00700 1 -- 172.21.15.142:0/3266994805 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fa584009730 con 0x7fa594100c30 2024-04-20T22:05:20.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.437+0000 7fa58be00700 1 --2- 172.21.15.142:0/3266994805 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa57806ecc0 0x7fa578071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:20.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.437+0000 7fa58be00700 1 -- 172.21.15.142:0/3266994805 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa58408eca0 con 0x7fa594100c30 2024-04-20T22:05:20.437 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.437+0000 7fa592a00700 1 --2- 172.21.15.142:0/3266994805 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa57806ecc0 0x7fa578071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:20.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.438+0000 7fa592a00700 1 --2- 172.21.15.142:0/3266994805 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa57806ecc0 0x7fa578071180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa580005090 tx=0x7fa580005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:20.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.442+0000 7fa58be00700 1 -- 172.21.15.142:0/3266994805 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fa584093070 con 0x7fa594100c30 2024-04-20T22:05:20.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.686+0000 7fa59a000700 1 -- 172.21.15.142:0/3266994805 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa59402ceb0 con 0x7fa57806ecc0 2024-04-20T22:05:20.687 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:20 smithi142 ceph-mon[79401]: pgmap v180: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:20.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.689+0000 7fa58be00700 1 -- 172.21.15.142:0/3266994805 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fa59402ceb0 con 0x7fa57806ecc0 2024-04-20T22:05:20.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.692+0000 7fa59a000700 1 -- 172.21.15.142:0/3266994805 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa57806ecc0 msgr2=0x7fa578071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:20.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.692+0000 7fa59a000700 1 --2- 172.21.15.142:0/3266994805 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa57806ecc0 0x7fa578071180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa580005090 tx=0x7fa580005960 comp rx=0 tx=0).stop 2024-04-20T22:05:20.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.692+0000 7fa59a000700 1 -- 172.21.15.142:0/3266994805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa594100c30 msgr2=0x7fa594198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:20.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.692+0000 7fa59a000700 1 --2- 172.21.15.142:0/3266994805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa594100c30 0x7fa594198820 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa58400d900 tx=0x7fa58400dc10 comp rx=0 tx=0).stop 2024-04-20T22:05:20.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.692+0000 7fa59a000700 1 -- 172.21.15.142:0/3266994805 shutdown_connections 2024-04-20T22:05:20.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.692+0000 7fa59a000700 1 --2- 172.21.15.142:0/3266994805 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa57806ecc0 0x7fa578071180 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:20.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.692+0000 7fa59a000700 1 --2- 172.21.15.142:0/3266994805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa594100c30 0x7fa594198820 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:20.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.692+0000 7fa59a000700 1 --2- 172.21.15.142:0/3266994805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa594101e30 0x7fa594198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:20.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.692+0000 7fa59a000700 1 -- 172.21.15.142:0/3266994805 >> 172.21.15.142:0/3266994805 conn(0x7fa5940fc1d0 msgr2=0x7fa594073460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:20.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.693+0000 7fa59a000700 1 -- 172.21.15.142:0/3266994805 shutdown_connections 2024-04-20T22:05:20.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.693+0000 7fa59a000700 1 -- 172.21.15.142:0/3266994805 wait complete. 2024-04-20T22:05:20.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:20 smithi164 ceph-mon[69784]: pgmap v180: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:20.696 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:20 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[43045]: 2024-04-20T22:05:20.431+0000 7f56d9000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T22:05:20.696 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:20 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[43045]: 2024-04-20T22:05:20.431+0000 7f56d9000700 -1 osd.5 75 *** Got signal Terminated *** 2024-04-20T22:05:20.696 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:20 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[43045]: 2024-04-20T22:05:20.431+0000 7f56d9000700 -1 osd.5 75 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T22:05:20.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.849+0000 7f0a83200700 1 -- 172.21.15.142:0/2650583219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a84100a40 msgr2=0x7f0a84100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:20.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.849+0000 7f0a83200700 1 --2- 172.21.15.142:0/2650583219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a84100a40 0x7f0a84100e60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009910 tx=0x7f0a74009c20 comp rx=0 tx=0).stop 2024-04-20T22:05:20.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.849+0000 7f0a83200700 1 -- 172.21.15.142:0/2650583219 shutdown_connections 2024-04-20T22:05:20.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.849+0000 7f0a83200700 1 --2- 172.21.15.142:0/2650583219 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a84101c40 0x7f0a841020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:20.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.849+0000 7f0a83200700 1 --2- 172.21.15.142:0/2650583219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a84100a40 0x7f0a84100e60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:20.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.849+0000 7f0a83200700 1 -- 172.21.15.142:0/2650583219 >> 172.21.15.142:0/2650583219 conn(0x7f0a840fc000 msgr2=0x7f0a840fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:20.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.850+0000 7f0a83200700 1 -- 172.21.15.142:0/2650583219 shutdown_connections 2024-04-20T22:05:20.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.850+0000 7f0a83200700 1 -- 172.21.15.142:0/2650583219 wait complete. 2024-04-20T22:05:20.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.851+0000 7f0a83200700 1 Processor -- start 2024-04-20T22:05:20.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.851+0000 7f0a83200700 1 -- start start 2024-04-20T22:05:20.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.851+0000 7f0a83200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a84100a40 0x7f0a841986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:20.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.851+0000 7f0a83200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a84101c40 0x7f0a84198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:20.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.851+0000 7f0a83200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a84199230 con 0x7f0a84100a40 2024-04-20T22:05:20.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.851+0000 7f0a83200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a84199370 con 0x7f0a84101c40 2024-04-20T22:05:20.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.851+0000 7f0a81e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a84100a40 0x7f0a841986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:20.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.851+0000 7f0a81e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a84100a40 0x7f0a841986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42248/0 (socket says 172.21.15.142:42248) 2024-04-20T22:05:20.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.851+0000 7f0a81e00700 1 -- 172.21.15.142:0/1376945250 learned_addr learned my addr 172.21.15.142:0/1376945250 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:05:20.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.852+0000 7f0a81400700 1 --2- 172.21.15.142:0/1376945250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a84101c40 0x7f0a84198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:20.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.852+0000 7f0a81e00700 1 -- 172.21.15.142:0/1376945250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a84101c40 msgr2=0x7f0a84198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:20.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.852+0000 7f0a81e00700 1 --2- 172.21.15.142:0/1376945250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a84101c40 0x7f0a84198c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:20.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.852+0000 7f0a81e00700 1 -- 172.21.15.142:0/1376945250 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a740095f0 con 0x7f0a84100a40 2024-04-20T22:05:20.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.852+0000 7f0a81e00700 1 --2- 172.21.15.142:0/1376945250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a84100a40 0x7f0a841986d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400bd70 tx=0x7f0a7400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:20.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.852+0000 7f0a7aa00700 1 -- 172.21.15.142:0/1376945250 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a7401d070 con 0x7f0a84100a40 2024-04-20T22:05:20.853 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.852+0000 7f0a7aa00700 1 -- 172.21.15.142:0/1376945250 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a74005dc0 con 0x7f0a84100a40 2024-04-20T22:05:20.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.852+0000 7f0a7aa00700 1 -- 172.21.15.142:0/1376945250 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a74021410 con 0x7f0a84100a40 2024-04-20T22:05:20.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.852+0000 7f0a83200700 1 -- 172.21.15.142:0/1376945250 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8419dd70 con 0x7f0a84100a40 2024-04-20T22:05:20.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.853+0000 7f0a83200700 1 -- 172.21.15.142:0/1376945250 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8419e280 con 0x7f0a84100a40 2024-04-20T22:05:20.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.854+0000 7f0a83200700 1 -- 172.21.15.142:0/1376945250 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a84062580 con 0x7f0a84100a40 2024-04-20T22:05:20.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.855+0000 7f0a7aa00700 1 -- 172.21.15.142:0/1376945250 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f0a7400f820 con 0x7f0a84100a40 2024-04-20T22:05:20.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.856+0000 7f0a7aa00700 1 --2- 172.21.15.142:0/1376945250 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0a6806ecc0 0x7f0a68071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:20.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.856+0000 7f0a7aa00700 1 -- 172.21.15.142:0/1376945250 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0a7408ffa0 con 0x7f0a84100a40 2024-04-20T22:05:20.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.856+0000 7f0a81400700 1 --2- 172.21.15.142:0/1376945250 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0a6806ecc0 0x7f0a68071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:20.856 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.857+0000 7f0a81400700 1 --2- 172.21.15.142:0/1376945250 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0a6806ecc0 0x7f0a68071180 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0a70005950 tx=0x7f0a700058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:20.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:20.861+0000 7f0a7aa00700 1 -- 172.21.15.142:0/1376945250 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f0a84062580 con 0x7f0a84100a40 2024-04-20T22:05:21.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.092+0000 7f0a83200700 1 -- 172.21.15.142:0/1376945250 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a84062510 con 0x7f0a6806ecc0 2024-04-20T22:05:21.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.105+0000 7f0a7aa00700 1 -- 172.21.15.142:0/1376945250 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f0a84062510 con 0x7f0a6806ecc0 2024-04-20T22:05:21.106 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:05:21.106 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (16m) 101s ago 17m 13.7M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T22:05:21.106 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (18m) 101s ago 18m 8682k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T22:05:21.106 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (16m) 30s ago 16m 8216k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T22:05:21.106 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (3m) 101s ago 18m 6665k - 19.0.0-3133-ga8c84f59 76bc6b91b726 64521ed7125b 2024-04-20T22:05:21.106 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (3m) 30s ago 16m 6656k - 19.0.0-3133-ga8c84f59 76bc6b91b726 893c6f16ee6d 2024-04-20T22:05:21.106 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (15m) 101s ago 17m 76.6M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T22:05:21.106 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (10m) 101s ago 10m 140M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 b68e279d7945 2024-04-20T22:05:21.106 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (10m) 101s ago 10m 16.4M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T22:05:21.107 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (10m) 30s ago 10m 16.9M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T22:05:21.107 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (10m) 30s ago 10m 17.2M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T22:05:21.107 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (7m) 101s ago 19m 505M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:05:21.107 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (5m) 30s ago 16m 453M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:05:21.107 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (5m) 101s ago 19m 47.0M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 af10a542c918 2024-04-20T22:05:21.107 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (4m) 30s ago 16m 35.6M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 133512694d46 2024-04-20T22:05:21.107 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (18m) 101s ago 18m 7894k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T22:05:21.107 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (16m) 30s ago 16m 7805k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T22:05:21.107 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (2m) 101s ago 15m 95.7M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 b7206d05a7cd 2024-04-20T22:05:21.107 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (2m) 101s ago 14m 91.8M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 82bcc0c46762 2024-04-20T22:05:21.107 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (109s) 101s ago 14m 12.6M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 3e2d91f49494 2024-04-20T22:05:21.107 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (79s) 30s ago 13m 103M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 a898b8b77c51 2024-04-20T22:05:21.108 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (35s) 30s ago 13m 11.2M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 539c4026f9fb 2024-04-20T22:05:21.108 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (12m) 30s ago 12m 226M 2240M 18.2.2-1237-g646b8c7d 9900ed1a6b81 4f36124aeb0d 2024-04-20T22:05:21.108 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (5m) 101s ago 17m 73.0M - 2.43.0 a07b618ecd1d 46b76c20eae5 2024-04-20T22:05:21.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.108+0000 7f0a83200700 1 -- 172.21.15.142:0/1376945250 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0a6806ecc0 msgr2=0x7f0a68071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:21.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.108+0000 7f0a83200700 1 --2- 172.21.15.142:0/1376945250 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0a6806ecc0 0x7f0a68071180 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0a70005950 tx=0x7f0a700058e0 comp rx=0 tx=0).stop 2024-04-20T22:05:21.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.108+0000 7f0a83200700 1 -- 172.21.15.142:0/1376945250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a84100a40 msgr2=0x7f0a841986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:21.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.108+0000 7f0a83200700 1 --2- 172.21.15.142:0/1376945250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a84100a40 0x7f0a841986d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400bd70 tx=0x7f0a7400be50 comp rx=0 tx=0).stop 2024-04-20T22:05:21.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.108+0000 7f0a83200700 1 -- 172.21.15.142:0/1376945250 shutdown_connections 2024-04-20T22:05:21.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.108+0000 7f0a83200700 1 --2- 172.21.15.142:0/1376945250 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0a6806ecc0 0x7f0a68071180 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:21.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.108+0000 7f0a83200700 1 --2- 172.21.15.142:0/1376945250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a84100a40 0x7f0a841986d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:21.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.108+0000 7f0a83200700 1 --2- 172.21.15.142:0/1376945250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a84101c40 0x7f0a84198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:21.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.108+0000 7f0a83200700 1 -- 172.21.15.142:0/1376945250 >> 172.21.15.142:0/1376945250 conn(0x7f0a840fc000 msgr2=0x7f0a840734b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:21.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.109+0000 7f0a83200700 1 -- 172.21.15.142:0/1376945250 shutdown_connections 2024-04-20T22:05:21.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.109+0000 7f0a83200700 1 -- 172.21.15.142:0/1376945250 wait complete. 2024-04-20T22:05:21.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.274+0000 7fb02b200700 1 -- 172.21.15.142:0/3724765710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb024074eb0 msgr2=0x7fb024073310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:21.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.274+0000 7fb02b200700 1 --2- 172.21.15.142:0/3724765710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb024074eb0 0x7fb024073310 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb014009910 tx=0x7fb014009c20 comp rx=0 tx=0).stop 2024-04-20T22:05:21.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.274+0000 7fb02b200700 1 -- 172.21.15.142:0/3724765710 shutdown_connections 2024-04-20T22:05:21.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.274+0000 7fb02b200700 1 --2- 172.21.15.142:0/3724765710 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0240738e0 0x7fb024073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:21.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.274+0000 7fb02b200700 1 --2- 172.21.15.142:0/3724765710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb024074eb0 0x7fb024073310 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:21.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.274+0000 7fb02b200700 1 -- 172.21.15.142:0/3724765710 >> 172.21.15.142:0/3724765710 conn(0x7fb0240fc200 msgr2=0x7fb0240fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:21.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.274+0000 7fb02b200700 1 -- 172.21.15.142:0/3724765710 shutdown_connections 2024-04-20T22:05:21.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.274+0000 7fb02b200700 1 -- 172.21.15.142:0/3724765710 wait complete. 2024-04-20T22:05:21.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.275+0000 7fb02b200700 1 Processor -- start 2024-04-20T22:05:21.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.275+0000 7fb02b200700 1 -- start start 2024-04-20T22:05:21.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.276+0000 7fb02b200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0240738e0 0x7fb0241987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:21.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.276+0000 7fb02b200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb024074eb0 0x7fb024198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:21.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.276+0000 7fb02b200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb024199310 con 0x7fb024074eb0 2024-04-20T22:05:21.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.276+0000 7fb02b200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb024199450 con 0x7fb0240738e0 2024-04-20T22:05:21.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.276+0000 7fb023400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb024074eb0 0x7fb024198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:21.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.276+0000 7fb023400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb024074eb0 0x7fb024198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42272/0 (socket says 172.21.15.142:42272) 2024-04-20T22:05:21.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.276+0000 7fb023400700 1 -- 172.21.15.142:0/201655494 learned_addr learned my addr 172.21.15.142:0/201655494 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:05:21.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.276+0000 7fb023400700 1 -- 172.21.15.142:0/201655494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0240738e0 msgr2=0x7fb0241987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:21.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.276+0000 7fb023400700 1 --2- 172.21.15.142:0/201655494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0240738e0 0x7fb0241987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:21.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.277+0000 7fb023400700 1 -- 172.21.15.142:0/201655494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0140095f0 con 0x7fb024074eb0 2024-04-20T22:05:21.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.277+0000 7fb023400700 1 --2- 172.21.15.142:0/201655494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb024074eb0 0x7fb024198cf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb01000c8a0 tx=0x7fb01000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:21.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.277+0000 7fb020c00700 1 -- 172.21.15.142:0/201655494 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb01000cea0 con 0x7fb024074eb0 2024-04-20T22:05:21.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.277+0000 7fb020c00700 1 -- 172.21.15.142:0/201655494 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb010004830 con 0x7fb024074eb0 2024-04-20T22:05:21.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.277+0000 7fb02b200700 1 -- 172.21.15.142:0/201655494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02419deb0 con 0x7fb024074eb0 2024-04-20T22:05:21.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.277+0000 7fb020c00700 1 -- 172.21.15.142:0/201655494 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0100055b0 con 0x7fb024074eb0 2024-04-20T22:05:21.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.277+0000 7fb02b200700 1 -- 172.21.15.142:0/201655494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02419e450 con 0x7fb024074eb0 2024-04-20T22:05:21.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.278+0000 7fb02b200700 1 -- 172.21.15.142:0/201655494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0241929b0 con 0x7fb024074eb0 2024-04-20T22:05:21.279 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.280+0000 7fb020c00700 1 -- 172.21.15.142:0/201655494 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fb0100049a0 con 0x7fb024074eb0 2024-04-20T22:05:21.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.281+0000 7fb020c00700 1 --2- 172.21.15.142:0/201655494 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb00806ecd0 0x7fb008071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:21.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.281+0000 7fb020c00700 1 -- 172.21.15.142:0/201655494 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb01008e9f0 con 0x7fb024074eb0 2024-04-20T22:05:21.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.281+0000 7fb023e00700 1 --2- 172.21.15.142:0/201655494 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb00806ecd0 0x7fb008071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:21.281 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.281+0000 7fb023e00700 1 --2- 172.21.15.142:0/201655494 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb00806ecd0 0x7fb008071190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb0140051c0 tx=0x7fb014005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:21.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.285+0000 7fb020c00700 1 -- 172.21.15.142:0/201655494 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fb010090e60 con 0x7fb024074eb0 2024-04-20T22:05:21.417 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:21 smithi142 ceph-mon[79401]: from='client.44245 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:05:21.417 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:21 smithi142 ceph-mon[79401]: osd.5 marked itself down and dead 2024-04-20T22:05:21.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.619+0000 7fb02b200700 1 -- 172.21.15.142:0/201655494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb02404ebb0 con 0x7fb024074eb0 2024-04-20T22:05:21.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.620+0000 7fb020c00700 1 -- 172.21.15.142:0/201655494 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+730 (secure 0 0 0) 0x7fb01001d070 con 0x7fb024074eb0 2024-04-20T22:05:21.620 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:05:21.620 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:05:21.620 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:05:21.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:05:21.621 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:05:21.621 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:05:21.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:05:21.621 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:05:21.621 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 5 2024-04-20T22:05:21.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:05:21.621 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:05:21.621 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4 2024-04-20T22:05:21.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:05:21.621 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:05:21.621 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 4, 2024-04-20T22:05:21.621 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 9 2024-04-20T22:05:21.621 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:05:21.621 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:05:21.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.623+0000 7fb02b200700 1 -- 172.21.15.142:0/201655494 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb00806ecd0 msgr2=0x7fb008071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:21.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.623+0000 7fb02b200700 1 --2- 172.21.15.142:0/201655494 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb00806ecd0 0x7fb008071190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb0140051c0 tx=0x7fb014005fd0 comp rx=0 tx=0).stop 2024-04-20T22:05:21.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.623+0000 7fb02b200700 1 -- 172.21.15.142:0/201655494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb024074eb0 msgr2=0x7fb024198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:21.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.623+0000 7fb02b200700 1 --2- 172.21.15.142:0/201655494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb024074eb0 0x7fb024198cf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb01000c8a0 tx=0x7fb01000cc60 comp rx=0 tx=0).stop 2024-04-20T22:05:21.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.623+0000 7fb02b200700 1 -- 172.21.15.142:0/201655494 shutdown_connections 2024-04-20T22:05:21.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.623+0000 7fb02b200700 1 --2- 172.21.15.142:0/201655494 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb00806ecd0 0x7fb008071190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:21.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.623+0000 7fb02b200700 1 --2- 172.21.15.142:0/201655494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0240738e0 0x7fb0241987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:21.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.623+0000 7fb02b200700 1 --2- 172.21.15.142:0/201655494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb024074eb0 0x7fb024198cf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:21.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.623+0000 7fb02b200700 1 -- 172.21.15.142:0/201655494 >> 172.21.15.142:0/201655494 conn(0x7fb0240fc200 msgr2=0x7fb024106da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:21.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.624+0000 7fb02b200700 1 -- 172.21.15.142:0/201655494 shutdown_connections 2024-04-20T22:05:21.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.624+0000 7fb02b200700 1 -- 172.21.15.142:0/201655494 wait complete. 2024-04-20T22:05:21.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:21 smithi164 ceph-mon[69784]: from='client.44245 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:05:21.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:21 smithi164 ceph-mon[69784]: osd.5 marked itself down and dead 2024-04-20T22:05:21.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:21 smithi164 ceph-mon[69784]: pgmap v181: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:21.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:21 smithi164 ceph-mon[69784]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:05:21.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:21 smithi164 ceph-mon[69784]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:05:21.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:21 smithi142 ceph-mon[79401]: pgmap v181: 65 pgs: 65 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:21.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:21 smithi142 ceph-mon[79401]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:05:21.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:21 smithi142 ceph-mon[79401]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:05:21.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.779+0000 7f0bc9800700 1 -- 172.21.15.142:0/3392075916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bc4073940 msgr2=0x7f0bc4073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:21.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.779+0000 7f0bc9800700 1 --2- 172.21.15.142:0/3392075916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bc4073940 0x7f0bc4073dc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009910 tx=0x7f0bac009c20 comp rx=0 tx=0).stop 2024-04-20T22:05:21.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.779+0000 7f0bc9800700 1 -- 172.21.15.142:0/3392075916 shutdown_connections 2024-04-20T22:05:21.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.779+0000 7f0bc9800700 1 --2- 172.21.15.142:0/3392075916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bc4073940 0x7f0bc4073dc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:21.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.779+0000 7f0bc9800700 1 --2- 172.21.15.142:0/3392075916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bc4074f10 0x7f0bc4073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:21.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.779+0000 7f0bc9800700 1 -- 172.21.15.142:0/3392075916 >> 172.21.15.142:0/3392075916 conn(0x7f0bc40fc1c0 msgr2=0x7f0bc40fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:21.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.779+0000 7f0bc9800700 1 -- 172.21.15.142:0/3392075916 shutdown_connections 2024-04-20T22:05:21.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.779+0000 7f0bc9800700 1 -- 172.21.15.142:0/3392075916 wait complete. 2024-04-20T22:05:21.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.780+0000 7f0bc9800700 1 Processor -- start 2024-04-20T22:05:21.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.780+0000 7f0bc9800700 1 -- start start 2024-04-20T22:05:21.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.781+0000 7f0bc9800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bc4073940 0x7f0bc41989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:21.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.781+0000 7f0bc9800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bc4074f10 0x7f0bc4198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:21.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.781+0000 7f0bc9800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc4199510 con 0x7f0bc4074f10 2024-04-20T22:05:21.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.781+0000 7f0bc9800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc4199650 con 0x7f0bc4073940 2024-04-20T22:05:21.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.781+0000 7f0bbbe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bc4074f10 0x7f0bc4198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:21.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.781+0000 7f0bbbe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bc4074f10 0x7f0bc4198ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42292/0 (socket says 172.21.15.142:42292) 2024-04-20T22:05:21.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.781+0000 7f0bbbe00700 1 -- 172.21.15.142:0/182777994 learned_addr learned my addr 172.21.15.142:0/182777994 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:05:21.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.781+0000 7f0bc2a00700 1 --2- 172.21.15.142:0/182777994 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bc4073940 0x7f0bc41989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:21.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.782+0000 7f0bbbe00700 1 -- 172.21.15.142:0/182777994 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bc4073940 msgr2=0x7f0bc41989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:21.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.782+0000 7f0bbbe00700 1 --2- 172.21.15.142:0/182777994 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bc4073940 0x7f0bc41989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:21.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.782+0000 7f0bbbe00700 1 -- 172.21.15.142:0/182777994 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac0095f0 con 0x7f0bc4074f10 2024-04-20T22:05:21.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.782+0000 7f0bbbe00700 1 --2- 172.21.15.142:0/182777994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bc4074f10 0x7f0bc4198ef0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0bac0059d0 tx=0x7f0bac00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:21.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.782+0000 7f0bbb400700 1 -- 172.21.15.142:0/182777994 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bac01d070 con 0x7f0bc4074f10 2024-04-20T22:05:21.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.782+0000 7f0bbb400700 1 -- 172.21.15.142:0/182777994 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0bac00f460 con 0x7f0bc4074f10 2024-04-20T22:05:21.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.782+0000 7f0bbb400700 1 -- 172.21.15.142:0/182777994 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bac021640 con 0x7f0bc4074f10 2024-04-20T22:05:21.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.782+0000 7f0bc9800700 1 -- 172.21.15.142:0/182777994 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc419e000 con 0x7f0bc4074f10 2024-04-20T22:05:21.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.783+0000 7f0bc9800700 1 -- 172.21.15.142:0/182777994 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc419e570 con 0x7f0bc4074f10 2024-04-20T22:05:21.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.784+0000 7f0bc9800700 1 -- 172.21.15.142:0/182777994 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc4192a30 con 0x7f0bc4074f10 2024-04-20T22:05:21.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.785+0000 7f0bbb400700 1 -- 172.21.15.142:0/182777994 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f0bac00f5d0 con 0x7f0bc4074f10 2024-04-20T22:05:21.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.786+0000 7f0bbb400700 1 --2- 172.21.15.142:0/182777994 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0ba806ecc0 0x7f0ba8071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:21.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.786+0000 7f0bbb400700 1 -- 172.21.15.142:0/182777994 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0bac090100 con 0x7f0bc4074f10 2024-04-20T22:05:21.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.786+0000 7f0bc2a00700 1 --2- 172.21.15.142:0/182777994 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0ba806ecc0 0x7f0ba8071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:21.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.787+0000 7f0bc2a00700 1 --2- 172.21.15.142:0/182777994 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0ba806ecc0 0x7f0ba8071180 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4006fd0 tx=0x7f0bb4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:21.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:21.791+0000 7f0bbb400700 1 -- 172.21.15.142:0/182777994 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f0bac05cac0 con 0x7f0bc4074f10 2024-04-20T22:05:22.046 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.046+0000 7f0bc9800700 1 -- 172.21.15.142:0/182777994 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0bc4062510 con 0x7f0bc4074f10 2024-04-20T22:05:22.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.047+0000 7f0bbb400700 1 -- 172.21.15.142:0/182777994 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1898 (secure 0 0 0) 0x7f0bac05c650 con 0x7f0bc4074f10 2024-04-20T22:05:22.047 INFO:teuthology.orchestra.run.smithi142.stdout:e12 2024-04-20T22:05:22.048 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:05:22.048 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:05:22.048 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T22:05:22.048 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:05:22.048 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T22:05:22.048 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T22:05:22.048 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 12 2024-04-20T22:05:22.048 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:05:22.048 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:05:22.048 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T21:54:51.692699+0000 2024-04-20T22:05:22.048 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T22:05:22.048 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T22:05:22.048 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T22:05:22.048 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T22:05:22.049 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T22:05:22.049 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T22:05:22.049 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T22:05:22.049 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T22:05:22.049 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2024-04-20T22:05:22.049 INFO:teuthology.orchestra.run.smithi142.stdout:snap_rstat 1 2024-04-20T22:05:22.049 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:05:22.049 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T22:05:22.049 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T22:05:22.049 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14468} 2024-04-20T22:05:22.049 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T22:05:22.049 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T22:05:22.049 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T22:05:22.049 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T22:05:22.049 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T22:05:22.050 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T22:05:22.050 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T22:05:22.050 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T22:05:22.050 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T22:05:22.050 INFO:teuthology.orchestra.run.smithi142.stdout:qdb_cluster leader: 0 members: 2024-04-20T22:05:22.050 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:14468} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.142:6826/2866697672,v1:172.21.15.142:6827/2866697672] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:05:22.050 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:05:22.050 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:05:22.050 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T22:05:22.050 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:05:22.050 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:14484} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:05:22.050 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:05:22.051 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:05:22.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.050+0000 7f0bc9800700 1 -- 172.21.15.142:0/182777994 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0ba806ecc0 msgr2=0x7f0ba8071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:22.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.050+0000 7f0bc9800700 1 --2- 172.21.15.142:0/182777994 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0ba806ecc0 0x7f0ba8071180 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4006fd0 tx=0x7f0bb4008040 comp rx=0 tx=0).stop 2024-04-20T22:05:22.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.050+0000 7f0bc9800700 1 -- 172.21.15.142:0/182777994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bc4074f10 msgr2=0x7f0bc4198ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:22.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.050+0000 7f0bc9800700 1 --2- 172.21.15.142:0/182777994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bc4074f10 0x7f0bc4198ef0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0bac0059d0 tx=0x7f0bac00be20 comp rx=0 tx=0).stop 2024-04-20T22:05:22.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.051+0000 7f0bc9800700 1 -- 172.21.15.142:0/182777994 shutdown_connections 2024-04-20T22:05:22.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.051+0000 7f0bc9800700 1 --2- 172.21.15.142:0/182777994 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0ba806ecc0 0x7f0ba8071180 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:22.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.051+0000 7f0bc9800700 1 --2- 172.21.15.142:0/182777994 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bc4073940 0x7f0bc41989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:22.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.051+0000 7f0bc9800700 1 --2- 172.21.15.142:0/182777994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0bc4074f10 0x7f0bc4198ef0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:22.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.051+0000 7f0bc9800700 1 -- 172.21.15.142:0/182777994 >> 172.21.15.142:0/182777994 conn(0x7f0bc40fc1c0 msgr2=0x7f0bc4106ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:22.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.051+0000 7f0bc9800700 1 -- 172.21.15.142:0/182777994 shutdown_connections 2024-04-20T22:05:22.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.051+0000 7f0bc9800700 1 -- 172.21.15.142:0/182777994 wait complete. 2024-04-20T22:05:22.052 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2024-04-20T22:05:22.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:21 smithi164 podman[88778]: 2024-04-20 22:05:21.915771387 +0000 UTC m=+1.612866073 container died 4f36124aeb0dba966f3767f375b6d589da9db2cb7fa7f137e24c7833835974c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=reef-646b8c7, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-20T22:05:22.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.200+0000 7fee17000700 1 -- 172.21.15.142:0/738167004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee10107240 msgr2=0x7fee10107660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:22.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.200+0000 7fee17000700 1 --2- 172.21.15.142:0/738167004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee10107240 0x7fee10107660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fee00009910 tx=0x7fee00009c20 comp rx=0 tx=0).stop 2024-04-20T22:05:22.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.200+0000 7fee17000700 1 -- 172.21.15.142:0/738167004 shutdown_connections 2024-04-20T22:05:22.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.200+0000 7fee17000700 1 --2- 172.21.15.142:0/738167004 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee10108440 0x7fee101088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:22.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.200+0000 7fee17000700 1 --2- 172.21.15.142:0/738167004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee10107240 0x7fee10107660 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:22.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.200+0000 7fee17000700 1 -- 172.21.15.142:0/738167004 >> 172.21.15.142:0/738167004 conn(0x7fee10076230 msgr2=0x7fee10078650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:22.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.200+0000 7fee17000700 1 -- 172.21.15.142:0/738167004 shutdown_connections 2024-04-20T22:05:22.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.200+0000 7fee17000700 1 -- 172.21.15.142:0/738167004 wait complete. 2024-04-20T22:05:22.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.201+0000 7fee17000700 1 Processor -- start 2024-04-20T22:05:22.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.201+0000 7fee17000700 1 -- start start 2024-04-20T22:05:22.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.202+0000 7fee17000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee10107240 0x7fee1019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:22.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.202+0000 7fee17000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee10108440 0x7fee1019d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:22.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.202+0000 7fee17000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1019d890 con 0x7fee10108440 2024-04-20T22:05:22.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.202+0000 7fee17000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee101a2250 con 0x7fee10107240 2024-04-20T22:05:22.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.202+0000 7fee0f400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee10108440 0x7fee1019d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:22.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.202+0000 7fee0f400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee10108440 0x7fee1019d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42304/0 (socket says 172.21.15.142:42304) 2024-04-20T22:05:22.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.202+0000 7fee0f400700 1 -- 172.21.15.142:0/146658516 learned_addr learned my addr 172.21.15.142:0/146658516 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:05:22.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.203+0000 7fee0f400700 1 -- 172.21.15.142:0/146658516 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee10107240 msgr2=0x7fee1019cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:22.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.203+0000 7fee0f400700 1 --2- 172.21.15.142:0/146658516 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee10107240 0x7fee1019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:22.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.203+0000 7fee0f400700 1 -- 172.21.15.142:0/146658516 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee000095f0 con 0x7fee10108440 2024-04-20T22:05:22.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.203+0000 7fee0f400700 1 --2- 172.21.15.142:0/146658516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee10108440 0x7fee1019d270 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fedfc00b4b0 tx=0x7fedfc00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:22.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.203+0000 7fee0cc00700 1 -- 172.21.15.142:0/146658516 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedfc011800 con 0x7fee10108440 2024-04-20T22:05:22.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.203+0000 7fee0cc00700 1 -- 172.21.15.142:0/146658516 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fedfc011e20 con 0x7fee10108440 2024-04-20T22:05:22.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.203+0000 7fee17000700 1 -- 172.21.15.142:0/146658516 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee101a2450 con 0x7fee10108440 2024-04-20T22:05:22.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.203+0000 7fee0cc00700 1 -- 172.21.15.142:0/146658516 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedfc00f2e0 con 0x7fee10108440 2024-04-20T22:05:22.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.203+0000 7fee17000700 1 -- 172.21.15.142:0/146658516 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee101a29f0 con 0x7fee10108440 2024-04-20T22:05:22.204 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.204+0000 7fee17000700 1 -- 172.21.15.142:0/146658516 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee10196e40 con 0x7fee10108440 2024-04-20T22:05:22.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.206+0000 7fee0cc00700 1 -- 172.21.15.142:0/146658516 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fedfc010380 con 0x7fee10108440 2024-04-20T22:05:22.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.207+0000 7fee0cc00700 1 --2- 172.21.15.142:0/146658516 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fedf406ecd0 0x7fedf4071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:22.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.207+0000 7fee0cc00700 1 -- 172.21.15.142:0/146658516 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fedfc08ea90 con 0x7fee10108440 2024-04-20T22:05:22.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.207+0000 7fee0fe00700 1 --2- 172.21.15.142:0/146658516 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fedf406ecd0 0x7fedf4071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:22.207 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.208+0000 7fee0fe00700 1 --2- 172.21.15.142:0/146658516 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fedf406ecd0 0x7fedf4071190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fee00005950 tx=0x7fee000058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:22.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.212+0000 7fee0cc00700 1 -- 172.21.15.142:0/146658516 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fedfc057800 con 0x7fee10108440 2024-04-20T22:05:22.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.478+0000 7fee17000700 1 -- 172.21.15.142:0/146658516 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fee1002ce50 con 0x7fedf406ecd0 2024-04-20T22:05:22.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.479+0000 7fee0cc00700 1 -- 172.21.15.142:0/146658516 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fee1002ce50 con 0x7fedf406ecd0 2024-04-20T22:05:22.479 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:05:22.479 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T22:05:22.479 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T22:05:22.479 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T22:05:22.479 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T22:05:22.479 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr", 2024-04-20T22:05:22.479 INFO:teuthology.orchestra.run.smithi142.stdout: "mon", 2024-04-20T22:05:22.480 INFO:teuthology.orchestra.run.smithi142.stdout: "crash" 2024-04-20T22:05:22.480 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T22:05:22.480 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "11/23 daemons upgraded", 2024-04-20T22:05:22.480 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading osd daemons", 2024-04-20T22:05:22.480 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T22:05:22.480 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:05:22.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.482+0000 7fee17000700 1 -- 172.21.15.142:0/146658516 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fedf406ecd0 msgr2=0x7fedf4071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:22.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.482+0000 7fee17000700 1 --2- 172.21.15.142:0/146658516 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fedf406ecd0 0x7fedf4071190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fee00005950 tx=0x7fee000058e0 comp rx=0 tx=0).stop 2024-04-20T22:05:22.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.482+0000 7fee17000700 1 -- 172.21.15.142:0/146658516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee10108440 msgr2=0x7fee1019d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:22.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.482+0000 7fee17000700 1 --2- 172.21.15.142:0/146658516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee10108440 0x7fee1019d270 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fedfc00b4b0 tx=0x7fedfc00b870 comp rx=0 tx=0).stop 2024-04-20T22:05:22.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.482+0000 7fee17000700 1 -- 172.21.15.142:0/146658516 shutdown_connections 2024-04-20T22:05:22.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.482+0000 7fee17000700 1 --2- 172.21.15.142:0/146658516 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fedf406ecd0 0x7fedf4071190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:22.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.482+0000 7fee17000700 1 --2- 172.21.15.142:0/146658516 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee10107240 0x7fee1019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:22.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.482+0000 7fee17000700 1 --2- 172.21.15.142:0/146658516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee10108440 0x7fee1019d270 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:22.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.482+0000 7fee17000700 1 -- 172.21.15.142:0/146658516 >> 172.21.15.142:0/146658516 conn(0x7fee10076230 msgr2=0x7fee1010ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:22.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.482+0000 7fee17000700 1 -- 172.21.15.142:0/146658516 shutdown_connections 2024-04-20T22:05:22.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.482+0000 7fee17000700 1 -- 172.21.15.142:0/146658516 wait complete. 2024-04-20T22:05:22.577 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:22 smithi164 podman[88778]: 2024-04-20 22:05:22.317339184 +0000 UTC m=+2.014433901 container cleanup 4f36124aeb0dba966f3767f375b6d589da9db2cb7fa7f137e24c7833835974c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, RELEASE=reef-646b8c7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-04-20T22:05:22.577 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:22 smithi164 bash[88778]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5 2024-04-20T22:05:22.577 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:22 smithi164 ceph-mon[69784]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-20T22:05:22.577 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:22 smithi164 ceph-mon[69784]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-20T22:05:22.577 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:22 smithi164 ceph-mon[69784]: osdmap e76: 6 total, 5 up, 6 in 2024-04-20T22:05:22.577 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:22 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/201655494' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:05:22.577 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:22 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/182777994' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:05:22.577 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:22 smithi164 ceph-mon[69784]: osdmap e77: 6 total, 5 up, 6 in 2024-04-20T22:05:22.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.624+0000 7f103a800700 1 -- 172.21.15.142:0/679096752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1034108430 msgr2=0x7f10341088b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:22.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.624+0000 7f103a800700 1 --2- 172.21.15.142:0/679096752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1034108430 0x7f10341088b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f101c009910 tx=0x7f101c009c20 comp rx=0 tx=0).stop 2024-04-20T22:05:22.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.624+0000 7f103a800700 1 -- 172.21.15.142:0/679096752 shutdown_connections 2024-04-20T22:05:22.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.624+0000 7f103a800700 1 --2- 172.21.15.142:0/679096752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1034108430 0x7f10341088b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:22.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.624+0000 7f103a800700 1 --2- 172.21.15.142:0/679096752 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1034107260 0x7f1034107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:22.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.624+0000 7f103a800700 1 -- 172.21.15.142:0/679096752 >> 172.21.15.142:0/679096752 conn(0x7f1034076400 msgr2=0x7f1034078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:22.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.624+0000 7f103a800700 1 -- 172.21.15.142:0/679096752 shutdown_connections 2024-04-20T22:05:22.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.625+0000 7f103a800700 1 -- 172.21.15.142:0/679096752 wait complete. 2024-04-20T22:05:22.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.625+0000 7f103a800700 1 Processor -- start 2024-04-20T22:05:22.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.626+0000 7f103a800700 1 -- start start 2024-04-20T22:05:22.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.626+0000 7f103a800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1034107260 0x7f103419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:22.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.626+0000 7f103a800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1034108430 0x7f103419d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:22.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.626+0000 7f103a800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103419d6a0 con 0x7f1034107260 2024-04-20T22:05:22.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.626+0000 7f103a800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103419d7e0 con 0x7f1034108430 2024-04-20T22:05:22.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.626+0000 7f1033400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1034107260 0x7f103419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:22.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.626+0000 7f1033400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1034107260 0x7f103419cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42332/0 (socket says 172.21.15.142:42332) 2024-04-20T22:05:22.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.626+0000 7f1033400700 1 -- 172.21.15.142:0/732195840 learned_addr learned my addr 172.21.15.142:0/732195840 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:05:22.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.627+0000 7f102be00700 1 --2- 172.21.15.142:0/732195840 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1034108430 0x7f103419d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:22.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.627+0000 7f1033400700 1 -- 172.21.15.142:0/732195840 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1034108430 msgr2=0x7f103419d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:22.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.627+0000 7f1033400700 1 --2- 172.21.15.142:0/732195840 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1034108430 0x7f103419d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:22.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.627+0000 7f1033400700 1 -- 172.21.15.142:0/732195840 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c0095f0 con 0x7f1034107260 2024-04-20T22:05:22.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.627+0000 7f1033400700 1 --2- 172.21.15.142:0/732195840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1034107260 0x7f103419cbd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f102400c930 tx=0x7f102400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:22.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.627+0000 7f1030c00700 1 -- 172.21.15.142:0/732195840 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1024007ad0 con 0x7f1034107260 2024-04-20T22:05:22.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.627+0000 7f1030c00700 1 -- 172.21.15.142:0/732195840 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1024007c30 con 0x7f1034107260 2024-04-20T22:05:22.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.627+0000 7f103a800700 1 -- 172.21.15.142:0/732195840 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10341a2250 con 0x7f1034107260 2024-04-20T22:05:22.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.627+0000 7f1030c00700 1 -- 172.21.15.142:0/732195840 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1024018610 con 0x7f1034107260 2024-04-20T22:05:22.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.627+0000 7f103a800700 1 -- 172.21.15.142:0/732195840 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10341a27f0 con 0x7f1034107260 2024-04-20T22:05:22.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.628+0000 7f103a800700 1 -- 172.21.15.142:0/732195840 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1034196dd0 con 0x7f1034107260 2024-04-20T22:05:22.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.629+0000 7f1030c00700 1 -- 172.21.15.142:0/732195840 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f102400f450 con 0x7f1034107260 2024-04-20T22:05:22.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.630+0000 7f1030c00700 1 --2- 172.21.15.142:0/732195840 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f101806ecc0 0x7f1018071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:22.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.630+0000 7f1030c00700 1 -- 172.21.15.142:0/732195840 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f102408f040 con 0x7f1034107260 2024-04-20T22:05:22.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.631+0000 7f102be00700 1 --2- 172.21.15.142:0/732195840 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f101806ecc0 0x7f1018071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:22.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.631+0000 7f102be00700 1 --2- 172.21.15.142:0/732195840 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f101806ecc0 0x7f1018071180 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f101c0051c0 tx=0x7f101c005920 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:22.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.635+0000 7f1030c00700 1 -- 172.21.15.142:0/732195840 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f102405b980 con 0x7f1034107260 2024-04-20T22:05:22.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:22 smithi142 ceph-mon[79401]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-20T22:05:22.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:22 smithi142 ceph-mon[79401]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-20T22:05:22.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:22 smithi142 ceph-mon[79401]: osdmap e76: 6 total, 5 up, 6 in 2024-04-20T22:05:22.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:22 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/201655494' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:05:22.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:22 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/182777994' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:05:22.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:22 smithi142 ceph-mon[79401]: osdmap e77: 6 total, 5 up, 6 in 2024-04-20T22:05:22.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.928+0000 7f103a800700 1 -- 172.21.15.142:0/732195840 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f103404ebb0 con 0x7f1034107260 2024-04-20T22:05:22.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.929+0000 7f1030c00700 1 -- 172.21.15.142:0/732195840 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+337 (secure 0 0 0) 0x7f102405b510 con 0x7f1034107260 2024-04-20T22:05:22.929 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid 2024-04-20T22:05:22.929 INFO:teuthology.orchestra.run.smithi142.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-20T22:05:22.929 INFO:teuthology.orchestra.run.smithi142.stdout: osd.5 (root=default,host=smithi164) is down 2024-04-20T22:05:22.929 INFO:teuthology.orchestra.run.smithi142.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-04-20T22:05:22.929 INFO:teuthology.orchestra.run.smithi142.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-04-20T22:05:22.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.931+0000 7f103a800700 1 -- 172.21.15.142:0/732195840 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f101806ecc0 msgr2=0x7f1018071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:22.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.931+0000 7f103a800700 1 --2- 172.21.15.142:0/732195840 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f101806ecc0 0x7f1018071180 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f101c0051c0 tx=0x7f101c005920 comp rx=0 tx=0).stop 2024-04-20T22:05:22.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.931+0000 7f103a800700 1 -- 172.21.15.142:0/732195840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1034107260 msgr2=0x7f103419cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:22.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.931+0000 7f103a800700 1 --2- 172.21.15.142:0/732195840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1034107260 0x7f103419cbd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f102400c930 tx=0x7f102400ccf0 comp rx=0 tx=0).stop 2024-04-20T22:05:22.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.931+0000 7f103a800700 1 -- 172.21.15.142:0/732195840 shutdown_connections 2024-04-20T22:05:22.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.931+0000 7f103a800700 1 --2- 172.21.15.142:0/732195840 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f101806ecc0 0x7f1018071180 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:22.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.931+0000 7f103a800700 1 --2- 172.21.15.142:0/732195840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1034107260 0x7f103419cbd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:22.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.931+0000 7f103a800700 1 --2- 172.21.15.142:0/732195840 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1034108430 0x7f103419d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:22.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.931+0000 7f103a800700 1 -- 172.21.15.142:0/732195840 >> 172.21.15.142:0/732195840 conn(0x7f1034076400 msgr2=0x7f103410b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:22.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.932+0000 7f103a800700 1 -- 172.21.15.142:0/732195840 shutdown_connections 2024-04-20T22:05:22.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:22.932+0000 7f103a800700 1 -- 172.21.15.142:0/732195840 wait complete. 2024-04-20T22:05:22.946 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:22 smithi164 podman[88798]: 2024-04-20 22:05:22.576614472 +0000 UTC m=+0.645797022 container remove 4f36124aeb0dba966f3767f375b6d589da9db2cb7fa7f137e24c7833835974c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:417b28a7fda24d3105eeb9bae56a845b9ffa154499a85601880a5fd035847210, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=reef-646b8c7, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-20T22:05:23.696 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:23 smithi164 podman[88885]: 2024-04-20 22:05:23.336650132 +0000 UTC m=+0.036347446 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:05:23.696 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:23 smithi164 podman[88885]: 2024-04-20 22:05:23.452471332 +0000 UTC m=+0.152168709 container create a970d38b99a3bbff04fd531a78415653741213eb20095ca117a9121519fcb6a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-20T22:05:23.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:23 smithi164 ceph-mon[69784]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:05:23.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:23 smithi164 ceph-mon[69784]: pgmap v184: 65 pgs: 13 stale+active+clean, 52 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:23.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:23 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/732195840' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:05:23.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:23 smithi142 ceph-mon[79401]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:05:23.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:23 smithi142 ceph-mon[79401]: pgmap v184: 65 pgs: 13 stale+active+clean, 52 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail 2024-04-20T22:05:23.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:23 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/732195840' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:05:24.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:23 smithi164 podman[88885]: 2024-04-20 22:05:23.765502154 +0000 UTC m=+0.465199544 container init a970d38b99a3bbff04fd531a78415653741213eb20095ca117a9121519fcb6a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T22:05:24.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:23 smithi164 podman[88885]: 2024-04-20 22:05:23.776569231 +0000 UTC m=+0.476266607 container start a970d38b99a3bbff04fd531a78415653741213eb20095ca117a9121519fcb6a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-deactivate, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-20T22:05:24.197 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:23 smithi164 podman[88885]: 2024-04-20 22:05:23.880398336 +0000 UTC m=+0.580095729 container attach a970d38b99a3bbff04fd531a78415653741213eb20095ca117a9121519fcb6a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.license=GPLv2) 2024-04-20T22:05:24.603 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:24 smithi164 podman[88885]: 2024-04-20 22:05:24.234571114 +0000 UTC m=+0.934268484 container died a970d38b99a3bbff04fd531a78415653741213eb20095ca117a9121519fcb6a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-04-20T22:05:24.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:24 smithi164 ceph-mon[69784]: Health check failed: Degraded data redundancy: 14/231 objects degraded (6.061%), 6 pgs degraded (PG_DEGRADED) 2024-04-20T22:05:24.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:24 smithi142 ceph-mon[79401]: Health check failed: Degraded data redundancy: 14/231 objects degraded (6.061%), 6 pgs degraded (PG_DEGRADED) 2024-04-20T22:05:25.446 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:25 smithi164 podman[88911]: 2024-04-20 22:05:25.034056531 +0000 UTC m=+0.781116312 container remove a970d38b99a3bbff04fd531a78415653741213eb20095ca117a9121519fcb6a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-20T22:05:25.446 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:25 smithi164 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.5.service: Deactivated successfully. 2024-04-20T22:05:25.446 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:25 smithi164 systemd[1]: Stopped Ceph osd.5 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T22:05:25.446 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:25 smithi164 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.5.service: Consumed 2min 12.823s CPU time. 2024-04-20T22:05:25.819 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:25 smithi164 ceph-mon[69784]: pgmap v185: 65 pgs: 6 active+undersized+degraded, 5 stale+active+clean, 9 active+undersized, 45 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 14/231 objects degraded (6.061%) 2024-04-20T22:05:25.819 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:25 smithi164 systemd[1]: Starting Ceph osd.5 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:05:25.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:25 smithi142 ceph-mon[79401]: pgmap v185: 65 pgs: 6 active+undersized+degraded, 5 stale+active+clean, 9 active+undersized, 45 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 14/231 objects degraded (6.061%) 2024-04-20T22:05:26.122 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:25 smithi164 podman[89011]: 2024-04-20 22:05:25.724755585 +0000 UTC m=+0.032754132 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:05:26.122 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:25 smithi164 podman[89011]: 2024-04-20 22:05:25.826672658 +0000 UTC m=+0.134671243 container create 8d6117338057c046001ef8bc38182f1d0c25d7735ef645b0dde1c9e126cc5891 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-20T22:05:26.446 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:26 smithi164 podman[89011]: 2024-04-20 22:05:26.122293512 +0000 UTC m=+0.430292103 container init 8d6117338057c046001ef8bc38182f1d0c25d7735ef645b0dde1c9e126cc5891 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T22:05:26.447 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:26 smithi164 podman[89011]: 2024-04-20 22:05:26.134230685 +0000 UTC m=+0.442229245 container start 8d6117338057c046001ef8bc38182f1d0c25d7735ef645b0dde1c9e126cc5891 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T22:05:26.447 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:26 smithi164 podman[89011]: 2024-04-20 22:05:26.220920347 +0000 UTC m=+0.528918978 container attach 8d6117338057c046001ef8bc38182f1d0c25d7735ef645b0dde1c9e126cc5891 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416) 2024-04-20T22:05:27.351 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-activate[89026]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:05:27.351 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-activate[89026]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:05:27.351 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 bash[89011]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:05:27.351 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 bash[89011]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-20T22:05:27.351 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 bash[89011]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-20T22:05:27.351 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 bash[89011]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-20T22:05:27.351 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 bash[89011]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-20T22:05:27.351 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 bash[89011]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-20T22:05:27.351 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 bash[89011]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-20T22:05:27.351 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 bash[89011]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-20T22:05:27.351 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 bash[89011]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-20T22:05:27.351 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-activate[89026]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-20T22:05:27.351 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-activate[89026]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-20T22:05:27.352 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-activate[89026]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-20T22:05:27.352 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-activate[89026]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-20T22:05:27.352 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-activate[89026]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-20T22:05:27.352 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-activate[89026]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-20T22:05:27.352 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-activate[89026]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-20T22:05:27.352 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 podman[89011]: 2024-04-20 22:05:27.140789446 +0000 UTC m=+1.448788018 container died 8d6117338057c046001ef8bc38182f1d0c25d7735ef645b0dde1c9e126cc5891 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True) 2024-04-20T22:05:27.890 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:27 smithi164 ceph-mon[69784]: pgmap v186: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 36/231 objects degraded (15.584%) 2024-04-20T22:05:27.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:27 smithi142 ceph-mon[79401]: pgmap v186: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 36/231 objects degraded (15.584%) 2024-04-20T22:05:28.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:27 smithi164 podman[89152]: 2024-04-20 22:05:27.891201863 +0000 UTC m=+0.728850001 container remove 8d6117338057c046001ef8bc38182f1d0c25d7735ef645b0dde1c9e126cc5891 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, ceph=True) 2024-04-20T22:05:28.528 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:28 smithi164 podman[89216]: 2024-04-20 22:05:28.147056716 +0000 UTC m=+0.036745254 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:05:28.528 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:28 smithi164 podman[89216]: 2024-04-20 22:05:28.27543028 +0000 UTC m=+0.165118815 container create ac1bdd69c94494161c1f049f8094a9affe13820876f019557fd5a12aae87e00f (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-20T22:05:28.946 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:28 smithi164 podman[89216]: 2024-04-20 22:05:28.52890273 +0000 UTC m=+0.418591338 container init ac1bdd69c94494161c1f049f8094a9affe13820876f019557fd5a12aae87e00f (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-20T22:05:28.946 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:28 smithi164 podman[89216]: 2024-04-20 22:05:28.539611223 +0000 UTC m=+0.429299767 container start ac1bdd69c94494161c1f049f8094a9affe13820876f019557fd5a12aae87e00f (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240416) 2024-04-20T22:05:28.946 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:28 smithi164 ceph-osd[89234]: -- 172.21.15.164:0/2343853468 <== mon.1 v2:172.21.15.164:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5601461e3680 con 0x5601461ad000 2024-04-20T22:05:28.947 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:28 smithi164 bash[89216]: ac1bdd69c94494161c1f049f8094a9affe13820876f019557fd5a12aae87e00f 2024-04-20T22:05:28.947 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:28 smithi164 systemd[1]: Started Ceph osd.5 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T22:05:29.445 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:29 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:05:29.114+0000 7ff044fc37c0 -1 Falling back to public interface 2024-04-20T22:05:30.026 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:29 smithi164 ceph-mon[69784]: pgmap v187: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 36/231 objects degraded (15.584%) 2024-04-20T22:05:30.026 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:30.027 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:30.027 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:05:30.027 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:30.027 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:05:30.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:29 smithi142 ceph-mon[79401]: pgmap v187: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 36/231 objects degraded (15.584%) 2024-04-20T22:05:30.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:30.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:30.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:05:30.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:30.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:05:31.852 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:31 smithi164 ceph-mon[69784]: pgmap v188: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 36/231 objects degraded (15.584%) 2024-04-20T22:05:31.852 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:31 smithi164 ceph-mon[69784]: Health check update: Degraded data redundancy: 36/231 objects degraded (15.584%), 12 pgs degraded (PG_DEGRADED) 2024-04-20T22:05:32.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:31 smithi142 ceph-mon[79401]: pgmap v188: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 36/231 objects degraded (15.584%) 2024-04-20T22:05:32.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:31 smithi142 ceph-mon[79401]: Health check update: Degraded data redundancy: 36/231 objects degraded (15.584%), 12 pgs degraded (PG_DEGRADED) 2024-04-20T22:05:34.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:34 smithi164 ceph-mon[69784]: pgmap v189: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 36/231 objects degraded (15.584%) 2024-04-20T22:05:34.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:34 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:34.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:34 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:34.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:34 smithi142 ceph-mon[79401]: pgmap v189: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 36/231 objects degraded (15.584%) 2024-04-20T22:05:34.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:34 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:34.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:34 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:34.945 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:34 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:05:34.490+0000 7ff044fc37c0 -1 osd.5 75 log_to_monitors true 2024-04-20T22:05:35.446 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:05:35 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:05:35.164+0000 7ff034400700 -1 osd.5 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T22:05:35.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:35 smithi164 ceph-mon[69784]: from='osd.5 [v2:172.21.15.164:6816/3289958207,v1:172.21.15.164:6817/3289958207]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-20T22:05:35.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:35 smithi164 ceph-mon[69784]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-20T22:05:35.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:35 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:35.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:35 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:35.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:35 smithi142 ceph-mon[79401]: from='osd.5 [v2:172.21.15.164:6816/3289958207,v1:172.21.15.164:6817/3289958207]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-20T22:05:35.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:35 smithi142 ceph-mon[79401]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-20T22:05:35.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:35 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:35.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:35 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:36.368 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:36 smithi164 ceph-mon[69784]: pgmap v190: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 36/231 objects degraded (15.584%) 2024-04-20T22:05:36.368 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:36 smithi164 ceph-mon[69784]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-20T22:05:36.368 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:36 smithi164 ceph-mon[69784]: osdmap e78: 6 total, 5 up, 6 in 2024-04-20T22:05:36.368 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:36 smithi164 ceph-mon[69784]: from='osd.5 [v2:172.21.15.164:6816/3289958207,v1:172.21.15.164:6817/3289958207]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T22:05:36.368 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:36 smithi164 ceph-mon[69784]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T22:05:36.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:36 smithi142 ceph-mon[79401]: pgmap v190: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 984 MiB used, 535 GiB / 536 GiB avail; 36/231 objects degraded (15.584%) 2024-04-20T22:05:36.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:36 smithi142 ceph-mon[79401]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-20T22:05:36.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:36 smithi142 ceph-mon[79401]: osdmap e78: 6 total, 5 up, 6 in 2024-04-20T22:05:36.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:36 smithi142 ceph-mon[79401]: from='osd.5 [v2:172.21.15.164:6816/3289958207,v1:172.21.15.164:6817/3289958207]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T22:05:36.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:36 smithi142 ceph-mon[79401]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-04-20T22:05:37.185 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:37 smithi164 ceph-mon[69784]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-20T22:05:37.185 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:37 smithi164 ceph-mon[69784]: osd.5 [v2:172.21.15.164:6816/3289958207,v1:172.21.15.164:6817/3289958207] boot 2024-04-20T22:05:37.185 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:37 smithi164 ceph-mon[69784]: osdmap e79: 6 total, 6 up, 6 in 2024-04-20T22:05:37.185 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:37 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T22:05:37.186 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:37 smithi164 ceph-mon[69784]: osdmap e80: 6 total, 6 up, 6 in 2024-04-20T22:05:37.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:37 smithi142 ceph-mon[79401]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-20T22:05:37.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:37 smithi142 ceph-mon[79401]: osd.5 [v2:172.21.15.164:6816/3289958207,v1:172.21.15.164:6817/3289958207] boot 2024-04-20T22:05:37.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:37 smithi142 ceph-mon[79401]: osdmap e79: 6 total, 6 up, 6 in 2024-04-20T22:05:37.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:37 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T22:05:37.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:37 smithi142 ceph-mon[79401]: osdmap e80: 6 total, 6 up, 6 in 2024-04-20T22:05:38.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:38 smithi142 ceph-mon[79401]: pgmap v193: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 36/231 objects degraded (15.584%) 2024-04-20T22:05:38.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:38 smithi164 ceph-mon[69784]: pgmap v193: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 36/231 objects degraded (15.584%) 2024-04-20T22:05:39.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:39 smithi164 ceph-mon[69784]: Health check update: Degraded data redundancy: 30/231 objects degraded (12.987%), 9 pgs degraded (PG_DEGRADED) 2024-04-20T22:05:39.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:39 smithi142 ceph-mon[79401]: Health check update: Degraded data redundancy: 30/231 objects degraded (12.987%), 9 pgs degraded (PG_DEGRADED) 2024-04-20T22:05:40.571 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:40 smithi164 ceph-mon[69784]: pgmap v195: 65 pgs: 9 active+undersized+degraded, 12 active+undersized, 44 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 30/231 objects degraded (12.987%) 2024-04-20T22:05:40.598 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:40 smithi142 ceph-mon[79401]: pgmap v195: 65 pgs: 9 active+undersized+degraded, 12 active+undersized, 44 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 30/231 objects degraded (12.987%) 2024-04-20T22:05:41.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: pgmap v196: 65 pgs: 1 active+undersized, 64 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:05:41.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:41.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:41.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:05:41.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:05:41.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:41.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:05:41.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:05:41.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:05:41.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:05:41.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:05:41.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: Upgrade: Setting container_image for all osd 2024-04-20T22:05:41.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:41.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-20T22:05:41.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-20T22:05:41.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/231 objects degraded (12.987%), 9 pgs degraded) 2024-04-20T22:05:41.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-20T22:05:41.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-20T22:05:41.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-20T22:05:41.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-20T22:05:41.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-20T22:05:41.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-20T22:05:41.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-20T22:05:41.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-20T22:05:41.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-20T22:05:41.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-20T22:05:41.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: Upgrade: Setting require_osd_release to 19 squid 2024-04-20T22:05:41.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-20T22:05:42.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: pgmap v196: 65 pgs: 1 active+undersized, 64 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:05:42.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:42.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:42.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:05:42.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:05:42.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:42.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:05:42.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:05:42.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:05:42.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:05:42.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:05:42.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: Upgrade: Setting container_image for all osd 2024-04-20T22:05:42.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:42.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-20T22:05:42.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-20T22:05:42.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/231 objects degraded (12.987%), 9 pgs degraded) 2024-04-20T22:05:42.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-20T22:05:42.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-20T22:05:42.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-20T22:05:42.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-20T22:05:42.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-20T22:05:42.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-20T22:05:42.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-20T22:05:42.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-20T22:05:42.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-20T22:05:42.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-20T22:05:42.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: Upgrade: Setting require_osd_release to 19 squid 2024-04-20T22:05:42.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-20T22:05:43.178 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:42 smithi142 ceph-mon[79401]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-20T22:05:43.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:42 smithi142 ceph-mon[79401]: Cluster is now healthy 2024-04-20T22:05:43.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:42 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-20T22:05:43.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:42 smithi142 ceph-mon[79401]: osdmap e81: 6 total, 6 up, 6 in 2024-04-20T22:05:43.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:42 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi142.lirkws"]}]: dispatch 2024-04-20T22:05:43.179 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:42 smithi142 ceph-mon[79401]: Upgrade: It appears safe to stop mds.cephfs.smithi142.lirkws 2024-04-20T22:05:43.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:42 smithi164 ceph-mon[69784]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-20T22:05:43.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:42 smithi164 ceph-mon[69784]: Cluster is now healthy 2024-04-20T22:05:43.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:42 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-20T22:05:43.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:42 smithi164 ceph-mon[69784]: osdmap e81: 6 total, 6 up, 6 in 2024-04-20T22:05:43.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:42 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi142.lirkws"]}]: dispatch 2024-04-20T22:05:43.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:42 smithi164 ceph-mon[69784]: Upgrade: It appears safe to stop mds.cephfs.smithi142.lirkws 2024-04-20T22:05:44.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:44 smithi164 ceph-mon[69784]: pgmap v198: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:05:44.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:44 smithi142 ceph-mon[79401]: pgmap v198: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:05:45.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:45 smithi142 ceph-mon[79401]: pgmap v199: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:05:45.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:45.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:05:45.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:45 smithi142 ceph-mon[79401]: Upgrade: Updating mds.cephfs.smithi142.lirkws 2024-04-20T22:05:45.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:45.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.lirkws", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T22:05:45.797 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:05:45.798 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:45 smithi142 ceph-mon[79401]: Deploying daemon mds.cephfs.smithi142.lirkws on smithi142 2024-04-20T22:05:45.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:45 smithi164 ceph-mon[69784]: pgmap v199: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:05:45.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:05:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:45 smithi164 ceph-mon[69784]: Upgrade: Updating mds.cephfs.smithi142.lirkws 2024-04-20T22:05:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.lirkws", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T22:05:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:05:45.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:45 smithi164 ceph-mon[69784]: Deploying daemon mds.cephfs.smithi142.lirkws on smithi142 2024-04-20T22:05:47.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:47 smithi142 ceph-mon[79401]: pgmap v200: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:05:47.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:47 smithi164 ceph-mon[69784]: pgmap v200: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:05:48.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:47 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142[79397]: 2024-04-20T22:05:47.754+0000 7fc6cd800700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T22:05:48.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:48 smithi142 ceph-mon[79401]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-20T22:05:48.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:48 smithi142 ceph-mon[79401]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T22:05:48.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:48 smithi142 ceph-mon[79401]: osdmap e82: 6 total, 6 up, 6 in 2024-04-20T22:05:48.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:48 smithi142 ceph-mon[79401]: Standby daemon mds.cephfs.smithi142.lrvfgg assigned to filesystem cephfs as rank 0 2024-04-20T22:05:48.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:48 smithi142 ceph-mon[79401]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-20T22:05:48.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:48 smithi142 ceph-mon[79401]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-20T22:05:48.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:48 smithi142 ceph-mon[79401]: fsmap cephfs:1/1 {0=cephfs.smithi142.lrvfgg=up:replay} 2 up:standby 2024-04-20T22:05:48.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:48 smithi164 ceph-mon[69784]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-20T22:05:48.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:48 smithi164 ceph-mon[69784]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T22:05:48.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:48 smithi164 ceph-mon[69784]: osdmap e82: 6 total, 6 up, 6 in 2024-04-20T22:05:48.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:48 smithi164 ceph-mon[69784]: Standby daemon mds.cephfs.smithi142.lrvfgg assigned to filesystem cephfs as rank 0 2024-04-20T22:05:48.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:48 smithi164 ceph-mon[69784]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-20T22:05:48.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:48 smithi164 ceph-mon[69784]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-20T22:05:48.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:48 smithi164 ceph-mon[69784]: fsmap cephfs:1/1 {0=cephfs.smithi142.lrvfgg=up:replay} 2 up:standby 2024-04-20T22:05:50.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:49 smithi142 ceph-mon[79401]: pgmap v202: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 1 op/s 2024-04-20T22:05:50.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:49 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:50.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:49 smithi164 ceph-mon[69784]: pgmap v202: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 1 op/s 2024-04-20T22:05:50.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:49 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:05:51.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:50 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lirkws"}]: dispatch 2024-04-20T22:05:51.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:50 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lirkws"}]: dispatch 2024-04-20T22:05:52.079 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:51 smithi142 ceph-mon[79401]: pgmap v203: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 9.8 MiB/s rd, 3 op/s 2024-04-20T22:05:52.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:51 smithi164 ceph-mon[69784]: pgmap v203: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 9.8 MiB/s rd, 3 op/s 2024-04-20T22:05:53.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.093+0000 7fe49a800700 1 -- 172.21.15.142:0/1845875422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe494074f10 msgr2=0x7fe494073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:53.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.093+0000 7fe49a800700 1 --2- 172.21.15.142:0/1845875422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe494074f10 0x7fe494073370 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe484009910 tx=0x7fe484009c20 comp rx=0 tx=0).stop 2024-04-20T22:05:53.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.093+0000 7fe49a800700 1 -- 172.21.15.142:0/1845875422 shutdown_connections 2024-04-20T22:05:53.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.093+0000 7fe49a800700 1 --2- 172.21.15.142:0/1845875422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe494073940 0x7fe494073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:53.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.093+0000 7fe49a800700 1 --2- 172.21.15.142:0/1845875422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe494074f10 0x7fe494073370 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:53.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.093+0000 7fe49a800700 1 -- 172.21.15.142:0/1845875422 >> 172.21.15.142:0/1845875422 conn(0x7fe4940fc1c0 msgr2=0x7fe4940fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:53.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.093+0000 7fe49a800700 1 -- 172.21.15.142:0/1845875422 shutdown_connections 2024-04-20T22:05:53.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.093+0000 7fe49a800700 1 -- 172.21.15.142:0/1845875422 wait complete. 2024-04-20T22:05:53.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.095+0000 7fe49a800700 1 Processor -- start 2024-04-20T22:05:53.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.095+0000 7fe49a800700 1 -- start start 2024-04-20T22:05:53.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.095+0000 7fe49a800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe494073940 0x7fe494198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:53.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.095+0000 7fe49a800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe494074f10 0x7fe494198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:53.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.095+0000 7fe49a800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4941994d0 con 0x7fe494073940 2024-04-20T22:05:53.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.095+0000 7fe49a800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe494199610 con 0x7fe494074f10 2024-04-20T22:05:53.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.095+0000 7fe493400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe494073940 0x7fe494198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:53.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.095+0000 7fe493400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe494073940 0x7fe494198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40240/0 (socket says 172.21.15.142:40240) 2024-04-20T22:05:53.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.095+0000 7fe493400700 1 -- 172.21.15.142:0/3990646702 learned_addr learned my addr 172.21.15.142:0/3990646702 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:05:53.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.096+0000 7fe492a00700 1 --2- 172.21.15.142:0/3990646702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe494074f10 0x7fe494198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:53.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.096+0000 7fe493400700 1 -- 172.21.15.142:0/3990646702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe494074f10 msgr2=0x7fe494198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:53.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.096+0000 7fe493400700 1 --2- 172.21.15.142:0/3990646702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe494074f10 0x7fe494198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:53.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.096+0000 7fe493400700 1 -- 172.21.15.142:0/3990646702 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4840095f0 con 0x7fe494073940 2024-04-20T22:05:53.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.096+0000 7fe493400700 1 --2- 172.21.15.142:0/3990646702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe494073940 0x7fe494198970 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe484000c00 tx=0x7fe48400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:53.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.097+0000 7fe48be00700 1 -- 172.21.15.142:0/3990646702 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe48401d070 con 0x7fe494073940 2024-04-20T22:05:53.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.097+0000 7fe48be00700 1 -- 172.21.15.142:0/3990646702 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe48400f460 con 0x7fe494073940 2024-04-20T22:05:53.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.097+0000 7fe48be00700 1 -- 172.21.15.142:0/3990646702 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe484021640 con 0x7fe494073940 2024-04-20T22:05:53.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.097+0000 7fe49a800700 1 -- 172.21.15.142:0/3990646702 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49419e010 con 0x7fe494073940 2024-04-20T22:05:53.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.097+0000 7fe49a800700 1 -- 172.21.15.142:0/3990646702 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49419e4e0 con 0x7fe494073940 2024-04-20T22:05:53.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.099+0000 7fe49a800700 1 -- 172.21.15.142:0/3990646702 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe494192a50 con 0x7fe494073940 2024-04-20T22:05:53.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.100+0000 7fe48be00700 1 -- 172.21.15.142:0/3990646702 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fe48400fab0 con 0x7fe494073940 2024-04-20T22:05:53.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.101+0000 7fe48be00700 1 --2- 172.21.15.142:0/3990646702 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe47806ecc0 0x7fe478071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:53.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.101+0000 7fe48be00700 1 -- 172.21.15.142:0/3990646702 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fe4840902d0 con 0x7fe494073940 2024-04-20T22:05:53.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.102+0000 7fe492a00700 1 --2- 172.21.15.142:0/3990646702 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe47806ecc0 0x7fe478071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:53.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.102+0000 7fe492a00700 1 --2- 172.21.15.142:0/3990646702 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe47806ecc0 0x7fe478071180 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe480006fd0 tx=0x7fe480008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:53.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.107+0000 7fe48be00700 1 -- 172.21.15.142:0/3990646702 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fe48405cb10 con 0x7fe494073940 2024-04-20T22:05:53.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.371+0000 7fe49a800700 1 -- 172.21.15.142:0/3990646702 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe49402cdb0 con 0x7fe47806ecc0 2024-04-20T22:05:53.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.373+0000 7fe48be00700 1 -- 172.21.15.142:0/3990646702 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe49402cdb0 con 0x7fe47806ecc0 2024-04-20T22:05:53.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.375+0000 7fe49a800700 1 -- 172.21.15.142:0/3990646702 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe47806ecc0 msgr2=0x7fe478071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:53.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.375+0000 7fe49a800700 1 --2- 172.21.15.142:0/3990646702 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe47806ecc0 0x7fe478071180 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe480006fd0 tx=0x7fe480008040 comp rx=0 tx=0).stop 2024-04-20T22:05:53.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.375+0000 7fe49a800700 1 -- 172.21.15.142:0/3990646702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe494073940 msgr2=0x7fe494198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:53.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.375+0000 7fe49a800700 1 --2- 172.21.15.142:0/3990646702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe494073940 0x7fe494198970 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe484000c00 tx=0x7fe48400be20 comp rx=0 tx=0).stop 2024-04-20T22:05:53.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.375+0000 7fe49a800700 1 -- 172.21.15.142:0/3990646702 shutdown_connections 2024-04-20T22:05:53.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.375+0000 7fe49a800700 1 --2- 172.21.15.142:0/3990646702 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe47806ecc0 0x7fe478071180 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:53.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.375+0000 7fe49a800700 1 --2- 172.21.15.142:0/3990646702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe494073940 0x7fe494198970 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:53.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.375+0000 7fe49a800700 1 --2- 172.21.15.142:0/3990646702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe494074f10 0x7fe494198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:53.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.375+0000 7fe49a800700 1 -- 172.21.15.142:0/3990646702 >> 172.21.15.142:0/3990646702 conn(0x7fe4940fc1c0 msgr2=0x7fe494106ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:53.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.376+0000 7fe49a800700 1 -- 172.21.15.142:0/3990646702 shutdown_connections 2024-04-20T22:05:53.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.376+0000 7fe49a800700 1 -- 172.21.15.142:0/3990646702 wait complete. 2024-04-20T22:05:53.390 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T22:05:53.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.524+0000 7fbf61c00700 1 -- 172.21.15.142:0/2181900614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf5c073940 msgr2=0x7fbf5c073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:53.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.524+0000 7fbf61c00700 1 --2- 172.21.15.142:0/2181900614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf5c073940 0x7fbf5c073dc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009910 tx=0x7fbf48009c20 comp rx=0 tx=0).stop 2024-04-20T22:05:53.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.525+0000 7fbf61c00700 1 -- 172.21.15.142:0/2181900614 shutdown_connections 2024-04-20T22:05:53.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.525+0000 7fbf61c00700 1 --2- 172.21.15.142:0/2181900614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf5c073940 0x7fbf5c073dc0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:53.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.525+0000 7fbf61c00700 1 --2- 172.21.15.142:0/2181900614 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf5c074f10 0x7fbf5c073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:53.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.525+0000 7fbf61c00700 1 -- 172.21.15.142:0/2181900614 >> 172.21.15.142:0/2181900614 conn(0x7fbf5c0fc000 msgr2=0x7fbf5c0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:53.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.525+0000 7fbf61c00700 1 -- 172.21.15.142:0/2181900614 shutdown_connections 2024-04-20T22:05:53.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.525+0000 7fbf61c00700 1 -- 172.21.15.142:0/2181900614 wait complete. 2024-04-20T22:05:53.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.526+0000 7fbf61c00700 1 Processor -- start 2024-04-20T22:05:53.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.526+0000 7fbf61c00700 1 -- start start 2024-04-20T22:05:53.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.527+0000 7fbf61c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf5c073940 0x7fbf5c19ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:53.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.527+0000 7fbf61c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf5c074f10 0x7fbf5c19cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:53.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.527+0000 7fbf61c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c19d5f0 con 0x7fbf5c073940 2024-04-20T22:05:53.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.527+0000 7fbf61c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c19d730 con 0x7fbf5c074f10 2024-04-20T22:05:53.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.527+0000 7fbf5be00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf5c073940 0x7fbf5c19ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:53.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.528+0000 7fbf5be00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf5c073940 0x7fbf5c19ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40264/0 (socket says 172.21.15.142:40264) 2024-04-20T22:05:53.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.528+0000 7fbf5be00700 1 -- 172.21.15.142:0/2517269302 learned_addr learned my addr 172.21.15.142:0/2517269302 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:05:53.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.528+0000 7fbf5b400700 1 --2- 172.21.15.142:0/2517269302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf5c074f10 0x7fbf5c19cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:53.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.528+0000 7fbf5be00700 1 -- 172.21.15.142:0/2517269302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf5c074f10 msgr2=0x7fbf5c19cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:53.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.528+0000 7fbf5be00700 1 --2- 172.21.15.142:0/2517269302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf5c074f10 0x7fbf5c19cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:53.528 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.528+0000 7fbf5be00700 1 -- 172.21.15.142:0/2517269302 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf480095f0 con 0x7fbf5c073940 2024-04-20T22:05:53.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.529+0000 7fbf5be00700 1 --2- 172.21.15.142:0/2517269302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf5c073940 0x7fbf5c19ca90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00c8f0 tx=0x7fbf4c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:53.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.529+0000 7fbf58c00700 1 -- 172.21.15.142:0/2517269302 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf4c0078a0 con 0x7fbf5c073940 2024-04-20T22:05:53.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.529+0000 7fbf58c00700 1 -- 172.21.15.142:0/2517269302 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf4c00f450 con 0x7fbf5c073940 2024-04-20T22:05:53.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.529+0000 7fbf58c00700 1 -- 172.21.15.142:0/2517269302 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf4c018610 con 0x7fbf5c073940 2024-04-20T22:05:53.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.529+0000 7fbf61c00700 1 -- 172.21.15.142:0/2517269302 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf5c1a2120 con 0x7fbf5c073940 2024-04-20T22:05:53.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.529+0000 7fbf61c00700 1 -- 172.21.15.142:0/2517269302 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf5c1a26f0 con 0x7fbf5c073940 2024-04-20T22:05:53.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.531+0000 7fbf61c00700 1 -- 172.21.15.142:0/2517269302 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf5c196bf0 con 0x7fbf5c073940 2024-04-20T22:05:53.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.532+0000 7fbf58c00700 1 -- 172.21.15.142:0/2517269302 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fbf4c00f5c0 con 0x7fbf5c073940 2024-04-20T22:05:53.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.533+0000 7fbf58c00700 1 --2- 172.21.15.142:0/2517269302 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fbf4006ecc0 0x7fbf40071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:53.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.533+0000 7fbf58c00700 1 -- 172.21.15.142:0/2517269302 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fbf4c08f100 con 0x7fbf5c073940 2024-04-20T22:05:53.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.533+0000 7fbf5b400700 1 --2- 172.21.15.142:0/2517269302 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fbf4006ecc0 0x7fbf40071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:53.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.534+0000 7fbf5b400700 1 --2- 172.21.15.142:0/2517269302 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fbf4006ecc0 0x7fbf40071180 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbf48005090 tx=0x7fbf4800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:53.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.541+0000 7fbf58c00700 1 -- 172.21.15.142:0/2517269302 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fbf4c05bb00 con 0x7fbf5c073940 2024-04-20T22:05:53.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.782+0000 7fbf61c00700 1 -- 172.21.15.142:0/2517269302 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf5c02ce50 con 0x7fbf4006ecc0 2024-04-20T22:05:53.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.784+0000 7fbf58c00700 1 -- 172.21.15.142:0/2517269302 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fbf5c02ce50 con 0x7fbf4006ecc0 2024-04-20T22:05:53.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.786+0000 7fbf61c00700 1 -- 172.21.15.142:0/2517269302 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fbf4006ecc0 msgr2=0x7fbf40071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:53.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.786+0000 7fbf61c00700 1 --2- 172.21.15.142:0/2517269302 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fbf4006ecc0 0x7fbf40071180 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbf48005090 tx=0x7fbf4800b540 comp rx=0 tx=0).stop 2024-04-20T22:05:53.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.786+0000 7fbf61c00700 1 -- 172.21.15.142:0/2517269302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf5c073940 msgr2=0x7fbf5c19ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:53.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.786+0000 7fbf61c00700 1 --2- 172.21.15.142:0/2517269302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf5c073940 0x7fbf5c19ca90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00c8f0 tx=0x7fbf4c00cc00 comp rx=0 tx=0).stop 2024-04-20T22:05:53.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.787+0000 7fbf61c00700 1 -- 172.21.15.142:0/2517269302 shutdown_connections 2024-04-20T22:05:53.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.787+0000 7fbf61c00700 1 --2- 172.21.15.142:0/2517269302 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fbf4006ecc0 0x7fbf40071180 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:53.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.787+0000 7fbf61c00700 1 --2- 172.21.15.142:0/2517269302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf5c073940 0x7fbf5c19ca90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:53.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.787+0000 7fbf61c00700 1 --2- 172.21.15.142:0/2517269302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf5c074f10 0x7fbf5c19cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:53.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.787+0000 7fbf61c00700 1 -- 172.21.15.142:0/2517269302 >> 172.21.15.142:0/2517269302 conn(0x7fbf5c0fc000 msgr2=0x7fbf5c1027d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:53.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.787+0000 7fbf61c00700 1 -- 172.21.15.142:0/2517269302 shutdown_connections 2024-04-20T22:05:53.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.787+0000 7fbf61c00700 1 -- 172.21.15.142:0/2517269302 wait complete. 2024-04-20T22:05:53.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.932+0000 7fcca5600700 1 -- 172.21.15.142:0/1386879871 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc940054b0 con 0x7fcca8104000 2024-04-20T22:05:53.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.932+0000 7fccada00700 1 -- 172.21.15.142:0/1386879871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcca8104000 msgr2=0x7fcca81063f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:53.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.932+0000 7fccada00700 1 --2- 172.21.15.142:0/1386879871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcca8104000 0x7fcca81063f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009910 tx=0x7fcc94009c20 comp rx=0 tx=0).stop 2024-04-20T22:05:53.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.933+0000 7fccada00700 1 -- 172.21.15.142:0/1386879871 shutdown_connections 2024-04-20T22:05:53.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.933+0000 7fccada00700 1 --2- 172.21.15.142:0/1386879871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcca8104000 0x7fcca81063f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:53.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.933+0000 7fccada00700 1 --2- 172.21.15.142:0/1386879871 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcca81016d0 0x7fcca8103ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:53.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.933+0000 7fccada00700 1 -- 172.21.15.142:0/1386879871 >> 172.21.15.142:0/1386879871 conn(0x7fcca80fb060 msgr2=0x7fcca80fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:53.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.933+0000 7fccada00700 1 -- 172.21.15.142:0/1386879871 shutdown_connections 2024-04-20T22:05:53.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.933+0000 7fccada00700 1 -- 172.21.15.142:0/1386879871 wait complete. 2024-04-20T22:05:53.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.934+0000 7fccada00700 1 Processor -- start 2024-04-20T22:05:53.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.934+0000 7fccada00700 1 -- start start 2024-04-20T22:05:53.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.934+0000 7fccada00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcca81016d0 0x7fcca8198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:53.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.934+0000 7fccada00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcca8104000 0x7fcca8198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:53.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.935+0000 7fccada00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca81992d0 con 0x7fcca81016d0 2024-04-20T22:05:53.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.935+0000 7fccada00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca8199410 con 0x7fcca8104000 2024-04-20T22:05:53.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.935+0000 7fcca6a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcca81016d0 0x7fcca8198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:53.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.935+0000 7fcca6a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcca81016d0 0x7fcca8198770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40284/0 (socket says 172.21.15.142:40284) 2024-04-20T22:05:53.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.935+0000 7fcca6a00700 1 -- 172.21.15.142:0/3089544539 learned_addr learned my addr 172.21.15.142:0/3089544539 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:05:53.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.935+0000 7fcca6000700 1 --2- 172.21.15.142:0/3089544539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcca8104000 0x7fcca8198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:53.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.935+0000 7fcca6a00700 1 -- 172.21.15.142:0/3089544539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcca8104000 msgr2=0x7fcca8198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:53.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.935+0000 7fcca6a00700 1 --2- 172.21.15.142:0/3089544539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcca8104000 0x7fcca8198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:53.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.935+0000 7fcca6a00700 1 -- 172.21.15.142:0/3089544539 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc940095f0 con 0x7fcca81016d0 2024-04-20T22:05:53.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.935+0000 7fcca6000700 1 --2- 172.21.15.142:0/3089544539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcca8104000 0x7fcca8198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:05:53.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.936+0000 7fcca6a00700 1 --2- 172.21.15.142:0/3089544539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcca81016d0 0x7fcca8198770 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800d8d0 tx=0x7fcc9800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:53.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.936+0000 7fcc9f400700 1 -- 172.21.15.142:0/3089544539 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc98009940 con 0x7fcca81016d0 2024-04-20T22:05:53.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.936+0000 7fcc9f400700 1 -- 172.21.15.142:0/3089544539 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc98010460 con 0x7fcca81016d0 2024-04-20T22:05:53.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.936+0000 7fccada00700 1 -- 172.21.15.142:0/3089544539 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca819de70 con 0x7fcca81016d0 2024-04-20T22:05:53.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.936+0000 7fccada00700 1 -- 172.21.15.142:0/3089544539 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca819e3b0 con 0x7fcca81016d0 2024-04-20T22:05:53.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.937+0000 7fcc9f400700 1 -- 172.21.15.142:0/3089544539 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc9800f5f0 con 0x7fcca81016d0 2024-04-20T22:05:53.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.938+0000 7fccada00700 1 -- 172.21.15.142:0/3089544539 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc88005320 con 0x7fcca81016d0 2024-04-20T22:05:53.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.939+0000 7fcc9f400700 1 -- 172.21.15.142:0/3089544539 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fcc98009aa0 con 0x7fcca81016d0 2024-04-20T22:05:53.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.939+0000 7fcc9f400700 1 --2- 172.21.15.142:0/3089544539 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcc8c06ecc0 0x7fcc8c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:53.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.940+0000 7fcc9f400700 1 -- 172.21.15.142:0/3089544539 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fcc9808ee10 con 0x7fcca81016d0 2024-04-20T22:05:53.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.940+0000 7fcca6000700 1 --2- 172.21.15.142:0/3089544539 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcc8c06ecc0 0x7fcc8c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:53.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.941+0000 7fcca6000700 1 --2- 172.21.15.142:0/3089544539 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcc8c06ecc0 0x7fcc8c071180 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcc940059d0 tx=0x7fcc94005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:53.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:53.944+0000 7fcc9f400700 1 -- 172.21.15.142:0/3089544539 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fcc9805b6f0 con 0x7fcca81016d0 2024-04-20T22:05:54.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.176+0000 7fccada00700 1 -- 172.21.15.142:0/3089544539 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc88000bf0 con 0x7fcc8c06ecc0 2024-04-20T22:05:54.176 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:53 smithi142 ceph-mon[79401]: pgmap v204: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 3 op/s 2024-04-20T22:05:54.176 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:53 smithi142 ceph-mon[79401]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:05:54.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.189+0000 7fcc9f400700 1 -- 172.21.15.142:0/3089544539 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fcc88000bf0 con 0x7fcc8c06ecc0 2024-04-20T22:05:54.189 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:05:54.189 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (16m) 2m ago 18m 13.7M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T22:05:54.189 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (18m) 2m ago 18m 8682k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T22:05:54.189 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (17m) 21s ago 17m 8560k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T22:05:54.189 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (4m) 2m ago 18m 6665k - 19.0.0-3133-ga8c84f59 76bc6b91b726 64521ed7125b 2024-04-20T22:05:54.189 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (3m) 21s ago 17m 6656k - 19.0.0-3133-ga8c84f59 76bc6b91b726 893c6f16ee6d 2024-04-20T22:05:54.189 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (16m) 2m ago 18m 76.6M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T22:05:54.190 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (11m) 2m ago 11m 140M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 b68e279d7945 2024-04-20T22:05:54.190 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (11m) 2m ago 11m 16.4M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T22:05:54.190 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (11m) 21s ago 11m 17.2M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T22:05:54.190 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (11m) 21s ago 11m 17.5M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T22:05:54.190 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (7m) 2m ago 20m 505M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:05:54.190 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (6m) 21s ago 17m 453M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:05:54.190 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (5m) 2m ago 20m 47.0M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 af10a542c918 2024-04-20T22:05:54.190 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (5m) 21s ago 17m 36.9M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 133512694d46 2024-04-20T22:05:54.190 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (18m) 2m ago 18m 7894k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T22:05:54.190 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (17m) 21s ago 17m 8300k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T22:05:54.190 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (3m) 2m ago 16m 95.7M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 b7206d05a7cd 2024-04-20T22:05:54.190 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (2m) 2m ago 15m 91.8M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 82bcc0c46762 2024-04-20T22:05:54.190 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (2m) 2m ago 14m 12.6M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 3e2d91f49494 2024-04-20T22:05:54.191 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (112s) 21s ago 14m 105M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 a898b8b77c51 2024-04-20T22:05:54.191 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (69s) 21s ago 13m 97.2M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 539c4026f9fb 2024-04-20T22:05:54.191 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (26s) 21s ago 13m 11.1M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 ac1bdd69c944 2024-04-20T22:05:54.191 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (6m) 2m ago 17m 73.0M - 2.43.0 a07b618ecd1d 46b76c20eae5 2024-04-20T22:05:54.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.192+0000 7fccada00700 1 -- 172.21.15.142:0/3089544539 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcc8c06ecc0 msgr2=0x7fcc8c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:54.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.192+0000 7fccada00700 1 --2- 172.21.15.142:0/3089544539 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcc8c06ecc0 0x7fcc8c071180 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcc940059d0 tx=0x7fcc94005960 comp rx=0 tx=0).stop 2024-04-20T22:05:54.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.192+0000 7fccada00700 1 -- 172.21.15.142:0/3089544539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcca81016d0 msgr2=0x7fcca8198770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:54.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.192+0000 7fccada00700 1 --2- 172.21.15.142:0/3089544539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcca81016d0 0x7fcca8198770 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800d8d0 tx=0x7fcc9800dc90 comp rx=0 tx=0).stop 2024-04-20T22:05:54.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.193+0000 7fccada00700 1 -- 172.21.15.142:0/3089544539 shutdown_connections 2024-04-20T22:05:54.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.193+0000 7fccada00700 1 --2- 172.21.15.142:0/3089544539 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcc8c06ecc0 0x7fcc8c071180 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:54.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.193+0000 7fccada00700 1 --2- 172.21.15.142:0/3089544539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcca81016d0 0x7fcca8198770 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:54.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.193+0000 7fccada00700 1 --2- 172.21.15.142:0/3089544539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcca8104000 0x7fcca8198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:54.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.193+0000 7fccada00700 1 -- 172.21.15.142:0/3089544539 >> 172.21.15.142:0/3089544539 conn(0x7fcca80fb060 msgr2=0x7fcca8104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:54.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.193+0000 7fccada00700 1 -- 172.21.15.142:0/3089544539 shutdown_connections 2024-04-20T22:05:54.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.193+0000 7fccada00700 1 -- 172.21.15.142:0/3089544539 wait complete. 2024-04-20T22:05:54.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:53 smithi164 ceph-mon[69784]: pgmap v204: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 3 op/s 2024-04-20T22:05:54.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:53 smithi164 ceph-mon[69784]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:05:54.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.337+0000 7fd325200700 1 -- 172.21.15.142:0/2702134869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd320101e20 msgr2=0x7fd320102280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:54.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.337+0000 7fd325200700 1 --2- 172.21.15.142:0/2702134869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd320101e20 0x7fd320102280 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009910 tx=0x7fd30c009c20 comp rx=0 tx=0).stop 2024-04-20T22:05:54.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.337+0000 7fd325200700 1 -- 172.21.15.142:0/2702134869 shutdown_connections 2024-04-20T22:05:54.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.337+0000 7fd325200700 1 --2- 172.21.15.142:0/2702134869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd320101e20 0x7fd320102280 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:54.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.337+0000 7fd325200700 1 --2- 172.21.15.142:0/2702134869 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd320100c20 0x7fd320101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:54.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.337+0000 7fd325200700 1 -- 172.21.15.142:0/2702134869 >> 172.21.15.142:0/2702134869 conn(0x7fd3200fc1c0 msgr2=0x7fd3200fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:54.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.337+0000 7fd325200700 1 -- 172.21.15.142:0/2702134869 shutdown_connections 2024-04-20T22:05:54.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.337+0000 7fd325200700 1 -- 172.21.15.142:0/2702134869 wait complete. 2024-04-20T22:05:54.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.338+0000 7fd325200700 1 Processor -- start 2024-04-20T22:05:54.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.338+0000 7fd325200700 1 -- start start 2024-04-20T22:05:54.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.339+0000 7fd325200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd320100c20 0x7fd320198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:54.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.339+0000 7fd325200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd320101e20 0x7fd320198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:54.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.339+0000 7fd325200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3201993a0 con 0x7fd320100c20 2024-04-20T22:05:54.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.339+0000 7fd325200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3201994e0 con 0x7fd320101e20 2024-04-20T22:05:54.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.339+0000 7fd31de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd320100c20 0x7fd320198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:54.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.339+0000 7fd31de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd320100c20 0x7fd320198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40300/0 (socket says 172.21.15.142:40300) 2024-04-20T22:05:54.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.339+0000 7fd31de00700 1 -- 172.21.15.142:0/3804368160 learned_addr learned my addr 172.21.15.142:0/3804368160 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:05:54.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.339+0000 7fd31d400700 1 --2- 172.21.15.142:0/3804368160 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd320101e20 0x7fd320198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:54.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.340+0000 7fd31de00700 1 -- 172.21.15.142:0/3804368160 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd320101e20 msgr2=0x7fd320198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:54.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.340+0000 7fd31de00700 1 --2- 172.21.15.142:0/3804368160 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd320101e20 0x7fd320198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:54.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.340+0000 7fd31de00700 1 -- 172.21.15.142:0/3804368160 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c0095f0 con 0x7fd320100c20 2024-04-20T22:05:54.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.340+0000 7fd31de00700 1 --2- 172.21.15.142:0/3804368160 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd320100c20 0x7fd320198840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd31000d900 tx=0x7fd31000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:54.341 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.340+0000 7fd316a00700 1 -- 172.21.15.142:0/3804368160 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3100041f0 con 0x7fd320100c20 2024-04-20T22:05:54.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.340+0000 7fd316a00700 1 -- 172.21.15.142:0/3804368160 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd310004350 con 0x7fd320100c20 2024-04-20T22:05:54.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.340+0000 7fd325200700 1 -- 172.21.15.142:0/3804368160 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd32019def0 con 0x7fd320100c20 2024-04-20T22:05:54.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.341+0000 7fd316a00700 1 -- 172.21.15.142:0/3804368160 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd310003dc0 con 0x7fd320100c20 2024-04-20T22:05:54.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.341+0000 7fd325200700 1 -- 172.21.15.142:0/3804368160 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32019e430 con 0x7fd320100c20 2024-04-20T22:05:54.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.342+0000 7fd325200700 1 -- 172.21.15.142:0/3804368160 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3201067f0 con 0x7fd320100c20 2024-04-20T22:05:54.343 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.344+0000 7fd316a00700 1 -- 172.21.15.142:0/3804368160 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fd310009730 con 0x7fd320100c20 2024-04-20T22:05:54.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.344+0000 7fd316a00700 1 --2- 172.21.15.142:0/3804368160 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd30406ecc0 0x7fd304071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:54.344 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.345+0000 7fd316a00700 1 -- 172.21.15.142:0/3804368160 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd31008f0a0 con 0x7fd320100c20 2024-04-20T22:05:54.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.345+0000 7fd31d400700 1 --2- 172.21.15.142:0/3804368160 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd30406ecc0 0x7fd304071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:54.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.346+0000 7fd31d400700 1 --2- 172.21.15.142:0/3804368160 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd30406ecc0 0x7fd304071180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0051c0 tx=0x7fd30c005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:54.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.354+0000 7fd316a00700 1 -- 172.21.15.142:0/3804368160 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fd31005b8e0 con 0x7fd320100c20 2024-04-20T22:05:54.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.661+0000 7fd325200700 1 -- 172.21.15.142:0/3804368160 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd3201097d0 con 0x7fd320100c20 2024-04-20T22:05:54.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.662+0000 7fd316a00700 1 -- 172.21.15.142:0/3804368160 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+731 (secure 0 0 0) 0x7fd31005b470 con 0x7fd320100c20 2024-04-20T22:05:54.662 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:05:54.662 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:05:54.662 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:05:54.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:05:54.662 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:05:54.663 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:05:54.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:05:54.663 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:05:54.663 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 6 2024-04-20T22:05:54.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:05:54.663 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:05:54.663 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 3 2024-04-20T22:05:54.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:05:54.663 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:05:54.663 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 3, 2024-04-20T22:05:54.663 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 10 2024-04-20T22:05:54.663 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:05:54.663 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:05:54.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.665+0000 7fd325200700 1 -- 172.21.15.142:0/3804368160 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd30406ecc0 msgr2=0x7fd304071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:54.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.665+0000 7fd325200700 1 --2- 172.21.15.142:0/3804368160 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd30406ecc0 0x7fd304071180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0051c0 tx=0x7fd30c005a90 comp rx=0 tx=0).stop 2024-04-20T22:05:54.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.665+0000 7fd325200700 1 -- 172.21.15.142:0/3804368160 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd320100c20 msgr2=0x7fd320198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:54.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.665+0000 7fd325200700 1 --2- 172.21.15.142:0/3804368160 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd320100c20 0x7fd320198840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd31000d900 tx=0x7fd31000dcc0 comp rx=0 tx=0).stop 2024-04-20T22:05:54.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.665+0000 7fd325200700 1 -- 172.21.15.142:0/3804368160 shutdown_connections 2024-04-20T22:05:54.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.665+0000 7fd325200700 1 --2- 172.21.15.142:0/3804368160 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd30406ecc0 0x7fd304071180 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:54.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.665+0000 7fd325200700 1 --2- 172.21.15.142:0/3804368160 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd320100c20 0x7fd320198840 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:54.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.665+0000 7fd325200700 1 --2- 172.21.15.142:0/3804368160 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd320101e20 0x7fd320198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:54.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.665+0000 7fd325200700 1 -- 172.21.15.142:0/3804368160 >> 172.21.15.142:0/3804368160 conn(0x7fd3200fc1c0 msgr2=0x7fd3200734e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:54.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.665+0000 7fd325200700 1 -- 172.21.15.142:0/3804368160 shutdown_connections 2024-04-20T22:05:54.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.665+0000 7fd325200700 1 -- 172.21.15.142:0/3804368160 wait complete. 2024-04-20T22:05:54.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.810+0000 7f1b48200700 1 -- 172.21.15.142:0/2648782436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b400738c0 msgr2=0x7f1b40073d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:54.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.810+0000 7f1b48200700 1 --2- 172.21.15.142:0/2648782436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b400738c0 0x7f1b40073d40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009910 tx=0x7f1b2c009c20 comp rx=0 tx=0).stop 2024-04-20T22:05:54.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.810+0000 7f1b48200700 1 -- 172.21.15.142:0/2648782436 shutdown_connections 2024-04-20T22:05:54.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.810+0000 7f1b48200700 1 --2- 172.21.15.142:0/2648782436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b400738c0 0x7f1b40073d40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:54.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.810+0000 7f1b48200700 1 --2- 172.21.15.142:0/2648782436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b40074e90 0x7f1b400732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:54.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.810+0000 7f1b48200700 1 -- 172.21.15.142:0/2648782436 >> 172.21.15.142:0/2648782436 conn(0x7f1b400fc1c0 msgr2=0x7f1b400fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:54.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.811+0000 7f1b48200700 1 -- 172.21.15.142:0/2648782436 shutdown_connections 2024-04-20T22:05:54.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.811+0000 7f1b48200700 1 -- 172.21.15.142:0/2648782436 wait complete. 2024-04-20T22:05:54.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.812+0000 7f1b48200700 1 Processor -- start 2024-04-20T22:05:54.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.812+0000 7f1b48200700 1 -- start start 2024-04-20T22:05:54.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.812+0000 7f1b48200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b400738c0 0x7f1b40198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:54.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.812+0000 7f1b48200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b40074e90 0x7f1b40198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:54.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.812+0000 7f1b48200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b40199380 con 0x7f1b40074e90 2024-04-20T22:05:54.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.812+0000 7f1b48200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b401994c0 con 0x7f1b400738c0 2024-04-20T22:05:54.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.812+0000 7f1b44e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b40074e90 0x7f1b40198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:54.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.812+0000 7f1b44e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b40074e90 0x7f1b40198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40318/0 (socket says 172.21.15.142:40318) 2024-04-20T22:05:54.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.812+0000 7f1b44e00700 1 -- 172.21.15.142:0/1527953971 learned_addr learned my addr 172.21.15.142:0/1527953971 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:05:54.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.813+0000 7f1b45800700 1 --2- 172.21.15.142:0/1527953971 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b400738c0 0x7f1b40198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:54.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.813+0000 7f1b44e00700 1 -- 172.21.15.142:0/1527953971 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b400738c0 msgr2=0x7f1b40198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:54.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.813+0000 7f1b44e00700 1 --2- 172.21.15.142:0/1527953971 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b400738c0 0x7f1b40198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:54.813 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.813+0000 7f1b44e00700 1 -- 172.21.15.142:0/1527953971 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c0095f0 con 0x7f1b40074e90 2024-04-20T22:05:54.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.813+0000 7f1b44e00700 1 --2- 172.21.15.142:0/1527953971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b40074e90 0x7f1b40198d60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00bd70 tx=0x7f1b2c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:54.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.814+0000 7f1b3e000700 1 -- 172.21.15.142:0/1527953971 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b2c01d070 con 0x7f1b40074e90 2024-04-20T22:05:54.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.814+0000 7f1b3e000700 1 -- 172.21.15.142:0/1527953971 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1b2c00f460 con 0x7f1b40074e90 2024-04-20T22:05:54.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.814+0000 7f1b48200700 1 -- 172.21.15.142:0/1527953971 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4019de70 con 0x7f1b40074e90 2024-04-20T22:05:54.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.814+0000 7f1b3e000700 1 -- 172.21.15.142:0/1527953971 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b2c021620 con 0x7f1b40074e90 2024-04-20T22:05:54.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.814+0000 7f1b48200700 1 -- 172.21.15.142:0/1527953971 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4019e3b0 con 0x7f1b40074e90 2024-04-20T22:05:54.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.815+0000 7f1b48200700 1 -- 172.21.15.142:0/1527953971 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b40192990 con 0x7f1b40074e90 2024-04-20T22:05:54.816 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.816+0000 7f1b3e000700 1 -- 172.21.15.142:0/1527953971 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f1b2c00fa70 con 0x7f1b40074e90 2024-04-20T22:05:54.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.817+0000 7f1b3e000700 1 --2- 172.21.15.142:0/1527953971 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f1b2806ecc0 0x7f1b28071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:54.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.817+0000 7f1b3e000700 1 -- 172.21.15.142:0/1527953971 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f1b2c0901e0 con 0x7f1b40074e90 2024-04-20T22:05:54.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.817+0000 7f1b45800700 1 --2- 172.21.15.142:0/1527953971 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f1b2806ecc0 0x7f1b28071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:54.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.818+0000 7f1b45800700 1 --2- 172.21.15.142:0/1527953971 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f1b2806ecc0 0x7f1b28071180 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b34005fd0 tx=0x7f1b3400a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:54.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:54.826+0000 7f1b3e000700 1 -- 172.21.15.142:0/1527953971 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f1b2c05cac0 con 0x7f1b40074e90 2024-04-20T22:05:54.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:54 smithi142 ceph-mon[79401]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:05:54.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:54 smithi142 ceph-mon[79401]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:05:54.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:54 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3804368160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:05:55.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.095+0000 7f1b48200700 1 -- 172.21.15.142:0/1527953971 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1b40062510 con 0x7f1b40074e90 2024-04-20T22:05:55.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.096+0000 7f1b3e000700 1 -- 172.21.15.142:0/1527953971 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1721 (secure 0 0 0) 0x7f1b2c05c650 con 0x7f1b40074e90 2024-04-20T22:05:55.096 INFO:teuthology.orchestra.run.smithi142.stdout:e14 2024-04-20T22:05:55.096 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:05:55.097 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:05:55.097 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T22:05:55.097 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:05:55.097 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T22:05:55.097 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T22:05:55.097 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 14 2024-04-20T22:05:55.097 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:05:55.097 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:05:55.097 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T22:05:47.764254+0000 2024-04-20T22:05:55.097 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T22:05:55.097 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T22:05:55.097 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T22:05:55.097 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T22:05:55.097 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T22:05:55.097 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T22:05:55.098 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T22:05:55.098 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T22:05:55.098 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 82 2024-04-20T22:05:55.098 INFO:teuthology.orchestra.run.smithi142.stdout:snap_rstat 1 2024-04-20T22:05:55.098 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:05:55.098 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T22:05:55.098 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T22:05:55.098 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=14484} 2024-04-20T22:05:55.099 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T22:05:55.099 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T22:05:55.099 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T22:05:55.099 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T22:05:55.099 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T22:05:55.099 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T22:05:55.100 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T22:05:55.100 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T22:05:55.100 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T22:05:55.100 INFO:teuthology.orchestra.run.smithi142.stdout:qdb_cluster leader: 0 members: 2024-04-20T22:05:55.100 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{0:14484} state up:replay seq 3 join_fscid=1 addr [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:05:55.100 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:05:55.100 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:05:55.100 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T22:05:55.100 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:05:55.100 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:24245} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:05:55.100 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:05:55.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.100+0000 7f1b48200700 1 -- 172.21.15.142:0/1527953971 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f1b2806ecc0 msgr2=0x7f1b28071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:55.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.100+0000 7f1b48200700 1 --2- 172.21.15.142:0/1527953971 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f1b2806ecc0 0x7f1b28071180 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b34005fd0 tx=0x7f1b3400a560 comp rx=0 tx=0).stop 2024-04-20T22:05:55.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.100+0000 7f1b48200700 1 -- 172.21.15.142:0/1527953971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b40074e90 msgr2=0x7f1b40198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:55.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.100+0000 7f1b48200700 1 --2- 172.21.15.142:0/1527953971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b40074e90 0x7f1b40198d60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00bd70 tx=0x7f1b2c00be50 comp rx=0 tx=0).stop 2024-04-20T22:05:55.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.100+0000 7f1b48200700 1 -- 172.21.15.142:0/1527953971 shutdown_connections 2024-04-20T22:05:55.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.100+0000 7f1b48200700 1 --2- 172.21.15.142:0/1527953971 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f1b2806ecc0 0x7f1b28071180 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:55.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.100+0000 7f1b48200700 1 --2- 172.21.15.142:0/1527953971 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1b400738c0 0x7f1b40198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:55.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.100+0000 7f1b48200700 1 --2- 172.21.15.142:0/1527953971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b40074e90 0x7f1b40198d60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:55.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.100+0000 7f1b48200700 1 -- 172.21.15.142:0/1527953971 >> 172.21.15.142:0/1527953971 conn(0x7f1b400fc1c0 msgr2=0x7f1b40106e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:55.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.100+0000 7f1b48200700 1 -- 172.21.15.142:0/1527953971 shutdown_connections 2024-04-20T22:05:55.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.100+0000 7f1b48200700 1 -- 172.21.15.142:0/1527953971 wait complete. 2024-04-20T22:05:55.102 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 14 2024-04-20T22:05:55.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:54 smithi164 ceph-mon[69784]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:05:55.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:54 smithi164 ceph-mon[69784]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:05:55.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:54 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3804368160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:05:55.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.262+0000 7f7409e00700 1 -- 172.21.15.142:0/4184598630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74040ff490 msgr2=0x7f74041018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:55.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.262+0000 7f7409e00700 1 --2- 172.21.15.142:0/4184598630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74040ff490 0x7f74041018c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f73f4009910 tx=0x7f73f4009c20 comp rx=0 tx=0).stop 2024-04-20T22:05:55.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.262+0000 7f7409e00700 1 -- 172.21.15.142:0/4184598630 shutdown_connections 2024-04-20T22:05:55.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.262+0000 7f7409e00700 1 --2- 172.21.15.142:0/4184598630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7404101e00 0x7f7404104290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:55.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.262+0000 7f7409e00700 1 --2- 172.21.15.142:0/4184598630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74040ff490 0x7f74041018c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:55.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.262+0000 7f7409e00700 1 -- 172.21.15.142:0/4184598630 >> 172.21.15.142:0/4184598630 conn(0x7f74040fb0d0 msgr2=0x7f74040fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:55.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.262+0000 7f7409e00700 1 -- 172.21.15.142:0/4184598630 shutdown_connections 2024-04-20T22:05:55.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.262+0000 7f7409e00700 1 -- 172.21.15.142:0/4184598630 wait complete. 2024-04-20T22:05:55.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.264+0000 7f7409e00700 1 Processor -- start 2024-04-20T22:05:55.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.264+0000 7f7409e00700 1 -- start start 2024-04-20T22:05:55.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.264+0000 7f7409e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74040ff490 0x7f740419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:55.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.264+0000 7f7409e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7404101e00 0x7f740419d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:55.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.264+0000 7f7409e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740419d790 con 0x7f7404101e00 2024-04-20T22:05:55.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.264+0000 7f7409e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740419d8d0 con 0x7f74040ff490 2024-04-20T22:05:55.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.265+0000 7f7402000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7404101e00 0x7f740419d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:55.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.265+0000 7f7402000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7404101e00 0x7f740419d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40346/0 (socket says 172.21.15.142:40346) 2024-04-20T22:05:55.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.265+0000 7f7402000700 1 -- 172.21.15.142:0/2266933890 learned_addr learned my addr 172.21.15.142:0/2266933890 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:05:55.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.265+0000 7f7402a00700 1 --2- 172.21.15.142:0/2266933890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74040ff490 0x7f740419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:55.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.265+0000 7f7402000700 1 -- 172.21.15.142:0/2266933890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74040ff490 msgr2=0x7f740419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:55.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.265+0000 7f7402000700 1 --2- 172.21.15.142:0/2266933890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74040ff490 0x7f740419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:55.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.265+0000 7f7402000700 1 -- 172.21.15.142:0/2266933890 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f40095f0 con 0x7f7404101e00 2024-04-20T22:05:55.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.265+0000 7f7402a00700 1 --2- 172.21.15.142:0/2266933890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74040ff490 0x7f740419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:05:55.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.266+0000 7f7402000700 1 --2- 172.21.15.142:0/2266933890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7404101e00 0x7f740419d170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f73f000d8d0 tx=0x7f73f000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:55.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.266+0000 7f7408a00700 1 -- 172.21.15.142:0/2266933890 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73f0009940 con 0x7f7404101e00 2024-04-20T22:05:55.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.266+0000 7f7408a00700 1 -- 172.21.15.142:0/2266933890 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f73f0010460 con 0x7f7404101e00 2024-04-20T22:05:55.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.266+0000 7f7409e00700 1 -- 172.21.15.142:0/2266933890 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74041a22e0 con 0x7f7404101e00 2024-04-20T22:05:55.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.266+0000 7f7408a00700 1 -- 172.21.15.142:0/2266933890 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73f000f5f0 con 0x7f7404101e00 2024-04-20T22:05:55.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.266+0000 7f7409e00700 1 -- 172.21.15.142:0/2266933890 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74041a28b0 con 0x7f7404101e00 2024-04-20T22:05:55.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.267+0000 7f7409e00700 1 -- 172.21.15.142:0/2266933890 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7404062510 con 0x7f7404101e00 2024-04-20T22:05:55.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.270+0000 7f7408a00700 1 -- 172.21.15.142:0/2266933890 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f73f00105d0 con 0x7f7404101e00 2024-04-20T22:05:55.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.271+0000 7f7408a00700 1 --2- 172.21.15.142:0/2266933890 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f73e806ecc0 0x7f73e8071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:55.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.271+0000 7f7408a00700 1 -- 172.21.15.142:0/2266933890 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f73f008ee10 con 0x7f7404101e00 2024-04-20T22:05:55.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.271+0000 7f7402a00700 1 --2- 172.21.15.142:0/2266933890 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f73e806ecc0 0x7f73e8071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:55.271 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.272+0000 7f7402a00700 1 --2- 172.21.15.142:0/2266933890 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f73e806ecc0 0x7f73e8071180 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f73f400b5c0 tx=0x7f73f4005180 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:55.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.280+0000 7f7408a00700 1 -- 172.21.15.142:0/2266933890 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f73f005b6d0 con 0x7f7404101e00 2024-04-20T22:05:55.520 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.520+0000 7f7409e00700 1 -- 172.21.15.142:0/2266933890 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7404102880 con 0x7f73e806ecc0 2024-04-20T22:05:55.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.522+0000 7f7408a00700 1 -- 172.21.15.142:0/2266933890 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7404102880 con 0x7f73e806ecc0 2024-04-20T22:05:55.522 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:05:55.522 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T22:05:55.522 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T22:05:55.522 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T22:05:55.522 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T22:05:55.522 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr", 2024-04-20T22:05:55.522 INFO:teuthology.orchestra.run.smithi142.stdout: "mon", 2024-04-20T22:05:55.522 INFO:teuthology.orchestra.run.smithi142.stdout: "crash", 2024-04-20T22:05:55.522 INFO:teuthology.orchestra.run.smithi142.stdout: "osd" 2024-04-20T22:05:55.522 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T22:05:55.523 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "12/23 daemons upgraded", 2024-04-20T22:05:55.523 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading mds daemons", 2024-04-20T22:05:55.523 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T22:05:55.523 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:05:55.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.525+0000 7f7409e00700 1 -- 172.21.15.142:0/2266933890 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f73e806ecc0 msgr2=0x7f73e8071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:55.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.525+0000 7f7409e00700 1 --2- 172.21.15.142:0/2266933890 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f73e806ecc0 0x7f73e8071180 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f73f400b5c0 tx=0x7f73f4005180 comp rx=0 tx=0).stop 2024-04-20T22:05:55.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.525+0000 7f7409e00700 1 -- 172.21.15.142:0/2266933890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7404101e00 msgr2=0x7f740419d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:55.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.525+0000 7f7409e00700 1 --2- 172.21.15.142:0/2266933890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7404101e00 0x7f740419d170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f73f000d8d0 tx=0x7f73f000dc90 comp rx=0 tx=0).stop 2024-04-20T22:05:55.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.525+0000 7f7409e00700 1 -- 172.21.15.142:0/2266933890 shutdown_connections 2024-04-20T22:05:55.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.525+0000 7f7409e00700 1 --2- 172.21.15.142:0/2266933890 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f73e806ecc0 0x7f73e8071180 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:55.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.525+0000 7f7409e00700 1 --2- 172.21.15.142:0/2266933890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74040ff490 0x7f740419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:55.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.525+0000 7f7409e00700 1 --2- 172.21.15.142:0/2266933890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7404101e00 0x7f740419d170 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:55.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.525+0000 7f7409e00700 1 -- 172.21.15.142:0/2266933890 >> 172.21.15.142:0/2266933890 conn(0x7f74040fb0d0 msgr2=0x7f74040fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:55.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.525+0000 7f7409e00700 1 -- 172.21.15.142:0/2266933890 shutdown_connections 2024-04-20T22:05:55.526 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.526+0000 7f7409e00700 1 -- 172.21.15.142:0/2266933890 wait complete. 2024-04-20T22:05:55.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.670+0000 7f179ce00700 1 -- 172.21.15.142:0/1807668919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1798074eb0 msgr2=0x7f1798073310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:55.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.670+0000 7f179ce00700 1 --2- 172.21.15.142:0/1807668919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1798074eb0 0x7f1798073310 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1788009910 tx=0x7f1788009c20 comp rx=0 tx=0).stop 2024-04-20T22:05:55.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.670+0000 7f179ce00700 1 -- 172.21.15.142:0/1807668919 shutdown_connections 2024-04-20T22:05:55.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.670+0000 7f179ce00700 1 --2- 172.21.15.142:0/1807668919 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17980738e0 0x7f1798073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:55.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.670+0000 7f179ce00700 1 --2- 172.21.15.142:0/1807668919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1798074eb0 0x7f1798073310 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:55.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.670+0000 7f179ce00700 1 -- 172.21.15.142:0/1807668919 >> 172.21.15.142:0/1807668919 conn(0x7f17980fc000 msgr2=0x7f17980fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:55.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.670+0000 7f179ce00700 1 -- 172.21.15.142:0/1807668919 shutdown_connections 2024-04-20T22:05:55.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.670+0000 7f179ce00700 1 -- 172.21.15.142:0/1807668919 wait complete. 2024-04-20T22:05:55.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.672+0000 7f179ce00700 1 Processor -- start 2024-04-20T22:05:55.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.672+0000 7f179ce00700 1 -- start start 2024-04-20T22:05:55.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.672+0000 7f179ce00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17980738e0 0x7f1798198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:55.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.672+0000 7f179ce00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1798074eb0 0x7f1798198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:55.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.672+0000 7f179ce00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17981992b0 con 0x7f17980738e0 2024-04-20T22:05:55.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.672+0000 7f179ce00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17981993f0 con 0x7f1798074eb0 2024-04-20T22:05:55.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.673+0000 7f1797400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17980738e0 0x7f1798198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.673+0000 7f1797400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17980738e0 0x7f1798198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40362/0 (socket says 172.21.15.142:40362) 2024-04-20T22:05:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.673+0000 7f1797400700 1 -- 172.21.15.142:0/1494920191 learned_addr learned my addr 172.21.15.142:0/1494920191 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:05:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.673+0000 7f1796a00700 1 --2- 172.21.15.142:0/1494920191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1798074eb0 0x7f1798198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.673+0000 7f1797400700 1 -- 172.21.15.142:0/1494920191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1798074eb0 msgr2=0x7f1798198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.673+0000 7f1797400700 1 --2- 172.21.15.142:0/1494920191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1798074eb0 0x7f1798198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.673+0000 7f1797400700 1 -- 172.21.15.142:0/1494920191 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17880095f0 con 0x7f17980738e0 2024-04-20T22:05:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.673+0000 7f1796a00700 1 --2- 172.21.15.142:0/1494920191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1798074eb0 0x7f1798198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:05:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.673+0000 7f1797400700 1 --2- 172.21.15.142:0/1494920191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17980738e0 0x7f1798198750 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f178800bd70 tx=0x7f178800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.674+0000 7f178fe00700 1 -- 172.21.15.142:0/1494920191 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f178801d070 con 0x7f17980738e0 2024-04-20T22:05:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.674+0000 7f178fe00700 1 -- 172.21.15.142:0/1494920191 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f178800f460 con 0x7f17980738e0 2024-04-20T22:05:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.674+0000 7f179ce00700 1 -- 172.21.15.142:0/1494920191 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179819dda0 con 0x7f17980738e0 2024-04-20T22:05:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.674+0000 7f178fe00700 1 -- 172.21.15.142:0/1494920191 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1788021620 con 0x7f17980738e0 2024-04-20T22:05:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.674+0000 7f179ce00700 1 -- 172.21.15.142:0/1494920191 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179819e2b0 con 0x7f17980738e0 2024-04-20T22:05:55.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.675+0000 7f179ce00700 1 -- 172.21.15.142:0/1494920191 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1798062580 con 0x7f17980738e0 2024-04-20T22:05:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.676+0000 7f178fe00700 1 -- 172.21.15.142:0/1494920191 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f178800fa70 con 0x7f17980738e0 2024-04-20T22:05:55.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.677+0000 7f178fe00700 1 --2- 172.21.15.142:0/1494920191 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f177c06ecc0 0x7f177c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:05:55.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.677+0000 7f178fe00700 1 -- 172.21.15.142:0/1494920191 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f17880902b0 con 0x7f17980738e0 2024-04-20T22:05:55.677 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.677+0000 7f1796a00700 1 --2- 172.21.15.142:0/1494920191 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f177c06ecc0 0x7f177c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:05:55.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.678+0000 7f1796a00700 1 --2- 172.21.15.142:0/1494920191 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f177c06ecc0 0x7f177c071180 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1784007900 tx=0x7f1784008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:05:55.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.682+0000 7f178fe00700 1 -- 172.21.15.142:0/1494920191 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f1798062580 con 0x7f17980738e0 2024-04-20T22:05:55.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.993+0000 7f179ce00700 1 -- 172.21.15.142:0/1494920191 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f179810b810 con 0x7f17980738e0 2024-04-20T22:05:55.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.994+0000 7f178fe00700 1 -- 172.21.15.142:0/1494920191 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7f178805c860 con 0x7f17980738e0 2024-04-20T22:05:55.994 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_WARN 1 filesystem is degraded 2024-04-20T22:05:55.994 INFO:teuthology.orchestra.run.smithi142.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-20T22:05:55.994 INFO:teuthology.orchestra.run.smithi142.stdout: fs cephfs is degraded 2024-04-20T22:05:55.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.997+0000 7f179ce00700 1 -- 172.21.15.142:0/1494920191 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f177c06ecc0 msgr2=0x7f177c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:55.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.997+0000 7f179ce00700 1 --2- 172.21.15.142:0/1494920191 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f177c06ecc0 0x7f177c071180 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1784007900 tx=0x7f1784008040 comp rx=0 tx=0).stop 2024-04-20T22:05:55.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.997+0000 7f179ce00700 1 -- 172.21.15.142:0/1494920191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17980738e0 msgr2=0x7f1798198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:05:55.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.997+0000 7f179ce00700 1 --2- 172.21.15.142:0/1494920191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17980738e0 0x7f1798198750 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f178800bd70 tx=0x7f178800be50 comp rx=0 tx=0).stop 2024-04-20T22:05:55.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.997+0000 7f179ce00700 1 -- 172.21.15.142:0/1494920191 shutdown_connections 2024-04-20T22:05:55.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.997+0000 7f179ce00700 1 --2- 172.21.15.142:0/1494920191 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f177c06ecc0 0x7f177c071180 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:55.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.997+0000 7f179ce00700 1 --2- 172.21.15.142:0/1494920191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17980738e0 0x7f1798198750 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:55.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.997+0000 7f179ce00700 1 --2- 172.21.15.142:0/1494920191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1798074eb0 0x7f1798198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:05:55.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.997+0000 7f179ce00700 1 -- 172.21.15.142:0/1494920191 >> 172.21.15.142:0/1494920191 conn(0x7f17980fc000 msgr2=0x7f1798106d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:05:55.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.997+0000 7f179ce00700 1 -- 172.21.15.142:0/1494920191 shutdown_connections 2024-04-20T22:05:55.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:05:55.997+0000 7f179ce00700 1 -- 172.21.15.142:0/1494920191 wait complete. 2024-04-20T22:05:56.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:55 smithi164 ceph-mon[69784]: pgmap v205: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-20T22:05:56.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:55 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/1527953971' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:05:56.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:55 smithi142 ceph-mon[79401]: pgmap v205: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-20T22:05:56.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:55 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1527953971' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:05:57.085 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:56 smithi142 ceph-mon[79401]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:05:57.085 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:56 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1494920191' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:05:57.098 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:56 smithi164 ceph-mon[69784]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:05:57.098 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:56 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/1494920191' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:05:58.126 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:57 smithi164 ceph-mon[69784]: pgmap v206: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-20T22:05:58.126 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:57 smithi164 ceph-mon[69784]: reconnect by client.14536 192.168.0.1:0/1982029803 after 0.00199996 2024-04-20T22:05:58.126 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:57 smithi164 ceph-mon[69784]: reconnect by client.24289 192.168.0.1:0/4069521734 after 0.00299995 2024-04-20T22:05:58.126 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:57 smithi164 ceph-mon[69784]: mds.? [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] up:reconnect 2024-04-20T22:05:58.127 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:57 smithi164 ceph-mon[69784]: fsmap cephfs:1/1 {0=cephfs.smithi142.lrvfgg=up:reconnect} 2 up:standby 2024-04-20T22:05:58.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:57 smithi142 ceph-mon[79401]: pgmap v206: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-20T22:05:58.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:57 smithi142 ceph-mon[79401]: reconnect by client.14536 192.168.0.1:0/1982029803 after 0.00199996 2024-04-20T22:05:58.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:57 smithi142 ceph-mon[79401]: reconnect by client.24289 192.168.0.1:0/4069521734 after 0.00299995 2024-04-20T22:05:58.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:57 smithi142 ceph-mon[79401]: mds.? [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] up:reconnect 2024-04-20T22:05:58.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:57 smithi142 ceph-mon[79401]: fsmap cephfs:1/1 {0=cephfs.smithi142.lrvfgg=up:reconnect} 2 up:standby 2024-04-20T22:05:59.102 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:58 smithi142 ceph-mon[79401]: mds.? [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] up:rejoin 2024-04-20T22:05:59.102 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:58 smithi142 ceph-mon[79401]: fsmap cephfs:1/1 {0=cephfs.smithi142.lrvfgg=up:rejoin} 2 up:standby 2024-04-20T22:05:59.102 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:58 smithi142 ceph-mon[79401]: daemon mds.cephfs.smithi142.lrvfgg is now active in filesystem cephfs as rank 0 2024-04-20T22:05:59.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:58 smithi164 ceph-mon[69784]: mds.? [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] up:rejoin 2024-04-20T22:05:59.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:58 smithi164 ceph-mon[69784]: fsmap cephfs:1/1 {0=cephfs.smithi142.lrvfgg=up:rejoin} 2 up:standby 2024-04-20T22:05:59.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:58 smithi164 ceph-mon[69784]: daemon mds.cephfs.smithi142.lrvfgg is now active in filesystem cephfs as rank 0 2024-04-20T22:05:59.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:59 smithi164 ceph-mon[69784]: pgmap v207: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 95 B/s wr, 6 op/s 2024-04-20T22:05:59.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:59 smithi164 ceph-mon[69784]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-20T22:05:59.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:59 smithi164 ceph-mon[69784]: Cluster is now healthy 2024-04-20T22:05:59.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:59 smithi164 ceph-mon[69784]: mds.? [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] up:active 2024-04-20T22:05:59.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:59 smithi164 ceph-mon[69784]: fsmap cephfs:1 {0=cephfs.smithi142.lrvfgg=up:active} 2 up:standby 2024-04-20T22:05:59.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:05:59 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:06:00.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:59 smithi142 ceph-mon[79401]: pgmap v207: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 95 B/s wr, 6 op/s 2024-04-20T22:06:00.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:59 smithi142 ceph-mon[79401]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-20T22:06:00.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:59 smithi142 ceph-mon[79401]: Cluster is now healthy 2024-04-20T22:06:00.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:59 smithi142 ceph-mon[79401]: mds.? [v2:172.21.15.142:6828/3327440588,v1:172.21.15.142:6829/3327440588] up:active 2024-04-20T22:06:00.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:59 smithi142 ceph-mon[79401]: fsmap cephfs:1 {0=cephfs.smithi142.lrvfgg=up:active} 2 up:standby 2024-04-20T22:06:00.185 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:05:59 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:06:01.452 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:01 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:01.453 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:01 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:01.849 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:01 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:01.849 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:01 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:01.849 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:01 smithi142 ceph-mon[79401]: pgmap v208: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-20T22:06:01.849 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:01 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:06:01.849 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:01 smithi142 ceph-mon[79401]: mds.? [v2:172.21.15.142:6826/2100080187,v1:172.21.15.142:6827/2100080187] up:boot 2024-04-20T22:06:01.849 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:01 smithi142 ceph-mon[79401]: fsmap cephfs:1 {0=cephfs.smithi142.lrvfgg=up:active} 3 up:standby 2024-04-20T22:06:01.849 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:01 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lirkws"}]: dispatch 2024-04-20T22:06:01.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:01 smithi164 ceph-mon[69784]: pgmap v208: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-20T22:06:01.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:01 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:06:01.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:01 smithi164 ceph-mon[69784]: mds.? [v2:172.21.15.142:6826/2100080187,v1:172.21.15.142:6827/2100080187] up:boot 2024-04-20T22:06:01.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:01 smithi164 ceph-mon[69784]: fsmap cephfs:1 {0=cephfs.smithi142.lrvfgg=up:active} 3 up:standby 2024-04-20T22:06:01.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:01 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lirkws"}]: dispatch 2024-04-20T22:06:03.832 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:03 smithi142 ceph-mon[79401]: pgmap v209: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 170 B/s wr, 4 op/s 2024-04-20T22:06:03.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:03 smithi164 ceph-mon[69784]: pgmap v209: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 170 B/s wr, 4 op/s 2024-04-20T22:06:05.830 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:05 smithi142 ceph-mon[79401]: pgmap v210: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 9.5 MiB/s rd, 511 B/s wr, 6 op/s 2024-04-20T22:06:05.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:05 smithi164 ceph-mon[69784]: pgmap v210: 65 pgs: 65 active+clean; 209 MiB data, 895 MiB used, 536 GiB / 536 GiB avail; 9.5 MiB/s rd, 511 B/s wr, 6 op/s 2024-04-20T22:06:07.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:07 smithi142 ceph-mon[79401]: pgmap v211: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 5.2 MiB/s rd, 511 B/s wr, 5 op/s 2024-04-20T22:06:07.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:07 smithi164 ceph-mon[69784]: pgmap v211: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 5.2 MiB/s rd, 511 B/s wr, 5 op/s 2024-04-20T22:06:09.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:08 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:09.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:08 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:09.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:08 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:09.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:08 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:10.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:09 smithi164 ceph-mon[69784]: pgmap v212: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 854 KiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-04-20T22:06:10.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:09 smithi142 ceph-mon[79401]: pgmap v212: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 854 KiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-04-20T22:06:11.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:10 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:11.104 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:10 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:11.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:10 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:11.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:10 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:12.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:12 smithi142 ceph-mon[79401]: pgmap v213: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-04-20T22:06:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:12 smithi164 ceph-mon[69784]: pgmap v213: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-04-20T22:06:14.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:14 smithi142 ceph-mon[79401]: pgmap v214: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 4.6 KiB/s wr, 4 op/s 2024-04-20T22:06:14.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:14 smithi164 ceph-mon[69784]: pgmap v214: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 4.6 KiB/s wr, 4 op/s 2024-04-20T22:06:15.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:06:15.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:06:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:16 smithi164 ceph-mon[69784]: pgmap v215: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 4.6 KiB/s wr, 4 op/s 2024-04-20T22:06:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:16 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:16 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:16 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:06:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:16 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:06:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:16 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:16.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:16 smithi142 ceph-mon[79401]: pgmap v215: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 4.6 KiB/s wr, 4 op/s 2024-04-20T22:06:16.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:16 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:16.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:16 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:16.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:16 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:06:16.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:16 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:06:16.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:16 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:17.381 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:17 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:06:17.381 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:17 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:06:17.381 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:17 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:06:17.382 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:17 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:06:17.382 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:17 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:06:17.382 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:17 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi142.lrvfgg"]}]: dispatch 2024-04-20T22:06:17.382 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:17 smithi142 ceph-mon[79401]: Upgrade: It appears safe to stop mds.cephfs.smithi142.lrvfgg 2024-04-20T22:06:17.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:17 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:06:17.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:17 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:06:17.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:17 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:06:17.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:17 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:06:17.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:17 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:06:17.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:17 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi142.lrvfgg"]}]: dispatch 2024-04-20T22:06:17.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:17 smithi164 ceph-mon[69784]: Upgrade: It appears safe to stop mds.cephfs.smithi142.lrvfgg 2024-04-20T22:06:18.384 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:18 smithi142 ceph-mon[79401]: pgmap v216: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 2 op/s 2024-04-20T22:06:18.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:18 smithi164 ceph-mon[69784]: pgmap v216: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 2 op/s 2024-04-20T22:06:19.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:19 smithi142 ceph-mon[79401]: Upgrade: Updating mds.cephfs.smithi142.lrvfgg 2024-04-20T22:06:19.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:19 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:19.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:19 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.lrvfgg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T22:06:19.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:19 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:06:19.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:19 smithi142 ceph-mon[79401]: Deploying daemon mds.cephfs.smithi142.lrvfgg on smithi142 2024-04-20T22:06:19.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:19 smithi142 ceph-mon[79401]: pgmap v217: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 2 op/s 2024-04-20T22:06:19.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:19 smithi164 ceph-mon[69784]: Upgrade: Updating mds.cephfs.smithi142.lrvfgg 2024-04-20T22:06:19.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:19 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:19.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:19 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi142.lrvfgg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T22:06:19.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:19 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:06:19.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:19 smithi164 ceph-mon[69784]: Deploying daemon mds.cephfs.smithi142.lrvfgg on smithi142 2024-04-20T22:06:19.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:19 smithi164 ceph-mon[69784]: pgmap v217: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 2 op/s 2024-04-20T22:06:21.856 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:21 smithi164 ceph-mon[69784]: pgmap v218: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:06:21.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:21 smithi142 ceph-mon[79401]: pgmap v218: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:06:21.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:21 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142[79397]: 2024-04-20T22:06:21.702+0000 7fc6cd800700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T22:06:22.877 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:22 smithi142 ceph-mon[79401]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-20T22:06:22.877 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:22 smithi142 ceph-mon[79401]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T22:06:22.877 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:22 smithi142 ceph-mon[79401]: osdmap e83: 6 total, 6 up, 6 in 2024-04-20T22:06:22.877 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:22 smithi142 ceph-mon[79401]: Standby daemon mds.cephfs.smithi164.ybvzha assigned to filesystem cephfs as rank 0 2024-04-20T22:06:22.877 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:22 smithi142 ceph-mon[79401]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-20T22:06:22.877 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:22 smithi142 ceph-mon[79401]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-20T22:06:22.877 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:22 smithi142 ceph-mon[79401]: fsmap cephfs:1/1 {0=cephfs.smithi164.ybvzha=up:replay} 2 up:standby 2024-04-20T22:06:22.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:22 smithi164 ceph-mon[69784]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-20T22:06:22.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:22 smithi164 ceph-mon[69784]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T22:06:22.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:22 smithi164 ceph-mon[69784]: osdmap e83: 6 total, 6 up, 6 in 2024-04-20T22:06:22.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:22 smithi164 ceph-mon[69784]: Standby daemon mds.cephfs.smithi164.ybvzha assigned to filesystem cephfs as rank 0 2024-04-20T22:06:22.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:22 smithi164 ceph-mon[69784]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-20T22:06:22.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:22 smithi164 ceph-mon[69784]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-20T22:06:22.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:22 smithi164 ceph-mon[69784]: fsmap cephfs:1/1 {0=cephfs.smithi164.ybvzha=up:replay} 2 up:standby 2024-04-20T22:06:24.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:23 smithi164 ceph-mon[69784]: pgmap v220: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:06:24.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:23 smithi142 ceph-mon[79401]: pgmap v220: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:06:26.171 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:25 smithi142 ceph-mon[79401]: pgmap v221: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s rd, 1 op/s 2024-04-20T22:06:26.171 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:25 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lrvfgg"}]: dispatch 2024-04-20T22:06:26.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.170+0000 7fad9e000700 1 -- 172.21.15.142:0/1802759946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad98073900 msgr2=0x7fad98073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:26.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.170+0000 7fad9e000700 1 --2- 172.21.15.142:0/1802759946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad98073900 0x7fad98073d60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad84009910 tx=0x7fad84009c20 comp rx=0 tx=0).stop 2024-04-20T22:06:26.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.170+0000 7fad9e000700 1 -- 172.21.15.142:0/1802759946 shutdown_connections 2024-04-20T22:06:26.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.170+0000 7fad9e000700 1 --2- 172.21.15.142:0/1802759946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad98073900 0x7fad98073d60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:26.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.170+0000 7fad9e000700 1 --2- 172.21.15.142:0/1802759946 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad98074ed0 0x7fad98073330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:26.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.170+0000 7fad9e000700 1 -- 172.21.15.142:0/1802759946 >> 172.21.15.142:0/1802759946 conn(0x7fad980fc050 msgr2=0x7fad980fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:06:26.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.171+0000 7fad9e000700 1 -- 172.21.15.142:0/1802759946 shutdown_connections 2024-04-20T22:06:26.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.171+0000 7fad9e000700 1 -- 172.21.15.142:0/1802759946 wait complete. 2024-04-20T22:06:26.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.172+0000 7fad9e000700 1 Processor -- start 2024-04-20T22:06:26.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.172+0000 7fad9e000700 1 -- start start 2024-04-20T22:06:26.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.172+0000 7fad9e000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad98073900 0x7fad9819ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:26.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.172+0000 7fad9e000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad98074ed0 0x7fad9819cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:26.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.172+0000 7fad9e000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9819d5c0 con 0x7fad98074ed0 2024-04-20T22:06:26.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.172+0000 7fad9e000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9819d700 con 0x7fad98073900 2024-04-20T22:06:26.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.172+0000 7fad97e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad98074ed0 0x7fad9819cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:26.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.173+0000 7fad97e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad98074ed0 0x7fad9819cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56316/0 (socket says 172.21.15.142:56316) 2024-04-20T22:06:26.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.173+0000 7fad97e00700 1 -- 172.21.15.142:0/2704017332 learned_addr learned my addr 172.21.15.142:0/2704017332 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:06:26.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.173+0000 7fad9cc00700 1 --2- 172.21.15.142:0/2704017332 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad98073900 0x7fad9819ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:26.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.173+0000 7fad97e00700 1 -- 172.21.15.142:0/2704017332 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad98073900 msgr2=0x7fad9819ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:26.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.173+0000 7fad97e00700 1 --2- 172.21.15.142:0/2704017332 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad98073900 0x7fad9819ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:26.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.173+0000 7fad97e00700 1 -- 172.21.15.142:0/2704017332 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad840095f0 con 0x7fad98074ed0 2024-04-20T22:06:26.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.173+0000 7fad9cc00700 1 --2- 172.21.15.142:0/2704017332 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad98073900 0x7fad9819ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T22:06:26.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.173+0000 7fad97e00700 1 --2- 172.21.15.142:0/2704017332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad98074ed0 0x7fad9819cfa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fad8400bd70 tx=0x7fad8400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:06:26.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.174+0000 7fad95600700 1 -- 172.21.15.142:0/2704017332 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad8401d070 con 0x7fad98074ed0 2024-04-20T22:06:26.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.174+0000 7fad95600700 1 -- 172.21.15.142:0/2704017332 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad8400f460 con 0x7fad98074ed0 2024-04-20T22:06:26.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.174+0000 7fad95600700 1 -- 172.21.15.142:0/2704017332 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad84021620 con 0x7fad98074ed0 2024-04-20T22:06:26.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.174+0000 7fad9e000700 1 -- 172.21.15.142:0/2704017332 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad981a2100 con 0x7fad98074ed0 2024-04-20T22:06:26.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.174+0000 7fad9e000700 1 -- 172.21.15.142:0/2704017332 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad981a2620 con 0x7fad98074ed0 2024-04-20T22:06:26.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.175+0000 7fad9e000700 1 -- 172.21.15.142:0/2704017332 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad98101c10 con 0x7fad98074ed0 2024-04-20T22:06:26.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.176+0000 7fad95600700 1 -- 172.21.15.142:0/2704017332 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fad8400fa70 con 0x7fad98074ed0 2024-04-20T22:06:26.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.177+0000 7fad95600700 1 --2- 172.21.15.142:0/2704017332 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fad8006ecd0 0x7fad80071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:26.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.177+0000 7fad95600700 1 -- 172.21.15.142:0/2704017332 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fad84090260 con 0x7fad98074ed0 2024-04-20T22:06:26.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.177+0000 7fad9cc00700 1 --2- 172.21.15.142:0/2704017332 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fad8006ecd0 0x7fad80071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:26.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.178+0000 7fad9cc00700 1 --2- 172.21.15.142:0/2704017332 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fad8006ecd0 0x7fad80071190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fad980752f0 tx=0x7fad8c005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:06:26.182 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.183+0000 7fad95600700 1 -- 172.21.15.142:0/2704017332 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fad8405cad0 con 0x7fad98074ed0 2024-04-20T22:06:26.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:25 smithi164 ceph-mon[69784]: pgmap v221: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s rd, 1 op/s 2024-04-20T22:06:26.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:25 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lrvfgg"}]: dispatch 2024-04-20T22:06:26.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.449+0000 7fad9e000700 1 -- 172.21.15.142:0/2704017332 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fad9802ce30 con 0x7fad8006ecd0 2024-04-20T22:06:26.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.451+0000 7fad95600700 1 -- 172.21.15.142:0/2704017332 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fad9802ce30 con 0x7fad8006ecd0 2024-04-20T22:06:26.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.453+0000 7fad9e000700 1 -- 172.21.15.142:0/2704017332 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fad8006ecd0 msgr2=0x7fad80071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:26.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.453+0000 7fad9e000700 1 --2- 172.21.15.142:0/2704017332 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fad8006ecd0 0x7fad80071190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fad980752f0 tx=0x7fad8c005f90 comp rx=0 tx=0).stop 2024-04-20T22:06:26.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.453+0000 7fad9e000700 1 -- 172.21.15.142:0/2704017332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad98074ed0 msgr2=0x7fad9819cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:26.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.453+0000 7fad9e000700 1 --2- 172.21.15.142:0/2704017332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad98074ed0 0x7fad9819cfa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fad8400bd70 tx=0x7fad8400be50 comp rx=0 tx=0).stop 2024-04-20T22:06:26.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.453+0000 7fad9e000700 1 -- 172.21.15.142:0/2704017332 shutdown_connections 2024-04-20T22:06:26.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.453+0000 7fad9e000700 1 --2- 172.21.15.142:0/2704017332 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fad8006ecd0 0x7fad80071190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:26.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.453+0000 7fad9e000700 1 --2- 172.21.15.142:0/2704017332 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad98073900 0x7fad9819ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:26.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.453+0000 7fad9e000700 1 --2- 172.21.15.142:0/2704017332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fad98074ed0 0x7fad9819cfa0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:26.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.453+0000 7fad9e000700 1 -- 172.21.15.142:0/2704017332 >> 172.21.15.142:0/2704017332 conn(0x7fad980fc050 msgr2=0x7fad98106c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:06:26.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.453+0000 7fad9e000700 1 -- 172.21.15.142:0/2704017332 shutdown_connections 2024-04-20T22:06:26.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.453+0000 7fad9e000700 1 -- 172.21.15.142:0/2704017332 wait complete. 2024-04-20T22:06:26.468 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T22:06:26.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.612+0000 7f8395e00700 1 -- 172.21.15.142:0/1854659272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8390101680 msgr2=0x7f8390103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:26.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.612+0000 7f8395e00700 1 --2- 172.21.15.142:0/1854659272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8390101680 0x7f8390103a70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f838000b0a0 tx=0x7f838000b3b0 comp rx=0 tx=0).stop 2024-04-20T22:06:26.612 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.612+0000 7f8395e00700 1 -- 172.21.15.142:0/1854659272 shutdown_connections 2024-04-20T22:06:26.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.612+0000 7f8395e00700 1 --2- 172.21.15.142:0/1854659272 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8390103fb0 0x7f83901063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:26.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.612+0000 7f8395e00700 1 --2- 172.21.15.142:0/1854659272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8390101680 0x7f8390103a70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:26.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.612+0000 7f8395e00700 1 -- 172.21.15.142:0/1854659272 >> 172.21.15.142:0/1854659272 conn(0x7f83900fb0d0 msgr2=0x7f83900fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:06:26.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.612+0000 7f8395e00700 1 -- 172.21.15.142:0/1854659272 shutdown_connections 2024-04-20T22:06:26.613 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.612+0000 7f8395e00700 1 -- 172.21.15.142:0/1854659272 wait complete. 2024-04-20T22:06:26.614 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.613+0000 7f8395e00700 1 Processor -- start 2024-04-20T22:06:26.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.613+0000 7f8395e00700 1 -- start start 2024-04-20T22:06:26.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.614+0000 7f8395e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8390101680 0x7f8390100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:26.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.614+0000 7f8395e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8390103fb0 0x7f83900ff630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:26.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.614+0000 7f8395e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83900ffb70 con 0x7f8390103fb0 2024-04-20T22:06:26.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.614+0000 7f8395e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83900ffcb0 con 0x7f8390101680 2024-04-20T22:06:26.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.614+0000 7f8386000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8390103fb0 0x7f83900ff630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:26.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.614+0000 7f8386000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8390103fb0 0x7f83900ff630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56342/0 (socket says 172.21.15.142:56342) 2024-04-20T22:06:26.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.614+0000 7f8386000700 1 -- 172.21.15.142:0/2498201655 learned_addr learned my addr 172.21.15.142:0/2498201655 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:06:26.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.614+0000 7f838ea00700 1 --2- 172.21.15.142:0/2498201655 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8390101680 0x7f8390100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:26.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.614+0000 7f8386000700 1 -- 172.21.15.142:0/2498201655 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8390101680 msgr2=0x7f8390100f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:26.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.614+0000 7f8386000700 1 --2- 172.21.15.142:0/2498201655 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8390101680 0x7f8390100f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:26.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.614+0000 7f8386000700 1 -- 172.21.15.142:0/2498201655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8380009d00 con 0x7f8390103fb0 2024-04-20T22:06:26.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.615+0000 7f8386000700 1 --2- 172.21.15.142:0/2498201655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8390103fb0 0x7f83900ff630 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f837800e940 tx=0x7f837800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:06:26.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.615+0000 7f8394a00700 1 -- 172.21.15.142:0/2498201655 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83780097b0 con 0x7f8390103fb0 2024-04-20T22:06:26.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.615+0000 7f8394a00700 1 -- 172.21.15.142:0/2498201655 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8378004cf0 con 0x7f8390103fb0 2024-04-20T22:06:26.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.615+0000 7f8394a00700 1 -- 172.21.15.142:0/2498201655 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8378005700 con 0x7f8390103fb0 2024-04-20T22:06:26.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.615+0000 7f8395e00700 1 -- 172.21.15.142:0/2498201655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83900fff90 con 0x7f8390103fb0 2024-04-20T22:06:26.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.615+0000 7f8395e00700 1 -- 172.21.15.142:0/2498201655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8390100490 con 0x7f8390103fb0 2024-04-20T22:06:26.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.616+0000 7f8395e00700 1 -- 172.21.15.142:0/2498201655 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8390062510 con 0x7f8390103fb0 2024-04-20T22:06:26.616 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.617+0000 7f8394a00700 1 -- 172.21.15.142:0/2498201655 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f837800cba0 con 0x7f8390103fb0 2024-04-20T22:06:26.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.618+0000 7f8394a00700 1 --2- 172.21.15.142:0/2498201655 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f837406ecc0 0x7f8374071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:26.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.618+0000 7f8394a00700 1 -- 172.21.15.142:0/2498201655 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f8378014070 con 0x7f8390103fb0 2024-04-20T22:06:26.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.618+0000 7f838ea00700 1 --2- 172.21.15.142:0/2498201655 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f837406ecc0 0x7f8374071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:26.618 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.619+0000 7f838ea00700 1 --2- 172.21.15.142:0/2498201655 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f837406ecc0 0x7f8374071180 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8380000f80 tx=0x7f838000b700 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:06:26.624 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.623+0000 7f8394a00700 1 -- 172.21.15.142:0/2498201655 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f837805bb00 con 0x7f8390103fb0 2024-04-20T22:06:26.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.872+0000 7f8395e00700 1 -- 172.21.15.142:0/2498201655 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8390105fb0 con 0x7f837406ecc0 2024-04-20T22:06:26.876 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.876+0000 7f8394a00700 1 -- 172.21.15.142:0/2498201655 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8390105fb0 con 0x7f837406ecc0 2024-04-20T22:06:26.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.879+0000 7f8395e00700 1 -- 172.21.15.142:0/2498201655 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f837406ecc0 msgr2=0x7f8374071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:26.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.879+0000 7f8395e00700 1 --2- 172.21.15.142:0/2498201655 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f837406ecc0 0x7f8374071180 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8380000f80 tx=0x7f838000b700 comp rx=0 tx=0).stop 2024-04-20T22:06:26.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.879+0000 7f8395e00700 1 -- 172.21.15.142:0/2498201655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8390103fb0 msgr2=0x7f83900ff630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:26.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.879+0000 7f8395e00700 1 --2- 172.21.15.142:0/2498201655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8390103fb0 0x7f83900ff630 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f837800e940 tx=0x7f837800ed00 comp rx=0 tx=0).stop 2024-04-20T22:06:26.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.879+0000 7f8395e00700 1 -- 172.21.15.142:0/2498201655 shutdown_connections 2024-04-20T22:06:26.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.879+0000 7f8395e00700 1 --2- 172.21.15.142:0/2498201655 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f837406ecc0 0x7f8374071180 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:26.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.879+0000 7f8395e00700 1 --2- 172.21.15.142:0/2498201655 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8390101680 0x7f8390100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:26.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.879+0000 7f8395e00700 1 --2- 172.21.15.142:0/2498201655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8390103fb0 0x7f83900ff630 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:26.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.879+0000 7f8395e00700 1 -- 172.21.15.142:0/2498201655 >> 172.21.15.142:0/2498201655 conn(0x7f83900fb0d0 msgr2=0x7f83900fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:06:26.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.879+0000 7f8395e00700 1 -- 172.21.15.142:0/2498201655 shutdown_connections 2024-04-20T22:06:26.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:26.879+0000 7f8395e00700 1 -- 172.21.15.142:0/2498201655 wait complete. 2024-04-20T22:06:27.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.037+0000 7f44e0400700 1 -- 172.21.15.142:0/1096761741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8108430 msgr2=0x7f44d81088b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:27.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.037+0000 7f44e0400700 1 --2- 172.21.15.142:0/1096761741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8108430 0x7f44d81088b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f44c4009910 tx=0x7f44c4009c20 comp rx=0 tx=0).stop 2024-04-20T22:06:27.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.037+0000 7f44e0400700 1 -- 172.21.15.142:0/1096761741 shutdown_connections 2024-04-20T22:06:27.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.037+0000 7f44e0400700 1 --2- 172.21.15.142:0/1096761741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8108430 0x7f44d81088b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:27.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.037+0000 7f44e0400700 1 --2- 172.21.15.142:0/1096761741 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44d8107260 0x7f44d8107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:27.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.037+0000 7f44e0400700 1 -- 172.21.15.142:0/1096761741 >> 172.21.15.142:0/1096761741 conn(0x7f44d8076400 msgr2=0x7f44d8078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:06:27.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.037+0000 7f44e0400700 1 -- 172.21.15.142:0/1096761741 shutdown_connections 2024-04-20T22:06:27.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.037+0000 7f44e0400700 1 -- 172.21.15.142:0/1096761741 wait complete. 2024-04-20T22:06:27.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.038+0000 7f44e0400700 1 Processor -- start 2024-04-20T22:06:27.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.038+0000 7f44e0400700 1 -- start start 2024-04-20T22:06:27.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.039+0000 7f44e0400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44d8107260 0x7f44d819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:27.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.039+0000 7f44e0400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8108430 0x7f44d819d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:27.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.039+0000 7f44e0400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d819d730 con 0x7f44d8108430 2024-04-20T22:06:27.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.039+0000 7f44e0400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d819d870 con 0x7f44d8107260 2024-04-20T22:06:27.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.039+0000 7f44dd000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8108430 0x7f44d819d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:27.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.039+0000 7f44dd000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8108430 0x7f44d819d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34214/0 (socket says 172.21.15.142:34214) 2024-04-20T22:06:27.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.039+0000 7f44dd000700 1 -- 172.21.15.142:0/1935879147 learned_addr learned my addr 172.21.15.142:0/1935879147 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:06:27.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.039+0000 7f44dda00700 1 --2- 172.21.15.142:0/1935879147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44d8107260 0x7f44d819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:27.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.039+0000 7f44dd000700 1 -- 172.21.15.142:0/1935879147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44d8107260 msgr2=0x7f44d819cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:27.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.039+0000 7f44dd000700 1 --2- 172.21.15.142:0/1935879147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44d8107260 0x7f44d819cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:27.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.040+0000 7f44dd000700 1 -- 172.21.15.142:0/1935879147 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c40095f0 con 0x7f44d8108430 2024-04-20T22:06:27.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.040+0000 7f44dd000700 1 --2- 172.21.15.142:0/1935879147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8108430 0x7f44d819d110 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f44c400bd70 tx=0x7f44c400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:06:27.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.040+0000 7f44d6000700 1 -- 172.21.15.142:0/1935879147 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44c401d070 con 0x7f44d8108430 2024-04-20T22:06:27.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.040+0000 7f44d6000700 1 -- 172.21.15.142:0/1935879147 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f44c4005dc0 con 0x7f44d8108430 2024-04-20T22:06:27.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.040+0000 7f44d6000700 1 -- 172.21.15.142:0/1935879147 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44c4021410 con 0x7f44d8108430 2024-04-20T22:06:27.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.040+0000 7f44e0400700 1 -- 172.21.15.142:0/1935879147 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d81a2270 con 0x7f44d8108430 2024-04-20T22:06:27.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.040+0000 7f44e0400700 1 -- 172.21.15.142:0/1935879147 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d81a2790 con 0x7f44d8108430 2024-04-20T22:06:27.041 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.042+0000 7f44e0400700 1 -- 172.21.15.142:0/1935879147 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d8196dd0 con 0x7f44d8108430 2024-04-20T22:06:27.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.043+0000 7f44d6000700 1 -- 172.21.15.142:0/1935879147 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f44c400f810 con 0x7f44d8108430 2024-04-20T22:06:27.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.044+0000 7f44d6000700 1 --2- 172.21.15.142:0/1935879147 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f44c006ecd0 0x7f44c0071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:27.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.044+0000 7f44d6000700 1 -- 172.21.15.142:0/1935879147 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f44c4090120 con 0x7f44d8108430 2024-04-20T22:06:27.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.045+0000 7f44dda00700 1 --2- 172.21.15.142:0/1935879147 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f44c006ecd0 0x7f44c0071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:27.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.045+0000 7f44dda00700 1 --2- 172.21.15.142:0/1935879147 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f44c006ecd0 0x7f44c0071190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f44cc005950 tx=0x7f44cc00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:06:27.049 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.049+0000 7f44d6000700 1 -- 172.21.15.142:0/1935879147 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f44c405c910 con 0x7f44d8108430 2024-04-20T22:06:27.288 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.287+0000 7f44e0400700 1 -- 172.21.15.142:0/1935879147 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f44d802ce50 con 0x7f44c006ecd0 2024-04-20T22:06:27.303 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.303+0000 7f44d6000700 1 -- 172.21.15.142:0/1935879147 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f44d802ce50 con 0x7f44c006ecd0 2024-04-20T22:06:27.304 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:06:27.304 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (17m) 19s ago 19m 14.2M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T22:06:27.304 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (19m) 19s ago 19m 9072k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T22:06:27.304 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (18m) 54s ago 17m 8560k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T22:06:27.304 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (4m) 19s ago 19m 6665k - 19.0.0-3133-ga8c84f59 76bc6b91b726 64521ed7125b 2024-04-20T22:06:27.304 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (4m) 54s ago 17m 6656k - 19.0.0-3133-ga8c84f59 76bc6b91b726 893c6f16ee6d 2024-04-20T22:06:27.304 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (16m) 19s ago 18m 74.4M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T22:06:27.304 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (28s) 19s ago 11m 11.0M - 19.0.0-3133-ga8c84f59 76bc6b91b726 603d9ff4accc 2024-04-20T22:06:27.305 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (11m) 19s ago 11m 88.6M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4ee1c2d30b57 2024-04-20T22:06:27.305 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (11m) 54s ago 11m 17.2M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T22:06:27.305 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (11m) 54s ago 11m 17.5M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T22:06:27.305 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (8m) 19s ago 20m 510M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:06:27.305 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (6m) 54s ago 17m 453M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:06:27.305 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (6m) 19s ago 21m 55.0M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 af10a542c918 2024-04-20T22:06:27.305 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (5m) 54s ago 17m 36.9M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 133512694d46 2024-04-20T22:06:27.305 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (19m) 19s ago 19m 7889k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T22:06:27.305 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (17m) 54s ago 17m 8300k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T22:06:27.305 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (3m) 19s ago 16m 101M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 b7206d05a7cd 2024-04-20T22:06:27.305 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (3m) 19s ago 16m 103M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 82bcc0c46762 2024-04-20T22:06:27.305 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (2m) 19s ago 15m 91.8M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 3e2d91f49494 2024-04-20T22:06:27.305 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (2m) 54s ago 14m 105M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 a898b8b77c51 2024-04-20T22:06:27.305 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (102s) 54s ago 14m 97.2M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 539c4026f9fb 2024-04-20T22:06:27.306 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (59s) 54s ago 13m 11.1M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 ac1bdd69c944 2024-04-20T22:06:27.306 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (6m) 19s ago 18m 76.9M - 2.43.0 a07b618ecd1d 46b76c20eae5 2024-04-20T22:06:27.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.306+0000 7f44e0400700 1 -- 172.21.15.142:0/1935879147 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f44c006ecd0 msgr2=0x7f44c0071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:27.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.306+0000 7f44e0400700 1 --2- 172.21.15.142:0/1935879147 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f44c006ecd0 0x7f44c0071190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f44cc005950 tx=0x7f44cc00b410 comp rx=0 tx=0).stop 2024-04-20T22:06:27.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.306+0000 7f44e0400700 1 -- 172.21.15.142:0/1935879147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8108430 msgr2=0x7f44d819d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:27.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.306+0000 7f44e0400700 1 --2- 172.21.15.142:0/1935879147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8108430 0x7f44d819d110 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f44c400bd70 tx=0x7f44c400bda0 comp rx=0 tx=0).stop 2024-04-20T22:06:27.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.306+0000 7f44e0400700 1 -- 172.21.15.142:0/1935879147 shutdown_connections 2024-04-20T22:06:27.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.306+0000 7f44e0400700 1 --2- 172.21.15.142:0/1935879147 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f44c006ecd0 0x7f44c0071190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:27.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.306+0000 7f44e0400700 1 --2- 172.21.15.142:0/1935879147 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44d8107260 0x7f44d819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:27.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.306+0000 7f44e0400700 1 --2- 172.21.15.142:0/1935879147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8108430 0x7f44d819d110 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:27.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.306+0000 7f44e0400700 1 -- 172.21.15.142:0/1935879147 >> 172.21.15.142:0/1935879147 conn(0x7f44d8076400 msgr2=0x7f44d810b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:06:27.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.307+0000 7f44e0400700 1 -- 172.21.15.142:0/1935879147 shutdown_connections 2024-04-20T22:06:27.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.307+0000 7f44e0400700 1 -- 172.21.15.142:0/1935879147 wait complete. 2024-04-20T22:06:27.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.450+0000 7f97df200700 1 -- 172.21.15.142:0/3340803716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97e0108290 msgr2=0x7f97e01086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:27.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.450+0000 7f97df200700 1 --2- 172.21.15.142:0/3340803716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97e0108290 0x7f97e01086f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009910 tx=0x7f97cc009c20 comp rx=0 tx=0).stop 2024-04-20T22:06:27.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.450+0000 7f97df200700 1 -- 172.21.15.142:0/3340803716 shutdown_connections 2024-04-20T22:06:27.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.450+0000 7f97df200700 1 --2- 172.21.15.142:0/3340803716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97e0108290 0x7f97e01086f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:27.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.450+0000 7f97df200700 1 --2- 172.21.15.142:0/3340803716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97e01070f0 0x7f97e0107510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:27.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.450+0000 7f97df200700 1 -- 172.21.15.142:0/3340803716 >> 172.21.15.142:0/3340803716 conn(0x7f97e00761d0 msgr2=0x7f97e0078610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:06:27.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.450+0000 7f97df200700 1 -- 172.21.15.142:0/3340803716 shutdown_connections 2024-04-20T22:06:27.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.450+0000 7f97df200700 1 -- 172.21.15.142:0/3340803716 wait complete. 2024-04-20T22:06:27.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.451+0000 7f97df200700 1 Processor -- start 2024-04-20T22:06:27.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.452+0000 7f97df200700 1 -- start start 2024-04-20T22:06:27.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.452+0000 7f97df200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97e01070f0 0x7f97e019ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:27.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.452+0000 7f97df200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97e0108290 0x7f97e019cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:27.452 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.452+0000 7f97df200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e019d5d0 con 0x7f97e01070f0 2024-04-20T22:06:27.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.452+0000 7f97df200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e019d710 con 0x7f97e0108290 2024-04-20T22:06:27.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.452+0000 7f97dde00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97e01070f0 0x7f97e019ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:27.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.452+0000 7f97dde00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97e01070f0 0x7f97e019ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34234/0 (socket says 172.21.15.142:34234) 2024-04-20T22:06:27.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.452+0000 7f97dde00700 1 -- 172.21.15.142:0/1394123936 learned_addr learned my addr 172.21.15.142:0/1394123936 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:06:27.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.452+0000 7f97dd400700 1 --2- 172.21.15.142:0/1394123936 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97e0108290 0x7f97e019cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:27.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.453+0000 7f97dde00700 1 -- 172.21.15.142:0/1394123936 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97e0108290 msgr2=0x7f97e019cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:27.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.453+0000 7f97dde00700 1 --2- 172.21.15.142:0/1394123936 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97e0108290 0x7f97e019cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:27.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.453+0000 7f97dde00700 1 -- 172.21.15.142:0/1394123936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc0095f0 con 0x7f97e01070f0 2024-04-20T22:06:27.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.453+0000 7f97dd400700 1 --2- 172.21.15.142:0/1394123936 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97e0108290 0x7f97e019cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T22:06:27.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.453+0000 7f97dde00700 1 --2- 172.21.15.142:0/1394123936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97e01070f0 0x7f97e019ca70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f97d000d900 tx=0x7f97d000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:06:27.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.453+0000 7f97d6a00700 1 -- 172.21.15.142:0/1394123936 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97d00041f0 con 0x7f97e01070f0 2024-04-20T22:06:27.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.453+0000 7f97d6a00700 1 -- 172.21.15.142:0/1394123936 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f97d0004350 con 0x7f97e01070f0 2024-04-20T22:06:27.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.453+0000 7f97df200700 1 -- 172.21.15.142:0/1394123936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e01a2170 con 0x7f97e01070f0 2024-04-20T22:06:27.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.453+0000 7f97d6a00700 1 -- 172.21.15.142:0/1394123936 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97d0003dc0 con 0x7f97e01070f0 2024-04-20T22:06:27.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.453+0000 7f97df200700 1 -- 172.21.15.142:0/1394123936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e01a2740 con 0x7f97e01070f0 2024-04-20T22:06:27.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.454+0000 7f97df200700 1 -- 172.21.15.142:0/1394123936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e0196c10 con 0x7f97e01070f0 2024-04-20T22:06:27.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.455+0000 7f97d6a00700 1 -- 172.21.15.142:0/1394123936 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f97d0009730 con 0x7f97e01070f0 2024-04-20T22:06:27.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.457+0000 7f97d6a00700 1 --2- 172.21.15.142:0/1394123936 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f97c406ecc0 0x7f97c4071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:27.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.457+0000 7f97d6a00700 1 -- 172.21.15.142:0/1394123936 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f97d008f100 con 0x7f97e01070f0 2024-04-20T22:06:27.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.457+0000 7f97dd400700 1 --2- 172.21.15.142:0/1394123936 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f97c406ecc0 0x7f97c4071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:27.457 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.458+0000 7f97dd400700 1 --2- 172.21.15.142:0/1394123936 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f97c406ecc0 0x7f97c4071180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f97cc005b40 tx=0x7f97cc005ab0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:06:27.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.462+0000 7f97d6a00700 1 -- 172.21.15.142:0/1394123936 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f97d005b8f0 con 0x7f97e01070f0 2024-04-20T22:06:27.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.781+0000 7f97df200700 1 -- 172.21.15.142:0/1394123936 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f97e010fc40 con 0x7f97e01070f0 2024-04-20T22:06:27.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.781+0000 7f97d6a00700 1 -- 172.21.15.142:0/1394123936 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+835 (secure 0 0 0) 0x7f97d005b480 con 0x7f97e01070f0 2024-04-20T22:06:27.781 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:06:27.781 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:06:27.781 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:06:27.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:06:27.782 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:06:27.782 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:06:27.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:06:27.782 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:06:27.782 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 6 2024-04-20T22:06:27.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:06:27.782 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:06:27.782 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 2, 2024-04-20T22:06:27.782 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 1 2024-04-20T22:06:27.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:06:27.782 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:06:27.783 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 2, 2024-04-20T22:06:27.783 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 11 2024-04-20T22:06:27.783 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:06:27.783 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:06:27.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.784+0000 7f97df200700 1 -- 172.21.15.142:0/1394123936 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f97c406ecc0 msgr2=0x7f97c4071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:27.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.784+0000 7f97df200700 1 --2- 172.21.15.142:0/1394123936 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f97c406ecc0 0x7f97c4071180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f97cc005b40 tx=0x7f97cc005ab0 comp rx=0 tx=0).stop 2024-04-20T22:06:27.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.784+0000 7f97df200700 1 -- 172.21.15.142:0/1394123936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97e01070f0 msgr2=0x7f97e019ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:27.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.784+0000 7f97df200700 1 --2- 172.21.15.142:0/1394123936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97e01070f0 0x7f97e019ca70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f97d000d900 tx=0x7f97d000dcc0 comp rx=0 tx=0).stop 2024-04-20T22:06:27.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.784+0000 7f97df200700 1 -- 172.21.15.142:0/1394123936 shutdown_connections 2024-04-20T22:06:27.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.784+0000 7f97df200700 1 --2- 172.21.15.142:0/1394123936 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f97c406ecc0 0x7f97c4071180 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:27.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.784+0000 7f97df200700 1 --2- 172.21.15.142:0/1394123936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97e01070f0 0x7f97e019ca70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:27.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.784+0000 7f97df200700 1 --2- 172.21.15.142:0/1394123936 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f97e0108290 0x7f97e019cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:27.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.784+0000 7f97df200700 1 -- 172.21.15.142:0/1394123936 >> 172.21.15.142:0/1394123936 conn(0x7f97e00761d0 msgr2=0x7f97e010b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:06:27.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.785+0000 7f97df200700 1 -- 172.21.15.142:0/1394123936 shutdown_connections 2024-04-20T22:06:27.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.785+0000 7f97df200700 1 -- 172.21.15.142:0/1394123936 wait complete. 2024-04-20T22:06:27.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.929+0000 7f50c9e00700 1 -- 172.21.15.142:0/3954742145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c4074e90 msgr2=0x7f50c40732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:27.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.929+0000 7f50c9e00700 1 --2- 172.21.15.142:0/3954742145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c4074e90 0x7f50c40732f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009910 tx=0x7f50b8009c20 comp rx=0 tx=0).stop 2024-04-20T22:06:27.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.929+0000 7f50c9e00700 1 -- 172.21.15.142:0/3954742145 shutdown_connections 2024-04-20T22:06:27.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.929+0000 7f50c9e00700 1 --2- 172.21.15.142:0/3954742145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50c40738c0 0x7f50c4073d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:27.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.929+0000 7f50c9e00700 1 --2- 172.21.15.142:0/3954742145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c4074e90 0x7f50c40732f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:27.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.929+0000 7f50c9e00700 1 -- 172.21.15.142:0/3954742145 >> 172.21.15.142:0/3954742145 conn(0x7f50c40fc050 msgr2=0x7f50c40fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:06:27.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.929+0000 7f50c9e00700 1 -- 172.21.15.142:0/3954742145 shutdown_connections 2024-04-20T22:06:27.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.930+0000 7f50c9e00700 1 -- 172.21.15.142:0/3954742145 wait complete. 2024-04-20T22:06:27.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.930+0000 7f50c9e00700 1 Processor -- start 2024-04-20T22:06:27.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.931+0000 7f50c9e00700 1 -- start start 2024-04-20T22:06:27.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.931+0000 7f50c9e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50c40738c0 0x7f50c4198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:27.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.931+0000 7f50c9e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c4074e90 0x7f50c4198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:27.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.931+0000 7f50c9e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c41991e0 con 0x7f50c4074e90 2024-04-20T22:06:27.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.931+0000 7f50c9e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c4199320 con 0x7f50c40738c0 2024-04-20T22:06:27.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.931+0000 7f50c3e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c4074e90 0x7f50c4198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:27.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.931+0000 7f50c3e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c4074e90 0x7f50c4198bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34256/0 (socket says 172.21.15.142:34256) 2024-04-20T22:06:27.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.931+0000 7f50c3e00700 1 -- 172.21.15.142:0/2346184522 learned_addr learned my addr 172.21.15.142:0/2346184522 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:06:27.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.931+0000 7f50c8a00700 1 --2- 172.21.15.142:0/2346184522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50c40738c0 0x7f50c4198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:27.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.932+0000 7f50c3e00700 1 -- 172.21.15.142:0/2346184522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50c40738c0 msgr2=0x7f50c4198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:27.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.932+0000 7f50c3e00700 1 --2- 172.21.15.142:0/2346184522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50c40738c0 0x7f50c4198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:27.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.932+0000 7f50c3e00700 1 -- 172.21.15.142:0/2346184522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b80095f0 con 0x7f50c4074e90 2024-04-20T22:06:27.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.932+0000 7f50c3e00700 1 --2- 172.21.15.142:0/2346184522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c4074e90 0x7f50c4198bc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f50b000d8d0 tx=0x7f50b000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:06:27.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.932+0000 7f50c1600700 1 -- 172.21.15.142:0/2346184522 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50b00098a0 con 0x7f50c4074e90 2024-04-20T22:06:27.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.932+0000 7f50c1600700 1 -- 172.21.15.142:0/2346184522 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f50b0010460 con 0x7f50c4074e90 2024-04-20T22:06:27.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.932+0000 7f50c9e00700 1 -- 172.21.15.142:0/2346184522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c419dd30 con 0x7f50c4074e90 2024-04-20T22:06:27.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.932+0000 7f50c1600700 1 -- 172.21.15.142:0/2346184522 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50b000f5f0 con 0x7f50c4074e90 2024-04-20T22:06:27.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.933+0000 7f50c9e00700 1 -- 172.21.15.142:0/2346184522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c419e300 con 0x7f50c4074e90 2024-04-20T22:06:27.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.934+0000 7f50c9e00700 1 -- 172.21.15.142:0/2346184522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c41927e0 con 0x7f50c4074e90 2024-04-20T22:06:27.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.935+0000 7f50c1600700 1 -- 172.21.15.142:0/2346184522 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f50b0009a00 con 0x7f50c4074e90 2024-04-20T22:06:27.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.936+0000 7f50c1600700 1 --2- 172.21.15.142:0/2346184522 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f50ac06ecd0 0x7f50ac071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:27.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.936+0000 7f50c1600700 1 -- 172.21.15.142:0/2346184522 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f50b008e7c0 con 0x7f50c4074e90 2024-04-20T22:06:27.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.936+0000 7f50c8a00700 1 --2- 172.21.15.142:0/2346184522 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f50ac06ecd0 0x7f50ac071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:27.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.937+0000 7f50c8a00700 1 --2- 172.21.15.142:0/2346184522 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f50ac06ecd0 0x7f50ac071190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f50b8006010 tx=0x7f50b800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:06:27.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:27.941+0000 7f50c1600700 1 -- 172.21.15.142:0/2346184522 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f50b005b050 con 0x7f50c4074e90 2024-04-20T22:06:28.051 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:27 smithi142 ceph-mon[79401]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:06:28.051 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:27 smithi142 ceph-mon[79401]: pgmap v222: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-04-20T22:06:28.051 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:27 smithi142 ceph-mon[79401]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:06:28.051 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:27 smithi142 ceph-mon[79401]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:06:28.133 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:27 smithi164 ceph-mon[69784]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:06:28.133 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:27 smithi164 ceph-mon[69784]: pgmap v222: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-04-20T22:06:28.133 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:27 smithi164 ceph-mon[69784]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:06:28.133 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:27 smithi164 ceph-mon[69784]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:06:28.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.226+0000 7f50c9e00700 1 -- 172.21.15.142:0/2346184522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f50c404f400 con 0x7f50c4074e90 2024-04-20T22:06:28.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.228+0000 7f50c1600700 1 -- 172.21.15.142:0/2346184522 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1722 (secure 0 0 0) 0x7f50b005abe0 con 0x7f50c4074e90 2024-04-20T22:06:28.228 INFO:teuthology.orchestra.run.smithi142.stdout:e20 2024-04-20T22:06:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:06:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:06:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T22:06:28.229 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:06:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T22:06:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T22:06:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 20 2024-04-20T22:06:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:06:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:06:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T22:06:21.711368+0000 2024-04-20T22:06:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T22:06:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T22:06:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T22:06:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T22:06:28.230 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T22:06:28.230 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T22:06:28.230 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T22:06:28.230 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T22:06:28.230 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 83 2024-04-20T22:06:28.230 INFO:teuthology.orchestra.run.smithi142.stdout:snap_rstat 1 2024-04-20T22:06:28.230 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:06:28.230 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T22:06:28.230 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T22:06:28.230 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=24245} 2024-04-20T22:06:28.230 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T22:06:28.230 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T22:06:28.230 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T22:06:28.230 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T22:06:28.231 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T22:06:28.231 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T22:06:28.231 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T22:06:28.231 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T22:06:28.231 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T22:06:28.231 INFO:teuthology.orchestra.run.smithi142.stdout:qdb_cluster leader: 0 members: 2024-04-20T22:06:28.231 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{0:24245} state up:replay seq 4 join_fscid=1 addr [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:06:28.231 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:06:28.231 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:06:28.231 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T22:06:28.231 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:06:28.231 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:24253} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:06:28.231 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{-1:34454} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6826/2100080187,v1:172.21.15.142:6827/2100080187] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:06:28.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.231+0000 7f50c9e00700 1 -- 172.21.15.142:0/2346184522 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f50ac06ecd0 msgr2=0x7f50ac071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:28.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.231+0000 7f50c9e00700 1 --2- 172.21.15.142:0/2346184522 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f50ac06ecd0 0x7f50ac071190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f50b8006010 tx=0x7f50b800b540 comp rx=0 tx=0).stop 2024-04-20T22:06:28.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.231+0000 7f50c9e00700 1 -- 172.21.15.142:0/2346184522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c4074e90 msgr2=0x7f50c4198bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:28.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.231+0000 7f50c9e00700 1 --2- 172.21.15.142:0/2346184522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c4074e90 0x7f50c4198bc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f50b000d8d0 tx=0x7f50b000dbe0 comp rx=0 tx=0).stop 2024-04-20T22:06:28.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.231+0000 7f50c9e00700 1 -- 172.21.15.142:0/2346184522 shutdown_connections 2024-04-20T22:06:28.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.231+0000 7f50c9e00700 1 --2- 172.21.15.142:0/2346184522 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f50ac06ecd0 0x7f50ac071190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:28.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.231+0000 7f50c9e00700 1 --2- 172.21.15.142:0/2346184522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50c40738c0 0x7f50c4198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:28.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.231+0000 7f50c9e00700 1 --2- 172.21.15.142:0/2346184522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50c4074e90 0x7f50c4198bc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:28.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.231+0000 7f50c9e00700 1 -- 172.21.15.142:0/2346184522 >> 172.21.15.142:0/2346184522 conn(0x7f50c40fc050 msgr2=0x7f50c4106cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:06:28.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.232+0000 7f50c9e00700 1 -- 172.21.15.142:0/2346184522 shutdown_connections 2024-04-20T22:06:28.233 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.232+0000 7f50c9e00700 1 -- 172.21.15.142:0/2346184522 wait complete. 2024-04-20T22:06:28.233 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 20 2024-04-20T22:06:28.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.388+0000 7fe85d800700 1 -- 172.21.15.142:0/964301205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe858100c20 msgr2=0x7fe858101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:28.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.388+0000 7fe85d800700 1 --2- 172.21.15.142:0/964301205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe858100c20 0x7fe858101040 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe848009910 tx=0x7fe848009c20 comp rx=0 tx=0).stop 2024-04-20T22:06:28.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.388+0000 7fe85d800700 1 -- 172.21.15.142:0/964301205 shutdown_connections 2024-04-20T22:06:28.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.388+0000 7fe85d800700 1 --2- 172.21.15.142:0/964301205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe858101e20 0x7fe858102280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:28.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.388+0000 7fe85d800700 1 --2- 172.21.15.142:0/964301205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe858100c20 0x7fe858101040 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:28.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.388+0000 7fe85d800700 1 -- 172.21.15.142:0/964301205 >> 172.21.15.142:0/964301205 conn(0x7fe8580fc1c0 msgr2=0x7fe8580fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:06:28.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.388+0000 7fe85d800700 1 -- 172.21.15.142:0/964301205 shutdown_connections 2024-04-20T22:06:28.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.389+0000 7fe85d800700 1 -- 172.21.15.142:0/964301205 wait complete. 2024-04-20T22:06:28.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.390+0000 7fe85d800700 1 Processor -- start 2024-04-20T22:06:28.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.390+0000 7fe85d800700 1 -- start start 2024-04-20T22:06:28.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.390+0000 7fe85d800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe858100c20 0x7fe858198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:28.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.390+0000 7fe85d800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe858101e20 0x7fe858198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:28.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.390+0000 7fe85d800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe858199390 con 0x7fe858100c20 2024-04-20T22:06:28.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.390+0000 7fe85d800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8581994d0 con 0x7fe858101e20 2024-04-20T22:06:28.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.391+0000 7fe856a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe858100c20 0x7fe858198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:28.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.391+0000 7fe856a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe858100c20 0x7fe858198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34280/0 (socket says 172.21.15.142:34280) 2024-04-20T22:06:28.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.391+0000 7fe856a00700 1 -- 172.21.15.142:0/1973660268 learned_addr learned my addr 172.21.15.142:0/1973660268 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:06:28.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.391+0000 7fe856000700 1 --2- 172.21.15.142:0/1973660268 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe858101e20 0x7fe858198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:28.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.391+0000 7fe856a00700 1 -- 172.21.15.142:0/1973660268 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe858101e20 msgr2=0x7fe858198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:28.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.391+0000 7fe856a00700 1 --2- 172.21.15.142:0/1973660268 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe858101e20 0x7fe858198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:28.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.391+0000 7fe856a00700 1 -- 172.21.15.142:0/1973660268 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8480095f0 con 0x7fe858100c20 2024-04-20T22:06:28.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.392+0000 7fe856a00700 1 --2- 172.21.15.142:0/1973660268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe858100c20 0x7fe858198830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe8480059d0 tx=0x7fe84800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:06:28.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.392+0000 7fe84f400700 1 -- 172.21.15.142:0/1973660268 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe84801d070 con 0x7fe858100c20 2024-04-20T22:06:28.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.392+0000 7fe84f400700 1 -- 172.21.15.142:0/1973660268 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe84800f460 con 0x7fe858100c20 2024-04-20T22:06:28.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.392+0000 7fe84f400700 1 -- 172.21.15.142:0/1973660268 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe848021640 con 0x7fe858100c20 2024-04-20T22:06:28.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.392+0000 7fe85d800700 1 -- 172.21.15.142:0/1973660268 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85819ded0 con 0x7fe858100c20 2024-04-20T22:06:28.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.392+0000 7fe85d800700 1 -- 172.21.15.142:0/1973660268 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85819e360 con 0x7fe858100c20 2024-04-20T22:06:28.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.393+0000 7fe85d800700 1 -- 172.21.15.142:0/1973660268 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe858062510 con 0x7fe858100c20 2024-04-20T22:06:28.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.394+0000 7fe84f400700 1 -- 172.21.15.142:0/1973660268 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fe84800f5d0 con 0x7fe858100c20 2024-04-20T22:06:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.395+0000 7fe84f400700 1 --2- 172.21.15.142:0/1973660268 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe83c06ecc0 0x7fe83c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.395+0000 7fe84f400700 1 -- 172.21.15.142:0/1973660268 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe8480901b0 con 0x7fe858100c20 2024-04-20T22:06:28.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.396+0000 7fe856000700 1 --2- 172.21.15.142:0/1973660268 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe83c06ecc0 0x7fe83c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:28.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.396+0000 7fe856000700 1 --2- 172.21.15.142:0/1973660268 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe83c06ecc0 0x7fe83c071180 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe844005950 tx=0x7fe84400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:06:28.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.400+0000 7fe84f400700 1 -- 172.21.15.142:0/1973660268 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fe84805c9a0 con 0x7fe858100c20 2024-04-20T22:06:28.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.649+0000 7fe85d800700 1 -- 172.21.15.142:0/1973660268 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe858074b50 con 0x7fe83c06ecc0 2024-04-20T22:06:28.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.651+0000 7fe84f400700 1 -- 172.21.15.142:0/1973660268 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe858074b50 con 0x7fe83c06ecc0 2024-04-20T22:06:28.651 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:06:28.651 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T22:06:28.651 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T22:06:28.651 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T22:06:28.652 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T22:06:28.652 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr", 2024-04-20T22:06:28.652 INFO:teuthology.orchestra.run.smithi142.stdout: "mon", 2024-04-20T22:06:28.652 INFO:teuthology.orchestra.run.smithi142.stdout: "crash", 2024-04-20T22:06:28.652 INFO:teuthology.orchestra.run.smithi142.stdout: "osd" 2024-04-20T22:06:28.652 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T22:06:28.652 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "13/23 daemons upgraded", 2024-04-20T22:06:28.652 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading mds daemons", 2024-04-20T22:06:28.652 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T22:06:28.652 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:06:28.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.654+0000 7fe85d800700 1 -- 172.21.15.142:0/1973660268 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe83c06ecc0 msgr2=0x7fe83c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:28.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.654+0000 7fe85d800700 1 --2- 172.21.15.142:0/1973660268 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe83c06ecc0 0x7fe83c071180 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe844005950 tx=0x7fe84400b410 comp rx=0 tx=0).stop 2024-04-20T22:06:28.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.654+0000 7fe85d800700 1 -- 172.21.15.142:0/1973660268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe858100c20 msgr2=0x7fe858198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:28.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.654+0000 7fe85d800700 1 --2- 172.21.15.142:0/1973660268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe858100c20 0x7fe858198830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe8480059d0 tx=0x7fe84800bd70 comp rx=0 tx=0).stop 2024-04-20T22:06:28.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.654+0000 7fe85d800700 1 -- 172.21.15.142:0/1973660268 shutdown_connections 2024-04-20T22:06:28.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.654+0000 7fe85d800700 1 --2- 172.21.15.142:0/1973660268 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe83c06ecc0 0x7fe83c071180 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:28.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.654+0000 7fe85d800700 1 --2- 172.21.15.142:0/1973660268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe858100c20 0x7fe858198830 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:28.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.654+0000 7fe85d800700 1 --2- 172.21.15.142:0/1973660268 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe858101e20 0x7fe858198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:28.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.654+0000 7fe85d800700 1 -- 172.21.15.142:0/1973660268 >> 172.21.15.142:0/1973660268 conn(0x7fe8580fc1c0 msgr2=0x7fe858073430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:06:28.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.654+0000 7fe85d800700 1 -- 172.21.15.142:0/1973660268 shutdown_connections 2024-04-20T22:06:28.655 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.654+0000 7fe85d800700 1 -- 172.21.15.142:0/1973660268 wait complete. 2024-04-20T22:06:28.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.819+0000 7fd4e7800700 1 -- 172.21.15.142:0/2220673581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4e0074f10 msgr2=0x7fd4e0073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:28.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.819+0000 7fd4e7800700 1 --2- 172.21.15.142:0/2220673581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4e0074f10 0x7fd4e0073370 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009910 tx=0x7fd4d4009c20 comp rx=0 tx=0).stop 2024-04-20T22:06:28.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.819+0000 7fd4e7800700 1 -- 172.21.15.142:0/2220673581 shutdown_connections 2024-04-20T22:06:28.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.819+0000 7fd4e7800700 1 --2- 172.21.15.142:0/2220673581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4e0073940 0x7fd4e0073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:28.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.819+0000 7fd4e7800700 1 --2- 172.21.15.142:0/2220673581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4e0074f10 0x7fd4e0073370 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:28.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.819+0000 7fd4e7800700 1 -- 172.21.15.142:0/2220673581 >> 172.21.15.142:0/2220673581 conn(0x7fd4e00fc1c0 msgr2=0x7fd4e00fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:06:28.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.819+0000 7fd4e7800700 1 -- 172.21.15.142:0/2220673581 shutdown_connections 2024-04-20T22:06:28.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.819+0000 7fd4e7800700 1 -- 172.21.15.142:0/2220673581 wait complete. 2024-04-20T22:06:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.820+0000 7fd4e7800700 1 Processor -- start 2024-04-20T22:06:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.821+0000 7fd4e7800700 1 -- start start 2024-04-20T22:06:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.821+0000 7fd4e7800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4e0073940 0x7fd4e019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.821+0000 7fd4e7800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4e0074f10 0x7fd4e019d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:28.821 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.821+0000 7fd4e7800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e019d780 con 0x7fd4e0074f10 2024-04-20T22:06:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.821+0000 7fd4e7800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e019d8c0 con 0x7fd4e0073940 2024-04-20T22:06:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.821+0000 7fd4dfe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4e0074f10 0x7fd4e019d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.821+0000 7fd4dfe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4e0074f10 0x7fd4e019d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34298/0 (socket says 172.21.15.142:34298) 2024-04-20T22:06:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.821+0000 7fd4dfe00700 1 -- 172.21.15.142:0/226452155 learned_addr learned my addr 172.21.15.142:0/226452155 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:06:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.821+0000 7fd4e4e00700 1 --2- 172.21.15.142:0/226452155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4e0073940 0x7fd4e019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.822+0000 7fd4dfe00700 1 -- 172.21.15.142:0/226452155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4e0073940 msgr2=0x7fd4e019cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.822+0000 7fd4dfe00700 1 --2- 172.21.15.142:0/226452155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4e0073940 0x7fd4e019cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.822+0000 7fd4dfe00700 1 -- 172.21.15.142:0/226452155 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d40095f0 con 0x7fd4e0074f10 2024-04-20T22:06:28.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.822+0000 7fd4dfe00700 1 --2- 172.21.15.142:0/226452155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4e0074f10 0x7fd4e019d160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00e8f0 tx=0x7fd4cc00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:06:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.822+0000 7fd4dd600700 1 -- 172.21.15.142:0/226452155 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4cc009790 con 0x7fd4e0074f10 2024-04-20T22:06:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.822+0000 7fd4e7800700 1 -- 172.21.15.142:0/226452155 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e01a2320 con 0x7fd4e0074f10 2024-04-20T22:06:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.822+0000 7fd4e7800700 1 -- 172.21.15.142:0/226452155 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e01a28f0 con 0x7fd4e0074f10 2024-04-20T22:06:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.822+0000 7fd4dd600700 1 -- 172.21.15.142:0/226452155 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4cc00c810 con 0x7fd4e0074f10 2024-04-20T22:06:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.822+0000 7fd4dd600700 1 -- 172.21.15.142:0/226452155 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4cc003d20 con 0x7fd4e0074f10 2024-04-20T22:06:28.823 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.823+0000 7fd4e7800700 1 -- 172.21.15.142:0/226452155 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c0005320 con 0x7fd4e0074f10 2024-04-20T22:06:28.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.825+0000 7fd4dd600700 1 -- 172.21.15.142:0/226452155 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fd4cc0041f0 con 0x7fd4e0074f10 2024-04-20T22:06:28.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.825+0000 7fd4dd600700 1 --2- 172.21.15.142:0/226452155 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd4c806ecc0 0x7fd4c8071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:28.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.826+0000 7fd4dd600700 1 -- 172.21.15.142:0/226452155 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd4cc014070 con 0x7fd4e0074f10 2024-04-20T22:06:28.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.826+0000 7fd4e4e00700 1 --2- 172.21.15.142:0/226452155 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd4c806ecc0 0x7fd4c8071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:28.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.826+0000 7fd4e4e00700 1 --2- 172.21.15.142:0/226452155 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd4c806ecc0 0x7fd4c8071180 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400b6f0 tx=0x7fd4d4005fb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:06:28.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:28.830+0000 7fd4dd600700 1 -- 172.21.15.142:0/226452155 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fd4cc05b930 con 0x7fd4e0074f10 2024-04-20T22:06:28.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:28 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1394123936' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:06:28.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:28 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2346184522' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:06:29.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:29.148+0000 7fd4e7800700 1 -- 172.21.15.142:0/226452155 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd4c00055d0 con 0x7fd4e0074f10 2024-04-20T22:06:29.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:29.148+0000 7fd4dd600700 1 -- 172.21.15.142:0/226452155 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7fd4cc05b4c0 con 0x7fd4e0074f10 2024-04-20T22:06:29.148 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_WARN 1 filesystem is degraded 2024-04-20T22:06:29.148 INFO:teuthology.orchestra.run.smithi142.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-20T22:06:29.149 INFO:teuthology.orchestra.run.smithi142.stdout: fs cephfs is degraded 2024-04-20T22:06:29.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:29.151+0000 7fd4e7800700 1 -- 172.21.15.142:0/226452155 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd4c806ecc0 msgr2=0x7fd4c8071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:29.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:29.151+0000 7fd4e7800700 1 --2- 172.21.15.142:0/226452155 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd4c806ecc0 0x7fd4c8071180 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400b6f0 tx=0x7fd4d4005fb0 comp rx=0 tx=0).stop 2024-04-20T22:06:29.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:29.151+0000 7fd4e7800700 1 -- 172.21.15.142:0/226452155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4e0074f10 msgr2=0x7fd4e019d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:29.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:29.151+0000 7fd4e7800700 1 --2- 172.21.15.142:0/226452155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4e0074f10 0x7fd4e019d160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00e8f0 tx=0x7fd4cc00ec00 comp rx=0 tx=0).stop 2024-04-20T22:06:29.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:29.151+0000 7fd4e7800700 1 -- 172.21.15.142:0/226452155 shutdown_connections 2024-04-20T22:06:29.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:29.151+0000 7fd4e7800700 1 --2- 172.21.15.142:0/226452155 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd4c806ecc0 0x7fd4c8071180 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:29.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:29.151+0000 7fd4e7800700 1 --2- 172.21.15.142:0/226452155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4e0073940 0x7fd4e019cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:29.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:29.151+0000 7fd4e7800700 1 --2- 172.21.15.142:0/226452155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4e0074f10 0x7fd4e019d160 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:29.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:29.151+0000 7fd4e7800700 1 -- 172.21.15.142:0/226452155 >> 172.21.15.142:0/226452155 conn(0x7fd4e00fc1c0 msgr2=0x7fd4e01029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:06:29.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:29.151+0000 7fd4e7800700 1 -- 172.21.15.142:0/226452155 shutdown_connections 2024-04-20T22:06:29.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:29.151+0000 7fd4e7800700 1 -- 172.21.15.142:0/226452155 wait complete. 2024-04-20T22:06:29.195 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:28 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/1394123936' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:06:29.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:28 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/2346184522' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:06:29.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:29 smithi164 ceph-mon[69784]: pgmap v223: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-20T22:06:29.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:29 smithi164 ceph-mon[69784]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:06:29.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:29 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/226452155' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:06:29.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:29.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:06:30.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:29 smithi142 ceph-mon[79401]: pgmap v223: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-20T22:06:30.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:29 smithi142 ceph-mon[79401]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:06:30.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:29 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/226452155' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:06:30.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:30.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:06:32.151 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:31 smithi164 ceph-mon[69784]: pgmap v224: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-04-20T22:06:32.152 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:31 smithi164 ceph-mon[69784]: mds.? [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] up:reconnect 2024-04-20T22:06:32.152 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:31 smithi164 ceph-mon[69784]: fsmap cephfs:1/1 {0=cephfs.smithi164.ybvzha=up:reconnect} 2 up:standby 2024-04-20T22:06:32.152 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:31 smithi164 ceph-mon[69784]: reconnect by client.14536 192.168.0.1:0/1982029803 after 0.00699989 2024-04-20T22:06:32.152 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:31 smithi164 ceph-mon[69784]: reconnect by client.24289 192.168.0.1:0/4069521734 after 0.00699989 2024-04-20T22:06:32.152 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:31 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:32.152 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:31 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:32.152 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:31 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:06:32.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:31 smithi142 ceph-mon[79401]: pgmap v224: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-04-20T22:06:32.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:31 smithi142 ceph-mon[79401]: mds.? [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] up:reconnect 2024-04-20T22:06:32.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:31 smithi142 ceph-mon[79401]: fsmap cephfs:1/1 {0=cephfs.smithi164.ybvzha=up:reconnect} 2 up:standby 2024-04-20T22:06:32.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:31 smithi142 ceph-mon[79401]: reconnect by client.14536 192.168.0.1:0/1982029803 after 0.00699989 2024-04-20T22:06:32.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:31 smithi142 ceph-mon[79401]: reconnect by client.24289 192.168.0.1:0/4069521734 after 0.00699989 2024-04-20T22:06:32.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:31 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:32.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:31 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:32.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:31 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:06:33.092 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:32 smithi142 ceph-mon[79401]: mds.? [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] up:rejoin 2024-04-20T22:06:33.092 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:32 smithi142 ceph-mon[79401]: mds.? [v2:172.21.15.142:6828/2960234081,v1:172.21.15.142:6829/2960234081] up:boot 2024-04-20T22:06:33.092 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:32 smithi142 ceph-mon[79401]: fsmap cephfs:1/1 {0=cephfs.smithi164.ybvzha=up:rejoin} 3 up:standby 2024-04-20T22:06:33.092 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:32 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lrvfgg"}]: dispatch 2024-04-20T22:06:33.092 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:32 smithi142 ceph-mon[79401]: daemon mds.cephfs.smithi164.ybvzha is now active in filesystem cephfs as rank 0 2024-04-20T22:06:33.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:32 smithi164 ceph-mon[69784]: mds.? [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] up:rejoin 2024-04-20T22:06:33.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:32 smithi164 ceph-mon[69784]: mds.? [v2:172.21.15.142:6828/2960234081,v1:172.21.15.142:6829/2960234081] up:boot 2024-04-20T22:06:33.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:32 smithi164 ceph-mon[69784]: fsmap cephfs:1/1 {0=cephfs.smithi164.ybvzha=up:rejoin} 3 up:standby 2024-04-20T22:06:33.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:32 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi142.lrvfgg"}]: dispatch 2024-04-20T22:06:33.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:32 smithi164 ceph-mon[69784]: daemon mds.cephfs.smithi164.ybvzha is now active in filesystem cephfs as rank 0 2024-04-20T22:06:34.087 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:33 smithi142 ceph-mon[79401]: pgmap v225: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-20T22:06:34.087 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:33 smithi142 ceph-mon[79401]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-20T22:06:34.088 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:33 smithi142 ceph-mon[79401]: Cluster is now healthy 2024-04-20T22:06:34.088 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:33 smithi142 ceph-mon[79401]: mds.? [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] up:active 2024-04-20T22:06:34.088 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:33 smithi142 ceph-mon[79401]: fsmap cephfs:1 {0=cephfs.smithi164.ybvzha=up:active} 3 up:standby 2024-04-20T22:06:34.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:33 smithi164 ceph-mon[69784]: pgmap v225: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-20T22:06:34.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:33 smithi164 ceph-mon[69784]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-20T22:06:34.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:33 smithi164 ceph-mon[69784]: Cluster is now healthy 2024-04-20T22:06:34.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:33 smithi164 ceph-mon[69784]: mds.? [v2:172.21.15.164:6824/4054029190,v1:172.21.15.164:6825/4054029190] up:active 2024-04-20T22:06:34.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:33 smithi164 ceph-mon[69784]: fsmap cephfs:1 {0=cephfs.smithi164.ybvzha=up:active} 3 up:standby 2024-04-20T22:06:36.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:35 smithi164 ceph-mon[69784]: pgmap v226: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 7 op/s 2024-04-20T22:06:36.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:35 smithi142 ceph-mon[79401]: pgmap v226: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 7 op/s 2024-04-20T22:06:37.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:37 smithi142 ceph-mon[79401]: pgmap v227: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 7 op/s 2024-04-20T22:06:38.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:37 smithi164 ceph-mon[69784]: pgmap v227: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 7 op/s 2024-04-20T22:06:40.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:39 smithi164 ceph-mon[69784]: pgmap v228: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 7.5 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-20T22:06:40.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:39 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:40.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:39 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:40.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:39 smithi142 ceph-mon[79401]: pgmap v228: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 7.5 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-20T22:06:40.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:39 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:40.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:39 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:42.249 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:42 smithi142 ceph-mon[79401]: pgmap v229: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 3.3 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-20T22:06:42.249 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:42 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:42.249 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:42 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:42.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:42 smithi164 ceph-mon[69784]: pgmap v229: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 3.3 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-20T22:06:42.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:42 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:42.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:42 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:44.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:44 smithi164 ceph-mon[69784]: pgmap v230: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-20T22:06:44.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:44 smithi142 ceph-mon[79401]: pgmap v230: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-20T22:06:45.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:45.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:06:45.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:45 smithi164 ceph-mon[69784]: pgmap v231: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-20T22:06:45.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:45.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:06:45.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:45 smithi142 ceph-mon[79401]: pgmap v231: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-20T22:06:47.832 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:47.833 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:47.833 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:06:47.833 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:06:47.833 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:47.833 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:47 smithi164 ceph-mon[69784]: pgmap v232: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 4.1 KiB/s wr, 3 op/s 2024-04-20T22:06:47.833 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:06:47.833 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:06:47.833 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:06:47.833 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:06:47.833 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:06:47.833 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:47 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi164.ybvzha"]}]: dispatch 2024-04-20T22:06:47.833 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:47 smithi164 ceph-mon[69784]: Upgrade: It appears safe to stop mds.cephfs.smithi164.ybvzha 2024-04-20T22:06:47.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:47.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:47.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:06:47.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:06:47.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:47.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:47 smithi142 ceph-mon[79401]: pgmap v232: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 4.1 KiB/s wr, 3 op/s 2024-04-20T22:06:47.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:06:47.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:06:47.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:06:47.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:06:47.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:06:47.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:47 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi164.ybvzha"]}]: dispatch 2024-04-20T22:06:47.948 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:47 smithi142 ceph-mon[79401]: Upgrade: It appears safe to stop mds.cephfs.smithi164.ybvzha 2024-04-20T22:06:50.556 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:50 smithi164 ceph-mon[69784]: pgmap v233: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 4.0 KiB/s wr, 1 op/s 2024-04-20T22:06:50.556 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:50 smithi164 ceph-mon[69784]: Upgrade: Updating mds.cephfs.smithi164.ybvzha 2024-04-20T22:06:50.556 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:50 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:50.556 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:50 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi164.ybvzha", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T22:06:50.556 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:50 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:06:50.556 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:50 smithi164 ceph-mon[69784]: Deploying daemon mds.cephfs.smithi164.ybvzha on smithi164 2024-04-20T22:06:50.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:50 smithi142 ceph-mon[79401]: pgmap v233: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 4.0 KiB/s wr, 1 op/s 2024-04-20T22:06:50.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:50 smithi142 ceph-mon[79401]: Upgrade: Updating mds.cephfs.smithi164.ybvzha 2024-04-20T22:06:50.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:50 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:06:50.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:50 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi164.ybvzha", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T22:06:50.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:50 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:06:50.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:50 smithi142 ceph-mon[79401]: Deploying daemon mds.cephfs.smithi164.ybvzha on smithi164 2024-04-20T22:06:52.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:52 smithi142 ceph-mon[79401]: pgmap v234: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:06:52.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:52 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142[79397]: 2024-04-20T22:06:52.436+0000 7fc6cd800700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T22:06:52.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:52 smithi164 ceph-mon[69784]: pgmap v234: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:06:53.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:53 smithi164 ceph-mon[69784]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-20T22:06:53.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:53 smithi164 ceph-mon[69784]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T22:06:53.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:53 smithi164 ceph-mon[69784]: osdmap e84: 6 total, 6 up, 6 in 2024-04-20T22:06:53.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:53 smithi164 ceph-mon[69784]: Standby daemon mds.cephfs.smithi164.gmmrfu assigned to filesystem cephfs as rank 0 2024-04-20T22:06:53.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:53 smithi164 ceph-mon[69784]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-20T22:06:53.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:53 smithi164 ceph-mon[69784]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-20T22:06:53.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:53 smithi164 ceph-mon[69784]: fsmap cephfs:1/1 {0=cephfs.smithi164.gmmrfu=up:replay} 2 up:standby 2024-04-20T22:06:53.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:53 smithi142 ceph-mon[79401]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-20T22:06:53.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:53 smithi142 ceph-mon[79401]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T22:06:53.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:53 smithi142 ceph-mon[79401]: osdmap e84: 6 total, 6 up, 6 in 2024-04-20T22:06:53.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:53 smithi142 ceph-mon[79401]: Standby daemon mds.cephfs.smithi164.gmmrfu assigned to filesystem cephfs as rank 0 2024-04-20T22:06:53.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:53 smithi142 ceph-mon[79401]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-20T22:06:53.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:53 smithi142 ceph-mon[79401]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-20T22:06:53.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:53 smithi142 ceph-mon[79401]: fsmap cephfs:1/1 {0=cephfs.smithi164.gmmrfu=up:replay} 2 up:standby 2024-04-20T22:06:54.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:54 smithi164 ceph-mon[69784]: pgmap v236: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:06:54.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:54 smithi142 ceph-mon[79401]: pgmap v236: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:06:56.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:56 smithi164 ceph-mon[69784]: pgmap v237: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 1 op/s 2024-04-20T22:06:56.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:56 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.ybvzha"}]: dispatch 2024-04-20T22:06:56.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:56 smithi142 ceph-mon[79401]: pgmap v237: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 1 op/s 2024-04-20T22:06:56.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:56 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.ybvzha"}]: dispatch 2024-04-20T22:06:58.528 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:06:58 smithi164 ceph-mon[69784]: pgmap v238: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 9.6 MiB/s rd, 3 op/s 2024-04-20T22:06:58.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:06:58 smithi142 ceph-mon[79401]: pgmap v238: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 9.6 MiB/s rd, 3 op/s 2024-04-20T22:06:59.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.322+0000 7f8f5e000700 1 -- 172.21.15.142:0/2063411292 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f58103fb0 msgr2=0x7f8f58104430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:59.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.322+0000 7f8f5e000700 1 --2- 172.21.15.142:0/2063411292 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f58103fb0 0x7f8f58104430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8f44009910 tx=0x7f8f44009c20 comp rx=0 tx=0).stop 2024-04-20T22:06:59.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.322+0000 7f8f5e000700 1 -- 172.21.15.142:0/2063411292 shutdown_connections 2024-04-20T22:06:59.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.322+0000 7f8f5e000700 1 --2- 172.21.15.142:0/2063411292 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f58103fb0 0x7f8f58104430 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:59.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.322+0000 7f8f5e000700 1 --2- 172.21.15.142:0/2063411292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f58102e50 0x7f8f58103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:59.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.322+0000 7f8f5e000700 1 -- 172.21.15.142:0/2063411292 >> 172.21.15.142:0/2063411292 conn(0x7f8f580fe3d0 msgr2=0x7f8f58100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:06:59.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.322+0000 7f8f5e000700 1 -- 172.21.15.142:0/2063411292 shutdown_connections 2024-04-20T22:06:59.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.322+0000 7f8f5e000700 1 -- 172.21.15.142:0/2063411292 wait complete. 2024-04-20T22:06:59.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.323+0000 7f8f5e000700 1 Processor -- start 2024-04-20T22:06:59.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.324+0000 7f8f5e000700 1 -- start start 2024-04-20T22:06:59.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.324+0000 7f8f5e000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f58102e50 0x7f8f58198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:59.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.324+0000 7f8f5e000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f58103fb0 0x7f8f58198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:59.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.324+0000 7f8f5e000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f58199370 con 0x7f8f58102e50 2024-04-20T22:06:59.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.324+0000 7f8f5e000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f581994b0 con 0x7f8f58103fb0 2024-04-20T22:06:59.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.324+0000 7f8f57400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f58102e50 0x7f8f58198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:59.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.324+0000 7f8f57400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f58102e50 0x7f8f58198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52640/0 (socket says 172.21.15.142:52640) 2024-04-20T22:06:59.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.324+0000 7f8f57400700 1 -- 172.21.15.142:0/3963640259 learned_addr learned my addr 172.21.15.142:0/3963640259 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:06:59.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.325+0000 7f8f57400700 1 -- 172.21.15.142:0/3963640259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f58103fb0 msgr2=0x7f8f58198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:59.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.325+0000 7f8f57400700 1 --2- 172.21.15.142:0/3963640259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f58103fb0 0x7f8f58198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:59.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.325+0000 7f8f57400700 1 -- 172.21.15.142:0/3963640259 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f440095f0 con 0x7f8f58102e50 2024-04-20T22:06:59.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.325+0000 7f8f57400700 1 --2- 172.21.15.142:0/3963640259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f58102e50 0x7f8f58198810 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8f4800e920 tx=0x7f8f4800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:06:59.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.325+0000 7f8f4fe00700 1 -- 172.21.15.142:0/3963640259 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f48009790 con 0x7f8f58102e50 2024-04-20T22:06:59.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.326+0000 7f8f4fe00700 1 -- 172.21.15.142:0/3963640259 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f4800cba0 con 0x7f8f58102e50 2024-04-20T22:06:59.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.326+0000 7f8f5e000700 1 -- 172.21.15.142:0/3963640259 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5819df10 con 0x7f8f58102e50 2024-04-20T22:06:59.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.326+0000 7f8f4fe00700 1 -- 172.21.15.142:0/3963640259 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f48018650 con 0x7f8f58102e50 2024-04-20T22:06:59.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.326+0000 7f8f5e000700 1 -- 172.21.15.142:0/3963640259 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5819e480 con 0x7f8f58102e50 2024-04-20T22:06:59.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.327+0000 7f8f5e000700 1 -- 172.21.15.142:0/3963640259 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f58192950 con 0x7f8f58102e50 2024-04-20T22:06:59.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.328+0000 7f8f4fe00700 1 -- 172.21.15.142:0/3963640259 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f8f4800cd10 con 0x7f8f58102e50 2024-04-20T22:06:59.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.329+0000 7f8f4fe00700 1 --2- 172.21.15.142:0/3963640259 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8f3c06ecc0 0x7f8f3c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:59.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.329+0000 7f8f4fe00700 1 -- 172.21.15.142:0/3963640259 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f8f48014070 con 0x7f8f58102e50 2024-04-20T22:06:59.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.330+0000 7f8f56a00700 1 --2- 172.21.15.142:0/3963640259 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8f3c06ecc0 0x7f8f3c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:59.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.331+0000 7f8f56a00700 1 --2- 172.21.15.142:0/3963640259 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8f3c06ecc0 0x7f8f3c071180 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f44006010 tx=0x7f8f4400b7c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:06:59.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.335+0000 7f8f4fe00700 1 -- 172.21.15.142:0/3963640259 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f8f48053ff0 con 0x7f8f58102e50 2024-04-20T22:06:59.582 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.582+0000 7f8f5e000700 1 -- 172.21.15.142:0/3963640259 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f5802cf30 con 0x7f8f3c06ecc0 2024-04-20T22:06:59.584 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.585+0000 7f8f4fe00700 1 -- 172.21.15.142:0/3963640259 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8f5802cf30 con 0x7f8f3c06ecc0 2024-04-20T22:06:59.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.588+0000 7f8f5e000700 1 -- 172.21.15.142:0/3963640259 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8f3c06ecc0 msgr2=0x7f8f3c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:59.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.588+0000 7f8f5e000700 1 --2- 172.21.15.142:0/3963640259 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8f3c06ecc0 0x7f8f3c071180 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f44006010 tx=0x7f8f4400b7c0 comp rx=0 tx=0).stop 2024-04-20T22:06:59.587 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.588+0000 7f8f5e000700 1 -- 172.21.15.142:0/3963640259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f58102e50 msgr2=0x7f8f58198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:59.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.588+0000 7f8f5e000700 1 --2- 172.21.15.142:0/3963640259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f58102e50 0x7f8f58198810 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8f4800e920 tx=0x7f8f4800ece0 comp rx=0 tx=0).stop 2024-04-20T22:06:59.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.588+0000 7f8f5e000700 1 -- 172.21.15.142:0/3963640259 shutdown_connections 2024-04-20T22:06:59.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.588+0000 7f8f5e000700 1 --2- 172.21.15.142:0/3963640259 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8f3c06ecc0 0x7f8f3c071180 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:59.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.588+0000 7f8f5e000700 1 --2- 172.21.15.142:0/3963640259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f58102e50 0x7f8f58198810 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:59.588 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.588+0000 7f8f5e000700 1 --2- 172.21.15.142:0/3963640259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f58103fb0 0x7f8f58198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:59.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.588+0000 7f8f5e000700 1 -- 172.21.15.142:0/3963640259 >> 172.21.15.142:0/3963640259 conn(0x7f8f580fe3d0 msgr2=0x7f8f58107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:06:59.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.588+0000 7f8f5e000700 1 -- 172.21.15.142:0/3963640259 shutdown_connections 2024-04-20T22:06:59.589 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.588+0000 7f8f5e000700 1 -- 172.21.15.142:0/3963640259 wait complete. 2024-04-20T22:06:59.604 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T22:06:59.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.735+0000 7f40ab200700 1 -- 172.21.15.142:0/2152977896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40a41070f0 msgr2=0x7f40a4107510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:59.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.735+0000 7f40ab200700 1 --2- 172.21.15.142:0/2152977896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40a41070f0 0x7f40a4107510 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4098009910 tx=0x7f4098009c20 comp rx=0 tx=0).stop 2024-04-20T22:06:59.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.735+0000 7f40ab200700 1 -- 172.21.15.142:0/2152977896 shutdown_connections 2024-04-20T22:06:59.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.735+0000 7f40ab200700 1 --2- 172.21.15.142:0/2152977896 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40a4108290 0x7f40a41086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:59.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.735+0000 7f40ab200700 1 --2- 172.21.15.142:0/2152977896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40a41070f0 0x7f40a4107510 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:59.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.735+0000 7f40ab200700 1 -- 172.21.15.142:0/2152977896 >> 172.21.15.142:0/2152977896 conn(0x7f40a40761d0 msgr2=0x7f40a4078610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:06:59.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.735+0000 7f40ab200700 1 -- 172.21.15.142:0/2152977896 shutdown_connections 2024-04-20T22:06:59.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.735+0000 7f40ab200700 1 -- 172.21.15.142:0/2152977896 wait complete. 2024-04-20T22:06:59.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.736+0000 7f40ab200700 1 Processor -- start 2024-04-20T22:06:59.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.736+0000 7f40ab200700 1 -- start start 2024-04-20T22:06:59.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.737+0000 7f40ab200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40a41070f0 0x7f40a419cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:59.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.737+0000 7f40ab200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40a4108290 0x7f40a419d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:59.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.737+0000 7f40ab200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a419d660 con 0x7f40a4108290 2024-04-20T22:06:59.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.737+0000 7f40ab200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a419d7a0 con 0x7f40a41070f0 2024-04-20T22:06:59.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.737+0000 7f40a9400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40a4108290 0x7f40a419d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:59.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.737+0000 7f40a9400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40a4108290 0x7f40a419d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52662/0 (socket says 172.21.15.142:52662) 2024-04-20T22:06:59.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.737+0000 7f40a9400700 1 -- 172.21.15.142:0/493516476 learned_addr learned my addr 172.21.15.142:0/493516476 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:06:59.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.737+0000 7f40a9e00700 1 --2- 172.21.15.142:0/493516476 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40a41070f0 0x7f40a419cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:59.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.737+0000 7f40a9400700 1 -- 172.21.15.142:0/493516476 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40a41070f0 msgr2=0x7f40a419cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:59.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.737+0000 7f40a9400700 1 --2- 172.21.15.142:0/493516476 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40a41070f0 0x7f40a419cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:59.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.737+0000 7f40a9400700 1 -- 172.21.15.142:0/493516476 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40980095f0 con 0x7f40a4108290 2024-04-20T22:06:59.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.738+0000 7f40a9400700 1 --2- 172.21.15.142:0/493516476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40a4108290 0x7f40a419d040 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f409400d8d0 tx=0x7f409400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:06:59.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.738+0000 7f409ea00700 1 -- 172.21.15.142:0/493516476 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40940098a0 con 0x7f40a4108290 2024-04-20T22:06:59.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.738+0000 7f409ea00700 1 -- 172.21.15.142:0/493516476 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4094010460 con 0x7f40a4108290 2024-04-20T22:06:59.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.738+0000 7f40ab200700 1 -- 172.21.15.142:0/493516476 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a41a21b0 con 0x7f40a4108290 2024-04-20T22:06:59.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.738+0000 7f409ea00700 1 -- 172.21.15.142:0/493516476 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f409400f5f0 con 0x7f40a4108290 2024-04-20T22:06:59.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.738+0000 7f40ab200700 1 -- 172.21.15.142:0/493516476 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a41a2780 con 0x7f40a4108290 2024-04-20T22:06:59.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.739+0000 7f40ab200700 1 -- 172.21.15.142:0/493516476 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a4196c10 con 0x7f40a4108290 2024-04-20T22:06:59.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.741+0000 7f409ea00700 1 -- 172.21.15.142:0/493516476 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f4094009a00 con 0x7f40a4108290 2024-04-20T22:06:59.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.741+0000 7f409ea00700 1 --2- 172.21.15.142:0/493516476 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f408c06ecd0 0x7f408c071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:06:59.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.742+0000 7f409ea00700 1 -- 172.21.15.142:0/493516476 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f409408ed50 con 0x7f40a4108290 2024-04-20T22:06:59.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.742+0000 7f40a9e00700 1 --2- 172.21.15.142:0/493516476 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f408c06ecd0 0x7f408c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:06:59.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.742+0000 7f40a9e00700 1 --2- 172.21.15.142:0/493516476 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f408c06ecd0 0x7f408c071190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4098005090 tx=0x7f409800b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:06:59.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.746+0000 7f409ea00700 1 -- 172.21.15.142:0/493516476 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f409405b590 con 0x7f40a4108290 2024-04-20T22:06:59.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.982+0000 7f40ab200700 1 -- 172.21.15.142:0/493516476 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f40a402ce30 con 0x7f408c06ecd0 2024-04-20T22:06:59.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.984+0000 7f409ea00700 1 -- 172.21.15.142:0/493516476 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f40a402ce30 con 0x7f408c06ecd0 2024-04-20T22:06:59.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.987+0000 7f40ab200700 1 -- 172.21.15.142:0/493516476 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f408c06ecd0 msgr2=0x7f408c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:59.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.987+0000 7f40ab200700 1 --2- 172.21.15.142:0/493516476 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f408c06ecd0 0x7f408c071190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4098005090 tx=0x7f409800b540 comp rx=0 tx=0).stop 2024-04-20T22:06:59.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.987+0000 7f40ab200700 1 -- 172.21.15.142:0/493516476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40a4108290 msgr2=0x7f40a419d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:06:59.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.987+0000 7f40ab200700 1 --2- 172.21.15.142:0/493516476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40a4108290 0x7f40a419d040 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f409400d8d0 tx=0x7f409400dbe0 comp rx=0 tx=0).stop 2024-04-20T22:06:59.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.987+0000 7f40ab200700 1 -- 172.21.15.142:0/493516476 shutdown_connections 2024-04-20T22:06:59.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.987+0000 7f40ab200700 1 --2- 172.21.15.142:0/493516476 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f408c06ecd0 0x7f408c071190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:59.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.987+0000 7f40ab200700 1 --2- 172.21.15.142:0/493516476 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40a41070f0 0x7f40a419cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:59.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.987+0000 7f40ab200700 1 --2- 172.21.15.142:0/493516476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40a4108290 0x7f40a419d040 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:06:59.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.987+0000 7f40ab200700 1 -- 172.21.15.142:0/493516476 >> 172.21.15.142:0/493516476 conn(0x7f40a40761d0 msgr2=0x7f40a410b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:06:59.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.988+0000 7f40ab200700 1 -- 172.21.15.142:0/493516476 shutdown_connections 2024-04-20T22:06:59.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:06:59.988+0000 7f40ab200700 1 -- 172.21.15.142:0/493516476 wait complete. 2024-04-20T22:07:00.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.132+0000 7f0080e00700 1 -- 172.21.15.142:0/1415820234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f007c102e50 msgr2=0x7f007c103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:00.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.132+0000 7f0080e00700 1 --2- 172.21.15.142:0/1415820234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f007c102e50 0x7f007c103270 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f006c009910 tx=0x7f006c009c20 comp rx=0 tx=0).stop 2024-04-20T22:07:00.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.132+0000 7f0080e00700 1 -- 172.21.15.142:0/1415820234 shutdown_connections 2024-04-20T22:07:00.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.132+0000 7f0080e00700 1 --2- 172.21.15.142:0/1415820234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f007c103fb0 0x7f007c104430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:00.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.132+0000 7f0080e00700 1 --2- 172.21.15.142:0/1415820234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f007c102e50 0x7f007c103270 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:00.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.132+0000 7f0080e00700 1 -- 172.21.15.142:0/1415820234 >> 172.21.15.142:0/1415820234 conn(0x7f007c0fe3d0 msgr2=0x7f007c100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:00.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.133+0000 7f0080e00700 1 -- 172.21.15.142:0/1415820234 shutdown_connections 2024-04-20T22:07:00.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.133+0000 7f0080e00700 1 -- 172.21.15.142:0/1415820234 wait complete. 2024-04-20T22:07:00.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.133+0000 7f0080e00700 1 Processor -- start 2024-04-20T22:07:00.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.134+0000 7f0080e00700 1 -- start start 2024-04-20T22:07:00.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.134+0000 7f0080e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f007c102e50 0x7f007c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:00.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.134+0000 7f0080e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f007c103fb0 0x7f007c198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:00.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.134+0000 7f0080e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c199340 con 0x7f007c103fb0 2024-04-20T22:07:00.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.134+0000 7f0080e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c199480 con 0x7f007c102e50 2024-04-20T22:07:00.135 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.134+0000 7f0079400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f007c103fb0 0x7f007c198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:00.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.134+0000 7f0079400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f007c103fb0 0x7f007c198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52682/0 (socket says 172.21.15.142:52682) 2024-04-20T22:07:00.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.134+0000 7f0079400700 1 -- 172.21.15.142:0/886392362 learned_addr learned my addr 172.21.15.142:0/886392362 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:07:00.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.134+0000 7f0079e00700 1 --2- 172.21.15.142:0/886392362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f007c102e50 0x7f007c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:00.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.135+0000 7f0079400700 1 -- 172.21.15.142:0/886392362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f007c102e50 msgr2=0x7f007c1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:00.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.135+0000 7f0079400700 1 --2- 172.21.15.142:0/886392362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f007c102e50 0x7f007c1987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:00.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.135+0000 7f0079400700 1 -- 172.21.15.142:0/886392362 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c0095f0 con 0x7f007c103fb0 2024-04-20T22:07:00.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.135+0000 7f0079400700 1 --2- 172.21.15.142:0/886392362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f007c103fb0 0x7f007c198d20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f006800d8d0 tx=0x7f006800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:00.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.135+0000 7f0072a00700 1 -- 172.21.15.142:0/886392362 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0068009940 con 0x7f007c103fb0 2024-04-20T22:07:00.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.135+0000 7f0072a00700 1 -- 172.21.15.142:0/886392362 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0068010460 con 0x7f007c103fb0 2024-04-20T22:07:00.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.135+0000 7f0080e00700 1 -- 172.21.15.142:0/886392362 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007c19dee0 con 0x7f007c103fb0 2024-04-20T22:07:00.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.135+0000 7f0072a00700 1 -- 172.21.15.142:0/886392362 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f006800f5f0 con 0x7f007c103fb0 2024-04-20T22:07:00.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.135+0000 7f0080e00700 1 -- 172.21.15.142:0/886392362 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007c19e480 con 0x7f007c103fb0 2024-04-20T22:07:00.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.136+0000 7f0080e00700 1 -- 172.21.15.142:0/886392362 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007c192950 con 0x7f007c103fb0 2024-04-20T22:07:00.137 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.138+0000 7f0072a00700 1 -- 172.21.15.142:0/886392362 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f00680105d0 con 0x7f007c103fb0 2024-04-20T22:07:00.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.139+0000 7f0072a00700 1 --2- 172.21.15.142:0/886392362 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f006006ecd0 0x7f0060071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:00.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.139+0000 7f0072a00700 1 -- 172.21.15.142:0/886392362 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f006808ef90 con 0x7f007c103fb0 2024-04-20T22:07:00.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.139+0000 7f0079e00700 1 --2- 172.21.15.142:0/886392362 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f006006ecd0 0x7f0060071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:00.139 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.140+0000 7f0079e00700 1 --2- 172.21.15.142:0/886392362 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f006006ecd0 0x7f0060071190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f006c0051c0 tx=0x7f006c00b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:00.143 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.144+0000 7f0072a00700 1 -- 172.21.15.142:0/886392362 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f006805b750 con 0x7f007c103fb0 2024-04-20T22:07:00.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.380+0000 7f0080e00700 1 -- 172.21.15.142:0/886392362 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f007c02ceb0 con 0x7f006006ecd0 2024-04-20T22:07:00.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.395+0000 7f0072a00700 1 -- 172.21.15.142:0/886392362 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f007c02ceb0 con 0x7f006006ecd0 2024-04-20T22:07:00.395 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:07:00.396 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (17m) 21s ago 19m 14.2M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T22:07:00.396 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (19m) 21s ago 19m 9110k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T22:07:00.396 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (18m) 87s ago 18m 8560k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T22:07:00.396 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (5m) 21s ago 19m 6665k - 19.0.0-3133-ga8c84f59 76bc6b91b726 64521ed7125b 2024-04-20T22:07:00.396 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (5m) 87s ago 18m 6656k - 19.0.0-3133-ga8c84f59 76bc6b91b726 893c6f16ee6d 2024-04-20T22:07:00.396 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (17m) 21s ago 19m 74.8M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T22:07:00.396 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (61s) 21s ago 12m 12.0M - 19.0.0-3133-ga8c84f59 76bc6b91b726 603d9ff4accc 2024-04-20T22:07:00.396 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (29s) 21s ago 12m 11.0M - 19.0.0-3133-ga8c84f59 76bc6b91b726 5fbbe225e911 2024-04-20T22:07:00.396 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (12m) 87s ago 12m 17.2M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 d84fef15c598 2024-04-20T22:07:00.396 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (12m) 87s ago 12m 17.5M - 18.2.2-1237-g646b8c7d 9900ed1a6b81 8d7c8ed08e41 2024-04-20T22:07:00.396 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (8m) 21s ago 21m 511M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:07:00.396 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (7m) 87s ago 18m 453M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:07:00.396 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (6m) 21s ago 21m 55.9M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 af10a542c918 2024-04-20T22:07:00.397 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (6m) 87s ago 18m 36.9M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 133512694d46 2024-04-20T22:07:00.397 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (19m) 21s ago 19m 8166k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T22:07:00.397 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (18m) 87s ago 18m 8300k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T22:07:00.397 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (4m) 21s ago 17m 104M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 b7206d05a7cd 2024-04-20T22:07:00.397 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (3m) 21s ago 16m 105M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 82bcc0c46762 2024-04-20T22:07:00.397 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (3m) 21s ago 15m 92.6M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 3e2d91f49494 2024-04-20T22:07:00.397 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (2m) 87s ago 15m 105M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 a898b8b77c51 2024-04-20T22:07:00.397 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (2m) 87s ago 14m 97.2M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 539c4026f9fb 2024-04-20T22:07:00.397 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (92s) 87s ago 14m 11.1M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 ac1bdd69c944 2024-04-20T22:07:00.397 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (7m) 21s ago 19m 77.5M - 2.43.0 a07b618ecd1d 46b76c20eae5 2024-04-20T22:07:00.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.399+0000 7f0080e00700 1 -- 172.21.15.142:0/886392362 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f006006ecd0 msgr2=0x7f0060071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:00.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.399+0000 7f0080e00700 1 --2- 172.21.15.142:0/886392362 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f006006ecd0 0x7f0060071190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f006c0051c0 tx=0x7f006c00b540 comp rx=0 tx=0).stop 2024-04-20T22:07:00.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.399+0000 7f0080e00700 1 -- 172.21.15.142:0/886392362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f007c103fb0 msgr2=0x7f007c198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:00.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.399+0000 7f0080e00700 1 --2- 172.21.15.142:0/886392362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f007c103fb0 0x7f007c198d20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f006800d8d0 tx=0x7f006800dc90 comp rx=0 tx=0).stop 2024-04-20T22:07:00.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.399+0000 7f0080e00700 1 -- 172.21.15.142:0/886392362 shutdown_connections 2024-04-20T22:07:00.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.399+0000 7f0080e00700 1 --2- 172.21.15.142:0/886392362 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f006006ecd0 0x7f0060071190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:00.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.399+0000 7f0080e00700 1 --2- 172.21.15.142:0/886392362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f007c102e50 0x7f007c1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:00.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.399+0000 7f0080e00700 1 --2- 172.21.15.142:0/886392362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f007c103fb0 0x7f007c198d20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:00.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.399+0000 7f0080e00700 1 -- 172.21.15.142:0/886392362 >> 172.21.15.142:0/886392362 conn(0x7f007c0fe3d0 msgr2=0x7f007c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:00.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.399+0000 7f0080e00700 1 -- 172.21.15.142:0/886392362 shutdown_connections 2024-04-20T22:07:00.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.399+0000 7f0080e00700 1 -- 172.21.15.142:0/886392362 wait complete. 2024-04-20T22:07:00.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.556+0000 7f6f08a00700 1 -- 172.21.15.142:0/764636709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f04073940 msgr2=0x7f6f04073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:00.556 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.556+0000 7f6f08a00700 1 --2- 172.21.15.142:0/764636709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f04073940 0x7f6f04073dc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009910 tx=0x7f6eec009c20 comp rx=0 tx=0).stop 2024-04-20T22:07:00.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.556+0000 7f6f08a00700 1 -- 172.21.15.142:0/764636709 shutdown_connections 2024-04-20T22:07:00.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.556+0000 7f6f08a00700 1 --2- 172.21.15.142:0/764636709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f04073940 0x7f6f04073dc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:00.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.556+0000 7f6f08a00700 1 --2- 172.21.15.142:0/764636709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f04074f10 0x7f6f04073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:00.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.556+0000 7f6f08a00700 1 -- 172.21.15.142:0/764636709 >> 172.21.15.142:0/764636709 conn(0x7f6f040fc1c0 msgr2=0x7f6f040fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:00.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.556+0000 7f6f08a00700 1 -- 172.21.15.142:0/764636709 shutdown_connections 2024-04-20T22:07:00.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.557+0000 7f6f08a00700 1 -- 172.21.15.142:0/764636709 wait complete. 2024-04-20T22:07:00.561 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.558+0000 7f6f08a00700 1 Processor -- start 2024-04-20T22:07:00.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.558+0000 7f6f08a00700 1 -- start start 2024-04-20T22:07:00.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.559+0000 7f6f08a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f04073940 0x7f6f0419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:00.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.559+0000 7f6f08a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f04074f10 0x7f6f0419d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:00.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.559+0000 7f6f08a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0419d780 con 0x7f6f04074f10 2024-04-20T22:07:00.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.559+0000 7f6f08a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0419d8c0 con 0x7f6f04073940 2024-04-20T22:07:00.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.559+0000 7f6ef9400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f04074f10 0x7f6f0419d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:00.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.560+0000 7f6ef9400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f04074f10 0x7f6f0419d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52708/0 (socket says 172.21.15.142:52708) 2024-04-20T22:07:00.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.560+0000 7f6ef9400700 1 -- 172.21.15.142:0/762108062 learned_addr learned my addr 172.21.15.142:0/762108062 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:07:00.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.560+0000 7f6ef9400700 1 -- 172.21.15.142:0/762108062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f04073940 msgr2=0x7f6f0419cc20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-20T22:07:00.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.560+0000 7f6ef9400700 1 --2- 172.21.15.142:0/762108062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f04073940 0x7f6f0419cc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:00.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.560+0000 7f6ef9400700 1 -- 172.21.15.142:0/762108062 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eec0095f0 con 0x7f6f04074f10 2024-04-20T22:07:00.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.561+0000 7f6ef9400700 1 --2- 172.21.15.142:0/762108062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f04074f10 0x7f6f0419d160 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00bd70 tx=0x7f6eec00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:00.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.562+0000 7f6efb400700 1 -- 172.21.15.142:0/762108062 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eec01d070 con 0x7f6f04074f10 2024-04-20T22:07:00.563 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.562+0000 7f6efb400700 1 -- 172.21.15.142:0/762108062 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6eec005dc0 con 0x7f6f04074f10 2024-04-20T22:07:00.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.562+0000 7f6efb400700 1 -- 172.21.15.142:0/762108062 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eec021410 con 0x7f6f04074f10 2024-04-20T22:07:00.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.562+0000 7f6f08a00700 1 -- 172.21.15.142:0/762108062 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f041a22c0 con 0x7f6f04074f10 2024-04-20T22:07:00.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.563+0000 7f6f08a00700 1 -- 172.21.15.142:0/762108062 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f041a2830 con 0x7f6f04074f10 2024-04-20T22:07:00.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.564+0000 7f6f08a00700 1 -- 172.21.15.142:0/762108062 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f04062510 con 0x7f6f04074f10 2024-04-20T22:07:00.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.565+0000 7f6efb400700 1 -- 172.21.15.142:0/762108062 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f6eec00f820 con 0x7f6f04074f10 2024-04-20T22:07:00.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.566+0000 7f6efb400700 1 --2- 172.21.15.142:0/762108062 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6ee806ecc0 0x7f6ee8071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:00.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.567+0000 7f6efb400700 1 -- 172.21.15.142:0/762108062 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f6eec090050 con 0x7f6f04074f10 2024-04-20T22:07:00.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.567+0000 7f6f01e00700 1 --2- 172.21.15.142:0/762108062 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6ee806ecc0 0x7f6ee8071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:00.567 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:00 smithi164 ceph-mon[69784]: pgmap v239: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-04-20T22:07:00.567 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:00 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:00.567 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:00 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:07:00.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.567+0000 7f6f01e00700 1 --2- 172.21.15.142:0/762108062 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6ee806ecc0 0x7f6ee8071180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009510 tx=0x7f6ef4009300 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:00.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.572+0000 7f6efb400700 1 -- 172.21.15.142:0/762108062 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f6eec05c940 con 0x7f6f04074f10 2024-04-20T22:07:00.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:00 smithi142 ceph-mon[79401]: pgmap v239: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-04-20T22:07:00.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:00 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:00.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:00 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:07:00.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.901+0000 7f6f08a00700 1 -- 172.21.15.142:0/762108062 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6f041a2aa0 con 0x7f6f04074f10 2024-04-20T22:07:00.902 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.902+0000 7f6efb400700 1 -- 172.21.15.142:0/762108062 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+835 (secure 0 0 0) 0x7f6eec05c4d0 con 0x7f6f04074f10 2024-04-20T22:07:00.902 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:07:00.902 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:07:00.902 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:07:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:07:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:07:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:07:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:07:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:07:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 6 2024-04-20T22:07:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:07:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:07:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 1, 2024-04-20T22:07:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 3 2024-04-20T22:07:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:07:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:07:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 18.2.2-1237-g646b8c7d (646b8c7d293d8ec31a40c69f7b3237b19c1be24d) reef (stable)": 1, 2024-04-20T22:07:00.903 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 13 2024-04-20T22:07:00.904 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:07:00.904 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:07:00.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.905+0000 7f6f08a00700 1 -- 172.21.15.142:0/762108062 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6ee806ecc0 msgr2=0x7f6ee8071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:00.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.905+0000 7f6f08a00700 1 --2- 172.21.15.142:0/762108062 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6ee806ecc0 0x7f6ee8071180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009510 tx=0x7f6ef4009300 comp rx=0 tx=0).stop 2024-04-20T22:07:00.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.905+0000 7f6f08a00700 1 -- 172.21.15.142:0/762108062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f04074f10 msgr2=0x7f6f0419d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:00.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.905+0000 7f6f08a00700 1 --2- 172.21.15.142:0/762108062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f04074f10 0x7f6f0419d160 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00bd70 tx=0x7f6eec00be50 comp rx=0 tx=0).stop 2024-04-20T22:07:00.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.905+0000 7f6f08a00700 1 -- 172.21.15.142:0/762108062 shutdown_connections 2024-04-20T22:07:00.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.905+0000 7f6f08a00700 1 --2- 172.21.15.142:0/762108062 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6ee806ecc0 0x7f6ee8071180 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:00.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.905+0000 7f6f08a00700 1 --2- 172.21.15.142:0/762108062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f04073940 0x7f6f0419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:00.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.905+0000 7f6f08a00700 1 --2- 172.21.15.142:0/762108062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f04074f10 0x7f6f0419d160 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:00.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.905+0000 7f6f08a00700 1 -- 172.21.15.142:0/762108062 >> 172.21.15.142:0/762108062 conn(0x7f6f040fc1c0 msgr2=0x7f6f04102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:00.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.906+0000 7f6f08a00700 1 -- 172.21.15.142:0/762108062 shutdown_connections 2024-04-20T22:07:00.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:00.906+0000 7f6f08a00700 1 -- 172.21.15.142:0/762108062 wait complete. 2024-04-20T22:07:01.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.062+0000 7f9ac3000700 1 -- 172.21.15.142:0/1759983008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9abc108290 msgr2=0x7f9abc1086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:01.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.062+0000 7f9ac3000700 1 --2- 172.21.15.142:0/1759983008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9abc108290 0x7f9abc1086f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009910 tx=0x7f9aa8009c20 comp rx=0 tx=0).stop 2024-04-20T22:07:01.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.062+0000 7f9ac3000700 1 -- 172.21.15.142:0/1759983008 shutdown_connections 2024-04-20T22:07:01.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.062+0000 7f9ac3000700 1 --2- 172.21.15.142:0/1759983008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9abc108290 0x7f9abc1086f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:01.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.062+0000 7f9ac3000700 1 --2- 172.21.15.142:0/1759983008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9abc1070f0 0x7f9abc107510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:01.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.062+0000 7f9ac3000700 1 -- 172.21.15.142:0/1759983008 >> 172.21.15.142:0/1759983008 conn(0x7f9abc0761d0 msgr2=0x7f9abc078610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:01.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.062+0000 7f9ac3000700 1 -- 172.21.15.142:0/1759983008 shutdown_connections 2024-04-20T22:07:01.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.062+0000 7f9ac3000700 1 -- 172.21.15.142:0/1759983008 wait complete. 2024-04-20T22:07:01.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.063+0000 7f9ac3000700 1 Processor -- start 2024-04-20T22:07:01.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.063+0000 7f9ac3000700 1 -- start start 2024-04-20T22:07:01.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.063+0000 7f9ac3000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9abc1070f0 0x7f9abc19ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:01.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.064+0000 7f9ac3000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9abc108290 0x7f9abc19cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:01.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.064+0000 7f9ac3000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc19d5d0 con 0x7f9abc108290 2024-04-20T22:07:01.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.064+0000 7f9ac3000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc19d710 con 0x7f9abc1070f0 2024-04-20T22:07:01.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.064+0000 7f9ac1200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9abc108290 0x7f9abc19cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:01.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.064+0000 7f9ac1c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9abc1070f0 0x7f9abc19ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:01.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.064+0000 7f9ac1200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9abc108290 0x7f9abc19cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52724/0 (socket says 172.21.15.142:52724) 2024-04-20T22:07:01.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.064+0000 7f9ac1200700 1 -- 172.21.15.142:0/3185886291 learned_addr learned my addr 172.21.15.142:0/3185886291 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:07:01.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.064+0000 7f9ac1200700 1 -- 172.21.15.142:0/3185886291 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9abc1070f0 msgr2=0x7f9abc19ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:01.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.064+0000 7f9ac1200700 1 --2- 172.21.15.142:0/3185886291 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9abc1070f0 0x7f9abc19ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:01.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.064+0000 7f9ac1200700 1 -- 172.21.15.142:0/3185886291 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa80095f0 con 0x7f9abc108290 2024-04-20T22:07:01.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.065+0000 7f9ac1200700 1 --2- 172.21.15.142:0/3185886291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9abc108290 0x7f9abc19cfb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8006010 tx=0x7f9aa800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:01.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.065+0000 7f9aba000700 1 -- 172.21.15.142:0/3185886291 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aa801d070 con 0x7f9abc108290 2024-04-20T22:07:01.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.065+0000 7f9aba000700 1 -- 172.21.15.142:0/3185886291 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9aa800f460 con 0x7f9abc108290 2024-04-20T22:07:01.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.065+0000 7f9aba000700 1 -- 172.21.15.142:0/3185886291 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aa8021620 con 0x7f9abc108290 2024-04-20T22:07:01.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.065+0000 7f9ac3000700 1 -- 172.21.15.142:0/3185886291 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9abc1a2110 con 0x7f9abc108290 2024-04-20T22:07:01.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.065+0000 7f9ac3000700 1 -- 172.21.15.142:0/3185886291 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9abc1a2680 con 0x7f9abc108290 2024-04-20T22:07:01.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.066+0000 7f9ac3000700 1 -- 172.21.15.142:0/3185886291 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9abc196c10 con 0x7f9abc108290 2024-04-20T22:07:01.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.067+0000 7f9aba000700 1 -- 172.21.15.142:0/3185886291 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f9aa800f5d0 con 0x7f9abc108290 2024-04-20T22:07:01.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.068+0000 7f9aba000700 1 --2- 172.21.15.142:0/3185886291 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9aa406ecc0 0x7f9aa4071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:01.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.068+0000 7f9aba000700 1 -- 172.21.15.142:0/3185886291 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f9aa8090150 con 0x7f9abc108290 2024-04-20T22:07:01.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.068+0000 7f9ac1c00700 1 --2- 172.21.15.142:0/3185886291 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9aa406ecc0 0x7f9aa4071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:01.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.069+0000 7f9ac1c00700 1 --2- 172.21.15.142:0/3185886291 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9aa406ecc0 0x7f9aa4071180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9abc1080f0 tx=0x7f9ab000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:01.072 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.073+0000 7f9aba000700 1 -- 172.21.15.142:0/3185886291 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f9aa805c990 con 0x7f9abc108290 2024-04-20T22:07:01.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.330+0000 7f9ac3000700 1 -- 172.21.15.142:0/3185886291 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9abc04f400 con 0x7f9abc108290 2024-04-20T22:07:01.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.331+0000 7f9aba000700 1 -- 172.21.15.142:0/3185886291 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1902 (secure 0 0 0) 0x7f9aa805c520 con 0x7f9abc108290 2024-04-20T22:07:01.332 INFO:teuthology.orchestra.run.smithi142.stdout:e26 2024-04-20T22:07:01.332 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:07:01.332 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:07:01.332 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T22:07:01.332 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:07:01.332 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T22:07:01.332 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T22:07:01.332 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 25 2024-04-20T22:07:01.332 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:07:01.332 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:07:01.333 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T22:06:52.449770+0000 2024-04-20T22:07:01.333 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T22:07:01.333 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T22:07:01.333 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T22:07:01.333 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T22:07:01.333 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T22:07:01.333 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T22:07:01.333 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T22:07:01.333 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T22:07:01.333 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 84 2024-04-20T22:07:01.333 INFO:teuthology.orchestra.run.smithi142.stdout:snap_rstat 1 2024-04-20T22:07:01.333 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:07:01.333 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T22:07:01.334 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T22:07:01.334 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=24253} 2024-04-20T22:07:01.334 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T22:07:01.334 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T22:07:01.334 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T22:07:01.334 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T22:07:01.334 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T22:07:01.334 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T22:07:01.334 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T22:07:01.334 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T22:07:01.334 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T22:07:01.334 INFO:teuthology.orchestra.run.smithi142.stdout:qdb_cluster leader: 0 members: 2024-04-20T22:07:01.334 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{0:24253} state up:replay seq 2 join_fscid=1 addr [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] compat {c=[1],r=[1],i=[7ff]}] 2024-04-20T22:07:01.335 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:07:01.335 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:07:01.335 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T22:07:01.335 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:07:01.335 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{-1:34454} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6826/2100080187,v1:172.21.15.142:6827/2100080187] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:07:01.335 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:34486} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6828/2960234081,v1:172.21.15.142:6829/2960234081] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:07:01.335 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.164:6824/1951894011,v1:172.21.15.164:6825/1951894011] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:07:01.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.334+0000 7f9ac3000700 1 -- 172.21.15.142:0/3185886291 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9aa406ecc0 msgr2=0x7f9aa4071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:01.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.334+0000 7f9ac3000700 1 --2- 172.21.15.142:0/3185886291 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9aa406ecc0 0x7f9aa4071180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9abc1080f0 tx=0x7f9ab000b410 comp rx=0 tx=0).stop 2024-04-20T22:07:01.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.334+0000 7f9ac3000700 1 -- 172.21.15.142:0/3185886291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9abc108290 msgr2=0x7f9abc19cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:01.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.334+0000 7f9ac3000700 1 --2- 172.21.15.142:0/3185886291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9abc108290 0x7f9abc19cfb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8006010 tx=0x7f9aa800bd70 comp rx=0 tx=0).stop 2024-04-20T22:07:01.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.334+0000 7f9ac3000700 1 -- 172.21.15.142:0/3185886291 shutdown_connections 2024-04-20T22:07:01.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.334+0000 7f9ac3000700 1 --2- 172.21.15.142:0/3185886291 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9aa406ecc0 0x7f9aa4071180 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:01.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.334+0000 7f9ac3000700 1 --2- 172.21.15.142:0/3185886291 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9abc1070f0 0x7f9abc19ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:01.336 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.334+0000 7f9ac3000700 1 --2- 172.21.15.142:0/3185886291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9abc108290 0x7f9abc19cfb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:01.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.334+0000 7f9ac3000700 1 -- 172.21.15.142:0/3185886291 >> 172.21.15.142:0/3185886291 conn(0x7f9abc0761d0 msgr2=0x7f9abc10b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:01.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.334+0000 7f9ac3000700 1 -- 172.21.15.142:0/3185886291 shutdown_connections 2024-04-20T22:07:01.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.335+0000 7f9ac3000700 1 -- 172.21.15.142:0/3185886291 wait complete. 2024-04-20T22:07:01.337 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 26 2024-04-20T22:07:01.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.487+0000 7f4708400700 1 -- 172.21.15.142:0/4164989733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4700107260 msgr2=0x7f4700107680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:01.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.487+0000 7f4708400700 1 --2- 172.21.15.142:0/4164989733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4700107260 0x7f4700107680 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009910 tx=0x7f46f4009c20 comp rx=0 tx=0).stop 2024-04-20T22:07:01.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.487+0000 7f4708400700 1 -- 172.21.15.142:0/4164989733 shutdown_connections 2024-04-20T22:07:01.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.487+0000 7f4708400700 1 --2- 172.21.15.142:0/4164989733 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4700108430 0x7f47001088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:01.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.487+0000 7f4708400700 1 --2- 172.21.15.142:0/4164989733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4700107260 0x7f4700107680 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:01.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.487+0000 7f4708400700 1 -- 172.21.15.142:0/4164989733 >> 172.21.15.142:0/4164989733 conn(0x7f4700076400 msgr2=0x7f4700078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:01.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.488+0000 7f4708400700 1 -- 172.21.15.142:0/4164989733 shutdown_connections 2024-04-20T22:07:01.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.488+0000 7f4708400700 1 -- 172.21.15.142:0/4164989733 wait complete. 2024-04-20T22:07:01.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.489+0000 7f4708400700 1 Processor -- start 2024-04-20T22:07:01.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.489+0000 7f4708400700 1 -- start start 2024-04-20T22:07:01.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.489+0000 7f4708400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4700107260 0x7f470019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:01.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.489+0000 7f4708400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4700108430 0x7f470019d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:01.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.489+0000 7f4708400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470019d770 con 0x7f4700107260 2024-04-20T22:07:01.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.489+0000 7f4708400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470019d8b0 con 0x7f4700108430 2024-04-20T22:07:01.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.490+0000 7f4705a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4700107260 0x7f470019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:01.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.490+0000 7f4705a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4700107260 0x7f470019cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52738/0 (socket says 172.21.15.142:52738) 2024-04-20T22:07:01.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.490+0000 7f4705a00700 1 -- 172.21.15.142:0/1784154916 learned_addr learned my addr 172.21.15.142:0/1784154916 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:07:01.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.490+0000 7f4705000700 1 --2- 172.21.15.142:0/1784154916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4700108430 0x7f470019d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:01.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.490+0000 7f4705a00700 1 -- 172.21.15.142:0/1784154916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4700108430 msgr2=0x7f470019d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:01.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.490+0000 7f4705a00700 1 --2- 172.21.15.142:0/1784154916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4700108430 0x7f470019d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:01.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.490+0000 7f4705a00700 1 -- 172.21.15.142:0/1784154916 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f40095f0 con 0x7f4700107260 2024-04-20T22:07:01.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.490+0000 7f4705000700 1 --2- 172.21.15.142:0/1784154916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4700108430 0x7f470019d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T22:07:01.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.490+0000 7f4705a00700 1 --2- 172.21.15.142:0/1784154916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4700107260 0x7f470019cc10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f46f400b650 tx=0x7f46f4005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:01.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.491+0000 7f46fe000700 1 -- 172.21.15.142:0/1784154916 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46f401d070 con 0x7f4700107260 2024-04-20T22:07:01.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.491+0000 7f46fe000700 1 -- 172.21.15.142:0/1784154916 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f46f40052a0 con 0x7f4700107260 2024-04-20T22:07:01.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.491+0000 7f46fe000700 1 -- 172.21.15.142:0/1784154916 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46f4017400 con 0x7f4700107260 2024-04-20T22:07:01.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.491+0000 7f4708400700 1 -- 172.21.15.142:0/1784154916 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47001a22b0 con 0x7f4700107260 2024-04-20T22:07:01.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.491+0000 7f4708400700 1 -- 172.21.15.142:0/1784154916 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47001a27d0 con 0x7f4700107260 2024-04-20T22:07:01.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.492+0000 7f4708400700 1 -- 172.21.15.142:0/1784154916 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4700196dd0 con 0x7f4700107260 2024-04-20T22:07:01.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.493+0000 7f46fe000700 1 -- 172.21.15.142:0/1784154916 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f46f4003810 con 0x7f4700107260 2024-04-20T22:07:01.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.494+0000 7f46fe000700 1 --2- 172.21.15.142:0/1784154916 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f46e806ecd0 0x7f46e8071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:01.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.494+0000 7f46fe000700 1 -- 172.21.15.142:0/1784154916 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f46f4090280 con 0x7f4700107260 2024-04-20T22:07:01.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.494+0000 7f4705000700 1 --2- 172.21.15.142:0/1784154916 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f46e806ecd0 0x7f46e8071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:01.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.495+0000 7f4705000700 1 --2- 172.21.15.142:0/1784154916 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f46e806ecd0 0x7f46e8071190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f46ec011490 tx=0x7f46ec009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:01.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.499+0000 7f46fe000700 1 -- 172.21.15.142:0/1784154916 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f46f405cac0 con 0x7f4700107260 2024-04-20T22:07:01.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:01 smithi164 ceph-mon[69784]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:07:01.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:01 smithi164 ceph-mon[69784]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:07:01.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:01 smithi164 ceph-mon[69784]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:07:01.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:01 smithi164 ceph-mon[69784]: mds.? [v2:172.21.15.164:6824/1951894011,v1:172.21.15.164:6825/1951894011] up:boot 2024-04-20T22:07:01.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:01 smithi164 ceph-mon[69784]: fsmap cephfs:1/1 {0=cephfs.smithi164.gmmrfu=up:replay} 3 up:standby 2024-04-20T22:07:01.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:01 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.ybvzha"}]: dispatch 2024-04-20T22:07:01.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:01 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:01.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:01 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:01.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:01 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:07:01.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:01 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/762108062' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:01.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:01 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3185886291' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:07:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:01 smithi142 ceph-mon[79401]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:07:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:01 smithi142 ceph-mon[79401]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:07:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:01 smithi142 ceph-mon[79401]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:07:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:01 smithi142 ceph-mon[79401]: mds.? [v2:172.21.15.164:6824/1951894011,v1:172.21.15.164:6825/1951894011] up:boot 2024-04-20T22:07:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:01 smithi142 ceph-mon[79401]: fsmap cephfs:1/1 {0=cephfs.smithi164.gmmrfu=up:replay} 3 up:standby 2024-04-20T22:07:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:01 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.ybvzha"}]: dispatch 2024-04-20T22:07:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:01 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:01 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:01 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:07:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:01 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/762108062' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:01.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:01 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3185886291' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:07:01.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.750+0000 7f4708400700 1 -- 172.21.15.142:0/1784154916 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f470002ce50 con 0x7f46e806ecd0 2024-04-20T22:07:01.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.752+0000 7f46fe000700 1 -- 172.21.15.142:0/1784154916 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f470002ce50 con 0x7f46e806ecd0 2024-04-20T22:07:01.752 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:07:01.752 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T22:07:01.752 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T22:07:01.752 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T22:07:01.752 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T22:07:01.752 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr", 2024-04-20T22:07:01.752 INFO:teuthology.orchestra.run.smithi142.stdout: "mon", 2024-04-20T22:07:01.752 INFO:teuthology.orchestra.run.smithi142.stdout: "crash", 2024-04-20T22:07:01.752 INFO:teuthology.orchestra.run.smithi142.stdout: "osd" 2024-04-20T22:07:01.752 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T22:07:01.753 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "14/23 daemons upgraded", 2024-04-20T22:07:01.753 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading mds daemons", 2024-04-20T22:07:01.753 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T22:07:01.753 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:07:01.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.754+0000 7f4708400700 1 -- 172.21.15.142:0/1784154916 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f46e806ecd0 msgr2=0x7f46e8071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:01.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.754+0000 7f4708400700 1 --2- 172.21.15.142:0/1784154916 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f46e806ecd0 0x7f46e8071190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f46ec011490 tx=0x7f46ec009260 comp rx=0 tx=0).stop 2024-04-20T22:07:01.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.754+0000 7f4708400700 1 -- 172.21.15.142:0/1784154916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4700107260 msgr2=0x7f470019cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:01.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.754+0000 7f4708400700 1 --2- 172.21.15.142:0/1784154916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4700107260 0x7f470019cc10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f46f400b650 tx=0x7f46f4005f00 comp rx=0 tx=0).stop 2024-04-20T22:07:01.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.754+0000 7f4708400700 1 -- 172.21.15.142:0/1784154916 shutdown_connections 2024-04-20T22:07:01.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.754+0000 7f4708400700 1 --2- 172.21.15.142:0/1784154916 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f46e806ecd0 0x7f46e8071190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:01.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.754+0000 7f4708400700 1 --2- 172.21.15.142:0/1784154916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4700107260 0x7f470019cc10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:01.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.754+0000 7f4708400700 1 --2- 172.21.15.142:0/1784154916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4700108430 0x7f470019d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:01.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.754+0000 7f4708400700 1 -- 172.21.15.142:0/1784154916 >> 172.21.15.142:0/1784154916 conn(0x7f4700076400 msgr2=0x7f470010ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:01.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.754+0000 7f4708400700 1 -- 172.21.15.142:0/1784154916 shutdown_connections 2024-04-20T22:07:01.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.755+0000 7f4708400700 1 -- 172.21.15.142:0/1784154916 wait complete. 2024-04-20T22:07:01.904 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.904+0000 7f9aa4800700 1 -- 172.21.15.142:0/1104652564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a9c073940 msgr2=0x7f9a9c073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:01.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.904+0000 7f9aa4800700 1 --2- 172.21.15.142:0/1104652564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a9c073940 0x7f9a9c073dc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009910 tx=0x7f9a8c009c20 comp rx=0 tx=0).stop 2024-04-20T22:07:01.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.904+0000 7f9aa4800700 1 -- 172.21.15.142:0/1104652564 shutdown_connections 2024-04-20T22:07:01.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.904+0000 7f9aa4800700 1 --2- 172.21.15.142:0/1104652564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a9c073940 0x7f9a9c073dc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:01.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.904+0000 7f9aa4800700 1 --2- 172.21.15.142:0/1104652564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a9c074f10 0x7f9a9c073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:01.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.904+0000 7f9aa4800700 1 -- 172.21.15.142:0/1104652564 >> 172.21.15.142:0/1104652564 conn(0x7f9a9c0fc1c0 msgr2=0x7f9a9c0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:01.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.904+0000 7f9aa4800700 1 -- 172.21.15.142:0/1104652564 shutdown_connections 2024-04-20T22:07:01.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.904+0000 7f9aa4800700 1 -- 172.21.15.142:0/1104652564 wait complete. 2024-04-20T22:07:01.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.905+0000 7f9aa4800700 1 Processor -- start 2024-04-20T22:07:01.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.905+0000 7f9aa4800700 1 -- start start 2024-04-20T22:07:01.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.906+0000 7f9aa4800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a9c073940 0x7f9a9c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:01.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.906+0000 7f9aa4800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a9c074f10 0x7f9a9c198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:01.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.906+0000 7f9aa4800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c199510 con 0x7f9a9c074f10 2024-04-20T22:07:01.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.906+0000 7f9aa4800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c199650 con 0x7f9a9c073940 2024-04-20T22:07:01.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.906+0000 7f9aa1400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a9c074f10 0x7f9a9c198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:01.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.906+0000 7f9aa1400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a9c074f10 0x7f9a9c198ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52756/0 (socket says 172.21.15.142:52756) 2024-04-20T22:07:01.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.906+0000 7f9aa1400700 1 -- 172.21.15.142:0/2722952565 learned_addr learned my addr 172.21.15.142:0/2722952565 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:07:01.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.906+0000 7f9aa1e00700 1 --2- 172.21.15.142:0/2722952565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a9c073940 0x7f9a9c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:01.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.906+0000 7f9aa1400700 1 -- 172.21.15.142:0/2722952565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a9c073940 msgr2=0x7f9a9c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:01.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.906+0000 7f9aa1400700 1 --2- 172.21.15.142:0/2722952565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a9c073940 0x7f9a9c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:01.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.907+0000 7f9aa1400700 1 -- 172.21.15.142:0/2722952565 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8c0095f0 con 0x7f9a9c074f10 2024-04-20T22:07:01.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.907+0000 7f9aa1400700 1 --2- 172.21.15.142:0/2722952565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a9c074f10 0x7f9a9c198ef0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00bd70 tx=0x7f9a8c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:01.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.907+0000 7f9a96a00700 1 -- 172.21.15.142:0/2722952565 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a8c01d070 con 0x7f9a9c074f10 2024-04-20T22:07:01.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.907+0000 7f9a96a00700 1 -- 172.21.15.142:0/2722952565 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a8c00f460 con 0x7f9a9c074f10 2024-04-20T22:07:01.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.907+0000 7f9a96a00700 1 -- 172.21.15.142:0/2722952565 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a8c021620 con 0x7f9a9c074f10 2024-04-20T22:07:01.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.907+0000 7f9aa4800700 1 -- 172.21.15.142:0/2722952565 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a9c19e000 con 0x7f9a9c074f10 2024-04-20T22:07:01.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.907+0000 7f9aa4800700 1 -- 172.21.15.142:0/2722952565 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9c19e570 con 0x7f9a9c074f10 2024-04-20T22:07:01.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.908+0000 7f9aa4800700 1 -- 172.21.15.142:0/2722952565 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a9c192a30 con 0x7f9a9c074f10 2024-04-20T22:07:01.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.909+0000 7f9a96a00700 1 -- 172.21.15.142:0/2722952565 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f9a8c00fa70 con 0x7f9a9c074f10 2024-04-20T22:07:01.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.910+0000 7f9a96a00700 1 --2- 172.21.15.142:0/2722952565 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9a8406ecc0 0x7f9a84071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:01.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.910+0000 7f9a96a00700 1 -- 172.21.15.142:0/2722952565 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f9a8c090270 con 0x7f9a9c074f10 2024-04-20T22:07:01.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.911+0000 7f9aa1e00700 1 --2- 172.21.15.142:0/2722952565 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9a8406ecc0 0x7f9a84071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:01.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.911+0000 7f9aa1e00700 1 --2- 172.21.15.142:0/2722952565 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9a8406ecc0 0x7f9a84071180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9a90006fd0 tx=0x7f9a90008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:01.915 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:01.915+0000 7f9a96a00700 1 -- 172.21.15.142:0/2722952565 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f9a8c05ca30 con 0x7f9a9c074f10 2024-04-20T22:07:02.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:02.221+0000 7f9aa4800700 1 -- 172.21.15.142:0/2722952565 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9a9c062510 con 0x7f9a9c074f10 2024-04-20T22:07:02.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:02.221+0000 7f9a96a00700 1 -- 172.21.15.142:0/2722952565 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7f9a8c05c5c0 con 0x7f9a9c074f10 2024-04-20T22:07:02.221 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_WARN 1 filesystem is degraded 2024-04-20T22:07:02.221 INFO:teuthology.orchestra.run.smithi142.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-20T22:07:02.221 INFO:teuthology.orchestra.run.smithi142.stdout: fs cephfs is degraded 2024-04-20T22:07:02.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:02.225+0000 7f9aa4800700 1 -- 172.21.15.142:0/2722952565 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9a8406ecc0 msgr2=0x7f9a84071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:02.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:02.225+0000 7f9aa4800700 1 --2- 172.21.15.142:0/2722952565 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9a8406ecc0 0x7f9a84071180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9a90006fd0 tx=0x7f9a90008040 comp rx=0 tx=0).stop 2024-04-20T22:07:02.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:02.225+0000 7f9aa4800700 1 -- 172.21.15.142:0/2722952565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a9c074f10 msgr2=0x7f9a9c198ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:02.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:02.225+0000 7f9aa4800700 1 --2- 172.21.15.142:0/2722952565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a9c074f10 0x7f9a9c198ef0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00bd70 tx=0x7f9a8c00be50 comp rx=0 tx=0).stop 2024-04-20T22:07:02.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:02.225+0000 7f9aa4800700 1 -- 172.21.15.142:0/2722952565 shutdown_connections 2024-04-20T22:07:02.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:02.225+0000 7f9aa4800700 1 --2- 172.21.15.142:0/2722952565 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9a8406ecc0 0x7f9a84071180 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:02.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:02.225+0000 7f9aa4800700 1 --2- 172.21.15.142:0/2722952565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a9c073940 0x7f9a9c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:02.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:02.225+0000 7f9aa4800700 1 --2- 172.21.15.142:0/2722952565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a9c074f10 0x7f9a9c198ef0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:02.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:02.225+0000 7f9aa4800700 1 -- 172.21.15.142:0/2722952565 >> 172.21.15.142:0/2722952565 conn(0x7f9a9c0fc1c0 msgr2=0x7f9a9c106ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:02.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:02.225+0000 7f9aa4800700 1 -- 172.21.15.142:0/2722952565 shutdown_connections 2024-04-20T22:07:02.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:02.225+0000 7f9aa4800700 1 -- 172.21.15.142:0/2722952565 wait complete. 2024-04-20T22:07:02.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:02 smithi164 ceph-mon[69784]: pgmap v240: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-04-20T22:07:02.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:02 smithi164 ceph-mon[69784]: reconnect by client.14536 192.168.0.1:0/1982029803 after 0.00299995 2024-04-20T22:07:02.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:02 smithi164 ceph-mon[69784]: reconnect by client.24289 192.168.0.1:0/4069521734 after 0.00299995 2024-04-20T22:07:02.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:02 smithi164 ceph-mon[69784]: mds.? [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] up:reconnect 2024-04-20T22:07:02.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:02 smithi164 ceph-mon[69784]: fsmap cephfs:1/1 {0=cephfs.smithi164.gmmrfu=up:reconnect} 3 up:standby 2024-04-20T22:07:02.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:02 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/2722952565' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:07:02.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:02 smithi142 ceph-mon[79401]: pgmap v240: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-04-20T22:07:02.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:02 smithi142 ceph-mon[79401]: reconnect by client.14536 192.168.0.1:0/1982029803 after 0.00299995 2024-04-20T22:07:02.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:02 smithi142 ceph-mon[79401]: reconnect by client.24289 192.168.0.1:0/4069521734 after 0.00299995 2024-04-20T22:07:02.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:02 smithi142 ceph-mon[79401]: mds.? [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] up:reconnect 2024-04-20T22:07:02.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:02 smithi142 ceph-mon[79401]: fsmap cephfs:1/1 {0=cephfs.smithi164.gmmrfu=up:reconnect} 3 up:standby 2024-04-20T22:07:02.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:02 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2722952565' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:07:03.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:03 smithi164 ceph-mon[69784]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:07:03.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:03 smithi164 ceph-mon[69784]: mds.? [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] up:rejoin 2024-04-20T22:07:03.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:03 smithi164 ceph-mon[69784]: fsmap cephfs:1/1 {0=cephfs.smithi164.gmmrfu=up:rejoin} 3 up:standby 2024-04-20T22:07:03.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:03 smithi164 ceph-mon[69784]: daemon mds.cephfs.smithi164.gmmrfu is now active in filesystem cephfs as rank 0 2024-04-20T22:07:03.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:03 smithi142 ceph-mon[79401]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:07:03.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:03 smithi142 ceph-mon[79401]: mds.? [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] up:rejoin 2024-04-20T22:07:03.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:03 smithi142 ceph-mon[79401]: fsmap cephfs:1/1 {0=cephfs.smithi164.gmmrfu=up:rejoin} 3 up:standby 2024-04-20T22:07:03.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:03 smithi142 ceph-mon[79401]: daemon mds.cephfs.smithi164.gmmrfu is now active in filesystem cephfs as rank 0 2024-04-20T22:07:04.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:04 smithi164 ceph-mon[69784]: pgmap v241: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-20T22:07:04.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:04 smithi164 ceph-mon[69784]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-20T22:07:04.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:04 smithi164 ceph-mon[69784]: Cluster is now healthy 2024-04-20T22:07:04.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:04 smithi164 ceph-mon[69784]: mds.? [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] up:active 2024-04-20T22:07:04.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:04 smithi164 ceph-mon[69784]: fsmap cephfs:1 {0=cephfs.smithi164.gmmrfu=up:active} 3 up:standby 2024-04-20T22:07:04.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:04 smithi142 ceph-mon[79401]: pgmap v241: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-20T22:07:04.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:04 smithi142 ceph-mon[79401]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-20T22:07:04.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:04 smithi142 ceph-mon[79401]: Cluster is now healthy 2024-04-20T22:07:04.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:04 smithi142 ceph-mon[79401]: mds.? [v2:172.21.15.164:6826/3096926963,v1:172.21.15.164:6827/3096926963] up:active 2024-04-20T22:07:04.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:04 smithi142 ceph-mon[79401]: fsmap cephfs:1 {0=cephfs.smithi164.gmmrfu=up:active} 3 up:standby 2024-04-20T22:07:06.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:06 smithi164 ceph-mon[69784]: pgmap v242: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 5 op/s 2024-04-20T22:07:06.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:06 smithi142 ceph-mon[79401]: pgmap v242: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 5 op/s 2024-04-20T22:07:08.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:08 smithi164 ceph-mon[69784]: pgmap v243: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-20T22:07:08.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:08 smithi142 ceph-mon[79401]: pgmap v243: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-20T22:07:10.598 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:10 smithi142 ceph-mon[79401]: pgmap v244: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-20T22:07:10.598 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:10 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:10.598 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:10 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:10.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:10 smithi164 ceph-mon[69784]: pgmap v244: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-20T22:07:10.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:10 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:10.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:10 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:12.673 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:12 smithi164 ceph-mon[69784]: pgmap v245: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 4.2 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-20T22:07:12.673 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:12 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:12.674 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:12 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:12.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:12 smithi142 ceph-mon[79401]: pgmap v245: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 4.2 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-20T22:07:12.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:12 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:12.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:12 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:14.445 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:14 smithi164 ceph-mon[69784]: pgmap v246: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 519 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-20T22:07:14.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:14 smithi142 ceph-mon[79401]: pgmap v246: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 519 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-20T22:07:15.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:15.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:07:15.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:15 smithi164 ceph-mon[69784]: pgmap v247: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 519 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-20T22:07:15.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:15.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:07:15.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:15 smithi142 ceph-mon[79401]: pgmap v247: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 519 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-20T22:07:18.397 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:18 smithi164 ceph-mon[69784]: pgmap v248: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-04-20T22:07:18.397 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:18 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:18.397 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:18 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:18.397 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:18 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:07:18.397 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:18 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:07:18.397 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:18 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:18.397 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:18 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:07:18.397 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:18 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:18.397 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:18 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:18.398 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:18 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:18.398 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:18 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:18.398 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:18 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi164.gmmrfu"]}]: dispatch 2024-04-20T22:07:18.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:18 smithi142 ceph-mon[79401]: pgmap v248: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-04-20T22:07:18.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:18 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:18.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:18 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:18.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:18 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:07:18.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:18 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:07:18.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:18 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:18.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:18 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:07:18.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:18 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:18.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:18 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:18.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:18 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:18.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:18 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:18.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:18 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi164.gmmrfu"]}]: dispatch 2024-04-20T22:07:19.421 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:19 smithi164 ceph-mon[69784]: Upgrade: It appears safe to stop mds.cephfs.smithi164.gmmrfu 2024-04-20T22:07:19.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:19 smithi142 ceph-mon[79401]: Upgrade: It appears safe to stop mds.cephfs.smithi164.gmmrfu 2024-04-20T22:07:20.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:20 smithi164 ceph-mon[69784]: pgmap v249: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4.0 KiB/s wr, 3 op/s 2024-04-20T22:07:20.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:20 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:20.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:20 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi164.gmmrfu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T22:07:20.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:20 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:07:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:20 smithi142 ceph-mon[79401]: pgmap v249: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4.0 KiB/s wr, 3 op/s 2024-04-20T22:07:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:20 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:20.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:20 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi164.gmmrfu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T22:07:20.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:20 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:07:21.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:21 smithi164 ceph-mon[69784]: Upgrade: Updating mds.cephfs.smithi164.gmmrfu 2024-04-20T22:07:21.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:21 smithi164 ceph-mon[69784]: Deploying daemon mds.cephfs.smithi164.gmmrfu on smithi164 2024-04-20T22:07:21.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:21 smithi142 ceph-mon[79401]: Upgrade: Updating mds.cephfs.smithi164.gmmrfu 2024-04-20T22:07:21.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:21 smithi142 ceph-mon[79401]: Deploying daemon mds.cephfs.smithi164.gmmrfu on smithi164 2024-04-20T22:07:22.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:22 smithi164 ceph-mon[69784]: pgmap v250: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:07:22.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:22 smithi142 ceph-mon[79401]: pgmap v250: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:07:23.110 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:22 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142[79397]: 2024-04-20T22:07:22.810+0000 7fc6cd800700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T22:07:23.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:23 smithi142 ceph-mon[79401]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-20T22:07:23.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:23 smithi142 ceph-mon[79401]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T22:07:23.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:23 smithi142 ceph-mon[79401]: osdmap e85: 6 total, 6 up, 6 in 2024-04-20T22:07:23.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:23 smithi142 ceph-mon[79401]: Standby daemon mds.cephfs.smithi142.lirkws assigned to filesystem cephfs as rank 0 2024-04-20T22:07:23.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:23 smithi142 ceph-mon[79401]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-20T22:07:23.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:23 smithi142 ceph-mon[79401]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-20T22:07:23.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:23 smithi142 ceph-mon[79401]: fsmap cephfs:1/1 {0=cephfs.smithi142.lirkws=up:replay} 2 up:standby 2024-04-20T22:07:23.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:23 smithi164 ceph-mon[69784]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-20T22:07:23.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:23 smithi164 ceph-mon[69784]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T22:07:23.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:23 smithi164 ceph-mon[69784]: osdmap e85: 6 total, 6 up, 6 in 2024-04-20T22:07:23.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:23 smithi164 ceph-mon[69784]: Standby daemon mds.cephfs.smithi142.lirkws assigned to filesystem cephfs as rank 0 2024-04-20T22:07:23.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:23 smithi164 ceph-mon[69784]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-20T22:07:23.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:23 smithi164 ceph-mon[69784]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-20T22:07:23.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:23 smithi164 ceph-mon[69784]: fsmap cephfs:1/1 {0=cephfs.smithi142.lirkws=up:replay} 2 up:standby 2024-04-20T22:07:24.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:24 smithi164 ceph-mon[69784]: pgmap v251: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:07:24.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:24 smithi142 ceph-mon[79401]: pgmap v251: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:07:26.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:26 smithi164 ceph-mon[69784]: pgmap v253: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 1 op/s 2024-04-20T22:07:26.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:26 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.gmmrfu"}]: dispatch 2024-04-20T22:07:26.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:26 smithi142 ceph-mon[79401]: pgmap v253: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 1 op/s 2024-04-20T22:07:26.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:26 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.gmmrfu"}]: dispatch 2024-04-20T22:07:28.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:28 smithi164 ceph-mon[69784]: pgmap v254: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 3 op/s 2024-04-20T22:07:28.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:28 smithi142 ceph-mon[79401]: pgmap v254: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 3 op/s 2024-04-20T22:07:30.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:30 smithi142 ceph-mon[79401]: pgmap v255: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-20T22:07:30.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:30.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:07:30.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:30 smithi164 ceph-mon[69784]: pgmap v255: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-20T22:07:30.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:30.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:07:32.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.388+0000 7fba04e00700 1 -- 172.21.15.142:0/2093738290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba00100cf0 msgr2=0x7fba00101150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:32.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.388+0000 7fba04e00700 1 --2- 172.21.15.142:0/2093738290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba00100cf0 0x7fba00101150 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec009910 tx=0x7fb9ec009c20 comp rx=0 tx=0).stop 2024-04-20T22:07:32.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.388+0000 7fba04e00700 1 -- 172.21.15.142:0/2093738290 shutdown_connections 2024-04-20T22:07:32.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.388+0000 7fba04e00700 1 --2- 172.21.15.142:0/2093738290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba00100cf0 0x7fba00101150 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:32.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.388+0000 7fba04e00700 1 --2- 172.21.15.142:0/2093738290 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba000ffaf0 0x7fba000fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:32.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.388+0000 7fba04e00700 1 -- 172.21.15.142:0/2093738290 >> 172.21.15.142:0/2093738290 conn(0x7fba000fb0d0 msgr2=0x7fba000fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:32.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.388+0000 7fba04e00700 1 -- 172.21.15.142:0/2093738290 shutdown_connections 2024-04-20T22:07:32.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.388+0000 7fba04e00700 1 -- 172.21.15.142:0/2093738290 wait complete. 2024-04-20T22:07:32.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.389+0000 7fba04e00700 1 Processor -- start 2024-04-20T22:07:32.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.389+0000 7fba04e00700 1 -- start start 2024-04-20T22:07:32.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.390+0000 7fba04e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba000ffaf0 0x7fba00107a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:32.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.390+0000 7fba04e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba00100cf0 0x7fba001060f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:32.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.390+0000 7fba04e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba00106630 con 0x7fba000ffaf0 2024-04-20T22:07:32.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.390+0000 7fba04e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba00106770 con 0x7fba00100cf0 2024-04-20T22:07:32.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.390+0000 7fb9fde00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba000ffaf0 0x7fba00107a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:32.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.390+0000 7fb9fde00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba000ffaf0 0x7fba00107a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52908/0 (socket says 172.21.15.142:52908) 2024-04-20T22:07:32.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.390+0000 7fb9fde00700 1 -- 172.21.15.142:0/3594664256 learned_addr learned my addr 172.21.15.142:0/3594664256 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:07:32.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.390+0000 7fb9fd400700 1 --2- 172.21.15.142:0/3594664256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba00100cf0 0x7fba001060f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:32.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.391+0000 7fb9fde00700 1 -- 172.21.15.142:0/3594664256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba00100cf0 msgr2=0x7fba001060f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:32.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.391+0000 7fb9fde00700 1 --2- 172.21.15.142:0/3594664256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba00100cf0 0x7fba001060f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:32.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.391+0000 7fb9fde00700 1 -- 172.21.15.142:0/3594664256 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec0095f0 con 0x7fba000ffaf0 2024-04-20T22:07:32.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.391+0000 7fb9fd400700 1 --2- 172.21.15.142:0/3594664256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba00100cf0 0x7fba001060f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:07:32.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.391+0000 7fb9fde00700 1 --2- 172.21.15.142:0/3594664256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba000ffaf0 0x7fba00107a50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000e8f0 tx=0x7fb9f000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:32.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.391+0000 7fb9f6a00700 1 -- 172.21.15.142:0/3594664256 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9f0009790 con 0x7fba000ffaf0 2024-04-20T22:07:32.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.391+0000 7fb9f6a00700 1 -- 172.21.15.142:0/3594664256 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9f00044e0 con 0x7fba000ffaf0 2024-04-20T22:07:32.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.391+0000 7fba04e00700 1 -- 172.21.15.142:0/3594664256 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba00106a50 con 0x7fba000ffaf0 2024-04-20T22:07:32.397 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:32 smithi142 ceph-mon[79401]: pgmap v256: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-20T22:07:32.397 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:32 smithi142 ceph-mon[79401]: mds.? [v2:172.21.15.164:6826/3399966592,v1:172.21.15.164:6827/3399966592] up:boot 2024-04-20T22:07:32.398 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:32 smithi142 ceph-mon[79401]: fsmap cephfs:1/1 {0=cephfs.smithi142.lirkws=up:replay} 3 up:standby 2024-04-20T22:07:32.398 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:32 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.gmmrfu"}]: dispatch 2024-04-20T22:07:32.398 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:32 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:32.398 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:32 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:32.398 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:32 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:07:32.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.391+0000 7fb9f6a00700 1 -- 172.21.15.142:0/3594664256 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9f0003e00 con 0x7fba000ffaf0 2024-04-20T22:07:32.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.391+0000 7fba04e00700 1 -- 172.21.15.142:0/3594664256 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0019e630 con 0x7fba000ffaf0 2024-04-20T22:07:32.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.393+0000 7fba04e00700 1 -- 172.21.15.142:0/3594664256 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba00190770 con 0x7fba000ffaf0 2024-04-20T22:07:32.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.394+0000 7fb9f6a00700 1 -- 172.21.15.142:0/3594664256 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fb9f0010520 con 0x7fba000ffaf0 2024-04-20T22:07:32.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.395+0000 7fb9f6a00700 1 --2- 172.21.15.142:0/3594664256 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb9e406ec60 0x7fb9e4071120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:32.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.395+0000 7fb9f6a00700 1 -- 172.21.15.142:0/3594664256 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fb9f0014070 con 0x7fba000ffaf0 2024-04-20T22:07:32.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.395+0000 7fb9fd400700 1 --2- 172.21.15.142:0/3594664256 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb9e406ec60 0x7fb9e4071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:32.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.396+0000 7fb9fd400700 1 --2- 172.21.15.142:0/3594664256 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb9e406ec60 0x7fb9e4071120 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec005f50 tx=0x7fb9ec005dc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:32.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.400+0000 7fb9f6a00700 1 -- 172.21.15.142:0/3594664256 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fb9f005bba0 con 0x7fba000ffaf0 2024-04-20T22:07:32.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:32 smithi164 ceph-mon[69784]: pgmap v256: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-20T22:07:32.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:32 smithi164 ceph-mon[69784]: mds.? [v2:172.21.15.164:6826/3399966592,v1:172.21.15.164:6827/3399966592] up:boot 2024-04-20T22:07:32.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:32 smithi164 ceph-mon[69784]: fsmap cephfs:1/1 {0=cephfs.smithi142.lirkws=up:replay} 3 up:standby 2024-04-20T22:07:32.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:32 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi164.gmmrfu"}]: dispatch 2024-04-20T22:07:32.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:32 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:32.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:32 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:32.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:32 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:07:32.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.667+0000 7fba04e00700 1 -- 172.21.15.142:0/3594664256 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba0002cde0 con 0x7fb9e406ec60 2024-04-20T22:07:32.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.669+0000 7fb9f6a00700 1 -- 172.21.15.142:0/3594664256 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fba0002cde0 con 0x7fb9e406ec60 2024-04-20T22:07:32.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.672+0000 7fba04e00700 1 -- 172.21.15.142:0/3594664256 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb9e406ec60 msgr2=0x7fb9e4071120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:32.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.672+0000 7fba04e00700 1 --2- 172.21.15.142:0/3594664256 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb9e406ec60 0x7fb9e4071120 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec005f50 tx=0x7fb9ec005dc0 comp rx=0 tx=0).stop 2024-04-20T22:07:32.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.672+0000 7fba04e00700 1 -- 172.21.15.142:0/3594664256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba000ffaf0 msgr2=0x7fba00107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:32.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.672+0000 7fba04e00700 1 --2- 172.21.15.142:0/3594664256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba000ffaf0 0x7fba00107a50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000e8f0 tx=0x7fb9f000ecb0 comp rx=0 tx=0).stop 2024-04-20T22:07:32.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.672+0000 7fba04e00700 1 -- 172.21.15.142:0/3594664256 shutdown_connections 2024-04-20T22:07:32.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.672+0000 7fba04e00700 1 --2- 172.21.15.142:0/3594664256 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb9e406ec60 0x7fb9e4071120 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:32.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.672+0000 7fba04e00700 1 --2- 172.21.15.142:0/3594664256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba000ffaf0 0x7fba00107a50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:32.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.672+0000 7fba04e00700 1 --2- 172.21.15.142:0/3594664256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fba00100cf0 0x7fba001060f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:32.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.672+0000 7fba04e00700 1 -- 172.21.15.142:0/3594664256 >> 172.21.15.142:0/3594664256 conn(0x7fba000fb0d0 msgr2=0x7fba00104290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:32.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.672+0000 7fba04e00700 1 -- 172.21.15.142:0/3594664256 shutdown_connections 2024-04-20T22:07:32.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.672+0000 7fba04e00700 1 -- 172.21.15.142:0/3594664256 wait complete. 2024-04-20T22:07:32.689 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T22:07:32.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.830+0000 7fe1f9e00700 1 -- 172.21.15.142:0/3829578715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1f4108290 msgr2=0x7fe1f41086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:32.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.830+0000 7fe1f9e00700 1 --2- 172.21.15.142:0/3829578715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1f4108290 0x7fe1f41086f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0009910 tx=0x7fe1e0009c20 comp rx=0 tx=0).stop 2024-04-20T22:07:32.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.830+0000 7fe1f9e00700 1 -- 172.21.15.142:0/3829578715 shutdown_connections 2024-04-20T22:07:32.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.830+0000 7fe1f9e00700 1 --2- 172.21.15.142:0/3829578715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1f4108290 0x7fe1f41086f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:32.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.830+0000 7fe1f9e00700 1 --2- 172.21.15.142:0/3829578715 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1f41070f0 0x7fe1f4107510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:32.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.830+0000 7fe1f9e00700 1 -- 172.21.15.142:0/3829578715 >> 172.21.15.142:0/3829578715 conn(0x7fe1f40761d0 msgr2=0x7fe1f4078610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:32.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.830+0000 7fe1f9e00700 1 -- 172.21.15.142:0/3829578715 shutdown_connections 2024-04-20T22:07:32.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.830+0000 7fe1f9e00700 1 -- 172.21.15.142:0/3829578715 wait complete. 2024-04-20T22:07:32.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.831+0000 7fe1f9e00700 1 Processor -- start 2024-04-20T22:07:32.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.831+0000 7fe1f9e00700 1 -- start start 2024-04-20T22:07:32.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.832+0000 7fe1f9e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1f41070f0 0x7fe1f419ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:32.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.832+0000 7fe1f9e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1f4108290 0x7fe1f419cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:32.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.832+0000 7fe1f9e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f419d5d0 con 0x7fe1f4108290 2024-04-20T22:07:32.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.832+0000 7fe1f9e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f419d710 con 0x7fe1f41070f0 2024-04-20T22:07:32.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.832+0000 7fe1f3e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1f4108290 0x7fe1f419cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:32.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.832+0000 7fe1f3e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1f4108290 0x7fe1f419cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52926/0 (socket says 172.21.15.142:52926) 2024-04-20T22:07:32.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.832+0000 7fe1f3e00700 1 -- 172.21.15.142:0/3761430270 learned_addr learned my addr 172.21.15.142:0/3761430270 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:07:32.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.832+0000 7fe1f8a00700 1 --2- 172.21.15.142:0/3761430270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1f41070f0 0x7fe1f419ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:32.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.832+0000 7fe1f3e00700 1 -- 172.21.15.142:0/3761430270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1f41070f0 msgr2=0x7fe1f419ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:32.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.832+0000 7fe1f3e00700 1 --2- 172.21.15.142:0/3761430270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1f41070f0 0x7fe1f419ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:32.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.832+0000 7fe1f3e00700 1 -- 172.21.15.142:0/3761430270 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e00095f0 con 0x7fe1f4108290 2024-04-20T22:07:32.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.832+0000 7fe1f8a00700 1 --2- 172.21.15.142:0/3761430270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1f41070f0 0x7fe1f419ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:07:32.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.833+0000 7fe1f3e00700 1 --2- 172.21.15.142:0/3761430270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1f4108290 0x7fe1f419cfb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000bd70 tx=0x7fe1e000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:32.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.833+0000 7fe1f1600700 1 -- 172.21.15.142:0/3761430270 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1e001d070 con 0x7fe1f4108290 2024-04-20T22:07:32.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.833+0000 7fe1f1600700 1 -- 172.21.15.142:0/3761430270 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe1e0005dc0 con 0x7fe1f4108290 2024-04-20T22:07:32.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.833+0000 7fe1f9e00700 1 -- 172.21.15.142:0/3761430270 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f41a2110 con 0x7fe1f4108290 2024-04-20T22:07:32.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.833+0000 7fe1f1600700 1 -- 172.21.15.142:0/3761430270 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1e0021410 con 0x7fe1f4108290 2024-04-20T22:07:32.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.833+0000 7fe1f9e00700 1 -- 172.21.15.142:0/3761430270 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f41a2680 con 0x7fe1f4108290 2024-04-20T22:07:32.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.834+0000 7fe1f9e00700 1 -- 172.21.15.142:0/3761430270 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f4196c10 con 0x7fe1f4108290 2024-04-20T22:07:32.836 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.835+0000 7fe1f1600700 1 -- 172.21.15.142:0/3761430270 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fe1e000f820 con 0x7fe1f4108290 2024-04-20T22:07:32.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.836+0000 7fe1f1600700 1 --2- 172.21.15.142:0/3761430270 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe1dc06ecd0 0x7fe1dc071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:32.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.836+0000 7fe1f1600700 1 -- 172.21.15.142:0/3761430270 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fe1e0090270 con 0x7fe1f4108290 2024-04-20T22:07:32.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.836+0000 7fe1f8a00700 1 --2- 172.21.15.142:0/3761430270 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe1dc06ecd0 0x7fe1dc071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:32.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.837+0000 7fe1f8a00700 1 --2- 172.21.15.142:0/3761430270 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe1dc06ecd0 0x7fe1dc071190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8005fd0 tx=0x7fe1e8005f00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:32.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:32.841+0000 7fe1f1600700 1 -- 172.21.15.142:0/3761430270 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fe1e005c9b0 con 0x7fe1f4108290 2024-04-20T22:07:33.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.086+0000 7fe1f9e00700 1 -- 172.21.15.142:0/3761430270 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1f402cdb0 con 0x7fe1dc06ecd0 2024-04-20T22:07:33.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.090+0000 7fe1f1600700 1 -- 172.21.15.142:0/3761430270 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe1f402cdb0 con 0x7fe1dc06ecd0 2024-04-20T22:07:33.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.092+0000 7fe1f9e00700 1 -- 172.21.15.142:0/3761430270 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe1dc06ecd0 msgr2=0x7fe1dc071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:33.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.092+0000 7fe1f9e00700 1 --2- 172.21.15.142:0/3761430270 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe1dc06ecd0 0x7fe1dc071190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8005fd0 tx=0x7fe1e8005f00 comp rx=0 tx=0).stop 2024-04-20T22:07:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.092+0000 7fe1f9e00700 1 -- 172.21.15.142:0/3761430270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1f4108290 msgr2=0x7fe1f419cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.092+0000 7fe1f9e00700 1 --2- 172.21.15.142:0/3761430270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1f4108290 0x7fe1f419cfb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000bd70 tx=0x7fe1e000be50 comp rx=0 tx=0).stop 2024-04-20T22:07:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.093+0000 7fe1f9e00700 1 -- 172.21.15.142:0/3761430270 shutdown_connections 2024-04-20T22:07:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.093+0000 7fe1f9e00700 1 --2- 172.21.15.142:0/3761430270 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe1dc06ecd0 0x7fe1dc071190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.093+0000 7fe1f9e00700 1 --2- 172.21.15.142:0/3761430270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1f41070f0 0x7fe1f419ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.093+0000 7fe1f9e00700 1 --2- 172.21.15.142:0/3761430270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1f4108290 0x7fe1f419cfb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.093+0000 7fe1f9e00700 1 -- 172.21.15.142:0/3761430270 >> 172.21.15.142:0/3761430270 conn(0x7fe1f40761d0 msgr2=0x7fe1f410b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.093+0000 7fe1f9e00700 1 -- 172.21.15.142:0/3761430270 shutdown_connections 2024-04-20T22:07:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.093+0000 7fe1f9e00700 1 -- 172.21.15.142:0/3761430270 wait complete. 2024-04-20T22:07:33.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.246+0000 7f7ef9e00700 1 -- 172.21.15.142:0/3209473134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ef4100cf0 msgr2=0x7f7ef4101150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:33.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.246+0000 7f7ef9e00700 1 --2- 172.21.15.142:0/3209473134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ef4100cf0 0x7f7ef4101150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009910 tx=0x7f7edc009c20 comp rx=0 tx=0).stop 2024-04-20T22:07:33.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.246+0000 7f7ef9e00700 1 -- 172.21.15.142:0/3209473134 shutdown_connections 2024-04-20T22:07:33.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.246+0000 7f7ef9e00700 1 --2- 172.21.15.142:0/3209473134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ef4100cf0 0x7f7ef4101150 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:33.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.246+0000 7f7ef9e00700 1 --2- 172.21.15.142:0/3209473134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ef40ffaf0 0x7f7ef40fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:33.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.246+0000 7f7ef9e00700 1 -- 172.21.15.142:0/3209473134 >> 172.21.15.142:0/3209473134 conn(0x7f7ef40fb0d0 msgr2=0x7f7ef40fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:33.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.246+0000 7f7ef9e00700 1 -- 172.21.15.142:0/3209473134 shutdown_connections 2024-04-20T22:07:33.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.246+0000 7f7ef9e00700 1 -- 172.21.15.142:0/3209473134 wait complete. 2024-04-20T22:07:33.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.248+0000 7f7ef9e00700 1 Processor -- start 2024-04-20T22:07:33.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.248+0000 7f7ef9e00700 1 -- start start 2024-04-20T22:07:33.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.248+0000 7f7ef9e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ef40ffaf0 0x7f7ef4198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:33.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.248+0000 7f7ef9e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ef4100cf0 0x7f7ef4198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:33.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.248+0000 7f7ef9e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef4199360 con 0x7f7ef4100cf0 2024-04-20T22:07:33.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.248+0000 7f7ef9e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef41994a0 con 0x7f7ef40ffaf0 2024-04-20T22:07:33.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.249+0000 7f7eea000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ef4100cf0 0x7f7ef4198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:33.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.249+0000 7f7ef2a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ef40ffaf0 0x7f7ef4198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:33.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.249+0000 7f7ef2a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ef40ffaf0 0x7f7ef4198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:37048/0 (socket says 172.21.15.142:37048) 2024-04-20T22:07:33.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.249+0000 7f7eea000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ef4100cf0 0x7f7ef4198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52934/0 (socket says 172.21.15.142:52934) 2024-04-20T22:07:33.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.249+0000 7f7ef2a00700 1 -- 172.21.15.142:0/2583714449 learned_addr learned my addr 172.21.15.142:0/2583714449 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:07:33.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.249+0000 7f7ef2a00700 1 -- 172.21.15.142:0/2583714449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ef4100cf0 msgr2=0x7f7ef4198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:33.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.249+0000 7f7ef2a00700 1 --2- 172.21.15.142:0/2583714449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ef4100cf0 0x7f7ef4198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:33.250 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.249+0000 7f7ef2a00700 1 -- 172.21.15.142:0/2583714449 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee4009c40 con 0x7f7ef40ffaf0 2024-04-20T22:07:33.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.250+0000 7f7ef2a00700 1 --2- 172.21.15.142:0/2583714449 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ef40ffaf0 0x7f7ef4198800 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7ee400c140 tx=0x7f7ee400c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:33.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.250+0000 7f7ef8a00700 1 -- 172.21.15.142:0/2583714449 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ee400e050 con 0x7f7ef40ffaf0 2024-04-20T22:07:33.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.250+0000 7f7ef9e00700 1 -- 172.21.15.142:0/2583714449 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7edc0095f0 con 0x7f7ef40ffaf0 2024-04-20T22:07:33.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.250+0000 7f7ef8a00700 1 -- 172.21.15.142:0/2583714449 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ee400f040 con 0x7f7ef40ffaf0 2024-04-20T22:07:33.251 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.250+0000 7f7ef8a00700 1 -- 172.21.15.142:0/2583714449 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ee4013630 con 0x7f7ef40ffaf0 2024-04-20T22:07:33.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.250+0000 7f7ef9e00700 1 -- 172.21.15.142:0/2583714449 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef419e280 con 0x7f7ef40ffaf0 2024-04-20T22:07:33.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.252+0000 7f7ef9e00700 1 -- 172.21.15.142:0/2583714449 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed00052f0 con 0x7f7ef40ffaf0 2024-04-20T22:07:33.253 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.252+0000 7f7ef8a00700 1 -- 172.21.15.142:0/2583714449 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f7ee4013790 con 0x7f7ef40ffaf0 2024-04-20T22:07:33.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.253+0000 7f7ef8a00700 1 --2- 172.21.15.142:0/2583714449 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7ed806ecc0 0x7f7ed8071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:33.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.253+0000 7f7ef8a00700 1 -- 172.21.15.142:0/2583714449 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f7ee408efe0 con 0x7f7ef40ffaf0 2024-04-20T22:07:33.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.254+0000 7f7eea000700 1 --2- 172.21.15.142:0/2583714449 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7ed806ecc0 0x7f7ed8071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:33.255 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.254+0000 7f7eea000700 1 --2- 172.21.15.142:0/2583714449 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7ed806ecc0 0x7f7ed8071180 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00b800 tx=0x7f7edc009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:33.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.264+0000 7f7ef8a00700 1 -- 172.21.15.142:0/2583714449 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f7ee405b7c0 con 0x7f7ef40ffaf0 2024-04-20T22:07:33.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:33 smithi142 ceph-mon[79401]: reconnect by client.24289 192.168.0.1:0/4069521734 after 0.00299995 2024-04-20T22:07:33.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:33 smithi142 ceph-mon[79401]: reconnect by client.14536 192.168.0.1:0/1982029803 after 0.00299995 2024-04-20T22:07:33.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:33 smithi142 ceph-mon[79401]: mds.? [v2:172.21.15.142:6826/2100080187,v1:172.21.15.142:6827/2100080187] up:reconnect 2024-04-20T22:07:33.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:33 smithi142 ceph-mon[79401]: fsmap cephfs:1/1 {0=cephfs.smithi142.lirkws=up:reconnect} 3 up:standby 2024-04-20T22:07:33.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:33 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:33.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:33 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:33.503 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:33 smithi164 ceph-mon[69784]: reconnect by client.24289 192.168.0.1:0/4069521734 after 0.00299995 2024-04-20T22:07:33.503 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:33 smithi164 ceph-mon[69784]: reconnect by client.14536 192.168.0.1:0/1982029803 after 0.00299995 2024-04-20T22:07:33.503 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:33 smithi164 ceph-mon[69784]: mds.? [v2:172.21.15.142:6826/2100080187,v1:172.21.15.142:6827/2100080187] up:reconnect 2024-04-20T22:07:33.503 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:33 smithi164 ceph-mon[69784]: fsmap cephfs:1/1 {0=cephfs.smithi142.lirkws=up:reconnect} 3 up:standby 2024-04-20T22:07:33.503 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:33 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:33.503 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:33 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:33.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.503+0000 7f7ef9e00700 1 -- 172.21.15.142:0/2583714449 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ed0000bc0 con 0x7f7ed806ecc0 2024-04-20T22:07:33.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.534+0000 7f7ef8a00700 1 -- 172.21.15.142:0/2583714449 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f7ed0000bc0 con 0x7f7ed806ecc0 2024-04-20T22:07:33.536 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:07:33.536 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (18m) 54s ago 20m 14.2M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T22:07:33.536 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (20m) 54s ago 20m 9110k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 4cb14949acdb 2024-04-20T22:07:33.536 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (19m) 24s ago 19m 9021k - 18.2.2-1237-g646b8c7d 9900ed1a6b81 3288baa8a25c 2024-04-20T22:07:33.536 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (5m) 54s ago 20m 6665k - 19.0.0-3133-ga8c84f59 76bc6b91b726 64521ed7125b 2024-04-20T22:07:33.536 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (5m) 24s ago 19m 6656k - 19.0.0-3133-ga8c84f59 76bc6b91b726 893c6f16ee6d 2024-04-20T22:07:33.536 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (18m) 54s ago 19m 74.8M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T22:07:33.536 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (94s) 54s ago 12m 12.0M - 19.0.0-3133-ga8c84f59 76bc6b91b726 603d9ff4accc 2024-04-20T22:07:33.536 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (62s) 54s ago 12m 11.0M - 19.0.0-3133-ga8c84f59 76bc6b91b726 5fbbe225e911 2024-04-20T22:07:33.536 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 starting - - - - 2024-04-20T22:07:33.536 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (33s) 24s ago 12m 10.9M - 19.0.0-3133-ga8c84f59 76bc6b91b726 44901e1ad990 2024-04-20T22:07:33.537 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (9m) 54s ago 21m 511M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:07:33.537 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (7m) 24s ago 18m 454M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:07:33.537 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (7m) 54s ago 22m 55.9M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 af10a542c918 2024-04-20T22:07:33.537 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (6m) 24s ago 18m 41.9M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 133512694d46 2024-04-20T22:07:33.537 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (20m) 54s ago 20m 8166k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T22:07:33.537 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (18m) 24s ago 18m 8288k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T22:07:33.537 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (5m) 54s ago 17m 104M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 b7206d05a7cd 2024-04-20T22:07:33.537 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (4m) 54s ago 17m 105M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 82bcc0c46762 2024-04-20T22:07:33.537 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (4m) 54s ago 16m 92.6M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 3e2d91f49494 2024-04-20T22:07:33.537 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (3m) 24s ago 15m 117M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 a898b8b77c51 2024-04-20T22:07:33.537 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (2m) 24s ago 15m 102M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 539c4026f9fb 2024-04-20T22:07:33.537 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (2m) 24s ago 14m 95.1M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 ac1bdd69c944 2024-04-20T22:07:33.537 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (8m) 54s ago 19m 77.5M - 2.43.0 a07b618ecd1d 46b76c20eae5 2024-04-20T22:07:33.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.537+0000 7f7ef9e00700 1 -- 172.21.15.142:0/2583714449 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7ed806ecc0 msgr2=0x7f7ed8071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:33.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.537+0000 7f7ef9e00700 1 --2- 172.21.15.142:0/2583714449 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7ed806ecc0 0x7f7ed8071180 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00b800 tx=0x7f7edc009f70 comp rx=0 tx=0).stop 2024-04-20T22:07:33.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.537+0000 7f7ef9e00700 1 -- 172.21.15.142:0/2583714449 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ef40ffaf0 msgr2=0x7f7ef4198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:33.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.537+0000 7f7ef9e00700 1 --2- 172.21.15.142:0/2583714449 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ef40ffaf0 0x7f7ef4198800 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7ee400c140 tx=0x7f7ee400c450 comp rx=0 tx=0).stop 2024-04-20T22:07:33.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.538+0000 7f7ef9e00700 1 -- 172.21.15.142:0/2583714449 shutdown_connections 2024-04-20T22:07:33.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.538+0000 7f7ef9e00700 1 --2- 172.21.15.142:0/2583714449 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7ed806ecc0 0x7f7ed8071180 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:33.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.538+0000 7f7ef9e00700 1 --2- 172.21.15.142:0/2583714449 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7ef40ffaf0 0x7f7ef4198800 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:33.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.538+0000 7f7ef9e00700 1 --2- 172.21.15.142:0/2583714449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ef4100cf0 0x7f7ef4198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:33.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.538+0000 7f7ef9e00700 1 -- 172.21.15.142:0/2583714449 >> 172.21.15.142:0/2583714449 conn(0x7f7ef40fb0d0 msgr2=0x7f7ef40685c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:33.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.538+0000 7f7ef9e00700 1 -- 172.21.15.142:0/2583714449 shutdown_connections 2024-04-20T22:07:33.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.538+0000 7f7ef9e00700 1 -- 172.21.15.142:0/2583714449 wait complete. 2024-04-20T22:07:33.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.693+0000 7fabfe200700 1 -- 172.21.15.142:0/4008019727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf8108290 msgr2=0x7fabf81086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:33.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.693+0000 7fabfe200700 1 --2- 172.21.15.142:0/4008019727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf8108290 0x7fabf81086f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009910 tx=0x7fabe4009c20 comp rx=0 tx=0).stop 2024-04-20T22:07:33.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.693+0000 7fabfe200700 1 -- 172.21.15.142:0/4008019727 shutdown_connections 2024-04-20T22:07:33.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.693+0000 7fabfe200700 1 --2- 172.21.15.142:0/4008019727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf8108290 0x7fabf81086f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:33.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.693+0000 7fabfe200700 1 --2- 172.21.15.142:0/4008019727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabf81070f0 0x7fabf8107510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:33.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.693+0000 7fabfe200700 1 -- 172.21.15.142:0/4008019727 >> 172.21.15.142:0/4008019727 conn(0x7fabf80761d0 msgr2=0x7fabf8078610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:33.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.693+0000 7fabfe200700 1 -- 172.21.15.142:0/4008019727 shutdown_connections 2024-04-20T22:07:33.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.693+0000 7fabfe200700 1 -- 172.21.15.142:0/4008019727 wait complete. 2024-04-20T22:07:33.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.694+0000 7fabfe200700 1 Processor -- start 2024-04-20T22:07:33.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.694+0000 7fabfe200700 1 -- start start 2024-04-20T22:07:33.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.695+0000 7fabfe200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabf81070f0 0x7fabf819ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:33.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.695+0000 7fabfe200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf8108290 0x7fabf819cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:33.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.695+0000 7fabfe200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf819d5d0 con 0x7fabf8108290 2024-04-20T22:07:33.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.695+0000 7fabfe200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf819d710 con 0x7fabf81070f0 2024-04-20T22:07:33.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.695+0000 7fabf7e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf8108290 0x7fabf819cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:33.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.695+0000 7fabfce00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabf81070f0 0x7fabf819ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:33.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.695+0000 7fabfce00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabf81070f0 0x7fabf819ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:37066/0 (socket says 172.21.15.142:37066) 2024-04-20T22:07:33.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.695+0000 7fabfce00700 1 -- 172.21.15.142:0/2397923736 learned_addr learned my addr 172.21.15.142:0/2397923736 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:07:33.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.695+0000 7fabf7e00700 1 -- 172.21.15.142:0/2397923736 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabf81070f0 msgr2=0x7fabf819ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:33.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.695+0000 7fabf7e00700 1 --2- 172.21.15.142:0/2397923736 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabf81070f0 0x7fabf819ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:33.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.695+0000 7fabf7e00700 1 -- 172.21.15.142:0/2397923736 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe40095f0 con 0x7fabf8108290 2024-04-20T22:07:33.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.696+0000 7fabf7e00700 1 --2- 172.21.15.142:0/2397923736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf8108290 0x7fabf819cfb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fabe4000c00 tx=0x7fabe400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:33.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.696+0000 7fabf5600700 1 -- 172.21.15.142:0/2397923736 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabe401d070 con 0x7fabf8108290 2024-04-20T22:07:33.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.696+0000 7fabf5600700 1 -- 172.21.15.142:0/2397923736 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fabe4005dc0 con 0x7fabf8108290 2024-04-20T22:07:33.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.696+0000 7fabf5600700 1 -- 172.21.15.142:0/2397923736 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabe4021410 con 0x7fabf8108290 2024-04-20T22:07:33.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.696+0000 7fabfe200700 1 -- 172.21.15.142:0/2397923736 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf81a2110 con 0x7fabf8108290 2024-04-20T22:07:33.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.696+0000 7fabfe200700 1 -- 172.21.15.142:0/2397923736 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf81a2680 con 0x7fabf8108290 2024-04-20T22:07:33.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.698+0000 7fabfe200700 1 -- 172.21.15.142:0/2397923736 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf8196c10 con 0x7fabf8108290 2024-04-20T22:07:33.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.699+0000 7fabf5600700 1 -- 172.21.15.142:0/2397923736 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fabe400f6f0 con 0x7fabf8108290 2024-04-20T22:07:33.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.700+0000 7fabf5600700 1 --2- 172.21.15.142:0/2397923736 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fabe006ecd0 0x7fabe0071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:33.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.700+0000 7fabf5600700 1 -- 172.21.15.142:0/2397923736 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fabe40900a0 con 0x7fabf8108290 2024-04-20T22:07:33.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.700+0000 7fabfce00700 1 --2- 172.21.15.142:0/2397923736 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fabe006ecd0 0x7fabe0071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:33.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.701+0000 7fabfce00700 1 --2- 172.21.15.142:0/2397923736 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fabe006ecd0 0x7fabe0071190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fabec00bd70 tx=0x7fabec00b4a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:33.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:33.705+0000 7fabf5600700 1 -- 172.21.15.142:0/2397923736 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fabe405c860 con 0x7fabf8108290 2024-04-20T22:07:34.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.020+0000 7fabfe200700 1 -- 172.21.15.142:0/2397923736 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fabf804f400 con 0x7fabf8108290 2024-04-20T22:07:34.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.021+0000 7fabf5600700 1 -- 172.21.15.142:0/2397923736 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fabe405c3f0 con 0x7fabf8108290 2024-04-20T22:07:34.022 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:07:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:07:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:07:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:07:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:07:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:07:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:07:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:07:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 6 2024-04-20T22:07:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:07:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:07:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 4 2024-04-20T22:07:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:07:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:07:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 14 2024-04-20T22:07:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:07:34.023 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:07:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.024+0000 7fabfe200700 1 -- 172.21.15.142:0/2397923736 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fabe006ecd0 msgr2=0x7fabe0071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.024+0000 7fabfe200700 1 --2- 172.21.15.142:0/2397923736 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fabe006ecd0 0x7fabe0071190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fabec00bd70 tx=0x7fabec00b4a0 comp rx=0 tx=0).stop 2024-04-20T22:07:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.024+0000 7fabfe200700 1 -- 172.21.15.142:0/2397923736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf8108290 msgr2=0x7fabf819cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.024+0000 7fabfe200700 1 --2- 172.21.15.142:0/2397923736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf8108290 0x7fabf819cfb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fabe4000c00 tx=0x7fabe400bd70 comp rx=0 tx=0).stop 2024-04-20T22:07:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.024+0000 7fabfe200700 1 -- 172.21.15.142:0/2397923736 shutdown_connections 2024-04-20T22:07:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.024+0000 7fabfe200700 1 --2- 172.21.15.142:0/2397923736 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fabe006ecd0 0x7fabe0071190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.024+0000 7fabfe200700 1 --2- 172.21.15.142:0/2397923736 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabf81070f0 0x7fabf819ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.024+0000 7fabfe200700 1 --2- 172.21.15.142:0/2397923736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabf8108290 0x7fabf819cfb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.024+0000 7fabfe200700 1 -- 172.21.15.142:0/2397923736 >> 172.21.15.142:0/2397923736 conn(0x7fabf80761d0 msgr2=0x7fabf810b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.024+0000 7fabfe200700 1 -- 172.21.15.142:0/2397923736 shutdown_connections 2024-04-20T22:07:34.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.024+0000 7fabfe200700 1 -- 172.21.15.142:0/2397923736 wait complete. 2024-04-20T22:07:34.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.185+0000 7fc9d2000700 1 -- 172.21.15.142:0/2306778910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9cc102e30 msgr2=0x7fc9cc103250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:34.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.185+0000 7fc9d2000700 1 --2- 172.21.15.142:0/2306778910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9cc102e30 0x7fc9cc103250 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009910 tx=0x7fc9bc009c20 comp rx=0 tx=0).stop 2024-04-20T22:07:34.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.185+0000 7fc9d2000700 1 -- 172.21.15.142:0/2306778910 shutdown_connections 2024-04-20T22:07:34.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.185+0000 7fc9d2000700 1 --2- 172.21.15.142:0/2306778910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9cc103f90 0x7fc9cc104410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:34.185 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.185+0000 7fc9d2000700 1 --2- 172.21.15.142:0/2306778910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9cc102e30 0x7fc9cc103250 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:34.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.185+0000 7fc9d2000700 1 -- 172.21.15.142:0/2306778910 >> 172.21.15.142:0/2306778910 conn(0x7fc9cc0fe3d0 msgr2=0x7fc9cc100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:34.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.185+0000 7fc9d2000700 1 -- 172.21.15.142:0/2306778910 shutdown_connections 2024-04-20T22:07:34.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.185+0000 7fc9d2000700 1 -- 172.21.15.142:0/2306778910 wait complete. 2024-04-20T22:07:34.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.186+0000 7fc9d2000700 1 Processor -- start 2024-04-20T22:07:34.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.186+0000 7fc9d2000700 1 -- start start 2024-04-20T22:07:34.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.187+0000 7fc9d2000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9cc102e30 0x7fc9cc1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:34.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.187+0000 7fc9d2000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9cc103f90 0x7fc9cc198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:34.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.187+0000 7fc9d2000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc199320 con 0x7fc9cc103f90 2024-04-20T22:07:34.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.187+0000 7fc9d2000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc199460 con 0x7fc9cc102e30 2024-04-20T22:07:34.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.187+0000 7fc9c3e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9cc103f90 0x7fc9cc198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:34.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.187+0000 7fc9c3e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9cc103f90 0x7fc9cc198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52954/0 (socket says 172.21.15.142:52954) 2024-04-20T22:07:34.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.187+0000 7fc9c3e00700 1 -- 172.21.15.142:0/454405417 learned_addr learned my addr 172.21.15.142:0/454405417 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:07:34.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.188+0000 7fc9cb400700 1 --2- 172.21.15.142:0/454405417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9cc102e30 0x7fc9cc1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:34.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.188+0000 7fc9c3e00700 1 -- 172.21.15.142:0/454405417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9cc102e30 msgr2=0x7fc9cc1987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:34.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.188+0000 7fc9c3e00700 1 --2- 172.21.15.142:0/454405417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9cc102e30 0x7fc9cc1987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:34.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.188+0000 7fc9c3e00700 1 -- 172.21.15.142:0/454405417 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc0095f0 con 0x7fc9cc103f90 2024-04-20T22:07:34.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.188+0000 7fc9cb400700 1 --2- 172.21.15.142:0/454405417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9cc102e30 0x7fc9cc1987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:07:34.188 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.188+0000 7fc9c3e00700 1 --2- 172.21.15.142:0/454405417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9cc103f90 0x7fc9cc198d00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400d8d0 tx=0x7fc9b400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:34.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.188+0000 7fc9c8c00700 1 -- 172.21.15.142:0/454405417 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9b4009940 con 0x7fc9cc103f90 2024-04-20T22:07:34.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.188+0000 7fc9c8c00700 1 -- 172.21.15.142:0/454405417 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9b4010460 con 0x7fc9cc103f90 2024-04-20T22:07:34.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.188+0000 7fc9c8c00700 1 -- 172.21.15.142:0/454405417 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9b400f5f0 con 0x7fc9cc103f90 2024-04-20T22:07:34.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.188+0000 7fc9d2000700 1 -- 172.21.15.142:0/454405417 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9cc19dec0 con 0x7fc9cc103f90 2024-04-20T22:07:34.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.188+0000 7fc9d2000700 1 -- 172.21.15.142:0/454405417 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9cc19e460 con 0x7fc9cc103f90 2024-04-20T22:07:34.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.189+0000 7fc9d2000700 1 -- 172.21.15.142:0/454405417 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9cc192930 con 0x7fc9cc103f90 2024-04-20T22:07:34.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.191+0000 7fc9c8c00700 1 -- 172.21.15.142:0/454405417 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fc9b40105d0 con 0x7fc9cc103f90 2024-04-20T22:07:34.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.191+0000 7fc9c8c00700 1 --2- 172.21.15.142:0/454405417 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc9b006ecd0 0x7fc9b0071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:34.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.192+0000 7fc9c8c00700 1 -- 172.21.15.142:0/454405417 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fc9b408eff0 con 0x7fc9cc103f90 2024-04-20T22:07:34.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.192+0000 7fc9cb400700 1 --2- 172.21.15.142:0/454405417 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc9b006ecd0 0x7fc9b0071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:34.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.193+0000 7fc9cb400700 1 --2- 172.21.15.142:0/454405417 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc9b006ecd0 0x7fc9b0071190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc005950 tx=0x7fc9bc0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:34.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.197+0000 7fc9c8c00700 1 -- 172.21.15.142:0/454405417 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fc9b405b750 con 0x7fc9cc103f90 2024-04-20T22:07:34.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:34 smithi142 ceph-mon[79401]: pgmap v257: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-20T22:07:34.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:34 smithi142 ceph-mon[79401]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:07:34.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:34 smithi142 ceph-mon[79401]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:07:34.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:34 smithi142 ceph-mon[79401]: mds.? [v2:172.21.15.142:6826/2100080187,v1:172.21.15.142:6827/2100080187] up:rejoin 2024-04-20T22:07:34.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:34 smithi142 ceph-mon[79401]: fsmap cephfs:1/1 {0=cephfs.smithi142.lirkws=up:rejoin} 3 up:standby 2024-04-20T22:07:34.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:34 smithi142 ceph-mon[79401]: daemon mds.cephfs.smithi142.lirkws is now active in filesystem cephfs as rank 0 2024-04-20T22:07:34.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:34 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2397923736' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:34.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.470+0000 7fc9d2000700 1 -- 172.21.15.142:0/454405417 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc9cc04ebb0 con 0x7fc9cc103f90 2024-04-20T22:07:34.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.471+0000 7fc9c8c00700 1 -- 172.21.15.142:0/454405417 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1957 (secure 0 0 0) 0x7fc9b405b2e0 con 0x7fc9cc103f90 2024-04-20T22:07:34.472 INFO:teuthology.orchestra.run.smithi142.stdout:e35 2024-04-20T22:07:34.472 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:07:34.472 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:07:34.473 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T22:07:34.473 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:07:34.473 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T22:07:34.473 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T22:07:34.473 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 35 2024-04-20T22:07:34.473 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:07:34.474 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:07:34.474 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T22:07:34.267651+0000 2024-04-20T22:07:34.474 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T22:07:34.474 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T22:07:34.474 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T22:07:34.474 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T22:07:34.475 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T22:07:34.475 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T22:07:34.475 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T22:07:34.475 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T22:07:34.475 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 85 2024-04-20T22:07:34.475 INFO:teuthology.orchestra.run.smithi142.stdout:snap_rstat 1 2024-04-20T22:07:34.475 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-20T22:07:34.476 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T22:07:34.476 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T22:07:34.476 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=34454} 2024-04-20T22:07:34.476 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T22:07:34.476 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T22:07:34.476 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T22:07:34.477 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T22:07:34.477 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T22:07:34.477 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T22:07:34.477 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T22:07:34.477 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T22:07:34.477 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T22:07:34.477 INFO:teuthology.orchestra.run.smithi142.stdout:qdb_cluster leader: 34454 members: 34454 2024-04-20T22:07:34.478 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:34454} state up:active seq 26 join_fscid=1 addr [v2:172.21.15.142:6826/2100080187,v1:172.21.15.142:6827/2100080187] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:07:34.478 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:07:34.478 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:07:34.478 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T22:07:34.478 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:07:34.478 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:34486} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6828/2960234081,v1:172.21.15.142:6829/2960234081] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:07:34.479 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.164:6824/1951894011,v1:172.21.15.164:6825/1951894011] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:07:34.479 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.164:6826/3399966592,v1:172.21.15.164:6827/3399966592] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:07:34.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.474+0000 7fc9d2000700 1 -- 172.21.15.142:0/454405417 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc9b006ecd0 msgr2=0x7fc9b0071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:34.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.474+0000 7fc9d2000700 1 --2- 172.21.15.142:0/454405417 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc9b006ecd0 0x7fc9b0071190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc005950 tx=0x7fc9bc0058e0 comp rx=0 tx=0).stop 2024-04-20T22:07:34.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.474+0000 7fc9d2000700 1 -- 172.21.15.142:0/454405417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9cc103f90 msgr2=0x7fc9cc198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:34.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.474+0000 7fc9d2000700 1 --2- 172.21.15.142:0/454405417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9cc103f90 0x7fc9cc198d00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400d8d0 tx=0x7fc9b400dc90 comp rx=0 tx=0).stop 2024-04-20T22:07:34.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.474+0000 7fc9d2000700 1 -- 172.21.15.142:0/454405417 shutdown_connections 2024-04-20T22:07:34.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.474+0000 7fc9d2000700 1 --2- 172.21.15.142:0/454405417 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc9b006ecd0 0x7fc9b0071190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:34.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.474+0000 7fc9d2000700 1 --2- 172.21.15.142:0/454405417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9cc102e30 0x7fc9cc1987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:34.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.474+0000 7fc9d2000700 1 --2- 172.21.15.142:0/454405417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9cc103f90 0x7fc9cc198d00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:34.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.474+0000 7fc9d2000700 1 -- 172.21.15.142:0/454405417 >> 172.21.15.142:0/454405417 conn(0x7fc9cc0fe3d0 msgr2=0x7fc9cc107570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:34.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.474+0000 7fc9d2000700 1 -- 172.21.15.142:0/454405417 shutdown_connections 2024-04-20T22:07:34.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.474+0000 7fc9d2000700 1 -- 172.21.15.142:0/454405417 wait complete. 2024-04-20T22:07:34.482 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 35 2024-04-20T22:07:34.543 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:34 smithi164 ceph-mon[69784]: pgmap v257: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-20T22:07:34.543 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:34 smithi164 ceph-mon[69784]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:07:34.543 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:34 smithi164 ceph-mon[69784]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:07:34.543 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:34 smithi164 ceph-mon[69784]: mds.? [v2:172.21.15.142:6826/2100080187,v1:172.21.15.142:6827/2100080187] up:rejoin 2024-04-20T22:07:34.543 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:34 smithi164 ceph-mon[69784]: fsmap cephfs:1/1 {0=cephfs.smithi142.lirkws=up:rejoin} 3 up:standby 2024-04-20T22:07:34.544 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:34 smithi164 ceph-mon[69784]: daemon mds.cephfs.smithi142.lirkws is now active in filesystem cephfs as rank 0 2024-04-20T22:07:34.544 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:34 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/2397923736' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:34.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.619+0000 7f0c60400700 1 -- 172.21.15.142:0/941568552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c58100c00 msgr2=0x7f0c58101020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:34.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.619+0000 7f0c60400700 1 --2- 172.21.15.142:0/941568552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c58100c00 0x7f0c58101020 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00b0a0 tx=0x7f0c4c00b3b0 comp rx=0 tx=0).stop 2024-04-20T22:07:34.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.619+0000 7f0c60400700 1 -- 172.21.15.142:0/941568552 shutdown_connections 2024-04-20T22:07:34.619 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.619+0000 7f0c60400700 1 --2- 172.21.15.142:0/941568552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c58101e00 0x7f0c58102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:34.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.619+0000 7f0c60400700 1 --2- 172.21.15.142:0/941568552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c58100c00 0x7f0c58101020 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:34.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.619+0000 7f0c60400700 1 -- 172.21.15.142:0/941568552 >> 172.21.15.142:0/941568552 conn(0x7f0c580fc1c0 msgr2=0x7f0c580fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:34.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.619+0000 7f0c60400700 1 -- 172.21.15.142:0/941568552 shutdown_connections 2024-04-20T22:07:34.620 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.619+0000 7f0c60400700 1 -- 172.21.15.142:0/941568552 wait complete. 2024-04-20T22:07:34.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.620+0000 7f0c60400700 1 Processor -- start 2024-04-20T22:07:34.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.620+0000 7f0c60400700 1 -- start start 2024-04-20T22:07:34.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.620+0000 7f0c60400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c58100c00 0x7f0c58074c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:34.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.620+0000 7f0c60400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c58101e00 0x7f0c580732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:34.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.620+0000 7f0c60400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c58073810 con 0x7f0c58100c00 2024-04-20T22:07:34.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.620+0000 7f0c60400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c58073950 con 0x7f0c58101e00 2024-04-20T22:07:34.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.621+0000 7f0c5da00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c58100c00 0x7f0c58074c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:34.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.621+0000 7f0c5da00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c58100c00 0x7f0c58074c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52978/0 (socket says 172.21.15.142:52978) 2024-04-20T22:07:34.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.621+0000 7f0c5da00700 1 -- 172.21.15.142:0/4199498832 learned_addr learned my addr 172.21.15.142:0/4199498832 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:07:34.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.621+0000 7f0c5da00700 1 -- 172.21.15.142:0/4199498832 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c58101e00 msgr2=0x7f0c580732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:34.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.621+0000 7f0c5da00700 1 --2- 172.21.15.142:0/4199498832 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c58101e00 0x7f0c580732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:34.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.621+0000 7f0c5da00700 1 -- 172.21.15.142:0/4199498832 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c009d00 con 0x7f0c58100c00 2024-04-20T22:07:34.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.621+0000 7f0c5da00700 1 --2- 172.21.15.142:0/4199498832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c58100c00 0x7f0c58074c30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00b070 tx=0x7f0c4c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:34.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.622+0000 7f0c56000700 1 -- 172.21.15.142:0/4199498832 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c4c00e040 con 0x7f0c58100c00 2024-04-20T22:07:34.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.622+0000 7f0c56000700 1 -- 172.21.15.142:0/4199498832 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c4c00ce60 con 0x7f0c58100c00 2024-04-20T22:07:34.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.622+0000 7f0c60400700 1 -- 172.21.15.142:0/4199498832 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c58073bd0 con 0x7f0c58100c00 2024-04-20T22:07:34.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.622+0000 7f0c56000700 1 -- 172.21.15.142:0/4199498832 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c4c01d920 con 0x7f0c58100c00 2024-04-20T22:07:34.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.622+0000 7f0c60400700 1 -- 172.21.15.142:0/4199498832 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c58074140 con 0x7f0c58100c00 2024-04-20T22:07:34.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.623+0000 7f0c60400700 1 -- 172.21.15.142:0/4199498832 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c58190800 con 0x7f0c58100c00 2024-04-20T22:07:34.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.624+0000 7f0c56000700 1 -- 172.21.15.142:0/4199498832 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f0c4c0048a0 con 0x7f0c58100c00 2024-04-20T22:07:34.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.625+0000 7f0c56000700 1 --2- 172.21.15.142:0/4199498832 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0c4006ecc0 0x7f0c40071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:34.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.625+0000 7f0c56000700 1 -- 172.21.15.142:0/4199498832 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f0c4c090790 con 0x7f0c58100c00 2024-04-20T22:07:34.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.625+0000 7f0c5d000700 1 --2- 172.21.15.142:0/4199498832 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0c4006ecc0 0x7f0c40071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:34.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.626+0000 7f0c5d000700 1 --2- 172.21.15.142:0/4199498832 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0c4006ecc0 0x7f0c40071180 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0c440097b0 tx=0x7f0c44006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:34.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.632+0000 7f0c56000700 1 -- 172.21.15.142:0/4199498832 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f0c4c05cf50 con 0x7f0c58100c00 2024-04-20T22:07:34.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.864+0000 7f0c60400700 1 -- 172.21.15.142:0/4199498832 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c58074140 con 0x7f0c4006ecc0 2024-04-20T22:07:34.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.866+0000 7f0c56000700 1 -- 172.21.15.142:0/4199498832 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0c58074140 con 0x7f0c4006ecc0 2024-04-20T22:07:34.866 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:07:34.866 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T22:07:34.866 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T22:07:34.867 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T22:07:34.867 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T22:07:34.867 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr", 2024-04-20T22:07:34.867 INFO:teuthology.orchestra.run.smithi142.stdout: "mon", 2024-04-20T22:07:34.867 INFO:teuthology.orchestra.run.smithi142.stdout: "crash", 2024-04-20T22:07:34.868 INFO:teuthology.orchestra.run.smithi142.stdout: "osd" 2024-04-20T22:07:34.868 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T22:07:34.868 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "15/23 daemons upgraded", 2024-04-20T22:07:34.868 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading mds daemons", 2024-04-20T22:07:34.868 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T22:07:34.868 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:07:34.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.868+0000 7f0c60400700 1 -- 172.21.15.142:0/4199498832 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0c4006ecc0 msgr2=0x7f0c40071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:34.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.868+0000 7f0c60400700 1 --2- 172.21.15.142:0/4199498832 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0c4006ecc0 0x7f0c40071180 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0c440097b0 tx=0x7f0c44006d20 comp rx=0 tx=0).stop 2024-04-20T22:07:34.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.868+0000 7f0c60400700 1 -- 172.21.15.142:0/4199498832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c58100c00 msgr2=0x7f0c58074c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:34.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.868+0000 7f0c60400700 1 --2- 172.21.15.142:0/4199498832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c58100c00 0x7f0c58074c30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00b070 tx=0x7f0c4c003ce0 comp rx=0 tx=0).stop 2024-04-20T22:07:34.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.868+0000 7f0c60400700 1 -- 172.21.15.142:0/4199498832 shutdown_connections 2024-04-20T22:07:34.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.868+0000 7f0c60400700 1 --2- 172.21.15.142:0/4199498832 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0c4006ecc0 0x7f0c40071180 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:34.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.868+0000 7f0c60400700 1 --2- 172.21.15.142:0/4199498832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c58100c00 0x7f0c58074c30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:34.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.868+0000 7f0c60400700 1 --2- 172.21.15.142:0/4199498832 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c58101e00 0x7f0c580732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:34.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.868+0000 7f0c60400700 1 -- 172.21.15.142:0/4199498832 >> 172.21.15.142:0/4199498832 conn(0x7f0c580fc1c0 msgr2=0x7f0c58105540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:34.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.869+0000 7f0c60400700 1 -- 172.21.15.142:0/4199498832 shutdown_connections 2024-04-20T22:07:34.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:34.869+0000 7f0c60400700 1 -- 172.21.15.142:0/4199498832 wait complete. 2024-04-20T22:07:35.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.016+0000 7f3b29600700 1 -- 172.21.15.142:0/831835702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b24101680 msgr2=0x7f3b24103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:35.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.016+0000 7f3b29600700 1 --2- 172.21.15.142:0/831835702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b24101680 0x7f3b24103a70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400b0a0 tx=0x7f3b1400b3b0 comp rx=0 tx=0).stop 2024-04-20T22:07:35.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.016+0000 7f3b29600700 1 -- 172.21.15.142:0/831835702 shutdown_connections 2024-04-20T22:07:35.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.016+0000 7f3b29600700 1 --2- 172.21.15.142:0/831835702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b24103fb0 0x7f3b241063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:35.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.016+0000 7f3b29600700 1 --2- 172.21.15.142:0/831835702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b24101680 0x7f3b24103a70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:35.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.016+0000 7f3b29600700 1 -- 172.21.15.142:0/831835702 >> 172.21.15.142:0/831835702 conn(0x7f3b240fb0d0 msgr2=0x7f3b240fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:35.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.017+0000 7f3b29600700 1 -- 172.21.15.142:0/831835702 shutdown_connections 2024-04-20T22:07:35.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.017+0000 7f3b29600700 1 -- 172.21.15.142:0/831835702 wait complete. 2024-04-20T22:07:35.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.018+0000 7f3b29600700 1 Processor -- start 2024-04-20T22:07:35.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.018+0000 7f3b29600700 1 -- start start 2024-04-20T22:07:35.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.019+0000 7f3b29600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b24101680 0x7f3b24196640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:35.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.019+0000 7f3b29600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b24103fb0 0x7f3b24196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:35.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.019+0000 7f3b29600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b241971a0 con 0x7f3b24103fb0 2024-04-20T22:07:35.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.019+0000 7f3b29600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b241972e0 con 0x7f3b24101680 2024-04-20T22:07:35.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.019+0000 7f3b1a000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b24103fb0 0x7f3b24196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:35.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.019+0000 7f3b1a000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b24103fb0 0x7f3b24196b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52990/0 (socket says 172.21.15.142:52990) 2024-04-20T22:07:35.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.019+0000 7f3b1a000700 1 -- 172.21.15.142:0/192005905 learned_addr learned my addr 172.21.15.142:0/192005905 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:07:35.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.019+0000 7f3b1a000700 1 -- 172.21.15.142:0/192005905 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b24101680 msgr2=0x7f3b24196640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:35.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.019+0000 7f3b1a000700 1 --2- 172.21.15.142:0/192005905 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b24101680 0x7f3b24196640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:35.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.019+0000 7f3b1a000700 1 -- 172.21.15.142:0/192005905 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b14009d00 con 0x7f3b24103fb0 2024-04-20T22:07:35.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.020+0000 7f3b1a000700 1 --2- 172.21.15.142:0/192005905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b24103fb0 0x7f3b24196b80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00d8d0 tx=0x7f3b0c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:35.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.020+0000 7f3b1be00700 1 -- 172.21.15.142:0/192005905 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b0c009940 con 0x7f3b24103fb0 2024-04-20T22:07:35.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.020+0000 7f3b1be00700 1 -- 172.21.15.142:0/192005905 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b0c010460 con 0x7f3b24103fb0 2024-04-20T22:07:35.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.020+0000 7f3b29600700 1 -- 172.21.15.142:0/192005905 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2419bcf0 con 0x7f3b24103fb0 2024-04-20T22:07:35.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.020+0000 7f3b1be00700 1 -- 172.21.15.142:0/192005905 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b0c00f5f0 con 0x7f3b24103fb0 2024-04-20T22:07:35.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.020+0000 7f3b29600700 1 -- 172.21.15.142:0/192005905 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2419c2c0 con 0x7f3b24103fb0 2024-04-20T22:07:35.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.021+0000 7f3b29600700 1 -- 172.21.15.142:0/192005905 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b24062510 con 0x7f3b24103fb0 2024-04-20T22:07:35.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.022+0000 7f3b1be00700 1 -- 172.21.15.142:0/192005905 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f3b0c0105d0 con 0x7f3b24103fb0 2024-04-20T22:07:35.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.023+0000 7f3b1be00700 1 --2- 172.21.15.142:0/192005905 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3b0806ecc0 0x7f3b08071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:07:35.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.023+0000 7f3b1be00700 1 -- 172.21.15.142:0/192005905 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f3b0c08eee0 con 0x7f3b24103fb0 2024-04-20T22:07:35.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.023+0000 7f3b22a00700 1 --2- 172.21.15.142:0/192005905 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3b0806ecc0 0x7f3b08071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:07:35.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.024+0000 7f3b22a00700 1 --2- 172.21.15.142:0/192005905 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3b0806ecc0 0x7f3b08071180 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3b14015040 tx=0x7f3b140078f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:07:35.028 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.028+0000 7f3b1be00700 1 -- 172.21.15.142:0/192005905 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f3b0c05b6a0 con 0x7f3b24103fb0 2024-04-20T22:07:35.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.358+0000 7f3b29600700 1 -- 172.21.15.142:0/192005905 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3b24109980 con 0x7f3b24103fb0 2024-04-20T22:07:35.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.359+0000 7f3b1be00700 1 -- 172.21.15.142:0/192005905 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3b0c05b230 con 0x7f3b24103fb0 2024-04-20T22:07:35.359 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_OK 2024-04-20T22:07:35.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.362+0000 7f3b29600700 1 -- 172.21.15.142:0/192005905 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3b0806ecc0 msgr2=0x7f3b08071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:35.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.362+0000 7f3b29600700 1 --2- 172.21.15.142:0/192005905 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3b0806ecc0 0x7f3b08071180 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3b14015040 tx=0x7f3b140078f0 comp rx=0 tx=0).stop 2024-04-20T22:07:35.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.362+0000 7f3b29600700 1 -- 172.21.15.142:0/192005905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b24103fb0 msgr2=0x7f3b24196b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:07:35.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.362+0000 7f3b29600700 1 --2- 172.21.15.142:0/192005905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b24103fb0 0x7f3b24196b80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00d8d0 tx=0x7f3b0c00dc90 comp rx=0 tx=0).stop 2024-04-20T22:07:35.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.362+0000 7f3b29600700 1 -- 172.21.15.142:0/192005905 shutdown_connections 2024-04-20T22:07:35.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.362+0000 7f3b29600700 1 --2- 172.21.15.142:0/192005905 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3b0806ecc0 0x7f3b08071180 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:35.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.362+0000 7f3b29600700 1 --2- 172.21.15.142:0/192005905 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b24101680 0x7f3b24196640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:35.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.362+0000 7f3b29600700 1 --2- 172.21.15.142:0/192005905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b24103fb0 0x7f3b24196b80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:07:35.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.362+0000 7f3b29600700 1 -- 172.21.15.142:0/192005905 >> 172.21.15.142:0/192005905 conn(0x7f3b240fb0d0 msgr2=0x7f3b240fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:07:35.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.363+0000 7f3b29600700 1 -- 172.21.15.142:0/192005905 shutdown_connections 2024-04-20T22:07:35.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:07:35.363+0000 7f3b29600700 1 -- 172.21.15.142:0/192005905 wait complete. 2024-04-20T22:07:35.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:35 smithi164 ceph-mon[69784]: from='client.44343 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:07:35.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:35 smithi164 ceph-mon[69784]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-20T22:07:35.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:35 smithi164 ceph-mon[69784]: Cluster is now healthy 2024-04-20T22:07:35.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:35 smithi164 ceph-mon[69784]: mds.? [v2:172.21.15.142:6826/2100080187,v1:172.21.15.142:6827/2100080187] up:active 2024-04-20T22:07:35.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:35 smithi164 ceph-mon[69784]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 3 up:standby 2024-04-20T22:07:35.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:35 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/454405417' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:07:35.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:35 smithi142 ceph-mon[79401]: from='client.44343 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:07:35.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:35 smithi142 ceph-mon[79401]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-20T22:07:35.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:35 smithi142 ceph-mon[79401]: Cluster is now healthy 2024-04-20T22:07:35.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:35 smithi142 ceph-mon[79401]: mds.? [v2:172.21.15.142:6826/2100080187,v1:172.21.15.142:6827/2100080187] up:active 2024-04-20T22:07:35.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:35 smithi142 ceph-mon[79401]: fsmap cephfs:1 {0=cephfs.smithi142.lirkws=up:active} 3 up:standby 2024-04-20T22:07:35.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:35 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/454405417' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:07:36.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:36 smithi164 ceph-mon[69784]: pgmap v258: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 87 B/s wr, 5 op/s 2024-04-20T22:07:36.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:36 smithi164 ceph-mon[69784]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:07:36.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:36 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/192005905' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:07:36.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:36 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:36.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:36 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:36.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:36 smithi142 ceph-mon[79401]: pgmap v258: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 87 B/s wr, 5 op/s 2024-04-20T22:07:36.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:36 smithi142 ceph-mon[79401]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:07:36.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:36 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/192005905' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:07:36.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:36 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:36.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:36 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:38.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:38 smithi164 ceph-mon[69784]: pgmap v259: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-20T22:07:38.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:38 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:38.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:38 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:38.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:38 smithi142 ceph-mon[79401]: pgmap v259: 65 pgs: 65 active+clean; 209 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-20T22:07:38.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:38 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:38.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:38 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:40.357 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:40 smithi164 ceph-mon[69784]: pgmap v260: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 9.5 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-20T22:07:40.498 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:40 smithi142 ceph-mon[79401]: pgmap v260: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 9.5 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-20T22:07:42.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:42 smithi164 ceph-mon[69784]: pgmap v261: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 5.2 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-20T22:07:42.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:42 smithi142 ceph-mon[79401]: pgmap v261: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 5.2 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-20T22:07:44.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: pgmap v262: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 864 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-20T22:07:44.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:44.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:44.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:07:44.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:07:44.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:44.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:07:44.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:44.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:44.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:44.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:44.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:44.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:44.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.lirkws"}]: dispatch 2024-04-20T22:07:44.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.lirkws"}]': finished 2024-04-20T22:07:44.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.lrvfgg"}]: dispatch 2024-04-20T22:07:44.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.lrvfgg"}]': finished 2024-04-20T22:07:44.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi164.gmmrfu"}]: dispatch 2024-04-20T22:07:44.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi164.gmmrfu"}]': finished 2024-04-20T22:07:44.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi164.ybvzha"}]: dispatch 2024-04-20T22:07:44.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi164.ybvzha"}]': finished 2024-04-20T22:07:44.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:44.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:44.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:44.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:44.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:44.591 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: pgmap v262: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 864 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-20T22:07:44.591 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:44.591 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:44.591 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:07:44.591 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:07:44.591 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:44.592 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:07:44.592 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:44.592 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:44.592 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:44.592 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:44.592 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:44.592 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:44.592 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.lirkws"}]: dispatch 2024-04-20T22:07:44.592 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.lirkws"}]': finished 2024-04-20T22:07:44.592 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.lrvfgg"}]: dispatch 2024-04-20T22:07:44.592 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi142.lrvfgg"}]': finished 2024-04-20T22:07:44.592 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi164.gmmrfu"}]: dispatch 2024-04-20T22:07:44.592 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi164.gmmrfu"}]': finished 2024-04-20T22:07:44.592 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi164.ybvzha"}]: dispatch 2024-04-20T22:07:44.593 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi164.ybvzha"}]': finished 2024-04-20T22:07:44.593 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:44.593 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:44.593 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:44.593 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:44.593 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:07:45.647 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:45 smithi142 ceph-mon[79401]: Upgrade: Setting container_image for all mds 2024-04-20T22:07:45.648 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:45 smithi142 ceph-mon[79401]: Upgrade: Setting container_image for all rgw 2024-04-20T22:07:45.648 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:45 smithi142 ceph-mon[79401]: Upgrade: Setting container_image for all rbd-mirror 2024-04-20T22:07:45.648 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:45.648 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:07:45.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:45 smithi164 ceph-mon[69784]: Upgrade: Setting container_image for all mds 2024-04-20T22:07:45.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:45 smithi164 ceph-mon[69784]: Upgrade: Setting container_image for all rgw 2024-04-20T22:07:45.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:45 smithi164 ceph-mon[69784]: Upgrade: Setting container_image for all rbd-mirror 2024-04-20T22:07:45.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:45.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:07:46.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:46 smithi142 ceph-mon[79401]: pgmap v263: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 864 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-20T22:07:46.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:46 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:46.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:46 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-20T22:07:46.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:46 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:07:46.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:46 smithi164 ceph-mon[69784]: pgmap v263: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 864 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-20T22:07:46.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:46 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:46.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:46 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi142", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-20T22:07:46.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:46 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:07:47.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:47 smithi164 ceph-mon[69784]: Upgrade: Updating ceph-exporter.smithi142 (1/2) 2024-04-20T22:07:47.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:47 smithi164 ceph-mon[69784]: Deploying daemon ceph-exporter.smithi142 on smithi142 2024-04-20T22:07:47.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:47 smithi142 ceph-mon[79401]: Upgrade: Updating ceph-exporter.smithi142 (1/2) 2024-04-20T22:07:47.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:47 smithi142 ceph-mon[79401]: Deploying daemon ceph-exporter.smithi142 on smithi142 2024-04-20T22:07:48.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:48 smithi142 ceph-mon[79401]: pgmap v264: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-04-20T22:07:48.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:48 smithi164 ceph-mon[69784]: pgmap v264: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-04-20T22:07:50.546 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:50 smithi142 ceph-mon[79401]: pgmap v265: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4.0 KiB/s wr, 3 op/s 2024-04-20T22:07:50.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:50 smithi164 ceph-mon[69784]: pgmap v265: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 4.0 KiB/s wr, 3 op/s 2024-04-20T22:07:52.668 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:52 smithi164 ceph-mon[69784]: pgmap v266: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:07:52.668 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:52 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:52.668 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:52 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:52.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:52 smithi142 ceph-mon[79401]: pgmap v266: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:07:52.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:52 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:52.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:52 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:54.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:54 smithi164 ceph-mon[69784]: pgmap v267: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:07:54.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:54 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:54.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:54 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi164", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-20T22:07:54.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:54 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:07:54.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:54 smithi142 ceph-mon[79401]: pgmap v267: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:07:54.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:54 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:07:54.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:54 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi164", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-04-20T22:07:54.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:54 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:07:55.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:55 smithi164 ceph-mon[69784]: Upgrade: Updating ceph-exporter.smithi164 (2/2) 2024-04-20T22:07:55.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:55 smithi164 ceph-mon[69784]: Deploying daemon ceph-exporter.smithi164 on smithi164 2024-04-20T22:07:55.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:55 smithi142 ceph-mon[79401]: Upgrade: Updating ceph-exporter.smithi164 (2/2) 2024-04-20T22:07:55.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:55 smithi142 ceph-mon[79401]: Deploying daemon ceph-exporter.smithi164 on smithi164 2024-04-20T22:07:56.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:56 smithi164 ceph-mon[69784]: pgmap v268: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:07:56.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:56 smithi142 ceph-mon[79401]: pgmap v268: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:07:58.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:07:58 smithi142 ceph-mon[79401]: pgmap v269: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:07:58.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:07:58 smithi164 ceph-mon[69784]: pgmap v269: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:00.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:00 smithi142 ceph-mon[79401]: pgmap v270: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:00.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:00 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:00.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:00 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:00.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:00 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:08:00.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:00 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:08:00.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:00 smithi164 ceph-mon[69784]: pgmap v270: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:00.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:00 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:00.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:00 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:00.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:00 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:08:00.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:00 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:08:01.818 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:01 smithi164 ceph-mon[69784]: pgmap v271: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:01.861 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:01 smithi142 ceph-mon[79401]: pgmap v271: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:04.354 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:04 smithi164 ceph-mon[69784]: pgmap v272: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:04.354 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:04 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:04.354 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:04 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:04.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:04 smithi142 ceph-mon[79401]: pgmap v272: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:04.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:04 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:04.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:04 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:05.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.531+0000 7f49cc400700 1 -- 172.21.15.142:0/2694095066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49c4073940 msgr2=0x7f49c4073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:05.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.531+0000 7f49cc400700 1 --2- 172.21.15.142:0/2694095066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49c4073940 0x7f49c4073dc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f49b0009910 tx=0x7f49b0009c20 comp rx=0 tx=0).stop 2024-04-20T22:08:05.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.531+0000 7f49cc400700 1 -- 172.21.15.142:0/2694095066 shutdown_connections 2024-04-20T22:08:05.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.531+0000 7f49cc400700 1 --2- 172.21.15.142:0/2694095066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49c4073940 0x7f49c4073dc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:05.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.531+0000 7f49cc400700 1 --2- 172.21.15.142:0/2694095066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49c4074f10 0x7f49c4073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:05.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.531+0000 7f49cc400700 1 -- 172.21.15.142:0/2694095066 >> 172.21.15.142:0/2694095066 conn(0x7f49c40fc1c0 msgr2=0x7f49c40fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:05.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.532+0000 7f49cc400700 1 -- 172.21.15.142:0/2694095066 shutdown_connections 2024-04-20T22:08:05.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.532+0000 7f49cc400700 1 -- 172.21.15.142:0/2694095066 wait complete. 2024-04-20T22:08:05.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.533+0000 7f49cc400700 1 Processor -- start 2024-04-20T22:08:05.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.533+0000 7f49cc400700 1 -- start start 2024-04-20T22:08:05.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.533+0000 7f49cc400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49c4073940 0x7f49c419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:05.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.533+0000 7f49cc400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49c4074f10 0x7f49c419d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:05.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.534+0000 7f49cc400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c419d780 con 0x7f49c4074f10 2024-04-20T22:08:05.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.534+0000 7f49cc400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c419d8c0 con 0x7f49c4073940 2024-04-20T22:08:05.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.534+0000 7f49c9000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49c4074f10 0x7f49c419d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:05.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.534+0000 7f49c9000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49c4074f10 0x7f49c419d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33320/0 (socket says 172.21.15.142:33320) 2024-04-20T22:08:05.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.534+0000 7f49c9000700 1 -- 172.21.15.142:0/1793894839 learned_addr learned my addr 172.21.15.142:0/1793894839 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:08:05.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.534+0000 7f49c9a00700 1 --2- 172.21.15.142:0/1793894839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49c4073940 0x7f49c419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:05.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.535+0000 7f49c9000700 1 -- 172.21.15.142:0/1793894839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49c4073940 msgr2=0x7f49c419cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:05.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.535+0000 7f49c9000700 1 --2- 172.21.15.142:0/1793894839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49c4073940 0x7f49c419cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:05.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.535+0000 7f49c9000700 1 -- 172.21.15.142:0/1793894839 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b00095f0 con 0x7f49c4074f10 2024-04-20T22:08:05.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.535+0000 7f49c9000700 1 --2- 172.21.15.142:0/1793894839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49c4074f10 0x7f49c419d160 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f49b000bd70 tx=0x7f49b000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:05.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.535+0000 7f49c2000700 1 -- 172.21.15.142:0/1793894839 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b001d070 con 0x7f49c4074f10 2024-04-20T22:08:05.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.535+0000 7f49c2000700 1 -- 172.21.15.142:0/1793894839 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49b0005dc0 con 0x7f49c4074f10 2024-04-20T22:08:05.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.535+0000 7f49cc400700 1 -- 172.21.15.142:0/1793894839 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c41a22c0 con 0x7f49c4074f10 2024-04-20T22:08:05.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.535+0000 7f49c2000700 1 -- 172.21.15.142:0/1793894839 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b0021410 con 0x7f49c4074f10 2024-04-20T22:08:05.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.536+0000 7f49cc400700 1 -- 172.21.15.142:0/1793894839 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c41a2830 con 0x7f49c4074f10 2024-04-20T22:08:05.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.537+0000 7f49cc400700 1 -- 172.21.15.142:0/1793894839 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c4062510 con 0x7f49c4074f10 2024-04-20T22:08:05.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.538+0000 7f49c2000700 1 -- 172.21.15.142:0/1793894839 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f49b000f460 con 0x7f49c4074f10 2024-04-20T22:08:05.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.539+0000 7f49c2000700 1 --2- 172.21.15.142:0/1793894839 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f49ac06ed10 0x7f49ac0711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:05.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.539+0000 7f49c2000700 1 -- 172.21.15.142:0/1793894839 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f49b00902c0 con 0x7f49c4074f10 2024-04-20T22:08:05.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.539+0000 7f49c9a00700 1 --2- 172.21.15.142:0/1793894839 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f49ac06ed10 0x7f49ac0711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:05.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.540+0000 7f49c9a00700 1 --2- 172.21.15.142:0/1793894839 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f49ac06ed10 0x7f49ac0711d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009550 tx=0x7f49b80091b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:05.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.544+0000 7f49c2000700 1 -- 172.21.15.142:0/1793894839 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f49b005ca00 con 0x7f49c4074f10 2024-04-20T22:08:05.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.800+0000 7f49cc400700 1 -- 172.21.15.142:0/1793894839 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49c4103c20 con 0x7f49ac06ed10 2024-04-20T22:08:05.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.802+0000 7f49c2000700 1 -- 172.21.15.142:0/1793894839 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f49c4103c20 con 0x7f49ac06ed10 2024-04-20T22:08:05.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.805+0000 7f49cc400700 1 -- 172.21.15.142:0/1793894839 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f49ac06ed10 msgr2=0x7f49ac0711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:05.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.805+0000 7f49cc400700 1 --2- 172.21.15.142:0/1793894839 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f49ac06ed10 0x7f49ac0711d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009550 tx=0x7f49b80091b0 comp rx=0 tx=0).stop 2024-04-20T22:08:05.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.805+0000 7f49cc400700 1 -- 172.21.15.142:0/1793894839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49c4074f10 msgr2=0x7f49c419d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:05.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.805+0000 7f49cc400700 1 --2- 172.21.15.142:0/1793894839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49c4074f10 0x7f49c419d160 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f49b000bd70 tx=0x7f49b000bda0 comp rx=0 tx=0).stop 2024-04-20T22:08:05.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.805+0000 7f49cc400700 1 -- 172.21.15.142:0/1793894839 shutdown_connections 2024-04-20T22:08:05.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.805+0000 7f49cc400700 1 --2- 172.21.15.142:0/1793894839 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f49ac06ed10 0x7f49ac0711d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:05.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.805+0000 7f49cc400700 1 --2- 172.21.15.142:0/1793894839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f49c4073940 0x7f49c419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:05.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.805+0000 7f49cc400700 1 --2- 172.21.15.142:0/1793894839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49c4074f10 0x7f49c419d160 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:05.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.806+0000 7f49cc400700 1 -- 172.21.15.142:0/1793894839 >> 172.21.15.142:0/1793894839 conn(0x7f49c40fc1c0 msgr2=0x7f49c4102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:05.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.806+0000 7f49cc400700 1 -- 172.21.15.142:0/1793894839 shutdown_connections 2024-04-20T22:08:05.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.806+0000 7f49cc400700 1 -- 172.21.15.142:0/1793894839 wait complete. 2024-04-20T22:08:05.823 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T22:08:05.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.959+0000 7f56f8200700 1 -- 172.21.15.142:0/1111504844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56f0101e10 msgr2=0x7f56f0102270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:05.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.959+0000 7f56f8200700 1 --2- 172.21.15.142:0/1111504844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56f0101e10 0x7f56f0102270 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009910 tx=0x7f56dc009c20 comp rx=0 tx=0).stop 2024-04-20T22:08:05.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.959+0000 7f56f8200700 1 -- 172.21.15.142:0/1111504844 shutdown_connections 2024-04-20T22:08:05.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.959+0000 7f56f8200700 1 --2- 172.21.15.142:0/1111504844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56f0101e10 0x7f56f0102270 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:05.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.959+0000 7f56f8200700 1 --2- 172.21.15.142:0/1111504844 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56f0100c10 0x7f56f0101030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:05.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.959+0000 7f56f8200700 1 -- 172.21.15.142:0/1111504844 >> 172.21.15.142:0/1111504844 conn(0x7f56f00fc1d0 msgr2=0x7f56f00fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:05.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.960+0000 7f56f8200700 1 -- 172.21.15.142:0/1111504844 shutdown_connections 2024-04-20T22:08:05.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.960+0000 7f56f8200700 1 -- 172.21.15.142:0/1111504844 wait complete. 2024-04-20T22:08:05.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.961+0000 7f56f8200700 1 Processor -- start 2024-04-20T22:08:05.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.961+0000 7f56f8200700 1 -- start start 2024-04-20T22:08:05.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.961+0000 7f56f8200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56f0100c10 0x7f56f0198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:05.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.962+0000 7f56f8200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56f0101e10 0x7f56f0198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:05.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.962+0000 7f56f8200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f0199370 con 0x7f56f0101e10 2024-04-20T22:08:05.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.962+0000 7f56f8200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f01994b0 con 0x7f56f0100c10 2024-04-20T22:08:05.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.962+0000 7f56f5800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56f0100c10 0x7f56f0198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:05.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.962+0000 7f56f4e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56f0101e10 0x7f56f0198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:05.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.962+0000 7f56f5800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56f0100c10 0x7f56f0198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.142:37796/0 (socket says 172.21.15.142:37796) 2024-04-20T22:08:05.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.962+0000 7f56f5800700 1 -- 172.21.15.142:0/3101584710 learned_addr learned my addr 172.21.15.142:0/3101584710 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:08:05.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.962+0000 7f56f5800700 1 -- 172.21.15.142:0/3101584710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56f0101e10 msgr2=0x7f56f0198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:05.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.962+0000 7f56f5800700 1 --2- 172.21.15.142:0/3101584710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56f0101e10 0x7f56f0198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:05.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.962+0000 7f56f5800700 1 -- 172.21.15.142:0/3101584710 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc0095f0 con 0x7f56f0100c10 2024-04-20T22:08:05.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.962+0000 7f56f4e00700 1 --2- 172.21.15.142:0/3101584710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56f0101e10 0x7f56f0198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T22:08:05.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.963+0000 7f56f5800700 1 --2- 172.21.15.142:0/3101584710 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56f0100c10 0x7f56f0198810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f56e400d900 tx=0x7f56e400dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.963+0000 7f56ee000700 1 -- 172.21.15.142:0/3101584710 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56e400b920 con 0x7f56f0100c10 2024-04-20T22:08:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.963+0000 7f56ee000700 1 -- 172.21.15.142:0/3101584710 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f56e4010460 con 0x7f56f0100c10 2024-04-20T22:08:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.963+0000 7f56f8200700 1 -- 172.21.15.142:0/3101584710 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f019df10 con 0x7f56f0100c10 2024-04-20T22:08:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.963+0000 7f56ee000700 1 -- 172.21.15.142:0/3101584710 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56e400f590 con 0x7f56f0100c10 2024-04-20T22:08:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.963+0000 7f56f8200700 1 -- 172.21.15.142:0/3101584710 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f019e3d0 con 0x7f56f0100c10 2024-04-20T22:08:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.965+0000 7f56f8200700 1 -- 172.21.15.142:0/3101584710 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f01067e0 con 0x7f56f0100c10 2024-04-20T22:08:05.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.966+0000 7f56ee000700 1 -- 172.21.15.142:0/3101584710 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f56e400ba80 con 0x7f56f0100c10 2024-04-20T22:08:05.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.966+0000 7f56ee000700 1 --2- 172.21.15.142:0/3101584710 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f56d806ecc0 0x7f56d8071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:05.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.967+0000 7f56ee000700 1 -- 172.21.15.142:0/3101584710 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f56e408ec80 con 0x7f56f0100c10 2024-04-20T22:08:05.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.967+0000 7f56f4e00700 1 --2- 172.21.15.142:0/3101584710 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f56d806ecc0 0x7f56d8071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:05.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.967+0000 7f56f4e00700 1 --2- 172.21.15.142:0/3101584710 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f56d806ecc0 0x7f56d8071180 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009fd0 tx=0x7f56dc005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:05.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:05.975+0000 7f56ee000700 1 -- 172.21.15.142:0/3101584710 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f56e405b3c0 con 0x7f56f0100c10 2024-04-20T22:08:06.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.243+0000 7f56f8200700 1 -- 172.21.15.142:0/3101584710 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f56f002ceb0 con 0x7f56d806ecc0 2024-04-20T22:08:06.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.245+0000 7f56ee000700 1 -- 172.21.15.142:0/3101584710 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f56f002ceb0 con 0x7f56d806ecc0 2024-04-20T22:08:06.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.248+0000 7f56f8200700 1 -- 172.21.15.142:0/3101584710 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f56d806ecc0 msgr2=0x7f56d8071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:06.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.248+0000 7f56f8200700 1 --2- 172.21.15.142:0/3101584710 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f56d806ecc0 0x7f56d8071180 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009fd0 tx=0x7f56dc005960 comp rx=0 tx=0).stop 2024-04-20T22:08:06.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.248+0000 7f56f8200700 1 -- 172.21.15.142:0/3101584710 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56f0100c10 msgr2=0x7f56f0198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:06.248 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.248+0000 7f56f8200700 1 --2- 172.21.15.142:0/3101584710 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56f0100c10 0x7f56f0198810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f56e400d900 tx=0x7f56e400dc10 comp rx=0 tx=0).stop 2024-04-20T22:08:06.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.249+0000 7f56f8200700 1 -- 172.21.15.142:0/3101584710 shutdown_connections 2024-04-20T22:08:06.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.249+0000 7f56f8200700 1 --2- 172.21.15.142:0/3101584710 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f56d806ecc0 0x7f56d8071180 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:06.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.249+0000 7f56f8200700 1 --2- 172.21.15.142:0/3101584710 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56f0100c10 0x7f56f0198810 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:06.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.249+0000 7f56f8200700 1 --2- 172.21.15.142:0/3101584710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56f0101e10 0x7f56f0198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:06.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.249+0000 7f56f8200700 1 -- 172.21.15.142:0/3101584710 >> 172.21.15.142:0/3101584710 conn(0x7f56f00fc1d0 msgr2=0x7f56f0073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:06.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.249+0000 7f56f8200700 1 -- 172.21.15.142:0/3101584710 shutdown_connections 2024-04-20T22:08:06.249 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.249+0000 7f56f8200700 1 -- 172.21.15.142:0/3101584710 wait complete. 2024-04-20T22:08:06.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.403+0000 7fa91da00700 1 -- 172.21.15.142:0/2343502048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa918101e00 msgr2=0x7fa918102260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:06.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.403+0000 7fa91da00700 1 --2- 172.21.15.142:0/2343502048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa918101e00 0x7fa918102260 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa904009910 tx=0x7fa904009c20 comp rx=0 tx=0).stop 2024-04-20T22:08:06.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.403+0000 7fa91da00700 1 -- 172.21.15.142:0/2343502048 shutdown_connections 2024-04-20T22:08:06.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.403+0000 7fa91da00700 1 --2- 172.21.15.142:0/2343502048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa918101e00 0x7fa918102260 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:06.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.403+0000 7fa91da00700 1 --2- 172.21.15.142:0/2343502048 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa918100c00 0x7fa918101020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:06.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.403+0000 7fa91da00700 1 -- 172.21.15.142:0/2343502048 >> 172.21.15.142:0/2343502048 conn(0x7fa9180fc1c0 msgr2=0x7fa9180fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:06.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.403+0000 7fa91da00700 1 -- 172.21.15.142:0/2343502048 shutdown_connections 2024-04-20T22:08:06.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.403+0000 7fa91da00700 1 -- 172.21.15.142:0/2343502048 wait complete. 2024-04-20T22:08:06.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.404+0000 7fa91da00700 1 Processor -- start 2024-04-20T22:08:06.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.404+0000 7fa91da00700 1 -- start start 2024-04-20T22:08:06.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.404+0000 7fa91da00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa918100c00 0x7fa918198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:06.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.404+0000 7fa91da00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa918101e00 0x7fa918198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:06.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.404+0000 7fa91da00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa918199380 con 0x7fa918100c00 2024-04-20T22:08:06.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.404+0000 7fa91da00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9181994c0 con 0x7fa918101e00 2024-04-20T22:08:06.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.405+0000 7fa916a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa918100c00 0x7fa918198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:06.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.405+0000 7fa916a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa918100c00 0x7fa918198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33344/0 (socket says 172.21.15.142:33344) 2024-04-20T22:08:06.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.405+0000 7fa916a00700 1 -- 172.21.15.142:0/999193461 learned_addr learned my addr 172.21.15.142:0/999193461 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:08:06.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.405+0000 7fa916000700 1 --2- 172.21.15.142:0/999193461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa918101e00 0x7fa918198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:06.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.405+0000 7fa916a00700 1 -- 172.21.15.142:0/999193461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa918101e00 msgr2=0x7fa918198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:06.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.405+0000 7fa916a00700 1 --2- 172.21.15.142:0/999193461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa918101e00 0x7fa918198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:06.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.405+0000 7fa916a00700 1 -- 172.21.15.142:0/999193461 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9040095f0 con 0x7fa918100c00 2024-04-20T22:08:06.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.405+0000 7fa916000700 1 --2- 172.21.15.142:0/999193461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa918101e00 0x7fa918198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:08:06.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.406+0000 7fa916a00700 1 --2- 172.21.15.142:0/999193461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa918100c00 0x7fa918198820 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa90800c8f0 tx=0x7fa90800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:06.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.406+0000 7fa90f400700 1 -- 172.21.15.142:0/999193461 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa908007a70 con 0x7fa918100c00 2024-04-20T22:08:06.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.406+0000 7fa91da00700 1 -- 172.21.15.142:0/999193461 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91819df20 con 0x7fa918100c00 2024-04-20T22:08:06.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.406+0000 7fa90f400700 1 -- 172.21.15.142:0/999193461 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa908007bd0 con 0x7fa918100c00 2024-04-20T22:08:06.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.406+0000 7fa90f400700 1 -- 172.21.15.142:0/999193461 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa908018630 con 0x7fa918100c00 2024-04-20T22:08:06.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.406+0000 7fa91da00700 1 -- 172.21.15.142:0/999193461 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91819e460 con 0x7fa918100c00 2024-04-20T22:08:06.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.407+0000 7fa91da00700 1 -- 172.21.15.142:0/999193461 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9181067d0 con 0x7fa918100c00 2024-04-20T22:08:06.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.408+0000 7fa90f400700 1 -- 172.21.15.142:0/999193461 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fa90800f450 con 0x7fa918100c00 2024-04-20T22:08:06.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.410+0000 7fa90f400700 1 --2- 172.21.15.142:0/999193461 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa8fc06ecc0 0x7fa8fc071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:06.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.410+0000 7fa90f400700 1 -- 172.21.15.142:0/999193461 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fa90808eff0 con 0x7fa918100c00 2024-04-20T22:08:06.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.410+0000 7fa916000700 1 --2- 172.21.15.142:0/999193461 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa8fc06ecc0 0x7fa8fc071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:06.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.411+0000 7fa916000700 1 --2- 172.21.15.142:0/999193461 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa8fc06ecc0 0x7fa8fc071180 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa90400b5c0 tx=0x7fa904005160 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:06.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.414+0000 7fa90f400700 1 -- 172.21.15.142:0/999193461 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fa9080c3ff0 con 0x7fa918100c00 2024-04-20T22:08:06.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:06 smithi164 ceph-mon[69784]: pgmap v273: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:06.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:06.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:06.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:06.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:06.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.660+0000 7fa91da00700 1 -- 172.21.15.142:0/999193461 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa91802ce50 con 0x7fa8fc06ecc0 2024-04-20T22:08:06.661 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:06 smithi142 ceph-mon[79401]: pgmap v273: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:06.661 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:06.661 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:06.661 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:06.661 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:06.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.679+0000 7fa90f400700 1 -- 172.21.15.142:0/999193461 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fa91802ce50 con 0x7fa8fc06ecc0 2024-04-20T22:08:06.679 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:08:06.679 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (18m) 0s ago 20m 14.3M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T22:08:06.679 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (15s) 0s ago 21m 7763k - 19.0.0-3133-ga8c84f59 76bc6b91b726 eadbb8123608 2024-04-20T22:08:06.679 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (7s) 3s ago 19m 7293k - 19.0.0-3133-ga8c84f59 76bc6b91b726 13030cc1a7a8 2024-04-20T22:08:06.679 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (6m) 0s ago 20m 6665k - 19.0.0-3133-ga8c84f59 76bc6b91b726 64521ed7125b 2024-04-20T22:08:06.679 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (6m) 3s ago 19m 6656k - 19.0.0-3133-ga8c84f59 76bc6b91b726 893c6f16ee6d 2024-04-20T22:08:06.679 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (18m) 0s ago 20m 75.1M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T22:08:06.679 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (2m) 0s ago 13m 86.9M - 19.0.0-3133-ga8c84f59 76bc6b91b726 603d9ff4accc 2024-04-20T22:08:06.680 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (95s) 0s ago 13m 12.4M - 19.0.0-3133-ga8c84f59 76bc6b91b726 5fbbe225e911 2024-04-20T22:08:06.680 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (36s) 3s ago 13m 12.0M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3ee3d509a48c 2024-04-20T22:08:06.680 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (66s) 3s ago 13m 12.2M - 19.0.0-3133-ga8c84f59 76bc6b91b726 44901e1ad990 2024-04-20T22:08:06.680 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (9m) 0s ago 22m 512M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:08:06.680 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (8m) 3s ago 19m 454M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:08:06.680 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (8m) 0s ago 22m 57.7M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 af10a542c918 2024-04-20T22:08:06.680 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (7m) 3s ago 19m 42.3M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 133512694d46 2024-04-20T22:08:06.680 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (20m) 0s ago 20m 8514k - 1.5.0 0da6a335fe13 7b54455f39e9 2024-04-20T22:08:06.680 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (19m) 3s ago 19m 8112k - 1.5.0 0da6a335fe13 d894b9107322 2024-04-20T22:08:06.680 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (5m) 0s ago 18m 107M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 b7206d05a7cd 2024-04-20T22:08:06.680 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (5m) 0s ago 17m 107M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 82bcc0c46762 2024-04-20T22:08:06.680 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (4m) 0s ago 17m 94.2M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 3e2d91f49494 2024-04-20T22:08:06.680 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (4m) 3s ago 16m 119M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 a898b8b77c51 2024-04-20T22:08:06.680 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (3m) 3s ago 15m 103M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 539c4026f9fb 2024-04-20T22:08:06.680 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (2m) 3s ago 15m 95.6M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 ac1bdd69c944 2024-04-20T22:08:06.681 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (8m) 0s ago 20m 78.7M - 2.43.0 a07b618ecd1d 46b76c20eae5 2024-04-20T22:08:06.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.681+0000 7fa91da00700 1 -- 172.21.15.142:0/999193461 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa8fc06ecc0 msgr2=0x7fa8fc071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:06.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.681+0000 7fa91da00700 1 --2- 172.21.15.142:0/999193461 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa8fc06ecc0 0x7fa8fc071180 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa90400b5c0 tx=0x7fa904005160 comp rx=0 tx=0).stop 2024-04-20T22:08:06.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.681+0000 7fa91da00700 1 -- 172.21.15.142:0/999193461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa918100c00 msgr2=0x7fa918198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:06.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.681+0000 7fa91da00700 1 --2- 172.21.15.142:0/999193461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa918100c00 0x7fa918198820 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa90800c8f0 tx=0x7fa90800ccb0 comp rx=0 tx=0).stop 2024-04-20T22:08:06.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.682+0000 7fa91da00700 1 -- 172.21.15.142:0/999193461 shutdown_connections 2024-04-20T22:08:06.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.682+0000 7fa91da00700 1 --2- 172.21.15.142:0/999193461 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa8fc06ecc0 0x7fa8fc071180 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:06.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.682+0000 7fa91da00700 1 --2- 172.21.15.142:0/999193461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa918100c00 0x7fa918198820 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:06.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.682+0000 7fa91da00700 1 --2- 172.21.15.142:0/999193461 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa918101e00 0x7fa918198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:06.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.682+0000 7fa91da00700 1 -- 172.21.15.142:0/999193461 >> 172.21.15.142:0/999193461 conn(0x7fa9180fc1c0 msgr2=0x7fa918073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:06.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.683+0000 7fa91da00700 1 -- 172.21.15.142:0/999193461 shutdown_connections 2024-04-20T22:08:06.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.683+0000 7fa91da00700 1 -- 172.21.15.142:0/999193461 wait complete. 2024-04-20T22:08:06.826 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.826+0000 7f2969600700 1 -- 172.21.15.142:0/4964907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2964073940 msgr2=0x7f2964073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:06.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.826+0000 7f2969600700 1 --2- 172.21.15.142:0/4964907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2964073940 0x7f2964073dc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2950009910 tx=0x7f2950009c20 comp rx=0 tx=0).stop 2024-04-20T22:08:06.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.826+0000 7f2969600700 1 -- 172.21.15.142:0/4964907 shutdown_connections 2024-04-20T22:08:06.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.826+0000 7f2969600700 1 --2- 172.21.15.142:0/4964907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2964073940 0x7f2964073dc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:06.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.826+0000 7f2969600700 1 --2- 172.21.15.142:0/4964907 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2964074f10 0x7f2964073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:06.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.826+0000 7f2969600700 1 -- 172.21.15.142:0/4964907 >> 172.21.15.142:0/4964907 conn(0x7f29640fc1c0 msgr2=0x7f29640fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:06.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.827+0000 7f2969600700 1 -- 172.21.15.142:0/4964907 shutdown_connections 2024-04-20T22:08:06.827 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.827+0000 7f2969600700 1 -- 172.21.15.142:0/4964907 wait complete. 2024-04-20T22:08:06.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.828+0000 7f2969600700 1 Processor -- start 2024-04-20T22:08:06.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.828+0000 7f2969600700 1 -- start start 2024-04-20T22:08:06.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.828+0000 7f2969600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2964073940 0x7f29641989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:06.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.828+0000 7f2969600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2964074f10 0x7f2964198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:06.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.828+0000 7f2969600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2964199510 con 0x7f2964074f10 2024-04-20T22:08:06.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.828+0000 7f2969600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2964199650 con 0x7f2964073940 2024-04-20T22:08:06.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.828+0000 7f2962000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2964074f10 0x7f2964198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:06.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.828+0000 7f2962000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2964074f10 0x7f2964198ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33364/0 (socket says 172.21.15.142:33364) 2024-04-20T22:08:06.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.828+0000 7f2962000700 1 -- 172.21.15.142:0/1330949052 learned_addr learned my addr 172.21.15.142:0/1330949052 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:08:06.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.828+0000 7f2962a00700 1 --2- 172.21.15.142:0/1330949052 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2964073940 0x7f29641989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:06.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.829+0000 7f2962000700 1 -- 172.21.15.142:0/1330949052 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2964073940 msgr2=0x7f29641989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:06.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.829+0000 7f2962000700 1 --2- 172.21.15.142:0/1330949052 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2964073940 0x7f29641989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:06.829 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.829+0000 7f2962000700 1 -- 172.21.15.142:0/1330949052 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29500095f0 con 0x7f2964074f10 2024-04-20T22:08:06.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.829+0000 7f2962000700 1 --2- 172.21.15.142:0/1330949052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2964074f10 0x7f2964198ef0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f29500059d0 tx=0x7f295000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:06.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.829+0000 7f295b400700 1 -- 172.21.15.142:0/1330949052 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f295001d070 con 0x7f2964074f10 2024-04-20T22:08:06.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.830+0000 7f295b400700 1 -- 172.21.15.142:0/1330949052 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f295000f460 con 0x7f2964074f10 2024-04-20T22:08:06.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.830+0000 7f2969600700 1 -- 172.21.15.142:0/1330949052 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296419e000 con 0x7f2964074f10 2024-04-20T22:08:06.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.830+0000 7f295b400700 1 -- 172.21.15.142:0/1330949052 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2950021640 con 0x7f2964074f10 2024-04-20T22:08:06.830 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.830+0000 7f2969600700 1 -- 172.21.15.142:0/1330949052 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296419e570 con 0x7f2964074f10 2024-04-20T22:08:06.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.831+0000 7f2969600700 1 -- 172.21.15.142:0/1330949052 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2964192a30 con 0x7f2964074f10 2024-04-20T22:08:06.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.832+0000 7f295b400700 1 -- 172.21.15.142:0/1330949052 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f295000f5d0 con 0x7f2964074f10 2024-04-20T22:08:06.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.833+0000 7f295b400700 1 --2- 172.21.15.142:0/1330949052 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f294806ecc0 0x7f2948071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:06.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.833+0000 7f295b400700 1 -- 172.21.15.142:0/1330949052 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f2950090310 con 0x7f2964074f10 2024-04-20T22:08:06.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.833+0000 7f2962a00700 1 --2- 172.21.15.142:0/1330949052 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f294806ecc0 0x7f2948071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:06.833 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.834+0000 7f2962a00700 1 --2- 172.21.15.142:0/1330949052 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f294806ecc0 0x7f2948071180 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f29640752f0 tx=0x7f2954009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:06.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:06.846+0000 7f295b400700 1 -- 172.21.15.142:0/1330949052 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f295005ca50 con 0x7f2964074f10 2024-04-20T22:08:07.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.190+0000 7f2969600700 1 -- 172.21.15.142:0/1330949052 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2964062510 con 0x7f2964074f10 2024-04-20T22:08:07.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.191+0000 7f295b400700 1 -- 172.21.15.142:0/1330949052 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f295005c5e0 con 0x7f2964074f10 2024-04-20T22:08:07.190 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:08:07.190 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:08:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:08:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:08:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:08:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:08:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:08:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:08:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 6 2024-04-20T22:08:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:08:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:08:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 4 2024-04-20T22:08:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:08:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:08:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 14 2024-04-20T22:08:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:08:07.192 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:08:07.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.193+0000 7f2969600700 1 -- 172.21.15.142:0/1330949052 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f294806ecc0 msgr2=0x7f2948071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:07.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.193+0000 7f2969600700 1 --2- 172.21.15.142:0/1330949052 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f294806ecc0 0x7f2948071180 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f29640752f0 tx=0x7f2954009190 comp rx=0 tx=0).stop 2024-04-20T22:08:07.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.193+0000 7f2969600700 1 -- 172.21.15.142:0/1330949052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2964074f10 msgr2=0x7f2964198ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:07.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.193+0000 7f2969600700 1 --2- 172.21.15.142:0/1330949052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2964074f10 0x7f2964198ef0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f29500059d0 tx=0x7f295000bd70 comp rx=0 tx=0).stop 2024-04-20T22:08:07.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.193+0000 7f2969600700 1 -- 172.21.15.142:0/1330949052 shutdown_connections 2024-04-20T22:08:07.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.193+0000 7f2969600700 1 --2- 172.21.15.142:0/1330949052 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f294806ecc0 0x7f2948071180 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:07.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.193+0000 7f2969600700 1 --2- 172.21.15.142:0/1330949052 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2964073940 0x7f29641989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:07.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.193+0000 7f2969600700 1 --2- 172.21.15.142:0/1330949052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2964074f10 0x7f2964198ef0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:07.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.193+0000 7f2969600700 1 -- 172.21.15.142:0/1330949052 >> 172.21.15.142:0/1330949052 conn(0x7f29640fc1c0 msgr2=0x7f2964106ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:07.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.194+0000 7f2969600700 1 -- 172.21.15.142:0/1330949052 shutdown_connections 2024-04-20T22:08:07.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.194+0000 7f2969600700 1 -- 172.21.15.142:0/1330949052 wait complete. 2024-04-20T22:08:07.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.352+0000 7eff3c400700 1 -- 172.21.15.142:0/3598774195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff34073940 msgr2=0x7eff34073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:07.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.352+0000 7eff3c400700 1 --2- 172.21.15.142:0/3598774195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff34073940 0x7eff34073dc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7eff24009910 tx=0x7eff24009c20 comp rx=0 tx=0).stop 2024-04-20T22:08:07.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.352+0000 7eff3c400700 1 -- 172.21.15.142:0/3598774195 shutdown_connections 2024-04-20T22:08:07.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.352+0000 7eff3c400700 1 --2- 172.21.15.142:0/3598774195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff34073940 0x7eff34073dc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:07.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.352+0000 7eff3c400700 1 --2- 172.21.15.142:0/3598774195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff34074f10 0x7eff34073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:07.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.352+0000 7eff3c400700 1 -- 172.21.15.142:0/3598774195 >> 172.21.15.142:0/3598774195 conn(0x7eff340fc1c0 msgr2=0x7eff340fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:07.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.352+0000 7eff3c400700 1 -- 172.21.15.142:0/3598774195 shutdown_connections 2024-04-20T22:08:07.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.352+0000 7eff3c400700 1 -- 172.21.15.142:0/3598774195 wait complete. 2024-04-20T22:08:07.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.353+0000 7eff3c400700 1 Processor -- start 2024-04-20T22:08:07.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.353+0000 7eff3c400700 1 -- start start 2024-04-20T22:08:07.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.353+0000 7eff3c400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff34073940 0x7eff34198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:07.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.353+0000 7eff3c400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff34074f10 0x7eff34198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:07.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.353+0000 7eff3c400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff34199380 con 0x7eff34074f10 2024-04-20T22:08:07.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.353+0000 7eff3c400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff341994c0 con 0x7eff34073940 2024-04-20T22:08:07.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.354+0000 7eff39000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff34074f10 0x7eff34198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:07.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.354+0000 7eff39000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff34074f10 0x7eff34198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60032/0 (socket says 172.21.15.142:60032) 2024-04-20T22:08:07.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.354+0000 7eff39000700 1 -- 172.21.15.142:0/2600565135 learned_addr learned my addr 172.21.15.142:0/2600565135 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:08:07.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.354+0000 7eff39a00700 1 --2- 172.21.15.142:0/2600565135 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff34073940 0x7eff34198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:07.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.354+0000 7eff39000700 1 -- 172.21.15.142:0/2600565135 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff34073940 msgr2=0x7eff34198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:07.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.354+0000 7eff39000700 1 --2- 172.21.15.142:0/2600565135 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff34073940 0x7eff34198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:07.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.354+0000 7eff39000700 1 -- 172.21.15.142:0/2600565135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff240095f0 con 0x7eff34074f10 2024-04-20T22:08:07.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.354+0000 7eff39000700 1 --2- 172.21.15.142:0/2600565135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff34074f10 0x7eff34198d60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7eff240059d0 tx=0x7eff2400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:07.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.355+0000 7eff32000700 1 -- 172.21.15.142:0/2600565135 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff2401d070 con 0x7eff34074f10 2024-04-20T22:08:07.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.355+0000 7eff32000700 1 -- 172.21.15.142:0/2600565135 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff2400f460 con 0x7eff34074f10 2024-04-20T22:08:07.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.355+0000 7eff32000700 1 -- 172.21.15.142:0/2600565135 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff24021640 con 0x7eff34074f10 2024-04-20T22:08:07.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.355+0000 7eff3c400700 1 -- 172.21.15.142:0/2600565135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3419dec0 con 0x7eff34074f10 2024-04-20T22:08:07.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.355+0000 7eff3c400700 1 -- 172.21.15.142:0/2600565135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3419e3b0 con 0x7eff34074f10 2024-04-20T22:08:07.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.356+0000 7eff3c400700 1 -- 172.21.15.142:0/2600565135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff341929b0 con 0x7eff34074f10 2024-04-20T22:08:07.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.357+0000 7eff32000700 1 -- 172.21.15.142:0/2600565135 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7eff2400f5d0 con 0x7eff34074f10 2024-04-20T22:08:07.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.358+0000 7eff32000700 1 --2- 172.21.15.142:0/2600565135 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7eff1c06ecc0 0x7eff1c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:07.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.358+0000 7eff32000700 1 -- 172.21.15.142:0/2600565135 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7eff240901d0 con 0x7eff34074f10 2024-04-20T22:08:07.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.359+0000 7eff39a00700 1 --2- 172.21.15.142:0/2600565135 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7eff1c06ecc0 0x7eff1c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:07.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.359+0000 7eff39a00700 1 --2- 172.21.15.142:0/2600565135 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7eff1c06ecc0 0x7eff1c071180 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7eff28005950 tx=0x7eff2800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:07.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.363+0000 7eff32000700 1 -- 172.21.15.142:0/2600565135 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7eff2405c9b0 con 0x7eff34074f10 2024-04-20T22:08:07.537 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:07 smithi164 ceph-mon[69784]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:08:07.537 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:07 smithi164 ceph-mon[69784]: from='client.44363 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:08:07.537 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:07 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/1330949052' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:07.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.638+0000 7eff3c400700 1 -- 172.21.15.142:0/2600565135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7eff34062510 con 0x7eff34074f10 2024-04-20T22:08:07.639 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:07 smithi142 ceph-mon[79401]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:08:07.639 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:07 smithi142 ceph-mon[79401]: from='client.44363 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:08:07.639 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:07 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1330949052' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:07.639 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.639+0000 7eff32000700 1 -- 172.21.15.142:0/2600565135 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1957 (secure 0 0 0) 0x7eff2405c540 con 0x7eff34074f10 2024-04-20T22:08:07.639 INFO:teuthology.orchestra.run.smithi142.stdout:e35 2024-04-20T22:08:07.639 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:08:07.639 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:08:07.640 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T22:08:07.640 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:08:07.640 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T22:08:07.640 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T22:08:07.640 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 35 2024-04-20T22:08:07.640 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:08:07.640 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:08:07.640 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T22:07:34.267651+0000 2024-04-20T22:08:07.640 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T22:08:07.640 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T22:08:07.640 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T22:08:07.640 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T22:08:07.640 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T22:08:07.640 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T22:08:07.641 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T22:08:07.641 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T22:08:07.641 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 85 2024-04-20T22:08:07.641 INFO:teuthology.orchestra.run.smithi142.stdout:snap_rstat 1 2024-04-20T22:08:07.641 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-20T22:08:07.641 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T22:08:07.641 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T22:08:07.641 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=34454} 2024-04-20T22:08:07.641 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T22:08:07.641 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T22:08:07.641 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T22:08:07.641 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T22:08:07.641 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T22:08:07.641 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T22:08:07.641 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T22:08:07.642 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T22:08:07.642 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T22:08:07.642 INFO:teuthology.orchestra.run.smithi142.stdout:qdb_cluster leader: 34454 members: 34454 2024-04-20T22:08:07.642 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:34454} state up:active seq 26 join_fscid=1 addr [v2:172.21.15.142:6826/2100080187,v1:172.21.15.142:6827/2100080187] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:08:07.642 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:08:07.642 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:08:07.642 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T22:08:07.642 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:08:07.642 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:34486} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6828/2960234081,v1:172.21.15.142:6829/2960234081] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:08:07.642 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.164:6824/1951894011,v1:172.21.15.164:6825/1951894011] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:08:07.642 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.164:6826/3399966592,v1:172.21.15.164:6827/3399966592] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:08:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.642+0000 7eff3c400700 1 -- 172.21.15.142:0/2600565135 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7eff1c06ecc0 msgr2=0x7eff1c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.642+0000 7eff3c400700 1 --2- 172.21.15.142:0/2600565135 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7eff1c06ecc0 0x7eff1c071180 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7eff28005950 tx=0x7eff2800b410 comp rx=0 tx=0).stop 2024-04-20T22:08:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.642+0000 7eff3c400700 1 -- 172.21.15.142:0/2600565135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff34074f10 msgr2=0x7eff34198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.642+0000 7eff3c400700 1 --2- 172.21.15.142:0/2600565135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff34074f10 0x7eff34198d60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7eff240059d0 tx=0x7eff2400bd70 comp rx=0 tx=0).stop 2024-04-20T22:08:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.643+0000 7eff3c400700 1 -- 172.21.15.142:0/2600565135 shutdown_connections 2024-04-20T22:08:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.643+0000 7eff3c400700 1 --2- 172.21.15.142:0/2600565135 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7eff1c06ecc0 0x7eff1c071180 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.643+0000 7eff3c400700 1 --2- 172.21.15.142:0/2600565135 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff34073940 0x7eff34198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.643+0000 7eff3c400700 1 --2- 172.21.15.142:0/2600565135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff34074f10 0x7eff34198d60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.643+0000 7eff3c400700 1 -- 172.21.15.142:0/2600565135 >> 172.21.15.142:0/2600565135 conn(0x7eff340fc1c0 msgr2=0x7eff34106dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:07.643 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.643+0000 7eff3c400700 1 -- 172.21.15.142:0/2600565135 shutdown_connections 2024-04-20T22:08:07.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.643+0000 7eff3c400700 1 -- 172.21.15.142:0/2600565135 wait complete. 2024-04-20T22:08:07.644 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 35 2024-04-20T22:08:07.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.799+0000 7fe830a00700 1 -- 172.21.15.142:0/4154235855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe82c103fe0 msgr2=0x7fe82c1063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:07.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.799+0000 7fe830a00700 1 --2- 172.21.15.142:0/4154235855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe82c103fe0 0x7fe82c1063d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe818009910 tx=0x7fe818009c20 comp rx=0 tx=0).stop 2024-04-20T22:08:07.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.799+0000 7fe830a00700 1 -- 172.21.15.142:0/4154235855 shutdown_connections 2024-04-20T22:08:07.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.799+0000 7fe830a00700 1 --2- 172.21.15.142:0/4154235855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe82c103fe0 0x7fe82c1063d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:07.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.799+0000 7fe830a00700 1 --2- 172.21.15.142:0/4154235855 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe82c1016b0 0x7fe82c103aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:07.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.799+0000 7fe830a00700 1 -- 172.21.15.142:0/4154235855 >> 172.21.15.142:0/4154235855 conn(0x7fe82c0fb0c0 msgr2=0x7fe82c0fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:07.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.799+0000 7fe830a00700 1 -- 172.21.15.142:0/4154235855 shutdown_connections 2024-04-20T22:08:07.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.799+0000 7fe830a00700 1 -- 172.21.15.142:0/4154235855 wait complete. 2024-04-20T22:08:07.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.800+0000 7fe830a00700 1 Processor -- start 2024-04-20T22:08:07.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.801+0000 7fe830a00700 1 -- start start 2024-04-20T22:08:07.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.801+0000 7fe830a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe82c1016b0 0x7fe82c100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:07.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.801+0000 7fe830a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe82c103fe0 0x7fe82c0ff660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:07.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.801+0000 7fe830a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0ffba0 con 0x7fe82c103fe0 2024-04-20T22:08:07.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.801+0000 7fe830a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0ffce0 con 0x7fe82c1016b0 2024-04-20T22:08:07.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.801+0000 7fe829400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe82c103fe0 0x7fe82c0ff660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:07.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.801+0000 7fe829400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe82c103fe0 0x7fe82c0ff660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60050/0 (socket says 172.21.15.142:60050) 2024-04-20T22:08:07.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.801+0000 7fe829400700 1 -- 172.21.15.142:0/1388545232 learned_addr learned my addr 172.21.15.142:0/1388545232 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:08:07.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.802+0000 7fe829e00700 1 --2- 172.21.15.142:0/1388545232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe82c1016b0 0x7fe82c100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:07.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.802+0000 7fe829400700 1 -- 172.21.15.142:0/1388545232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe82c1016b0 msgr2=0x7fe82c100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:07.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.802+0000 7fe829400700 1 --2- 172.21.15.142:0/1388545232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe82c1016b0 0x7fe82c100f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:07.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.802+0000 7fe829400700 1 -- 172.21.15.142:0/1388545232 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8180095f0 con 0x7fe82c103fe0 2024-04-20T22:08:07.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.802+0000 7fe829400700 1 --2- 172.21.15.142:0/1388545232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe82c103fe0 0x7fe82c0ff660 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe818006010 tx=0x7fe81800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:07.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.802+0000 7fe822a00700 1 -- 172.21.15.142:0/1388545232 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe81801d070 con 0x7fe82c103fe0 2024-04-20T22:08:07.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.802+0000 7fe822a00700 1 -- 172.21.15.142:0/1388545232 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe81800f460 con 0x7fe82c103fe0 2024-04-20T22:08:07.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.803+0000 7fe830a00700 1 -- 172.21.15.142:0/1388545232 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82c0fff60 con 0x7fe82c103fe0 2024-04-20T22:08:07.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.803+0000 7fe822a00700 1 -- 172.21.15.142:0/1388545232 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe818021640 con 0x7fe82c103fe0 2024-04-20T22:08:07.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.803+0000 7fe830a00700 1 -- 172.21.15.142:0/1388545232 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82c1004d0 con 0x7fe82c103fe0 2024-04-20T22:08:07.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.804+0000 7fe830a00700 1 -- 172.21.15.142:0/1388545232 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82c04ebb0 con 0x7fe82c103fe0 2024-04-20T22:08:07.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.805+0000 7fe822a00700 1 -- 172.21.15.142:0/1388545232 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fe81800fab0 con 0x7fe82c103fe0 2024-04-20T22:08:07.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.806+0000 7fe822a00700 1 --2- 172.21.15.142:0/1388545232 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe81006ecd0 0x7fe810071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:07.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.806+0000 7fe822a00700 1 -- 172.21.15.142:0/1388545232 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fe8180900f0 con 0x7fe82c103fe0 2024-04-20T22:08:07.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.806+0000 7fe829e00700 1 --2- 172.21.15.142:0/1388545232 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe81006ecd0 0x7fe810071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:07.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.807+0000 7fe829e00700 1 --2- 172.21.15.142:0/1388545232 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe81006ecd0 0x7fe810071190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe81c006fd0 tx=0x7fe81c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:07.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:07.810+0000 7fe822a00700 1 -- 172.21.15.142:0/1388545232 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fe81805c8b0 con 0x7fe82c103fe0 2024-04-20T22:08:08.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.062+0000 7fe830a00700 1 -- 172.21.15.142:0/1388545232 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe82c1004d0 con 0x7fe81006ecd0 2024-04-20T22:08:08.063 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.064+0000 7fe822a00700 1 -- 172.21.15.142:0/1388545232 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7fe82c1004d0 con 0x7fe81006ecd0 2024-04-20T22:08:08.064 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:08:08.064 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T22:08:08.064 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T22:08:08.064 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T22:08:08.064 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T22:08:08.064 INFO:teuthology.orchestra.run.smithi142.stdout: "mon", 2024-04-20T22:08:08.064 INFO:teuthology.orchestra.run.smithi142.stdout: "mds", 2024-04-20T22:08:08.064 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr", 2024-04-20T22:08:08.064 INFO:teuthology.orchestra.run.smithi142.stdout: "osd", 2024-04-20T22:08:08.065 INFO:teuthology.orchestra.run.smithi142.stdout: "crash", 2024-04-20T22:08:08.065 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph-exporter" 2024-04-20T22:08:08.065 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T22:08:08.065 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "18/23 daemons upgraded", 2024-04-20T22:08:08.065 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-04-20T22:08:08.065 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T22:08:08.065 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:08:08.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.066+0000 7fe830a00700 1 -- 172.21.15.142:0/1388545232 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe81006ecd0 msgr2=0x7fe810071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:08.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.066+0000 7fe830a00700 1 --2- 172.21.15.142:0/1388545232 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe81006ecd0 0x7fe810071190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe81c006fd0 tx=0x7fe81c008040 comp rx=0 tx=0).stop 2024-04-20T22:08:08.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.066+0000 7fe830a00700 1 -- 172.21.15.142:0/1388545232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe82c103fe0 msgr2=0x7fe82c0ff660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:08.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.066+0000 7fe830a00700 1 --2- 172.21.15.142:0/1388545232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe82c103fe0 0x7fe82c0ff660 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe818006010 tx=0x7fe81800be20 comp rx=0 tx=0).stop 2024-04-20T22:08:08.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.067+0000 7fe830a00700 1 -- 172.21.15.142:0/1388545232 shutdown_connections 2024-04-20T22:08:08.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.067+0000 7fe830a00700 1 --2- 172.21.15.142:0/1388545232 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe81006ecd0 0x7fe810071190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:08.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.067+0000 7fe830a00700 1 --2- 172.21.15.142:0/1388545232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe82c1016b0 0x7fe82c100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:08.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.067+0000 7fe830a00700 1 --2- 172.21.15.142:0/1388545232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe82c103fe0 0x7fe82c0ff660 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:08.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.067+0000 7fe830a00700 1 -- 172.21.15.142:0/1388545232 >> 172.21.15.142:0/1388545232 conn(0x7fe82c0fb0c0 msgr2=0x7fe82c0fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:08.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.067+0000 7fe830a00700 1 -- 172.21.15.142:0/1388545232 shutdown_connections 2024-04-20T22:08:08.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.067+0000 7fe830a00700 1 -- 172.21.15.142:0/1388545232 wait complete. 2024-04-20T22:08:08.219 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.219+0000 7f360d000700 1 -- 172.21.15.142:0/2042404312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3608103fb0 msgr2=0x7f36081063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:08.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.219+0000 7f360d000700 1 --2- 172.21.15.142:0/2042404312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3608103fb0 0x7f36081063a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009910 tx=0x7f35f4009c20 comp rx=0 tx=0).stop 2024-04-20T22:08:08.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.219+0000 7f360d000700 1 -- 172.21.15.142:0/2042404312 shutdown_connections 2024-04-20T22:08:08.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.219+0000 7f360d000700 1 --2- 172.21.15.142:0/2042404312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3608103fb0 0x7f36081063a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:08.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.219+0000 7f360d000700 1 --2- 172.21.15.142:0/2042404312 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3608101680 0x7f3608103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:08.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.219+0000 7f360d000700 1 -- 172.21.15.142:0/2042404312 >> 172.21.15.142:0/2042404312 conn(0x7f36080fb0d0 msgr2=0x7f36080fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:08.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.219+0000 7f360d000700 1 -- 172.21.15.142:0/2042404312 shutdown_connections 2024-04-20T22:08:08.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.219+0000 7f360d000700 1 -- 172.21.15.142:0/2042404312 wait complete. 2024-04-20T22:08:08.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.220+0000 7f360d000700 1 Processor -- start 2024-04-20T22:08:08.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.221+0000 7f360d000700 1 -- start start 2024-04-20T22:08:08.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.221+0000 7f360d000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3608101680 0x7f3608100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:08.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.221+0000 7f360d000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3608103fb0 0x7f36080ff630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:08.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.221+0000 7f360d000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36080ffb70 con 0x7f3608103fb0 2024-04-20T22:08:08.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.221+0000 7f360d000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36080ffcb0 con 0x7f3608101680 2024-04-20T22:08:08.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.221+0000 7f3605400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3608103fb0 0x7f36080ff630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:08.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.221+0000 7f3605400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3608103fb0 0x7f36080ff630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60060/0 (socket says 172.21.15.142:60060) 2024-04-20T22:08:08.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.222+0000 7f3605400700 1 -- 172.21.15.142:0/3576058381 learned_addr learned my addr 172.21.15.142:0/3576058381 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:08:08.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.222+0000 7f3605e00700 1 --2- 172.21.15.142:0/3576058381 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3608101680 0x7f3608100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:08.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.222+0000 7f3605400700 1 -- 172.21.15.142:0/3576058381 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3608101680 msgr2=0x7f3608100f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:08.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.222+0000 7f3605400700 1 --2- 172.21.15.142:0/3576058381 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3608101680 0x7f3608100f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:08.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.222+0000 7f3605400700 1 -- 172.21.15.142:0/3576058381 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f40095f0 con 0x7f3608103fb0 2024-04-20T22:08:08.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.222+0000 7f3605400700 1 --2- 172.21.15.142:0/3576058381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3608103fb0 0x7f36080ff630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f35f4006010 tx=0x7f35f400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:08.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.223+0000 7f35fea00700 1 -- 172.21.15.142:0/3576058381 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35f401d070 con 0x7f3608103fb0 2024-04-20T22:08:08.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.223+0000 7f35fea00700 1 -- 172.21.15.142:0/3576058381 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f35f400f460 con 0x7f3608103fb0 2024-04-20T22:08:08.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.223+0000 7f35fea00700 1 -- 172.21.15.142:0/3576058381 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35f4021620 con 0x7f3608103fb0 2024-04-20T22:08:08.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.223+0000 7f360d000700 1 -- 172.21.15.142:0/3576058381 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36080fff30 con 0x7f3608103fb0 2024-04-20T22:08:08.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.223+0000 7f360d000700 1 -- 172.21.15.142:0/3576058381 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36081004a0 con 0x7f3608103fb0 2024-04-20T22:08:08.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.224+0000 7f360d000700 1 -- 172.21.15.142:0/3576058381 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3608062510 con 0x7f3608103fb0 2024-04-20T22:08:08.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.225+0000 7f35fea00700 1 -- 172.21.15.142:0/3576058381 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f35f400f5d0 con 0x7f3608103fb0 2024-04-20T22:08:08.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.226+0000 7f35fea00700 1 --2- 172.21.15.142:0/3576058381 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f35ec06ecc0 0x7f35ec071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:08.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.227+0000 7f35fea00700 1 -- 172.21.15.142:0/3576058381 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f35f40901d0 con 0x7f3608103fb0 2024-04-20T22:08:08.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.227+0000 7f3605e00700 1 --2- 172.21.15.142:0/3576058381 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f35ec06ecc0 0x7f35ec071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:08.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.228+0000 7f3605e00700 1 --2- 172.21.15.142:0/3576058381 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f35ec06ecc0 0x7f35ec071180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f35f8005950 tx=0x7f35f800a300 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:08.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.232+0000 7f35fea00700 1 -- 172.21.15.142:0/3576058381 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f35f405c910 con 0x7f3608103fb0 2024-04-20T22:08:08.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:08 smithi142 ceph-mon[79401]: pgmap v274: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:08.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:08 smithi142 ceph-mon[79401]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:08:08.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:08 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2600565135' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:08:08.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:08 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:08.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:08 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:08.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.568+0000 7f360d000700 1 -- 172.21.15.142:0/3576058381 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f36081004a0 con 0x7f3608103fb0 2024-04-20T22:08:08.568 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.568+0000 7f35fea00700 1 -- 172.21.15.142:0/3576058381 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f36081004a0 con 0x7f3608103fb0 2024-04-20T22:08:08.568 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_OK 2024-04-20T22:08:08.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.571+0000 7f360d000700 1 -- 172.21.15.142:0/3576058381 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f35ec06ecc0 msgr2=0x7f35ec071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:08.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.571+0000 7f360d000700 1 --2- 172.21.15.142:0/3576058381 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f35ec06ecc0 0x7f35ec071180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f35f8005950 tx=0x7f35f800a300 comp rx=0 tx=0).stop 2024-04-20T22:08:08.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.571+0000 7f360d000700 1 -- 172.21.15.142:0/3576058381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3608103fb0 msgr2=0x7f36080ff630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:08.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.571+0000 7f360d000700 1 --2- 172.21.15.142:0/3576058381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3608103fb0 0x7f36080ff630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f35f4006010 tx=0x7f35f400bd70 comp rx=0 tx=0).stop 2024-04-20T22:08:08.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.571+0000 7f360d000700 1 -- 172.21.15.142:0/3576058381 shutdown_connections 2024-04-20T22:08:08.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.571+0000 7f360d000700 1 --2- 172.21.15.142:0/3576058381 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f35ec06ecc0 0x7f35ec071180 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:08.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.571+0000 7f360d000700 1 --2- 172.21.15.142:0/3576058381 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3608101680 0x7f3608100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:08.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.571+0000 7f360d000700 1 --2- 172.21.15.142:0/3576058381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3608103fb0 0x7f36080ff630 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:08.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.571+0000 7f360d000700 1 -- 172.21.15.142:0/3576058381 >> 172.21.15.142:0/3576058381 conn(0x7f36080fb0d0 msgr2=0x7f36080fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:08.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.571+0000 7f360d000700 1 -- 172.21.15.142:0/3576058381 shutdown_connections 2024-04-20T22:08:08.571 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:08.571+0000 7f360d000700 1 -- 172.21.15.142:0/3576058381 wait complete. 2024-04-20T22:08:08.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:08 smithi164 ceph-mon[69784]: pgmap v274: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:08.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:08 smithi164 ceph-mon[69784]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:08:08.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:08 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/2600565135' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:08:08.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:08 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:08.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:08 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:09 smithi164 ceph-mon[69784]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:08:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:09 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3576058381' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:08:09.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:09 smithi142 ceph-mon[79401]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:08:09.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:09 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3576058381' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:08:10.504 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:10 smithi142 ceph-mon[79401]: pgmap v275: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:10.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:10 smithi164 ceph-mon[69784]: pgmap v275: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:11.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:11 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:11.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:11 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:11.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:11 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:11.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:11 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:12.683 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:12 smithi142 ceph-mon[79401]: pgmap v276: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:12.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:12 smithi164 ceph-mon[69784]: pgmap v276: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:14.525 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: pgmap v277: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:14.525 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:14.525 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:14.525 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:08:14.526 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:08:14.526 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:14.526 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:08:14.526 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.526 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.526 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.526 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.526 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.526 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.526 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.526 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.526 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.526 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:14.527 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi142"}]: dispatch 2024-04-20T22:08:14.527 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi142"}]': finished 2024-04-20T22:08:14.527 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi164"}]: dispatch 2024-04-20T22:08:14.527 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi164"}]': finished 2024-04-20T22:08:14.527 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.527 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:14.527 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.527 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:14.527 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.527 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:14.548 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: pgmap v277: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:14.548 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:14.548 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:14.548 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:08:14.548 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:08:14.548 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:14.548 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:08:14.548 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.548 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.548 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.548 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.548 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.549 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.549 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.549 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.549 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.549 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:14.549 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi142"}]: dispatch 2024-04-20T22:08:14.549 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi142"}]': finished 2024-04-20T22:08:14.549 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi164"}]: dispatch 2024-04-20T22:08:14.549 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi164"}]': finished 2024-04-20T22:08:14.549 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.549 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:14.549 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.549 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:14.550 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:14.550 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:15.429 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:15 smithi142 ceph-mon[79401]: Upgrade: Setting container_image for all ceph-exporter 2024-04-20T22:08:15.429 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:15 smithi142 ceph-mon[79401]: Upgrade: Setting container_image for all iscsi 2024-04-20T22:08:15.429 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:15 smithi142 ceph-mon[79401]: Upgrade: Setting container_image for all nfs 2024-04-20T22:08:15.429 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:15 smithi142 ceph-mon[79401]: Upgrade: Setting container_image for all nvmeof 2024-04-20T22:08:15.429 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:08:15.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:15 smithi164 ceph-mon[69784]: Upgrade: Setting container_image for all ceph-exporter 2024-04-20T22:08:15.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:15 smithi164 ceph-mon[69784]: Upgrade: Setting container_image for all iscsi 2024-04-20T22:08:15.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:15 smithi164 ceph-mon[69784]: Upgrade: Setting container_image for all nfs 2024-04-20T22:08:15.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:15 smithi164 ceph-mon[69784]: Upgrade: Setting container_image for all nvmeof 2024-04-20T22:08:15.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:08:16.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:16 smithi142 ceph-mon[79401]: pgmap v278: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:16.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:16 smithi164 ceph-mon[69784]: pgmap v278: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:17.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:17 smithi142 ceph-mon[79401]: Upgrade: Updating node-exporter.smithi142 (1/2) 2024-04-20T22:08:17.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:17 smithi142 ceph-mon[79401]: Deploying daemon node-exporter.smithi142 on smithi142 2024-04-20T22:08:17.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:17 smithi164 ceph-mon[69784]: Upgrade: Updating node-exporter.smithi142 (1/2) 2024-04-20T22:08:17.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:17 smithi164 ceph-mon[69784]: Deploying daemon node-exporter.smithi142 on smithi142 2024-04-20T22:08:18.433 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:18 smithi142 ceph-mon[79401]: pgmap v279: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:18.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:18 smithi164 ceph-mon[69784]: pgmap v279: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:20 smithi142 ceph-mon[79401]: pgmap v280: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:20.695 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:20 smithi164 ceph-mon[69784]: pgmap v280: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:21.620 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:21 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:21.620 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:21 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:21.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:21 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:21.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:21 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:22.513 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:22 smithi164 ceph-mon[69784]: pgmap v281: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:22.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:22 smithi142 ceph-mon[79401]: pgmap v281: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:24.604 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:24 smithi164 ceph-mon[69784]: pgmap v282: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:24.604 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:24 smithi164 ceph-mon[69784]: Upgrade: Updating node-exporter.smithi164 (2/2) 2024-04-20T22:08:24.604 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:24 smithi164 ceph-mon[69784]: Deploying daemon node-exporter.smithi164 on smithi164 2024-04-20T22:08:24.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:24 smithi142 ceph-mon[79401]: pgmap v282: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:24.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:24 smithi142 ceph-mon[79401]: Upgrade: Updating node-exporter.smithi164 (2/2) 2024-04-20T22:08:24.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:24 smithi142 ceph-mon[79401]: Deploying daemon node-exporter.smithi164 on smithi164 2024-04-20T22:08:26.656 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:26 smithi164 ceph-mon[69784]: pgmap v283: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:26.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:26 smithi142 ceph-mon[79401]: pgmap v283: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:28.151 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:27 smithi164 ceph-mon[69784]: pgmap v284: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:28.151 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:27 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:28.151 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:27 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:28.151 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:27 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:08:28.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:27 smithi142 ceph-mon[79401]: pgmap v284: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:28.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:27 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:28.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:27 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:28.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:27 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:08:29.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:29 smithi142 ceph-mon[79401]: pgmap v285: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:29.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:08:30.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:29 smithi164 ceph-mon[69784]: pgmap v285: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:30.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:08:31.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:31 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:31.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:31 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:31.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:31 smithi142 ceph-mon[79401]: pgmap v286: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:31.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:31 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:31.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:31 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:31.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:31 smithi164 ceph-mon[69784]: pgmap v286: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:33.909 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:33 smithi164 ceph-mon[69784]: pgmap v287: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:33.909 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:33 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:33.909 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:33 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:33.909 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:33 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:33.909 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:33 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:33.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:33 smithi142 ceph-mon[79401]: pgmap v287: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:33.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:33 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:33.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:33 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:33.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:33 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:33.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:33 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:35.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:35 smithi164 ceph-mon[69784]: pgmap v288: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:35.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:35 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:35.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:35 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:35.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:35 smithi142 ceph-mon[79401]: pgmap v288: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:35.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:35 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:35.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:35 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:37.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:37 smithi142 ceph-mon[79401]: pgmap v289: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:37.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:37 smithi164 ceph-mon[69784]: pgmap v289: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:38.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.736+0000 7f9016600700 1 -- 172.21.15.142:0/1728193189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90100fef10 msgr2=0x7f90100ff330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:38.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.736+0000 7f9016600700 1 --2- 172.21.15.142:0/1728193189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90100fef10 0x7f90100ff330 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9000009910 tx=0x7f9000009c20 comp rx=0 tx=0).stop 2024-04-20T22:08:38.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.736+0000 7f9016600700 1 -- 172.21.15.142:0/1728193189 shutdown_connections 2024-04-20T22:08:38.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.736+0000 7f9016600700 1 --2- 172.21.15.142:0/1728193189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90100ffc80 0x7f9010100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:38.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.736+0000 7f9016600700 1 --2- 172.21.15.142:0/1728193189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90100fef10 0x7f90100ff330 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:38.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.736+0000 7f9016600700 1 -- 172.21.15.142:0/1728193189 >> 172.21.15.142:0/1728193189 conn(0x7f90100fa850 msgr2=0x7f90100fccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:38.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.736+0000 7f9016600700 1 -- 172.21.15.142:0/1728193189 shutdown_connections 2024-04-20T22:08:38.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.736+0000 7f9016600700 1 -- 172.21.15.142:0/1728193189 wait complete. 2024-04-20T22:08:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.737+0000 7f9016600700 1 Processor -- start 2024-04-20T22:08:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.737+0000 7f9016600700 1 -- start start 2024-04-20T22:08:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.737+0000 7f9016600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90100fef10 0x7f901019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.737+0000 7f9016600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90100ffc80 0x7f901019d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.737+0000 7f9016600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901019d800 con 0x7f90100ffc80 2024-04-20T22:08:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.737+0000 7f9016600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90101a21c0 con 0x7f90100fef10 2024-04-20T22:08:38.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.738+0000 7f900ea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90100ffc80 0x7f901019d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:38.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.738+0000 7f900ea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90100ffc80 0x7f901019d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40836/0 (socket says 172.21.15.142:40836) 2024-04-20T22:08:38.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.738+0000 7f900ea00700 1 -- 172.21.15.142:0/3937526669 learned_addr learned my addr 172.21.15.142:0/3937526669 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:08:38.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.738+0000 7f900f400700 1 --2- 172.21.15.142:0/3937526669 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90100fef10 0x7f901019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:38.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.738+0000 7f900ea00700 1 -- 172.21.15.142:0/3937526669 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90100fef10 msgr2=0x7f901019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:38.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.738+0000 7f900ea00700 1 --2- 172.21.15.142:0/3937526669 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90100fef10 0x7f901019cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:38.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.738+0000 7f900ea00700 1 -- 172.21.15.142:0/3937526669 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90000095f0 con 0x7f90100ffc80 2024-04-20T22:08:38.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.738+0000 7f900ea00700 1 --2- 172.21.15.142:0/3937526669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90100ffc80 0x7f901019d1e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00c8a0 tx=0x7f8ffc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:38.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.739+0000 7f9007e00700 1 -- 172.21.15.142:0/3937526669 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ffc00cea0 con 0x7f90100ffc80 2024-04-20T22:08:38.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.739+0000 7f9007e00700 1 -- 172.21.15.142:0/3937526669 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ffc004830 con 0x7f90100ffc80 2024-04-20T22:08:38.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.739+0000 7f9007e00700 1 -- 172.21.15.142:0/3937526669 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ffc0055d0 con 0x7f90100ffc80 2024-04-20T22:08:38.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.739+0000 7f9016600700 1 -- 172.21.15.142:0/3937526669 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90101a23c0 con 0x7f90100ffc80 2024-04-20T22:08:38.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.739+0000 7f9016600700 1 -- 172.21.15.142:0/3937526669 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90101a2960 con 0x7f90100ffc80 2024-04-20T22:08:38.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.740+0000 7f9016600700 1 -- 172.21.15.142:0/3937526669 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9010196de0 con 0x7f90100ffc80 2024-04-20T22:08:38.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.742+0000 7f9007e00700 1 -- 172.21.15.142:0/3937526669 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f8ffc0049a0 con 0x7f90100ffc80 2024-04-20T22:08:38.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.743+0000 7f9007e00700 1 --2- 172.21.15.142:0/3937526669 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8ff406ecd0 0x7f8ff4071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:38.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.743+0000 7f9007e00700 1 -- 172.21.15.142:0/3937526669 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f8ffc08ec10 con 0x7f90100ffc80 2024-04-20T22:08:38.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.743+0000 7f900f400700 1 --2- 172.21.15.142:0/3937526669 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8ff406ecd0 0x7f8ff4071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:38.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.744+0000 7f900f400700 1 --2- 172.21.15.142:0/3937526669 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8ff406ecd0 0x7f8ff4071190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f90000051c0 tx=0x7f9000005fb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:38.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:38.748+0000 7f9007e00700 1 -- 172.21.15.142:0/3937526669 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f8ffc0578a0 con 0x7f90100ffc80 2024-04-20T22:08:39.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.035+0000 7f9016600700 1 -- 172.21.15.142:0/3937526669 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f901002ce50 con 0x7f8ff406ecd0 2024-04-20T22:08:39.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.037+0000 7f9007e00700 1 -- 172.21.15.142:0/3937526669 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7f901002ce50 con 0x7f8ff406ecd0 2024-04-20T22:08:39.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.041+0000 7f9016600700 1 -- 172.21.15.142:0/3937526669 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8ff406ecd0 msgr2=0x7f8ff4071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:39.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.041+0000 7f9016600700 1 --2- 172.21.15.142:0/3937526669 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8ff406ecd0 0x7f8ff4071190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f90000051c0 tx=0x7f9000005fb0 comp rx=0 tx=0).stop 2024-04-20T22:08:39.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.041+0000 7f9016600700 1 -- 172.21.15.142:0/3937526669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90100ffc80 msgr2=0x7f901019d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:39.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.041+0000 7f9016600700 1 --2- 172.21.15.142:0/3937526669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90100ffc80 0x7f901019d1e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00c8a0 tx=0x7f8ffc00cc60 comp rx=0 tx=0).stop 2024-04-20T22:08:39.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.041+0000 7f9016600700 1 -- 172.21.15.142:0/3937526669 shutdown_connections 2024-04-20T22:08:39.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.041+0000 7f9016600700 1 --2- 172.21.15.142:0/3937526669 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8ff406ecd0 0x7f8ff4071190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:39.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.041+0000 7f9016600700 1 --2- 172.21.15.142:0/3937526669 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90100fef10 0x7f901019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:39.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.041+0000 7f9016600700 1 --2- 172.21.15.142:0/3937526669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90100ffc80 0x7f901019d1e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:39.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.041+0000 7f9016600700 1 -- 172.21.15.142:0/3937526669 >> 172.21.15.142:0/3937526669 conn(0x7f90100fa850 msgr2=0x7f9010103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:39.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.041+0000 7f9016600700 1 -- 172.21.15.142:0/3937526669 shutdown_connections 2024-04-20T22:08:39.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.041+0000 7f9016600700 1 -- 172.21.15.142:0/3937526669 wait complete. 2024-04-20T22:08:39.057 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T22:08:39.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.190+0000 7efcaf800700 1 -- 172.21.15.142:0/812461023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efca80ff470 msgr2=0x7efca80ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:39.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.190+0000 7efcaf800700 1 --2- 172.21.15.142:0/812461023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efca80ff470 0x7efca80ff890 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009910 tx=0x7efc9c009c20 comp rx=0 tx=0).stop 2024-04-20T22:08:39.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.190+0000 7efcaf800700 1 -- 172.21.15.142:0/812461023 shutdown_connections 2024-04-20T22:08:39.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.190+0000 7efcaf800700 1 --2- 172.21.15.142:0/812461023 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efca80ffdd0 0x7efca8100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:39.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.190+0000 7efcaf800700 1 --2- 172.21.15.142:0/812461023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efca80ff470 0x7efca80ff890 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:39.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.190+0000 7efcaf800700 1 -- 172.21.15.142:0/812461023 >> 172.21.15.142:0/812461023 conn(0x7efca80fb0d0 msgr2=0x7efca80fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:39.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.190+0000 7efcaf800700 1 -- 172.21.15.142:0/812461023 shutdown_connections 2024-04-20T22:08:39.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.190+0000 7efcaf800700 1 -- 172.21.15.142:0/812461023 wait complete. 2024-04-20T22:08:39.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.192+0000 7efcaf800700 1 Processor -- start 2024-04-20T22:08:39.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.192+0000 7efcaf800700 1 -- start start 2024-04-20T22:08:39.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.192+0000 7efcaf800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efca80ff470 0x7efca8198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:39.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.192+0000 7efcaf800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efca80ffdd0 0x7efca8198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:39.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.192+0000 7efcaf800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca8199460 con 0x7efca80ff470 2024-04-20T22:08:39.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.192+0000 7efcaf800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca81995a0 con 0x7efca80ffdd0 2024-04-20T22:08:39.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.192+0000 7efcace00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efca80ff470 0x7efca8198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:39.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.193+0000 7efcace00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efca80ff470 0x7efca8198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40864/0 (socket says 172.21.15.142:40864) 2024-04-20T22:08:39.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.193+0000 7efcace00700 1 -- 172.21.15.142:0/3695264166 learned_addr learned my addr 172.21.15.142:0/3695264166 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:08:39.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.193+0000 7efcace00700 1 -- 172.21.15.142:0/3695264166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efca80ffdd0 msgr2=0x7efca8198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:39.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.193+0000 7efcace00700 1 --2- 172.21.15.142:0/3695264166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efca80ffdd0 0x7efca8198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:39.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.193+0000 7efcace00700 1 -- 172.21.15.142:0/3695264166 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c0095f0 con 0x7efca80ff470 2024-04-20T22:08:39.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.193+0000 7efcace00700 1 --2- 172.21.15.142:0/3695264166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efca80ff470 0x7efca8198900 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00bd70 tx=0x7efc9c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:39.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.193+0000 7efca5600700 1 -- 172.21.15.142:0/3695264166 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc9c01d070 con 0x7efca80ff470 2024-04-20T22:08:39.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.194+0000 7efca5600700 1 -- 172.21.15.142:0/3695264166 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc9c00f460 con 0x7efca80ff470 2024-04-20T22:08:39.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.194+0000 7efcaf800700 1 -- 172.21.15.142:0/3695264166 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca819dfa0 con 0x7efca80ff470 2024-04-20T22:08:39.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.194+0000 7efca5600700 1 -- 172.21.15.142:0/3695264166 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc9c021620 con 0x7efca80ff470 2024-04-20T22:08:39.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.194+0000 7efcaf800700 1 -- 172.21.15.142:0/3695264166 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca819e4c0 con 0x7efca80ff470 2024-04-20T22:08:39.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.195+0000 7efcaf800700 1 -- 172.21.15.142:0/3695264166 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca81929e0 con 0x7efca80ff470 2024-04-20T22:08:39.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.196+0000 7efca5600700 1 -- 172.21.15.142:0/3695264166 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7efc9c00fa70 con 0x7efca80ff470 2024-04-20T22:08:39.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.197+0000 7efca5600700 1 --2- 172.21.15.142:0/3695264166 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7efc9006ecc0 0x7efc90071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:39.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.197+0000 7efca5600700 1 -- 172.21.15.142:0/3695264166 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7efc9c0903b0 con 0x7efca80ff470 2024-04-20T22:08:39.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.197+0000 7efca7e00700 1 --2- 172.21.15.142:0/3695264166 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7efc9006ecc0 0x7efc90071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:39.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.198+0000 7efca7e00700 1 --2- 172.21.15.142:0/3695264166 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7efc9006ecc0 0x7efc90071180 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efc940097b0 tx=0x7efc94006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:39.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.202+0000 7efca5600700 1 -- 172.21.15.142:0/3695264166 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7efc9c05caf0 con 0x7efca80ff470 2024-04-20T22:08:39.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:39 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:39.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:39 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:39.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:39 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:39.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:39 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:39.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.532+0000 7efcaf800700 1 -- 172.21.15.142:0/3695264166 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efca802ceb0 con 0x7efc9006ecc0 2024-04-20T22:08:39.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.533+0000 7efca5600700 1 -- 172.21.15.142:0/3695264166 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7efca802ceb0 con 0x7efc9006ecc0 2024-04-20T22:08:39.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.536+0000 7efcaf800700 1 -- 172.21.15.142:0/3695264166 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7efc9006ecc0 msgr2=0x7efc90071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:39.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.536+0000 7efcaf800700 1 --2- 172.21.15.142:0/3695264166 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7efc9006ecc0 0x7efc90071180 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efc940097b0 tx=0x7efc94006d20 comp rx=0 tx=0).stop 2024-04-20T22:08:39.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.536+0000 7efcaf800700 1 -- 172.21.15.142:0/3695264166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efca80ff470 msgr2=0x7efca8198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:39.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.536+0000 7efcaf800700 1 --2- 172.21.15.142:0/3695264166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efca80ff470 0x7efca8198900 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00bd70 tx=0x7efc9c00be50 comp rx=0 tx=0).stop 2024-04-20T22:08:39.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.536+0000 7efcaf800700 1 -- 172.21.15.142:0/3695264166 shutdown_connections 2024-04-20T22:08:39.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.536+0000 7efcaf800700 1 --2- 172.21.15.142:0/3695264166 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7efc9006ecc0 0x7efc90071180 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:39.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.536+0000 7efcaf800700 1 --2- 172.21.15.142:0/3695264166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efca80ff470 0x7efca8198900 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:39.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.536+0000 7efcaf800700 1 --2- 172.21.15.142:0/3695264166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efca80ffdd0 0x7efca8198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:39.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.536+0000 7efcaf800700 1 -- 172.21.15.142:0/3695264166 >> 172.21.15.142:0/3695264166 conn(0x7efca80fb0d0 msgr2=0x7efca8107ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:39.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.536+0000 7efcaf800700 1 -- 172.21.15.142:0/3695264166 shutdown_connections 2024-04-20T22:08:39.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.536+0000 7efcaf800700 1 -- 172.21.15.142:0/3695264166 wait complete. 2024-04-20T22:08:39.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.698+0000 7f0e57c00700 1 -- 172.21.15.142:0/3224789366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e50100c20 msgr2=0x7f0e50101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:39.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.698+0000 7f0e57c00700 1 --2- 172.21.15.142:0/3224789366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e50100c20 0x7f0e50101040 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009910 tx=0x7f0e44009c20 comp rx=0 tx=0).stop 2024-04-20T22:08:39.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.698+0000 7f0e57c00700 1 -- 172.21.15.142:0/3224789366 shutdown_connections 2024-04-20T22:08:39.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.698+0000 7f0e57c00700 1 --2- 172.21.15.142:0/3224789366 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e50101e20 0x7f0e50102280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:39.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.698+0000 7f0e57c00700 1 --2- 172.21.15.142:0/3224789366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e50100c20 0x7f0e50101040 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:39.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.698+0000 7f0e57c00700 1 -- 172.21.15.142:0/3224789366 >> 172.21.15.142:0/3224789366 conn(0x7f0e500fc1e0 msgr2=0x7f0e500fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:39.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.698+0000 7f0e57c00700 1 -- 172.21.15.142:0/3224789366 shutdown_connections 2024-04-20T22:08:39.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.698+0000 7f0e57c00700 1 -- 172.21.15.142:0/3224789366 wait complete. 2024-04-20T22:08:39.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.699+0000 7f0e57c00700 1 Processor -- start 2024-04-20T22:08:39.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.700+0000 7f0e57c00700 1 -- start start 2024-04-20T22:08:39.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.700+0000 7f0e57c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e50100c20 0x7f0e50074be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:39.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.700+0000 7f0e57c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e50101e20 0x7f0e500732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:39.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.700+0000 7f0e57c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e50073810 con 0x7f0e50101e20 2024-04-20T22:08:39.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.700+0000 7f0e57c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e50073950 con 0x7f0e50100c20 2024-04-20T22:08:39.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.700+0000 7f0e4fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e50101e20 0x7f0e500732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:39.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.700+0000 7f0e4fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e50101e20 0x7f0e500732d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40888/0 (socket says 172.21.15.142:40888) 2024-04-20T22:08:39.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.700+0000 7f0e4fe00700 1 -- 172.21.15.142:0/706677642 learned_addr learned my addr 172.21.15.142:0/706677642 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:08:39.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.701+0000 7f0e55200700 1 --2- 172.21.15.142:0/706677642 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e50100c20 0x7f0e50074be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:39.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.701+0000 7f0e4fe00700 1 -- 172.21.15.142:0/706677642 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e50100c20 msgr2=0x7f0e50074be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:39.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.701+0000 7f0e4fe00700 1 --2- 172.21.15.142:0/706677642 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e50100c20 0x7f0e50074be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:39.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.701+0000 7f0e4fe00700 1 -- 172.21.15.142:0/706677642 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e440095f0 con 0x7f0e50101e20 2024-04-20T22:08:39.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.701+0000 7f0e4fe00700 1 --2- 172.21.15.142:0/706677642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e50101e20 0x7f0e500732d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00b4b0 tx=0x7f0e3c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:39.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.701+0000 7f0e4d600700 1 -- 172.21.15.142:0/706677642 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e3c011800 con 0x7f0e50101e20 2024-04-20T22:08:39.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.701+0000 7f0e4d600700 1 -- 172.21.15.142:0/706677642 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e3c011e20 con 0x7f0e50101e20 2024-04-20T22:08:39.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.702+0000 7f0e4d600700 1 -- 172.21.15.142:0/706677642 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e3c00f2e0 con 0x7f0e50101e20 2024-04-20T22:08:39.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.702+0000 7f0e57c00700 1 -- 172.21.15.142:0/706677642 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e50073c30 con 0x7f0e50101e20 2024-04-20T22:08:39.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.702+0000 7f0e57c00700 1 -- 172.21.15.142:0/706677642 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5019e7c0 con 0x7f0e50101e20 2024-04-20T22:08:39.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.703+0000 7f0e57c00700 1 -- 172.21.15.142:0/706677642 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e50190820 con 0x7f0e50101e20 2024-04-20T22:08:39.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.704+0000 7f0e4d600700 1 -- 172.21.15.142:0/706677642 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f0e3c010380 con 0x7f0e50101e20 2024-04-20T22:08:39.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.705+0000 7f0e4d600700 1 --2- 172.21.15.142:0/706677642 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0e3806ecc0 0x7f0e38071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:39.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.705+0000 7f0e4d600700 1 -- 172.21.15.142:0/706677642 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f0e3c08eb30 con 0x7f0e50101e20 2024-04-20T22:08:39.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.706+0000 7f0e55200700 1 --2- 172.21.15.142:0/706677642 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0e3806ecc0 0x7f0e38071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:39.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.707+0000 7f0e55200700 1 --2- 172.21.15.142:0/706677642 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0e3806ecc0 0x7f0e38071180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e44006010 tx=0x7f0e4400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:39.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.710+0000 7f0e4d600700 1 -- 172.21.15.142:0/706677642 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f0e3c05b3a0 con 0x7f0e50101e20 2024-04-20T22:08:39.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.956+0000 7f0e57c00700 1 -- 172.21.15.142:0/706677642 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e5002cdb0 con 0x7f0e3806ecc0 2024-04-20T22:08:39.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.968+0000 7f0e4d600700 1 -- 172.21.15.142:0/706677642 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f0e5002cdb0 con 0x7f0e3806ecc0 2024-04-20T22:08:39.970 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:08:39.970 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (19m) 6s ago 21m 14.3M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T22:08:39.970 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (48s) 6s ago 21m 7918k - 19.0.0-3133-ga8c84f59 76bc6b91b726 eadbb8123608 2024-04-20T22:08:39.970 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (41s) 9s ago 20m 7638k - 19.0.0-3133-ga8c84f59 76bc6b91b726 13030cc1a7a8 2024-04-20T22:08:39.970 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (6m) 6s ago 21m 6665k - 19.0.0-3133-ga8c84f59 76bc6b91b726 64521ed7125b 2024-04-20T22:08:39.970 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (6m) 9s ago 20m 6656k - 19.0.0-3133-ga8c84f59 76bc6b91b726 893c6f16ee6d 2024-04-20T22:08:39.970 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (19m) 6s ago 20m 74.9M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T22:08:39.970 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (2m) 6s ago 14m 87.2M - 19.0.0-3133-ga8c84f59 76bc6b91b726 603d9ff4accc 2024-04-20T22:08:39.970 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (2m) 6s ago 13m 12.7M - 19.0.0-3133-ga8c84f59 76bc6b91b726 5fbbe225e911 2024-04-20T22:08:39.971 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (69s) 9s ago 13m 12.2M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3ee3d509a48c 2024-04-20T22:08:39.971 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (100s) 9s ago 14m 12.4M - 19.0.0-3133-ga8c84f59 76bc6b91b726 44901e1ad990 2024-04-20T22:08:39.971 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (10m) 6s ago 23m 513M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:08:39.971 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (9m) 9s ago 19m 454M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:08:39.971 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (8m) 6s ago 23m 59.8M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 af10a542c918 2024-04-20T22:08:39.971 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (8m) 9s ago 19m 43.5M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 133512694d46 2024-04-20T22:08:39.971 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (20s) 6s ago 21m 2847k - 1.5.0 0da6a335fe13 f21ef73493a2 2024-04-20T22:08:39.971 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (13s) 9s ago 20m 2843k - 1.5.0 0da6a335fe13 0ba09db59c8e 2024-04-20T22:08:39.971 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (6m) 6s ago 18m 107M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 b7206d05a7cd 2024-04-20T22:08:39.971 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (5m) 6s ago 18m 109M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 82bcc0c46762 2024-04-20T22:08:39.971 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (5m) 6s ago 17m 95.7M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 3e2d91f49494 2024-04-20T22:08:39.971 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (4m) 9s ago 17m 119M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 a898b8b77c51 2024-04-20T22:08:39.971 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (3m) 9s ago 16m 103M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 539c4026f9fb 2024-04-20T22:08:39.971 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (3m) 9s ago 15m 95.8M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 ac1bdd69c944 2024-04-20T22:08:39.971 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (9m) 6s ago 20m 78.9M - 2.43.0 a07b618ecd1d 46b76c20eae5 2024-04-20T22:08:39.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.970+0000 7f0e57c00700 1 -- 172.21.15.142:0/706677642 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0e3806ecc0 msgr2=0x7f0e38071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:39.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.970+0000 7f0e57c00700 1 --2- 172.21.15.142:0/706677642 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0e3806ecc0 0x7f0e38071180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e44006010 tx=0x7f0e4400b540 comp rx=0 tx=0).stop 2024-04-20T22:08:39.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.970+0000 7f0e57c00700 1 -- 172.21.15.142:0/706677642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e50101e20 msgr2=0x7f0e500732d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:39.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.970+0000 7f0e57c00700 1 --2- 172.21.15.142:0/706677642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e50101e20 0x7f0e500732d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00b4b0 tx=0x7f0e3c00b870 comp rx=0 tx=0).stop 2024-04-20T22:08:39.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.970+0000 7f0e57c00700 1 -- 172.21.15.142:0/706677642 shutdown_connections 2024-04-20T22:08:39.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.970+0000 7f0e57c00700 1 --2- 172.21.15.142:0/706677642 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0e3806ecc0 0x7f0e38071180 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:39.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.970+0000 7f0e57c00700 1 --2- 172.21.15.142:0/706677642 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0e50100c20 0x7f0e50074be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:39.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.970+0000 7f0e57c00700 1 --2- 172.21.15.142:0/706677642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e50101e20 0x7f0e500732d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:39.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.970+0000 7f0e57c00700 1 -- 172.21.15.142:0/706677642 >> 172.21.15.142:0/706677642 conn(0x7f0e500fc1e0 msgr2=0x7f0e50105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:39.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.970+0000 7f0e57c00700 1 -- 172.21.15.142:0/706677642 shutdown_connections 2024-04-20T22:08:39.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:39.971+0000 7f0e57c00700 1 -- 172.21.15.142:0/706677642 wait complete. 2024-04-20T22:08:40.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.115+0000 7f3133600700 1 -- 172.21.15.142:0/3438162367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f312c102e30 msgr2=0x7f312c103250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:40.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.115+0000 7f3133600700 1 --2- 172.21.15.142:0/3438162367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f312c102e30 0x7f312c103250 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3120009910 tx=0x7f3120009c20 comp rx=0 tx=0).stop 2024-04-20T22:08:40.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.115+0000 7f3133600700 1 -- 172.21.15.142:0/3438162367 shutdown_connections 2024-04-20T22:08:40.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.115+0000 7f3133600700 1 --2- 172.21.15.142:0/3438162367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f312c103f90 0x7f312c104410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:40.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.115+0000 7f3133600700 1 --2- 172.21.15.142:0/3438162367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f312c102e30 0x7f312c103250 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:40.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.115+0000 7f3133600700 1 -- 172.21.15.142:0/3438162367 >> 172.21.15.142:0/3438162367 conn(0x7f312c0fe3f0 msgr2=0x7f312c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:40.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.115+0000 7f3133600700 1 -- 172.21.15.142:0/3438162367 shutdown_connections 2024-04-20T22:08:40.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.115+0000 7f3133600700 1 -- 172.21.15.142:0/3438162367 wait complete. 2024-04-20T22:08:40.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.116+0000 7f3133600700 1 Processor -- start 2024-04-20T22:08:40.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.117+0000 7f3133600700 1 -- start start 2024-04-20T22:08:40.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.117+0000 7f3133600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f312c102e30 0x7f312c078c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:40.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.117+0000 7f3133600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f312c103f90 0x7f312c079180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:40.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.117+0000 7f3133600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c075780 con 0x7f312c102e30 2024-04-20T22:08:40.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.117+0000 7f3133600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c0758c0 con 0x7f312c103f90 2024-04-20T22:08:40.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.118+0000 7f3130c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f312c102e30 0x7f312c078c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:40.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.118+0000 7f3130c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f312c102e30 0x7f312c078c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40894/0 (socket says 172.21.15.142:40894) 2024-04-20T22:08:40.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.118+0000 7f3130c00700 1 -- 172.21.15.142:0/1592988873 learned_addr learned my addr 172.21.15.142:0/1592988873 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:08:40.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.118+0000 7f312be00700 1 --2- 172.21.15.142:0/1592988873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f312c103f90 0x7f312c079180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:40.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.118+0000 7f3130c00700 1 -- 172.21.15.142:0/1592988873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f312c103f90 msgr2=0x7f312c079180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:40.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.118+0000 7f3130c00700 1 --2- 172.21.15.142:0/1592988873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f312c103f90 0x7f312c079180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:40.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.118+0000 7f3130c00700 1 -- 172.21.15.142:0/1592988873 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31200095f0 con 0x7f312c102e30 2024-04-20T22:08:40.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.119+0000 7f3130c00700 1 --2- 172.21.15.142:0/1592988873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f312c102e30 0x7f312c078c40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f312000bd70 tx=0x7f312000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:40.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.119+0000 7f3129600700 1 -- 172.21.15.142:0/1592988873 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f312001d070 con 0x7f312c102e30 2024-04-20T22:08:40.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.119+0000 7f3129600700 1 -- 172.21.15.142:0/1592988873 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f312000f460 con 0x7f312c102e30 2024-04-20T22:08:40.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.119+0000 7f3133600700 1 -- 172.21.15.142:0/1592988873 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312c075b40 con 0x7f312c102e30 2024-04-20T22:08:40.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.119+0000 7f3129600700 1 -- 172.21.15.142:0/1592988873 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3120021640 con 0x7f312c102e30 2024-04-20T22:08:40.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.119+0000 7f3133600700 1 -- 172.21.15.142:0/1592988873 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312c0760b0 con 0x7f312c102e30 2024-04-20T22:08:40.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.121+0000 7f3133600700 1 -- 172.21.15.142:0/1592988873 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f312c1929b0 con 0x7f312c102e30 2024-04-20T22:08:40.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.122+0000 7f3129600700 1 -- 172.21.15.142:0/1592988873 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f312000fad0 con 0x7f312c102e30 2024-04-20T22:08:40.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.123+0000 7f3129600700 1 --2- 172.21.15.142:0/1592988873 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f311406ecd0 0x7f3114071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:40.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.123+0000 7f3129600700 1 -- 172.21.15.142:0/1592988873 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f31200902b0 con 0x7f312c102e30 2024-04-20T22:08:40.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.123+0000 7f312be00700 1 --2- 172.21.15.142:0/1592988873 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f311406ecd0 0x7f3114071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:40.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.124+0000 7f312be00700 1 --2- 172.21.15.142:0/1592988873 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f311406ecd0 0x7f3114071190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3118009a10 tx=0x7f3118009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:40.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.128+0000 7f3129600700 1 -- 172.21.15.142:0/1592988873 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f312005ca70 con 0x7f312c102e30 2024-04-20T22:08:40.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:40 smithi164 ceph-mon[69784]: pgmap v290: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:40.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:40 smithi164 ceph-mon[69784]: from='client.34584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:08:40.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:40 smithi142 ceph-mon[79401]: pgmap v290: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:40.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:40 smithi142 ceph-mon[79401]: from='client.34584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:08:40.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.449+0000 7f3133600700 1 -- 172.21.15.142:0/1592988873 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f312c04ebb0 con 0x7f312c102e30 2024-04-20T22:08:40.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.451+0000 7f3129600700 1 -- 172.21.15.142:0/1592988873 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f312005c600 con 0x7f312c102e30 2024-04-20T22:08:40.451 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:08:40.451 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:08:40.451 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:08:40.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:08:40.451 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:08:40.451 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:08:40.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:08:40.451 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:08:40.451 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 6 2024-04-20T22:08:40.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:08:40.451 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:08:40.451 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 4 2024-04-20T22:08:40.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:08:40.451 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:08:40.452 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 14 2024-04-20T22:08:40.452 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:08:40.452 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:08:40.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.453+0000 7f3133600700 1 -- 172.21.15.142:0/1592988873 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f311406ecd0 msgr2=0x7f3114071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:40.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.453+0000 7f3133600700 1 --2- 172.21.15.142:0/1592988873 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f311406ecd0 0x7f3114071190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3118009a10 tx=0x7f3118009190 comp rx=0 tx=0).stop 2024-04-20T22:08:40.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.453+0000 7f3133600700 1 -- 172.21.15.142:0/1592988873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f312c102e30 msgr2=0x7f312c078c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:40.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.453+0000 7f3133600700 1 --2- 172.21.15.142:0/1592988873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f312c102e30 0x7f312c078c40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f312000bd70 tx=0x7f312000bda0 comp rx=0 tx=0).stop 2024-04-20T22:08:40.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.453+0000 7f3133600700 1 -- 172.21.15.142:0/1592988873 shutdown_connections 2024-04-20T22:08:40.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.453+0000 7f3133600700 1 --2- 172.21.15.142:0/1592988873 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f311406ecd0 0x7f3114071190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:40.453 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.453+0000 7f3133600700 1 --2- 172.21.15.142:0/1592988873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f312c102e30 0x7f312c078c40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:40.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.453+0000 7f3133600700 1 --2- 172.21.15.142:0/1592988873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f312c103f90 0x7f312c079180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:40.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.453+0000 7f3133600700 1 -- 172.21.15.142:0/1592988873 >> 172.21.15.142:0/1592988873 conn(0x7f312c0fe3f0 msgr2=0x7f312c107620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:40.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.453+0000 7f3133600700 1 -- 172.21.15.142:0/1592988873 shutdown_connections 2024-04-20T22:08:40.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.454+0000 7f3133600700 1 -- 172.21.15.142:0/1592988873 wait complete. 2024-04-20T22:08:40.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.600+0000 7f7f31000700 1 -- 172.21.15.142:0/1434173237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2c101e30 msgr2=0x7f7f2c102290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:40.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.600+0000 7f7f31000700 1 --2- 172.21.15.142:0/1434173237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2c101e30 0x7f7f2c102290 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009910 tx=0x7f7f18009c20 comp rx=0 tx=0).stop 2024-04-20T22:08:40.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.601+0000 7f7f31000700 1 -- 172.21.15.142:0/1434173237 shutdown_connections 2024-04-20T22:08:40.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.601+0000 7f7f31000700 1 --2- 172.21.15.142:0/1434173237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2c101e30 0x7f7f2c102290 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:40.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.601+0000 7f7f31000700 1 --2- 172.21.15.142:0/1434173237 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f2c100c30 0x7f7f2c101050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:40.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.601+0000 7f7f31000700 1 -- 172.21.15.142:0/1434173237 >> 172.21.15.142:0/1434173237 conn(0x7f7f2c0fc1f0 msgr2=0x7f7f2c0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:40.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.601+0000 7f7f31000700 1 -- 172.21.15.142:0/1434173237 shutdown_connections 2024-04-20T22:08:40.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.601+0000 7f7f31000700 1 -- 172.21.15.142:0/1434173237 wait complete. 2024-04-20T22:08:40.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.602+0000 7f7f31000700 1 Processor -- start 2024-04-20T22:08:40.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.602+0000 7f7f31000700 1 -- start start 2024-04-20T22:08:40.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.602+0000 7f7f31000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2c100c30 0x7f7f2c196640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:40.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.602+0000 7f7f31000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f2c101e30 0x7f7f2c196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:40.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.602+0000 7f7f31000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c1971a0 con 0x7f7f2c100c30 2024-04-20T22:08:40.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.602+0000 7f7f31000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c1972e0 con 0x7f7f2c101e30 2024-04-20T22:08:40.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.602+0000 7f7f29e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2c100c30 0x7f7f2c196640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:40.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.602+0000 7f7f29e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2c100c30 0x7f7f2c196640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40910/0 (socket says 172.21.15.142:40910) 2024-04-20T22:08:40.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.602+0000 7f7f29e00700 1 -- 172.21.15.142:0/3253910613 learned_addr learned my addr 172.21.15.142:0/3253910613 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:08:40.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.603+0000 7f7f29400700 1 --2- 172.21.15.142:0/3253910613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f2c101e30 0x7f7f2c196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:40.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.603+0000 7f7f29e00700 1 -- 172.21.15.142:0/3253910613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f2c101e30 msgr2=0x7f7f2c196b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:40.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.603+0000 7f7f29e00700 1 --2- 172.21.15.142:0/3253910613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f2c101e30 0x7f7f2c196b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:40.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.603+0000 7f7f29e00700 1 -- 172.21.15.142:0/3253910613 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f180095f0 con 0x7f7f2c100c30 2024-04-20T22:08:40.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.603+0000 7f7f29400700 1 --2- 172.21.15.142:0/3253910613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f2c101e30 0x7f7f2c196b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:08:40.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.603+0000 7f7f29e00700 1 --2- 172.21.15.142:0/3253910613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2c100c30 0x7f7f2c196640 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00c8f0 tx=0x7f7f1c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:40.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.603+0000 7f7f22a00700 1 -- 172.21.15.142:0/3253910613 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f1c007a70 con 0x7f7f2c100c30 2024-04-20T22:08:40.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.603+0000 7f7f22a00700 1 -- 172.21.15.142:0/3253910613 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f1c007bd0 con 0x7f7f2c100c30 2024-04-20T22:08:40.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.603+0000 7f7f22a00700 1 -- 172.21.15.142:0/3253910613 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f1c018630 con 0x7f7f2c100c30 2024-04-20T22:08:40.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.603+0000 7f7f31000700 1 -- 172.21.15.142:0/3253910613 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2c19bcf0 con 0x7f7f2c100c30 2024-04-20T22:08:40.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.603+0000 7f7f31000700 1 -- 172.21.15.142:0/3253910613 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2c19c220 con 0x7f7f2c100c30 2024-04-20T22:08:40.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.605+0000 7f7f31000700 1 -- 172.21.15.142:0/3253910613 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2c1907b0 con 0x7f7f2c100c30 2024-04-20T22:08:40.605 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.606+0000 7f7f22a00700 1 -- 172.21.15.142:0/3253910613 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f7f1c00f450 con 0x7f7f2c100c30 2024-04-20T22:08:40.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.606+0000 7f7f22a00700 1 --2- 172.21.15.142:0/3253910613 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7f1006ecd0 0x7f7f10071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:40.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.607+0000 7f7f22a00700 1 -- 172.21.15.142:0/3253910613 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f7f1c08eed0 con 0x7f7f2c100c30 2024-04-20T22:08:40.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.607+0000 7f7f29400700 1 --2- 172.21.15.142:0/3253910613 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7f1006ecd0 0x7f7f10071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:40.607 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.607+0000 7f7f29400700 1 --2- 172.21.15.142:0/3253910613 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7f1006ecd0 0x7f7f10071190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800b5c0 tx=0x7f7f18005160 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:40.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.611+0000 7f7f22a00700 1 -- 172.21.15.142:0/3253910613 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f7f1c05b690 con 0x7f7f2c100c30 2024-04-20T22:08:40.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.874+0000 7f7f31000700 1 -- 172.21.15.142:0/3253910613 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7f2c02cec0 con 0x7f7f2c100c30 2024-04-20T22:08:40.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.875+0000 7f7f22a00700 1 -- 172.21.15.142:0/3253910613 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1957 (secure 0 0 0) 0x7f7f1c05b220 con 0x7f7f2c100c30 2024-04-20T22:08:40.875 INFO:teuthology.orchestra.run.smithi142.stdout:e35 2024-04-20T22:08:40.875 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:08:40.875 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:08:40.876 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T22:08:40.876 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:08:40.876 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T22:08:40.876 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T22:08:40.876 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 35 2024-04-20T22:08:40.876 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:08:40.876 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:08:40.876 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T22:07:34.267651+0000 2024-04-20T22:08:40.876 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T22:08:40.876 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T22:08:40.876 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T22:08:40.876 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T22:08:40.876 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T22:08:40.876 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T22:08:40.877 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T22:08:40.877 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T22:08:40.877 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 85 2024-04-20T22:08:40.877 INFO:teuthology.orchestra.run.smithi142.stdout:snap_rstat 1 2024-04-20T22:08:40.877 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-20T22:08:40.877 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T22:08:40.877 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T22:08:40.877 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=34454} 2024-04-20T22:08:40.877 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T22:08:40.877 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T22:08:40.877 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T22:08:40.877 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T22:08:40.877 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T22:08:40.877 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T22:08:40.878 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T22:08:40.878 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T22:08:40.878 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T22:08:40.878 INFO:teuthology.orchestra.run.smithi142.stdout:qdb_cluster leader: 34454 members: 34454 2024-04-20T22:08:40.878 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:34454} state up:active seq 26 join_fscid=1 addr [v2:172.21.15.142:6826/2100080187,v1:172.21.15.142:6827/2100080187] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:08:40.878 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:08:40.878 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:08:40.878 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T22:08:40.878 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:08:40.878 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:34486} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6828/2960234081,v1:172.21.15.142:6829/2960234081] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:08:40.878 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.164:6824/1951894011,v1:172.21.15.164:6825/1951894011] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:08:40.878 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.164:6826/3399966592,v1:172.21.15.164:6827/3399966592] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:08:40.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.878+0000 7f7f31000700 1 -- 172.21.15.142:0/3253910613 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7f1006ecd0 msgr2=0x7f7f10071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:40.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.878+0000 7f7f31000700 1 --2- 172.21.15.142:0/3253910613 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7f1006ecd0 0x7f7f10071190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800b5c0 tx=0x7f7f18005160 comp rx=0 tx=0).stop 2024-04-20T22:08:40.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.878+0000 7f7f31000700 1 -- 172.21.15.142:0/3253910613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2c100c30 msgr2=0x7f7f2c196640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:40.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.878+0000 7f7f31000700 1 --2- 172.21.15.142:0/3253910613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2c100c30 0x7f7f2c196640 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00c8f0 tx=0x7f7f1c00ccb0 comp rx=0 tx=0).stop 2024-04-20T22:08:40.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.878+0000 7f7f31000700 1 -- 172.21.15.142:0/3253910613 shutdown_connections 2024-04-20T22:08:40.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.878+0000 7f7f31000700 1 --2- 172.21.15.142:0/3253910613 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7f1006ecd0 0x7f7f10071190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:40.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.878+0000 7f7f31000700 1 --2- 172.21.15.142:0/3253910613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2c100c30 0x7f7f2c196640 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:40.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.878+0000 7f7f31000700 1 --2- 172.21.15.142:0/3253910613 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7f2c101e30 0x7f7f2c196b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:40.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.878+0000 7f7f31000700 1 -- 172.21.15.142:0/3253910613 >> 172.21.15.142:0/3253910613 conn(0x7f7f2c0fc1f0 msgr2=0x7f7f2c1053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:40.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.879+0000 7f7f31000700 1 -- 172.21.15.142:0/3253910613 shutdown_connections 2024-04-20T22:08:40.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:40.879+0000 7f7f31000700 1 -- 172.21.15.142:0/3253910613 wait complete. 2024-04-20T22:08:40.880 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 35 2024-04-20T22:08:41.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.032+0000 7f0c4b200700 1 -- 172.21.15.142:0/4042970519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c4c101c40 msgr2=0x7f0c4c1020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:41.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.032+0000 7f0c4b200700 1 --2- 172.21.15.142:0/4042970519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c4c101c40 0x7f0c4c1020a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009910 tx=0x7f0c34009c20 comp rx=0 tx=0).stop 2024-04-20T22:08:41.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.032+0000 7f0c4b200700 1 -- 172.21.15.142:0/4042970519 shutdown_connections 2024-04-20T22:08:41.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.032+0000 7f0c4b200700 1 --2- 172.21.15.142:0/4042970519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c4c101c40 0x7f0c4c1020a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:41.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.032+0000 7f0c4b200700 1 --2- 172.21.15.142:0/4042970519 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c4c100a40 0x7f0c4c100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:41.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.032+0000 7f0c4b200700 1 -- 172.21.15.142:0/4042970519 >> 172.21.15.142:0/4042970519 conn(0x7f0c4c0fc000 msgr2=0x7f0c4c0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:41.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.032+0000 7f0c4b200700 1 -- 172.21.15.142:0/4042970519 shutdown_connections 2024-04-20T22:08:41.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.032+0000 7f0c4b200700 1 -- 172.21.15.142:0/4042970519 wait complete. 2024-04-20T22:08:41.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.034+0000 7f0c4b200700 1 Processor -- start 2024-04-20T22:08:41.033 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.034+0000 7f0c4b200700 1 -- start start 2024-04-20T22:08:41.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.034+0000 7f0c4b200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c4c100a40 0x7f0c4c198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:41.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.034+0000 7f0c4b200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c4c101c40 0x7f0c4c198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:41.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.034+0000 7f0c4b200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c1991e0 con 0x7f0c4c101c40 2024-04-20T22:08:41.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.034+0000 7f0c4b200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c199320 con 0x7f0c4c100a40 2024-04-20T22:08:41.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.034+0000 7f0c41400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c4c101c40 0x7f0c4c198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:41.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.035+0000 7f0c41400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c4c101c40 0x7f0c4c198bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40942/0 (socket says 172.21.15.142:40942) 2024-04-20T22:08:41.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.035+0000 7f0c41400700 1 -- 172.21.15.142:0/215572523 learned_addr learned my addr 172.21.15.142:0/215572523 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:08:41.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.035+0000 7f0c49e00700 1 --2- 172.21.15.142:0/215572523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c4c100a40 0x7f0c4c198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:41.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.035+0000 7f0c41400700 1 -- 172.21.15.142:0/215572523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c4c100a40 msgr2=0x7f0c4c198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:41.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.035+0000 7f0c41400700 1 --2- 172.21.15.142:0/215572523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c4c100a40 0x7f0c4c198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:41.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.035+0000 7f0c41400700 1 -- 172.21.15.142:0/215572523 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c340095f0 con 0x7f0c4c101c40 2024-04-20T22:08:41.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.035+0000 7f0c41400700 1 --2- 172.21.15.142:0/215572523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c4c101c40 0x7f0c4c198bc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0c34005b40 tx=0x7f0c3400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:41.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.036+0000 7f0c43400700 1 -- 172.21.15.142:0/215572523 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c3401d070 con 0x7f0c4c101c40 2024-04-20T22:08:41.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.036+0000 7f0c43400700 1 -- 172.21.15.142:0/215572523 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c340050d0 con 0x7f0c4c101c40 2024-04-20T22:08:41.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.036+0000 7f0c4b200700 1 -- 172.21.15.142:0/215572523 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4c19dcd0 con 0x7f0c4c101c40 2024-04-20T22:08:41.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.036+0000 7f0c43400700 1 -- 172.21.15.142:0/215572523 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c340226a0 con 0x7f0c4c101c40 2024-04-20T22:08:41.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.036+0000 7f0c4b200700 1 -- 172.21.15.142:0/215572523 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4c19e240 con 0x7f0c4c101c40 2024-04-20T22:08:41.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.037+0000 7f0c4b200700 1 -- 172.21.15.142:0/215572523 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4c106610 con 0x7f0c4c101c40 2024-04-20T22:08:41.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.038+0000 7f0c43400700 1 -- 172.21.15.142:0/215572523 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f0c34003680 con 0x7f0c4c101c40 2024-04-20T22:08:41.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.039+0000 7f0c43400700 1 --2- 172.21.15.142:0/215572523 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0c3006ecc0 0x7f0c30071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:41.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.039+0000 7f0c43400700 1 -- 172.21.15.142:0/215572523 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f0c340905f0 con 0x7f0c4c101c40 2024-04-20T22:08:41.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.039+0000 7f0c49e00700 1 --2- 172.21.15.142:0/215572523 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0c3006ecc0 0x7f0c30071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:41.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.040+0000 7f0c49e00700 1 --2- 172.21.15.142:0/215572523 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0c3006ecc0 0x7f0c30071180 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c101aa0 tx=0x7f0c3c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:41.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.044+0000 7f0c43400700 1 -- 172.21.15.142:0/215572523 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f0c3405cd30 con 0x7f0c4c101c40 2024-04-20T22:08:41.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.305+0000 7f0c4b200700 1 -- 172.21.15.142:0/215572523 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c4c02cef0 con 0x7f0c3006ecc0 2024-04-20T22:08:41.306 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.307+0000 7f0c43400700 1 -- 172.21.15.142:0/215572523 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+463 (secure 0 0 0) 0x7f0c4c02cef0 con 0x7f0c3006ecc0 2024-04-20T22:08:41.306 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:08:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T22:08:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T22:08:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T22:08:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T22:08:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: "mon", 2024-04-20T22:08:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: "mds", 2024-04-20T22:08:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr", 2024-04-20T22:08:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: "osd", 2024-04-20T22:08:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: "crash", 2024-04-20T22:08:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph-exporter" 2024-04-20T22:08:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T22:08:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "18/23 daemons upgraded", 2024-04-20T22:08:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading prometheus daemons", 2024-04-20T22:08:41.307 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T22:08:41.308 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:08:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.310+0000 7f0c4b200700 1 -- 172.21.15.142:0/215572523 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0c3006ecc0 msgr2=0x7f0c30071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.310+0000 7f0c4b200700 1 --2- 172.21.15.142:0/215572523 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0c3006ecc0 0x7f0c30071180 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c101aa0 tx=0x7f0c3c00b040 comp rx=0 tx=0).stop 2024-04-20T22:08:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.310+0000 7f0c4b200700 1 -- 172.21.15.142:0/215572523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c4c101c40 msgr2=0x7f0c4c198bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.310+0000 7f0c4b200700 1 --2- 172.21.15.142:0/215572523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c4c101c40 0x7f0c4c198bc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0c34005b40 tx=0x7f0c3400f740 comp rx=0 tx=0).stop 2024-04-20T22:08:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.310+0000 7f0c4b200700 1 -- 172.21.15.142:0/215572523 shutdown_connections 2024-04-20T22:08:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.310+0000 7f0c4b200700 1 --2- 172.21.15.142:0/215572523 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0c3006ecc0 0x7f0c30071180 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.310+0000 7f0c4b200700 1 --2- 172.21.15.142:0/215572523 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0c4c100a40 0x7f0c4c198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.310+0000 7f0c4b200700 1 --2- 172.21.15.142:0/215572523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c4c101c40 0x7f0c4c198bc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.310+0000 7f0c4b200700 1 -- 172.21.15.142:0/215572523 >> 172.21.15.142:0/215572523 conn(0x7f0c4c0fc000 msgr2=0x7f0c4c0734b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:41.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.310+0000 7f0c4b200700 1 -- 172.21.15.142:0/215572523 shutdown_connections 2024-04-20T22:08:41.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.310+0000 7f0c4b200700 1 -- 172.21.15.142:0/215572523 wait complete. 2024-04-20T22:08:41.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='client.34588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:08:41.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='client.34592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:08:41.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1592988873' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:41.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:41.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:08:41.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:08:41.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:41.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3253910613' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:08:41.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:08:41.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.448 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:41 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='client.34588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:08:41.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='client.34592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:08:41.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/1592988873' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:41.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:41.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:08:41.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:08:41.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:41.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3253910613' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:08:41.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:08:41.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.449 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:41 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.461+0000 7f8493600700 1 -- 172.21.15.142:0/597886054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f848c073940 msgr2=0x7f848c073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.461+0000 7f8493600700 1 --2- 172.21.15.142:0/597886054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f848c073940 0x7f848c073dc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8478009910 tx=0x7f8478009c20 comp rx=0 tx=0).stop 2024-04-20T22:08:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.461+0000 7f8493600700 1 -- 172.21.15.142:0/597886054 shutdown_connections 2024-04-20T22:08:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.461+0000 7f8493600700 1 --2- 172.21.15.142:0/597886054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f848c073940 0x7f848c073dc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.461+0000 7f8493600700 1 --2- 172.21.15.142:0/597886054 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f848c074f10 0x7f848c073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.461+0000 7f8493600700 1 -- 172.21.15.142:0/597886054 >> 172.21.15.142:0/597886054 conn(0x7f848c0fc1c0 msgr2=0x7f848c0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.461+0000 7f8493600700 1 -- 172.21.15.142:0/597886054 shutdown_connections 2024-04-20T22:08:41.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.461+0000 7f8493600700 1 -- 172.21.15.142:0/597886054 wait complete. 2024-04-20T22:08:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.463+0000 7f8493600700 1 Processor -- start 2024-04-20T22:08:41.462 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.463+0000 7f8493600700 1 -- start start 2024-04-20T22:08:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.463+0000 7f8493600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f848c073940 0x7f848c19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.463+0000 7f8493600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f848c074f10 0x7f848c19d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.463+0000 7f8493600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c19d780 con 0x7f848c073940 2024-04-20T22:08:41.463 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.463+0000 7f8493600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c19d8c0 con 0x7f848c074f10 2024-04-20T22:08:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.464+0000 7f8490c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f848c073940 0x7f848c19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.464+0000 7f8490c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f848c073940 0x7f848c19cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40958/0 (socket says 172.21.15.142:40958) 2024-04-20T22:08:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.464+0000 7f8490c00700 1 -- 172.21.15.142:0/1531116574 learned_addr learned my addr 172.21.15.142:0/1531116574 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:08:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.464+0000 7f848be00700 1 --2- 172.21.15.142:0/1531116574 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f848c074f10 0x7f848c19d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.464+0000 7f8490c00700 1 -- 172.21.15.142:0/1531116574 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f848c074f10 msgr2=0x7f848c19d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.464+0000 7f8490c00700 1 --2- 172.21.15.142:0/1531116574 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f848c074f10 0x7f848c19d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.464+0000 7f8490c00700 1 -- 172.21.15.142:0/1531116574 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84780095f0 con 0x7f848c073940 2024-04-20T22:08:41.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.464+0000 7f8490c00700 1 --2- 172.21.15.142:0/1531116574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f848c073940 0x7f848c19cc20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f848000c8f0 tx=0x7f848000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.465+0000 7f8489600700 1 -- 172.21.15.142:0/1531116574 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8480007a50 con 0x7f848c073940 2024-04-20T22:08:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.465+0000 7f8489600700 1 -- 172.21.15.142:0/1531116574 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8480007bb0 con 0x7f848c073940 2024-04-20T22:08:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.465+0000 7f8489600700 1 -- 172.21.15.142:0/1531116574 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8480018630 con 0x7f848c073940 2024-04-20T22:08:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.465+0000 7f8493600700 1 -- 172.21.15.142:0/1531116574 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848c1a2320 con 0x7f848c073940 2024-04-20T22:08:41.465 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.465+0000 7f8493600700 1 -- 172.21.15.142:0/1531116574 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848c1a28f0 con 0x7f848c073940 2024-04-20T22:08:41.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.466+0000 7f8493600700 1 -- 172.21.15.142:0/1531116574 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848c062510 con 0x7f848c073940 2024-04-20T22:08:41.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.468+0000 7f8489600700 1 -- 172.21.15.142:0/1531116574 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f8480007d20 con 0x7f848c073940 2024-04-20T22:08:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.469+0000 7f8489600700 1 --2- 172.21.15.142:0/1531116574 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f847406ecc0 0x7f8474071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:08:41.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.469+0000 7f8489600700 1 -- 172.21.15.142:0/1531116574 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f848008ef20 con 0x7f848c073940 2024-04-20T22:08:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.469+0000 7f848be00700 1 --2- 172.21.15.142:0/1531116574 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f847406ecc0 0x7f8474071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:08:41.469 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.470+0000 7f848be00700 1 --2- 172.21.15.142:0/1531116574 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f847406ecc0 0x7f8474071180 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8478006010 tx=0x7f847800b580 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:08:41.473 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.474+0000 7f8489600700 1 -- 172.21.15.142:0/1531116574 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f848005b6e0 con 0x7f848c073940 2024-04-20T22:08:41.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.791+0000 7f8493600700 1 -- 172.21.15.142:0/1531116574 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f848c10fd90 con 0x7f848c073940 2024-04-20T22:08:41.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.791+0000 7f8489600700 1 -- 172.21.15.142:0/1531116574 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f848005b270 con 0x7f848c073940 2024-04-20T22:08:41.791 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_OK 2024-04-20T22:08:41.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.795+0000 7f8493600700 1 -- 172.21.15.142:0/1531116574 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f847406ecc0 msgr2=0x7f8474071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:41.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.795+0000 7f8493600700 1 --2- 172.21.15.142:0/1531116574 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f847406ecc0 0x7f8474071180 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8478006010 tx=0x7f847800b580 comp rx=0 tx=0).stop 2024-04-20T22:08:41.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.795+0000 7f8493600700 1 -- 172.21.15.142:0/1531116574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f848c073940 msgr2=0x7f848c19cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:08:41.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.795+0000 7f8493600700 1 --2- 172.21.15.142:0/1531116574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f848c073940 0x7f848c19cc20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f848000c8f0 tx=0x7f848000ccb0 comp rx=0 tx=0).stop 2024-04-20T22:08:41.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.795+0000 7f8493600700 1 -- 172.21.15.142:0/1531116574 shutdown_connections 2024-04-20T22:08:41.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.795+0000 7f8493600700 1 --2- 172.21.15.142:0/1531116574 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f847406ecc0 0x7f8474071180 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:41.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.795+0000 7f8493600700 1 --2- 172.21.15.142:0/1531116574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f848c073940 0x7f848c19cc20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:41.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.795+0000 7f8493600700 1 --2- 172.21.15.142:0/1531116574 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f848c074f10 0x7f848c19d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:08:41.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.795+0000 7f8493600700 1 -- 172.21.15.142:0/1531116574 >> 172.21.15.142:0/1531116574 conn(0x7f848c0fc1c0 msgr2=0x7f848c102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:08:41.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.795+0000 7f8493600700 1 -- 172.21.15.142:0/1531116574 shutdown_connections 2024-04-20T22:08:41.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:08:41.795+0000 7f8493600700 1 -- 172.21.15.142:0/1531116574 wait complete. 2024-04-20T22:08:42.339 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:42 smithi142 ceph-mon[79401]: pgmap v291: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:42.340 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:42 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:42.340 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:42 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:42.340 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:42 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:42.340 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:42 smithi142 ceph-mon[79401]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:08:42.340 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:42 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1531116574' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:08:42.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:42 smithi164 ceph-mon[69784]: pgmap v291: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:42.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:42 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:42.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:42 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:42.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:42 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:08:42.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:42 smithi164 ceph-mon[69784]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:08:42.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:42 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/1531116574' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:08:44.524 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:44 smithi142 ceph-mon[79401]: pgmap v292: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:44.525 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:44 smithi142 ceph-mon[79401]: Upgrade: Updating prometheus.smithi142 2024-04-20T22:08:44.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:44 smithi164 ceph-mon[69784]: pgmap v292: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:44.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:44 smithi164 ceph-mon[69784]: Upgrade: Updating prometheus.smithi142 2024-04-20T22:08:45.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:45 smithi142 ceph-mon[79401]: Deploying daemon prometheus.smithi142 on smithi142 2024-04-20T22:08:45.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:08:45.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:45 smithi164 ceph-mon[69784]: Deploying daemon prometheus.smithi142 on smithi142 2024-04-20T22:08:45.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:08:46.501 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:46 smithi142 ceph-mon[79401]: pgmap v293: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:46.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:46 smithi164 ceph-mon[69784]: pgmap v293: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:48.587 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:48 smithi142 ceph-mon[79401]: pgmap v294: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:48.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:48 smithi164 ceph-mon[69784]: pgmap v294: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:50.514 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:50 smithi164 ceph-mon[69784]: pgmap v295: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:50.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:50 smithi142 ceph-mon[79401]: pgmap v295: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:52.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:52 smithi164 ceph-mon[69784]: pgmap v296: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:52.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:52 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:52.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:52 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:52.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:52 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:08:52.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:52 smithi142 ceph-mon[79401]: pgmap v296: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:52.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:52 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:52.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:52 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:52.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:52 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:08:54.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:54 smithi142 ceph-mon[79401]: pgmap v297: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:54.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:54 smithi164 ceph-mon[69784]: pgmap v297: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:56.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:56 smithi164 ceph-mon[69784]: pgmap v298: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:56.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:56 smithi142 ceph-mon[79401]: pgmap v298: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:58.501 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:58 smithi164 ceph-mon[69784]: pgmap v299: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:58.501 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:58 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:58.501 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:08:58 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:58.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:58 smithi142 ceph-mon[79401]: pgmap v299: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:08:58.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:58 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:08:58.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:08:58 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:00.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:00 smithi142 ceph-mon[79401]: pgmap v300: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:00.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:00 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:09:00.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:00 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:00.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:00 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:00.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:00 smithi164 ceph-mon[69784]: pgmap v300: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:00.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:00 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:09:00.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:00 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:00.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:00 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:02.574 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:02 smithi142 ceph-mon[79401]: pgmap v301: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:02.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:02 smithi164 ceph-mon[69784]: pgmap v301: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:04.550 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:04 smithi142 ceph-mon[79401]: pgmap v302: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:04.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:04 smithi164 ceph-mon[69784]: pgmap v302: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:06.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: pgmap v303: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:06.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:06.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:06.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:09:06.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:09:06.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:06.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-20T22:09:06.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:09:06.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.698 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.698 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: pgmap v303: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:06.699 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:06.699 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:06.699 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:09:06.699 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:09:06.699 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:06.699 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-20T22:09:06.699 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:09:06.699 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.699 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.700 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.700 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.700 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.700 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.700 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.700 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.700 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.700 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.700 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.700 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.700 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:06.700 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:07.335 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:07 smithi142 ceph-mon[79401]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-20T22:09:07.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:07 smithi164 ceph-mon[69784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-20T22:09:08.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:08 smithi142 ceph-mon[79401]: pgmap v304: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:08.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:08 smithi164 ceph-mon[69784]: pgmap v304: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:09.417 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:09 smithi142 ceph-mon[79401]: Upgrade: Updating alertmanager.smithi142 2024-04-20T22:09:09.417 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:09 smithi142 ceph-mon[79401]: Deploying daemon alertmanager.smithi142 on smithi142 2024-04-20T22:09:09.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:09 smithi164 ceph-mon[69784]: Upgrade: Updating alertmanager.smithi142 2024-04-20T22:09:09.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:09 smithi164 ceph-mon[69784]: Deploying daemon alertmanager.smithi142 on smithi142 2024-04-20T22:09:10.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:10 smithi142 ceph-mon[79401]: pgmap v305: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:10.573 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:10 smithi164 ceph-mon[69784]: pgmap v305: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:11.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.966+0000 7f433b000700 1 -- 172.21.15.142:0/483876621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4334100c00 msgr2=0x7f4334101020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:11.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.966+0000 7f433b000700 1 --2- 172.21.15.142:0/483876621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4334100c00 0x7f4334101020 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4324009910 tx=0x7f4324009c20 comp rx=0 tx=0).stop 2024-04-20T22:09:11.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.966+0000 7f433b000700 1 -- 172.21.15.142:0/483876621 shutdown_connections 2024-04-20T22:09:11.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.966+0000 7f433b000700 1 --2- 172.21.15.142:0/483876621 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4334101e00 0x7f4334102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:11.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.966+0000 7f433b000700 1 --2- 172.21.15.142:0/483876621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4334100c00 0x7f4334101020 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:11.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.966+0000 7f433b000700 1 -- 172.21.15.142:0/483876621 >> 172.21.15.142:0/483876621 conn(0x7f43340fc1c0 msgr2=0x7f43340fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:11.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.966+0000 7f433b000700 1 -- 172.21.15.142:0/483876621 shutdown_connections 2024-04-20T22:09:11.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.966+0000 7f433b000700 1 -- 172.21.15.142:0/483876621 wait complete. 2024-04-20T22:09:11.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.967+0000 7f433b000700 1 Processor -- start 2024-04-20T22:09:11.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.968+0000 7f433b000700 1 -- start start 2024-04-20T22:09:11.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.968+0000 7f433b000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4334100c00 0x7f4334198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:11.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.968+0000 7f433b000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4334101e00 0x7f4334198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:11.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.968+0000 7f433b000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43341993d0 con 0x7f4334101e00 2024-04-20T22:09:11.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.968+0000 7f433b000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4334199510 con 0x7f4334100c00 2024-04-20T22:09:11.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.968+0000 7f4333400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4334101e00 0x7f4334198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:11.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.968+0000 7f4333400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4334101e00 0x7f4334198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39600/0 (socket says 172.21.15.142:39600) 2024-04-20T22:09:11.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.968+0000 7f4333400700 1 -- 172.21.15.142:0/1391225083 learned_addr learned my addr 172.21.15.142:0/1391225083 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:09:11.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.969+0000 7f4333e00700 1 --2- 172.21.15.142:0/1391225083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4334100c00 0x7f4334198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:11.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.969+0000 7f4333400700 1 -- 172.21.15.142:0/1391225083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4334100c00 msgr2=0x7f4334198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:11.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.969+0000 7f4333400700 1 --2- 172.21.15.142:0/1391225083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4334100c00 0x7f4334198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:11.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.969+0000 7f4333400700 1 -- 172.21.15.142:0/1391225083 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43240095f0 con 0x7f4334101e00 2024-04-20T22:09:11.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.969+0000 7f4333400700 1 --2- 172.21.15.142:0/1391225083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4334101e00 0x7f4334198db0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f432000c8a0 tx=0x7f432000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:11.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.970+0000 7f4330c00700 1 -- 172.21.15.142:0/1391225083 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f432000cea0 con 0x7f4334101e00 2024-04-20T22:09:11.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.970+0000 7f4330c00700 1 -- 172.21.15.142:0/1391225083 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4320004830 con 0x7f4334101e00 2024-04-20T22:09:11.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.970+0000 7f433b000700 1 -- 172.21.15.142:0/1391225083 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433419df20 con 0x7f4334101e00 2024-04-20T22:09:11.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.970+0000 7f4330c00700 1 -- 172.21.15.142:0/1391225083 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43200055b0 con 0x7f4334101e00 2024-04-20T22:09:11.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.970+0000 7f433b000700 1 -- 172.21.15.142:0/1391225083 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433419e4c0 con 0x7f4334101e00 2024-04-20T22:09:11.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.971+0000 7f433b000700 1 -- 172.21.15.142:0/1391225083 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43341067d0 con 0x7f4334101e00 2024-04-20T22:09:11.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.972+0000 7f4330c00700 1 -- 172.21.15.142:0/1391225083 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f43200049a0 con 0x7f4334101e00 2024-04-20T22:09:11.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.973+0000 7f4330c00700 1 --2- 172.21.15.142:0/1391225083 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f431806ecc0 0x7f4318071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:11.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.973+0000 7f4330c00700 1 -- 172.21.15.142:0/1391225083 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f432008ebf0 con 0x7f4334101e00 2024-04-20T22:09:11.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.974+0000 7f4333e00700 1 --2- 172.21.15.142:0/1391225083 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f431806ecc0 0x7f4318071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:11.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.975+0000 7f4333e00700 1 --2- 172.21.15.142:0/1391225083 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f431806ecc0 0x7f4318071180 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4324006010 tx=0x7f432400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:11.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:11.979+0000 7f4330c00700 1 -- 172.21.15.142:0/1391225083 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f432005b3b0 con 0x7f4334101e00 2024-04-20T22:09:12.225 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.225+0000 7f433b000700 1 -- 172.21.15.142:0/1391225083 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f433402ceb0 con 0x7f431806ecc0 2024-04-20T22:09:12.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.228+0000 7f4330c00700 1 -- 172.21.15.142:0/1391225083 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7f433402ceb0 con 0x7f431806ecc0 2024-04-20T22:09:12.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.231+0000 7f433b000700 1 -- 172.21.15.142:0/1391225083 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f431806ecc0 msgr2=0x7f4318071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:12.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.231+0000 7f433b000700 1 --2- 172.21.15.142:0/1391225083 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f431806ecc0 0x7f4318071180 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4324006010 tx=0x7f432400b540 comp rx=0 tx=0).stop 2024-04-20T22:09:12.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.231+0000 7f433b000700 1 -- 172.21.15.142:0/1391225083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4334101e00 msgr2=0x7f4334198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:12.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.231+0000 7f433b000700 1 --2- 172.21.15.142:0/1391225083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4334101e00 0x7f4334198db0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f432000c8a0 tx=0x7f432000cc60 comp rx=0 tx=0).stop 2024-04-20T22:09:12.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.231+0000 7f433b000700 1 -- 172.21.15.142:0/1391225083 shutdown_connections 2024-04-20T22:09:12.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.231+0000 7f433b000700 1 --2- 172.21.15.142:0/1391225083 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f431806ecc0 0x7f4318071180 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:12.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.231+0000 7f433b000700 1 --2- 172.21.15.142:0/1391225083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4334100c00 0x7f4334198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:12.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.231+0000 7f433b000700 1 --2- 172.21.15.142:0/1391225083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4334101e00 0x7f4334198db0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:12.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.231+0000 7f433b000700 1 -- 172.21.15.142:0/1391225083 >> 172.21.15.142:0/1391225083 conn(0x7f43340fc1c0 msgr2=0x7f43340734e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:12.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.231+0000 7f433b000700 1 -- 172.21.15.142:0/1391225083 shutdown_connections 2024-04-20T22:09:12.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.232+0000 7f433b000700 1 -- 172.21.15.142:0/1391225083 wait complete. 2024-04-20T22:09:12.247 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T22:09:12.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.388+0000 7fb272a00700 1 -- 172.21.15.142:0/1712613037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb26c103e00 msgr2=0x7fb26c1061f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:12.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.388+0000 7fb272a00700 1 --2- 172.21.15.142:0/1712613037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb26c103e00 0x7fb26c1061f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb258009910 tx=0x7fb258009c20 comp rx=0 tx=0).stop 2024-04-20T22:09:12.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.388+0000 7fb272a00700 1 -- 172.21.15.142:0/1712613037 shutdown_connections 2024-04-20T22:09:12.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.388+0000 7fb272a00700 1 --2- 172.21.15.142:0/1712613037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb26c103e00 0x7fb26c1061f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:12.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.388+0000 7fb272a00700 1 --2- 172.21.15.142:0/1712613037 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb26c1014d0 0x7fb26c1038c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:12.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.388+0000 7fb272a00700 1 -- 172.21.15.142:0/1712613037 >> 172.21.15.142:0/1712613037 conn(0x7fb26c0faee0 msgr2=0x7fb26c0fd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:12.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.388+0000 7fb272a00700 1 -- 172.21.15.142:0/1712613037 shutdown_connections 2024-04-20T22:09:12.389 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.388+0000 7fb272a00700 1 -- 172.21.15.142:0/1712613037 wait complete. 2024-04-20T22:09:12.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.389+0000 7fb272a00700 1 Processor -- start 2024-04-20T22:09:12.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.390+0000 7fb272a00700 1 -- start start 2024-04-20T22:09:12.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.390+0000 7fb272a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb26c1014d0 0x7fb26c198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:12.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.390+0000 7fb272a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb26c103e00 0x7fb26c198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:12.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.390+0000 7fb272a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c199190 con 0x7fb26c103e00 2024-04-20T22:09:12.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.390+0000 7fb272a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c1992d0 con 0x7fb26c1014d0 2024-04-20T22:09:12.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.390+0000 7fb270c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb26c103e00 0x7fb26c198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:12.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.390+0000 7fb270c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb26c103e00 0x7fb26c198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39610/0 (socket says 172.21.15.142:39610) 2024-04-20T22:09:12.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.390+0000 7fb270c00700 1 -- 172.21.15.142:0/705581753 learned_addr learned my addr 172.21.15.142:0/705581753 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:09:12.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.391+0000 7fb271600700 1 --2- 172.21.15.142:0/705581753 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb26c1014d0 0x7fb26c198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:12.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.391+0000 7fb270c00700 1 -- 172.21.15.142:0/705581753 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb26c1014d0 msgr2=0x7fb26c198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:12.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.391+0000 7fb270c00700 1 --2- 172.21.15.142:0/705581753 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb26c1014d0 0x7fb26c198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:12.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.391+0000 7fb270c00700 1 -- 172.21.15.142:0/705581753 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2580095f0 con 0x7fb26c103e00 2024-04-20T22:09:12.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.391+0000 7fb271600700 1 --2- 172.21.15.142:0/705581753 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb26c1014d0 0x7fb26c198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:09:12.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.391+0000 7fb270c00700 1 --2- 172.21.15.142:0/705581753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb26c103e00 0x7fb26c198b70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb25800bd70 tx=0x7fb25800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:12.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.391+0000 7fb26a000700 1 -- 172.21.15.142:0/705581753 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb25801d070 con 0x7fb26c103e00 2024-04-20T22:09:12.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.391+0000 7fb26a000700 1 -- 172.21.15.142:0/705581753 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb25800f460 con 0x7fb26c103e00 2024-04-20T22:09:12.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.391+0000 7fb272a00700 1 -- 172.21.15.142:0/705581753 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26c19dcd0 con 0x7fb26c103e00 2024-04-20T22:09:12.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.391+0000 7fb26a000700 1 -- 172.21.15.142:0/705581753 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb258021620 con 0x7fb26c103e00 2024-04-20T22:09:12.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.392+0000 7fb272a00700 1 -- 172.21.15.142:0/705581753 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26c19e240 con 0x7fb26c103e00 2024-04-20T22:09:12.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.393+0000 7fb272a00700 1 -- 172.21.15.142:0/705581753 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26c062510 con 0x7fb26c103e00 2024-04-20T22:09:12.393 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.394+0000 7fb26a000700 1 -- 172.21.15.142:0/705581753 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fb25800fa70 con 0x7fb26c103e00 2024-04-20T22:09:12.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.394+0000 7fb26a000700 1 --2- 172.21.15.142:0/705581753 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb25406ecc0 0x7fb254071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:12.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.395+0000 7fb26a000700 1 -- 172.21.15.142:0/705581753 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fb2580903b0 con 0x7fb26c103e00 2024-04-20T22:09:12.394 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.395+0000 7fb271600700 1 --2- 172.21.15.142:0/705581753 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb25406ecc0 0x7fb254071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:12.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.395+0000 7fb271600700 1 --2- 172.21.15.142:0/705581753 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb25406ecc0 0x7fb254071180 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb260005fd0 tx=0x7fb260005dc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:12.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.399+0000 7fb26a000700 1 -- 172.21.15.142:0/705581753 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fb25805caf0 con 0x7fb26c103e00 2024-04-20T22:09:12.481 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:12 smithi142 ceph-mon[79401]: pgmap v306: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:12.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.664+0000 7fb272a00700 1 -- 172.21.15.142:0/705581753 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb26c0ffd30 con 0x7fb25406ecc0 2024-04-20T22:09:12.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.666+0000 7fb26a000700 1 -- 172.21.15.142:0/705581753 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7fb26c0ffd30 con 0x7fb25406ecc0 2024-04-20T22:09:12.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.669+0000 7fb272a00700 1 -- 172.21.15.142:0/705581753 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb25406ecc0 msgr2=0x7fb254071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:12.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.669+0000 7fb272a00700 1 --2- 172.21.15.142:0/705581753 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb25406ecc0 0x7fb254071180 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb260005fd0 tx=0x7fb260005dc0 comp rx=0 tx=0).stop 2024-04-20T22:09:12.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.669+0000 7fb272a00700 1 -- 172.21.15.142:0/705581753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb26c103e00 msgr2=0x7fb26c198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:12.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.669+0000 7fb272a00700 1 --2- 172.21.15.142:0/705581753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb26c103e00 0x7fb26c198b70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb25800bd70 tx=0x7fb25800be50 comp rx=0 tx=0).stop 2024-04-20T22:09:12.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.669+0000 7fb272a00700 1 -- 172.21.15.142:0/705581753 shutdown_connections 2024-04-20T22:09:12.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.669+0000 7fb272a00700 1 --2- 172.21.15.142:0/705581753 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fb25406ecc0 0x7fb254071180 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:12.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.669+0000 7fb272a00700 1 --2- 172.21.15.142:0/705581753 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb26c1014d0 0x7fb26c198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:12.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.669+0000 7fb272a00700 1 --2- 172.21.15.142:0/705581753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb26c103e00 0x7fb26c198b70 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:12.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.669+0000 7fb272a00700 1 -- 172.21.15.142:0/705581753 >> 172.21.15.142:0/705581753 conn(0x7fb26c0faee0 msgr2=0x7fb26c0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:12.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.670+0000 7fb272a00700 1 -- 172.21.15.142:0/705581753 shutdown_connections 2024-04-20T22:09:12.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.670+0000 7fb272a00700 1 -- 172.21.15.142:0/705581753 wait complete. 2024-04-20T22:09:12.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:12 smithi164 ceph-mon[69784]: pgmap v306: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:12.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.867+0000 7fd1b3a00700 1 -- 172.21.15.142:0/263238484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1ac101680 msgr2=0x7fd1ac103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:12.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.867+0000 7fd1b3a00700 1 --2- 172.21.15.142:0/263238484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1ac101680 0x7fd1ac103a70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009910 tx=0x7fd1a0009c20 comp rx=0 tx=0).stop 2024-04-20T22:09:12.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.867+0000 7fd1b3a00700 1 -- 172.21.15.142:0/263238484 shutdown_connections 2024-04-20T22:09:12.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.867+0000 7fd1b3a00700 1 --2- 172.21.15.142:0/263238484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1ac103fb0 0x7fd1ac1063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:12.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.867+0000 7fd1b3a00700 1 --2- 172.21.15.142:0/263238484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1ac101680 0x7fd1ac103a70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:12.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.867+0000 7fd1b3a00700 1 -- 172.21.15.142:0/263238484 >> 172.21.15.142:0/263238484 conn(0x7fd1ac0fb0d0 msgr2=0x7fd1ac0fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:12.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.867+0000 7fd1b3a00700 1 -- 172.21.15.142:0/263238484 shutdown_connections 2024-04-20T22:09:12.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.867+0000 7fd1b3a00700 1 -- 172.21.15.142:0/263238484 wait complete. 2024-04-20T22:09:12.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.868+0000 7fd1b3a00700 1 Processor -- start 2024-04-20T22:09:12.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.869+0000 7fd1b3a00700 1 -- start start 2024-04-20T22:09:12.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.869+0000 7fd1b3a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1ac101680 0x7fd1ac100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:12.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.869+0000 7fd1b3a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1ac103fb0 0x7fd1ac0ff630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:12.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.869+0000 7fd1b3a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0ffb70 con 0x7fd1ac101680 2024-04-20T22:09:12.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.869+0000 7fd1b3a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0ffcb0 con 0x7fd1ac103fb0 2024-04-20T22:09:12.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.869+0000 7fd1b1000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1ac101680 0x7fd1ac100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:12.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.869+0000 7fd1b1000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1ac101680 0x7fd1ac100f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39616/0 (socket says 172.21.15.142:39616) 2024-04-20T22:09:12.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.869+0000 7fd1b1000700 1 -- 172.21.15.142:0/3638015363 learned_addr learned my addr 172.21.15.142:0/3638015363 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:09:12.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.870+0000 7fd1b1000700 1 -- 172.21.15.142:0/3638015363 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1ac103fb0 msgr2=0x7fd1ac0ff630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:12.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.870+0000 7fd1b1000700 1 --2- 172.21.15.142:0/3638015363 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1ac103fb0 0x7fd1ac0ff630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:12.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.870+0000 7fd1b1000700 1 -- 172.21.15.142:0/3638015363 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a00095f0 con 0x7fd1ac101680 2024-04-20T22:09:12.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.870+0000 7fd1b1000700 1 --2- 172.21.15.142:0/3638015363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1ac101680 0x7fd1ac100f90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0006010 tx=0x7fd1a000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:12.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.870+0000 7fd1a9600700 1 -- 172.21.15.142:0/3638015363 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1a001d070 con 0x7fd1ac101680 2024-04-20T22:09:12.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.870+0000 7fd1a9600700 1 -- 172.21.15.142:0/3638015363 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd1a000f460 con 0x7fd1ac101680 2024-04-20T22:09:12.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.870+0000 7fd1b3a00700 1 -- 172.21.15.142:0/3638015363 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ac0fff30 con 0x7fd1ac101680 2024-04-20T22:09:12.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.870+0000 7fd1a9600700 1 -- 172.21.15.142:0/3638015363 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1a0021640 con 0x7fd1ac101680 2024-04-20T22:09:12.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.870+0000 7fd1b3a00700 1 -- 172.21.15.142:0/3638015363 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ac1004a0 con 0x7fd1ac101680 2024-04-20T22:09:12.873 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.872+0000 7fd1b3a00700 1 -- 172.21.15.142:0/3638015363 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ac062510 con 0x7fd1ac101680 2024-04-20T22:09:12.874 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.873+0000 7fd1a9600700 1 -- 172.21.15.142:0/3638015363 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fd1a000fab0 con 0x7fd1ac101680 2024-04-20T22:09:12.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.873+0000 7fd1a9600700 1 --2- 172.21.15.142:0/3638015363 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd19406ecc0 0x7fd194071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:12.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.874+0000 7fd1a9600700 1 -- 172.21.15.142:0/3638015363 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fd1a00900d0 con 0x7fd1ac101680 2024-04-20T22:09:12.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.874+0000 7fd1abe00700 1 --2- 172.21.15.142:0/3638015363 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd19406ecc0 0x7fd194071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:12.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.875+0000 7fd1abe00700 1 --2- 172.21.15.142:0/3638015363 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd19406ecc0 0x7fd194071180 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd19800a990 tx=0x7fd198005c80 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:12.878 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:12.878+0000 7fd1a9600700 1 -- 172.21.15.142:0/3638015363 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fd1a005c930 con 0x7fd1ac101680 2024-04-20T22:09:13.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.116+0000 7fd1b3a00700 1 -- 172.21.15.142:0/3638015363 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1ac1004a0 con 0x7fd19406ecc0 2024-04-20T22:09:13.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.147+0000 7fd1a9600700 1 -- 172.21.15.142:0/3638015363 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fd1ac1004a0 con 0x7fd19406ecc0 2024-04-20T22:09:13.147 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:09:13.147 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (19m) 15s ago 21m 14.4M - 0.25.0 c8568f914cd2 673723c56b84 2024-04-20T22:09:13.147 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (81s) 15s ago 22m 7944k - 19.0.0-3133-ga8c84f59 76bc6b91b726 eadbb8123608 2024-04-20T22:09:13.147 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (74s) 42s ago 20m 7638k - 19.0.0-3133-ga8c84f59 76bc6b91b726 13030cc1a7a8 2024-04-20T22:09:13.147 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (7m) 15s ago 22m 6665k - 19.0.0-3133-ga8c84f59 76bc6b91b726 64521ed7125b 2024-04-20T22:09:13.147 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (7m) 42s ago 20m 6656k - 19.0.0-3133-ga8c84f59 76bc6b91b726 893c6f16ee6d 2024-04-20T22:09:13.148 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (19m) 15s ago 21m 74.9M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T22:09:13.148 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (3m) 15s ago 14m 87.3M - 19.0.0-3133-ga8c84f59 76bc6b91b726 603d9ff4accc 2024-04-20T22:09:13.148 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (2m) 15s ago 14m 12.9M - 19.0.0-3133-ga8c84f59 76bc6b91b726 5fbbe225e911 2024-04-20T22:09:13.148 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (102s) 42s ago 14m 12.2M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3ee3d509a48c 2024-04-20T22:09:13.148 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (2m) 42s ago 14m 12.4M - 19.0.0-3133-ga8c84f59 76bc6b91b726 44901e1ad990 2024-04-20T22:09:13.148 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (11m) 15s ago 23m 515M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:09:13.148 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (9m) 42s ago 20m 454M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:09:13.148 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (9m) 15s ago 23m 60.3M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 af10a542c918 2024-04-20T22:09:13.148 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (8m) 42s ago 20m 43.5M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 133512694d46 2024-04-20T22:09:13.148 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (53s) 15s ago 21m 6912k - 1.5.0 0da6a335fe13 f21ef73493a2 2024-04-20T22:09:13.148 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (46s) 42s ago 20m 2843k - 1.5.0 0da6a335fe13 0ba09db59c8e 2024-04-20T22:09:13.148 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (6m) 15s ago 19m 107M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 b7206d05a7cd 2024-04-20T22:09:13.148 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (6m) 15s ago 18m 107M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 82bcc0c46762 2024-04-20T22:09:13.148 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (5m) 15s ago 18m 94.5M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 3e2d91f49494 2024-04-20T22:09:13.149 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (5m) 42s ago 17m 119M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 a898b8b77c51 2024-04-20T22:09:13.149 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (4m) 42s ago 16m 103M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 539c4026f9fb 2024-04-20T22:09:13.149 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (3m) 42s ago 16m 95.8M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 ac1bdd69c944 2024-04-20T22:09:13.149 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (22s) 15s ago 21m 46.5M - 2.43.0 a07b618ecd1d 2b3da2d4dfc7 2024-04-20T22:09:13.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.150+0000 7fd1b3a00700 1 -- 172.21.15.142:0/3638015363 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd19406ecc0 msgr2=0x7fd194071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:13.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.150+0000 7fd1b3a00700 1 --2- 172.21.15.142:0/3638015363 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd19406ecc0 0x7fd194071180 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd19800a990 tx=0x7fd198005c80 comp rx=0 tx=0).stop 2024-04-20T22:09:13.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.150+0000 7fd1b3a00700 1 -- 172.21.15.142:0/3638015363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1ac101680 msgr2=0x7fd1ac100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:13.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.150+0000 7fd1b3a00700 1 --2- 172.21.15.142:0/3638015363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1ac101680 0x7fd1ac100f90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0006010 tx=0x7fd1a000be20 comp rx=0 tx=0).stop 2024-04-20T22:09:13.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.150+0000 7fd1b3a00700 1 -- 172.21.15.142:0/3638015363 shutdown_connections 2024-04-20T22:09:13.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.150+0000 7fd1b3a00700 1 --2- 172.21.15.142:0/3638015363 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd19406ecc0 0x7fd194071180 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:13.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.150+0000 7fd1b3a00700 1 --2- 172.21.15.142:0/3638015363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1ac101680 0x7fd1ac100f90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:13.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.150+0000 7fd1b3a00700 1 --2- 172.21.15.142:0/3638015363 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd1ac103fb0 0x7fd1ac0ff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:13.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.150+0000 7fd1b3a00700 1 -- 172.21.15.142:0/3638015363 >> 172.21.15.142:0/3638015363 conn(0x7fd1ac0fb0d0 msgr2=0x7fd1ac0fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:13.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.150+0000 7fd1b3a00700 1 -- 172.21.15.142:0/3638015363 shutdown_connections 2024-04-20T22:09:13.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.150+0000 7fd1b3a00700 1 -- 172.21.15.142:0/3638015363 wait complete. 2024-04-20T22:09:13.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.304+0000 7f8422800700 1 -- 172.21.15.142:0/659849535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f841c102e50 msgr2=0x7f841c103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:13.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.304+0000 7f8422800700 1 --2- 172.21.15.142:0/659849535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f841c102e50 0x7f841c103270 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f840c009910 tx=0x7f840c009c20 comp rx=0 tx=0).stop 2024-04-20T22:09:13.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.304+0000 7f8422800700 1 -- 172.21.15.142:0/659849535 shutdown_connections 2024-04-20T22:09:13.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.304+0000 7f8422800700 1 --2- 172.21.15.142:0/659849535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f841c103fb0 0x7f841c104430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:13.304 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.304+0000 7f8422800700 1 --2- 172.21.15.142:0/659849535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f841c102e50 0x7f841c103270 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:13.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.304+0000 7f8422800700 1 -- 172.21.15.142:0/659849535 >> 172.21.15.142:0/659849535 conn(0x7f841c0fe3d0 msgr2=0x7f841c100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:13.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.304+0000 7f8422800700 1 -- 172.21.15.142:0/659849535 shutdown_connections 2024-04-20T22:09:13.305 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.304+0000 7f8422800700 1 -- 172.21.15.142:0/659849535 wait complete. 2024-04-20T22:09:13.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.305+0000 7f8422800700 1 Processor -- start 2024-04-20T22:09:13.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.305+0000 7f8422800700 1 -- start start 2024-04-20T22:09:13.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.306+0000 7f8422800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f841c102e50 0x7f841c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:13.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.306+0000 7f8422800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f841c103fb0 0x7f841c198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:13.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.306+0000 7f8422800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c1992b0 con 0x7f841c103fb0 2024-04-20T22:09:13.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.306+0000 7f8422800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c1993f0 con 0x7f841c102e50 2024-04-20T22:09:13.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.306+0000 7f841aa00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f841c103fb0 0x7f841c198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:13.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.306+0000 7f841aa00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f841c103fb0 0x7f841c198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39632/0 (socket says 172.21.15.142:39632) 2024-04-20T22:09:13.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.306+0000 7f841aa00700 1 -- 172.21.15.142:0/2110347674 learned_addr learned my addr 172.21.15.142:0/2110347674 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:09:13.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.306+0000 7f841b400700 1 --2- 172.21.15.142:0/2110347674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f841c102e50 0x7f841c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:13.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.307+0000 7f841aa00700 1 -- 172.21.15.142:0/2110347674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f841c102e50 msgr2=0x7f841c1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:13.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.307+0000 7f841aa00700 1 --2- 172.21.15.142:0/2110347674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f841c102e50 0x7f841c1987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:13.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.307+0000 7f841aa00700 1 -- 172.21.15.142:0/2110347674 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c0095f0 con 0x7f841c103fb0 2024-04-20T22:09:13.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.307+0000 7f841b400700 1 --2- 172.21.15.142:0/2110347674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f841c102e50 0x7f841c1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:09:13.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.307+0000 7f841aa00700 1 --2- 172.21.15.142:0/2110347674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f841c103fb0 0x7f841c198d20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f840800c930 tx=0x7f840800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:13.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.307+0000 7f8413e00700 1 -- 172.21.15.142:0/2110347674 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8408007ad0 con 0x7f841c103fb0 2024-04-20T22:09:13.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.307+0000 7f8413e00700 1 -- 172.21.15.142:0/2110347674 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8408007c30 con 0x7f841c103fb0 2024-04-20T22:09:13.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.307+0000 7f8422800700 1 -- 172.21.15.142:0/2110347674 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f841c19de60 con 0x7f841c103fb0 2024-04-20T22:09:13.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.307+0000 7f8413e00700 1 -- 172.21.15.142:0/2110347674 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8408018610 con 0x7f841c103fb0 2024-04-20T22:09:13.308 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.307+0000 7f8422800700 1 -- 172.21.15.142:0/2110347674 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841c19e400 con 0x7f841c103fb0 2024-04-20T22:09:13.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.309+0000 7f8422800700 1 -- 172.21.15.142:0/2110347674 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841c192950 con 0x7f841c103fb0 2024-04-20T22:09:13.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.310+0000 7f8413e00700 1 -- 172.21.15.142:0/2110347674 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f840800f450 con 0x7f841c103fb0 2024-04-20T22:09:13.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.311+0000 7f8413e00700 1 --2- 172.21.15.142:0/2110347674 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f840006ecd0 0x7f8400071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:13.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.311+0000 7f8413e00700 1 -- 172.21.15.142:0/2110347674 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f840808f1e0 con 0x7f841c103fb0 2024-04-20T22:09:13.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.312+0000 7f841b400700 1 --2- 172.21.15.142:0/2110347674 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f840006ecd0 0x7f8400071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:13.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.312+0000 7f841b400700 1 --2- 172.21.15.142:0/2110347674 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f840006ecd0 0x7f8400071190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f840c00b5c0 tx=0x7f840c005180 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:13.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.317+0000 7f8413e00700 1 -- 172.21.15.142:0/2110347674 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f840805b960 con 0x7f841c103fb0 2024-04-20T22:09:13.390 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:13 smithi142 ceph-mon[79401]: from='client.34612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:09:13.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.627+0000 7f8422800700 1 -- 172.21.15.142:0/2110347674 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f841c10b930 con 0x7f841c103fb0 2024-04-20T22:09:13.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.628+0000 7f8413e00700 1 -- 172.21.15.142:0/2110347674 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f840805b4f0 con 0x7f841c103fb0 2024-04-20T22:09:13.628 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:09:13.628 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:09:13.628 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:09:13.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:09:13.628 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:09:13.628 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:09:13.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:09:13.628 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:09:13.629 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 6 2024-04-20T22:09:13.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:09:13.629 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:09:13.629 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 4 2024-04-20T22:09:13.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:09:13.629 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:09:13.629 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 14 2024-04-20T22:09:13.629 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:09:13.629 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:09:13.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.631+0000 7f8422800700 1 -- 172.21.15.142:0/2110347674 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f840006ecd0 msgr2=0x7f8400071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:13.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.631+0000 7f8422800700 1 --2- 172.21.15.142:0/2110347674 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f840006ecd0 0x7f8400071190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f840c00b5c0 tx=0x7f840c005180 comp rx=0 tx=0).stop 2024-04-20T22:09:13.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.631+0000 7f8422800700 1 -- 172.21.15.142:0/2110347674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f841c103fb0 msgr2=0x7f841c198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:13.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.631+0000 7f8422800700 1 --2- 172.21.15.142:0/2110347674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f841c103fb0 0x7f841c198d20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f840800c930 tx=0x7f840800ccf0 comp rx=0 tx=0).stop 2024-04-20T22:09:13.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.631+0000 7f8422800700 1 -- 172.21.15.142:0/2110347674 shutdown_connections 2024-04-20T22:09:13.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.631+0000 7f8422800700 1 --2- 172.21.15.142:0/2110347674 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f840006ecd0 0x7f8400071190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:13.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.631+0000 7f8422800700 1 --2- 172.21.15.142:0/2110347674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f841c102e50 0x7f841c1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:13.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.631+0000 7f8422800700 1 --2- 172.21.15.142:0/2110347674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f841c103fb0 0x7f841c198d20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:13.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.631+0000 7f8422800700 1 -- 172.21.15.142:0/2110347674 >> 172.21.15.142:0/2110347674 conn(0x7f841c0fe3d0 msgr2=0x7f841c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:13.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.631+0000 7f8422800700 1 -- 172.21.15.142:0/2110347674 shutdown_connections 2024-04-20T22:09:13.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.632+0000 7f8422800700 1 -- 172.21.15.142:0/2110347674 wait complete. 2024-04-20T22:09:13.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:13 smithi164 ceph-mon[69784]: from='client.34612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:09:13.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.790+0000 7f21cf400700 1 -- 172.21.15.142:0/1020362682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c8103ff0 msgr2=0x7f21c81063e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:13.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.790+0000 7f21cf400700 1 --2- 172.21.15.142:0/1020362682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c8103ff0 0x7f21c81063e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009910 tx=0x7f21b4009c20 comp rx=0 tx=0).stop 2024-04-20T22:09:13.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.790+0000 7f21cf400700 1 -- 172.21.15.142:0/1020362682 shutdown_connections 2024-04-20T22:09:13.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.790+0000 7f21cf400700 1 --2- 172.21.15.142:0/1020362682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c8103ff0 0x7f21c81063e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:13.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.790+0000 7f21cf400700 1 --2- 172.21.15.142:0/1020362682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21c81016c0 0x7f21c8103ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:13.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.790+0000 7f21cf400700 1 -- 172.21.15.142:0/1020362682 >> 172.21.15.142:0/1020362682 conn(0x7f21c80fb0d0 msgr2=0x7f21c80fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:13.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.790+0000 7f21cf400700 1 -- 172.21.15.142:0/1020362682 shutdown_connections 2024-04-20T22:09:13.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.790+0000 7f21cf400700 1 -- 172.21.15.142:0/1020362682 wait complete. 2024-04-20T22:09:13.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.791+0000 7f21cf400700 1 Processor -- start 2024-04-20T22:09:13.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.791+0000 7f21cf400700 1 -- start start 2024-04-20T22:09:13.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.792+0000 7f21cf400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c81016c0 0x7f21c8100fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:13.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.792+0000 7f21cf400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21c8103ff0 0x7f21c80ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:13.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.792+0000 7f21cf400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c80ffbb0 con 0x7f21c81016c0 2024-04-20T22:09:13.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.792+0000 7f21cf400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c80ffcf0 con 0x7f21c8103ff0 2024-04-20T22:09:13.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.792+0000 7f21cca00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c81016c0 0x7f21c8100fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:13.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.792+0000 7f21cca00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c81016c0 0x7f21c8100fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39650/0 (socket says 172.21.15.142:39650) 2024-04-20T22:09:13.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.792+0000 7f21cca00700 1 -- 172.21.15.142:0/3290685858 learned_addr learned my addr 172.21.15.142:0/3290685858 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:09:13.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.792+0000 7f21c7e00700 1 --2- 172.21.15.142:0/3290685858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21c8103ff0 0x7f21c80ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:13.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.793+0000 7f21cca00700 1 -- 172.21.15.142:0/3290685858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21c8103ff0 msgr2=0x7f21c80ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:13.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.793+0000 7f21cca00700 1 --2- 172.21.15.142:0/3290685858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21c8103ff0 0x7f21c80ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:13.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.793+0000 7f21cca00700 1 -- 172.21.15.142:0/3290685858 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b40095f0 con 0x7f21c81016c0 2024-04-20T22:09:13.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.793+0000 7f21c7e00700 1 --2- 172.21.15.142:0/3290685858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21c8103ff0 0x7f21c80ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:09:13.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.793+0000 7f21cca00700 1 --2- 172.21.15.142:0/3290685858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c81016c0 0x7f21c8100fd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00d8d0 tx=0x7f21bc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:13.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.793+0000 7f21c5600700 1 -- 172.21.15.142:0/3290685858 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21bc009940 con 0x7f21c81016c0 2024-04-20T22:09:13.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.793+0000 7f21c5600700 1 -- 172.21.15.142:0/3290685858 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f21bc010460 con 0x7f21c81016c0 2024-04-20T22:09:13.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.793+0000 7f21c5600700 1 -- 172.21.15.142:0/3290685858 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21bc00f5f0 con 0x7f21c81016c0 2024-04-20T22:09:13.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.793+0000 7f21cf400700 1 -- 172.21.15.142:0/3290685858 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c80fffd0 con 0x7f21c81016c0 2024-04-20T22:09:13.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.793+0000 7f21cf400700 1 -- 172.21.15.142:0/3290685858 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c819e620 con 0x7f21c81016c0 2024-04-20T22:09:13.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.795+0000 7f21cf400700 1 -- 172.21.15.142:0/3290685858 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c8062510 con 0x7f21c81016c0 2024-04-20T22:09:13.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.797+0000 7f21c5600700 1 -- 172.21.15.142:0/3290685858 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f21bc0105d0 con 0x7f21c81016c0 2024-04-20T22:09:13.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.798+0000 7f21c5600700 1 --2- 172.21.15.142:0/3290685858 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f21b006ecc0 0x7f21b0071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:13.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.798+0000 7f21c5600700 1 -- 172.21.15.142:0/3290685858 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f21bc08efe0 con 0x7f21c81016c0 2024-04-20T22:09:13.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.798+0000 7f21c7e00700 1 --2- 172.21.15.142:0/3290685858 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f21b006ecc0 0x7f21b0071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:13.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.799+0000 7f21c7e00700 1 --2- 172.21.15.142:0/3290685858 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f21b006ecc0 0x7f21b0071180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f21b400b5c0 tx=0x7f21b4005180 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:13.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:13.803+0000 7f21c5600700 1 -- 172.21.15.142:0/3290685858 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f21bc05b760 con 0x7f21c81016c0 2024-04-20T22:09:14.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.074+0000 7f21cf400700 1 -- 172.21.15.142:0/3290685858 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f21c819e930 con 0x7f21c81016c0 2024-04-20T22:09:14.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.075+0000 7f21c5600700 1 -- 172.21.15.142:0/3290685858 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1957 (secure 0 0 0) 0x7f21bc05b2f0 con 0x7f21c81016c0 2024-04-20T22:09:14.075 INFO:teuthology.orchestra.run.smithi142.stdout:e35 2024-04-20T22:09:14.075 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:09:14.075 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:09:14.075 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T22:09:14.076 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:09:14.076 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T22:09:14.076 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T22:09:14.076 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 35 2024-04-20T22:09:14.076 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:09:14.076 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:09:14.076 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T22:07:34.267651+0000 2024-04-20T22:09:14.076 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T22:09:14.076 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T22:09:14.076 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T22:09:14.076 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T22:09:14.076 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T22:09:14.076 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T22:09:14.076 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T22:09:14.076 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T22:09:14.076 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 85 2024-04-20T22:09:14.077 INFO:teuthology.orchestra.run.smithi142.stdout:snap_rstat 1 2024-04-20T22:09:14.077 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-20T22:09:14.077 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T22:09:14.077 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T22:09:14.077 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=34454} 2024-04-20T22:09:14.077 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T22:09:14.077 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T22:09:14.077 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T22:09:14.077 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T22:09:14.077 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T22:09:14.077 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T22:09:14.077 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T22:09:14.077 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T22:09:14.078 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T22:09:14.078 INFO:teuthology.orchestra.run.smithi142.stdout:qdb_cluster leader: 34454 members: 34454 2024-04-20T22:09:14.078 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:34454} state up:active seq 26 join_fscid=1 addr [v2:172.21.15.142:6826/2100080187,v1:172.21.15.142:6827/2100080187] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:09:14.078 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:09:14.078 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:09:14.078 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T22:09:14.078 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:09:14.078 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:34486} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6828/2960234081,v1:172.21.15.142:6829/2960234081] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:09:14.078 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.164:6824/1951894011,v1:172.21.15.164:6825/1951894011] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:09:14.078 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.164:6826/3399966592,v1:172.21.15.164:6827/3399966592] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:09:14.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.078+0000 7f21cf400700 1 -- 172.21.15.142:0/3290685858 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f21b006ecc0 msgr2=0x7f21b0071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:14.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.078+0000 7f21cf400700 1 --2- 172.21.15.142:0/3290685858 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f21b006ecc0 0x7f21b0071180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f21b400b5c0 tx=0x7f21b4005180 comp rx=0 tx=0).stop 2024-04-20T22:09:14.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.078+0000 7f21cf400700 1 -- 172.21.15.142:0/3290685858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c81016c0 msgr2=0x7f21c8100fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:14.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.078+0000 7f21cf400700 1 --2- 172.21.15.142:0/3290685858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c81016c0 0x7f21c8100fd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00d8d0 tx=0x7f21bc00dc90 comp rx=0 tx=0).stop 2024-04-20T22:09:14.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.078+0000 7f21cf400700 1 -- 172.21.15.142:0/3290685858 shutdown_connections 2024-04-20T22:09:14.079 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.078+0000 7f21cf400700 1 --2- 172.21.15.142:0/3290685858 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f21b006ecc0 0x7f21b0071180 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:14.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.078+0000 7f21cf400700 1 --2- 172.21.15.142:0/3290685858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21c81016c0 0x7f21c8100fd0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:14.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.078+0000 7f21cf400700 1 --2- 172.21.15.142:0/3290685858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21c8103ff0 0x7f21c80ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:14.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.078+0000 7f21cf400700 1 -- 172.21.15.142:0/3290685858 >> 172.21.15.142:0/3290685858 conn(0x7f21c80fb0d0 msgr2=0x7f21c80fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:14.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.078+0000 7f21cf400700 1 -- 172.21.15.142:0/3290685858 shutdown_connections 2024-04-20T22:09:14.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.078+0000 7f21cf400700 1 -- 172.21.15.142:0/3290685858 wait complete. 2024-04-20T22:09:14.080 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 35 2024-04-20T22:09:14.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.226+0000 7f55f4e00700 1 -- 172.21.15.142:0/3572858415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55f0102e20 msgr2=0x7f55f0103240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:14.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.226+0000 7f55f4e00700 1 --2- 172.21.15.142:0/3572858415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55f0102e20 0x7f55f0103240 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009910 tx=0x7f55e0009c20 comp rx=0 tx=0).stop 2024-04-20T22:09:14.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.226+0000 7f55f4e00700 1 -- 172.21.15.142:0/3572858415 shutdown_connections 2024-04-20T22:09:14.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.226+0000 7f55f4e00700 1 --2- 172.21.15.142:0/3572858415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55f0103f80 0x7f55f0104400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:14.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.226+0000 7f55f4e00700 1 --2- 172.21.15.142:0/3572858415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55f0102e20 0x7f55f0103240 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:14.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.226+0000 7f55f4e00700 1 -- 172.21.15.142:0/3572858415 >> 172.21.15.142:0/3572858415 conn(0x7f55f00fe3a0 msgr2=0x7f55f0100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:14.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.226+0000 7f55f4e00700 1 -- 172.21.15.142:0/3572858415 shutdown_connections 2024-04-20T22:09:14.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.226+0000 7f55f4e00700 1 -- 172.21.15.142:0/3572858415 wait complete. 2024-04-20T22:09:14.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.227+0000 7f55f4e00700 1 Processor -- start 2024-04-20T22:09:14.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.227+0000 7f55f4e00700 1 -- start start 2024-04-20T22:09:14.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.227+0000 7f55f4e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55f0102e20 0x7f55f0198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:14.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.227+0000 7f55f4e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55f0103f80 0x7f55f0198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:14.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.227+0000 7f55f4e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f0199490 con 0x7f55f0102e20 2024-04-20T22:09:14.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.227+0000 7f55f4e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f01995d0 con 0x7f55f0103f80 2024-04-20T22:09:14.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.228+0000 7f55ede00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55f0102e20 0x7f55f0198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:14.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.228+0000 7f55ede00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55f0102e20 0x7f55f0198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39678/0 (socket says 172.21.15.142:39678) 2024-04-20T22:09:14.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.228+0000 7f55ede00700 1 -- 172.21.15.142:0/573931144 learned_addr learned my addr 172.21.15.142:0/573931144 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:09:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.228+0000 7f55ed400700 1 --2- 172.21.15.142:0/573931144 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55f0103f80 0x7f55f0198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.228+0000 7f55ede00700 1 -- 172.21.15.142:0/573931144 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55f0103f80 msgr2=0x7f55f0198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.228+0000 7f55ede00700 1 --2- 172.21.15.142:0/573931144 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55f0103f80 0x7f55f0198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.228+0000 7f55ede00700 1 -- 172.21.15.142:0/573931144 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e00095f0 con 0x7f55f0102e20 2024-04-20T22:09:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.228+0000 7f55ede00700 1 --2- 172.21.15.142:0/573931144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55f0102e20 0x7f55f0198930 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f55e0006010 tx=0x7f55e000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.229+0000 7f55e6a00700 1 -- 172.21.15.142:0/573931144 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55e001d070 con 0x7f55f0102e20 2024-04-20T22:09:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.229+0000 7f55e6a00700 1 -- 172.21.15.142:0/573931144 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f55e000f460 con 0x7f55f0102e20 2024-04-20T22:09:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.229+0000 7f55e6a00700 1 -- 172.21.15.142:0/573931144 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55e0021640 con 0x7f55f0102e20 2024-04-20T22:09:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.229+0000 7f55f4e00700 1 -- 172.21.15.142:0/573931144 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f019df80 con 0x7f55f0102e20 2024-04-20T22:09:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.229+0000 7f55f4e00700 1 -- 172.21.15.142:0/573931144 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f019e410 con 0x7f55f0102e20 2024-04-20T22:09:14.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.230+0000 7f55f4e00700 1 -- 172.21.15.142:0/573931144 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f01929a0 con 0x7f55f0102e20 2024-04-20T22:09:14.230 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.231+0000 7f55e6a00700 1 -- 172.21.15.142:0/573931144 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f55e000fad0 con 0x7f55f0102e20 2024-04-20T22:09:14.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.232+0000 7f55e6a00700 1 --2- 172.21.15.142:0/573931144 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f55d406ecc0 0x7f55d4071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:14.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.232+0000 7f55e6a00700 1 -- 172.21.15.142:0/573931144 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f55e00902e0 con 0x7f55f0102e20 2024-04-20T22:09:14.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.232+0000 7f55ed400700 1 --2- 172.21.15.142:0/573931144 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f55d406ecc0 0x7f55d4071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:14.232 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.233+0000 7f55ed400700 1 --2- 172.21.15.142:0/573931144 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f55d406ecc0 0x7f55d4071180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f55dc006fd0 tx=0x7f55dc008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:14.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.237+0000 7f55e6a00700 1 -- 172.21.15.142:0/573931144 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f55e005caa0 con 0x7f55f0102e20 2024-04-20T22:09:14.330 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:14 smithi142 ceph-mon[79401]: pgmap v307: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:14.330 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:14 smithi142 ceph-mon[79401]: from='client.34616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:09:14.330 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:14 smithi142 ceph-mon[79401]: from='client.34620 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:09:14.330 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:14 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2110347674' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:14.330 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:14 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3290685858' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:09:14.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.475+0000 7f55f4e00700 1 -- 172.21.15.142:0/573931144 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f55f002ce50 con 0x7f55d406ecc0 2024-04-20T22:09:14.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.477+0000 7f55e6a00700 1 -- 172.21.15.142:0/573931144 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+465 (secure 0 0 0) 0x7f55f002ce50 con 0x7f55d406ecc0 2024-04-20T22:09:14.477 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:09:14.477 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T22:09:14.477 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T22:09:14.477 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T22:09:14.477 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T22:09:14.477 INFO:teuthology.orchestra.run.smithi142.stdout: "mon", 2024-04-20T22:09:14.477 INFO:teuthology.orchestra.run.smithi142.stdout: "mds", 2024-04-20T22:09:14.477 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr", 2024-04-20T22:09:14.477 INFO:teuthology.orchestra.run.smithi142.stdout: "osd", 2024-04-20T22:09:14.477 INFO:teuthology.orchestra.run.smithi142.stdout: "crash", 2024-04-20T22:09:14.477 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph-exporter" 2024-04-20T22:09:14.478 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T22:09:14.478 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "18/23 daemons upgraded", 2024-04-20T22:09:14.478 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading alertmanager daemons", 2024-04-20T22:09:14.478 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T22:09:14.478 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:09:14.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.480+0000 7f55f4e00700 1 -- 172.21.15.142:0/573931144 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f55d406ecc0 msgr2=0x7f55d4071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:14.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.480+0000 7f55f4e00700 1 --2- 172.21.15.142:0/573931144 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f55d406ecc0 0x7f55d4071180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f55dc006fd0 tx=0x7f55dc008040 comp rx=0 tx=0).stop 2024-04-20T22:09:14.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.480+0000 7f55f4e00700 1 -- 172.21.15.142:0/573931144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55f0102e20 msgr2=0x7f55f0198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:14.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.480+0000 7f55f4e00700 1 --2- 172.21.15.142:0/573931144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55f0102e20 0x7f55f0198930 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f55e0006010 tx=0x7f55e000be20 comp rx=0 tx=0).stop 2024-04-20T22:09:14.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.480+0000 7f55f4e00700 1 -- 172.21.15.142:0/573931144 shutdown_connections 2024-04-20T22:09:14.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.480+0000 7f55f4e00700 1 --2- 172.21.15.142:0/573931144 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f55d406ecc0 0x7f55d4071180 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:14.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.480+0000 7f55f4e00700 1 --2- 172.21.15.142:0/573931144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55f0102e20 0x7f55f0198930 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:14.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.480+0000 7f55f4e00700 1 --2- 172.21.15.142:0/573931144 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f55f0103f80 0x7f55f0198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:14.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.480+0000 7f55f4e00700 1 -- 172.21.15.142:0/573931144 >> 172.21.15.142:0/573931144 conn(0x7f55f00fe3a0 msgr2=0x7f55f0107610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:14.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.480+0000 7f55f4e00700 1 -- 172.21.15.142:0/573931144 shutdown_connections 2024-04-20T22:09:14.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.480+0000 7f55f4e00700 1 -- 172.21.15.142:0/573931144 wait complete. 2024-04-20T22:09:14.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.647+0000 7f9caba00700 1 -- 172.21.15.142:0/4254460630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ca4108430 msgr2=0x7f9ca41088b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:14.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.647+0000 7f9caba00700 1 --2- 172.21.15.142:0/4254460630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ca4108430 0x7f9ca41088b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009910 tx=0x7f9c90009c20 comp rx=0 tx=0).stop 2024-04-20T22:09:14.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.648+0000 7f9caba00700 1 -- 172.21.15.142:0/4254460630 shutdown_connections 2024-04-20T22:09:14.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.648+0000 7f9caba00700 1 --2- 172.21.15.142:0/4254460630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ca4108430 0x7f9ca41088b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:14.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.648+0000 7f9caba00700 1 --2- 172.21.15.142:0/4254460630 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ca4107260 0x7f9ca4107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:14.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.648+0000 7f9caba00700 1 -- 172.21.15.142:0/4254460630 >> 172.21.15.142:0/4254460630 conn(0x7f9ca4076400 msgr2=0x7f9ca4078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:14.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.648+0000 7f9caba00700 1 -- 172.21.15.142:0/4254460630 shutdown_connections 2024-04-20T22:09:14.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.648+0000 7f9caba00700 1 -- 172.21.15.142:0/4254460630 wait complete. 2024-04-20T22:09:14.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.649+0000 7f9caba00700 1 Processor -- start 2024-04-20T22:09:14.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.650+0000 7f9caba00700 1 -- start start 2024-04-20T22:09:14.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.650+0000 7f9caba00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ca4107260 0x7f9ca419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:14.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.650+0000 7f9caba00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ca4108430 0x7f9ca419d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:14.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.650+0000 7f9caba00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca419d8a0 con 0x7f9ca4107260 2024-04-20T22:09:14.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.650+0000 7f9caba00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca41a2260 con 0x7f9ca4108430 2024-04-20T22:09:14.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.650+0000 7f9ca9000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ca4107260 0x7f9ca419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:14.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.650+0000 7f9ca9000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ca4107260 0x7f9ca419cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39692/0 (socket says 172.21.15.142:39692) 2024-04-20T22:09:14.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.650+0000 7f9ca9000700 1 -- 172.21.15.142:0/16211122 learned_addr learned my addr 172.21.15.142:0/16211122 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:09:14.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.651+0000 7f9ca3e00700 1 --2- 172.21.15.142:0/16211122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ca4108430 0x7f9ca419d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:14.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.651+0000 7f9ca9000700 1 -- 172.21.15.142:0/16211122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ca4108430 msgr2=0x7f9ca419d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:14.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.651+0000 7f9ca9000700 1 --2- 172.21.15.142:0/16211122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ca4108430 0x7f9ca419d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:14.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.651+0000 7f9ca9000700 1 -- 172.21.15.142:0/16211122 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c900095f0 con 0x7f9ca4107260 2024-04-20T22:09:14.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.651+0000 7f9ca9000700 1 --2- 172.21.15.142:0/16211122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ca4107260 0x7f9ca419cd40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9c9800b4b0 tx=0x7f9c9800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:14.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.651+0000 7f9ca1600700 1 -- 172.21.15.142:0/16211122 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c98011800 con 0x7f9ca4107260 2024-04-20T22:09:14.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.652+0000 7f9ca1600700 1 -- 172.21.15.142:0/16211122 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c98011e20 con 0x7f9ca4107260 2024-04-20T22:09:14.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.652+0000 7f9caba00700 1 -- 172.21.15.142:0/16211122 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca41a2460 con 0x7f9ca4107260 2024-04-20T22:09:14.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.652+0000 7f9ca1600700 1 -- 172.21.15.142:0/16211122 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c9800f2e0 con 0x7f9ca4107260 2024-04-20T22:09:14.652 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.652+0000 7f9caba00700 1 -- 172.21.15.142:0/16211122 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca41a2a00 con 0x7f9ca4107260 2024-04-20T22:09:14.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.653+0000 7f9caba00700 1 -- 172.21.15.142:0/16211122 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca4196e50 con 0x7f9ca4107260 2024-04-20T22:09:14.654 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.655+0000 7f9ca1600700 1 -- 172.21.15.142:0/16211122 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f9c98010380 con 0x7f9ca4107260 2024-04-20T22:09:14.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.656+0000 7f9ca1600700 1 --2- 172.21.15.142:0/16211122 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9c8c06ecc0 0x7f9c8c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:14.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.656+0000 7f9ca1600700 1 -- 172.21.15.142:0/16211122 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f9c9808ead0 con 0x7f9ca4107260 2024-04-20T22:09:14.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.656+0000 7f9ca3e00700 1 --2- 172.21.15.142:0/16211122 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9c8c06ecc0 0x7f9c8c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:14.656 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.657+0000 7f9ca3e00700 1 --2- 172.21.15.142:0/16211122 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9c8c06ecc0 0x7f9c8c071180 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9c90006010 tx=0x7f9c9000b580 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:14.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.661+0000 7f9ca1600700 1 -- 172.21.15.142:0/16211122 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f9c98057760 con 0x7f9ca4107260 2024-04-20T22:09:14.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:14 smithi164 ceph-mon[69784]: pgmap v307: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:14.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:14 smithi164 ceph-mon[69784]: from='client.34616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:09:14.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:14 smithi164 ceph-mon[69784]: from='client.34620 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:09:14.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:14 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/2110347674' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:14.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:14 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3290685858' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:09:14.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.989+0000 7f9caba00700 1 -- 172.21.15.142:0/16211122 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9ca404ebb0 con 0x7f9ca4107260 2024-04-20T22:09:14.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.989+0000 7f9ca1600700 1 -- 172.21.15.142:0/16211122 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9c9805ae20 con 0x7f9ca4107260 2024-04-20T22:09:14.989 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_OK 2024-04-20T22:09:14.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.992+0000 7f9caba00700 1 -- 172.21.15.142:0/16211122 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9c8c06ecc0 msgr2=0x7f9c8c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:14.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.992+0000 7f9caba00700 1 --2- 172.21.15.142:0/16211122 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9c8c06ecc0 0x7f9c8c071180 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9c90006010 tx=0x7f9c9000b580 comp rx=0 tx=0).stop 2024-04-20T22:09:14.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.992+0000 7f9caba00700 1 -- 172.21.15.142:0/16211122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ca4107260 msgr2=0x7f9ca419cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:14.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.992+0000 7f9caba00700 1 --2- 172.21.15.142:0/16211122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ca4107260 0x7f9ca419cd40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9c9800b4b0 tx=0x7f9c9800b870 comp rx=0 tx=0).stop 2024-04-20T22:09:14.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.992+0000 7f9caba00700 1 -- 172.21.15.142:0/16211122 shutdown_connections 2024-04-20T22:09:14.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.992+0000 7f9caba00700 1 --2- 172.21.15.142:0/16211122 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f9c8c06ecc0 0x7f9c8c071180 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:14.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.992+0000 7f9caba00700 1 --2- 172.21.15.142:0/16211122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ca4107260 0x7f9ca419cd40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:14.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.992+0000 7f9caba00700 1 --2- 172.21.15.142:0/16211122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ca4108430 0x7f9ca419d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:14.992 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.992+0000 7f9caba00700 1 -- 172.21.15.142:0/16211122 >> 172.21.15.142:0/16211122 conn(0x7f9ca4076400 msgr2=0x7f9ca410ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:14.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.993+0000 7f9caba00700 1 -- 172.21.15.142:0/16211122 shutdown_connections 2024-04-20T22:09:14.993 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:14.993+0000 7f9caba00700 1 -- 172.21.15.142:0/16211122 wait complete. 2024-04-20T22:09:15.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:09:15.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:15 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/16211122' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:09:15.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:09:15.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:15 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/16211122' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:09:16.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:16 smithi142 ceph-mon[79401]: from='client.34632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:09:16.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:16 smithi142 ceph-mon[79401]: pgmap v308: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:16.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:16 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:16.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:16 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:16.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:16 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:09:16.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:16 smithi164 ceph-mon[69784]: from='client.34632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:09:16.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:16 smithi164 ceph-mon[69784]: pgmap v308: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:16.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:16 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:16.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:16 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:16.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:16 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:09:18.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:18 smithi142 ceph-mon[79401]: pgmap v309: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:18.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:18 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:18.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:18 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:18.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:18 smithi164 ceph-mon[69784]: pgmap v309: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:18.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:18 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:18.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:18 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:20 smithi142 ceph-mon[79401]: pgmap v310: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:20.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:20 smithi164 ceph-mon[69784]: pgmap v310: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:22.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:22 smithi142 ceph-mon[79401]: pgmap v311: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:22.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:22 smithi164 ceph-mon[69784]: pgmap v311: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:23.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:23 smithi142 ceph-mon[79401]: pgmap v312: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:23.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:23 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:23.931 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:23 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:23.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:23 smithi164 ceph-mon[69784]: pgmap v312: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:23.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:23 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:23.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:23 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:25.896 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:25 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:25.897 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:25 smithi142 ceph-mon[79401]: pgmap v313: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:25.897 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:25 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:25.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:25 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:25.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:25 smithi164 ceph-mon[69784]: pgmap v313: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:25.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:25 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:27.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:27 smithi164 ceph-mon[69784]: pgmap v314: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:27.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:27 smithi142 ceph-mon[79401]: pgmap v314: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:29.815 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:29 smithi142 ceph-mon[79401]: pgmap v315: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:29.816 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:09:29.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:29 smithi164 ceph-mon[69784]: pgmap v315: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:29.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:09:31.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:31.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:31.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:09:31.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:09:31.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:31.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-20T22:09:31.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-20T22:09:31.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:09:31.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.198 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:31.198 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:31.198 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:09:31.198 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:09:31.198 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:31.198 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-20T22:09:31.198 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-20T22:09:31.199 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:09:31.199 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.199 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.199 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.199 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.199 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.199 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.199 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.199 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.199 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.199 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.199 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.199 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.199 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.199 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:31.200 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:32.320 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:31 smithi142 ceph-mon[79401]: pgmap v316: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:32.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:31 smithi164 ceph-mon[69784]: pgmap v316: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:34.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:33 smithi164 ceph-mon[69784]: Upgrade: Updating grafana.smithi142 2024-04-20T22:09:34.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:33 smithi164 ceph-mon[69784]: Deploying daemon grafana.smithi142 on smithi142 2024-04-20T22:09:34.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:33 smithi164 ceph-mon[69784]: pgmap v317: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:34.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:33 smithi142 ceph-mon[79401]: Upgrade: Updating grafana.smithi142 2024-04-20T22:09:34.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:33 smithi142 ceph-mon[79401]: Deploying daemon grafana.smithi142 on smithi142 2024-04-20T22:09:34.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:33 smithi142 ceph-mon[79401]: pgmap v317: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:36.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:35 smithi142 ceph-mon[79401]: pgmap v318: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:36.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:35 smithi164 ceph-mon[69784]: pgmap v318: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:38.368 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:37 smithi142 ceph-mon[79401]: pgmap v319: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:38.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:37 smithi164 ceph-mon[69784]: pgmap v319: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:40.347 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:39 smithi142 ceph-mon[79401]: pgmap v320: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:40.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:39 smithi164 ceph-mon[69784]: pgmap v320: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:42.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:42 smithi164 ceph-mon[69784]: pgmap v321: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:42.268 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:42 smithi142 ceph-mon[79401]: pgmap v321: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:44.265 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:44 smithi142 ceph-mon[79401]: pgmap v322: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:44.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:44 smithi164 ceph-mon[69784]: pgmap v322: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:45.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.171+0000 7f1223a00700 1 -- 172.21.15.142:0/1904882459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f121c100c30 msgr2=0x7f121c101050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:45.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.171+0000 7f1223a00700 1 --2- 172.21.15.142:0/1904882459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f121c100c30 0x7f121c101050 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1210009910 tx=0x7f1210009c20 comp rx=0 tx=0).stop 2024-04-20T22:09:45.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.171+0000 7f1223a00700 1 -- 172.21.15.142:0/1904882459 shutdown_connections 2024-04-20T22:09:45.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.171+0000 7f1223a00700 1 --2- 172.21.15.142:0/1904882459 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f121c101e30 0x7f121c102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:45.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.171+0000 7f1223a00700 1 --2- 172.21.15.142:0/1904882459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f121c100c30 0x7f121c101050 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:45.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.171+0000 7f1223a00700 1 -- 172.21.15.142:0/1904882459 >> 172.21.15.142:0/1904882459 conn(0x7f121c0fc1f0 msgr2=0x7f121c0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:45.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.171+0000 7f1223a00700 1 -- 172.21.15.142:0/1904882459 shutdown_connections 2024-04-20T22:09:45.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.171+0000 7f1223a00700 1 -- 172.21.15.142:0/1904882459 wait complete. 2024-04-20T22:09:45.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.173+0000 7f1223a00700 1 Processor -- start 2024-04-20T22:09:45.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.173+0000 7f1223a00700 1 -- start start 2024-04-20T22:09:45.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.173+0000 7f1223a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f121c100c30 0x7f121c074c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:45.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.173+0000 7f1223a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f121c101e30 0x7f121c0732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:45.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.173+0000 7f1223a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c073810 con 0x7f121c100c30 2024-04-20T22:09:45.173 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.173+0000 7f1223a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c073950 con 0x7f121c101e30 2024-04-20T22:09:45.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.174+0000 7f1221000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f121c100c30 0x7f121c074c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:45.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.174+0000 7f1221000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f121c100c30 0x7f121c074c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39484/0 (socket says 172.21.15.142:39484) 2024-04-20T22:09:45.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.174+0000 7f1221000700 1 -- 172.21.15.142:0/3575885686 learned_addr learned my addr 172.21.15.142:0/3575885686 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:09:45.174 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.174+0000 7f121be00700 1 --2- 172.21.15.142:0/3575885686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f121c101e30 0x7f121c0732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:45.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.174+0000 7f1221000700 1 -- 172.21.15.142:0/3575885686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f121c101e30 msgr2=0x7f121c0732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:45.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.174+0000 7f1221000700 1 --2- 172.21.15.142:0/3575885686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f121c101e30 0x7f121c0732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:45.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.174+0000 7f1221000700 1 -- 172.21.15.142:0/3575885686 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12100095f0 con 0x7f121c100c30 2024-04-20T22:09:45.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.174+0000 7f1221000700 1 --2- 172.21.15.142:0/3575885686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f121c100c30 0x7f121c074c30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f121000bd70 tx=0x7f121000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:45.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.175+0000 7f1219600700 1 -- 172.21.15.142:0/3575885686 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f121001d070 con 0x7f121c100c30 2024-04-20T22:09:45.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.175+0000 7f1219600700 1 -- 172.21.15.142:0/3575885686 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f121000f460 con 0x7f121c100c30 2024-04-20T22:09:45.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.175+0000 7f1223a00700 1 -- 172.21.15.142:0/3575885686 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f121c073bd0 con 0x7f121c100c30 2024-04-20T22:09:45.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.175+0000 7f1219600700 1 -- 172.21.15.142:0/3575885686 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1210021600 con 0x7f121c100c30 2024-04-20T22:09:45.175 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.175+0000 7f1223a00700 1 -- 172.21.15.142:0/3575885686 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f121c074140 con 0x7f121c100c30 2024-04-20T22:09:45.176 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.176+0000 7f1223a00700 1 -- 172.21.15.142:0/3575885686 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121c1907b0 con 0x7f121c100c30 2024-04-20T22:09:45.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.177+0000 7f1219600700 1 -- 172.21.15.142:0/3575885686 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f121000fa50 con 0x7f121c100c30 2024-04-20T22:09:45.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.178+0000 7f1219600700 1 --2- 172.21.15.142:0/3575885686 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f120406ecd0 0x7f1204071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:45.178 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.179+0000 7f1219600700 1 -- 172.21.15.142:0/3575885686 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f1210090030 con 0x7f121c100c30 2024-04-20T22:09:45.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.179+0000 7f121be00700 1 --2- 172.21.15.142:0/3575885686 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f120406ecd0 0x7f1204071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:45.179 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.180+0000 7f121be00700 1 --2- 172.21.15.142:0/3575885686 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f120406ecd0 0x7f1204071190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1208005fd0 tx=0x7f120800a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:45.184 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.185+0000 7f1219600700 1 -- 172.21.15.142:0/3575885686 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f121005c890 con 0x7f121c100c30 2024-04-20T22:09:45.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:09:45.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:09:45.461 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.461+0000 7f1223a00700 1 -- 172.21.15.142:0/3575885686 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f121c074140 con 0x7f120406ecd0 2024-04-20T22:09:45.464 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.464+0000 7f1219600700 1 -- 172.21.15.142:0/3575885686 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7f121c074140 con 0x7f120406ecd0 2024-04-20T22:09:45.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.467+0000 7f1223a00700 1 -- 172.21.15.142:0/3575885686 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f120406ecd0 msgr2=0x7f1204071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:45.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.467+0000 7f1223a00700 1 --2- 172.21.15.142:0/3575885686 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f120406ecd0 0x7f1204071190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1208005fd0 tx=0x7f120800a560 comp rx=0 tx=0).stop 2024-04-20T22:09:45.466 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.467+0000 7f1223a00700 1 -- 172.21.15.142:0/3575885686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f121c100c30 msgr2=0x7f121c074c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.467+0000 7f1223a00700 1 --2- 172.21.15.142:0/3575885686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f121c100c30 0x7f121c074c30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f121000bd70 tx=0x7f121000be50 comp rx=0 tx=0).stop 2024-04-20T22:09:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.467+0000 7f1223a00700 1 -- 172.21.15.142:0/3575885686 shutdown_connections 2024-04-20T22:09:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.467+0000 7f1223a00700 1 --2- 172.21.15.142:0/3575885686 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f120406ecd0 0x7f1204071190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.467+0000 7f1223a00700 1 --2- 172.21.15.142:0/3575885686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f121c100c30 0x7f121c074c30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.467+0000 7f1223a00700 1 --2- 172.21.15.142:0/3575885686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f121c101e30 0x7f121c0732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:45.467 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.467+0000 7f1223a00700 1 -- 172.21.15.142:0/3575885686 >> 172.21.15.142:0/3575885686 conn(0x7f121c0fc1f0 msgr2=0x7f121c1053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:45.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.467+0000 7f1223a00700 1 -- 172.21.15.142:0/3575885686 shutdown_connections 2024-04-20T22:09:45.468 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.467+0000 7f1223a00700 1 -- 172.21.15.142:0/3575885686 wait complete. 2024-04-20T22:09:45.491 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T22:09:45.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.641+0000 7f89f8a00700 1 -- 172.21.15.142:0/1400061715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89f4074f10 msgr2=0x7f89f4073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:45.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.641+0000 7f89f8a00700 1 --2- 172.21.15.142:0/1400061715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89f4074f10 0x7f89f4073370 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009910 tx=0x7f89e4009c20 comp rx=0 tx=0).stop 2024-04-20T22:09:45.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.641+0000 7f89f8a00700 1 -- 172.21.15.142:0/1400061715 shutdown_connections 2024-04-20T22:09:45.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.641+0000 7f89f8a00700 1 --2- 172.21.15.142:0/1400061715 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f4073940 0x7f89f4073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:45.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.641+0000 7f89f8a00700 1 --2- 172.21.15.142:0/1400061715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89f4074f10 0x7f89f4073370 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:45.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.641+0000 7f89f8a00700 1 -- 172.21.15.142:0/1400061715 >> 172.21.15.142:0/1400061715 conn(0x7f89f40fc1c0 msgr2=0x7f89f40fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:45.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.641+0000 7f89f8a00700 1 -- 172.21.15.142:0/1400061715 shutdown_connections 2024-04-20T22:09:45.642 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.641+0000 7f89f8a00700 1 -- 172.21.15.142:0/1400061715 wait complete. 2024-04-20T22:09:45.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.642+0000 7f89f8a00700 1 Processor -- start 2024-04-20T22:09:45.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.643+0000 7f89f8a00700 1 -- start start 2024-04-20T22:09:45.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.643+0000 7f89f8a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f4073940 0x7f89f419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:45.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.643+0000 7f89f8a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89f4074f10 0x7f89f419d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:45.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.643+0000 7f89f8a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f419d780 con 0x7f89f4074f10 2024-04-20T22:09:45.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.643+0000 7f89f8a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f419d8c0 con 0x7f89f4073940 2024-04-20T22:09:45.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.643+0000 7f89ebe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89f4074f10 0x7f89f419d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:45.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.643+0000 7f89ebe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89f4074f10 0x7f89f419d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39496/0 (socket says 172.21.15.142:39496) 2024-04-20T22:09:45.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.643+0000 7f89ebe00700 1 -- 172.21.15.142:0/3601397240 learned_addr learned my addr 172.21.15.142:0/3601397240 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:09:45.644 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.644+0000 7f89f1e00700 1 --2- 172.21.15.142:0/3601397240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f4073940 0x7f89f419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:45.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.644+0000 7f89ebe00700 1 -- 172.21.15.142:0/3601397240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f4073940 msgr2=0x7f89f419cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:45.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.644+0000 7f89ebe00700 1 --2- 172.21.15.142:0/3601397240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f4073940 0x7f89f419cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:45.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.644+0000 7f89ebe00700 1 -- 172.21.15.142:0/3601397240 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e40095f0 con 0x7f89f4074f10 2024-04-20T22:09:45.645 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.644+0000 7f89ebe00700 1 --2- 172.21.15.142:0/3601397240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89f4074f10 0x7f89f419d160 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00c8f0 tx=0x7f89dc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:45.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.644+0000 7f89eaa00700 1 -- 172.21.15.142:0/3601397240 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89dc007a70 con 0x7f89f4074f10 2024-04-20T22:09:45.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.645+0000 7f89eaa00700 1 -- 172.21.15.142:0/3601397240 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f89dc007bd0 con 0x7f89f4074f10 2024-04-20T22:09:45.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.645+0000 7f89f8a00700 1 -- 172.21.15.142:0/3601397240 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f41a2320 con 0x7f89f4074f10 2024-04-20T22:09:45.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.645+0000 7f89eaa00700 1 -- 172.21.15.142:0/3601397240 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89dc018630 con 0x7f89f4074f10 2024-04-20T22:09:45.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.645+0000 7f89f8a00700 1 -- 172.21.15.142:0/3601397240 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f41a28f0 con 0x7f89f4074f10 2024-04-20T22:09:45.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.646+0000 7f89f8a00700 1 -- 172.21.15.142:0/3601397240 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f4196d90 con 0x7f89f4074f10 2024-04-20T22:09:45.647 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.647+0000 7f89eaa00700 1 -- 172.21.15.142:0/3601397240 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f89dc00f450 con 0x7f89f4074f10 2024-04-20T22:09:45.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.648+0000 7f89eaa00700 1 --2- 172.21.15.142:0/3601397240 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f89d806ecc0 0x7f89d8071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:45.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.649+0000 7f89eaa00700 1 -- 172.21.15.142:0/3601397240 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f89dc08ef80 con 0x7f89f4074f10 2024-04-20T22:09:45.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.649+0000 7f89f1e00700 1 --2- 172.21.15.142:0/3601397240 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f89d806ecc0 0x7f89d8071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:45.649 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.650+0000 7f89f1e00700 1 --2- 172.21.15.142:0/3601397240 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f89d806ecc0 0x7f89d8071180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f89e4006010 tx=0x7f89e400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:45.653 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.654+0000 7f89eaa00700 1 -- 172.21.15.142:0/3601397240 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f89dc05b760 con 0x7f89f4074f10 2024-04-20T22:09:45.929 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.929+0000 7f89f8a00700 1 -- 172.21.15.142:0/3601397240 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f89f402ce50 con 0x7f89d806ecc0 2024-04-20T22:09:45.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.930+0000 7f89eaa00700 1 -- 172.21.15.142:0/3601397240 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7f89f402ce50 con 0x7f89d806ecc0 2024-04-20T22:09:45.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.933+0000 7f89f8a00700 1 -- 172.21.15.142:0/3601397240 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f89d806ecc0 msgr2=0x7f89d8071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:45.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.933+0000 7f89f8a00700 1 --2- 172.21.15.142:0/3601397240 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f89d806ecc0 0x7f89d8071180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f89e4006010 tx=0x7f89e400b540 comp rx=0 tx=0).stop 2024-04-20T22:09:45.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.933+0000 7f89f8a00700 1 -- 172.21.15.142:0/3601397240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89f4074f10 msgr2=0x7f89f419d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:45.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.933+0000 7f89f8a00700 1 --2- 172.21.15.142:0/3601397240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89f4074f10 0x7f89f419d160 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00c8f0 tx=0x7f89dc00ccb0 comp rx=0 tx=0).stop 2024-04-20T22:09:45.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.933+0000 7f89f8a00700 1 -- 172.21.15.142:0/3601397240 shutdown_connections 2024-04-20T22:09:45.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.933+0000 7f89f8a00700 1 --2- 172.21.15.142:0/3601397240 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f89d806ecc0 0x7f89d8071180 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:45.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.933+0000 7f89f8a00700 1 --2- 172.21.15.142:0/3601397240 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f4073940 0x7f89f419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:45.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.933+0000 7f89f8a00700 1 --2- 172.21.15.142:0/3601397240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89f4074f10 0x7f89f419d160 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:45.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.933+0000 7f89f8a00700 1 -- 172.21.15.142:0/3601397240 >> 172.21.15.142:0/3601397240 conn(0x7f89f40fc1c0 msgr2=0x7f89f41029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:45.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.934+0000 7f89f8a00700 1 -- 172.21.15.142:0/3601397240 shutdown_connections 2024-04-20T22:09:45.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:45.934+0000 7f89f8a00700 1 -- 172.21.15.142:0/3601397240 wait complete. 2024-04-20T22:09:46.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.098+0000 7f9724800700 1 -- 172.21.15.142:0/1535759238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f971c108430 msgr2=0x7f971c1088b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:46.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.098+0000 7f9724800700 1 --2- 172.21.15.142:0/1535759238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f971c108430 0x7f971c1088b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f970c009910 tx=0x7f970c009c20 comp rx=0 tx=0).stop 2024-04-20T22:09:46.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.098+0000 7f9724800700 1 -- 172.21.15.142:0/1535759238 shutdown_connections 2024-04-20T22:09:46.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.098+0000 7f9724800700 1 --2- 172.21.15.142:0/1535759238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f971c108430 0x7f971c1088b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:46.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.098+0000 7f9724800700 1 --2- 172.21.15.142:0/1535759238 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971c107260 0x7f971c107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:46.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.098+0000 7f9724800700 1 -- 172.21.15.142:0/1535759238 >> 172.21.15.142:0/1535759238 conn(0x7f971c076400 msgr2=0x7f971c078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:46.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.098+0000 7f9724800700 1 -- 172.21.15.142:0/1535759238 shutdown_connections 2024-04-20T22:09:46.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.098+0000 7f9724800700 1 -- 172.21.15.142:0/1535759238 wait complete. 2024-04-20T22:09:46.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.099+0000 7f9724800700 1 Processor -- start 2024-04-20T22:09:46.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.099+0000 7f9724800700 1 -- start start 2024-04-20T22:09:46.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.100+0000 7f9724800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f971c107260 0x7f971c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:46.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.100+0000 7f9724800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971c108430 0x7f971c19d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:46.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.100+0000 7f9724800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c19d8a0 con 0x7f971c107260 2024-04-20T22:09:46.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.100+0000 7f9724800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c1a2260 con 0x7f971c108430 2024-04-20T22:09:46.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.100+0000 7f9721e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f971c107260 0x7f971c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:46.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.100+0000 7f9721e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f971c107260 0x7f971c19cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39526/0 (socket says 172.21.15.142:39526) 2024-04-20T22:09:46.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.100+0000 7f9721e00700 1 -- 172.21.15.142:0/712487998 learned_addr learned my addr 172.21.15.142:0/712487998 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:09:46.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.100+0000 7f9721e00700 1 -- 172.21.15.142:0/712487998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971c108430 msgr2=0x7f971c19d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:46.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.100+0000 7f9721400700 1 --2- 172.21.15.142:0/712487998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971c108430 0x7f971c19d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:46.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.100+0000 7f9721e00700 1 --2- 172.21.15.142:0/712487998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971c108430 0x7f971c19d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:46.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.101+0000 7f9721e00700 1 -- 172.21.15.142:0/712487998 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c0095f0 con 0x7f971c107260 2024-04-20T22:09:46.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.101+0000 7f9721e00700 1 --2- 172.21.15.142:0/712487998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f971c107260 0x7f971c19cd40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f971000b4b0 tx=0x7f971000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:46.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.101+0000 7f9716a00700 1 -- 172.21.15.142:0/712487998 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9710011800 con 0x7f971c107260 2024-04-20T22:09:46.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.101+0000 7f9716a00700 1 -- 172.21.15.142:0/712487998 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9710011e20 con 0x7f971c107260 2024-04-20T22:09:46.101 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.101+0000 7f9724800700 1 -- 172.21.15.142:0/712487998 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971c1a2460 con 0x7f971c107260 2024-04-20T22:09:46.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.101+0000 7f9716a00700 1 -- 172.21.15.142:0/712487998 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f971000f2e0 con 0x7f971c107260 2024-04-20T22:09:46.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.101+0000 7f9724800700 1 -- 172.21.15.142:0/712487998 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c1a2a00 con 0x7f971c107260 2024-04-20T22:09:46.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.102+0000 7f9724800700 1 -- 172.21.15.142:0/712487998 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971c196e50 con 0x7f971c107260 2024-04-20T22:09:46.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.104+0000 7f9716a00700 1 -- 172.21.15.142:0/712487998 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f9710010380 con 0x7f971c107260 2024-04-20T22:09:46.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.105+0000 7f9716a00700 1 --2- 172.21.15.142:0/712487998 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f970406ecc0 0x7f9704071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:46.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.105+0000 7f9716a00700 1 -- 172.21.15.142:0/712487998 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f971008ea50 con 0x7f971c107260 2024-04-20T22:09:46.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.105+0000 7f9721400700 1 --2- 172.21.15.142:0/712487998 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f970406ecc0 0x7f9704071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:46.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.106+0000 7f9721400700 1 --2- 172.21.15.142:0/712487998 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f970406ecc0 0x7f9704071180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f970c00b5c0 tx=0x7f970c005160 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:46.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.110+0000 7f9716a00700 1 -- 172.21.15.142:0/712487998 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f9710057780 con 0x7f971c107260 2024-04-20T22:09:46.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:46 smithi142 ceph-mon[79401]: pgmap v323: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:46.345 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.345+0000 7f9724800700 1 -- 172.21.15.142:0/712487998 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f971c02ce50 con 0x7f970406ecc0 2024-04-20T22:09:46.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.376+0000 7f9716a00700 1 -- 172.21.15.142:0/712487998 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f971c02ce50 con 0x7f970406ecc0 2024-04-20T22:09:46.376 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:09:46.377 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (31s) 23s ago 22m 14.5M - 0.25.0 c8568f914cd2 91b692cbdcb6 2024-04-20T22:09:46.377 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (115s) 23s ago 22m 7998k - 19.0.0-3133-ga8c84f59 76bc6b91b726 eadbb8123608 2024-04-20T22:09:46.377 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (107s) 75s ago 21m 7638k - 19.0.0-3133-ga8c84f59 76bc6b91b726 13030cc1a7a8 2024-04-20T22:09:46.377 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (7m) 23s ago 22m 6665k - 19.0.0-3133-ga8c84f59 76bc6b91b726 64521ed7125b 2024-04-20T22:09:46.377 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (7m) 75s ago 21m 6656k - 19.0.0-3133-ga8c84f59 76bc6b91b726 893c6f16ee6d 2024-04-20T22:09:46.377 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (20m) 23s ago 22m 74.9M - 9.4.7 954c08fa6188 aa366dff74ad 2024-04-20T22:09:46.377 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (3m) 23s ago 15m 87.4M - 19.0.0-3133-ga8c84f59 76bc6b91b726 603d9ff4accc 2024-04-20T22:09:46.377 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (3m) 23s ago 15m 13.1M - 19.0.0-3133-ga8c84f59 76bc6b91b726 5fbbe225e911 2024-04-20T22:09:46.377 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (2m) 75s ago 14m 12.2M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3ee3d509a48c 2024-04-20T22:09:46.377 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (2m) 75s ago 15m 12.4M - 19.0.0-3133-ga8c84f59 76bc6b91b726 44901e1ad990 2024-04-20T22:09:46.377 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (11m) 23s ago 24m 515M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:09:46.377 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (10m) 75s ago 21m 454M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:09:46.377 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (9m) 23s ago 24m 61.1M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 af10a542c918 2024-04-20T22:09:46.377 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (9m) 75s ago 20m 43.5M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 133512694d46 2024-04-20T22:09:46.378 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (86s) 23s ago 22m 7666k - 1.5.0 0da6a335fe13 f21ef73493a2 2024-04-20T22:09:46.378 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (80s) 75s ago 21m 2843k - 1.5.0 0da6a335fe13 0ba09db59c8e 2024-04-20T22:09:46.378 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (7m) 23s ago 19m 108M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 b7206d05a7cd 2024-04-20T22:09:46.378 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (6m) 23s ago 19m 108M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 82bcc0c46762 2024-04-20T22:09:46.378 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (6m) 23s ago 18m 94.6M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 3e2d91f49494 2024-04-20T22:09:46.378 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (5m) 75s ago 18m 119M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 a898b8b77c51 2024-04-20T22:09:46.378 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (5m) 75s ago 17m 103M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 539c4026f9fb 2024-04-20T22:09:46.378 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (4m) 75s ago 16m 95.8M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 ac1bdd69c944 2024-04-20T22:09:46.378 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (55s) 23s ago 21m 58.2M - 2.43.0 a07b618ecd1d 2b3da2d4dfc7 2024-04-20T22:09:46.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.379+0000 7f9724800700 1 -- 172.21.15.142:0/712487998 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f970406ecc0 msgr2=0x7f9704071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:46.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.379+0000 7f9724800700 1 --2- 172.21.15.142:0/712487998 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f970406ecc0 0x7f9704071180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f970c00b5c0 tx=0x7f970c005160 comp rx=0 tx=0).stop 2024-04-20T22:09:46.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.379+0000 7f9724800700 1 -- 172.21.15.142:0/712487998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f971c107260 msgr2=0x7f971c19cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:46.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.379+0000 7f9724800700 1 --2- 172.21.15.142:0/712487998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f971c107260 0x7f971c19cd40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f971000b4b0 tx=0x7f971000b870 comp rx=0 tx=0).stop 2024-04-20T22:09:46.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.379+0000 7f9724800700 1 -- 172.21.15.142:0/712487998 shutdown_connections 2024-04-20T22:09:46.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.379+0000 7f9724800700 1 --2- 172.21.15.142:0/712487998 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f970406ecc0 0x7f9704071180 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:46.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.379+0000 7f9724800700 1 --2- 172.21.15.142:0/712487998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f971c107260 0x7f971c19cd40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:46.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.379+0000 7f9724800700 1 --2- 172.21.15.142:0/712487998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971c108430 0x7f971c19d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:46.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.379+0000 7f9724800700 1 -- 172.21.15.142:0/712487998 >> 172.21.15.142:0/712487998 conn(0x7f971c076400 msgr2=0x7f971c10ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:46.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.380+0000 7f9724800700 1 -- 172.21.15.142:0/712487998 shutdown_connections 2024-04-20T22:09:46.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.380+0000 7f9724800700 1 -- 172.21.15.142:0/712487998 wait complete. 2024-04-20T22:09:46.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:46 smithi164 ceph-mon[69784]: pgmap v323: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.529+0000 7f613b000700 1 -- 172.21.15.142:0/3236230998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6134103fb0 msgr2=0x7f61341063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.529+0000 7f613b000700 1 --2- 172.21.15.142:0/3236230998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6134103fb0 0x7f61341063a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6120009910 tx=0x7f6120009c20 comp rx=0 tx=0).stop 2024-04-20T22:09:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.529+0000 7f613b000700 1 -- 172.21.15.142:0/3236230998 shutdown_connections 2024-04-20T22:09:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.529+0000 7f613b000700 1 --2- 172.21.15.142:0/3236230998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6134103fb0 0x7f61341063a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.529+0000 7f613b000700 1 --2- 172.21.15.142:0/3236230998 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6134101680 0x7f6134103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.529+0000 7f613b000700 1 -- 172.21.15.142:0/3236230998 >> 172.21.15.142:0/3236230998 conn(0x7f61340fb0d0 msgr2=0x7f61340fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.529+0000 7f613b000700 1 -- 172.21.15.142:0/3236230998 shutdown_connections 2024-04-20T22:09:46.529 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.529+0000 7f613b000700 1 -- 172.21.15.142:0/3236230998 wait complete. 2024-04-20T22:09:46.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.530+0000 7f613b000700 1 Processor -- start 2024-04-20T22:09:46.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.530+0000 7f613b000700 1 -- start start 2024-04-20T22:09:46.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.531+0000 7f613b000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6134101680 0x7f61341988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:46.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.531+0000 7f613b000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6134103fb0 0x7f6134198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:46.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.531+0000 7f613b000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6134199430 con 0x7f6134101680 2024-04-20T22:09:46.530 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.531+0000 7f613b000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6134199570 con 0x7f6134103fb0 2024-04-20T22:09:46.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.531+0000 7f6133e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6134101680 0x7f61341988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:46.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.531+0000 7f6133e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6134101680 0x7f61341988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39548/0 (socket says 172.21.15.142:39548) 2024-04-20T22:09:46.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.531+0000 7f6133e00700 1 -- 172.21.15.142:0/3451573372 learned_addr learned my addr 172.21.15.142:0/3451573372 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:09:46.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.531+0000 7f6133e00700 1 -- 172.21.15.142:0/3451573372 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6134103fb0 msgr2=0x7f6134198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:46.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.531+0000 7f6133e00700 1 --2- 172.21.15.142:0/3451573372 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6134103fb0 0x7f6134198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:46.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.531+0000 7f6133e00700 1 -- 172.21.15.142:0/3451573372 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61200095f0 con 0x7f6134101680 2024-04-20T22:09:46.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.532+0000 7f6133e00700 1 --2- 172.21.15.142:0/3451573372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6134101680 0x7f61341988d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f612400b4b0 tx=0x7f612400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:46.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.532+0000 7f6130c00700 1 -- 172.21.15.142:0/3451573372 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6124011800 con 0x7f6134101680 2024-04-20T22:09:46.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.532+0000 7f6130c00700 1 -- 172.21.15.142:0/3451573372 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6124011e20 con 0x7f6134101680 2024-04-20T22:09:46.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.532+0000 7f6130c00700 1 -- 172.21.15.142:0/3451573372 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f612400f2e0 con 0x7f6134101680 2024-04-20T22:09:46.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.532+0000 7f613b000700 1 -- 172.21.15.142:0/3451573372 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613419dfd0 con 0x7f6134101680 2024-04-20T22:09:46.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.532+0000 7f613b000700 1 -- 172.21.15.142:0/3451573372 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613419e540 con 0x7f6134101680 2024-04-20T22:09:46.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.533+0000 7f613b000700 1 -- 172.21.15.142:0/3451573372 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6134062510 con 0x7f6134101680 2024-04-20T22:09:46.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.534+0000 7f6130c00700 1 -- 172.21.15.142:0/3451573372 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f6124010380 con 0x7f6134101680 2024-04-20T22:09:46.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.536+0000 7f6130c00700 1 --2- 172.21.15.142:0/3451573372 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f611806ecc0 0x7f6118071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:46.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.536+0000 7f6130c00700 1 -- 172.21.15.142:0/3451573372 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f612408eb30 con 0x7f6134101680 2024-04-20T22:09:46.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.536+0000 7f6133400700 1 --2- 172.21.15.142:0/3451573372 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f611806ecc0 0x7f6118071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:46.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.536+0000 7f6133400700 1 --2- 172.21.15.142:0/3451573372 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f611806ecc0 0x7f6118071180 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f61200051c0 tx=0x7f6120005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:46.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.540+0000 7f6130c00700 1 -- 172.21.15.142:0/3451573372 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f612405b3a0 con 0x7f6134101680 2024-04-20T22:09:46.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.885+0000 7f613b000700 1 -- 172.21.15.142:0/3451573372 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f61341097d0 con 0x7f6134101680 2024-04-20T22:09:46.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.886+0000 7f6130c00700 1 -- 172.21.15.142:0/3451573372 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f612405af30 con 0x7f6134101680 2024-04-20T22:09:46.886 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:09:46.886 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:09:46.886 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:09:46.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:09:46.886 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:09:46.886 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:09:46.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:09:46.887 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:09:46.887 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 6 2024-04-20T22:09:46.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:09:46.887 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:09:46.887 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 4 2024-04-20T22:09:46.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:09:46.887 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:09:46.887 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 14 2024-04-20T22:09:46.887 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:09:46.888 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:09:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.889+0000 7f613b000700 1 -- 172.21.15.142:0/3451573372 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f611806ecc0 msgr2=0x7f6118071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.889+0000 7f613b000700 1 --2- 172.21.15.142:0/3451573372 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f611806ecc0 0x7f6118071180 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f61200051c0 tx=0x7f6120005fd0 comp rx=0 tx=0).stop 2024-04-20T22:09:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.889+0000 7f613b000700 1 -- 172.21.15.142:0/3451573372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6134101680 msgr2=0x7f61341988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.889+0000 7f613b000700 1 --2- 172.21.15.142:0/3451573372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6134101680 0x7f61341988d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f612400b4b0 tx=0x7f612400b870 comp rx=0 tx=0).stop 2024-04-20T22:09:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.889+0000 7f613b000700 1 -- 172.21.15.142:0/3451573372 shutdown_connections 2024-04-20T22:09:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.889+0000 7f613b000700 1 --2- 172.21.15.142:0/3451573372 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f611806ecc0 0x7f6118071180 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.889+0000 7f613b000700 1 --2- 172.21.15.142:0/3451573372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6134101680 0x7f61341988d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.889+0000 7f613b000700 1 --2- 172.21.15.142:0/3451573372 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6134103fb0 0x7f6134198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.889+0000 7f613b000700 1 -- 172.21.15.142:0/3451573372 >> 172.21.15.142:0/3451573372 conn(0x7f61340fb0d0 msgr2=0x7f61341004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.889+0000 7f613b000700 1 -- 172.21.15.142:0/3451573372 shutdown_connections 2024-04-20T22:09:46.889 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:46.889+0000 7f613b000700 1 -- 172.21.15.142:0/3451573372 wait complete. 2024-04-20T22:09:47.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.052+0000 7fd893e00700 1 -- 172.21.15.142:0/2738754513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd88c100c00 msgr2=0x7fd88c101020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:47.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.052+0000 7fd893e00700 1 --2- 172.21.15.142:0/2738754513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd88c100c00 0x7fd88c101020 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd880009910 tx=0x7fd880009c20 comp rx=0 tx=0).stop 2024-04-20T22:09:47.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.053+0000 7fd893e00700 1 -- 172.21.15.142:0/2738754513 shutdown_connections 2024-04-20T22:09:47.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.053+0000 7fd893e00700 1 --2- 172.21.15.142:0/2738754513 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd88c101e00 0x7fd88c102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:47.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.053+0000 7fd893e00700 1 --2- 172.21.15.142:0/2738754513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd88c100c00 0x7fd88c101020 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:47.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.053+0000 7fd893e00700 1 -- 172.21.15.142:0/2738754513 >> 172.21.15.142:0/2738754513 conn(0x7fd88c0fc1c0 msgr2=0x7fd88c0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:47.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.053+0000 7fd893e00700 1 -- 172.21.15.142:0/2738754513 shutdown_connections 2024-04-20T22:09:47.053 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.053+0000 7fd893e00700 1 -- 172.21.15.142:0/2738754513 wait complete. 2024-04-20T22:09:47.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.054+0000 7fd893e00700 1 Processor -- start 2024-04-20T22:09:47.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.054+0000 7fd893e00700 1 -- start start 2024-04-20T22:09:47.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.054+0000 7fd893e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd88c100c00 0x7fd88c074be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:47.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.054+0000 7fd893e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd88c101e00 0x7fd88c0732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:47.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.054+0000 7fd893e00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c073810 con 0x7fd88c101e00 2024-04-20T22:09:47.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.054+0000 7fd893e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c073950 con 0x7fd88c100c00 2024-04-20T22:09:47.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.055+0000 7fd890a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd88c101e00 0x7fd88c0732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:47.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.055+0000 7fd890a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd88c101e00 0x7fd88c0732d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59760/0 (socket says 172.21.15.142:59760) 2024-04-20T22:09:47.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.055+0000 7fd890a00700 1 -- 172.21.15.142:0/3596679454 learned_addr learned my addr 172.21.15.142:0/3596679454 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:09:47.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.055+0000 7fd891400700 1 --2- 172.21.15.142:0/3596679454 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd88c100c00 0x7fd88c074be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:47.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.055+0000 7fd890a00700 1 -- 172.21.15.142:0/3596679454 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd88c100c00 msgr2=0x7fd88c074be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:47.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.055+0000 7fd890a00700 1 --2- 172.21.15.142:0/3596679454 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd88c100c00 0x7fd88c074be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:47.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.055+0000 7fd890a00700 1 -- 172.21.15.142:0/3596679454 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8800095f0 con 0x7fd88c101e00 2024-04-20T22:09:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.056+0000 7fd890a00700 1 --2- 172.21.15.142:0/3596679454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd88c101e00 0x7fd88c0732d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd87800b4b0 tx=0x7fd87800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.056+0000 7fd88a000700 1 -- 172.21.15.142:0/3596679454 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd878011800 con 0x7fd88c101e00 2024-04-20T22:09:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.056+0000 7fd88a000700 1 -- 172.21.15.142:0/3596679454 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd878011e20 con 0x7fd88c101e00 2024-04-20T22:09:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.056+0000 7fd88a000700 1 -- 172.21.15.142:0/3596679454 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd87800f2e0 con 0x7fd88c101e00 2024-04-20T22:09:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.056+0000 7fd893e00700 1 -- 172.21.15.142:0/3596679454 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88c073c30 con 0x7fd88c101e00 2024-04-20T22:09:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.056+0000 7fd893e00700 1 -- 172.21.15.142:0/3596679454 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88c19e7a0 con 0x7fd88c101e00 2024-04-20T22:09:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.058+0000 7fd893e00700 1 -- 172.21.15.142:0/3596679454 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd88c190800 con 0x7fd88c101e00 2024-04-20T22:09:47.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.058+0000 7fd88a000700 1 -- 172.21.15.142:0/3596679454 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fd878010380 con 0x7fd88c101e00 2024-04-20T22:09:47.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.060+0000 7fd88a000700 1 --2- 172.21.15.142:0/3596679454 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd87406ecc0 0x7fd874071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:47.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.060+0000 7fd88a000700 1 -- 172.21.15.142:0/3596679454 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fd87808eb30 con 0x7fd88c101e00 2024-04-20T22:09:47.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.060+0000 7fd891400700 1 --2- 172.21.15.142:0/3596679454 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd87406ecc0 0x7fd874071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:47.061 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.061+0000 7fd891400700 1 --2- 172.21.15.142:0/3596679454 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd87406ecc0 0x7fd874071180 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd880006010 tx=0x7fd88000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:47.064 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.065+0000 7fd88a000700 1 -- 172.21.15.142:0/3596679454 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fd87805b3a0 con 0x7fd88c101e00 2024-04-20T22:09:47.373 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:47 smithi142 ceph-mon[79401]: from='client.34640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:09:47.374 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:47 smithi142 ceph-mon[79401]: from='client.34644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:09:47.374 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:47 smithi142 ceph-mon[79401]: from='client.34648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:09:47.374 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:47 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3451573372' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:47.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.373+0000 7fd893e00700 1 -- 172.21.15.142:0/3596679454 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd88c062510 con 0x7fd88c101e00 2024-04-20T22:09:47.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.374+0000 7fd88a000700 1 -- 172.21.15.142:0/3596679454 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1957 (secure 0 0 0) 0x7fd87805af30 con 0x7fd88c101e00 2024-04-20T22:09:47.375 INFO:teuthology.orchestra.run.smithi142.stdout:e35 2024-04-20T22:09:47.375 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:09:47.375 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:09:47.375 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T22:09:47.375 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:09:47.375 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T22:09:47.375 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T22:09:47.375 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 35 2024-04-20T22:09:47.375 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:09:47.375 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:09:47.375 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T22:07:34.267651+0000 2024-04-20T22:09:47.376 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T22:09:47.376 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T22:09:47.376 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T22:09:47.376 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T22:09:47.376 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T22:09:47.376 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T22:09:47.376 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T22:09:47.376 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T22:09:47.376 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 85 2024-04-20T22:09:47.376 INFO:teuthology.orchestra.run.smithi142.stdout:snap_rstat 1 2024-04-20T22:09:47.376 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-20T22:09:47.376 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T22:09:47.376 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T22:09:47.376 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=34454} 2024-04-20T22:09:47.377 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T22:09:47.377 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T22:09:47.377 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T22:09:47.377 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T22:09:47.377 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T22:09:47.377 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T22:09:47.377 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T22:09:47.377 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T22:09:47.377 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T22:09:47.377 INFO:teuthology.orchestra.run.smithi142.stdout:qdb_cluster leader: 34454 members: 34454 2024-04-20T22:09:47.377 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:34454} state up:active seq 26 join_fscid=1 addr [v2:172.21.15.142:6826/2100080187,v1:172.21.15.142:6827/2100080187] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:09:47.377 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:09:47.377 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:09:47.377 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T22:09:47.377 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:09:47.378 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:34486} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6828/2960234081,v1:172.21.15.142:6829/2960234081] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:09:47.378 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.164:6824/1951894011,v1:172.21.15.164:6825/1951894011] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:09:47.378 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.164:6826/3399966592,v1:172.21.15.164:6827/3399966592] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:09:47.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.378+0000 7fd893e00700 1 -- 172.21.15.142:0/3596679454 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd87406ecc0 msgr2=0x7fd874071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:47.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.378+0000 7fd893e00700 1 --2- 172.21.15.142:0/3596679454 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd87406ecc0 0x7fd874071180 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd880006010 tx=0x7fd88000b540 comp rx=0 tx=0).stop 2024-04-20T22:09:47.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.378+0000 7fd893e00700 1 -- 172.21.15.142:0/3596679454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd88c101e00 msgr2=0x7fd88c0732d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:47.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.378+0000 7fd893e00700 1 --2- 172.21.15.142:0/3596679454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd88c101e00 0x7fd88c0732d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd87800b4b0 tx=0x7fd87800b870 comp rx=0 tx=0).stop 2024-04-20T22:09:47.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.379+0000 7fd893e00700 1 -- 172.21.15.142:0/3596679454 shutdown_connections 2024-04-20T22:09:47.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.379+0000 7fd893e00700 1 --2- 172.21.15.142:0/3596679454 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd87406ecc0 0x7fd874071180 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:47.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.379+0000 7fd893e00700 1 --2- 172.21.15.142:0/3596679454 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd88c100c00 0x7fd88c074be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:47.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.379+0000 7fd893e00700 1 --2- 172.21.15.142:0/3596679454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd88c101e00 0x7fd88c0732d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:47.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.379+0000 7fd893e00700 1 -- 172.21.15.142:0/3596679454 >> 172.21.15.142:0/3596679454 conn(0x7fd88c0fc1c0 msgr2=0x7fd88c105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:47.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.379+0000 7fd893e00700 1 -- 172.21.15.142:0/3596679454 shutdown_connections 2024-04-20T22:09:47.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.379+0000 7fd893e00700 1 -- 172.21.15.142:0/3596679454 wait complete. 2024-04-20T22:09:47.380 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 35 2024-04-20T22:09:47.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:47 smithi164 ceph-mon[69784]: from='client.34640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:09:47.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:47 smithi164 ceph-mon[69784]: from='client.34644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:09:47.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:47 smithi164 ceph-mon[69784]: from='client.34648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:09:47.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:47 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3451573372' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:09:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.546+0000 7fd805000700 1 -- 172.21.15.142:0/47556711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8000ff4d0 msgr2=0x7fd8000ff8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.546+0000 7fd805000700 1 --2- 172.21.15.142:0/47556711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8000ff4d0 0x7fd8000ff8f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009910 tx=0x7fd7f0009c20 comp rx=0 tx=0).stop 2024-04-20T22:09:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.546+0000 7fd805000700 1 -- 172.21.15.142:0/47556711 shutdown_connections 2024-04-20T22:09:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.546+0000 7fd805000700 1 --2- 172.21.15.142:0/47556711 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8000ffe30 0x7fd8001002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.546+0000 7fd805000700 1 --2- 172.21.15.142:0/47556711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8000ff4d0 0x7fd8000ff8f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.546+0000 7fd805000700 1 -- 172.21.15.142:0/47556711 >> 172.21.15.142:0/47556711 conn(0x7fd8000fb0d0 msgr2=0x7fd8000fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:47.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.546+0000 7fd805000700 1 -- 172.21.15.142:0/47556711 shutdown_connections 2024-04-20T22:09:47.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.546+0000 7fd805000700 1 -- 172.21.15.142:0/47556711 wait complete. 2024-04-20T22:09:47.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.547+0000 7fd805000700 1 Processor -- start 2024-04-20T22:09:47.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.548+0000 7fd805000700 1 -- start start 2024-04-20T22:09:47.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.548+0000 7fd805000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8000ff4d0 0x7fd8001988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:47.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.548+0000 7fd805000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8000ffe30 0x7fd800198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:47.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.548+0000 7fd805000700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd800199440 con 0x7fd8000ff4d0 2024-04-20T22:09:47.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.548+0000 7fd805000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd800199580 con 0x7fd8000ffe30 2024-04-20T22:09:47.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.548+0000 7fd7fde00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8000ff4d0 0x7fd8001988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:47.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.548+0000 7fd7fde00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8000ff4d0 0x7fd8001988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59784/0 (socket says 172.21.15.142:59784) 2024-04-20T22:09:47.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.548+0000 7fd7fde00700 1 -- 172.21.15.142:0/246578137 learned_addr learned my addr 172.21.15.142:0/246578137 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:09:47.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.549+0000 7fd7fd400700 1 --2- 172.21.15.142:0/246578137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8000ffe30 0x7fd800198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:47.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.549+0000 7fd7fde00700 1 -- 172.21.15.142:0/246578137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8000ffe30 msgr2=0x7fd800198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:47.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.549+0000 7fd7fde00700 1 --2- 172.21.15.142:0/246578137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8000ffe30 0x7fd800198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:47.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.549+0000 7fd7fde00700 1 -- 172.21.15.142:0/246578137 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f00095f0 con 0x7fd8000ff4d0 2024-04-20T22:09:47.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.549+0000 7fd7fde00700 1 --2- 172.21.15.142:0/246578137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8000ff4d0 0x7fd8001988e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0006010 tx=0x7fd7f000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:47.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.549+0000 7fd7f6a00700 1 -- 172.21.15.142:0/246578137 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7f001d070 con 0x7fd8000ff4d0 2024-04-20T22:09:47.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.549+0000 7fd7f6a00700 1 -- 172.21.15.142:0/246578137 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7f000f460 con 0x7fd8000ff4d0 2024-04-20T22:09:47.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.549+0000 7fd7f6a00700 1 -- 172.21.15.142:0/246578137 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7f0021640 con 0x7fd8000ff4d0 2024-04-20T22:09:47.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.549+0000 7fd805000700 1 -- 172.21.15.142:0/246578137 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80006aa40 con 0x7fd8000ff4d0 2024-04-20T22:09:47.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.550+0000 7fd805000700 1 -- 172.21.15.142:0/246578137 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80006af10 con 0x7fd8000ff4d0 2024-04-20T22:09:47.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.551+0000 7fd805000700 1 -- 172.21.15.142:0/246578137 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8001929f0 con 0x7fd8000ff4d0 2024-04-20T22:09:47.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.552+0000 7fd7f6a00700 1 -- 172.21.15.142:0/246578137 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fd7f000fab0 con 0x7fd8000ff4d0 2024-04-20T22:09:47.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.553+0000 7fd7f6a00700 1 --2- 172.21.15.142:0/246578137 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd7e406ecc0 0x7fd7e4071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:47.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.554+0000 7fd7f6a00700 1 -- 172.21.15.142:0/246578137 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fd7f0090400 con 0x7fd8000ff4d0 2024-04-20T22:09:47.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.554+0000 7fd7fd400700 1 --2- 172.21.15.142:0/246578137 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd7e406ecc0 0x7fd7e4071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:47.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.555+0000 7fd7fd400700 1 --2- 172.21.15.142:0/246578137 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd7e406ecc0 0x7fd7e4071180 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec006fd0 tx=0x7fd7ec008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:47.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.558+0000 7fd7f6a00700 1 -- 172.21.15.142:0/246578137 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fd7f005cb40 con 0x7fd8000ff4d0 2024-04-20T22:09:47.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.841+0000 7fd805000700 1 -- 172.21.15.142:0/246578137 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd800061320 con 0x7fd7e406ecc0 2024-04-20T22:09:47.842 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.843+0000 7fd7f6a00700 1 -- 172.21.15.142:0/246578137 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+460 (secure 0 0 0) 0x7fd800061320 con 0x7fd7e406ecc0 2024-04-20T22:09:47.843 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:09:47.843 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1", 2024-04-20T22:09:47.843 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": true, 2024-04-20T22:09:47.843 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-20T22:09:47.843 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [ 2024-04-20T22:09:47.843 INFO:teuthology.orchestra.run.smithi142.stdout: "mon", 2024-04-20T22:09:47.843 INFO:teuthology.orchestra.run.smithi142.stdout: "mds", 2024-04-20T22:09:47.843 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr", 2024-04-20T22:09:47.843 INFO:teuthology.orchestra.run.smithi142.stdout: "osd", 2024-04-20T22:09:47.843 INFO:teuthology.orchestra.run.smithi142.stdout: "crash", 2024-04-20T22:09:47.843 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph-exporter" 2024-04-20T22:09:47.843 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-20T22:09:47.843 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": "18/23 daemons upgraded", 2024-04-20T22:09:47.843 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "Currently upgrading grafana daemons", 2024-04-20T22:09:47.844 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T22:09:47.844 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:09:47.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.845+0000 7fd805000700 1 -- 172.21.15.142:0/246578137 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd7e406ecc0 msgr2=0x7fd7e4071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:47.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.845+0000 7fd805000700 1 --2- 172.21.15.142:0/246578137 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd7e406ecc0 0x7fd7e4071180 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec006fd0 tx=0x7fd7ec008040 comp rx=0 tx=0).stop 2024-04-20T22:09:47.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.845+0000 7fd805000700 1 -- 172.21.15.142:0/246578137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8000ff4d0 msgr2=0x7fd8001988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:47.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.845+0000 7fd805000700 1 --2- 172.21.15.142:0/246578137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8000ff4d0 0x7fd8001988e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0006010 tx=0x7fd7f000be20 comp rx=0 tx=0).stop 2024-04-20T22:09:47.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.846+0000 7fd805000700 1 -- 172.21.15.142:0/246578137 shutdown_connections 2024-04-20T22:09:47.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.846+0000 7fd805000700 1 --2- 172.21.15.142:0/246578137 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd7e406ecc0 0x7fd7e4071180 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:47.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.846+0000 7fd805000700 1 --2- 172.21.15.142:0/246578137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8000ff4d0 0x7fd8001988e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:47.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.846+0000 7fd805000700 1 --2- 172.21.15.142:0/246578137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8000ffe30 0x7fd800198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:47.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.846+0000 7fd805000700 1 -- 172.21.15.142:0/246578137 >> 172.21.15.142:0/246578137 conn(0x7fd8000fb0d0 msgr2=0x7fd800107f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:47.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.846+0000 7fd805000700 1 -- 172.21.15.142:0/246578137 shutdown_connections 2024-04-20T22:09:47.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.846+0000 7fd805000700 1 -- 172.21.15.142:0/246578137 wait complete. 2024-04-20T22:09:47.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.993+0000 7f4f7d200700 1 -- 172.21.15.142:0/1411607857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f78074eb0 msgr2=0x7f4f78073310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:47.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.993+0000 7f4f7d200700 1 --2- 172.21.15.142:0/1411607857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f78074eb0 0x7f4f78073310 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009910 tx=0x7f4f68009c20 comp rx=0 tx=0).stop 2024-04-20T22:09:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.993+0000 7f4f7d200700 1 -- 172.21.15.142:0/1411607857 shutdown_connections 2024-04-20T22:09:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.993+0000 7f4f7d200700 1 --2- 172.21.15.142:0/1411607857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f780738e0 0x7f4f78073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.993+0000 7f4f7d200700 1 --2- 172.21.15.142:0/1411607857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f78074eb0 0x7f4f78073310 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.993+0000 7f4f7d200700 1 -- 172.21.15.142:0/1411607857 >> 172.21.15.142:0/1411607857 conn(0x7f4f780fc1d0 msgr2=0x7f4f780fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.993+0000 7f4f7d200700 1 -- 172.21.15.142:0/1411607857 shutdown_connections 2024-04-20T22:09:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.993+0000 7f4f7d200700 1 -- 172.21.15.142:0/1411607857 wait complete. 2024-04-20T22:09:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.994+0000 7f4f7d200700 1 Processor -- start 2024-04-20T22:09:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.994+0000 7f4f7d200700 1 -- start start 2024-04-20T22:09:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.995+0000 7f4f7d200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f780738e0 0x7f4f781988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.995+0000 7f4f7d200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f78074eb0 0x7f4f78198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:47.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.995+0000 7f4f7d200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f78199450 con 0x7f4f78074eb0 2024-04-20T22:09:47.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.995+0000 7f4f7d200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f78199590 con 0x7f4f780738e0 2024-04-20T22:09:47.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.995+0000 7f4f75400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f78074eb0 0x7f4f78198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:47.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.995+0000 7f4f75400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f78074eb0 0x7f4f78198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59796/0 (socket says 172.21.15.142:59796) 2024-04-20T22:09:47.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.995+0000 7f4f75400700 1 -- 172.21.15.142:0/3867784472 learned_addr learned my addr 172.21.15.142:0/3867784472 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:09:47.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.995+0000 7f4f75e00700 1 --2- 172.21.15.142:0/3867784472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f780738e0 0x7f4f781988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:47.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.995+0000 7f4f75400700 1 -- 172.21.15.142:0/3867784472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f780738e0 msgr2=0x7f4f781988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:47.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.995+0000 7f4f75400700 1 --2- 172.21.15.142:0/3867784472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f780738e0 0x7f4f781988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:47.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.995+0000 7f4f75400700 1 -- 172.21.15.142:0/3867784472 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f680095f0 con 0x7f4f78074eb0 2024-04-20T22:09:47.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.996+0000 7f4f75400700 1 --2- 172.21.15.142:0/3867784472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f78074eb0 0x7f4f78198e30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400b4b0 tx=0x7f4f6400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:47.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.996+0000 7f4f6ea00700 1 -- 172.21.15.142:0/3867784472 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f64011800 con 0x7f4f78074eb0 2024-04-20T22:09:47.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.996+0000 7f4f6ea00700 1 -- 172.21.15.142:0/3867784472 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f64011e20 con 0x7f4f78074eb0 2024-04-20T22:09:47.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.996+0000 7f4f7d200700 1 -- 172.21.15.142:0/3867784472 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7819dfa0 con 0x7f4f78074eb0 2024-04-20T22:09:47.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.996+0000 7f4f6ea00700 1 -- 172.21.15.142:0/3867784472 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f6400f2e0 con 0x7f4f78074eb0 2024-04-20T22:09:47.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.996+0000 7f4f7d200700 1 -- 172.21.15.142:0/3867784472 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7819e540 con 0x7f4f78074eb0 2024-04-20T22:09:47.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.997+0000 7f4f7d200700 1 -- 172.21.15.142:0/3867784472 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f78192a00 con 0x7f4f78074eb0 2024-04-20T22:09:48.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.998+0000 7f4f6ea00700 1 -- 172.21.15.142:0/3867784472 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f4f64011960 con 0x7f4f78074eb0 2024-04-20T22:09:48.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.999+0000 7f4f6ea00700 1 --2- 172.21.15.142:0/3867784472 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4f5c06ecc0 0x7f4f5c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:09:48.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:47.999+0000 7f4f6ea00700 1 -- 172.21.15.142:0/3867784472 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f4f6408e7c0 con 0x7f4f78074eb0 2024-04-20T22:09:48.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:48.000+0000 7f4f75e00700 1 --2- 172.21.15.142:0/3867784472 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4f5c06ecc0 0x7f4f5c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:09:48.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:48.001+0000 7f4f75e00700 1 --2- 172.21.15.142:0/3867784472 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4f5c06ecc0 0x7f4f5c071180 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800b5c0 tx=0x7f4f68005160 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:09:48.004 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:48.004+0000 7f4f6ea00700 1 -- 172.21.15.142:0/3867784472 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f4f6405afa0 con 0x7f4f78074eb0 2024-04-20T22:09:48.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:48 smithi142 ceph-mon[79401]: pgmap v324: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:48.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:48 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3596679454' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:09:48.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:48.329+0000 7f4f7d200700 1 -- 172.21.15.142:0/3867784472 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4f78062510 con 0x7f4f78074eb0 2024-04-20T22:09:48.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:48.330+0000 7f4f6ea00700 1 -- 172.21.15.142:0/3867784472 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f4f6405ab30 con 0x7f4f78074eb0 2024-04-20T22:09:48.330 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_OK 2024-04-20T22:09:48.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:48.333+0000 7f4f7d200700 1 -- 172.21.15.142:0/3867784472 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4f5c06ecc0 msgr2=0x7f4f5c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:48.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:48.333+0000 7f4f7d200700 1 --2- 172.21.15.142:0/3867784472 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4f5c06ecc0 0x7f4f5c071180 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800b5c0 tx=0x7f4f68005160 comp rx=0 tx=0).stop 2024-04-20T22:09:48.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:48.333+0000 7f4f7d200700 1 -- 172.21.15.142:0/3867784472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f78074eb0 msgr2=0x7f4f78198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:09:48.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:48.333+0000 7f4f7d200700 1 --2- 172.21.15.142:0/3867784472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f78074eb0 0x7f4f78198e30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400b4b0 tx=0x7f4f6400b870 comp rx=0 tx=0).stop 2024-04-20T22:09:48.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:48.333+0000 7f4f7d200700 1 -- 172.21.15.142:0/3867784472 shutdown_connections 2024-04-20T22:09:48.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:48.333+0000 7f4f7d200700 1 --2- 172.21.15.142:0/3867784472 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4f5c06ecc0 0x7f4f5c071180 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:48.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:48.333+0000 7f4f7d200700 1 --2- 172.21.15.142:0/3867784472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f780738e0 0x7f4f781988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:48.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:48.333+0000 7f4f7d200700 1 --2- 172.21.15.142:0/3867784472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f78074eb0 0x7f4f78198e30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:09:48.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:48.333+0000 7f4f7d200700 1 -- 172.21.15.142:0/3867784472 >> 172.21.15.142:0/3867784472 conn(0x7f4f780fc1d0 msgr2=0x7f4f78106e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:09:48.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:48.333+0000 7f4f7d200700 1 -- 172.21.15.142:0/3867784472 shutdown_connections 2024-04-20T22:09:48.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:09:48.333+0000 7f4f7d200700 1 -- 172.21.15.142:0/3867784472 wait complete. 2024-04-20T22:09:48.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:48 smithi164 ceph-mon[69784]: pgmap v324: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:48.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:48 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3596679454' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:09:49.390 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:49 smithi142 ceph-mon[79401]: from='client.34660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:09:49.390 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:49 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3867784472' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:09:49.390 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:49 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:49.390 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:49 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:49.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:49 smithi164 ceph-mon[69784]: from='client.34660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:09:49.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:49 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3867784472' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:09:49.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:49 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:49.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:49 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:50.384 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:50 smithi142 ceph-mon[79401]: pgmap v325: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:50.385 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:50 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:09:50.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:50 smithi164 ceph-mon[69784]: pgmap v325: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:50.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:50 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:09:52.414 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:52 smithi142 ceph-mon[79401]: pgmap v326: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:52.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:52 smithi164 ceph-mon[69784]: pgmap v326: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:54.325 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:54 smithi142 ceph-mon[79401]: pgmap v327: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:54.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:54 smithi164 ceph-mon[69784]: pgmap v327: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:56.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:56 smithi142 ceph-mon[79401]: pgmap v328: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:56.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:56 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:56.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:56 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:56.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:56 smithi164 ceph-mon[69784]: pgmap v328: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:56.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:56 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:56.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:56 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:58.665 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:58 smithi142 ceph-mon[79401]: pgmap v329: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:58.666 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:58 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:58.666 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:09:58 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:58.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:58 smithi164 ceph-mon[69784]: pgmap v329: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:09:58.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:58 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:09:58.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:09:58 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:10:00.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:00 smithi142 ceph-mon[79401]: pgmap v330: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:00.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:00 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:10:00.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:00 smithi142 ceph-mon[79401]: overall HEALTH_OK 2024-04-20T22:10:00.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:00 smithi164 ceph-mon[69784]: pgmap v330: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:00.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:00 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:10:00.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:00 smithi164 ceph-mon[69784]: overall HEALTH_OK 2024-04-20T22:10:02.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:02 smithi142 ceph-mon[79401]: pgmap v331: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:02.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:02 smithi164 ceph-mon[69784]: pgmap v331: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:03.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: pgmap v332: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:03.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:10:03.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:10:03.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:10:03.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:10:03.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:10:03.948 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-20T22:10:03.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-20T22:10:03.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:10:03.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.949 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.950 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.950 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.950 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.950 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.950 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: pgmap v332: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:03.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:10:03.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:10:03.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:10:03.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:10:03.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:10:03.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-20T22:10:03.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-20T22:10:03.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:10:03.951 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.952 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: Upgrade: Finalizing container_image settings 2024-04-20T22:10:03.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:10:03.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-20T22:10:03.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-20T22:10:03.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-20T22:10:03.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-20T22:10:03.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-20T22:10:03.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-20T22:10:03.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-20T22:10:03.953 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-20T22:10:03.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-20T22:10:03.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-20T22:10:03.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-20T22:10:03.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-20T22:10:03.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-20T22:10:03.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-20T22:10:03.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-20T22:10:03.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-20T22:10:03.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-20T22:10:03.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-20T22:10:03.954 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-20T22:10:03.954 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:03.954 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: Upgrade: Finalizing container_image settings 2024-04-20T22:10:03.954 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:10:03.955 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-20T22:10:03.955 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-20T22:10:03.955 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-20T22:10:03.955 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-20T22:10:03.955 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-20T22:10:03.955 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-20T22:10:03.955 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-20T22:10:03.955 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-20T22:10:03.955 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-20T22:10:03.955 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-20T22:10:03.955 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-20T22:10:03.955 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-20T22:10:03.955 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-20T22:10:03.955 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-20T22:10:03.956 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-20T22:10:03.956 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-20T22:10:03.956 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-20T22:10:03.956 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-20T22:10:03.956 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-20T22:10:03.956 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-20T22:10:03.956 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-20T22:10:03.956 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-20T22:10:03.956 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-20T22:10:03.956 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-20T22:10:03.956 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-20T22:10:03.956 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-20T22:10:03.956 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-20T22:10:03.956 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-20T22:10:03.957 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-20T22:10:03.957 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: Upgrade: Complete! 2024-04-20T22:10:03.957 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-20T22:10:03.957 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-20T22:10:03.957 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:10:03.957 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:10:03.957 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:10:03.957 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:10:03.957 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:10:03.957 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:10:03.957 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:10:03.957 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:03 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:10:03.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-20T22:10:03.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-20T22:10:03.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-20T22:10:03.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-20T22:10:03.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-20T22:10:03.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-20T22:10:03.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-20T22:10:03.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-20T22:10:03.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-20T22:10:03.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-20T22:10:03.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: Upgrade: Complete! 2024-04-20T22:10:03.958 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-20T22:10:03.959 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-20T22:10:03.959 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:10:03.959 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:10:03.959 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:10:03.959 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:10:03.959 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:10:03.959 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:10:03.959 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:10:03.959 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:03 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:10:05.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:05 smithi142 ceph-mon[79401]: pgmap v333: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:05.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:05 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:10:05.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:05 smithi164 ceph-mon[69784]: pgmap v333: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:05.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:05 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:10:07.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:07 smithi164 ceph-mon[69784]: pgmap v334: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:07.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:07 smithi142 ceph-mon[79401]: pgmap v334: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:09.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:09 smithi164 ceph-mon[69784]: pgmap v335: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:09.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:09 smithi142 ceph-mon[79401]: pgmap v335: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:11.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:11 smithi164 ceph-mon[69784]: pgmap v336: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:11.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:11 smithi142 ceph-mon[79401]: pgmap v336: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:13.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:13 smithi164 ceph-mon[69784]: pgmap v337: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:13.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:13 smithi142 ceph-mon[79401]: pgmap v337: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:15.158 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:10:15.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:10:16.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:15 smithi142 ceph-mon[79401]: pgmap v338: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:16.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:15 smithi164 ceph-mon[69784]: pgmap v338: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:17.968 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:17 smithi164 ceph-mon[69784]: pgmap v339: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:18.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:17 smithi142 ceph-mon[79401]: pgmap v339: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:18.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.505+0000 7f6887200700 1 -- 172.21.15.142:0/1880478916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6880108430 msgr2=0x7f68801088b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:18.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.505+0000 7f6887200700 1 --2- 172.21.15.142:0/1880478916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6880108430 0x7f68801088b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f686c009910 tx=0x7f686c009c20 comp rx=0 tx=0).stop 2024-04-20T22:10:18.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.505+0000 7f6887200700 1 -- 172.21.15.142:0/1880478916 shutdown_connections 2024-04-20T22:10:18.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.505+0000 7f6887200700 1 --2- 172.21.15.142:0/1880478916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6880108430 0x7f68801088b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:18.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.505+0000 7f6887200700 1 --2- 172.21.15.142:0/1880478916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6880107260 0x7f6880107680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:18.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.505+0000 7f6887200700 1 -- 172.21.15.142:0/1880478916 >> 172.21.15.142:0/1880478916 conn(0x7f6880076400 msgr2=0x7f6880078840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:10:18.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.505+0000 7f6887200700 1 -- 172.21.15.142:0/1880478916 shutdown_connections 2024-04-20T22:10:18.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.505+0000 7f6887200700 1 -- 172.21.15.142:0/1880478916 wait complete. 2024-04-20T22:10:18.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.506+0000 7f6887200700 1 Processor -- start 2024-04-20T22:10:18.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.506+0000 7f6887200700 1 -- start start 2024-04-20T22:10:18.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.507+0000 7f6887200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6880107260 0x7f688019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:10:18.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.507+0000 7f6887200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6880108430 0x7f688019d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:10:18.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.507+0000 7f6887200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688019d760 con 0x7f6880107260 2024-04-20T22:10:18.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.507+0000 7f6887200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688019d8a0 con 0x7f6880108430 2024-04-20T22:10:18.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.507+0000 7f687fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6880107260 0x7f688019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:10:18.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.507+0000 7f687fe00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6880107260 0x7f688019cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39172/0 (socket says 172.21.15.142:39172) 2024-04-20T22:10:18.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.507+0000 7f687fe00700 1 -- 172.21.15.142:0/1345768551 learned_addr learned my addr 172.21.15.142:0/1345768551 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:10:18.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.508+0000 7f687fe00700 1 -- 172.21.15.142:0/1345768551 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6880108430 msgr2=0x7f688019d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:18.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.508+0000 7f687fe00700 1 --2- 172.21.15.142:0/1345768551 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6880108430 0x7f688019d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:18.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.508+0000 7f687fe00700 1 -- 172.21.15.142:0/1345768551 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c0095f0 con 0x7f6880107260 2024-04-20T22:10:18.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.508+0000 7f687fe00700 1 --2- 172.21.15.142:0/1345768551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6880107260 0x7f688019cc00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f687000c8a0 tx=0x7f687000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:10:18.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.508+0000 7f687cc00700 1 -- 172.21.15.142:0/1345768551 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f687000cea0 con 0x7f6880107260 2024-04-20T22:10:18.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.508+0000 7f687cc00700 1 -- 172.21.15.142:0/1345768551 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6870004830 con 0x7f6880107260 2024-04-20T22:10:18.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.508+0000 7f6887200700 1 -- 172.21.15.142:0/1345768551 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68801a2300 con 0x7f6880107260 2024-04-20T22:10:18.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.508+0000 7f6887200700 1 -- 172.21.15.142:0/1345768551 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68801a28d0 con 0x7f6880107260 2024-04-20T22:10:18.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.508+0000 7f687cc00700 1 -- 172.21.15.142:0/1345768551 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68700055b0 con 0x7f6880107260 2024-04-20T22:10:18.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.509+0000 7f6887200700 1 -- 172.21.15.142:0/1345768551 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68600052f0 con 0x7f6880107260 2024-04-20T22:10:18.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.511+0000 7f687cc00700 1 -- 172.21.15.142:0/1345768551 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f6870004e10 con 0x7f6880107260 2024-04-20T22:10:18.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.512+0000 7f687cc00700 1 --2- 172.21.15.142:0/1345768551 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f686406ecc0 0x7f6864071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:10:18.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.512+0000 7f687cc00700 1 -- 172.21.15.142:0/1345768551 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f687008eb60 con 0x7f6880107260 2024-04-20T22:10:18.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.512+0000 7f687f400700 1 --2- 172.21.15.142:0/1345768551 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f686406ecc0 0x7f6864071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:10:18.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.513+0000 7f687f400700 1 --2- 172.21.15.142:0/1345768551 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f686406ecc0 0x7f6864071180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f686c0051c0 tx=0x7f686c005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:10:18.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.518+0000 7f687cc00700 1 -- 172.21.15.142:0/1345768551 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f687005b320 con 0x7f6880107260 2024-04-20T22:10:18.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.767+0000 7f6887200700 1 -- 172.21.15.142:0/1345768551 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6860000bc0 con 0x7f686406ecc0 2024-04-20T22:10:18.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.770+0000 7f687cc00700 1 -- 172.21.15.142:0/1345768551 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f6860000bc0 con 0x7f686406ecc0 2024-04-20T22:10:18.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.773+0000 7f6887200700 1 -- 172.21.15.142:0/1345768551 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f686406ecc0 msgr2=0x7f6864071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:18.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.773+0000 7f6887200700 1 --2- 172.21.15.142:0/1345768551 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f686406ecc0 0x7f6864071180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f686c0051c0 tx=0x7f686c005fd0 comp rx=0 tx=0).stop 2024-04-20T22:10:18.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.773+0000 7f6887200700 1 -- 172.21.15.142:0/1345768551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6880107260 msgr2=0x7f688019cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:18.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.773+0000 7f6887200700 1 --2- 172.21.15.142:0/1345768551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6880107260 0x7f688019cc00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f687000c8a0 tx=0x7f687000cc60 comp rx=0 tx=0).stop 2024-04-20T22:10:18.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.773+0000 7f6887200700 1 -- 172.21.15.142:0/1345768551 shutdown_connections 2024-04-20T22:10:18.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.773+0000 7f6887200700 1 --2- 172.21.15.142:0/1345768551 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f686406ecc0 0x7f6864071180 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:18.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.773+0000 7f6887200700 1 --2- 172.21.15.142:0/1345768551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6880107260 0x7f688019cc00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:18.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.773+0000 7f6887200700 1 --2- 172.21.15.142:0/1345768551 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6880108430 0x7f688019d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:18.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.773+0000 7f6887200700 1 -- 172.21.15.142:0/1345768551 >> 172.21.15.142:0/1345768551 conn(0x7f6880076400 msgr2=0x7f688010b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:10:18.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.773+0000 7f6887200700 1 -- 172.21.15.142:0/1345768551 shutdown_connections 2024-04-20T22:10:18.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:18.773+0000 7f6887200700 1 -- 172.21.15.142:0/1345768551 wait complete. 2024-04-20T22:10:19.548 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -e sha1=a8c84f5997950fd7d008204839253291d52e6eda -- bash -c 'ceph orch ps' 2024-04-20T22:10:19.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:19 smithi142 ceph-mon[79401]: pgmap v340: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:19.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:19 smithi142 ceph-mon[79401]: from='client.34668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:10:19.967 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T22:10:20.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:19 smithi164 ceph-mon[69784]: pgmap v340: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:20.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:19 smithi164 ceph-mon[69784]: from='client.34668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:10:21.839 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:21 smithi142 ceph-mon[79401]: pgmap v341: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:22.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.010+0000 7fee55400700 1 -- 172.21.15.142:0/2342621673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee50104a00 msgr2=0x7fee50104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:22.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.010+0000 7fee55400700 1 --2- 172.21.15.142:0/2342621673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee50104a00 0x7fee50104e80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009910 tx=0x7fee3c009c20 comp rx=0 tx=0).stop 2024-04-20T22:10:22.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.011+0000 7fee55400700 1 -- 172.21.15.142:0/2342621673 shutdown_connections 2024-04-20T22:10:22.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.011+0000 7fee55400700 1 --2- 172.21.15.142:0/2342621673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee50104a00 0x7fee50104e80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:22.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.011+0000 7fee55400700 1 --2- 172.21.15.142:0/2342621673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee50103110 0x7fee501034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:22.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.011+0000 7fee55400700 1 -- 172.21.15.142:0/2342621673 >> 172.21.15.142:0/2342621673 conn(0x7fee500fe880 msgr2=0x7fee50100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:10:22.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.011+0000 7fee55400700 1 -- 172.21.15.142:0/2342621673 shutdown_connections 2024-04-20T22:10:22.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.011+0000 7fee55400700 1 -- 172.21.15.142:0/2342621673 wait complete. 2024-04-20T22:10:22.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.012+0000 7fee55400700 1 Processor -- start 2024-04-20T22:10:22.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.012+0000 7fee55400700 1 -- start start 2024-04-20T22:10:22.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.012+0000 7fee55400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee50103110 0x7fee5019ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:10:22.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.012+0000 7fee55400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee50104a00 0x7fee5019ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:10:22.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.012+0000 7fee55400700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5019f5b0 con 0x7fee50104a00 2024-04-20T22:10:22.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.012+0000 7fee55400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee50198b90 con 0x7fee50103110 2024-04-20T22:10:22.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.013+0000 7fee4de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee50104a00 0x7fee5019ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:10:22.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.013+0000 7fee4de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee50104a00 0x7fee5019ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39198/0 (socket says 172.21.15.142:39198) 2024-04-20T22:10:22.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.013+0000 7fee4de00700 1 -- 172.21.15.142:0/3739664117 learned_addr learned my addr 172.21.15.142:0/3739664117 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:10:22.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.013+0000 7fee4e800700 1 --2- 172.21.15.142:0/3739664117 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee50103110 0x7fee5019ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:10:22.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.013+0000 7fee4de00700 1 -- 172.21.15.142:0/3739664117 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee50103110 msgr2=0x7fee5019ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:22.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.013+0000 7fee4de00700 1 --2- 172.21.15.142:0/3739664117 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee50103110 0x7fee5019ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:22.013 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.013+0000 7fee4de00700 1 -- 172.21.15.142:0/3739664117 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c0095f0 con 0x7fee50104a00 2024-04-20T22:10:22.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.013+0000 7fee4de00700 1 --2- 172.21.15.142:0/3739664117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee50104a00 0x7fee5019ef90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0092e0 tx=0x7fee3c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:10:22.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.014+0000 7fee47400700 1 -- 172.21.15.142:0/3739664117 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee3c01d070 con 0x7fee50104a00 2024-04-20T22:10:22.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.014+0000 7fee47400700 1 -- 172.21.15.142:0/3739664117 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee3c00f460 con 0x7fee50104a00 2024-04-20T22:10:22.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.014+0000 7fee55400700 1 -- 172.21.15.142:0/3739664117 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee50198e10 con 0x7fee50104a00 2024-04-20T22:10:22.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.014+0000 7fee47400700 1 -- 172.21.15.142:0/3739664117 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee3c017630 con 0x7fee50104a00 2024-04-20T22:10:22.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.014+0000 7fee55400700 1 -- 172.21.15.142:0/3739664117 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee50199380 con 0x7fee50104a00 2024-04-20T22:10:22.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.015+0000 7fee55400700 1 -- 172.21.15.142:0/3739664117 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5010b480 con 0x7fee50104a00 2024-04-20T22:10:22.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.016+0000 7fee47400700 1 -- 172.21.15.142:0/3739664117 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fee3c00f5d0 con 0x7fee50104a00 2024-04-20T22:10:22.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.018+0000 7fee47400700 1 --2- 172.21.15.142:0/3739664117 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fee3406ecd0 0x7fee34071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:10:22.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.018+0000 7fee47400700 1 -- 172.21.15.142:0/3739664117 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fee3c090450 con 0x7fee50104a00 2024-04-20T22:10:22.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.018+0000 7fee4e800700 1 --2- 172.21.15.142:0/3739664117 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fee3406ecd0 0x7fee34071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:10:22.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.019+0000 7fee4e800700 1 --2- 172.21.15.142:0/3739664117 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fee3406ecd0 0x7fee34071190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fee40005fd0 tx=0x7fee4000a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:10:22.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.023+0000 7fee47400700 1 -- 172.21.15.142:0/3739664117 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fee3c05cc10 con 0x7fee50104a00 2024-04-20T22:10:22.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:21 smithi164 ceph-mon[69784]: pgmap v341: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:22.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.263+0000 7fee55400700 1 -- 172.21.15.142:0/3739664117 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fee50199fe0 con 0x7fee3406ecd0 2024-04-20T22:10:22.280 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.281+0000 7fee47400700 1 -- 172.21.15.142:0/3739664117 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fee50199fe0 con 0x7fee3406ecd0 2024-04-20T22:10:22.281 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:10:22.281 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (66s) 26s ago 22m 14.5M - 0.25.0 c8568f914cd2 91b692cbdcb6 2024-04-20T22:10:22.281 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (2m) 26s ago 23m 8040k - 19.0.0-3133-ga8c84f59 76bc6b91b726 eadbb8123608 2024-04-20T22:10:22.281 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (2m) 111s ago 21m 7638k - 19.0.0-3133-ga8c84f59 76bc6b91b726 13030cc1a7a8 2024-04-20T22:10:22.281 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (8m) 26s ago 23m 6665k - 19.0.0-3133-ga8c84f59 76bc6b91b726 64521ed7125b 2024-04-20T22:10:22.281 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (8m) 111s ago 21m 6656k - 19.0.0-3133-ga8c84f59 76bc6b91b726 893c6f16ee6d 2024-04-20T22:10:22.281 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (34s) 26s ago 22m 51.1M - 9.4.12 2bacad6d85d8 b4589f50ae1c 2024-04-20T22:10:22.281 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (4m) 26s ago 15m 87.3M - 19.0.0-3133-ga8c84f59 76bc6b91b726 603d9ff4accc 2024-04-20T22:10:22.281 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (3m) 26s ago 15m 13.4M - 19.0.0-3133-ga8c84f59 76bc6b91b726 5fbbe225e911 2024-04-20T22:10:22.281 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (2m) 111s ago 15m 12.2M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3ee3d509a48c 2024-04-20T22:10:22.281 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (3m) 111s ago 15m 12.4M - 19.0.0-3133-ga8c84f59 76bc6b91b726 44901e1ad990 2024-04-20T22:10:22.281 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (12m) 26s ago 24m 522M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:10:22.282 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (10m) 111s ago 21m 454M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:10:22.282 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (10m) 26s ago 24m 62.5M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 af10a542c918 2024-04-20T22:10:22.282 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (9m) 111s ago 21m 43.5M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 133512694d46 2024-04-20T22:10:22.282 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (2m) 26s ago 23m 7578k - 1.5.0 0da6a335fe13 f21ef73493a2 2024-04-20T22:10:22.282 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (116s) 111s ago 21m 2843k - 1.5.0 0da6a335fe13 0ba09db59c8e 2024-04-20T22:10:22.282 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (7m) 26s ago 20m 108M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 b7206d05a7cd 2024-04-20T22:10:22.282 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (7m) 26s ago 19m 109M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 82bcc0c46762 2024-04-20T22:10:22.282 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (6m) 26s ago 19m 94.8M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 3e2d91f49494 2024-04-20T22:10:22.282 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (6m) 111s ago 18m 119M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 a898b8b77c51 2024-04-20T22:10:22.282 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (5m) 111s ago 18m 103M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 539c4026f9fb 2024-04-20T22:10:22.282 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (4m) 111s ago 17m 95.8M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 ac1bdd69c944 2024-04-20T22:10:22.282 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (91s) 26s ago 22m 58.9M - 2.43.0 a07b618ecd1d 2b3da2d4dfc7 2024-04-20T22:10:22.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.283+0000 7fee55400700 1 -- 172.21.15.142:0/3739664117 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fee3406ecd0 msgr2=0x7fee34071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:22.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.283+0000 7fee55400700 1 --2- 172.21.15.142:0/3739664117 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fee3406ecd0 0x7fee34071190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fee40005fd0 tx=0x7fee4000a560 comp rx=0 tx=0).stop 2024-04-20T22:10:22.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.283+0000 7fee55400700 1 -- 172.21.15.142:0/3739664117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee50104a00 msgr2=0x7fee5019ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:22.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.283+0000 7fee55400700 1 --2- 172.21.15.142:0/3739664117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee50104a00 0x7fee5019ef90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0092e0 tx=0x7fee3c00be20 comp rx=0 tx=0).stop 2024-04-20T22:10:22.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.284+0000 7fee55400700 1 -- 172.21.15.142:0/3739664117 shutdown_connections 2024-04-20T22:10:22.283 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.284+0000 7fee55400700 1 --2- 172.21.15.142:0/3739664117 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fee3406ecd0 0x7fee34071190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:22.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.284+0000 7fee55400700 1 --2- 172.21.15.142:0/3739664117 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee50103110 0x7fee5019ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:22.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.284+0000 7fee55400700 1 --2- 172.21.15.142:0/3739664117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee50104a00 0x7fee5019ef90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:22.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.284+0000 7fee55400700 1 -- 172.21.15.142:0/3739664117 >> 172.21.15.142:0/3739664117 conn(0x7fee500fe880 msgr2=0x7fee500ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:10:22.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.284+0000 7fee55400700 1 -- 172.21.15.142:0/3739664117 shutdown_connections 2024-04-20T22:10:22.284 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:22.284+0000 7fee55400700 1 -- 172.21.15.142:0/3739664117 wait complete. 2024-04-20T22:10:22.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:22 smithi142 ceph-mon[79401]: from='client.34672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:10:23.061 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -e sha1=a8c84f5997950fd7d008204839253291d52e6eda -- bash -c 'ceph orch upgrade status' 2024-04-20T22:10:23.115 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:22 smithi164 ceph-mon[69784]: from='client.34672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:10:23.492 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T22:10:23.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:23 smithi142 ceph-mon[79401]: pgmap v342: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:24.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:23 smithi164 ceph-mon[69784]: pgmap v342: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:25.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.735+0000 7f65c2a00700 1 -- 172.21.15.142:0/1255858311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65bc104a00 msgr2=0x7f65bc104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:25.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.735+0000 7f65c2a00700 1 --2- 172.21.15.142:0/1255858311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65bc104a00 0x7f65bc104e80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009910 tx=0x7f65a8009c20 comp rx=0 tx=0).stop 2024-04-20T22:10:25.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.735+0000 7f65c2a00700 1 -- 172.21.15.142:0/1255858311 shutdown_connections 2024-04-20T22:10:25.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.735+0000 7f65c2a00700 1 --2- 172.21.15.142:0/1255858311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65bc104a00 0x7f65bc104e80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:25.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.735+0000 7f65c2a00700 1 --2- 172.21.15.142:0/1255858311 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65bc103110 0x7f65bc1034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:25.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.735+0000 7f65c2a00700 1 -- 172.21.15.142:0/1255858311 >> 172.21.15.142:0/1255858311 conn(0x7f65bc0fe880 msgr2=0x7f65bc100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:10:25.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.735+0000 7f65c2a00700 1 -- 172.21.15.142:0/1255858311 shutdown_connections 2024-04-20T22:10:25.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.735+0000 7f65c2a00700 1 -- 172.21.15.142:0/1255858311 wait complete. 2024-04-20T22:10:25.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.736+0000 7f65c2a00700 1 Processor -- start 2024-04-20T22:10:25.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.736+0000 7f65c2a00700 1 -- start start 2024-04-20T22:10:25.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.737+0000 7f65c2a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65bc103110 0x7f65bc19ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:10:25.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.737+0000 7f65c2a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65bc104a00 0x7f65bc19ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:10:25.737 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.737+0000 7f65c2a00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc19f5b0 con 0x7f65bc104a00 2024-04-20T22:10:25.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.737+0000 7f65c2a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc198b90 con 0x7f65bc103110 2024-04-20T22:10:25.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.737+0000 7f65bb400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65bc104a00 0x7f65bc19ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:10:25.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.737+0000 7f65bb400700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65bc104a00 0x7f65bc19ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39222/0 (socket says 172.21.15.142:39222) 2024-04-20T22:10:25.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.737+0000 7f65bb400700 1 -- 172.21.15.142:0/3844686369 learned_addr learned my addr 172.21.15.142:0/3844686369 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:10:25.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.737+0000 7f65bbe00700 1 --2- 172.21.15.142:0/3844686369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65bc103110 0x7f65bc19ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:10:25.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.737+0000 7f65bb400700 1 -- 172.21.15.142:0/3844686369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65bc103110 msgr2=0x7f65bc19ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:25.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.737+0000 7f65bb400700 1 --2- 172.21.15.142:0/3844686369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65bc103110 0x7f65bc19ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:25.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.737+0000 7f65bb400700 1 -- 172.21.15.142:0/3844686369 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a80095f0 con 0x7f65bc104a00 2024-04-20T22:10:25.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.738+0000 7f65bbe00700 1 --2- 172.21.15.142:0/3844686369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65bc103110 0x7f65bc19ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:10:25.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.738+0000 7f65bb400700 1 --2- 172.21.15.142:0/3844686369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65bc104a00 0x7f65bc19ef90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f65a80092e0 tx=0x7f65a800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:10:25.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.738+0000 7f65b8c00700 1 -- 172.21.15.142:0/3844686369 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65a801d070 con 0x7f65bc104a00 2024-04-20T22:10:25.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.738+0000 7f65b8c00700 1 -- 172.21.15.142:0/3844686369 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f65a80056e0 con 0x7f65bc104a00 2024-04-20T22:10:25.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.738+0000 7f65b8c00700 1 -- 172.21.15.142:0/3844686369 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65a800fe80 con 0x7f65bc104a00 2024-04-20T22:10:25.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.738+0000 7f65c2a00700 1 -- 172.21.15.142:0/3844686369 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65bc198e10 con 0x7f65bc104a00 2024-04-20T22:10:25.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.738+0000 7f65c2a00700 1 -- 172.21.15.142:0/3844686369 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65bc199380 con 0x7f65bc104a00 2024-04-20T22:10:25.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.739+0000 7f65c2a00700 1 -- 172.21.15.142:0/3844686369 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65bc10b480 con 0x7f65bc104a00 2024-04-20T22:10:25.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.741+0000 7f65b8c00700 1 -- 172.21.15.142:0/3844686369 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f65a800f6f0 con 0x7f65bc104a00 2024-04-20T22:10:25.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.742+0000 7f65b8c00700 1 --2- 172.21.15.142:0/3844686369 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f65a006ecd0 0x7f65a0071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:10:25.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.742+0000 7f65b8c00700 1 -- 172.21.15.142:0/3844686369 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f65a8090360 con 0x7f65bc104a00 2024-04-20T22:10:25.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.742+0000 7f65bbe00700 1 --2- 172.21.15.142:0/3844686369 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f65a006ecd0 0x7f65a0071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:10:25.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.743+0000 7f65bbe00700 1 --2- 172.21.15.142:0/3844686369 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f65a006ecd0 0x7f65a0071190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f65ac005fd0 tx=0x7f65ac005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:10:25.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.747+0000 7f65b8c00700 1 -- 172.21.15.142:0/3844686369 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f65a805cb20 con 0x7f65bc104a00 2024-04-20T22:10:25.996 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.996+0000 7f65c2a00700 1 -- 172.21.15.142:0/3844686369 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f65bc04ec50 con 0x7f65a006ecd0 2024-04-20T22:10:25.997 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:25 smithi142 ceph-mon[79401]: pgmap v343: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:25.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:25.998+0000 7f65b8c00700 1 -- 172.21.15.142:0/3844686369 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f65bc04ec50 con 0x7f65a006ecd0 2024-04-20T22:10:25.999 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:10:25.999 INFO:teuthology.orchestra.run.smithi142.stdout: "target_image": null, 2024-04-20T22:10:25.999 INFO:teuthology.orchestra.run.smithi142.stdout: "in_progress": false, 2024-04-20T22:10:26.000 INFO:teuthology.orchestra.run.smithi142.stdout: "which": "", 2024-04-20T22:10:26.000 INFO:teuthology.orchestra.run.smithi142.stdout: "services_complete": [], 2024-04-20T22:10:26.000 INFO:teuthology.orchestra.run.smithi142.stdout: "progress": null, 2024-04-20T22:10:26.000 INFO:teuthology.orchestra.run.smithi142.stdout: "message": "", 2024-04-20T22:10:26.000 INFO:teuthology.orchestra.run.smithi142.stdout: "is_paused": false 2024-04-20T22:10:26.000 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:10:26.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:26.001+0000 7f65c2a00700 1 -- 172.21.15.142:0/3844686369 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f65a006ecd0 msgr2=0x7f65a0071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:26.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:26.001+0000 7f65c2a00700 1 --2- 172.21.15.142:0/3844686369 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f65a006ecd0 0x7f65a0071190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f65ac005fd0 tx=0x7f65ac005ee0 comp rx=0 tx=0).stop 2024-04-20T22:10:26.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:26.001+0000 7f65c2a00700 1 -- 172.21.15.142:0/3844686369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65bc104a00 msgr2=0x7f65bc19ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:26.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:26.001+0000 7f65c2a00700 1 --2- 172.21.15.142:0/3844686369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65bc104a00 0x7f65bc19ef90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f65a80092e0 tx=0x7f65a800be20 comp rx=0 tx=0).stop 2024-04-20T22:10:26.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:26.001+0000 7f65c2a00700 1 -- 172.21.15.142:0/3844686369 shutdown_connections 2024-04-20T22:10:26.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:26.001+0000 7f65c2a00700 1 --2- 172.21.15.142:0/3844686369 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f65a006ecd0 0x7f65a0071190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:26.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:26.001+0000 7f65c2a00700 1 --2- 172.21.15.142:0/3844686369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65bc103110 0x7f65bc19ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:26.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:26.001+0000 7f65c2a00700 1 --2- 172.21.15.142:0/3844686369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65bc104a00 0x7f65bc19ef90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:26.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:26.001+0000 7f65c2a00700 1 -- 172.21.15.142:0/3844686369 >> 172.21.15.142:0/3844686369 conn(0x7f65bc0fe880 msgr2=0x7f65bc0ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:10:26.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:26.001+0000 7f65c2a00700 1 -- 172.21.15.142:0/3844686369 shutdown_connections 2024-04-20T22:10:26.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:26.002+0000 7f65c2a00700 1 -- 172.21.15.142:0/3844686369 wait complete. 2024-04-20T22:10:26.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:25 smithi164 ceph-mon[69784]: pgmap v343: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:26.761 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -e sha1=a8c84f5997950fd7d008204839253291d52e6eda -- bash -c 'ceph health detail' 2024-04-20T22:10:27.175 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T22:10:27.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:26 smithi142 ceph-mon[79401]: from='client.34676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:10:27.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:26 smithi164 ceph-mon[69784]: from='client.34676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:10:27.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:27 smithi142 ceph-mon[79401]: pgmap v344: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:28.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:27 smithi164 ceph-mon[69784]: pgmap v344: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:29.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.350+0000 7f1f55200700 1 -- 172.21.15.142:0/2872254076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f50107520 msgr2=0x7f1f50107900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:29.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.350+0000 7f1f55200700 1 --2- 172.21.15.142:0/2872254076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f50107520 0x7f1f50107900 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1f40009910 tx=0x7f1f40009c20 comp rx=0 tx=0).stop 2024-04-20T22:10:29.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.350+0000 7f1f55200700 1 -- 172.21.15.142:0/2872254076 shutdown_connections 2024-04-20T22:10:29.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.350+0000 7f1f55200700 1 --2- 172.21.15.142:0/2872254076 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f50108e10 0x7f1f50109290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:29.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.350+0000 7f1f55200700 1 --2- 172.21.15.142:0/2872254076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f50107520 0x7f1f50107900 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:29.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.350+0000 7f1f55200700 1 -- 172.21.15.142:0/2872254076 >> 172.21.15.142:0/2872254076 conn(0x7f1f500768f0 msgr2=0x7f1f50078d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:10:29.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.350+0000 7f1f55200700 1 -- 172.21.15.142:0/2872254076 shutdown_connections 2024-04-20T22:10:29.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.350+0000 7f1f55200700 1 -- 172.21.15.142:0/2872254076 wait complete. 2024-04-20T22:10:29.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.351+0000 7f1f55200700 1 Processor -- start 2024-04-20T22:10:29.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.351+0000 7f1f55200700 1 -- start start 2024-04-20T22:10:29.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.352+0000 7f1f55200700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f50107520 0x7f1f5019d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:10:29.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.352+0000 7f1f55200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f50108e10 0x7f1f5019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:10:29.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.352+0000 7f1f55200700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5019ddd0 con 0x7f1f50107520 2024-04-20T22:10:29.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.352+0000 7f1f55200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f501a1aa0 con 0x7f1f50108e10 2024-04-20T22:10:29.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.352+0000 7f1f4de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f50107520 0x7f1f5019d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:10:29.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.352+0000 7f1f4de00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f50107520 0x7f1f5019d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43678/0 (socket says 172.21.15.142:43678) 2024-04-20T22:10:29.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.352+0000 7f1f4de00700 1 -- 172.21.15.142:0/403507082 learned_addr learned my addr 172.21.15.142:0/403507082 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:10:29.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.353+0000 7f1f4de00700 1 -- 172.21.15.142:0/403507082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f50108e10 msgr2=0x7f1f5019d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:29.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.353+0000 7f1f4de00700 1 --2- 172.21.15.142:0/403507082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f50108e10 0x7f1f5019d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:29.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.353+0000 7f1f4de00700 1 -- 172.21.15.142:0/403507082 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f400095f0 con 0x7f1f50107520 2024-04-20T22:10:29.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.353+0000 7f1f4de00700 1 --2- 172.21.15.142:0/403507082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f50107520 0x7f1f5019d1b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1f40000c00 tx=0x7f1f4000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:10:29.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.353+0000 7f1f46a00700 1 -- 172.21.15.142:0/403507082 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f4001d070 con 0x7f1f50107520 2024-04-20T22:10:29.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.353+0000 7f1f46a00700 1 -- 172.21.15.142:0/403507082 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f400056e0 con 0x7f1f50107520 2024-04-20T22:10:29.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.353+0000 7f1f55200700 1 -- 172.21.15.142:0/403507082 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f501a1d20 con 0x7f1f50107520 2024-04-20T22:10:29.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.353+0000 7f1f46a00700 1 -- 172.21.15.142:0/403507082 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f4000fe80 con 0x7f1f50107520 2024-04-20T22:10:29.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.353+0000 7f1f55200700 1 -- 172.21.15.142:0/403507082 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f501a2290 con 0x7f1f50107520 2024-04-20T22:10:29.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.355+0000 7f1f55200700 1 -- 172.21.15.142:0/403507082 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5010f890 con 0x7f1f50107520 2024-04-20T22:10:29.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.356+0000 7f1f46a00700 1 -- 172.21.15.142:0/403507082 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f1f4000f6f0 con 0x7f1f50107520 2024-04-20T22:10:29.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.357+0000 7f1f46a00700 1 --2- 172.21.15.142:0/403507082 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f1f3406ecd0 0x7f1f34071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:10:29.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.357+0000 7f1f46a00700 1 -- 172.21.15.142:0/403507082 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f1f400902c0 con 0x7f1f50107520 2024-04-20T22:10:29.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.357+0000 7f1f4d400700 1 --2- 172.21.15.142:0/403507082 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f1f3406ecd0 0x7f1f34071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:10:29.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.358+0000 7f1f4d400700 1 --2- 172.21.15.142:0/403507082 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f1f3406ecd0 0x7f1f34071190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c005950 tx=0x7f1f3c0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:10:29.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.362+0000 7f1f46a00700 1 -- 172.21.15.142:0/403507082 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f1f40058ff0 con 0x7f1f50107520 2024-04-20T22:10:29.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.678+0000 7f1f55200700 1 -- 172.21.15.142:0/403507082 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1f5019e4c0 con 0x7f1f50107520 2024-04-20T22:10:29.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.679+0000 7f1f46a00700 1 -- 172.21.15.142:0/403507082 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f1f4005c6b0 con 0x7f1f50107520 2024-04-20T22:10:29.678 INFO:teuthology.orchestra.run.smithi142.stdout:HEALTH_OK 2024-04-20T22:10:29.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.681+0000 7f1f55200700 1 -- 172.21.15.142:0/403507082 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f1f3406ecd0 msgr2=0x7f1f34071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:29.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.681+0000 7f1f55200700 1 --2- 172.21.15.142:0/403507082 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f1f3406ecd0 0x7f1f34071190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c005950 tx=0x7f1f3c0058e0 comp rx=0 tx=0).stop 2024-04-20T22:10:29.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.681+0000 7f1f55200700 1 -- 172.21.15.142:0/403507082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f50107520 msgr2=0x7f1f5019d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:29.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.681+0000 7f1f55200700 1 --2- 172.21.15.142:0/403507082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f50107520 0x7f1f5019d1b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1f40000c00 tx=0x7f1f4000be20 comp rx=0 tx=0).stop 2024-04-20T22:10:29.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.682+0000 7f1f55200700 1 -- 172.21.15.142:0/403507082 shutdown_connections 2024-04-20T22:10:29.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.682+0000 7f1f55200700 1 --2- 172.21.15.142:0/403507082 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f1f3406ecd0 0x7f1f34071190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:29.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.682+0000 7f1f55200700 1 --2- 172.21.15.142:0/403507082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f50107520 0x7f1f5019d1b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:29.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.682+0000 7f1f55200700 1 --2- 172.21.15.142:0/403507082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1f50108e10 0x7f1f5019d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:29.682 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.682+0000 7f1f55200700 1 -- 172.21.15.142:0/403507082 >> 172.21.15.142:0/403507082 conn(0x7f1f500768f0 msgr2=0x7f1f50077490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:10:29.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.682+0000 7f1f55200700 1 -- 172.21.15.142:0/403507082 shutdown_connections 2024-04-20T22:10:29.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:29.682+0000 7f1f55200700 1 -- 172.21.15.142:0/403507082 wait complete. 2024-04-20T22:10:29.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:29 smithi142 ceph-mon[79401]: pgmap v345: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:29.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:10:29.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:29 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/403507082' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:10:30.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:29 smithi164 ceph-mon[69784]: pgmap v345: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:30.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:10:30.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:29 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/403507082' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-20T22:10:30.528 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -e sha1=a8c84f5997950fd7d008204839253291d52e6eda -- bash -c 'ceph versions' 2024-04-20T22:10:30.940 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T22:10:32.002 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:31 smithi142 ceph-mon[79401]: pgmap v346: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:32.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:31 smithi164 ceph-mon[69784]: pgmap v346: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:33.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.185+0000 7f2655c00700 1 -- 172.21.15.142:0/2155431333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2650103040 msgr2=0x7f2650103420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:33.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.185+0000 7f2655c00700 1 --2- 172.21.15.142:0/2155431333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2650103040 0x7f2650103420 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2640009910 tx=0x7f2640009c20 comp rx=0 tx=0).stop 2024-04-20T22:10:33.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.186+0000 7f2655c00700 1 -- 172.21.15.142:0/2155431333 shutdown_connections 2024-04-20T22:10:33.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.186+0000 7f2655c00700 1 --2- 172.21.15.142:0/2155431333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26501039f0 0x7f2650107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:33.186 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.186+0000 7f2655c00700 1 --2- 172.21.15.142:0/2155431333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2650103040 0x7f2650103420 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:33.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.186+0000 7f2655c00700 1 -- 172.21.15.142:0/2155431333 >> 172.21.15.142:0/2155431333 conn(0x7f26500fe8d0 msgr2=0x7f2650100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:10:33.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.186+0000 7f2655c00700 1 -- 172.21.15.142:0/2155431333 shutdown_connections 2024-04-20T22:10:33.187 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.186+0000 7f2655c00700 1 -- 172.21.15.142:0/2155431333 wait complete. 2024-04-20T22:10:33.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.187+0000 7f2655c00700 1 Processor -- start 2024-04-20T22:10:33.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.187+0000 7f2655c00700 1 -- start start 2024-04-20T22:10:33.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.187+0000 7f2655c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2650103040 0x7f2650198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:10:33.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.187+0000 7f2655c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26501039f0 0x7f2650199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:10:33.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.187+0000 7f2655c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2650199a70 con 0x7f2650103040 2024-04-20T22:10:33.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.187+0000 7f2655c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265019d740 con 0x7f26501039f0 2024-04-20T22:10:33.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.188+0000 7f264ea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2650103040 0x7f2650198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:10:33.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.188+0000 7f264ea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2650103040 0x7f2650198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43700/0 (socket says 172.21.15.142:43700) 2024-04-20T22:10:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.188+0000 7f264ea00700 1 -- 172.21.15.142:0/2806982379 learned_addr learned my addr 172.21.15.142:0/2806982379 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:10:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.188+0000 7f264ea00700 1 -- 172.21.15.142:0/2806982379 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26501039f0 msgr2=0x7f2650199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.188+0000 7f264e000700 1 --2- 172.21.15.142:0/2806982379 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26501039f0 0x7f2650199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:10:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.188+0000 7f264ea00700 1 --2- 172.21.15.142:0/2806982379 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26501039f0 0x7f2650199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.188+0000 7f264ea00700 1 -- 172.21.15.142:0/2806982379 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26400095f0 con 0x7f2650103040 2024-04-20T22:10:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.188+0000 7f264ea00700 1 --2- 172.21.15.142:0/2806982379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2650103040 0x7f2650198e50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f264000bda0 tx=0x7f264000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:10:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.189+0000 7f2647400700 1 -- 172.21.15.142:0/2806982379 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f264001d070 con 0x7f2650103040 2024-04-20T22:10:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.189+0000 7f2647400700 1 -- 172.21.15.142:0/2806982379 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f264000f460 con 0x7f2650103040 2024-04-20T22:10:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.189+0000 7f2647400700 1 -- 172.21.15.142:0/2806982379 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2640017630 con 0x7f2650103040 2024-04-20T22:10:33.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.189+0000 7f2655c00700 1 -- 172.21.15.142:0/2806982379 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265019d9c0 con 0x7f2650103040 2024-04-20T22:10:33.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.189+0000 7f2655c00700 1 -- 172.21.15.142:0/2806982379 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265019deb0 con 0x7f2650103040 2024-04-20T22:10:33.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.190+0000 7f2655c00700 1 -- 172.21.15.142:0/2806982379 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265010b3e0 con 0x7f2650103040 2024-04-20T22:10:33.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.191+0000 7f2647400700 1 -- 172.21.15.142:0/2806982379 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f264000fa00 con 0x7f2650103040 2024-04-20T22:10:33.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.192+0000 7f2647400700 1 --2- 172.21.15.142:0/2806982379 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f263406ecc0 0x7f2634071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:10:33.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.192+0000 7f2647400700 1 -- 172.21.15.142:0/2806982379 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f2640090400 con 0x7f2650103040 2024-04-20T22:10:33.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.192+0000 7f264e000700 1 --2- 172.21.15.142:0/2806982379 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f263406ecc0 0x7f2634071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:10:33.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.193+0000 7f264e000700 1 --2- 172.21.15.142:0/2806982379 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f263406ecc0 0x7f2634071180 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f263c006fd0 tx=0x7f263c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:10:33.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.197+0000 7f2647400700 1 -- 172.21.15.142:0/2806982379 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f2640059090 con 0x7f2650103040 2024-04-20T22:10:33.517 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.517+0000 7f2655c00700 1 -- 172.21.15.142:0/2806982379 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f265019a200 con 0x7f2650103040 2024-04-20T22:10:33.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.518+0000 7f2647400700 1 -- 172.21.15.142:0/2806982379 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f264005c750 con 0x7f2650103040 2024-04-20T22:10:33.518 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:10:33.518 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:10:33.519 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:10:33.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:10:33.519 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:10:33.519 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:10:33.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:10:33.519 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:10:33.519 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 6 2024-04-20T22:10:33.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:10:33.520 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:10:33.520 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 4 2024-04-20T22:10:33.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:10:33.520 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:10:33.520 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 14 2024-04-20T22:10:33.520 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:10:33.520 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:10:33.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.521+0000 7f2655c00700 1 -- 172.21.15.142:0/2806982379 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f263406ecc0 msgr2=0x7f2634071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:33.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.521+0000 7f2655c00700 1 --2- 172.21.15.142:0/2806982379 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f263406ecc0 0x7f2634071180 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f263c006fd0 tx=0x7f263c008040 comp rx=0 tx=0).stop 2024-04-20T22:10:33.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.521+0000 7f2655c00700 1 -- 172.21.15.142:0/2806982379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2650103040 msgr2=0x7f2650198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:10:33.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.521+0000 7f2655c00700 1 --2- 172.21.15.142:0/2806982379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2650103040 0x7f2650198e50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f264000bda0 tx=0x7f264000be80 comp rx=0 tx=0).stop 2024-04-20T22:10:33.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.521+0000 7f2655c00700 1 -- 172.21.15.142:0/2806982379 shutdown_connections 2024-04-20T22:10:33.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.521+0000 7f2655c00700 1 --2- 172.21.15.142:0/2806982379 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f263406ecc0 0x7f2634071180 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:33.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.521+0000 7f2655c00700 1 --2- 172.21.15.142:0/2806982379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2650103040 0x7f2650198e50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:33.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.521+0000 7f2655c00700 1 --2- 172.21.15.142:0/2806982379 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f26501039f0 0x7f2650199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:10:33.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.521+0000 7f2655c00700 1 -- 172.21.15.142:0/2806982379 >> 172.21.15.142:0/2806982379 conn(0x7f26500fe8d0 msgr2=0x7f26500ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:10:33.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.522+0000 7f2655c00700 1 -- 172.21.15.142:0/2806982379 shutdown_connections 2024-04-20T22:10:33.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:10:33.522+0000 7f2655c00700 1 -- 172.21.15.142:0/2806982379 wait complete. 2024-04-20T22:10:34.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:33 smithi164 ceph-mon[69784]: pgmap v347: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:34.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:33 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/2806982379' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:34.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:33 smithi142 ceph-mon[79401]: pgmap v347: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:34.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:33 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2806982379' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:10:34.312 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -e sha1=a8c84f5997950fd7d008204839253291d52e6eda -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-04-20T22:10:34.711 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T22:10:36.103 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:35 smithi142 ceph-mon[79401]: pgmap v348: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:36.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:35 smithi164 ceph-mon[69784]: pgmap v348: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:36.872 INFO:teuthology.orchestra.run.smithi142.stdout:wait for servicemap items w/ changing names to refresh 2024-04-20T22:10:37.615 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -e sha1=a8c84f5997950fd7d008204839253291d52e6eda -- bash -c 'sleep 60' 2024-04-20T22:10:38.019 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T22:10:38.175 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:37 smithi142 ceph-mon[79401]: pgmap v349: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:38.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:37 smithi164 ceph-mon[69784]: pgmap v349: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:40.096 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:39 smithi142 ceph-mon[79401]: pgmap v350: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:40.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:39 smithi164 ceph-mon[69784]: pgmap v350: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:42.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:41 smithi142 ceph-mon[79401]: pgmap v351: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:42.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:41 smithi164 ceph-mon[69784]: pgmap v351: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:44.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:43 smithi164 ceph-mon[69784]: pgmap v352: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:44.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:43 smithi142 ceph-mon[79401]: pgmap v352: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:45.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:10:45.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:10:46.098 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:45 smithi142 ceph-mon[79401]: pgmap v353: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:46.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:45 smithi164 ceph-mon[69784]: pgmap v353: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:48.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:47 smithi142 ceph-mon[79401]: pgmap v354: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:48.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:47 smithi164 ceph-mon[69784]: pgmap v354: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:50.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:49 smithi142 ceph-mon[79401]: pgmap v355: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:50.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:49 smithi164 ceph-mon[69784]: pgmap v355: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:52.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:51 smithi164 ceph-mon[69784]: pgmap v356: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:52.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:51 smithi142 ceph-mon[79401]: pgmap v356: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:54.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:53 smithi164 ceph-mon[69784]: pgmap v357: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:54.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:53 smithi142 ceph-mon[79401]: pgmap v357: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:56.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:55 smithi164 ceph-mon[69784]: pgmap v358: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:56.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:55 smithi142 ceph-mon[79401]: pgmap v358: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:58.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:57 smithi164 ceph-mon[69784]: pgmap v359: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:10:58.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:57 smithi142 ceph-mon[79401]: pgmap v359: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:00.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:59 smithi142 ceph-mon[79401]: pgmap v360: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:00.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:10:59 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:11:00.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:59 smithi164 ceph-mon[69784]: pgmap v360: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:00.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:10:59 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:11:02.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:01 smithi164 ceph-mon[69784]: pgmap v361: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:02.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:01 smithi142 ceph-mon[79401]: pgmap v361: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:04.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:03 smithi142 ceph-mon[79401]: pgmap v362: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:04.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:03 smithi164 ceph-mon[69784]: pgmap v362: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:05.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:04 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:11:05.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:04 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:11:06.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:05 smithi142 ceph-mon[79401]: pgmap v363: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:06.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:05 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:11:06.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:05 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:11:06.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:05 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:11:06.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:05 smithi164 ceph-mon[69784]: pgmap v363: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:06.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:05 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:11:06.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:05 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:11:06.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:05 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:11:08.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:07 smithi164 ceph-mon[69784]: pgmap v364: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:08.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:07 smithi142 ceph-mon[79401]: pgmap v364: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:10.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:09 smithi164 ceph-mon[69784]: pgmap v365: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:10.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:09 smithi142 ceph-mon[79401]: pgmap v365: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:12.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:11 smithi164 ceph-mon[69784]: pgmap v366: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:12.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:11 smithi142 ceph-mon[79401]: pgmap v366: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:14.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:13 smithi142 ceph-mon[79401]: pgmap v367: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:14.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:13 smithi164 ceph-mon[69784]: pgmap v367: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:15.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:11:15.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:11:16.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:15 smithi142 ceph-mon[79401]: pgmap v368: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:16.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:15 smithi164 ceph-mon[69784]: pgmap v368: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:18.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:17 smithi164 ceph-mon[69784]: pgmap v369: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:18.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:17 smithi142 ceph-mon[79401]: pgmap v369: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:20.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:19 smithi164 ceph-mon[69784]: pgmap v370: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:19 smithi142 ceph-mon[79401]: pgmap v370: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:22.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:21 smithi142 ceph-mon[79401]: pgmap v371: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:22.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:21 smithi164 ceph-mon[69784]: pgmap v371: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:24.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:23 smithi142 ceph-mon[79401]: pgmap v372: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:24.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:23 smithi164 ceph-mon[69784]: pgmap v372: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:26.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:25 smithi142 ceph-mon[79401]: pgmap v373: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:26.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:25 smithi164 ceph-mon[69784]: pgmap v373: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:28.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:27 smithi142 ceph-mon[79401]: pgmap v374: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:28.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:27 smithi164 ceph-mon[69784]: pgmap v374: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:30.249 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:29 smithi164 ceph-mon[69784]: pgmap v375: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:30.249 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:11:30.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:29 smithi142 ceph-mon[79401]: pgmap v375: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:30.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:11:32.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:31 smithi164 ceph-mon[69784]: pgmap v376: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:32.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:31 smithi142 ceph-mon[79401]: pgmap v376: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:34.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:33 smithi142 ceph-mon[79401]: pgmap v377: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:34.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:34 smithi164 ceph-mon[69784]: pgmap v377: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:36.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:36 smithi142 ceph-mon[79401]: pgmap v378: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:36.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:36 smithi164 ceph-mon[69784]: pgmap v378: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:38.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:38 smithi164 ceph-mon[69784]: pgmap v379: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:38.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:38 smithi142 ceph-mon[79401]: pgmap v379: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:40.327 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:40 smithi164 ceph-mon[69784]: pgmap v380: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:40.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:40 smithi142 ceph-mon[79401]: pgmap v380: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:40.981 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -e sha1=a8c84f5997950fd7d008204839253291d52e6eda -- bash -c 'ceph orch ps' 2024-04-20T22:11:41.393 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T22:11:42.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:42 smithi142 ceph-mon[79401]: pgmap v381: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:42.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:42 smithi164 ceph-mon[69784]: pgmap v381: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:43.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.699+0000 7f1072c00700 1 -- 172.21.15.142:0/3446336063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f106c107520 msgr2=0x7f106c107900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:43.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.699+0000 7f1072c00700 1 --2- 172.21.15.142:0/3446336063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f106c107520 0x7f106c107900 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f105c009910 tx=0x7f105c009c20 comp rx=0 tx=0).stop 2024-04-20T22:11:43.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.699+0000 7f1072c00700 1 -- 172.21.15.142:0/3446336063 shutdown_connections 2024-04-20T22:11:43.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.699+0000 7f1072c00700 1 --2- 172.21.15.142:0/3446336063 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f106c108e10 0x7f106c109290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:43.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.699+0000 7f1072c00700 1 --2- 172.21.15.142:0/3446336063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f106c107520 0x7f106c107900 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:43.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.699+0000 7f1072c00700 1 -- 172.21.15.142:0/3446336063 >> 172.21.15.142:0/3446336063 conn(0x7f106c0768f0 msgr2=0x7f106c078d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:11:43.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.700+0000 7f1072c00700 1 -- 172.21.15.142:0/3446336063 shutdown_connections 2024-04-20T22:11:43.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.700+0000 7f1072c00700 1 -- 172.21.15.142:0/3446336063 wait complete. 2024-04-20T22:11:43.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.701+0000 7f1072c00700 1 Processor -- start 2024-04-20T22:11:43.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.701+0000 7f1072c00700 1 -- start start 2024-04-20T22:11:43.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.701+0000 7f1072c00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f106c107520 0x7f106c19d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:11:43.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.702+0000 7f1072c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f106c108e10 0x7f106c19d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:11:43.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.702+0000 7f1072c00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c19ddd0 con 0x7f106c107520 2024-04-20T22:11:43.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.702+0000 7f1072c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c1a1aa0 con 0x7f106c108e10 2024-04-20T22:11:43.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.702+0000 7f106be00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f106c107520 0x7f106c19d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:11:43.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.702+0000 7f106be00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f106c107520 0x7f106c19d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44474/0 (socket says 172.21.15.142:44474) 2024-04-20T22:11:43.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.702+0000 7f106be00700 1 -- 172.21.15.142:0/18600142 learned_addr learned my addr 172.21.15.142:0/18600142 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:11:43.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.702+0000 7f106b400700 1 --2- 172.21.15.142:0/18600142 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f106c108e10 0x7f106c19d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:11:43.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.702+0000 7f106be00700 1 -- 172.21.15.142:0/18600142 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f106c108e10 msgr2=0x7f106c19d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:43.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.702+0000 7f106be00700 1 --2- 172.21.15.142:0/18600142 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f106c108e10 0x7f106c19d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:43.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.702+0000 7f106be00700 1 -- 172.21.15.142:0/18600142 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c0095f0 con 0x7f106c107520 2024-04-20T22:11:43.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.702+0000 7f106b400700 1 --2- 172.21.15.142:0/18600142 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f106c108e10 0x7f106c19d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:11:43.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.703+0000 7f106be00700 1 --2- 172.21.15.142:0/18600142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f106c107520 0x7f106c19d1b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f105c006010 tx=0x7f105c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:11:43.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.703+0000 7f1068c00700 1 -- 172.21.15.142:0/18600142 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f105c01d070 con 0x7f106c107520 2024-04-20T22:11:43.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.703+0000 7f1068c00700 1 -- 172.21.15.142:0/18600142 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f105c0056e0 con 0x7f106c107520 2024-04-20T22:11:43.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.703+0000 7f1072c00700 1 -- 172.21.15.142:0/18600142 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106c1a1d20 con 0x7f106c107520 2024-04-20T22:11:43.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.703+0000 7f1068c00700 1 -- 172.21.15.142:0/18600142 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f105c017400 con 0x7f106c107520 2024-04-20T22:11:43.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.703+0000 7f1072c00700 1 -- 172.21.15.142:0/18600142 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106c1a2290 con 0x7f106c107520 2024-04-20T22:11:43.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.704+0000 7f1072c00700 1 -- 172.21.15.142:0/18600142 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106c10f890 con 0x7f106c107520 2024-04-20T22:11:43.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.705+0000 7f1068c00700 1 -- 172.21.15.142:0/18600142 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f105c00f860 con 0x7f106c107520 2024-04-20T22:11:43.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.706+0000 7f1068c00700 1 --2- 172.21.15.142:0/18600142 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f105006ecc0 0x7f1050071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:11:43.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.706+0000 7f1068c00700 1 -- 172.21.15.142:0/18600142 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f105c090380 con 0x7f106c107520 2024-04-20T22:11:43.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.707+0000 7f106b400700 1 --2- 172.21.15.142:0/18600142 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f105006ecc0 0x7f1050071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:11:43.707 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.707+0000 7f106b400700 1 --2- 172.21.15.142:0/18600142 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f105006ecc0 0x7f1050071180 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1058005fd0 tx=0x7f1058005ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:11:43.711 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.712+0000 7f1068c00700 1 -- 172.21.15.142:0/18600142 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f105c059050 con 0x7f106c107520 2024-04-20T22:11:43.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.949+0000 7f1072c00700 1 -- 172.21.15.142:0/18600142 --> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f106c1144c0 con 0x7f105006ecc0 2024-04-20T22:11:43.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.967+0000 7f1068c00700 1 -- 172.21.15.142:0/18600142 <== mgr.34104 v2:172.21.15.142:6800/2916737211 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f106c1144c0 con 0x7f105006ecc0 2024-04-20T22:11:43.967 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T22:11:43.967 INFO:teuthology.orchestra.run.smithi142.stdout:alertmanager.smithi142 smithi142 *:9093,9094 running (2m) 108s ago 24m 14.5M - 0.25.0 c8568f914cd2 91b692cbdcb6 2024-04-20T22:11:43.967 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi142 smithi142 running (3m) 108s ago 24m 8040k - 19.0.0-3133-ga8c84f59 76bc6b91b726 eadbb8123608 2024-04-20T22:11:43.967 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-exporter.smithi164 smithi164 running (3m) 3m ago 23m 7638k - 19.0.0-3133-ga8c84f59 76bc6b91b726 13030cc1a7a8 2024-04-20T22:11:43.967 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi142 smithi142 running (9m) 108s ago 24m 6665k - 19.0.0-3133-ga8c84f59 76bc6b91b726 64521ed7125b 2024-04-20T22:11:43.968 INFO:teuthology.orchestra.run.smithi142.stdout:crash.smithi164 smithi164 running (9m) 3m ago 23m 6656k - 19.0.0-3133-ga8c84f59 76bc6b91b726 893c6f16ee6d 2024-04-20T22:11:43.968 INFO:teuthology.orchestra.run.smithi142.stdout:grafana.smithi142 smithi142 *:3000 running (116s) 108s ago 23m 51.1M - 9.4.12 2bacad6d85d8 b4589f50ae1c 2024-04-20T22:11:43.968 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lirkws smithi142 running (5m) 108s ago 17m 87.3M - 19.0.0-3133-ga8c84f59 76bc6b91b726 603d9ff4accc 2024-04-20T22:11:43.968 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi142.lrvfgg smithi142 running (5m) 108s ago 17m 13.4M - 19.0.0-3133-ga8c84f59 76bc6b91b726 5fbbe225e911 2024-04-20T22:11:43.968 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.gmmrfu smithi164 running (4m) 3m ago 16m 12.2M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3ee3d509a48c 2024-04-20T22:11:43.968 INFO:teuthology.orchestra.run.smithi142.stdout:mds.cephfs.smithi164.ybvzha smithi164 running (4m) 3m ago 17m 12.4M - 19.0.0-3133-ga8c84f59 76bc6b91b726 44901e1ad990 2024-04-20T22:11:43.968 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi142.zzmcfz smithi142 *:8443,9283,8765 running (13m) 108s ago 26m 522M - 19.0.0-3133-ga8c84f59 76bc6b91b726 3c995aa209e3 2024-04-20T22:11:43.968 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.smithi164.oejajr smithi164 *:8443,9283,8765 running (12m) 3m ago 23m 454M - 19.0.0-3133-ga8c84f59 76bc6b91b726 99ece3cd0be9 2024-04-20T22:11:43.968 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi142 smithi142 running (11m) 108s ago 26m 62.5M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 af10a542c918 2024-04-20T22:11:43.968 INFO:teuthology.orchestra.run.smithi142.stdout:mon.smithi164 smithi164 running (11m) 3m ago 22m 43.5M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 133512694d46 2024-04-20T22:11:43.968 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi142 smithi142 *:9100 running (3m) 108s ago 24m 7578k - 1.5.0 0da6a335fe13 f21ef73493a2 2024-04-20T22:11:43.968 INFO:teuthology.orchestra.run.smithi142.stdout:node-exporter.smithi164 smithi164 *:9100 running (3m) 3m ago 23m 2843k - 1.5.0 0da6a335fe13 0ba09db59c8e 2024-04-20T22:11:43.969 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (9m) 108s ago 21m 108M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 b7206d05a7cd 2024-04-20T22:11:43.969 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi142 running (8m) 108s ago 21m 109M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 82bcc0c46762 2024-04-20T22:11:43.969 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi142 running (8m) 108s ago 20m 94.8M 1216M 19.0.0-3133-ga8c84f59 76bc6b91b726 3e2d91f49494 2024-04-20T22:11:43.969 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi164 running (7m) 3m ago 20m 119M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 a898b8b77c51 2024-04-20T22:11:43.969 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi164 running (6m) 3m ago 19m 103M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 539c4026f9fb 2024-04-20T22:11:43.969 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi164 running (6m) 3m ago 18m 95.8M 2240M 19.0.0-3133-ga8c84f59 76bc6b91b726 ac1bdd69c944 2024-04-20T22:11:43.969 INFO:teuthology.orchestra.run.smithi142.stdout:prometheus.smithi142 smithi142 *:9095 running (2m) 108s ago 23m 58.9M - 2.43.0 a07b618ecd1d 2b3da2d4dfc7 2024-04-20T22:11:43.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.971+0000 7f1072c00700 1 -- 172.21.15.142:0/18600142 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f105006ecc0 msgr2=0x7f1050071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:43.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.971+0000 7f1072c00700 1 --2- 172.21.15.142:0/18600142 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f105006ecc0 0x7f1050071180 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1058005fd0 tx=0x7f1058005ee0 comp rx=0 tx=0).stop 2024-04-20T22:11:43.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.971+0000 7f1072c00700 1 -- 172.21.15.142:0/18600142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f106c107520 msgr2=0x7f106c19d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:43.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.971+0000 7f1072c00700 1 --2- 172.21.15.142:0/18600142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f106c107520 0x7f106c19d1b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f105c006010 tx=0x7f105c00be20 comp rx=0 tx=0).stop 2024-04-20T22:11:43.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.971+0000 7f1072c00700 1 -- 172.21.15.142:0/18600142 shutdown_connections 2024-04-20T22:11:43.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.971+0000 7f1072c00700 1 --2- 172.21.15.142:0/18600142 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f105006ecc0 0x7f1050071180 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:43.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.971+0000 7f1072c00700 1 --2- 172.21.15.142:0/18600142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f106c107520 0x7f106c19d1b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:43.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.971+0000 7f1072c00700 1 --2- 172.21.15.142:0/18600142 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f106c108e10 0x7f106c19d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:43.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.971+0000 7f1072c00700 1 -- 172.21.15.142:0/18600142 >> 172.21.15.142:0/18600142 conn(0x7f106c0768f0 msgr2=0x7f106c077490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:11:43.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.971+0000 7f1072c00700 1 -- 172.21.15.142:0/18600142 shutdown_connections 2024-04-20T22:11:43.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:43.971+0000 7f1072c00700 1 -- 172.21.15.142:0/18600142 wait complete. 2024-04-20T22:11:44.322 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:44 smithi142 ceph-mon[79401]: pgmap v382: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:44.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:44 smithi164 ceph-mon[69784]: pgmap v382: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:44.738 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -e sha1=a8c84f5997950fd7d008204839253291d52e6eda -- bash -c 'ceph versions' 2024-04-20T22:11:45.136 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T22:11:45.323 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:45 smithi142 ceph-mon[79401]: from='client.34688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:11:45.323 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:11:45.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:45 smithi164 ceph-mon[69784]: from='client.34688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T22:11:45.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:11:46.332 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:46 smithi142 ceph-mon[79401]: pgmap v383: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:46.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:46 smithi164 ceph-mon[69784]: pgmap v383: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.487+0000 7f771d600700 1 -- 172.21.15.142:0/102286576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7718073c30 msgr2=0x7f771810cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.487+0000 7f771d600700 1 --2- 172.21.15.142:0/102286576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7718073c30 0x7f771810cee0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7704009910 tx=0x7f7704009c20 comp rx=0 tx=0).stop 2024-04-20T22:11:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.487+0000 7f771d600700 1 -- 172.21.15.142:0/102286576 shutdown_connections 2024-04-20T22:11:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.487+0000 7f771d600700 1 --2- 172.21.15.142:0/102286576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7718073c30 0x7f771810cee0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.487+0000 7f771d600700 1 --2- 172.21.15.142:0/102286576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7718073310 0x7f77180736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.487+0000 7f771d600700 1 -- 172.21.15.142:0/102286576 >> 172.21.15.142:0/102286576 conn(0x7f77180fc6d0 msgr2=0x7f77180feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:11:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.488+0000 7f771d600700 1 -- 172.21.15.142:0/102286576 shutdown_connections 2024-04-20T22:11:47.488 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.488+0000 7f771d600700 1 -- 172.21.15.142:0/102286576 wait complete. 2024-04-20T22:11:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.489+0000 7f771d600700 1 Processor -- start 2024-04-20T22:11:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.489+0000 7f771d600700 1 -- start start 2024-04-20T22:11:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.489+0000 7f771d600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7718073310 0x7f7718198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:11:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.489+0000 7f771d600700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7718073c30 0x7f7718199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:11:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.489+0000 7f771d600700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77181999f0 con 0x7f7718073c30 2024-04-20T22:11:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.489+0000 7f771d600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771819d6c0 con 0x7f7718073310 2024-04-20T22:11:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.489+0000 7f7716000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7718073c30 0x7f7718199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:11:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.490+0000 7f7716000700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7718073c30 0x7f7718199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55590/0 (socket says 172.21.15.142:55590) 2024-04-20T22:11:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.490+0000 7f7716000700 1 -- 172.21.15.142:0/2988948416 learned_addr learned my addr 172.21.15.142:0/2988948416 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:11:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.490+0000 7f7716a00700 1 --2- 172.21.15.142:0/2988948416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7718073310 0x7f7718198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:11:47.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.490+0000 7f7716000700 1 -- 172.21.15.142:0/2988948416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7718073310 msgr2=0x7f7718198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:47.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.490+0000 7f7716000700 1 --2- 172.21.15.142:0/2988948416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7718073310 0x7f7718198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:47.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.490+0000 7f7716000700 1 -- 172.21.15.142:0/2988948416 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77040095f0 con 0x7f7718073c30 2024-04-20T22:11:47.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.490+0000 7f7716000700 1 --2- 172.21.15.142:0/2988948416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7718073c30 0x7f7718199310 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7704006010 tx=0x7f770400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:11:47.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.491+0000 7f770f400700 1 -- 172.21.15.142:0/2988948416 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f770401d070 con 0x7f7718073c30 2024-04-20T22:11:47.491 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.491+0000 7f770f400700 1 -- 172.21.15.142:0/2988948416 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f770400f460 con 0x7f7718073c30 2024-04-20T22:11:47.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.491+0000 7f771d600700 1 -- 172.21.15.142:0/2988948416 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771819d940 con 0x7f7718073c30 2024-04-20T22:11:47.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.491+0000 7f770f400700 1 -- 172.21.15.142:0/2988948416 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7704017630 con 0x7f7718073c30 2024-04-20T22:11:47.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.491+0000 7f771d600700 1 -- 172.21.15.142:0/2988948416 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771819de30 con 0x7f7718073c30 2024-04-20T22:11:47.492 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.492+0000 7f771d600700 1 -- 172.21.15.142:0/2988948416 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77180749c0 con 0x7f7718073c30 2024-04-20T22:11:47.493 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.494+0000 7f770f400700 1 -- 172.21.15.142:0/2988948416 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f770400f5d0 con 0x7f7718073c30 2024-04-20T22:11:47.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.495+0000 7f770f400700 1 --2- 172.21.15.142:0/2988948416 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f76fc06ecd0 0x7f76fc071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:11:47.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.495+0000 7f770f400700 1 -- 172.21.15.142:0/2988948416 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f7704090480 con 0x7f7718073c30 2024-04-20T22:11:47.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.495+0000 7f7716a00700 1 --2- 172.21.15.142:0/2988948416 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f76fc06ecd0 0x7f76fc071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:11:47.495 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.496+0000 7f7716a00700 1 --2- 172.21.15.142:0/2988948416 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f76fc06ecd0 0x7f76fc071190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7708009f20 tx=0x7f77080094f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:11:47.500 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.500+0000 7f770f400700 1 -- 172.21.15.142:0/2988948416 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f77040591d0 con 0x7f7718073c30 2024-04-20T22:11:47.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.824+0000 7f771d600700 1 -- 172.21.15.142:0/2988948416 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7718107780 con 0x7f7718073c30 2024-04-20T22:11:47.824 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.825+0000 7f770f400700 1 -- 172.21.15.142:0/2988948416 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f770405c890 con 0x7f7718073c30 2024-04-20T22:11:47.825 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-20T22:11:47.825 INFO:teuthology.orchestra.run.smithi142.stdout: "mon": { 2024-04-20T22:11:47.825 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:11:47.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:11:47.825 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr": { 2024-04-20T22:11:47.825 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 2 2024-04-20T22:11:47.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:11:47.825 INFO:teuthology.orchestra.run.smithi142.stdout: "osd": { 2024-04-20T22:11:47.825 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 6 2024-04-20T22:11:47.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:11:47.825 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-04-20T22:11:47.826 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 4 2024-04-20T22:11:47.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-20T22:11:47.826 INFO:teuthology.orchestra.run.smithi142.stdout: "overall": { 2024-04-20T22:11:47.826 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)": 14 2024-04-20T22:11:47.826 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-20T22:11:47.826 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-20T22:11:47.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.828+0000 7f771d600700 1 -- 172.21.15.142:0/2988948416 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f76fc06ecd0 msgr2=0x7f76fc071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:47.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.828+0000 7f771d600700 1 --2- 172.21.15.142:0/2988948416 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f76fc06ecd0 0x7f76fc071190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7708009f20 tx=0x7f77080094f0 comp rx=0 tx=0).stop 2024-04-20T22:11:47.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.828+0000 7f771d600700 1 -- 172.21.15.142:0/2988948416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7718073c30 msgr2=0x7f7718199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:47.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.828+0000 7f771d600700 1 --2- 172.21.15.142:0/2988948416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7718073c30 0x7f7718199310 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7704006010 tx=0x7f770400be20 comp rx=0 tx=0).stop 2024-04-20T22:11:47.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.828+0000 7f771d600700 1 -- 172.21.15.142:0/2988948416 shutdown_connections 2024-04-20T22:11:47.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.828+0000 7f771d600700 1 --2- 172.21.15.142:0/2988948416 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f76fc06ecd0 0x7f76fc071190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:47.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.828+0000 7f771d600700 1 --2- 172.21.15.142:0/2988948416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7718073310 0x7f7718198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:47.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.828+0000 7f771d600700 1 --2- 172.21.15.142:0/2988948416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7718073c30 0x7f7718199310 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:47.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.828+0000 7f771d600700 1 -- 172.21.15.142:0/2988948416 >> 172.21.15.142:0/2988948416 conn(0x7f77180fc6d0 msgr2=0x7f77181053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:11:47.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.828+0000 7f771d600700 1 -- 172.21.15.142:0/2988948416 shutdown_connections 2024-04-20T22:11:47.828 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:47.828+0000 7f771d600700 1 -- 172.21.15.142:0/2988948416 wait complete. 2024-04-20T22:11:48.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:48 smithi142 ceph-mon[79401]: pgmap v384: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:48.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:48 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2988948416' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:11:48.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:48 smithi164 ceph-mon[69784]: pgmap v384: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:48.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:48 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/2988948416' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:11:48.711 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -e sha1=a8c84f5997950fd7d008204839253291d52e6eda -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-04-20T22:11:49.136 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T22:11:50.343 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:50 smithi142 ceph-mon[79401]: pgmap v385: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:50.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:50 smithi164 ceph-mon[69784]: pgmap v385: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:51.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.410+0000 7fa2a9800700 1 -- 172.21.15.142:0/2200942343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a4107df0 msgr2=0x7fa2a410be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:51.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.410+0000 7fa2a9800700 1 --2- 172.21.15.142:0/2200942343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a4107df0 0x7fa2a410be40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa290009910 tx=0x7fa290009c20 comp rx=0 tx=0).stop 2024-04-20T22:11:51.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.410+0000 7fa2a9800700 1 -- 172.21.15.142:0/2200942343 shutdown_connections 2024-04-20T22:11:51.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.410+0000 7fa2a9800700 1 --2- 172.21.15.142:0/2200942343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a4107df0 0x7fa2a410be40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:51.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.410+0000 7fa2a9800700 1 --2- 172.21.15.142:0/2200942343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2a4107440 0x7fa2a4107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:51.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.410+0000 7fa2a9800700 1 -- 172.21.15.142:0/2200942343 >> 172.21.15.142:0/2200942343 conn(0x7fa2a4076a10 msgr2=0x7fa2a4078e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:11:51.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.410+0000 7fa2a9800700 1 -- 172.21.15.142:0/2200942343 shutdown_connections 2024-04-20T22:11:51.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.410+0000 7fa2a9800700 1 -- 172.21.15.142:0/2200942343 wait complete. 2024-04-20T22:11:51.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.412+0000 7fa2a9800700 1 Processor -- start 2024-04-20T22:11:51.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.412+0000 7fa2a9800700 1 -- start start 2024-04-20T22:11:51.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.412+0000 7fa2a9800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a4107440 0x7fa2a419d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:11:51.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.412+0000 7fa2a9800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2a4107df0 0x7fa2a419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:11:51.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.412+0000 7fa2a9800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a419dce0 con 0x7fa2a4107440 2024-04-20T22:11:51.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.412+0000 7fa2a9800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a419de20 con 0x7fa2a4107df0 2024-04-20T22:11:51.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.413+0000 7fa2a2a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a4107440 0x7fa2a419d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:11:51.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.413+0000 7fa2a2a00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a4107440 0x7fa2a419d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55610/0 (socket says 172.21.15.142:55610) 2024-04-20T22:11:51.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.413+0000 7fa2a2a00700 1 -- 172.21.15.142:0/4087837758 learned_addr learned my addr 172.21.15.142:0/4087837758 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:11:51.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.413+0000 7fa2a2000700 1 --2- 172.21.15.142:0/4087837758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2a4107df0 0x7fa2a419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:11:51.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.413+0000 7fa2a2a00700 1 -- 172.21.15.142:0/4087837758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2a4107df0 msgr2=0x7fa2a419d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:51.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.413+0000 7fa2a2a00700 1 --2- 172.21.15.142:0/4087837758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2a4107df0 0x7fa2a419d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:51.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.413+0000 7fa2a2a00700 1 -- 172.21.15.142:0/4087837758 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2900095f0 con 0x7fa2a4107440 2024-04-20T22:11:51.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.414+0000 7fa2a2a00700 1 --2- 172.21.15.142:0/4087837758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a4107440 0x7fa2a419d150 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa29400c930 tx=0x7fa29400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:11:51.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.414+0000 7fa29b400700 1 -- 172.21.15.142:0/4087837758 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa294007ad0 con 0x7fa2a4107440 2024-04-20T22:11:51.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.414+0000 7fa2a9800700 1 -- 172.21.15.142:0/4087837758 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a41a1b60 con 0x7fa2a4107440 2024-04-20T22:11:51.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.414+0000 7fa29b400700 1 -- 172.21.15.142:0/4087837758 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa294007c30 con 0x7fa2a4107440 2024-04-20T22:11:51.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.414+0000 7fa29b400700 1 -- 172.21.15.142:0/4087837758 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa294018610 con 0x7fa2a4107440 2024-04-20T22:11:51.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.414+0000 7fa2a9800700 1 -- 172.21.15.142:0/4087837758 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a41a20b0 con 0x7fa2a4107440 2024-04-20T22:11:51.415 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.415+0000 7fa2a9800700 1 -- 172.21.15.142:0/4087837758 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a410f840 con 0x7fa2a4107440 2024-04-20T22:11:51.416 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.416+0000 7fa29b400700 1 -- 172.21.15.142:0/4087837758 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fa29400f450 con 0x7fa2a4107440 2024-04-20T22:11:51.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.418+0000 7fa29b400700 1 --2- 172.21.15.142:0/4087837758 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa28806ecc0 0x7fa288071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:11:51.417 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.418+0000 7fa29b400700 1 -- 172.21.15.142:0/4087837758 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fa29408f150 con 0x7fa2a4107440 2024-04-20T22:11:51.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.418+0000 7fa2a2000700 1 --2- 172.21.15.142:0/4087837758 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa28806ecc0 0x7fa288071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:11:51.418 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.419+0000 7fa2a2000700 1 --2- 172.21.15.142:0/4087837758 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa28806ecc0 0x7fa288071180 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa290006010 tx=0x7fa29000b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:11:51.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.423+0000 7fa29b400700 1 -- 172.21.15.142:0/4087837758 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fa294057de0 con 0x7fa2a4107440 2024-04-20T22:11:51.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.745+0000 7fa2a9800700 1 -- 172.21.15.142:0/4087837758 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa2a41143e0 con 0x7fa2a4107440 2024-04-20T22:11:51.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.746+0000 7fa29b400700 1 -- 172.21.15.142:0/4087837758 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fa29405b4a0 con 0x7fa2a4107440 2024-04-20T22:11:51.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.749+0000 7fa2a9800700 1 -- 172.21.15.142:0/4087837758 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa28806ecc0 msgr2=0x7fa288071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:51.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.749+0000 7fa2a9800700 1 --2- 172.21.15.142:0/4087837758 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa28806ecc0 0x7fa288071180 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa290006010 tx=0x7fa29000b540 comp rx=0 tx=0).stop 2024-04-20T22:11:51.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.749+0000 7fa2a9800700 1 -- 172.21.15.142:0/4087837758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a4107440 msgr2=0x7fa2a419d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:51.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.749+0000 7fa2a9800700 1 --2- 172.21.15.142:0/4087837758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a4107440 0x7fa2a419d150 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa29400c930 tx=0x7fa29400ccf0 comp rx=0 tx=0).stop 2024-04-20T22:11:51.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.749+0000 7fa2a9800700 1 -- 172.21.15.142:0/4087837758 shutdown_connections 2024-04-20T22:11:51.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.749+0000 7fa2a9800700 1 --2- 172.21.15.142:0/4087837758 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fa28806ecc0 0x7fa288071180 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:51.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.749+0000 7fa2a9800700 1 --2- 172.21.15.142:0/4087837758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a4107440 0x7fa2a419d150 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:51.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.749+0000 7fa2a9800700 1 --2- 172.21.15.142:0/4087837758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2a4107df0 0x7fa2a419d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:51.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.749+0000 7fa2a9800700 1 -- 172.21.15.142:0/4087837758 >> 172.21.15.142:0/4087837758 conn(0x7fa2a4076a10 msgr2=0x7fa2a4076df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:11:51.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.749+0000 7fa2a9800700 1 -- 172.21.15.142:0/4087837758 shutdown_connections 2024-04-20T22:11:51.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:51.750+0000 7fa2a9800700 1 -- 172.21.15.142:0/4087837758 wait complete. 2024-04-20T22:11:51.765 INFO:teuthology.orchestra.run.smithi142.stdout:true 2024-04-20T22:11:52.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:52 smithi164 ceph-mon[69784]: pgmap v386: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:52.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:52 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/4087837758' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:11:52.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:52 smithi142 ceph-mon[79401]: pgmap v386: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:52.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:52 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/4087837758' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:11:52.537 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -e sha1=a8c84f5997950fd7d008204839253291d52e6eda -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-04-20T22:11:52.933 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T22:11:54.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:54 smithi142 ceph-mon[79401]: pgmap v387: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:54.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:54 smithi164 ceph-mon[69784]: pgmap v387: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:55.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.034+0000 7f0ad6800700 1 -- 172.21.15.142:0/405985612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad0101da0 msgr2=0x7f0ad0102180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:55.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.034+0000 7f0ad6800700 1 --2- 172.21.15.142:0/405985612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad0101da0 0x7f0ad0102180 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009940 tx=0x7f0ac0009c50 comp rx=0 tx=0).stop 2024-04-20T22:11:55.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.034+0000 7f0ad6800700 1 -- 172.21.15.142:0/405985612 shutdown_connections 2024-04-20T22:11:55.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.034+0000 7f0ad6800700 1 --2- 172.21.15.142:0/405985612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ad01026c0 0x7f0ad010abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:55.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.034+0000 7f0ad6800700 1 --2- 172.21.15.142:0/405985612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad0101da0 0x7f0ad0102180 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:55.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.034+0000 7f0ad6800700 1 -- 172.21.15.142:0/405985612 >> 172.21.15.142:0/405985612 conn(0x7f0ad0076750 msgr2=0x7f0ad00fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:11:55.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.034+0000 7f0ad6800700 1 -- 172.21.15.142:0/405985612 shutdown_connections 2024-04-20T22:11:55.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.034+0000 7f0ad6800700 1 -- 172.21.15.142:0/405985612 wait complete. 2024-04-20T22:11:55.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.036+0000 7f0ad6800700 1 Processor -- start 2024-04-20T22:11:55.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.036+0000 7f0ad6800700 1 -- start start 2024-04-20T22:11:55.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.036+0000 7f0ad6800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ad0101da0 0x7f0ad00ffa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:11:55.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.036+0000 7f0ad6800700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad01026c0 0x7f0ad00fff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:11:55.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.036+0000 7f0ad6800700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0100480 con 0x7f0ad01026c0 2024-04-20T22:11:55.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.036+0000 7f0ad6800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad01005c0 con 0x7f0ad0101da0 2024-04-20T22:11:55.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.037+0000 7f0acea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad01026c0 0x7f0ad00fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:11:55.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.037+0000 7f0acea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad01026c0 0x7f0ad00fff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55632/0 (socket says 172.21.15.142:55632) 2024-04-20T22:11:55.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.037+0000 7f0acea00700 1 -- 172.21.15.142:0/3168800014 learned_addr learned my addr 172.21.15.142:0/3168800014 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:11:55.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.037+0000 7f0acf400700 1 --2- 172.21.15.142:0/3168800014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ad0101da0 0x7f0ad00ffa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:11:55.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.037+0000 7f0acea00700 1 -- 172.21.15.142:0/3168800014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ad0101da0 msgr2=0x7f0ad00ffa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:55.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.037+0000 7f0acea00700 1 --2- 172.21.15.142:0/3168800014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ad0101da0 0x7f0ad00ffa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:55.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.037+0000 7f0acea00700 1 -- 172.21.15.142:0/3168800014 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac00095f0 con 0x7f0ad01026c0 2024-04-20T22:11:55.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.038+0000 7f0acea00700 1 --2- 172.21.15.142:0/3168800014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad01026c0 0x7f0ad00fff40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00b480 tx=0x7f0abc00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:11:55.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.038+0000 7f0ac7e00700 1 -- 172.21.15.142:0/3168800014 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0abc011800 con 0x7f0ad01026c0 2024-04-20T22:11:55.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.038+0000 7f0ac7e00700 1 -- 172.21.15.142:0/3168800014 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0abc011e20 con 0x7f0ad01026c0 2024-04-20T22:11:55.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.038+0000 7f0ac7e00700 1 -- 172.21.15.142:0/3168800014 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0abc010ea0 con 0x7f0ad01026c0 2024-04-20T22:11:55.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.038+0000 7f0ad6800700 1 -- 172.21.15.142:0/3168800014 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad01a2da0 con 0x7f0ad01026c0 2024-04-20T22:11:55.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.038+0000 7f0ad6800700 1 -- 172.21.15.142:0/3168800014 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad01a3100 con 0x7f0ad01026c0 2024-04-20T22:11:55.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.039+0000 7f0ad6800700 1 -- 172.21.15.142:0/3168800014 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad0068df0 con 0x7f0ad01026c0 2024-04-20T22:11:55.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.041+0000 7f0ac7e00700 1 -- 172.21.15.142:0/3168800014 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f0abc010380 con 0x7f0ad01026c0 2024-04-20T22:11:55.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.042+0000 7f0ac7e00700 1 --2- 172.21.15.142:0/3168800014 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0ab406ecc0 0x7f0ab4071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:11:55.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.042+0000 7f0ac7e00700 1 -- 172.21.15.142:0/3168800014 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f0abc08ea50 con 0x7f0ad01026c0 2024-04-20T22:11:55.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.043+0000 7f0acf400700 1 --2- 172.21.15.142:0/3168800014 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0ab406ecc0 0x7f0ab4071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:11:55.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.043+0000 7f0acf400700 1 --2- 172.21.15.142:0/3168800014 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0ab406ecc0 0x7f0ab4071180 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009910 tx=0x7f0ac0005ad0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:11:55.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.047+0000 7f0ac7e00700 1 -- 172.21.15.142:0/3168800014 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f0abc0576e0 con 0x7f0ad01026c0 2024-04-20T22:11:55.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.366+0000 7f0ad6800700 1 -- 172.21.15.142:0/3168800014 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0ad0100780 con 0x7f0ad01026c0 2024-04-20T22:11:55.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.368+0000 7f0ac7e00700 1 -- 172.21.15.142:0/3168800014 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f0ad0100780 con 0x7f0ad01026c0 2024-04-20T22:11:55.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.371+0000 7f0ad6800700 1 -- 172.21.15.142:0/3168800014 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0ab406ecc0 msgr2=0x7f0ab4071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:55.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.371+0000 7f0ad6800700 1 --2- 172.21.15.142:0/3168800014 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0ab406ecc0 0x7f0ab4071180 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009910 tx=0x7f0ac0005ad0 comp rx=0 tx=0).stop 2024-04-20T22:11:55.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.371+0000 7f0ad6800700 1 -- 172.21.15.142:0/3168800014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad01026c0 msgr2=0x7f0ad00fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:55.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.371+0000 7f0ad6800700 1 --2- 172.21.15.142:0/3168800014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad01026c0 0x7f0ad00fff40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00b480 tx=0x7f0abc00b790 comp rx=0 tx=0).stop 2024-04-20T22:11:55.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.371+0000 7f0ad6800700 1 -- 172.21.15.142:0/3168800014 shutdown_connections 2024-04-20T22:11:55.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.371+0000 7f0ad6800700 1 --2- 172.21.15.142:0/3168800014 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f0ab406ecc0 0x7f0ab4071180 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:55.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.371+0000 7f0ad6800700 1 --2- 172.21.15.142:0/3168800014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ad0101da0 0x7f0ad00ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:55.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.371+0000 7f0ad6800700 1 --2- 172.21.15.142:0/3168800014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad01026c0 0x7f0ad00fff40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:55.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.371+0000 7f0ad6800700 1 -- 172.21.15.142:0/3168800014 >> 172.21.15.142:0/3168800014 conn(0x7f0ad0076750 msgr2=0x7f0ad0103090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:11:55.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.371+0000 7f0ad6800700 1 -- 172.21.15.142:0/3168800014 shutdown_connections 2024-04-20T22:11:55.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:55.371+0000 7f0ad6800700 1 -- 172.21.15.142:0/3168800014 wait complete. 2024-04-20T22:11:55.387 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)" 2024-04-20T22:11:56.277 DEBUG:teuthology.parallel:result is None 2024-04-20T22:11:56.278 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-20T22:11:56.290 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi142.front.sepia.ceph.com 2024-04-20T22:11:56.291 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-20T22:11:56.361 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:56 smithi142 ceph-mon[79401]: pgmap v388: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:56.361 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:56 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3168800014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:11:56.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:56 smithi164 ceph-mon[69784]: pgmap v388: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:56.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:56 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3168800014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-20T22:11:56.705 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/mon.smithi142/config 2024-04-20T22:11:58.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:58 smithi142 ceph-mon[79401]: pgmap v389: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:58.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:58 smithi164 ceph-mon[69784]: pgmap v389: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:11:58.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.773+0000 7f933ea00700 1 -- 172.21.15.142:0/3435886426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9338107520 msgr2=0x7f9338107900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:58.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.773+0000 7f933ea00700 1 --2- 172.21.15.142:0/3435886426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9338107520 0x7f9338107900 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9328009910 tx=0x7f9328009c20 comp rx=0 tx=0).stop 2024-04-20T22:11:58.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.773+0000 7f933ea00700 1 -- 172.21.15.142:0/3435886426 shutdown_connections 2024-04-20T22:11:58.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.773+0000 7f933ea00700 1 --2- 172.21.15.142:0/3435886426 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9338108e10 0x7f9338109290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:58.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.773+0000 7f933ea00700 1 --2- 172.21.15.142:0/3435886426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9338107520 0x7f9338107900 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:58.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.773+0000 7f933ea00700 1 -- 172.21.15.142:0/3435886426 >> 172.21.15.142:0/3435886426 conn(0x7f93380768f0 msgr2=0x7f9338078d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:11:58.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.773+0000 7f933ea00700 1 -- 172.21.15.142:0/3435886426 shutdown_connections 2024-04-20T22:11:58.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.774+0000 7f933ea00700 1 -- 172.21.15.142:0/3435886426 wait complete. 2024-04-20T22:11:58.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.774+0000 7f933ea00700 1 Processor -- start 2024-04-20T22:11:58.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.775+0000 7f933ea00700 1 -- start start 2024-04-20T22:11:58.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.775+0000 7f933ea00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9338107520 0x7f933819d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:11:58.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.775+0000 7f933ea00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9338108e10 0x7f933819d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:11:58.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.775+0000 7f933ea00700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933819ddd0 con 0x7f9338107520 2024-04-20T22:11:58.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.775+0000 7f933ea00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93381a1aa0 con 0x7f9338108e10 2024-04-20T22:11:58.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.775+0000 7f9337e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9338107520 0x7f933819d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:11:58.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.775+0000 7f9337e00700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9338107520 0x7f933819d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46744/0 (socket says 172.21.15.142:46744) 2024-04-20T22:11:58.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.775+0000 7f9337e00700 1 -- 172.21.15.142:0/1977510119 learned_addr learned my addr 172.21.15.142:0/1977510119 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:11:58.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.776+0000 7f9337400700 1 --2- 172.21.15.142:0/1977510119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9338108e10 0x7f933819d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:11:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.776+0000 7f9337e00700 1 -- 172.21.15.142:0/1977510119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9338108e10 msgr2=0x7f933819d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.776+0000 7f9337e00700 1 --2- 172.21.15.142:0/1977510119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9338108e10 0x7f933819d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.776+0000 7f9337e00700 1 -- 172.21.15.142:0/1977510119 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93280095f0 con 0x7f9338107520 2024-04-20T22:11:58.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.776+0000 7f9337e00700 1 --2- 172.21.15.142:0/1977510119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9338107520 0x7f933819d1b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9328006010 tx=0x7f932800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:11:58.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.777+0000 7f9334c00700 1 -- 172.21.15.142:0/1977510119 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f932801d070 con 0x7f9338107520 2024-04-20T22:11:58.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.777+0000 7f9334c00700 1 -- 172.21.15.142:0/1977510119 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93280056e0 con 0x7f9338107520 2024-04-20T22:11:58.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.777+0000 7f933ea00700 1 -- 172.21.15.142:0/1977510119 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93381a1d20 con 0x7f9338107520 2024-04-20T22:11:58.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.777+0000 7f9334c00700 1 -- 172.21.15.142:0/1977510119 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f932800fdf0 con 0x7f9338107520 2024-04-20T22:11:58.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.777+0000 7f933ea00700 1 -- 172.21.15.142:0/1977510119 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93381a2290 con 0x7f9338107520 2024-04-20T22:11:58.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.778+0000 7f933ea00700 1 -- 172.21.15.142:0/1977510119 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f933810f870 con 0x7f9338107520 2024-04-20T22:11:58.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.779+0000 7f9334c00700 1 -- 172.21.15.142:0/1977510119 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f932800f5f0 con 0x7f9338107520 2024-04-20T22:11:58.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.781+0000 7f9334c00700 1 --2- 172.21.15.142:0/1977510119 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f931c06ecc0 0x7f931c071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:11:58.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.781+0000 7f9334c00700 1 -- 172.21.15.142:0/1977510119 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f9328090530 con 0x7f9338107520 2024-04-20T22:11:58.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.781+0000 7f9337400700 1 --2- 172.21.15.142:0/1977510119 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f931c06ecc0 0x7f931c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:11:58.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.782+0000 7f9337400700 1 --2- 172.21.15.142:0/1977510119 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f931c06ecc0 0x7f931c071180 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f933819e710 tx=0x7f932400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:11:58.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:58.785+0000 7f9334c00700 1 -- 172.21.15.142:0/1977510119 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f93280591c0 con 0x7f9338107520 2024-04-20T22:11:59.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:59.052+0000 7f933ea00700 1 -- 172.21.15.142:0/1977510119 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f933819e4f0 con 0x7f9338107520 2024-04-20T22:11:59.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:59.053+0000 7f9334c00700 1 -- 172.21.15.142:0/1977510119 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1957 (secure 0 0 0) 0x7f932805c880 con 0x7f9338107520 2024-04-20T22:11:59.053 INFO:teuthology.orchestra.run.smithi142.stdout:e35 2024-04-20T22:11:59.053 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T22:11:59.054 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-20T22:11:59.054 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2024-04-20T22:11:59.054 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:11:59.054 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2024-04-20T22:11:59.054 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2024-04-20T22:11:59.054 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 35 2024-04-20T22:11:59.054 INFO:teuthology.orchestra.run.smithi142.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-20T22:11:59.054 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-20T21:54:30.428853+0000 2024-04-20T22:11:59.054 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2024-04-20T22:07:34.267651+0000 2024-04-20T22:11:59.054 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2024-04-20T22:11:59.054 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2024-04-20T22:11:59.054 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 60 2024-04-20T22:11:59.054 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2024-04-20T22:11:59.055 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2024-04-20T22:11:59.055 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2024-04-20T22:11:59.055 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2024-04-20T22:11:59.055 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2024-04-20T22:11:59.055 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 85 2024-04-20T22:11:59.055 INFO:teuthology.orchestra.run.smithi142.stdout:snap_rstat 1 2024-04-20T22:11:59.055 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-20T22:11:59.055 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 1 2024-04-20T22:11:59.055 INFO:teuthology.orchestra.run.smithi142.stdout:in 0 2024-04-20T22:11:59.055 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=34454} 2024-04-20T22:11:59.055 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2024-04-20T22:11:59.055 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2024-04-20T22:11:59.055 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2024-04-20T22:11:59.055 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2024-04-20T22:11:59.056 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2024-04-20T22:11:59.056 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2024-04-20T22:11:59.056 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2024-04-20T22:11:59.056 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2024-04-20T22:11:59.056 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 1 2024-04-20T22:11:59.056 INFO:teuthology.orchestra.run.smithi142.stdout:qdb_cluster leader: 34454 members: 34454 2024-04-20T22:11:59.056 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lirkws{0:34454} state up:active seq 26 join_fscid=1 addr [v2:172.21.15.142:6826/2100080187,v1:172.21.15.142:6827/2100080187] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:11:59.056 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:11:59.056 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:11:59.056 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2024-04-20T22:11:59.056 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:11:59.056 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi142.lrvfgg{-1:34486} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.142:6828/2960234081,v1:172.21.15.142:6829/2960234081] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:11:59.056 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.ybvzha{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.164:6824/1951894011,v1:172.21.15.164:6825/1951894011] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:11:59.056 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.cephfs.smithi164.gmmrfu{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.164:6826/3399966592,v1:172.21.15.164:6827/3399966592] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T22:11:59.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:59.056+0000 7f933ea00700 1 -- 172.21.15.142:0/1977510119 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f931c06ecc0 msgr2=0x7f931c071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:59.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:59.056+0000 7f933ea00700 1 --2- 172.21.15.142:0/1977510119 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f931c06ecc0 0x7f931c071180 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f933819e710 tx=0x7f932400b410 comp rx=0 tx=0).stop 2024-04-20T22:11:59.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:59.056+0000 7f933ea00700 1 -- 172.21.15.142:0/1977510119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9338107520 msgr2=0x7f933819d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:11:59.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:59.056+0000 7f933ea00700 1 --2- 172.21.15.142:0/1977510119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9338107520 0x7f933819d1b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9328006010 tx=0x7f932800bd70 comp rx=0 tx=0).stop 2024-04-20T22:11:59.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:59.056+0000 7f933ea00700 1 -- 172.21.15.142:0/1977510119 shutdown_connections 2024-04-20T22:11:59.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:59.056+0000 7f933ea00700 1 --2- 172.21.15.142:0/1977510119 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f931c06ecc0 0x7f931c071180 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:59.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:59.056+0000 7f933ea00700 1 --2- 172.21.15.142:0/1977510119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9338107520 0x7f933819d1b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:59.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:59.056+0000 7f933ea00700 1 --2- 172.21.15.142:0/1977510119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9338108e10 0x7f933819d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:11:59.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:59.056+0000 7f933ea00700 1 -- 172.21.15.142:0/1977510119 >> 172.21.15.142:0/1977510119 conn(0x7f93380768f0 msgr2=0x7f9338077490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:11:59.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:59.056+0000 7f933ea00700 1 -- 172.21.15.142:0/1977510119 shutdown_connections 2024-04-20T22:11:59.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:11:59.056+0000 7f933ea00700 1 -- 172.21.15.142:0/1977510119 wait complete. 2024-04-20T22:11:59.058 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 35 2024-04-20T22:11:59.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:11:59 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/1977510119' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:11:59.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:11:59 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1977510119' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T22:11:59.868 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-04-20T22:11:59.880 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T22:12:00.091 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.092+0000 7fdb86600640 1 -- 172.21.15.142:0/2056776828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb80102e50 msgr2=0x7fdb80106e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:00.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.092+0000 7fdb86600640 1 --2- 172.21.15.142:0/2056776828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb80102e50 0x7fdb80106e90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c009880 tx=0x7fdb6c02bce0 comp rx=0 tx=0).stop 2024-04-20T22:12:00.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.092+0000 7fdb86600640 1 -- 172.21.15.142:0/2056776828 shutdown_connections 2024-04-20T22:12:00.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.092+0000 7fdb86600640 1 --2- 172.21.15.142:0/2056776828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb80102e50 0x7fdb80106e90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:00.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.092+0000 7fdb86600640 1 --2- 172.21.15.142:0/2056776828 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb801024a0 0x7fdb80102880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:00.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.092+0000 7fdb86600640 1 -- 172.21.15.142:0/2056776828 >> 172.21.15.142:0/2056776828 conn(0x7fdb800fdd00 msgr2=0x7fdb80100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:00.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.092+0000 7fdb86600640 1 -- 172.21.15.142:0/2056776828 shutdown_connections 2024-04-20T22:12:00.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.092+0000 7fdb86600640 1 -- 172.21.15.142:0/2056776828 wait complete. 2024-04-20T22:12:00.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.093+0000 7fdb86600640 1 Processor -- start 2024-04-20T22:12:00.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.093+0000 7fdb86600640 1 -- start start 2024-04-20T22:12:00.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.093+0000 7fdb86600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb801024a0 0x7fdb80197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:00.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.093+0000 7fdb86600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb801983b0 0x7fdb8019c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:00.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.093+0000 7fdb86600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb801989b0 con 0x7fdb801983b0 2024-04-20T22:12:00.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.093+0000 7fdb86600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb80198b20 con 0x7fdb801024a0 2024-04-20T22:12:00.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.094+0000 7fdb7ea00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb801983b0 0x7fdb8019c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:00.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.094+0000 7fdb7ea00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb801983b0 0x7fdb8019c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46768/0 (socket says 172.21.15.142:46768) 2024-04-20T22:12:00.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.094+0000 7fdb7ea00640 1 -- 172.21.15.142:0/3205247980 learned_addr learned my addr 172.21.15.142:0/3205247980 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:00.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.094+0000 7fdb7f400640 1 --2- 172.21.15.142:0/3205247980 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb801024a0 0x7fdb80197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:00.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.094+0000 7fdb7ea00640 1 -- 172.21.15.142:0/3205247980 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb801024a0 msgr2=0x7fdb80197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:00.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.094+0000 7fdb7ea00640 1 --2- 172.21.15.142:0/3205247980 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb801024a0 0x7fdb80197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:00.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.094+0000 7fdb7ea00640 1 -- 172.21.15.142:0/3205247980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c009560 con 0x7fdb801983b0 2024-04-20T22:12:00.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.095+0000 7fdb7ea00640 1 --2- 172.21.15.142:0/3205247980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb801983b0 0x7fdb8019c810 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c036040 tx=0x7fdb6c02c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:00.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.095+0000 7fdb77e00640 1 -- 172.21.15.142:0/3205247980 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb6c0035f0 con 0x7fdb801983b0 2024-04-20T22:12:00.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.095+0000 7fdb77e00640 1 -- 172.21.15.142:0/3205247980 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb6c003c10 con 0x7fdb801983b0 2024-04-20T22:12:00.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.095+0000 7fdb86600640 1 -- 172.21.15.142:0/3205247980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb8019cdb0 con 0x7fdb801983b0 2024-04-20T22:12:00.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.095+0000 7fdb77e00640 1 -- 172.21.15.142:0/3205247980 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb6c034440 con 0x7fdb801983b0 2024-04-20T22:12:00.095 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.095+0000 7fdb86600640 1 -- 172.21.15.142:0/3205247980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb8019d310 con 0x7fdb801983b0 2024-04-20T22:12:00.096 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.096+0000 7fdb86600640 1 -- 172.21.15.142:0/3205247980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb8004e040 con 0x7fdb801983b0 2024-04-20T22:12:00.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.097+0000 7fdb77e00640 1 -- 172.21.15.142:0/3205247980 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fdb6c003750 con 0x7fdb801983b0 2024-04-20T22:12:00.097 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.098+0000 7fdb77e00640 1 --2- 172.21.15.142:0/3205247980 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdb6406ecf0 0x7fdb640711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:00.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.098+0000 7fdb77e00640 1 -- 172.21.15.142:0/3205247980 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fdb6c0b13c0 con 0x7fdb801983b0 2024-04-20T22:12:00.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.099+0000 7fdb7f400640 1 --2- 172.21.15.142:0/3205247980 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdb6406ecf0 0x7fdb640711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:00.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.099+0000 7fdb7f400640 1 --2- 172.21.15.142:0/3205247980 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdb6406ecf0 0x7fdb640711b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdb70005fd0 tx=0x7fdb70005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:00.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.104+0000 7fdb77e00640 1 -- 172.21.15.142:0/3205247980 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fdb6c079fd0 con 0x7fdb801983b0 2024-04-20T22:12:00.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.311+0000 7fdb86600640 1 -- 172.21.15.142:0/3205247980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb8010a7a0 con 0x7fdb801983b0 2024-04-20T22:12:00.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.313+0000 7fdb77e00640 1 -- 172.21.15.142:0/3205247980 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+17089 (secure 0 0 0) 0x7fdb6c09ce60 con 0x7fdb801983b0 2024-04-20T22:12:00.314 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:00.314 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":85,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","created":"2024-04-20T21:45:27.213653+0000","modified":"2024-04-20T22:07:22.811117+0000","last_up_change":"2024-04-20T22:05:36.132962+0000","last_in_change":"2024-04-20T21:52:31.576977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:51:10.763901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-20T21:54:29.338742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-20T21:54:29.935422+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0042c600-a874-4d57-bb8f-7b6f32723bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":838783033},{"type":"v1","addr":"172.21.15.142:6803","nonce":838783033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":838783033},{"type":"v1","addr":"172.21.15.142:6805","nonce":838783033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":838783033},{"type":"v1","addr":"172.21.15.142:6809","nonce":838783033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":838783033},{"type":"v1","addr":"172.21.15.142:6807","nonce":838783033}]},"public_addr":"172.21.15.142:6803/838783033","cluster_addr":"172.21.15.142:6805/838783033","heartbeat_back_addr":"172.21.15.142:6809/838783033","heartbeat_front_addr":"172.21.15.142:6807/838783033","state":["exists","up"]},{"osd":1,"uuid":"29049537-368a-4d1f-b92c-21d962dd8031","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3789493679},{"type":"v1","addr":"172.21.15.142:6811","nonce":3789493679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3789493679},{"type":"v1","addr":"172.21.15.142:6813","nonce":3789493679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3789493679},{"type":"v1","addr":"172.21.15.142:6817","nonce":3789493679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3789493679},{"type":"v1","addr":"172.21.15.142:6815","nonce":3789493679}]},"public_addr":"172.21.15.142:6811/3789493679","cluster_addr":"172.21.15.142:6813/3789493679","heartbeat_back_addr":"172.21.15.142:6817/3789493679","heartbeat_front_addr":"172.21.15.142:6815/3789493679","state":["exists","up"]},{"osd":2,"uuid":"4ea8215b-dc6f-4f18-9d2c-5a5b21e02fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":4113404383},{"type":"v1","addr":"172.21.15.142:6819","nonce":4113404383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":4113404383},{"type":"v1","addr":"172.21.15.142:6821","nonce":4113404383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4113404383},{"type":"v1","addr":"172.21.15.142:6825","nonce":4113404383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":4113404383},{"type":"v1","addr":"172.21.15.142:6823","nonce":4113404383}]},"public_addr":"172.21.15.142:6819/4113404383","cluster_addr":"172.21.15.142:6821/4113404383","heartbeat_back_addr":"172.21.15.142:6825/4113404383","heartbeat_front_addr":"172.21.15.142:6823/4113404383","state":["exists","up"]},{"osd":3,"uuid":"981987e0-cff5-42e9-8129-2a08175c6ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2211531735},{"type":"v1","addr":"172.21.15.164:6801","nonce":2211531735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2211531735},{"type":"v1","addr":"172.21.15.164:6803","nonce":2211531735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2211531735},{"type":"v1","addr":"172.21.15.164:6807","nonce":2211531735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2211531735},{"type":"v1","addr":"172.21.15.164:6805","nonce":2211531735}]},"public_addr":"172.21.15.164:6801/2211531735","cluster_addr":"172.21.15.164:6803/2211531735","heartbeat_back_addr":"172.21.15.164:6807/2211531735","heartbeat_front_addr":"172.21.15.164:6805/2211531735","state":["exists","up"]},{"osd":4,"uuid":"a839fb7d-f82c-4bb0-8c33-b4f4f261bcae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":36,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":155884460},{"type":"v1","addr":"172.21.15.164:6809","nonce":155884460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":155884460},{"type":"v1","addr":"172.21.15.164:6811","nonce":155884460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":155884460},{"type":"v1","addr":"172.21.15.164:6815","nonce":155884460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":155884460},{"type":"v1","addr":"172.21.15.164:6813","nonce":155884460}]},"public_addr":"172.21.15.164:6809/155884460","cluster_addr":"172.21.15.164:6811/155884460","heartbeat_back_addr":"172.21.15.164:6815/155884460","heartbeat_front_addr":"172.21.15.164:6813/155884460","state":["exists","up"]},{"osd":5,"uuid":"72378e50-3a51-469d-a402-489d9bbfed7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":41,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3289958207},{"type":"v1","addr":"172.21.15.164:6817","nonce":3289958207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3289958207},{"type":"v1","addr":"172.21.15.164:6819","nonce":3289958207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3289958207},{"type":"v1","addr":"172.21.15.164:6823","nonce":3289958207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3289958207},{"type":"v1","addr":"172.21.15.164:6821","nonce":3289958207}]},"public_addr":"172.21.15.164:6817/3289958207","cluster_addr":"172.21.15.164:6819/3289958207","heartbeat_back_addr":"172.21.15.164:6823/3289958207","heartbeat_front_addr":"172.21.15.164:6821/3289958207","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:49:52.556673+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:50:29.868343+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:51:07.890840+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:51:43.365372+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:52:18.872393+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:52:54.318402+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:6827/3096926963":"2024-04-21T22:07:22.811065+0000","172.21.15.164:6825/4054029190":"2024-04-21T22:06:52.436542+0000","172.21.15.164:6824/4054029190":"2024-04-21T22:06:52.436542+0000","172.21.15.142:6829/3327440588":"2024-04-21T22:06:21.702075+0000","172.21.15.142:6828/3327440588":"2024-04-21T22:06:21.702075+0000","172.21.15.142:6827/2866697672":"2024-04-21T22:05:47.754237+0000","172.21.15.142:0/966681596":"2024-04-21T22:00:14.360617+0000","172.21.15.164:6826/3096926963":"2024-04-21T22:07:22.811065+0000","172.21.15.142:0/3515098784":"2024-04-21T21:48:09.914211+0000","172.21.15.142:6801/2803679129":"2024-04-21T21:46:01.678961+0000","172.21.15.142:0/99578737":"2024-04-21T21:57:21.903211+0000","172.21.15.142:0/195339089":"2024-04-21T21:48:09.914211+0000","172.21.15.142:6800/3610638500":"2024-04-21T21:57:21.903211+0000","172.21.15.142:6826/2866697672":"2024-04-21T22:05:47.754237+0000","172.21.15.142:0/1074487851":"2024-04-21T22:00:14.360617+0000","172.21.15.164:0/2404972195":"2024-04-21T21:58:50.797892+0000","172.21.15.142:0/3333243244":"2024-04-21T21:57:21.903211+0000","172.21.15.142:0/680486182":"2024-04-21T21:46:43.407590+0000","172.21.15.164:0/1385398224":"2024-04-21T21:58:50.797892+0000","172.21.15.142:0/3501876256":"2024-04-21T21:46:01.678961+0000","172.21.15.142:0/2483063574":"2024-04-21T21:57:21.903211+0000","172.21.15.142:0/4043640333":"2024-04-21T21:57:21.903211+0000","172.21.15.142:0/801898031":"2024-04-21T21:46:43.407590+0000","172.21.15.164:0/1190693155":"2024-04-21T21:58:50.797892+0000","172.21.15.164:0/3440297070":"2024-04-21T21:58:50.797892+0000","172.21.15.142:6800/2803679129":"2024-04-21T21:46:01.678961+0000","172.21.15.142:6800/54392364":"2024-04-21T22:00:14.360617+0000","172.21.15.142:0/1140713527":"2024-04-21T21:46:01.678961+0000","172.21.15.142:0/2707077921":"2024-04-21T22:00:14.360617+0000","172.21.15.142:0/1249568560":"2024-04-21T22:00:14.360617+0000","172.21.15.142:0/841637693":"2024-04-21T21:48:09.914211+0000","172.21.15.164:6829/929524464":"2024-04-21T21:58:50.797892+0000","172.21.15.142:6801/550675874":"2024-04-21T21:46:43.407590+0000","172.21.15.142:6801/3610638500":"2024-04-21T21:57:21.903211+0000","172.21.15.142:0/2901318326":"2024-04-21T21:46:01.678961+0000","172.21.15.164:0/716355240":"2024-04-21T21:58:50.797892+0000","172.21.15.142:6800/3464616902":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/4246233855":"2024-04-21T21:46:43.407590+0000","172.21.15.164:0/248046752":"2024-04-21T21:58:50.797892+0000","172.21.15.142:6800/550675874":"2024-04-21T21:46:43.407590+0000","172.21.15.142:6801/3464616902":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/540390027":"2024-04-21T22:00:14.360617+0000","172.21.15.142:0/1338478936":"2024-04-21T22:00:14.360617+0000","172.21.15.164:6828/929524464":"2024-04-21T21:58:50.797892+0000","172.21.15.142:6801/54392364":"2024-04-21T22:00:14.360617+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T22:12:00.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.316+0000 7fdb86600640 1 -- 172.21.15.142:0/3205247980 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdb6406ecf0 msgr2=0x7fdb640711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:00.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.317+0000 7fdb86600640 1 --2- 172.21.15.142:0/3205247980 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdb6406ecf0 0x7fdb640711b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdb70005fd0 tx=0x7fdb70005850 comp rx=0 tx=0).stop 2024-04-20T22:12:00.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.317+0000 7fdb86600640 1 -- 172.21.15.142:0/3205247980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb801983b0 msgr2=0x7fdb8019c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:00.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.317+0000 7fdb86600640 1 --2- 172.21.15.142:0/3205247980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb801983b0 0x7fdb8019c810 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c036040 tx=0x7fdb6c02c850 comp rx=0 tx=0).stop 2024-04-20T22:12:00.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.317+0000 7fdb86600640 1 -- 172.21.15.142:0/3205247980 shutdown_connections 2024-04-20T22:12:00.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.317+0000 7fdb86600640 1 --2- 172.21.15.142:0/3205247980 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdb6406ecf0 0x7fdb640711b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:00.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.317+0000 7fdb86600640 1 --2- 172.21.15.142:0/3205247980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb801983b0 0x7fdb8019c810 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:00.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.317+0000 7fdb86600640 1 --2- 172.21.15.142:0/3205247980 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb801024a0 0x7fdb80197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:00.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.317+0000 7fdb86600640 1 -- 172.21.15.142:0/3205247980 >> 172.21.15.142:0/3205247980 conn(0x7fdb800fdd00 msgr2=0x7fdb800ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:00.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.317+0000 7fdb86600640 1 -- 172.21.15.142:0/3205247980 shutdown_connections 2024-04-20T22:12:00.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.317+0000 7fdb86600640 1 -- 172.21.15.142:0/3205247980 wait complete. 2024-04-20T22:12:00.336 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:51:10.763901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-20T21:54:29.338742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-20T21:54:29.935422+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T22:12:00.336 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T22:12:00.347 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:00 smithi164 ceph-mon[69784]: pgmap v390: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:00.347 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:00 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:12:00.399 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:00 smithi142 ceph-mon[79401]: pgmap v390: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:00.399 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:00 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:12:00.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.536+0000 7f3b36c00640 1 -- 172.21.15.142:0/1676747870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b301000c0 msgr2=0x7f3b301004a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:00.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.536+0000 7f3b36c00640 1 --2- 172.21.15.142:0/1676747870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b301000c0 0x7f3b301004a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3b24009880 tx=0x7f3b2402bce0 comp rx=0 tx=0).stop 2024-04-20T22:12:00.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.537+0000 7f3b36c00640 1 -- 172.21.15.142:0/1676747870 shutdown_connections 2024-04-20T22:12:00.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.537+0000 7f3b36c00640 1 --2- 172.21.15.142:0/1676747870 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b30100a70 0x7f3b30104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:00.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.537+0000 7f3b36c00640 1 --2- 172.21.15.142:0/1676747870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b301000c0 0x7f3b301004a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:00.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.537+0000 7f3b36c00640 1 -- 172.21.15.142:0/1676747870 >> 172.21.15.142:0/1676747870 conn(0x7f3b300fb920 msgr2=0x7f3b300fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:00.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.537+0000 7f3b36c00640 1 -- 172.21.15.142:0/1676747870 shutdown_connections 2024-04-20T22:12:00.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.537+0000 7f3b36c00640 1 -- 172.21.15.142:0/1676747870 wait complete. 2024-04-20T22:12:00.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.538+0000 7f3b36c00640 1 Processor -- start 2024-04-20T22:12:00.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.538+0000 7f3b36c00640 1 -- start start 2024-04-20T22:12:00.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.538+0000 7f3b36c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b301000c0 0x7f3b300725a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:00.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.538+0000 7f3b36c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b30072ae0 0x7f3b30072f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:00.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.538+0000 7f3b36c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b301a1de0 con 0x7f3b301000c0 2024-04-20T22:12:00.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.538+0000 7f3b36c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b301a1f20 con 0x7f3b30072ae0 2024-04-20T22:12:00.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.538+0000 7f3b35800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b301000c0 0x7f3b300725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:00.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.538+0000 7f3b35800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b301000c0 0x7f3b300725a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46794/0 (socket says 172.21.15.142:46794) 2024-04-20T22:12:00.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.539+0000 7f3b35800640 1 -- 172.21.15.142:0/2137030709 learned_addr learned my addr 172.21.15.142:0/2137030709 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:00.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.539+0000 7f3b34e00640 1 --2- 172.21.15.142:0/2137030709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b30072ae0 0x7f3b30072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:00.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.539+0000 7f3b35800640 1 -- 172.21.15.142:0/2137030709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b30072ae0 msgr2=0x7f3b30072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:00.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.539+0000 7f3b35800640 1 --2- 172.21.15.142:0/2137030709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b30072ae0 0x7f3b30072f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:00.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.539+0000 7f3b35800640 1 -- 172.21.15.142:0/2137030709 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b24009560 con 0x7f3b301000c0 2024-04-20T22:12:00.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.539+0000 7f3b35800640 1 --2- 172.21.15.142:0/2137030709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b301000c0 0x7f3b300725a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3b24009430 tx=0x7f3b24004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:00.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.540+0000 7f3b2e000640 1 -- 172.21.15.142:0/2137030709 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b240035f0 con 0x7f3b301000c0 2024-04-20T22:12:00.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.540+0000 7f3b2e000640 1 -- 172.21.15.142:0/2137030709 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b24003c10 con 0x7f3b301000c0 2024-04-20T22:12:00.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.540+0000 7f3b2e000640 1 -- 172.21.15.142:0/2137030709 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b24005670 con 0x7f3b301000c0 2024-04-20T22:12:00.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.540+0000 7f3b36c00640 1 -- 172.21.15.142:0/2137030709 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b301a2060 con 0x7f3b301000c0 2024-04-20T22:12:00.540 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.540+0000 7f3b36c00640 1 -- 172.21.15.142:0/2137030709 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b301a2570 con 0x7f3b301000c0 2024-04-20T22:12:00.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.541+0000 7f3b36c00640 1 -- 172.21.15.142:0/2137030709 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b3004e040 con 0x7f3b301000c0 2024-04-20T22:12:00.541 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.542+0000 7f3b2e000640 1 -- 172.21.15.142:0/2137030709 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f3b24004dd0 con 0x7f3b301000c0 2024-04-20T22:12:00.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.543+0000 7f3b2e000640 1 --2- 172.21.15.142:0/2137030709 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3b1806ebe0 0x7f3b180710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:00.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.543+0000 7f3b2e000640 1 -- 172.21.15.142:0/2137030709 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f3b240b13c0 con 0x7f3b301000c0 2024-04-20T22:12:00.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.543+0000 7f3b34e00640 1 --2- 172.21.15.142:0/2137030709 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3b1806ebe0 0x7f3b180710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:00.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.544+0000 7f3b34e00640 1 --2- 172.21.15.142:0/2137030709 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3b1806ebe0 0x7f3b180710a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c005fd0 tx=0x7f3b1c005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:00.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.548+0000 7f3b2e000640 1 -- 172.21.15.142:0/2137030709 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f3b24079fd0 con 0x7f3b301000c0 2024-04-20T22:12:00.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.754+0000 7f3b36c00640 1 -- 172.21.15.142:0/2137030709 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b301083c0 con 0x7f3b301000c0 2024-04-20T22:12:00.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.755+0000 7f3b2e000640 1 -- 172.21.15.142:0/2137030709 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b301083c0 con 0x7f3b301000c0 2024-04-20T22:12:00.755 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2024-04-20T22:12:00.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.758+0000 7f3b36c00640 1 -- 172.21.15.142:0/2137030709 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3b1806ebe0 msgr2=0x7f3b180710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:00.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.758+0000 7f3b36c00640 1 --2- 172.21.15.142:0/2137030709 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3b1806ebe0 0x7f3b180710a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c005fd0 tx=0x7f3b1c005850 comp rx=0 tx=0).stop 2024-04-20T22:12:00.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.758+0000 7f3b36c00640 1 -- 172.21.15.142:0/2137030709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b301000c0 msgr2=0x7f3b300725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:00.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.758+0000 7f3b36c00640 1 --2- 172.21.15.142:0/2137030709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b301000c0 0x7f3b300725a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3b24009430 tx=0x7f3b24004040 comp rx=0 tx=0).stop 2024-04-20T22:12:00.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.758+0000 7f3b36c00640 1 -- 172.21.15.142:0/2137030709 shutdown_connections 2024-04-20T22:12:00.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.758+0000 7f3b36c00640 1 --2- 172.21.15.142:0/2137030709 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f3b1806ebe0 0x7f3b180710a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:00.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.758+0000 7f3b36c00640 1 --2- 172.21.15.142:0/2137030709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b30072ae0 0x7f3b30072f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:00.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.758+0000 7f3b36c00640 1 --2- 172.21.15.142:0/2137030709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b301000c0 0x7f3b300725a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:00.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.758+0000 7f3b36c00640 1 -- 172.21.15.142:0/2137030709 >> 172.21.15.142:0/2137030709 conn(0x7f3b300fb920 msgr2=0x7f3b300fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:00.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.758+0000 7f3b36c00640 1 -- 172.21.15.142:0/2137030709 shutdown_connections 2024-04-20T22:12:00.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.758+0000 7f3b36c00640 1 -- 172.21.15.142:0/2137030709 wait complete. 2024-04-20T22:12:00.779 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-20T22:12:00.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.977+0000 7f51b5800640 1 -- 172.21.15.142:0/423353236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51b0106490 msgr2=0x7f51b01068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:00.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.977+0000 7f51b5800640 1 --2- 172.21.15.142:0/423353236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51b0106490 0x7f51b01068f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5198009880 tx=0x7f519802bd80 comp rx=0 tx=0).stop 2024-04-20T22:12:00.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.977+0000 7f51b5800640 1 -- 172.21.15.142:0/423353236 shutdown_connections 2024-04-20T22:12:00.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.977+0000 7f51b5800640 1 --2- 172.21.15.142:0/423353236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51b0106490 0x7f51b01068f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:00.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.977+0000 7f51b5800640 1 --2- 172.21.15.142:0/423353236 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51b010b400 0x7f51b010b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:00.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.977+0000 7f51b5800640 1 -- 172.21.15.142:0/423353236 >> 172.21.15.142:0/423353236 conn(0x7f51b0075c50 msgr2=0x7f51b0078070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:00.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.977+0000 7f51b5800640 1 -- 172.21.15.142:0/423353236 shutdown_connections 2024-04-20T22:12:00.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.977+0000 7f51b5800640 1 -- 172.21.15.142:0/423353236 wait complete. 2024-04-20T22:12:00.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.978+0000 7f51b5800640 1 Processor -- start 2024-04-20T22:12:00.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.979+0000 7f51b5800640 1 -- start start 2024-04-20T22:12:00.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.979+0000 7f51b5800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51b0106490 0x7f51b019c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:00.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.979+0000 7f51b5800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51b010b400 0x7f51b019c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:00.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.979+0000 7f51b5800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b019cd40 con 0x7f51b0106490 2024-04-20T22:12:00.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.979+0000 7f51b5800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b01a0b10 con 0x7f51b010b400 2024-04-20T22:12:00.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.980+0000 7f51afe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51b0106490 0x7f51b019c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:00.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.980+0000 7f51afe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51b0106490 0x7f51b019c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46802/0 (socket says 172.21.15.142:46802) 2024-04-20T22:12:00.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.980+0000 7f51afe00640 1 -- 172.21.15.142:0/1051498280 learned_addr learned my addr 172.21.15.142:0/1051498280 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:00.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.980+0000 7f51afe00640 1 -- 172.21.15.142:0/1051498280 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51b010b400 msgr2=0x7f51b019c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:00.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.980+0000 7f51afe00640 1 --2- 172.21.15.142:0/1051498280 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51b010b400 0x7f51b019c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:00.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.980+0000 7f51afe00640 1 -- 172.21.15.142:0/1051498280 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5198009560 con 0x7f51b0106490 2024-04-20T22:12:00.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.980+0000 7f51afe00640 1 --2- 172.21.15.142:0/1051498280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51b0106490 0x7f51b019c170 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f51a000c8f0 tx=0x7f51a000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:00.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.981+0000 7f51acc00640 1 -- 172.21.15.142:0/1051498280 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51a0007b80 con 0x7f51b0106490 2024-04-20T22:12:00.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.981+0000 7f51b5800640 1 -- 172.21.15.142:0/1051498280 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b01a0df0 con 0x7f51b0106490 2024-04-20T22:12:00.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.981+0000 7f51acc00640 1 -- 172.21.15.142:0/1051498280 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f51a00054e0 con 0x7f51b0106490 2024-04-20T22:12:00.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.981+0000 7f51acc00640 1 -- 172.21.15.142:0/1051498280 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51a000f450 con 0x7f51b0106490 2024-04-20T22:12:00.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.981+0000 7f51b5800640 1 -- 172.21.15.142:0/1051498280 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b01a1350 con 0x7f51b0106490 2024-04-20T22:12:00.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.982+0000 7f51b5800640 1 -- 172.21.15.142:0/1051498280 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b004e040 con 0x7f51b0106490 2024-04-20T22:12:00.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.983+0000 7f51acc00640 1 -- 172.21.15.142:0/1051498280 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f51a0004f60 con 0x7f51b0106490 2024-04-20T22:12:00.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.984+0000 7f51acc00640 1 --2- 172.21.15.142:0/1051498280 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f519406ec30 0x7f51940710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:00.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.984+0000 7f51acc00640 1 -- 172.21.15.142:0/1051498280 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f51a008ee60 con 0x7f51b0106490 2024-04-20T22:12:00.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.984+0000 7f51af400640 1 --2- 172.21.15.142:0/1051498280 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f519406ec30 0x7f51940710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:00.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.985+0000 7f51af400640 1 --2- 172.21.15.142:0/1051498280 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f519406ec30 0x7f51940710f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5198036040 tx=0x7f5198000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:00.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:00.989+0000 7f51acc00640 1 -- 172.21.15.142:0/1051498280 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f51a0057a70 con 0x7f51b0106490 2024-04-20T22:12:01.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.195+0000 7f51b5800640 1 -- 172.21.15.142:0/1051498280 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f51b010e900 con 0x7f51b0106490 2024-04-20T22:12:01.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.196+0000 7f51acc00640 1 -- 172.21.15.142:0/1051498280 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f51a001d020 con 0x7f51b0106490 2024-04-20T22:12:01.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:01 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3205247980' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T22:12:01.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:01 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/2137030709' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T22:12:01.197 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2024-04-20T22:12:01.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.199+0000 7f51b5800640 1 -- 172.21.15.142:0/1051498280 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f519406ec30 msgr2=0x7f51940710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.199+0000 7f51b5800640 1 --2- 172.21.15.142:0/1051498280 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f519406ec30 0x7f51940710f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5198036040 tx=0x7f5198000bc0 comp rx=0 tx=0).stop 2024-04-20T22:12:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.199+0000 7f51b5800640 1 -- 172.21.15.142:0/1051498280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51b0106490 msgr2=0x7f51b019c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.199+0000 7f51b5800640 1 --2- 172.21.15.142:0/1051498280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51b0106490 0x7f51b019c170 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f51a000c8f0 tx=0x7f51a000cdb0 comp rx=0 tx=0).stop 2024-04-20T22:12:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.200+0000 7f51b5800640 1 -- 172.21.15.142:0/1051498280 shutdown_connections 2024-04-20T22:12:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.200+0000 7f51b5800640 1 --2- 172.21.15.142:0/1051498280 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f519406ec30 0x7f51940710f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.200+0000 7f51b5800640 1 --2- 172.21.15.142:0/1051498280 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f51b010b400 0x7f51b019c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.200+0000 7f51b5800640 1 --2- 172.21.15.142:0/1051498280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51b0106490 0x7f51b019c170 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.200+0000 7f51b5800640 1 -- 172.21.15.142:0/1051498280 >> 172.21.15.142:0/1051498280 conn(0x7f51b0075c50 msgr2=0x7f51b0076720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.200+0000 7f51b5800640 1 -- 172.21.15.142:0/1051498280 shutdown_connections 2024-04-20T22:12:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.200+0000 7f51b5800640 1 -- 172.21.15.142:0/1051498280 wait complete. 2024-04-20T22:12:01.219 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-20T22:12:01.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.425+0000 7f7b85800640 1 -- 172.21.15.142:0/657408028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b801022e0 msgr2=0x7f7b801026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:01.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.425+0000 7f7b85800640 1 --2- 172.21.15.142:0/657408028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b801022e0 0x7f7b801026c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7b70009880 tx=0x7f7b7002bce0 comp rx=0 tx=0).stop 2024-04-20T22:12:01.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.425+0000 7f7b85800640 1 -- 172.21.15.142:0/657408028 shutdown_connections 2024-04-20T22:12:01.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.425+0000 7f7b85800640 1 --2- 172.21.15.142:0/657408028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b80102c90 0x7f7b80106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:01.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.425+0000 7f7b85800640 1 --2- 172.21.15.142:0/657408028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b801022e0 0x7f7b801026c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:01.425 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.425+0000 7f7b85800640 1 -- 172.21.15.142:0/657408028 >> 172.21.15.142:0/657408028 conn(0x7f7b800fdb60 msgr2=0x7f7b800fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:01.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.425+0000 7f7b85800640 1 -- 172.21.15.142:0/657408028 shutdown_connections 2024-04-20T22:12:01.426 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.425+0000 7f7b85800640 1 -- 172.21.15.142:0/657408028 wait complete. 2024-04-20T22:12:01.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.426+0000 7f7b85800640 1 Processor -- start 2024-04-20T22:12:01.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.427+0000 7f7b85800640 1 -- start start 2024-04-20T22:12:01.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.427+0000 7f7b85800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b801022e0 0x7f7b80197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:01.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.427+0000 7f7b85800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b80198310 0x7f7b8019c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:01.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.427+0000 7f7b85800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b80198910 con 0x7f7b80198310 2024-04-20T22:12:01.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.427+0000 7f7b85800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b80198a80 con 0x7f7b801022e0 2024-04-20T22:12:01.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.427+0000 7f7b77400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b80198310 0x7f7b8019c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:01.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.427+0000 7f7b77400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b80198310 0x7f7b8019c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46822/0 (socket says 172.21.15.142:46822) 2024-04-20T22:12:01.427 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.427+0000 7f7b77400640 1 -- 172.21.15.142:0/21675691 learned_addr learned my addr 172.21.15.142:0/21675691 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:01.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.428+0000 7f7b7fe00640 1 --2- 172.21.15.142:0/21675691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b801022e0 0x7f7b80197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:01.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.428+0000 7f7b77400640 1 -- 172.21.15.142:0/21675691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b801022e0 msgr2=0x7f7b80197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:01.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.428+0000 7f7b77400640 1 --2- 172.21.15.142:0/21675691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b801022e0 0x7f7b80197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:01.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.428+0000 7f7b77400640 1 -- 172.21.15.142:0/21675691 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b70009560 con 0x7f7b80198310 2024-04-20T22:12:01.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.428+0000 7f7b7fe00640 1 --2- 172.21.15.142:0/21675691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b801022e0 0x7f7b80197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:12:01.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.428+0000 7f7b77400640 1 --2- 172.21.15.142:0/21675691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b80198310 0x7f7b8019c770 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7b6800d6f0 tx=0x7f7b6800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:01.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.428+0000 7f7b7d600640 1 -- 172.21.15.142:0/21675691 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b680051f0 con 0x7f7b80198310 2024-04-20T22:12:01.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.428+0000 7f7b7d600640 1 -- 172.21.15.142:0/21675691 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b68009ce0 con 0x7f7b80198310 2024-04-20T22:12:01.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.428+0000 7f7b85800640 1 -- 172.21.15.142:0/21675691 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8019cd70 con 0x7f7b80198310 2024-04-20T22:12:01.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.428+0000 7f7b7d600640 1 -- 172.21.15.142:0/21675691 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b68004e80 con 0x7f7b80198310 2024-04-20T22:12:01.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.429+0000 7f7b85800640 1 -- 172.21.15.142:0/21675691 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8019d2d0 con 0x7f7b80198310 2024-04-20T22:12:01.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.430+0000 7f7b85800640 1 -- 172.21.15.142:0/21675691 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8019d5a0 con 0x7f7b80198310 2024-04-20T22:12:01.430 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.431+0000 7f7b7d600640 1 -- 172.21.15.142:0/21675691 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f7b680046c0 con 0x7f7b80198310 2024-04-20T22:12:01.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.431+0000 7f7b7d600640 1 --2- 172.21.15.142:0/21675691 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7b6406ec30 0x7f7b640710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:01.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.432+0000 7f7b7d600640 1 -- 172.21.15.142:0/21675691 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f7b6808e9b0 con 0x7f7b80198310 2024-04-20T22:12:01.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.432+0000 7f7b7fe00640 1 --2- 172.21.15.142:0/21675691 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7b6406ec30 0x7f7b640710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:01.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.433+0000 7f7b7fe00640 1 --2- 172.21.15.142:0/21675691 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7b6406ec30 0x7f7b640710f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7b70005ec0 tx=0x7f7b70005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:01.436 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.436+0000 7f7b7d600640 1 -- 172.21.15.142:0/21675691 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f7b68057640 con 0x7f7b80198310 2024-04-20T22:12:01.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:01 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3205247980' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T22:12:01.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:01 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2137030709' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T22:12:01.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.637+0000 7f7b85800640 1 -- 172.21.15.142:0/21675691 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f7b80199190 con 0x7f7b80198310 2024-04-20T22:12:01.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.638+0000 7f7b7d600640 1 -- 172.21.15.142:0/21675691 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f7b68017020 con 0x7f7b80198310 2024-04-20T22:12:01.638 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2024-04-20T22:12:01.640 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.641+0000 7f7b85800640 1 -- 172.21.15.142:0/21675691 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7b6406ec30 msgr2=0x7f7b640710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:01.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.641+0000 7f7b85800640 1 --2- 172.21.15.142:0/21675691 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7b6406ec30 0x7f7b640710f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7b70005ec0 tx=0x7f7b70005fd0 comp rx=0 tx=0).stop 2024-04-20T22:12:01.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.641+0000 7f7b85800640 1 -- 172.21.15.142:0/21675691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b80198310 msgr2=0x7f7b8019c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:01.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.641+0000 7f7b85800640 1 --2- 172.21.15.142:0/21675691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b80198310 0x7f7b8019c770 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7b6800d6f0 tx=0x7f7b6800dbb0 comp rx=0 tx=0).stop 2024-04-20T22:12:01.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.641+0000 7f7b85800640 1 -- 172.21.15.142:0/21675691 shutdown_connections 2024-04-20T22:12:01.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.641+0000 7f7b85800640 1 --2- 172.21.15.142:0/21675691 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7b6406ec30 0x7f7b640710f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:01.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.641+0000 7f7b85800640 1 --2- 172.21.15.142:0/21675691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b80198310 0x7f7b8019c770 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:01.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.641+0000 7f7b85800640 1 --2- 172.21.15.142:0/21675691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b801022e0 0x7f7b80197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:01.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.641+0000 7f7b85800640 1 -- 172.21.15.142:0/21675691 >> 172.21.15.142:0/21675691 conn(0x7f7b800fdb60 msgr2=0x7f7b800ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:01.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.641+0000 7f7b85800640 1 -- 172.21.15.142:0/21675691 shutdown_connections 2024-04-20T22:12:01.641 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.641+0000 7f7b85800640 1 -- 172.21.15.142:0/21675691 wait complete. 2024-04-20T22:12:01.660 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T22:12:01.859 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.859+0000 7fe1de200640 1 -- 172.21.15.142:0/1018416200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1d8072650 msgr2=0x7fe1d8072a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:01.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.859+0000 7fe1de200640 1 --2- 172.21.15.142:0/1018416200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1d8072650 0x7fe1d8072a30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0009880 tx=0x7fe1c002bd70 comp rx=0 tx=0).stop 2024-04-20T22:12:01.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.860+0000 7fe1de200640 1 -- 172.21.15.142:0/1018416200 shutdown_connections 2024-04-20T22:12:01.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.860+0000 7fe1de200640 1 --2- 172.21.15.142:0/1018416200 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1d8072f70 0x7fe1d810c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:01.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.860+0000 7fe1de200640 1 --2- 172.21.15.142:0/1018416200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1d8072650 0x7fe1d8072a30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:01.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.860+0000 7fe1de200640 1 -- 172.21.15.142:0/1018416200 >> 172.21.15.142:0/1018416200 conn(0x7fe1d80fb930 msgr2=0x7fe1d80fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:01.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.860+0000 7fe1de200640 1 -- 172.21.15.142:0/1018416200 shutdown_connections 2024-04-20T22:12:01.860 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.860+0000 7fe1de200640 1 -- 172.21.15.142:0/1018416200 wait complete. 2024-04-20T22:12:01.861 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.861+0000 7fe1de200640 1 Processor -- start 2024-04-20T22:12:01.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.861+0000 7fe1de200640 1 -- start start 2024-04-20T22:12:01.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.861+0000 7fe1de200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1d8072650 0x7fe1d8197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:01.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.861+0000 7fe1de200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1d8072f70 0x7fe1d81982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:01.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.861+0000 7fe1de200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d8198940 con 0x7fe1d8072650 2024-04-20T22:12:01.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.861+0000 7fe1de200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d819c710 con 0x7fe1d8072f70 2024-04-20T22:12:01.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.862+0000 7fe1dce00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1d8072650 0x7fe1d8197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:01.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.862+0000 7fe1dce00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1d8072650 0x7fe1d8197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46844/0 (socket says 172.21.15.142:46844) 2024-04-20T22:12:01.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.862+0000 7fe1dce00640 1 -- 172.21.15.142:0/3474591735 learned_addr learned my addr 172.21.15.142:0/3474591735 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:01.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.862+0000 7fe1cfe00640 1 --2- 172.21.15.142:0/3474591735 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1d8072f70 0x7fe1d81982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:01.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.862+0000 7fe1dce00640 1 -- 172.21.15.142:0/3474591735 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1d8072f70 msgr2=0x7fe1d81982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:01.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.862+0000 7fe1dce00640 1 --2- 172.21.15.142:0/3474591735 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1d8072f70 0x7fe1d81982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:01.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.862+0000 7fe1dce00640 1 -- 172.21.15.142:0/3474591735 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c0009560 con 0x7fe1d8072650 2024-04-20T22:12:01.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.862+0000 7fe1dce00640 1 --2- 172.21.15.142:0/3474591735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1d8072650 0x7fe1d8197d70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0036040 tx=0x7fe1c0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:01.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.863+0000 7fe1d6000640 1 -- 172.21.15.142:0/3474591735 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1c00037c0 con 0x7fe1d8072650 2024-04-20T22:12:01.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.863+0000 7fe1d6000640 1 -- 172.21.15.142:0/3474591735 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe1c0004aa0 con 0x7fe1d8072650 2024-04-20T22:12:01.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.863+0000 7fe1de200640 1 -- 172.21.15.142:0/3474591735 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d819c990 con 0x7fe1d8072650 2024-04-20T22:12:01.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.863+0000 7fe1d6000640 1 -- 172.21.15.142:0/3474591735 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1c0034670 con 0x7fe1d8072650 2024-04-20T22:12:01.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.863+0000 7fe1de200640 1 -- 172.21.15.142:0/3474591735 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d819ce90 con 0x7fe1d8072650 2024-04-20T22:12:01.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.864+0000 7fe1de200640 1 -- 172.21.15.142:0/3474591735 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d804e890 con 0x7fe1d8072650 2024-04-20T22:12:01.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.865+0000 7fe1d6000640 1 -- 172.21.15.142:0/3474591735 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fe1c0004dd0 con 0x7fe1d8072650 2024-04-20T22:12:01.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.866+0000 7fe1d6000640 1 --2- 172.21.15.142:0/3474591735 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe1b806ecf0 0x7fe1b80711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:01.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.866+0000 7fe1d6000640 1 -- 172.21.15.142:0/3474591735 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fe1c00b1490 con 0x7fe1d8072650 2024-04-20T22:12:01.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.866+0000 7fe1cfe00640 1 --2- 172.21.15.142:0/3474591735 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe1b806ecf0 0x7fe1b80711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:01.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.867+0000 7fe1cfe00640 1 --2- 172.21.15.142:0/3474591735 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe1b806ecf0 0x7fe1b80711b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8199380 tx=0x7fe1c8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:01.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:01.871+0000 7fe1d6000640 1 -- 172.21.15.142:0/3474591735 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fe1c007a160 con 0x7fe1d8072650 2024-04-20T22:12:02.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.118+0000 7fe1de200640 1 -- 172.21.15.142:0/3474591735 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1d8109850 con 0x7fe1d8072650 2024-04-20T22:12:02.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.119+0000 7fe1d6000640 1 -- 172.21.15.142:0/3474591735 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+5237 (secure 0 0 0) 0x7fe1c007d820 con 0x7fe1d8072650 2024-04-20T22:12:02.119 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:02.119 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34486,"name":"cephfs.smithi142.lrvfgg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6829/2960234081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2960234081},{"type":"v1","addr":"172.21.15.142:6829","nonce":2960234081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44319,"name":"cephfs.smithi164.ybvzha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6825/1951894011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951894011},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951894011}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44335,"name":"cephfs.smithi164.gmmrfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6827/3399966592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3399966592},{"type":"v1","addr":"172.21.15.164:6827","nonce":3399966592}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:07:34.267651+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34454":{"gid":34454,"name":"cephfs.smithi142.lirkws","rank":0,"incarnation":31,"state":"up:active","state_seq":26,"addr":"172.21.15.142:6827/2100080187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2100080187},{"type":"v1","addr":"172.21.15.142:6827","nonce":2100080187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34454,"qdb_cluster":[34454]},"id":1}]} 2024-04-20T22:12:02.119 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 35 2024-04-20T22:12:02.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.122+0000 7fe1de200640 1 -- 172.21.15.142:0/3474591735 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe1b806ecf0 msgr2=0x7fe1b80711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:02.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.122+0000 7fe1de200640 1 --2- 172.21.15.142:0/3474591735 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe1b806ecf0 0x7fe1b80711b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8199380 tx=0x7fe1c8008040 comp rx=0 tx=0).stop 2024-04-20T22:12:02.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.122+0000 7fe1de200640 1 -- 172.21.15.142:0/3474591735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1d8072650 msgr2=0x7fe1d8197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:02.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.122+0000 7fe1de200640 1 --2- 172.21.15.142:0/3474591735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1d8072650 0x7fe1d8197d70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0036040 tx=0x7fe1c0004270 comp rx=0 tx=0).stop 2024-04-20T22:12:02.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.122+0000 7fe1de200640 1 -- 172.21.15.142:0/3474591735 shutdown_connections 2024-04-20T22:12:02.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.122+0000 7fe1de200640 1 --2- 172.21.15.142:0/3474591735 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fe1b806ecf0 0x7fe1b80711b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:02.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.122+0000 7fe1de200640 1 --2- 172.21.15.142:0/3474591735 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1d8072f70 0x7fe1d81982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:02.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.122+0000 7fe1de200640 1 --2- 172.21.15.142:0/3474591735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1d8072650 0x7fe1d8197d70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:02.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.122+0000 7fe1de200640 1 -- 172.21.15.142:0/3474591735 >> 172.21.15.142:0/3474591735 conn(0x7fe1d80fb930 msgr2=0x7fe1d8106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:02.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.122+0000 7fe1de200640 1 -- 172.21.15.142:0/3474591735 shutdown_connections 2024-04-20T22:12:02.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.122+0000 7fe1de200640 1 -- 172.21.15.142:0/3474591735 wait complete. 2024-04-20T22:12:02.142 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 12, 'max_mds': 1, 'flags': 18} 2024-04-20T22:12:02.142 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 13 2024-04-20T22:12:02.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.346+0000 7f01cec00640 1 -- 172.21.15.142:0/2238433015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01c81022c0 msgr2=0x7f01c81026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:02.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.346+0000 7f01cec00640 1 --2- 172.21.15.142:0/2238433015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01c81022c0 0x7f01c81026a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009880 tx=0x7f01bc02bce0 comp rx=0 tx=0).stop 2024-04-20T22:12:02.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.346+0000 7f01cec00640 1 -- 172.21.15.142:0/2238433015 shutdown_connections 2024-04-20T22:12:02.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.346+0000 7f01cec00640 1 --2- 172.21.15.142:0/2238433015 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01c8102c70 0x7f01c8106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:02.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.346+0000 7f01cec00640 1 --2- 172.21.15.142:0/2238433015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01c81022c0 0x7f01c81026a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:02.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.346+0000 7f01cec00640 1 -- 172.21.15.142:0/2238433015 >> 172.21.15.142:0/2238433015 conn(0x7f01c80fdb00 msgr2=0x7f01c80fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:02.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.346+0000 7f01cec00640 1 -- 172.21.15.142:0/2238433015 shutdown_connections 2024-04-20T22:12:02.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.346+0000 7f01cec00640 1 -- 172.21.15.142:0/2238433015 wait complete. 2024-04-20T22:12:02.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.347+0000 7f01cec00640 1 Processor -- start 2024-04-20T22:12:02.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.347+0000 7f01cec00640 1 -- start start 2024-04-20T22:12:02.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.348+0000 7f01cec00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01c81022c0 0x7f01c8197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:02.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.348+0000 7f01cec00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01c81982f0 0x7f01c819c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:02.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.348+0000 7f01cec00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c81988f0 con 0x7f01c81982f0 2024-04-20T22:12:02.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.348+0000 7f01cec00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c8198a60 con 0x7f01c81022c0 2024-04-20T22:12:02.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.348+0000 7f01cce00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01c81982f0 0x7f01c819c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:02.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.348+0000 7f01cce00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01c81982f0 0x7f01c819c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46866/0 (socket says 172.21.15.142:46866) 2024-04-20T22:12:02.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.348+0000 7f01cce00640 1 -- 172.21.15.142:0/4294675241 learned_addr learned my addr 172.21.15.142:0/4294675241 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:02.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.348+0000 7f01cce00640 1 -- 172.21.15.142:0/4294675241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01c81022c0 msgr2=0x7f01c8197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:02.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.348+0000 7f01cce00640 1 --2- 172.21.15.142:0/4294675241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01c81022c0 0x7f01c8197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:02.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.349+0000 7f01cce00640 1 -- 172.21.15.142:0/4294675241 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc009560 con 0x7f01c81982f0 2024-04-20T22:12:02.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.349+0000 7f01cce00640 1 --2- 172.21.15.142:0/4294675241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01c81982f0 0x7f01c819c750 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f01b400d6f0 tx=0x7f01b400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:02.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.349+0000 7f01c6000640 1 -- 172.21.15.142:0/4294675241 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01b40051f0 con 0x7f01c81982f0 2024-04-20T22:12:02.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.349+0000 7f01c6000640 1 -- 172.21.15.142:0/4294675241 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f01b4009ce0 con 0x7f01c81982f0 2024-04-20T22:12:02.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.349+0000 7f01cec00640 1 -- 172.21.15.142:0/4294675241 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c819cd50 con 0x7f01c81982f0 2024-04-20T22:12:02.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.349+0000 7f01c6000640 1 -- 172.21.15.142:0/4294675241 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01b4004e80 con 0x7f01c81982f0 2024-04-20T22:12:02.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.349+0000 7f01cec00640 1 -- 172.21.15.142:0/4294675241 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c819d2b0 con 0x7f01c81982f0 2024-04-20T22:12:02.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.350+0000 7f01cec00640 1 -- 172.21.15.142:0/4294675241 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c819d580 con 0x7f01c81982f0 2024-04-20T22:12:02.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.351+0000 7f01c6000640 1 -- 172.21.15.142:0/4294675241 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f01b40046c0 con 0x7f01c81982f0 2024-04-20T22:12:02.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.353+0000 7f01c6000640 1 --2- 172.21.15.142:0/4294675241 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f01b006ec80 0x7f01b0071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:02.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.353+0000 7f01c6000640 1 -- 172.21.15.142:0/4294675241 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f01b408e950 con 0x7f01c81982f0 2024-04-20T22:12:02.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.353+0000 7f01cd800640 1 --2- 172.21.15.142:0/4294675241 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f01b006ec80 0x7f01b0071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:02.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.354+0000 7f01cd800640 1 --2- 172.21.15.142:0/4294675241 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f01b006ec80 0x7f01b0071140 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f01bc02efd0 tx=0x7f01bc000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:02.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.357+0000 7f01c6000640 1 -- 172.21.15.142:0/4294675241 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f01b40575e0 con 0x7f01c81982f0 2024-04-20T22:12:02.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:02 smithi142 ceph-mon[79401]: pgmap v391: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:02.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:02 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1051498280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-20T22:12:02.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:02 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/21675691' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-20T22:12:02.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:02 smithi164 ceph-mon[69784]: pgmap v391: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:02.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:02 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/1051498280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-20T22:12:02.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:02 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/21675691' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-20T22:12:02.601 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.602+0000 7f01cec00640 1 -- 172.21.15.142:0/4294675241 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 13, "format": "json"} v 0) v1 -- 0x7f01c810a5c0 con 0x7f01c81982f0 2024-04-20T22:12:02.603 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.603+0000 7f01c6000640 1 -- 172.21.15.142:0/4294675241 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 13, "format": "json"}]=0 dumped fsmap epoch 13 v35) v1 ==== 107+0+4094 (secure 0 0 0) 0x7f01b4017090 con 0x7f01c81982f0 2024-04-20T22:12:02.603 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:02.603 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14484,"name":"cephfs.smithi142.lrvfgg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.142:6829/3327440588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3327440588},{"type":"v1","addr":"172.21.15.142:6829","nonce":3327440588}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24245,"name":"cephfs.smithi164.ybvzha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.164:6825/4054029190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":4054029190},{"type":"v1","addr":"172.21.15.164:6825","nonce":4054029190}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24253,"name":"cephfs.smithi164.gmmrfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.164:6827/3096926963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3096926963},{"type":"v1","addr":"172.21.15.164:6827","nonce":3096926963}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:05:47.754259+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-20T22:12:02.603 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 13 2024-04-20T22:12:02.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.606+0000 7f01cec00640 1 -- 172.21.15.142:0/4294675241 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f01b006ec80 msgr2=0x7f01b0071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:02.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.606+0000 7f01cec00640 1 --2- 172.21.15.142:0/4294675241 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f01b006ec80 0x7f01b0071140 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f01bc02efd0 tx=0x7f01bc000bc0 comp rx=0 tx=0).stop 2024-04-20T22:12:02.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.606+0000 7f01cec00640 1 -- 172.21.15.142:0/4294675241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01c81982f0 msgr2=0x7f01c819c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:02.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.606+0000 7f01cec00640 1 --2- 172.21.15.142:0/4294675241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01c81982f0 0x7f01c819c750 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f01b400d6f0 tx=0x7f01b400dbb0 comp rx=0 tx=0).stop 2024-04-20T22:12:02.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.606+0000 7f01cec00640 1 -- 172.21.15.142:0/4294675241 shutdown_connections 2024-04-20T22:12:02.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.606+0000 7f01cec00640 1 --2- 172.21.15.142:0/4294675241 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f01b006ec80 0x7f01b0071140 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:02.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.606+0000 7f01cec00640 1 --2- 172.21.15.142:0/4294675241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01c81982f0 0x7f01c819c750 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:02.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.606+0000 7f01cec00640 1 --2- 172.21.15.142:0/4294675241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f01c81022c0 0x7f01c8197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:02.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.606+0000 7f01cec00640 1 -- 172.21.15.142:0/4294675241 >> 172.21.15.142:0/4294675241 conn(0x7f01c80fdb00 msgr2=0x7f01c80ff120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:02.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.606+0000 7f01cec00640 1 -- 172.21.15.142:0/4294675241 shutdown_connections 2024-04-20T22:12:02.606 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.606+0000 7f01cec00640 1 -- 172.21.15.142:0/4294675241 wait complete. 2024-04-20T22:12:02.625 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 14 2024-04-20T22:12:02.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.834+0000 7fd70f200640 1 -- 172.21.15.142:0/501434228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7101000e0 msgr2=0x7fd7101004c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:02.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.834+0000 7fd70f200640 1 --2- 172.21.15.142:0/501434228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7101000e0 0x7fd7101004c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd700009c20 tx=0x7fd70002c1b0 comp rx=0 tx=0).stop 2024-04-20T22:12:02.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.834+0000 7fd70f200640 1 -- 172.21.15.142:0/501434228 shutdown_connections 2024-04-20T22:12:02.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.834+0000 7fd70f200640 1 --2- 172.21.15.142:0/501434228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd710100a90 0x7fd710104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:02.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.834+0000 7fd70f200640 1 --2- 172.21.15.142:0/501434228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7101000e0 0x7fd7101004c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:02.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.834+0000 7fd70f200640 1 -- 172.21.15.142:0/501434228 >> 172.21.15.142:0/501434228 conn(0x7fd7100fb960 msgr2=0x7fd7100fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:02.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.834+0000 7fd70f200640 1 -- 172.21.15.142:0/501434228 shutdown_connections 2024-04-20T22:12:02.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.834+0000 7fd70f200640 1 -- 172.21.15.142:0/501434228 wait complete. 2024-04-20T22:12:02.835 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.835+0000 7fd70f200640 1 Processor -- start 2024-04-20T22:12:02.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.835+0000 7fd70f200640 1 -- start start 2024-04-20T22:12:02.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.836+0000 7fd70f200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7101000e0 0x7fd710197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:02.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.836+0000 7fd70f200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd710198280 0x7fd71019c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:02.837 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.836+0000 7fd70f200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd710198880 con 0x7fd710198280 2024-04-20T22:12:02.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.836+0000 7fd70f200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7101989f0 con 0x7fd7101000e0 2024-04-20T22:12:02.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.836+0000 7fd70d400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd710198280 0x7fd71019c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:02.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.836+0000 7fd70d400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd710198280 0x7fd71019c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46878/0 (socket says 172.21.15.142:46878) 2024-04-20T22:12:02.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.836+0000 7fd70d400640 1 -- 172.21.15.142:0/3547540836 learned_addr learned my addr 172.21.15.142:0/3547540836 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:02.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.836+0000 7fd70d400640 1 -- 172.21.15.142:0/3547540836 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7101000e0 msgr2=0x7fd710197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:02.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.836+0000 7fd70d400640 1 --2- 172.21.15.142:0/3547540836 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7101000e0 0x7fd710197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:02.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.836+0000 7fd70d400640 1 -- 172.21.15.142:0/3547540836 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd700009900 con 0x7fd710198280 2024-04-20T22:12:02.838 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.837+0000 7fd70d400640 1 --2- 172.21.15.142:0/3547540836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd710198280 0x7fd71019c6e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00c920 tx=0x7fd6fc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:02.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.837+0000 7fd706a00640 1 -- 172.21.15.142:0/3547540836 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6fc007b80 con 0x7fd710198280 2024-04-20T22:12:02.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.837+0000 7fd706a00640 1 -- 172.21.15.142:0/3547540836 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6fc007ce0 con 0x7fd710198280 2024-04-20T22:12:02.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.837+0000 7fd706a00640 1 -- 172.21.15.142:0/3547540836 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6fc0187d0 con 0x7fd710198280 2024-04-20T22:12:02.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.837+0000 7fd70f200640 1 -- 172.21.15.142:0/3547540836 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71019cce0 con 0x7fd710198280 2024-04-20T22:12:02.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.837+0000 7fd70f200640 1 -- 172.21.15.142:0/3547540836 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71019d240 con 0x7fd710198280 2024-04-20T22:12:02.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.838+0000 7fd70f200640 1 -- 172.21.15.142:0/3547540836 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71004e890 con 0x7fd710198280 2024-04-20T22:12:02.839 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.839+0000 7fd706a00640 1 -- 172.21.15.142:0/3547540836 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fd6fc00f450 con 0x7fd710198280 2024-04-20T22:12:02.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.840+0000 7fd706a00640 1 --2- 172.21.15.142:0/3547540836 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd6f406ec80 0x7fd6f4071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:02.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.840+0000 7fd706a00640 1 -- 172.21.15.142:0/3547540836 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fd6fc08f060 con 0x7fd710198280 2024-04-20T22:12:02.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.841+0000 7fd70de00640 1 --2- 172.21.15.142:0/3547540836 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd6f406ec80 0x7fd6f4071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:02.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.841+0000 7fd70de00640 1 --2- 172.21.15.142:0/3547540836 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd6f406ec80 0x7fd6f4071140 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd700006010 tx=0x7fd700035be0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:02.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:02.845+0000 7fd706a00640 1 -- 172.21.15.142:0/3547540836 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fd6fc057d90 con 0x7fd710198280 2024-04-20T22:12:03.089 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.090+0000 7fd70f200640 1 -- 172.21.15.142:0/3547540836 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 14, "format": "json"} v 0) v1 -- 0x7fd7101991f0 con 0x7fd710198280 2024-04-20T22:12:03.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.091+0000 7fd706a00640 1 -- 172.21.15.142:0/3547540836 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 14, "format": "json"}]=0 dumped fsmap epoch 14 v35) v1 ==== 107+0+4105 (secure 0 0 0) 0x7fd6fc05b450 con 0x7fd710198280 2024-04-20T22:12:03.091 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:03.091 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24245,"name":"cephfs.smithi164.ybvzha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.164:6825/4054029190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":4054029190},{"type":"v1","addr":"172.21.15.164:6825","nonce":4054029190}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24253,"name":"cephfs.smithi164.gmmrfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.164:6827/3096926963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3096926963},{"type":"v1","addr":"172.21.15.164:6827","nonce":3096926963}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:05:47.764254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi142.lrvfgg","rank":0,"incarnation":14,"state":"up:replay","state_seq":3,"addr":"172.21.15.142:6829/3327440588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3327440588},{"type":"v1","addr":"172.21.15.142:6829","nonce":3327440588}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-20T22:12:03.091 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 14 2024-04-20T22:12:03.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.093+0000 7fd70f200640 1 -- 172.21.15.142:0/3547540836 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd6f406ec80 msgr2=0x7fd6f4071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:03.093 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.093+0000 7fd70f200640 1 --2- 172.21.15.142:0/3547540836 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd6f406ec80 0x7fd6f4071140 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd700006010 tx=0x7fd700035be0 comp rx=0 tx=0).stop 2024-04-20T22:12:03.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.093+0000 7fd70f200640 1 -- 172.21.15.142:0/3547540836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd710198280 msgr2=0x7fd71019c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:03.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.093+0000 7fd70f200640 1 --2- 172.21.15.142:0/3547540836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd710198280 0x7fd71019c6e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00c920 tx=0x7fd6fc00cde0 comp rx=0 tx=0).stop 2024-04-20T22:12:03.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.094+0000 7fd70f200640 1 -- 172.21.15.142:0/3547540836 shutdown_connections 2024-04-20T22:12:03.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.094+0000 7fd70f200640 1 --2- 172.21.15.142:0/3547540836 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd6f406ec80 0x7fd6f4071140 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:03.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.094+0000 7fd70f200640 1 --2- 172.21.15.142:0/3547540836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd710198280 0x7fd71019c6e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:03.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.094+0000 7fd70f200640 1 --2- 172.21.15.142:0/3547540836 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd7101000e0 0x7fd710197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:03.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.094+0000 7fd70f200640 1 -- 172.21.15.142:0/3547540836 >> 172.21.15.142:0/3547540836 conn(0x7fd7100fb960 msgr2=0x7fd7100fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:03.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.094+0000 7fd70f200640 1 -- 172.21.15.142:0/3547540836 shutdown_connections 2024-04-20T22:12:03.094 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.094+0000 7fd70f200640 1 -- 172.21.15.142:0/3547540836 wait complete. 2024-04-20T22:12:03.114 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 15 2024-04-20T22:12:03.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.310+0000 7f09e3600640 1 -- 172.21.15.142:0/895207926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09dc10c6a0 msgr2=0x7f09dc10ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:03.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.310+0000 7f09e3600640 1 --2- 172.21.15.142:0/895207926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09dc10c6a0 0x7f09dc10ca80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f09cc009880 tx=0x7f09cc02bd90 comp rx=0 tx=0).stop 2024-04-20T22:12:03.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.311+0000 7f09e3600640 1 -- 172.21.15.142:0/895207926 shutdown_connections 2024-04-20T22:12:03.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.311+0000 7f09e3600640 1 --2- 172.21.15.142:0/895207926 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09dc1066a0 0x7f09dc106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:03.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.311+0000 7f09e3600640 1 --2- 172.21.15.142:0/895207926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09dc10c6a0 0x7f09dc10ca80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:03.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.311+0000 7f09e3600640 1 -- 172.21.15.142:0/895207926 >> 172.21.15.142:0/895207926 conn(0x7f09dc075e50 msgr2=0x7f09dc078270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:03.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.311+0000 7f09e3600640 1 -- 172.21.15.142:0/895207926 shutdown_connections 2024-04-20T22:12:03.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.311+0000 7f09e3600640 1 -- 172.21.15.142:0/895207926 wait complete. 2024-04-20T22:12:03.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.312+0000 7f09e3600640 1 Processor -- start 2024-04-20T22:12:03.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.312+0000 7f09e3600640 1 -- start start 2024-04-20T22:12:03.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.312+0000 7f09e3600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09dc1066a0 0x7f09dc19c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:03.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.312+0000 7f09e3600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09dc10c6a0 0x7f09dc19c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:03.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.312+0000 7f09e3600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc19cf10 con 0x7f09dc1066a0 2024-04-20T22:12:03.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.312+0000 7f09e3600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc1a0ce0 con 0x7f09dc10c6a0 2024-04-20T22:12:03.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.313+0000 7f09e0c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09dc1066a0 0x7f09dc19c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:03.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.313+0000 7f09e0c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09dc1066a0 0x7f09dc19c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46890/0 (socket says 172.21.15.142:46890) 2024-04-20T22:12:03.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.313+0000 7f09e0c00640 1 -- 172.21.15.142:0/1767691570 learned_addr learned my addr 172.21.15.142:0/1767691570 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:03.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.313+0000 7f09d3e00640 1 --2- 172.21.15.142:0/1767691570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09dc10c6a0 0x7f09dc19c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:03.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.313+0000 7f09e0c00640 1 -- 172.21.15.142:0/1767691570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09dc10c6a0 msgr2=0x7f09dc19c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:03.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.313+0000 7f09e0c00640 1 --2- 172.21.15.142:0/1767691570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09dc10c6a0 0x7f09dc19c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:03.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.313+0000 7f09e0c00640 1 -- 172.21.15.142:0/1767691570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc009560 con 0x7f09dc1066a0 2024-04-20T22:12:03.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.314+0000 7f09e0c00640 1 --2- 172.21.15.142:0/1767691570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09dc1066a0 0x7f09dc19c340 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f09cc036040 tx=0x7f09cc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:03.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.314+0000 7f09da000640 1 -- 172.21.15.142:0/1767691570 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09cc0037c0 con 0x7f09dc1066a0 2024-04-20T22:12:03.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.314+0000 7f09da000640 1 -- 172.21.15.142:0/1767691570 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f09cc003de0 con 0x7f09dc1066a0 2024-04-20T22:12:03.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.314+0000 7f09da000640 1 -- 172.21.15.142:0/1767691570 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09cc03e450 con 0x7f09dc1066a0 2024-04-20T22:12:03.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.314+0000 7f09e3600640 1 -- 172.21.15.142:0/1767691570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09dc1a0f60 con 0x7f09dc1066a0 2024-04-20T22:12:03.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.314+0000 7f09e3600640 1 -- 172.21.15.142:0/1767691570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09dc1a1470 con 0x7f09dc1066a0 2024-04-20T22:12:03.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.315+0000 7f09e3600640 1 -- 172.21.15.142:0/1767691570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09dc04e040 con 0x7f09dc1066a0 2024-04-20T22:12:03.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.317+0000 7f09da000640 1 -- 172.21.15.142:0/1767691570 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f09cc004fd0 con 0x7f09dc1066a0 2024-04-20T22:12:03.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.317+0000 7f09da000640 1 --2- 172.21.15.142:0/1767691570 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f09c006ecf0 0x7f09c00711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:03.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.318+0000 7f09da000640 1 -- 172.21.15.142:0/1767691570 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f09cc0b1cd0 con 0x7f09dc1066a0 2024-04-20T22:12:03.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.318+0000 7f09d3e00640 1 --2- 172.21.15.142:0/1767691570 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f09c006ecf0 0x7f09c00711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:03.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.319+0000 7f09d3e00640 1 --2- 172.21.15.142:0/1767691570 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f09c006ecf0 0x7f09c00711b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f09dc19d950 tx=0x7f09c4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:03.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.324+0000 7f09da000640 1 -- 172.21.15.142:0/1767691570 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f09cc07a8e0 con 0x7f09dc1066a0 2024-04-20T22:12:03.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:03 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3474591735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T22:12:03.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:03 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/4294675241' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 13, "format": "json"}]: dispatch 2024-04-20T22:12:03.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:03 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3547540836' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-04-20T22:12:03.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:03 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3474591735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T22:12:03.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:03 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/4294675241' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 13, "format": "json"}]: dispatch 2024-04-20T22:12:03.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:03 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3547540836' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-04-20T22:12:03.565 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.565+0000 7f09e3600640 1 -- 172.21.15.142:0/1767691570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7f09dc19d690 con 0x7f09dc1066a0 2024-04-20T22:12:03.566 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.567+0000 7f09da000640 1 -- 172.21.15.142:0/1767691570 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v35) v1 ==== 107+0+4110 (secure 0 0 0) 0x7f09cc07dfa0 con 0x7f09dc1066a0 2024-04-20T22:12:03.567 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:03.567 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24245,"name":"cephfs.smithi164.ybvzha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.164:6825/4054029190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":4054029190},{"type":"v1","addr":"172.21.15.164:6825","nonce":4054029190}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24253,"name":"cephfs.smithi164.gmmrfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.164:6827/3096926963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3096926963},{"type":"v1","addr":"172.21.15.164:6827","nonce":3096926963}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:05:56.380045+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi142.lrvfgg","rank":0,"incarnation":14,"state":"up:reconnect","state_seq":170,"addr":"172.21.15.142:6829/3327440588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3327440588},{"type":"v1","addr":"172.21.15.142:6829","nonce":3327440588}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-20T22:12:03.567 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 15 2024-04-20T22:12:03.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.569+0000 7f09e3600640 1 -- 172.21.15.142:0/1767691570 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f09c006ecf0 msgr2=0x7f09c00711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:03.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.569+0000 7f09e3600640 1 --2- 172.21.15.142:0/1767691570 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f09c006ecf0 0x7f09c00711b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f09dc19d950 tx=0x7f09c4008040 comp rx=0 tx=0).stop 2024-04-20T22:12:03.569 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.569+0000 7f09e3600640 1 -- 172.21.15.142:0/1767691570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09dc1066a0 msgr2=0x7f09dc19c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:03.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.569+0000 7f09e3600640 1 --2- 172.21.15.142:0/1767691570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09dc1066a0 0x7f09dc19c340 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f09cc036040 tx=0x7f09cc004270 comp rx=0 tx=0).stop 2024-04-20T22:12:03.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.570+0000 7f09e3600640 1 -- 172.21.15.142:0/1767691570 shutdown_connections 2024-04-20T22:12:03.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.570+0000 7f09e3600640 1 --2- 172.21.15.142:0/1767691570 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f09c006ecf0 0x7f09c00711b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:03.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.570+0000 7f09e3600640 1 --2- 172.21.15.142:0/1767691570 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09dc10c6a0 0x7f09dc19c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:03.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.570+0000 7f09e3600640 1 --2- 172.21.15.142:0/1767691570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09dc1066a0 0x7f09dc19c340 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:03.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.570+0000 7f09e3600640 1 -- 172.21.15.142:0/1767691570 >> 172.21.15.142:0/1767691570 conn(0x7f09dc075e50 msgr2=0x7f09dc077910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:03.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.570+0000 7f09e3600640 1 -- 172.21.15.142:0/1767691570 shutdown_connections 2024-04-20T22:12:03.570 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.570+0000 7f09e3600640 1 -- 172.21.15.142:0/1767691570 wait complete. 2024-04-20T22:12:03.588 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-04-20T22:12:03.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.777+0000 7fdb65c00640 1 -- 172.21.15.142:0/1085620145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb60100aa0 msgr2=0x7fdb60104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:03.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.777+0000 7fdb65c00640 1 --2- 172.21.15.142:0/1085620145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb60100aa0 0x7fdb60104ae0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009880 tx=0x7fdb4c02bcf0 comp rx=0 tx=0).stop 2024-04-20T22:12:03.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.777+0000 7fdb65c00640 1 -- 172.21.15.142:0/1085620145 shutdown_connections 2024-04-20T22:12:03.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.777+0000 7fdb65c00640 1 --2- 172.21.15.142:0/1085620145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb60100aa0 0x7fdb60104ae0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:03.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.777+0000 7fdb65c00640 1 --2- 172.21.15.142:0/1085620145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb601000f0 0x7fdb601004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:03.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.777+0000 7fdb65c00640 1 -- 172.21.15.142:0/1085620145 >> 172.21.15.142:0/1085620145 conn(0x7fdb600fb970 msgr2=0x7fdb600fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:03.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.777+0000 7fdb65c00640 1 -- 172.21.15.142:0/1085620145 shutdown_connections 2024-04-20T22:12:03.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.777+0000 7fdb65c00640 1 -- 172.21.15.142:0/1085620145 wait complete. 2024-04-20T22:12:03.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.778+0000 7fdb65c00640 1 Processor -- start 2024-04-20T22:12:03.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.778+0000 7fdb65c00640 1 -- start start 2024-04-20T22:12:03.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.779+0000 7fdb65c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb601000f0 0x7fdb60197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:03.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.779+0000 7fdb65c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb60198390 0x7fdb6019c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:03.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.779+0000 7fdb65c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb60198900 con 0x7fdb60198390 2024-04-20T22:12:03.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.779+0000 7fdb65c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb60198a70 con 0x7fdb601000f0 2024-04-20T22:12:03.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.779+0000 7fdb5f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb60198390 0x7fdb6019c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:03.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.779+0000 7fdb5f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb60198390 0x7fdb6019c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46904/0 (socket says 172.21.15.142:46904) 2024-04-20T22:12:03.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.779+0000 7fdb5f400640 1 -- 172.21.15.142:0/998824928 learned_addr learned my addr 172.21.15.142:0/998824928 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:03.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.779+0000 7fdb5fe00640 1 --2- 172.21.15.142:0/998824928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb601000f0 0x7fdb60197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:03.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.779+0000 7fdb5f400640 1 -- 172.21.15.142:0/998824928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb601000f0 msgr2=0x7fdb60197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:03.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.779+0000 7fdb5f400640 1 --2- 172.21.15.142:0/998824928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb601000f0 0x7fdb60197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:03.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.779+0000 7fdb5f400640 1 -- 172.21.15.142:0/998824928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c009560 con 0x7fdb60198390 2024-04-20T22:12:03.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.780+0000 7fdb5f400640 1 --2- 172.21.15.142:0/998824928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb60198390 0x7fdb6019c7f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009230 tx=0x7fdb4c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:03.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.780+0000 7fdb5cc00640 1 -- 172.21.15.142:0/998824928 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb4c0037c0 con 0x7fdb60198390 2024-04-20T22:12:03.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.780+0000 7fdb5cc00640 1 -- 172.21.15.142:0/998824928 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb4c003de0 con 0x7fdb60198390 2024-04-20T22:12:03.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.780+0000 7fdb5cc00640 1 -- 172.21.15.142:0/998824928 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb4c03e460 con 0x7fdb60198390 2024-04-20T22:12:03.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.780+0000 7fdb65c00640 1 -- 172.21.15.142:0/998824928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6019cd90 con 0x7fdb60198390 2024-04-20T22:12:03.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.780+0000 7fdb65c00640 1 -- 172.21.15.142:0/998824928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6019d250 con 0x7fdb60198390 2024-04-20T22:12:03.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.781+0000 7fdb65c00640 1 -- 172.21.15.142:0/998824928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6004e040 con 0x7fdb60198390 2024-04-20T22:12:03.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.782+0000 7fdb5cc00640 1 -- 172.21.15.142:0/998824928 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fdb4c004fd0 con 0x7fdb60198390 2024-04-20T22:12:03.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.783+0000 7fdb5cc00640 1 --2- 172.21.15.142:0/998824928 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdb4406ec30 0x7fdb440710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:03.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.784+0000 7fdb5cc00640 1 -- 172.21.15.142:0/998824928 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fdb4c0b18d0 con 0x7fdb60198390 2024-04-20T22:12:03.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.784+0000 7fdb5fe00640 1 --2- 172.21.15.142:0/998824928 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdb4406ec30 0x7fdb440710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:03.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.784+0000 7fdb5fe00640 1 --2- 172.21.15.142:0/998824928 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdb4406ec30 0x7fdb440710f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdb50008d20 tx=0x7fdb500082b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:03.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:03.788+0000 7fdb5cc00640 1 -- 172.21.15.142:0/998824928 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fdb4c07a580 con 0x7fdb60198390 2024-04-20T22:12:04.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.030+0000 7fdb65c00640 1 -- 172.21.15.142:0/998824928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7fdb601041d0 con 0x7fdb60198390 2024-04-20T22:12:04.031 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.032+0000 7fdb5cc00640 1 -- 172.21.15.142:0/998824928 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v35) v1 ==== 107+0+4107 (secure 0 0 0) 0x7fdb4c07dc40 con 0x7fdb60198390 2024-04-20T22:12:04.032 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:04.032 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24245,"name":"cephfs.smithi164.ybvzha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.164:6825/4054029190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":4054029190},{"type":"v1","addr":"172.21.15.164:6825","nonce":4054029190}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24253,"name":"cephfs.smithi164.gmmrfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.164:6827/3096926963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3096926963},{"type":"v1","addr":"172.21.15.164:6827","nonce":3096926963}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:05:56.820793+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi142.lrvfgg","rank":0,"incarnation":14,"state":"up:rejoin","state_seq":171,"addr":"172.21.15.142:6829/3327440588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3327440588},{"type":"v1","addr":"172.21.15.142:6829","nonce":3327440588}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-20T22:12:04.032 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 16 2024-04-20T22:12:04.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.035+0000 7fdb65c00640 1 -- 172.21.15.142:0/998824928 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdb4406ec30 msgr2=0x7fdb440710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:04.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.035+0000 7fdb65c00640 1 --2- 172.21.15.142:0/998824928 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdb4406ec30 0x7fdb440710f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdb50008d20 tx=0x7fdb500082b0 comp rx=0 tx=0).stop 2024-04-20T22:12:04.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.035+0000 7fdb65c00640 1 -- 172.21.15.142:0/998824928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb60198390 msgr2=0x7fdb6019c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:04.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.035+0000 7fdb65c00640 1 --2- 172.21.15.142:0/998824928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb60198390 0x7fdb6019c7f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009230 tx=0x7fdb4c004270 comp rx=0 tx=0).stop 2024-04-20T22:12:04.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.035+0000 7fdb65c00640 1 -- 172.21.15.142:0/998824928 shutdown_connections 2024-04-20T22:12:04.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.035+0000 7fdb65c00640 1 --2- 172.21.15.142:0/998824928 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fdb4406ec30 0x7fdb440710f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:04.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.035+0000 7fdb65c00640 1 --2- 172.21.15.142:0/998824928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb60198390 0x7fdb6019c7f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:04.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.035+0000 7fdb65c00640 1 --2- 172.21.15.142:0/998824928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb601000f0 0x7fdb60197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:04.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.035+0000 7fdb65c00640 1 -- 172.21.15.142:0/998824928 >> 172.21.15.142:0/998824928 conn(0x7fdb600fb970 msgr2=0x7fdb600fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:04.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.035+0000 7fdb65c00640 1 -- 172.21.15.142:0/998824928 shutdown_connections 2024-04-20T22:12:04.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.036+0000 7fdb65c00640 1 -- 172.21.15.142:0/998824928 wait complete. 2024-04-20T22:12:04.054 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-04-20T22:12:04.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.257+0000 7fafdde00640 1 -- 172.21.15.142:0/3119936251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafd8100c20 msgr2=0x7fafd8104c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:04.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.257+0000 7fafdde00640 1 --2- 172.21.15.142:0/3119936251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafd8100c20 0x7fafd8104c60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009880 tx=0x7fafc002bce0 comp rx=0 tx=0).stop 2024-04-20T22:12:04.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.257+0000 7fafdde00640 1 -- 172.21.15.142:0/3119936251 shutdown_connections 2024-04-20T22:12:04.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.257+0000 7fafdde00640 1 --2- 172.21.15.142:0/3119936251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafd8100c20 0x7fafd8104c60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:04.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.257+0000 7fafdde00640 1 --2- 172.21.15.142:0/3119936251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafd8100270 0x7fafd8100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:04.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.257+0000 7fafdde00640 1 -- 172.21.15.142:0/3119936251 >> 172.21.15.142:0/3119936251 conn(0x7fafd80fbad0 msgr2=0x7fafd80fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:04.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.257+0000 7fafdde00640 1 -- 172.21.15.142:0/3119936251 shutdown_connections 2024-04-20T22:12:04.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.257+0000 7fafdde00640 1 -- 172.21.15.142:0/3119936251 wait complete. 2024-04-20T22:12:04.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.258+0000 7fafdde00640 1 Processor -- start 2024-04-20T22:12:04.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.259+0000 7fafdde00640 1 -- start start 2024-04-20T22:12:04.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.259+0000 7fafdde00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafd8100270 0x7fafd8197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:04.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.259+0000 7fafdde00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafd8198420 0x7fafd819c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:04.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.259+0000 7fafdde00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd8198a20 con 0x7fafd8100270 2024-04-20T22:12:04.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.259+0000 7fafdde00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd8198b90 con 0x7fafd8198420 2024-04-20T22:12:04.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.259+0000 7fafd6a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafd8100270 0x7fafd8197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:04.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.259+0000 7fafd6a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafd8100270 0x7fafd8197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46908/0 (socket says 172.21.15.142:46908) 2024-04-20T22:12:04.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.259+0000 7fafd6a00640 1 -- 172.21.15.142:0/1403613394 learned_addr learned my addr 172.21.15.142:0/1403613394 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:04.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.260+0000 7fafd6a00640 1 -- 172.21.15.142:0/1403613394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafd8198420 msgr2=0x7fafd819c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:04.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.260+0000 7fafce000640 1 --2- 172.21.15.142:0/1403613394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafd8198420 0x7fafd819c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:04.260 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.260+0000 7fafd6a00640 1 --2- 172.21.15.142:0/1403613394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafd8198420 0x7fafd819c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:04.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.260+0000 7fafd6a00640 1 -- 172.21.15.142:0/1403613394 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc0009560 con 0x7fafd8100270 2024-04-20T22:12:04.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.260+0000 7fafd6a00640 1 --2- 172.21.15.142:0/1403613394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafd8100270 0x7fafd8197ee0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fafc800d720 tx=0x7fafc800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:04.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.260+0000 7fafdca00640 1 -- 172.21.15.142:0/1403613394 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafc80051f0 con 0x7fafd8100270 2024-04-20T22:12:04.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.260+0000 7fafdca00640 1 -- 172.21.15.142:0/1403613394 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fafc8009ce0 con 0x7fafd8100270 2024-04-20T22:12:04.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.260+0000 7fafdca00640 1 -- 172.21.15.142:0/1403613394 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafc8010460 con 0x7fafd8100270 2024-04-20T22:12:04.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.260+0000 7fafdde00640 1 -- 172.21.15.142:0/1403613394 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd819ce80 con 0x7fafd8100270 2024-04-20T22:12:04.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.260+0000 7fafdde00640 1 -- 172.21.15.142:0/1403613394 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd819d3e0 con 0x7fafd8100270 2024-04-20T22:12:04.261 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.262+0000 7fafdde00640 1 -- 172.21.15.142:0/1403613394 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd819d6b0 con 0x7fafd8100270 2024-04-20T22:12:04.262 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.263+0000 7fafdca00640 1 -- 172.21.15.142:0/1403613394 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fafc8005350 con 0x7fafd8100270 2024-04-20T22:12:04.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.263+0000 7fafdca00640 1 --2- 172.21.15.142:0/1403613394 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fafbc06ecf0 0x7fafbc0711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:04.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.264+0000 7fafdca00640 1 -- 172.21.15.142:0/1403613394 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fafc808ea60 con 0x7fafd8100270 2024-04-20T22:12:04.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.264+0000 7fafce000640 1 --2- 172.21.15.142:0/1403613394 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fafbc06ecf0 0x7fafbc0711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:04.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.265+0000 7fafce000640 1 --2- 172.21.15.142:0/1403613394 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fafbc06ecf0 0x7fafbc0711b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fafc0036040 tx=0x7fafc0005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:04.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.269+0000 7fafdca00640 1 -- 172.21.15.142:0/1403613394 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fafc8057790 con 0x7fafd8100270 2024-04-20T22:12:04.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:04 smithi164 ceph-mon[69784]: pgmap v392: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:04.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:04 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/1767691570' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-04-20T22:12:04.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:04 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/998824928' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-04-20T22:12:04.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:04 smithi142 ceph-mon[79401]: pgmap v392: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:04.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:04 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1767691570' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-04-20T22:12:04.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:04 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/998824928' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-04-20T22:12:04.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.514+0000 7fafdde00640 1 -- 172.21.15.142:0/1403613394 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7fafd804e040 con 0x7fafd8100270 2024-04-20T22:12:04.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.516+0000 7fafdca00640 1 -- 172.21.15.142:0/1403613394 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v35) v1 ==== 107+0+4116 (secure 0 0 0) 0x7fafc8017090 con 0x7fafd8100270 2024-04-20T22:12:04.515 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:04.516 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24245,"name":"cephfs.smithi164.ybvzha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.164:6825/4054029190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":4054029190},{"type":"v1","addr":"172.21.15.164:6825","nonce":4054029190}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24253,"name":"cephfs.smithi164.gmmrfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.164:6827/3096926963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3096926963},{"type":"v1","addr":"172.21.15.164:6827","nonce":3096926963}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:05:58.826420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi142.lrvfgg","rank":0,"incarnation":14,"state":"up:active","state_seq":172,"addr":"172.21.15.142:6829/3327440588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3327440588},{"type":"v1","addr":"172.21.15.142:6829","nonce":3327440588}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14484,"qdb_cluster":[14484]},"id":1}]} 2024-04-20T22:12:04.516 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 17 2024-04-20T22:12:04.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.518+0000 7fafdde00640 1 -- 172.21.15.142:0/1403613394 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fafbc06ecf0 msgr2=0x7fafbc0711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:04.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.518+0000 7fafdde00640 1 --2- 172.21.15.142:0/1403613394 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fafbc06ecf0 0x7fafbc0711b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fafc0036040 tx=0x7fafc0005fd0 comp rx=0 tx=0).stop 2024-04-20T22:12:04.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.518+0000 7fafdde00640 1 -- 172.21.15.142:0/1403613394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafd8100270 msgr2=0x7fafd8197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:04.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.518+0000 7fafdde00640 1 --2- 172.21.15.142:0/1403613394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafd8100270 0x7fafd8197ee0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fafc800d720 tx=0x7fafc800dbe0 comp rx=0 tx=0).stop 2024-04-20T22:12:04.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.519+0000 7fafdde00640 1 -- 172.21.15.142:0/1403613394 shutdown_connections 2024-04-20T22:12:04.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.519+0000 7fafdde00640 1 --2- 172.21.15.142:0/1403613394 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fafbc06ecf0 0x7fafbc0711b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:04.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.519+0000 7fafdde00640 1 --2- 172.21.15.142:0/1403613394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fafd8198420 0x7fafd819c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:04.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.519+0000 7fafdde00640 1 --2- 172.21.15.142:0/1403613394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafd8100270 0x7fafd8197ee0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:04.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.519+0000 7fafdde00640 1 -- 172.21.15.142:0/1403613394 >> 172.21.15.142:0/1403613394 conn(0x7fafd80fbad0 msgr2=0x7fafd80fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:04.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.519+0000 7fafdde00640 1 -- 172.21.15.142:0/1403613394 shutdown_connections 2024-04-20T22:12:04.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.519+0000 7fafdde00640 1 -- 172.21.15.142:0/1403613394 wait complete. 2024-04-20T22:12:04.536 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-04-20T22:12:04.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.738+0000 7f5254600640 1 -- 172.21.15.142:0/2579584920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f524c102e50 msgr2=0x7f524c106e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:04.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.738+0000 7f5254600640 1 --2- 172.21.15.142:0/2579584920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f524c102e50 0x7f524c106e90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5238009880 tx=0x7f523802bcf0 comp rx=0 tx=0).stop 2024-04-20T22:12:04.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.738+0000 7f5254600640 1 -- 172.21.15.142:0/2579584920 shutdown_connections 2024-04-20T22:12:04.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.738+0000 7f5254600640 1 --2- 172.21.15.142:0/2579584920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f524c102e50 0x7f524c106e90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:04.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.738+0000 7f5254600640 1 --2- 172.21.15.142:0/2579584920 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f524c1024a0 0x7f524c102880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:04.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.738+0000 7f5254600640 1 -- 172.21.15.142:0/2579584920 >> 172.21.15.142:0/2579584920 conn(0x7f524c0fdd00 msgr2=0x7f524c100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:04.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.738+0000 7f5254600640 1 -- 172.21.15.142:0/2579584920 shutdown_connections 2024-04-20T22:12:04.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.738+0000 7f5254600640 1 -- 172.21.15.142:0/2579584920 wait complete. 2024-04-20T22:12:04.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.739+0000 7f5254600640 1 Processor -- start 2024-04-20T22:12:04.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.740+0000 7f5254600640 1 -- start start 2024-04-20T22:12:04.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.740+0000 7f5254600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f524c1024a0 0x7f524c197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:04.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.740+0000 7f5254600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f524c198440 0x7f524c19c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:04.740 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.740+0000 7f5254600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c1989b0 con 0x7f524c198440 2024-04-20T22:12:04.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.740+0000 7f5254600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c198b20 con 0x7f524c1024a0 2024-04-20T22:12:04.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.740+0000 7f5251200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f524c198440 0x7f524c19c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:04.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.740+0000 7f5251200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f524c198440 0x7f524c19c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46926/0 (socket says 172.21.15.142:46926) 2024-04-20T22:12:04.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.740+0000 7f5251200640 1 -- 172.21.15.142:0/2206699451 learned_addr learned my addr 172.21.15.142:0/2206699451 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:04.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.741+0000 7f5251c00640 1 --2- 172.21.15.142:0/2206699451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f524c1024a0 0x7f524c197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:04.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.741+0000 7f5251200640 1 -- 172.21.15.142:0/2206699451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f524c1024a0 msgr2=0x7f524c197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:04.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.741+0000 7f5251200640 1 --2- 172.21.15.142:0/2206699451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f524c1024a0 0x7f524c197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:04.741 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.741+0000 7f5251200640 1 -- 172.21.15.142:0/2206699451 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5238009560 con 0x7f524c198440 2024-04-20T22:12:04.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.741+0000 7f5251200640 1 --2- 172.21.15.142:0/2206699451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f524c198440 0x7f524c19c8a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5238009230 tx=0x7f5238004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:04.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.742+0000 7f524a000640 1 -- 172.21.15.142:0/2206699451 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52380037c0 con 0x7f524c198440 2024-04-20T22:12:04.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.742+0000 7f524a000640 1 -- 172.21.15.142:0/2206699451 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5238003de0 con 0x7f524c198440 2024-04-20T22:12:04.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.742+0000 7f524a000640 1 -- 172.21.15.142:0/2206699451 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f523803e460 con 0x7f524c198440 2024-04-20T22:12:04.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.742+0000 7f5254600640 1 -- 172.21.15.142:0/2206699451 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524c19ce40 con 0x7f524c198440 2024-04-20T22:12:04.742 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.742+0000 7f5254600640 1 -- 172.21.15.142:0/2206699451 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524c19d350 con 0x7f524c198440 2024-04-20T22:12:04.743 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.743+0000 7f5254600640 1 -- 172.21.15.142:0/2206699451 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524c04e040 con 0x7f524c198440 2024-04-20T22:12:04.744 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.744+0000 7f524a000640 1 -- 172.21.15.142:0/2206699451 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f5238004fd0 con 0x7f524c198440 2024-04-20T22:12:04.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.745+0000 7f524a000640 1 --2- 172.21.15.142:0/2206699451 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f523006ecf0 0x7f52300711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:04.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.745+0000 7f524a000640 1 -- 172.21.15.142:0/2206699451 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f52380b17e0 con 0x7f524c198440 2024-04-20T22:12:04.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.746+0000 7f5251c00640 1 --2- 172.21.15.142:0/2206699451 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f523006ecf0 0x7f52300711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:04.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.747+0000 7f5251c00640 1 --2- 172.21.15.142:0/2206699451 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f523006ecf0 0x7f52300711b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f523c007350 tx=0x7f523c0072e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:04.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.750+0000 7f524a000640 1 -- 172.21.15.142:0/2206699451 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f523807a510 con 0x7f524c198440 2024-04-20T22:12:04.995 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.996+0000 7f5254600640 1 -- 172.21.15.142:0/2206699451 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f524c102e50 con 0x7f524c198440 2024-04-20T22:12:04.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:04.998+0000 7f524a000640 1 -- 172.21.15.142:0/2206699451 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v35) v1 ==== 107+0+4966 (secure 0 0 0) 0x7f523807dbd0 con 0x7f524c198440 2024-04-20T22:12:04.997 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:04.998 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24245,"name":"cephfs.smithi164.ybvzha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.164:6825/4054029190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":4054029190},{"type":"v1","addr":"172.21.15.164:6825","nonce":4054029190}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24253,"name":"cephfs.smithi164.gmmrfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.164:6827/3096926963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3096926963},{"type":"v1","addr":"172.21.15.164:6827","nonce":3096926963}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":34454,"name":"cephfs.smithi142.lirkws","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2100080187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2100080187},{"type":"v1","addr":"172.21.15.142:6827","nonce":2100080187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:05:58.826420+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi142.lrvfgg","rank":0,"incarnation":14,"state":"up:active","state_seq":172,"addr":"172.21.15.142:6829/3327440588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":3327440588},{"type":"v1","addr":"172.21.15.142:6829","nonce":3327440588}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14484,"qdb_cluster":[14484]},"id":1}]} 2024-04-20T22:12:04.998 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 18 2024-04-20T22:12:05.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.000+0000 7f5254600640 1 -- 172.21.15.142:0/2206699451 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f523006ecf0 msgr2=0x7f52300711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:05.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.000+0000 7f5254600640 1 --2- 172.21.15.142:0/2206699451 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f523006ecf0 0x7f52300711b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f523c007350 tx=0x7f523c0072e0 comp rx=0 tx=0).stop 2024-04-20T22:12:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.001+0000 7f5254600640 1 -- 172.21.15.142:0/2206699451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f524c198440 msgr2=0x7f524c19c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.001+0000 7f5254600640 1 --2- 172.21.15.142:0/2206699451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f524c198440 0x7f524c19c8a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5238009230 tx=0x7f5238004270 comp rx=0 tx=0).stop 2024-04-20T22:12:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.001+0000 7f5254600640 1 -- 172.21.15.142:0/2206699451 shutdown_connections 2024-04-20T22:12:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.001+0000 7f5254600640 1 --2- 172.21.15.142:0/2206699451 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f523006ecf0 0x7f52300711b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.001+0000 7f5254600640 1 --2- 172.21.15.142:0/2206699451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f524c198440 0x7f524c19c8a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.001+0000 7f5254600640 1 --2- 172.21.15.142:0/2206699451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f524c1024a0 0x7f524c197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.001+0000 7f5254600640 1 -- 172.21.15.142:0/2206699451 >> 172.21.15.142:0/2206699451 conn(0x7f524c0fdd00 msgr2=0x7f524c100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.001+0000 7f5254600640 1 -- 172.21.15.142:0/2206699451 shutdown_connections 2024-04-20T22:12:05.001 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.001+0000 7f5254600640 1 -- 172.21.15.142:0/2206699451 wait complete. 2024-04-20T22:12:05.020 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-04-20T22:12:05.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.220+0000 7f7fde800640 1 -- 172.21.15.142:0/1604922715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fd8101ae0 msgr2=0x7f7fd8109fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:05.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.220+0000 7f7fde800640 1 --2- 172.21.15.142:0/1604922715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fd8101ae0 0x7f7fd8109fc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009880 tx=0x7f7fc002bd90 comp rx=0 tx=0).stop 2024-04-20T22:12:05.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.220+0000 7f7fde800640 1 -- 172.21.15.142:0/1604922715 shutdown_connections 2024-04-20T22:12:05.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.220+0000 7f7fde800640 1 --2- 172.21.15.142:0/1604922715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fd8101ae0 0x7f7fd8109fc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:05.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.220+0000 7f7fde800640 1 --2- 172.21.15.142:0/1604922715 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fd81011c0 0x7f7fd81015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:05.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.220+0000 7f7fde800640 1 -- 172.21.15.142:0/1604922715 >> 172.21.15.142:0/1604922715 conn(0x7f7fd80fa9c0 msgr2=0x7f7fd80fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:05.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.220+0000 7f7fde800640 1 -- 172.21.15.142:0/1604922715 shutdown_connections 2024-04-20T22:12:05.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.220+0000 7f7fde800640 1 -- 172.21.15.142:0/1604922715 wait complete. 2024-04-20T22:12:05.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.221+0000 7f7fde800640 1 Processor -- start 2024-04-20T22:12:05.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.221+0000 7f7fde800640 1 -- start start 2024-04-20T22:12:05.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.221+0000 7f7fde800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fd81011c0 0x7f7fd8197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:05.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.221+0000 7f7fde800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fd8101ae0 0x7f7fd8198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.221+0000 7f7fde800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd8198a10 con 0x7f7fd81011c0 2024-04-20T22:12:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.221+0000 7f7fde800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd819c7e0 con 0x7f7fd8101ae0 2024-04-20T22:12:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.222+0000 7f7fd7400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fd81011c0 0x7f7fd8197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.222+0000 7f7fd7400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fd81011c0 0x7f7fd8197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46936/0 (socket says 172.21.15.142:46936) 2024-04-20T22:12:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.222+0000 7f7fd7400640 1 -- 172.21.15.142:0/3456695488 learned_addr learned my addr 172.21.15.142:0/3456695488 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.222+0000 7f7fcea00640 1 --2- 172.21.15.142:0/3456695488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fd8101ae0 0x7f7fd8198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.222+0000 7f7fd7400640 1 -- 172.21.15.142:0/3456695488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fd8101ae0 msgr2=0x7f7fd8198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.222+0000 7f7fd7400640 1 --2- 172.21.15.142:0/3456695488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fd8101ae0 0x7f7fd8198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.222+0000 7f7fd7400640 1 -- 172.21.15.142:0/3456695488 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc0009560 con 0x7f7fd81011c0 2024-04-20T22:12:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.222+0000 7f7fcea00640 1 --2- 172.21.15.142:0/3456695488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fd8101ae0 0x7f7fd8198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:12:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.222+0000 7f7fd7400640 1 --2- 172.21.15.142:0/3456695488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fd81011c0 0x7f7fd8197e40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800d6f0 tx=0x7f7fc800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.223+0000 7f7fd4c00640 1 -- 172.21.15.142:0/3456695488 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fc8009a30 con 0x7f7fd81011c0 2024-04-20T22:12:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.223+0000 7f7fd4c00640 1 -- 172.21.15.142:0/3456695488 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7fc80054e0 con 0x7f7fd81011c0 2024-04-20T22:12:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.223+0000 7f7fde800640 1 -- 172.21.15.142:0/3456695488 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd819cac0 con 0x7f7fd81011c0 2024-04-20T22:12:05.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.223+0000 7f7fd4c00640 1 -- 172.21.15.142:0/3456695488 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fc8010460 con 0x7f7fd81011c0 2024-04-20T22:12:05.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.223+0000 7f7fde800640 1 -- 172.21.15.142:0/3456695488 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd819d020 con 0x7f7fd81011c0 2024-04-20T22:12:05.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.224+0000 7f7fde800640 1 -- 172.21.15.142:0/3456695488 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd804e040 con 0x7f7fd81011c0 2024-04-20T22:12:05.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.225+0000 7f7fd4c00640 1 -- 172.21.15.142:0/3456695488 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f7fc8009b90 con 0x7f7fd81011c0 2024-04-20T22:12:05.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.226+0000 7f7fd4c00640 1 --2- 172.21.15.142:0/3456695488 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7fbc06ecf0 0x7f7fbc0711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:05.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.226+0000 7f7fd4c00640 1 -- 172.21.15.142:0/3456695488 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f7fc808eb10 con 0x7f7fd81011c0 2024-04-20T22:12:05.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.227+0000 7f7fcea00640 1 --2- 172.21.15.142:0/3456695488 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7fbc06ecf0 0x7f7fbc0711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:05.226 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.227+0000 7f7fcea00640 1 --2- 172.21.15.142:0/3456695488 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7fbc06ecf0 0x7f7fbc0711b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7fc002c950 tx=0x7f7fc0005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:05.231 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.232+0000 7f7fd4c00640 1 -- 172.21.15.142:0/3456695488 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f7fc80577c0 con 0x7f7fd81011c0 2024-04-20T22:12:05.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:05 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1403613394' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-20T22:12:05.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:05 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2206699451' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-20T22:12:05.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:05 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/1403613394' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-20T22:12:05.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:05 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/2206699451' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-20T22:12:05.475 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.475+0000 7f7fde800640 1 -- 172.21.15.142:0/3456695488 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f7fd810d2a0 con 0x7f7fd81011c0 2024-04-20T22:12:05.476 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.476+0000 7f7fd4c00640 1 -- 172.21.15.142:0/3456695488 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v35) v1 ==== 107+0+4162 (secure 0 0 0) 0x7f7fc8017090 con 0x7f7fd81011c0 2024-04-20T22:12:05.476 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:05.476 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24245,"name":"cephfs.smithi164.ybvzha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.164:6825/4054029190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":4054029190},{"type":"v1","addr":"172.21.15.164:6825","nonce":4054029190}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24253,"name":"cephfs.smithi164.gmmrfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.164:6827/3096926963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3096926963},{"type":"v1","addr":"172.21.15.164:6827","nonce":3096926963}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":34454,"name":"cephfs.smithi142.lirkws","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2100080187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2100080187},{"type":"v1","addr":"172.21.15.142:6827","nonce":2100080187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:06:21.702871+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-20T22:12:05.477 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 19 2024-04-20T22:12:05.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.479+0000 7f7fde800640 1 -- 172.21.15.142:0/3456695488 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7fbc06ecf0 msgr2=0x7f7fbc0711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:05.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.479+0000 7f7fde800640 1 --2- 172.21.15.142:0/3456695488 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7fbc06ecf0 0x7f7fbc0711b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7fc002c950 tx=0x7f7fc0005a20 comp rx=0 tx=0).stop 2024-04-20T22:12:05.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.479+0000 7f7fde800640 1 -- 172.21.15.142:0/3456695488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fd81011c0 msgr2=0x7f7fd8197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:05.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.479+0000 7f7fde800640 1 --2- 172.21.15.142:0/3456695488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fd81011c0 0x7f7fd8197e40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800d6f0 tx=0x7f7fc800dbb0 comp rx=0 tx=0).stop 2024-04-20T22:12:05.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.479+0000 7f7fde800640 1 -- 172.21.15.142:0/3456695488 shutdown_connections 2024-04-20T22:12:05.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.479+0000 7f7fde800640 1 --2- 172.21.15.142:0/3456695488 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f7fbc06ecf0 0x7f7fbc0711b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:05.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.479+0000 7f7fde800640 1 --2- 172.21.15.142:0/3456695488 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fd8101ae0 0x7f7fd8198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:05.479 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.479+0000 7f7fde800640 1 --2- 172.21.15.142:0/3456695488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fd81011c0 0x7f7fd8197e40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:05.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.479+0000 7f7fde800640 1 -- 172.21.15.142:0/3456695488 >> 172.21.15.142:0/3456695488 conn(0x7f7fd80fa9c0 msgr2=0x7f7fd80ff5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:05.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.480+0000 7f7fde800640 1 -- 172.21.15.142:0/3456695488 shutdown_connections 2024-04-20T22:12:05.480 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.480+0000 7f7fde800640 1 -- 172.21.15.142:0/3456695488 wait complete. 2024-04-20T22:12:05.499 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-04-20T22:12:05.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.700+0000 7f6d05c00640 1 -- 172.21.15.142:0/638674961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d00101b20 msgr2=0x7f6d0010a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:05.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.700+0000 7f6d05c00640 1 --2- 172.21.15.142:0/638674961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d00101b20 0x7f6d0010a000 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009880 tx=0x7f6ce802bd70 comp rx=0 tx=0).stop 2024-04-20T22:12:05.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.700+0000 7f6d05c00640 1 -- 172.21.15.142:0/638674961 shutdown_connections 2024-04-20T22:12:05.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.700+0000 7f6d05c00640 1 --2- 172.21.15.142:0/638674961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d00101b20 0x7f6d0010a000 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:05.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.700+0000 7f6d05c00640 1 --2- 172.21.15.142:0/638674961 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d00101200 0x7f6d001015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:05.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.700+0000 7f6d05c00640 1 -- 172.21.15.142:0/638674961 >> 172.21.15.142:0/638674961 conn(0x7f6d000faa20 msgr2=0x7f6d000fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:05.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.700+0000 7f6d05c00640 1 -- 172.21.15.142:0/638674961 shutdown_connections 2024-04-20T22:12:05.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.700+0000 7f6d05c00640 1 -- 172.21.15.142:0/638674961 wait complete. 2024-04-20T22:12:05.702 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.701+0000 7f6d05c00640 1 Processor -- start 2024-04-20T22:12:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.701+0000 7f6d05c00640 1 -- start start 2024-04-20T22:12:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.702+0000 7f6d05c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d00101200 0x7f6d00198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.702+0000 7f6d05c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d00101b20 0x7f6d00198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.702+0000 7f6d05c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d00198bd0 con 0x7f6d00101200 2024-04-20T22:12:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.702+0000 7f6d05c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0019c9a0 con 0x7f6d00101b20 2024-04-20T22:12:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.702+0000 7f6cfea00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d00101200 0x7f6d00198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.702+0000 7f6cfea00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d00101200 0x7f6d00198000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46954/0 (socket says 172.21.15.142:46954) 2024-04-20T22:12:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.702+0000 7f6cfea00640 1 -- 172.21.15.142:0/2681396505 learned_addr learned my addr 172.21.15.142:0/2681396505 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:05.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.702+0000 7f6cf6000640 1 --2- 172.21.15.142:0/2681396505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d00101b20 0x7f6d00198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:05.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.703+0000 7f6cfea00640 1 -- 172.21.15.142:0/2681396505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d00101b20 msgr2=0x7f6d00198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:05.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.703+0000 7f6cfea00640 1 --2- 172.21.15.142:0/2681396505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d00101b20 0x7f6d00198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:05.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.703+0000 7f6cfea00640 1 -- 172.21.15.142:0/2681396505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce8009560 con 0x7f6d00101200 2024-04-20T22:12:05.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.703+0000 7f6cfea00640 1 --2- 172.21.15.142:0/2681396505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d00101200 0x7f6d00198000 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000e970 tx=0x7f6cf000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:05.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.703+0000 7f6cf7e00640 1 -- 172.21.15.142:0/2681396505 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cf000cc90 con 0x7f6d00101200 2024-04-20T22:12:05.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.703+0000 7f6d05c00640 1 -- 172.21.15.142:0/2681396505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0019cc80 con 0x7f6d00101200 2024-04-20T22:12:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.703+0000 7f6cf7e00640 1 -- 172.21.15.142:0/2681396505 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6cf000cdf0 con 0x7f6d00101200 2024-04-20T22:12:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.703+0000 7f6cf7e00640 1 -- 172.21.15.142:0/2681396505 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cf0010430 con 0x7f6d00101200 2024-04-20T22:12:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.703+0000 7f6d05c00640 1 -- 172.21.15.142:0/2681396505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0019d1b0 con 0x7f6d00101200 2024-04-20T22:12:05.705 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.705+0000 7f6d05c00640 1 -- 172.21.15.142:0/2681396505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0004e040 con 0x7f6d00101200 2024-04-20T22:12:05.706 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.706+0000 7f6cf7e00640 1 -- 172.21.15.142:0/2681396505 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f6cf00046c0 con 0x7f6d00101200 2024-04-20T22:12:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.707+0000 7f6cf7e00640 1 --2- 172.21.15.142:0/2681396505 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6ce406ec30 0x7f6ce40710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.707+0000 7f6cf7e00640 1 -- 172.21.15.142:0/2681396505 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f6cf0014070 con 0x7f6d00101200 2024-04-20T22:12:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.707+0000 7f6cf6000640 1 --2- 172.21.15.142:0/2681396505 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6ce406ec30 0x7f6ce40710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:05.708 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.708+0000 7f6cf6000640 1 --2- 172.21.15.142:0/2681396505 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6ce406ec30 0x7f6ce40710f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8006010 tx=0x7f6ce8005b50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:05.712 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.712+0000 7f6cf7e00640 1 -- 172.21.15.142:0/2681396505 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f6cf0058180 con 0x7f6d00101200 2024-04-20T22:12:05.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.959+0000 7f6d05c00640 1 -- 172.21.15.142:0/2681396505 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f6d00109ad0 con 0x7f6d00101200 2024-04-20T22:12:05.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.960+0000 7f6cf7e00640 1 -- 172.21.15.142:0/2681396505 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v35) v1 ==== 107+0+4173 (secure 0 0 0) 0x7f6cf005b840 con 0x7f6d00101200 2024-04-20T22:12:05.961 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:05.961 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24253,"name":"cephfs.smithi164.gmmrfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.164:6827/3096926963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3096926963},{"type":"v1","addr":"172.21.15.164:6827","nonce":3096926963}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":34454,"name":"cephfs.smithi142.lirkws","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2100080187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2100080187},{"type":"v1","addr":"172.21.15.142:6827","nonce":2100080187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:06:21.711368+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24245":{"gid":24245,"name":"cephfs.smithi164.ybvzha","rank":0,"incarnation":20,"state":"up:replay","state_seq":4,"addr":"172.21.15.164:6825/4054029190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":4054029190},{"type":"v1","addr":"172.21.15.164:6825","nonce":4054029190}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-20T22:12:05.961 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 20 2024-04-20T22:12:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.963+0000 7f6d05c00640 1 -- 172.21.15.142:0/2681396505 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6ce406ec30 msgr2=0x7f6ce40710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.963+0000 7f6d05c00640 1 --2- 172.21.15.142:0/2681396505 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6ce406ec30 0x7f6ce40710f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8006010 tx=0x7f6ce8005b50 comp rx=0 tx=0).stop 2024-04-20T22:12:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.963+0000 7f6d05c00640 1 -- 172.21.15.142:0/2681396505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d00101200 msgr2=0x7f6d00198000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.963+0000 7f6d05c00640 1 --2- 172.21.15.142:0/2681396505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d00101200 0x7f6d00198000 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000e970 tx=0x7f6cf000ed70 comp rx=0 tx=0).stop 2024-04-20T22:12:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.963+0000 7f6d05c00640 1 -- 172.21.15.142:0/2681396505 shutdown_connections 2024-04-20T22:12:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.963+0000 7f6d05c00640 1 --2- 172.21.15.142:0/2681396505 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f6ce406ec30 0x7f6ce40710f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.963+0000 7f6d05c00640 1 --2- 172.21.15.142:0/2681396505 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d00101b20 0x7f6d00198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.963+0000 7f6d05c00640 1 --2- 172.21.15.142:0/2681396505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d00101200 0x7f6d00198000 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.963+0000 7f6d05c00640 1 -- 172.21.15.142:0/2681396505 >> 172.21.15.142:0/2681396505 conn(0x7f6d000faa20 msgr2=0x7f6d000ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.963+0000 7f6d05c00640 1 -- 172.21.15.142:0/2681396505 shutdown_connections 2024-04-20T22:12:05.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:05.963+0000 7f6d05c00640 1 -- 172.21.15.142:0/2681396505 wait complete. 2024-04-20T22:12:05.992 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-04-20T22:12:06.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.188+0000 7f8e71e00640 1 -- 172.21.15.142:0/4137173270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e6c1011d0 msgr2=0x7f8e6c1015b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:06.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.188+0000 7f8e71e00640 1 --2- 172.21.15.142:0/4137173270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e6c1011d0 0x7f8e6c1015b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c009880 tx=0x7f8e5c02bd70 comp rx=0 tx=0).stop 2024-04-20T22:12:06.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.189+0000 7f8e71e00640 1 -- 172.21.15.142:0/4137173270 shutdown_connections 2024-04-20T22:12:06.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.189+0000 7f8e71e00640 1 --2- 172.21.15.142:0/4137173270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e6c101af0 0x7f8e6c109fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:06.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.189+0000 7f8e71e00640 1 --2- 172.21.15.142:0/4137173270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e6c1011d0 0x7f8e6c1015b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:06.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.189+0000 7f8e71e00640 1 -- 172.21.15.142:0/4137173270 >> 172.21.15.142:0/4137173270 conn(0x7f8e6c0fa9f0 msgr2=0x7f8e6c0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:06.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.189+0000 7f8e71e00640 1 -- 172.21.15.142:0/4137173270 shutdown_connections 2024-04-20T22:12:06.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.189+0000 7f8e71e00640 1 -- 172.21.15.142:0/4137173270 wait complete. 2024-04-20T22:12:06.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.190+0000 7f8e71e00640 1 Processor -- start 2024-04-20T22:12:06.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.190+0000 7f8e71e00640 1 -- start start 2024-04-20T22:12:06.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.190+0000 7f8e71e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e6c1011d0 0x7f8e6c197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:06.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.190+0000 7f8e71e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e6c101af0 0x7f8e6c198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:06.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.190+0000 7f8e71e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c198a20 con 0x7f8e6c101af0 2024-04-20T22:12:06.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.190+0000 7f8e71e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c19c7f0 con 0x7f8e6c1011d0 2024-04-20T22:12:06.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.191+0000 7f8e6a000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e6c101af0 0x7f8e6c198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:06.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.191+0000 7f8e6a000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e6c101af0 0x7f8e6c198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46970/0 (socket says 172.21.15.142:46970) 2024-04-20T22:12:06.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.191+0000 7f8e6a000640 1 -- 172.21.15.142:0/2884866514 learned_addr learned my addr 172.21.15.142:0/2884866514 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:06.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.191+0000 7f8e6aa00640 1 --2- 172.21.15.142:0/2884866514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e6c1011d0 0x7f8e6c197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:06.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.191+0000 7f8e6a000640 1 -- 172.21.15.142:0/2884866514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e6c1011d0 msgr2=0x7f8e6c197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:06.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.191+0000 7f8e6a000640 1 --2- 172.21.15.142:0/2884866514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e6c1011d0 0x7f8e6c197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:06.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.191+0000 7f8e6a000640 1 -- 172.21.15.142:0/2884866514 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c009560 con 0x7f8e6c101af0 2024-04-20T22:12:06.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.192+0000 7f8e6a000640 1 --2- 172.21.15.142:0/2884866514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e6c101af0 0x7f8e6c198390 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800d6d0 tx=0x7f8e5800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:06.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.192+0000 7f8e70a00640 1 -- 172.21.15.142:0/2884866514 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e580051f0 con 0x7f8e6c101af0 2024-04-20T22:12:06.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.192+0000 7f8e70a00640 1 -- 172.21.15.142:0/2884866514 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e58009ce0 con 0x7f8e6c101af0 2024-04-20T22:12:06.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.192+0000 7f8e71e00640 1 -- 172.21.15.142:0/2884866514 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6c19cad0 con 0x7f8e6c101af0 2024-04-20T22:12:06.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.192+0000 7f8e70a00640 1 -- 172.21.15.142:0/2884866514 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e58004db0 con 0x7f8e6c101af0 2024-04-20T22:12:06.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.192+0000 7f8e71e00640 1 -- 172.21.15.142:0/2884866514 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6c19d030 con 0x7f8e6c101af0 2024-04-20T22:12:06.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.193+0000 7f8e71e00640 1 -- 172.21.15.142:0/2884866514 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e6c04e040 con 0x7f8e6c101af0 2024-04-20T22:12:06.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.194+0000 7f8e70a00640 1 -- 172.21.15.142:0/2884866514 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f8e58009820 con 0x7f8e6c101af0 2024-04-20T22:12:06.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.195+0000 7f8e70a00640 1 --2- 172.21.15.142:0/2884866514 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8e5006ec90 0x7f8e50071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:06.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.195+0000 7f8e70a00640 1 -- 172.21.15.142:0/2884866514 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f8e5808e9c0 con 0x7f8e6c101af0 2024-04-20T22:12:06.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.195+0000 7f8e6aa00640 1 --2- 172.21.15.142:0/2884866514 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8e5006ec90 0x7f8e50071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:06.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.196+0000 7f8e6aa00640 1 --2- 172.21.15.142:0/2884866514 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8e5006ec90 0x7f8e50071150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c006010 tx=0x7f8e5c005dd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:06.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.200+0000 7f8e70a00640 1 -- 172.21.15.142:0/2884866514 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f8e58057680 con 0x7f8e6c101af0 2024-04-20T22:12:06.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:06 smithi142 ceph-mon[79401]: pgmap v393: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:06.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:06 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3456695488' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-20T22:12:06.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:06 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:12:06.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:06 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2681396505' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-20T22:12:06.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:06 smithi164 ceph-mon[69784]: pgmap v393: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:06.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:06 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3456695488' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-20T22:12:06.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:06 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:12:06.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:06 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/2681396505' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-20T22:12:06.449 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.449+0000 7f8e71e00640 1 -- 172.21.15.142:0/2884866514 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f8e6c109aa0 con 0x7f8e6c101af0 2024-04-20T22:12:06.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.450+0000 7f8e70a00640 1 -- 172.21.15.142:0/2884866514 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v35) v1 ==== 107+0+4178 (secure 0 0 0) 0x7f8e5805ad40 con 0x7f8e6c101af0 2024-04-20T22:12:06.451 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:06.451 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24253,"name":"cephfs.smithi164.gmmrfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.164:6827/3096926963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3096926963},{"type":"v1","addr":"172.21.15.164:6827","nonce":3096926963}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":34454,"name":"cephfs.smithi142.lirkws","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2100080187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2100080187},{"type":"v1","addr":"172.21.15.142:6827","nonce":2100080187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:06:30.301085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24245":{"gid":24245,"name":"cephfs.smithi164.ybvzha","rank":0,"incarnation":20,"state":"up:reconnect","state_seq":179,"addr":"172.21.15.164:6825/4054029190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":4054029190},{"type":"v1","addr":"172.21.15.164:6825","nonce":4054029190}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-20T22:12:06.451 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 21 2024-04-20T22:12:06.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.453+0000 7f8e71e00640 1 -- 172.21.15.142:0/2884866514 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8e5006ec90 msgr2=0x7f8e50071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:06.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.453+0000 7f8e71e00640 1 --2- 172.21.15.142:0/2884866514 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8e5006ec90 0x7f8e50071150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c006010 tx=0x7f8e5c005dd0 comp rx=0 tx=0).stop 2024-04-20T22:12:06.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.453+0000 7f8e71e00640 1 -- 172.21.15.142:0/2884866514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e6c101af0 msgr2=0x7f8e6c198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:06.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.453+0000 7f8e71e00640 1 --2- 172.21.15.142:0/2884866514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e6c101af0 0x7f8e6c198390 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800d6d0 tx=0x7f8e5800db90 comp rx=0 tx=0).stop 2024-04-20T22:12:06.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.453+0000 7f8e71e00640 1 -- 172.21.15.142:0/2884866514 shutdown_connections 2024-04-20T22:12:06.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.453+0000 7f8e71e00640 1 --2- 172.21.15.142:0/2884866514 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8e5006ec90 0x7f8e50071150 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:06.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.453+0000 7f8e71e00640 1 --2- 172.21.15.142:0/2884866514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e6c101af0 0x7f8e6c198390 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:06.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.453+0000 7f8e71e00640 1 --2- 172.21.15.142:0/2884866514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e6c1011d0 0x7f8e6c197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:06.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.453+0000 7f8e71e00640 1 -- 172.21.15.142:0/2884866514 >> 172.21.15.142:0/2884866514 conn(0x7f8e6c0fa9f0 msgr2=0x7f8e6c0ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:06.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.453+0000 7f8e71e00640 1 -- 172.21.15.142:0/2884866514 shutdown_connections 2024-04-20T22:12:06.454 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.453+0000 7f8e71e00640 1 -- 172.21.15.142:0/2884866514 wait complete. 2024-04-20T22:12:06.472 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-04-20T22:12:06.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.660+0000 7f8e6c600640 1 -- 172.21.15.142:0/3485419659 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e640750f0 msgr2=0x7f8e641109b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:06.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.660+0000 7f8e6c600640 1 --2- 172.21.15.142:0/3485419659 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e640750f0 0x7f8e641109b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8e500097e0 tx=0x7f8e5002bc30 comp rx=0 tx=0).stop 2024-04-20T22:12:06.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.660+0000 7f8e6c600640 1 -- 172.21.15.142:0/3485419659 shutdown_connections 2024-04-20T22:12:06.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.660+0000 7f8e6c600640 1 --2- 172.21.15.142:0/3485419659 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e640750f0 0x7f8e641109b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:06.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.660+0000 7f8e6c600640 1 --2- 172.21.15.142:0/3485419659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e640747d0 0x7f8e64074bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:06.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.660+0000 7f8e6c600640 1 -- 172.21.15.142:0/3485419659 >> 172.21.15.142:0/3485419659 conn(0x7f8e640fdd40 msgr2=0x7f8e64100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:06.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.660+0000 7f8e6c600640 1 -- 172.21.15.142:0/3485419659 shutdown_connections 2024-04-20T22:12:06.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.660+0000 7f8e6c600640 1 -- 172.21.15.142:0/3485419659 wait complete. 2024-04-20T22:12:06.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.661+0000 7f8e6c600640 1 Processor -- start 2024-04-20T22:12:06.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.661+0000 7f8e6c600640 1 -- start start 2024-04-20T22:12:06.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.662+0000 7f8e6c600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e640747d0 0x7f8e6419c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:06.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.662+0000 7f8e6c600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e640750f0 0x7f8e6419c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:06.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.662+0000 7f8e6c600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6419ce80 con 0x7f8e640747d0 2024-04-20T22:12:06.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.662+0000 7f8e6c600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e641a0c50 con 0x7f8e640750f0 2024-04-20T22:12:06.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.662+0000 7f8e69c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e640747d0 0x7f8e6419c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:06.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.662+0000 7f8e69c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e640747d0 0x7f8e6419c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46990/0 (socket says 172.21.15.142:46990) 2024-04-20T22:12:06.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.662+0000 7f8e69c00640 1 -- 172.21.15.142:0/1911187250 learned_addr learned my addr 172.21.15.142:0/1911187250 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:06.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.662+0000 7f8e69200640 1 --2- 172.21.15.142:0/1911187250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e640750f0 0x7f8e6419c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:06.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.662+0000 7f8e69c00640 1 -- 172.21.15.142:0/1911187250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e640750f0 msgr2=0x7f8e6419c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:06.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.662+0000 7f8e69c00640 1 --2- 172.21.15.142:0/1911187250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e640750f0 0x7f8e6419c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:06.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.663+0000 7f8e69c00640 1 -- 172.21.15.142:0/1911187250 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e58009560 con 0x7f8e640747d0 2024-04-20T22:12:06.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.663+0000 7f8e69c00640 1 --2- 172.21.15.142:0/1911187250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e640747d0 0x7f8e6419c2b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800e940 tx=0x7f8e5800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:06.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.663+0000 7f8e62000640 1 -- 172.21.15.142:0/1911187250 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e5800cd50 con 0x7f8e640747d0 2024-04-20T22:12:06.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.663+0000 7f8e6c600640 1 -- 172.21.15.142:0/1911187250 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e50009490 con 0x7f8e640747d0 2024-04-20T22:12:06.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.663+0000 7f8e62000640 1 -- 172.21.15.142:0/1911187250 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e580035f0 con 0x7f8e640747d0 2024-04-20T22:12:06.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.663+0000 7f8e62000640 1 -- 172.21.15.142:0/1911187250 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e580044e0 con 0x7f8e640747d0 2024-04-20T22:12:06.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.663+0000 7f8e6c600640 1 -- 172.21.15.142:0/1911187250 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e641a1300 con 0x7f8e640747d0 2024-04-20T22:12:06.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.665+0000 7f8e6c600640 1 -- 172.21.15.142:0/1911187250 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e6404e040 con 0x7f8e640747d0 2024-04-20T22:12:06.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.666+0000 7f8e62000640 1 -- 172.21.15.142:0/1911187250 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f8e58003760 con 0x7f8e640747d0 2024-04-20T22:12:06.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.667+0000 7f8e62000640 1 --2- 172.21.15.142:0/1911187250 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8e4c06ec30 0x7f8e4c0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:06.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.667+0000 7f8e62000640 1 -- 172.21.15.142:0/1911187250 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f8e58014070 con 0x7f8e640747d0 2024-04-20T22:12:06.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.667+0000 7f8e69200640 1 --2- 172.21.15.142:0/1911187250 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8e4c06ec30 0x7f8e4c0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:06.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.668+0000 7f8e69200640 1 --2- 172.21.15.142:0/1911187250 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8e4c06ec30 0x7f8e4c0710f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8e6419d8c0 tx=0x7f8e50005d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:06.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.671+0000 7f8e62000640 1 -- 172.21.15.142:0/1911187250 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f8e58058180 con 0x7f8e640747d0 2024-04-20T22:12:06.920 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.919+0000 7f8e6c600640 1 -- 172.21.15.142:0/1911187250 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f8e6410e090 con 0x7f8e640747d0 2024-04-20T22:12:06.921 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.920+0000 7f8e62000640 1 -- 172.21.15.142:0/1911187250 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v35) v1 ==== 107+0+5025 (secure 0 0 0) 0x7f8e5805b840 con 0x7f8e640747d0 2024-04-20T22:12:06.921 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:06.921 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24253,"name":"cephfs.smithi164.gmmrfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.164:6827/3096926963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3096926963},{"type":"v1","addr":"172.21.15.164:6827","nonce":3096926963}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":34454,"name":"cephfs.smithi142.lirkws","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2100080187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2100080187},{"type":"v1","addr":"172.21.15.142:6827","nonce":2100080187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34486,"name":"cephfs.smithi142.lrvfgg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6829/2960234081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2960234081},{"type":"v1","addr":"172.21.15.142:6829","nonce":2960234081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:06:30.766472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24245":{"gid":24245,"name":"cephfs.smithi164.ybvzha","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":180,"addr":"172.21.15.164:6825/4054029190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":4054029190},{"type":"v1","addr":"172.21.15.164:6825","nonce":4054029190}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-20T22:12:06.922 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 22 2024-04-20T22:12:06.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.923+0000 7f8e6c600640 1 -- 172.21.15.142:0/1911187250 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8e4c06ec30 msgr2=0x7f8e4c0710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:06.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.923+0000 7f8e6c600640 1 --2- 172.21.15.142:0/1911187250 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8e4c06ec30 0x7f8e4c0710f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8e6419d8c0 tx=0x7f8e50005d10 comp rx=0 tx=0).stop 2024-04-20T22:12:06.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.923+0000 7f8e6c600640 1 -- 172.21.15.142:0/1911187250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e640747d0 msgr2=0x7f8e6419c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:06.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.923+0000 7f8e6c600640 1 --2- 172.21.15.142:0/1911187250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e640747d0 0x7f8e6419c2b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800e940 tx=0x7f8e5800ee00 comp rx=0 tx=0).stop 2024-04-20T22:12:06.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.923+0000 7f8e6c600640 1 -- 172.21.15.142:0/1911187250 shutdown_connections 2024-04-20T22:12:06.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.923+0000 7f8e6c600640 1 --2- 172.21.15.142:0/1911187250 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8e4c06ec30 0x7f8e4c0710f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:06.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.923+0000 7f8e6c600640 1 --2- 172.21.15.142:0/1911187250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e640750f0 0x7f8e6419c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:06.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.923+0000 7f8e6c600640 1 --2- 172.21.15.142:0/1911187250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e640747d0 0x7f8e6419c2b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:06.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.923+0000 7f8e6c600640 1 -- 172.21.15.142:0/1911187250 >> 172.21.15.142:0/1911187250 conn(0x7f8e640fdd40 msgr2=0x7f8e640fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:06.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.923+0000 7f8e6c600640 1 -- 172.21.15.142:0/1911187250 shutdown_connections 2024-04-20T22:12:06.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:06.923+0000 7f8e6c600640 1 -- 172.21.15.142:0/1911187250 wait complete. 2024-04-20T22:12:06.943 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-04-20T22:12:07.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.127+0000 7f0653e00640 1 -- 172.21.15.142:0/1116181611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0654067c70 msgr2=0x7f065410c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:07.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.127+0000 7f0653e00640 1 --2- 172.21.15.142:0/1116181611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0654067c70 0x7f065410c470 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f063c009880 tx=0x7f063c02bd30 comp rx=0 tx=0).stop 2024-04-20T22:12:07.128 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.127+0000 7f0653e00640 1 -- 172.21.15.142:0/1116181611 shutdown_connections 2024-04-20T22:12:07.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.127+0000 7f0653e00640 1 --2- 172.21.15.142:0/1116181611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0654067c70 0x7f065410c470 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:07.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.127+0000 7f0653e00640 1 --2- 172.21.15.142:0/1116181611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0654067350 0x7f0654067730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:07.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.127+0000 7f0653e00640 1 -- 172.21.15.142:0/1116181611 >> 172.21.15.142:0/1116181611 conn(0x7f06540748e0 msgr2=0x7f0654074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:07.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.127+0000 7f0653e00640 1 -- 172.21.15.142:0/1116181611 shutdown_connections 2024-04-20T22:12:07.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.127+0000 7f0653e00640 1 -- 172.21.15.142:0/1116181611 wait complete. 2024-04-20T22:12:07.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.128+0000 7f0653e00640 1 Processor -- start 2024-04-20T22:12:07.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.128+0000 7f0653e00640 1 -- start start 2024-04-20T22:12:07.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.129+0000 7f0653e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0654067350 0x7f065419da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:07.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.129+0000 7f0653e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0654067c70 0x7f065419df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:07.131 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.129+0000 7f0653e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0654197ac0 con 0x7f0654067350 2024-04-20T22:12:07.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.129+0000 7f0653e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0654197c30 con 0x7f0654067c70 2024-04-20T22:12:07.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.129+0000 7f0652a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0654067350 0x7f065419da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:07.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.129+0000 7f0652a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0654067350 0x7f065419da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41098/0 (socket says 172.21.15.142:41098) 2024-04-20T22:12:07.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.129+0000 7f0652a00640 1 -- 172.21.15.142:0/2211477874 learned_addr learned my addr 172.21.15.142:0/2211477874 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:07.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.130+0000 7f0652000640 1 --2- 172.21.15.142:0/2211477874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0654067c70 0x7f065419df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:07.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.130+0000 7f0652a00640 1 -- 172.21.15.142:0/2211477874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0654067c70 msgr2=0x7f065419df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:07.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.130+0000 7f0652a00640 1 --2- 172.21.15.142:0/2211477874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0654067c70 0x7f065419df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:07.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.130+0000 7f0652a00640 1 -- 172.21.15.142:0/2211477874 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c009560 con 0x7f0654067350 2024-04-20T22:12:07.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.130+0000 7f0652a00640 1 --2- 172.21.15.142:0/2211477874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0654067350 0x7f065419da50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f064400d6f0 tx=0x7f064400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:07.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.130+0000 7f064b400640 1 -- 172.21.15.142:0/2211477874 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0644009a30 con 0x7f0654067350 2024-04-20T22:12:07.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.130+0000 7f064b400640 1 -- 172.21.15.142:0/2211477874 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f06440054e0 con 0x7f0654067350 2024-04-20T22:12:07.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.130+0000 7f064b400640 1 -- 172.21.15.142:0/2211477874 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0644010460 con 0x7f0654067350 2024-04-20T22:12:07.132 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.130+0000 7f0653e00640 1 -- 172.21.15.142:0/2211477874 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0654197f10 con 0x7f0654067350 2024-04-20T22:12:07.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.131+0000 7f0653e00640 1 -- 172.21.15.142:0/2211477874 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0654198440 con 0x7f0654067350 2024-04-20T22:12:07.133 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.132+0000 7f0653e00640 1 -- 172.21.15.142:0/2211477874 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065404e890 con 0x7f0654067350 2024-04-20T22:12:07.136 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.135+0000 7f064b400640 1 -- 172.21.15.142:0/2211477874 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f0644009b90 con 0x7f0654067350 2024-04-20T22:12:07.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.136+0000 7f064b400640 1 --2- 172.21.15.142:0/2211477874 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f063806ec80 0x7f0638071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:07.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.136+0000 7f064b400640 1 -- 172.21.15.142:0/2211477874 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f064408ef70 con 0x7f0654067350 2024-04-20T22:12:07.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.137+0000 7f0652000640 1 --2- 172.21.15.142:0/2211477874 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f063806ec80 0x7f0638071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:07.138 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.137+0000 7f0652000640 1 --2- 172.21.15.142:0/2211477874 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f063806ec80 0x7f0638071140 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0654198f30 tx=0x7f063c005a40 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:07.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.140+0000 7f064b400640 1 -- 172.21.15.142:0/2211477874 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f0644057c80 con 0x7f0654067350 2024-04-20T22:12:07.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:07 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2884866514' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-20T22:12:07.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:07 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:12:07.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:07 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:12:07.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:07 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:12:07.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:07 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1911187250' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-20T22:12:07.395 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.394+0000 7f0653e00640 1 -- 172.21.15.142:0/2211477874 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f0654109b50 con 0x7f0654067350 2024-04-20T22:12:07.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.396+0000 7f064b400640 1 -- 172.21.15.142:0/2211477874 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v35) v1 ==== 107+0+5034 (secure 0 0 0) 0x7f0644020090 con 0x7f0654067350 2024-04-20T22:12:07.397 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:07.397 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24253,"name":"cephfs.smithi164.gmmrfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.164:6827/3096926963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3096926963},{"type":"v1","addr":"172.21.15.164:6827","nonce":3096926963}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":34454,"name":"cephfs.smithi142.lirkws","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2100080187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2100080187},{"type":"v1","addr":"172.21.15.142:6827","nonce":2100080187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34486,"name":"cephfs.smithi142.lrvfgg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6829/2960234081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2960234081},{"type":"v1","addr":"172.21.15.142:6829","nonce":2960234081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:06:32.768715+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24245":{"gid":24245,"name":"cephfs.smithi164.ybvzha","rank":0,"incarnation":20,"state":"up:active","state_seq":181,"addr":"172.21.15.164:6825/4054029190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":4054029190},{"type":"v1","addr":"172.21.15.164:6825","nonce":4054029190}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24245,"qdb_cluster":[24245]},"id":1}]} 2024-04-20T22:12:07.397 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 23 2024-04-20T22:12:07.399 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.399+0000 7f0653e00640 1 -- 172.21.15.142:0/2211477874 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f063806ec80 msgr2=0x7f0638071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:07.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.399+0000 7f0653e00640 1 --2- 172.21.15.142:0/2211477874 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f063806ec80 0x7f0638071140 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0654198f30 tx=0x7f063c005a40 comp rx=0 tx=0).stop 2024-04-20T22:12:07.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.399+0000 7f0653e00640 1 -- 172.21.15.142:0/2211477874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0654067350 msgr2=0x7f065419da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:07.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.399+0000 7f0653e00640 1 --2- 172.21.15.142:0/2211477874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0654067350 0x7f065419da50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f064400d6f0 tx=0x7f064400dbb0 comp rx=0 tx=0).stop 2024-04-20T22:12:07.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.399+0000 7f0653e00640 1 -- 172.21.15.142:0/2211477874 shutdown_connections 2024-04-20T22:12:07.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.399+0000 7f0653e00640 1 --2- 172.21.15.142:0/2211477874 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f063806ec80 0x7f0638071140 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:07.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.399+0000 7f0653e00640 1 --2- 172.21.15.142:0/2211477874 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0654067c70 0x7f065419df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:07.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.399+0000 7f0653e00640 1 --2- 172.21.15.142:0/2211477874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0654067350 0x7f065419da50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:07.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.399+0000 7f0653e00640 1 -- 172.21.15.142:0/2211477874 >> 172.21.15.142:0/2211477874 conn(0x7f06540748e0 msgr2=0x7f06540fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:07.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.399+0000 7f0653e00640 1 -- 172.21.15.142:0/2211477874 shutdown_connections 2024-04-20T22:12:07.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.399+0000 7f0653e00640 1 -- 172.21.15.142:0/2211477874 wait complete. 2024-04-20T22:12:07.418 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-04-20T22:12:07.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:07 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/2884866514' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-20T22:12:07.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:07 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:12:07.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:07 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:12:07.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:07 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:12:07.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:07 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/1911187250' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-20T22:12:07.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.624+0000 7fd9a6e00640 1 -- 172.21.15.142:0/1536033671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a0102c90 msgr2=0x7fd9a0106cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:07.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.624+0000 7fd9a6e00640 1 --2- 172.21.15.142:0/1536033671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a0102c90 0x7fd9a0106cd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009880 tx=0x7fd98c02bce0 comp rx=0 tx=0).stop 2024-04-20T22:12:07.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.624+0000 7fd9a6e00640 1 -- 172.21.15.142:0/1536033671 shutdown_connections 2024-04-20T22:12:07.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.624+0000 7fd9a6e00640 1 --2- 172.21.15.142:0/1536033671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a0102c90 0x7fd9a0106cd0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:07.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.624+0000 7fd9a6e00640 1 --2- 172.21.15.142:0/1536033671 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9a01022e0 0x7fd9a01026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:07.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.624+0000 7fd9a6e00640 1 -- 172.21.15.142:0/1536033671 >> 172.21.15.142:0/1536033671 conn(0x7fd9a00fdb20 msgr2=0x7fd9a00fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:07.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.624+0000 7fd9a6e00640 1 -- 172.21.15.142:0/1536033671 shutdown_connections 2024-04-20T22:12:07.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.624+0000 7fd9a6e00640 1 -- 172.21.15.142:0/1536033671 wait complete. 2024-04-20T22:12:07.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.625+0000 7fd9a6e00640 1 Processor -- start 2024-04-20T22:12:07.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.625+0000 7fd9a6e00640 1 -- start start 2024-04-20T22:12:07.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.626+0000 7fd9a6e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9a01022e0 0x7fd9a0197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:07.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.626+0000 7fd9a6e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a01982e0 0x7fd9a019c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:07.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.626+0000 7fd9a6e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a01988e0 con 0x7fd9a01982e0 2024-04-20T22:12:07.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.626+0000 7fd9a6e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a0198a50 con 0x7fd9a01022e0 2024-04-20T22:12:07.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.626+0000 7fd9a5000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a01982e0 0x7fd9a019c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:07.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.626+0000 7fd9a5000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a01982e0 0x7fd9a019c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41122/0 (socket says 172.21.15.142:41122) 2024-04-20T22:12:07.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.626+0000 7fd9a5000640 1 -- 172.21.15.142:0/119197111 learned_addr learned my addr 172.21.15.142:0/119197111 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:07.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.626+0000 7fd9a5a00640 1 --2- 172.21.15.142:0/119197111 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9a01022e0 0x7fd9a0197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:07.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.626+0000 7fd9a5000640 1 -- 172.21.15.142:0/119197111 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9a01022e0 msgr2=0x7fd9a0197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:07.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.626+0000 7fd9a5000640 1 --2- 172.21.15.142:0/119197111 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9a01022e0 0x7fd9a0197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:07.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.626+0000 7fd9a5000640 1 -- 172.21.15.142:0/119197111 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c009560 con 0x7fd9a01982e0 2024-04-20T22:12:07.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.627+0000 7fd9a5000640 1 --2- 172.21.15.142:0/119197111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a01982e0 0x7fd9a019c740 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd98c036040 tx=0x7fd98c02c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:07.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.627+0000 7fd99e000640 1 -- 172.21.15.142:0/119197111 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd98c004520 con 0x7fd9a01982e0 2024-04-20T22:12:07.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.627+0000 7fd9a6e00640 1 -- 172.21.15.142:0/119197111 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a019cce0 con 0x7fd9a01982e0 2024-04-20T22:12:07.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.627+0000 7fd99e000640 1 -- 172.21.15.142:0/119197111 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd98c003ab0 con 0x7fd9a01982e0 2024-04-20T22:12:07.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.627+0000 7fd99e000640 1 -- 172.21.15.142:0/119197111 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd98c034440 con 0x7fd9a01982e0 2024-04-20T22:12:07.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.627+0000 7fd9a6e00640 1 -- 172.21.15.142:0/119197111 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a019d240 con 0x7fd9a01982e0 2024-04-20T22:12:07.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.628+0000 7fd9a6e00640 1 -- 172.21.15.142:0/119197111 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a004e040 con 0x7fd9a01982e0 2024-04-20T22:12:07.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.630+0000 7fd99e000640 1 -- 172.21.15.142:0/119197111 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fd98c003c20 con 0x7fd9a01982e0 2024-04-20T22:12:07.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.631+0000 7fd99e000640 1 --2- 172.21.15.142:0/119197111 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd98806ec30 0x7fd9880710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:07.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.631+0000 7fd99e000640 1 -- 172.21.15.142:0/119197111 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fd98c0b1410 con 0x7fd9a01982e0 2024-04-20T22:12:07.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.631+0000 7fd9a5a00640 1 --2- 172.21.15.142:0/119197111 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd98806ec30 0x7fd9880710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:07.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.632+0000 7fd9a5a00640 1 --2- 172.21.15.142:0/119197111 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd98806ec30 0x7fd9880710f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd994005fd0 tx=0x7fd994005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:07.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.635+0000 7fd99e000640 1 -- 172.21.15.142:0/119197111 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fd98c07a020 con 0x7fd9a01982e0 2024-04-20T22:12:07.877 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.877+0000 7fd9a6e00640 1 -- 172.21.15.142:0/119197111 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fd9a010a5e0 con 0x7fd9a01982e0 2024-04-20T22:12:07.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.878+0000 7fd99e000640 1 -- 172.21.15.142:0/119197111 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v35) v1 ==== 107+0+4230 (secure 0 0 0) 0x7fd98c07d6e0 con 0x7fd9a01982e0 2024-04-20T22:12:07.879 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:07.879 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24253,"name":"cephfs.smithi164.gmmrfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.164:6827/3096926963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3096926963},{"type":"v1","addr":"172.21.15.164:6827","nonce":3096926963}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":34454,"name":"cephfs.smithi142.lirkws","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2100080187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2100080187},{"type":"v1","addr":"172.21.15.142:6827","nonce":2100080187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34486,"name":"cephfs.smithi142.lrvfgg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6829/2960234081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2960234081},{"type":"v1","addr":"172.21.15.142:6829","nonce":2960234081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:06:52.437043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-20T22:12:07.879 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 24 2024-04-20T22:12:07.881 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.881+0000 7fd9a6e00640 1 -- 172.21.15.142:0/119197111 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd98806ec30 msgr2=0x7fd9880710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:07.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.881+0000 7fd9a6e00640 1 --2- 172.21.15.142:0/119197111 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd98806ec30 0x7fd9880710f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd994005fd0 tx=0x7fd994005850 comp rx=0 tx=0).stop 2024-04-20T22:12:07.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.881+0000 7fd9a6e00640 1 -- 172.21.15.142:0/119197111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a01982e0 msgr2=0x7fd9a019c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:07.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.881+0000 7fd9a6e00640 1 --2- 172.21.15.142:0/119197111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a01982e0 0x7fd9a019c740 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd98c036040 tx=0x7fd98c02c7a0 comp rx=0 tx=0).stop 2024-04-20T22:12:07.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.881+0000 7fd9a6e00640 1 -- 172.21.15.142:0/119197111 shutdown_connections 2024-04-20T22:12:07.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.881+0000 7fd9a6e00640 1 --2- 172.21.15.142:0/119197111 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd98806ec30 0x7fd9880710f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:07.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.881+0000 7fd9a6e00640 1 --2- 172.21.15.142:0/119197111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a01982e0 0x7fd9a019c740 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:07.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.881+0000 7fd9a6e00640 1 --2- 172.21.15.142:0/119197111 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9a01022e0 0x7fd9a0197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:07.882 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.881+0000 7fd9a6e00640 1 -- 172.21.15.142:0/119197111 >> 172.21.15.142:0/119197111 conn(0x7fd9a00fdb20 msgr2=0x7fd9a00ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:07.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.881+0000 7fd9a6e00640 1 -- 172.21.15.142:0/119197111 shutdown_connections 2024-04-20T22:12:07.883 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:07.881+0000 7fd9a6e00640 1 -- 172.21.15.142:0/119197111 wait complete. 2024-04-20T22:12:07.902 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-04-20T22:12:08.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.107+0000 7f141ec00640 1 -- 172.21.15.142:0/3424718082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1418102e70 msgr2=0x7f1418106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:08.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.107+0000 7f141ec00640 1 --2- 172.21.15.142:0/3424718082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1418102e70 0x7f1418106eb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1404009880 tx=0x7f140402bce0 comp rx=0 tx=0).stop 2024-04-20T22:12:08.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.107+0000 7f141ec00640 1 -- 172.21.15.142:0/3424718082 shutdown_connections 2024-04-20T22:12:08.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.107+0000 7f141ec00640 1 --2- 172.21.15.142:0/3424718082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1418102e70 0x7f1418106eb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:08.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.107+0000 7f141ec00640 1 --2- 172.21.15.142:0/3424718082 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14181024c0 0x7f14181028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:08.108 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.107+0000 7f141ec00640 1 -- 172.21.15.142:0/3424718082 >> 172.21.15.142:0/3424718082 conn(0x7f14180fdce0 msgr2=0x7f1418100100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:08.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.107+0000 7f141ec00640 1 -- 172.21.15.142:0/3424718082 shutdown_connections 2024-04-20T22:12:08.109 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.107+0000 7f141ec00640 1 -- 172.21.15.142:0/3424718082 wait complete. 2024-04-20T22:12:08.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.108+0000 7f141ec00640 1 Processor -- start 2024-04-20T22:12:08.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.108+0000 7f141ec00640 1 -- start start 2024-04-20T22:12:08.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.108+0000 7f141ec00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14181024c0 0x7f1418197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:08.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.108+0000 7f141ec00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14181984a0 0x7f141819c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:08.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.108+0000 7f141ec00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1418198aa0 con 0x7f14181024c0 2024-04-20T22:12:08.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.108+0000 7f141ec00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1418198c10 con 0x7f14181984a0 2024-04-20T22:12:08.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.109+0000 7f1417e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14181024c0 0x7f1418197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:08.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.109+0000 7f1417e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14181024c0 0x7f1418197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41152/0 (socket says 172.21.15.142:41152) 2024-04-20T22:12:08.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.109+0000 7f1417e00640 1 -- 172.21.15.142:0/1011753116 learned_addr learned my addr 172.21.15.142:0/1011753116 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:08.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.109+0000 7f1417e00640 1 -- 172.21.15.142:0/1011753116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14181984a0 msgr2=0x7f141819c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:08.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.109+0000 7f1417400640 1 --2- 172.21.15.142:0/1011753116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14181984a0 0x7f141819c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:08.111 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.109+0000 7f1417e00640 1 --2- 172.21.15.142:0/1011753116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14181984a0 0x7f141819c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:08.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.109+0000 7f1417e00640 1 -- 172.21.15.142:0/1011753116 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1404009560 con 0x7f14181024c0 2024-04-20T22:12:08.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.109+0000 7f1417e00640 1 --2- 172.21.15.142:0/1011753116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14181024c0 0x7f1418197f60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f140800d720 tx=0x7f140800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:08.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.110+0000 7f1414c00640 1 -- 172.21.15.142:0/1011753116 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14080051f0 con 0x7f14181024c0 2024-04-20T22:12:08.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.110+0000 7f141ec00640 1 -- 172.21.15.142:0/1011753116 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141819cf00 con 0x7f14181024c0 2024-04-20T22:12:08.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.110+0000 7f1414c00640 1 -- 172.21.15.142:0/1011753116 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1408009ce0 con 0x7f14181024c0 2024-04-20T22:12:08.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.110+0000 7f1414c00640 1 -- 172.21.15.142:0/1011753116 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1408010460 con 0x7f14181024c0 2024-04-20T22:12:08.112 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.110+0000 7f141ec00640 1 -- 172.21.15.142:0/1011753116 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141819d460 con 0x7f14181024c0 2024-04-20T22:12:08.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.111+0000 7f141ec00640 1 -- 172.21.15.142:0/1011753116 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141804e040 con 0x7f14181024c0 2024-04-20T22:12:08.113 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.112+0000 7f1414c00640 1 -- 172.21.15.142:0/1011753116 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f1408005350 con 0x7f14181024c0 2024-04-20T22:12:08.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.113+0000 7f1414c00640 1 --2- 172.21.15.142:0/1011753116 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f13fc06ec80 0x7f13fc071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:08.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.113+0000 7f1414c00640 1 -- 172.21.15.142:0/1011753116 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f140808eb90 con 0x7f14181024c0 2024-04-20T22:12:08.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.113+0000 7f1417400640 1 --2- 172.21.15.142:0/1011753116 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f13fc06ec80 0x7f13fc071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:08.114 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.114+0000 7f1417400640 1 --2- 172.21.15.142:0/1011753116 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f13fc06ec80 0x7f13fc071140 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1404036040 tx=0x7f140402cf90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:08.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.118+0000 7f1414c00640 1 -- 172.21.15.142:0/1011753116 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f14080577a0 con 0x7f14181024c0 2024-04-20T22:12:08.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:08 smithi142 ceph-mon[79401]: pgmap v394: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:08.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:08 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2211477874' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-20T22:12:08.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:08 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/119197111' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-20T22:12:08.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.370+0000 7f141ec00640 1 -- 172.21.15.142:0/1011753116 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f1418199340 con 0x7f14181024c0 2024-04-20T22:12:08.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.371+0000 7f1414c00640 1 -- 172.21.15.142:0/1011753116 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v35) v1 ==== 107+0+4241 (secure 0 0 0) 0x7f140805ae60 con 0x7f14181024c0 2024-04-20T22:12:08.372 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:08.372 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34454,"name":"cephfs.smithi142.lirkws","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2100080187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2100080187},{"type":"v1","addr":"172.21.15.142:6827","nonce":2100080187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34486,"name":"cephfs.smithi142.lrvfgg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6829/2960234081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2960234081},{"type":"v1","addr":"172.21.15.142:6829","nonce":2960234081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:06:52.449770+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi164.gmmrfu","rank":0,"incarnation":25,"state":"up:replay","state_seq":2,"addr":"172.21.15.164:6827/3096926963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3096926963},{"type":"v1","addr":"172.21.15.164:6827","nonce":3096926963}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-20T22:12:08.372 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 25 2024-04-20T22:12:08.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.374+0000 7f141ec00640 1 -- 172.21.15.142:0/1011753116 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f13fc06ec80 msgr2=0x7f13fc071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:08.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.374+0000 7f141ec00640 1 --2- 172.21.15.142:0/1011753116 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f13fc06ec80 0x7f13fc071140 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1404036040 tx=0x7f140402cf90 comp rx=0 tx=0).stop 2024-04-20T22:12:08.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.374+0000 7f141ec00640 1 -- 172.21.15.142:0/1011753116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14181024c0 msgr2=0x7f1418197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:08.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.374+0000 7f141ec00640 1 --2- 172.21.15.142:0/1011753116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14181024c0 0x7f1418197f60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f140800d720 tx=0x7f140800dbe0 comp rx=0 tx=0).stop 2024-04-20T22:12:08.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.374+0000 7f141ec00640 1 -- 172.21.15.142:0/1011753116 shutdown_connections 2024-04-20T22:12:08.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.374+0000 7f141ec00640 1 --2- 172.21.15.142:0/1011753116 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f13fc06ec80 0x7f13fc071140 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:08.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.374+0000 7f141ec00640 1 --2- 172.21.15.142:0/1011753116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14181984a0 0x7f141819c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:08.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.374+0000 7f141ec00640 1 --2- 172.21.15.142:0/1011753116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14181024c0 0x7f1418197f60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:08.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.374+0000 7f141ec00640 1 -- 172.21.15.142:0/1011753116 >> 172.21.15.142:0/1011753116 conn(0x7f14180fdce0 msgr2=0x7f14180ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:08.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.374+0000 7f141ec00640 1 -- 172.21.15.142:0/1011753116 shutdown_connections 2024-04-20T22:12:08.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.374+0000 7f141ec00640 1 -- 172.21.15.142:0/1011753116 wait complete. 2024-04-20T22:12:08.395 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-04-20T22:12:08.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:08 smithi164 ceph-mon[69784]: pgmap v394: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:08.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:08 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/2211477874' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-20T22:12:08.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:08 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/119197111' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-20T22:12:08.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.592+0000 7fd9a3200640 1 -- 172.21.15.142:0/1887183954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a40750f0 msgr2=0x7fd9a4110790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:08.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.592+0000 7fd9a3200640 1 --2- 172.21.15.142:0/1887183954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a40750f0 0x7fd9a4110790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009880 tx=0x7fd98c02bce0 comp rx=0 tx=0).stop 2024-04-20T22:12:08.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.592+0000 7fd9a3200640 1 -- 172.21.15.142:0/1887183954 shutdown_connections 2024-04-20T22:12:08.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.592+0000 7fd9a3200640 1 --2- 172.21.15.142:0/1887183954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a40750f0 0x7fd9a4110790 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:08.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.592+0000 7fd9a3200640 1 --2- 172.21.15.142:0/1887183954 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9a40747d0 0x7fd9a4074bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:08.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.592+0000 7fd9a3200640 1 -- 172.21.15.142:0/1887183954 >> 172.21.15.142:0/1887183954 conn(0x7fd9a40fdb20 msgr2=0x7fd9a40fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:08.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.592+0000 7fd9a3200640 1 -- 172.21.15.142:0/1887183954 shutdown_connections 2024-04-20T22:12:08.594 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.592+0000 7fd9a3200640 1 -- 172.21.15.142:0/1887183954 wait complete. 2024-04-20T22:12:08.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.593+0000 7fd9a3200640 1 Processor -- start 2024-04-20T22:12:08.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.594+0000 7fd9a3200640 1 -- start start 2024-04-20T22:12:08.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.594+0000 7fd9a3200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a40747d0 0x7fd9a419c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:08.595 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.594+0000 7fd9a3200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9a40750f0 0x7fd9a419c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.594+0000 7fd9a3200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a419cc30 con 0x7fd9a40747d0 2024-04-20T22:12:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.594+0000 7fd9a3200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a41a0a00 con 0x7fd9a40750f0 2024-04-20T22:12:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.594+0000 7fd9a1e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a40747d0 0x7fd9a419c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.594+0000 7fd9a1e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a40747d0 0x7fd9a419c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41160/0 (socket says 172.21.15.142:41160) 2024-04-20T22:12:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.594+0000 7fd9a1e00640 1 -- 172.21.15.142:0/2345602164 learned_addr learned my addr 172.21.15.142:0/2345602164 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.595+0000 7fd99be00640 1 --2- 172.21.15.142:0/2345602164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9a40750f0 0x7fd9a419c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.595+0000 7fd9a1e00640 1 -- 172.21.15.142:0/2345602164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9a40750f0 msgr2=0x7fd9a419c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.595+0000 7fd9a1e00640 1 --2- 172.21.15.142:0/2345602164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9a40750f0 0x7fd9a419c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:08.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.595+0000 7fd9a1e00640 1 -- 172.21.15.142:0/2345602164 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c009560 con 0x7fd9a40747d0 2024-04-20T22:12:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.595+0000 7fd9a1e00640 1 --2- 172.21.15.142:0/2345602164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a40747d0 0x7fd9a419c060 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd99400c810 tx=0x7fd99400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.595+0000 7fd99aa00640 1 -- 172.21.15.142:0/2345602164 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9940041f0 con 0x7fd9a40747d0 2024-04-20T22:12:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.596+0000 7fd9a3200640 1 -- 172.21.15.142:0/2345602164 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a41a0ce0 con 0x7fd9a40747d0 2024-04-20T22:12:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.596+0000 7fd99aa00640 1 -- 172.21.15.142:0/2345602164 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd994007e70 con 0x7fd9a40747d0 2024-04-20T22:12:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.596+0000 7fd99aa00640 1 -- 172.21.15.142:0/2345602164 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9940049d0 con 0x7fd9a40747d0 2024-04-20T22:12:08.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.596+0000 7fd9a3200640 1 -- 172.21.15.142:0/2345602164 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a41a1240 con 0x7fd9a40747d0 2024-04-20T22:12:08.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.597+0000 7fd9a3200640 1 -- 172.21.15.142:0/2345602164 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a404e890 con 0x7fd9a40747d0 2024-04-20T22:12:08.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.598+0000 7fd99aa00640 1 -- 172.21.15.142:0/2345602164 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fd9940079b0 con 0x7fd9a40747d0 2024-04-20T22:12:08.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.599+0000 7fd99aa00640 1 --2- 172.21.15.142:0/2345602164 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd98806ec80 0x7fd988071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:08.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.599+0000 7fd99aa00640 1 -- 172.21.15.142:0/2345602164 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fd99408ed50 con 0x7fd9a40747d0 2024-04-20T22:12:08.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.599+0000 7fd99be00640 1 --2- 172.21.15.142:0/2345602164 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd98806ec80 0x7fd988071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:08.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.600+0000 7fd99be00640 1 --2- 172.21.15.142:0/2345602164 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd98806ec80 0x7fd988071140 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd9a419d670 tx=0x7fd98c02cf90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:08.604 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.604+0000 7fd99aa00640 1 -- 172.21.15.142:0/2345602164 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fd9940579e0 con 0x7fd9a40747d0 2024-04-20T22:12:08.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.844+0000 7fd9a3200640 1 -- 172.21.15.142:0/2345602164 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fd9a410de70 con 0x7fd9a40747d0 2024-04-20T22:12:08.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.845+0000 7fd99aa00640 1 -- 172.21.15.142:0/2345602164 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v35) v1 ==== 107+0+5091 (secure 0 0 0) 0x7fd99401d090 con 0x7fd9a40747d0 2024-04-20T22:12:08.846 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:08.846 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34454,"name":"cephfs.smithi142.lirkws","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2100080187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2100080187},{"type":"v1","addr":"172.21.15.142:6827","nonce":2100080187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34486,"name":"cephfs.smithi142.lrvfgg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6829/2960234081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2960234081},{"type":"v1","addr":"172.21.15.142:6829","nonce":2960234081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44319,"name":"cephfs.smithi164.ybvzha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6825/1951894011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951894011},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951894011}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:06:52.449770+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi164.gmmrfu","rank":0,"incarnation":25,"state":"up:replay","state_seq":2,"addr":"172.21.15.164:6827/3096926963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3096926963},{"type":"v1","addr":"172.21.15.164:6827","nonce":3096926963}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-20T22:12:08.847 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 26 2024-04-20T22:12:08.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.848+0000 7fd9a3200640 1 -- 172.21.15.142:0/2345602164 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd98806ec80 msgr2=0x7fd988071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:08.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.848+0000 7fd9a3200640 1 --2- 172.21.15.142:0/2345602164 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd98806ec80 0x7fd988071140 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd9a419d670 tx=0x7fd98c02cf90 comp rx=0 tx=0).stop 2024-04-20T22:12:08.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.848+0000 7fd9a3200640 1 -- 172.21.15.142:0/2345602164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a40747d0 msgr2=0x7fd9a419c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:08.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.848+0000 7fd9a3200640 1 --2- 172.21.15.142:0/2345602164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a40747d0 0x7fd9a419c060 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd99400c810 tx=0x7fd99400ccd0 comp rx=0 tx=0).stop 2024-04-20T22:12:08.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.848+0000 7fd9a3200640 1 -- 172.21.15.142:0/2345602164 shutdown_connections 2024-04-20T22:12:08.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.848+0000 7fd9a3200640 1 --2- 172.21.15.142:0/2345602164 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd98806ec80 0x7fd988071140 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:08.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.848+0000 7fd9a3200640 1 --2- 172.21.15.142:0/2345602164 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9a40750f0 0x7fd9a419c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:08.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.848+0000 7fd9a3200640 1 --2- 172.21.15.142:0/2345602164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9a40747d0 0x7fd9a419c060 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:08.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.848+0000 7fd9a3200640 1 -- 172.21.15.142:0/2345602164 >> 172.21.15.142:0/2345602164 conn(0x7fd9a40fdb20 msgr2=0x7fd9a40fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:08.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.849+0000 7fd9a3200640 1 -- 172.21.15.142:0/2345602164 shutdown_connections 2024-04-20T22:12:08.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:08.849+0000 7fd9a3200640 1 -- 172.21.15.142:0/2345602164 wait complete. 2024-04-20T22:12:08.869 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-04-20T22:12:09.051 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.050+0000 7fef7ca00640 1 -- 172.21.15.142:0/2189678993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef78072ff0 msgr2=0x7fef7810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:09.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.050+0000 7fef7ca00640 1 --2- 172.21.15.142:0/2189678993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef78072ff0 0x7fef7810c170 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fef60009880 tx=0x7fef6002bd90 comp rx=0 tx=0).stop 2024-04-20T22:12:09.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.051+0000 7fef7ca00640 1 -- 172.21.15.142:0/2189678993 shutdown_connections 2024-04-20T22:12:09.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.051+0000 7fef7ca00640 1 --2- 172.21.15.142:0/2189678993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef78072ff0 0x7fef7810c170 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:09.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.051+0000 7fef7ca00640 1 --2- 172.21.15.142:0/2189678993 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef780726d0 0x7fef78072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:09.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.051+0000 7fef7ca00640 1 -- 172.21.15.142:0/2189678993 >> 172.21.15.142:0/2189678993 conn(0x7fef780fb960 msgr2=0x7fef780fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:09.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.051+0000 7fef7ca00640 1 -- 172.21.15.142:0/2189678993 shutdown_connections 2024-04-20T22:12:09.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.051+0000 7fef7ca00640 1 -- 172.21.15.142:0/2189678993 wait complete. 2024-04-20T22:12:09.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.052+0000 7fef7ca00640 1 Processor -- start 2024-04-20T22:12:09.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.052+0000 7fef7ca00640 1 -- start start 2024-04-20T22:12:09.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.052+0000 7fef7ca00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef780726d0 0x7fef78197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:09.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.052+0000 7fef7ca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef78072ff0 0x7fef78198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:09.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.052+0000 7fef7ca00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef781988f0 con 0x7fef780726d0 2024-04-20T22:12:09.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.052+0000 7fef7ca00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7819b5c0 con 0x7fef78072ff0 2024-04-20T22:12:09.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.052+0000 7fef77400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef780726d0 0x7fef78197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:09.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.052+0000 7fef77400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef780726d0 0x7fef78197cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41172/0 (socket says 172.21.15.142:41172) 2024-04-20T22:12:09.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.052+0000 7fef77400640 1 -- 172.21.15.142:0/3646002824 learned_addr learned my addr 172.21.15.142:0/3646002824 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:09.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.053+0000 7fef76a00640 1 --2- 172.21.15.142:0/3646002824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef78072ff0 0x7fef78198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:09.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.053+0000 7fef77400640 1 -- 172.21.15.142:0/3646002824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef78072ff0 msgr2=0x7fef78198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:09.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.053+0000 7fef77400640 1 --2- 172.21.15.142:0/3646002824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef78072ff0 0x7fef78198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:09.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.053+0000 7fef77400640 1 -- 172.21.15.142:0/3646002824 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef60009560 con 0x7fef780726d0 2024-04-20T22:12:09.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.053+0000 7fef76a00640 1 --2- 172.21.15.142:0/3646002824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef78072ff0 0x7fef78198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:12:09.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.053+0000 7fef77400640 1 --2- 172.21.15.142:0/3646002824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef780726d0 0x7fef78197cd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fef7000cc60 tx=0x7fef7000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:09.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.053+0000 7fef6fe00640 1 -- 172.21.15.142:0/3646002824 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef70004b20 con 0x7fef780726d0 2024-04-20T22:12:09.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.053+0000 7fef6fe00640 1 -- 172.21.15.142:0/3646002824 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef70004c80 con 0x7fef780726d0 2024-04-20T22:12:09.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.053+0000 7fef6fe00640 1 -- 172.21.15.142:0/3646002824 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef7000f640 con 0x7fef780726d0 2024-04-20T22:12:09.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.053+0000 7fef7ca00640 1 -- 172.21.15.142:0/3646002824 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7819b8a0 con 0x7fef780726d0 2024-04-20T22:12:09.056 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.053+0000 7fef7ca00640 1 -- 172.21.15.142:0/3646002824 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7819bdb0 con 0x7fef780726d0 2024-04-20T22:12:09.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.054+0000 7fef7ca00640 1 -- 172.21.15.142:0/3646002824 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7804e890 con 0x7fef780726d0 2024-04-20T22:12:09.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.055+0000 7fef6fe00640 1 -- 172.21.15.142:0/3646002824 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fef700055e0 con 0x7fef780726d0 2024-04-20T22:12:09.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.056+0000 7fef6fe00640 1 --2- 172.21.15.142:0/3646002824 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fef5c06ec30 0x7fef5c0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:09.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.056+0000 7fef6fe00640 1 -- 172.21.15.142:0/3646002824 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fef7008f210 con 0x7fef780726d0 2024-04-20T22:12:09.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.057+0000 7fef76a00640 1 --2- 172.21.15.142:0/3646002824 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fef5c06ec30 0x7fef5c0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:09.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.057+0000 7fef76a00640 1 --2- 172.21.15.142:0/3646002824 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fef5c06ec30 0x7fef5c0710f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fef60036040 tx=0x7fef600058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:09.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.062+0000 7fef6fe00640 1 -- 172.21.15.142:0/3646002824 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fef70057e20 con 0x7fef780726d0 2024-04-20T22:12:09.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.306+0000 7fef7ca00640 1 -- 172.21.15.142:0/3646002824 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fef781097e0 con 0x7fef780726d0 2024-04-20T22:12:09.309 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.308+0000 7fef6fe00640 1 -- 172.21.15.142:0/3646002824 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v35) v1 ==== 107+0+5096 (secure 0 0 0) 0x7fef7005b4e0 con 0x7fef780726d0 2024-04-20T22:12:09.309 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:09.309 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34454,"name":"cephfs.smithi142.lirkws","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2100080187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2100080187},{"type":"v1","addr":"172.21.15.142:6827","nonce":2100080187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34486,"name":"cephfs.smithi142.lrvfgg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6829/2960234081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2960234081},{"type":"v1","addr":"172.21.15.142:6829","nonce":2960234081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44319,"name":"cephfs.smithi164.ybvzha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6825/1951894011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951894011},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951894011}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:07:01.101825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi164.gmmrfu","rank":0,"incarnation":25,"state":"up:reconnect","state_seq":185,"addr":"172.21.15.164:6827/3096926963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3096926963},{"type":"v1","addr":"172.21.15.164:6827","nonce":3096926963}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-20T22:12:09.309 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 27 2024-04-20T22:12:09.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.311+0000 7fef7ca00640 1 -- 172.21.15.142:0/3646002824 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fef5c06ec30 msgr2=0x7fef5c0710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:09.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.311+0000 7fef7ca00640 1 --2- 172.21.15.142:0/3646002824 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fef5c06ec30 0x7fef5c0710f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fef60036040 tx=0x7fef600058d0 comp rx=0 tx=0).stop 2024-04-20T22:12:09.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.311+0000 7fef7ca00640 1 -- 172.21.15.142:0/3646002824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef780726d0 msgr2=0x7fef78197cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:09.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.311+0000 7fef7ca00640 1 --2- 172.21.15.142:0/3646002824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef780726d0 0x7fef78197cd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fef7000cc60 tx=0x7fef7000a620 comp rx=0 tx=0).stop 2024-04-20T22:12:09.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.311+0000 7fef7ca00640 1 -- 172.21.15.142:0/3646002824 shutdown_connections 2024-04-20T22:12:09.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.311+0000 7fef7ca00640 1 --2- 172.21.15.142:0/3646002824 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fef5c06ec30 0x7fef5c0710f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:09.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.311+0000 7fef7ca00640 1 --2- 172.21.15.142:0/3646002824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef78072ff0 0x7fef78198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:09.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.311+0000 7fef7ca00640 1 --2- 172.21.15.142:0/3646002824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef780726d0 0x7fef78197cd0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:09.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.311+0000 7fef7ca00640 1 -- 172.21.15.142:0/3646002824 >> 172.21.15.142:0/3646002824 conn(0x7fef780fb960 msgr2=0x7fef781069b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:09.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.311+0000 7fef7ca00640 1 -- 172.21.15.142:0/3646002824 shutdown_connections 2024-04-20T22:12:09.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.311+0000 7fef7ca00640 1 -- 172.21.15.142:0/3646002824 wait complete. 2024-04-20T22:12:09.330 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-04-20T22:12:09.400 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:09 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1011753116' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-20T22:12:09.400 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:09 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2345602164' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-20T22:12:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:09 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/1011753116' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-20T22:12:09.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:09 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/2345602164' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-20T22:12:09.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.530+0000 7f45b9800640 1 -- 172.21.15.142:0/1856733130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b4100a70 msgr2=0x7f45b4104ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:09.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.530+0000 7f45b9800640 1 --2- 172.21.15.142:0/1856733130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b4100a70 0x7f45b4104ab0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f459c009c20 tx=0x7f459c02c1b0 comp rx=0 tx=0).stop 2024-04-20T22:12:09.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.530+0000 7f45b9800640 1 -- 172.21.15.142:0/1856733130 shutdown_connections 2024-04-20T22:12:09.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.530+0000 7f45b9800640 1 --2- 172.21.15.142:0/1856733130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b4100a70 0x7f45b4104ab0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:09.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.530+0000 7f45b9800640 1 --2- 172.21.15.142:0/1856733130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45b41000c0 0x7f45b41004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:09.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.530+0000 7f45b9800640 1 -- 172.21.15.142:0/1856733130 >> 172.21.15.142:0/1856733130 conn(0x7f45b40fb960 msgr2=0x7f45b40fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:09.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.530+0000 7f45b9800640 1 -- 172.21.15.142:0/1856733130 shutdown_connections 2024-04-20T22:12:09.531 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.530+0000 7f45b9800640 1 -- 172.21.15.142:0/1856733130 wait complete. 2024-04-20T22:12:09.532 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.531+0000 7f45b9800640 1 Processor -- start 2024-04-20T22:12:09.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.531+0000 7f45b9800640 1 -- start start 2024-04-20T22:12:09.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.532+0000 7f45b9800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45b41000c0 0x7f45b40725a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:09.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.532+0000 7f45b9800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b4072ae0 0x7f45b4072f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:09.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.532+0000 7f45b9800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b4074530 con 0x7f45b4072ae0 2024-04-20T22:12:09.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.532+0000 7f45b9800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b41a1d80 con 0x7f45b41000c0 2024-04-20T22:12:09.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.532+0000 7f45b3400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b4072ae0 0x7f45b4072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:09.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.532+0000 7f45b3400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b4072ae0 0x7f45b4072f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41202/0 (socket says 172.21.15.142:41202) 2024-04-20T22:12:09.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.532+0000 7f45b3400640 1 -- 172.21.15.142:0/3033603844 learned_addr learned my addr 172.21.15.142:0/3033603844 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:09.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.532+0000 7f45b3400640 1 -- 172.21.15.142:0/3033603844 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45b41000c0 msgr2=0x7f45b40725a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:09.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.532+0000 7f45b3e00640 1 --2- 172.21.15.142:0/3033603844 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45b41000c0 0x7f45b40725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:09.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.533+0000 7f45b3400640 1 --2- 172.21.15.142:0/3033603844 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45b41000c0 0x7f45b40725a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:09.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.533+0000 7f45b3400640 1 -- 172.21.15.142:0/3033603844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c009900 con 0x7f45b4072ae0 2024-04-20T22:12:09.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.533+0000 7f45b3e00640 1 --2- 172.21.15.142:0/3033603844 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45b41000c0 0x7f45b40725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:12:09.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.533+0000 7f45b3400640 1 --2- 172.21.15.142:0/3033603844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b4072ae0 0x7f45b4072f40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f459c000f80 tx=0x7f459c032b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:09.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.533+0000 7f45b0c00640 1 -- 172.21.15.142:0/3033603844 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f459c034820 con 0x7f45b4072ae0 2024-04-20T22:12:09.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.533+0000 7f45b0c00640 1 -- 172.21.15.142:0/3033603844 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f459c003e30 con 0x7f45b4072ae0 2024-04-20T22:12:09.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.533+0000 7f45b0c00640 1 -- 172.21.15.142:0/3033603844 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f459c03f440 con 0x7f45b4072ae0 2024-04-20T22:12:09.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.533+0000 7f45b9800640 1 -- 172.21.15.142:0/3033603844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b41a1f20 con 0x7f45b4072ae0 2024-04-20T22:12:09.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.533+0000 7f45b9800640 1 -- 172.21.15.142:0/3033603844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b41a23f0 con 0x7f45b4072ae0 2024-04-20T22:12:09.535 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.534+0000 7f45b9800640 1 -- 172.21.15.142:0/3033603844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b404e890 con 0x7f45b4072ae0 2024-04-20T22:12:09.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.536+0000 7f45b0c00640 1 -- 172.21.15.142:0/3033603844 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f459c03b040 con 0x7f45b4072ae0 2024-04-20T22:12:09.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.537+0000 7f45b0c00640 1 --2- 172.21.15.142:0/3033603844 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f459406ec80 0x7f4594071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:09.537 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.537+0000 7f45b0c00640 1 -- 172.21.15.142:0/3033603844 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f459c0b1c60 con 0x7f45b4072ae0 2024-04-20T22:12:09.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.537+0000 7f45b3e00640 1 --2- 172.21.15.142:0/3033603844 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f459406ec80 0x7f4594071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:09.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.538+0000 7f45b3e00640 1 --2- 172.21.15.142:0/3033603844 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f459406ec80 0x7f4594071140 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f45a400baa0 tx=0x7f45a4005d90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:09.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.543+0000 7f45b0c00640 1 -- 172.21.15.142:0/3033603844 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f459c07a910 con 0x7f45b4072ae0 2024-04-20T22:12:09.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.786+0000 7f45b9800640 1 -- 172.21.15.142:0/3033603844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f45b41083c0 con 0x7f45b4072ae0 2024-04-20T22:12:09.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.787+0000 7f45b0c00640 1 -- 172.21.15.142:0/3033603844 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v35) v1 ==== 107+0+5093 (secure 0 0 0) 0x7f459c07dfd0 con 0x7f45b4072ae0 2024-04-20T22:12:09.788 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:09.788 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34454,"name":"cephfs.smithi142.lirkws","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2100080187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2100080187},{"type":"v1","addr":"172.21.15.142:6827","nonce":2100080187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34486,"name":"cephfs.smithi142.lrvfgg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6829/2960234081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2960234081},{"type":"v1","addr":"172.21.15.142:6829","nonce":2960234081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44319,"name":"cephfs.smithi164.ybvzha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6825/1951894011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951894011},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951894011}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:07:01.550766+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi164.gmmrfu","rank":0,"incarnation":25,"state":"up:rejoin","state_seq":186,"addr":"172.21.15.164:6827/3096926963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3096926963},{"type":"v1","addr":"172.21.15.164:6827","nonce":3096926963}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-20T22:12:09.788 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 28 2024-04-20T22:12:09.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.790+0000 7f45b9800640 1 -- 172.21.15.142:0/3033603844 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f459406ec80 msgr2=0x7f4594071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:09.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.790+0000 7f45b9800640 1 --2- 172.21.15.142:0/3033603844 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f459406ec80 0x7f4594071140 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f45a400baa0 tx=0x7f45a4005d90 comp rx=0 tx=0).stop 2024-04-20T22:12:09.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.790+0000 7f45b9800640 1 -- 172.21.15.142:0/3033603844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b4072ae0 msgr2=0x7f45b4072f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:09.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.790+0000 7f45b9800640 1 --2- 172.21.15.142:0/3033603844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b4072ae0 0x7f45b4072f40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f459c000f80 tx=0x7f459c032b60 comp rx=0 tx=0).stop 2024-04-20T22:12:09.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.790+0000 7f45b9800640 1 -- 172.21.15.142:0/3033603844 shutdown_connections 2024-04-20T22:12:09.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.790+0000 7f45b9800640 1 --2- 172.21.15.142:0/3033603844 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f459406ec80 0x7f4594071140 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:09.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.790+0000 7f45b9800640 1 --2- 172.21.15.142:0/3033603844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b4072ae0 0x7f45b4072f40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:09.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.790+0000 7f45b9800640 1 --2- 172.21.15.142:0/3033603844 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f45b41000c0 0x7f45b40725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:09.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.790+0000 7f45b9800640 1 -- 172.21.15.142:0/3033603844 >> 172.21.15.142:0/3033603844 conn(0x7f45b40fb960 msgr2=0x7f45b40fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:09.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.790+0000 7f45b9800640 1 -- 172.21.15.142:0/3033603844 shutdown_connections 2024-04-20T22:12:09.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:09.790+0000 7f45b9800640 1 -- 172.21.15.142:0/3033603844 wait complete. 2024-04-20T22:12:09.809 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-04-20T22:12:10.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.010+0000 7f5833200640 1 -- 172.21.15.142:0/1043061151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58341000e0 msgr2=0x7f58341004c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:10.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.010+0000 7f5833200640 1 --2- 172.21.15.142:0/1043061151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58341000e0 0x7f58341004c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f581c009880 tx=0x7f581c02bce0 comp rx=0 tx=0).stop 2024-04-20T22:12:10.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.010+0000 7f5833200640 1 -- 172.21.15.142:0/1043061151 shutdown_connections 2024-04-20T22:12:10.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.010+0000 7f5833200640 1 --2- 172.21.15.142:0/1043061151 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5834100a90 0x7f5834104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:10.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.010+0000 7f5833200640 1 --2- 172.21.15.142:0/1043061151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58341000e0 0x7f58341004c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:10.011 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.010+0000 7f5833200640 1 -- 172.21.15.142:0/1043061151 >> 172.21.15.142:0/1043061151 conn(0x7f58340fb960 msgr2=0x7f58340fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:10.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.010+0000 7f5833200640 1 -- 172.21.15.142:0/1043061151 shutdown_connections 2024-04-20T22:12:10.012 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.010+0000 7f5833200640 1 -- 172.21.15.142:0/1043061151 wait complete. 2024-04-20T22:12:10.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.011+0000 7f5833200640 1 Processor -- start 2024-04-20T22:12:10.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.011+0000 7f5833200640 1 -- start start 2024-04-20T22:12:10.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.012+0000 7f5833200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58341000e0 0x7f5834197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:10.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.012+0000 7f5833200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5834198280 0x7f583419c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:10.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.012+0000 7f5833200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5834198880 con 0x7f58341000e0 2024-04-20T22:12:10.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.012+0000 7f5833200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58341989f0 con 0x7f5834198280 2024-04-20T22:12:10.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.012+0000 7f5831e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58341000e0 0x7f5834197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:10.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.012+0000 7f5831e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58341000e0 0x7f5834197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41218/0 (socket says 172.21.15.142:41218) 2024-04-20T22:12:10.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.012+0000 7f5831e00640 1 -- 172.21.15.142:0/1056567742 learned_addr learned my addr 172.21.15.142:0/1056567742 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:10.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.012+0000 7f5831400640 1 --2- 172.21.15.142:0/1056567742 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5834198280 0x7f583419c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:10.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.012+0000 7f5831e00640 1 -- 172.21.15.142:0/1056567742 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5834198280 msgr2=0x7f583419c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:10.014 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.012+0000 7f5831e00640 1 --2- 172.21.15.142:0/1056567742 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5834198280 0x7f583419c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:10.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.012+0000 7f5831e00640 1 -- 172.21.15.142:0/1056567742 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c009560 con 0x7f58341000e0 2024-04-20T22:12:10.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.012+0000 7f5831400640 1 --2- 172.21.15.142:0/1056567742 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5834198280 0x7f583419c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:12:10.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.013+0000 7f5831e00640 1 --2- 172.21.15.142:0/1056567742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58341000e0 0x7f5834197d40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f581c036040 tx=0x7f581c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:10.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.013+0000 7f582aa00640 1 -- 172.21.15.142:0/1056567742 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f581c0035f0 con 0x7f58341000e0 2024-04-20T22:12:10.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.013+0000 7f582aa00640 1 -- 172.21.15.142:0/1056567742 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f581c003c10 con 0x7f58341000e0 2024-04-20T22:12:10.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.013+0000 7f5833200640 1 -- 172.21.15.142:0/1056567742 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583419cc80 con 0x7f58341000e0 2024-04-20T22:12:10.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.013+0000 7f582aa00640 1 -- 172.21.15.142:0/1056567742 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f581c034440 con 0x7f58341000e0 2024-04-20T22:12:10.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.013+0000 7f5833200640 1 -- 172.21.15.142:0/1056567742 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583419d1e0 con 0x7f58341000e0 2024-04-20T22:12:10.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.014+0000 7f5833200640 1 -- 172.21.15.142:0/1056567742 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583419d510 con 0x7f58341000e0 2024-04-20T22:12:10.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.016+0000 7f582aa00640 1 -- 172.21.15.142:0/1056567742 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f581c004fd0 con 0x7f58341000e0 2024-04-20T22:12:10.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.016+0000 7f582aa00640 1 --2- 172.21.15.142:0/1056567742 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f581806ec80 0x7f5818071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:10.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.017+0000 7f582aa00640 1 -- 172.21.15.142:0/1056567742 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f581c0b13b0 con 0x7f58341000e0 2024-04-20T22:12:10.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.017+0000 7f5831400640 1 --2- 172.21.15.142:0/1056567742 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f581806ec80 0x7f5818071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:10.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.017+0000 7f5831400640 1 --2- 172.21.15.142:0/1056567742 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f581806ec80 0x7f5818071140 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5824005c40 tx=0x7f58240082f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:10.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.021+0000 7f582aa00640 1 -- 172.21.15.142:0/1056567742 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f581c07a040 con 0x7f58341000e0 2024-04-20T22:12:10.263 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.263+0000 7f5833200640 1 -- 172.21.15.142:0/1056567742 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f583404e890 con 0x7f58341000e0 2024-04-20T22:12:10.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.264+0000 7f582aa00640 1 -- 172.21.15.142:0/1056567742 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v35) v1 ==== 107+0+5102 (secure 0 0 0) 0x7f581c07d700 con 0x7f58341000e0 2024-04-20T22:12:10.264 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:10.265 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34454,"name":"cephfs.smithi142.lirkws","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2100080187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2100080187},{"type":"v1","addr":"172.21.15.142:6827","nonce":2100080187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34486,"name":"cephfs.smithi142.lrvfgg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6829/2960234081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2960234081},{"type":"v1","addr":"172.21.15.142:6829","nonce":2960234081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44319,"name":"cephfs.smithi164.ybvzha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6825/1951894011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951894011},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951894011}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:07:03.547851+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi164.gmmrfu","rank":0,"incarnation":25,"state":"up:active","state_seq":187,"addr":"172.21.15.164:6827/3096926963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3096926963},{"type":"v1","addr":"172.21.15.164:6827","nonce":3096926963}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24253,"qdb_cluster":[24253]},"id":1}]} 2024-04-20T22:12:10.265 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 29 2024-04-20T22:12:10.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.267+0000 7f5833200640 1 -- 172.21.15.142:0/1056567742 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f581806ec80 msgr2=0x7f5818071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:10.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.267+0000 7f5833200640 1 --2- 172.21.15.142:0/1056567742 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f581806ec80 0x7f5818071140 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5824005c40 tx=0x7f58240082f0 comp rx=0 tx=0).stop 2024-04-20T22:12:10.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.267+0000 7f5833200640 1 -- 172.21.15.142:0/1056567742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58341000e0 msgr2=0x7f5834197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:10.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.267+0000 7f5833200640 1 --2- 172.21.15.142:0/1056567742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58341000e0 0x7f5834197d40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f581c036040 tx=0x7f581c004040 comp rx=0 tx=0).stop 2024-04-20T22:12:10.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.267+0000 7f5833200640 1 -- 172.21.15.142:0/1056567742 shutdown_connections 2024-04-20T22:12:10.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.267+0000 7f5833200640 1 --2- 172.21.15.142:0/1056567742 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f581806ec80 0x7f5818071140 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:10.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.267+0000 7f5833200640 1 --2- 172.21.15.142:0/1056567742 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5834198280 0x7f583419c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:10.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.267+0000 7f5833200640 1 --2- 172.21.15.142:0/1056567742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58341000e0 0x7f5834197d40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:10.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.267+0000 7f5833200640 1 -- 172.21.15.142:0/1056567742 >> 172.21.15.142:0/1056567742 conn(0x7f58340fb960 msgr2=0x7f58340fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:10.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.268+0000 7f5833200640 1 -- 172.21.15.142:0/1056567742 shutdown_connections 2024-04-20T22:12:10.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.268+0000 7f5833200640 1 -- 172.21.15.142:0/1056567742 wait complete. 2024-04-20T22:12:10.286 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-04-20T22:12:10.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:10 smithi142 ceph-mon[79401]: pgmap v395: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:10.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:10 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3646002824' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-20T22:12:10.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:10 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3033603844' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-20T22:12:10.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:10 smithi164 ceph-mon[69784]: pgmap v395: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:10.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:10 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3646002824' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-20T22:12:10.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:10 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3033603844' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-20T22:12:10.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.481+0000 7f387fe00640 1 -- 172.21.15.142:0/337958473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38800726d0 msgr2=0x7f3880072ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:10.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.481+0000 7f387fe00640 1 --2- 172.21.15.142:0/337958473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38800726d0 0x7f3880072ab0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3870009880 tx=0x7f387002bd70 comp rx=0 tx=0).stop 2024-04-20T22:12:10.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.482+0000 7f387fe00640 1 -- 172.21.15.142:0/337958473 shutdown_connections 2024-04-20T22:12:10.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.482+0000 7f387fe00640 1 --2- 172.21.15.142:0/337958473 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3880072ff0 0x7f388010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:10.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.482+0000 7f387fe00640 1 --2- 172.21.15.142:0/337958473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38800726d0 0x7f3880072ab0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:10.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.482+0000 7f387fe00640 1 -- 172.21.15.142:0/337958473 >> 172.21.15.142:0/337958473 conn(0x7f38800fb960 msgr2=0x7f38800fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:10.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.482+0000 7f387fe00640 1 -- 172.21.15.142:0/337958473 shutdown_connections 2024-04-20T22:12:10.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.482+0000 7f387fe00640 1 -- 172.21.15.142:0/337958473 wait complete. 2024-04-20T22:12:10.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.483+0000 7f387fe00640 1 Processor -- start 2024-04-20T22:12:10.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.483+0000 7f387fe00640 1 -- start start 2024-04-20T22:12:10.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.483+0000 7f387fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38800726d0 0x7f388019dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:10.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.483+0000 7f387fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3880072ff0 0x7f388019e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:10.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.484+0000 7f387fe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3880197b30 con 0x7f3880072ff0 2024-04-20T22:12:10.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.484+0000 7f387fe00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3880197ca0 con 0x7f38800726d0 2024-04-20T22:12:10.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.484+0000 7f387e000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3880072ff0 0x7f388019e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:10.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.484+0000 7f387e000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3880072ff0 0x7f388019e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41236/0 (socket says 172.21.15.142:41236) 2024-04-20T22:12:10.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.484+0000 7f387e000640 1 -- 172.21.15.142:0/483914067 learned_addr learned my addr 172.21.15.142:0/483914067 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:10.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.484+0000 7f387ea00640 1 --2- 172.21.15.142:0/483914067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38800726d0 0x7f388019dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:10.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.484+0000 7f387e000640 1 -- 172.21.15.142:0/483914067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38800726d0 msgr2=0x7f388019dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:10.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.484+0000 7f387e000640 1 --2- 172.21.15.142:0/483914067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38800726d0 0x7f388019dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:10.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.484+0000 7f387e000640 1 -- 172.21.15.142:0/483914067 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3870009560 con 0x7f3880072ff0 2024-04-20T22:12:10.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.485+0000 7f387e000640 1 --2- 172.21.15.142:0/483914067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3880072ff0 0x7f388019e000 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f386800ea00 tx=0x7f386800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:10.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.485+0000 7f3877400640 1 -- 172.21.15.142:0/483914067 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f386800cd50 con 0x7f3880072ff0 2024-04-20T22:12:10.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.485+0000 7f3877400640 1 -- 172.21.15.142:0/483914067 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3868005020 con 0x7f3880072ff0 2024-04-20T22:12:10.485 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.485+0000 7f387fe00640 1 -- 172.21.15.142:0/483914067 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3880197f80 con 0x7f3880072ff0 2024-04-20T22:12:10.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.485+0000 7f3877400640 1 -- 172.21.15.142:0/483914067 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38680116a0 con 0x7f3880072ff0 2024-04-20T22:12:10.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.485+0000 7f387fe00640 1 -- 172.21.15.142:0/483914067 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38801984e0 con 0x7f3880072ff0 2024-04-20T22:12:10.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.487+0000 7f387fe00640 1 -- 172.21.15.142:0/483914067 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f388004e890 con 0x7f3880072ff0 2024-04-20T22:12:10.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.488+0000 7f3877400640 1 -- 172.21.15.142:0/483914067 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f3868005190 con 0x7f3880072ff0 2024-04-20T22:12:10.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.489+0000 7f3877400640 1 --2- 172.21.15.142:0/483914067 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f386006ec80 0x7f3860071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:10.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.489+0000 7f3877400640 1 -- 172.21.15.142:0/483914067 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f386808f320 con 0x7f3880072ff0 2024-04-20T22:12:10.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.489+0000 7f387ea00640 1 --2- 172.21.15.142:0/483914067 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f386006ec80 0x7f3860071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:10.489 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.490+0000 7f387ea00640 1 --2- 172.21.15.142:0/483914067 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f386006ec80 0x7f3860071140 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3870005ab0 tx=0x7f3870005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:10.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.494+0000 7f3877400640 1 -- 172.21.15.142:0/483914067 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f3868057fd0 con 0x7f3880072ff0 2024-04-20T22:12:10.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.725+0000 7f387fe00640 1 -- 172.21.15.142:0/483914067 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f38801990e0 con 0x7f3880072ff0 2024-04-20T22:12:10.726 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.726+0000 7f3877400640 1 -- 172.21.15.142:0/483914067 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v35) v1 ==== 107+0+4298 (secure 0 0 0) 0x7f386807ae60 con 0x7f3880072ff0 2024-04-20T22:12:10.726 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:10.726 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34454,"name":"cephfs.smithi142.lirkws","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6827/2100080187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2100080187},{"type":"v1","addr":"172.21.15.142:6827","nonce":2100080187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34486,"name":"cephfs.smithi142.lrvfgg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6829/2960234081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2960234081},{"type":"v1","addr":"172.21.15.142:6829","nonce":2960234081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44319,"name":"cephfs.smithi164.ybvzha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6825/1951894011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951894011},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951894011}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:07:22.811529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-20T22:12:10.727 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 30 2024-04-20T22:12:10.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.729+0000 7f387fe00640 1 -- 172.21.15.142:0/483914067 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f386006ec80 msgr2=0x7f3860071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:10.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.729+0000 7f387fe00640 1 --2- 172.21.15.142:0/483914067 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f386006ec80 0x7f3860071140 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3870005ab0 tx=0x7f3870005a20 comp rx=0 tx=0).stop 2024-04-20T22:12:10.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.729+0000 7f387fe00640 1 -- 172.21.15.142:0/483914067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3880072ff0 msgr2=0x7f388019e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:10.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.729+0000 7f387fe00640 1 --2- 172.21.15.142:0/483914067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3880072ff0 0x7f388019e000 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f386800ea00 tx=0x7f386800eec0 comp rx=0 tx=0).stop 2024-04-20T22:12:10.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.729+0000 7f387fe00640 1 -- 172.21.15.142:0/483914067 shutdown_connections 2024-04-20T22:12:10.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.729+0000 7f387fe00640 1 --2- 172.21.15.142:0/483914067 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f386006ec80 0x7f3860071140 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:10.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.729+0000 7f387fe00640 1 --2- 172.21.15.142:0/483914067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3880072ff0 0x7f388019e000 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:10.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.729+0000 7f387fe00640 1 --2- 172.21.15.142:0/483914067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38800726d0 0x7f388019dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:10.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.729+0000 7f387fe00640 1 -- 172.21.15.142:0/483914067 >> 172.21.15.142:0/483914067 conn(0x7f38800fb960 msgr2=0x7f38801069b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:10.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.729+0000 7f387fe00640 1 -- 172.21.15.142:0/483914067 shutdown_connections 2024-04-20T22:12:10.729 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.729+0000 7f387fe00640 1 -- 172.21.15.142:0/483914067 wait complete. 2024-04-20T22:12:10.745 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-04-20T22:12:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.934+0000 7f501cc00640 1 -- 172.21.15.142:0/4043798704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50181000e0 msgr2=0x7f50181004c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.934+0000 7f501cc00640 1 --2- 172.21.15.142:0/4043798704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50181000e0 0x7f50181004c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5008009c20 tx=0x7f500802c1b0 comp rx=0 tx=0).stop 2024-04-20T22:12:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.934+0000 7f501cc00640 1 -- 172.21.15.142:0/4043798704 shutdown_connections 2024-04-20T22:12:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.934+0000 7f501cc00640 1 --2- 172.21.15.142:0/4043798704 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5018100a90 0x7f5018104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.934+0000 7f501cc00640 1 --2- 172.21.15.142:0/4043798704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50181000e0 0x7f50181004c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.934+0000 7f501cc00640 1 -- 172.21.15.142:0/4043798704 >> 172.21.15.142:0/4043798704 conn(0x7f50180fb960 msgr2=0x7f50180fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.934+0000 7f501cc00640 1 -- 172.21.15.142:0/4043798704 shutdown_connections 2024-04-20T22:12:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.934+0000 7f501cc00640 1 -- 172.21.15.142:0/4043798704 wait complete. 2024-04-20T22:12:10.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.935+0000 7f501cc00640 1 Processor -- start 2024-04-20T22:12:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.935+0000 7f501cc00640 1 -- start start 2024-04-20T22:12:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.935+0000 7f501cc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50181000e0 0x7f5018197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.935+0000 7f501cc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50181982a0 0x7f501819c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.935+0000 7f501cc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50181988a0 con 0x7f50181982a0 2024-04-20T22:12:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.935+0000 7f501cc00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5018198a10 con 0x7f50181000e0 2024-04-20T22:12:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.936+0000 7f5016a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50181982a0 0x7f501819c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.936+0000 7f5016a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50181982a0 0x7f501819c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41264/0 (socket says 172.21.15.142:41264) 2024-04-20T22:12:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.936+0000 7f5016a00640 1 -- 172.21.15.142:0/202176710 learned_addr learned my addr 172.21.15.142:0/202176710 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.936+0000 7f5017400640 1 --2- 172.21.15.142:0/202176710 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50181000e0 0x7f5018197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.936+0000 7f5016a00640 1 -- 172.21.15.142:0/202176710 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50181000e0 msgr2=0x7f5018197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.936+0000 7f5016a00640 1 --2- 172.21.15.142:0/202176710 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50181000e0 0x7f5018197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.936+0000 7f5016a00640 1 -- 172.21.15.142:0/202176710 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5008009900 con 0x7f50181982a0 2024-04-20T22:12:10.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.936+0000 7f5016a00640 1 --2- 172.21.15.142:0/202176710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50181982a0 0x7f501819c700 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f500000d6f0 tx=0x7f500000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:10.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.937+0000 7f500fe00640 1 -- 172.21.15.142:0/202176710 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50000051f0 con 0x7f50181982a0 2024-04-20T22:12:10.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.937+0000 7f500fe00640 1 -- 172.21.15.142:0/202176710 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5000009ce0 con 0x7f50181982a0 2024-04-20T22:12:10.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.937+0000 7f501cc00640 1 -- 172.21.15.142:0/202176710 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501819cd00 con 0x7f50181982a0 2024-04-20T22:12:10.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.937+0000 7f500fe00640 1 -- 172.21.15.142:0/202176710 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5000004e80 con 0x7f50181982a0 2024-04-20T22:12:10.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.937+0000 7f501cc00640 1 -- 172.21.15.142:0/202176710 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501819d260 con 0x7f50181982a0 2024-04-20T22:12:10.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.938+0000 7f501cc00640 1 -- 172.21.15.142:0/202176710 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f501819d530 con 0x7f50181982a0 2024-04-20T22:12:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.939+0000 7f500fe00640 1 -- 172.21.15.142:0/202176710 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f50000046c0 con 0x7f50181982a0 2024-04-20T22:12:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.940+0000 7f500fe00640 1 --2- 172.21.15.142:0/202176710 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4ffc06ec80 0x7f4ffc071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.940+0000 7f500fe00640 1 -- 172.21.15.142:0/202176710 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f500008e9b0 con 0x7f50181982a0 2024-04-20T22:12:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.940+0000 7f5017400640 1 --2- 172.21.15.142:0/202176710 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4ffc06ec80 0x7f4ffc071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:10.941 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.941+0000 7f5017400640 1 --2- 172.21.15.142:0/202176710 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4ffc06ec80 0x7f4ffc071140 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5008000f80 tx=0x7f5008009360 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:10.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:10.945+0000 7f500fe00640 1 -- 172.21.15.142:0/202176710 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f5000057640 con 0x7f50181982a0 2024-04-20T22:12:11.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.193+0000 7f501cc00640 1 -- 172.21.15.142:0/202176710 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f5018199190 con 0x7f50181982a0 2024-04-20T22:12:11.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.197+0000 7f500fe00640 1 -- 172.21.15.142:0/202176710 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v35) v1 ==== 107+0+4377 (secure 0 0 0) 0x7f5018199190 con 0x7f50181982a0 2024-04-20T22:12:11.197 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:11.197 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34486,"name":"cephfs.smithi142.lrvfgg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6829/2960234081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2960234081},{"type":"v1","addr":"172.21.15.142:6829","nonce":2960234081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44319,"name":"cephfs.smithi164.ybvzha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6825/1951894011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951894011},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951894011}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:07:22.823508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34454":{"gid":34454,"name":"cephfs.smithi142.lirkws","rank":0,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.142:6827/2100080187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2100080187},{"type":"v1","addr":"172.21.15.142:6827","nonce":2100080187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-20T22:12:11.197 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 31 2024-04-20T22:12:11.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.200+0000 7f501cc00640 1 -- 172.21.15.142:0/202176710 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4ffc06ec80 msgr2=0x7f4ffc071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:11.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.200+0000 7f501cc00640 1 --2- 172.21.15.142:0/202176710 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4ffc06ec80 0x7f4ffc071140 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5008000f80 tx=0x7f5008009360 comp rx=0 tx=0).stop 2024-04-20T22:12:11.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.200+0000 7f501cc00640 1 -- 172.21.15.142:0/202176710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50181982a0 msgr2=0x7f501819c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:11.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.200+0000 7f501cc00640 1 --2- 172.21.15.142:0/202176710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50181982a0 0x7f501819c700 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f500000d6f0 tx=0x7f500000dbb0 comp rx=0 tx=0).stop 2024-04-20T22:12:11.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.200+0000 7f501cc00640 1 -- 172.21.15.142:0/202176710 shutdown_connections 2024-04-20T22:12:11.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.200+0000 7f501cc00640 1 --2- 172.21.15.142:0/202176710 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f4ffc06ec80 0x7f4ffc071140 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:11.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.200+0000 7f501cc00640 1 --2- 172.21.15.142:0/202176710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50181982a0 0x7f501819c700 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:11.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.200+0000 7f501cc00640 1 --2- 172.21.15.142:0/202176710 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50181000e0 0x7f5018197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:11.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.200+0000 7f501cc00640 1 -- 172.21.15.142:0/202176710 >> 172.21.15.142:0/202176710 conn(0x7f50180fb960 msgr2=0x7f50180fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:11.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.200+0000 7f501cc00640 1 -- 172.21.15.142:0/202176710 shutdown_connections 2024-04-20T22:12:11.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.200+0000 7f501cc00640 1 -- 172.21.15.142:0/202176710 wait complete. 2024-04-20T22:12:11.219 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-04-20T22:12:11.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.400+0000 7feeaf200640 1 -- 172.21.15.142:0/3556513419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb0067350 msgr2=0x7feeb0067730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:11.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.400+0000 7feeaf200640 1 --2- 172.21.15.142:0/3556513419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb0067350 0x7feeb0067730 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fee98009880 tx=0x7fee9802bd30 comp rx=0 tx=0).stop 2024-04-20T22:12:11.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.400+0000 7feeaf200640 1 -- 172.21.15.142:0/3556513419 shutdown_connections 2024-04-20T22:12:11.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.400+0000 7feeaf200640 1 --2- 172.21.15.142:0/3556513419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb0067c70 0x7feeb010c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:11.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.400+0000 7feeaf200640 1 --2- 172.21.15.142:0/3556513419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb0067350 0x7feeb0067730 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:11.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.400+0000 7feeaf200640 1 -- 172.21.15.142:0/3556513419 >> 172.21.15.142:0/3556513419 conn(0x7feeb00748e0 msgr2=0x7feeb0074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:11.400 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.400+0000 7feeaf200640 1 -- 172.21.15.142:0/3556513419 shutdown_connections 2024-04-20T22:12:11.401 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.400+0000 7feeaf200640 1 -- 172.21.15.142:0/3556513419 wait complete. 2024-04-20T22:12:11.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.401+0000 7feeaf200640 1 Processor -- start 2024-04-20T22:12:11.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.401+0000 7feeaf200640 1 -- start start 2024-04-20T22:12:11.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.402+0000 7feeaf200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb0067350 0x7feeb019da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:11.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.402+0000 7feeaf200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb0067c70 0x7feeb019dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:11.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.402+0000 7feeaf200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0197ae0 con 0x7feeb0067350 2024-04-20T22:12:11.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.402+0000 7feeaf200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0197c50 con 0x7feeb0067c70 2024-04-20T22:12:11.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.402+0000 7feeade00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb0067350 0x7feeb019da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:11.402 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.402+0000 7feeade00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb0067350 0x7feeb019da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41284/0 (socket says 172.21.15.142:41284) 2024-04-20T22:12:11.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.402+0000 7feeade00640 1 -- 172.21.15.142:0/3886111390 learned_addr learned my addr 172.21.15.142:0/3886111390 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:11.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.402+0000 7feea5400640 1 --2- 172.21.15.142:0/3886111390 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb0067c70 0x7feeb019dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:11.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.402+0000 7feeade00640 1 -- 172.21.15.142:0/3886111390 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb0067c70 msgr2=0x7feeb019dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:11.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.402+0000 7feeade00640 1 --2- 172.21.15.142:0/3886111390 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb0067c70 0x7feeb019dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:11.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.402+0000 7feeade00640 1 -- 172.21.15.142:0/3886111390 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee98009560 con 0x7feeb0067350 2024-04-20T22:12:11.403 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.403+0000 7feeade00640 1 --2- 172.21.15.142:0/3886111390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb0067350 0x7feeb019da70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fee98036040 tx=0x7fee9802c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:11.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.403+0000 7feea7400640 1 -- 172.21.15.142:0/3886111390 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee98004520 con 0x7feeb0067350 2024-04-20T22:12:11.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.403+0000 7feea7400640 1 -- 172.21.15.142:0/3886111390 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee98003ab0 con 0x7feeb0067350 2024-04-20T22:12:11.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.403+0000 7feeaf200640 1 -- 172.21.15.142:0/3886111390 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb0197ed0 con 0x7feeb0067350 2024-04-20T22:12:11.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.403+0000 7feea7400640 1 -- 172.21.15.142:0/3886111390 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee980055d0 con 0x7feeb0067350 2024-04-20T22:12:11.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.403+0000 7feeaf200640 1 -- 172.21.15.142:0/3886111390 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb0198430 con 0x7feeb0067350 2024-04-20T22:12:11.404 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.404+0000 7feeaf200640 1 -- 172.21.15.142:0/3886111390 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb004e890 con 0x7feeb0067350 2024-04-20T22:12:11.405 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.405+0000 7feea7400640 1 -- 172.21.15.142:0/3886111390 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fee98004dd0 con 0x7feeb0067350 2024-04-20T22:12:11.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.407+0000 7feea7400640 1 --2- 172.21.15.142:0/3886111390 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fee9406ec80 0x7fee94071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:11.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.407+0000 7feea7400640 1 -- 172.21.15.142:0/3886111390 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fee980b1a30 con 0x7feeb0067350 2024-04-20T22:12:11.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.408+0000 7feea5400640 1 --2- 172.21.15.142:0/3886111390 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fee9406ec80 0x7fee94071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:11.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.408+0000 7feea5400640 1 --2- 172.21.15.142:0/3886111390 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fee9406ec80 0x7fee94071140 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feea0005fd0 tx=0x7feea0005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:11.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.412+0000 7feea7400640 1 -- 172.21.15.142:0/3886111390 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fee9807a6c0 con 0x7feeb0067350 2024-04-20T22:12:11.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:11 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1056567742' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-20T22:12:11.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:11 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/483914067' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-20T22:12:11.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:11 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/1056567742' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-20T22:12:11.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:11 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/483914067' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-20T22:12:11.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.647+0000 7feeaf200640 1 -- 172.21.15.142:0/3886111390 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7feeb0109b50 con 0x7feeb0067350 2024-04-20T22:12:11.648 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.648+0000 7feea7400640 1 -- 172.21.15.142:0/3886111390 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v35) v1 ==== 107+0+5227 (secure 0 0 0) 0x7fee9807dd80 con 0x7feeb0067350 2024-04-20T22:12:11.648 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:11.648 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34486,"name":"cephfs.smithi142.lrvfgg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6829/2960234081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2960234081},{"type":"v1","addr":"172.21.15.142:6829","nonce":2960234081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44319,"name":"cephfs.smithi164.ybvzha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6825/1951894011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951894011},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951894011}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44335,"name":"cephfs.smithi164.gmmrfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6827/3399966592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3399966592},{"type":"v1","addr":"172.21.15.164:6827","nonce":3399966592}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:07:22.823508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34454":{"gid":34454,"name":"cephfs.smithi142.lirkws","rank":0,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.142:6827/2100080187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2100080187},{"type":"v1","addr":"172.21.15.142:6827","nonce":2100080187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-20T22:12:11.648 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 32 2024-04-20T22:12:11.650 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.650+0000 7feeaf200640 1 -- 172.21.15.142:0/3886111390 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fee9406ec80 msgr2=0x7fee94071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:11.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.650+0000 7feeaf200640 1 --2- 172.21.15.142:0/3886111390 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fee9406ec80 0x7fee94071140 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feea0005fd0 tx=0x7feea0005850 comp rx=0 tx=0).stop 2024-04-20T22:12:11.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.650+0000 7feeaf200640 1 -- 172.21.15.142:0/3886111390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb0067350 msgr2=0x7feeb019da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:11.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.650+0000 7feeaf200640 1 --2- 172.21.15.142:0/3886111390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb0067350 0x7feeb019da70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fee98036040 tx=0x7fee9802c7b0 comp rx=0 tx=0).stop 2024-04-20T22:12:11.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.650+0000 7feeaf200640 1 -- 172.21.15.142:0/3886111390 shutdown_connections 2024-04-20T22:12:11.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.651+0000 7feeaf200640 1 --2- 172.21.15.142:0/3886111390 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fee9406ec80 0x7fee94071140 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:11.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.651+0000 7feeaf200640 1 --2- 172.21.15.142:0/3886111390 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb0067c70 0x7feeb019dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:11.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.651+0000 7feeaf200640 1 --2- 172.21.15.142:0/3886111390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeb0067350 0x7feeb019da70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:11.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.651+0000 7feeaf200640 1 -- 172.21.15.142:0/3886111390 >> 172.21.15.142:0/3886111390 conn(0x7feeb00748e0 msgr2=0x7feeb00fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:11.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.651+0000 7feeaf200640 1 -- 172.21.15.142:0/3886111390 shutdown_connections 2024-04-20T22:12:11.651 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.651+0000 7feeaf200640 1 -- 172.21.15.142:0/3886111390 wait complete. 2024-04-20T22:12:11.667 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-04-20T22:12:11.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.844+0000 7f65bf600640 1 -- 172.21.15.142:0/450801882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65b81024a0 msgr2=0x7f65b8102880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:11.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.844+0000 7f65bf600640 1 --2- 172.21.15.142:0/450801882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65b81024a0 0x7f65b8102880 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009880 tx=0x7f65ac02bce0 comp rx=0 tx=0).stop 2024-04-20T22:12:11.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.844+0000 7f65bf600640 1 -- 172.21.15.142:0/450801882 shutdown_connections 2024-04-20T22:12:11.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.844+0000 7f65bf600640 1 --2- 172.21.15.142:0/450801882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65b8102e50 0x7f65b8106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:11.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.844+0000 7f65bf600640 1 --2- 172.21.15.142:0/450801882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65b81024a0 0x7f65b8102880 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:11.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.844+0000 7f65bf600640 1 -- 172.21.15.142:0/450801882 >> 172.21.15.142:0/450801882 conn(0x7f65b80fdd00 msgr2=0x7f65b8100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:11.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.844+0000 7f65bf600640 1 -- 172.21.15.142:0/450801882 shutdown_connections 2024-04-20T22:12:11.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.844+0000 7f65bf600640 1 -- 172.21.15.142:0/450801882 wait complete. 2024-04-20T22:12:11.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.845+0000 7f65bf600640 1 Processor -- start 2024-04-20T22:12:11.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.845+0000 7f65bf600640 1 -- start start 2024-04-20T22:12:11.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.845+0000 7f65bf600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65b81024a0 0x7f65b8197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:11.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.845+0000 7f65bf600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65b81983c0 0x7f65b819c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:11.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.845+0000 7f65bf600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b81989c0 con 0x7f65b81983c0 2024-04-20T22:12:11.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.845+0000 7f65bf600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b8198b30 con 0x7f65b81024a0 2024-04-20T22:12:11.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.846+0000 7f65b7e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65b81983c0 0x7f65b819c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:11.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.846+0000 7f65b7e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65b81983c0 0x7f65b819c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41296/0 (socket says 172.21.15.142:41296) 2024-04-20T22:12:11.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.846+0000 7f65b7e00640 1 -- 172.21.15.142:0/4114316791 learned_addr learned my addr 172.21.15.142:0/4114316791 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:11.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.846+0000 7f65bcc00640 1 --2- 172.21.15.142:0/4114316791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65b81024a0 0x7f65b8197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:11.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.846+0000 7f65b7e00640 1 -- 172.21.15.142:0/4114316791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65b81024a0 msgr2=0x7f65b8197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:11.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.846+0000 7f65b7e00640 1 --2- 172.21.15.142:0/4114316791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65b81024a0 0x7f65b8197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:11.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.846+0000 7f65b7e00640 1 -- 172.21.15.142:0/4114316791 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac009560 con 0x7f65b81983c0 2024-04-20T22:12:11.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.847+0000 7f65b7e00640 1 --2- 172.21.15.142:0/4114316791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65b81983c0 0x7f65b819c820 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f65a400c920 tx=0x7f65a400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:11.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.847+0000 7f65b5600640 1 -- 172.21.15.142:0/4114316791 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65a4007b80 con 0x7f65b81983c0 2024-04-20T22:12:11.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.847+0000 7f65b5600640 1 -- 172.21.15.142:0/4114316791 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f65a4007ce0 con 0x7f65b81983c0 2024-04-20T22:12:11.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.847+0000 7f65b5600640 1 -- 172.21.15.142:0/4114316791 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65a40187d0 con 0x7f65b81983c0 2024-04-20T22:12:11.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.847+0000 7f65bf600640 1 -- 172.21.15.142:0/4114316791 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b819ce20 con 0x7f65b81983c0 2024-04-20T22:12:11.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.847+0000 7f65bf600640 1 -- 172.21.15.142:0/4114316791 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b819d380 con 0x7f65b81983c0 2024-04-20T22:12:11.848 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.848+0000 7f65bf600640 1 -- 172.21.15.142:0/4114316791 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b804e040 con 0x7f65b81983c0 2024-04-20T22:12:11.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.849+0000 7f65b5600640 1 -- 172.21.15.142:0/4114316791 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f65a400f450 con 0x7f65b81983c0 2024-04-20T22:12:11.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.850+0000 7f65b5600640 1 --2- 172.21.15.142:0/4114316791 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f65a006ecf0 0x7f65a00711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:11.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.850+0000 7f65b5600640 1 -- 172.21.15.142:0/4114316791 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f65a408f100 con 0x7f65b81983c0 2024-04-20T22:12:11.850 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.851+0000 7f65bcc00640 1 --2- 172.21.15.142:0/4114316791 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f65a006ecf0 0x7f65a00711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:11.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.851+0000 7f65bcc00640 1 --2- 172.21.15.142:0/4114316791 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f65a006ecf0 0x7f65a00711b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f65ac000c00 tx=0x7f65ac02cf90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:11.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:11.856+0000 7f65b5600640 1 -- 172.21.15.142:0/4114316791 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f65a4057d90 con 0x7f65b81983c0 2024-04-20T22:12:12.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.102+0000 7f65bf600640 1 -- 172.21.15.142:0/4114316791 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f65b81992f0 con 0x7f65b81983c0 2024-04-20T22:12:12.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.103+0000 7f65b5600640 1 -- 172.21.15.142:0/4114316791 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v35) v1 ==== 107+0+5231 (secure 0 0 0) 0x7f65a405b450 con 0x7f65b81983c0 2024-04-20T22:12:12.103 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:12.103 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34486,"name":"cephfs.smithi142.lrvfgg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6829/2960234081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2960234081},{"type":"v1","addr":"172.21.15.142:6829","nonce":2960234081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44319,"name":"cephfs.smithi164.ybvzha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6825/1951894011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951894011},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951894011}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44335,"name":"cephfs.smithi164.gmmrfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6827/3399966592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3399966592},{"type":"v1","addr":"172.21.15.164:6827","nonce":3399966592}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:07:31.216055+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34454":{"gid":34454,"name":"cephfs.smithi142.lirkws","rank":0,"incarnation":31,"state":"up:reconnect","state_seq":24,"addr":"172.21.15.142:6827/2100080187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2100080187},{"type":"v1","addr":"172.21.15.142:6827","nonce":2100080187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-20T22:12:12.104 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 33 2024-04-20T22:12:12.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.106+0000 7f65bf600640 1 -- 172.21.15.142:0/4114316791 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f65a006ecf0 msgr2=0x7f65a00711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:12.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.106+0000 7f65bf600640 1 --2- 172.21.15.142:0/4114316791 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f65a006ecf0 0x7f65a00711b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f65ac000c00 tx=0x7f65ac02cf90 comp rx=0 tx=0).stop 2024-04-20T22:12:12.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.106+0000 7f65bf600640 1 -- 172.21.15.142:0/4114316791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65b81983c0 msgr2=0x7f65b819c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:12.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.106+0000 7f65bf600640 1 --2- 172.21.15.142:0/4114316791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65b81983c0 0x7f65b819c820 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f65a400c920 tx=0x7f65a400cde0 comp rx=0 tx=0).stop 2024-04-20T22:12:12.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.106+0000 7f65bf600640 1 -- 172.21.15.142:0/4114316791 shutdown_connections 2024-04-20T22:12:12.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.106+0000 7f65bf600640 1 --2- 172.21.15.142:0/4114316791 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f65a006ecf0 0x7f65a00711b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:12.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.106+0000 7f65bf600640 1 --2- 172.21.15.142:0/4114316791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65b81983c0 0x7f65b819c820 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:12.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.106+0000 7f65bf600640 1 --2- 172.21.15.142:0/4114316791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65b81024a0 0x7f65b8197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:12.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.106+0000 7f65bf600640 1 -- 172.21.15.142:0/4114316791 >> 172.21.15.142:0/4114316791 conn(0x7f65b80fdd00 msgr2=0x7f65b80ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:12.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.106+0000 7f65bf600640 1 -- 172.21.15.142:0/4114316791 shutdown_connections 2024-04-20T22:12:12.107 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.106+0000 7f65bf600640 1 -- 172.21.15.142:0/4114316791 wait complete. 2024-04-20T22:12:12.124 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-04-20T22:12:12.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.318+0000 7f1927200640 1 -- 172.21.15.142:0/818887817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19281022a0 msgr2=0x7f1928102680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:12.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.318+0000 7f1927200640 1 --2- 172.21.15.142:0/818887817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19281022a0 0x7f1928102680 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1918009880 tx=0x7f191802bce0 comp rx=0 tx=0).stop 2024-04-20T22:12:12.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.318+0000 7f1927200640 1 -- 172.21.15.142:0/818887817 shutdown_connections 2024-04-20T22:12:12.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.318+0000 7f1927200640 1 --2- 172.21.15.142:0/818887817 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1928102c50 0x7f1928106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:12.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.318+0000 7f1927200640 1 --2- 172.21.15.142:0/818887817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19281022a0 0x7f1928102680 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:12.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.318+0000 7f1927200640 1 -- 172.21.15.142:0/818887817 >> 172.21.15.142:0/818887817 conn(0x7f19280fdb20 msgr2=0x7f19280fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:12.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.318+0000 7f1927200640 1 -- 172.21.15.142:0/818887817 shutdown_connections 2024-04-20T22:12:12.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.318+0000 7f1927200640 1 -- 172.21.15.142:0/818887817 wait complete. 2024-04-20T22:12:12.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.319+0000 7f1927200640 1 Processor -- start 2024-04-20T22:12:12.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.319+0000 7f1927200640 1 -- start start 2024-04-20T22:12:12.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.319+0000 7f1927200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19281022a0 0x7f1928197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:12.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.319+0000 7f1927200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19281982d0 0x7f192819c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:12.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.319+0000 7f1927200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19281988d0 con 0x7f19281982d0 2024-04-20T22:12:12.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.319+0000 7f1927200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1928198a40 con 0x7f19281022a0 2024-04-20T22:12:12.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.319+0000 7f1925400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19281982d0 0x7f192819c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:12.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.319+0000 7f1925400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19281982d0 0x7f192819c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41328/0 (socket says 172.21.15.142:41328) 2024-04-20T22:12:12.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.319+0000 7f1925400640 1 -- 172.21.15.142:0/3160650501 learned_addr learned my addr 172.21.15.142:0/3160650501 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:12.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.320+0000 7f1925e00640 1 --2- 172.21.15.142:0/3160650501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19281022a0 0x7f1928197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:12.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.320+0000 7f1925400640 1 -- 172.21.15.142:0/3160650501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19281022a0 msgr2=0x7f1928197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:12.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.320+0000 7f1925400640 1 --2- 172.21.15.142:0/3160650501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19281022a0 0x7f1928197d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:12.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.320+0000 7f1925400640 1 -- 172.21.15.142:0/3160650501 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1918009560 con 0x7f19281982d0 2024-04-20T22:12:12.322 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.320+0000 7f1925400640 1 --2- 172.21.15.142:0/3160650501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19281982d0 0x7f192819c730 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f191400c920 tx=0x7f191400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.320+0000 7f191ea00640 1 -- 172.21.15.142:0/3160650501 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1914007b80 con 0x7f19281982d0 2024-04-20T22:12:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.320+0000 7f191ea00640 1 -- 172.21.15.142:0/3160650501 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f19140054e0 con 0x7f19281982d0 2024-04-20T22:12:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.320+0000 7f1927200640 1 -- 172.21.15.142:0/3160650501 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192819cd30 con 0x7f19281982d0 2024-04-20T22:12:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.320+0000 7f191ea00640 1 -- 172.21.15.142:0/3160650501 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f191400f450 con 0x7f19281982d0 2024-04-20T22:12:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.321+0000 7f1927200640 1 -- 172.21.15.142:0/3160650501 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192819d290 con 0x7f19281982d0 2024-04-20T22:12:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.322+0000 7f1927200640 1 -- 172.21.15.142:0/3160650501 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192819d570 con 0x7f19281982d0 2024-04-20T22:12:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.323+0000 7f191ea00640 1 -- 172.21.15.142:0/3160650501 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f19140046c0 con 0x7f19281982d0 2024-04-20T22:12:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.324+0000 7f191ea00640 1 --2- 172.21.15.142:0/3160650501 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f190c06ec80 0x7f190c071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.324+0000 7f191ea00640 1 -- 172.21.15.142:0/3160650501 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f191408ee60 con 0x7f19281982d0 2024-04-20T22:12:12.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.324+0000 7f1925e00640 1 --2- 172.21.15.142:0/3160650501 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f190c06ec80 0x7f190c071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:12.325 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.325+0000 7f1925e00640 1 --2- 172.21.15.142:0/3160650501 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f190c06ec80 0x7f190c071140 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1918036040 tx=0x7f191802cf90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:12.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.329+0000 7f191ea00640 1 -- 172.21.15.142:0/3160650501 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f1914057a70 con 0x7f19281982d0 2024-04-20T22:12:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:12 smithi164 ceph-mon[69784]: pgmap v396: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:12 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/202176710' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-20T22:12:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:12 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3886111390' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-20T22:12:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:12 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/4114316791' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-20T22:12:12.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:12 smithi142 ceph-mon[79401]: pgmap v396: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:12.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:12 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/202176710' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-20T22:12:12.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:12 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3886111390' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-20T22:12:12.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:12 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/4114316791' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-20T22:12:12.562 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.563+0000 7f1927200640 1 -- 172.21.15.142:0/3160650501 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f19281990e0 con 0x7f19281982d0 2024-04-20T22:12:12.564 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.564+0000 7f191ea00640 1 -- 172.21.15.142:0/3160650501 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v35) v1 ==== 107+0+5228 (secure 0 0 0) 0x7f191405b130 con 0x7f19281982d0 2024-04-20T22:12:12.564 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:12.564 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34486,"name":"cephfs.smithi142.lrvfgg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6829/2960234081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2960234081},{"type":"v1","addr":"172.21.15.142:6829","nonce":2960234081}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44319,"name":"cephfs.smithi164.ybvzha","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6825/1951894011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951894011},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951894011}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44335,"name":"cephfs.smithi164.gmmrfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6827/3399966592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3399966592},{"type":"v1","addr":"172.21.15.164:6827","nonce":3399966592}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T21:54:30.428853+0000","modified":"2024-04-20T22:07:32.216113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34454":{"gid":34454,"name":"cephfs.smithi142.lirkws","rank":0,"incarnation":31,"state":"up:rejoin","state_seq":25,"addr":"172.21.15.142:6827/2100080187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2100080187},{"type":"v1","addr":"172.21.15.142:6827","nonce":2100080187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-20T22:12:12.564 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 34 2024-04-20T22:12:12.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.566+0000 7f1927200640 1 -- 172.21.15.142:0/3160650501 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f190c06ec80 msgr2=0x7f190c071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:12.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.566+0000 7f1927200640 1 --2- 172.21.15.142:0/3160650501 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f190c06ec80 0x7f190c071140 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1918036040 tx=0x7f191802cf90 comp rx=0 tx=0).stop 2024-04-20T22:12:12.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.566+0000 7f1927200640 1 -- 172.21.15.142:0/3160650501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19281982d0 msgr2=0x7f192819c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:12.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.566+0000 7f1927200640 1 --2- 172.21.15.142:0/3160650501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19281982d0 0x7f192819c730 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f191400c920 tx=0x7f191400cde0 comp rx=0 tx=0).stop 2024-04-20T22:12:12.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.567+0000 7f1927200640 1 -- 172.21.15.142:0/3160650501 shutdown_connections 2024-04-20T22:12:12.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.567+0000 7f1927200640 1 --2- 172.21.15.142:0/3160650501 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f190c06ec80 0x7f190c071140 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:12.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.567+0000 7f1927200640 1 --2- 172.21.15.142:0/3160650501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19281982d0 0x7f192819c730 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:12.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.567+0000 7f1927200640 1 --2- 172.21.15.142:0/3160650501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19281022a0 0x7f1928197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:12.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.567+0000 7f1927200640 1 -- 172.21.15.142:0/3160650501 >> 172.21.15.142:0/3160650501 conn(0x7f19280fdb20 msgr2=0x7f19280ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:12.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.567+0000 7f1927200640 1 -- 172.21.15.142:0/3160650501 shutdown_connections 2024-04-20T22:12:12.567 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.567+0000 7f1927200640 1 -- 172.21.15.142:0/3160650501 wait complete. 2024-04-20T22:12:12.584 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-20T22:12:12.596 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-20T22:12:12.596 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-20T22:12:12.596 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T22:12:12.648 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-20T22:12:12.648 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T22:12:12.691 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T22:12:12.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.933+0000 7fbdb7c00640 1 -- 172.21.15.142:0/38890825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdb01066a0 msgr2=0x7fbdb0106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:12.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.933+0000 7fbdb7c00640 1 --2- 172.21.15.142:0/38890825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdb01066a0 0x7fbdb0106b20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009880 tx=0x7fbd9802bce0 comp rx=0 tx=0).stop 2024-04-20T22:12:12.933 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.933+0000 7fbdb7c00640 1 -- 172.21.15.142:0/38890825 shutdown_connections 2024-04-20T22:12:12.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.933+0000 7fbdb7c00640 1 --2- 172.21.15.142:0/38890825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdb01066a0 0x7fbdb0106b20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:12.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.933+0000 7fbdb7c00640 1 --2- 172.21.15.142:0/38890825 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdb010c660 0x7fbdb010ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:12.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.933+0000 7fbdb7c00640 1 -- 172.21.15.142:0/38890825 >> 172.21.15.142:0/38890825 conn(0x7fbdb0075e80 msgr2=0x7fbdb00782a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:12.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.933+0000 7fbdb7c00640 1 -- 172.21.15.142:0/38890825 shutdown_connections 2024-04-20T22:12:12.934 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.933+0000 7fbdb7c00640 1 -- 172.21.15.142:0/38890825 wait complete. 2024-04-20T22:12:12.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.935+0000 7fbdb7c00640 1 Processor -- start 2024-04-20T22:12:12.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.935+0000 7fbdb7c00640 1 -- start start 2024-04-20T22:12:12.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.935+0000 7fbdb7c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdb01066a0 0x7fbdb019c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:12.935 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.935+0000 7fbdb7c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdb010c660 0x7fbdb019c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:12.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.935+0000 7fbdb7c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb019cfa0 con 0x7fbdb01066a0 2024-04-20T22:12:12.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.935+0000 7fbdb7c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb01a0d70 con 0x7fbdb010c660 2024-04-20T22:12:12.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.935+0000 7fbdb5200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdb01066a0 0x7fbdb019c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:12.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.936+0000 7fbdb5200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdb01066a0 0x7fbdb019c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41352/0 (socket says 172.21.15.142:41352) 2024-04-20T22:12:12.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.936+0000 7fbdb5200640 1 -- 172.21.15.142:0/3289271638 learned_addr learned my addr 172.21.15.142:0/3289271638 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:12.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.936+0000 7fbda7e00640 1 --2- 172.21.15.142:0/3289271638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdb010c660 0x7fbdb019c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:12.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.936+0000 7fbdb5200640 1 -- 172.21.15.142:0/3289271638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdb010c660 msgr2=0x7fbdb019c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:12.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.936+0000 7fbdb5200640 1 --2- 172.21.15.142:0/3289271638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdb010c660 0x7fbdb019c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:12.936 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.936+0000 7fbdb5200640 1 -- 172.21.15.142:0/3289271638 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd98009560 con 0x7fbdb01066a0 2024-04-20T22:12:12.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.936+0000 7fbdb5200640 1 --2- 172.21.15.142:0/3289271638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdb01066a0 0x7fbdb019c3d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbda000b420 tx=0x7fbda000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:12.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.936+0000 7fbdae000640 1 -- 172.21.15.142:0/3289271638 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbda0011800 con 0x7fbdb01066a0 2024-04-20T22:12:12.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.937+0000 7fbdae000640 1 -- 172.21.15.142:0/3289271638 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbda0011e20 con 0x7fbdb01066a0 2024-04-20T22:12:12.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.937+0000 7fbdb7c00640 1 -- 172.21.15.142:0/3289271638 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb01a1050 con 0x7fbdb01066a0 2024-04-20T22:12:12.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.937+0000 7fbdae000640 1 -- 172.21.15.142:0/3289271638 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbda000f2e0 con 0x7fbdb01066a0 2024-04-20T22:12:12.937 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.937+0000 7fbdb7c00640 1 -- 172.21.15.142:0/3289271638 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb01a15b0 con 0x7fbdb01066a0 2024-04-20T22:12:12.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.938+0000 7fbdb7c00640 1 -- 172.21.15.142:0/3289271638 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb004e040 con 0x7fbdb01066a0 2024-04-20T22:12:12.938 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.939+0000 7fbdae000640 1 -- 172.21.15.142:0/3289271638 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fbda0010380 con 0x7fbdb01066a0 2024-04-20T22:12:12.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.940+0000 7fbdae000640 1 --2- 172.21.15.142:0/3289271638 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fbd9406ecf0 0x7fbd940711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:12.939 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.940+0000 7fbdae000640 1 -- 172.21.15.142:0/3289271638 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fbda008e980 con 0x7fbdb01066a0 2024-04-20T22:12:12.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.940+0000 7fbda7e00640 1 --2- 172.21.15.142:0/3289271638 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fbd9406ecf0 0x7fbd940711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:12.940 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.941+0000 7fbda7e00640 1 --2- 172.21.15.142:0/3289271638 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fbd9406ecf0 0x7fbd940711b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbdb019d9e0 tx=0x7fbd98000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:12.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:12.945+0000 7fbdae000640 1 -- 172.21.15.142:0/3289271638 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fbda0057590 con 0x7fbdb01066a0 2024-04-20T22:12:13.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.145+0000 7fbdb7c00640 1 -- 172.21.15.142:0/3289271638 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdb0113940 con 0x7fbdb01066a0 2024-04-20T22:12:13.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.148+0000 7fbdae000640 1 -- 172.21.15.142:0/3289271638 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+17089 (secure 0 0 0) 0x7fbda0055e60 con 0x7fbdb01066a0 2024-04-20T22:12:13.148 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:13.148 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":85,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","created":"2024-04-20T21:45:27.213653+0000","modified":"2024-04-20T22:07:22.811117+0000","last_up_change":"2024-04-20T22:05:36.132962+0000","last_in_change":"2024-04-20T21:52:31.576977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:51:10.763901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-20T21:54:29.338742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-20T21:54:29.935422+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0042c600-a874-4d57-bb8f-7b6f32723bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":838783033},{"type":"v1","addr":"172.21.15.142:6803","nonce":838783033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":838783033},{"type":"v1","addr":"172.21.15.142:6805","nonce":838783033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":838783033},{"type":"v1","addr":"172.21.15.142:6809","nonce":838783033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":838783033},{"type":"v1","addr":"172.21.15.142:6807","nonce":838783033}]},"public_addr":"172.21.15.142:6803/838783033","cluster_addr":"172.21.15.142:6805/838783033","heartbeat_back_addr":"172.21.15.142:6809/838783033","heartbeat_front_addr":"172.21.15.142:6807/838783033","state":["exists","up"]},{"osd":1,"uuid":"29049537-368a-4d1f-b92c-21d962dd8031","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3789493679},{"type":"v1","addr":"172.21.15.142:6811","nonce":3789493679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3789493679},{"type":"v1","addr":"172.21.15.142:6813","nonce":3789493679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3789493679},{"type":"v1","addr":"172.21.15.142:6817","nonce":3789493679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3789493679},{"type":"v1","addr":"172.21.15.142:6815","nonce":3789493679}]},"public_addr":"172.21.15.142:6811/3789493679","cluster_addr":"172.21.15.142:6813/3789493679","heartbeat_back_addr":"172.21.15.142:6817/3789493679","heartbeat_front_addr":"172.21.15.142:6815/3789493679","state":["exists","up"]},{"osd":2,"uuid":"4ea8215b-dc6f-4f18-9d2c-5a5b21e02fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":4113404383},{"type":"v1","addr":"172.21.15.142:6819","nonce":4113404383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":4113404383},{"type":"v1","addr":"172.21.15.142:6821","nonce":4113404383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4113404383},{"type":"v1","addr":"172.21.15.142:6825","nonce":4113404383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":4113404383},{"type":"v1","addr":"172.21.15.142:6823","nonce":4113404383}]},"public_addr":"172.21.15.142:6819/4113404383","cluster_addr":"172.21.15.142:6821/4113404383","heartbeat_back_addr":"172.21.15.142:6825/4113404383","heartbeat_front_addr":"172.21.15.142:6823/4113404383","state":["exists","up"]},{"osd":3,"uuid":"981987e0-cff5-42e9-8129-2a08175c6ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2211531735},{"type":"v1","addr":"172.21.15.164:6801","nonce":2211531735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2211531735},{"type":"v1","addr":"172.21.15.164:6803","nonce":2211531735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2211531735},{"type":"v1","addr":"172.21.15.164:6807","nonce":2211531735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2211531735},{"type":"v1","addr":"172.21.15.164:6805","nonce":2211531735}]},"public_addr":"172.21.15.164:6801/2211531735","cluster_addr":"172.21.15.164:6803/2211531735","heartbeat_back_addr":"172.21.15.164:6807/2211531735","heartbeat_front_addr":"172.21.15.164:6805/2211531735","state":["exists","up"]},{"osd":4,"uuid":"a839fb7d-f82c-4bb0-8c33-b4f4f261bcae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":36,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":155884460},{"type":"v1","addr":"172.21.15.164:6809","nonce":155884460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":155884460},{"type":"v1","addr":"172.21.15.164:6811","nonce":155884460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":155884460},{"type":"v1","addr":"172.21.15.164:6815","nonce":155884460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":155884460},{"type":"v1","addr":"172.21.15.164:6813","nonce":155884460}]},"public_addr":"172.21.15.164:6809/155884460","cluster_addr":"172.21.15.164:6811/155884460","heartbeat_back_addr":"172.21.15.164:6815/155884460","heartbeat_front_addr":"172.21.15.164:6813/155884460","state":["exists","up"]},{"osd":5,"uuid":"72378e50-3a51-469d-a402-489d9bbfed7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":41,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3289958207},{"type":"v1","addr":"172.21.15.164:6817","nonce":3289958207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3289958207},{"type":"v1","addr":"172.21.15.164:6819","nonce":3289958207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3289958207},{"type":"v1","addr":"172.21.15.164:6823","nonce":3289958207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3289958207},{"type":"v1","addr":"172.21.15.164:6821","nonce":3289958207}]},"public_addr":"172.21.15.164:6817/3289958207","cluster_addr":"172.21.15.164:6819/3289958207","heartbeat_back_addr":"172.21.15.164:6823/3289958207","heartbeat_front_addr":"172.21.15.164:6821/3289958207","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:49:52.556673+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:50:29.868343+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:51:07.890840+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:51:43.365372+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:52:18.872393+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:52:54.318402+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:6827/3096926963":"2024-04-21T22:07:22.811065+0000","172.21.15.164:6825/4054029190":"2024-04-21T22:06:52.436542+0000","172.21.15.164:6824/4054029190":"2024-04-21T22:06:52.436542+0000","172.21.15.142:6829/3327440588":"2024-04-21T22:06:21.702075+0000","172.21.15.142:6828/3327440588":"2024-04-21T22:06:21.702075+0000","172.21.15.142:6827/2866697672":"2024-04-21T22:05:47.754237+0000","172.21.15.142:0/966681596":"2024-04-21T22:00:14.360617+0000","172.21.15.164:6826/3096926963":"2024-04-21T22:07:22.811065+0000","172.21.15.142:0/3515098784":"2024-04-21T21:48:09.914211+0000","172.21.15.142:6801/2803679129":"2024-04-21T21:46:01.678961+0000","172.21.15.142:0/99578737":"2024-04-21T21:57:21.903211+0000","172.21.15.142:0/195339089":"2024-04-21T21:48:09.914211+0000","172.21.15.142:6800/3610638500":"2024-04-21T21:57:21.903211+0000","172.21.15.142:6826/2866697672":"2024-04-21T22:05:47.754237+0000","172.21.15.142:0/1074487851":"2024-04-21T22:00:14.360617+0000","172.21.15.164:0/2404972195":"2024-04-21T21:58:50.797892+0000","172.21.15.142:0/3333243244":"2024-04-21T21:57:21.903211+0000","172.21.15.142:0/680486182":"2024-04-21T21:46:43.407590+0000","172.21.15.164:0/1385398224":"2024-04-21T21:58:50.797892+0000","172.21.15.142:0/3501876256":"2024-04-21T21:46:01.678961+0000","172.21.15.142:0/2483063574":"2024-04-21T21:57:21.903211+0000","172.21.15.142:0/4043640333":"2024-04-21T21:57:21.903211+0000","172.21.15.142:0/801898031":"2024-04-21T21:46:43.407590+0000","172.21.15.164:0/1190693155":"2024-04-21T21:58:50.797892+0000","172.21.15.164:0/3440297070":"2024-04-21T21:58:50.797892+0000","172.21.15.142:6800/2803679129":"2024-04-21T21:46:01.678961+0000","172.21.15.142:6800/54392364":"2024-04-21T22:00:14.360617+0000","172.21.15.142:0/1140713527":"2024-04-21T21:46:01.678961+0000","172.21.15.142:0/2707077921":"2024-04-21T22:00:14.360617+0000","172.21.15.142:0/1249568560":"2024-04-21T22:00:14.360617+0000","172.21.15.142:0/841637693":"2024-04-21T21:48:09.914211+0000","172.21.15.164:6829/929524464":"2024-04-21T21:58:50.797892+0000","172.21.15.142:6801/550675874":"2024-04-21T21:46:43.407590+0000","172.21.15.142:6801/3610638500":"2024-04-21T21:57:21.903211+0000","172.21.15.142:0/2901318326":"2024-04-21T21:46:01.678961+0000","172.21.15.164:0/716355240":"2024-04-21T21:58:50.797892+0000","172.21.15.142:6800/3464616902":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/4246233855":"2024-04-21T21:46:43.407590+0000","172.21.15.164:0/248046752":"2024-04-21T21:58:50.797892+0000","172.21.15.142:6800/550675874":"2024-04-21T21:46:43.407590+0000","172.21.15.142:6801/3464616902":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/540390027":"2024-04-21T22:00:14.360617+0000","172.21.15.142:0/1338478936":"2024-04-21T22:00:14.360617+0000","172.21.15.164:6828/929524464":"2024-04-21T21:58:50.797892+0000","172.21.15.142:6801/54392364":"2024-04-21T22:00:14.360617+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T22:12:13.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.153+0000 7fbdb7c00640 1 -- 172.21.15.142:0/3289271638 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fbd9406ecf0 msgr2=0x7fbd940711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:13.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.153+0000 7fbdb7c00640 1 --2- 172.21.15.142:0/3289271638 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fbd9406ecf0 0x7fbd940711b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbdb019d9e0 tx=0x7fbd98000bc0 comp rx=0 tx=0).stop 2024-04-20T22:12:13.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.153+0000 7fbdb7c00640 1 -- 172.21.15.142:0/3289271638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdb01066a0 msgr2=0x7fbdb019c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:13.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.153+0000 7fbdb7c00640 1 --2- 172.21.15.142:0/3289271638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdb01066a0 0x7fbdb019c3d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbda000b420 tx=0x7fbda000b8e0 comp rx=0 tx=0).stop 2024-04-20T22:12:13.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.153+0000 7fbdb7c00640 1 -- 172.21.15.142:0/3289271638 shutdown_connections 2024-04-20T22:12:13.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.153+0000 7fbdb7c00640 1 --2- 172.21.15.142:0/3289271638 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fbd9406ecf0 0x7fbd940711b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:13.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.153+0000 7fbdb7c00640 1 --2- 172.21.15.142:0/3289271638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdb010c660 0x7fbdb019c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:13.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.153+0000 7fbdb7c00640 1 --2- 172.21.15.142:0/3289271638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdb01066a0 0x7fbdb019c3d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:13.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.153+0000 7fbdb7c00640 1 -- 172.21.15.142:0/3289271638 >> 172.21.15.142:0/3289271638 conn(0x7fbdb0075e80 msgr2=0x7fbdb00768b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:13.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.153+0000 7fbdb7c00640 1 -- 172.21.15.142:0/3289271638 shutdown_connections 2024-04-20T22:12:13.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.153+0000 7fbdb7c00640 1 -- 172.21.15.142:0/3289271638 wait complete. 2024-04-20T22:12:13.171 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:51:10.763901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-20T21:54:29.338742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-20T21:54:29.935422+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T22:12:13.171 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T22:12:13.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.361+0000 7f05e1200640 1 -- 172.21.15.142:0/2271739495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05dc0747d0 msgr2=0x7f05dc074bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:13.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.361+0000 7f05e1200640 1 --2- 172.21.15.142:0/2271739495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05dc0747d0 0x7f05dc074bb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009880 tx=0x7f05cc02bce0 comp rx=0 tx=0).stop 2024-04-20T22:12:13.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.361+0000 7f05e1200640 1 -- 172.21.15.142:0/2271739495 shutdown_connections 2024-04-20T22:12:13.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.361+0000 7f05e1200640 1 --2- 172.21.15.142:0/2271739495 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05dc0750f0 0x7f05dc1107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:13.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.361+0000 7f05e1200640 1 --2- 172.21.15.142:0/2271739495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05dc0747d0 0x7f05dc074bb0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:13.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.361+0000 7f05e1200640 1 -- 172.21.15.142:0/2271739495 >> 172.21.15.142:0/2271739495 conn(0x7f05dc0fdb20 msgr2=0x7f05dc0fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:13.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.361+0000 7f05e1200640 1 -- 172.21.15.142:0/2271739495 shutdown_connections 2024-04-20T22:12:13.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.361+0000 7f05e1200640 1 -- 172.21.15.142:0/2271739495 wait complete. 2024-04-20T22:12:13.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.363+0000 7f05e1200640 1 Processor -- start 2024-04-20T22:12:13.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.363+0000 7f05e1200640 1 -- start start 2024-04-20T22:12:13.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.363+0000 7f05e1200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05dc0747d0 0x7f05dc19c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:13.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.363+0000 7f05e1200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05dc0750f0 0x7f05dc19c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:13.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.363+0000 7f05e1200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc19ce50 con 0x7f05dc0750f0 2024-04-20T22:12:13.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.363+0000 7f05e1200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc1a0c20 con 0x7f05dc0747d0 2024-04-20T22:12:13.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.363+0000 7f05daa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05dc0750f0 0x7f05dc19c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:13.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.363+0000 7f05daa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05dc0750f0 0x7f05dc19c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41374/0 (socket says 172.21.15.142:41374) 2024-04-20T22:12:13.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.364+0000 7f05daa00640 1 -- 172.21.15.142:0/1184222202 learned_addr learned my addr 172.21.15.142:0/1184222202 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:13.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.364+0000 7f05db400640 1 --2- 172.21.15.142:0/1184222202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05dc0747d0 0x7f05dc19c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:13.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.364+0000 7f05daa00640 1 -- 172.21.15.142:0/1184222202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05dc0747d0 msgr2=0x7f05dc19c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:13.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.364+0000 7f05daa00640 1 --2- 172.21.15.142:0/1184222202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05dc0747d0 0x7f05dc19c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:13.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.364+0000 7f05daa00640 1 -- 172.21.15.142:0/1184222202 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc009560 con 0x7f05dc0750f0 2024-04-20T22:12:13.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.364+0000 7f05daa00640 1 --2- 172.21.15.142:0/1184222202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05dc0750f0 0x7f05dc19c7c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f05c800c8f0 tx=0x7f05c800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:13.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.364+0000 7f05d3e00640 1 -- 172.21.15.142:0/1184222202 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05c8007b80 con 0x7f05dc0750f0 2024-04-20T22:12:13.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.365+0000 7f05d3e00640 1 -- 172.21.15.142:0/1184222202 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f05c80054e0 con 0x7f05dc0750f0 2024-04-20T22:12:13.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.365+0000 7f05d3e00640 1 -- 172.21.15.142:0/1184222202 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05c800f450 con 0x7f05dc0750f0 2024-04-20T22:12:13.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.365+0000 7f05e1200640 1 -- 172.21.15.142:0/1184222202 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05dc1a0f00 con 0x7f05dc0750f0 2024-04-20T22:12:13.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.365+0000 7f05e1200640 1 -- 172.21.15.142:0/1184222202 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05dc1a1460 con 0x7f05dc0750f0 2024-04-20T22:12:13.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.366+0000 7f05e1200640 1 -- 172.21.15.142:0/1184222202 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05dc04e040 con 0x7f05dc0750f0 2024-04-20T22:12:13.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.367+0000 7f05d3e00640 1 -- 172.21.15.142:0/1184222202 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f05c8004f60 con 0x7f05dc0750f0 2024-04-20T22:12:13.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.368+0000 7f05d3e00640 1 --2- 172.21.15.142:0/1184222202 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f05c006ec30 0x7f05c00710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:13.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.368+0000 7f05d3e00640 1 -- 172.21.15.142:0/1184222202 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f05c808ed50 con 0x7f05dc0750f0 2024-04-20T22:12:13.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.368+0000 7f05db400640 1 --2- 172.21.15.142:0/1184222202 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f05c006ec30 0x7f05c00710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:13.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.369+0000 7f05db400640 1 --2- 172.21.15.142:0/1184222202 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f05c006ec30 0x7f05c00710f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f05cc000c00 tx=0x7f05cc005bd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:13.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.373+0000 7f05d3e00640 1 -- 172.21.15.142:0/1184222202 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f05c8057a20 con 0x7f05dc0750f0 2024-04-20T22:12:13.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:13 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3160650501' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-20T22:12:13.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:13 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3289271638' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T22:12:13.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:13 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3160650501' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-20T22:12:13.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:13 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3289271638' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T22:12:13.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.592+0000 7f05e1200640 1 -- 172.21.15.142:0/1184222202 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05dc1136e0 con 0x7f05dc0750f0 2024-04-20T22:12:13.593 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.593+0000 7f05d3e00640 1 -- 172.21.15.142:0/1184222202 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05c801d0a0 con 0x7f05dc0750f0 2024-04-20T22:12:13.593 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2024-04-20T22:12:13.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.596+0000 7f05e1200640 1 -- 172.21.15.142:0/1184222202 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f05c006ec30 msgr2=0x7f05c00710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:13.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.596+0000 7f05e1200640 1 --2- 172.21.15.142:0/1184222202 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f05c006ec30 0x7f05c00710f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f05cc000c00 tx=0x7f05cc005bd0 comp rx=0 tx=0).stop 2024-04-20T22:12:13.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.596+0000 7f05e1200640 1 -- 172.21.15.142:0/1184222202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05dc0750f0 msgr2=0x7f05dc19c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:13.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.596+0000 7f05e1200640 1 --2- 172.21.15.142:0/1184222202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05dc0750f0 0x7f05dc19c7c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f05c800c8f0 tx=0x7f05c800cdb0 comp rx=0 tx=0).stop 2024-04-20T22:12:13.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.596+0000 7f05e1200640 1 -- 172.21.15.142:0/1184222202 shutdown_connections 2024-04-20T22:12:13.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.596+0000 7f05e1200640 1 --2- 172.21.15.142:0/1184222202 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f05c006ec30 0x7f05c00710f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:13.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.596+0000 7f05e1200640 1 --2- 172.21.15.142:0/1184222202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05dc0750f0 0x7f05dc19c7c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:13.596 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.596+0000 7f05e1200640 1 --2- 172.21.15.142:0/1184222202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f05dc0747d0 0x7f05dc19c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:13.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.596+0000 7f05e1200640 1 -- 172.21.15.142:0/1184222202 >> 172.21.15.142:0/1184222202 conn(0x7f05dc0fdb20 msgr2=0x7f05dc0fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:13.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.596+0000 7f05e1200640 1 -- 172.21.15.142:0/1184222202 shutdown_connections 2024-04-20T22:12:13.597 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.596+0000 7f05e1200640 1 -- 172.21.15.142:0/1184222202 wait complete. 2024-04-20T22:12:13.613 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-20T22:12:13.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.814+0000 7fc1e3e00640 1 -- 172.21.15.142:0/707328205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e4106490 msgr2=0x7fc1e41068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:13.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.814+0000 7fc1e3e00640 1 --2- 172.21.15.142:0/707328205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e4106490 0x7fc1e41068f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc009880 tx=0x7fc1cc02bd70 comp rx=0 tx=0).stop 2024-04-20T22:12:13.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.815+0000 7fc1e3e00640 1 -- 172.21.15.142:0/707328205 shutdown_connections 2024-04-20T22:12:13.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.815+0000 7fc1e3e00640 1 --2- 172.21.15.142:0/707328205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e4106490 0x7fc1e41068f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:13.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.815+0000 7fc1e3e00640 1 --2- 172.21.15.142:0/707328205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410b400 0x7fc1e410b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:13.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.815+0000 7fc1e3e00640 1 -- 172.21.15.142:0/707328205 >> 172.21.15.142:0/707328205 conn(0x7fc1e4075c50 msgr2=0x7fc1e4078070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:13.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.815+0000 7fc1e3e00640 1 -- 172.21.15.142:0/707328205 shutdown_connections 2024-04-20T22:12:13.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.815+0000 7fc1e3e00640 1 -- 172.21.15.142:0/707328205 wait complete. 2024-04-20T22:12:13.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.816+0000 7fc1e3e00640 1 Processor -- start 2024-04-20T22:12:13.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.816+0000 7fc1e3e00640 1 -- start start 2024-04-20T22:12:13.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.816+0000 7fc1e3e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e4106490 0x7fc1e419c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:13.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.816+0000 7fc1e3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410b400 0x7fc1e419c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:13.817 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.816+0000 7fc1e3e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e419cd40 con 0x7fc1e4106490 2024-04-20T22:12:13.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.816+0000 7fc1e3e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e41a0b10 con 0x7fc1e410b400 2024-04-20T22:12:13.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.816+0000 7fc1e2a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e4106490 0x7fc1e419c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:13.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.816+0000 7fc1e2a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e4106490 0x7fc1e419c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41392/0 (socket says 172.21.15.142:41392) 2024-04-20T22:12:13.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.816+0000 7fc1e2a00640 1 -- 172.21.15.142:0/3560925186 learned_addr learned my addr 172.21.15.142:0/3560925186 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:13.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.817+0000 7fc1dbe00640 1 --2- 172.21.15.142:0/3560925186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410b400 0x7fc1e419c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:13.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.817+0000 7fc1e2a00640 1 -- 172.21.15.142:0/3560925186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410b400 msgr2=0x7fc1e419c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:13.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.817+0000 7fc1e2a00640 1 --2- 172.21.15.142:0/3560925186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410b400 0x7fc1e419c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:13.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.817+0000 7fc1e2a00640 1 -- 172.21.15.142:0/3560925186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc009560 con 0x7fc1e4106490 2024-04-20T22:12:13.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.817+0000 7fc1e2a00640 1 --2- 172.21.15.142:0/3560925186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e4106490 0x7fc1e419c170 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400c8f0 tx=0x7fc1d400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:13.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.817+0000 7fc1e8a00640 1 -- 172.21.15.142:0/3560925186 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1d4007b80 con 0x7fc1e4106490 2024-04-20T22:12:13.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.817+0000 7fc1e8a00640 1 -- 172.21.15.142:0/3560925186 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1d40054e0 con 0x7fc1e4106490 2024-04-20T22:12:13.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.817+0000 7fc1e3e00640 1 -- 172.21.15.142:0/3560925186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e41a0df0 con 0x7fc1e4106490 2024-04-20T22:12:13.818 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.817+0000 7fc1e8a00640 1 -- 172.21.15.142:0/3560925186 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1d400f450 con 0x7fc1e4106490 2024-04-20T22:12:13.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.818+0000 7fc1e3e00640 1 -- 172.21.15.142:0/3560925186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e41a1350 con 0x7fc1e4106490 2024-04-20T22:12:13.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.819+0000 7fc1e3e00640 1 -- 172.21.15.142:0/3560925186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e404e040 con 0x7fc1e4106490 2024-04-20T22:12:13.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.820+0000 7fc1e8a00640 1 -- 172.21.15.142:0/3560925186 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fc1d4004f60 con 0x7fc1e4106490 2024-04-20T22:12:13.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.821+0000 7fc1e8a00640 1 --2- 172.21.15.142:0/3560925186 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc1c806ec30 0x7fc1c80710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:13.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.821+0000 7fc1e8a00640 1 -- 172.21.15.142:0/3560925186 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fc1d408ecf0 con 0x7fc1e4106490 2024-04-20T22:12:13.820 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.821+0000 7fc1dbe00640 1 --2- 172.21.15.142:0/3560925186 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc1c806ec30 0x7fc1c80710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:13.822 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.822+0000 7fc1dbe00640 1 --2- 172.21.15.142:0/3560925186 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc1c806ec30 0x7fc1c80710f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc036040 tx=0x7fc1cc005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:13.825 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:13.826+0000 7fc1e8a00640 1 -- 172.21.15.142:0/3560925186 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fc1d4057a20 con 0x7fc1e4106490 2024-04-20T22:12:14.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.015+0000 7fc1e3e00640 1 -- 172.21.15.142:0/3560925186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fc1e410e900 con 0x7fc1e4106490 2024-04-20T22:12:14.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.016+0000 7fc1e8a00640 1 -- 172.21.15.142:0/3560925186 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc1d401d0b0 con 0x7fc1e4106490 2024-04-20T22:12:14.016 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2024-04-20T22:12:14.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.019+0000 7fc1e3e00640 1 -- 172.21.15.142:0/3560925186 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc1c806ec30 msgr2=0x7fc1c80710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:14.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.019+0000 7fc1e3e00640 1 --2- 172.21.15.142:0/3560925186 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc1c806ec30 0x7fc1c80710f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc036040 tx=0x7fc1cc005fd0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.019+0000 7fc1e3e00640 1 -- 172.21.15.142:0/3560925186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e4106490 msgr2=0x7fc1e419c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:14.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.019+0000 7fc1e3e00640 1 --2- 172.21.15.142:0/3560925186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e4106490 0x7fc1e419c170 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400c8f0 tx=0x7fc1d400cdb0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.019+0000 7fc1e3e00640 1 -- 172.21.15.142:0/3560925186 shutdown_connections 2024-04-20T22:12:14.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.019+0000 7fc1e3e00640 1 --2- 172.21.15.142:0/3560925186 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fc1c806ec30 0x7fc1c80710f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.019+0000 7fc1e3e00640 1 --2- 172.21.15.142:0/3560925186 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410b400 0x7fc1e419c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.019+0000 7fc1e3e00640 1 --2- 172.21.15.142:0/3560925186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1e4106490 0x7fc1e419c170 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.019+0000 7fc1e3e00640 1 -- 172.21.15.142:0/3560925186 >> 172.21.15.142:0/3560925186 conn(0x7fc1e4075c50 msgr2=0x7fc1e4076720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:14.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.019+0000 7fc1e3e00640 1 -- 172.21.15.142:0/3560925186 shutdown_connections 2024-04-20T22:12:14.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.019+0000 7fc1e3e00640 1 -- 172.21.15.142:0/3560925186 wait complete. 2024-04-20T22:12:14.036 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-20T22:12:14.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.240+0000 7fd477600640 1 -- 172.21.15.142:0/227648937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd470102e70 msgr2=0x7fd470106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:14.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.240+0000 7fd477600640 1 --2- 172.21.15.142:0/227648937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd470102e70 0x7fd470106eb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd458009880 tx=0x7fd45802bce0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.240+0000 7fd477600640 1 -- 172.21.15.142:0/227648937 shutdown_connections 2024-04-20T22:12:14.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.240+0000 7fd477600640 1 --2- 172.21.15.142:0/227648937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd470102e70 0x7fd470106eb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.240+0000 7fd477600640 1 --2- 172.21.15.142:0/227648937 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4701024c0 0x7fd4701028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.240+0000 7fd477600640 1 -- 172.21.15.142:0/227648937 >> 172.21.15.142:0/227648937 conn(0x7fd4700fdce0 msgr2=0x7fd470100100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:14.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.240+0000 7fd477600640 1 -- 172.21.15.142:0/227648937 shutdown_connections 2024-04-20T22:12:14.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.240+0000 7fd477600640 1 -- 172.21.15.142:0/227648937 wait complete. 2024-04-20T22:12:14.240 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.241+0000 7fd477600640 1 Processor -- start 2024-04-20T22:12:14.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.241+0000 7fd477600640 1 -- start start 2024-04-20T22:12:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.241+0000 7fd477600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4701024c0 0x7fd470198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.242+0000 7fd477600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd470198570 0x7fd47019c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.242+0000 7fd477600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd470198ae0 con 0x7fd4701024c0 2024-04-20T22:12:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.242+0000 7fd477600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd470198c50 con 0x7fd470198570 2024-04-20T22:12:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.242+0000 7fd474c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4701024c0 0x7fd470198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.242+0000 7fd474c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4701024c0 0x7fd470198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41408/0 (socket says 172.21.15.142:41408) 2024-04-20T22:12:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.242+0000 7fd474c00640 1 -- 172.21.15.142:0/1312574682 learned_addr learned my addr 172.21.15.142:0/1312574682 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.242+0000 7fd467e00640 1 --2- 172.21.15.142:0/1312574682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd470198570 0x7fd47019c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.242+0000 7fd474c00640 1 -- 172.21.15.142:0/1312574682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd470198570 msgr2=0x7fd47019c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.242+0000 7fd474c00640 1 --2- 172.21.15.142:0/1312574682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd470198570 0x7fd47019c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.242+0000 7fd474c00640 1 -- 172.21.15.142:0/1312574682 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd458009560 con 0x7fd4701024c0 2024-04-20T22:12:14.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.243+0000 7fd474c00640 1 --2- 172.21.15.142:0/1312574682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4701024c0 0x7fd470198030 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd46000c8a0 tx=0x7fd46000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:14.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.243+0000 7fd46e000640 1 -- 172.21.15.142:0/1312574682 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd460007b80 con 0x7fd4701024c0 2024-04-20T22:12:14.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.243+0000 7fd46e000640 1 -- 172.21.15.142:0/1312574682 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd460007ce0 con 0x7fd4701024c0 2024-04-20T22:12:14.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.243+0000 7fd46e000640 1 -- 172.21.15.142:0/1312574682 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd460018810 con 0x7fd4701024c0 2024-04-20T22:12:14.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.243+0000 7fd477600640 1 -- 172.21.15.142:0/1312574682 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd47019cf70 con 0x7fd4701024c0 2024-04-20T22:12:14.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.243+0000 7fd477600640 1 -- 172.21.15.142:0/1312574682 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47019d480 con 0x7fd4701024c0 2024-04-20T22:12:14.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.244+0000 7fd477600640 1 -- 172.21.15.142:0/1312574682 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd47004e040 con 0x7fd4701024c0 2024-04-20T22:12:14.245 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.245+0000 7fd46e000640 1 -- 172.21.15.142:0/1312574682 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fd460018970 con 0x7fd4701024c0 2024-04-20T22:12:14.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.246+0000 7fd46e000640 1 --2- 172.21.15.142:0/1312574682 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd45406ec30 0x7fd4540710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:14.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.247+0000 7fd46e000640 1 -- 172.21.15.142:0/1312574682 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fd46008f1a0 con 0x7fd4701024c0 2024-04-20T22:12:14.246 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.247+0000 7fd467e00640 1 --2- 172.21.15.142:0/1312574682 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd45406ec30 0x7fd4540710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:14.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.247+0000 7fd467e00640 1 --2- 172.21.15.142:0/1312574682 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd45406ec30 0x7fd4540710f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd458036040 tx=0x7fd45802cf90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:14.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.253+0000 7fd46e000640 1 -- 172.21.15.142:0/1312574682 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fd460057e30 con 0x7fd4701024c0 2024-04-20T22:12:14.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:14 smithi164 ceph-mon[69784]: pgmap v397: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:14.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:14 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/1184222202' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T22:12:14.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:14 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3560925186' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-20T22:12:14.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:14 smithi142 ceph-mon[79401]: pgmap v397: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:14.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:14 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1184222202' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T22:12:14.447 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:14 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3560925186' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-20T22:12:14.455 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.456+0000 7fd477600640 1 -- 172.21.15.142:0/1312574682 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fd47019d7b0 con 0x7fd4701024c0 2024-04-20T22:12:14.456 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.457+0000 7fd46e000640 1 -- 172.21.15.142:0/1312574682 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd46005b4f0 con 0x7fd4701024c0 2024-04-20T22:12:14.457 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2024-04-20T22:12:14.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.460+0000 7fd477600640 1 -- 172.21.15.142:0/1312574682 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd45406ec30 msgr2=0x7fd4540710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:14.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.460+0000 7fd477600640 1 --2- 172.21.15.142:0/1312574682 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd45406ec30 0x7fd4540710f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd458036040 tx=0x7fd45802cf90 comp rx=0 tx=0).stop 2024-04-20T22:12:14.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.460+0000 7fd477600640 1 -- 172.21.15.142:0/1312574682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4701024c0 msgr2=0x7fd470198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:14.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.460+0000 7fd477600640 1 --2- 172.21.15.142:0/1312574682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4701024c0 0x7fd470198030 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd46000c8a0 tx=0x7fd46000cd60 comp rx=0 tx=0).stop 2024-04-20T22:12:14.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.460+0000 7fd477600640 1 -- 172.21.15.142:0/1312574682 shutdown_connections 2024-04-20T22:12:14.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.460+0000 7fd477600640 1 --2- 172.21.15.142:0/1312574682 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fd45406ec30 0x7fd4540710f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.460+0000 7fd477600640 1 --2- 172.21.15.142:0/1312574682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd470198570 0x7fd47019c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.460+0000 7fd477600640 1 --2- 172.21.15.142:0/1312574682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4701024c0 0x7fd470198030 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.460+0000 7fd477600640 1 -- 172.21.15.142:0/1312574682 >> 172.21.15.142:0/1312574682 conn(0x7fd4700fdce0 msgr2=0x7fd4700ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:14.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.460+0000 7fd477600640 1 -- 172.21.15.142:0/1312574682 shutdown_connections 2024-04-20T22:12:14.460 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.460+0000 7fd477600640 1 -- 172.21.15.142:0/1312574682 wait complete. 2024-04-20T22:12:14.478 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-20T22:12:14.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.673+0000 7f21f1c00640 1 -- 172.21.15.142:0/418667651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21ec101b20 msgr2=0x7f21ec10a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:14.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.673+0000 7f21f1c00640 1 --2- 172.21.15.142:0/418667651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21ec101b20 0x7f21ec10a000 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f21d80098b0 tx=0x7f21d802bcd0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.673+0000 7f21f1c00640 1 -- 172.21.15.142:0/418667651 shutdown_connections 2024-04-20T22:12:14.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.673+0000 7f21f1c00640 1 --2- 172.21.15.142:0/418667651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21ec101b20 0x7f21ec10a000 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.673+0000 7f21f1c00640 1 --2- 172.21.15.142:0/418667651 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21ec101170 0x7f21ec101550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.673+0000 7f21f1c00640 1 -- 172.21.15.142:0/418667651 >> 172.21.15.142:0/418667651 conn(0x7f21ec0faa00 msgr2=0x7f21ec0fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:14.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.673+0000 7f21f1c00640 1 -- 172.21.15.142:0/418667651 shutdown_connections 2024-04-20T22:12:14.673 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.673+0000 7f21f1c00640 1 -- 172.21.15.142:0/418667651 wait complete. 2024-04-20T22:12:14.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.675+0000 7f21f1c00640 1 Processor -- start 2024-04-20T22:12:14.675 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.675+0000 7f21f1c00640 1 -- start start 2024-04-20T22:12:14.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.676+0000 7f21f1c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21ec101170 0x7f21ec19ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:14.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.676+0000 7f21f1c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21ec101b20 0x7f21ec19bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:14.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.676+0000 7f21f1c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec195ad0 con 0x7f21ec101170 2024-04-20T22:12:14.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.676+0000 7f21f1c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec195c40 con 0x7f21ec101b20 2024-04-20T22:12:14.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.676+0000 7f21eaa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21ec101170 0x7f21ec19ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:14.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.676+0000 7f21eaa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21ec101170 0x7f21ec19ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41430/0 (socket says 172.21.15.142:41430) 2024-04-20T22:12:14.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.676+0000 7f21eaa00640 1 -- 172.21.15.142:0/3898288589 learned_addr learned my addr 172.21.15.142:0/3898288589 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:14.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.677+0000 7f21ea000640 1 --2- 172.21.15.142:0/3898288589 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21ec101b20 0x7f21ec19bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:14.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.677+0000 7f21eaa00640 1 -- 172.21.15.142:0/3898288589 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21ec101b20 msgr2=0x7f21ec19bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:14.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.677+0000 7f21eaa00640 1 --2- 172.21.15.142:0/3898288589 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21ec101b20 0x7f21ec19bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.677+0000 7f21eaa00640 1 -- 172.21.15.142:0/3898288589 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d8009560 con 0x7f21ec101170 2024-04-20T22:12:14.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.677+0000 7f21eaa00640 1 --2- 172.21.15.142:0/3898288589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21ec101170 0x7f21ec19ba60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00d6f0 tx=0x7f21dc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:14.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.677+0000 7f21e3400640 1 -- 172.21.15.142:0/3898288589 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21dc009a30 con 0x7f21ec101170 2024-04-20T22:12:14.678 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.678+0000 7f21f1c00640 1 -- 172.21.15.142:0/3898288589 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ec195f20 con 0x7f21ec101170 2024-04-20T22:12:14.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.678+0000 7f21e3400640 1 -- 172.21.15.142:0/3898288589 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f21dc0054e0 con 0x7f21ec101170 2024-04-20T22:12:14.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.678+0000 7f21e3400640 1 -- 172.21.15.142:0/3898288589 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21dc010460 con 0x7f21ec101170 2024-04-20T22:12:14.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.678+0000 7f21f1c00640 1 -- 172.21.15.142:0/3898288589 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ec196480 con 0x7f21ec101170 2024-04-20T22:12:14.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.679+0000 7f21f1c00640 1 -- 172.21.15.142:0/3898288589 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ec04e040 con 0x7f21ec101170 2024-04-20T22:12:14.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.680+0000 7f21e3400640 1 -- 172.21.15.142:0/3898288589 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f21dc009b90 con 0x7f21ec101170 2024-04-20T22:12:14.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.681+0000 7f21e3400640 1 --2- 172.21.15.142:0/3898288589 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f21d006ecf0 0x7f21d00711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:14.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.681+0000 7f21e3400640 1 -- 172.21.15.142:0/3898288589 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f21dc08eb10 con 0x7f21ec101170 2024-04-20T22:12:14.680 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.681+0000 7f21ea000640 1 --2- 172.21.15.142:0/3898288589 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f21d006ecf0 0x7f21d00711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:14.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.682+0000 7f21ea000640 1 --2- 172.21.15.142:0/3898288589 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f21d006ecf0 0x7f21d00711b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f21d8036040 tx=0x7f21d8005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:14.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.686+0000 7f21e3400640 1 -- 172.21.15.142:0/3898288589 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f21dc0577c0 con 0x7f21ec101170 2024-04-20T22:12:14.900 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.900+0000 7f21f1c00640 1 -- 172.21.15.142:0/3898288589 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f21ec107670 con 0x7f21ec101170 2024-04-20T22:12:14.901 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.902+0000 7f21e3400640 1 -- 172.21.15.142:0/3898288589 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 45 entries v85) v1 ==== 81+0+2697 (secure 0 0 0) 0x7f21dc020aa0 con 0x7f21ec101170 2024-04-20T22:12:14.901 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:6827/3096926963 2024-04-21T22:07:22.811065+0000 2024-04-20T22:12:14.901 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:6825/4054029190 2024-04-21T22:06:52.436542+0000 2024-04-20T22:12:14.902 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:6824/4054029190 2024-04-21T22:06:52.436542+0000 2024-04-20T22:12:14.902 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6829/3327440588 2024-04-21T22:06:21.702075+0000 2024-04-20T22:12:14.902 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6828/3327440588 2024-04-21T22:06:21.702075+0000 2024-04-20T22:12:14.902 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6827/2866697672 2024-04-21T22:05:47.754237+0000 2024-04-20T22:12:14.902 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/966681596 2024-04-21T22:00:14.360617+0000 2024-04-20T22:12:14.902 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:6826/3096926963 2024-04-21T22:07:22.811065+0000 2024-04-20T22:12:14.902 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/3515098784 2024-04-21T21:48:09.914211+0000 2024-04-20T22:12:14.902 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6801/2803679129 2024-04-21T21:46:01.678961+0000 2024-04-20T22:12:14.902 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/99578737 2024-04-21T21:57:21.903211+0000 2024-04-20T22:12:14.902 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/195339089 2024-04-21T21:48:09.914211+0000 2024-04-20T22:12:14.902 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6800/3610638500 2024-04-21T21:57:21.903211+0000 2024-04-20T22:12:14.902 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6826/2866697672 2024-04-21T22:05:47.754237+0000 2024-04-20T22:12:14.902 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/1074487851 2024-04-21T22:00:14.360617+0000 2024-04-20T22:12:14.902 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:0/2404972195 2024-04-21T21:58:50.797892+0000 2024-04-20T22:12:14.903 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/3333243244 2024-04-21T21:57:21.903211+0000 2024-04-20T22:12:14.903 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/680486182 2024-04-21T21:46:43.407590+0000 2024-04-20T22:12:14.903 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:0/1385398224 2024-04-21T21:58:50.797892+0000 2024-04-20T22:12:14.903 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/3501876256 2024-04-21T21:46:01.678961+0000 2024-04-20T22:12:14.903 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/2483063574 2024-04-21T21:57:21.903211+0000 2024-04-20T22:12:14.903 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/4043640333 2024-04-21T21:57:21.903211+0000 2024-04-20T22:12:14.903 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/801898031 2024-04-21T21:46:43.407590+0000 2024-04-20T22:12:14.903 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:0/1190693155 2024-04-21T21:58:50.797892+0000 2024-04-20T22:12:14.903 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:0/3440297070 2024-04-21T21:58:50.797892+0000 2024-04-20T22:12:14.903 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6800/2803679129 2024-04-21T21:46:01.678961+0000 2024-04-20T22:12:14.903 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6800/54392364 2024-04-21T22:00:14.360617+0000 2024-04-20T22:12:14.903 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/1140713527 2024-04-21T21:46:01.678961+0000 2024-04-20T22:12:14.903 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/2707077921 2024-04-21T22:00:14.360617+0000 2024-04-20T22:12:14.903 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/1249568560 2024-04-21T22:00:14.360617+0000 2024-04-20T22:12:14.904 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/841637693 2024-04-21T21:48:09.914211+0000 2024-04-20T22:12:14.904 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:6829/929524464 2024-04-21T21:58:50.797892+0000 2024-04-20T22:12:14.904 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6801/550675874 2024-04-21T21:46:43.407590+0000 2024-04-20T22:12:14.904 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6801/3610638500 2024-04-21T21:57:21.903211+0000 2024-04-20T22:12:14.904 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/2901318326 2024-04-21T21:46:01.678961+0000 2024-04-20T22:12:14.904 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:0/716355240 2024-04-21T21:58:50.797892+0000 2024-04-20T22:12:14.904 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6800/3464616902 2024-04-21T21:48:09.914211+0000 2024-04-20T22:12:14.904 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/4246233855 2024-04-21T21:46:43.407590+0000 2024-04-20T22:12:14.904 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:0/248046752 2024-04-21T21:58:50.797892+0000 2024-04-20T22:12:14.904 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6800/550675874 2024-04-21T21:46:43.407590+0000 2024-04-20T22:12:14.904 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6801/3464616902 2024-04-21T21:48:09.914211+0000 2024-04-20T22:12:14.904 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/540390027 2024-04-21T22:00:14.360617+0000 2024-04-20T22:12:14.904 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/1338478936 2024-04-21T22:00:14.360617+0000 2024-04-20T22:12:14.904 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:6828/929524464 2024-04-21T21:58:50.797892+0000 2024-04-20T22:12:14.904 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6801/54392364 2024-04-21T22:00:14.360617+0000 2024-04-20T22:12:14.905 INFO:teuthology.orchestra.run.smithi142.stderr:listed 45 entries 2024-04-20T22:12:14.905 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.904+0000 7f21f1c00640 1 -- 172.21.15.142:0/3898288589 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f21d006ecf0 msgr2=0x7f21d00711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:14.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.904+0000 7f21f1c00640 1 --2- 172.21.15.142:0/3898288589 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f21d006ecf0 0x7f21d00711b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f21d8036040 tx=0x7f21d8005fd0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.904+0000 7f21f1c00640 1 -- 172.21.15.142:0/3898288589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21ec101170 msgr2=0x7f21ec19ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:14.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.904+0000 7f21f1c00640 1 --2- 172.21.15.142:0/3898288589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21ec101170 0x7f21ec19ba60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00d6f0 tx=0x7f21dc00dbb0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.904+0000 7f21f1c00640 1 -- 172.21.15.142:0/3898288589 shutdown_connections 2024-04-20T22:12:14.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.904+0000 7f21f1c00640 1 --2- 172.21.15.142:0/3898288589 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f21d006ecf0 0x7f21d00711b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.904+0000 7f21f1c00640 1 --2- 172.21.15.142:0/3898288589 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f21ec101b20 0x7f21ec19bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.904+0000 7f21f1c00640 1 --2- 172.21.15.142:0/3898288589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21ec101170 0x7f21ec19ba60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:14.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.904+0000 7f21f1c00640 1 -- 172.21.15.142:0/3898288589 >> 172.21.15.142:0/3898288589 conn(0x7f21ec0faa00 msgr2=0x7f21ec104840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:14.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.904+0000 7f21f1c00640 1 -- 172.21.15.142:0/3898288589 shutdown_connections 2024-04-20T22:12:14.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:14.904+0000 7f21f1c00640 1 -- 172.21.15.142:0/3898288589 wait complete. 2024-04-20T22:12:14.922 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-20T22:12:14.922 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T22:12:14.971 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T22:12:15.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.218+0000 7f2c04a00640 1 -- 172.21.15.142:0/3135392708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c00100a80 msgr2=0x7f2c00104ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:15.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.218+0000 7f2c04a00640 1 --2- 172.21.15.142:0/3135392708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c00100a80 0x7f2c00104ac0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009880 tx=0x7f2be802bcf0 comp rx=0 tx=0).stop 2024-04-20T22:12:15.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.218+0000 7f2c04a00640 1 -- 172.21.15.142:0/3135392708 shutdown_connections 2024-04-20T22:12:15.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.218+0000 7f2c04a00640 1 --2- 172.21.15.142:0/3135392708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c00100a80 0x7f2c00104ac0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:15.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.218+0000 7f2c04a00640 1 --2- 172.21.15.142:0/3135392708 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c001000d0 0x7f2c001004b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:15.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.218+0000 7f2c04a00640 1 -- 172.21.15.142:0/3135392708 >> 172.21.15.142:0/3135392708 conn(0x7f2c000fb930 msgr2=0x7f2c000fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:15.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.218+0000 7f2c04a00640 1 -- 172.21.15.142:0/3135392708 shutdown_connections 2024-04-20T22:12:15.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.218+0000 7f2c04a00640 1 -- 172.21.15.142:0/3135392708 wait complete. 2024-04-20T22:12:15.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.219+0000 7f2c04a00640 1 Processor -- start 2024-04-20T22:12:15.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.219+0000 7f2c04a00640 1 -- start start 2024-04-20T22:12:15.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.219+0000 7f2c04a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c001000d0 0x7f2c000725a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:15.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.219+0000 7f2c04a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c00072ae0 0x7f2c00072f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:15.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.219+0000 7f2c04a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c00074520 con 0x7f2c001000d0 2024-04-20T22:12:15.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.219+0000 7f2c04a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c001a1f50 con 0x7f2c00072ae0 2024-04-20T22:12:15.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.220+0000 7f2bfe800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c001000d0 0x7f2c000725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:15.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.220+0000 7f2bfe800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c001000d0 0x7f2c000725a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41460/0 (socket says 172.21.15.142:41460) 2024-04-20T22:12:15.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.220+0000 7f2bfe800640 1 -- 172.21.15.142:0/2248545262 learned_addr learned my addr 172.21.15.142:0/2248545262 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:15.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.220+0000 7f2bf5e00640 1 --2- 172.21.15.142:0/2248545262 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c00072ae0 0x7f2c00072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:15.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.220+0000 7f2bfe800640 1 -- 172.21.15.142:0/2248545262 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c00072ae0 msgr2=0x7f2c00072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:15.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.220+0000 7f2bfe800640 1 --2- 172.21.15.142:0/2248545262 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c00072ae0 0x7f2c00072f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:15.220 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.220+0000 7f2bfe800640 1 -- 172.21.15.142:0/2248545262 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be8009560 con 0x7f2c001000d0 2024-04-20T22:12:15.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.221+0000 7f2bfe800640 1 --2- 172.21.15.142:0/2248545262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c001000d0 0x7f2c000725a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2bf000b420 tx=0x7f2bf000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:15.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.221+0000 7f2bf7e00640 1 -- 172.21.15.142:0/2248545262 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bf0011800 con 0x7f2c001000d0 2024-04-20T22:12:15.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.221+0000 7f2bf7e00640 1 -- 172.21.15.142:0/2248545262 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2bf0011e20 con 0x7f2c001000d0 2024-04-20T22:12:15.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.221+0000 7f2c04a00640 1 -- 172.21.15.142:0/2248545262 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c001a2150 con 0x7f2c001000d0 2024-04-20T22:12:15.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.221+0000 7f2bf7e00640 1 -- 172.21.15.142:0/2248545262 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bf000f2e0 con 0x7f2c001000d0 2024-04-20T22:12:15.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.221+0000 7f2c04a00640 1 -- 172.21.15.142:0/2248545262 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c001a2680 con 0x7f2c001000d0 2024-04-20T22:12:15.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.222+0000 7f2c04a00640 1 -- 172.21.15.142:0/2248545262 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c0004e890 con 0x7f2c001000d0 2024-04-20T22:12:15.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.223+0000 7f2bf7e00640 1 -- 172.21.15.142:0/2248545262 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f2bf0010380 con 0x7f2c001000d0 2024-04-20T22:12:15.223 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.224+0000 7f2bf7e00640 1 --2- 172.21.15.142:0/2248545262 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f2be406ecf0 0x7f2be40711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:15.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.224+0000 7f2bf7e00640 1 -- 172.21.15.142:0/2248545262 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f2bf008e940 con 0x7f2c001000d0 2024-04-20T22:12:15.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.224+0000 7f2bf5e00640 1 --2- 172.21.15.142:0/2248545262 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f2be406ecf0 0x7f2be40711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:15.224 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.225+0000 7f2bf5e00640 1 --2- 172.21.15.142:0/2248545262 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f2be406ecf0 0x7f2be40711b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2be802c8b0 tx=0x7f2be8005fd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:15.228 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.229+0000 7f2bf7e00640 1 -- 172.21.15.142:0/2248545262 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f2bf00575f0 con 0x7f2c001000d0 2024-04-20T22:12:15.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.435+0000 7f2c04a00640 1 -- 172.21.15.142:0/2248545262 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c00100a80 con 0x7f2c001000d0 2024-04-20T22:12:15.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.439+0000 7f2bf7e00640 1 -- 172.21.15.142:0/2248545262 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+17089 (secure 0 0 0) 0x7f2bf005acb0 con 0x7f2c001000d0 2024-04-20T22:12:15.439 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-20T22:12:15.439 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":85,"fsid":"270cccba-ff5f-11ee-bc93-c7b262605968","created":"2024-04-20T21:45:27.213653+0000","modified":"2024-04-20T22:07:22.811117+0000","last_up_change":"2024-04-20T22:05:36.132962+0000","last_in_change":"2024-04-20T21:52:31.576977+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T21:51:10.763901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-20T21:54:29.338742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-20T21:54:29.935422+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0042c600-a874-4d57-bb8f-7b6f32723bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":838783033},{"type":"v1","addr":"172.21.15.142:6803","nonce":838783033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":838783033},{"type":"v1","addr":"172.21.15.142:6805","nonce":838783033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":838783033},{"type":"v1","addr":"172.21.15.142:6809","nonce":838783033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":838783033},{"type":"v1","addr":"172.21.15.142:6807","nonce":838783033}]},"public_addr":"172.21.15.142:6803/838783033","cluster_addr":"172.21.15.142:6805/838783033","heartbeat_back_addr":"172.21.15.142:6809/838783033","heartbeat_front_addr":"172.21.15.142:6807/838783033","state":["exists","up"]},{"osd":1,"uuid":"29049537-368a-4d1f-b92c-21d962dd8031","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3789493679},{"type":"v1","addr":"172.21.15.142:6811","nonce":3789493679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3789493679},{"type":"v1","addr":"172.21.15.142:6813","nonce":3789493679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3789493679},{"type":"v1","addr":"172.21.15.142:6817","nonce":3789493679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3789493679},{"type":"v1","addr":"172.21.15.142:6815","nonce":3789493679}]},"public_addr":"172.21.15.142:6811/3789493679","cluster_addr":"172.21.15.142:6813/3789493679","heartbeat_back_addr":"172.21.15.142:6817/3789493679","heartbeat_front_addr":"172.21.15.142:6815/3789493679","state":["exists","up"]},{"osd":2,"uuid":"4ea8215b-dc6f-4f18-9d2c-5a5b21e02fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":4113404383},{"type":"v1","addr":"172.21.15.142:6819","nonce":4113404383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":4113404383},{"type":"v1","addr":"172.21.15.142:6821","nonce":4113404383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4113404383},{"type":"v1","addr":"172.21.15.142:6825","nonce":4113404383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":4113404383},{"type":"v1","addr":"172.21.15.142:6823","nonce":4113404383}]},"public_addr":"172.21.15.142:6819/4113404383","cluster_addr":"172.21.15.142:6821/4113404383","heartbeat_back_addr":"172.21.15.142:6825/4113404383","heartbeat_front_addr":"172.21.15.142:6823/4113404383","state":["exists","up"]},{"osd":3,"uuid":"981987e0-cff5-42e9-8129-2a08175c6ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2211531735},{"type":"v1","addr":"172.21.15.164:6801","nonce":2211531735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":2211531735},{"type":"v1","addr":"172.21.15.164:6803","nonce":2211531735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":2211531735},{"type":"v1","addr":"172.21.15.164:6807","nonce":2211531735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":2211531735},{"type":"v1","addr":"172.21.15.164:6805","nonce":2211531735}]},"public_addr":"172.21.15.164:6801/2211531735","cluster_addr":"172.21.15.164:6803/2211531735","heartbeat_back_addr":"172.21.15.164:6807/2211531735","heartbeat_front_addr":"172.21.15.164:6805/2211531735","state":["exists","up"]},{"osd":4,"uuid":"a839fb7d-f82c-4bb0-8c33-b4f4f261bcae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":36,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":155884460},{"type":"v1","addr":"172.21.15.164:6809","nonce":155884460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":155884460},{"type":"v1","addr":"172.21.15.164:6811","nonce":155884460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":155884460},{"type":"v1","addr":"172.21.15.164:6815","nonce":155884460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":155884460},{"type":"v1","addr":"172.21.15.164:6813","nonce":155884460}]},"public_addr":"172.21.15.164:6809/155884460","cluster_addr":"172.21.15.164:6811/155884460","heartbeat_back_addr":"172.21.15.164:6815/155884460","heartbeat_front_addr":"172.21.15.164:6813/155884460","state":["exists","up"]},{"osd":5,"uuid":"72378e50-3a51-469d-a402-489d9bbfed7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":41,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3289958207},{"type":"v1","addr":"172.21.15.164:6817","nonce":3289958207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3289958207},{"type":"v1","addr":"172.21.15.164:6819","nonce":3289958207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3289958207},{"type":"v1","addr":"172.21.15.164:6823","nonce":3289958207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3289958207},{"type":"v1","addr":"172.21.15.164:6821","nonce":3289958207}]},"public_addr":"172.21.15.164:6817/3289958207","cluster_addr":"172.21.15.164:6819/3289958207","heartbeat_back_addr":"172.21.15.164:6823/3289958207","heartbeat_front_addr":"172.21.15.164:6821/3289958207","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:49:52.556673+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:50:29.868343+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:51:07.890840+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:51:43.365372+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:52:18.872393+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T21:52:54.318402+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:6827/3096926963":"2024-04-21T22:07:22.811065+0000","172.21.15.164:6825/4054029190":"2024-04-21T22:06:52.436542+0000","172.21.15.164:6824/4054029190":"2024-04-21T22:06:52.436542+0000","172.21.15.142:6829/3327440588":"2024-04-21T22:06:21.702075+0000","172.21.15.142:6828/3327440588":"2024-04-21T22:06:21.702075+0000","172.21.15.142:6827/2866697672":"2024-04-21T22:05:47.754237+0000","172.21.15.142:0/966681596":"2024-04-21T22:00:14.360617+0000","172.21.15.164:6826/3096926963":"2024-04-21T22:07:22.811065+0000","172.21.15.142:0/3515098784":"2024-04-21T21:48:09.914211+0000","172.21.15.142:6801/2803679129":"2024-04-21T21:46:01.678961+0000","172.21.15.142:0/99578737":"2024-04-21T21:57:21.903211+0000","172.21.15.142:0/195339089":"2024-04-21T21:48:09.914211+0000","172.21.15.142:6800/3610638500":"2024-04-21T21:57:21.903211+0000","172.21.15.142:6826/2866697672":"2024-04-21T22:05:47.754237+0000","172.21.15.142:0/1074487851":"2024-04-21T22:00:14.360617+0000","172.21.15.164:0/2404972195":"2024-04-21T21:58:50.797892+0000","172.21.15.142:0/3333243244":"2024-04-21T21:57:21.903211+0000","172.21.15.142:0/680486182":"2024-04-21T21:46:43.407590+0000","172.21.15.164:0/1385398224":"2024-04-21T21:58:50.797892+0000","172.21.15.142:0/3501876256":"2024-04-21T21:46:01.678961+0000","172.21.15.142:0/2483063574":"2024-04-21T21:57:21.903211+0000","172.21.15.142:0/4043640333":"2024-04-21T21:57:21.903211+0000","172.21.15.142:0/801898031":"2024-04-21T21:46:43.407590+0000","172.21.15.164:0/1190693155":"2024-04-21T21:58:50.797892+0000","172.21.15.164:0/3440297070":"2024-04-21T21:58:50.797892+0000","172.21.15.142:6800/2803679129":"2024-04-21T21:46:01.678961+0000","172.21.15.142:6800/54392364":"2024-04-21T22:00:14.360617+0000","172.21.15.142:0/1140713527":"2024-04-21T21:46:01.678961+0000","172.21.15.142:0/2707077921":"2024-04-21T22:00:14.360617+0000","172.21.15.142:0/1249568560":"2024-04-21T22:00:14.360617+0000","172.21.15.142:0/841637693":"2024-04-21T21:48:09.914211+0000","172.21.15.164:6829/929524464":"2024-04-21T21:58:50.797892+0000","172.21.15.142:6801/550675874":"2024-04-21T21:46:43.407590+0000","172.21.15.142:6801/3610638500":"2024-04-21T21:57:21.903211+0000","172.21.15.142:0/2901318326":"2024-04-21T21:46:01.678961+0000","172.21.15.164:0/716355240":"2024-04-21T21:58:50.797892+0000","172.21.15.142:6800/3464616902":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/4246233855":"2024-04-21T21:46:43.407590+0000","172.21.15.164:0/248046752":"2024-04-21T21:58:50.797892+0000","172.21.15.142:6800/550675874":"2024-04-21T21:46:43.407590+0000","172.21.15.142:6801/3464616902":"2024-04-21T21:48:09.914211+0000","172.21.15.142:0/540390027":"2024-04-21T22:00:14.360617+0000","172.21.15.142:0/1338478936":"2024-04-21T22:00:14.360617+0000","172.21.15.164:6828/929524464":"2024-04-21T21:58:50.797892+0000","172.21.15.142:6801/54392364":"2024-04-21T22:00:14.360617+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T22:12:15.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.441+0000 7f2c04a00640 1 -- 172.21.15.142:0/2248545262 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f2be406ecf0 msgr2=0x7f2be40711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:15.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.441+0000 7f2c04a00640 1 --2- 172.21.15.142:0/2248545262 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f2be406ecf0 0x7f2be40711b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2be802c8b0 tx=0x7f2be8005fd0 comp rx=0 tx=0).stop 2024-04-20T22:12:15.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.441+0000 7f2c04a00640 1 -- 172.21.15.142:0/2248545262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c001000d0 msgr2=0x7f2c000725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:15.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.441+0000 7f2c04a00640 1 --2- 172.21.15.142:0/2248545262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c001000d0 0x7f2c000725a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2bf000b420 tx=0x7f2bf000b8e0 comp rx=0 tx=0).stop 2024-04-20T22:12:15.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.442+0000 7f2c04a00640 1 -- 172.21.15.142:0/2248545262 shutdown_connections 2024-04-20T22:12:15.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.442+0000 7f2c04a00640 1 --2- 172.21.15.142:0/2248545262 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f2be406ecf0 0x7f2be40711b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:15.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.442+0000 7f2c04a00640 1 --2- 172.21.15.142:0/2248545262 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c00072ae0 0x7f2c00072f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:15.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.442+0000 7f2c04a00640 1 --2- 172.21.15.142:0/2248545262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c001000d0 0x7f2c000725a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:15.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.442+0000 7f2c04a00640 1 -- 172.21.15.142:0/2248545262 >> 172.21.15.142:0/2248545262 conn(0x7f2c000fb930 msgr2=0x7f2c000fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:15.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.442+0000 7f2c04a00640 1 -- 172.21.15.142:0/2248545262 shutdown_connections 2024-04-20T22:12:15.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.442+0000 7f2c04a00640 1 -- 172.21.15.142:0/2248545262 wait complete. 2024-04-20T22:12:15.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:15 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/1312574682' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-20T22:12:15.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:12:15.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:15 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3898288589' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-20T22:12:15.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:15 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/1312574682' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-20T22:12:15.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:12:15.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:15 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3898288589' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-20T22:12:15.459 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T21:51:10.763901+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-20T21:54:29.338742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-20T21:54:29.935422+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T22:12:15.460 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T22:12:15.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.659+0000 7f8fbd800640 1 -- 172.21.15.142:0/3967722207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fb80747d0 msgr2=0x7f8fb8074bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:15.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.659+0000 7f8fbd800640 1 --2- 172.21.15.142:0/3967722207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fb80747d0 0x7f8fb8074bb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009880 tx=0x7f8fa802bce0 comp rx=0 tx=0).stop 2024-04-20T22:12:15.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.659+0000 7f8fbd800640 1 -- 172.21.15.142:0/3967722207 shutdown_connections 2024-04-20T22:12:15.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.659+0000 7f8fbd800640 1 --2- 172.21.15.142:0/3967722207 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fb80750f0 0x7f8fb81107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:15.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.659+0000 7f8fbd800640 1 --2- 172.21.15.142:0/3967722207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fb80747d0 0x7f8fb8074bb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:15.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.659+0000 7f8fbd800640 1 -- 172.21.15.142:0/3967722207 >> 172.21.15.142:0/3967722207 conn(0x7f8fb80fdb20 msgr2=0x7f8fb80fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:15.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.660+0000 7f8fbd800640 1 -- 172.21.15.142:0/3967722207 shutdown_connections 2024-04-20T22:12:15.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.660+0000 7f8fbd800640 1 -- 172.21.15.142:0/3967722207 wait complete. 2024-04-20T22:12:15.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.661+0000 7f8fbd800640 1 Processor -- start 2024-04-20T22:12:15.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.661+0000 7f8fbd800640 1 -- start start 2024-04-20T22:12:15.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.661+0000 7f8fbd800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fb80747d0 0x7f8fb819c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:15.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.661+0000 7f8fbd800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fb80750f0 0x7f8fb819c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:15.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.661+0000 7f8fbd800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb819ce50 con 0x7f8fb80747d0 2024-04-20T22:12:15.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.661+0000 7f8fbd800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb81a0c20 con 0x7f8fb80750f0 2024-04-20T22:12:15.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.662+0000 7f8fb7e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fb80747d0 0x7f8fb819c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:15.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.662+0000 7f8fb7e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fb80747d0 0x7f8fb819c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41484/0 (socket says 172.21.15.142:41484) 2024-04-20T22:12:15.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.662+0000 7f8fb7e00640 1 -- 172.21.15.142:0/668696492 learned_addr learned my addr 172.21.15.142:0/668696492 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:15.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.662+0000 7f8fafe00640 1 --2- 172.21.15.142:0/668696492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fb80750f0 0x7f8fb819c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:15.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.662+0000 7f8fb7e00640 1 -- 172.21.15.142:0/668696492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fb80750f0 msgr2=0x7f8fb819c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:15.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.662+0000 7f8fb7e00640 1 --2- 172.21.15.142:0/668696492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fb80750f0 0x7f8fb819c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:15.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.662+0000 7f8fb7e00640 1 -- 172.21.15.142:0/668696492 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa8009560 con 0x7f8fb80747d0 2024-04-20T22:12:15.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.663+0000 7f8fb7e00640 1 --2- 172.21.15.142:0/668696492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fb80747d0 0x7f8fb819c280 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009230 tx=0x7f8fa8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:15.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.663+0000 7f8fb5600640 1 -- 172.21.15.142:0/668696492 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fa80037c0 con 0x7f8fb80747d0 2024-04-20T22:12:15.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.663+0000 7f8fb5600640 1 -- 172.21.15.142:0/668696492 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8fa8005d50 con 0x7f8fb80747d0 2024-04-20T22:12:15.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.663+0000 7f8fbd800640 1 -- 172.21.15.142:0/668696492 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb81a0ea0 con 0x7f8fb80747d0 2024-04-20T22:12:15.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.663+0000 7f8fb5600640 1 -- 172.21.15.142:0/668696492 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fa8034440 con 0x7f8fb80747d0 2024-04-20T22:12:15.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.663+0000 7f8fbd800640 1 -- 172.21.15.142:0/668696492 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb81a13a0 con 0x7f8fb80747d0 2024-04-20T22:12:15.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.664+0000 7f8fbd800640 1 -- 172.21.15.142:0/668696492 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb804e040 con 0x7f8fb80747d0 2024-04-20T22:12:15.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.665+0000 7f8fb5600640 1 -- 172.21.15.142:0/668696492 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f8fa8004dd0 con 0x7f8fb80747d0 2024-04-20T22:12:15.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.666+0000 7f8fb5600640 1 --2- 172.21.15.142:0/668696492 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8f9c06ec30 0x7f8f9c0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:15.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.666+0000 7f8fb5600640 1 -- 172.21.15.142:0/668696492 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f8fa80b12b0 con 0x7f8fb80747d0 2024-04-20T22:12:15.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.667+0000 7f8fafe00640 1 --2- 172.21.15.142:0/668696492 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8f9c06ec30 0x7f8f9c0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:15.667 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.667+0000 7f8fafe00640 1 --2- 172.21.15.142:0/668696492 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8f9c06ec30 0x7f8f9c0710f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0005fd0 tx=0x7f8fa0005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:15.672 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.672+0000 7f8fb5600640 1 -- 172.21.15.142:0/668696492 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f8fa8079fe0 con 0x7f8fb80747d0 2024-04-20T22:12:15.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.871+0000 7f8fbd800640 1 -- 172.21.15.142:0/668696492 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fb81136e0 con 0x7f8fb80747d0 2024-04-20T22:12:15.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.872+0000 7f8fb5600640 1 -- 172.21.15.142:0/668696492 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8fa80056b0 con 0x7f8fb80747d0 2024-04-20T22:12:15.872 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2024-04-20T22:12:15.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.875+0000 7f8fbd800640 1 -- 172.21.15.142:0/668696492 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8f9c06ec30 msgr2=0x7f8f9c0710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:15.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.875+0000 7f8fbd800640 1 --2- 172.21.15.142:0/668696492 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8f9c06ec30 0x7f8f9c0710f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0005fd0 tx=0x7f8fa0005850 comp rx=0 tx=0).stop 2024-04-20T22:12:15.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.875+0000 7f8fbd800640 1 -- 172.21.15.142:0/668696492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fb80747d0 msgr2=0x7f8fb819c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:15.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.875+0000 7f8fbd800640 1 --2- 172.21.15.142:0/668696492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fb80747d0 0x7f8fb819c280 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009230 tx=0x7f8fa8004270 comp rx=0 tx=0).stop 2024-04-20T22:12:15.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.875+0000 7f8fbd800640 1 -- 172.21.15.142:0/668696492 shutdown_connections 2024-04-20T22:12:15.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.875+0000 7f8fbd800640 1 --2- 172.21.15.142:0/668696492 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f8f9c06ec30 0x7f8f9c0710f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:15.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.875+0000 7f8fbd800640 1 --2- 172.21.15.142:0/668696492 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8fb80750f0 0x7f8fb819c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:15.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.875+0000 7f8fbd800640 1 --2- 172.21.15.142:0/668696492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fb80747d0 0x7f8fb819c280 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:15.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.875+0000 7f8fbd800640 1 -- 172.21.15.142:0/668696492 >> 172.21.15.142:0/668696492 conn(0x7f8fb80fdb20 msgr2=0x7f8fb80fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:15.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.875+0000 7f8fbd800640 1 -- 172.21.15.142:0/668696492 shutdown_connections 2024-04-20T22:12:15.875 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:15.875+0000 7f8fbd800640 1 -- 172.21.15.142:0/668696492 wait complete. 2024-04-20T22:12:15.894 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-20T22:12:16.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.099+0000 7f3459200640 1 -- 172.21.15.142:0/3877319037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f345410b400 msgr2=0x7f345410b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:16.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.099+0000 7f3459200640 1 --2- 172.21.15.142:0/3877319037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f345410b400 0x7f345410b7e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3444009880 tx=0x7f344402bd70 comp rx=0 tx=0).stop 2024-04-20T22:12:16.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.099+0000 7f3459200640 1 -- 172.21.15.142:0/3877319037 shutdown_connections 2024-04-20T22:12:16.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.099+0000 7f3459200640 1 --2- 172.21.15.142:0/3877319037 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3454106490 0x7f34541068f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.099+0000 7f3459200640 1 --2- 172.21.15.142:0/3877319037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f345410b400 0x7f345410b7e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.099+0000 7f3459200640 1 -- 172.21.15.142:0/3877319037 >> 172.21.15.142:0/3877319037 conn(0x7f3454075c50 msgr2=0x7f3454078070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:16.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.099+0000 7f3459200640 1 -- 172.21.15.142:0/3877319037 shutdown_connections 2024-04-20T22:12:16.100 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.099+0000 7f3459200640 1 -- 172.21.15.142:0/3877319037 wait complete. 2024-04-20T22:12:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.100+0000 7f3459200640 1 Processor -- start 2024-04-20T22:12:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.100+0000 7f3459200640 1 -- start start 2024-04-20T22:12:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.101+0000 7f3459200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3454106490 0x7f345419c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.101+0000 7f3459200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f345410b400 0x7f345419c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.101+0000 7f3459200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345419cdd0 con 0x7f345410b400 2024-04-20T22:12:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.101+0000 7f3459200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34541a0ba0 con 0x7f3454106490 2024-04-20T22:12:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.101+0000 7f344be00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f345410b400 0x7f345419c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.101+0000 7f344be00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f345410b400 0x7f345419c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41498/0 (socket says 172.21.15.142:41498) 2024-04-20T22:12:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.101+0000 7f344be00640 1 -- 172.21.15.142:0/3541775496 learned_addr learned my addr 172.21.15.142:0/3541775496 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.101+0000 7f3453400640 1 --2- 172.21.15.142:0/3541775496 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3454106490 0x7f345419c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:16.102 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.101+0000 7f344be00640 1 -- 172.21.15.142:0/3541775496 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3454106490 msgr2=0x7f345419c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:16.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.101+0000 7f344be00640 1 --2- 172.21.15.142:0/3541775496 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3454106490 0x7f345419c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.101+0000 7f344be00640 1 -- 172.21.15.142:0/3541775496 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3444009560 con 0x7f345410b400 2024-04-20T22:12:16.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.102+0000 7f3453400640 1 --2- 172.21.15.142:0/3541775496 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3454106490 0x7f345419c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T22:12:16.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.102+0000 7f344be00640 1 --2- 172.21.15.142:0/3541775496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f345410b400 0x7f345419c740 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f343c00d6f0 tx=0x7f343c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:16.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.102+0000 7f3450c00640 1 -- 172.21.15.142:0/3541775496 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f343c009a30 con 0x7f345410b400 2024-04-20T22:12:16.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.102+0000 7f3450c00640 1 -- 172.21.15.142:0/3541775496 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f343c0054e0 con 0x7f345410b400 2024-04-20T22:12:16.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.102+0000 7f3459200640 1 -- 172.21.15.142:0/3541775496 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34541a0e80 con 0x7f345410b400 2024-04-20T22:12:16.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.102+0000 7f3450c00640 1 -- 172.21.15.142:0/3541775496 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f343c010460 con 0x7f345410b400 2024-04-20T22:12:16.103 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.102+0000 7f3459200640 1 -- 172.21.15.142:0/3541775496 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34541a13e0 con 0x7f345410b400 2024-04-20T22:12:16.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.104+0000 7f3459200640 1 -- 172.21.15.142:0/3541775496 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345404e040 con 0x7f345410b400 2024-04-20T22:12:16.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.104+0000 7f3450c00640 1 -- 172.21.15.142:0/3541775496 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7f343c009b90 con 0x7f345410b400 2024-04-20T22:12:16.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.106+0000 7f3450c00640 1 --2- 172.21.15.142:0/3541775496 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f343806ec30 0x7f34380710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:16.105 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.106+0000 7f3450c00640 1 -- 172.21.15.142:0/3541775496 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7f343c08eb10 con 0x7f345410b400 2024-04-20T22:12:16.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.106+0000 7f3453400640 1 --2- 172.21.15.142:0/3541775496 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f343806ec30 0x7f34380710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:16.106 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.107+0000 7f3453400640 1 --2- 172.21.15.142:0/3541775496 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f343806ec30 0x7f34380710f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3444005ec0 tx=0x7f3444000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:16.110 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.110+0000 7f3450c00640 1 -- 172.21.15.142:0/3541775496 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7f343c0577c0 con 0x7f345410b400 2024-04-20T22:12:16.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.312+0000 7f3459200640 1 -- 172.21.15.142:0/3541775496 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f345410e920 con 0x7f345410b400 2024-04-20T22:12:16.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.313+0000 7f3450c00640 1 -- 172.21.15.142:0/3541775496 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f343c020020 con 0x7f345410b400 2024-04-20T22:12:16.312 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2024-04-20T22:12:16.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.315+0000 7f3459200640 1 -- 172.21.15.142:0/3541775496 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f343806ec30 msgr2=0x7f34380710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:16.315 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.315+0000 7f3459200640 1 --2- 172.21.15.142:0/3541775496 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f343806ec30 0x7f34380710f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3444005ec0 tx=0x7f3444000bc0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.315+0000 7f3459200640 1 -- 172.21.15.142:0/3541775496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f345410b400 msgr2=0x7f345419c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:16.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.315+0000 7f3459200640 1 --2- 172.21.15.142:0/3541775496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f345410b400 0x7f345419c740 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f343c00d6f0 tx=0x7f343c00dbb0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.316+0000 7f3459200640 1 -- 172.21.15.142:0/3541775496 shutdown_connections 2024-04-20T22:12:16.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.316+0000 7f3459200640 1 --2- 172.21.15.142:0/3541775496 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7f343806ec30 0x7f34380710f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.316+0000 7f3459200640 1 --2- 172.21.15.142:0/3541775496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f345410b400 0x7f345419c740 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.316+0000 7f3459200640 1 --2- 172.21.15.142:0/3541775496 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3454106490 0x7f345419c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.316+0000 7f3459200640 1 -- 172.21.15.142:0/3541775496 >> 172.21.15.142:0/3541775496 conn(0x7f3454075c50 msgr2=0x7f34540767b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:16.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.316+0000 7f3459200640 1 -- 172.21.15.142:0/3541775496 shutdown_connections 2024-04-20T22:12:16.316 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.316+0000 7f3459200640 1 -- 172.21.15.142:0/3541775496 wait complete. 2024-04-20T22:12:16.336 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-20T22:12:16.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.547+0000 7ffa7b200640 1 -- 172.21.15.142:0/2953816126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa7c102c70 msgr2=0x7ffa7c106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:16.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.547+0000 7ffa7b200640 1 --2- 172.21.15.142:0/2953816126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa7c102c70 0x7ffa7c106cb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009880 tx=0x7ffa6402bce0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.547+0000 7ffa7b200640 1 -- 172.21.15.142:0/2953816126 shutdown_connections 2024-04-20T22:12:16.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.547+0000 7ffa7b200640 1 --2- 172.21.15.142:0/2953816126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa7c102c70 0x7ffa7c106cb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.547+0000 7ffa7b200640 1 --2- 172.21.15.142:0/2953816126 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa7c1022c0 0x7ffa7c1026a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.547 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.547+0000 7ffa7b200640 1 -- 172.21.15.142:0/2953816126 >> 172.21.15.142:0/2953816126 conn(0x7ffa7c0fdb20 msgr2=0x7ffa7c0fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:16.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.547+0000 7ffa7b200640 1 -- 172.21.15.142:0/2953816126 shutdown_connections 2024-04-20T22:12:16.548 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.547+0000 7ffa7b200640 1 -- 172.21.15.142:0/2953816126 wait complete. 2024-04-20T22:12:16.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.548+0000 7ffa7b200640 1 Processor -- start 2024-04-20T22:12:16.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.549+0000 7ffa7b200640 1 -- start start 2024-04-20T22:12:16.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.549+0000 7ffa7b200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa7c1022c0 0x7ffa7c197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:16.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.549+0000 7ffa7b200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa7c198340 0x7ffa7c19c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:16.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.549+0000 7ffa7b200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c198940 con 0x7ffa7c1022c0 2024-04-20T22:12:16.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.549+0000 7ffa7b200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c198ab0 con 0x7ffa7c198340 2024-04-20T22:12:16.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.549+0000 7ffa79e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa7c1022c0 0x7ffa7c197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:16.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.549+0000 7ffa79e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa7c1022c0 0x7ffa7c197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41514/0 (socket says 172.21.15.142:41514) 2024-04-20T22:12:16.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.549+0000 7ffa79e00640 1 -- 172.21.15.142:0/75294304 learned_addr learned my addr 172.21.15.142:0/75294304 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:16.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.550+0000 7ffa73e00640 1 --2- 172.21.15.142:0/75294304 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa7c198340 0x7ffa7c19c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:16.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.550+0000 7ffa79e00640 1 -- 172.21.15.142:0/75294304 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa7c198340 msgr2=0x7ffa7c19c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:16.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.550+0000 7ffa79e00640 1 --2- 172.21.15.142:0/75294304 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa7c198340 0x7ffa7c19c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.550+0000 7ffa79e00640 1 -- 172.21.15.142:0/75294304 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa64009560 con 0x7ffa7c1022c0 2024-04-20T22:12:16.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.550+0000 7ffa79e00640 1 --2- 172.21.15.142:0/75294304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa7c1022c0 0x7ffa7c197e00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00d720 tx=0x7ffa6c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:16.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.550+0000 7ffa72a00640 1 -- 172.21.15.142:0/75294304 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa6c0051f0 con 0x7ffa7c1022c0 2024-04-20T22:12:16.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.550+0000 7ffa72a00640 1 -- 172.21.15.142:0/75294304 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa6c009ce0 con 0x7ffa7c1022c0 2024-04-20T22:12:16.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.550+0000 7ffa7b200640 1 -- 172.21.15.142:0/75294304 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7c19cda0 con 0x7ffa7c1022c0 2024-04-20T22:12:16.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.550+0000 7ffa72a00640 1 -- 172.21.15.142:0/75294304 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa6c010460 con 0x7ffa7c1022c0 2024-04-20T22:12:16.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.551+0000 7ffa7b200640 1 -- 172.21.15.142:0/75294304 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7c19d300 con 0x7ffa7c1022c0 2024-04-20T22:12:16.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.552+0000 7ffa7b200640 1 -- 172.21.15.142:0/75294304 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7c04e040 con 0x7ffa7c1022c0 2024-04-20T22:12:16.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.553+0000 7ffa72a00640 1 -- 172.21.15.142:0/75294304 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7ffa6c005350 con 0x7ffa7c1022c0 2024-04-20T22:12:16.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.554+0000 7ffa72a00640 1 --2- 172.21.15.142:0/75294304 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7ffa6006ec30 0x7ffa600710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:16.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.554+0000 7ffa72a00640 1 -- 172.21.15.142:0/75294304 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7ffa6c08eaf0 con 0x7ffa7c1022c0 2024-04-20T22:12:16.553 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.554+0000 7ffa73e00640 1 --2- 172.21.15.142:0/75294304 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7ffa6006ec30 0x7ffa600710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:16.554 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.555+0000 7ffa73e00640 1 --2- 172.21.15.142:0/75294304 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7ffa6006ec30 0x7ffa600710f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffa64006010 tx=0x7ffa64000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:16.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.559+0000 7ffa72a00640 1 -- 172.21.15.142:0/75294304 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7ffa6c0577a0 con 0x7ffa7c1022c0 2024-04-20T22:12:16.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:16 smithi142 ceph-mon[79401]: pgmap v398: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:16.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:16 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2248545262' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T22:12:16.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:16 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/668696492' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T22:12:16.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:16 smithi164 ceph-mon[69784]: pgmap v398: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:16.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:16 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/2248545262' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T22:12:16.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:16 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/668696492' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T22:12:16.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.760+0000 7ffa7b200640 1 -- 172.21.15.142:0/75294304 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7ffa7c199150 con 0x7ffa7c1022c0 2024-04-20T22:12:16.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.761+0000 7ffa72a00640 1 -- 172.21.15.142:0/75294304 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7ffa6c05ae60 con 0x7ffa7c1022c0 2024-04-20T22:12:16.761 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2024-04-20T22:12:16.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.764+0000 7ffa7b200640 1 -- 172.21.15.142:0/75294304 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7ffa6006ec30 msgr2=0x7ffa600710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:16.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.764+0000 7ffa7b200640 1 --2- 172.21.15.142:0/75294304 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7ffa6006ec30 0x7ffa600710f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffa64006010 tx=0x7ffa64000bc0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.764+0000 7ffa7b200640 1 -- 172.21.15.142:0/75294304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa7c1022c0 msgr2=0x7ffa7c197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:16.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.764+0000 7ffa7b200640 1 --2- 172.21.15.142:0/75294304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa7c1022c0 0x7ffa7c197e00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00d720 tx=0x7ffa6c00dbe0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.764+0000 7ffa7b200640 1 -- 172.21.15.142:0/75294304 shutdown_connections 2024-04-20T22:12:16.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.764+0000 7ffa7b200640 1 --2- 172.21.15.142:0/75294304 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7ffa6006ec30 0x7ffa600710f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.764+0000 7ffa7b200640 1 --2- 172.21.15.142:0/75294304 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa7c198340 0x7ffa7c19c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.764+0000 7ffa7b200640 1 --2- 172.21.15.142:0/75294304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa7c1022c0 0x7ffa7c197e00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.764+0000 7ffa7b200640 1 -- 172.21.15.142:0/75294304 >> 172.21.15.142:0/75294304 conn(0x7ffa7c0fdb20 msgr2=0x7ffa7c0ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:16.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.764+0000 7ffa7b200640 1 -- 172.21.15.142:0/75294304 shutdown_connections 2024-04-20T22:12:16.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.764+0000 7ffa7b200640 1 -- 172.21.15.142:0/75294304 wait complete. 2024-04-20T22:12:16.783 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-20T22:12:16.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.982+0000 7fcfce600640 1 -- 172.21.15.142:0/1041953899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfc8106490 msgr2=0x7fcfc8106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:16.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.982+0000 7fcfce600640 1 --2- 172.21.15.142:0/1041953899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfc8106490 0x7fcfc8106910 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009880 tx=0x7fcfb002bce0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.982+0000 7fcfce600640 1 -- 172.21.15.142:0/1041953899 shutdown_connections 2024-04-20T22:12:16.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.982+0000 7fcfce600640 1 --2- 172.21.15.142:0/1041953899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfc8106490 0x7fcfc8106910 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.982+0000 7fcfce600640 1 --2- 172.21.15.142:0/1041953899 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfc810c550 0x7fcfc810c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.982+0000 7fcfce600640 1 -- 172.21.15.142:0/1041953899 >> 172.21.15.142:0/1041953899 conn(0x7fcfc8075c60 msgr2=0x7fcfc8078080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:16.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.982+0000 7fcfce600640 1 -- 172.21.15.142:0/1041953899 shutdown_connections 2024-04-20T22:12:16.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.982+0000 7fcfce600640 1 -- 172.21.15.142:0/1041953899 wait complete. 2024-04-20T22:12:16.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.983+0000 7fcfce600640 1 Processor -- start 2024-04-20T22:12:16.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.983+0000 7fcfce600640 1 -- start start 2024-04-20T22:12:16.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.984+0000 7fcfce600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfc8106490 0x7fcfc819c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:16.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.984+0000 7fcfce600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfc810c550 0x7fcfc819c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:16.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.984+0000 7fcfce600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc819cc90 con 0x7fcfc8106490 2024-04-20T22:12:16.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.984+0000 7fcfce600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc81a0a60 con 0x7fcfc810c550 2024-04-20T22:12:16.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.984+0000 7fcfcd200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfc8106490 0x7fcfc819c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:16.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.984+0000 7fcfcd200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfc8106490 0x7fcfc819c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35852/0 (socket says 172.21.15.142:35852) 2024-04-20T22:12:16.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.984+0000 7fcfcd200640 1 -- 172.21.15.142:0/2217565014 learned_addr learned my addr 172.21.15.142:0/2217565014 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-20T22:12:16.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.984+0000 7fcfbfe00640 1 --2- 172.21.15.142:0/2217565014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfc810c550 0x7fcfc819c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:16.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.984+0000 7fcfcd200640 1 -- 172.21.15.142:0/2217565014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfc810c550 msgr2=0x7fcfc819c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:16.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.984+0000 7fcfcd200640 1 --2- 172.21.15.142:0/2217565014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfc810c550 0x7fcfc819c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:16.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.984+0000 7fcfcd200640 1 -- 172.21.15.142:0/2217565014 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb0009560 con 0x7fcfc8106490 2024-04-20T22:12:16.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.985+0000 7fcfcd200640 1 --2- 172.21.15.142:0/2217565014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfc8106490 0x7fcfc819c0c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800d6f0 tx=0x7fcfb800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:16.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.985+0000 7fcfc6000640 1 -- 172.21.15.142:0/2217565014 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfb8009a30 con 0x7fcfc8106490 2024-04-20T22:12:16.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.985+0000 7fcfc6000640 1 -- 172.21.15.142:0/2217565014 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcfb80054e0 con 0x7fcfc8106490 2024-04-20T22:12:16.986 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.985+0000 7fcfce600640 1 -- 172.21.15.142:0/2217565014 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc81a0d40 con 0x7fcfc8106490 2024-04-20T22:12:16.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.985+0000 7fcfc6000640 1 -- 172.21.15.142:0/2217565014 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfb8010460 con 0x7fcfc8106490 2024-04-20T22:12:16.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.985+0000 7fcfce600640 1 -- 172.21.15.142:0/2217565014 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc81a12a0 con 0x7fcfc8106490 2024-04-20T22:12:16.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.986+0000 7fcfce600640 1 -- 172.21.15.142:0/2217565014 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc804e890 con 0x7fcfc8106490 2024-04-20T22:12:16.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.987+0000 7fcfc6000640 1 -- 172.21.15.142:0/2217565014 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 38) v1 ==== 92747+0+0 (secure 0 0 0) 0x7fcfb8009b90 con 0x7fcfc8106490 2024-04-20T22:12:16.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.989+0000 7fcfc6000640 1 --2- 172.21.15.142:0/2217565014 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcfac06ec80 0x7fcfac071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T22:12:16.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.989+0000 7fcfc6000640 1 -- 172.21.15.142:0/2217565014 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6758+0+0 (secure 0 0 0) 0x7fcfb808ea50 con 0x7fcfc8106490 2024-04-20T22:12:16.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.989+0000 7fcfbfe00640 1 --2- 172.21.15.142:0/2217565014 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcfac06ec80 0x7fcfac071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T22:12:16.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.990+0000 7fcfbfe00640 1 --2- 172.21.15.142:0/2217565014 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcfac06ec80 0x7fcfac071140 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0036040 tx=0x7fcfb002cf90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T22:12:16.994 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:16.994+0000 7fcfc6000640 1 -- 172.21.15.142:0/2217565014 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188381 (secure 0 0 0) 0x7fcfb8057780 con 0x7fcfc8106490 2024-04-20T22:12:17.211 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:17.212+0000 7fcfce600640 1 -- 172.21.15.142:0/2217565014 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcfc819d410 con 0x7fcfc8106490 2024-04-20T22:12:17.216 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:17.216+0000 7fcfc6000640 1 -- 172.21.15.142:0/2217565014 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 45 entries v85) v1 ==== 81+0+2697 (secure 0 0 0) 0x7fcfb8020aa0 con 0x7fcfc8106490 2024-04-20T22:12:17.217 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:6827/3096926963 2024-04-21T22:07:22.811065+0000 2024-04-20T22:12:17.217 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:6825/4054029190 2024-04-21T22:06:52.436542+0000 2024-04-20T22:12:17.217 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:6824/4054029190 2024-04-21T22:06:52.436542+0000 2024-04-20T22:12:17.218 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6829/3327440588 2024-04-21T22:06:21.702075+0000 2024-04-20T22:12:17.218 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6828/3327440588 2024-04-21T22:06:21.702075+0000 2024-04-20T22:12:17.218 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6827/2866697672 2024-04-21T22:05:47.754237+0000 2024-04-20T22:12:17.218 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/966681596 2024-04-21T22:00:14.360617+0000 2024-04-20T22:12:17.218 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:6826/3096926963 2024-04-21T22:07:22.811065+0000 2024-04-20T22:12:17.218 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/3515098784 2024-04-21T21:48:09.914211+0000 2024-04-20T22:12:17.218 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6801/2803679129 2024-04-21T21:46:01.678961+0000 2024-04-20T22:12:17.218 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/99578737 2024-04-21T21:57:21.903211+0000 2024-04-20T22:12:17.218 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/195339089 2024-04-21T21:48:09.914211+0000 2024-04-20T22:12:17.218 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6800/3610638500 2024-04-21T21:57:21.903211+0000 2024-04-20T22:12:17.218 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6826/2866697672 2024-04-21T22:05:47.754237+0000 2024-04-20T22:12:17.218 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/1074487851 2024-04-21T22:00:14.360617+0000 2024-04-20T22:12:17.218 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:0/2404972195 2024-04-21T21:58:50.797892+0000 2024-04-20T22:12:17.218 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/3333243244 2024-04-21T21:57:21.903211+0000 2024-04-20T22:12:17.219 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/680486182 2024-04-21T21:46:43.407590+0000 2024-04-20T22:12:17.219 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:0/1385398224 2024-04-21T21:58:50.797892+0000 2024-04-20T22:12:17.219 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/3501876256 2024-04-21T21:46:01.678961+0000 2024-04-20T22:12:17.219 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/2483063574 2024-04-21T21:57:21.903211+0000 2024-04-20T22:12:17.219 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/4043640333 2024-04-21T21:57:21.903211+0000 2024-04-20T22:12:17.219 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/801898031 2024-04-21T21:46:43.407590+0000 2024-04-20T22:12:17.219 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:0/1190693155 2024-04-21T21:58:50.797892+0000 2024-04-20T22:12:17.219 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:0/3440297070 2024-04-21T21:58:50.797892+0000 2024-04-20T22:12:17.219 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6800/2803679129 2024-04-21T21:46:01.678961+0000 2024-04-20T22:12:17.219 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6800/54392364 2024-04-21T22:00:14.360617+0000 2024-04-20T22:12:17.219 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/1140713527 2024-04-21T21:46:01.678961+0000 2024-04-20T22:12:17.219 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/2707077921 2024-04-21T22:00:14.360617+0000 2024-04-20T22:12:17.219 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/1249568560 2024-04-21T22:00:14.360617+0000 2024-04-20T22:12:17.220 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/841637693 2024-04-21T21:48:09.914211+0000 2024-04-20T22:12:17.220 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:6829/929524464 2024-04-21T21:58:50.797892+0000 2024-04-20T22:12:17.220 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6801/550675874 2024-04-21T21:46:43.407590+0000 2024-04-20T22:12:17.220 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6801/3610638500 2024-04-21T21:57:21.903211+0000 2024-04-20T22:12:17.220 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/2901318326 2024-04-21T21:46:01.678961+0000 2024-04-20T22:12:17.220 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:0/716355240 2024-04-21T21:58:50.797892+0000 2024-04-20T22:12:17.220 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6800/3464616902 2024-04-21T21:48:09.914211+0000 2024-04-20T22:12:17.220 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/4246233855 2024-04-21T21:46:43.407590+0000 2024-04-20T22:12:17.220 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:0/248046752 2024-04-21T21:58:50.797892+0000 2024-04-20T22:12:17.220 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6800/550675874 2024-04-21T21:46:43.407590+0000 2024-04-20T22:12:17.220 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6801/3464616902 2024-04-21T21:48:09.914211+0000 2024-04-20T22:12:17.220 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/540390027 2024-04-21T22:00:14.360617+0000 2024-04-20T22:12:17.220 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/1338478936 2024-04-21T22:00:14.360617+0000 2024-04-20T22:12:17.220 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.164:6828/929524464 2024-04-21T21:58:50.797892+0000 2024-04-20T22:12:17.221 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6801/54392364 2024-04-21T22:00:14.360617+0000 2024-04-20T22:12:17.221 INFO:teuthology.orchestra.run.smithi142.stderr:listed 45 entries 2024-04-20T22:12:17.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:17.221+0000 7fcfce600640 1 -- 172.21.15.142:0/2217565014 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcfac06ec80 msgr2=0x7fcfac071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:17.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:17.221+0000 7fcfce600640 1 --2- 172.21.15.142:0/2217565014 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcfac06ec80 0x7fcfac071140 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0036040 tx=0x7fcfb002cf90 comp rx=0 tx=0).stop 2024-04-20T22:12:17.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:17.221+0000 7fcfce600640 1 -- 172.21.15.142:0/2217565014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfc8106490 msgr2=0x7fcfc819c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T22:12:17.221 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:17.221+0000 7fcfce600640 1 --2- 172.21.15.142:0/2217565014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfc8106490 0x7fcfc819c0c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800d6f0 tx=0x7fcfb800dbb0 comp rx=0 tx=0).stop 2024-04-20T22:12:17.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:17.222+0000 7fcfce600640 1 -- 172.21.15.142:0/2217565014 shutdown_connections 2024-04-20T22:12:17.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:17.222+0000 7fcfce600640 1 --2- 172.21.15.142:0/2217565014 >> [v2:172.21.15.142:6800/2916737211,v1:172.21.15.142:6801/2916737211] conn(0x7fcfac06ec80 0x7fcfac071140 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:17.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:17.222+0000 7fcfce600640 1 --2- 172.21.15.142:0/2217565014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcfc810c550 0x7fcfc819c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:17.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:17.222+0000 7fcfce600640 1 --2- 172.21.15.142:0/2217565014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfc8106490 0x7fcfc819c0c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T22:12:17.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:17.222+0000 7fcfce600640 1 -- 172.21.15.142:0/2217565014 >> 172.21.15.142:0/2217565014 conn(0x7fcfc8075c60 msgr2=0x7fcfc80774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T22:12:17.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:17.222+0000 7fcfce600640 1 -- 172.21.15.142:0/2217565014 shutdown_connections 2024-04-20T22:12:17.222 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-20T22:12:17.222+0000 7fcfce600640 1 -- 172.21.15.142:0/2217565014 wait complete. 2024-04-20T22:12:17.238 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi142.front.sepia.ceph.com... 2024-04-20T22:12:17.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T22:12:17.238 DEBUG:teuthology.orchestra.run.smithi142:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-20T22:12:17.305 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T22:12:17.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:17 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/3541775496' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-20T22:12:17.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:17 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/75294304' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-20T22:12:17.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:17 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/3541775496' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-20T22:12:17.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:17 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/75294304' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-20T22:12:18.475 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:18 smithi142 ceph-mon[79401]: pgmap v399: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:18.476 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:18 smithi142 ceph-mon[79401]: from='client.? 172.21.15.142:0/2217565014' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-20T22:12:18.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:18 smithi164 ceph-mon[69784]: pgmap v399: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:18.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:18 smithi164 ceph-mon[69784]: from='client.? 172.21.15.142:0/2217565014' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-20T22:12:20.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:20 smithi164 ceph-mon[69784]: pgmap v400: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:20.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:20 smithi142 ceph-mon[79401]: pgmap v400: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:22.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:22 smithi142 ceph-mon[79401]: pgmap v401: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:22.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:22 smithi164 ceph-mon[69784]: pgmap v401: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:24.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:24 smithi164 ceph-mon[69784]: pgmap v402: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:24.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:24 smithi142 ceph-mon[79401]: pgmap v402: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:26.640 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:26 smithi164 ceph-mon[69784]: pgmap v403: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:26.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:26 smithi142 ceph-mon[79401]: pgmap v403: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:28.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:28 smithi164 ceph-mon[69784]: pgmap v404: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:28.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:28 smithi142 ceph-mon[79401]: pgmap v404: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:30.501 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:30 smithi164 ceph-mon[69784]: pgmap v405: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:30.501 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:12:30.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:30 smithi142 ceph-mon[79401]: pgmap v405: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:30.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:12:32.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:32 smithi142 ceph-mon[79401]: pgmap v406: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:32.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:32 smithi164 ceph-mon[69784]: pgmap v406: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:34.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:34 smithi164 ceph-mon[69784]: pgmap v407: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:34.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:34 smithi142 ceph-mon[79401]: pgmap v407: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:36.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:36 smithi142 ceph-mon[79401]: pgmap v408: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:36.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:36 smithi164 ceph-mon[69784]: pgmap v408: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:38.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:38 smithi164 ceph-mon[69784]: pgmap v409: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:38.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:38 smithi142 ceph-mon[79401]: pgmap v409: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:40.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:40 smithi142 ceph-mon[79401]: pgmap v410: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:40.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:40 smithi164 ceph-mon[69784]: pgmap v410: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:42.448 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:42 smithi164 ceph-mon[69784]: pgmap v411: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:42.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:42 smithi142 ceph-mon[79401]: pgmap v411: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:44.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:44 smithi142 ceph-mon[79401]: pgmap v412: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:44.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:44 smithi164 ceph-mon[69784]: pgmap v412: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:45.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:12:45.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:12:46.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:46 smithi142 ceph-mon[79401]: pgmap v413: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:46.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:46 smithi164 ceph-mon[69784]: pgmap v413: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:48.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:48 smithi142 ceph-mon[79401]: pgmap v414: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:48.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:48 smithi164 ceph-mon[69784]: pgmap v414: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:50.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:50 smithi142 ceph-mon[79401]: pgmap v415: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:50.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:50 smithi164 ceph-mon[69784]: pgmap v415: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:52.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:52 smithi164 ceph-mon[69784]: pgmap v416: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:52.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:52 smithi142 ceph-mon[79401]: pgmap v416: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:54.609 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:54 smithi142 ceph-mon[79401]: pgmap v417: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:54.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:54 smithi164 ceph-mon[69784]: pgmap v417: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:56.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:56 smithi142 ceph-mon[79401]: pgmap v418: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:56.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:56 smithi164 ceph-mon[69784]: pgmap v418: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:58.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:12:58 smithi164 ceph-mon[69784]: pgmap v419: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:12:58.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:12:58 smithi142 ceph-mon[79401]: pgmap v419: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:00.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:00 smithi164 ceph-mon[69784]: pgmap v420: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:00.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:00 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:13:00.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:00 smithi142 ceph-mon[79401]: pgmap v420: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:00.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:00 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:13:02.684 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:02 smithi164 ceph-mon[69784]: pgmap v421: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:02.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:02 smithi142 ceph-mon[79401]: pgmap v421: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:04.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:04 smithi142 ceph-mon[79401]: pgmap v422: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:04.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:04 smithi164 ceph-mon[69784]: pgmap v422: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:06.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:06 smithi164 ceph-mon[69784]: pgmap v423: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:06.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:06 smithi142 ceph-mon[79401]: pgmap v423: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:07.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:07 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:13:07.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:07 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:13:08.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:08 smithi164 ceph-mon[69784]: pgmap v424: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:08.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:08 smithi142 ceph-mon[79401]: pgmap v424: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:09.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:09 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:13:09.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:09 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:13:09.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:09 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:13:09.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:09 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:13:09.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:09 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:13:09.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:09 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:13:10.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:10 smithi142 ceph-mon[79401]: pgmap v425: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:10.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:10 smithi164 ceph-mon[69784]: pgmap v425: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:12.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:12 smithi142 ceph-mon[79401]: pgmap v426: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:12.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:12 smithi164 ceph-mon[69784]: pgmap v426: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:14.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:14 smithi142 ceph-mon[79401]: pgmap v427: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:14.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:14 smithi164 ceph-mon[69784]: pgmap v427: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:15.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:13:15.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:13:16.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:16 smithi164 ceph-mon[69784]: pgmap v428: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:16.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:16 smithi142 ceph-mon[79401]: pgmap v428: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:18.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:18 smithi164 ceph-mon[69784]: pgmap v429: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:18.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:18 smithi142 ceph-mon[79401]: pgmap v429: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:20.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:20 smithi142 ceph-mon[79401]: pgmap v430: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:20.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:20 smithi164 ceph-mon[69784]: pgmap v430: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:22.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:22 smithi142 ceph-mon[79401]: pgmap v431: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:22.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:22 smithi164 ceph-mon[69784]: pgmap v431: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:24.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:24 smithi142 ceph-mon[79401]: pgmap v432: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:24.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:24 smithi164 ceph-mon[69784]: pgmap v432: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:26.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:26 smithi142 ceph-mon[79401]: pgmap v433: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:26.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:26 smithi164 ceph-mon[69784]: pgmap v433: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:28.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:28 smithi164 ceph-mon[69784]: pgmap v434: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:28.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:28 smithi142 ceph-mon[79401]: pgmap v434: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:30.748 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:30 smithi142 ceph-mon[79401]: pgmap v435: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:30.748 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:13:30.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:30 smithi164 ceph-mon[69784]: pgmap v435: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:30.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:13:32.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:32 smithi164 ceph-mon[69784]: pgmap v436: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:32.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:32 smithi142 ceph-mon[79401]: pgmap v436: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:34.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:34 smithi142 ceph-mon[79401]: pgmap v437: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:34.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:34 smithi164 ceph-mon[69784]: pgmap v437: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:36.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:36 smithi142 ceph-mon[79401]: pgmap v438: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:36.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:36 smithi164 ceph-mon[69784]: pgmap v438: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:38.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:38 smithi142 ceph-mon[79401]: pgmap v439: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:38.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:38 smithi164 ceph-mon[69784]: pgmap v439: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:40.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:40 smithi142 ceph-mon[79401]: pgmap v440: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:40 smithi164 ceph-mon[69784]: pgmap v440: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:42.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:42 smithi164 ceph-mon[69784]: pgmap v441: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:42.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:42 smithi142 ceph-mon[79401]: pgmap v441: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:43.790 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:43 smithi164 ceph-mon[69784]: pgmap v442: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:43.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:43 smithi142 ceph-mon[79401]: pgmap v442: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:44.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:13:44.947 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:13:45.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:45 smithi164 ceph-mon[69784]: pgmap v443: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:45.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:45 smithi142 ceph-mon[79401]: pgmap v443: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:48.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:47 smithi164 ceph-mon[69784]: pgmap v444: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:48.197 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:47 smithi142 ceph-mon[79401]: pgmap v444: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:50.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:49 smithi142 ceph-mon[79401]: pgmap v445: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:50.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:49 smithi164 ceph-mon[69784]: pgmap v445: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:52.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:51 smithi164 ceph-mon[69784]: pgmap v446: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:52.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:51 smithi142 ceph-mon[79401]: pgmap v446: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:54.086 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:53 smithi164 ceph-mon[69784]: pgmap v447: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:54.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:53 smithi142 ceph-mon[79401]: pgmap v447: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:56.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:55 smithi164 ceph-mon[69784]: pgmap v448: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:56.198 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:55 smithi142 ceph-mon[79401]: pgmap v448: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:58.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:57 smithi164 ceph-mon[69784]: pgmap v449: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:13:58.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:57 smithi142 ceph-mon[79401]: pgmap v449: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:00.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:59 smithi164 ceph-mon[69784]: pgmap v450: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:00.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:13:59 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:14:00.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:59 smithi142 ceph-mon[79401]: pgmap v450: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:00.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:13:59 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:14:01.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:01 smithi142 ceph-mon[79401]: pgmap v451: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:02.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:01 smithi164 ceph-mon[69784]: pgmap v451: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:04.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:03 smithi142 ceph-mon[79401]: pgmap v452: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:04.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:03 smithi164 ceph-mon[69784]: pgmap v452: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:06.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:05 smithi164 ceph-mon[69784]: pgmap v453: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:06.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:05 smithi142 ceph-mon[79401]: pgmap v453: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:08.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:07 smithi142 ceph-mon[79401]: pgmap v454: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:08.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:07 smithi164 ceph-mon[69784]: pgmap v454: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:10.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:09 smithi142 ceph-mon[79401]: pgmap v455: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:10.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:09 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:14:10.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:09 smithi164 ceph-mon[69784]: pgmap v455: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:10.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:09 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:14:11.097 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:10 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:14:11.097 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:10 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:14:11.097 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:10 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:14:11.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:10 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:14:11.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:10 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:14:11.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:10 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:14:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:12 smithi164 ceph-mon[69784]: pgmap v456: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:12.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:12 smithi142 ceph-mon[79401]: pgmap v456: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:14.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:14 smithi164 ceph-mon[69784]: pgmap v457: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:14.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:14 smithi142 ceph-mon[79401]: pgmap v457: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:15.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:14:15.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:14:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:16 smithi164 ceph-mon[69784]: pgmap v458: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:16.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:16 smithi142 ceph-mon[79401]: pgmap v458: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:18.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:18 smithi164 ceph-mon[69784]: pgmap v459: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:18.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:18 smithi142 ceph-mon[79401]: pgmap v459: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:20.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:20 smithi142 ceph-mon[79401]: pgmap v460: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:20.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:20 smithi164 ceph-mon[69784]: pgmap v460: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:22.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:22 smithi142 ceph-mon[79401]: pgmap v461: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:22.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:22 smithi164 ceph-mon[69784]: pgmap v461: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:24.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:24 smithi164 ceph-mon[69784]: pgmap v462: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:24.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:24 smithi142 ceph-mon[79401]: pgmap v462: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:26.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:26 smithi164 ceph-mon[69784]: pgmap v463: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:26.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:26 smithi142 ceph-mon[79401]: pgmap v463: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:28.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:28 smithi164 ceph-mon[69784]: pgmap v464: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:28.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:28 smithi142 ceph-mon[79401]: pgmap v464: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:30.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:30 smithi164 ceph-mon[69784]: pgmap v465: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:30.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:14:30.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:30 smithi142 ceph-mon[79401]: pgmap v465: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:30.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:14:32.678 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:32 smithi142 ceph-mon[79401]: pgmap v466: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:32.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:32 smithi164 ceph-mon[69784]: pgmap v466: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:34.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:34 smithi142 ceph-mon[79401]: pgmap v467: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:34.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:34 smithi164 ceph-mon[69784]: pgmap v467: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:36.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:36 smithi142 ceph-mon[79401]: pgmap v468: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:36.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:36 smithi164 ceph-mon[69784]: pgmap v468: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:38.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:38 smithi142 ceph-mon[79401]: pgmap v469: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:38.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:38 smithi164 ceph-mon[69784]: pgmap v469: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:40.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:40 smithi142 ceph-mon[79401]: pgmap v470: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:40.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:40 smithi164 ceph-mon[69784]: pgmap v470: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:42.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:42 smithi164 ceph-mon[69784]: pgmap v471: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:42.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:42 smithi142 ceph-mon[79401]: pgmap v471: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:44.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:44 smithi164 ceph-mon[69784]: pgmap v472: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:44.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:44 smithi142 ceph-mon[79401]: pgmap v472: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:45.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:14:45.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:14:46.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:46 smithi142 ceph-mon[79401]: pgmap v473: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:46.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:46 smithi164 ceph-mon[69784]: pgmap v473: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:48.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:48 smithi142 ceph-mon[79401]: pgmap v474: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:48.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:48 smithi164 ceph-mon[69784]: pgmap v474: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:50.653 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:50 smithi164 ceph-mon[69784]: pgmap v475: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:50.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:50 smithi142 ceph-mon[79401]: pgmap v475: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:52.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:52 smithi142 ceph-mon[79401]: pgmap v476: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:52.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:52 smithi164 ceph-mon[69784]: pgmap v476: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:54.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:54 smithi142 ceph-mon[79401]: pgmap v477: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:54.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:54 smithi164 ceph-mon[69784]: pgmap v477: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:56.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:56 smithi142 ceph-mon[79401]: pgmap v478: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:56.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:56 smithi164 ceph-mon[69784]: pgmap v478: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:58.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:14:58 smithi164 ceph-mon[69784]: pgmap v479: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:14:58.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:14:58 smithi142 ceph-mon[79401]: pgmap v479: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:00.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:00 smithi142 ceph-mon[79401]: pgmap v480: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:00.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:00 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:15:00.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:00 smithi164 ceph-mon[69784]: pgmap v480: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:00.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:00 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:15:02.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:02 smithi164 ceph-mon[69784]: pgmap v481: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:02.742 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:02 smithi142 ceph-mon[79401]: pgmap v481: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:04.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:04 smithi142 ceph-mon[79401]: pgmap v482: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:04.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:04 smithi164 ceph-mon[69784]: pgmap v482: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:06.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:06 smithi164 ceph-mon[69784]: pgmap v483: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:06.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:06 smithi142 ceph-mon[79401]: pgmap v483: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:08.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:08 smithi164 ceph-mon[69784]: pgmap v484: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:08.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:08 smithi142 ceph-mon[79401]: pgmap v484: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:10.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:10 smithi164 ceph-mon[69784]: pgmap v485: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:10.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:10 smithi142 ceph-mon[79401]: pgmap v485: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:11.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:11 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:15:11.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:11 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:15:12.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:12 smithi164 ceph-mon[69784]: pgmap v486: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:12.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:12 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:15:12.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:12 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:15:12.697 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:12 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:15:12.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:12 smithi142 ceph-mon[79401]: pgmap v486: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:12.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:12 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:15:12.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:12 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:15:12.697 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:12 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:15:14.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:14 smithi142 ceph-mon[79401]: pgmap v487: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:14.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:14 smithi164 ceph-mon[69784]: pgmap v487: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:15.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:15:15.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:15:16.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:16 smithi164 ceph-mon[69784]: pgmap v488: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:16.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:16 smithi142 ceph-mon[79401]: pgmap v488: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:18.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:18 smithi142 ceph-mon[79401]: pgmap v489: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:18.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:18 smithi164 ceph-mon[69784]: pgmap v489: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:20.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:20 smithi164 ceph-mon[69784]: pgmap v490: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:20.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:20 smithi142 ceph-mon[79401]: pgmap v490: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:22.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:22 smithi142 ceph-mon[79401]: pgmap v491: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:22.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:22 smithi164 ceph-mon[69784]: pgmap v491: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:24.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:24 smithi142 ceph-mon[79401]: pgmap v492: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:24.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:24 smithi164 ceph-mon[69784]: pgmap v492: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:26.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:26 smithi164 ceph-mon[69784]: pgmap v493: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:26.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:26 smithi142 ceph-mon[79401]: pgmap v493: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:28.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:28 smithi142 ceph-mon[79401]: pgmap v494: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:28.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:28 smithi164 ceph-mon[69784]: pgmap v494: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:30.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:30 smithi142 ceph-mon[79401]: pgmap v495: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:30.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:30 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:15:30.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:30 smithi164 ceph-mon[69784]: pgmap v495: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:30.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:30 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:15:32.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:32 smithi164 ceph-mon[69784]: pgmap v496: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:32.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:32 smithi142 ceph-mon[79401]: pgmap v496: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:34.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:34 smithi164 ceph-mon[69784]: pgmap v497: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:34.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:34 smithi142 ceph-mon[79401]: pgmap v497: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:36.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:36 smithi142 ceph-mon[79401]: pgmap v498: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:36.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:36 smithi164 ceph-mon[69784]: pgmap v498: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:38.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:38 smithi142 ceph-mon[79401]: pgmap v499: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:38.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:38 smithi164 ceph-mon[69784]: pgmap v499: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:40.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:40 smithi164 ceph-mon[69784]: pgmap v500: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:40.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:40 smithi142 ceph-mon[79401]: pgmap v500: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:42.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:42 smithi142 ceph-mon[79401]: pgmap v501: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:42.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:42 smithi164 ceph-mon[69784]: pgmap v501: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:44.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:44 smithi164 ceph-mon[69784]: pgmap v502: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:44.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:44 smithi142 ceph-mon[79401]: pgmap v502: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:45.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:45 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:15:45.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:45 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:15:46.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:46 smithi142 ceph-mon[79401]: pgmap v503: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:46.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:46 smithi164 ceph-mon[69784]: pgmap v503: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:48.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:48 smithi164 ceph-mon[69784]: pgmap v504: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:48.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:48 smithi142 ceph-mon[79401]: pgmap v504: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:50.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:50 smithi164 ceph-mon[69784]: pgmap v505: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:50.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:50 smithi142 ceph-mon[79401]: pgmap v505: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:52.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:52 smithi164 ceph-mon[69784]: pgmap v506: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:52.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:52 smithi142 ceph-mon[79401]: pgmap v506: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:54.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:54 smithi142 ceph-mon[79401]: pgmap v507: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:54.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:54 smithi164 ceph-mon[69784]: pgmap v507: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:56.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:56 smithi164 ceph-mon[69784]: pgmap v508: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:56.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:56 smithi142 ceph-mon[79401]: pgmap v508: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:58.946 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:58 smithi164 ceph-mon[69784]: pgmap v509: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:58.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:58 smithi142 ceph-mon[79401]: pgmap v509: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:59.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:59 smithi142 ceph-mon[79401]: pgmap v510: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:59.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:15:59 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:15:59.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:59 smithi164 ceph-mon[69784]: pgmap v510: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:15:59.947 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:15:59 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:16:02.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:01 smithi164 ceph-mon[69784]: pgmap v511: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:02.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:01 smithi142 ceph-mon[79401]: pgmap v511: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:04.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:03 smithi142 ceph-mon[79401]: pgmap v512: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:04.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:03 smithi164 ceph-mon[69784]: pgmap v512: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:05.946 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:05 smithi142 ceph-mon[79401]: pgmap v513: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:06.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:05 smithi164 ceph-mon[69784]: pgmap v513: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:08.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:07 smithi164 ceph-mon[69784]: pgmap v514: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:08.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:07 smithi142 ceph-mon[79401]: pgmap v514: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:10.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:09 smithi164 ceph-mon[69784]: pgmap v515: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:10.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:09 smithi142 ceph-mon[79401]: pgmap v515: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:12.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:11 smithi142 ceph-mon[79401]: pgmap v516: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:12.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:11 smithi164 ceph-mon[69784]: pgmap v516: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:13.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:12 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:16:13.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:12 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:16:14.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:13 smithi142 ceph-mon[79401]: pgmap v517: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:14.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:13 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:16:14.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:13 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:16:14.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:13 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:16:14.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:13 smithi164 ceph-mon[69784]: pgmap v517: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:14.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:13 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:16:14.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:13 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:16:14.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:13 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:16:15.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:16:15.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:16:16.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:15 smithi164 ceph-mon[69784]: pgmap v518: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:16.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:15 smithi142 ceph-mon[79401]: pgmap v518: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:18.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:17 smithi142 ceph-mon[79401]: pgmap v519: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:18.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:17 smithi164 ceph-mon[69784]: pgmap v519: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:20.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:19 smithi142 ceph-mon[79401]: pgmap v520: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:20.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:19 smithi164 ceph-mon[69784]: pgmap v520: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:22.198 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:21 smithi164 ceph-mon[69784]: pgmap v521: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:22.199 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:21 smithi142 ceph-mon[79401]: pgmap v521: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:24.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:23 smithi142 ceph-mon[79401]: pgmap v522: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:24.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:23 smithi164 ceph-mon[69784]: pgmap v522: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:26.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:25 smithi164 ceph-mon[69784]: pgmap v523: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:26.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:25 smithi142 ceph-mon[79401]: pgmap v523: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:28.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:27 smithi142 ceph-mon[79401]: pgmap v524: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:28.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:27 smithi164 ceph-mon[69784]: pgmap v524: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:30.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:29 smithi142 ceph-mon[79401]: pgmap v525: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:30.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:29 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:16:30.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:29 smithi164 ceph-mon[69784]: pgmap v525: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:30.197 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:29 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:16:32.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:31 smithi164 ceph-mon[69784]: pgmap v526: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:32.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:31 smithi142 ceph-mon[79401]: pgmap v526: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:34.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:33 smithi142 ceph-mon[79401]: pgmap v527: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:34.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:33 smithi164 ceph-mon[69784]: pgmap v527: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:36.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:35 smithi164 ceph-mon[69784]: pgmap v528: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:36.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:35 smithi142 ceph-mon[79401]: pgmap v528: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:38.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:37 smithi164 ceph-mon[69784]: pgmap v529: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:38.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:37 smithi142 ceph-mon[79401]: pgmap v529: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:40.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:39 smithi164 ceph-mon[69784]: pgmap v530: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:40.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:39 smithi142 ceph-mon[79401]: pgmap v530: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:42.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:41 smithi142 ceph-mon[79401]: pgmap v531: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:42.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:41 smithi164 ceph-mon[69784]: pgmap v531: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:44.196 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:43 smithi164 ceph-mon[69784]: pgmap v532: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:44.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:43 smithi142 ceph-mon[79401]: pgmap v532: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:45.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:44 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:16:45.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:44 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:16:46.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:45 smithi142 ceph-mon[79401]: pgmap v533: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:46.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:45 smithi164 ceph-mon[69784]: pgmap v533: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:48.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:47 smithi164 ceph-mon[69784]: pgmap v534: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:48.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:47 smithi142 ceph-mon[79401]: pgmap v534: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:50.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:49 smithi142 ceph-mon[79401]: pgmap v535: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:50.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:49 smithi164 ceph-mon[69784]: pgmap v535: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:52.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:51 smithi142 ceph-mon[79401]: pgmap v536: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:52.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:51 smithi164 ceph-mon[69784]: pgmap v536: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:54.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:53 smithi142 ceph-mon[79401]: pgmap v537: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:54.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:53 smithi164 ceph-mon[69784]: pgmap v537: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:56.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:55 smithi164 ceph-mon[69784]: pgmap v538: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:56.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:55 smithi142 ceph-mon[79401]: pgmap v538: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:58.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:16:58 smithi164 ceph-mon[69784]: pgmap v539: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:16:58.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:16:58 smithi142 ceph-mon[79401]: pgmap v539: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:17:00.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:00 smithi142 ceph-mon[79401]: pgmap v540: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:17:00.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:00 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:17:00.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:00 smithi164 ceph-mon[69784]: pgmap v540: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:17:00.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:00 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:17:02.377 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:02 smithi142 ceph-mon[79401]: pgmap v541: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:17:02.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:02 smithi164 ceph-mon[69784]: pgmap v541: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:17:04.444 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:04 smithi164 ceph-mon[69784]: pgmap v542: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:17:04.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:04 smithi142 ceph-mon[79401]: pgmap v542: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:17:06.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:06 smithi142 ceph-mon[79401]: pgmap v543: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:17:06.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:06 smithi164 ceph-mon[69784]: pgmap v543: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:17:08.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:08 smithi164 ceph-mon[69784]: pgmap v544: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:17:08.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:08 smithi142 ceph-mon[79401]: pgmap v544: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:17:10.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:10 smithi142 ceph-mon[79401]: pgmap v545: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:17:10.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:10 smithi164 ceph-mon[69784]: pgmap v545: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:17:12.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:12 smithi142 ceph-mon[79401]: pgmap v546: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:17:12.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:12 smithi164 ceph-mon[69784]: pgmap v546: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:17:14.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:14 smithi142 ceph-mon[79401]: pgmap v547: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:17:14.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:14 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:17:14.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:14 smithi164 ceph-mon[69784]: pgmap v547: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:17:14.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:14 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T22:17:15.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:15 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:17:15.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:15 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-20T22:17:16.374 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-04-20T22:17:16.374 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-20T22:17:16.375 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-20T22:17:16.388 INFO:tasks.cephadm:Teardown begin 2024-04-20T22:17:16.389 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/cephadm.py", line 2246, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-20T22:17:16.390 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-20T22:17:16.445 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:16 smithi142 ceph-mon[79401]: pgmap v548: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:17:16.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:16 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:17:16.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:16 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:17:16.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:16 smithi142 ceph-mon[79401]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:17:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:16 smithi164 ceph-mon[69784]: pgmap v548: 65 pgs: 65 active+clean; 210 MiB data, 896 MiB used, 536 GiB / 536 GiB avail 2024-04-20T22:17:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:16 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T22:17:16.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:16 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T22:17:16.447 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:16 smithi164 ceph-mon[69784]: from='mgr.34104 172.21.15.142:0/235911952' entity='mgr.smithi142.zzmcfz' 2024-04-20T22:17:16.481 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-20T22:17:16.573 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-20T22:17:16.573 DEBUG:teuthology.orchestra.run.smithi142:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-20T22:17:16.631 DEBUG:teuthology.orchestra.run.smithi164:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-20T22:17:16.688 INFO:tasks.cephadm:Stopping all daemons... 2024-04-20T22:17:16.688 INFO:tasks.cephadm.mon.smithi142:Stopping mon.smithi142... 2024-04-20T22:17:16.688 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mon.smithi142 2024-04-20T22:17:17.196 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:16 smithi142 systemd[1]: Stopping Ceph mon.smithi142 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:17:17.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:17 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142[79397]: 2024-04-20T22:17:17.272+0000 7fc6d4600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi142 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T22:17:17.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:17 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142[79397]: 2024-04-20T22:17:17.272+0000 7fc6d4600700 -1 mon.smithi142@0(leader) e3 *** Got Signal Terminated *** 2024-04-20T22:17:17.696 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:17 smithi142 podman[141175]: 2024-04-20 22:17:17.468703371 +0000 UTC m=+0.351442251 container died af10a542c918d7cf23a9d488900532e6ab789ea5062ae796a1d9fa142bc457fa (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-20T22:17:18.062 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:18 smithi142 podman[141175]: 2024-04-20 22:17:18.024354401 +0000 UTC m=+0.907093294 container cleanup af10a542c918d7cf23a9d488900532e6ab789ea5062ae796a1d9fa142bc457fa (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True) 2024-04-20T22:17:18.062 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:18 smithi142 bash[141175]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142 2024-04-20T22:17:18.446 INFO:journalctl@ceph.mon.smithi142.smithi142.stdout:Apr 20 22:17:18 smithi142 podman[141200]: 2024-04-20 22:17:18.284598767 +0000 UTC m=+0.800501998 container remove af10a542c918d7cf23a9d488900532e6ab789ea5062ae796a1d9fa142bc457fa (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi142, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416) 2024-04-20T22:17:18.775 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mon.smithi142.service' 2024-04-20T22:17:18.925 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T22:17:18.925 INFO:tasks.cephadm.mon.smithi142:Stopped mon.smithi142 2024-04-20T22:17:18.925 INFO:tasks.cephadm.mon.smithi164:Stopping mon.smithi164... 2024-04-20T22:17:18.925 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mon.smithi164 2024-04-20T22:17:19.446 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:19 smithi164 systemd[1]: Stopping Ceph mon.smithi164 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:17:19.889 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:19 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi164[69780]: 2024-04-20T22:17:19.556+0000 7f9743800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi164 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T22:17:19.889 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:19 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi164[69780]: 2024-04-20T22:17:19.556+0000 7f9743800700 -1 mon.smithi164@1(peon) e3 *** Got Signal Terminated *** 2024-04-20T22:17:19.889 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:19 smithi164 podman[110769]: 2024-04-20 22:17:19.650332975 +0000 UTC m=+0.246592371 container died 133512694d4633656297593db3e471bf23b273b45bf9e5f2859e8ae3f239a7a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi164, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-20T22:17:20.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:20 smithi164 podman[110769]: 2024-04-20 22:17:20.207950979 +0000 UTC m=+0.804210365 container cleanup 133512694d4633656297593db3e471bf23b273b45bf9e5f2859e8ae3f239a7a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi164, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-20T22:17:20.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:20 smithi164 bash[110769]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi164 2024-04-20T22:17:20.696 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Apr 20 22:17:20 smithi164 podman[110783]: 2024-04-20 22:17:20.417838563 +0000 UTC m=+0.755939613 container remove 133512694d4633656297593db3e471bf23b273b45bf9e5f2859e8ae3f239a7a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-mon-smithi164, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-20T22:17:20.902 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-270cccba-ff5f-11ee-bc93-c7b262605968@mon.smithi164.service' 2024-04-20T22:17:21.038 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T22:17:21.038 INFO:tasks.cephadm.mon.smithi164:Stopped mon.smithi164 2024-04-20T22:17:21.038 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-20T22:17:21.038 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.0 2024-04-20T22:17:21.446 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:17:21 smithi142 systemd[1]: Stopping Ceph osd.0 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:17:21.946 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:17:21 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0[88591]: 2024-04-20T22:17:21.544+0000 7f3516600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T22:17:21.946 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:17:21 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0[88591]: 2024-04-20T22:17:21.544+0000 7f3516600700 -1 osd.0 85 *** Got signal Terminated *** 2024-04-20T22:17:21.946 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:17:21 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0[88591]: 2024-04-20T22:17:21.544+0000 7f3516600700 -1 osd.0 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T22:17:27.301 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:17:26 smithi142 podman[141307]: 2024-04-20 22:17:26.998563309 +0000 UTC m=+5.579762374 container died b7206d05a7cdd2d282851c11b1f88cbd5738e603b2b4891706d7ee81ff552e17 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T22:17:27.688 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:17:27 smithi142 podman[141307]: 2024-04-20 22:17:27.437757062 +0000 UTC m=+6.018956119 container cleanup b7206d05a7cdd2d282851c11b1f88cbd5738e603b2b4891706d7ee81ff552e17 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-20T22:17:27.689 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:17:27 smithi142 bash[141307]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0 2024-04-20T22:17:27.946 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:17:27 smithi142 podman[141325]: 2024-04-20 22:17:27.68901205 +0000 UTC m=+0.684041313 container remove b7206d05a7cdd2d282851c11b1f88cbd5738e603b2b4891706d7ee81ff552e17 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux ) 2024-04-20T22:17:28.844 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:17:28 smithi142 podman[141415]: 2024-04-20 22:17:28.451237813 +0000 UTC m=+0.034356694 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:17:28.845 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:17:28 smithi142 podman[141415]: 2024-04-20 22:17:28.581814829 +0000 UTC m=+0.164933747 container create e68c62a7f390f0c71e77a844d2633638d436b5bb00b7d4b3c55f72ab4eb0b234 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-20T22:17:28.845 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:17:28 smithi142 podman[141415]: 2024-04-20 22:17:28.84419784 +0000 UTC m=+0.427316778 container init e68c62a7f390f0c71e77a844d2633638d436b5bb00b7d4b3c55f72ab4eb0b234 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True) 2024-04-20T22:17:29.201 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:17:28 smithi142 podman[141415]: 2024-04-20 22:17:28.857419893 +0000 UTC m=+0.440538779 container start e68c62a7f390f0c71e77a844d2633638d436b5bb00b7d4b3c55f72ab4eb0b234 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2) 2024-04-20T22:17:29.201 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:17:28 smithi142 podman[141415]: 2024-04-20 22:17:28.975700486 +0000 UTC m=+0.558819457 container attach e68c62a7f390f0c71e77a844d2633638d436b5bb00b7d4b3c55f72ab4eb0b234 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux ) 2024-04-20T22:17:29.641 INFO:journalctl@ceph.osd.0.smithi142.stdout:Apr 20 22:17:29 smithi142 podman[141441]: 2024-04-20 22:17:29.371901976 +0000 UTC m=+0.036731565 container died e68c62a7f390f0c71e77a844d2633638d436b5bb00b7d4b3c55f72ab4eb0b234 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-0-deactivate, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD) 2024-04-20T22:17:30.285 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.0.service' 2024-04-20T22:17:30.393 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T22:17:30.393 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-20T22:17:30.393 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-20T22:17:30.393 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.1 2024-04-20T22:17:30.946 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:17:30 smithi142 systemd[1]: Stopping Ceph osd.1 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:17:31.446 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:17:30 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1[93975]: 2024-04-20T22:17:30.962+0000 7f3830800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T22:17:31.446 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:17:30 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1[93975]: 2024-04-20T22:17:30.962+0000 7f3830800700 -1 osd.1 85 *** Got signal Terminated *** 2024-04-20T22:17:31.446 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:17:30 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1[93975]: 2024-04-20T22:17:30.962+0000 7f3830800700 -1 osd.1 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T22:17:36.858 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:17:36 smithi142 podman[141522]: 2024-04-20 22:17:36.52917413 +0000 UTC m=+5.710008954 container died 82bcc0c46762a845d620769fd565225434d170c700ae9b8ef825716918b55633 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-20T22:17:37.196 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:17:36 smithi142 podman[141522]: 2024-04-20 22:17:36.974410901 +0000 UTC m=+6.155245762 container cleanup 82bcc0c46762a845d620769fd565225434d170c700ae9b8ef825716918b55633 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS) 2024-04-20T22:17:37.196 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:17:36 smithi142 bash[141522]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1 2024-04-20T22:17:37.696 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:17:37 smithi142 podman[141540]: 2024-04-20 22:17:37.227111611 +0000 UTC m=+0.677786088 container remove 82bcc0c46762a845d620769fd565225434d170c700ae9b8ef825716918b55633 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, GIT_BRANCH=HEAD) 2024-04-20T22:17:38.341 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:17:38 smithi142 podman[141626]: 2024-04-20 22:17:37.994961568 +0000 UTC m=+0.033619664 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:17:38.341 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:17:38 smithi142 podman[141626]: 2024-04-20 22:17:38.093215041 +0000 UTC m=+0.131873174 container create 81a26d19d20958bcec0cb6e82ffd5c8f7edc630359efb15b9dd9e2f8e3412e37 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , ceph=True) 2024-04-20T22:17:38.696 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:17:38 smithi142 podman[141626]: 2024-04-20 22:17:38.40597604 +0000 UTC m=+0.444634180 container init 81a26d19d20958bcec0cb6e82ffd5c8f7edc630359efb15b9dd9e2f8e3412e37 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-20T22:17:38.696 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:17:38 smithi142 podman[141626]: 2024-04-20 22:17:38.41963905 +0000 UTC m=+0.458297153 container start 81a26d19d20958bcec0cb6e82ffd5c8f7edc630359efb15b9dd9e2f8e3412e37 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5) 2024-04-20T22:17:38.696 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:17:38 smithi142 podman[141626]: 2024-04-20 22:17:38.504270955 +0000 UTC m=+0.542929138 container attach 81a26d19d20958bcec0cb6e82ffd5c8f7edc630359efb15b9dd9e2f8e3412e37 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-20T22:17:39.196 INFO:journalctl@ceph.osd.1.smithi142.stdout:Apr 20 22:17:38 smithi142 podman[141626]: 2024-04-20 22:17:38.874178548 +0000 UTC m=+0.912836717 container died 81a26d19d20958bcec0cb6e82ffd5c8f7edc630359efb15b9dd9e2f8e3412e37 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-20T22:17:39.653 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.1.service' 2024-04-20T22:17:39.764 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T22:17:39.764 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-20T22:17:39.765 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-20T22:17:39.765 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.2 2024-04-20T22:17:40.196 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:17:39 smithi142 systemd[1]: Stopping Ceph osd.2 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:17:40.696 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:17:40 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2[99330]: 2024-04-20T22:17:40.242+0000 7fb644400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T22:17:40.696 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:17:40 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2[99330]: 2024-04-20T22:17:40.242+0000 7fb644400700 -1 osd.2 85 *** Got signal Terminated *** 2024-04-20T22:17:40.696 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:17:40 smithi142 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2[99330]: 2024-04-20T22:17:40.242+0000 7fb644400700 -1 osd.2 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T22:17:45.947 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:17:45 smithi142 podman[141733]: 2024-04-20 22:17:45.647045235 +0000 UTC m=+5.533236072 container died 3e2d91f49494be369b503fec77a1fe3807f7a04f89b2e03efe702bfe689cabdb (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-20T22:17:46.345 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:17:46 smithi142 podman[141733]: 2024-04-20 22:17:46.086142869 +0000 UTC m=+5.972333763 container cleanup 3e2d91f49494be369b503fec77a1fe3807f7a04f89b2e03efe702bfe689cabdb (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-20T22:17:46.345 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:17:46 smithi142 bash[141733]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2 2024-04-20T22:17:46.696 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:17:46 smithi142 podman[141764]: 2024-04-20 22:17:46.345510155 +0000 UTC m=+0.682398842 container remove 3e2d91f49494be369b503fec77a1fe3807f7a04f89b2e03efe702bfe689cabdb (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.build-date=20240416) 2024-04-20T22:17:47.446 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:17:47 smithi142 podman[141855]: 2024-04-20 22:17:47.051002563 +0000 UTC m=+0.034797292 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:17:47.446 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:17:47 smithi142 podman[141855]: 2024-04-20 22:17:47.163186621 +0000 UTC m=+0.146981369 container create 4864aff2d566a27572ae63320677c9610f256e33033329d63f85e3fc18a7e3c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-20T22:17:47.907 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:17:47 smithi142 podman[141855]: 2024-04-20 22:17:47.450050578 +0000 UTC m=+0.433845338 container init 4864aff2d566a27572ae63320677c9610f256e33033329d63f85e3fc18a7e3c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, ceph=True, GIT_BRANCH=HEAD) 2024-04-20T22:17:47.908 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:17:47 smithi142 podman[141855]: 2024-04-20 22:17:47.461190577 +0000 UTC m=+0.444985304 container start 4864aff2d566a27572ae63320677c9610f256e33033329d63f85e3fc18a7e3c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-20T22:17:47.908 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:17:47 smithi142 podman[141855]: 2024-04-20 22:17:47.590541632 +0000 UTC m=+0.574336426 container attach 4864aff2d566a27572ae63320677c9610f256e33033329d63f85e3fc18a7e3c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-20T22:17:48.196 INFO:journalctl@ceph.osd.2.smithi142.stdout:Apr 20 22:17:47 smithi142 podman[141855]: 2024-04-20 22:17:47.90847152 +0000 UTC m=+0.892266284 container died 4864aff2d566a27572ae63320677c9610f256e33033329d63f85e3fc18a7e3c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416) 2024-04-20T22:17:48.695 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.2.service' 2024-04-20T22:17:48.810 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T22:17:48.810 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-20T22:17:48.810 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-20T22:17:48.810 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.3 2024-04-20T22:17:49.196 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:17:48 smithi164 systemd[1]: Stopping Ceph osd.3 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:17:49.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:17:48 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:17:48.902+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:17:49.696 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:17:49 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3[79484]: 2024-04-20T22:17:49.364+0000 7f3c50e00700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:26.450530+0000 front 2024-04-20T22:17:26.450507+0000 (oldest deadline 2024-04-20T22:17:49.349937+0000) 2024-04-20T22:17:49.696 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:17:49 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3[79484]: 2024-04-20T22:17:49.385+0000 7f3c55600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T22:17:49.696 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:17:49 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3[79484]: 2024-04-20T22:17:49.385+0000 7f3c55600700 -1 osd.3 85 *** Got signal Terminated *** 2024-04-20T22:17:49.696 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:17:49 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3[79484]: 2024-04-20T22:17:49.385+0000 7f3c55600700 -1 osd.3 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T22:17:50.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:17:49 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:17:49.923+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:17:50.686 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:17:50 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3[79484]: 2024-04-20T22:17:50.323+0000 7f3c50e00700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:26.450530+0000 front 2024-04-20T22:17:26.450507+0000 (oldest deadline 2024-04-20T22:17:49.349937+0000) 2024-04-20T22:17:50.686 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:17:50 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:17:50.462+0000 7fd21ae00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:26.349324+0000 front 2024-04-20T22:17:26.349757+0000 (oldest deadline 2024-04-20T22:17:50.448968+0000) 2024-04-20T22:17:50.946 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:17:50 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:17:50.913+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:17:51.696 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:17:51 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3[79484]: 2024-04-20T22:17:51.285+0000 7f3c50e00700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:26.450530+0000 front 2024-04-20T22:17:26.450507+0000 (oldest deadline 2024-04-20T22:17:49.349937+0000) 2024-04-20T22:17:51.697 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:17:51 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:17:51.442+0000 7fd21ae00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:26.349324+0000 front 2024-04-20T22:17:26.349757+0000 (oldest deadline 2024-04-20T22:17:50.448968+0000) 2024-04-20T22:17:52.198 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:17:51 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:17:51.920+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:17:52.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:17:52 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:17:52.427+0000 7fd21ae00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:26.349324+0000 front 2024-04-20T22:17:26.349757+0000 (oldest deadline 2024-04-20T22:17:50.448968+0000) 2024-04-20T22:17:52.696 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:17:52 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3[79484]: 2024-04-20T22:17:52.335+0000 7f3c50e00700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:26.450530+0000 front 2024-04-20T22:17:26.450507+0000 (oldest deadline 2024-04-20T22:17:49.349937+0000) 2024-04-20T22:17:53.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:17:52 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:17:52.923+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:17:53.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:17:53 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:17:53.445+0000 7fd21ae00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:26.349324+0000 front 2024-04-20T22:17:26.349757+0000 (oldest deadline 2024-04-20T22:17:50.448968+0000) 2024-04-20T22:17:53.696 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:17:53 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3[79484]: 2024-04-20T22:17:53.381+0000 7f3c50e00700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:26.450530+0000 front 2024-04-20T22:17:26.450507+0000 (oldest deadline 2024-04-20T22:17:49.349937+0000) 2024-04-20T22:17:54.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:17:53 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:17:53.913+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:17:54.748 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:17:54 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:17:54.471+0000 7fd21ae00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:26.349324+0000 front 2024-04-20T22:17:26.349757+0000 (oldest deadline 2024-04-20T22:17:50.448968+0000) 2024-04-20T22:17:55.050 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:17:54 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:17:54.874+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:17:55.051 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:17:54 smithi164 podman[110905]: 2024-04-20 22:17:54.749624152 +0000 UTC m=+5.495196871 container died a898b8b77c519e12b08f77519fa079dd55d047b6c510d35b822a311da9d980e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T22:17:55.428 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:17:55 smithi164 podman[110905]: 2024-04-20 22:17:55.221290963 +0000 UTC m=+5.966863719 container cleanup a898b8b77c519e12b08f77519fa079dd55d047b6c510d35b822a311da9d980e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-20T22:17:55.429 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:17:55 smithi164 bash[110905]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3 2024-04-20T22:17:55.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:17:55 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:17:55.427+0000 7fd21ae00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:26.349324+0000 front 2024-04-20T22:17:26.349757+0000 (oldest deadline 2024-04-20T22:17:50.448968+0000) 2024-04-20T22:17:55.696 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:17:55 smithi164 podman[110922]: 2024-04-20 22:17:55.606900294 +0000 UTC m=+0.845203107 container remove a898b8b77c519e12b08f77519fa079dd55d047b6c510d35b822a311da9d980e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T22:17:56.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:17:55 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:17:55.870+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:17:56.535 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:17:56 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:17:56.414+0000 7fd21ae00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:26.349324+0000 front 2024-04-20T22:17:26.349757+0000 (oldest deadline 2024-04-20T22:17:50.448968+0000) 2024-04-20T22:17:56.536 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:17:56 smithi164 podman[111010]: 2024-04-20 22:17:56.136530977 +0000 UTC m=+0.038459888 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:17:56.536 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:17:56 smithi164 podman[111010]: 2024-04-20 22:17:56.266059406 +0000 UTC m=+0.167988349 container create 69b181b8a396cab17551dcac68e8fc2c9e1f374c3b870d9834f538f37a7c47a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-deactivate, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416) 2024-04-20T22:17:56.536 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:17:56 smithi164 podman[111010]: 2024-04-20 22:17:56.535993128 +0000 UTC m=+0.437922081 container init 69b181b8a396cab17551dcac68e8fc2c9e1f374c3b870d9834f538f37a7c47a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-20T22:17:56.906 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:17:56 smithi164 podman[111010]: 2024-04-20 22:17:56.549812891 +0000 UTC m=+0.451741830 container start 69b181b8a396cab17551dcac68e8fc2c9e1f374c3b870d9834f538f37a7c47a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-20T22:17:56.907 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:17:56 smithi164 podman[111010]: 2024-04-20 22:17:56.660027647 +0000 UTC m=+0.561956650 container attach 69b181b8a396cab17551dcac68e8fc2c9e1f374c3b870d9834f538f37a7c47a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5) 2024-04-20T22:17:57.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:17:56 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:17:56.906+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:17:57.197 INFO:journalctl@ceph.osd.3.smithi164.stdout:Apr 20 22:17:56 smithi164 podman[111010]: 2024-04-20 22:17:56.998035491 +0000 UTC m=+0.899964396 container died 69b181b8a396cab17551dcac68e8fc2c9e1f374c3b870d9834f538f37a7c47a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-20T22:17:57.645 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:17:57 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:17:57.439+0000 7fd21ae00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:26.349324+0000 front 2024-04-20T22:17:26.349757+0000 (oldest deadline 2024-04-20T22:17:50.448968+0000) 2024-04-20T22:17:57.692 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.3.service' 2024-04-20T22:17:57.792 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T22:17:57.792 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-20T22:17:57.793 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-20T22:17:57.793 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.4 2024-04-20T22:17:58.196 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:17:57 smithi164 systemd[1]: Stopping Ceph osd.4 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:17:58.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:17:57 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:17:57.947+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:17:58.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:17:58 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:17:58.389+0000 7fd224600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T22:17:58.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:17:58 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:17:58.389+0000 7fd224600700 -1 osd.4 85 *** Got signal Terminated *** 2024-04-20T22:17:58.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:17:58 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:17:58.389+0000 7fd224600700 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T22:17:58.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:17:58 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:17:58.413+0000 7fd21ae00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:26.349324+0000 front 2024-04-20T22:17:26.349757+0000 (oldest deadline 2024-04-20T22:17:50.448968+0000) 2024-04-20T22:17:59.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:17:58 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:17:58.910+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:17:59.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:17:59 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:17:59.436+0000 7fd21ae00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:26.349324+0000 front 2024-04-20T22:17:26.349757+0000 (oldest deadline 2024-04-20T22:17:50.448968+0000) 2024-04-20T22:18:00.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:17:59 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:17:59.877+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:18:00.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:17:59 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:17:59.878+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6814 osd.1 since back 2024-04-20T22:17:35.468092+0000 front 2024-04-20T22:17:35.468325+0000 (oldest deadline 2024-04-20T22:17:59.567814+0000) 2024-04-20T22:18:00.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:18:00 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:18:00.392+0000 7fd21ae00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:26.349324+0000 front 2024-04-20T22:17:26.349757+0000 (oldest deadline 2024-04-20T22:17:50.448968+0000) 2024-04-20T22:18:00.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:18:00 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:18:00.392+0000 7fd21ae00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.142:6814 osd.1 since back 2024-04-20T22:17:33.851268+0000 front 2024-04-20T22:17:33.851590+0000 (oldest deadline 2024-04-20T22:17:59.751073+0000) 2024-04-20T22:18:01.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:00 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:00.918+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:18:01.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:00 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:00.918+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6814 osd.1 since back 2024-04-20T22:17:35.468092+0000 front 2024-04-20T22:17:35.468325+0000 (oldest deadline 2024-04-20T22:17:59.567814+0000) 2024-04-20T22:18:01.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:18:01 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:18:01.348+0000 7fd21ae00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:26.349324+0000 front 2024-04-20T22:17:26.349757+0000 (oldest deadline 2024-04-20T22:17:50.448968+0000) 2024-04-20T22:18:01.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:18:01 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:18:01.348+0000 7fd21ae00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.142:6814 osd.1 since back 2024-04-20T22:17:33.851268+0000 front 2024-04-20T22:17:33.851590+0000 (oldest deadline 2024-04-20T22:17:59.751073+0000) 2024-04-20T22:18:02.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:01 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:01.872+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:18:02.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:01 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:01.872+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6814 osd.1 since back 2024-04-20T22:17:35.468092+0000 front 2024-04-20T22:17:35.468325+0000 (oldest deadline 2024-04-20T22:17:59.567814+0000) 2024-04-20T22:18:02.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:18:02 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:18:02.336+0000 7fd21ae00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:26.349324+0000 front 2024-04-20T22:17:26.349757+0000 (oldest deadline 2024-04-20T22:17:50.448968+0000) 2024-04-20T22:18:02.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:18:02 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:18:02.336+0000 7fd21ae00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.142:6814 osd.1 since back 2024-04-20T22:17:33.851268+0000 front 2024-04-20T22:17:33.851590+0000 (oldest deadline 2024-04-20T22:17:59.751073+0000) 2024-04-20T22:18:03.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:02 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:02.861+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:18:03.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:02 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:02.861+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6814 osd.1 since back 2024-04-20T22:17:35.468092+0000 front 2024-04-20T22:17:35.468325+0000 (oldest deadline 2024-04-20T22:17:59.567814+0000) 2024-04-20T22:18:03.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:18:03 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:18:03.311+0000 7fd21ae00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:26.349324+0000 front 2024-04-20T22:17:26.349757+0000 (oldest deadline 2024-04-20T22:17:50.448968+0000) 2024-04-20T22:18:03.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:18:03 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4[84342]: 2024-04-20T22:18:03.311+0000 7fd21ae00700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.142:6814 osd.1 since back 2024-04-20T22:17:33.851268+0000 front 2024-04-20T22:17:33.851590+0000 (oldest deadline 2024-04-20T22:17:59.751073+0000) 2024-04-20T22:18:04.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:03 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:03.858+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:18:04.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:03 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:03.858+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6814 osd.1 since back 2024-04-20T22:17:35.468092+0000 front 2024-04-20T22:17:35.468325+0000 (oldest deadline 2024-04-20T22:17:59.567814+0000) 2024-04-20T22:18:04.197 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:18:03 smithi164 podman[111125]: 2024-04-20 22:18:03.932126608 +0000 UTC m=+5.674554452 container stop 539c4026f9fb3db356050e48f40371327020f9948f4353ecab9f19d66d829625 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416) 2024-04-20T22:18:04.197 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:18:03 smithi164 podman[111125]: 2024-04-20 22:18:03.961166197 +0000 UTC m=+5.703594052 container died 539c4026f9fb3db356050e48f40371327020f9948f4353ecab9f19d66d829625 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416) 2024-04-20T22:18:04.633 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:18:04 smithi164 podman[111125]: 2024-04-20 22:18:04.407483768 +0000 UTC m=+6.149911647 container cleanup 539c4026f9fb3db356050e48f40371327020f9948f4353ecab9f19d66d829625 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T22:18:04.633 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:18:04 smithi164 bash[111125]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4 2024-04-20T22:18:04.946 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:18:04 smithi164 podman[111145]: 2024-04-20 22:18:04.63354683 +0000 UTC m=+0.683903676 container remove 539c4026f9fb3db356050e48f40371327020f9948f4353ecab9f19d66d829625 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T22:18:04.946 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:04 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:04.847+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:18:04.946 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:04 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:04.847+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6814 osd.1 since back 2024-04-20T22:17:35.468092+0000 front 2024-04-20T22:17:35.468325+0000 (oldest deadline 2024-04-20T22:17:59.567814+0000) 2024-04-20T22:18:05.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:18:05 smithi164 podman[111239]: 2024-04-20 22:18:05.348861597 +0000 UTC m=+0.040859100 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:18:05.696 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:18:05 smithi164 podman[111239]: 2024-04-20 22:18:05.476136863 +0000 UTC m=+0.168134359 container create 007b95443f2f0187b231ebb2eee665b3f1b5d01772a4d7ea8688436b2c7bb040 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T22:18:06.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:05 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:05.855+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:18:06.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:05 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:05.855+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6814 osd.1 since back 2024-04-20T22:17:35.468092+0000 front 2024-04-20T22:17:35.468325+0000 (oldest deadline 2024-04-20T22:17:59.567814+0000) 2024-04-20T22:18:06.196 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:18:05 smithi164 podman[111239]: 2024-04-20 22:18:05.806558819 +0000 UTC m=+0.498556362 container init 007b95443f2f0187b231ebb2eee665b3f1b5d01772a4d7ea8688436b2c7bb040 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-20T22:18:06.196 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:18:05 smithi164 podman[111239]: 2024-04-20 22:18:05.819563193 +0000 UTC m=+0.511560719 container start 007b95443f2f0187b231ebb2eee665b3f1b5d01772a4d7ea8688436b2c7bb040 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416) 2024-04-20T22:18:06.196 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:18:05 smithi164 podman[111239]: 2024-04-20 22:18:05.895017933 +0000 UTC m=+0.587015437 container attach 007b95443f2f0187b231ebb2eee665b3f1b5d01772a4d7ea8688436b2c7bb040 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-20T22:18:06.628 INFO:journalctl@ceph.osd.4.smithi164.stdout:Apr 20 22:18:06 smithi164 podman[111239]: 2024-04-20 22:18:06.274023716 +0000 UTC m=+0.966021194 container died 007b95443f2f0187b231ebb2eee665b3f1b5d01772a4d7ea8688436b2c7bb040 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5) 2024-04-20T22:18:07.016 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.4.service' 2024-04-20T22:18:07.123 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T22:18:07.124 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-20T22:18:07.124 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-20T22:18:07.124 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.5 2024-04-20T22:18:07.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:06 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:06.878+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:18:07.197 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:06 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:06.878+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6814 osd.1 since back 2024-04-20T22:17:35.468092+0000 front 2024-04-20T22:17:35.468325+0000 (oldest deadline 2024-04-20T22:17:59.567814+0000) 2024-04-20T22:18:07.197 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:06 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:06.878+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6822 osd.2 since back 2024-04-20T22:17:43.570132+0000 front 2024-04-20T22:17:43.569913+0000 (oldest deadline 2024-04-20T22:18:06.469690+0000) 2024-04-20T22:18:07.683 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:07 smithi164 systemd[1]: Stopping Ceph osd.5 for 270cccba-ff5f-11ee-bc93-c7b262605968... 2024-04-20T22:18:07.683 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:07 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:07.683+0000 7ff03aa00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T22:18:07.683 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:07 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:07.683+0000 7ff03aa00700 -1 osd.5 85 *** Got signal Terminated *** 2024-04-20T22:18:07.683 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:07 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:07.683+0000 7ff03aa00700 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T22:18:07.946 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:07 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:07.921+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:18:07.946 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:07 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:07.921+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6814 osd.1 since back 2024-04-20T22:17:35.468092+0000 front 2024-04-20T22:17:35.468325+0000 (oldest deadline 2024-04-20T22:17:59.567814+0000) 2024-04-20T22:18:07.946 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:07 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:07.921+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6822 osd.2 since back 2024-04-20T22:17:43.570132+0000 front 2024-04-20T22:17:43.569913+0000 (oldest deadline 2024-04-20T22:18:06.469690+0000) 2024-04-20T22:18:09.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:08 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:08.878+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:18:09.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:08 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:08.878+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6814 osd.1 since back 2024-04-20T22:17:35.468092+0000 front 2024-04-20T22:17:35.468325+0000 (oldest deadline 2024-04-20T22:17:59.567814+0000) 2024-04-20T22:18:09.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:08 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:08.878+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6822 osd.2 since back 2024-04-20T22:17:43.570132+0000 front 2024-04-20T22:17:43.569913+0000 (oldest deadline 2024-04-20T22:18:06.469690+0000) 2024-04-20T22:18:10.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:09 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:09.915+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:18:10.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:09 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:09.915+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6814 osd.1 since back 2024-04-20T22:17:35.468092+0000 front 2024-04-20T22:17:35.468325+0000 (oldest deadline 2024-04-20T22:17:59.567814+0000) 2024-04-20T22:18:10.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:09 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:09.915+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6822 osd.2 since back 2024-04-20T22:17:43.570132+0000 front 2024-04-20T22:17:43.569913+0000 (oldest deadline 2024-04-20T22:18:06.469690+0000) 2024-04-20T22:18:11.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:10 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:10.901+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:18:11.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:10 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:10.901+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6814 osd.1 since back 2024-04-20T22:17:35.468092+0000 front 2024-04-20T22:17:35.468325+0000 (oldest deadline 2024-04-20T22:17:59.567814+0000) 2024-04-20T22:18:11.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:10 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:10.901+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6822 osd.2 since back 2024-04-20T22:17:43.570132+0000 front 2024-04-20T22:17:43.569913+0000 (oldest deadline 2024-04-20T22:18:06.469690+0000) 2024-04-20T22:18:12.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:11 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:11.944+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2024-04-20T22:17:23.765510+0000 front 2024-04-20T22:17:23.765624+0000 (oldest deadline 2024-04-20T22:17:48.465634+0000) 2024-04-20T22:18:12.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:11 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:11.944+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6814 osd.1 since back 2024-04-20T22:17:35.468092+0000 front 2024-04-20T22:17:35.468325+0000 (oldest deadline 2024-04-20T22:17:59.567814+0000) 2024-04-20T22:18:12.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:11 smithi164 ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5[89230]: 2024-04-20T22:18:11.944+0000 7ff036200700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.142:6822 osd.2 since back 2024-04-20T22:17:43.570132+0000 front 2024-04-20T22:17:43.569913+0000 (oldest deadline 2024-04-20T22:18:06.469690+0000) 2024-04-20T22:18:13.366 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:13 smithi164 podman[111345]: 2024-04-20 22:18:13.098323966 +0000 UTC m=+5.551681018 container died ac1bdd69c94494161c1f049f8094a9affe13820876f019557fd5a12aae87e00f (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-20T22:18:13.696 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:13 smithi164 podman[111345]: 2024-04-20 22:18:13.534367481 +0000 UTC m=+5.987724549 container cleanup ac1bdd69c94494161c1f049f8094a9affe13820876f019557fd5a12aae87e00f (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-20T22:18:13.697 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:13 smithi164 bash[111345]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5 2024-04-20T22:18:14.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:13 smithi164 podman[111366]: 2024-04-20 22:18:13.785521594 +0000 UTC m=+0.669546992 container remove ac1bdd69c94494161c1f049f8094a9affe13820876f019557fd5a12aae87e00f (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-04-20T22:18:14.856 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:14 smithi164 podman[111459]: 2024-04-20 22:18:14.449938046 +0000 UTC m=+0.037115705 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T22:18:14.856 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:14 smithi164 podman[111459]: 2024-04-20 22:18:14.561250197 +0000 UTC m=+0.148427892 container create aa59fe7b1b500a297d38727f90cd94c83f3d1e4b3c0305d4a4281a955e765619 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-04-20T22:18:15.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:14 smithi164 podman[111459]: 2024-04-20 22:18:14.973233349 +0000 UTC m=+0.560411051 container init aa59fe7b1b500a297d38727f90cd94c83f3d1e4b3c0305d4a4281a955e765619 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T22:18:15.196 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:14 smithi164 podman[111459]: 2024-04-20 22:18:14.984787852 +0000 UTC m=+0.571965517 container start aa59fe7b1b500a297d38727f90cd94c83f3d1e4b3c0305d4a4281a955e765619 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2) 2024-04-20T22:18:15.197 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:15 smithi164 podman[111459]: 2024-04-20 22:18:15.080437426 +0000 UTC m=+0.667615168 container attach aa59fe7b1b500a297d38727f90cd94c83f3d1e4b3c0305d4a4281a955e765619 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-20T22:18:15.696 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:15 smithi164 podman[111459]: 2024-04-20 22:18:15.440512204 +0000 UTC m=+1.027689911 container died aa59fe7b1b500a297d38727f90cd94c83f3d1e4b3c0305d4a4281a955e765619 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-deactivate, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-20T22:18:16.273 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.5.service' 2024-04-20T22:18:16.387 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:16 smithi164 podman[111485]: 2024-04-20 22:18:16.225439269 +0000 UTC m=+0.760494366 container remove aa59fe7b1b500a297d38727f90cd94c83f3d1e4b3c0305d4a4281a955e765619 (image=quay.ceph.io/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-270cccba-ff5f-11ee-bc93-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-20T22:18:16.387 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:16 smithi164 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.5.service: Deactivated successfully. 2024-04-20T22:18:16.387 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:16 smithi164 systemd[1]: Stopped Ceph osd.5 for 270cccba-ff5f-11ee-bc93-c7b262605968. 2024-04-20T22:18:16.387 INFO:journalctl@ceph.osd.5.smithi164.stdout:Apr 20 22:18:16 smithi164 systemd[1]: ceph-270cccba-ff5f-11ee-bc93-c7b262605968@osd.5.service: Consumed 19.659s CPU time. 2024-04-20T22:18:16.422 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T22:18:16.422 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-20T22:18:16.422 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 --force --keep-logs 2024-04-20T22:18:16.698 INFO:teuthology.orchestra.run.smithi142.stdout:Deleting cluster with fsid: 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T22:18:23.662 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi142.stderr:ceph-fuse[63446]: fuse finished with error 0 and tester_r 0 2024-04-20T22:18:45.670 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 --force --keep-logs 2024-04-20T22:18:45.952 INFO:teuthology.orchestra.run.smithi164.stdout:Deleting cluster with fsid: 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T22:19:05.443 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-20T22:19:05.536 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-20T22:19:05.626 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-20T22:19:05.628 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7665444/remote/smithi142/crash 2024-04-20T22:19:05.629 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/crash -- . 2024-04-20T22:19:05.711 INFO:teuthology.orchestra.run.smithi142.stderr:tar: /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-20T22:19:05.711 INFO:teuthology.orchestra.run.smithi142.stderr:tar: Error is not recoverable: exiting now 2024-04-20T22:19:05.715 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7665444/remote/smithi164/crash 2024-04-20T22:19:05.716 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/crash -- . 2024-04-20T22:19:05.802 INFO:teuthology.orchestra.run.smithi164.stderr:tar: /var/lib/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-20T22:19:05.802 INFO:teuthology.orchestra.run.smithi164.stderr:tar: Error is not recoverable: exiting now 2024-04-20T22:19:05.805 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-20T22:19:05.806 DEBUG:teuthology.orchestra.run.smithi142:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-20T22:19:05.910 INFO:tasks.cephadm:Compressing logs... 2024-04-20T22:19:05.910 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-20T22:19:05.914 DEBUG:teuthology.orchestra.run.smithi164:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-20T22:19:05.971 INFO:teuthology.orchestra.run.smithi142.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-20T22:19:05.971 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-04-20T22:19:05.972 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-20T22:19:05.973 INFO:teuthology.orchestra.run.smithi142.stderr:gzip/var/log/ceph/ceph-client.0.log: -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph.log 2024-04-20T22:19:05.974 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mgr.smithi142.zzmcfz.log 2024-04-20T22:19:05.975 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-osd.2.log 2024-04-20T22:19:05.976 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mgr.smithi142.zzmcfz.log: gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mds.cephfs.smithi142.lrvfgg.log 2024-04-20T22:19:05.978 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph.audit.log 2024-04-20T22:19:05.978 INFO:teuthology.orchestra.run.smithi142.stderr: 88.6% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph.log.gz 2024-04-20T22:19:05.979 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mds.cephfs.smithi142.lrvfgg.log: gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mds.cephfs.smithi142.lirkws.log 2024-04-20T22:19:05.981 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-osd.1.log 2024-04-20T22:19:05.983 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mds.cephfs.smithi142.lirkws.log: /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-osd.0.log 2024-04-20T22:19:05.986 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-osd.0.log: 91.5% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph.audit.log.gz 2024-04-20T22:19:05.987 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-client.ceph-exporter.smithi142.log 2024-04-20T22:19:05.990 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mon.smithi142.log 2024-04-20T22:19:05.999 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mon.smithi142.log: /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-client.ceph-exporter.smithi142.log: gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph.cephadm.log 2024-04-20T22:19:05.999 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-volume.log 2024-04-20T22:19:06.000 INFO:teuthology.orchestra.run.smithi164.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-20T22:19:06.000 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-04-20T22:19:06.000 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-20T22:19:06.000 INFO:teuthology.orchestra.run.smithi142.stderr: 94.2% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-client.ceph-exporter.smithi142.log.gz 2024-04-20T22:19:06.001 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.1.log: gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-client.ceph-exporter.smithi164.log 2024-04-20T22:19:06.002 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph.log 2024-04-20T22:19:06.003 INFO:teuthology.orchestra.run.smithi142.stderr: 90.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-20T22:19:06.003 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-client.ceph-exporter.smithi164.log: gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mds.cephfs.smithi164.gmmrfu.log 2024-04-20T22:19:06.004 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph.cephadm.log: /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-volume.log: 85.7% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-20T22:19:06.004 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph.audit.log 2024-04-20T22:19:06.005 INFO:teuthology.orchestra.run.smithi164.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-20T22:19:06.006 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mds.cephfs.smithi164.gmmrfu.log: gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mds.cephfs.smithi164.ybvzha.log 2024-04-20T22:19:06.007 INFO:teuthology.orchestra.run.smithi164.stderr: 94.3% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-client.ceph-exporter.smithi164.log.gz 2024-04-20T22:19:06.007 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph.audit.log: 88.6% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph.log.gz 2024-04-20T22:19:06.008 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-osd.5.log 2024-04-20T22:19:06.009 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-osd.3.log 2024-04-20T22:19:06.011 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mds.cephfs.smithi164.ybvzha.log: /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-osd.4.log 2024-04-20T22:19:06.012 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mgr.smithi164.oejajr.log 2024-04-20T22:19:06.013 INFO:teuthology.orchestra.run.smithi164.stderr: 91.6% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph.audit.log.gz 2024-04-20T22:19:06.013 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph.cephadm.log 2024-04-20T22:19:06.016 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mgr.smithi164.oejajr.log: /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mon.smithi164.log 2024-04-20T22:19:06.020 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mon.smithi164.log: 85.7%gzip -5 --verbose -- /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-volume.log 2024-04-20T22:19:06.020 INFO:teuthology.orchestra.run.smithi164.stderr: -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-20T22:19:06.058 INFO:teuthology.orchestra.run.smithi142.stderr: 90.9% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-volume.log.gz 2024-04-20T22:19:06.080 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-volume.log: 89.2% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mgr.smithi164.oejajr.log.gz 2024-04-20T22:19:06.080 INFO:teuthology.orchestra.run.smithi164.stderr: 90.9% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-volume.log.gz 2024-04-20T22:19:06.457 INFO:teuthology.orchestra.run.smithi142.stderr: 88.5% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mgr.smithi142.zzmcfz.log.gz 2024-04-20T22:19:06.561 INFO:teuthology.orchestra.run.smithi164.stderr: 92.5% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mon.smithi164.log.gz 2024-04-20T22:19:07.458 INFO:teuthology.orchestra.run.smithi142.stderr: 90.3% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mon.smithi142.log.gz 2024-04-20T22:19:10.709 INFO:teuthology.orchestra.run.smithi142.stderr: 93.5% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-osd.2.log.gz 2024-04-20T22:19:12.031 INFO:teuthology.orchestra.run.smithi142.stderr: 93.4% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-osd.1.log.gz 2024-04-20T22:19:12.274 INFO:teuthology.orchestra.run.smithi164.stderr: 93.6% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-osd.5.log.gz 2024-04-20T22:19:12.828 INFO:teuthology.orchestra.run.smithi164.stderr: 93.4% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-osd.4.log.gz 2024-04-20T22:19:13.148 INFO:teuthology.orchestra.run.smithi142.stderr: 93.4% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-osd.0.log.gz 2024-04-20T22:19:13.662 INFO:teuthology.orchestra.run.smithi164.stderr: 93.5% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-osd.3.log.gz 2024-04-20T22:19:13.686 INFO:teuthology.orchestra.run.smithi142.stderr: 94.7% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mds.cephfs.smithi142.lrvfgg.log.gz 2024-04-20T22:19:13.830 INFO:teuthology.orchestra.run.smithi164.stderr: 94.7% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mds.cephfs.smithi164.ybvzha.log.gz 2024-04-20T22:19:14.245 INFO:teuthology.orchestra.run.smithi164.stderr: 94.7% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mds.cephfs.smithi164.gmmrfu.log.gz 2024-04-20T22:19:22.475 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-04-20T22:19:22.475 INFO:teuthology.orchestra.run.smithi164.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-04-20T22:19:22.479 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-20T22:19:22.479 INFO:teuthology.orchestra.run.smithi164.stderr:real 0m16.511s 2024-04-20T22:19:22.479 INFO:teuthology.orchestra.run.smithi164.stderr:user 0m50.445s 2024-04-20T22:19:22.479 INFO:teuthology.orchestra.run.smithi164.stderr:sys 0m3.529s 2024-04-20T22:19:22.595 INFO:teuthology.orchestra.run.smithi142.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-04-20T22:20:40.556 INFO:teuthology.orchestra.run.smithi142.stderr: 93.0% -- replaced with /var/log/ceph/270cccba-ff5f-11ee-bc93-c7b262605968/ceph-mds.cephfs.smithi142.lirkws.log.gz 2024-04-20T22:20:40.560 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-04-20T22:20:40.560 INFO:teuthology.orchestra.run.smithi142.stderr:real 1m34.613s 2024-04-20T22:20:40.560 INFO:teuthology.orchestra.run.smithi142.stderr:user 2m8.851s 2024-04-20T22:20:40.560 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m9.846s 2024-04-20T22:20:40.561 INFO:tasks.cephadm:Archiving logs... 2024-04-20T22:20:40.561 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7665444/remote/smithi142/log 2024-04-20T22:20:40.563 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-20T22:20:59.823 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7665444/remote/smithi164/log 2024-04-20T22:20:59.824 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-20T22:21:06.175 INFO:tasks.cephadm:Removing cluster... 2024-04-20T22:21:06.175 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 --force 2024-04-20T22:21:06.447 INFO:teuthology.orchestra.run.smithi142.stdout:Deleting cluster with fsid: 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T22:21:07.487 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 270cccba-ff5f-11ee-bc93-c7b262605968 --force 2024-04-20T22:21:07.760 INFO:teuthology.orchestra.run.smithi164.stdout:Deleting cluster with fsid: 270cccba-ff5f-11ee-bc93-c7b262605968 2024-04-20T22:21:08.555 INFO:tasks.cephadm:Removing cephadm ... 2024-04-20T22:21:08.556 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-20T22:21:08.618 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-20T22:21:08.675 INFO:tasks.cephadm:Teardown complete 2024-04-20T22:21:08.675 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-20T22:21:08.686 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-20T22:21:08.687 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-20T22:21:08.687 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-20T22:21:08.695 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-20T22:21:08.830 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-20T22:21:08.841 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-20T22:21:08.842 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T22:21:08.849 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T22:21:08.897 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-04-20T22:21:08.904 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-04-20T22:21:08.906 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T22:21:08.906 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-04-20T22:21:08.906 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 28 -733us[ -733us] +/- 91ms 2024-04-20T22:21:08.906 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv02.front.sepia.ceph.com 3 6 377 29 -611us[ -607us] +/- 72ms 2024-04-20T22:21:08.906 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +1385us[+1385us] +/- 83ms 2024-04-20T22:21:08.906 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T22:21:08.913 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T22:21:08.914 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-04-20T22:21:08.914 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 31 -750us[ -749us] +/- 91ms 2024-04-20T22:21:08.914 INFO:teuthology.orchestra.run.smithi164.stdout:^* hv02.front.sepia.ceph.com 3 6 377 28 -622us[ -621us] +/- 72ms 2024-04-20T22:21:08.914 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +1392us[+1392us] +/- 83ms 2024-04-20T22:21:08.914 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T22:21:08.915 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-20T22:21:08.926 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-20T22:21:08.927 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-20T22:21:08.938 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-20T22:21:09.133 DEBUG:teuthology.orchestra.run.smithi164:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-20T22:21:09.295 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-20T22:21:09.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T22:21:09.389 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-20T22:21:09.481 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T22:21:09.481 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-20T22:21:09.493 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-20T22:21:09.513 INFO:teuthology.task.internal:Duration was 2503.973823 seconds 2024-04-20T22:21:09.514 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-20T22:21:09.526 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-20T22:21:09.526 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-20T22:21:09.534 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-20T22:21:09.656 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T22:21:09.666 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T22:21:10.042 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-20T22:21:10.042 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2024-04-20T22:21:10.043 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-20T22:21:10.107 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2024-04-20T22:21:10.107 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-20T22:21:10.187 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-20T22:21:10.187 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-20T22:21:10.192 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-20T22:21:10.275 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-20T22:21:10.275 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-20T22:21:10.280 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-20T22:21:11.051 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-20T22:21:11.064 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-20T22:21:11.064 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-20T22:21:11.143 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-20T22:21:11.225 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-20T22:21:11.238 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-20T22:21:11.245 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-20T22:21:11.333 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2024-04-20T22:21:11.339 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2024-04-20T22:21:11.396 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-20T22:21:11.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T22:21:11.448 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-20T22:21:11.504 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T22:21:11.505 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-20T22:21:11.517 INFO:teuthology.task.internal:Transferring archived files... 2024-04-20T22:21:11.518 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7665444/remote/smithi142 2024-04-20T22:21:11.518 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-20T22:21:11.630 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7665444/remote/smithi164 2024-04-20T22:21:11.630 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-20T22:21:11.730 INFO:teuthology.task.internal:Removing archive directory... 2024-04-20T22:21:11.730 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-20T22:21:11.738 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-20T22:21:11.796 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-20T22:21:11.812 INFO:teuthology.task.internal:Not uploading archives. 2024-04-20T22:21:11.813 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-20T22:21:11.824 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-20T22:21:11.825 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-20T22:21:11.832 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-20T22:21:11.883 INFO:teuthology.orchestra.run.smithi142.stdout: 393229 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 20 22:21 /home/ubuntu/cephtest 2024-04-20T22:21:11.883 INFO:teuthology.orchestra.run.smithi142.stdout: 685488 4 d--------- 2 ubuntu ubuntu 4096 Apr 20 21:55 /home/ubuntu/cephtest/mnt.0 2024-04-20T22:21:11.883 INFO:teuthology.orchestra.run.smithi142.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-04-20T22:21:11.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T22:21:11.885 INFO:teuthology.orchestra.run.smithi142.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-20T22:21:11.886 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-20T22:21:11.887 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-20T22:21:11.900 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-20T22:21:11.914 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-20T22:21:11.914 INFO:teuthology.nuke:Checking targets against current locks 2024-04-20T22:21:11.941 DEBUG:teuthology.nuke:shortname: smithi142 2024-04-20T22:21:11.941 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-20T22:21:11.964 DEBUG:teuthology.nuke:shortname: smithi164 2024-04-20T22:21:11.964 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-20T22:21:11.972 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7665444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-20 21:29:56.346926', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBmEBIoxIXZ4cAqXa/x1kHPZJAP2smKFPLLhRaXmpRd9RxH14vh29+WjYYCMjP8O8pBVnDNC0lqjtZd3eQNLnUs='} 2024-04-20T22:21:11.991 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-20_20:50:37-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7665444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-20 21:29:56.345085', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFzbnjFpY8PUT527bg14rx75k3Cvz58dms2XrL8LHDGy9LfPsu5WcNJeNgpQq+15WK4RWNMjghB+KJeXMvl+Y0g='} 2024-04-20T22:21:12.021 INFO:teuthology.orchestra.console.smithi142:Power off 2024-04-20T22:21:12.021 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-20T22:21:12.040 INFO:teuthology.orchestra.console.smithi164:Power off 2024-04-20T22:21:12.040 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-20T22:21:12.050 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2024-04-20T22:21:12.050 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-20T22:21:12.063 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2024-04-20T22:21:12.063 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-20T22:21:12.073 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-04-20T22:21:12.086 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-04-20T22:21:16.074 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-20T22:21:16.087 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-20T22:21:16.185 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-04-20T22:21:16.196 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-04-20T22:21:20.191 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-20T22:21:20.200 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-20T22:21:20.303 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-04-20T22:21:20.312 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-04-20T22:21:20.404 INFO:teuthology.orchestra.console.smithi142:Power off completed 2024-04-20T22:21:24.314 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-20T22:21:24.423 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-04-20T22:21:24.524 INFO:teuthology.orchestra.console.smithi164:Power off completed 2024-04-20T22:21:24.629 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2503.973822593689 failure_reason: reached maximum tries (51) after waiting for 300 seconds flavor: default host.a-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 host.b-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 owner: scheduled_rishabh@teuthology status: fail success: false 2024-04-20T22:21:24.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-20T22:21:24.868 INFO:teuthology.run:FAIL